2024-06-02T04:26:55.764 INFO:root:teuthology version: 0.0.1.dev296+ge1979f0 2024-06-02T04:26:55.764 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --name teuthology-2024-05-29_22:24:02-fs-reef-distro-default-smithi --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2024-05-29_22:24:02-fs-reef-distro-default-smithi/7733689 --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-workunit/postgres}} -- /home/teuthworker/archive/teuthology-2024-05-29_22:24:02-fs-reef-distro-default-smithi/7733689/orig.config.yaml 2024-06-02T04:26:55.824 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-06-02T04:26:55.919 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-05-29_22:24:02-fs-reef-distro-default-smithi/7733689 branch: reef description: fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-workunit/postgres}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7733689' kernel: kdb: 1 sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: teuthology-2024-05-29_22:24:02-fs-reef-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.6' overrides: admin_socket: branch: reef ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 3 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - slow metadata IO - SLOW_OPS - slow request sha1: 3bb45379356e8aa965152e0b8c663715c5df9bda subvols: create: 2 subvol_options: --size 25000000000 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: mntopts: - context=system_u:object_r:postgresql_db_t:s0 mount_subvol_num: 0 mountpoint: /tmp/cephfs check-counter: counters: mds: - mds.exported - mds.imported install: ceph: flavor: default sha1: 3bb45379356e8aa965152e0b8c663715c5df9bda kclient: client.0: mntopts: - context=system_u:object_r:postgresql_db_t:s0 mount_subvol_num: 1 mountpoint: /tmp/cephfs selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: reef sha1: 111a617aaeda17ec8908c7a46e47c4a09ebf905d owner: scheduled_teuthology@teuthology priority: 930 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 4691 sha1: 3bb45379356e8aa965152e0b8c663715c5df9bda sleep_before_teardown: 0 subset: 327/512 suite: fs suite_branch: reef suite_path: /home/teuthworker/src/git.ceph.com_ceph_111a617aaeda17ec8908c7a46e47c4a09ebf905d/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 111a617aaeda17ec8908c7a46e47c4a09ebf905d syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi076.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNI8z8vKGFSuiq3EmiknRSaLGfvUp7+byUV0TfayX3VPMDMMcn8TazGbJrKZIVabejEzl5v5pD7Is12uKKinMTY= smithi119.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBL1Mln+7VtZ3TQ7B4PRBVqE+4U88FCOEfiNxXm4l7GPrIB5Jct2qh1D+icZlBjoD1YdCsAcw9QM0Os1m+ksHnvA= smithi192.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAcJYBLdblwZjN5Wn4vJ3YVHM3PVauBlCdukUzBTDX0CZ67yxUSxksNZYCTCyNclicAChG4Ymg5os/B1DogKpDA= tasks: - pexec: all: - sudo cp /etc/containers/registries.conf /etc/containers/registries.conf.backup - sudo dnf -y module reset container-tools - sudo dnf -y module install container-tools:rhel8 --allowerasing --nobest - sudo cp /etc/containers/registries.conf.backup /etc/containers/registries.conf - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - ceph-fuse: null - exec: mon.a: - ceph fs set cephfs balance_automate true - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - exec: client.0: - sudo ls -l /tmp/cephfs/ && sudo df -h /tmp/cephfs/ - sudo mkdir -m 755 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres && sudo chown postgres:postgres /tmp/cephfs/postgres - sudo -u postgres -- mkdir -m 700 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres/data - sudo semanage fcontext -a -t postgresql_db_t "/tmp/cephfs/postgres(/.*)?" - sudo grep -i postgresql /etc/selinux/targeted/contexts/files/file_contexts.local - sudo restorecon -R -v /tmp/cephfs/postgres - sudo ls -lZaR /tmp/cephfs/postgres/ - sudo mkdir -p /etc/systemd/system/postgresql.service.d/ && printf '[Service]\nEnvironment=PGDATA=/tmp/cephfs/postgres/data\nEnvironment=PGLOG=/tmp/cephfs/postgres/pgstartup.log\n' | sudo tee /etc/systemd/system/postgresql.service.d/env.conf - sudo -u postgres -- postgresql-setup --initdb - sudo ls -lZaR /tmp/cephfs/postgres/ - sudo systemctl start postgresql - sudo -u postgres -- pgbench -s 32 -i - sudo -u postgres -- pgbench -c 100 -j 4 --progress=5 --time=900 - sudo systemctl stop postgresql - sudo ls -lZaR /tmp/cephfs/postgres/ teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: e1979f064b0becde2020282c7e87cf3c5e98026c timestamp: 2024-05-29_22:24:02 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2698841 2024-06-02T04:26:55.919 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_111a617aaeda17ec8908c7a46e47c4a09ebf905d/qa; will attempt to use it 2024-06-02T04:26:55.920 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_111a617aaeda17ec8908c7a46e47c4a09ebf905d/qa/tasks 2024-06-02T04:26:55.920 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-06-02T04:26:55.922 INFO:teuthology.task.internal:Checking packages... 2024-06-02T04:26:55.943 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '3bb45379356e8aa965152e0b8c663715c5df9bda' 2024-06-02T04:26:55.944 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-06-02T04:26:55.944 INFO:teuthology.packaging:ref: None 2024-06-02T04:26:55.944 INFO:teuthology.packaging:tag: None 2024-06-02T04:26:55.944 INFO:teuthology.packaging:branch: reef 2024-06-02T04:26:55.944 INFO:teuthology.packaging:sha1: 3bb45379356e8aa965152e0b8c663715c5df9bda 2024-06-02T04:26:55.944 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=reef 2024-06-02T04:26:56.266 INFO:teuthology.task.internal:Found packages for ceph version 18.2.2-1387.g71c5cfc9 2024-06-02T04:26:56.268 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-06-02T04:26:56.274 INFO:teuthology.task.internal:no buildpackages task found 2024-06-02T04:26:56.274 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-06-02T04:26:56.294 INFO:teuthology.task.internal:Saving configuration 2024-06-02T04:26:56.324 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-06-02T04:26:56.331 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-06-02T04:26:56.352 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi076.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-05-29_22:24:02-fs-reef-distro-default-smithi/7733689', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-06-02 04:21:30.135585', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNI8z8vKGFSuiq3EmiknRSaLGfvUp7+byUV0TfayX3VPMDMMcn8TazGbJrKZIVabejEzl5v5pD7Is12uKKinMTY='} 2024-06-02T04:26:56.371 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi119.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-05-29_22:24:02-fs-reef-distro-default-smithi/7733689', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-06-02 04:21:30.136976', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBL1Mln+7VtZ3TQ7B4PRBVqE+4U88FCOEfiNxXm4l7GPrIB5Jct2qh1D+icZlBjoD1YdCsAcw9QM0Os1m+ksHnvA='} 2024-06-02T04:26:56.392 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi192.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-05-29_22:24:02-fs-reef-distro-default-smithi/7733689', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-06-02 04:21:30.138103', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAcJYBLdblwZjN5Wn4vJ3YVHM3PVauBlCdukUzBTDX0CZ67yxUSxksNZYCTCyNclicAChG4Ymg5os/B1DogKpDA='} 2024-06-02T04:26:56.392 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-06-02T04:26:56.398 INFO:teuthology.task.internal:roles: ubuntu@smithi076.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-06-02T04:26:56.398 INFO:teuthology.task.internal:roles: ubuntu@smithi119.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-06-02T04:26:56.399 INFO:teuthology.task.internal:roles: ubuntu@smithi192.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-06-02T04:26:56.399 INFO:teuthology.run_tasks:Running task console_log... 2024-06-02T04:26:56.480 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f93ded13be0>, signals=[15]) 2024-06-02T04:26:56.480 INFO:teuthology.run_tasks:Running task internal.connect... 2024-06-02T04:26:56.486 INFO:teuthology.task.internal:Opening connections... 2024-06-02T04:26:56.486 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi076.front.sepia.ceph.com 2024-06-02T04:26:56.487 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-02T04:26:56.585 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi119.front.sepia.ceph.com 2024-06-02T04:26:56.586 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-02T04:26:56.658 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi192.front.sepia.ceph.com 2024-06-02T04:26:56.659 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-02T04:26:56.732 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-06-02T04:26:56.738 DEBUG:teuthology.orchestra.run.smithi076:> uname -m 2024-06-02T04:26:56.759 INFO:teuthology.orchestra.run.smithi076.stdout:x86_64 2024-06-02T04:26:56.759 DEBUG:teuthology.orchestra.run.smithi076:> cat /etc/os-release 2024-06-02T04:26:56.819 INFO:teuthology.orchestra.run.smithi076.stdout:NAME="Red Hat Enterprise Linux" 2024-06-02T04:26:56.819 INFO:teuthology.orchestra.run.smithi076.stdout:VERSION="8.6 (Ootpa)" 2024-06-02T04:26:56.819 INFO:teuthology.orchestra.run.smithi076.stdout:ID="rhel" 2024-06-02T04:26:56.820 INFO:teuthology.orchestra.run.smithi076.stdout:ID_LIKE="fedora" 2024-06-02T04:26:56.820 INFO:teuthology.orchestra.run.smithi076.stdout:VERSION_ID="8.6" 2024-06-02T04:26:56.820 INFO:teuthology.orchestra.run.smithi076.stdout:PLATFORM_ID="platform:el8" 2024-06-02T04:26:56.820 INFO:teuthology.orchestra.run.smithi076.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-06-02T04:26:56.820 INFO:teuthology.orchestra.run.smithi076.stdout:ANSI_COLOR="0;31" 2024-06-02T04:26:56.820 INFO:teuthology.orchestra.run.smithi076.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-06-02T04:26:56.821 INFO:teuthology.orchestra.run.smithi076.stdout:HOME_URL="https://www.redhat.com/" 2024-06-02T04:26:56.821 INFO:teuthology.orchestra.run.smithi076.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-06-02T04:26:56.821 INFO:teuthology.orchestra.run.smithi076.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-06-02T04:26:56.821 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:26:56.821 INFO:teuthology.orchestra.run.smithi076.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-06-02T04:26:56.821 INFO:teuthology.orchestra.run.smithi076.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-06-02T04:26:56.822 INFO:teuthology.orchestra.run.smithi076.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-06-02T04:26:56.822 INFO:teuthology.orchestra.run.smithi076.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-06-02T04:26:56.823 INFO:teuthology.lock.ops:Updating smithi076.front.sepia.ceph.com on lock server 2024-06-02T04:26:56.847 DEBUG:teuthology.orchestra.run.smithi119:> uname -m 2024-06-02T04:26:56.868 INFO:teuthology.orchestra.run.smithi119.stdout:x86_64 2024-06-02T04:26:56.868 DEBUG:teuthology.orchestra.run.smithi119:> cat /etc/os-release 2024-06-02T04:26:56.927 INFO:teuthology.orchestra.run.smithi119.stdout:NAME="Red Hat Enterprise Linux" 2024-06-02T04:26:56.927 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION="8.6 (Ootpa)" 2024-06-02T04:26:56.927 INFO:teuthology.orchestra.run.smithi119.stdout:ID="rhel" 2024-06-02T04:26:56.927 INFO:teuthology.orchestra.run.smithi119.stdout:ID_LIKE="fedora" 2024-06-02T04:26:56.927 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION_ID="8.6" 2024-06-02T04:26:56.928 INFO:teuthology.orchestra.run.smithi119.stdout:PLATFORM_ID="platform:el8" 2024-06-02T04:26:56.928 INFO:teuthology.orchestra.run.smithi119.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-06-02T04:26:56.928 INFO:teuthology.orchestra.run.smithi119.stdout:ANSI_COLOR="0;31" 2024-06-02T04:26:56.928 INFO:teuthology.orchestra.run.smithi119.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-06-02T04:26:56.928 INFO:teuthology.orchestra.run.smithi119.stdout:HOME_URL="https://www.redhat.com/" 2024-06-02T04:26:56.928 INFO:teuthology.orchestra.run.smithi119.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-06-02T04:26:56.928 INFO:teuthology.orchestra.run.smithi119.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-06-02T04:26:56.928 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-06-02T04:26:56.928 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-06-02T04:26:56.928 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-06-02T04:26:56.928 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-06-02T04:26:56.928 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-06-02T04:26:56.929 INFO:teuthology.lock.ops:Updating smithi119.front.sepia.ceph.com on lock server 2024-06-02T04:26:56.946 DEBUG:teuthology.orchestra.run.smithi192:> uname -m 2024-06-02T04:26:56.967 INFO:teuthology.orchestra.run.smithi192.stdout:x86_64 2024-06-02T04:26:56.968 DEBUG:teuthology.orchestra.run.smithi192:> cat /etc/os-release 2024-06-02T04:26:57.027 INFO:teuthology.orchestra.run.smithi192.stdout:NAME="Red Hat Enterprise Linux" 2024-06-02T04:26:57.027 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION="8.6 (Ootpa)" 2024-06-02T04:26:57.027 INFO:teuthology.orchestra.run.smithi192.stdout:ID="rhel" 2024-06-02T04:26:57.027 INFO:teuthology.orchestra.run.smithi192.stdout:ID_LIKE="fedora" 2024-06-02T04:26:57.027 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION_ID="8.6" 2024-06-02T04:26:57.027 INFO:teuthology.orchestra.run.smithi192.stdout:PLATFORM_ID="platform:el8" 2024-06-02T04:26:57.028 INFO:teuthology.orchestra.run.smithi192.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-06-02T04:26:57.028 INFO:teuthology.orchestra.run.smithi192.stdout:ANSI_COLOR="0;31" 2024-06-02T04:26:57.028 INFO:teuthology.orchestra.run.smithi192.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-06-02T04:26:57.028 INFO:teuthology.orchestra.run.smithi192.stdout:HOME_URL="https://www.redhat.com/" 2024-06-02T04:26:57.028 INFO:teuthology.orchestra.run.smithi192.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-06-02T04:26:57.028 INFO:teuthology.orchestra.run.smithi192.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-06-02T04:26:57.028 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-06-02T04:26:57.028 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-06-02T04:26:57.028 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-06-02T04:26:57.028 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-06-02T04:26:57.028 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-06-02T04:26:57.029 INFO:teuthology.lock.ops:Updating smithi192.front.sepia.ceph.com on lock server 2024-06-02T04:26:57.046 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-06-02T04:26:57.057 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-06-02T04:26:57.062 INFO:teuthology.task.internal:Checking for old test directory... 2024-06-02T04:26:57.063 DEBUG:teuthology.orchestra.run.smithi076:> test '!' -e /home/ubuntu/cephtest 2024-06-02T04:26:57.065 DEBUG:teuthology.orchestra.run.smithi119:> test '!' -e /home/ubuntu/cephtest 2024-06-02T04:26:57.067 DEBUG:teuthology.orchestra.run.smithi192:> test '!' -e /home/ubuntu/cephtest 2024-06-02T04:26:57.085 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-06-02T04:26:57.090 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-06-02T04:26:57.091 DEBUG:teuthology.orchestra.run.smithi076:> test -z $(ls -A /var/lib/ceph) 2024-06-02T04:26:57.125 DEBUG:teuthology.orchestra.run.smithi119:> test -z $(ls -A /var/lib/ceph) 2024-06-02T04:26:57.128 DEBUG:teuthology.orchestra.run.smithi192:> test -z $(ls -A /var/lib/ceph) 2024-06-02T04:26:57.163 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-06-02T04:26:57.232 INFO:teuthology.run_tasks:Running task kernel... 2024-06-02T04:26:57.247 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-06-02T04:26:57.247 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}, 'mon.c': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-06-02T04:26:57.247 DEBUG:teuthology.orchestra.run.smithi076:> test -f /run/.containerenv -o -f /.dockerenv 2024-06-02T04:26:57.248 DEBUG:teuthology.orchestra.run.smithi119:> test -f /run/.containerenv -o -f /.dockerenv 2024-06-02T04:26:57.249 DEBUG:teuthology.orchestra.run.smithi192:> test -f /run/.containerenv -o -f /.dockerenv 2024-06-02T04:26:57.267 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-02T04:26:57.268 DEBUG:teuthology.orchestra.run.smithi076:> uname -r 2024-06-02T04:26:57.269 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-02T04:26:57.269 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-02T04:26:57.271 DEBUG:teuthology.orchestra.run.smithi192:> uname -r 2024-06-02T04:26:57.272 DEBUG:teuthology.orchestra.run.smithi119:> uname -r 2024-06-02T04:26:57.328 INFO:teuthology.orchestra.run.smithi076.stdout:4.18.0-513.9.1.el8_9.x86_64 2024-06-02T04:26:57.328 INFO:teuthology.task.kernel:Running kernel on smithi076: 4.18.0-513.9.1.el8_9.x86_64 2024-06-02T04:26:57.328 DEBUG:teuthology.orchestra.run.smithi076:> sudo yum install -y kernel 2024-06-02T04:26:57.331 INFO:teuthology.orchestra.run.smithi192.stdout:4.18.0-513.9.1.el8_9.x86_64 2024-06-02T04:26:57.332 INFO:teuthology.orchestra.run.smithi119.stdout:4.18.0-513.9.1.el8_9.x86_64 2024-06-02T04:26:57.332 INFO:teuthology.task.kernel:Running kernel on smithi192: 4.18.0-513.9.1.el8_9.x86_64 2024-06-02T04:26:57.332 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum install -y kernel 2024-06-02T04:26:57.333 INFO:teuthology.task.kernel:Running kernel on smithi119: 4.18.0-513.9.1.el8_9.x86_64 2024-06-02T04:26:57.333 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum install -y kernel 2024-06-02T04:26:58.862 INFO:teuthology.orchestra.run.smithi192.stdout:Updating Subscription Management repositories. 2024-06-02T04:26:58.862 INFO:teuthology.orchestra.run.smithi192.stdout:Unable to read consumer identity 2024-06-02T04:26:58.889 INFO:teuthology.orchestra.run.smithi119.stdout:Updating Subscription Management repositories. 2024-06-02T04:26:58.890 INFO:teuthology.orchestra.run.smithi119.stdout:Unable to read consumer identity 2024-06-02T04:26:58.925 INFO:teuthology.orchestra.run.smithi076.stdout:Updating Subscription Management repositories. 2024-06-02T04:26:58.925 INFO:teuthology.orchestra.run.smithi076.stdout:Unable to read consumer identity 2024-06-02T04:26:59.170 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-06-02T04:26:59.170 INFO:teuthology.orchestra.run.smithi192.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2024-06-02T04:26:59.170 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-06-02T04:26:59.203 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-06-02T04:26:59.203 INFO:teuthology.orchestra.run.smithi119.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2024-06-02T04:26:59.203 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-06-02T04:26:59.217 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:26:59.217 INFO:teuthology.orchestra.run.smithi076.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2024-06-02T04:26:59.218 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:27:00.984 INFO:teuthology.orchestra.run.smithi119.stdout:Copr repo for python3-asyncssh owned by ceph 18 kB/s | 3.5 kB 00:00 2024-06-02T04:27:01.008 INFO:teuthology.orchestra.run.smithi192.stdout:Copr repo for python3-asyncssh owned by ceph 14 kB/s | 3.5 kB 00:00 2024-06-02T04:27:01.142 INFO:teuthology.orchestra.run.smithi076.stdout:Copr repo for python3-asyncssh owned by ceph 16 kB/s | 3.5 kB 00:00 2024-06-02T04:27:01.516 INFO:teuthology.orchestra.run.smithi192.stdout:Extra Packages for Enterprise Linux 29 MB/s | 14 MB 00:00 2024-06-02T04:27:02.318 INFO:teuthology.orchestra.run.smithi119.stdout:Extra Packages for Enterprise Linux 10 MB/s | 14 MB 00:01 2024-06-02T04:27:02.751 INFO:teuthology.orchestra.run.smithi076.stdout:Extra Packages for Enterprise Linux 8.6 MB/s | 14 MB 00:01 2024-06-02T04:27:05.650 INFO:teuthology.orchestra.run.smithi192.stdout:lab-extras 464 kB/s | 24 kB 00:00 2024-06-02T04:27:06.402 INFO:teuthology.orchestra.run.smithi192.stdout:Package kernel-4.18.0-513.9.1.el8_9.x86_64 is already installed. 2024-06-02T04:27:06.403 INFO:teuthology.orchestra.run.smithi192.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2024-06-02T04:27:06.423 INFO:teuthology.orchestra.run.smithi119.stdout:lab-extras 282 kB/s | 24 kB 00:00 2024-06-02T04:27:06.478 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2024-06-02T04:27:06.479 INFO:teuthology.orchestra.run.smithi192.stdout:Nothing to do. 2024-06-02T04:27:06.479 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2024-06-02T04:27:06.615 DEBUG:teuthology.orchestra.run.smithi192:> echo no | sudo yum reinstall kernel || true 2024-06-02T04:27:06.876 INFO:teuthology.orchestra.run.smithi076.stdout:lab-extras 444 kB/s | 24 kB 00:00 2024-06-02T04:27:06.990 INFO:teuthology.orchestra.run.smithi192.stdout:Updating Subscription Management repositories. 2024-06-02T04:27:06.991 INFO:teuthology.orchestra.run.smithi192.stdout:Unable to read consumer identity 2024-06-02T04:27:07.229 INFO:teuthology.orchestra.run.smithi119.stdout:Package kernel-4.18.0-513.9.1.el8_9.x86_64 is already installed. 2024-06-02T04:27:07.229 INFO:teuthology.orchestra.run.smithi119.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2024-06-02T04:27:07.311 INFO:teuthology.orchestra.run.smithi119.stdout:Dependencies resolved. 2024-06-02T04:27:07.312 INFO:teuthology.orchestra.run.smithi119.stdout:Nothing to do. 2024-06-02T04:27:07.312 INFO:teuthology.orchestra.run.smithi119.stdout:Complete! 2024-06-02T04:27:07.381 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-06-02T04:27:07.382 INFO:teuthology.orchestra.run.smithi192.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2024-06-02T04:27:07.382 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-06-02T04:27:07.427 DEBUG:teuthology.orchestra.run.smithi119:> echo no | sudo yum reinstall kernel || true 2024-06-02T04:27:07.687 INFO:teuthology.orchestra.run.smithi076.stdout:Package kernel-4.18.0-513.9.1.el8_9.x86_64 is already installed. 2024-06-02T04:27:07.687 INFO:teuthology.orchestra.run.smithi076.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2024-06-02T04:27:07.695 INFO:teuthology.orchestra.run.smithi192.stdout:Last metadata expiration check: 0:00:02 ago on Sun 02 Jun 2024 04:27:05 AM UTC. 2024-06-02T04:27:07.759 INFO:teuthology.orchestra.run.smithi119.stdout:Updating Subscription Management repositories. 2024-06-02T04:27:07.760 INFO:teuthology.orchestra.run.smithi119.stdout:Unable to read consumer identity 2024-06-02T04:27:07.765 INFO:teuthology.orchestra.run.smithi076.stdout:Dependencies resolved. 2024-06-02T04:27:07.766 INFO:teuthology.orchestra.run.smithi076.stdout:Nothing to do. 2024-06-02T04:27:07.766 INFO:teuthology.orchestra.run.smithi076.stdout:Complete! 2024-06-02T04:27:07.784 INFO:teuthology.orchestra.run.smithi192.stdout:Installed package kernel-4.18.0-513.9.1.el8_9.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2024-06-02T04:27:07.793 INFO:teuthology.orchestra.run.smithi192.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2024-06-02T04:27:07.838 INFO:teuthology.orchestra.run.smithi192.stderr:Error: No packages marked for reinstall. 2024-06-02T04:27:07.886 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum reinstall -y kernel || true 2024-06-02T04:27:07.939 DEBUG:teuthology.orchestra.run.smithi076:> echo no | sudo yum reinstall kernel || true 2024-06-02T04:27:07.997 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-06-02T04:27:07.997 INFO:teuthology.orchestra.run.smithi119.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2024-06-02T04:27:07.997 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-06-02T04:27:08.261 INFO:teuthology.orchestra.run.smithi192.stdout:Updating Subscription Management repositories. 2024-06-02T04:27:08.262 INFO:teuthology.orchestra.run.smithi192.stdout:Unable to read consumer identity 2024-06-02T04:27:08.276 INFO:teuthology.orchestra.run.smithi076.stdout:Updating Subscription Management repositories. 2024-06-02T04:27:08.276 INFO:teuthology.orchestra.run.smithi076.stdout:Unable to read consumer identity 2024-06-02T04:27:08.310 INFO:teuthology.orchestra.run.smithi119.stdout:Last metadata expiration check: 0:00:02 ago on Sun 02 Jun 2024 04:27:06 AM UTC. 2024-06-02T04:27:08.390 INFO:teuthology.orchestra.run.smithi119.stdout:Installed package kernel-4.18.0-513.9.1.el8_9.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2024-06-02T04:27:08.390 INFO:teuthology.orchestra.run.smithi119.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2024-06-02T04:27:08.439 INFO:teuthology.orchestra.run.smithi119.stderr:Error: No packages marked for reinstall. 2024-06-02T04:27:08.485 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum reinstall -y kernel || true 2024-06-02T04:27:08.500 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:27:08.500 INFO:teuthology.orchestra.run.smithi076.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2024-06-02T04:27:08.500 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:27:08.510 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-06-02T04:27:08.511 INFO:teuthology.orchestra.run.smithi192.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2024-06-02T04:27:08.511 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-06-02T04:27:08.814 INFO:teuthology.orchestra.run.smithi076.stdout:Last metadata expiration check: 0:00:02 ago on Sun 02 Jun 2024 04:27:06 AM UTC. 2024-06-02T04:27:08.817 INFO:teuthology.orchestra.run.smithi119.stdout:Updating Subscription Management repositories. 2024-06-02T04:27:08.818 INFO:teuthology.orchestra.run.smithi119.stdout:Unable to read consumer identity 2024-06-02T04:27:08.819 INFO:teuthology.orchestra.run.smithi192.stdout:Last metadata expiration check: 0:00:03 ago on Sun 02 Jun 2024 04:27:05 AM UTC. 2024-06-02T04:27:08.887 INFO:teuthology.orchestra.run.smithi192.stdout:Installed package kernel-4.18.0-513.9.1.el8_9.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2024-06-02T04:27:08.887 INFO:teuthology.orchestra.run.smithi192.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2024-06-02T04:27:08.900 INFO:teuthology.orchestra.run.smithi076.stdout:Installed package kernel-4.18.0-513.9.1.el8_9.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2024-06-02T04:27:08.903 INFO:teuthology.orchestra.run.smithi076.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2024-06-02T04:27:08.944 INFO:teuthology.orchestra.run.smithi192.stderr:Error: No packages marked for reinstall. 2024-06-02T04:27:08.984 INFO:teuthology.orchestra.run.smithi076.stderr:Error: No packages marked for reinstall. 2024-06-02T04:27:08.991 DEBUG:teuthology.orchestra.run.smithi192:> rpm -q kernel | sort -rV | head -n 1 2024-06-02T04:27:09.005 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-06-02T04:27:09.005 INFO:teuthology.orchestra.run.smithi119.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2024-06-02T04:27:09.005 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-06-02T04:27:09.031 DEBUG:teuthology.orchestra.run.smithi076:> sudo yum reinstall -y kernel || true 2024-06-02T04:27:09.147 INFO:teuthology.orchestra.run.smithi192.stdout:kernel-4.18.0-513.9.1.el8_9.x86_64 2024-06-02T04:27:09.147 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-513.9.1.el8_9.x86_64 2024-06-02T04:27:09.147 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-06-02T04:27:09.147 INFO:teuthology.task.kernel:Enabling kdb on mon.c... 2024-06-02T04:27:09.147 DEBUG:teuthology.orchestra.run.smithi192:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-06-02T04:27:09.183 INFO:teuthology.orchestra.run.smithi192.stdout:ttyS1 2024-06-02T04:27:09.198 DEBUG:teuthology.parallel:result is None 2024-06-02T04:27:09.312 INFO:teuthology.orchestra.run.smithi119.stdout:Last metadata expiration check: 0:00:03 ago on Sun 02 Jun 2024 04:27:06 AM UTC. 2024-06-02T04:27:09.371 INFO:teuthology.orchestra.run.smithi076.stdout:Updating Subscription Management repositories. 2024-06-02T04:27:09.371 INFO:teuthology.orchestra.run.smithi076.stdout:Unable to read consumer identity 2024-06-02T04:27:09.375 INFO:teuthology.orchestra.run.smithi119.stdout:Installed package kernel-4.18.0-513.9.1.el8_9.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2024-06-02T04:27:09.375 INFO:teuthology.orchestra.run.smithi119.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2024-06-02T04:27:09.415 INFO:teuthology.orchestra.run.smithi119.stderr:Error: No packages marked for reinstall. 2024-06-02T04:27:09.462 DEBUG:teuthology.orchestra.run.smithi119:> rpm -q kernel | sort -rV | head -n 1 2024-06-02T04:27:09.624 INFO:teuthology.orchestra.run.smithi119.stdout:kernel-4.18.0-513.9.1.el8_9.x86_64 2024-06-02T04:27:09.624 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-513.9.1.el8_9.x86_64 2024-06-02T04:27:09.624 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-06-02T04:27:09.624 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-06-02T04:27:09.624 DEBUG:teuthology.orchestra.run.smithi119:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-06-02T04:27:09.656 INFO:teuthology.orchestra.run.smithi119.stdout:ttyS1 2024-06-02T04:27:09.661 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:27:09.661 INFO:teuthology.orchestra.run.smithi076.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2024-06-02T04:27:09.661 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:27:09.670 DEBUG:teuthology.parallel:result is None 2024-06-02T04:27:09.967 INFO:teuthology.orchestra.run.smithi076.stdout:Last metadata expiration check: 0:00:03 ago on Sun 02 Jun 2024 04:27:06 AM UTC. 2024-06-02T04:27:10.029 INFO:teuthology.orchestra.run.smithi076.stdout:Installed package kernel-4.18.0-513.9.1.el8_9.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2024-06-02T04:27:10.030 INFO:teuthology.orchestra.run.smithi076.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2024-06-02T04:27:10.076 INFO:teuthology.orchestra.run.smithi076.stderr:Error: No packages marked for reinstall. 2024-06-02T04:27:10.123 DEBUG:teuthology.orchestra.run.smithi076:> rpm -q kernel | sort -rV | head -n 1 2024-06-02T04:27:10.293 INFO:teuthology.orchestra.run.smithi076.stdout:kernel-4.18.0-513.9.1.el8_9.x86_64 2024-06-02T04:27:10.294 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-513.9.1.el8_9.x86_64 2024-06-02T04:27:10.294 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-06-02T04:27:10.294 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-06-02T04:27:10.294 DEBUG:teuthology.orchestra.run.smithi076:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-06-02T04:27:10.329 INFO:teuthology.orchestra.run.smithi076.stdout:ttyS1 2024-06-02T04:27:10.340 DEBUG:teuthology.parallel:result is None 2024-06-02T04:27:10.341 INFO:teuthology.run_tasks:Running task internal.base... 2024-06-02T04:27:10.349 INFO:teuthology.task.internal:Creating test directory... 2024-06-02T04:27:10.349 DEBUG:teuthology.orchestra.run.smithi076:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-06-02T04:27:10.383 DEBUG:teuthology.orchestra.run.smithi119:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-06-02T04:27:10.386 DEBUG:teuthology.orchestra.run.smithi192:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-06-02T04:27:10.406 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-06-02T04:27:10.413 INFO:teuthology.run_tasks:Running task internal.archive... 2024-06-02T04:27:10.422 INFO:teuthology.task.internal:Creating archive directory... 2024-06-02T04:27:10.422 DEBUG:teuthology.orchestra.run.smithi076:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-06-02T04:27:10.440 DEBUG:teuthology.orchestra.run.smithi119:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-06-02T04:27:10.445 DEBUG:teuthology.orchestra.run.smithi192:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-06-02T04:27:10.481 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-06-02T04:27:10.488 INFO:teuthology.task.internal:Enabling coredump saving... 2024-06-02T04:27:10.488 DEBUG:teuthology.orchestra.run.smithi076:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-06-02T04:27:10.510 DEBUG:teuthology.orchestra.run.smithi119:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-06-02T04:27:10.512 DEBUG:teuthology.orchestra.run.smithi192:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-06-02T04:27:10.542 INFO:teuthology.orchestra.run.smithi076.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-06-02T04:27:10.549 INFO:teuthology.orchestra.run.smithi119.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-06-02T04:27:10.553 INFO:teuthology.orchestra.run.smithi076.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-06-02T04:27:10.558 INFO:teuthology.orchestra.run.smithi192.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-06-02T04:27:10.560 INFO:teuthology.orchestra.run.smithi119.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-06-02T04:27:10.570 INFO:teuthology.orchestra.run.smithi192.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-06-02T04:27:10.574 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-06-02T04:27:10.581 INFO:teuthology.task.internal:Configuring sudo... 2024-06-02T04:27:10.582 DEBUG:teuthology.orchestra.run.smithi076:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-06-02T04:27:10.596 DEBUG:teuthology.orchestra.run.smithi119:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-06-02T04:27:10.605 DEBUG:teuthology.orchestra.run.smithi192:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-06-02T04:27:10.644 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-06-02T04:27:10.653 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-06-02T04:27:10.653 DEBUG:teuthology.orchestra.run.smithi076:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-06-02T04:27:10.664 DEBUG:teuthology.orchestra.run.smithi119:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-06-02T04:27:10.675 DEBUG:teuthology.orchestra.run.smithi192:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-06-02T04:27:10.702 DEBUG:teuthology.orchestra.run.smithi076:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-06-02T04:27:10.761 DEBUG:teuthology.orchestra.run.smithi076:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-06-02T04:27:10.810 DEBUG:teuthology.orchestra.run.smithi076:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-06-02T04:27:10.893 DEBUG:teuthology.orchestra.run.smithi076:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-06-02T04:27:10.935 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2024-06-02T04:27:10.935 DEBUG:teuthology.orchestra.run.smithi076:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-06-02T04:27:11.003 DEBUG:teuthology.orchestra.run.smithi119:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-06-02T04:27:11.047 DEBUG:teuthology.orchestra.run.smithi119:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-06-02T04:27:11.112 DEBUG:teuthology.orchestra.run.smithi119:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-06-02T04:27:11.157 DEBUG:teuthology.orchestra.run.smithi119:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-06-02T04:27:11.201 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-06-02T04:27:11.201 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-06-02T04:27:11.269 DEBUG:teuthology.orchestra.run.smithi192:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-06-02T04:27:11.313 DEBUG:teuthology.orchestra.run.smithi192:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-06-02T04:27:11.367 DEBUG:teuthology.orchestra.run.smithi192:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-06-02T04:27:11.453 DEBUG:teuthology.orchestra.run.smithi192:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-06-02T04:27:11.497 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-06-02T04:27:11.497 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-06-02T04:27:11.566 DEBUG:teuthology.orchestra.run.smithi076:> sudo service rsyslog restart 2024-06-02T04:27:11.568 DEBUG:teuthology.orchestra.run.smithi119:> sudo service rsyslog restart 2024-06-02T04:27:11.571 DEBUG:teuthology.orchestra.run.smithi192:> sudo service rsyslog restart 2024-06-02T04:27:11.614 INFO:teuthology.orchestra.run.smithi076.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-06-02T04:27:11.621 INFO:teuthology.orchestra.run.smithi119.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-06-02T04:27:11.653 INFO:teuthology.orchestra.run.smithi192.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-06-02T04:27:11.995 INFO:teuthology.run_tasks:Running task internal.timer... 2024-06-02T04:27:12.006 INFO:teuthology.task.internal:Starting timer... 2024-06-02T04:27:12.006 INFO:teuthology.run_tasks:Running task pcp... 2024-06-02T04:27:12.016 INFO:teuthology.run_tasks:Running task selinux... 2024-06-02T04:27:12.025 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-06-02T04:27:12.025 DEBUG:teuthology.orchestra.run.smithi076:> sudo service auditd rotate 2024-06-02T04:27:12.083 INFO:teuthology.orchestra.run.smithi076.stdout:Rotating logs: 2024-06-02T04:27:12.085 DEBUG:teuthology.orchestra.run.smithi119:> sudo service auditd rotate 2024-06-02T04:27:12.174 INFO:teuthology.orchestra.run.smithi119.stdout:Rotating logs: 2024-06-02T04:27:12.176 DEBUG:teuthology.orchestra.run.smithi192:> sudo service auditd rotate 2024-06-02T04:27:12.230 INFO:teuthology.orchestra.run.smithi192.stdout:Rotating logs: 2024-06-02T04:27:12.231 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-06-02T04:27:12.232 DEBUG:teuthology.orchestra.run.smithi076:> /usr/sbin/getenforce 2024-06-02T04:27:12.268 INFO:teuthology.orchestra.run.smithi076.stdout:Permissive 2024-06-02T04:27:12.268 DEBUG:teuthology.orchestra.run.smithi119:> /usr/sbin/getenforce 2024-06-02T04:27:12.295 INFO:teuthology.orchestra.run.smithi119.stdout:Permissive 2024-06-02T04:27:12.295 DEBUG:teuthology.orchestra.run.smithi192:> /usr/sbin/getenforce 2024-06-02T04:27:12.318 INFO:teuthology.orchestra.run.smithi192.stdout:Permissive 2024-06-02T04:27:12.319 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi076.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi119.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi192.front.sepia.ceph.com': 'permissive'} 2024-06-02T04:27:12.319 DEBUG:teuthology.orchestra.run.smithi076:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-06-02T04:27:12.349 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-02T04:27:12.349 DEBUG:teuthology.orchestra.run.smithi119:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-06-02T04:27:12.376 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-02T04:27:12.376 DEBUG:teuthology.orchestra.run.smithi192:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-06-02T04:27:12.403 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-02T04:27:12.403 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-06-02T04:27:12.403 DEBUG:teuthology.orchestra.run.smithi076:> sudo /usr/sbin/setenforce permissive 2024-06-02T04:27:12.432 DEBUG:teuthology.orchestra.run.smithi119:> sudo /usr/sbin/setenforce permissive 2024-06-02T04:27:12.461 DEBUG:teuthology.orchestra.run.smithi192:> sudo /usr/sbin/setenforce permissive 2024-06-02T04:27:12.488 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-06-02T04:27:12.498 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-06-02T04:27:12.501 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-06-02T04:27:12.627 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-06-02T04:27:12.639 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-06-02T04:27:12.640 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi076.front.sepia.ceph.com,smithi119.front.sepia.ceph.com,smithi192.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-06-02T04:37:40.999 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi076.front.sepia.ceph.com'), Remote(name='ubuntu@smithi119.front.sepia.ceph.com'), Remote(name='ubuntu@smithi192.front.sepia.ceph.com')] 2024-06-02T04:37:41.000 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi076.front.sepia.ceph.com' 2024-06-02T04:37:41.001 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-02T04:37:41.086 DEBUG:teuthology.orchestra.run.smithi076:> true 2024-06-02T04:37:41.106 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi076.front.sepia.ceph.com' 2024-06-02T04:37:41.107 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2024-06-02T04:37:41.107 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-02T04:37:41.181 DEBUG:teuthology.orchestra.run.smithi119:> true 2024-06-02T04:37:41.249 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi119.front.sepia.ceph.com' 2024-06-02T04:37:41.249 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi192.front.sepia.ceph.com' 2024-06-02T04:37:41.250 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-02T04:37:41.327 DEBUG:teuthology.orchestra.run.smithi192:> true 2024-06-02T04:37:41.398 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi192.front.sepia.ceph.com' 2024-06-02T04:37:41.399 INFO:teuthology.run_tasks:Running task clock... 2024-06-02T04:37:41.409 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-06-02T04:37:41.410 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-06-02T04:37:41.410 DEBUG:teuthology.orchestra.run.smithi076:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-06-02T04:37:41.413 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-06-02T04:37:41.413 DEBUG:teuthology.orchestra.run.smithi119:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-06-02T04:37:41.415 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-06-02T04:37:41.415 DEBUG:teuthology.orchestra.run.smithi192:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-06-02T04:37:41.444 INFO:teuthology.orchestra.run.smithi076.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-06-02T04:37:41.446 INFO:teuthology.orchestra.run.smithi119.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-06-02T04:37:41.459 INFO:teuthology.orchestra.run.smithi076.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-06-02T04:37:41.461 INFO:teuthology.orchestra.run.smithi119.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-06-02T04:37:41.472 INFO:teuthology.orchestra.run.smithi192.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-06-02T04:37:41.488 INFO:teuthology.orchestra.run.smithi192.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-06-02T04:37:41.542 INFO:teuthology.orchestra.run.smithi119.stderr:sudo: ntpd: command not found 2024-06-02T04:37:41.545 INFO:teuthology.orchestra.run.smithi076.stderr:sudo: ntpd: command not found 2024-06-02T04:37:41.554 INFO:teuthology.orchestra.run.smithi119.stdout:506 Cannot talk to daemon 2024-06-02T04:37:41.557 INFO:teuthology.orchestra.run.smithi076.stdout:506 Cannot talk to daemon 2024-06-02T04:37:41.564 INFO:teuthology.orchestra.run.smithi192.stderr:sudo: ntpd: command not found 2024-06-02T04:37:41.569 INFO:teuthology.orchestra.run.smithi119.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-06-02T04:37:41.572 INFO:teuthology.orchestra.run.smithi076.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-06-02T04:37:41.576 INFO:teuthology.orchestra.run.smithi192.stdout:506 Cannot talk to daemon 2024-06-02T04:37:41.583 INFO:teuthology.orchestra.run.smithi119.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-06-02T04:37:41.586 INFO:teuthology.orchestra.run.smithi076.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-06-02T04:37:41.591 INFO:teuthology.orchestra.run.smithi192.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-06-02T04:37:41.605 INFO:teuthology.orchestra.run.smithi192.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-06-02T04:37:41.651 INFO:teuthology.orchestra.run.smithi119.stderr:bash: ntpq: command not found 2024-06-02T04:37:41.654 INFO:teuthology.orchestra.run.smithi119.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-06-02T04:37:41.654 INFO:teuthology.orchestra.run.smithi119.stdout:=============================================================================== 2024-06-02T04:37:41.654 INFO:teuthology.orchestra.run.smithi119.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-02T04:37:41.654 INFO:teuthology.orchestra.run.smithi119.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-02T04:37:41.655 INFO:teuthology.orchestra.run.smithi119.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-02T04:37:41.655 INFO:teuthology.orchestra.run.smithi119.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-02T04:37:41.669 INFO:teuthology.orchestra.run.smithi076.stderr:bash: ntpq: command not found 2024-06-02T04:37:41.673 INFO:teuthology.orchestra.run.smithi076.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-06-02T04:37:41.673 INFO:teuthology.orchestra.run.smithi076.stdout:=============================================================================== 2024-06-02T04:37:41.673 INFO:teuthology.orchestra.run.smithi076.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-02T04:37:41.673 INFO:teuthology.orchestra.run.smithi076.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-02T04:37:41.673 INFO:teuthology.orchestra.run.smithi076.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-02T04:37:41.673 INFO:teuthology.orchestra.run.smithi076.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-02T04:37:41.681 INFO:teuthology.orchestra.run.smithi192.stderr:bash: ntpq: command not found 2024-06-02T04:37:41.685 INFO:teuthology.orchestra.run.smithi192.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-06-02T04:37:41.685 INFO:teuthology.orchestra.run.smithi192.stdout:=============================================================================== 2024-06-02T04:37:41.685 INFO:teuthology.orchestra.run.smithi192.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-02T04:37:41.685 INFO:teuthology.orchestra.run.smithi192.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-02T04:37:41.685 INFO:teuthology.orchestra.run.smithi192.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-02T04:37:41.686 INFO:teuthology.orchestra.run.smithi192.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-02T04:37:41.686 INFO:teuthology.run_tasks:Running task pexec... 2024-06-02T04:37:41.696 INFO:teuthology.task.pexec:Executing custom commands... 2024-06-02T04:37:41.696 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi076.front.sepia.ceph.com 2024-06-02T04:37:41.696 DEBUG:teuthology.orchestra.run.smithi076:> TESTDIR=/home/ubuntu/cephtest bash -s 2024-06-02T04:37:41.697 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi119.front.sepia.ceph.com 2024-06-02T04:37:41.697 DEBUG:teuthology.orchestra.run.smithi119:> TESTDIR=/home/ubuntu/cephtest bash -s 2024-06-02T04:37:41.697 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi192.front.sepia.ceph.com 2024-06-02T04:37:41.697 DEBUG:teuthology.orchestra.run.smithi192:> TESTDIR=/home/ubuntu/cephtest bash -s 2024-06-02T04:37:42.074 INFO:teuthology.orchestra.run.smithi119.stdout:Updating Subscription Management repositories. 2024-06-02T04:37:42.091 INFO:teuthology.orchestra.run.smithi076.stdout:Updating Subscription Management repositories. 2024-06-02T04:37:42.103 INFO:teuthology.orchestra.run.smithi192.stdout:Updating Subscription Management repositories. 2024-06-02T04:37:43.878 INFO:teuthology.orchestra.run.smithi076.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 30 kB/s | 4.5 kB 00:00 2024-06-02T04:37:44.008 INFO:teuthology.orchestra.run.smithi119.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 50 kB/s | 4.5 kB 00:00 2024-06-02T04:37:44.131 INFO:teuthology.orchestra.run.smithi192.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 20 kB/s | 4.1 kB 00:00 2024-06-02T04:37:44.438 INFO:teuthology.orchestra.run.smithi192.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 46 kB/s | 4.5 kB 00:00 2024-06-02T04:37:44.500 INFO:teuthology.orchestra.run.smithi076.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 29 kB/s | 4.1 kB 00:00 2024-06-02T04:37:44.613 INFO:teuthology.orchestra.run.smithi119.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 32 kB/s | 4.1 kB 00:00 2024-06-02T04:37:47.408 INFO:teuthology.orchestra.run.smithi076.stdout:Dependencies resolved. 2024-06-02T04:37:47.409 INFO:teuthology.orchestra.run.smithi076.stdout:================================================================================ 2024-06-02T04:37:47.409 INFO:teuthology.orchestra.run.smithi076.stdout: Package Architecture Version Repository Size 2024-06-02T04:37:47.409 INFO:teuthology.orchestra.run.smithi076.stdout:================================================================================ 2024-06-02T04:37:47.409 INFO:teuthology.orchestra.run.smithi076.stdout:Resetting modules: 2024-06-02T04:37:47.410 INFO:teuthology.orchestra.run.smithi076.stdout: container-tools 2024-06-02T04:37:47.410 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:37:47.410 INFO:teuthology.orchestra.run.smithi076.stdout:Transaction Summary 2024-06-02T04:37:47.410 INFO:teuthology.orchestra.run.smithi076.stdout:================================================================================ 2024-06-02T04:37:47.410 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:37:47.610 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2024-06-02T04:37:47.611 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2024-06-02T04:37:47.611 INFO:teuthology.orchestra.run.smithi192.stdout: Package Architecture Version Repository Size 2024-06-02T04:37:47.611 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2024-06-02T04:37:47.611 INFO:teuthology.orchestra.run.smithi192.stdout:Resetting modules: 2024-06-02T04:37:47.611 INFO:teuthology.orchestra.run.smithi192.stdout: container-tools 2024-06-02T04:37:47.611 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-06-02T04:37:47.611 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction Summary 2024-06-02T04:37:47.611 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2024-06-02T04:37:47.611 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-06-02T04:37:47.715 INFO:teuthology.orchestra.run.smithi119.stdout:Dependencies resolved. 2024-06-02T04:37:47.716 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2024-06-02T04:37:47.716 INFO:teuthology.orchestra.run.smithi119.stdout: Package Architecture Version Repository Size 2024-06-02T04:37:47.716 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2024-06-02T04:37:47.716 INFO:teuthology.orchestra.run.smithi119.stdout:Resetting modules: 2024-06-02T04:37:47.716 INFO:teuthology.orchestra.run.smithi119.stdout: container-tools 2024-06-02T04:37:47.716 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-06-02T04:37:47.716 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction Summary 2024-06-02T04:37:47.716 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2024-06-02T04:37:47.717 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-06-02T04:37:56.347 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2024-06-02T04:37:56.821 INFO:teuthology.orchestra.run.smithi192.stdout:Updating Subscription Management repositories. 2024-06-02T04:37:57.991 INFO:teuthology.orchestra.run.smithi076.stdout:Complete! 2024-06-02T04:37:58.464 INFO:teuthology.orchestra.run.smithi076.stdout:Updating Subscription Management repositories. 2024-06-02T04:37:58.757 INFO:teuthology.orchestra.run.smithi192.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 33 kB/s | 4.1 kB 00:00 2024-06-02T04:37:59.085 INFO:teuthology.orchestra.run.smithi192.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 38 kB/s | 4.5 kB 00:00 2024-06-02T04:37:59.572 INFO:teuthology.orchestra.run.smithi119.stdout:Complete! 2024-06-02T04:38:00.044 INFO:teuthology.orchestra.run.smithi119.stdout:Updating Subscription Management repositories. 2024-06-02T04:38:00.337 INFO:teuthology.orchestra.run.smithi076.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 38 kB/s | 4.5 kB 00:00 2024-06-02T04:38:00.891 INFO:teuthology.orchestra.run.smithi076.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 49 kB/s | 4.1 kB 00:00 2024-06-02T04:38:01.999 INFO:teuthology.orchestra.run.smithi119.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 35 kB/s | 4.5 kB 00:00 2024-06-02T04:38:02.179 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2024-06-02T04:38:02.349 INFO:teuthology.orchestra.run.smithi192.stdout:========================================================================================================== 2024-06-02T04:38:02.349 INFO:teuthology.orchestra.run.smithi192.stdout: Package Arch Version Repository Size 2024-06-02T04:38:02.349 INFO:teuthology.orchestra.run.smithi192.stdout:========================================================================================================== 2024-06-02T04:38:02.349 INFO:teuthology.orchestra.run.smithi192.stdout:Installing group/module packages: 2024-06-02T04:38:02.349 INFO:teuthology.orchestra.run.smithi192.stdout: aardvark-dns x86_64 2:1.7.0-1.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 1.0 M 2024-06-02T04:38:02.349 INFO:teuthology.orchestra.run.smithi192.stdout: buildah x86_64 1:1.31.5-1.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 8.8 M 2024-06-02T04:38:02.349 INFO:teuthology.orchestra.run.smithi192.stdout: cockpit-podman noarch 75-1.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 739 k 2024-06-02T04:38:02.349 INFO:teuthology.orchestra.run.smithi192.stdout: crun x86_64 1.8.7-1.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 239 k 2024-06-02T04:38:02.350 INFO:teuthology.orchestra.run.smithi192.stdout: netavark x86_64 2:1.7.0-2.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 3.7 M 2024-06-02T04:38:02.350 INFO:teuthology.orchestra.run.smithi192.stdout: python3-podman noarch 4.6.0-2.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 154 k 2024-06-02T04:38:02.350 INFO:teuthology.orchestra.run.smithi192.stdout: skopeo x86_64 2:1.13.3-3.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 8.1 M 2024-06-02T04:38:02.350 INFO:teuthology.orchestra.run.smithi192.stdout: toolbox x86_64 0.0.99.4-5.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 2.5 M 2024-06-02T04:38:02.350 INFO:teuthology.orchestra.run.smithi192.stdout: udica noarch 0.2.6-20.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 49 k 2024-06-02T04:38:02.350 INFO:teuthology.orchestra.run.smithi192.stdout:Installing dependencies: 2024-06-02T04:38:02.350 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2024-06-02T04:38:02.350 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2024-06-02T04:38:02.350 INFO:teuthology.orchestra.run.smithi192.stdout: yajl x86_64 2.1.0-12.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2024-06-02T04:38:02.350 INFO:teuthology.orchestra.run.smithi192.stdout:Installing weak dependencies: 2024-06-02T04:38:02.350 INFO:teuthology.orchestra.run.smithi192.stdout: criu-libs x86_64 3.18-4.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 39 k 2024-06-02T04:38:02.350 INFO:teuthology.orchestra.run.smithi192.stdout:Installing module profiles: 2024-06-02T04:38:02.351 INFO:teuthology.orchestra.run.smithi192.stdout: container-tools/common 2024-06-02T04:38:02.351 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-06-02T04:38:02.351 INFO:teuthology.orchestra.run.smithi192.stdout:Enabling module streams: 2024-06-02T04:38:02.351 INFO:teuthology.orchestra.run.smithi192.stdout: container-tools rhel8 2024-06-02T04:38:02.351 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-06-02T04:38:02.351 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction Summary 2024-06-02T04:38:02.351 INFO:teuthology.orchestra.run.smithi192.stdout:========================================================================================================== 2024-06-02T04:38:02.351 INFO:teuthology.orchestra.run.smithi192.stdout:Install 13 Packages 2024-06-02T04:38:02.351 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-06-02T04:38:02.352 INFO:teuthology.orchestra.run.smithi192.stdout:Total download size: 26 M 2024-06-02T04:38:02.352 INFO:teuthology.orchestra.run.smithi192.stdout:Installed size: 87 M 2024-06-02T04:38:02.352 INFO:teuthology.orchestra.run.smithi192.stdout:Downloading Packages: 2024-06-02T04:38:02.566 INFO:teuthology.orchestra.run.smithi192.stdout:(1/13): criu-libs-3.18-4.module+el8.9.0+20326+3 184 kB/s | 39 kB 00:00 2024-06-02T04:38:02.591 INFO:teuthology.orchestra.run.smithi192.stdout:(2/13): python3-pyxdg-0.25-16.el8.noarch.rpm 392 kB/s | 94 kB 00:00 2024-06-02T04:38:02.592 INFO:teuthology.orchestra.run.smithi119.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 33 kB/s | 4.1 kB 00:00 2024-06-02T04:38:02.642 INFO:teuthology.orchestra.run.smithi192.stdout:(3/13): python3-pytoml-0.1.14-5.git7dea353.el8. 86 kB/s | 25 kB 00:00 2024-06-02T04:38:02.734 INFO:teuthology.orchestra.run.smithi192.stdout:(4/13): aardvark-dns-1.7.0-1.module+el8.9.0+216 7.1 MB/s | 1.0 MB 00:00 2024-06-02T04:38:02.809 INFO:teuthology.orchestra.run.smithi192.stdout:(5/13): yajl-2.1.0-12.el8.x86_64.rpm 169 kB/s | 41 kB 00:00 2024-06-02T04:38:02.968 INFO:teuthology.orchestra.run.smithi192.stdout:(6/13): buildah-1.31.5-1.module+el8.9.0+21697+6 27 MB/s | 8.8 MB 00:00 2024-06-02T04:38:02.993 INFO:teuthology.orchestra.run.smithi192.stdout:(7/13): crun-1.8.7-1.module+el8.9.0+21697+6a5e9 1.3 MB/s | 239 kB 00:00 2024-06-02T04:38:03.027 INFO:teuthology.orchestra.run.smithi192.stdout:(8/13): cockpit-podman-75-1.module+el8.9.0+2169 2.5 MB/s | 739 kB 00:00 2024-06-02T04:38:03.094 INFO:teuthology.orchestra.run.smithi192.stdout:(9/13): python3-podman-4.6.0-2.module+el8.9.0+2 1.5 MB/s | 154 kB 00:00 2024-06-02T04:38:03.144 INFO:teuthology.orchestra.run.smithi192.stdout:(10/13): netavark-1.7.0-2.module+el8.9.0+21697+ 21 MB/s | 3.7 MB 00:00 2024-06-02T04:38:03.270 INFO:teuthology.orchestra.run.smithi192.stdout:(11/13): toolbox-0.0.99.4-5.module+el8.9.0+2169 14 MB/s | 2.5 MB 00:00 2024-06-02T04:38:03.295 INFO:teuthology.orchestra.run.smithi192.stdout:(12/13): udica-0.2.6-20.module+el8.9.0+21697+6a 329 kB/s | 49 kB 00:00 2024-06-02T04:38:03.428 INFO:teuthology.orchestra.run.smithi192.stdout:(13/13): skopeo-1.13.3-3.module+el8.9.0+21697+6 20 MB/s | 8.1 MB 00:00 2024-06-02T04:38:03.429 INFO:teuthology.orchestra.run.smithi192.stdout:-------------------------------------------------------------------------------- 2024-06-02T04:38:03.429 INFO:teuthology.orchestra.run.smithi192.stdout:Total 24 MB/s | 26 MB 00:01 2024-06-02T04:38:03.709 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction check 2024-06-02T04:38:03.731 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction check succeeded. 2024-06-02T04:38:03.731 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction test 2024-06-02T04:38:03.950 INFO:teuthology.orchestra.run.smithi076.stdout:Dependencies resolved. 2024-06-02T04:38:03.960 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction test succeeded. 2024-06-02T04:38:03.969 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction 2024-06-02T04:38:04.118 INFO:teuthology.orchestra.run.smithi076.stdout:========================================================================================================== 2024-06-02T04:38:04.119 INFO:teuthology.orchestra.run.smithi076.stdout: Package Arch Version Repository Size 2024-06-02T04:38:04.119 INFO:teuthology.orchestra.run.smithi076.stdout:========================================================================================================== 2024-06-02T04:38:04.119 INFO:teuthology.orchestra.run.smithi076.stdout:Installing group/module packages: 2024-06-02T04:38:04.119 INFO:teuthology.orchestra.run.smithi076.stdout: aardvark-dns x86_64 2:1.7.0-1.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 1.0 M 2024-06-02T04:38:04.119 INFO:teuthology.orchestra.run.smithi076.stdout: buildah x86_64 1:1.31.5-1.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 8.8 M 2024-06-02T04:38:04.119 INFO:teuthology.orchestra.run.smithi076.stdout: cockpit-podman noarch 75-1.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 739 k 2024-06-02T04:38:04.119 INFO:teuthology.orchestra.run.smithi076.stdout: crun x86_64 1.8.7-1.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 239 k 2024-06-02T04:38:04.119 INFO:teuthology.orchestra.run.smithi076.stdout: netavark x86_64 2:1.7.0-2.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 3.7 M 2024-06-02T04:38:04.119 INFO:teuthology.orchestra.run.smithi076.stdout: python3-podman noarch 4.6.0-2.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 154 k 2024-06-02T04:38:04.119 INFO:teuthology.orchestra.run.smithi076.stdout: skopeo x86_64 2:1.13.3-3.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 8.1 M 2024-06-02T04:38:04.120 INFO:teuthology.orchestra.run.smithi076.stdout: toolbox x86_64 0.0.99.4-5.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 2.5 M 2024-06-02T04:38:04.120 INFO:teuthology.orchestra.run.smithi076.stdout: udica noarch 0.2.6-20.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 49 k 2024-06-02T04:38:04.120 INFO:teuthology.orchestra.run.smithi076.stdout:Installing dependencies: 2024-06-02T04:38:04.120 INFO:teuthology.orchestra.run.smithi076.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2024-06-02T04:38:04.120 INFO:teuthology.orchestra.run.smithi076.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2024-06-02T04:38:04.120 INFO:teuthology.orchestra.run.smithi076.stdout: yajl x86_64 2.1.0-12.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2024-06-02T04:38:04.120 INFO:teuthology.orchestra.run.smithi076.stdout:Installing weak dependencies: 2024-06-02T04:38:04.120 INFO:teuthology.orchestra.run.smithi076.stdout: criu-libs x86_64 3.18-4.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 39 k 2024-06-02T04:38:04.120 INFO:teuthology.orchestra.run.smithi076.stdout:Installing module profiles: 2024-06-02T04:38:04.120 INFO:teuthology.orchestra.run.smithi076.stdout: container-tools/common 2024-06-02T04:38:04.121 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:38:04.121 INFO:teuthology.orchestra.run.smithi076.stdout:Enabling module streams: 2024-06-02T04:38:04.121 INFO:teuthology.orchestra.run.smithi076.stdout: container-tools rhel8 2024-06-02T04:38:04.121 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:38:04.121 INFO:teuthology.orchestra.run.smithi076.stdout:Transaction Summary 2024-06-02T04:38:04.121 INFO:teuthology.orchestra.run.smithi076.stdout:========================================================================================================== 2024-06-02T04:38:04.121 INFO:teuthology.orchestra.run.smithi076.stdout:Install 13 Packages 2024-06-02T04:38:04.121 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:38:04.122 INFO:teuthology.orchestra.run.smithi076.stdout:Total download size: 26 M 2024-06-02T04:38:04.122 INFO:teuthology.orchestra.run.smithi076.stdout:Installed size: 87 M 2024-06-02T04:38:04.122 INFO:teuthology.orchestra.run.smithi076.stdout:Downloading Packages: 2024-06-02T04:38:04.258 INFO:teuthology.orchestra.run.smithi076.stdout:(1/13): python3-pytoml-0.1.14-5.git7dea353.el8. 181 kB/s | 25 kB 00:00 2024-06-02T04:38:04.313 INFO:teuthology.orchestra.run.smithi076.stdout:(2/13): criu-libs-3.18-4.module+el8.9.0+20326+3 205 kB/s | 39 kB 00:00 2024-06-02T04:38:04.342 INFO:teuthology.orchestra.run.smithi076.stdout:(3/13): python3-pyxdg-0.25-16.el8.noarch.rpm 425 kB/s | 94 kB 00:00 2024-06-02T04:38:04.368 INFO:teuthology.orchestra.run.smithi076.stdout:(4/13): yajl-2.1.0-12.el8.x86_64.rpm 375 kB/s | 41 kB 00:00 2024-06-02T04:38:04.443 INFO:teuthology.orchestra.run.smithi076.stdout:(5/13): aardvark-dns-1.7.0-1.module+el8.9.0+216 7.8 MB/s | 1.0 MB 00:00 2024-06-02T04:38:04.643 INFO:teuthology.orchestra.run.smithi076.stdout:(6/13): buildah-1.31.5-1.module+el8.9.0+21697+6 29 MB/s | 8.8 MB 00:00 2024-06-02T04:38:04.677 INFO:teuthology.orchestra.run.smithi076.stdout:(7/13): cockpit-podman-75-1.module+el8.9.0+2169 2.3 MB/s | 739 kB 00:00 2024-06-02T04:38:04.702 INFO:teuthology.orchestra.run.smithi076.stdout:(8/13): crun-1.8.7-1.module+el8.9.0+21697+6a5e9 924 kB/s | 239 kB 00:00 2024-06-02T04:38:04.720 INFO:teuthology.orchestra.run.smithi192.stdout: Preparing : 1/1 2024-06-02T04:38:04.786 INFO:teuthology.orchestra.run.smithi076.stdout:(9/13): python3-podman-4.6.0-2.module+el8.9.0+2 1.4 MB/s | 154 kB 00:00 2024-06-02T04:38:04.894 INFO:teuthology.orchestra.run.smithi076.stdout:(10/13): netavark-1.7.0-2.module+el8.9.0+21697+ 15 MB/s | 3.7 MB 00:00 2024-06-02T04:38:04.995 INFO:teuthology.orchestra.run.smithi076.stdout:(11/13): toolbox-0.0.99.4-5.module+el8.9.0+2169 12 MB/s | 2.5 MB 00:00 2024-06-02T04:38:05.037 INFO:teuthology.orchestra.run.smithi076.stdout:(12/13): udica-0.2.6-20.module+el8.9.0+21697+6a 348 kB/s | 49 kB 00:00 2024-06-02T04:38:05.170 INFO:teuthology.orchestra.run.smithi076.stdout:(13/13): skopeo-1.13.3-3.module+el8.9.0+21697+6 17 MB/s | 8.1 MB 00:00 2024-06-02T04:38:05.170 INFO:teuthology.orchestra.run.smithi076.stdout:-------------------------------------------------------------------------------- 2024-06-02T04:38:05.171 INFO:teuthology.orchestra.run.smithi076.stdout:Total 24 MB/s | 26 MB 00:01 2024-06-02T04:38:05.242 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : aardvark-dns-2:1.7.0-1.module+el8.9.0+21697+6a5e98 1/13 2024-06-02T04:38:05.404 INFO:teuthology.orchestra.run.smithi119.stdout:Dependencies resolved. 2024-06-02T04:38:05.449 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : netavark-2:1.7.0-2.module+el8.9.0+21697+6a5e98e7.x 2/13 2024-06-02T04:38:05.452 INFO:teuthology.orchestra.run.smithi076.stdout:Running transaction check 2024-06-02T04:38:05.473 INFO:teuthology.orchestra.run.smithi076.stdout:Transaction check succeeded. 2024-06-02T04:38:05.473 INFO:teuthology.orchestra.run.smithi076.stdout:Running transaction test 2024-06-02T04:38:05.569 INFO:teuthology.orchestra.run.smithi119.stdout:========================================================================================================== 2024-06-02T04:38:05.569 INFO:teuthology.orchestra.run.smithi119.stdout: Package Arch Version Repository Size 2024-06-02T04:38:05.570 INFO:teuthology.orchestra.run.smithi119.stdout:========================================================================================================== 2024-06-02T04:38:05.570 INFO:teuthology.orchestra.run.smithi119.stdout:Installing group/module packages: 2024-06-02T04:38:05.570 INFO:teuthology.orchestra.run.smithi119.stdout: aardvark-dns x86_64 2:1.7.0-1.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 1.0 M 2024-06-02T04:38:05.570 INFO:teuthology.orchestra.run.smithi119.stdout: buildah x86_64 1:1.31.5-1.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 8.8 M 2024-06-02T04:38:05.570 INFO:teuthology.orchestra.run.smithi119.stdout: cockpit-podman noarch 75-1.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 739 k 2024-06-02T04:38:05.570 INFO:teuthology.orchestra.run.smithi119.stdout: crun x86_64 1.8.7-1.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 239 k 2024-06-02T04:38:05.570 INFO:teuthology.orchestra.run.smithi119.stdout: netavark x86_64 2:1.7.0-2.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 3.7 M 2024-06-02T04:38:05.570 INFO:teuthology.orchestra.run.smithi119.stdout: python3-podman noarch 4.6.0-2.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 154 k 2024-06-02T04:38:05.570 INFO:teuthology.orchestra.run.smithi119.stdout: skopeo x86_64 2:1.13.3-3.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 8.1 M 2024-06-02T04:38:05.570 INFO:teuthology.orchestra.run.smithi119.stdout: toolbox x86_64 0.0.99.4-5.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 2.5 M 2024-06-02T04:38:05.570 INFO:teuthology.orchestra.run.smithi119.stdout: udica noarch 0.2.6-20.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 49 k 2024-06-02T04:38:05.570 INFO:teuthology.orchestra.run.smithi119.stdout:Installing dependencies: 2024-06-02T04:38:05.571 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2024-06-02T04:38:05.571 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2024-06-02T04:38:05.571 INFO:teuthology.orchestra.run.smithi119.stdout: yajl x86_64 2.1.0-12.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2024-06-02T04:38:05.571 INFO:teuthology.orchestra.run.smithi119.stdout:Installing weak dependencies: 2024-06-02T04:38:05.571 INFO:teuthology.orchestra.run.smithi119.stdout: criu-libs x86_64 3.18-4.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 39 k 2024-06-02T04:38:05.571 INFO:teuthology.orchestra.run.smithi119.stdout:Installing module profiles: 2024-06-02T04:38:05.571 INFO:teuthology.orchestra.run.smithi119.stdout: container-tools/common 2024-06-02T04:38:05.571 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-06-02T04:38:05.571 INFO:teuthology.orchestra.run.smithi119.stdout:Enabling module streams: 2024-06-02T04:38:05.571 INFO:teuthology.orchestra.run.smithi119.stdout: container-tools rhel8 2024-06-02T04:38:05.571 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-06-02T04:38:05.571 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction Summary 2024-06-02T04:38:05.571 INFO:teuthology.orchestra.run.smithi119.stdout:========================================================================================================== 2024-06-02T04:38:05.572 INFO:teuthology.orchestra.run.smithi119.stdout:Install 13 Packages 2024-06-02T04:38:05.572 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-06-02T04:38:05.572 INFO:teuthology.orchestra.run.smithi119.stdout:Total download size: 26 M 2024-06-02T04:38:05.572 INFO:teuthology.orchestra.run.smithi119.stdout:Installed size: 87 M 2024-06-02T04:38:05.572 INFO:teuthology.orchestra.run.smithi119.stdout:Downloading Packages: 2024-06-02T04:38:05.590 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : yajl-2.1.0-12.el8.x86_64 3/13 2024-06-02T04:38:05.702 INFO:teuthology.orchestra.run.smithi076.stdout:Transaction test succeeded. 2024-06-02T04:38:05.712 INFO:teuthology.orchestra.run.smithi076.stdout:Running transaction 2024-06-02T04:38:05.750 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : criu-libs-3.18-4.module+el8.9.0+20326+387084d0.x86 4/13 2024-06-02T04:38:05.768 INFO:teuthology.orchestra.run.smithi119.stdout:(1/13): python3-pytoml-0.1.14-5.git7dea353.el8. 127 kB/s | 25 kB 00:00 2024-06-02T04:38:05.793 INFO:teuthology.orchestra.run.smithi119.stdout:(2/13): criu-libs-3.18-4.module+el8.9.0+20326+3 178 kB/s | 39 kB 00:00 2024-06-02T04:38:05.819 INFO:teuthology.orchestra.run.smithi119.stdout:(3/13): python3-pyxdg-0.25-16.el8.noarch.rpm 381 kB/s | 94 kB 00:00 2024-06-02T04:38:05.902 INFO:teuthology.orchestra.run.smithi119.stdout:(4/13): aardvark-dns-1.7.0-1.module+el8.9.0+216 9.3 MB/s | 1.0 MB 00:00 2024-06-02T04:38:05.962 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 5/13 2024-06-02T04:38:06.019 INFO:teuthology.orchestra.run.smithi119.stdout:(5/13): yajl-2.1.0-12.el8.x86_64.rpm 163 kB/s | 41 kB 00:00 2024-06-02T04:38:06.128 INFO:teuthology.orchestra.run.smithi119.stdout:(6/13): cockpit-podman-75-1.module+el8.9.0+2169 3.2 MB/s | 739 kB 00:00 2024-06-02T04:38:06.161 INFO:teuthology.orchestra.run.smithi119.stdout:(7/13): crun-1.8.7-1.module+el8.9.0+21697+6a5e9 1.6 MB/s | 239 kB 00:00 2024-06-02T04:38:06.179 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 6/13 2024-06-02T04:38:06.322 INFO:teuthology.orchestra.run.smithi119.stdout:(8/13): buildah-1.31.5-1.module+el8.9.0+21697+6 18 MB/s | 8.8 MB 00:00 2024-06-02T04:38:06.337 INFO:teuthology.orchestra.run.smithi119.stdout:(9/13): python3-podman-4.6.0-2.module+el8.9.0+2 875 kB/s | 154 kB 00:00 2024-06-02T04:38:06.412 INFO:teuthology.orchestra.run.smithi119.stdout:(10/13): netavark-1.7.0-2.module+el8.9.0+21697+ 13 MB/s | 3.7 MB 00:00 2024-06-02T04:38:06.415 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-podman-4.6.0-2.module+el8.9.0+21697+6a5e98 7/13 2024-06-02T04:38:06.482 INFO:teuthology.orchestra.run.smithi076.stdout: Preparing : 1/1 2024-06-02T04:38:06.529 INFO:teuthology.orchestra.run.smithi119.stdout:(11/13): toolbox-0.0.99.4-5.module+el8.9.0+2169 13 MB/s | 2.5 MB 00:00 2024-06-02T04:38:06.671 INFO:teuthology.orchestra.run.smithi119.stdout:(12/13): skopeo-1.13.3-3.module+el8.9.0+21697+6 23 MB/s | 8.1 MB 00:00 2024-06-02T04:38:06.696 INFO:teuthology.orchestra.run.smithi119.stdout:(13/13): udica-0.2.6-20.module+el8.9.0+21697+6a 174 kB/s | 49 kB 00:00 2024-06-02T04:38:06.697 INFO:teuthology.orchestra.run.smithi119.stdout:-------------------------------------------------------------------------------- 2024-06-02T04:38:06.697 INFO:teuthology.orchestra.run.smithi119.stdout:Total 23 MB/s | 26 MB 00:01 2024-06-02T04:38:06.973 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : aardvark-dns-2:1.7.0-1.module+el8.9.0+21697+6a5e98 1/13 2024-06-02T04:38:06.979 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction check 2024-06-02T04:38:07.000 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction check succeeded. 2024-06-02T04:38:07.000 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction test 2024-06-02T04:38:07.161 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : netavark-2:1.7.0-2.module+el8.9.0+21697+6a5e98e7.x 2/13 2024-06-02T04:38:07.229 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction test succeeded. 2024-06-02T04:38:07.238 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction 2024-06-02T04:38:07.289 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : crun-1.8.7-1.module+el8.9.0+21697+6a5e98e7.x86_64 8/13 2024-06-02T04:38:07.354 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : yajl-2.1.0-12.el8.x86_64 3/13 2024-06-02T04:38:07.512 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : buildah-1:1.31.5-1.module+el8.9.0+21697+6a5e98e7.x 9/13 2024-06-02T04:38:07.539 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : criu-libs-3.18-4.module+el8.9.0+20326+387084d0.x86 4/13 2024-06-02T04:38:07.709 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 5/13 2024-06-02T04:38:07.917 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : udica-0.2.6-20.module+el8.9.0+21697+6a5e98e7.noarc 10/13 2024-06-02T04:38:07.942 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 6/13 2024-06-02T04:38:07.966 INFO:teuthology.orchestra.run.smithi119.stdout: Preparing : 1/1 2024-06-02T04:38:08.195 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-podman-4.6.0-2.module+el8.9.0+21697+6a5e98 7/13 2024-06-02T04:38:08.471 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : aardvark-dns-2:1.7.0-1.module+el8.9.0+21697+6a5e98 1/13 2024-06-02T04:38:08.672 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : netavark-2:1.7.0-2.module+el8.9.0+21697+6a5e98e7.x 2/13 2024-06-02T04:38:08.825 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : toolbox-0.0.99.4-5.module+el8.9.0+21697+6a5e98e7.x 11/13 2024-06-02T04:38:08.836 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : yajl-2.1.0-12.el8.x86_64 3/13 2024-06-02T04:38:08.997 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : criu-libs-3.18-4.module+el8.9.0+20326+387084d0.x86 4/13 2024-06-02T04:38:09.069 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : skopeo-2:1.13.3-3.module+el8.9.0+21697+6a5e98e7.x8 12/13 2024-06-02T04:38:09.101 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : crun-1.8.7-1.module+el8.9.0+21697+6a5e98e7.x86_64 8/13 2024-06-02T04:38:09.175 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 5/13 2024-06-02T04:38:09.244 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : cockpit-podman-75-1.module+el8.9.0+21697+6a5e98e7. 13/13 2024-06-02T04:38:09.366 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : buildah-1:1.31.5-1.module+el8.9.0+21697+6a5e98e7.x 9/13 2024-06-02T04:38:09.396 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 6/13 2024-06-02T04:38:09.619 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-podman-4.6.0-2.module+el8.9.0+21697+6a5e98 7/13 2024-06-02T04:38:09.672 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: cockpit-podman-75-1.module+el8.9.0+21697+6a5e98e7. 13/13 2024-06-02T04:38:09.673 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/13 2024-06-02T04:38:09.673 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 2/13 2024-06-02T04:38:09.673 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : criu-libs-3.18-4.module+el8.9.0+20326+387084d0.x86 3/13 2024-06-02T04:38:09.673 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : yajl-2.1.0-12.el8.x86_64 4/13 2024-06-02T04:38:09.673 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : aardvark-dns-2:1.7.0-1.module+el8.9.0+21697+6a5e98 5/13 2024-06-02T04:38:09.673 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : buildah-1:1.31.5-1.module+el8.9.0+21697+6a5e98e7.x 6/13 2024-06-02T04:38:09.673 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : cockpit-podman-75-1.module+el8.9.0+21697+6a5e98e7. 7/13 2024-06-02T04:38:09.673 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : crun-1.8.7-1.module+el8.9.0+21697+6a5e98e7.x86_64 8/13 2024-06-02T04:38:09.673 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : netavark-2:1.7.0-2.module+el8.9.0+21697+6a5e98e7.x 9/13 2024-06-02T04:38:09.674 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-podman-4.6.0-2.module+el8.9.0+21697+6a5e98 10/13 2024-06-02T04:38:09.674 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : skopeo-2:1.13.3-3.module+el8.9.0+21697+6a5e98e7.x8 11/13 2024-06-02T04:38:09.674 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : toolbox-0.0.99.4-5.module+el8.9.0+21697+6a5e98e7.x 12/13 2024-06-02T04:38:09.772 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : udica-0.2.6-20.module+el8.9.0+21697+6a5e98e7.noarc 10/13 2024-06-02T04:38:10.495 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : crun-1.8.7-1.module+el8.9.0+21697+6a5e98e7.x86_64 8/13 2024-06-02T04:38:10.688 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : toolbox-0.0.99.4-5.module+el8.9.0+21697+6a5e98e7.x 11/13 2024-06-02T04:38:10.711 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : buildah-1:1.31.5-1.module+el8.9.0+21697+6a5e98e7.x 9/13 2024-06-02T04:38:10.900 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : skopeo-2:1.13.3-3.module+el8.9.0+21697+6a5e98e7.x8 12/13 2024-06-02T04:38:11.069 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : udica-0.2.6-20.module+el8.9.0+21697+6a5e98e7.noarc 10/13 2024-06-02T04:38:11.124 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : cockpit-podman-75-1.module+el8.9.0+21697+6a5e98e7. 13/13 2024-06-02T04:38:11.537 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: cockpit-podman-75-1.module+el8.9.0+21697+6a5e98e7. 13/13 2024-06-02T04:38:11.537 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/13 2024-06-02T04:38:11.537 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 2/13 2024-06-02T04:38:11.537 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : criu-libs-3.18-4.module+el8.9.0+20326+387084d0.x86 3/13 2024-06-02T04:38:11.537 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : yajl-2.1.0-12.el8.x86_64 4/13 2024-06-02T04:38:11.537 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : aardvark-dns-2:1.7.0-1.module+el8.9.0+21697+6a5e98 5/13 2024-06-02T04:38:11.537 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : buildah-1:1.31.5-1.module+el8.9.0+21697+6a5e98e7.x 6/13 2024-06-02T04:38:11.537 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : cockpit-podman-75-1.module+el8.9.0+21697+6a5e98e7. 7/13 2024-06-02T04:38:11.538 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : crun-1.8.7-1.module+el8.9.0+21697+6a5e98e7.x86_64 8/13 2024-06-02T04:38:11.538 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : netavark-2:1.7.0-2.module+el8.9.0+21697+6a5e98e7.x 9/13 2024-06-02T04:38:11.538 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-podman-4.6.0-2.module+el8.9.0+21697+6a5e98 10/13 2024-06-02T04:38:11.538 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : skopeo-2:1.13.3-3.module+el8.9.0+21697+6a5e98e7.x8 11/13 2024-06-02T04:38:11.538 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : toolbox-0.0.99.4-5.module+el8.9.0+21697+6a5e98e7.x 12/13 2024-06-02T04:38:11.936 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : toolbox-0.0.99.4-5.module+el8.9.0+21697+6a5e98e7.x 11/13 2024-06-02T04:38:12.140 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : skopeo-2:1.13.3-3.module+el8.9.0+21697+6a5e98e7.x8 12/13 2024-06-02T04:38:12.323 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : cockpit-podman-75-1.module+el8.9.0+21697+6a5e98e7. 13/13 2024-06-02T04:38:12.727 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: cockpit-podman-75-1.module+el8.9.0+21697+6a5e98e7. 13/13 2024-06-02T04:38:12.727 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/13 2024-06-02T04:38:12.728 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 2/13 2024-06-02T04:38:12.728 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : criu-libs-3.18-4.module+el8.9.0+20326+387084d0.x86 3/13 2024-06-02T04:38:12.728 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : yajl-2.1.0-12.el8.x86_64 4/13 2024-06-02T04:38:12.728 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : aardvark-dns-2:1.7.0-1.module+el8.9.0+21697+6a5e98 5/13 2024-06-02T04:38:12.728 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : buildah-1:1.31.5-1.module+el8.9.0+21697+6a5e98e7.x 6/13 2024-06-02T04:38:12.728 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : cockpit-podman-75-1.module+el8.9.0+21697+6a5e98e7. 7/13 2024-06-02T04:38:12.728 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : crun-1.8.7-1.module+el8.9.0+21697+6a5e98e7.x86_64 8/13 2024-06-02T04:38:12.728 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : netavark-2:1.7.0-2.module+el8.9.0+21697+6a5e98e7.x 9/13 2024-06-02T04:38:12.728 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-podman-4.6.0-2.module+el8.9.0+21697+6a5e98 10/13 2024-06-02T04:38:12.728 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : skopeo-2:1.13.3-3.module+el8.9.0+21697+6a5e98e7.x8 11/13 2024-06-02T04:38:12.728 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : toolbox-0.0.99.4-5.module+el8.9.0+21697+6a5e98e7.x 12/13 2024-06-02T04:38:23.462 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : udica-0.2.6-20.module+el8.9.0+21697+6a5e98e7.noarc 13/13 2024-06-02T04:38:23.462 INFO:teuthology.orchestra.run.smithi192.stdout:Installed products updated. 2024-06-02T04:38:24.023 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-06-02T04:38:24.023 INFO:teuthology.orchestra.run.smithi192.stdout:Installed: 2024-06-02T04:38:24.023 INFO:teuthology.orchestra.run.smithi192.stdout: aardvark-dns-2:1.7.0-1.module+el8.9.0+21697+6a5e98e7.x86_64 2024-06-02T04:38:24.023 INFO:teuthology.orchestra.run.smithi192.stdout: buildah-1:1.31.5-1.module+el8.9.0+21697+6a5e98e7.x86_64 2024-06-02T04:38:24.023 INFO:teuthology.orchestra.run.smithi192.stdout: cockpit-podman-75-1.module+el8.9.0+21697+6a5e98e7.noarch 2024-06-02T04:38:24.023 INFO:teuthology.orchestra.run.smithi192.stdout: criu-libs-3.18-4.module+el8.9.0+20326+387084d0.x86_64 2024-06-02T04:38:24.024 INFO:teuthology.orchestra.run.smithi192.stdout: crun-1.8.7-1.module+el8.9.0+21697+6a5e98e7.x86_64 2024-06-02T04:38:24.024 INFO:teuthology.orchestra.run.smithi192.stdout: netavark-2:1.7.0-2.module+el8.9.0+21697+6a5e98e7.x86_64 2024-06-02T04:38:24.024 INFO:teuthology.orchestra.run.smithi192.stdout: python3-podman-4.6.0-2.module+el8.9.0+21697+6a5e98e7.noarch 2024-06-02T04:38:24.024 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2024-06-02T04:38:24.024 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyxdg-0.25-16.el8.noarch 2024-06-02T04:38:24.024 INFO:teuthology.orchestra.run.smithi192.stdout: skopeo-2:1.13.3-3.module+el8.9.0+21697+6a5e98e7.x86_64 2024-06-02T04:38:24.024 INFO:teuthology.orchestra.run.smithi192.stdout: toolbox-0.0.99.4-5.module+el8.9.0+21697+6a5e98e7.x86_64 2024-06-02T04:38:24.024 INFO:teuthology.orchestra.run.smithi192.stdout: udica-0.2.6-20.module+el8.9.0+21697+6a5e98e7.noarch 2024-06-02T04:38:24.024 INFO:teuthology.orchestra.run.smithi192.stdout: yajl-2.1.0-12.el8.x86_64 2024-06-02T04:38:24.024 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-06-02T04:38:24.024 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2024-06-02T04:38:24.190 DEBUG:teuthology.parallel:result is None 2024-06-02T04:38:26.430 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : udica-0.2.6-20.module+el8.9.0+21697+6a5e98e7.noarc 13/13 2024-06-02T04:38:26.431 INFO:teuthology.orchestra.run.smithi076.stdout:Installed products updated. 2024-06-02T04:38:26.934 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : udica-0.2.6-20.module+el8.9.0+21697+6a5e98e7.noarc 13/13 2024-06-02T04:38:26.934 INFO:teuthology.orchestra.run.smithi119.stdout:Installed products updated. 2024-06-02T04:38:27.022 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:38:27.022 INFO:teuthology.orchestra.run.smithi076.stdout:Installed: 2024-06-02T04:38:27.022 INFO:teuthology.orchestra.run.smithi076.stdout: aardvark-dns-2:1.7.0-1.module+el8.9.0+21697+6a5e98e7.x86_64 2024-06-02T04:38:27.023 INFO:teuthology.orchestra.run.smithi076.stdout: buildah-1:1.31.5-1.module+el8.9.0+21697+6a5e98e7.x86_64 2024-06-02T04:38:27.023 INFO:teuthology.orchestra.run.smithi076.stdout: cockpit-podman-75-1.module+el8.9.0+21697+6a5e98e7.noarch 2024-06-02T04:38:27.023 INFO:teuthology.orchestra.run.smithi076.stdout: criu-libs-3.18-4.module+el8.9.0+20326+387084d0.x86_64 2024-06-02T04:38:27.023 INFO:teuthology.orchestra.run.smithi076.stdout: crun-1.8.7-1.module+el8.9.0+21697+6a5e98e7.x86_64 2024-06-02T04:38:27.023 INFO:teuthology.orchestra.run.smithi076.stdout: netavark-2:1.7.0-2.module+el8.9.0+21697+6a5e98e7.x86_64 2024-06-02T04:38:27.023 INFO:teuthology.orchestra.run.smithi076.stdout: python3-podman-4.6.0-2.module+el8.9.0+21697+6a5e98e7.noarch 2024-06-02T04:38:27.023 INFO:teuthology.orchestra.run.smithi076.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2024-06-02T04:38:27.023 INFO:teuthology.orchestra.run.smithi076.stdout: python3-pyxdg-0.25-16.el8.noarch 2024-06-02T04:38:27.023 INFO:teuthology.orchestra.run.smithi076.stdout: skopeo-2:1.13.3-3.module+el8.9.0+21697+6a5e98e7.x86_64 2024-06-02T04:38:27.023 INFO:teuthology.orchestra.run.smithi076.stdout: toolbox-0.0.99.4-5.module+el8.9.0+21697+6a5e98e7.x86_64 2024-06-02T04:38:27.023 INFO:teuthology.orchestra.run.smithi076.stdout: udica-0.2.6-20.module+el8.9.0+21697+6a5e98e7.noarch 2024-06-02T04:38:27.023 INFO:teuthology.orchestra.run.smithi076.stdout: yajl-2.1.0-12.el8.x86_64 2024-06-02T04:38:27.024 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:38:27.024 INFO:teuthology.orchestra.run.smithi076.stdout:Complete! 2024-06-02T04:38:27.247 DEBUG:teuthology.parallel:result is None 2024-06-02T04:38:27.489 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-06-02T04:38:27.489 INFO:teuthology.orchestra.run.smithi119.stdout:Installed: 2024-06-02T04:38:27.489 INFO:teuthology.orchestra.run.smithi119.stdout: aardvark-dns-2:1.7.0-1.module+el8.9.0+21697+6a5e98e7.x86_64 2024-06-02T04:38:27.490 INFO:teuthology.orchestra.run.smithi119.stdout: buildah-1:1.31.5-1.module+el8.9.0+21697+6a5e98e7.x86_64 2024-06-02T04:38:27.490 INFO:teuthology.orchestra.run.smithi119.stdout: cockpit-podman-75-1.module+el8.9.0+21697+6a5e98e7.noarch 2024-06-02T04:38:27.490 INFO:teuthology.orchestra.run.smithi119.stdout: criu-libs-3.18-4.module+el8.9.0+20326+387084d0.x86_64 2024-06-02T04:38:27.490 INFO:teuthology.orchestra.run.smithi119.stdout: crun-1.8.7-1.module+el8.9.0+21697+6a5e98e7.x86_64 2024-06-02T04:38:27.490 INFO:teuthology.orchestra.run.smithi119.stdout: netavark-2:1.7.0-2.module+el8.9.0+21697+6a5e98e7.x86_64 2024-06-02T04:38:27.490 INFO:teuthology.orchestra.run.smithi119.stdout: python3-podman-4.6.0-2.module+el8.9.0+21697+6a5e98e7.noarch 2024-06-02T04:38:27.490 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2024-06-02T04:38:27.490 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyxdg-0.25-16.el8.noarch 2024-06-02T04:38:27.490 INFO:teuthology.orchestra.run.smithi119.stdout: skopeo-2:1.13.3-3.module+el8.9.0+21697+6a5e98e7.x86_64 2024-06-02T04:38:27.490 INFO:teuthology.orchestra.run.smithi119.stdout: toolbox-0.0.99.4-5.module+el8.9.0+21697+6a5e98e7.x86_64 2024-06-02T04:38:27.490 INFO:teuthology.orchestra.run.smithi119.stdout: udica-0.2.6-20.module+el8.9.0+21697+6a5e98e7.noarch 2024-06-02T04:38:27.491 INFO:teuthology.orchestra.run.smithi119.stdout: yajl-2.1.0-12.el8.x86_64 2024-06-02T04:38:27.491 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-06-02T04:38:27.491 INFO:teuthology.orchestra.run.smithi119.stdout:Complete! 2024-06-02T04:38:27.649 DEBUG:teuthology.parallel:result is None 2024-06-02T04:38:27.650 INFO:teuthology.run_tasks:Running task install... 2024-06-02T04:38:27.660 DEBUG:teuthology.task.install:project ceph 2024-06-02T04:38:27.660 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '3bb45379356e8aa965152e0b8c663715c5df9bda'}} 2024-06-02T04:38:27.661 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '3bb45379356e8aa965152e0b8c663715c5df9bda'} 2024-06-02T04:38:27.661 INFO:teuthology.task.install:Using flavor: default 2024-06-02T04:38:27.667 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-06-02T04:38:27.667 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2024-06-02T04:38:27.667 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3bb45379356e8aa965152e0b8c663715c5df9bda', 'tag': None, 'wait_for_package': False} 2024-06-02T04:38:27.668 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=3bb45379356e8aa965152e0b8c663715c5df9bda 2024-06-02T04:38:27.670 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3bb45379356e8aa965152e0b8c663715c5df9bda', 'tag': None, 'wait_for_package': False} 2024-06-02T04:38:27.670 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=3bb45379356e8aa965152e0b8c663715c5df9bda 2024-06-02T04:38:27.671 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3bb45379356e8aa965152e0b8c663715c5df9bda', 'tag': None, 'wait_for_package': False} 2024-06-02T04:38:27.671 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=3bb45379356e8aa965152e0b8c663715c5df9bda 2024-06-02T04:38:27.816 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/reef/3bb45379356e8aa965152e0b8c663715c5df9bda/centos/8/flavors/default/ 2024-06-02T04:38:27.816 INFO:teuthology.task.install.rpm:Package version is 18.2.2-1381.g3bb45379 2024-06-02T04:38:27.882 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/reef/3bb45379356e8aa965152e0b8c663715c5df9bda/centos/8/flavors/default/ 2024-06-02T04:38:27.882 INFO:teuthology.task.install.rpm:Package version is 18.2.2-1381.g3bb45379 2024-06-02T04:38:27.895 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/reef/3bb45379356e8aa965152e0b8c663715c5df9bda/centos/8/flavors/default/ 2024-06-02T04:38:27.895 INFO:teuthology.task.install.rpm:Package version is 18.2.2-1381.g3bb45379 2024-06-02T04:38:27.992 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/reef/3bb45379356e8aa965152e0b8c663715c5df9bda/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/reef/3bb45379356e8aa965152e0b8c663715c5df9bda/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/reef/3bb45379356e8aa965152e0b8c663715c5df9bda/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-06-02T04:38:27.992 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-06-02T04:38:27.992 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-06-02T04:38:27.997 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/reef/3bb45379356e8aa965152e0b8c663715c5df9bda/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/reef/3bb45379356e8aa965152e0b8c663715c5df9bda/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/reef/3bb45379356e8aa965152e0b8c663715c5df9bda/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-06-02T04:38:27.997 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2024-06-02T04:38:27.997 DEBUG:teuthology.orchestra.run.smithi076:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-06-02T04:38:28.026 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-06-02T04:38:28.026 DEBUG:teuthology.orchestra.run.smithi192:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/3bb45379356e8aa965152e0b8c663715c5df9bda/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-06-02T04:38:28.031 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-06-02T04:38:28.031 DEBUG:teuthology.orchestra.run.smithi076:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/3bb45379356e8aa965152e0b8c663715c5df9bda/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-06-02T04:38:28.069 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/reef/3bb45379356e8aa965152e0b8c663715c5df9bda/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/reef/3bb45379356e8aa965152e0b8c663715c5df9bda/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/reef/3bb45379356e8aa965152e0b8c663715c5df9bda/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-06-02T04:38:28.069 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-06-02T04:38:28.069 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-06-02T04:38:28.098 DEBUG:teuthology.orchestra.run.smithi192:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-06-02T04:38:28.099 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-06-02T04:38:28.099 DEBUG:teuthology.orchestra.run.smithi119:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/3bb45379356e8aa965152e0b8c663715c5df9bda/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-06-02T04:38:28.105 DEBUG:teuthology.orchestra.run.smithi076:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-06-02T04:38:28.169 DEBUG:teuthology.orchestra.run.smithi119:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-06-02T04:38:28.180 DEBUG:teuthology.orchestra.run.smithi192:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-06-02T04:38:28.191 DEBUG:teuthology.orchestra.run.smithi076:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-06-02T04:38:28.221 INFO:teuthology.orchestra.run.smithi076.stdout:check_obsoletes = 1 2024-06-02T04:38:28.223 DEBUG:teuthology.orchestra.run.smithi076:> sudo yum clean all 2024-06-02T04:38:28.247 DEBUG:teuthology.orchestra.run.smithi119:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-06-02T04:38:28.249 INFO:teuthology.orchestra.run.smithi192.stdout:check_obsoletes = 1 2024-06-02T04:38:28.251 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum clean all 2024-06-02T04:38:28.313 INFO:teuthology.orchestra.run.smithi119.stdout:check_obsoletes = 1 2024-06-02T04:38:28.315 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum clean all 2024-06-02T04:38:28.615 INFO:teuthology.orchestra.run.smithi076.stdout:Updating Subscription Management repositories. 2024-06-02T04:38:28.630 INFO:teuthology.orchestra.run.smithi192.stdout:Updating Subscription Management repositories. 2024-06-02T04:38:28.689 INFO:teuthology.orchestra.run.smithi119.stdout:Updating Subscription Management repositories. 2024-06-02T04:38:29.940 INFO:teuthology.orchestra.run.smithi192.stdout:47 files removed 2024-06-02T04:38:29.992 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-06-02T04:38:30.027 INFO:teuthology.orchestra.run.smithi076.stdout:47 files removed 2024-06-02T04:38:30.078 DEBUG:teuthology.orchestra.run.smithi076:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-06-02T04:38:30.166 INFO:teuthology.orchestra.run.smithi119.stdout:47 files removed 2024-06-02T04:38:30.219 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-06-02T04:38:30.328 INFO:teuthology.orchestra.run.smithi192.stdout:Updating Subscription Management repositories. 2024-06-02T04:38:30.415 INFO:teuthology.orchestra.run.smithi076.stdout:Updating Subscription Management repositories. 2024-06-02T04:38:30.558 INFO:teuthology.orchestra.run.smithi119.stdout:Updating Subscription Management repositories. 2024-06-02T04:38:32.691 INFO:teuthology.orchestra.run.smithi076.stdout:ceph packages for x86_64 96 kB/s | 80 kB 00:00 2024-06-02T04:38:32.743 INFO:teuthology.orchestra.run.smithi119.stdout:ceph packages for x86_64 105 kB/s | 80 kB 00:00 2024-06-02T04:38:32.842 INFO:teuthology.orchestra.run.smithi192.stdout:ceph packages for x86_64 90 kB/s | 80 kB 00:00 2024-06-02T04:38:33.358 INFO:teuthology.orchestra.run.smithi076.stdout:ceph noarch packages 18 kB/s | 11 kB 00:00 2024-06-02T04:38:33.435 INFO:teuthology.orchestra.run.smithi119.stdout:ceph noarch packages 17 kB/s | 11 kB 00:00 2024-06-02T04:38:33.576 INFO:teuthology.orchestra.run.smithi192.stdout:ceph noarch packages 16 kB/s | 11 kB 00:00 2024-06-02T04:38:33.825 INFO:teuthology.orchestra.run.smithi076.stdout:ceph source packages 3.4 kB/s | 1.5 kB 00:00 2024-06-02T04:38:33.994 INFO:teuthology.orchestra.run.smithi119.stdout:ceph source packages 2.8 kB/s | 1.5 kB 00:00 2024-06-02T04:38:34.009 INFO:teuthology.orchestra.run.smithi076.stdout:Copr repo for python3-asyncssh owned by ceph 22 kB/s | 3.5 kB 00:00 2024-06-02T04:38:34.153 INFO:teuthology.orchestra.run.smithi119.stdout:Copr repo for python3-asyncssh owned by ceph 26 kB/s | 3.5 kB 00:00 2024-06-02T04:38:34.168 INFO:teuthology.orchestra.run.smithi192.stdout:ceph source packages 2.6 kB/s | 1.5 kB 00:00 2024-06-02T04:38:34.327 INFO:teuthology.orchestra.run.smithi192.stdout:Copr repo for python3-asyncssh owned by ceph 26 kB/s | 3.5 kB 00:00 2024-06-02T04:38:34.502 INFO:teuthology.orchestra.run.smithi076.stdout:Extra Packages for Enterprise Linux 29 MB/s | 14 MB 00:00 2024-06-02T04:38:35.220 INFO:teuthology.orchestra.run.smithi119.stdout:Extra Packages for Enterprise Linux 13 MB/s | 14 MB 00:01 2024-06-02T04:38:35.703 INFO:teuthology.orchestra.run.smithi192.stdout:Extra Packages for Enterprise Linux 10 MB/s | 14 MB 00:01 2024-06-02T04:38:38.535 INFO:teuthology.orchestra.run.smithi076.stdout:lab-extras 410 kB/s | 24 kB 00:00 2024-06-02T04:38:39.278 INFO:teuthology.orchestra.run.smithi119.stdout:lab-extras 423 kB/s | 24 kB 00:00 2024-06-02T04:38:39.822 INFO:teuthology.orchestra.run.smithi076.stdout:Red Hat CodeReady Linux Builder for RHEL 8 x86_ 7.2 MB/s | 8.8 MB 00:01 2024-06-02T04:38:39.828 INFO:teuthology.orchestra.run.smithi192.stdout:lab-extras 265 kB/s | 24 kB 00:00 2024-06-02T04:38:39.880 INFO:teuthology.orchestra.run.smithi119.stdout:Red Hat CodeReady Linux Builder for RHEL 8 x86_ 17 MB/s | 8.8 MB 00:00 2024-06-02T04:38:40.597 INFO:teuthology.orchestra.run.smithi192.stdout:Red Hat CodeReady Linux Builder for RHEL 8 x86_ 13 MB/s | 8.8 MB 00:00 2024-06-02T04:38:42.672 INFO:teuthology.orchestra.run.smithi076.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 46 MB/s | 61 MB 00:01 2024-06-02T04:38:42.699 INFO:teuthology.orchestra.run.smithi119.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 47 MB/s | 61 MB 00:01 2024-06-02T04:38:43.908 INFO:teuthology.orchestra.run.smithi192.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 38 MB/s | 67 MB 00:01 2024-06-02T04:38:54.141 INFO:teuthology.orchestra.run.smithi119.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 52 MB/s | 67 MB 00:01 2024-06-02T04:38:54.398 INFO:teuthology.orchestra.run.smithi076.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 49 MB/s | 67 MB 00:01 2024-06-02T04:38:55.000 INFO:teuthology.orchestra.run.smithi192.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 46 MB/s | 61 MB 00:01 2024-06-02T04:39:09.182 INFO:teuthology.orchestra.run.smithi119.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2024-06-02T04:39:09.183 INFO:teuthology.orchestra.run.smithi119.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2024-06-02T04:39:09.202 INFO:teuthology.orchestra.run.smithi119.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2024-06-02T04:39:09.203 INFO:teuthology.orchestra.run.smithi119.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2024-06-02T04:39:09.204 INFO:teuthology.orchestra.run.smithi119.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2024-06-02T04:39:09.206 INFO:teuthology.orchestra.run.smithi119.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2024-06-02T04:39:09.209 INFO:teuthology.orchestra.run.smithi119.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2024-06-02T04:39:09.213 INFO:teuthology.orchestra.run.smithi119.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2024-06-02T04:39:09.214 INFO:teuthology.orchestra.run.smithi119.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2024-06-02T04:39:09.446 INFO:teuthology.orchestra.run.smithi119.stdout:Dependencies resolved. 2024-06-02T04:39:09.461 INFO:teuthology.orchestra.run.smithi119.stdout:=================================================================================================================================== 2024-06-02T04:39:09.461 INFO:teuthology.orchestra.run.smithi119.stdout: Package Arch Version Repository Size 2024-06-02T04:39:09.461 INFO:teuthology.orchestra.run.smithi119.stdout:=================================================================================================================================== 2024-06-02T04:39:09.461 INFO:teuthology.orchestra.run.smithi119.stdout:Installing: 2024-06-02T04:39:09.461 INFO:teuthology.orchestra.run.smithi119.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-15.el8_9 rhel-8-for-x86_64-baseos-rpms 144 k 2024-06-02T04:39:09.462 INFO:teuthology.orchestra.run.smithi119.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2024-06-02T04:39:09.462 INFO:teuthology.orchestra.run.smithi119.stdout: ceph x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 6.4 k 2024-06-02T04:39:09.462 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-base x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 5.5 M 2024-06-02T04:39:09.462 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-fuse x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 859 k 2024-06-02T04:39:09.462 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-immutable-object-cache x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 166 k 2024-06-02T04:39:09.462 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 1.6 M 2024-06-02T04:39:09.462 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-cephadm noarch 2:18.2.2-1381.g3bb45379.el8 ceph-noarch 138 k 2024-06-02T04:39:09.462 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-dashboard noarch 2:18.2.2-1381.g3bb45379.el8 ceph-noarch 3.5 M 2024-06-02T04:39:09.462 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.2-1381.g3bb45379.el8 ceph-noarch 7.4 M 2024-06-02T04:39:09.462 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-rook noarch 2:18.2.2-1381.g3bb45379.el8 ceph-noarch 49 k 2024-06-02T04:39:09.462 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-radosgw x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 13 M 2024-06-02T04:39:09.463 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-test x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 47 M 2024-06-02T04:39:09.463 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-volume noarch 2:18.2.2-1381.g3bb45379.el8 ceph-noarch 263 k 2024-06-02T04:39:09.463 INFO:teuthology.orchestra.run.smithi119.stdout: cephadm noarch 2:18.2.2-1381.g3bb45379.el8 ceph-noarch 170 k 2024-06-02T04:39:09.463 INFO:teuthology.orchestra.run.smithi119.stdout: cephfs-mirror x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 261 k 2024-06-02T04:39:09.463 INFO:teuthology.orchestra.run.smithi119.stdout: cephfs-top noarch 2:18.2.2-1381.g3bb45379.el8 ceph-noarch 18 k 2024-06-02T04:39:09.463 INFO:teuthology.orchestra.run.smithi119.stdout: elfutils-libelf-devel x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 62 k 2024-06-02T04:39:09.463 INFO:teuthology.orchestra.run.smithi119.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2024-06-02T04:39:09.463 INFO:teuthology.orchestra.run.smithi119.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2024-06-02T04:39:09.463 INFO:teuthology.orchestra.run.smithi119.stdout: libcephfs-devel x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 31 k 2024-06-02T04:39:09.463 INFO:teuthology.orchestra.run.smithi119.stdout: libcephfs2 x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 780 k 2024-06-02T04:39:09.464 INFO:teuthology.orchestra.run.smithi119.stdout: librados-devel x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 139 k 2024-06-02T04:39:09.464 INFO:teuthology.orchestra.run.smithi119.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2024-06-02T04:39:09.464 INFO:teuthology.orchestra.run.smithi119.stdout: libuuid-devel x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 100 k 2024-06-02T04:39:09.464 INFO:teuthology.orchestra.run.smithi119.stdout: openssl-devel x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 2.3 M 2024-06-02T04:39:09.464 INFO:teuthology.orchestra.run.smithi119.stdout: postgresql x86_64 10.23-4.module+el8.9.0+21317+d2c6bf8a rhel-8-for-x86_64-appstream-rpms 1.5 M 2024-06-02T04:39:09.464 INFO:teuthology.orchestra.run.smithi119.stdout: postgresql-contrib x86_64 10.23-4.module+el8.9.0+21317+d2c6bf8a rhel-8-for-x86_64-appstream-rpms 812 k 2024-06-02T04:39:09.464 INFO:teuthology.orchestra.run.smithi119.stdout: postgresql-server x86_64 10.23-4.module+el8.9.0+21317+d2c6bf8a rhel-8-for-x86_64-appstream-rpms 5.1 M 2024-06-02T04:39:09.464 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cephfs x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 196 k 2024-06-02T04:39:09.464 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rados x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 371 k 2024-06-02T04:39:09.464 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rbd x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 365 k 2024-06-02T04:39:09.464 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rgw x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 107 k 2024-06-02T04:39:09.464 INFO:teuthology.orchestra.run.smithi119.stdout: rbd-fuse x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 96 k 2024-06-02T04:39:09.464 INFO:teuthology.orchestra.run.smithi119.stdout: rbd-mirror x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 3.5 M 2024-06-02T04:39:09.465 INFO:teuthology.orchestra.run.smithi119.stdout: rbd-nbd x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 181 k 2024-06-02T04:39:09.465 INFO:teuthology.orchestra.run.smithi119.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 73 k 2024-06-02T04:39:09.465 INFO:teuthology.orchestra.run.smithi119.stdout:Upgrading: 2024-06-02T04:39:09.465 INFO:teuthology.orchestra.run.smithi119.stdout: elfutils-libelf x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 232 k 2024-06-02T04:39:09.465 INFO:teuthology.orchestra.run.smithi119.stdout: elfutils-libs x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 303 k 2024-06-02T04:39:09.465 INFO:teuthology.orchestra.run.smithi119.stdout: iproute x86_64 6.2.0-5.el8_9 rhel-8-for-x86_64-baseos-rpms 854 k 2024-06-02T04:39:09.465 INFO:teuthology.orchestra.run.smithi119.stdout: libblkid x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 221 k 2024-06-02T04:39:09.465 INFO:teuthology.orchestra.run.smithi119.stdout: libfdisk x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 254 k 2024-06-02T04:39:09.465 INFO:teuthology.orchestra.run.smithi119.stdout: libmount x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 237 k 2024-06-02T04:39:09.465 INFO:teuthology.orchestra.run.smithi119.stdout: librados2 x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 3.7 M 2024-06-02T04:39:09.465 INFO:teuthology.orchestra.run.smithi119.stdout: librbd1 x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 3.6 M 2024-06-02T04:39:09.465 INFO:teuthology.orchestra.run.smithi119.stdout: libsmartcols x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 180 k 2024-06-02T04:39:09.466 INFO:teuthology.orchestra.run.smithi119.stdout: libuuid x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 99 k 2024-06-02T04:39:09.466 INFO:teuthology.orchestra.run.smithi119.stdout: openssl x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 711 k 2024-06-02T04:39:09.466 INFO:teuthology.orchestra.run.smithi119.stdout: openssl-libs x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 1.5 M 2024-06-02T04:39:09.466 INFO:teuthology.orchestra.run.smithi119.stdout: util-linux x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 2.5 M 2024-06-02T04:39:09.466 INFO:teuthology.orchestra.run.smithi119.stdout: util-linux-user x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 103 k 2024-06-02T04:39:09.466 INFO:teuthology.orchestra.run.smithi119.stdout: xfsdump x86_64 3.1.8-7.el8_9 rhel-8-for-x86_64-baseos-rpms 333 k 2024-06-02T04:39:09.466 INFO:teuthology.orchestra.run.smithi119.stdout: xfsprogs x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 1.1 M 2024-06-02T04:39:09.466 INFO:teuthology.orchestra.run.smithi119.stdout:Installing dependencies: 2024-06-02T04:39:09.466 INFO:teuthology.orchestra.run.smithi119.stdout: automake noarch 1.16.1-8.el8 rhel-8-for-x86_64-appstream-rpms 714 k 2024-06-02T04:39:09.467 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-common x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 22 M 2024-06-02T04:39:09.467 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-grafana-dashboards noarch 2:18.2.2-1381.g3bb45379.el8 ceph-noarch 24 k 2024-06-02T04:39:09.467 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mds x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 2.3 M 2024-06-02T04:39:09.467 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-modules-core noarch 2:18.2.2-1381.g3bb45379.el8 ceph-noarch 246 k 2024-06-02T04:39:09.467 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mon x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 4.8 M 2024-06-02T04:39:09.467 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-osd x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 18 M 2024-06-02T04:39:09.467 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-prometheus-alerts noarch 2:18.2.2-1381.g3bb45379.el8 ceph-noarch 16 k 2024-06-02T04:39:09.467 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-selinux x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 24 k 2024-06-02T04:39:09.467 INFO:teuthology.orchestra.run.smithi119.stdout: fuse x86_64 2.9.7-17.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2024-06-02T04:39:09.467 INFO:teuthology.orchestra.run.smithi119.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-06-02T04:39:09.467 INFO:teuthology.orchestra.run.smithi119.stdout: jq x86_64 1.6-7.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2024-06-02T04:39:09.468 INFO:teuthology.orchestra.run.smithi119.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2024-06-02T04:39:09.468 INFO:teuthology.orchestra.run.smithi119.stdout: krb5-devel x86_64 1.18.2-26.el8_9 rhel-8-for-x86_64-baseos-rpms 562 k 2024-06-02T04:39:09.468 INFO:teuthology.orchestra.run.smithi119.stdout: libcephsqlite x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 142 k 2024-06-02T04:39:09.468 INFO:teuthology.orchestra.run.smithi119.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2024-06-02T04:39:09.468 INFO:teuthology.orchestra.run.smithi119.stdout: libgfortran x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 645 k 2024-06-02T04:39:09.468 INFO:teuthology.orchestra.run.smithi119.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-06-02T04:39:09.468 INFO:teuthology.orchestra.run.smithi119.stdout: libpq x86_64 13.11-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2024-06-02T04:39:09.468 INFO:teuthology.orchestra.run.smithi119.stdout: libquadmath x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 172 k 2024-06-02T04:39:09.468 INFO:teuthology.orchestra.run.smithi119.stdout: librabbitmq x86_64 0.9.0-5.el8_9 rhel-8-for-x86_64-baseos-rpms 47 k 2024-06-02T04:39:09.468 INFO:teuthology.orchestra.run.smithi119.stdout: libradosstriper1 x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 474 k 2024-06-02T04:39:09.468 INFO:teuthology.orchestra.run.smithi119.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2024-06-02T04:39:09.468 INFO:teuthology.orchestra.run.smithi119.stdout: librgw2 x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 6.5 M 2024-06-02T04:39:09.469 INFO:teuthology.orchestra.run.smithi119.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2024-06-02T04:39:09.469 INFO:teuthology.orchestra.run.smithi119.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2024-06-02T04:39:09.469 INFO:teuthology.orchestra.run.smithi119.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-06-02T04:39:09.469 INFO:teuthology.orchestra.run.smithi119.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2024-06-02T04:39:09.469 INFO:teuthology.orchestra.run.smithi119.stdout: libzstd-devel x86_64 1.4.4-1.el8 rhel-8-for-x86_64-baseos-rpms 44 k 2024-06-02T04:39:09.469 INFO:teuthology.orchestra.run.smithi119.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2024-06-02T04:39:09.469 INFO:teuthology.orchestra.run.smithi119.stdout: oniguruma x86_64 6.8.2-2.1.el8_9 rhel-8-for-x86_64-appstream-rpms 188 k 2024-06-02T04:39:09.469 INFO:teuthology.orchestra.run.smithi119.stdout: openblas x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.0 M 2024-06-02T04:39:09.469 INFO:teuthology.orchestra.run.smithi119.stdout: openblas-threads x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.2 M 2024-06-02T04:39:09.469 INFO:teuthology.orchestra.run.smithi119.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2024-06-02T04:39:09.469 INFO:teuthology.orchestra.run.smithi119.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2024-06-02T04:39:09.469 INFO:teuthology.orchestra.run.smithi119.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2024-06-02T04:39:09.470 INFO:teuthology.orchestra.run.smithi119.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2024-06-02T04:39:09.470 INFO:teuthology.orchestra.run.smithi119.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2024-06-02T04:39:09.470 INFO:teuthology.orchestra.run.smithi119.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-06-02T04:39:09.470 INFO:teuthology.orchestra.run.smithi119.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-06-02T04:39:09.470 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2024-06-02T04:39:09.470 INFO:teuthology.orchestra.run.smithi119.stdout: python3-ceph-argparse x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 45 k 2024-06-02T04:39:09.470 INFO:teuthology.orchestra.run.smithi119.stdout: python3-ceph-common x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 129 k 2024-06-02T04:39:09.470 INFO:teuthology.orchestra.run.smithi119.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2024-06-02T04:39:09.470 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cffi x86_64 1.11.5-6.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2024-06-02T04:39:09.470 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-06-02T04:39:09.470 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-06-02T04:39:09.471 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cryptography x86_64 3.2.1-7.el8_9 rhel-8-for-x86_64-baseos-rpms 559 k 2024-06-02T04:39:09.471 INFO:teuthology.orchestra.run.smithi119.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2024-06-02T04:39:09.471 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-06-02T04:39:09.471 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-06-02T04:39:09.471 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2024-06-02T04:39:09.471 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2024-06-02T04:39:09.471 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2024-06-02T04:39:09.471 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2024-06-02T04:39:09.471 INFO:teuthology.orchestra.run.smithi119.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2024-06-02T04:39:09.471 INFO:teuthology.orchestra.run.smithi119.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-06-02T04:39:09.471 INFO:teuthology.orchestra.run.smithi119.stdout: python3-mako noarch 1.0.6-14.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2024-06-02T04:39:09.471 INFO:teuthology.orchestra.run.smithi119.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2024-06-02T04:39:09.471 INFO:teuthology.orchestra.run.smithi119.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-06-02T04:39:09.472 INFO:teuthology.orchestra.run.smithi119.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2024-06-02T04:39:09.472 INFO:teuthology.orchestra.run.smithi119.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2024-06-02T04:39:09.472 INFO:teuthology.orchestra.run.smithi119.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2024-06-02T04:39:09.472 INFO:teuthology.orchestra.run.smithi119.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2024-06-02T04:39:09.472 INFO:teuthology.orchestra.run.smithi119.stdout: python3-packaging noarch 16.8-9.el8 codeready-builder-for-rhel-8-x86_64-rpms 48 k 2024-06-02T04:39:09.472 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-06-02T04:39:09.472 INFO:teuthology.orchestra.run.smithi119.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-06-02T04:39:09.472 INFO:teuthology.orchestra.run.smithi119.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2024-06-02T04:39:09.472 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2024-06-02T04:39:09.472 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2024-06-02T04:39:09.472 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2024-06-02T04:39:09.472 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2024-06-02T04:39:09.473 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pytz noarch 2017.2-11.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2024-06-02T04:39:09.473 INFO:teuthology.orchestra.run.smithi119.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2024-06-02T04:39:09.473 INFO:teuthology.orchestra.run.smithi119.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2024-06-02T04:39:09.473 INFO:teuthology.orchestra.run.smithi119.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2024-06-02T04:39:09.473 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2024-06-02T04:39:09.473 INFO:teuthology.orchestra.run.smithi119.stdout: python3-scipy x86_64 1.0.0-21.module+el8.9.0+20976+d3c38525 rhel-8-for-x86_64-appstream-rpms 14 M 2024-06-02T04:39:09.473 INFO:teuthology.orchestra.run.smithi119.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-06-02T04:39:09.473 INFO:teuthology.orchestra.run.smithi119.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-06-02T04:39:09.473 INFO:teuthology.orchestra.run.smithi119.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-06-02T04:39:09.473 INFO:teuthology.orchestra.run.smithi119.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-06-02T04:39:09.473 INFO:teuthology.orchestra.run.smithi119.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-06-02T04:39:09.473 INFO:teuthology.orchestra.run.smithi119.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-06-02T04:39:09.473 INFO:teuthology.orchestra.run.smithi119.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2024-06-02T04:39:09.474 INFO:teuthology.orchestra.run.smithi119.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-06-02T04:39:09.474 INFO:teuthology.orchestra.run.smithi119.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2024-06-02T04:39:09.474 INFO:teuthology.orchestra.run.smithi119.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-06-02T04:39:09.474 INFO:teuthology.orchestra.run.smithi119.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2024-06-02T04:39:09.474 INFO:teuthology.orchestra.run.smithi119.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2024-06-02T04:39:09.474 INFO:teuthology.orchestra.run.smithi119.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2024-06-02T04:39:09.474 INFO:teuthology.orchestra.run.smithi119.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2024-06-02T04:39:09.474 INFO:teuthology.orchestra.run.smithi119.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2024-06-02T04:39:09.474 INFO:teuthology.orchestra.run.smithi119.stdout:Enabling module streams: 2024-06-02T04:39:09.474 INFO:teuthology.orchestra.run.smithi119.stdout: postgresql 10 2024-06-02T04:39:09.474 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-06-02T04:39:09.475 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction Summary 2024-06-02T04:39:09.475 INFO:teuthology.orchestra.run.smithi119.stdout:=================================================================================================================================== 2024-06-02T04:39:09.475 INFO:teuthology.orchestra.run.smithi119.stdout:Install 130 Packages 2024-06-02T04:39:09.475 INFO:teuthology.orchestra.run.smithi119.stdout:Upgrade 16 Packages 2024-06-02T04:39:09.475 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-06-02T04:39:09.475 INFO:teuthology.orchestra.run.smithi119.stdout:Total download size: 215 M 2024-06-02T04:39:09.475 INFO:teuthology.orchestra.run.smithi119.stdout:Downloading Packages: 2024-06-02T04:39:09.495 INFO:teuthology.orchestra.run.smithi076.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2024-06-02T04:39:09.496 INFO:teuthology.orchestra.run.smithi076.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2024-06-02T04:39:09.515 INFO:teuthology.orchestra.run.smithi076.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2024-06-02T04:39:09.516 INFO:teuthology.orchestra.run.smithi076.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2024-06-02T04:39:09.517 INFO:teuthology.orchestra.run.smithi076.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2024-06-02T04:39:09.519 INFO:teuthology.orchestra.run.smithi076.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2024-06-02T04:39:09.522 INFO:teuthology.orchestra.run.smithi076.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2024-06-02T04:39:09.526 INFO:teuthology.orchestra.run.smithi076.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2024-06-02T04:39:09.528 INFO:teuthology.orchestra.run.smithi076.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2024-06-02T04:39:09.752 INFO:teuthology.orchestra.run.smithi076.stdout:Dependencies resolved. 2024-06-02T04:39:09.766 INFO:teuthology.orchestra.run.smithi076.stdout:=================================================================================================================================== 2024-06-02T04:39:09.767 INFO:teuthology.orchestra.run.smithi076.stdout: Package Arch Version Repository Size 2024-06-02T04:39:09.767 INFO:teuthology.orchestra.run.smithi076.stdout:=================================================================================================================================== 2024-06-02T04:39:09.767 INFO:teuthology.orchestra.run.smithi076.stdout:Installing: 2024-06-02T04:39:09.767 INFO:teuthology.orchestra.run.smithi076.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-15.el8_9 rhel-8-for-x86_64-baseos-rpms 144 k 2024-06-02T04:39:09.767 INFO:teuthology.orchestra.run.smithi076.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2024-06-02T04:39:09.767 INFO:teuthology.orchestra.run.smithi076.stdout: ceph x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 6.4 k 2024-06-02T04:39:09.767 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-base x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 5.5 M 2024-06-02T04:39:09.767 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-fuse x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 859 k 2024-06-02T04:39:09.767 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-immutable-object-cache x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 166 k 2024-06-02T04:39:09.767 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-mgr x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 1.6 M 2024-06-02T04:39:09.767 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-mgr-cephadm noarch 2:18.2.2-1381.g3bb45379.el8 ceph-noarch 138 k 2024-06-02T04:39:09.768 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-mgr-dashboard noarch 2:18.2.2-1381.g3bb45379.el8 ceph-noarch 3.5 M 2024-06-02T04:39:09.768 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.2-1381.g3bb45379.el8 ceph-noarch 7.4 M 2024-06-02T04:39:09.768 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-mgr-rook noarch 2:18.2.2-1381.g3bb45379.el8 ceph-noarch 49 k 2024-06-02T04:39:09.768 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-radosgw x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 13 M 2024-06-02T04:39:09.768 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-test x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 47 M 2024-06-02T04:39:09.768 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-volume noarch 2:18.2.2-1381.g3bb45379.el8 ceph-noarch 263 k 2024-06-02T04:39:09.768 INFO:teuthology.orchestra.run.smithi076.stdout: cephadm noarch 2:18.2.2-1381.g3bb45379.el8 ceph-noarch 170 k 2024-06-02T04:39:09.768 INFO:teuthology.orchestra.run.smithi076.stdout: cephfs-mirror x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 261 k 2024-06-02T04:39:09.768 INFO:teuthology.orchestra.run.smithi076.stdout: cephfs-top noarch 2:18.2.2-1381.g3bb45379.el8 ceph-noarch 18 k 2024-06-02T04:39:09.769 INFO:teuthology.orchestra.run.smithi076.stdout: elfutils-libelf-devel x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 62 k 2024-06-02T04:39:09.769 INFO:teuthology.orchestra.run.smithi076.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2024-06-02T04:39:09.769 INFO:teuthology.orchestra.run.smithi076.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2024-06-02T04:39:09.769 INFO:teuthology.orchestra.run.smithi076.stdout: libcephfs-devel x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 31 k 2024-06-02T04:39:09.769 INFO:teuthology.orchestra.run.smithi076.stdout: libcephfs2 x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 780 k 2024-06-02T04:39:09.769 INFO:teuthology.orchestra.run.smithi076.stdout: librados-devel x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 139 k 2024-06-02T04:39:09.769 INFO:teuthology.orchestra.run.smithi076.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2024-06-02T04:39:09.769 INFO:teuthology.orchestra.run.smithi076.stdout: libuuid-devel x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 100 k 2024-06-02T04:39:09.769 INFO:teuthology.orchestra.run.smithi076.stdout: openssl-devel x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 2.3 M 2024-06-02T04:39:09.769 INFO:teuthology.orchestra.run.smithi076.stdout: postgresql x86_64 10.23-4.module+el8.9.0+21317+d2c6bf8a rhel-8-for-x86_64-appstream-rpms 1.5 M 2024-06-02T04:39:09.769 INFO:teuthology.orchestra.run.smithi076.stdout: postgresql-contrib x86_64 10.23-4.module+el8.9.0+21317+d2c6bf8a rhel-8-for-x86_64-appstream-rpms 812 k 2024-06-02T04:39:09.769 INFO:teuthology.orchestra.run.smithi076.stdout: postgresql-server x86_64 10.23-4.module+el8.9.0+21317+d2c6bf8a rhel-8-for-x86_64-appstream-rpms 5.1 M 2024-06-02T04:39:09.770 INFO:teuthology.orchestra.run.smithi076.stdout: python3-cephfs x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 196 k 2024-06-02T04:39:09.770 INFO:teuthology.orchestra.run.smithi076.stdout: python3-rados x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 371 k 2024-06-02T04:39:09.770 INFO:teuthology.orchestra.run.smithi076.stdout: python3-rbd x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 365 k 2024-06-02T04:39:09.770 INFO:teuthology.orchestra.run.smithi076.stdout: python3-rgw x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 107 k 2024-06-02T04:39:09.770 INFO:teuthology.orchestra.run.smithi076.stdout: rbd-fuse x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 96 k 2024-06-02T04:39:09.770 INFO:teuthology.orchestra.run.smithi076.stdout: rbd-mirror x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 3.5 M 2024-06-02T04:39:09.770 INFO:teuthology.orchestra.run.smithi076.stdout: rbd-nbd x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 181 k 2024-06-02T04:39:09.770 INFO:teuthology.orchestra.run.smithi076.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 73 k 2024-06-02T04:39:09.770 INFO:teuthology.orchestra.run.smithi076.stdout:Upgrading: 2024-06-02T04:39:09.770 INFO:teuthology.orchestra.run.smithi076.stdout: elfutils-libelf x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 232 k 2024-06-02T04:39:09.770 INFO:teuthology.orchestra.run.smithi076.stdout: elfutils-libs x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 303 k 2024-06-02T04:39:09.771 INFO:teuthology.orchestra.run.smithi076.stdout: iproute x86_64 6.2.0-5.el8_9 rhel-8-for-x86_64-baseos-rpms 854 k 2024-06-02T04:39:09.771 INFO:teuthology.orchestra.run.smithi076.stdout: libblkid x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 221 k 2024-06-02T04:39:09.771 INFO:teuthology.orchestra.run.smithi076.stdout: libfdisk x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 254 k 2024-06-02T04:39:09.771 INFO:teuthology.orchestra.run.smithi076.stdout: libmount x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 237 k 2024-06-02T04:39:09.771 INFO:teuthology.orchestra.run.smithi076.stdout: librados2 x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 3.7 M 2024-06-02T04:39:09.771 INFO:teuthology.orchestra.run.smithi076.stdout: librbd1 x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 3.6 M 2024-06-02T04:39:09.771 INFO:teuthology.orchestra.run.smithi076.stdout: libsmartcols x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 180 k 2024-06-02T04:39:09.771 INFO:teuthology.orchestra.run.smithi076.stdout: libuuid x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 99 k 2024-06-02T04:39:09.771 INFO:teuthology.orchestra.run.smithi076.stdout: openssl x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 711 k 2024-06-02T04:39:09.771 INFO:teuthology.orchestra.run.smithi076.stdout: openssl-libs x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 1.5 M 2024-06-02T04:39:09.772 INFO:teuthology.orchestra.run.smithi076.stdout: util-linux x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 2.5 M 2024-06-02T04:39:09.772 INFO:teuthology.orchestra.run.smithi076.stdout: util-linux-user x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 103 k 2024-06-02T04:39:09.772 INFO:teuthology.orchestra.run.smithi076.stdout: xfsdump x86_64 3.1.8-7.el8_9 rhel-8-for-x86_64-baseos-rpms 333 k 2024-06-02T04:39:09.772 INFO:teuthology.orchestra.run.smithi076.stdout: xfsprogs x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 1.1 M 2024-06-02T04:39:09.772 INFO:teuthology.orchestra.run.smithi076.stdout:Installing dependencies: 2024-06-02T04:39:09.772 INFO:teuthology.orchestra.run.smithi076.stdout: automake noarch 1.16.1-8.el8 rhel-8-for-x86_64-appstream-rpms 714 k 2024-06-02T04:39:09.772 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-common x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 22 M 2024-06-02T04:39:09.772 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-grafana-dashboards noarch 2:18.2.2-1381.g3bb45379.el8 ceph-noarch 24 k 2024-06-02T04:39:09.772 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-mds x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 2.3 M 2024-06-02T04:39:09.772 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-mgr-modules-core noarch 2:18.2.2-1381.g3bb45379.el8 ceph-noarch 246 k 2024-06-02T04:39:09.772 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-mon x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 4.8 M 2024-06-02T04:39:09.772 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-osd x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 18 M 2024-06-02T04:39:09.773 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-prometheus-alerts noarch 2:18.2.2-1381.g3bb45379.el8 ceph-noarch 16 k 2024-06-02T04:39:09.773 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-selinux x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 24 k 2024-06-02T04:39:09.773 INFO:teuthology.orchestra.run.smithi076.stdout: fuse x86_64 2.9.7-17.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2024-06-02T04:39:09.773 INFO:teuthology.orchestra.run.smithi076.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-06-02T04:39:09.773 INFO:teuthology.orchestra.run.smithi076.stdout: jq x86_64 1.6-7.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2024-06-02T04:39:09.773 INFO:teuthology.orchestra.run.smithi076.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2024-06-02T04:39:09.773 INFO:teuthology.orchestra.run.smithi076.stdout: krb5-devel x86_64 1.18.2-26.el8_9 rhel-8-for-x86_64-baseos-rpms 562 k 2024-06-02T04:39:09.773 INFO:teuthology.orchestra.run.smithi076.stdout: libcephsqlite x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 142 k 2024-06-02T04:39:09.773 INFO:teuthology.orchestra.run.smithi076.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2024-06-02T04:39:09.774 INFO:teuthology.orchestra.run.smithi076.stdout: libgfortran x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 645 k 2024-06-02T04:39:09.774 INFO:teuthology.orchestra.run.smithi076.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-06-02T04:39:09.774 INFO:teuthology.orchestra.run.smithi076.stdout: libpq x86_64 13.11-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2024-06-02T04:39:09.774 INFO:teuthology.orchestra.run.smithi076.stdout: libquadmath x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 172 k 2024-06-02T04:39:09.775 INFO:teuthology.orchestra.run.smithi076.stdout: librabbitmq x86_64 0.9.0-5.el8_9 rhel-8-for-x86_64-baseos-rpms 47 k 2024-06-02T04:39:09.775 INFO:teuthology.orchestra.run.smithi076.stdout: libradosstriper1 x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 474 k 2024-06-02T04:39:09.775 INFO:teuthology.orchestra.run.smithi076.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2024-06-02T04:39:09.775 INFO:teuthology.orchestra.run.smithi076.stdout: librgw2 x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 6.5 M 2024-06-02T04:39:09.775 INFO:teuthology.orchestra.run.smithi076.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2024-06-02T04:39:09.775 INFO:teuthology.orchestra.run.smithi076.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2024-06-02T04:39:09.775 INFO:teuthology.orchestra.run.smithi076.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-06-02T04:39:09.775 INFO:teuthology.orchestra.run.smithi076.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2024-06-02T04:39:09.775 INFO:teuthology.orchestra.run.smithi076.stdout: libzstd-devel x86_64 1.4.4-1.el8 rhel-8-for-x86_64-baseos-rpms 44 k 2024-06-02T04:39:09.775 INFO:teuthology.orchestra.run.smithi076.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2024-06-02T04:39:09.775 INFO:teuthology.orchestra.run.smithi076.stdout: oniguruma x86_64 6.8.2-2.1.el8_9 rhel-8-for-x86_64-appstream-rpms 188 k 2024-06-02T04:39:09.775 INFO:teuthology.orchestra.run.smithi076.stdout: openblas x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.0 M 2024-06-02T04:39:09.775 INFO:teuthology.orchestra.run.smithi076.stdout: openblas-threads x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.2 M 2024-06-02T04:39:09.776 INFO:teuthology.orchestra.run.smithi076.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2024-06-02T04:39:09.776 INFO:teuthology.orchestra.run.smithi076.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2024-06-02T04:39:09.776 INFO:teuthology.orchestra.run.smithi076.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2024-06-02T04:39:09.776 INFO:teuthology.orchestra.run.smithi076.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2024-06-02T04:39:09.776 INFO:teuthology.orchestra.run.smithi076.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2024-06-02T04:39:09.776 INFO:teuthology.orchestra.run.smithi076.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-06-02T04:39:09.776 INFO:teuthology.orchestra.run.smithi076.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-06-02T04:39:09.776 INFO:teuthology.orchestra.run.smithi076.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2024-06-02T04:39:09.776 INFO:teuthology.orchestra.run.smithi076.stdout: python3-ceph-argparse x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 45 k 2024-06-02T04:39:09.776 INFO:teuthology.orchestra.run.smithi076.stdout: python3-ceph-common x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 129 k 2024-06-02T04:39:09.776 INFO:teuthology.orchestra.run.smithi076.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2024-06-02T04:39:09.776 INFO:teuthology.orchestra.run.smithi076.stdout: python3-cffi x86_64 1.11.5-6.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2024-06-02T04:39:09.777 INFO:teuthology.orchestra.run.smithi076.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-06-02T04:39:09.777 INFO:teuthology.orchestra.run.smithi076.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-06-02T04:39:09.777 INFO:teuthology.orchestra.run.smithi076.stdout: python3-cryptography x86_64 3.2.1-7.el8_9 rhel-8-for-x86_64-baseos-rpms 559 k 2024-06-02T04:39:09.777 INFO:teuthology.orchestra.run.smithi076.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2024-06-02T04:39:09.777 INFO:teuthology.orchestra.run.smithi076.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-06-02T04:39:09.777 INFO:teuthology.orchestra.run.smithi076.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-06-02T04:39:09.777 INFO:teuthology.orchestra.run.smithi076.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2024-06-02T04:39:09.777 INFO:teuthology.orchestra.run.smithi076.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2024-06-02T04:39:09.777 INFO:teuthology.orchestra.run.smithi076.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2024-06-02T04:39:09.777 INFO:teuthology.orchestra.run.smithi076.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2024-06-02T04:39:09.777 INFO:teuthology.orchestra.run.smithi076.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2024-06-02T04:39:09.777 INFO:teuthology.orchestra.run.smithi076.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-06-02T04:39:09.777 INFO:teuthology.orchestra.run.smithi076.stdout: python3-mako noarch 1.0.6-14.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2024-06-02T04:39:09.778 INFO:teuthology.orchestra.run.smithi076.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2024-06-02T04:39:09.778 INFO:teuthology.orchestra.run.smithi076.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-06-02T04:39:09.778 INFO:teuthology.orchestra.run.smithi076.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2024-06-02T04:39:09.778 INFO:teuthology.orchestra.run.smithi076.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2024-06-02T04:39:09.778 INFO:teuthology.orchestra.run.smithi076.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2024-06-02T04:39:09.778 INFO:teuthology.orchestra.run.smithi076.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2024-06-02T04:39:09.778 INFO:teuthology.orchestra.run.smithi076.stdout: python3-packaging noarch 16.8-9.el8 codeready-builder-for-rhel-8-x86_64-rpms 48 k 2024-06-02T04:39:09.778 INFO:teuthology.orchestra.run.smithi076.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-06-02T04:39:09.778 INFO:teuthology.orchestra.run.smithi076.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-06-02T04:39:09.779 INFO:teuthology.orchestra.run.smithi076.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2024-06-02T04:39:09.779 INFO:teuthology.orchestra.run.smithi076.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2024-06-02T04:39:09.779 INFO:teuthology.orchestra.run.smithi076.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2024-06-02T04:39:09.779 INFO:teuthology.orchestra.run.smithi076.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2024-06-02T04:39:09.779 INFO:teuthology.orchestra.run.smithi076.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2024-06-02T04:39:09.779 INFO:teuthology.orchestra.run.smithi076.stdout: python3-pytz noarch 2017.2-11.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2024-06-02T04:39:09.779 INFO:teuthology.orchestra.run.smithi076.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2024-06-02T04:39:09.779 INFO:teuthology.orchestra.run.smithi076.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2024-06-02T04:39:09.779 INFO:teuthology.orchestra.run.smithi076.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2024-06-02T04:39:09.779 INFO:teuthology.orchestra.run.smithi076.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2024-06-02T04:39:09.779 INFO:teuthology.orchestra.run.smithi076.stdout: python3-scipy x86_64 1.0.0-21.module+el8.9.0+20976+d3c38525 rhel-8-for-x86_64-appstream-rpms 14 M 2024-06-02T04:39:09.780 INFO:teuthology.orchestra.run.smithi076.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-06-02T04:39:09.780 INFO:teuthology.orchestra.run.smithi076.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-06-02T04:39:09.780 INFO:teuthology.orchestra.run.smithi076.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-06-02T04:39:09.780 INFO:teuthology.orchestra.run.smithi076.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-06-02T04:39:09.780 INFO:teuthology.orchestra.run.smithi076.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-06-02T04:39:09.780 INFO:teuthology.orchestra.run.smithi076.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-06-02T04:39:09.780 INFO:teuthology.orchestra.run.smithi076.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2024-06-02T04:39:09.780 INFO:teuthology.orchestra.run.smithi076.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-06-02T04:39:09.780 INFO:teuthology.orchestra.run.smithi076.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2024-06-02T04:39:09.780 INFO:teuthology.orchestra.run.smithi076.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-06-02T04:39:09.780 INFO:teuthology.orchestra.run.smithi076.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2024-06-02T04:39:09.780 INFO:teuthology.orchestra.run.smithi076.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2024-06-02T04:39:09.781 INFO:teuthology.orchestra.run.smithi076.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2024-06-02T04:39:09.781 INFO:teuthology.orchestra.run.smithi076.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2024-06-02T04:39:09.781 INFO:teuthology.orchestra.run.smithi076.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2024-06-02T04:39:09.781 INFO:teuthology.orchestra.run.smithi076.stdout:Enabling module streams: 2024-06-02T04:39:09.781 INFO:teuthology.orchestra.run.smithi076.stdout: postgresql 10 2024-06-02T04:39:09.781 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:39:09.781 INFO:teuthology.orchestra.run.smithi076.stdout:Transaction Summary 2024-06-02T04:39:09.781 INFO:teuthology.orchestra.run.smithi076.stdout:=================================================================================================================================== 2024-06-02T04:39:09.781 INFO:teuthology.orchestra.run.smithi076.stdout:Install 130 Packages 2024-06-02T04:39:09.782 INFO:teuthology.orchestra.run.smithi076.stdout:Upgrade 16 Packages 2024-06-02T04:39:09.782 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:39:09.782 INFO:teuthology.orchestra.run.smithi076.stdout:Total download size: 215 M 2024-06-02T04:39:09.782 INFO:teuthology.orchestra.run.smithi076.stdout:Downloading Packages: 2024-06-02T04:39:09.815 INFO:teuthology.orchestra.run.smithi119.stdout:(1/146): ceph-18.2.2-1381.g3bb45379.el8.x86_64. 35 kB/s | 6.4 kB 00:00 2024-06-02T04:39:10.356 INFO:teuthology.orchestra.run.smithi076.stdout:(1/146): ceph-18.2.2-1381.g3bb45379.el8.x86_64. 26 kB/s | 6.4 kB 00:00 2024-06-02T04:39:10.682 INFO:teuthology.orchestra.run.smithi119.stdout:(2/146): ceph-fuse-18.2.2-1381.g3bb45379.el8.x8 992 kB/s | 859 kB 00:00 2024-06-02T04:39:10.711 INFO:teuthology.orchestra.run.smithi192.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2024-06-02T04:39:10.712 INFO:teuthology.orchestra.run.smithi192.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2024-06-02T04:39:10.730 INFO:teuthology.orchestra.run.smithi192.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2024-06-02T04:39:10.732 INFO:teuthology.orchestra.run.smithi192.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2024-06-02T04:39:10.733 INFO:teuthology.orchestra.run.smithi192.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2024-06-02T04:39:10.734 INFO:teuthology.orchestra.run.smithi192.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2024-06-02T04:39:10.737 INFO:teuthology.orchestra.run.smithi192.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2024-06-02T04:39:10.741 INFO:teuthology.orchestra.run.smithi192.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2024-06-02T04:39:10.742 INFO:teuthology.orchestra.run.smithi192.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2024-06-02T04:39:10.865 INFO:teuthology.orchestra.run.smithi119.stdout:(3/146): ceph-immutable-object-cache-18.2.2-138 906 kB/s | 166 kB 00:00 2024-06-02T04:39:10.966 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2024-06-02T04:39:10.980 INFO:teuthology.orchestra.run.smithi192.stdout:=================================================================================================================================== 2024-06-02T04:39:10.981 INFO:teuthology.orchestra.run.smithi192.stdout: Package Arch Version Repository Size 2024-06-02T04:39:10.981 INFO:teuthology.orchestra.run.smithi192.stdout:=================================================================================================================================== 2024-06-02T04:39:10.981 INFO:teuthology.orchestra.run.smithi192.stdout:Installing: 2024-06-02T04:39:10.981 INFO:teuthology.orchestra.run.smithi192.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-15.el8_9 rhel-8-for-x86_64-baseos-rpms 144 k 2024-06-02T04:39:10.981 INFO:teuthology.orchestra.run.smithi192.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2024-06-02T04:39:10.981 INFO:teuthology.orchestra.run.smithi192.stdout: ceph x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 6.4 k 2024-06-02T04:39:10.981 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-base x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 5.5 M 2024-06-02T04:39:10.981 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-fuse x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 859 k 2024-06-02T04:39:10.981 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-immutable-object-cache x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 166 k 2024-06-02T04:39:10.981 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 1.6 M 2024-06-02T04:39:10.981 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-cephadm noarch 2:18.2.2-1381.g3bb45379.el8 ceph-noarch 138 k 2024-06-02T04:39:10.981 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-dashboard noarch 2:18.2.2-1381.g3bb45379.el8 ceph-noarch 3.5 M 2024-06-02T04:39:10.982 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.2-1381.g3bb45379.el8 ceph-noarch 7.4 M 2024-06-02T04:39:10.982 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-rook noarch 2:18.2.2-1381.g3bb45379.el8 ceph-noarch 49 k 2024-06-02T04:39:10.982 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-radosgw x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 13 M 2024-06-02T04:39:10.982 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-test x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 47 M 2024-06-02T04:39:10.982 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-volume noarch 2:18.2.2-1381.g3bb45379.el8 ceph-noarch 263 k 2024-06-02T04:39:10.982 INFO:teuthology.orchestra.run.smithi192.stdout: cephadm noarch 2:18.2.2-1381.g3bb45379.el8 ceph-noarch 170 k 2024-06-02T04:39:10.982 INFO:teuthology.orchestra.run.smithi192.stdout: cephfs-mirror x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 261 k 2024-06-02T04:39:10.982 INFO:teuthology.orchestra.run.smithi192.stdout: cephfs-top noarch 2:18.2.2-1381.g3bb45379.el8 ceph-noarch 18 k 2024-06-02T04:39:10.982 INFO:teuthology.orchestra.run.smithi192.stdout: elfutils-libelf-devel x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 62 k 2024-06-02T04:39:10.982 INFO:teuthology.orchestra.run.smithi192.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2024-06-02T04:39:10.982 INFO:teuthology.orchestra.run.smithi192.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2024-06-02T04:39:10.982 INFO:teuthology.orchestra.run.smithi192.stdout: libcephfs-devel x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 31 k 2024-06-02T04:39:10.983 INFO:teuthology.orchestra.run.smithi192.stdout: libcephfs2 x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 780 k 2024-06-02T04:39:10.983 INFO:teuthology.orchestra.run.smithi192.stdout: librados-devel x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 139 k 2024-06-02T04:39:10.983 INFO:teuthology.orchestra.run.smithi192.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2024-06-02T04:39:10.983 INFO:teuthology.orchestra.run.smithi192.stdout: libuuid-devel x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 100 k 2024-06-02T04:39:10.983 INFO:teuthology.orchestra.run.smithi192.stdout: openssl-devel x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 2.3 M 2024-06-02T04:39:10.983 INFO:teuthology.orchestra.run.smithi192.stdout: postgresql x86_64 10.23-4.module+el8.9.0+21317+d2c6bf8a rhel-8-for-x86_64-appstream-rpms 1.5 M 2024-06-02T04:39:10.983 INFO:teuthology.orchestra.run.smithi192.stdout: postgresql-contrib x86_64 10.23-4.module+el8.9.0+21317+d2c6bf8a rhel-8-for-x86_64-appstream-rpms 812 k 2024-06-02T04:39:10.983 INFO:teuthology.orchestra.run.smithi192.stdout: postgresql-server x86_64 10.23-4.module+el8.9.0+21317+d2c6bf8a rhel-8-for-x86_64-appstream-rpms 5.1 M 2024-06-02T04:39:10.983 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cephfs x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 196 k 2024-06-02T04:39:10.983 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rados x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 371 k 2024-06-02T04:39:10.983 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rbd x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 365 k 2024-06-02T04:39:10.983 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rgw x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 107 k 2024-06-02T04:39:10.984 INFO:teuthology.orchestra.run.smithi192.stdout: rbd-fuse x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 96 k 2024-06-02T04:39:10.984 INFO:teuthology.orchestra.run.smithi192.stdout: rbd-mirror x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 3.5 M 2024-06-02T04:39:10.984 INFO:teuthology.orchestra.run.smithi192.stdout: rbd-nbd x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 181 k 2024-06-02T04:39:10.984 INFO:teuthology.orchestra.run.smithi192.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 73 k 2024-06-02T04:39:10.984 INFO:teuthology.orchestra.run.smithi192.stdout:Upgrading: 2024-06-02T04:39:10.984 INFO:teuthology.orchestra.run.smithi192.stdout: elfutils-libelf x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 232 k 2024-06-02T04:39:10.984 INFO:teuthology.orchestra.run.smithi192.stdout: elfutils-libs x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 303 k 2024-06-02T04:39:10.984 INFO:teuthology.orchestra.run.smithi192.stdout: iproute x86_64 6.2.0-5.el8_9 rhel-8-for-x86_64-baseos-rpms 854 k 2024-06-02T04:39:10.984 INFO:teuthology.orchestra.run.smithi192.stdout: libblkid x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 221 k 2024-06-02T04:39:10.984 INFO:teuthology.orchestra.run.smithi192.stdout: libfdisk x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 254 k 2024-06-02T04:39:10.984 INFO:teuthology.orchestra.run.smithi192.stdout: libmount x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 237 k 2024-06-02T04:39:10.984 INFO:teuthology.orchestra.run.smithi192.stdout: librados2 x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 3.7 M 2024-06-02T04:39:10.984 INFO:teuthology.orchestra.run.smithi192.stdout: librbd1 x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 3.6 M 2024-06-02T04:39:10.984 INFO:teuthology.orchestra.run.smithi192.stdout: libsmartcols x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 180 k 2024-06-02T04:39:10.985 INFO:teuthology.orchestra.run.smithi192.stdout: libuuid x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 99 k 2024-06-02T04:39:10.985 INFO:teuthology.orchestra.run.smithi192.stdout: openssl x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 711 k 2024-06-02T04:39:10.985 INFO:teuthology.orchestra.run.smithi192.stdout: openssl-libs x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 1.5 M 2024-06-02T04:39:10.985 INFO:teuthology.orchestra.run.smithi192.stdout: util-linux x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 2.5 M 2024-06-02T04:39:10.985 INFO:teuthology.orchestra.run.smithi192.stdout: util-linux-user x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 103 k 2024-06-02T04:39:10.985 INFO:teuthology.orchestra.run.smithi192.stdout: xfsdump x86_64 3.1.8-7.el8_9 rhel-8-for-x86_64-baseos-rpms 333 k 2024-06-02T04:39:10.985 INFO:teuthology.orchestra.run.smithi192.stdout: xfsprogs x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 1.1 M 2024-06-02T04:39:10.985 INFO:teuthology.orchestra.run.smithi192.stdout:Installing dependencies: 2024-06-02T04:39:10.985 INFO:teuthology.orchestra.run.smithi192.stdout: automake noarch 1.16.1-8.el8 rhel-8-for-x86_64-appstream-rpms 714 k 2024-06-02T04:39:10.985 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-common x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 22 M 2024-06-02T04:39:10.985 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-grafana-dashboards noarch 2:18.2.2-1381.g3bb45379.el8 ceph-noarch 24 k 2024-06-02T04:39:10.985 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mds x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 2.3 M 2024-06-02T04:39:10.985 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-modules-core noarch 2:18.2.2-1381.g3bb45379.el8 ceph-noarch 246 k 2024-06-02T04:39:10.986 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mon x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 4.8 M 2024-06-02T04:39:10.986 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-osd x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 18 M 2024-06-02T04:39:10.986 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-prometheus-alerts noarch 2:18.2.2-1381.g3bb45379.el8 ceph-noarch 16 k 2024-06-02T04:39:10.986 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-selinux x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 24 k 2024-06-02T04:39:10.986 INFO:teuthology.orchestra.run.smithi192.stdout: fuse x86_64 2.9.7-17.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2024-06-02T04:39:10.986 INFO:teuthology.orchestra.run.smithi192.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-06-02T04:39:10.986 INFO:teuthology.orchestra.run.smithi192.stdout: jq x86_64 1.6-7.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2024-06-02T04:39:10.986 INFO:teuthology.orchestra.run.smithi192.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2024-06-02T04:39:10.986 INFO:teuthology.orchestra.run.smithi192.stdout: krb5-devel x86_64 1.18.2-26.el8_9 rhel-8-for-x86_64-baseos-rpms 562 k 2024-06-02T04:39:10.986 INFO:teuthology.orchestra.run.smithi192.stdout: libcephsqlite x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 142 k 2024-06-02T04:39:10.986 INFO:teuthology.orchestra.run.smithi192.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2024-06-02T04:39:10.986 INFO:teuthology.orchestra.run.smithi192.stdout: libgfortran x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 645 k 2024-06-02T04:39:10.987 INFO:teuthology.orchestra.run.smithi192.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-06-02T04:39:10.987 INFO:teuthology.orchestra.run.smithi192.stdout: libpq x86_64 13.11-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2024-06-02T04:39:10.987 INFO:teuthology.orchestra.run.smithi192.stdout: libquadmath x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 172 k 2024-06-02T04:39:10.987 INFO:teuthology.orchestra.run.smithi192.stdout: librabbitmq x86_64 0.9.0-5.el8_9 rhel-8-for-x86_64-baseos-rpms 47 k 2024-06-02T04:39:10.987 INFO:teuthology.orchestra.run.smithi192.stdout: libradosstriper1 x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 474 k 2024-06-02T04:39:10.987 INFO:teuthology.orchestra.run.smithi192.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2024-06-02T04:39:10.987 INFO:teuthology.orchestra.run.smithi192.stdout: librgw2 x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 6.5 M 2024-06-02T04:39:10.987 INFO:teuthology.orchestra.run.smithi192.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2024-06-02T04:39:10.987 INFO:teuthology.orchestra.run.smithi192.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2024-06-02T04:39:10.987 INFO:teuthology.orchestra.run.smithi192.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-06-02T04:39:10.987 INFO:teuthology.orchestra.run.smithi192.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2024-06-02T04:39:10.987 INFO:teuthology.orchestra.run.smithi192.stdout: libzstd-devel x86_64 1.4.4-1.el8 rhel-8-for-x86_64-baseos-rpms 44 k 2024-06-02T04:39:10.987 INFO:teuthology.orchestra.run.smithi192.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2024-06-02T04:39:10.988 INFO:teuthology.orchestra.run.smithi192.stdout: oniguruma x86_64 6.8.2-2.1.el8_9 rhel-8-for-x86_64-appstream-rpms 188 k 2024-06-02T04:39:10.988 INFO:teuthology.orchestra.run.smithi192.stdout: openblas x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.0 M 2024-06-02T04:39:10.988 INFO:teuthology.orchestra.run.smithi192.stdout: openblas-threads x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.2 M 2024-06-02T04:39:10.988 INFO:teuthology.orchestra.run.smithi192.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2024-06-02T04:39:10.988 INFO:teuthology.orchestra.run.smithi192.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2024-06-02T04:39:10.988 INFO:teuthology.orchestra.run.smithi192.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2024-06-02T04:39:10.988 INFO:teuthology.orchestra.run.smithi192.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2024-06-02T04:39:10.988 INFO:teuthology.orchestra.run.smithi192.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2024-06-02T04:39:10.988 INFO:teuthology.orchestra.run.smithi192.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-06-02T04:39:10.988 INFO:teuthology.orchestra.run.smithi192.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-06-02T04:39:10.988 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2024-06-02T04:39:10.988 INFO:teuthology.orchestra.run.smithi192.stdout: python3-ceph-argparse x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 45 k 2024-06-02T04:39:10.989 INFO:teuthology.orchestra.run.smithi192.stdout: python3-ceph-common x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 129 k 2024-06-02T04:39:10.989 INFO:teuthology.orchestra.run.smithi192.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2024-06-02T04:39:10.989 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cffi x86_64 1.11.5-6.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2024-06-02T04:39:10.989 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-06-02T04:39:10.989 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-06-02T04:39:10.989 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cryptography x86_64 3.2.1-7.el8_9 rhel-8-for-x86_64-baseos-rpms 559 k 2024-06-02T04:39:10.989 INFO:teuthology.orchestra.run.smithi192.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2024-06-02T04:39:10.989 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-06-02T04:39:10.989 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-06-02T04:39:10.989 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2024-06-02T04:39:10.989 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2024-06-02T04:39:10.989 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2024-06-02T04:39:10.989 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2024-06-02T04:39:10.990 INFO:teuthology.orchestra.run.smithi192.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2024-06-02T04:39:10.990 INFO:teuthology.orchestra.run.smithi192.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-06-02T04:39:10.990 INFO:teuthology.orchestra.run.smithi192.stdout: python3-mako noarch 1.0.6-14.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2024-06-02T04:39:10.990 INFO:teuthology.orchestra.run.smithi192.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2024-06-02T04:39:10.990 INFO:teuthology.orchestra.run.smithi192.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-06-02T04:39:10.990 INFO:teuthology.orchestra.run.smithi192.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2024-06-02T04:39:10.990 INFO:teuthology.orchestra.run.smithi192.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2024-06-02T04:39:10.990 INFO:teuthology.orchestra.run.smithi192.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2024-06-02T04:39:10.990 INFO:teuthology.orchestra.run.smithi192.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2024-06-02T04:39:10.990 INFO:teuthology.orchestra.run.smithi192.stdout: python3-packaging noarch 16.8-9.el8 codeready-builder-for-rhel-8-x86_64-rpms 48 k 2024-06-02T04:39:10.990 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-06-02T04:39:10.990 INFO:teuthology.orchestra.run.smithi192.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-06-02T04:39:10.990 INFO:teuthology.orchestra.run.smithi192.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2024-06-02T04:39:10.991 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2024-06-02T04:39:10.991 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2024-06-02T04:39:10.991 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2024-06-02T04:39:10.991 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2024-06-02T04:39:10.991 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pytz noarch 2017.2-11.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2024-06-02T04:39:10.991 INFO:teuthology.orchestra.run.smithi192.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2024-06-02T04:39:10.991 INFO:teuthology.orchestra.run.smithi192.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2024-06-02T04:39:10.991 INFO:teuthology.orchestra.run.smithi192.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2024-06-02T04:39:10.991 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2024-06-02T04:39:10.991 INFO:teuthology.orchestra.run.smithi192.stdout: python3-scipy x86_64 1.0.0-21.module+el8.9.0+20976+d3c38525 rhel-8-for-x86_64-appstream-rpms 14 M 2024-06-02T04:39:10.991 INFO:teuthology.orchestra.run.smithi192.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-06-02T04:39:10.991 INFO:teuthology.orchestra.run.smithi192.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-06-02T04:39:10.992 INFO:teuthology.orchestra.run.smithi192.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-06-02T04:39:10.992 INFO:teuthology.orchestra.run.smithi192.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-06-02T04:39:10.992 INFO:teuthology.orchestra.run.smithi192.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-06-02T04:39:10.992 INFO:teuthology.orchestra.run.smithi192.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-06-02T04:39:10.992 INFO:teuthology.orchestra.run.smithi192.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2024-06-02T04:39:10.992 INFO:teuthology.orchestra.run.smithi192.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-06-02T04:39:10.992 INFO:teuthology.orchestra.run.smithi192.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2024-06-02T04:39:10.992 INFO:teuthology.orchestra.run.smithi192.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-06-02T04:39:10.992 INFO:teuthology.orchestra.run.smithi192.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2024-06-02T04:39:10.992 INFO:teuthology.orchestra.run.smithi192.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2024-06-02T04:39:10.992 INFO:teuthology.orchestra.run.smithi192.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2024-06-02T04:39:10.992 INFO:teuthology.orchestra.run.smithi192.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2024-06-02T04:39:10.992 INFO:teuthology.orchestra.run.smithi192.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2024-06-02T04:39:10.993 INFO:teuthology.orchestra.run.smithi192.stdout:Enabling module streams: 2024-06-02T04:39:10.993 INFO:teuthology.orchestra.run.smithi192.stdout: postgresql 10 2024-06-02T04:39:10.993 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-06-02T04:39:10.993 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction Summary 2024-06-02T04:39:10.993 INFO:teuthology.orchestra.run.smithi192.stdout:=================================================================================================================================== 2024-06-02T04:39:10.993 INFO:teuthology.orchestra.run.smithi192.stdout:Install 130 Packages 2024-06-02T04:39:10.993 INFO:teuthology.orchestra.run.smithi192.stdout:Upgrade 16 Packages 2024-06-02T04:39:10.993 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-06-02T04:39:10.994 INFO:teuthology.orchestra.run.smithi192.stdout:Total download size: 215 M 2024-06-02T04:39:10.994 INFO:teuthology.orchestra.run.smithi192.stdout:Downloading Packages: 2024-06-02T04:39:11.406 INFO:teuthology.orchestra.run.smithi076.stdout:(2/146): ceph-fuse-18.2.2-1381.g3bb45379.el8.x8 819 kB/s | 859 kB 00:01 2024-06-02T04:39:11.407 INFO:teuthology.orchestra.run.smithi192.stdout:(1/146): ceph-18.2.2-1381.g3bb45379.el8.x86_64. 22 kB/s | 6.4 kB 00:00 2024-06-02T04:39:11.532 INFO:teuthology.orchestra.run.smithi076.stdout:(3/146): ceph-immutable-object-cache-18.2.2-138 1.3 MB/s | 166 kB 00:00 2024-06-02T04:39:11.532 INFO:teuthology.orchestra.run.smithi119.stdout:(4/146): ceph-common-18.2.2-1381.g3bb45379.el8. 11 MB/s | 22 MB 00:01 2024-06-02T04:39:11.766 INFO:teuthology.orchestra.run.smithi119.stdout:(5/146): ceph-mgr-18.2.2-1381.g3bb45379.el8.x86 6.7 MB/s | 1.6 MB 00:00 2024-06-02T04:39:11.816 INFO:teuthology.orchestra.run.smithi192.stdout:(2/146): ceph-fuse-18.2.2-1381.g3bb45379.el8.x8 2.1 MB/s | 859 kB 00:00 2024-06-02T04:39:11.891 INFO:teuthology.orchestra.run.smithi192.stdout:(3/146): ceph-immutable-object-cache-18.2.2-138 2.2 MB/s | 166 kB 00:00 2024-06-02T04:39:12.416 INFO:teuthology.orchestra.run.smithi119.stdout:(6/146): ceph-base-18.2.2-1381.g3bb45379.el8.x8 2.0 MB/s | 5.5 MB 00:02 2024-06-02T04:39:12.429 INFO:teuthology.orchestra.run.smithi192.stdout:(4/146): ceph-mds-18.2.2-1381.g3bb45379.el8.x86 4.2 MB/s | 2.3 MB 00:00 2024-06-02T04:39:12.776 INFO:teuthology.orchestra.run.smithi192.stdout:(5/146): ceph-mgr-18.2.2-1381.g3bb45379.el8.x86 4.5 MB/s | 1.6 MB 00:00 2024-06-02T04:39:12.858 INFO:teuthology.orchestra.run.smithi119.stdout:(7/146): ceph-mon-18.2.2-1381.g3bb45379.el8.x86 4.4 MB/s | 4.8 MB 00:01 2024-06-02T04:39:12.909 INFO:teuthology.orchestra.run.smithi192.stdout:(6/146): ceph-base-18.2.2-1381.g3bb45379.el8.x8 3.1 MB/s | 5.5 MB 00:01 2024-06-02T04:39:12.940 INFO:teuthology.orchestra.run.smithi076.stdout:(4/146): ceph-base-18.2.2-1381.g3bb45379.el8.x8 1.9 MB/s | 5.5 MB 00:02 2024-06-02T04:39:13.165 INFO:teuthology.orchestra.run.smithi076.stdout:(5/146): ceph-mds-18.2.2-1381.g3bb45379.el8.x86 1.4 MB/s | 2.3 MB 00:01 2024-06-02T04:39:13.567 INFO:teuthology.orchestra.run.smithi119.stdout:(8/146): ceph-mds-18.2.2-1381.g3bb45379.el8.x86 861 kB/s | 2.3 MB 00:02 2024-06-02T04:39:13.692 INFO:teuthology.orchestra.run.smithi119.stdout:(9/146): ceph-selinux-18.2.2-1381.g3bb45379.el8 195 kB/s | 24 kB 00:00 2024-06-02T04:39:13.774 INFO:teuthology.orchestra.run.smithi076.stdout:(6/146): ceph-mgr-18.2.2-1381.g3bb45379.el8.x86 1.9 MB/s | 1.6 MB 00:00 2024-06-02T04:39:13.819 INFO:teuthology.orchestra.run.smithi192.stdout:(7/146): ceph-mon-18.2.2-1381.g3bb45379.el8.x86 4.6 MB/s | 4.8 MB 00:01 2024-06-02T04:39:15.417 INFO:teuthology.orchestra.run.smithi119.stdout:(10/146): ceph-osd-18.2.2-1381.g3bb45379.el8.x8 6.1 MB/s | 18 MB 00:03 2024-06-02T04:39:15.517 INFO:teuthology.orchestra.run.smithi119.stdout:(11/146): cephfs-mirror-18.2.2-1381.g3bb45379.e 2.6 MB/s | 261 kB 00:00 2024-06-02T04:39:15.676 INFO:teuthology.orchestra.run.smithi119.stdout:(12/146): ceph-radosgw-18.2.2-1381.g3bb45379.el 4.6 MB/s | 13 MB 00:02 2024-06-02T04:39:15.693 INFO:teuthology.orchestra.run.smithi119.stdout:(13/146): libcephfs-devel-18.2.2-1381.g3bb45379 176 kB/s | 31 kB 00:00 2024-06-02T04:39:15.793 INFO:teuthology.orchestra.run.smithi119.stdout:(14/146): libcephsqlite-18.2.2-1381.g3bb45379.e 1.4 MB/s | 142 kB 00:00 2024-06-02T04:39:15.876 INFO:teuthology.orchestra.run.smithi119.stdout:(15/146): libcephfs2-18.2.2-1381.g3bb45379.el8. 3.8 MB/s | 780 kB 00:00 2024-06-02T04:39:15.910 INFO:teuthology.orchestra.run.smithi119.stdout:(16/146): librados-devel-18.2.2-1381.g3bb45379. 1.2 MB/s | 139 kB 00:00 2024-06-02T04:39:16.010 INFO:teuthology.orchestra.run.smithi119.stdout:(17/146): libradosstriper1-18.2.2-1381.g3bb4537 3.5 MB/s | 474 kB 00:00 2024-06-02T04:39:16.061 INFO:teuthology.orchestra.run.smithi119.stdout:(18/146): python3-ceph-argparse-18.2.2-1381.g3b 891 kB/s | 45 kB 00:00 2024-06-02T04:39:16.068 INFO:teuthology.orchestra.run.smithi192.stdout:(8/146): ceph-radosgw-18.2.2-1381.g3bb45379.el8 5.8 MB/s | 13 MB 00:02 2024-06-02T04:39:16.119 INFO:teuthology.orchestra.run.smithi119.stdout:(19/146): python3-ceph-common-18.2.2-1381.g3bb4 2.2 MB/s | 129 kB 00:00 2024-06-02T04:39:16.135 INFO:teuthology.orchestra.run.smithi192.stdout:(9/146): ceph-selinux-18.2.2-1381.g3bb45379.el8 367 kB/s | 24 kB 00:00 2024-06-02T04:39:16.186 INFO:teuthology.orchestra.run.smithi119.stdout:(20/146): python3-cephfs-18.2.2-1381.g3bb45379. 2.9 MB/s | 196 kB 00:00 2024-06-02T04:39:16.307 INFO:teuthology.orchestra.run.smithi076.stdout:(7/146): ceph-mon-18.2.2-1381.g3bb45379.el8.x86 1.5 MB/s | 4.8 MB 00:03 2024-06-02T04:39:16.328 INFO:teuthology.orchestra.run.smithi119.stdout:(21/146): python3-rados-18.2.2-1381.g3bb45379.e 2.6 MB/s | 371 kB 00:00 2024-06-02T04:39:16.478 INFO:teuthology.orchestra.run.smithi119.stdout:(22/146): python3-rbd-18.2.2-1381.g3bb45379.el8 2.4 MB/s | 365 kB 00:00 2024-06-02T04:39:16.554 INFO:teuthology.orchestra.run.smithi119.stdout:(23/146): python3-rgw-18.2.2-1381.g3bb45379.el8 1.4 MB/s | 107 kB 00:00 2024-06-02T04:39:16.629 INFO:teuthology.orchestra.run.smithi119.stdout:(24/146): rbd-fuse-18.2.2-1381.g3bb45379.el8.x8 1.2 MB/s | 96 kB 00:00 2024-06-02T04:39:17.046 INFO:teuthology.orchestra.run.smithi119.stdout:(25/146): librgw2-18.2.2-1381.g3bb45379.el8.x86 5.8 MB/s | 6.5 MB 00:01 2024-06-02T04:39:17.193 INFO:teuthology.orchestra.run.smithi119.stdout:(26/146): rbd-nbd-18.2.2-1381.g3bb45379.el8.x86 1.2 MB/s | 181 kB 00:00 2024-06-02T04:39:17.305 INFO:teuthology.orchestra.run.smithi119.stdout:(27/146): ceph-grafana-dashboards-18.2.2-1381.g 218 kB/s | 24 kB 00:00 2024-06-02T04:39:17.422 INFO:teuthology.orchestra.run.smithi119.stdout:(28/146): ceph-mgr-cephadm-18.2.2-1381.g3bb4537 1.2 MB/s | 138 kB 00:00 2024-06-02T04:39:17.881 INFO:teuthology.orchestra.run.smithi119.stdout:(29/146): rbd-mirror-18.2.2-1381.g3bb45379.el8. 2.8 MB/s | 3.5 MB 00:01 2024-06-02T04:39:17.977 INFO:teuthology.orchestra.run.smithi192.stdout:(10/146): ceph-osd-18.2.2-1381.g3bb45379.el8.x8 3.6 MB/s | 18 MB 00:05 2024-06-02T04:39:18.097 INFO:teuthology.orchestra.run.smithi119.stdout:(30/146): ceph-mgr-dashboard-18.2.2-1381.g3bb45 5.2 MB/s | 3.5 MB 00:00 2024-06-02T04:39:18.119 INFO:teuthology.orchestra.run.smithi192.stdout:(11/146): cephfs-mirror-18.2.2-1381.g3bb45379.e 1.8 MB/s | 261 kB 00:00 2024-06-02T04:39:18.197 INFO:teuthology.orchestra.run.smithi119.stdout:(31/146): ceph-mgr-modules-core-18.2.2-1381.g3b 2.4 MB/s | 246 kB 00:00 2024-06-02T04:39:18.202 INFO:teuthology.orchestra.run.smithi192.stdout:(12/146): libcephfs-devel-18.2.2-1381.g3bb45379 372 kB/s | 31 kB 00:00 2024-06-02T04:39:18.273 INFO:teuthology.orchestra.run.smithi119.stdout:(32/146): ceph-mgr-rook-18.2.2-1381.g3bb45379.e 655 kB/s | 49 kB 00:00 2024-06-02T04:39:18.365 INFO:teuthology.orchestra.run.smithi119.stdout:(33/146): ceph-prometheus-alerts-18.2.2-1381.g3 178 kB/s | 16 kB 00:00 2024-06-02T04:39:18.436 INFO:teuthology.orchestra.run.smithi192.stdout:(13/146): libcephfs2-18.2.2-1381.g3bb45379.el8. 3.3 MB/s | 780 kB 00:00 2024-06-02T04:39:18.457 INFO:teuthology.orchestra.run.smithi119.stdout:(34/146): ceph-volume-18.2.2-1381.g3bb45379.el8 2.8 MB/s | 263 kB 00:00 2024-06-02T04:39:18.528 INFO:teuthology.orchestra.run.smithi192.stdout:(14/146): libcephsqlite-18.2.2-1381.g3bb45379.e 1.5 MB/s | 142 kB 00:00 2024-06-02T04:39:18.549 INFO:teuthology.orchestra.run.smithi119.stdout:(35/146): cephadm-18.2.2-1381.g3bb45379.el8.noa 1.8 MB/s | 170 kB 00:00 2024-06-02T04:39:18.603 INFO:teuthology.orchestra.run.smithi192.stdout:(15/146): librados-devel-18.2.2-1381.g3bb45379. 1.8 MB/s | 139 kB 00:00 2024-06-02T04:39:18.641 INFO:teuthology.orchestra.run.smithi119.stdout:(36/146): cephfs-top-18.2.2-1381.g3bb45379.el8. 197 kB/s | 18 kB 00:00 2024-06-02T04:39:18.745 INFO:teuthology.orchestra.run.smithi192.stdout:(16/146): libradosstriper1-18.2.2-1381.g3bb4537 3.3 MB/s | 474 kB 00:00 2024-06-02T04:39:19.532 INFO:teuthology.orchestra.run.smithi119.stdout:(37/146): gperftools-libs-2.7-9.el8.x86_64.rpm 343 kB/s | 306 kB 00:00 2024-06-02T04:39:19.758 INFO:teuthology.orchestra.run.smithi119.stdout:(38/146): ceph-mgr-diskprediction-local-18.2.2- 3.9 MB/s | 7.4 MB 00:01 2024-06-02T04:39:19.783 INFO:teuthology.orchestra.run.smithi119.stdout:(39/146): liboath-2.6.2-3.el8.x86_64.rpm 235 kB/s | 59 kB 00:00 2024-06-02T04:39:19.975 INFO:teuthology.orchestra.run.smithi119.stdout:(40/146): python3-asyncssh-2.7.0-2.el8.noarch.r 2.4 MB/s | 476 kB 00:00 2024-06-02T04:39:20.000 INFO:teuthology.orchestra.run.smithi119.stdout:(41/146): libunwind-1.3.1-3.el8.x86_64.rpm 310 kB/s | 75 kB 00:00 2024-06-02T04:39:20.176 INFO:teuthology.orchestra.run.smithi119.stdout:(42/146): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 218 kB/s | 44 kB 00:00 2024-06-02T04:39:20.187 INFO:teuthology.orchestra.run.smithi192.stdout:(17/146): librgw2-18.2.2-1381.g3bb45379.el8.x86 4.5 MB/s | 6.5 MB 00:01 2024-06-02T04:39:20.266 INFO:teuthology.orchestra.run.smithi192.stdout:(18/146): python3-ceph-argparse-18.2.2-1381.g3b 568 kB/s | 45 kB 00:00 2024-06-02T04:39:20.299 INFO:teuthology.orchestra.run.smithi076.stdout:(8/146): ceph-osd-18.2.2-1381.g3bb45379.el8.x86 2.8 MB/s | 18 MB 00:06 2024-06-02T04:39:20.317 INFO:teuthology.orchestra.run.smithi119.stdout:(43/146): python3-beautifulsoup4-4.6.3-2.el8.1. 584 kB/s | 185 kB 00:00 2024-06-02T04:39:20.329 INFO:teuthology.orchestra.run.smithi192.stdout:(19/146): python3-ceph-common-18.2.2-1381.g3bb4 2.0 MB/s | 129 kB 00:00 2024-06-02T04:39:20.349 INFO:teuthology.orchestra.run.smithi076.stdout:(9/146): ceph-selinux-18.2.2-1381.g3bb45379.el8 492 kB/s | 24 kB 00:00 2024-06-02T04:39:20.384 INFO:teuthology.orchestra.run.smithi119.stdout:(44/146): python3-cachetools-3.1.1-4.el8.noarch 158 kB/s | 33 kB 00:00 2024-06-02T04:39:20.388 INFO:teuthology.orchestra.run.smithi192.stdout:(20/146): python3-cephfs-18.2.2-1381.g3bb45379. 3.3 MB/s | 196 kB 00:00 2024-06-02T04:39:20.505 INFO:teuthology.orchestra.run.smithi192.stdout:(21/146): python3-rados-18.2.2-1381.g3bb45379.e 3.1 MB/s | 371 kB 00:00 2024-06-02T04:39:20.534 INFO:teuthology.orchestra.run.smithi119.stdout:(45/146): python3-certifi-2018.10.15-7.el8.noar 75 kB/s | 16 kB 00:00 2024-06-02T04:39:20.560 INFO:teuthology.orchestra.run.smithi119.stdout:(46/146): python3-cheroot-8.5.2-1.el8.noarch.rp 985 kB/s | 173 kB 00:00 2024-06-02T04:39:20.622 INFO:teuthology.orchestra.run.smithi192.stdout:(22/146): python3-rbd-18.2.2-1381.g3bb45379.el8 3.1 MB/s | 365 kB 00:00 2024-06-02T04:39:20.694 INFO:teuthology.orchestra.run.smithi119.stdout:(47/146): python3-google-auth-1.1.1-10.el8.noar 610 kB/s | 81 kB 00:00 2024-06-02T04:39:20.714 INFO:teuthology.orchestra.run.smithi192.stdout:(23/146): python3-rgw-18.2.2-1381.g3bb45379.el8 1.1 MB/s | 107 kB 00:00 2024-06-02T04:39:20.781 INFO:teuthology.orchestra.run.smithi192.stdout:(24/146): rbd-fuse-18.2.2-1381.g3bb45379.el8.x8 1.4 MB/s | 96 kB 00:00 2024-06-02T04:39:20.977 INFO:teuthology.orchestra.run.smithi119.stdout:(48/146): python3-jaraco-6.2-6.el8.noarch.rpm 39 kB/s | 11 kB 00:00 2024-06-02T04:39:21.027 INFO:teuthology.orchestra.run.smithi119.stdout:(49/146): python3-cherrypy-18.4.0-1.el8.noarch. 781 kB/s | 384 kB 00:00 2024-06-02T04:39:21.071 INFO:teuthology.orchestra.run.smithi076.stdout:(10/146): ceph-radosgw-18.2.2-1381.g3bb45379.el 2.7 MB/s | 13 MB 00:04 2024-06-02T04:39:21.081 INFO:teuthology.orchestra.run.smithi192.stdout:(25/146): ceph-common-18.2.2-1381.g3bb45379.el8 2.2 MB/s | 22 MB 00:09 2024-06-02T04:39:21.174 INFO:teuthology.orchestra.run.smithi076.stdout:(11/146): cephfs-mirror-18.2.2-1381.g3bb45379.e 2.5 MB/s | 261 kB 00:00 2024-06-02T04:39:21.231 INFO:teuthology.orchestra.run.smithi192.stdout:(26/146): rbd-nbd-18.2.2-1381.g3bb45379.el8.x86 1.2 MB/s | 181 kB 00:00 2024-06-02T04:39:21.298 INFO:teuthology.orchestra.run.smithi192.stdout:(27/146): ceph-grafana-dashboards-18.2.2-1381.g 365 kB/s | 24 kB 00:00 2024-06-02T04:39:21.303 INFO:teuthology.orchestra.run.smithi119.stdout:(50/146): python3-jaraco-functools-2.0-4.el8.no 54 kB/s | 18 kB 00:00 2024-06-02T04:39:21.336 INFO:teuthology.orchestra.run.smithi119.stdout:(51/146): python3-kubernetes-11.0.0-6.el8.noarc 3.8 MB/s | 1.2 MB 00:00 2024-06-02T04:39:21.399 INFO:teuthology.orchestra.run.smithi192.stdout:(28/146): ceph-mgr-cephadm-18.2.2-1381.g3bb4537 1.4 MB/s | 138 kB 00:00 2024-06-02T04:39:21.408 INFO:teuthology.orchestra.run.smithi076.stdout:(12/146): ceph-common-18.2.2-1381.g3bb45379.el8 1.9 MB/s | 22 MB 00:11 2024-06-02T04:39:21.433 INFO:teuthology.orchestra.run.smithi076.stdout:(13/146): libcephfs-devel-18.2.2-1381.g3bb45379 120 kB/s | 31 kB 00:00 2024-06-02T04:39:21.474 INFO:teuthology.orchestra.run.smithi192.stdout:(29/146): rbd-mirror-18.2.2-1381.g3bb45379.el8. 5.0 MB/s | 3.5 MB 00:00 2024-06-02T04:39:21.492 INFO:teuthology.orchestra.run.smithi076.stdout:(14/146): libcephsqlite-18.2.2-1381.g3bb45379.e 2.4 MB/s | 142 kB 00:00 2024-06-02T04:39:21.511 INFO:teuthology.orchestra.run.smithi119.stdout:(52/146): python3-logutils-0.3.5-11.el8.noarch. 234 kB/s | 49 kB 00:00 2024-06-02T04:39:21.620 INFO:teuthology.orchestra.run.smithi119.stdout:(53/146): python3-more-itertools-7.2.0-3.el8.no 207 kB/s | 59 kB 00:00 2024-06-02T04:39:21.634 INFO:teuthology.orchestra.run.smithi076.stdout:(15/146): librados-devel-18.2.2-1381.g3bb45379. 984 kB/s | 139 kB 00:00 2024-06-02T04:39:21.713 INFO:teuthology.orchestra.run.smithi119.stdout:(54/146): python3-natsort-7.1.1-2.el8.noarch.rp 300 kB/s | 60 kB 00:00 2024-06-02T04:39:21.793 INFO:teuthology.orchestra.run.smithi119.stdout:(55/146): python3-pecan-1.3.2-9.el8.noarch.rpm 1.6 MB/s | 283 kB 00:00 2024-06-02T04:39:21.821 INFO:teuthology.orchestra.run.smithi119.stdout:(56/146): python3-portend-2.6-1.el8.noarch.rpm 144 kB/s | 16 kB 00:00 2024-06-02T04:39:21.901 INFO:teuthology.orchestra.run.smithi076.stdout:(16/146): libcephfs2-18.2.2-1381.g3bb45379.el8. 1.5 MB/s | 780 kB 00:00 2024-06-02T04:39:21.959 INFO:teuthology.orchestra.run.smithi076.stdout:(17/146): libradosstriper1-18.2.2-1381.g3bb4537 1.4 MB/s | 474 kB 00:00 2024-06-02T04:39:22.026 INFO:teuthology.orchestra.run.smithi076.stdout:(18/146): python3-ceph-argparse-18.2.2-1381.g3b 670 kB/s | 45 kB 00:00 2024-06-02T04:39:22.101 INFO:teuthology.orchestra.run.smithi076.stdout:(19/146): python3-ceph-common-18.2.2-1381.g3bb4 1.7 MB/s | 129 kB 00:00 2024-06-02T04:39:22.113 INFO:teuthology.orchestra.run.smithi119.stdout:(57/146): python3-routes-2.4.1-12.el8.noarch.rp 674 kB/s | 196 kB 00:00 2024-06-02T04:39:22.172 INFO:teuthology.orchestra.run.smithi119.stdout:(58/146): python3-repoze-lru-0.7-6.el8.noarch.r 89 kB/s | 34 kB 00:00 2024-06-02T04:39:22.205 INFO:teuthology.orchestra.run.smithi119.stdout:(59/146): python3-rsa-4.9-2.el8.noarch.rpm 698 kB/s | 64 kB 00:00 2024-06-02T04:39:22.218 INFO:teuthology.orchestra.run.smithi076.stdout:(20/146): python3-cephfs-18.2.2-1381.g3bb45379. 1.6 MB/s | 196 kB 00:00 2024-06-02T04:39:22.256 INFO:teuthology.orchestra.run.smithi119.stdout:(60/146): python3-simplegeneric-0.8.1-17.el8.no 224 kB/s | 19 kB 00:00 2024-06-02T04:39:22.306 INFO:teuthology.orchestra.run.smithi119.stdout:(61/146): python3-singledispatch-3.4.0.3-18.el8 239 kB/s | 24 kB 00:00 2024-06-02T04:39:22.352 INFO:teuthology.orchestra.run.smithi076.stdout:(21/146): python3-rados-18.2.2-1381.g3bb45379.e 2.7 MB/s | 371 kB 00:00 2024-06-02T04:39:22.365 INFO:teuthology.orchestra.run.smithi119.stdout:(62/146): python3-tempora-1.14.1-5.el8.noarch.r 269 kB/s | 29 kB 00:00 2024-06-02T04:39:22.415 INFO:teuthology.orchestra.run.smithi119.stdout:(63/146): python3-trustme-0.6.0-4.el8.noarch.rp 253 kB/s | 27 kB 00:00 2024-06-02T04:39:22.466 INFO:teuthology.orchestra.run.smithi076.stdout:(22/146): python3-rbd-18.2.2-1381.g3bb45379.el8 3.1 MB/s | 365 kB 00:00 2024-06-02T04:39:22.519 INFO:teuthology.orchestra.run.smithi076.stdout:(23/146): python3-rgw-18.2.2-1381.g3bb45379.el8 2.0 MB/s | 107 kB 00:00 2024-06-02T04:39:22.569 INFO:teuthology.orchestra.run.smithi076.stdout:(24/146): rbd-fuse-18.2.2-1381.g3bb45379.el8.x8 1.9 MB/s | 96 kB 00:00 2024-06-02T04:39:22.665 INFO:teuthology.orchestra.run.smithi119.stdout:(64/146): python3-webob-1.8.5-1.el8.1.noarch.rp 1.0 MB/s | 251 kB 00:00 2024-06-02T04:39:22.690 INFO:teuthology.orchestra.run.smithi119.stdout:(65/146): python3-waitress-1.4.3-1.el8.noarch.r 784 kB/s | 255 kB 00:00 2024-06-02T04:39:22.724 INFO:teuthology.orchestra.run.smithi192.stdout:(30/146): ceph-test-18.2.2-1381.g3bb45379.el8.x 7.2 MB/s | 47 MB 00:06 2024-06-02T04:39:22.783 INFO:teuthology.orchestra.run.smithi192.stdout:(31/146): ceph-mgr-dashboard-18.2.2-1381.g3bb45 2.5 MB/s | 3.5 MB 00:01 2024-06-02T04:39:22.808 INFO:teuthology.orchestra.run.smithi192.stdout:(32/146): ceph-mgr-modules-core-18.2.2-1381.g3b 2.9 MB/s | 246 kB 00:00 2024-06-02T04:39:22.917 INFO:teuthology.orchestra.run.smithi192.stdout:(33/146): ceph-mgr-diskprediction-local-18.2.2- 5.1 MB/s | 7.4 MB 00:01 2024-06-02T04:39:22.934 INFO:teuthology.orchestra.run.smithi192.stdout:(34/146): ceph-prometheus-alerts-18.2.2-1381.g3 130 kB/s | 16 kB 00:00 2024-06-02T04:39:22.951 INFO:teuthology.orchestra.run.smithi192.stdout:(35/146): ceph-mgr-rook-18.2.2-1381.g3bb45379.e 294 kB/s | 49 kB 00:00 2024-06-02T04:39:22.976 INFO:teuthology.orchestra.run.smithi192.stdout:(36/146): ceph-volume-18.2.2-1381.g3bb45379.el8 4.4 MB/s | 263 kB 00:00 2024-06-02T04:39:23.001 INFO:teuthology.orchestra.run.smithi192.stdout:(37/146): cephadm-18.2.2-1381.g3bb45379.el8.noa 2.5 MB/s | 170 kB 00:00 2024-06-02T04:39:23.027 INFO:teuthology.orchestra.run.smithi192.stdout:(38/146): cephfs-top-18.2.2-1381.g3bb45379.el8. 240 kB/s | 18 kB 00:00 2024-06-02T04:39:23.070 INFO:teuthology.orchestra.run.smithi076.stdout:(25/146): rbd-mirror-18.2.2-1381.g3bb45379.el8. 6.9 MB/s | 3.5 MB 00:00 2024-06-02T04:39:23.094 INFO:teuthology.orchestra.run.smithi192.stdout:(39/146): liboath-2.6.2-3.el8.x86_64.rpm 640 kB/s | 59 kB 00:00 2024-06-02T04:39:23.110 INFO:teuthology.orchestra.run.smithi192.stdout:(40/146): libunwind-1.3.1-3.el8.x86_64.rpm 1.0 MB/s | 75 kB 00:00 2024-06-02T04:39:23.120 INFO:teuthology.orchestra.run.smithi076.stdout:(26/146): rbd-nbd-18.2.2-1381.g3bb45379.el8.x86 3.6 MB/s | 181 kB 00:00 2024-06-02T04:39:23.136 INFO:teuthology.orchestra.run.smithi192.stdout:(41/146): gperftools-libs-2.7-9.el8.x86_64.rpm 1.9 MB/s | 306 kB 00:00 2024-06-02T04:39:23.161 INFO:teuthology.orchestra.run.smithi192.stdout:(42/146): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 869 kB/s | 44 kB 00:00 2024-06-02T04:39:23.170 INFO:teuthology.orchestra.run.smithi076.stdout:(27/146): ceph-grafana-dashboards-18.2.2-1381.g 486 kB/s | 24 kB 00:00 2024-06-02T04:39:23.186 INFO:teuthology.orchestra.run.smithi192.stdout:(43/146): python3-beautifulsoup4-4.6.3-2.el8.1. 3.6 MB/s | 185 kB 00:00 2024-06-02T04:39:23.199 INFO:teuthology.orchestra.run.smithi119.stdout:(66/146): python3-websocket-client-0.56.0-5.el8 115 kB/s | 61 kB 00:00 2024-06-02T04:39:23.212 INFO:teuthology.orchestra.run.smithi192.stdout:(44/146): python3-cachetools-3.1.1-4.el8.noarch 655 kB/s | 33 kB 00:00 2024-06-02T04:39:23.237 INFO:teuthology.orchestra.run.smithi192.stdout:(45/146): python3-certifi-2018.10.15-7.el8.noar 325 kB/s | 16 kB 00:00 2024-06-02T04:39:23.249 INFO:teuthology.orchestra.run.smithi119.stdout:(67/146): python3-webtest-2.0.33-1.el8.noarch.r 153 kB/s | 85 kB 00:00 2024-06-02T04:39:23.254 INFO:teuthology.orchestra.run.smithi076.stdout:(28/146): ceph-mgr-cephadm-18.2.2-1381.g3bb4537 1.6 MB/s | 138 kB 00:00 2024-06-02T04:39:23.262 INFO:teuthology.orchestra.run.smithi192.stdout:(46/146): python3-asyncssh-2.7.0-2.el8.noarch.r 2.8 MB/s | 476 kB 00:00 2024-06-02T04:39:23.291 INFO:teuthology.orchestra.run.smithi119.stdout:(68/146): python3-zc-lockfile-2.0-2.el8.noarch. 250 kB/s | 23 kB 00:00 2024-06-02T04:39:23.312 INFO:teuthology.orchestra.run.smithi192.stdout:(47/146): python3-cheroot-8.5.2-1.el8.noarch.rp 1.7 MB/s | 173 kB 00:00 2024-06-02T04:39:23.338 INFO:teuthology.orchestra.run.smithi192.stdout:(48/146): python3-google-auth-1.1.1-10.el8.noar 1.1 MB/s | 81 kB 00:00 2024-06-02T04:39:23.341 INFO:teuthology.orchestra.run.smithi119.stdout:(69/146): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.4 MB/s | 70 kB 00:00 2024-06-02T04:39:23.363 INFO:teuthology.orchestra.run.smithi192.stdout:(49/146): python3-jaraco-6.2-6.el8.noarch.rpm 221 kB/s | 11 kB 00:00 2024-06-02T04:39:23.388 INFO:teuthology.orchestra.run.smithi192.stdout:(50/146): python3-jaraco-functools-2.0-4.el8.no 351 kB/s | 18 kB 00:00 2024-06-02T04:39:23.396 INFO:teuthology.orchestra.run.smithi076.stdout:(29/146): librgw2-18.2.2-1381.g3bb45379.el8.x86 4.4 MB/s | 6.5 MB 00:01 2024-06-02T04:39:23.414 INFO:teuthology.orchestra.run.smithi192.stdout:(51/146): python3-cherrypy-18.4.0-1.el8.noarch. 2.1 MB/s | 384 kB 00:00 2024-06-02T04:39:23.439 INFO:teuthology.orchestra.run.smithi192.stdout:(52/146): python3-logutils-0.3.5-11.el8.noarch. 973 kB/s | 49 kB 00:00 2024-06-02T04:39:23.464 INFO:teuthology.orchestra.run.smithi192.stdout:(53/146): python3-more-itertools-7.2.0-3.el8.no 1.1 MB/s | 59 kB 00:00 2024-06-02T04:39:23.489 INFO:teuthology.orchestra.run.smithi192.stdout:(54/146): python3-natsort-7.1.1-2.el8.noarch.rp 1.2 MB/s | 60 kB 00:00 2024-06-02T04:39:23.515 INFO:teuthology.orchestra.run.smithi192.stdout:(55/146): python3-pecan-1.3.2-9.el8.noarch.rpm 5.5 MB/s | 283 kB 00:00 2024-06-02T04:39:23.517 INFO:teuthology.orchestra.run.smithi119.stdout:(70/146): python3-packaging-16.8-9.el8.noarch.r 275 kB/s | 48 kB 00:00 2024-06-02T04:39:23.540 INFO:teuthology.orchestra.run.smithi192.stdout:(56/146): python3-portend-2.6-1.el8.noarch.rpm 310 kB/s | 16 kB 00:00 2024-06-02T04:39:23.565 INFO:teuthology.orchestra.run.smithi192.stdout:(57/146): python3-repoze-lru-0.7-6.el8.noarch.r 670 kB/s | 34 kB 00:00 2024-06-02T04:39:23.600 INFO:teuthology.orchestra.run.smithi192.stdout:(58/146): python3-routes-2.4.1-12.el8.noarch.rp 3.3 MB/s | 196 kB 00:00 2024-06-02T04:39:23.625 INFO:teuthology.orchestra.run.smithi192.stdout:(59/146): python3-rsa-4.9-2.el8.noarch.rpm 1.1 MB/s | 64 kB 00:00 2024-06-02T04:39:23.650 INFO:teuthology.orchestra.run.smithi192.stdout:(60/146): python3-simplegeneric-0.8.1-17.el8.no 374 kB/s | 19 kB 00:00 2024-06-02T04:39:23.675 INFO:teuthology.orchestra.run.smithi192.stdout:(61/146): python3-kubernetes-11.0.0-6.el8.noarc 3.7 MB/s | 1.2 MB 00:00 2024-06-02T04:39:23.700 INFO:teuthology.orchestra.run.smithi192.stdout:(62/146): python3-singledispatch-3.4.0.3-18.el8 317 kB/s | 24 kB 00:00 2024-06-02T04:39:23.751 INFO:teuthology.orchestra.run.smithi192.stdout:(63/146): python3-tempora-1.14.1-5.el8.noarch.r 291 kB/s | 29 kB 00:00 2024-06-02T04:39:23.775 INFO:teuthology.orchestra.run.smithi119.stdout:(71/146): python3-jsonpointer-1.10-11.el8.noarc 77 kB/s | 20 kB 00:00 2024-06-02T04:39:23.776 INFO:teuthology.orchestra.run.smithi192.stdout:(64/146): python3-trustme-0.6.0-4.el8.noarch.rp 366 kB/s | 27 kB 00:00 2024-06-02T04:39:23.796 INFO:teuthology.orchestra.run.smithi076.stdout:(30/146): ceph-mgr-dashboard-18.2.2-1381.g3bb45 6.5 MB/s | 3.5 MB 00:00 2024-06-02T04:39:23.801 INFO:teuthology.orchestra.run.smithi192.stdout:(65/146): python3-waitress-1.4.3-1.el8.noarch.r 2.5 MB/s | 255 kB 00:00 2024-06-02T04:39:23.827 INFO:teuthology.orchestra.run.smithi192.stdout:(66/146): python3-webob-1.8.5-1.el8.1.noarch.rp 3.3 MB/s | 251 kB 00:00 2024-06-02T04:39:23.852 INFO:teuthology.orchestra.run.smithi192.stdout:(67/146): python3-websocket-client-0.56.0-5.el8 811 kB/s | 61 kB 00:00 2024-06-02T04:39:23.863 INFO:teuthology.orchestra.run.smithi076.stdout:(31/146): ceph-mgr-modules-core-18.2.2-1381.g3b 3.6 MB/s | 246 kB 00:00 2024-06-02T04:39:23.877 INFO:teuthology.orchestra.run.smithi192.stdout:(68/146): python3-zc-lockfile-2.0-2.el8.noarch. 457 kB/s | 23 kB 00:00 2024-06-02T04:39:23.902 INFO:teuthology.orchestra.run.smithi192.stdout:(69/146): python3-webtest-2.0.33-1.el8.noarch.r 848 kB/s | 85 kB 00:00 2024-06-02T04:39:23.905 INFO:teuthology.orchestra.run.smithi076.stdout:(32/146): ceph-mgr-rook-18.2.2-1381.g3bb45379.e 1.2 MB/s | 49 kB 00:00 2024-06-02T04:39:23.909 INFO:teuthology.orchestra.run.smithi119.stdout:(72/146): python3-prettytable-0.7.2-14.el8.noar 329 kB/s | 44 kB 00:00 2024-06-02T04:39:23.928 INFO:teuthology.orchestra.run.smithi192.stdout:(70/146): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.4 MB/s | 70 kB 00:00 2024-06-02T04:39:23.947 INFO:teuthology.orchestra.run.smithi076.stdout:(33/146): ceph-prometheus-alerts-18.2.2-1381.g3 394 kB/s | 16 kB 00:00 2024-06-02T04:39:23.951 INFO:teuthology.orchestra.run.smithi119.stdout:(73/146): python3-pyasn1-modules-0.3.7-6.el8.no 2.6 MB/s | 110 kB 00:00 2024-06-02T04:39:23.978 INFO:teuthology.orchestra.run.smithi192.stdout:(71/146): thrift-0.13.0-2.el8.x86_64.rpm 14 MB/s | 1.7 MB 00:00 2024-06-02T04:39:24.047 INFO:teuthology.orchestra.run.smithi076.stdout:(34/146): ceph-volume-18.2.2-1381.g3bb45379.el8 2.6 MB/s | 263 kB 00:00 2024-06-02T04:39:24.053 INFO:teuthology.orchestra.run.smithi192.stdout:(72/146): python3-packaging-16.8-9.el8.noarch.r 320 kB/s | 48 kB 00:00 2024-06-02T04:39:24.070 INFO:teuthology.orchestra.run.smithi192.stdout:(73/146): libverto-devel-0.3.0-5.el8.x86_64.rpm 131 kB/s | 18 kB 00:00 2024-06-02T04:39:24.097 INFO:teuthology.orchestra.run.smithi076.stdout:(35/146): cephadm-18.2.2-1381.g3bb45379.el8.noa 3.3 MB/s | 170 kB 00:00 2024-06-02T04:39:24.110 INFO:teuthology.orchestra.run.smithi119.stdout:(74/146): thrift-0.13.0-2.el8.x86_64.rpm 2.0 MB/s | 1.7 MB 00:00 2024-06-02T04:39:24.131 INFO:teuthology.orchestra.run.smithi076.stdout:(36/146): cephfs-top-18.2.2-1381.g3bb45379.el8. 545 kB/s | 18 kB 00:00 2024-06-02T04:39:24.135 INFO:teuthology.orchestra.run.smithi119.stdout:(75/146): python3-jsonpatch-1.21-2.el8.noarch.r 145 kB/s | 27 kB 00:00 2024-06-02T04:39:24.187 INFO:teuthology.orchestra.run.smithi192.stdout:(74/146): python3-jwt-1.6.1-2.el8.noarch.rpm 209 kB/s | 43 kB 00:00 2024-06-02T04:39:24.213 INFO:teuthology.orchestra.run.smithi192.stdout:(75/146): python3-oauthlib-2.1.0-1.el8.noarch.r 975 kB/s | 155 kB 00:00 2024-06-02T04:39:24.238 INFO:teuthology.orchestra.run.smithi192.stdout:(76/146): python3-pycparser-2.14-14.el8.noarch. 652 kB/s | 109 kB 00:00 2024-06-02T04:39:24.294 INFO:teuthology.orchestra.run.smithi119.stdout:(76/146): python3-pyasn1-0.3.7-6.el8.noarch.rpm 689 kB/s | 126 kB 00:00 2024-06-02T04:39:24.313 INFO:teuthology.orchestra.run.smithi192.stdout:(77/146): python3-requests-oauthlib-1.0.0-1.el8 340 kB/s | 43 kB 00:00 2024-06-02T04:39:24.327 INFO:teuthology.orchestra.run.smithi119.stdout:(77/146): python3-werkzeug-0.12.2-4.el8.noarch. 2.4 MB/s | 457 kB 00:00 2024-06-02T04:39:24.355 INFO:teuthology.orchestra.run.smithi192.stdout:(78/146): libaio-devel-0.3.112-1.el8.x86_64.rpm 132 kB/s | 19 kB 00:00 2024-06-02T04:39:24.372 INFO:teuthology.orchestra.run.smithi192.stdout:(79/146): libzstd-devel-1.4.4-1.el8.x86_64.rpm 327 kB/s | 44 kB 00:00 2024-06-02T04:39:24.469 INFO:teuthology.orchestra.run.smithi119.stdout:(78/146): bison-3.0.4-10.el8.x86_64.rpm 3.8 MB/s | 688 kB 00:00 2024-06-02T04:39:24.472 INFO:teuthology.orchestra.run.smithi192.stdout:(80/146): pcre2-utf16-10.32-2.el8.x86_64.rpm 1.9 MB/s | 229 kB 00:00 2024-06-02T04:39:24.484 INFO:teuthology.orchestra.run.smithi076.stdout:(37/146): ceph-mgr-diskprediction-local-18.2.2- 6.8 MB/s | 7.4 MB 00:01 2024-06-02T04:39:24.494 INFO:teuthology.orchestra.run.smithi119.stdout:(79/146): flex-2.6.1-9.el8.x86_64.rpm 1.9 MB/s | 320 kB 00:00 2024-06-02T04:39:24.582 INFO:teuthology.orchestra.run.smithi076.stdout:(38/146): gperftools-libs-2.7-9.el8.x86_64.rpm 680 kB/s | 306 kB 00:00 2024-06-02T04:39:24.620 INFO:teuthology.orchestra.run.smithi119.stdout:(80/146): libtool-2.4.6-25.el8.x86_64.rpm 4.6 MB/s | 709 kB 00:00 2024-06-02T04:39:24.645 INFO:teuthology.orchestra.run.smithi119.stdout:(81/146): python3-markupsafe-0.23-19.el8.x86_64 258 kB/s | 39 kB 00:00 2024-06-02T04:39:24.665 INFO:teuthology.orchestra.run.smithi076.stdout:(39/146): libunwind-1.3.1-3.el8.x86_64.rpm 903 kB/s | 75 kB 00:00 2024-06-02T04:39:24.764 INFO:teuthology.orchestra.run.smithi192.stdout:(81/146): pcre2-devel-10.32-2.el8.x86_64.rpm 1.3 MB/s | 605 kB 00:00 2024-06-02T04:39:24.766 INFO:teuthology.orchestra.run.smithi076.stdout:(40/146): liboath-2.6.2-3.el8.x86_64.rpm 207 kB/s | 59 kB 00:00 2024-06-02T04:39:24.771 INFO:teuthology.orchestra.run.smithi119.stdout:(82/146): uuid-1.6.2-43.el8.x86_64.rpm 511 kB/s | 64 kB 00:00 2024-06-02T04:39:24.790 INFO:teuthology.orchestra.run.smithi192.stdout:(82/146): libselinux-devel-2.9-5.el8.x86_64.rpm 630 kB/s | 200 kB 00:00 2024-06-02T04:39:24.796 INFO:teuthology.orchestra.run.smithi119.stdout:(83/146): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.4 MB/s | 259 kB 00:00 2024-06-02T04:39:24.815 INFO:teuthology.orchestra.run.smithi192.stdout:(83/146): pcre2-utf32-10.32-2.el8.x86_64.rpm 498 kB/s | 220 kB 00:00 2024-06-02T04:39:24.841 INFO:teuthology.orchestra.run.smithi076.stdout:(41/146): python3-asyncssh-2.7.0-2.el8.noarch.r 2.7 MB/s | 476 kB 00:00 2024-06-02T04:39:24.866 INFO:teuthology.orchestra.run.smithi076.stdout:(42/146): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 435 kB/s | 44 kB 00:00 2024-06-02T04:39:24.879 INFO:teuthology.orchestra.run.smithi119.stdout:(84/146): python3-pyOpenSSL-19.0.0-1.el8.noarch 954 kB/s | 103 kB 00:00 2024-06-02T04:39:24.882 INFO:teuthology.orchestra.run.smithi192.stdout:(84/146): keyutils-libs-devel-1.5.10-9.el8.x86_ 410 kB/s | 48 kB 00:00 2024-06-02T04:39:24.907 INFO:teuthology.orchestra.run.smithi192.stdout:(85/146): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 628 kB/s | 58 kB 00:00 2024-06-02T04:39:24.925 INFO:teuthology.orchestra.run.smithi192.stdout:(86/146): libsepol-devel-2.9-3.el8.x86_64.rpm 647 kB/s | 87 kB 00:00 2024-06-02T04:39:24.926 INFO:teuthology.orchestra.run.smithi076.stdout:(43/146): python3-beautifulsoup4-4.6.3-2.el8.1. 2.2 MB/s | 185 kB 00:00 2024-06-02T04:39:24.951 INFO:teuthology.orchestra.run.smithi076.stdout:(44/146): python3-cachetools-3.1.1-4.el8.noarch 395 kB/s | 33 kB 00:00 2024-06-02T04:39:25.000 INFO:teuthology.orchestra.run.smithi076.stdout:(45/146): python3-certifi-2018.10.15-7.el8.noar 217 kB/s | 16 kB 00:00 2024-06-02T04:39:25.038 INFO:teuthology.orchestra.run.smithi119.stdout:(85/146): python3-babel-2.5.1-7.el8.noarch.rpm 20 MB/s | 4.8 MB 00:00 2024-06-02T04:39:25.071 INFO:teuthology.orchestra.run.smithi119.stdout:(86/146): python3-jinja2-2.10.1-3.el8.noarch.rp 2.7 MB/s | 538 kB 00:00 2024-06-02T04:39:25.079 INFO:teuthology.orchestra.run.smithi192.stdout:(87/146): fuse-2.9.7-17.el8.x86_64.rpm 482 kB/s | 83 kB 00:00 2024-06-02T04:39:25.100 INFO:teuthology.orchestra.run.smithi076.stdout:(46/146): python3-cherrypy-18.4.0-1.el8.noarch. 3.8 MB/s | 384 kB 00:00 2024-06-02T04:39:25.108 INFO:teuthology.orchestra.run.smithi192.stdout:(88/146): libcom_err-devel-1.45.6-4.el8.x86_64. 171 kB/s | 39 kB 00:00 2024-06-02T04:39:25.126 INFO:teuthology.orchestra.run.smithi076.stdout:(47/146): python3-cheroot-8.5.2-1.el8.noarch.rp 984 kB/s | 173 kB 00:00 2024-06-02T04:39:25.142 INFO:teuthology.orchestra.run.smithi192.stdout:(89/146): libgfortran-8.5.0-20.el8.x86_64.rpm 2.9 MB/s | 645 kB 00:00 2024-06-02T04:39:25.176 INFO:teuthology.orchestra.run.smithi076.stdout:(48/146): python3-google-auth-1.1.1-10.el8.noar 1.1 MB/s | 81 kB 00:00 2024-06-02T04:39:25.202 INFO:teuthology.orchestra.run.smithi076.stdout:(49/146): python3-jaraco-6.2-6.el8.noarch.rpm 147 kB/s | 11 kB 00:00 2024-06-02T04:39:25.214 INFO:teuthology.orchestra.run.smithi119.stdout:(87/146): python3-numpy-1.14.3-10.el8.x86_64.rp 21 MB/s | 3.7 MB 00:00 2024-06-02T04:39:25.226 INFO:teuthology.orchestra.run.smithi192.stdout:(90/146): python3-cffi-1.11.5-6.el8.x86_64.rpm 2.0 MB/s | 238 kB 00:00 2024-06-02T04:39:25.238 INFO:teuthology.orchestra.run.smithi119.stdout:(88/146): socat-1.7.4.1-1.el8.x86_64.rpm 1.9 MB/s | 323 kB 00:00 2024-06-02T04:39:25.251 INFO:teuthology.orchestra.run.smithi192.stdout:(91/146): libquadmath-8.5.0-20.el8.x86_64.rpm 1.0 MB/s | 172 kB 00:00 2024-06-02T04:39:25.251 INFO:teuthology.orchestra.run.smithi076.stdout:(50/146): python3-jaraco-functools-2.0-4.el8.no 233 kB/s | 18 kB 00:00 2024-06-02T04:39:25.322 INFO:teuthology.orchestra.run.smithi119.stdout:(89/146): python3-numpy-f2py-1.14.3-10.el8.x86_ 2.0 MB/s | 225 kB 00:00 2024-06-02T04:39:25.327 INFO:teuthology.orchestra.run.smithi192.stdout:(92/146): elfutils-libelf-devel-0.189-3.el8.x86 617 kB/s | 62 kB 00:00 2024-06-02T04:39:25.348 INFO:teuthology.orchestra.run.smithi119.stdout:(90/146): librdkafka-0.11.4-3.el8.x86_64.rpm 3.2 MB/s | 354 kB 00:00 2024-06-02T04:39:25.351 INFO:teuthology.orchestra.run.smithi192.stdout:(93/146): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 347 kB/s | 73 kB 00:00 2024-06-02T04:39:25.352 INFO:teuthology.orchestra.run.smithi076.stdout:(51/146): python3-logutils-0.3.5-11.el8.noarch. 487 kB/s | 49 kB 00:00 2024-06-02T04:39:25.435 INFO:teuthology.orchestra.run.smithi076.stdout:(52/146): python3-kubernetes-11.0.0-6.el8.noarc 5.0 MB/s | 1.2 MB 00:00 2024-06-02T04:39:25.461 INFO:teuthology.orchestra.run.smithi076.stdout:(53/146): python3-more-itertools-7.2.0-3.el8.no 542 kB/s | 59 kB 00:00 2024-06-02T04:39:25.511 INFO:teuthology.orchestra.run.smithi076.stdout:(54/146): python3-natsort-7.1.1-2.el8.noarch.rp 801 kB/s | 60 kB 00:00 2024-06-02T04:39:25.523 INFO:teuthology.orchestra.run.smithi119.stdout:(91/146): python3-mako-1.0.6-14.el8.noarch.rpm 897 kB/s | 157 kB 00:00 2024-06-02T04:39:25.528 INFO:teuthology.orchestra.run.smithi192.stdout:(94/146): openssl-devel-1.1.1k-12.el8_9.x86_64. 12 MB/s | 2.3 MB 00:00 2024-06-02T04:39:25.553 INFO:teuthology.orchestra.run.smithi076.stdout:(55/146): python3-pecan-1.3.2-9.el8.noarch.rpm 3.0 MB/s | 283 kB 00:00 2024-06-02T04:39:25.568 INFO:teuthology.orchestra.run.smithi192.stdout:(95/146): krb5-devel-1.18.2-26.el8_9.x86_64.rpm 1.7 MB/s | 562 kB 00:00 2024-06-02T04:39:25.621 INFO:teuthology.orchestra.run.smithi076.stdout:(56/146): python3-portend-2.6-1.el8.noarch.rpm 142 kB/s | 16 kB 00:00 2024-06-02T04:39:25.654 INFO:teuthology.orchestra.run.smithi076.stdout:(57/146): python3-repoze-lru-0.7-6.el8.noarch.r 335 kB/s | 34 kB 00:00 2024-06-02T04:39:25.665 INFO:teuthology.orchestra.run.smithi119.stdout:(92/146): openblas-threads-0.3.15-6.el8.x86_64. 15 MB/s | 5.2 MB 00:00 2024-06-02T04:39:25.677 INFO:teuthology.orchestra.run.smithi192.stdout:(96/146): librabbitmq-0.9.0-5.el8_9.x86_64.rpm 145 kB/s | 47 kB 00:00 2024-06-02T04:39:25.695 INFO:teuthology.orchestra.run.smithi076.stdout:(58/146): python3-routes-2.4.1-12.el8.noarch.rp 2.6 MB/s | 196 kB 00:00 2024-06-02T04:39:25.711 INFO:teuthology.orchestra.run.smithi192.stdout:(97/146): python3-cryptography-3.2.1-7.el8_9.x8 3.0 MB/s | 559 kB 00:00 2024-06-02T04:39:25.729 INFO:teuthology.orchestra.run.smithi076.stdout:(59/146): python3-rsa-4.9-2.el8.noarch.rpm 854 kB/s | 64 kB 00:00 2024-06-02T04:39:25.736 INFO:teuthology.orchestra.run.smithi192.stdout:(98/146): NetworkManager-initscripts-updown-1.4 863 kB/s | 144 kB 00:00 2024-06-02T04:39:25.770 INFO:teuthology.orchestra.run.smithi192.stdout:(99/146): libuuid-devel-2.32.1-44.el8_9.1.x86_6 1.1 MB/s | 100 kB 00:00 2024-06-02T04:39:25.771 INFO:teuthology.orchestra.run.smithi076.stdout:(60/146): python3-simplegeneric-0.8.1-17.el8.no 249 kB/s | 19 kB 00:00 2024-06-02T04:39:25.773 INFO:teuthology.orchestra.run.smithi119.stdout:(93/146): openblas-0.3.15-6.el8.x86_64.rpm 20 MB/s | 5.0 MB 00:00 2024-06-02T04:39:25.803 INFO:teuthology.orchestra.run.smithi192.stdout:(100/146): python3-jsonpointer-1.10-11.el8.noar 217 kB/s | 20 kB 00:00 2024-06-02T04:39:25.805 INFO:teuthology.orchestra.run.smithi076.stdout:(61/146): python3-singledispatch-3.4.0.3-18.el8 318 kB/s | 24 kB 00:00 2024-06-02T04:39:25.829 INFO:teuthology.orchestra.run.smithi192.stdout:(101/146): python3-prettytable-0.7.2-14.el8.noa 477 kB/s | 44 kB 00:00 2024-06-02T04:39:25.840 INFO:teuthology.orchestra.run.smithi119.stdout:(94/146): automake-1.16.1-8.el8.noarch.rpm 4.0 MB/s | 714 kB 00:00 2024-06-02T04:39:25.847 INFO:teuthology.orchestra.run.smithi076.stdout:(62/146): python3-tempora-1.14.1-5.el8.noarch.r 389 kB/s | 29 kB 00:00 2024-06-02T04:39:25.896 INFO:teuthology.orchestra.run.smithi192.stdout:(102/146): python3-pyasn1-modules-0.3.7-6.el8.n 876 kB/s | 110 kB 00:00 2024-06-02T04:39:25.905 INFO:teuthology.orchestra.run.smithi076.stdout:(63/146): python3-trustme-0.6.0-4.el8.noarch.rp 275 kB/s | 27 kB 00:00 2024-06-02T04:39:25.921 INFO:teuthology.orchestra.run.smithi192.stdout:(103/146): python3-jsonpatch-1.21-2.el8.noarch. 226 kB/s | 27 kB 00:00 2024-06-02T04:39:25.924 INFO:teuthology.orchestra.run.smithi119.stdout:(95/146): libpq-13.11-1.el8.x86_64.rpm 1.3 MB/s | 198 kB 00:00 2024-06-02T04:39:25.930 INFO:teuthology.orchestra.run.smithi076.stdout:(64/146): python3-waitress-1.4.3-1.el8.noarch.r 3.0 MB/s | 255 kB 00:00 2024-06-02T04:39:25.988 INFO:teuthology.orchestra.run.smithi192.stdout:(104/146): python3-pyasn1-0.3.7-6.el8.noarch.rp 795 kB/s | 126 kB 00:00 2024-06-02T04:39:25.997 INFO:teuthology.orchestra.run.smithi076.stdout:(65/146): python3-webob-1.8.5-1.el8.1.noarch.rp 2.7 MB/s | 251 kB 00:00 2024-06-02T04:39:26.021 INFO:teuthology.orchestra.run.smithi192.stdout:(105/146): python3-werkzeug-0.12.2-4.el8.noarch 3.6 MB/s | 457 kB 00:00 2024-06-02T04:39:26.023 INFO:teuthology.orchestra.run.smithi076.stdout:(66/146): python3-websocket-client-0.56.0-5.el8 667 kB/s | 61 kB 00:00 2024-06-02T04:39:26.032 INFO:teuthology.orchestra.run.smithi119.stdout:(96/146): jq-1.6-7.el8.x86_64.rpm 1.0 MB/s | 202 kB 00:00 2024-06-02T04:39:26.055 INFO:teuthology.orchestra.run.smithi192.stdout:(106/146): bison-3.0.4-10.el8.x86_64.rpm 5.0 MB/s | 688 kB 00:00 2024-06-02T04:39:26.073 INFO:teuthology.orchestra.run.smithi076.stdout:(67/146): python3-webtest-2.0.33-1.el8.noarch.r 1.1 MB/s | 85 kB 00:00 2024-06-02T04:39:26.074 INFO:teuthology.orchestra.run.smithi119.stdout:(97/146): python3-pytz-2017.2-11.el8.noarch.rpm 361 kB/s | 54 kB 00:00 2024-06-02T04:39:26.080 INFO:teuthology.orchestra.run.smithi192.stdout:(107/146): flex-2.6.1-9.el8.x86_64.rpm 3.4 MB/s | 320 kB 00:00 2024-06-02T04:39:26.098 INFO:teuthology.orchestra.run.smithi076.stdout:(68/146): python3-zc-lockfile-2.0-2.el8.noarch. 305 kB/s | 23 kB 00:00 2024-06-02T04:39:26.144 INFO:teuthology.orchestra.run.smithi076.stdout:(69/146): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.5 MB/s | 70 kB 00:00 2024-06-02T04:39:26.147 INFO:teuthology.orchestra.run.smithi192.stdout:(108/146): libtool-2.4.6-25.el8.x86_64.rpm 5.5 MB/s | 709 kB 00:00 2024-06-02T04:39:26.198 INFO:teuthology.orchestra.run.smithi192.stdout:(109/146): lttng-ust-2.8.1-11.el8.x86_64.rpm 2.2 MB/s | 259 kB 00:00 2024-06-02T04:39:26.208 INFO:teuthology.orchestra.run.smithi119.stdout:(98/146): oniguruma-6.8.2-2.1.el8_9.x86_64.rpm 1.4 MB/s | 188 kB 00:00 2024-06-02T04:39:26.223 INFO:teuthology.orchestra.run.smithi192.stdout:(110/146): python3-markupsafe-0.23-19.el8.x86_6 232 kB/s | 39 kB 00:00 2024-06-02T04:39:26.248 INFO:teuthology.orchestra.run.smithi192.stdout:(111/146): uuid-1.6.2-43.el8.x86_64.rpm 637 kB/s | 64 kB 00:00 2024-06-02T04:39:26.265 INFO:teuthology.orchestra.run.smithi076.stdout:(70/146): thrift-0.13.0-2.el8.x86_64.rpm 9.0 MB/s | 1.7 MB 00:00 2024-06-02T04:39:26.315 INFO:teuthology.orchestra.run.smithi076.stdout:(71/146): python3-packaging-16.8-9.el8.noarch.r 281 kB/s | 48 kB 00:00 2024-06-02T04:39:26.332 INFO:teuthology.orchestra.run.smithi192.stdout:(112/146): python3-pyOpenSSL-19.0.0-1.el8.noarc 774 kB/s | 103 kB 00:00 2024-06-02T04:39:26.414 INFO:teuthology.orchestra.run.smithi076.stdout:(72/146): python3-prettytable-0.7.2-14.el8.noar 450 kB/s | 44 kB 00:00 2024-06-02T04:39:26.424 INFO:teuthology.orchestra.run.smithi192.stdout:(113/146): python3-jinja2-2.10.1-3.el8.noarch.r 3.0 MB/s | 538 kB 00:00 2024-06-02T04:39:26.474 INFO:teuthology.orchestra.run.smithi076.stdout:(73/146): python3-jsonpointer-1.10-11.el8.noarc 96 kB/s | 20 kB 00:00 2024-06-02T04:39:26.491 INFO:teuthology.orchestra.run.smithi192.stdout:(114/146): python3-babel-2.5.1-7.el8.noarch.rpm 18 MB/s | 4.8 MB 00:00 2024-06-02T04:39:26.500 INFO:teuthology.orchestra.run.smithi119.stdout:(99/146): python3-scipy-1.0.0-21.module+el8.9.0 29 MB/s | 14 MB 00:00 2024-06-02T04:39:26.542 INFO:teuthology.orchestra.run.smithi119.stdout:(100/146): postgresql-10.23-4.module+el8.9.0+21 4.5 MB/s | 1.5 MB 00:00 2024-06-02T04:39:26.591 INFO:teuthology.orchestra.run.smithi192.stdout:(115/146): python3-numpy-1.14.3-10.el8.x86_64.r 14 MB/s | 3.7 MB 00:00 2024-06-02T04:39:26.616 INFO:teuthology.orchestra.run.smithi192.stdout:(116/146): python3-numpy-f2py-1.14.3-10.el8.x86 1.8 MB/s | 225 kB 00:00 2024-06-02T04:39:26.642 INFO:teuthology.orchestra.run.smithi192.stdout:(117/146): socat-1.7.4.1-1.el8.x86_64.rpm 1.4 MB/s | 323 kB 00:00 2024-06-02T04:39:26.708 INFO:teuthology.orchestra.run.smithi076.stdout:(74/146): python3-pyasn1-modules-0.3.7-6.el8.no 374 kB/s | 110 kB 00:00 2024-06-02T04:39:26.733 INFO:teuthology.orchestra.run.smithi076.stdout:(75/146): python3-jsonpatch-1.21-2.el8.noarch.r 103 kB/s | 27 kB 00:00 2024-06-02T04:39:26.759 INFO:teuthology.orchestra.run.smithi192.stdout:(118/146): librdkafka-0.11.4-3.el8.x86_64.rpm 2.1 MB/s | 354 kB 00:00 2024-06-02T04:39:26.792 INFO:teuthology.orchestra.run.smithi119.stdout:(101/146): postgresql-server-10.23-4.module+el8 20 MB/s | 5.1 MB 00:00 2024-06-02T04:39:26.821 INFO:teuthology.orchestra.run.smithi192.stdout:(119/146): python3-mako-1.0.6-14.el8.noarch.rpm 878 kB/s | 157 kB 00:00 2024-06-02T04:39:26.842 INFO:teuthology.orchestra.run.smithi119.stdout:(102/146): postgresql-contrib-10.23-4.module+el 2.3 MB/s | 812 kB 00:00 2024-06-02T04:39:26.926 INFO:teuthology.orchestra.run.smithi192.stdout:(120/146): openblas-threads-0.3.15-6.el8.x86_64 17 MB/s | 5.2 MB 00:00 2024-06-02T04:39:26.934 INFO:teuthology.orchestra.run.smithi119.stdout:(103/146): libverto-devel-0.3.0-5.el8.x86_64.rp 126 kB/s | 18 kB 00:00 2024-06-02T04:39:26.960 INFO:teuthology.orchestra.run.smithi192.stdout:(121/146): automake-1.16.1-8.el8.noarch.rpm 5.0 MB/s | 714 kB 00:00 2024-06-02T04:39:26.960 INFO:teuthology.orchestra.run.smithi119.stdout:(104/146): python3-jwt-1.6.1-2.el8.noarch.rpm 364 kB/s | 43 kB 00:00 2024-06-02T04:39:27.060 INFO:teuthology.orchestra.run.smithi119.stdout:(105/146): python3-oauthlib-2.1.0-1.el8.noarch. 1.2 MB/s | 155 kB 00:00 2024-06-02T04:39:27.068 INFO:teuthology.orchestra.run.smithi192.stdout:(122/146): openblas-0.3.15-6.el8.x86_64.rpm 16 MB/s | 5.0 MB 00:00 2024-06-02T04:39:27.093 INFO:teuthology.orchestra.run.smithi192.stdout:(123/146): libpq-13.11-1.el8.x86_64.rpm 1.2 MB/s | 198 kB 00:00 2024-06-02T04:39:27.102 INFO:teuthology.orchestra.run.smithi119.stdout:(106/146): python3-pycparser-2.14-14.el8.noarch 769 kB/s | 109 kB 00:00 2024-06-02T04:39:27.127 INFO:teuthology.orchestra.run.smithi192.stdout:(124/146): jq-1.6-7.el8.x86_64.rpm 1.2 MB/s | 202 kB 00:00 2024-06-02T04:39:27.172 INFO:teuthology.orchestra.run.smithi119.stdout:(107/146): python3-requests-oauthlib-1.0.0-1.el 382 kB/s | 43 kB 00:00 2024-06-02T04:39:27.177 INFO:teuthology.orchestra.run.smithi192.stdout:(125/146): python3-pytz-2017.2-11.el8.noarch.rp 498 kB/s | 54 kB 00:00 2024-06-02T04:39:27.203 INFO:teuthology.orchestra.run.smithi119.stdout:(108/146): libaio-devel-0.3.112-1.el8.x86_64.rp 186 kB/s | 19 kB 00:00 2024-06-02T04:39:27.203 INFO:teuthology.orchestra.run.smithi192.stdout:(126/146): oniguruma-6.8.2-2.1.el8_9.x86_64.rpm 2.4 MB/s | 188 kB 00:00 2024-06-02T04:39:27.270 INFO:teuthology.orchestra.run.smithi119.stdout:(109/146): libzstd-devel-1.4.4-1.el8.x86_64.rpm 452 kB/s | 44 kB 00:00 2024-06-02T04:39:27.303 INFO:teuthology.orchestra.run.smithi192.stdout:(127/146): postgresql-contrib-10.23-4.module+el 7.9 MB/s | 812 kB 00:00 2024-06-02T04:39:27.320 INFO:teuthology.orchestra.run.smithi119.stdout:(110/146): pcre2-devel-10.32-2.el8.x86_64.rpm 5.1 MB/s | 605 kB 00:00 2024-06-02T04:39:27.342 INFO:teuthology.orchestra.run.smithi076.stdout:(76/146): ceph-test-18.2.2-1381.g3bb45379.el8.x 6.7 MB/s | 47 MB 00:06 2024-06-02T04:39:27.347 INFO:teuthology.orchestra.run.smithi119.stdout:(111/146): pcre2-utf16-10.32-2.el8.x86_64.rpm 2.9 MB/s | 229 kB 00:00 2024-06-02T04:39:27.361 INFO:teuthology.orchestra.run.smithi192.stdout:(128/146): postgresql-10.23-4.module+el8.9.0+21 8.2 MB/s | 1.5 MB 00:00 2024-06-02T04:39:27.370 INFO:teuthology.orchestra.run.smithi076.stdout:(77/146): python3-pyasn1-0.3.7-6.el8.noarch.rpm 192 kB/s | 126 kB 00:00 2024-06-02T04:39:27.401 INFO:teuthology.orchestra.run.smithi076.stdout:(78/146): python3-werkzeug-0.12.2-4.el8.noarch. 686 kB/s | 457 kB 00:00 2024-06-02T04:39:27.489 INFO:teuthology.orchestra.run.smithi119.stdout:(112/146): pcre2-utf32-10.32-2.el8.x86_64.rpm 1.3 MB/s | 220 kB 00:00 2024-06-02T04:39:27.514 INFO:teuthology.orchestra.run.smithi119.stdout:(113/146): libselinux-devel-2.9-5.el8.x86_64.rp 1.2 MB/s | 200 kB 00:00 2024-06-02T04:39:27.535 INFO:teuthology.orchestra.run.smithi076.stdout:(79/146): bison-3.0.4-10.el8.x86_64.rpm 3.5 MB/s | 688 kB 00:00 2024-06-02T04:39:27.537 INFO:teuthology.orchestra.run.smithi192.stdout:(129/146): python3-scipy-1.0.0-21.module+el8.9. 31 MB/s | 14 MB 00:00 2024-06-02T04:39:27.568 INFO:teuthology.orchestra.run.smithi076.stdout:(80/146): flex-2.6.1-9.el8.x86_64.rpm 1.6 MB/s | 320 kB 00:00 2024-06-02T04:39:27.590 INFO:teuthology.orchestra.run.smithi119.stdout:(114/146): keyutils-libs-devel-1.5.10-9.el8.x86 480 kB/s | 48 kB 00:00 2024-06-02T04:39:27.602 INFO:teuthology.orchestra.run.smithi076.stdout:(81/146): libtool-2.4.6-25.el8.x86_64.rpm 3.4 MB/s | 709 kB 00:00 2024-06-02T04:39:27.615 INFO:teuthology.orchestra.run.smithi119.stdout:(115/146): libsepol-devel-2.9-3.el8.x86_64.rpm 869 kB/s | 87 kB 00:00 2024-06-02T04:39:27.627 INFO:teuthology.orchestra.run.smithi076.stdout:(82/146): python3-markupsafe-0.23-19.el8.x86_64 422 kB/s | 39 kB 00:00 2024-06-02T04:39:27.629 INFO:teuthology.orchestra.run.smithi192.stdout:(130/146): postgresql-server-10.23-4.module+el8 16 MB/s | 5.1 MB 00:00 2024-06-02T04:39:27.702 INFO:teuthology.orchestra.run.smithi076.stdout:(83/146): uuid-1.6.2-43.el8.x86_64.rpm 639 kB/s | 64 kB 00:00 2024-06-02T04:39:27.715 INFO:teuthology.orchestra.run.smithi119.stdout:(116/146): libcom_err-devel-1.45.6-4.el8.x86_64 386 kB/s | 39 kB 00:00 2024-06-02T04:39:27.754 INFO:teuthology.orchestra.run.smithi192.stdout:(131/146): elfutils-libelf-0.189-3.el8.x86_64.r 1.8 MB/s | 232 kB 00:00 2024-06-02T04:39:27.770 INFO:teuthology.orchestra.run.smithi076.stdout:(84/146): python3-pyOpenSSL-19.0.0-1.el8.noarch 728 kB/s | 103 kB 00:00 2024-06-02T04:39:27.774 INFO:teuthology.orchestra.run.smithi119.stdout:(117/146): zlib-devel-1.2.11-18.el8_5.x86_64.rp 313 kB/s | 58 kB 00:00 2024-06-02T04:39:27.799 INFO:teuthology.orchestra.run.smithi119.stdout:(118/146): fuse-2.9.7-17.el8.x86_64.rpm 993 kB/s | 83 kB 00:00 2024-06-02T04:39:27.803 INFO:teuthology.orchestra.run.smithi076.stdout:(85/146): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.1 MB/s | 259 kB 00:00 2024-06-02T04:39:27.846 INFO:teuthology.orchestra.run.smithi192.stdout:(132/146): librados2-18.2.2-1381.g3bb45379.el8. 7.6 MB/s | 3.7 MB 00:00 2024-06-02T04:39:27.861 INFO:teuthology.orchestra.run.smithi076.stdout:(86/146): python3-jinja2-2.10.1-3.el8.noarch.rp 5.8 MB/s | 538 kB 00:00 2024-06-02T04:39:27.871 INFO:teuthology.orchestra.run.smithi192.stdout:(133/146): elfutils-libs-0.189-3.el8.x86_64.rpm 2.5 MB/s | 303 kB 00:00 2024-06-02T04:39:27.874 INFO:teuthology.orchestra.run.smithi119.stdout:(119/146): libgfortran-8.5.0-20.el8.x86_64.rpm 6.3 MB/s | 645 kB 00:00 2024-06-02T04:39:27.925 INFO:teuthology.orchestra.run.smithi119.stdout:(120/146): libquadmath-8.5.0-20.el8.x86_64.rpm 1.3 MB/s | 172 kB 00:00 2024-06-02T04:39:27.937 INFO:teuthology.orchestra.run.smithi076.stdout:(87/146): python3-babel-2.5.1-7.el8.noarch.rpm 20 MB/s | 4.8 MB 00:00 2024-06-02T04:39:27.972 INFO:teuthology.orchestra.run.smithi192.stdout:(134/146): iproute-6.2.0-5.el8_9.x86_64.rpm 6.7 MB/s | 854 kB 00:00 2024-06-02T04:39:27.996 INFO:teuthology.orchestra.run.smithi076.stdout:(88/146): socat-1.7.4.1-1.el8.x86_64.rpm 2.4 MB/s | 323 kB 00:00 2024-06-02T04:39:28.000 INFO:teuthology.orchestra.run.smithi119.stdout:(121/146): python3-cffi-1.11.5-6.el8.x86_64.rpm 1.9 MB/s | 238 kB 00:00 2024-06-02T04:39:28.047 INFO:teuthology.orchestra.run.smithi192.stdout:(135/146): librbd1-18.2.2-1381.g3bb45379.el8.x8 7.0 MB/s | 3.6 MB 00:00 2024-06-02T04:39:28.059 INFO:teuthology.orchestra.run.smithi119.stdout:(122/146): xfsprogs-devel-5.0.0-12.el8.x86_64.r 544 kB/s | 73 kB 00:00 2024-06-02T04:39:28.080 INFO:teuthology.orchestra.run.smithi192.stdout:(136/146): openssl-1.1.1k-12.el8_9.x86_64.rpm 3.3 MB/s | 711 kB 00:00 2024-06-02T04:39:28.087 INFO:teuthology.orchestra.run.smithi076.stdout:(89/146): python3-numpy-1.14.3-10.el8.x86_64.rp 13 MB/s | 3.7 MB 00:00 2024-06-02T04:39:28.112 INFO:teuthology.orchestra.run.smithi076.stdout:(90/146): python3-numpy-f2py-1.14.3-10.el8.x86_ 1.3 MB/s | 225 kB 00:00 2024-06-02T04:39:28.117 INFO:teuthology.orchestra.run.smithi119.stdout:(123/146): elfutils-libelf-devel-0.189-3.el8.x8 528 kB/s | 62 kB 00:00 2024-06-02T04:39:28.162 INFO:teuthology.orchestra.run.smithi076.stdout:(91/146): librdkafka-0.11.4-3.el8.x86_64.rpm 2.1 MB/s | 354 kB 00:00 2024-06-02T04:39:28.164 INFO:teuthology.orchestra.run.smithi192.stdout:(137/146): openssl-libs-1.1.1k-12.el8_9.x86_64. 7.7 MB/s | 1.5 MB 00:00 2024-06-02T04:39:28.214 INFO:teuthology.orchestra.run.smithi192.stdout:(138/146): xfsdump-3.1.8-7.el8_9.x86_64.rpm 1.9 MB/s | 333 kB 00:00 2024-06-02T04:39:28.238 INFO:teuthology.orchestra.run.smithi076.stdout:(92/146): python3-mako-1.0.6-14.el8.noarch.rpm 1.2 MB/s | 157 kB 00:00 2024-06-02T04:39:28.256 INFO:teuthology.orchestra.run.smithi192.stdout:(139/146): xfsprogs-5.0.0-12.el8.x86_64.rpm 6.1 MB/s | 1.1 MB 00:00 2024-06-02T04:39:28.309 INFO:teuthology.orchestra.run.smithi119.stdout:(124/146): krb5-devel-1.18.2-26.el8_9.x86_64.rp 2.2 MB/s | 562 kB 00:00 2024-06-02T04:39:28.355 INFO:teuthology.orchestra.run.smithi076.stdout:(93/146): openblas-threads-0.3.15-6.el8.x86_64. 19 MB/s | 5.2 MB 00:00 2024-06-02T04:39:28.357 INFO:teuthology.orchestra.run.smithi192.stdout:(140/146): libblkid-2.32.1-44.el8_9.1.x86_64.rp 1.1 MB/s | 221 kB 00:00 2024-06-02T04:39:28.388 INFO:teuthology.orchestra.run.smithi076.stdout:(94/146): automake-1.16.1-8.el8.noarch.rpm 4.6 MB/s | 714 kB 00:00 2024-06-02T04:39:28.410 INFO:teuthology.orchestra.run.smithi119.stdout:(125/146): openssl-devel-1.1.1k-12.el8_9.x86_64 8.0 MB/s | 2.3 MB 00:00 2024-06-02T04:39:28.432 INFO:teuthology.orchestra.run.smithi192.stdout:(141/146): libfdisk-2.32.1-44.el8_9.1.x86_64.rp 1.1 MB/s | 254 kB 00:00 2024-06-02T04:39:28.435 INFO:teuthology.orchestra.run.smithi119.stdout:(126/146): librabbitmq-0.9.0-5.el8_9.x86_64.rpm 376 kB/s | 47 kB 00:00 2024-06-02T04:39:28.499 INFO:teuthology.orchestra.run.smithi192.stdout:(142/146): libsmartcols-2.32.1-44.el8_9.1.x86_6 1.2 MB/s | 180 kB 00:00 2024-06-02T04:39:28.522 INFO:teuthology.orchestra.run.smithi076.stdout:(95/146): openblas-0.3.15-6.el8.x86_64.rpm 14 MB/s | 5.0 MB 00:00 2024-06-02T04:39:28.558 INFO:teuthology.orchestra.run.smithi192.stdout:(143/146): libmount-2.32.1-44.el8_9.1.x86_64.rp 785 kB/s | 237 kB 00:00 2024-06-02T04:39:28.581 INFO:teuthology.orchestra.run.smithi076.stdout:(96/146): libpq-13.11-1.el8.x86_64.rpm 883 kB/s | 198 kB 00:00 2024-06-02T04:39:28.585 INFO:teuthology.orchestra.run.smithi119.stdout:(127/146): python3-cryptography-3.2.1-7.el8_9.x 3.1 MB/s | 559 kB 00:00 2024-06-02T04:39:28.606 INFO:teuthology.orchestra.run.smithi076.stdout:(97/146): jq-1.6-7.el8.x86_64.rpm 933 kB/s | 202 kB 00:00 2024-06-02T04:39:28.616 INFO:teuthology.orchestra.run.smithi192.stdout:(144/146): libuuid-2.32.1-44.el8_9.1.x86_64.rpm 538 kB/s | 99 kB 00:00 2024-06-02T04:39:28.644 INFO:teuthology.orchestra.run.smithi119.stdout:(128/146): NetworkManager-initscripts-updown-1. 691 kB/s | 144 kB 00:00 2024-06-02T04:39:28.691 INFO:teuthology.orchestra.run.smithi192.stdout:(145/146): util-linux-2.32.1-44.el8_9.1.x86_64. 13 MB/s | 2.5 MB 00:00 2024-06-02T04:39:28.711 INFO:teuthology.orchestra.run.smithi119.stdout:(129/146): libuuid-devel-2.32.1-44.el8_9.1.x86_ 798 kB/s | 100 kB 00:00 2024-06-02T04:39:28.714 INFO:teuthology.orchestra.run.smithi076.stdout:(98/146): python3-pytz-2017.2-11.el8.noarch.rpm 283 kB/s | 54 kB 00:00 2024-06-02T04:39:28.731 INFO:teuthology.orchestra.run.smithi076.stdout:(99/146): oniguruma-6.8.2-2.1.el8_9.x86_64.rpm 1.5 MB/s | 188 kB 00:00 2024-06-02T04:39:28.733 INFO:teuthology.orchestra.run.smithi192.stdout:(146/146): util-linux-user-2.32.1-44.el8_9.1.x8 588 kB/s | 103 kB 00:00 2024-06-02T04:39:28.737 INFO:teuthology.orchestra.run.smithi192.stdout:-------------------------------------------------------------------------------- 2024-06-02T04:39:28.737 INFO:teuthology.orchestra.run.smithi192.stdout:Total 12 MB/s | 215 MB 00:17 2024-06-02T04:39:28.923 INFO:teuthology.orchestra.run.smithi076.stdout:(100/146): python3-scipy-1.0.0-21.module+el8.9. 40 MB/s | 14 MB 00:00 2024-06-02T04:39:28.965 INFO:teuthology.orchestra.run.smithi076.stdout:(101/146): postgresql-contrib-10.23-4.module+el 3.4 MB/s | 812 kB 00:00 2024-06-02T04:39:29.007 INFO:teuthology.orchestra.run.smithi076.stdout:(102/146): postgresql-10.23-4.module+el8.9.0+21 5.1 MB/s | 1.5 MB 00:00 2024-06-02T04:39:29.091 INFO:teuthology.orchestra.run.smithi076.stdout:(103/146): libverto-devel-0.3.0-5.el8.x86_64.rp 143 kB/s | 18 kB 00:00 2024-06-02T04:39:29.133 INFO:teuthology.orchestra.run.smithi076.stdout:(104/146): python3-jwt-1.6.1-2.el8.noarch.rpm 340 kB/s | 43 kB 00:00 2024-06-02T04:39:29.161 INFO:teuthology.orchestra.run.smithi119.stdout:(130/146): librados2-18.2.2-1381.g3bb45379.el8. 7.2 MB/s | 3.7 MB 00:00 2024-06-02T04:39:29.216 INFO:teuthology.orchestra.run.smithi076.stdout:(105/146): postgresql-server-10.23-4.module+el8 17 MB/s | 5.1 MB 00:00 2024-06-02T04:39:29.228 INFO:teuthology.orchestra.run.smithi119.stdout:(131/146): librbd1-18.2.2-1381.g3bb45379.el8.x8 6.9 MB/s | 3.6 MB 00:00 2024-06-02T04:39:29.241 INFO:teuthology.orchestra.run.smithi076.stdout:(106/146): python3-pycparser-2.14-14.el8.noarch 1.0 MB/s | 109 kB 00:00 2024-06-02T04:39:29.258 INFO:teuthology.orchestra.run.smithi076.stdout:(107/146): python3-oauthlib-2.1.0-1.el8.noarch. 926 kB/s | 155 kB 00:00 2024-06-02T04:39:29.262 INFO:teuthology.orchestra.run.smithi119.stdout:(132/146): elfutils-libelf-0.189-3.el8.x86_64.r 2.3 MB/s | 232 kB 00:00 2024-06-02T04:39:29.292 INFO:teuthology.orchestra.run.smithi076.stdout:(108/146): python3-requests-oauthlib-1.0.0-1.el 567 kB/s | 43 kB 00:00 2024-06-02T04:39:29.384 INFO:teuthology.orchestra.run.smithi076.stdout:(109/146): libaio-devel-0.3.112-1.el8.x86_64.rp 131 kB/s | 19 kB 00:00 2024-06-02T04:39:29.403 INFO:teuthology.orchestra.run.smithi119.stdout:(133/146): elfutils-libs-0.189-3.el8.x86_64.rpm 1.7 MB/s | 303 kB 00:00 2024-06-02T04:39:29.426 INFO:teuthology.orchestra.run.smithi076.stdout:(110/146): pcre2-devel-10.32-2.el8.x86_64.rpm 4.4 MB/s | 605 kB 00:00 2024-06-02T04:39:29.443 INFO:teuthology.orchestra.run.smithi076.stdout:(111/146): libzstd-devel-1.4.4-1.el8.x86_64.rpm 238 kB/s | 44 kB 00:00 2024-06-02T04:39:29.470 INFO:teuthology.orchestra.run.smithi119.stdout:(134/146): iproute-6.2.0-5.el8_9.x86_64.rpm 4.0 MB/s | 854 kB 00:00 2024-06-02T04:39:29.501 INFO:teuthology.orchestra.run.smithi076.stdout:(112/146): pcre2-utf16-10.32-2.el8.x86_64.rpm 1.9 MB/s | 229 kB 00:00 2024-06-02T04:39:29.587 INFO:teuthology.orchestra.run.smithi119.stdout:(135/146): openssl-1.1.1k-12.el8_9.x86_64.rpm 3.8 MB/s | 711 kB 00:00 2024-06-02T04:39:29.635 INFO:teuthology.orchestra.run.smithi076.stdout:(113/146): libselinux-devel-2.9-5.el8.x86_64.rp 1.0 MB/s | 200 kB 00:00 2024-06-02T04:39:29.663 INFO:teuthology.orchestra.run.smithi119.stdout:(136/146): openssl-libs-1.1.1k-12.el8_9.x86_64. 7.7 MB/s | 1.5 MB 00:00 2024-06-02T04:39:29.677 INFO:teuthology.orchestra.run.smithi076.stdout:(114/146): pcre2-utf32-10.32-2.el8.x86_64.rpm 879 kB/s | 220 kB 00:00 2024-06-02T04:39:29.702 INFO:teuthology.orchestra.run.smithi076.stdout:(115/146): keyutils-libs-devel-1.5.10-9.el8.x86 240 kB/s | 48 kB 00:00 2024-06-02T04:39:29.778 INFO:teuthology.orchestra.run.smithi076.stdout:(116/146): libsepol-devel-2.9-3.el8.x86_64.rpm 612 kB/s | 87 kB 00:00 2024-06-02T04:39:29.813 INFO:teuthology.orchestra.run.smithi119.stdout:(137/146): xfsdump-3.1.8-7.el8_9.x86_64.rpm 1.4 MB/s | 333 kB 00:00 2024-06-02T04:39:29.830 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction check 2024-06-02T04:39:29.855 INFO:teuthology.orchestra.run.smithi119.stdout:(138/146): xfsprogs-5.0.0-12.el8.x86_64.rpm 5.6 MB/s | 1.1 MB 00:00 2024-06-02T04:39:29.869 INFO:teuthology.orchestra.run.smithi076.stdout:(117/146): zlib-devel-1.2.11-18.el8_5.x86_64.rp 300 kB/s | 58 kB 00:00 2024-06-02T04:39:29.895 INFO:teuthology.orchestra.run.smithi076.stdout:(118/146): libcom_err-devel-1.45.6-4.el8.x86_64 201 kB/s | 39 kB 00:00 2024-06-02T04:39:29.920 INFO:teuthology.orchestra.run.smithi076.stdout:(119/146): fuse-2.9.7-17.el8.x86_64.rpm 584 kB/s | 83 kB 00:00 2024-06-02T04:39:29.964 INFO:teuthology.orchestra.run.smithi119.stdout:(139/146): libblkid-2.32.1-44.el8_9.1.x86_64.rp 1.4 MB/s | 221 kB 00:00 2024-06-02T04:39:30.037 INFO:teuthology.orchestra.run.smithi076.stdout:(120/146): libgfortran-8.5.0-20.el8.x86_64.rpm 3.8 MB/s | 645 kB 00:00 2024-06-02T04:39:30.070 INFO:teuthology.orchestra.run.smithi076.stdout:(121/146): libquadmath-8.5.0-20.el8.x86_64.rpm 984 kB/s | 172 kB 00:00 2024-06-02T04:39:30.137 INFO:teuthology.orchestra.run.smithi076.stdout:(122/146): python3-cffi-1.11.5-6.el8.x86_64.rpm 1.1 MB/s | 238 kB 00:00 2024-06-02T04:39:30.163 INFO:teuthology.orchestra.run.smithi076.stdout:(123/146): elfutils-libelf-devel-0.189-3.el8.x8 671 kB/s | 62 kB 00:00 2024-06-02T04:39:30.188 INFO:teuthology.orchestra.run.smithi076.stdout:(124/146): xfsprogs-devel-5.0.0-12.el8.x86_64.r 482 kB/s | 73 kB 00:00 2024-06-02T04:39:30.225 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction check succeeded. 2024-06-02T04:39:30.225 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction test 2024-06-02T04:39:30.288 INFO:teuthology.orchestra.run.smithi076.stdout:(125/146): krb5-devel-1.18.2-26.el8_9.x86_64.rp 3.7 MB/s | 562 kB 00:00 2024-06-02T04:39:30.322 INFO:teuthology.orchestra.run.smithi076.stdout:(126/146): librabbitmq-0.9.0-5.el8_9.x86_64.rpm 353 kB/s | 47 kB 00:00 2024-06-02T04:39:30.405 INFO:teuthology.orchestra.run.smithi076.stdout:(127/146): openssl-devel-1.1.1k-12.el8_9.x86_64 9.6 MB/s | 2.3 MB 00:00 2024-06-02T04:39:30.422 INFO:teuthology.orchestra.run.smithi119.stdout:(140/146): ceph-test-18.2.2-1381.g3bb45379.el8. 2.8 MB/s | 47 MB 00:16 2024-06-02T04:39:30.430 INFO:teuthology.orchestra.run.smithi076.stdout:(128/146): NetworkManager-initscripts-updown-1. 1.3 MB/s | 144 kB 00:00 2024-06-02T04:39:30.448 INFO:teuthology.orchestra.run.smithi119.stdout:(141/146): libfdisk-2.32.1-44.el8_9.1.x86_64.rp 429 kB/s | 254 kB 00:00 2024-06-02T04:39:30.464 INFO:teuthology.orchestra.run.smithi076.stdout:(129/146): python3-cryptography-3.2.1-7.el8_9.x 3.1 MB/s | 559 kB 00:00 2024-06-02T04:39:30.481 INFO:teuthology.orchestra.run.smithi119.stdout:(142/146): libmount-2.32.1-44.el8_9.1.x86_64.rp 458 kB/s | 237 kB 00:00 2024-06-02T04:39:30.506 INFO:teuthology.orchestra.run.smithi076.stdout:(130/146): libuuid-devel-2.32.1-44.el8_9.1.x86_ 995 kB/s | 100 kB 00:00 2024-06-02T04:39:30.565 INFO:teuthology.orchestra.run.smithi119.stdout:(143/146): libuuid-2.32.1-44.el8_9.1.x86_64.rpm 890 kB/s | 99 kB 00:00 2024-06-02T04:39:30.590 INFO:teuthology.orchestra.run.smithi076.stdout:(131/146): elfutils-libelf-0.189-3.el8.x86_64.r 2.7 MB/s | 232 kB 00:00 2024-06-02T04:39:30.623 INFO:teuthology.orchestra.run.smithi119.stdout:(144/146): libsmartcols-2.32.1-44.el8_9.1.x86_6 897 kB/s | 180 kB 00:00 2024-06-02T04:39:30.691 INFO:teuthology.orchestra.run.smithi119.stdout:(145/146): util-linux-user-2.32.1-44.el8_9.1.x8 822 kB/s | 103 kB 00:00 2024-06-02T04:39:30.748 INFO:teuthology.orchestra.run.smithi076.stdout:(132/146): elfutils-libs-0.189-3.el8.x86_64.rpm 1.9 MB/s | 303 kB 00:00 2024-06-02T04:39:30.782 INFO:teuthology.orchestra.run.smithi119.stdout:(146/146): util-linux-2.32.1-44.el8_9.1.x86_64. 8.2 MB/s | 2.5 MB 00:00 2024-06-02T04:39:30.785 INFO:teuthology.orchestra.run.smithi119.stdout:-------------------------------------------------------------------------------- 2024-06-02T04:39:30.785 INFO:teuthology.orchestra.run.smithi119.stdout:Total 10 MB/s | 215 MB 00:21 2024-06-02T04:39:30.849 INFO:teuthology.orchestra.run.smithi076.stdout:(133/146): librbd1-18.2.2-1381.g3bb45379.el8.x8 9.3 MB/s | 3.6 MB 00:00 2024-06-02T04:39:30.907 INFO:teuthology.orchestra.run.smithi076.stdout:(134/146): iproute-6.2.0-5.el8_9.x86_64.rpm 5.3 MB/s | 854 kB 00:00 2024-06-02T04:39:30.966 INFO:teuthology.orchestra.run.smithi076.stdout:(135/146): openssl-1.1.1k-12.el8_9.x86_64.rpm 5.9 MB/s | 711 kB 00:00 2024-06-02T04:39:31.033 INFO:teuthology.orchestra.run.smithi076.stdout:(136/146): librados2-18.2.2-1381.g3bb45379.el8. 6.1 MB/s | 3.7 MB 00:00 2024-06-02T04:39:31.083 INFO:teuthology.orchestra.run.smithi076.stdout:(137/146): openssl-libs-1.1.1k-12.el8_9.x86_64. 8.4 MB/s | 1.5 MB 00:00 2024-06-02T04:39:31.152 INFO:teuthology.orchestra.run.smithi076.stdout:(138/146): xfsdump-3.1.8-7.el8_9.x86_64.rpm 1.8 MB/s | 333 kB 00:00 2024-06-02T04:39:31.200 INFO:teuthology.orchestra.run.smithi076.stdout:(139/146): xfsprogs-5.0.0-12.el8.x86_64.rpm 6.4 MB/s | 1.1 MB 00:00 2024-06-02T04:39:31.225 INFO:teuthology.orchestra.run.smithi076.stdout:(140/146): libblkid-2.32.1-44.el8_9.1.x86_64.rp 1.5 MB/s | 221 kB 00:00 2024-06-02T04:39:31.300 INFO:teuthology.orchestra.run.smithi076.stdout:(141/146): libfdisk-2.32.1-44.el8_9.1.x86_64.rp 1.7 MB/s | 254 kB 00:00 2024-06-02T04:39:31.326 INFO:teuthology.orchestra.run.smithi076.stdout:(142/146): libmount-2.32.1-44.el8_9.1.x86_64.rp 1.8 MB/s | 237 kB 00:00 2024-06-02T04:39:31.343 INFO:teuthology.orchestra.run.smithi076.stdout:(143/146): libsmartcols-2.32.1-44.el8_9.1.x86_6 1.5 MB/s | 180 kB 00:00 2024-06-02T04:39:31.426 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction test succeeded. 2024-06-02T04:39:31.437 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction 2024-06-02T04:39:31.443 INFO:teuthology.orchestra.run.smithi076.stdout:(144/146): libuuid-2.32.1-44.el8_9.1.x86_64.rpm 696 kB/s | 99 kB 00:00 2024-06-02T04:39:31.468 INFO:teuthology.orchestra.run.smithi076.stdout:(145/146): util-linux-user-2.32.1-44.el8_9.1.x8 821 kB/s | 103 kB 00:00 2024-06-02T04:39:31.527 INFO:teuthology.orchestra.run.smithi076.stdout:(146/146): util-linux-2.32.1-44.el8_9.1.x86_64. 12 MB/s | 2.5 MB 00:00 2024-06-02T04:39:31.530 INFO:teuthology.orchestra.run.smithi076.stdout:-------------------------------------------------------------------------------- 2024-06-02T04:39:31.530 INFO:teuthology.orchestra.run.smithi076.stdout:Total 9.9 MB/s | 215 MB 00:21 2024-06-02T04:39:31.852 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction check 2024-06-02T04:39:32.245 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction check succeeded. 2024-06-02T04:39:32.246 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction test 2024-06-02T04:39:32.615 INFO:teuthology.orchestra.run.smithi076.stdout:Running transaction check 2024-06-02T04:39:33.011 INFO:teuthology.orchestra.run.smithi076.stdout:Transaction check succeeded. 2024-06-02T04:39:33.011 INFO:teuthology.orchestra.run.smithi076.stdout:Running transaction test 2024-06-02T04:39:33.446 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction test succeeded. 2024-06-02T04:39:33.457 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction 2024-06-02T04:39:34.208 INFO:teuthology.orchestra.run.smithi076.stdout:Transaction test succeeded. 2024-06-02T04:39:34.218 INFO:teuthology.orchestra.run.smithi076.stdout:Running transaction 2024-06-02T04:39:37.460 INFO:teuthology.orchestra.run.smithi192.stdout: Preparing : 1/1 2024-06-02T04:39:37.596 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/1 2024-06-02T04:39:37.895 INFO:teuthology.orchestra.run.smithi192.stdout: Upgrading : openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/162 2024-06-02T04:39:38.115 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/162 2024-06-02T04:39:38.311 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : thrift-0.13.0-2.el8.x86_64 2/162 2024-06-02T04:39:38.490 INFO:teuthology.orchestra.run.smithi192.stdout: Upgrading : libuuid-2.32.1-44.el8_9.1.x86_64 3/162 2024-06-02T04:39:38.552 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: libuuid-2.32.1-44.el8_9.1.x86_64 3/162 2024-06-02T04:39:38.740 INFO:teuthology.orchestra.run.smithi192.stdout: Upgrading : libblkid-2.32.1-44.el8_9.1.x86_64 4/162 2024-06-02T04:39:38.812 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: libblkid-2.32.1-44.el8_9.1.x86_64 4/162 2024-06-02T04:39:39.002 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : liboath-2.6.2-3.el8.x86_64 5/162 2024-06-02T04:39:39.020 INFO:teuthology.orchestra.run.smithi119.stdout: Preparing : 1/1 2024-06-02T04:39:39.155 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/1 2024-06-02T04:39:39.247 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : librabbitmq-0.9.0-5.el8_9.x86_64 6/162 2024-06-02T04:39:39.440 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 7/162 2024-06-02T04:39:39.535 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 7/162 2024-06-02T04:39:39.551 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/162 2024-06-02T04:39:39.764 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 8/162 2024-06-02T04:39:39.772 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/162 2024-06-02T04:39:39.948 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : thrift-0.13.0-2.el8.x86_64 2/162 2024-06-02T04:39:40.118 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : libuuid-2.32.1-44.el8_9.1.x86_64 3/162 2024-06-02T04:39:40.170 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 8/162 2024-06-02T04:39:40.191 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: libuuid-2.32.1-44.el8_9.1.x86_64 3/162 2024-06-02T04:39:40.390 INFO:teuthology.orchestra.run.smithi192.stdout: Upgrading : librados2-2:18.2.2-1381.g3bb45379.el8.x86_64 9/162 2024-06-02T04:39:40.394 INFO:teuthology.orchestra.run.smithi076.stdout: Preparing : 1/1 2024-06-02T04:39:40.401 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : libblkid-2.32.1-44.el8_9.1.x86_64 4/162 2024-06-02T04:39:40.469 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: libblkid-2.32.1-44.el8_9.1.x86_64 4/162 2024-06-02T04:39:40.530 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/1 2024-06-02T04:39:40.683 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : liboath-2.6.2-3.el8.x86_64 5/162 2024-06-02T04:39:40.814 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: librados2-2:18.2.2-1381.g3bb45379.el8.x86_64 9/162 2024-06-02T04:39:40.833 INFO:teuthology.orchestra.run.smithi076.stdout: Upgrading : openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/162 2024-06-02T04:39:40.860 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 6/162 2024-06-02T04:39:40.912 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 6/162 2024-06-02T04:39:41.032 INFO:teuthology.orchestra.run.smithi192.stdout: Upgrading : librbd1-2:18.2.2-1381.g3bb45379.el8.x86_64 10/162 2024-06-02T04:39:41.050 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/162 2024-06-02T04:39:41.138 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : librabbitmq-0.9.0-5.el8_9.x86_64 7/162 2024-06-02T04:39:41.163 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: librbd1-2:18.2.2-1381.g3bb45379.el8.x86_64 10/162 2024-06-02T04:39:41.218 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : thrift-0.13.0-2.el8.x86_64 2/162 2024-06-02T04:39:41.318 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 8/162 2024-06-02T04:39:41.398 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libcephfs2-2:18.2.2-1381.g3bb45379.el8.x86_64 11/162 2024-06-02T04:39:41.422 INFO:teuthology.orchestra.run.smithi076.stdout: Upgrading : libuuid-2.32.1-44.el8_9.1.x86_64 3/162 2024-06-02T04:39:41.492 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: libcephfs2-2:18.2.2-1381.g3bb45379.el8.x86_64 11/162 2024-06-02T04:39:41.494 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: libuuid-2.32.1-44.el8_9.1.x86_64 3/162 2024-06-02T04:39:41.680 INFO:teuthology.orchestra.run.smithi076.stdout: Upgrading : libblkid-2.32.1-44.el8_9.1.x86_64 4/162 2024-06-02T04:39:41.729 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 8/162 2024-06-02T04:39:41.747 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: libblkid-2.32.1-44.el8_9.1.x86_64 4/162 2024-06-02T04:39:41.782 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-rados-2:18.2.2-1381.g3bb45379.el8.x86_64 12/162 2024-06-02T04:39:41.968 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : librados2-2:18.2.2-1381.g3bb45379.el8.x86_64 9/162 2024-06-02T04:39:41.970 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : liboath-2.6.2-3.el8.x86_64 5/162 2024-06-02T04:39:42.064 INFO:teuthology.orchestra.run.smithi192.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 13/162 2024-06-02T04:39:42.149 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 13/162 2024-06-02T04:39:42.189 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 6/162 2024-06-02T04:39:42.264 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 6/162 2024-06-02T04:39:42.355 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: librados2-2:18.2.2-1381.g3bb45379.el8.x86_64 9/162 2024-06-02T04:39:42.404 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libpq-13.11-1.el8.x86_64 14/162 2024-06-02T04:39:42.490 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : librabbitmq-0.9.0-5.el8_9.x86_64 7/162 2024-06-02T04:39:42.535 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : librbd1-2:18.2.2-1381.g3bb45379.el8.x86_64 10/162 2024-06-02T04:39:42.667 INFO:teuthology.orchestra.run.smithi192.stdout: Upgrading : elfutils-libelf-0.189-3.el8.x86_64 15/162 2024-06-02T04:39:42.685 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: librbd1-2:18.2.2-1381.g3bb45379.el8.x86_64 10/162 2024-06-02T04:39:42.705 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 8/162 2024-06-02T04:39:42.851 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 16/162 2024-06-02T04:39:42.876 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libcephfs2-2:18.2.2-1381.g3bb45379.el8.x86_64 11/162 2024-06-02T04:39:42.973 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: libcephfs2-2:18.2.2-1381.g3bb45379.el8.x86_64 11/162 2024-06-02T04:39:43.117 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 8/162 2024-06-02T04:39:43.218 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 17/162 2024-06-02T04:39:43.287 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-rados-2:18.2.2-1381.g3bb45379.el8.x86_64 12/162 2024-06-02T04:39:43.372 INFO:teuthology.orchestra.run.smithi076.stdout: Upgrading : librados2-2:18.2.2-1381.g3bb45379.el8.x86_64 9/162 2024-06-02T04:39:43.443 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : postgresql-10.23-4.module+el8.9.0+21317+d2c6bf8a 18/162 2024-06-02T04:39:43.567 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 13/162 2024-06-02T04:39:43.606 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libcephsqlite-2:18.2.2-1381.g3bb45379.el8.x86_64 19/162 2024-06-02T04:39:43.639 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 13/162 2024-06-02T04:39:43.710 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: libcephsqlite-2:18.2.2-1381.g3bb45379.el8.x86_64 19/162 2024-06-02T04:39:43.770 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: librados2-2:18.2.2-1381.g3bb45379.el8.x86_64 9/162 2024-06-02T04:39:43.849 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libpq-13.11-1.el8.x86_64 14/162 2024-06-02T04:39:43.866 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libradosstriper1-2:18.2.2-1381.g3bb45379.el8.x86 20/162 2024-06-02T04:39:43.941 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: libradosstriper1-2:18.2.2-1381.g3bb45379.el8.x86 20/162 2024-06-02T04:39:43.989 INFO:teuthology.orchestra.run.smithi076.stdout: Upgrading : librbd1-2:18.2.2-1381.g3bb45379.el8.x86_64 10/162 2024-06-02T04:39:44.113 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: librbd1-2:18.2.2-1381.g3bb45379.el8.x86_64 10/162 2024-06-02T04:39:44.151 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 21/162 2024-06-02T04:39:44.172 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : elfutils-libelf-0.189-3.el8.x86_64 15/162 2024-06-02T04:39:44.338 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : libcephfs2-2:18.2.2-1381.g3bb45379.el8.x86_64 11/162 2024-06-02T04:39:44.379 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 16/162 2024-06-02T04:39:44.456 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 22/162 2024-06-02T04:39:44.466 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: libcephfs2-2:18.2.2-1381.g3bb45379.el8.x86_64 11/162 2024-06-02T04:39:44.686 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 23/162 2024-06-02T04:39:44.748 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 17/162 2024-06-02T04:39:44.757 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-rados-2:18.2.2-1381.g3bb45379.el8.x86_64 12/162 2024-06-02T04:39:44.864 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 24/162 2024-06-02T04:39:44.996 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : postgresql-10.23-4.module+el8.9.0+21317+d2c6bf8a 18/162 2024-06-02T04:39:45.007 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 24/162 2024-06-02T04:39:45.030 INFO:teuthology.orchestra.run.smithi076.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 13/162 2024-06-02T04:39:45.116 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 13/162 2024-06-02T04:39:45.148 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 25/162 2024-06-02T04:39:45.159 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libcephsqlite-2:18.2.2-1381.g3bb45379.el8.x86_64 19/162 2024-06-02T04:39:45.250 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: libcephsqlite-2:18.2.2-1381.g3bb45379.el8.x86_64 19/162 2024-06-02T04:39:45.377 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : libpq-13.11-1.el8.x86_64 14/162 2024-06-02T04:39:45.422 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libradosstriper1-2:18.2.2-1381.g3bb45379.el8.x86 20/162 2024-06-02T04:39:45.480 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: libradosstriper1-2:18.2.2-1381.g3bb45379.el8.x86 20/162 2024-06-02T04:39:45.667 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 21/162 2024-06-02T04:39:45.674 INFO:teuthology.orchestra.run.smithi076.stdout: Upgrading : elfutils-libelf-0.189-3.el8.x86_64 15/162 2024-06-02T04:39:45.768 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 25/162 2024-06-02T04:39:45.787 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 21/162 2024-06-02T04:39:45.850 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 16/162 2024-06-02T04:39:45.951 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 22/162 2024-06-02T04:39:45.955 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : openblas-threads-0.3.15-6.el8.x86_64 26/162 2024-06-02T04:39:46.210 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 17/162 2024-06-02T04:39:46.458 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : postgresql-10.23-4.module+el8.9.0+21317+d2c6bf8a 18/162 2024-06-02T04:39:46.571 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 22/162 2024-06-02T04:39:46.575 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: openblas-threads-0.3.15-6.el8.x86_64 26/162 2024-06-02T04:39:46.663 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : libcephsqlite-2:18.2.2-1381.g3bb45379.el8.x86_64 19/162 2024-06-02T04:39:46.747 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : openblas-0.3.15-6.el8.x86_64 27/162 2024-06-02T04:39:46.768 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: libcephsqlite-2:18.2.2-1381.g3bb45379.el8.x86_64 19/162 2024-06-02T04:39:46.775 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : openblas-threads-0.3.15-6.el8.x86_64 23/162 2024-06-02T04:39:46.974 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : libradosstriper1-2:18.2.2-1381.g3bb45379.el8.x86 20/162 2024-06-02T04:39:47.048 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: libradosstriper1-2:18.2.2-1381.g3bb45379.el8.x86 20/162 2024-06-02T04:39:47.229 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 21/162 2024-06-02T04:39:47.364 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 21/162 2024-06-02T04:39:47.378 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: openblas-threads-0.3.15-6.el8.x86_64 23/162 2024-06-02T04:39:47.430 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: openblas-0.3.15-6.el8.x86_64 27/162 2024-06-02T04:39:47.550 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : openblas-0.3.15-6.el8.x86_64 24/162 2024-06-02T04:39:47.555 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 22/162 2024-06-02T04:39:47.695 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 28/162 2024-06-02T04:39:47.902 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 29/162 2024-06-02T04:39:48.173 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 30/162 2024-06-02T04:39:48.211 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 22/162 2024-06-02T04:39:48.235 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: openblas-0.3.15-6.el8.x86_64 24/162 2024-06-02T04:39:48.386 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-ceph-common-2:18.2.2-1381.g3bb45379.el8. 31/162 2024-06-02T04:39:48.402 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : openblas-threads-0.3.15-6.el8.x86_64 23/162 2024-06-02T04:39:48.481 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 25/162 2024-06-02T04:39:48.532 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-ceph-argparse-2:18.2.2-1381.g3bb45379.el 32/162 2024-06-02T04:39:48.631 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 26/162 2024-06-02T04:39:48.775 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-cephfs-2:18.2.2-1381.g3bb45379.el8.x86_6 33/162 2024-06-02T04:39:48.837 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 27/162 2024-06-02T04:39:48.947 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 34/162 2024-06-02T04:39:49.042 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: openblas-threads-0.3.15-6.el8.x86_64 23/162 2024-06-02T04:39:49.084 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 28/162 2024-06-02T04:39:49.204 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : openblas-0.3.15-6.el8.x86_64 24/162 2024-06-02T04:39:49.364 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 29/162 2024-06-02T04:39:49.660 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 30/162 2024-06-02T04:39:49.823 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-ceph-common-2:18.2.2-1381.g3bb45379.el8. 31/162 2024-06-02T04:39:49.925 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: openblas-0.3.15-6.el8.x86_64 24/162 2024-06-02T04:39:49.979 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-ceph-argparse-2:18.2.2-1381.g3bb45379.el 32/162 2024-06-02T04:39:50.210 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 25/162 2024-06-02T04:39:50.236 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-cephfs-2:18.2.2-1381.g3bb45379.el8.x86_6 33/162 2024-06-02T04:39:50.385 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 26/162 2024-06-02T04:39:50.589 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 27/162 2024-06-02T04:39:50.682 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 34/162 2024-06-02T04:39:50.863 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 28/162 2024-06-02T04:39:51.032 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c3 35/162 2024-06-02T04:39:51.169 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 29/162 2024-06-02T04:39:51.204 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 34/162 2024-06-02T04:39:51.448 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 30/162 2024-06-02T04:39:51.530 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 35/162 2024-06-02T04:39:51.652 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-ceph-common-2:18.2.2-1381.g3bb45379.el8. 31/162 2024-06-02T04:39:51.806 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-ceph-argparse-2:18.2.2-1381.g3bb45379.el 32/162 2024-06-02T04:39:51.810 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 36/162 2024-06-02T04:39:51.976 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 36/162 2024-06-02T04:39:52.033 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 37/162 2024-06-02T04:39:52.098 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-cephfs-2:18.2.2-1381.g3bb45379.el8.x86_6 33/162 2024-06-02T04:39:52.292 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 37/162 2024-06-02T04:39:52.547 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 38/162 2024-06-02T04:39:52.790 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-rsa-4.9-2.el8.noarch 39/162 2024-06-02T04:39:53.032 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 40/162 2024-06-02T04:39:53.089 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 34/162 2024-06-02T04:39:53.243 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-rbd-2:18.2.2-1381.g3bb45379.el8.x86_64 41/162 2024-06-02T04:39:53.412 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : librados-devel-2:18.2.2-1381.g3bb45379.el8.x86_6 42/162 2024-06-02T04:39:53.475 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 35/162 2024-06-02T04:39:53.646 INFO:teuthology.orchestra.run.smithi192.stdout: Upgrading : libfdisk-2.32.1-44.el8_9.1.x86_64 43/162 2024-06-02T04:39:53.718 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: libfdisk-2.32.1-44.el8_9.1.x86_64 43/162 2024-06-02T04:39:53.752 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 36/162 2024-06-02T04:39:53.785 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 37/162 2024-06-02T04:39:53.921 INFO:teuthology.orchestra.run.smithi192.stdout: Upgrading : libmount-2.32.1-44.el8_9.1.x86_64 44/162 2024-06-02T04:39:53.954 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 37/162 2024-06-02T04:39:54.021 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: libmount-2.32.1-44.el8_9.1.x86_64 44/162 2024-06-02T04:39:54.083 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c3 38/162 2024-06-02T04:39:54.243 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libuuid-devel-2.32.1-44.el8_9.1.x86_64 45/162 2024-06-02T04:39:54.293 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-rsa-4.9-2.el8.noarch 39/162 2024-06-02T04:39:54.424 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 46/162 2024-06-02T04:39:54.518 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 40/162 2024-06-02T04:39:54.638 INFO:teuthology.orchestra.run.smithi192.stdout: Upgrading : libsmartcols-2.32.1-44.el8_9.1.x86_64 47/162 2024-06-02T04:39:54.713 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-rbd-2:18.2.2-1381.g3bb45379.el8.x86_64 41/162 2024-06-02T04:39:54.890 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : librados-devel-2:18.2.2-1381.g3bb45379.el8.x86_6 42/162 2024-06-02T04:39:55.079 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: libsmartcols-2.32.1-44.el8_9.1.x86_64 47/162 2024-06-02T04:39:55.091 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : libfdisk-2.32.1-44.el8_9.1.x86_64 43/162 2024-06-02T04:39:55.155 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: libfdisk-2.32.1-44.el8_9.1.x86_64 43/162 2024-06-02T04:39:55.366 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : libmount-2.32.1-44.el8_9.1.x86_64 44/162 2024-06-02T04:39:55.413 INFO:teuthology.orchestra.run.smithi192.stdout: Upgrading : util-linux-2.32.1-44.el8_9.1.x86_64 48/162 2024-06-02T04:39:55.432 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: libmount-2.32.1-44.el8_9.1.x86_64 44/162 2024-06-02T04:39:55.441 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: util-linux-2.32.1-44.el8_9.1.x86_64 48/162 2024-06-02T04:39:55.605 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : oniguruma-6.8.2-2.1.el8_9.x86_64 49/162 2024-06-02T04:39:55.653 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libuuid-devel-2.32.1-44.el8_9.1.x86_64 45/162 2024-06-02T04:39:55.677 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: oniguruma-6.8.2-2.1.el8_9.x86_64 49/162 2024-06-02T04:39:55.699 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 37/162 2024-06-02T04:39:55.868 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 46/162 2024-06-02T04:39:55.974 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : jq-1.6-7.el8.x86_64 50/162 2024-06-02T04:39:56.054 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c3 38/162 2024-06-02T04:39:56.057 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : libsmartcols-2.32.1-44.el8_9.1.x86_64 47/162 2024-06-02T04:39:56.254 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : automake-1.16.1-8.el8.noarch 51/162 2024-06-02T04:39:56.298 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-rsa-4.9-2.el8.noarch 39/162 2024-06-02T04:39:56.429 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : uuid-1.6.2-43.el8.x86_64 52/162 2024-06-02T04:39:56.499 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: libsmartcols-2.32.1-44.el8_9.1.x86_64 47/162 2024-06-02T04:39:56.504 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 52/162 2024-06-02T04:39:56.539 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 40/162 2024-06-02T04:39:56.718 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 53/162 2024-06-02T04:39:56.751 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-rbd-2:18.2.2-1381.g3bb45379.el8.x86_64 41/162 2024-06-02T04:39:56.833 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : util-linux-2.32.1-44.el8_9.1.x86_64 48/162 2024-06-02T04:39:56.851 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: util-linux-2.32.1-44.el8_9.1.x86_64 48/162 2024-06-02T04:39:56.886 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 54/162 2024-06-02T04:39:56.952 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : librados-devel-2:18.2.2-1381.g3bb45379.el8.x86_6 42/162 2024-06-02T04:39:57.036 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : fuse-2.9.7-17.el8.x86_64 49/162 2024-06-02T04:39:57.096 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 55/162 2024-06-02T04:39:57.179 INFO:teuthology.orchestra.run.smithi076.stdout: Upgrading : libfdisk-2.32.1-44.el8_9.1.x86_64 43/162 2024-06-02T04:39:57.220 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 50/162 2024-06-02T04:39:57.262 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: libfdisk-2.32.1-44.el8_9.1.x86_64 43/162 2024-06-02T04:39:57.267 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : fuse-2.9.7-17.el8.x86_64 56/162 2024-06-02T04:39:57.445 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 51/162 2024-06-02T04:39:57.486 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 57/162 2024-06-02T04:39:57.512 INFO:teuthology.orchestra.run.smithi076.stdout: Upgrading : libmount-2.32.1-44.el8_9.1.x86_64 44/162 2024-06-02T04:39:57.581 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: libmount-2.32.1-44.el8_9.1.x86_64 44/162 2024-06-02T04:39:57.618 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 52/162 2024-06-02T04:39:57.701 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 58/162 2024-06-02T04:39:57.815 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : libuuid-devel-2.32.1-44.el8_9.1.x86_64 45/162 2024-06-02T04:39:57.819 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 53/162 2024-06-02T04:39:57.882 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 59/162 2024-06-02T04:39:58.047 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 46/162 2024-06-02T04:39:58.083 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 60/162 2024-06-02T04:39:58.111 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 54/162 2024-06-02T04:39:58.265 INFO:teuthology.orchestra.run.smithi076.stdout: Upgrading : libsmartcols-2.32.1-44.el8_9.1.x86_64 47/162 2024-06-02T04:39:58.377 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 61/162 2024-06-02T04:39:58.379 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 55/162 2024-06-02T04:39:58.612 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 56/162 2024-06-02T04:39:58.633 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 62/162 2024-06-02T04:39:58.709 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: libsmartcols-2.32.1-44.el8_9.1.x86_64 47/162 2024-06-02T04:39:58.777 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 57/162 2024-06-02T04:39:58.876 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 63/162 2024-06-02T04:39:59.026 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 58/162 2024-06-02T04:39:59.033 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 64/162 2024-06-02T04:39:59.106 INFO:teuthology.orchestra.run.smithi076.stdout: Upgrading : util-linux-2.32.1-44.el8_9.1.x86_64 48/162 2024-06-02T04:39:59.124 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: util-linux-2.32.1-44.el8_9.1.x86_64 48/162 2024-06-02T04:39:59.264 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 65/162 2024-06-02T04:39:59.374 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : fuse-2.9.7-17.el8.x86_64 49/162 2024-06-02T04:39:59.380 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 59/162 2024-06-02T04:39:59.576 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 50/162 2024-06-02T04:39:59.609 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 66/162 2024-06-02T04:39:59.701 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-cryptography-3.2.1-7.el8_9.x86_64 60/162 2024-06-02T04:39:59.783 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 51/162 2024-06-02T04:39:59.906 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-cryptography-3.2.1-7.el8_9.x86_64 67/162 2024-06-02T04:39:59.972 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 61/162 2024-06-02T04:39:59.989 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 52/162 2024-06-02T04:40:00.173 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 62/162 2024-06-02T04:40:00.177 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 68/162 2024-06-02T04:40:00.199 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 53/162 2024-06-02T04:40:00.366 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 63/162 2024-06-02T04:40:00.386 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 69/162 2024-06-02T04:40:00.496 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 54/162 2024-06-02T04:40:00.615 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 70/162 2024-06-02T04:40:00.619 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 64/162 2024-06-02T04:40:00.799 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 55/162 2024-06-02T04:40:00.841 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 71/162 2024-06-02T04:40:00.878 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 65/162 2024-06-02T04:40:01.058 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 56/162 2024-06-02T04:40:01.108 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 72/162 2024-06-02T04:40:01.117 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 66/162 2024-06-02T04:40:01.265 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 57/162 2024-06-02T04:40:01.342 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 67/162 2024-06-02T04:40:01.413 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 73/162 2024-06-02T04:40:01.480 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 58/162 2024-06-02T04:40:01.528 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 68/162 2024-06-02T04:40:01.673 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 74/162 2024-06-02T04:40:01.767 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : krb5-devel-1.18.2-26.el8_9.x86_64 69/162 2024-06-02T04:40:01.852 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 59/162 2024-06-02T04:40:01.862 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 75/162 2024-06-02T04:40:01.931 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : oniguruma-6.8.2-2.1.el8_9.x86_64 70/162 2024-06-02T04:40:02.023 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: oniguruma-6.8.2-2.1.el8_9.x86_64 70/162 2024-06-02T04:40:02.157 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : krb5-devel-1.18.2-26.el8_9.x86_64 76/162 2024-06-02T04:40:02.214 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-cryptography-3.2.1-7.el8_9.x86_64 60/162 2024-06-02T04:40:02.294 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : jq-1.6-7.el8.x86_64 71/162 2024-06-02T04:40:02.397 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-packaging-16.8-9.el8.noarch 77/162 2024-06-02T04:40:02.515 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : automake-1.16.1-8.el8.noarch 72/162 2024-06-02T04:40:02.526 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 61/162 2024-06-02T04:40:02.554 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 78/162 2024-06-02T04:40:02.673 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : uuid-1.6.2-43.el8.x86_64 73/162 2024-06-02T04:40:02.757 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 79/162 2024-06-02T04:40:02.767 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 73/162 2024-06-02T04:40:02.785 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 62/162 2024-06-02T04:40:02.946 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 74/162 2024-06-02T04:40:03.023 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 63/162 2024-06-02T04:40:03.050 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 80/162 2024-06-02T04:40:03.113 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 75/162 2024-06-02T04:40:03.282 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 64/162 2024-06-02T04:40:03.291 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 76/162 2024-06-02T04:40:03.302 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 81/162 2024-06-02T04:40:03.458 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 82/162 2024-06-02T04:40:03.491 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-packaging-16.8-9.el8.noarch 77/162 2024-06-02T04:40:03.599 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 65/162 2024-06-02T04:40:03.607 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 83/162 2024-06-02T04:40:03.656 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 78/162 2024-06-02T04:40:03.822 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 84/162 2024-06-02T04:40:03.824 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 79/162 2024-06-02T04:40:03.899 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 66/162 2024-06-02T04:40:04.058 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 85/162 2024-06-02T04:40:04.119 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 80/162 2024-06-02T04:40:04.147 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 67/162 2024-06-02T04:40:04.314 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 86/162 2024-06-02T04:40:04.363 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 81/162 2024-06-02T04:40:04.393 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 68/162 2024-06-02T04:40:04.473 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 87/162 2024-06-02T04:40:04.527 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 82/162 2024-06-02T04:40:04.650 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 88/162 2024-06-02T04:40:04.693 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 83/162 2024-06-02T04:40:04.698 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : krb5-devel-1.18.2-26.el8_9.x86_64 69/162 2024-06-02T04:40:04.886 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : oniguruma-6.8.2-2.1.el8_9.x86_64 70/162 2024-06-02T04:40:04.898 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 89/162 2024-06-02T04:40:04.924 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 84/162 2024-06-02T04:40:04.955 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: oniguruma-6.8.2-2.1.el8_9.x86_64 70/162 2024-06-02T04:40:05.131 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 90/162 2024-06-02T04:40:05.168 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 85/162 2024-06-02T04:40:05.259 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : jq-1.6-7.el8.x86_64 71/162 2024-06-02T04:40:05.317 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 91/162 2024-06-02T04:40:05.375 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 86/162 2024-06-02T04:40:05.495 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : automake-1.16.1-8.el8.noarch 72/162 2024-06-02T04:40:05.551 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 87/162 2024-06-02T04:40:05.581 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-portend-2.6-1.el8.noarch 92/162 2024-06-02T04:40:05.694 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : uuid-1.6.2-43.el8.x86_64 73/162 2024-06-02T04:40:05.695 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 88/162 2024-06-02T04:40:05.764 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 73/162 2024-06-02T04:40:05.828 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 93/162 2024-06-02T04:40:05.893 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 89/162 2024-06-02T04:40:05.976 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 74/162 2024-06-02T04:40:06.019 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 94/162 2024-06-02T04:40:06.093 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 90/162 2024-06-02T04:40:06.177 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 75/162 2024-06-02T04:40:06.226 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 95/162 2024-06-02T04:40:06.253 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 91/162 2024-06-02T04:40:06.414 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 76/162 2024-06-02T04:40:06.508 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-portend-2.6-1.el8.noarch 92/162 2024-06-02T04:40:06.638 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-packaging-16.8-9.el8.noarch 77/162 2024-06-02T04:40:06.763 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 93/162 2024-06-02T04:40:06.778 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 78/162 2024-06-02T04:40:06.930 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 94/162 2024-06-02T04:40:07.015 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 79/162 2024-06-02T04:40:07.154 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 95/162 2024-06-02T04:40:07.324 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 96/162 2024-06-02T04:40:07.347 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 80/162 2024-06-02T04:40:07.609 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 81/162 2024-06-02T04:40:07.673 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 97/162 2024-06-02T04:40:07.815 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 82/162 2024-06-02T04:40:07.893 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 98/162 2024-06-02T04:40:08.030 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 83/162 2024-06-02T04:40:08.220 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 96/162 2024-06-02T04:40:08.226 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 99/162 2024-06-02T04:40:08.239 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 84/162 2024-06-02T04:40:08.456 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 85/162 2024-06-02T04:40:08.491 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 100/162 2024-06-02T04:40:08.550 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 97/162 2024-06-02T04:40:08.694 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 101/162 2024-06-02T04:40:08.696 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 86/162 2024-06-02T04:40:08.762 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 98/162 2024-06-02T04:40:08.897 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 87/162 2024-06-02T04:40:09.038 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 99/162 2024-06-02T04:40:09.083 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 88/162 2024-06-02T04:40:09.281 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 100/162 2024-06-02T04:40:09.304 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 89/162 2024-06-02T04:40:09.457 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 102/162 2024-06-02T04:40:09.463 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 101/162 2024-06-02T04:40:09.547 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 90/162 2024-06-02T04:40:09.655 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : librgw2-2:18.2.2-1381.g3bb45379.el8.x86_64 103/162 2024-06-02T04:40:09.727 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: librgw2-2:18.2.2-1381.g3bb45379.el8.x86_64 103/162 2024-06-02T04:40:09.749 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 91/162 2024-06-02T04:40:09.919 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-rgw-2:18.2.2-1381.g3bb45379.el8.x86_64 104/162 2024-06-02T04:40:10.037 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-portend-2.6-1.el8.noarch 92/162 2024-06-02T04:40:10.220 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 102/162 2024-06-02T04:40:10.301 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 93/162 2024-06-02T04:40:10.542 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 94/162 2024-06-02T04:40:10.566 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : librgw2-2:18.2.2-1381.g3bb45379.el8.x86_64 103/162 2024-06-02T04:40:10.637 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: librgw2-2:18.2.2-1381.g3bb45379.el8.x86_64 103/162 2024-06-02T04:40:10.814 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-rgw-2:18.2.2-1381.g3bb45379.el8.x86_64 104/162 2024-06-02T04:40:10.842 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 95/162 2024-06-02T04:40:11.963 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 96/162 2024-06-02T04:40:12.306 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 97/162 2024-06-02T04:40:12.559 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 98/162 2024-06-02T04:40:12.860 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 99/162 2024-06-02T04:40:13.160 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 100/162 2024-06-02T04:40:13.343 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 101/162 2024-06-02T04:40:13.676 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-common-2:18.2.2-1381.g3bb45379.el8.x86_64 105/162 2024-06-02T04:40:13.944 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-common-2:18.2.2-1381.g3bb45379.el8.x86_64 105/162 2024-06-02T04:40:14.129 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 102/162 2024-06-02T04:40:14.533 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-common-2:18.2.2-1381.g3bb45379.el8.x86_64 105/162 2024-06-02T04:40:14.538 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-common-2:18.2.2-1381.g3bb45379.el8.x86_64 105/162 2024-06-02T04:40:14.728 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : librgw2-2:18.2.2-1381.g3bb45379.el8.x86_64 103/162 2024-06-02T04:40:14.755 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-common-2:18.2.2-1381.g3bb45379.el8.x86_64 105/162 2024-06-02T04:40:14.815 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-base-2:18.2.2-1381.g3bb45379.el8.x86_64 106/162 2024-06-02T04:40:14.823 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: librgw2-2:18.2.2-1381.g3bb45379.el8.x86_64 103/162 2024-06-02T04:40:14.896 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-base-2:18.2.2-1381.g3bb45379.el8.x86_64 106/162 2024-06-02T04:40:15.027 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-rgw-2:18.2.2-1381.g3bb45379.el8.x86_64 104/162 2024-06-02T04:40:15.043 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-selinux-2:18.2.2-1381.g3bb45379.el8.x86_64 107/162 2024-06-02T04:40:15.344 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-common-2:18.2.2-1381.g3bb45379.el8.x86_64 105/162 2024-06-02T04:40:15.637 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-base-2:18.2.2-1381.g3bb45379.el8.x86_64 106/162 2024-06-02T04:40:16.065 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-base-2:18.2.2-1381.g3bb45379.el8.x86_64 106/162 2024-06-02T04:40:16.562 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-selinux-2:18.2.2-1381.g3bb45379.el8.x86_64 107/162 2024-06-02T04:40:18.935 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: ceph-common-2:18.2.2-1381.g3bb45379.el8.x86_64 105/162 2024-06-02T04:40:19.176 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : ceph-common-2:18.2.2-1381.g3bb45379.el8.x86_64 105/162 2024-06-02T04:40:19.770 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: ceph-common-2:18.2.2-1381.g3bb45379.el8.x86_64 105/162 2024-06-02T04:40:20.771 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : ceph-base-2:18.2.2-1381.g3bb45379.el8.x86_64 106/162 2024-06-02T04:40:20.862 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: ceph-base-2:18.2.2-1381.g3bb45379.el8.x86_64 106/162 2024-06-02T04:40:21.017 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : ceph-selinux-2:18.2.2-1381.g3bb45379.el8.x86_64 107/162 2024-06-02T04:40:34.619 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-selinux-2:18.2.2-1381.g3bb45379.el8.x86_64 107/162 2024-06-02T04:40:34.619 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /sys 2024-06-02T04:40:34.619 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /proc 2024-06-02T04:40:34.619 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /dev 2024-06-02T04:40:34.619 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /run 2024-06-02T04:40:34.620 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /mnt 2024-06-02T04:40:34.620 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /var/tmp 2024-06-02T04:40:34.620 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /home 2024-06-02T04:40:34.620 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /tmp 2024-06-02T04:40:34.620 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /dev 2024-06-02T04:40:34.620 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-06-02T04:40:35.015 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-volume-2:18.2.2-1381.g3bb45379.el8.noarch 108/162 2024-06-02T04:40:36.017 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-selinux-2:18.2.2-1381.g3bb45379.el8.x86_64 107/162 2024-06-02T04:40:36.017 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /sys 2024-06-02T04:40:36.017 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /proc 2024-06-02T04:40:36.017 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /dev 2024-06-02T04:40:36.017 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /run 2024-06-02T04:40:36.017 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /mnt 2024-06-02T04:40:36.017 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /var/tmp 2024-06-02T04:40:36.017 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /home 2024-06-02T04:40:36.018 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /tmp 2024-06-02T04:40:36.018 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /dev 2024-06-02T04:40:36.018 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-06-02T04:40:36.359 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-volume-2:18.2.2-1381.g3bb45379.el8.noarch 108/162 2024-06-02T04:40:36.649 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-volume-2:18.2.2-1381.g3bb45379.el8.noarch 108/162 2024-06-02T04:40:36.836 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-osd-2:18.2.2-1381.g3bb45379.el8.x86_64 109/162 2024-06-02T04:40:37.055 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-osd-2:18.2.2-1381.g3bb45379.el8.x86_64 109/162 2024-06-02T04:40:37.215 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mds-2:18.2.2-1381.g3bb45379.el8.x86_64 110/162 2024-06-02T04:40:37.691 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-mds-2:18.2.2-1381.g3bb45379.el8.x86_64 110/162 2024-06-02T04:40:37.890 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mon-2:18.2.2-1381.g3bb45379.el8.x86_64 111/162 2024-06-02T04:40:37.909 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-mon-2:18.2.2-1381.g3bb45379.el8.x86_64 111/162 2024-06-02T04:40:37.994 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-volume-2:18.2.2-1381.g3bb45379.el8.noarch 108/162 2024-06-02T04:40:38.192 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-osd-2:18.2.2-1381.g3bb45379.el8.x86_64 109/162 2024-06-02T04:40:38.409 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-osd-2:18.2.2-1381.g3bb45379.el8.x86_64 109/162 2024-06-02T04:40:38.576 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mds-2:18.2.2-1381.g3bb45379.el8.x86_64 110/162 2024-06-02T04:40:39.058 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-mds-2:18.2.2-1381.g3bb45379.el8.x86_64 110/162 2024-06-02T04:40:39.234 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mon-2:18.2.2-1381.g3bb45379.el8.x86_64 111/162 2024-06-02T04:40:39.252 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-mon-2:18.2.2-1381.g3bb45379.el8.x86_64 111/162 2024-06-02T04:40:39.725 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: cephadm-2:18.2.2-1381.g3bb45379.el8.noarch 112/162 2024-06-02T04:40:39.881 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : cephadm-2:18.2.2-1381.g3bb45379.el8.noarch 112/162 2024-06-02T04:40:40.046 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-prometheus-alerts-2:18.2.2-1381.g3bb45379.e 113/162 2024-06-02T04:40:40.241 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-grafana-dashboards-2:18.2.2-1381.g3bb45379. 114/162 2024-06-02T04:40:40.467 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: ceph-selinux-2:18.2.2-1381.g3bb45379.el8.x86_64 107/162 2024-06-02T04:40:40.467 INFO:teuthology.orchestra.run.smithi076.stdout:skipping the directory /sys 2024-06-02T04:40:40.467 INFO:teuthology.orchestra.run.smithi076.stdout:skipping the directory /proc 2024-06-02T04:40:40.467 INFO:teuthology.orchestra.run.smithi076.stdout:skipping the directory /dev 2024-06-02T04:40:40.467 INFO:teuthology.orchestra.run.smithi076.stdout:skipping the directory /run 2024-06-02T04:40:40.467 INFO:teuthology.orchestra.run.smithi076.stdout:skipping the directory /mnt 2024-06-02T04:40:40.467 INFO:teuthology.orchestra.run.smithi076.stdout:skipping the directory /var/tmp 2024-06-02T04:40:40.467 INFO:teuthology.orchestra.run.smithi076.stdout:skipping the directory /home 2024-06-02T04:40:40.467 INFO:teuthology.orchestra.run.smithi076.stdout:skipping the directory /tmp 2024-06-02T04:40:40.467 INFO:teuthology.orchestra.run.smithi076.stdout:skipping the directory /dev 2024-06-02T04:40:40.468 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:40:40.472 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mgr-cephadm-2:18.2.2-1381.g3bb45379.el8.noa 115/162 2024-06-02T04:40:40.840 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : ceph-volume-2:18.2.2-1381.g3bb45379.el8.noarch 108/162 2024-06-02T04:40:41.008 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: cephadm-2:18.2.2-1381.g3bb45379.el8.noarch 112/162 2024-06-02T04:40:41.185 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : cephadm-2:18.2.2-1381.g3bb45379.el8.noarch 112/162 2024-06-02T04:40:41.307 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-prometheus-alerts-2:18.2.2-1381.g3bb45379.e 113/162 2024-06-02T04:40:41.499 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.2-1381.g3bb45379.el8.noa 115/162 2024-06-02T04:40:41.500 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-grafana-dashboards-2:18.2.2-1381.g3bb45379. 114/162 2024-06-02T04:40:41.708 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mgr-cephadm-2:18.2.2-1381.g3bb45379.el8.noa 115/162 2024-06-02T04:40:41.727 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mgr-dashboard-2:18.2.2-1381.g3bb45379.el8.n 116/162 2024-06-02T04:40:42.482 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: ceph-volume-2:18.2.2-1381.g3bb45379.el8.noarch 108/162 2024-06-02T04:40:42.703 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.2-1381.g3bb45379.el8.n 116/162 2024-06-02T04:40:42.734 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : ceph-osd-2:18.2.2-1381.g3bb45379.el8.x86_64 109/162 2024-06-02T04:40:42.746 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.2-1381.g3bb45379.el8.noa 115/162 2024-06-02T04:40:42.880 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.2-1381.g3bb 117/162 2024-06-02T04:40:42.955 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: ceph-osd-2:18.2.2-1381.g3bb45379.el8.x86_64 109/162 2024-06-02T04:40:42.974 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mgr-dashboard-2:18.2.2-1381.g3bb45379.el8.n 116/162 2024-06-02T04:40:42.974 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.2-1381.g3bb 117/162 2024-06-02T04:40:43.106 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : ceph-mds-2:18.2.2-1381.g3bb45379.el8.x86_64 110/162 2024-06-02T04:40:43.365 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mgr-modules-core-2:18.2.2-1381.g3bb45379.el 118/162 2024-06-02T04:40:43.577 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mgr-2:18.2.2-1381.g3bb45379.el8.x86_64 119/162 2024-06-02T04:40:43.583 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: ceph-mds-2:18.2.2-1381.g3bb45379.el8.x86_64 110/162 2024-06-02T04:40:43.616 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-mgr-2:18.2.2-1381.g3bb45379.el8.x86_64 119/162 2024-06-02T04:40:43.773 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : ceph-mon-2:18.2.2-1381.g3bb45379.el8.x86_64 111/162 2024-06-02T04:40:43.780 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mgr-rook-2:18.2.2-1381.g3bb45379.el8.noarch 120/162 2024-06-02T04:40:43.791 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: ceph-mon-2:18.2.2-1381.g3bb45379.el8.x86_64 111/162 2024-06-02T04:40:43.792 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.2-1381.g3bb45379.el8.noarch 120/162 2024-06-02T04:40:43.938 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.2-1381.g3bb45379.el8.n 116/162 2024-06-02T04:40:44.091 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.2-1381.g3bb 117/162 2024-06-02T04:40:44.184 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.2-1381.g3bb 117/162 2024-06-02T04:40:44.519 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mgr-modules-core-2:18.2.2-1381.g3bb45379.el 118/162 2024-06-02T04:40:44.716 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mgr-2:18.2.2-1381.g3bb45379.el8.x86_64 119/162 2024-06-02T04:40:44.755 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-mgr-2:18.2.2-1381.g3bb45379.el8.x86_64 119/162 2024-06-02T04:40:44.941 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mgr-rook-2:18.2.2-1381.g3bb45379.el8.noarch 120/162 2024-06-02T04:40:44.953 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.2-1381.g3bb45379.el8.noarch 120/162 2024-06-02T04:40:45.248 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-2:18.2.2-1381.g3bb45379.el8.x86_64 121/162 2024-06-02T04:40:45.510 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-radosgw-2:18.2.2-1381.g3bb45379.el8.x86_64 122/162 2024-06-02T04:40:45.546 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-radosgw-2:18.2.2-1381.g3bb45379.el8.x86_64 122/162 2024-06-02T04:40:45.688 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: cephadm-2:18.2.2-1381.g3bb45379.el8.noarch 112/162 2024-06-02T04:40:45.722 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-immutable-object-cache-2:18.2.2-1381.g3bb45 123/162 2024-06-02T04:40:45.766 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.2-1381.g3bb45 123/162 2024-06-02T04:40:45.895 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : cephadm-2:18.2.2-1381.g3bb45379.el8.noarch 112/162 2024-06-02T04:40:45.951 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : cephfs-mirror-2:18.2.2-1381.g3bb45379.el8.x86_64 124/162 2024-06-02T04:40:46.037 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : ceph-prometheus-alerts-2:18.2.2-1381.g3bb45379.e 113/162 2024-06-02T04:40:46.201 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-2:18.2.2-1381.g3bb45379.el8.x86_64 121/162 2024-06-02T04:40:46.264 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : ceph-grafana-dashboards-2:18.2.2-1381.g3bb45379. 114/162 2024-06-02T04:40:46.298 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: cephfs-mirror-2:18.2.2-1381.g3bb45379.el8.x86_64 124/162 2024-06-02T04:40:46.407 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-radosgw-2:18.2.2-1381.g3bb45379.el8.x86_64 122/162 2024-06-02T04:40:46.441 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-radosgw-2:18.2.2-1381.g3bb45379.el8.x86_64 122/162 2024-06-02T04:40:46.456 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : rbd-mirror-2:18.2.2-1381.g3bb45379.el8.x86_64 125/162 2024-06-02T04:40:46.514 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : ceph-mgr-cephadm-2:18.2.2-1381.g3bb45379.el8.noa 115/162 2024-06-02T04:40:46.608 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-immutable-object-cache-2:18.2.2-1381.g3bb45 123/162 2024-06-02T04:40:46.651 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.2-1381.g3bb45 123/162 2024-06-02T04:40:46.804 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : cephfs-mirror-2:18.2.2-1381.g3bb45379.el8.x86_64 124/162 2024-06-02T04:40:47.151 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: cephfs-mirror-2:18.2.2-1381.g3bb45379.el8.x86_64 124/162 2024-06-02T04:40:47.341 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : rbd-mirror-2:18.2.2-1381.g3bb45379.el8.x86_64 125/162 2024-06-02T04:40:47.542 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.2-1381.g3bb45379.el8.noa 115/162 2024-06-02T04:40:47.833 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : ceph-mgr-dashboard-2:18.2.2-1381.g3bb45379.el8.n 116/162 2024-06-02T04:40:48.802 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.2-1381.g3bb45379.el8.n 116/162 2024-06-02T04:40:48.980 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.2-1381.g3bb 117/162 2024-06-02T04:40:49.076 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.2-1381.g3bb 117/162 2024-06-02T04:40:49.471 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : ceph-mgr-modules-core-2:18.2.2-1381.g3bb45379.el 118/162 2024-06-02T04:40:49.892 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : ceph-mgr-2:18.2.2-1381.g3bb45379.el8.x86_64 119/162 2024-06-02T04:40:49.932 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: ceph-mgr-2:18.2.2-1381.g3bb45379.el8.x86_64 119/162 2024-06-02T04:40:50.124 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : ceph-mgr-rook-2:18.2.2-1381.g3bb45379.el8.noarch 120/162 2024-06-02T04:40:50.136 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.2-1381.g3bb45379.el8.noarch 120/162 2024-06-02T04:40:50.905 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: rbd-mirror-2:18.2.2-1381.g3bb45379.el8.x86_64 125/162 2024-06-02T04:40:51.408 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : ceph-2:18.2.2-1381.g3bb45379.el8.x86_64 121/162 2024-06-02T04:40:51.649 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : ceph-radosgw-2:18.2.2-1381.g3bb45379.el8.x86_64 122/162 2024-06-02T04:40:51.684 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: ceph-radosgw-2:18.2.2-1381.g3bb45379.el8.x86_64 122/162 2024-06-02T04:40:51.786 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: rbd-mirror-2:18.2.2-1381.g3bb45379.el8.x86_64 125/162 2024-06-02T04:40:51.872 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : ceph-immutable-object-cache-2:18.2.2-1381.g3bb45 123/162 2024-06-02T04:40:51.893 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-test-2:18.2.2-1381.g3bb45379.el8.x86_64 126/162 2024-06-02T04:40:51.915 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.2-1381.g3bb45 123/162 2024-06-02T04:40:52.122 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : cephfs-mirror-2:18.2.2-1381.g3bb45379.el8.x86_64 124/162 2024-06-02T04:40:52.209 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : openssl-devel-1:1.1.1k-12.el8_9.x86_64 127/162 2024-06-02T04:40:52.291 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-test-2:18.2.2-1381.g3bb45379.el8.x86_64 126/162 2024-06-02T04:40:52.470 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: cephfs-mirror-2:18.2.2-1381.g3bb45379.el8.x86_64 124/162 2024-06-02T04:40:52.530 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : elfutils-libelf-devel-0.189-3.el8.x86_64 128/162 2024-06-02T04:40:52.617 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : postgresql-contrib-10.23-4.module+el8.9.0+21317+ 127/162 2024-06-02T04:40:52.655 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : rbd-mirror-2:18.2.2-1381.g3bb45379.el8.x86_64 125/162 2024-06-02T04:40:52.823 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libtool-2.4.6-25.el8.x86_64 128/162 2024-06-02T04:40:52.906 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-fuse-2:18.2.2-1381.g3bb45379.el8.x86_64 129/162 2024-06-02T04:40:53.315 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : postgresql-contrib-10.23-4.module+el8.9.0+21317+ 130/162 2024-06-02T04:40:53.503 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 128/162 2024-06-02T04:40:53.537 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libtool-2.4.6-25.el8.x86_64 131/162 2024-06-02T04:40:53.551 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 131/162 2024-06-02T04:40:53.790 INFO:teuthology.orchestra.run.smithi192.stdout: Upgrading : util-linux-user-2.32.1-44.el8_9.1.x86_64 132/162 2024-06-02T04:40:53.802 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : openssl-devel-1:1.1.1k-12.el8_9.x86_64 129/162 2024-06-02T04:40:53.975 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 133/162 2024-06-02T04:40:54.089 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : elfutils-libelf-devel-0.189-3.el8.x86_64 130/162 2024-06-02T04:40:54.188 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libcephfs-devel-2:18.2.2-1381.g3bb45379.el8.x86_ 134/162 2024-06-02T04:40:54.337 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-fuse-2:18.2.2-1381.g3bb45379.el8.x86_64 131/162 2024-06-02T04:40:54.542 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : util-linux-user-2.32.1-44.el8_9.1.x86_64 132/162 2024-06-02T04:40:54.719 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 133/162 2024-06-02T04:40:54.916 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libcephfs-devel-2:18.2.2-1381.g3bb45379.el8.x86_ 134/162 2024-06-02T04:40:56.527 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: postgresql-server-10.23-4.module+el8.9.0+21317+d 135/162 2024-06-02T04:40:56.854 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : postgresql-server-10.23-4.module+el8.9.0+21317+d 135/162 2024-06-02T04:40:56.893 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: postgresql-server-10.23-4.module+el8.9.0+21317+d 135/162 2024-06-02T04:40:57.114 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: rbd-mirror-2:18.2.2-1381.g3bb45379.el8.x86_64 125/162 2024-06-02T04:40:57.167 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: postgresql-server-10.23-4.module+el8.9.0+21317+d 135/162 2024-06-02T04:40:57.331 INFO:teuthology.orchestra.run.smithi192.stdout: Upgrading : elfutils-libs-0.189-3.el8.x86_64 136/162 2024-06-02T04:40:57.465 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : postgresql-server-10.23-4.module+el8.9.0+21317+d 135/162 2024-06-02T04:40:57.503 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: postgresql-server-10.23-4.module+el8.9.0+21317+d 135/162 2024-06-02T04:40:57.605 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : ceph-test-2:18.2.2-1381.g3bb45379.el8.x86_64 126/162 2024-06-02T04:40:57.703 INFO:teuthology.orchestra.run.smithi192.stdout: Upgrading : iproute-6.2.0-5.el8_9.x86_64 137/162 2024-06-02T04:40:57.866 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : elfutils-libs-0.189-3.el8.x86_64 136/162 2024-06-02T04:40:57.915 INFO:teuthology.orchestra.run.smithi192.stdout: Upgrading : xfsdump-3.1.8-7.el8_9.x86_64 138/162 2024-06-02T04:40:57.939 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : postgresql-contrib-10.23-4.module+el8.9.0+21317+ 127/162 2024-06-02T04:40:58.129 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : cephfs-top-2:18.2.2-1381.g3bb45379.el8.noarch 139/162 2024-06-02T04:40:58.187 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : libtool-2.4.6-25.el8.x86_64 128/162 2024-06-02T04:40:58.213 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : iproute-6.2.0-5.el8_9.x86_64 137/162 2024-06-02T04:40:58.328 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : rbd-fuse-2:18.2.2-1381.g3bb45379.el8.x86_64 140/162 2024-06-02T04:40:58.418 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : xfsdump-3.1.8-7.el8_9.x86_64 138/162 2024-06-02T04:40:58.581 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : cephfs-top-2:18.2.2-1381.g3bb45379.el8.noarch 139/162 2024-06-02T04:40:58.618 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : rbd-nbd-2:18.2.2-1381.g3bb45379.el8.x86_64 141/162 2024-06-02T04:40:58.789 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : rbd-fuse-2:18.2.2-1381.g3bb45379.el8.x86_64 140/162 2024-06-02T04:40:58.879 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 128/162 2024-06-02T04:40:58.938 INFO:teuthology.orchestra.run.smithi192.stdout: Upgrading : openssl-1:1.1.1k-12.el8_9.x86_64 142/162 2024-06-02T04:40:59.030 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : rbd-nbd-2:18.2.2-1381.g3bb45379.el8.x86_64 141/162 2024-06-02T04:40:59.192 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : flex-2.6.1-9.el8.x86_64 143/162 2024-06-02T04:40:59.209 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : openssl-devel-1:1.1.1k-12.el8_9.x86_64 129/162 2024-06-02T04:40:59.268 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 143/162 2024-06-02T04:40:59.307 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : openssl-1:1.1.1k-12.el8_9.x86_64 142/162 2024-06-02T04:40:59.503 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : elfutils-libelf-devel-0.189-3.el8.x86_64 130/162 2024-06-02T04:40:59.512 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : bison-3.0.4-10.el8.x86_64 144/162 2024-06-02T04:40:59.514 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : NetworkManager-initscripts-updown-1:1.40.16-15.e 143/162 2024-06-02T04:40:59.523 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-15.e 143/162 2024-06-02T04:40:59.525 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 144/162 2024-06-02T04:40:59.695 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : NetworkManager-initscripts-updown-1:1.40.16-15.e 145/162 2024-06-02T04:40:59.704 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-15.e 145/162 2024-06-02T04:40:59.725 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 144/162 2024-06-02T04:40:59.743 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : ceph-fuse-2:18.2.2-1381.g3bb45379.el8.x86_64 131/162 2024-06-02T04:40:59.905 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 146/162 2024-06-02T04:40:59.965 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : flex-2.6.1-9.el8.x86_64 145/162 2024-06-02T04:41:00.006 INFO:teuthology.orchestra.run.smithi076.stdout: Upgrading : util-linux-user-2.32.1-44.el8_9.1.x86_64 132/162 2024-06-02T04:41:00.041 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 145/162 2024-06-02T04:41:00.078 INFO:teuthology.orchestra.run.smithi192.stdout: Cleanup : elfutils-libs-0.186-1.el8.x86_64 147/162 2024-06-02T04:41:00.246 INFO:teuthology.orchestra.run.smithi192.stdout: Cleanup : openssl-1:1.1.1k-6.el8_5.x86_64 148/162 2024-06-02T04:41:00.250 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 133/162 2024-06-02T04:41:00.289 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : bison-3.0.4-10.el8.x86_64 146/162 2024-06-02T04:41:00.301 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 146/162 2024-06-02T04:41:00.430 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : libcephfs-devel-2:18.2.2-1381.g3bb45379.el8.x86_ 134/162 2024-06-02T04:41:00.457 INFO:teuthology.orchestra.run.smithi192.stdout: Cleanup : xfsdump-3.1.8-4.el8.x86_64 149/162 2024-06-02T04:41:00.457 INFO:teuthology.orchestra.run.smithi192.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 150/162 2024-06-02T04:41:00.483 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : elfutils-libs-0.186-1.el8.x86_64 147/162 2024-06-02T04:41:00.657 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : openssl-1:1.1.1k-6.el8_5.x86_64 148/162 2024-06-02T04:41:00.756 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 150/162 2024-06-02T04:41:00.756 INFO:teuthology.orchestra.run.smithi192.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 151/162 2024-06-02T04:41:00.825 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : xfsdump-3.1.8-4.el8.x86_64 149/162 2024-06-02T04:41:00.825 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 150/162 2024-06-02T04:41:00.999 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 151/162 2024-06-02T04:41:00.999 INFO:teuthology.orchestra.run.smithi192.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 152/162 2024-06-02T04:41:01.083 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 150/162 2024-06-02T04:41:01.083 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 151/162 2024-06-02T04:41:01.284 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 152/162 2024-06-02T04:41:01.308 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 151/162 2024-06-02T04:41:01.308 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 152/162 2024-06-02T04:41:01.496 INFO:teuthology.orchestra.run.smithi192.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 153/162 2024-06-02T04:41:01.543 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 152/162 2024-06-02T04:41:01.705 INFO:teuthology.orchestra.run.smithi192.stdout: Cleanup : util-linux-user-2.32.1-35.el8.x86_64 154/162 2024-06-02T04:41:01.782 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 153/162 2024-06-02T04:41:01.938 INFO:teuthology.orchestra.run.smithi192.stdout: Cleanup : util-linux-2.32.1-35.el8.x86_64 155/162 2024-06-02T04:41:01.938 INFO:teuthology.orchestra.run.smithi192.stdout: Cleanup : libfdisk-2.32.1-35.el8.x86_64 156/162 2024-06-02T04:41:01.982 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : util-linux-user-2.32.1-35.el8.x86_64 154/162 2024-06-02T04:41:02.214 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: libfdisk-2.32.1-35.el8.x86_64 156/162 2024-06-02T04:41:02.214 INFO:teuthology.orchestra.run.smithi192.stdout: Cleanup : libmount-2.32.1-35.el8.x86_64 157/162 2024-06-02T04:41:02.215 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : util-linux-2.32.1-35.el8.x86_64 155/162 2024-06-02T04:41:02.215 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : libfdisk-2.32.1-35.el8.x86_64 156/162 2024-06-02T04:41:02.447 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: libmount-2.32.1-35.el8.x86_64 157/162 2024-06-02T04:41:02.447 INFO:teuthology.orchestra.run.smithi192.stdout: Cleanup : libblkid-2.32.1-35.el8.x86_64 158/162 2024-06-02T04:41:02.466 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: libfdisk-2.32.1-35.el8.x86_64 156/162 2024-06-02T04:41:02.466 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : libmount-2.32.1-35.el8.x86_64 157/162 2024-06-02T04:41:02.697 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: libblkid-2.32.1-35.el8.x86_64 158/162 2024-06-02T04:41:02.697 INFO:teuthology.orchestra.run.smithi192.stdout: Cleanup : libuuid-2.32.1-35.el8.x86_64 159/162 2024-06-02T04:41:02.741 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: libmount-2.32.1-35.el8.x86_64 157/162 2024-06-02T04:41:02.741 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : libblkid-2.32.1-35.el8.x86_64 158/162 2024-06-02T04:41:02.802 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: postgresql-server-10.23-4.module+el8.9.0+21317+d 135/162 2024-06-02T04:41:02.963 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: libuuid-2.32.1-35.el8.x86_64 159/162 2024-06-02T04:41:02.964 INFO:teuthology.orchestra.run.smithi192.stdout: Cleanup : libsmartcols-2.32.1-35.el8.x86_64 160/162 2024-06-02T04:41:02.974 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: libblkid-2.32.1-35.el8.x86_64 158/162 2024-06-02T04:41:02.974 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : libuuid-2.32.1-35.el8.x86_64 159/162 2024-06-02T04:41:03.204 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : postgresql-server-10.23-4.module+el8.9.0+21317+d 135/162 2024-06-02T04:41:03.205 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: libsmartcols-2.32.1-35.el8.x86_64 160/162 2024-06-02T04:41:03.232 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: libuuid-2.32.1-35.el8.x86_64 159/162 2024-06-02T04:41:03.232 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : libsmartcols-2.32.1-35.el8.x86_64 160/162 2024-06-02T04:41:03.242 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: postgresql-server-10.23-4.module+el8.9.0+21317+d 135/162 2024-06-02T04:41:03.372 INFO:teuthology.orchestra.run.smithi192.stdout: Cleanup : elfutils-libelf-0.186-1.el8.x86_64 161/162 2024-06-02T04:41:03.372 INFO:teuthology.orchestra.run.smithi192.stdout: Cleanup : openssl-libs-1:1.1.1k-6.el8_5.x86_64 162/162 2024-06-02T04:41:03.482 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: libsmartcols-2.32.1-35.el8.x86_64 160/162 2024-06-02T04:41:03.641 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : elfutils-libelf-0.186-1.el8.x86_64 161/162 2024-06-02T04:41:03.641 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : openssl-libs-1:1.1.1k-6.el8_5.x86_64 162/162 2024-06-02T04:41:03.664 INFO:teuthology.orchestra.run.smithi076.stdout: Upgrading : elfutils-libs-0.189-3.el8.x86_64 136/162 2024-06-02T04:41:04.039 INFO:teuthology.orchestra.run.smithi076.stdout: Upgrading : iproute-6.2.0-5.el8_9.x86_64 137/162 2024-06-02T04:41:04.299 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: openssl-libs-1:1.1.1k-6.el8_5.x86_64 162/162 2024-06-02T04:41:04.299 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-2:18.2.2-1381.g3bb45379.el8.x86_64 1/162 2024-06-02T04:41:04.299 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-base-2:18.2.2-1381.g3bb45379.el8.x86_64 2/162 2024-06-02T04:41:04.299 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-common-2:18.2.2-1381.g3bb45379.el8.x86_64 3/162 2024-06-02T04:41:04.299 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-fuse-2:18.2.2-1381.g3bb45379.el8.x86_64 4/162 2024-06-02T04:41:04.299 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-immutable-object-cache-2:18.2.2-1381.g3bb45 5/162 2024-06-02T04:41:04.299 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mds-2:18.2.2-1381.g3bb45379.el8.x86_64 6/162 2024-06-02T04:41:04.299 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mgr-2:18.2.2-1381.g3bb45379.el8.x86_64 7/162 2024-06-02T04:41:04.300 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mon-2:18.2.2-1381.g3bb45379.el8.x86_64 8/162 2024-06-02T04:41:04.300 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-osd-2:18.2.2-1381.g3bb45379.el8.x86_64 9/162 2024-06-02T04:41:04.300 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-radosgw-2:18.2.2-1381.g3bb45379.el8.x86_64 10/162 2024-06-02T04:41:04.300 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-selinux-2:18.2.2-1381.g3bb45379.el8.x86_64 11/162 2024-06-02T04:41:04.300 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-test-2:18.2.2-1381.g3bb45379.el8.x86_64 12/162 2024-06-02T04:41:04.300 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : cephfs-mirror-2:18.2.2-1381.g3bb45379.el8.x86_64 13/162 2024-06-02T04:41:04.300 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libcephfs-devel-2:18.2.2-1381.g3bb45379.el8.x86_ 14/162 2024-06-02T04:41:04.300 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libcephfs2-2:18.2.2-1381.g3bb45379.el8.x86_64 15/162 2024-06-02T04:41:04.300 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libcephsqlite-2:18.2.2-1381.g3bb45379.el8.x86_64 16/162 2024-06-02T04:41:04.300 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librados-devel-2:18.2.2-1381.g3bb45379.el8.x86_6 17/162 2024-06-02T04:41:04.300 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libradosstriper1-2:18.2.2-1381.g3bb45379.el8.x86 18/162 2024-06-02T04:41:04.301 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librgw2-2:18.2.2-1381.g3bb45379.el8.x86_64 19/162 2024-06-02T04:41:04.301 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-ceph-argparse-2:18.2.2-1381.g3bb45379.el 20/162 2024-06-02T04:41:04.301 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-ceph-common-2:18.2.2-1381.g3bb45379.el8. 21/162 2024-06-02T04:41:04.301 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-cephfs-2:18.2.2-1381.g3bb45379.el8.x86_6 22/162 2024-06-02T04:41:04.301 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-rados-2:18.2.2-1381.g3bb45379.el8.x86_64 23/162 2024-06-02T04:41:04.301 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-rbd-2:18.2.2-1381.g3bb45379.el8.x86_64 24/162 2024-06-02T04:41:04.301 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-rgw-2:18.2.2-1381.g3bb45379.el8.x86_64 25/162 2024-06-02T04:41:04.301 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : rbd-fuse-2:18.2.2-1381.g3bb45379.el8.x86_64 26/162 2024-06-02T04:41:04.301 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : rbd-mirror-2:18.2.2-1381.g3bb45379.el8.x86_64 27/162 2024-06-02T04:41:04.301 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : rbd-nbd-2:18.2.2-1381.g3bb45379.el8.x86_64 28/162 2024-06-02T04:41:04.301 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-grafana-dashboards-2:18.2.2-1381.g3bb45379. 29/162 2024-06-02T04:41:04.301 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mgr-cephadm-2:18.2.2-1381.g3bb45379.el8.noa 30/162 2024-06-02T04:41:04.302 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mgr-dashboard-2:18.2.2-1381.g3bb45379.el8.n 31/162 2024-06-02T04:41:04.302 INFO:teuthology.orchestra.run.smithi076.stdout: Upgrading : xfsdump-3.1.8-7.el8_9.x86_64 138/162 2024-06-02T04:41:04.313 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.2-1381.g3bb 32/162 2024-06-02T04:41:04.313 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mgr-modules-core-2:18.2.2-1381.g3bb45379.el 33/162 2024-06-02T04:41:04.313 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mgr-rook-2:18.2.2-1381.g3bb45379.el8.noarch 34/162 2024-06-02T04:41:04.313 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-prometheus-alerts-2:18.2.2-1381.g3bb45379.e 35/162 2024-06-02T04:41:04.313 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-volume-2:18.2.2-1381.g3bb45379.el8.noarch 36/162 2024-06-02T04:41:04.313 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : cephadm-2:18.2.2-1381.g3bb45379.el8.noarch 37/162 2024-06-02T04:41:04.313 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : cephfs-top-2:18.2.2-1381.g3bb45379.el8.noarch 38/162 2024-06-02T04:41:04.314 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/162 2024-06-02T04:41:04.314 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/162 2024-06-02T04:41:04.314 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/162 2024-06-02T04:41:04.314 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/162 2024-06-02T04:41:04.314 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/162 2024-06-02T04:41:04.314 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/162 2024-06-02T04:41:04.314 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/162 2024-06-02T04:41:04.314 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/162 2024-06-02T04:41:04.314 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/162 2024-06-02T04:41:04.314 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/162 2024-06-02T04:41:04.314 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/162 2024-06-02T04:41:04.314 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/162 2024-06-02T04:41:04.315 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/162 2024-06-02T04:41:04.315 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/162 2024-06-02T04:41:04.315 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/162 2024-06-02T04:41:04.315 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/162 2024-06-02T04:41:04.315 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/162 2024-06-02T04:41:04.315 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/162 2024-06-02T04:41:04.315 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/162 2024-06-02T04:41:04.315 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/162 2024-06-02T04:41:04.315 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/162 2024-06-02T04:41:04.315 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/162 2024-06-02T04:41:04.315 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/162 2024-06-02T04:41:04.316 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/162 2024-06-02T04:41:04.316 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/162 2024-06-02T04:41:04.316 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/162 2024-06-02T04:41:04.316 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/162 2024-06-02T04:41:04.316 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/162 2024-06-02T04:41:04.316 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/162 2024-06-02T04:41:04.316 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/162 2024-06-02T04:41:04.316 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/162 2024-06-02T04:41:04.316 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/162 2024-06-02T04:41:04.316 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/162 2024-06-02T04:41:04.316 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-packaging-16.8-9.el8.noarch 72/162 2024-06-02T04:41:04.316 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 73/162 2024-06-02T04:41:04.316 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/162 2024-06-02T04:41:04.316 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 75/162 2024-06-02T04:41:04.317 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 76/162 2024-06-02T04:41:04.317 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 77/162 2024-06-02T04:41:04.317 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 78/162 2024-06-02T04:41:04.317 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 79/162 2024-06-02T04:41:04.317 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 80/162 2024-06-02T04:41:04.317 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 81/162 2024-06-02T04:41:04.317 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 82/162 2024-06-02T04:41:04.317 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 83/162 2024-06-02T04:41:04.317 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 84/162 2024-06-02T04:41:04.317 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 85/162 2024-06-02T04:41:04.317 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 86/162 2024-06-02T04:41:04.317 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 87/162 2024-06-02T04:41:04.318 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 88/162 2024-06-02T04:41:04.318 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 89/162 2024-06-02T04:41:04.318 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 90/162 2024-06-02T04:41:04.318 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 91/162 2024-06-02T04:41:04.318 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 92/162 2024-06-02T04:41:04.318 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : elfutils-libelf-devel-0.189-3.el8.x86_64 93/162 2024-06-02T04:41:04.318 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : krb5-devel-1.18.2-26.el8_9.x86_64 94/162 2024-06-02T04:41:04.318 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : openssl-devel-1:1.1.1k-12.el8_9.x86_64 95/162 2024-06-02T04:41:04.318 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librabbitmq-0.9.0-5.el8_9.x86_64 96/162 2024-06-02T04:41:04.318 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-cryptography-3.2.1-7.el8_9.x86_64 97/162 2024-06-02T04:41:04.318 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-15.e 98/162 2024-06-02T04:41:04.318 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libuuid-devel-2.32.1-44.el8_9.1.x86_64 99/162 2024-06-02T04:41:04.318 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 100/162 2024-06-02T04:41:04.319 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 101/162 2024-06-02T04:41:04.319 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 102/162 2024-06-02T04:41:04.319 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 103/162 2024-06-02T04:41:04.319 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 104/162 2024-06-02T04:41:04.319 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 105/162 2024-06-02T04:41:04.319 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : bison-3.0.4-10.el8.x86_64 106/162 2024-06-02T04:41:04.319 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : flex-2.6.1-9.el8.x86_64 107/162 2024-06-02T04:41:04.319 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 108/162 2024-06-02T04:41:04.319 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 109/162 2024-06-02T04:41:04.319 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 110/162 2024-06-02T04:41:04.319 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 111/162 2024-06-02T04:41:04.319 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 112/162 2024-06-02T04:41:04.319 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 113/162 2024-06-02T04:41:04.320 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 114/162 2024-06-02T04:41:04.320 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 115/162 2024-06-02T04:41:04.320 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 116/162 2024-06-02T04:41:04.320 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 117/162 2024-06-02T04:41:04.320 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 118/162 2024-06-02T04:41:04.320 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : openblas-threads-0.3.15-6.el8.x86_64 119/162 2024-06-02T04:41:04.320 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 120/162 2024-06-02T04:41:04.320 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : openblas-0.3.15-6.el8.x86_64 121/162 2024-06-02T04:41:04.320 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : automake-1.16.1-8.el8.noarch 122/162 2024-06-02T04:41:04.320 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libpq-13.11-1.el8.x86_64 123/162 2024-06-02T04:41:04.320 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : jq-1.6-7.el8.x86_64 124/162 2024-06-02T04:41:04.320 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 125/162 2024-06-02T04:41:04.321 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c3 126/162 2024-06-02T04:41:04.321 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : oniguruma-6.8.2-2.1.el8_9.x86_64 127/162 2024-06-02T04:41:04.321 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : postgresql-10.23-4.module+el8.9.0+21317+d2c6bf8a 128/162 2024-06-02T04:41:04.321 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : postgresql-contrib-10.23-4.module+el8.9.0+21317+ 129/162 2024-06-02T04:41:04.321 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : postgresql-server-10.23-4.module+el8.9.0+21317+d 130/162 2024-06-02T04:41:04.321 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librados2-2:18.2.2-1381.g3bb45379.el8.x86_64 131/162 2024-06-02T04:41:04.321 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 132/162 2024-06-02T04:41:04.321 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librbd1-2:18.2.2-1381.g3bb45379.el8.x86_64 133/162 2024-06-02T04:41:04.321 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 134/162 2024-06-02T04:41:04.321 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : elfutils-libelf-0.189-3.el8.x86_64 135/162 2024-06-02T04:41:04.322 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : elfutils-libelf-0.186-1.el8.x86_64 136/162 2024-06-02T04:41:04.322 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : elfutils-libs-0.189-3.el8.x86_64 137/162 2024-06-02T04:41:04.322 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : elfutils-libs-0.186-1.el8.x86_64 138/162 2024-06-02T04:41:04.322 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : iproute-6.2.0-5.el8_9.x86_64 139/162 2024-06-02T04:41:04.322 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 140/162 2024-06-02T04:41:04.322 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : openssl-1:1.1.1k-12.el8_9.x86_64 141/162 2024-06-02T04:41:04.322 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : openssl-1:1.1.1k-6.el8_5.x86_64 142/162 2024-06-02T04:41:04.322 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : openssl-libs-1:1.1.1k-12.el8_9.x86_64 143/162 2024-06-02T04:41:04.322 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : openssl-libs-1:1.1.1k-6.el8_5.x86_64 144/162 2024-06-02T04:41:04.322 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : xfsdump-3.1.8-7.el8_9.x86_64 145/162 2024-06-02T04:41:04.322 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : xfsdump-3.1.8-4.el8.x86_64 146/162 2024-06-02T04:41:04.322 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 147/162 2024-06-02T04:41:04.322 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 148/162 2024-06-02T04:41:04.323 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libblkid-2.32.1-44.el8_9.1.x86_64 149/162 2024-06-02T04:41:04.323 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libblkid-2.32.1-35.el8.x86_64 150/162 2024-06-02T04:41:04.323 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libfdisk-2.32.1-44.el8_9.1.x86_64 151/162 2024-06-02T04:41:04.323 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libfdisk-2.32.1-35.el8.x86_64 152/162 2024-06-02T04:41:04.323 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libmount-2.32.1-44.el8_9.1.x86_64 153/162 2024-06-02T04:41:04.323 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libmount-2.32.1-35.el8.x86_64 154/162 2024-06-02T04:41:04.323 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libsmartcols-2.32.1-44.el8_9.1.x86_64 155/162 2024-06-02T04:41:04.323 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libsmartcols-2.32.1-35.el8.x86_64 156/162 2024-06-02T04:41:04.323 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libuuid-2.32.1-44.el8_9.1.x86_64 157/162 2024-06-02T04:41:04.323 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libuuid-2.32.1-35.el8.x86_64 158/162 2024-06-02T04:41:04.323 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : util-linux-2.32.1-44.el8_9.1.x86_64 159/162 2024-06-02T04:41:04.323 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : util-linux-2.32.1-35.el8.x86_64 160/162 2024-06-02T04:41:04.324 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : util-linux-user-2.32.1-44.el8_9.1.x86_64 161/162 2024-06-02T04:41:04.470 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : cephfs-top-2:18.2.2-1381.g3bb45379.el8.noarch 139/162 2024-06-02T04:41:04.538 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: openssl-libs-1:1.1.1k-6.el8_5.x86_64 162/162 2024-06-02T04:41:04.538 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-2:18.2.2-1381.g3bb45379.el8.x86_64 1/162 2024-06-02T04:41:04.538 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-base-2:18.2.2-1381.g3bb45379.el8.x86_64 2/162 2024-06-02T04:41:04.538 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-common-2:18.2.2-1381.g3bb45379.el8.x86_64 3/162 2024-06-02T04:41:04.539 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-fuse-2:18.2.2-1381.g3bb45379.el8.x86_64 4/162 2024-06-02T04:41:04.539 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-immutable-object-cache-2:18.2.2-1381.g3bb45 5/162 2024-06-02T04:41:04.539 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mds-2:18.2.2-1381.g3bb45379.el8.x86_64 6/162 2024-06-02T04:41:04.539 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mgr-2:18.2.2-1381.g3bb45379.el8.x86_64 7/162 2024-06-02T04:41:04.539 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mon-2:18.2.2-1381.g3bb45379.el8.x86_64 8/162 2024-06-02T04:41:04.539 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-osd-2:18.2.2-1381.g3bb45379.el8.x86_64 9/162 2024-06-02T04:41:04.539 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-radosgw-2:18.2.2-1381.g3bb45379.el8.x86_64 10/162 2024-06-02T04:41:04.539 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-selinux-2:18.2.2-1381.g3bb45379.el8.x86_64 11/162 2024-06-02T04:41:04.539 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-test-2:18.2.2-1381.g3bb45379.el8.x86_64 12/162 2024-06-02T04:41:04.539 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : cephfs-mirror-2:18.2.2-1381.g3bb45379.el8.x86_64 13/162 2024-06-02T04:41:04.539 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libcephfs-devel-2:18.2.2-1381.g3bb45379.el8.x86_ 14/162 2024-06-02T04:41:04.539 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libcephfs2-2:18.2.2-1381.g3bb45379.el8.x86_64 15/162 2024-06-02T04:41:04.540 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libcephsqlite-2:18.2.2-1381.g3bb45379.el8.x86_64 16/162 2024-06-02T04:41:04.540 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librados-devel-2:18.2.2-1381.g3bb45379.el8.x86_6 17/162 2024-06-02T04:41:04.540 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libradosstriper1-2:18.2.2-1381.g3bb45379.el8.x86 18/162 2024-06-02T04:41:04.540 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librgw2-2:18.2.2-1381.g3bb45379.el8.x86_64 19/162 2024-06-02T04:41:04.540 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-ceph-argparse-2:18.2.2-1381.g3bb45379.el 20/162 2024-06-02T04:41:04.540 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-ceph-common-2:18.2.2-1381.g3bb45379.el8. 21/162 2024-06-02T04:41:04.540 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-cephfs-2:18.2.2-1381.g3bb45379.el8.x86_6 22/162 2024-06-02T04:41:04.540 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-rados-2:18.2.2-1381.g3bb45379.el8.x86_64 23/162 2024-06-02T04:41:04.540 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-rbd-2:18.2.2-1381.g3bb45379.el8.x86_64 24/162 2024-06-02T04:41:04.540 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-rgw-2:18.2.2-1381.g3bb45379.el8.x86_64 25/162 2024-06-02T04:41:04.540 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : rbd-fuse-2:18.2.2-1381.g3bb45379.el8.x86_64 26/162 2024-06-02T04:41:04.540 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : rbd-mirror-2:18.2.2-1381.g3bb45379.el8.x86_64 27/162 2024-06-02T04:41:04.541 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : rbd-nbd-2:18.2.2-1381.g3bb45379.el8.x86_64 28/162 2024-06-02T04:41:04.541 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-grafana-dashboards-2:18.2.2-1381.g3bb45379. 29/162 2024-06-02T04:41:04.541 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mgr-cephadm-2:18.2.2-1381.g3bb45379.el8.noa 30/162 2024-06-02T04:41:04.541 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mgr-dashboard-2:18.2.2-1381.g3bb45379.el8.n 31/162 2024-06-02T04:41:04.541 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.2-1381.g3bb 32/162 2024-06-02T04:41:04.541 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mgr-modules-core-2:18.2.2-1381.g3bb45379.el 33/162 2024-06-02T04:41:04.541 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mgr-rook-2:18.2.2-1381.g3bb45379.el8.noarch 34/162 2024-06-02T04:41:04.541 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-prometheus-alerts-2:18.2.2-1381.g3bb45379.e 35/162 2024-06-02T04:41:04.541 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-volume-2:18.2.2-1381.g3bb45379.el8.noarch 36/162 2024-06-02T04:41:04.541 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : cephadm-2:18.2.2-1381.g3bb45379.el8.noarch 37/162 2024-06-02T04:41:04.541 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : cephfs-top-2:18.2.2-1381.g3bb45379.el8.noarch 38/162 2024-06-02T04:41:04.541 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/162 2024-06-02T04:41:04.542 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/162 2024-06-02T04:41:04.542 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/162 2024-06-02T04:41:04.542 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/162 2024-06-02T04:41:04.542 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/162 2024-06-02T04:41:04.542 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/162 2024-06-02T04:41:04.542 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/162 2024-06-02T04:41:04.542 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/162 2024-06-02T04:41:04.542 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/162 2024-06-02T04:41:04.542 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/162 2024-06-02T04:41:04.542 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/162 2024-06-02T04:41:04.542 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/162 2024-06-02T04:41:04.543 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/162 2024-06-02T04:41:04.543 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/162 2024-06-02T04:41:04.543 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/162 2024-06-02T04:41:04.543 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/162 2024-06-02T04:41:04.543 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/162 2024-06-02T04:41:04.543 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/162 2024-06-02T04:41:04.543 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/162 2024-06-02T04:41:04.543 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/162 2024-06-02T04:41:04.543 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/162 2024-06-02T04:41:04.543 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/162 2024-06-02T04:41:04.543 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/162 2024-06-02T04:41:04.543 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/162 2024-06-02T04:41:04.544 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/162 2024-06-02T04:41:04.544 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/162 2024-06-02T04:41:04.544 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/162 2024-06-02T04:41:04.544 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/162 2024-06-02T04:41:04.544 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/162 2024-06-02T04:41:04.544 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/162 2024-06-02T04:41:04.544 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/162 2024-06-02T04:41:04.544 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/162 2024-06-02T04:41:04.544 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/162 2024-06-02T04:41:04.544 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-packaging-16.8-9.el8.noarch 72/162 2024-06-02T04:41:04.544 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 73/162 2024-06-02T04:41:04.544 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 74/162 2024-06-02T04:41:04.544 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 75/162 2024-06-02T04:41:04.545 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 76/162 2024-06-02T04:41:04.545 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 77/162 2024-06-02T04:41:04.545 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 78/162 2024-06-02T04:41:04.545 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : bison-3.0.4-10.el8.x86_64 79/162 2024-06-02T04:41:04.545 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : flex-2.6.1-9.el8.x86_64 80/162 2024-06-02T04:41:04.545 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 81/162 2024-06-02T04:41:04.545 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 82/162 2024-06-02T04:41:04.545 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 83/162 2024-06-02T04:41:04.545 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 84/162 2024-06-02T04:41:04.545 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 85/162 2024-06-02T04:41:04.545 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 86/162 2024-06-02T04:41:04.546 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 87/162 2024-06-02T04:41:04.546 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 88/162 2024-06-02T04:41:04.546 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 89/162 2024-06-02T04:41:04.546 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 90/162 2024-06-02T04:41:04.546 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 91/162 2024-06-02T04:41:04.546 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : openblas-threads-0.3.15-6.el8.x86_64 92/162 2024-06-02T04:41:04.546 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 93/162 2024-06-02T04:41:04.546 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : openblas-0.3.15-6.el8.x86_64 94/162 2024-06-02T04:41:04.546 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : automake-1.16.1-8.el8.noarch 95/162 2024-06-02T04:41:04.546 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libpq-13.11-1.el8.x86_64 96/162 2024-06-02T04:41:04.546 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : jq-1.6-7.el8.x86_64 97/162 2024-06-02T04:41:04.546 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 98/162 2024-06-02T04:41:04.547 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c3 99/162 2024-06-02T04:41:04.547 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : oniguruma-6.8.2-2.1.el8_9.x86_64 100/162 2024-06-02T04:41:04.547 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : postgresql-10.23-4.module+el8.9.0+21317+d2c6bf8a 101/162 2024-06-02T04:41:04.547 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : postgresql-contrib-10.23-4.module+el8.9.0+21317+ 102/162 2024-06-02T04:41:04.547 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : postgresql-server-10.23-4.module+el8.9.0+21317+d 103/162 2024-06-02T04:41:04.547 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 104/162 2024-06-02T04:41:04.547 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 105/162 2024-06-02T04:41:04.547 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 106/162 2024-06-02T04:41:04.547 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 107/162 2024-06-02T04:41:04.547 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 108/162 2024-06-02T04:41:04.547 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 109/162 2024-06-02T04:41:04.548 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 110/162 2024-06-02T04:41:04.548 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 111/162 2024-06-02T04:41:04.548 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 112/162 2024-06-02T04:41:04.548 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 113/162 2024-06-02T04:41:04.548 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 114/162 2024-06-02T04:41:04.548 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 115/162 2024-06-02T04:41:04.548 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 116/162 2024-06-02T04:41:04.548 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 117/162 2024-06-02T04:41:04.548 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 118/162 2024-06-02T04:41:04.548 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 119/162 2024-06-02T04:41:04.548 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 120/162 2024-06-02T04:41:04.548 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 121/162 2024-06-02T04:41:04.548 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 122/162 2024-06-02T04:41:04.549 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 123/162 2024-06-02T04:41:04.549 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : elfutils-libelf-devel-0.189-3.el8.x86_64 124/162 2024-06-02T04:41:04.549 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : krb5-devel-1.18.2-26.el8_9.x86_64 125/162 2024-06-02T04:41:04.549 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : openssl-devel-1:1.1.1k-12.el8_9.x86_64 126/162 2024-06-02T04:41:04.549 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librabbitmq-0.9.0-5.el8_9.x86_64 127/162 2024-06-02T04:41:04.549 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-cryptography-3.2.1-7.el8_9.x86_64 128/162 2024-06-02T04:41:04.549 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-15.e 129/162 2024-06-02T04:41:04.549 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libuuid-devel-2.32.1-44.el8_9.1.x86_64 130/162 2024-06-02T04:41:04.549 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librados2-2:18.2.2-1381.g3bb45379.el8.x86_64 131/162 2024-06-02T04:41:04.549 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 132/162 2024-06-02T04:41:04.549 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librbd1-2:18.2.2-1381.g3bb45379.el8.x86_64 133/162 2024-06-02T04:41:04.549 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 134/162 2024-06-02T04:41:04.550 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : elfutils-libelf-0.189-3.el8.x86_64 135/162 2024-06-02T04:41:04.550 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : elfutils-libelf-0.186-1.el8.x86_64 136/162 2024-06-02T04:41:04.550 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : elfutils-libs-0.189-3.el8.x86_64 137/162 2024-06-02T04:41:04.550 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : elfutils-libs-0.186-1.el8.x86_64 138/162 2024-06-02T04:41:04.550 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : iproute-6.2.0-5.el8_9.x86_64 139/162 2024-06-02T04:41:04.550 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 140/162 2024-06-02T04:41:04.550 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : openssl-1:1.1.1k-12.el8_9.x86_64 141/162 2024-06-02T04:41:04.550 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : openssl-1:1.1.1k-6.el8_5.x86_64 142/162 2024-06-02T04:41:04.550 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : openssl-libs-1:1.1.1k-12.el8_9.x86_64 143/162 2024-06-02T04:41:04.550 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : openssl-libs-1:1.1.1k-6.el8_5.x86_64 144/162 2024-06-02T04:41:04.551 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : xfsdump-3.1.8-7.el8_9.x86_64 145/162 2024-06-02T04:41:04.551 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : xfsdump-3.1.8-4.el8.x86_64 146/162 2024-06-02T04:41:04.551 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 147/162 2024-06-02T04:41:04.551 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 148/162 2024-06-02T04:41:04.551 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libblkid-2.32.1-44.el8_9.1.x86_64 149/162 2024-06-02T04:41:04.551 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libblkid-2.32.1-35.el8.x86_64 150/162 2024-06-02T04:41:04.551 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libfdisk-2.32.1-44.el8_9.1.x86_64 151/162 2024-06-02T04:41:04.551 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libfdisk-2.32.1-35.el8.x86_64 152/162 2024-06-02T04:41:04.551 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libmount-2.32.1-44.el8_9.1.x86_64 153/162 2024-06-02T04:41:04.551 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libmount-2.32.1-35.el8.x86_64 154/162 2024-06-02T04:41:04.551 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libsmartcols-2.32.1-44.el8_9.1.x86_64 155/162 2024-06-02T04:41:04.552 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libsmartcols-2.32.1-35.el8.x86_64 156/162 2024-06-02T04:41:04.552 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libuuid-2.32.1-44.el8_9.1.x86_64 157/162 2024-06-02T04:41:04.552 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libuuid-2.32.1-35.el8.x86_64 158/162 2024-06-02T04:41:04.552 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : util-linux-2.32.1-44.el8_9.1.x86_64 159/162 2024-06-02T04:41:04.552 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : util-linux-2.32.1-35.el8.x86_64 160/162 2024-06-02T04:41:04.552 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : util-linux-user-2.32.1-44.el8_9.1.x86_64 161/162 2024-06-02T04:41:04.703 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : rbd-fuse-2:18.2.2-1381.g3bb45379.el8.x86_64 140/162 2024-06-02T04:41:05.045 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : rbd-nbd-2:18.2.2-1381.g3bb45379.el8.x86_64 141/162 2024-06-02T04:41:05.338 INFO:teuthology.orchestra.run.smithi076.stdout: Upgrading : openssl-1:1.1.1k-12.el8_9.x86_64 142/162 2024-06-02T04:41:05.511 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : NetworkManager-initscripts-updown-1:1.40.16-15.e 143/162 2024-06-02T04:41:05.521 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-15.e 143/162 2024-06-02T04:41:05.740 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 144/162 2024-06-02T04:41:06.005 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : flex-2.6.1-9.el8.x86_64 145/162 2024-06-02T04:41:06.087 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 145/162 2024-06-02T04:41:06.336 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : bison-3.0.4-10.el8.x86_64 146/162 2024-06-02T04:41:06.351 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 146/162 2024-06-02T04:41:06.568 INFO:teuthology.orchestra.run.smithi076.stdout: Cleanup : elfutils-libs-0.186-1.el8.x86_64 147/162 2024-06-02T04:41:06.780 INFO:teuthology.orchestra.run.smithi076.stdout: Cleanup : openssl-1:1.1.1k-6.el8_5.x86_64 148/162 2024-06-02T04:41:06.981 INFO:teuthology.orchestra.run.smithi076.stdout: Cleanup : xfsdump-3.1.8-4.el8.x86_64 149/162 2024-06-02T04:41:06.982 INFO:teuthology.orchestra.run.smithi076.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 150/162 2024-06-02T04:41:07.281 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 150/162 2024-06-02T04:41:07.281 INFO:teuthology.orchestra.run.smithi076.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 151/162 2024-06-02T04:41:07.548 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 151/162 2024-06-02T04:41:07.548 INFO:teuthology.orchestra.run.smithi076.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 152/162 2024-06-02T04:41:07.817 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 152/162 2024-06-02T04:41:08.079 INFO:teuthology.orchestra.run.smithi076.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 153/162 2024-06-02T04:41:08.245 INFO:teuthology.orchestra.run.smithi076.stdout: Cleanup : util-linux-user-2.32.1-35.el8.x86_64 154/162 2024-06-02T04:41:08.554 INFO:teuthology.orchestra.run.smithi076.stdout: Cleanup : util-linux-2.32.1-35.el8.x86_64 155/162 2024-06-02T04:41:08.555 INFO:teuthology.orchestra.run.smithi076.stdout: Cleanup : libfdisk-2.32.1-35.el8.x86_64 156/162 2024-06-02T04:41:08.839 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: libfdisk-2.32.1-35.el8.x86_64 156/162 2024-06-02T04:41:08.839 INFO:teuthology.orchestra.run.smithi076.stdout: Cleanup : libmount-2.32.1-35.el8.x86_64 157/162 2024-06-02T04:41:09.105 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: libmount-2.32.1-35.el8.x86_64 157/162 2024-06-02T04:41:09.105 INFO:teuthology.orchestra.run.smithi076.stdout: Cleanup : libblkid-2.32.1-35.el8.x86_64 158/162 2024-06-02T04:41:09.355 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: libblkid-2.32.1-35.el8.x86_64 158/162 2024-06-02T04:41:09.355 INFO:teuthology.orchestra.run.smithi076.stdout: Cleanup : libuuid-2.32.1-35.el8.x86_64 159/162 2024-06-02T04:41:09.621 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: libuuid-2.32.1-35.el8.x86_64 159/162 2024-06-02T04:41:09.621 INFO:teuthology.orchestra.run.smithi076.stdout: Cleanup : libsmartcols-2.32.1-35.el8.x86_64 160/162 2024-06-02T04:41:09.888 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: libsmartcols-2.32.1-35.el8.x86_64 160/162 2024-06-02T04:41:10.047 INFO:teuthology.orchestra.run.smithi076.stdout: Cleanup : elfutils-libelf-0.186-1.el8.x86_64 161/162 2024-06-02T04:41:10.047 INFO:teuthology.orchestra.run.smithi076.stdout: Cleanup : openssl-libs-1:1.1.1k-6.el8_5.x86_64 162/162 2024-06-02T04:41:11.257 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: openssl-libs-1:1.1.1k-6.el8_5.x86_64 162/162 2024-06-02T04:41:11.257 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : ceph-2:18.2.2-1381.g3bb45379.el8.x86_64 1/162 2024-06-02T04:41:11.257 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : ceph-base-2:18.2.2-1381.g3bb45379.el8.x86_64 2/162 2024-06-02T04:41:11.257 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : ceph-common-2:18.2.2-1381.g3bb45379.el8.x86_64 3/162 2024-06-02T04:41:11.257 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : ceph-fuse-2:18.2.2-1381.g3bb45379.el8.x86_64 4/162 2024-06-02T04:41:11.257 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : ceph-immutable-object-cache-2:18.2.2-1381.g3bb45 5/162 2024-06-02T04:41:11.258 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : ceph-mds-2:18.2.2-1381.g3bb45379.el8.x86_64 6/162 2024-06-02T04:41:11.258 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : ceph-mgr-2:18.2.2-1381.g3bb45379.el8.x86_64 7/162 2024-06-02T04:41:11.258 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : ceph-mon-2:18.2.2-1381.g3bb45379.el8.x86_64 8/162 2024-06-02T04:41:11.258 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : ceph-osd-2:18.2.2-1381.g3bb45379.el8.x86_64 9/162 2024-06-02T04:41:11.258 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : ceph-radosgw-2:18.2.2-1381.g3bb45379.el8.x86_64 10/162 2024-06-02T04:41:11.258 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : ceph-selinux-2:18.2.2-1381.g3bb45379.el8.x86_64 11/162 2024-06-02T04:41:11.258 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : ceph-test-2:18.2.2-1381.g3bb45379.el8.x86_64 12/162 2024-06-02T04:41:11.258 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : cephfs-mirror-2:18.2.2-1381.g3bb45379.el8.x86_64 13/162 2024-06-02T04:41:11.258 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : libcephfs-devel-2:18.2.2-1381.g3bb45379.el8.x86_ 14/162 2024-06-02T04:41:11.258 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : libcephfs2-2:18.2.2-1381.g3bb45379.el8.x86_64 15/162 2024-06-02T04:41:11.258 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : libcephsqlite-2:18.2.2-1381.g3bb45379.el8.x86_64 16/162 2024-06-02T04:41:11.258 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : librados-devel-2:18.2.2-1381.g3bb45379.el8.x86_6 17/162 2024-06-02T04:41:11.259 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : libradosstriper1-2:18.2.2-1381.g3bb45379.el8.x86 18/162 2024-06-02T04:41:11.259 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : librgw2-2:18.2.2-1381.g3bb45379.el8.x86_64 19/162 2024-06-02T04:41:11.259 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-ceph-argparse-2:18.2.2-1381.g3bb45379.el 20/162 2024-06-02T04:41:11.259 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-ceph-common-2:18.2.2-1381.g3bb45379.el8. 21/162 2024-06-02T04:41:11.259 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-cephfs-2:18.2.2-1381.g3bb45379.el8.x86_6 22/162 2024-06-02T04:41:11.259 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-rados-2:18.2.2-1381.g3bb45379.el8.x86_64 23/162 2024-06-02T04:41:11.259 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-rbd-2:18.2.2-1381.g3bb45379.el8.x86_64 24/162 2024-06-02T04:41:11.259 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-rgw-2:18.2.2-1381.g3bb45379.el8.x86_64 25/162 2024-06-02T04:41:11.259 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : rbd-fuse-2:18.2.2-1381.g3bb45379.el8.x86_64 26/162 2024-06-02T04:41:11.259 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : rbd-mirror-2:18.2.2-1381.g3bb45379.el8.x86_64 27/162 2024-06-02T04:41:11.259 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : rbd-nbd-2:18.2.2-1381.g3bb45379.el8.x86_64 28/162 2024-06-02T04:41:11.259 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : ceph-grafana-dashboards-2:18.2.2-1381.g3bb45379. 29/162 2024-06-02T04:41:11.259 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : ceph-mgr-cephadm-2:18.2.2-1381.g3bb45379.el8.noa 30/162 2024-06-02T04:41:11.270 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : ceph-mgr-dashboard-2:18.2.2-1381.g3bb45379.el8.n 31/162 2024-06-02T04:41:11.270 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.2-1381.g3bb 32/162 2024-06-02T04:41:11.270 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : ceph-mgr-modules-core-2:18.2.2-1381.g3bb45379.el 33/162 2024-06-02T04:41:11.270 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : ceph-mgr-rook-2:18.2.2-1381.g3bb45379.el8.noarch 34/162 2024-06-02T04:41:11.271 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : ceph-prometheus-alerts-2:18.2.2-1381.g3bb45379.e 35/162 2024-06-02T04:41:11.271 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : ceph-volume-2:18.2.2-1381.g3bb45379.el8.noarch 36/162 2024-06-02T04:41:11.271 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : cephadm-2:18.2.2-1381.g3bb45379.el8.noarch 37/162 2024-06-02T04:41:11.271 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : cephfs-top-2:18.2.2-1381.g3bb45379.el8.noarch 38/162 2024-06-02T04:41:11.271 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/162 2024-06-02T04:41:11.271 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/162 2024-06-02T04:41:11.271 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/162 2024-06-02T04:41:11.271 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/162 2024-06-02T04:41:11.271 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/162 2024-06-02T04:41:11.271 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/162 2024-06-02T04:41:11.271 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/162 2024-06-02T04:41:11.271 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/162 2024-06-02T04:41:11.272 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/162 2024-06-02T04:41:11.272 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/162 2024-06-02T04:41:11.272 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/162 2024-06-02T04:41:11.272 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/162 2024-06-02T04:41:11.272 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/162 2024-06-02T04:41:11.272 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/162 2024-06-02T04:41:11.272 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/162 2024-06-02T04:41:11.272 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/162 2024-06-02T04:41:11.272 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/162 2024-06-02T04:41:11.272 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/162 2024-06-02T04:41:11.272 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/162 2024-06-02T04:41:11.272 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/162 2024-06-02T04:41:11.272 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/162 2024-06-02T04:41:11.273 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/162 2024-06-02T04:41:11.273 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/162 2024-06-02T04:41:11.273 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/162 2024-06-02T04:41:11.273 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/162 2024-06-02T04:41:11.273 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/162 2024-06-02T04:41:11.273 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/162 2024-06-02T04:41:11.273 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/162 2024-06-02T04:41:11.273 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/162 2024-06-02T04:41:11.273 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/162 2024-06-02T04:41:11.273 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/162 2024-06-02T04:41:11.273 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/162 2024-06-02T04:41:11.273 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/162 2024-06-02T04:41:11.274 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-packaging-16.8-9.el8.noarch 72/162 2024-06-02T04:41:11.274 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 73/162 2024-06-02T04:41:11.274 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 74/162 2024-06-02T04:41:11.274 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 75/162 2024-06-02T04:41:11.274 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 76/162 2024-06-02T04:41:11.274 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 77/162 2024-06-02T04:41:11.274 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 78/162 2024-06-02T04:41:11.274 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : bison-3.0.4-10.el8.x86_64 79/162 2024-06-02T04:41:11.274 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : flex-2.6.1-9.el8.x86_64 80/162 2024-06-02T04:41:11.274 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 81/162 2024-06-02T04:41:11.274 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 82/162 2024-06-02T04:41:11.274 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 83/162 2024-06-02T04:41:11.275 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 84/162 2024-06-02T04:41:11.275 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 85/162 2024-06-02T04:41:11.275 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 86/162 2024-06-02T04:41:11.275 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 87/162 2024-06-02T04:41:11.275 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 88/162 2024-06-02T04:41:11.275 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 89/162 2024-06-02T04:41:11.275 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 90/162 2024-06-02T04:41:11.275 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 91/162 2024-06-02T04:41:11.275 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : openblas-threads-0.3.15-6.el8.x86_64 92/162 2024-06-02T04:41:11.275 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 93/162 2024-06-02T04:41:11.275 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : openblas-0.3.15-6.el8.x86_64 94/162 2024-06-02T04:41:11.275 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : automake-1.16.1-8.el8.noarch 95/162 2024-06-02T04:41:11.276 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : libpq-13.11-1.el8.x86_64 96/162 2024-06-02T04:41:11.276 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : jq-1.6-7.el8.x86_64 97/162 2024-06-02T04:41:11.276 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 98/162 2024-06-02T04:41:11.276 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c3 99/162 2024-06-02T04:41:11.276 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : oniguruma-6.8.2-2.1.el8_9.x86_64 100/162 2024-06-02T04:41:11.276 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : postgresql-10.23-4.module+el8.9.0+21317+d2c6bf8a 101/162 2024-06-02T04:41:11.276 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : postgresql-contrib-10.23-4.module+el8.9.0+21317+ 102/162 2024-06-02T04:41:11.276 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : postgresql-server-10.23-4.module+el8.9.0+21317+d 103/162 2024-06-02T04:41:11.276 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 104/162 2024-06-02T04:41:11.276 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 105/162 2024-06-02T04:41:11.276 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 106/162 2024-06-02T04:41:11.276 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 107/162 2024-06-02T04:41:11.276 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 108/162 2024-06-02T04:41:11.277 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 109/162 2024-06-02T04:41:11.277 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 110/162 2024-06-02T04:41:11.277 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 111/162 2024-06-02T04:41:11.277 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 112/162 2024-06-02T04:41:11.277 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 113/162 2024-06-02T04:41:11.277 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 114/162 2024-06-02T04:41:11.277 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 115/162 2024-06-02T04:41:11.277 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 116/162 2024-06-02T04:41:11.277 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 117/162 2024-06-02T04:41:11.277 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 118/162 2024-06-02T04:41:11.277 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 119/162 2024-06-02T04:41:11.277 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 120/162 2024-06-02T04:41:11.277 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 121/162 2024-06-02T04:41:11.278 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 122/162 2024-06-02T04:41:11.278 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 123/162 2024-06-02T04:41:11.278 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : elfutils-libelf-devel-0.189-3.el8.x86_64 124/162 2024-06-02T04:41:11.278 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : krb5-devel-1.18.2-26.el8_9.x86_64 125/162 2024-06-02T04:41:11.278 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : openssl-devel-1:1.1.1k-12.el8_9.x86_64 126/162 2024-06-02T04:41:11.278 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : librabbitmq-0.9.0-5.el8_9.x86_64 127/162 2024-06-02T04:41:11.278 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-cryptography-3.2.1-7.el8_9.x86_64 128/162 2024-06-02T04:41:11.278 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-15.e 129/162 2024-06-02T04:41:11.278 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : libuuid-devel-2.32.1-44.el8_9.1.x86_64 130/162 2024-06-02T04:41:11.278 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : librados2-2:18.2.2-1381.g3bb45379.el8.x86_64 131/162 2024-06-02T04:41:11.278 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 132/162 2024-06-02T04:41:11.278 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : librbd1-2:18.2.2-1381.g3bb45379.el8.x86_64 133/162 2024-06-02T04:41:11.278 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 134/162 2024-06-02T04:41:11.279 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : elfutils-libelf-0.189-3.el8.x86_64 135/162 2024-06-02T04:41:11.279 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : elfutils-libelf-0.186-1.el8.x86_64 136/162 2024-06-02T04:41:11.279 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : elfutils-libs-0.189-3.el8.x86_64 137/162 2024-06-02T04:41:11.279 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : elfutils-libs-0.186-1.el8.x86_64 138/162 2024-06-02T04:41:11.279 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : iproute-6.2.0-5.el8_9.x86_64 139/162 2024-06-02T04:41:11.279 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 140/162 2024-06-02T04:41:11.279 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : openssl-1:1.1.1k-12.el8_9.x86_64 141/162 2024-06-02T04:41:11.279 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : openssl-1:1.1.1k-6.el8_5.x86_64 142/162 2024-06-02T04:41:11.279 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : openssl-libs-1:1.1.1k-12.el8_9.x86_64 143/162 2024-06-02T04:41:11.279 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : openssl-libs-1:1.1.1k-6.el8_5.x86_64 144/162 2024-06-02T04:41:11.279 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : xfsdump-3.1.8-7.el8_9.x86_64 145/162 2024-06-02T04:41:11.279 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : xfsdump-3.1.8-4.el8.x86_64 146/162 2024-06-02T04:41:11.279 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 147/162 2024-06-02T04:41:11.280 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 148/162 2024-06-02T04:41:11.280 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : libblkid-2.32.1-44.el8_9.1.x86_64 149/162 2024-06-02T04:41:11.280 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : libblkid-2.32.1-35.el8.x86_64 150/162 2024-06-02T04:41:11.280 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : libfdisk-2.32.1-44.el8_9.1.x86_64 151/162 2024-06-02T04:41:11.280 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : libfdisk-2.32.1-35.el8.x86_64 152/162 2024-06-02T04:41:11.280 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : libmount-2.32.1-44.el8_9.1.x86_64 153/162 2024-06-02T04:41:11.280 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : libmount-2.32.1-35.el8.x86_64 154/162 2024-06-02T04:41:11.280 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : libsmartcols-2.32.1-44.el8_9.1.x86_64 155/162 2024-06-02T04:41:11.280 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : libsmartcols-2.32.1-35.el8.x86_64 156/162 2024-06-02T04:41:11.280 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : libuuid-2.32.1-44.el8_9.1.x86_64 157/162 2024-06-02T04:41:11.280 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : libuuid-2.32.1-35.el8.x86_64 158/162 2024-06-02T04:41:11.280 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : util-linux-2.32.1-44.el8_9.1.x86_64 159/162 2024-06-02T04:41:11.280 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : util-linux-2.32.1-35.el8.x86_64 160/162 2024-06-02T04:41:11.280 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : util-linux-user-2.32.1-44.el8_9.1.x86_64 161/162 2024-06-02T04:41:19.164 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : util-linux-user-2.32.1-35.el8.x86_64 162/162 2024-06-02T04:41:19.164 INFO:teuthology.orchestra.run.smithi119.stdout:Installed products updated. 2024-06-02T04:41:19.308 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : util-linux-user-2.32.1-35.el8.x86_64 162/162 2024-06-02T04:41:19.308 INFO:teuthology.orchestra.run.smithi192.stdout:Installed products updated. 2024-06-02T04:41:19.929 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-06-02T04:41:19.929 INFO:teuthology.orchestra.run.smithi192.stdout:Upgraded: 2024-06-02T04:41:19.929 INFO:teuthology.orchestra.run.smithi192.stdout: elfutils-libelf-0.189-3.el8.x86_64 2024-06-02T04:41:19.929 INFO:teuthology.orchestra.run.smithi192.stdout: elfutils-libs-0.189-3.el8.x86_64 2024-06-02T04:41:19.930 INFO:teuthology.orchestra.run.smithi192.stdout: iproute-6.2.0-5.el8_9.x86_64 2024-06-02T04:41:19.930 INFO:teuthology.orchestra.run.smithi192.stdout: libblkid-2.32.1-44.el8_9.1.x86_64 2024-06-02T04:41:19.930 INFO:teuthology.orchestra.run.smithi192.stdout: libfdisk-2.32.1-44.el8_9.1.x86_64 2024-06-02T04:41:19.930 INFO:teuthology.orchestra.run.smithi192.stdout: libmount-2.32.1-44.el8_9.1.x86_64 2024-06-02T04:41:19.930 INFO:teuthology.orchestra.run.smithi192.stdout: librados2-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T04:41:19.930 INFO:teuthology.orchestra.run.smithi192.stdout: librbd1-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T04:41:19.930 INFO:teuthology.orchestra.run.smithi192.stdout: libsmartcols-2.32.1-44.el8_9.1.x86_64 2024-06-02T04:41:19.930 INFO:teuthology.orchestra.run.smithi192.stdout: libuuid-2.32.1-44.el8_9.1.x86_64 2024-06-02T04:41:19.930 INFO:teuthology.orchestra.run.smithi192.stdout: openssl-1:1.1.1k-12.el8_9.x86_64 2024-06-02T04:41:19.930 INFO:teuthology.orchestra.run.smithi192.stdout: openssl-libs-1:1.1.1k-12.el8_9.x86_64 2024-06-02T04:41:19.930 INFO:teuthology.orchestra.run.smithi192.stdout: util-linux-2.32.1-44.el8_9.1.x86_64 2024-06-02T04:41:19.930 INFO:teuthology.orchestra.run.smithi192.stdout: util-linux-user-2.32.1-44.el8_9.1.x86_64 2024-06-02T04:41:19.931 INFO:teuthology.orchestra.run.smithi192.stdout: xfsdump-3.1.8-7.el8_9.x86_64 2024-06-02T04:41:19.931 INFO:teuthology.orchestra.run.smithi192.stdout: xfsprogs-5.0.0-12.el8.x86_64 2024-06-02T04:41:19.931 INFO:teuthology.orchestra.run.smithi192.stdout:Installed: 2024-06-02T04:41:19.931 INFO:teuthology.orchestra.run.smithi192.stdout: NetworkManager-initscripts-updown-1:1.40.16-15.el8_9.noarch 2024-06-02T04:41:19.931 INFO:teuthology.orchestra.run.smithi192.stdout: automake-1.16.1-8.el8.noarch 2024-06-02T04:41:19.931 INFO:teuthology.orchestra.run.smithi192.stdout: bison-3.0.4-10.el8.x86_64 2024-06-02T04:41:19.931 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T04:41:19.931 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-base-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T04:41:19.931 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-common-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T04:41:19.931 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-fuse-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T04:41:19.931 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-grafana-dashboards-2:18.2.2-1381.g3bb45379.el8.noarch 2024-06-02T04:41:19.931 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-immutable-object-cache-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T04:41:19.932 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mds-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T04:41:19.932 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T04:41:19.932 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-cephadm-2:18.2.2-1381.g3bb45379.el8.noarch 2024-06-02T04:41:19.932 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-dashboard-2:18.2.2-1381.g3bb45379.el8.noarch 2024-06-02T04:41:19.932 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-diskprediction-local-2:18.2.2-1381.g3bb45379.el8.noarch 2024-06-02T04:41:19.932 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-modules-core-2:18.2.2-1381.g3bb45379.el8.noarch 2024-06-02T04:41:19.932 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-rook-2:18.2.2-1381.g3bb45379.el8.noarch 2024-06-02T04:41:19.932 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mon-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T04:41:19.932 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-osd-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T04:41:19.932 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-prometheus-alerts-2:18.2.2-1381.g3bb45379.el8.noarch 2024-06-02T04:41:19.932 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-radosgw-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T04:41:19.932 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-selinux-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T04:41:19.932 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-test-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T04:41:19.933 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-volume-2:18.2.2-1381.g3bb45379.el8.noarch 2024-06-02T04:41:19.933 INFO:teuthology.orchestra.run.smithi192.stdout: cephadm-2:18.2.2-1381.g3bb45379.el8.noarch 2024-06-02T04:41:19.933 INFO:teuthology.orchestra.run.smithi192.stdout: cephfs-mirror-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T04:41:19.933 INFO:teuthology.orchestra.run.smithi192.stdout: cephfs-top-2:18.2.2-1381.g3bb45379.el8.noarch 2024-06-02T04:41:19.933 INFO:teuthology.orchestra.run.smithi192.stdout: elfutils-libelf-devel-0.189-3.el8.x86_64 2024-06-02T04:41:19.933 INFO:teuthology.orchestra.run.smithi192.stdout: flex-2.6.1-9.el8.x86_64 2024-06-02T04:41:19.933 INFO:teuthology.orchestra.run.smithi192.stdout: fuse-2.9.7-17.el8.x86_64 2024-06-02T04:41:19.933 INFO:teuthology.orchestra.run.smithi192.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-06-02T04:41:19.933 INFO:teuthology.orchestra.run.smithi192.stdout: jq-1.6-7.el8.x86_64 2024-06-02T04:41:19.933 INFO:teuthology.orchestra.run.smithi192.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2024-06-02T04:41:19.933 INFO:teuthology.orchestra.run.smithi192.stdout: krb5-devel-1.18.2-26.el8_9.x86_64 2024-06-02T04:41:19.933 INFO:teuthology.orchestra.run.smithi192.stdout: libaio-devel-0.3.112-1.el8.x86_64 2024-06-02T04:41:19.933 INFO:teuthology.orchestra.run.smithi192.stdout: libcephfs-devel-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T04:41:19.933 INFO:teuthology.orchestra.run.smithi192.stdout: libcephfs2-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T04:41:19.934 INFO:teuthology.orchestra.run.smithi192.stdout: libcephsqlite-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T04:41:19.934 INFO:teuthology.orchestra.run.smithi192.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2024-06-02T04:41:19.934 INFO:teuthology.orchestra.run.smithi192.stdout: libgfortran-8.5.0-20.el8.x86_64 2024-06-02T04:41:19.934 INFO:teuthology.orchestra.run.smithi192.stdout: liboath-2.6.2-3.el8.x86_64 2024-06-02T04:41:19.934 INFO:teuthology.orchestra.run.smithi192.stdout: libpq-13.11-1.el8.x86_64 2024-06-02T04:41:19.934 INFO:teuthology.orchestra.run.smithi192.stdout: libquadmath-8.5.0-20.el8.x86_64 2024-06-02T04:41:19.934 INFO:teuthology.orchestra.run.smithi192.stdout: librabbitmq-0.9.0-5.el8_9.x86_64 2024-06-02T04:41:19.934 INFO:teuthology.orchestra.run.smithi192.stdout: librados-devel-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T04:41:19.934 INFO:teuthology.orchestra.run.smithi192.stdout: libradosstriper1-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T04:41:19.934 INFO:teuthology.orchestra.run.smithi192.stdout: librdkafka-0.11.4-3.el8.x86_64 2024-06-02T04:41:19.934 INFO:teuthology.orchestra.run.smithi192.stdout: librgw2-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T04:41:19.934 INFO:teuthology.orchestra.run.smithi192.stdout: libselinux-devel-2.9-5.el8.x86_64 2024-06-02T04:41:19.935 INFO:teuthology.orchestra.run.smithi192.stdout: libsepol-devel-2.9-3.el8.x86_64 2024-06-02T04:41:19.935 INFO:teuthology.orchestra.run.smithi192.stdout: libtool-2.4.6-25.el8.x86_64 2024-06-02T04:41:19.935 INFO:teuthology.orchestra.run.smithi192.stdout: libunwind-1.3.1-3.el8.x86_64 2024-06-02T04:41:19.935 INFO:teuthology.orchestra.run.smithi192.stdout: libuuid-devel-2.32.1-44.el8_9.1.x86_64 2024-06-02T04:41:19.935 INFO:teuthology.orchestra.run.smithi192.stdout: libverto-devel-0.3.0-5.el8.x86_64 2024-06-02T04:41:19.935 INFO:teuthology.orchestra.run.smithi192.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2024-06-02T04:41:19.935 INFO:teuthology.orchestra.run.smithi192.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-06-02T04:41:19.935 INFO:teuthology.orchestra.run.smithi192.stdout: oniguruma-6.8.2-2.1.el8_9.x86_64 2024-06-02T04:41:19.935 INFO:teuthology.orchestra.run.smithi192.stdout: openblas-0.3.15-6.el8.x86_64 2024-06-02T04:41:19.935 INFO:teuthology.orchestra.run.smithi192.stdout: openblas-threads-0.3.15-6.el8.x86_64 2024-06-02T04:41:19.935 INFO:teuthology.orchestra.run.smithi192.stdout: openssl-devel-1:1.1.1k-12.el8_9.x86_64 2024-06-02T04:41:19.935 INFO:teuthology.orchestra.run.smithi192.stdout: pcre2-devel-10.32-2.el8.x86_64 2024-06-02T04:41:19.935 INFO:teuthology.orchestra.run.smithi192.stdout: pcre2-utf16-10.32-2.el8.x86_64 2024-06-02T04:41:19.935 INFO:teuthology.orchestra.run.smithi192.stdout: pcre2-utf32-10.32-2.el8.x86_64 2024-06-02T04:41:19.936 INFO:teuthology.orchestra.run.smithi192.stdout: postgresql-10.23-4.module+el8.9.0+21317+d2c6bf8a.x86_64 2024-06-02T04:41:19.936 INFO:teuthology.orchestra.run.smithi192.stdout: postgresql-contrib-10.23-4.module+el8.9.0+21317+d2c6bf8a.x86_64 2024-06-02T04:41:19.936 INFO:teuthology.orchestra.run.smithi192.stdout: postgresql-server-10.23-4.module+el8.9.0+21317+d2c6bf8a.x86_64 2024-06-02T04:41:19.936 INFO:teuthology.orchestra.run.smithi192.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2024-06-02T04:41:19.936 INFO:teuthology.orchestra.run.smithi192.stdout: python3-babel-2.5.1-7.el8.noarch 2024-06-02T04:41:19.936 INFO:teuthology.orchestra.run.smithi192.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-06-02T04:41:19.936 INFO:teuthology.orchestra.run.smithi192.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-06-02T04:41:19.936 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cachetools-3.1.1-4.el8.noarch 2024-06-02T04:41:19.936 INFO:teuthology.orchestra.run.smithi192.stdout: python3-ceph-argparse-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T04:41:19.936 INFO:teuthology.orchestra.run.smithi192.stdout: python3-ceph-common-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T04:41:19.936 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cephfs-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T04:41:19.936 INFO:teuthology.orchestra.run.smithi192.stdout: python3-certifi-2018.10.15-7.el8.noarch 2024-06-02T04:41:19.936 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-06-02T04:41:19.936 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-06-02T04:41:19.937 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-06-02T04:41:19.937 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cryptography-3.2.1-7.el8_9.x86_64 2024-06-02T04:41:19.937 INFO:teuthology.orchestra.run.smithi192.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2024-06-02T04:41:19.937 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco-6.2-6.el8.noarch 2024-06-02T04:41:19.937 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-06-02T04:41:19.937 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jinja2-2.10.1-3.el8.noarch 2024-06-02T04:41:19.937 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jsonpatch-1.21-2.el8.noarch 2024-06-02T04:41:19.937 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jsonpointer-1.10-11.el8.noarch 2024-06-02T04:41:19.937 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jwt-1.6.1-2.el8.noarch 2024-06-02T04:41:19.937 INFO:teuthology.orchestra.run.smithi192.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2024-06-02T04:41:19.937 INFO:teuthology.orchestra.run.smithi192.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-06-02T04:41:19.937 INFO:teuthology.orchestra.run.smithi192.stdout: python3-mako-1.0.6-14.el8.noarch 2024-06-02T04:41:19.937 INFO:teuthology.orchestra.run.smithi192.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-06-02T04:41:19.937 INFO:teuthology.orchestra.run.smithi192.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-06-02T04:41:19.938 INFO:teuthology.orchestra.run.smithi192.stdout: python3-natsort-7.1.1-2.el8.noarch 2024-06-02T04:41:19.938 INFO:teuthology.orchestra.run.smithi192.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2024-06-02T04:41:19.938 INFO:teuthology.orchestra.run.smithi192.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2024-06-02T04:41:19.938 INFO:teuthology.orchestra.run.smithi192.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2024-06-02T04:41:19.938 INFO:teuthology.orchestra.run.smithi192.stdout: python3-packaging-16.8-9.el8.noarch 2024-06-02T04:41:19.938 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-06-02T04:41:19.938 INFO:teuthology.orchestra.run.smithi192.stdout: python3-portend-2.6-1.el8.noarch 2024-06-02T04:41:19.938 INFO:teuthology.orchestra.run.smithi192.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-06-02T04:41:19.938 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-06-02T04:41:19.938 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2024-06-02T04:41:19.938 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2024-06-02T04:41:19.938 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pycparser-2.14-14.el8.noarch 2024-06-02T04:41:19.938 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pytz-2017.2-11.el8.noarch 2024-06-02T04:41:19.939 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rados-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T04:41:19.939 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rbd-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T04:41:19.939 INFO:teuthology.orchestra.run.smithi192.stdout: python3-repoze-lru-0.7-6.el8.noarch 2024-06-02T04:41:19.939 INFO:teuthology.orchestra.run.smithi192.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2024-06-02T04:41:19.939 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rgw-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T04:41:19.939 INFO:teuthology.orchestra.run.smithi192.stdout: python3-routes-2.4.1-12.el8.noarch 2024-06-02T04:41:19.939 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rsa-4.9-2.el8.noarch 2024-06-02T04:41:19.939 INFO:teuthology.orchestra.run.smithi192.stdout: python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c38525.x86_64 2024-06-02T04:41:19.939 INFO:teuthology.orchestra.run.smithi192.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-06-02T04:41:19.939 INFO:teuthology.orchestra.run.smithi192.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-06-02T04:41:19.939 INFO:teuthology.orchestra.run.smithi192.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-06-02T04:41:19.939 INFO:teuthology.orchestra.run.smithi192.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-06-02T04:41:19.939 INFO:teuthology.orchestra.run.smithi192.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-06-02T04:41:19.939 INFO:teuthology.orchestra.run.smithi192.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-06-02T04:41:19.940 INFO:teuthology.orchestra.run.smithi192.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2024-06-02T04:41:19.940 INFO:teuthology.orchestra.run.smithi192.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-06-02T04:41:19.940 INFO:teuthology.orchestra.run.smithi192.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-06-02T04:41:19.940 INFO:teuthology.orchestra.run.smithi192.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-06-02T04:41:19.940 INFO:teuthology.orchestra.run.smithi192.stdout: rbd-fuse-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T04:41:19.940 INFO:teuthology.orchestra.run.smithi192.stdout: rbd-mirror-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T04:41:19.940 INFO:teuthology.orchestra.run.smithi192.stdout: rbd-nbd-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T04:41:19.940 INFO:teuthology.orchestra.run.smithi192.stdout: socat-1.7.4.1-1.el8.x86_64 2024-06-02T04:41:19.940 INFO:teuthology.orchestra.run.smithi192.stdout: thrift-0.13.0-2.el8.x86_64 2024-06-02T04:41:19.940 INFO:teuthology.orchestra.run.smithi192.stdout: uuid-1.6.2-43.el8.x86_64 2024-06-02T04:41:19.940 INFO:teuthology.orchestra.run.smithi192.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2024-06-02T04:41:19.940 INFO:teuthology.orchestra.run.smithi192.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2024-06-02T04:41:19.941 INFO:teuthology.orchestra.run.smithi192.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2024-06-02T04:41:19.941 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-06-02T04:41:19.941 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2024-06-02T04:41:20.173 DEBUG:teuthology.parallel:result is None 2024-06-02T04:41:20.625 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-06-02T04:41:20.625 INFO:teuthology.orchestra.run.smithi119.stdout:Upgraded: 2024-06-02T04:41:20.625 INFO:teuthology.orchestra.run.smithi119.stdout: elfutils-libelf-0.189-3.el8.x86_64 2024-06-02T04:41:20.625 INFO:teuthology.orchestra.run.smithi119.stdout: elfutils-libs-0.189-3.el8.x86_64 2024-06-02T04:41:20.625 INFO:teuthology.orchestra.run.smithi119.stdout: iproute-6.2.0-5.el8_9.x86_64 2024-06-02T04:41:20.625 INFO:teuthology.orchestra.run.smithi119.stdout: libblkid-2.32.1-44.el8_9.1.x86_64 2024-06-02T04:41:20.625 INFO:teuthology.orchestra.run.smithi119.stdout: libfdisk-2.32.1-44.el8_9.1.x86_64 2024-06-02T04:41:20.625 INFO:teuthology.orchestra.run.smithi119.stdout: libmount-2.32.1-44.el8_9.1.x86_64 2024-06-02T04:41:20.625 INFO:teuthology.orchestra.run.smithi119.stdout: librados2-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T04:41:20.626 INFO:teuthology.orchestra.run.smithi119.stdout: librbd1-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T04:41:20.626 INFO:teuthology.orchestra.run.smithi119.stdout: libsmartcols-2.32.1-44.el8_9.1.x86_64 2024-06-02T04:41:20.626 INFO:teuthology.orchestra.run.smithi119.stdout: libuuid-2.32.1-44.el8_9.1.x86_64 2024-06-02T04:41:20.626 INFO:teuthology.orchestra.run.smithi119.stdout: openssl-1:1.1.1k-12.el8_9.x86_64 2024-06-02T04:41:20.626 INFO:teuthology.orchestra.run.smithi119.stdout: openssl-libs-1:1.1.1k-12.el8_9.x86_64 2024-06-02T04:41:20.626 INFO:teuthology.orchestra.run.smithi119.stdout: util-linux-2.32.1-44.el8_9.1.x86_64 2024-06-02T04:41:20.626 INFO:teuthology.orchestra.run.smithi119.stdout: util-linux-user-2.32.1-44.el8_9.1.x86_64 2024-06-02T04:41:20.626 INFO:teuthology.orchestra.run.smithi119.stdout: xfsdump-3.1.8-7.el8_9.x86_64 2024-06-02T04:41:20.626 INFO:teuthology.orchestra.run.smithi119.stdout: xfsprogs-5.0.0-12.el8.x86_64 2024-06-02T04:41:20.626 INFO:teuthology.orchestra.run.smithi119.stdout:Installed: 2024-06-02T04:41:20.626 INFO:teuthology.orchestra.run.smithi119.stdout: NetworkManager-initscripts-updown-1:1.40.16-15.el8_9.noarch 2024-06-02T04:41:20.626 INFO:teuthology.orchestra.run.smithi119.stdout: automake-1.16.1-8.el8.noarch 2024-06-02T04:41:20.627 INFO:teuthology.orchestra.run.smithi119.stdout: bison-3.0.4-10.el8.x86_64 2024-06-02T04:41:20.627 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T04:41:20.627 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-base-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T04:41:20.627 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-common-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T04:41:20.627 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-fuse-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T04:41:20.627 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-grafana-dashboards-2:18.2.2-1381.g3bb45379.el8.noarch 2024-06-02T04:41:20.627 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-immutable-object-cache-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T04:41:20.627 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mds-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T04:41:20.627 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T04:41:20.628 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-cephadm-2:18.2.2-1381.g3bb45379.el8.noarch 2024-06-02T04:41:20.628 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-dashboard-2:18.2.2-1381.g3bb45379.el8.noarch 2024-06-02T04:41:20.628 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-diskprediction-local-2:18.2.2-1381.g3bb45379.el8.noarch 2024-06-02T04:41:20.628 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-modules-core-2:18.2.2-1381.g3bb45379.el8.noarch 2024-06-02T04:41:20.628 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-rook-2:18.2.2-1381.g3bb45379.el8.noarch 2024-06-02T04:41:20.628 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mon-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T04:41:20.628 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-osd-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T04:41:20.628 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-prometheus-alerts-2:18.2.2-1381.g3bb45379.el8.noarch 2024-06-02T04:41:20.629 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-radosgw-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T04:41:20.629 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-selinux-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T04:41:20.629 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-test-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T04:41:20.629 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-volume-2:18.2.2-1381.g3bb45379.el8.noarch 2024-06-02T04:41:20.629 INFO:teuthology.orchestra.run.smithi119.stdout: cephadm-2:18.2.2-1381.g3bb45379.el8.noarch 2024-06-02T04:41:20.629 INFO:teuthology.orchestra.run.smithi119.stdout: cephfs-mirror-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T04:41:20.629 INFO:teuthology.orchestra.run.smithi119.stdout: cephfs-top-2:18.2.2-1381.g3bb45379.el8.noarch 2024-06-02T04:41:20.629 INFO:teuthology.orchestra.run.smithi119.stdout: elfutils-libelf-devel-0.189-3.el8.x86_64 2024-06-02T04:41:20.629 INFO:teuthology.orchestra.run.smithi119.stdout: flex-2.6.1-9.el8.x86_64 2024-06-02T04:41:20.629 INFO:teuthology.orchestra.run.smithi119.stdout: fuse-2.9.7-17.el8.x86_64 2024-06-02T04:41:20.629 INFO:teuthology.orchestra.run.smithi119.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-06-02T04:41:20.629 INFO:teuthology.orchestra.run.smithi119.stdout: jq-1.6-7.el8.x86_64 2024-06-02T04:41:20.630 INFO:teuthology.orchestra.run.smithi119.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2024-06-02T04:41:20.630 INFO:teuthology.orchestra.run.smithi119.stdout: krb5-devel-1.18.2-26.el8_9.x86_64 2024-06-02T04:41:20.630 INFO:teuthology.orchestra.run.smithi119.stdout: libaio-devel-0.3.112-1.el8.x86_64 2024-06-02T04:41:20.630 INFO:teuthology.orchestra.run.smithi119.stdout: libcephfs-devel-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T04:41:20.630 INFO:teuthology.orchestra.run.smithi119.stdout: libcephfs2-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T04:41:20.630 INFO:teuthology.orchestra.run.smithi119.stdout: libcephsqlite-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T04:41:20.630 INFO:teuthology.orchestra.run.smithi119.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2024-06-02T04:41:20.630 INFO:teuthology.orchestra.run.smithi119.stdout: libgfortran-8.5.0-20.el8.x86_64 2024-06-02T04:41:20.630 INFO:teuthology.orchestra.run.smithi119.stdout: liboath-2.6.2-3.el8.x86_64 2024-06-02T04:41:20.630 INFO:teuthology.orchestra.run.smithi119.stdout: libpq-13.11-1.el8.x86_64 2024-06-02T04:41:20.630 INFO:teuthology.orchestra.run.smithi119.stdout: libquadmath-8.5.0-20.el8.x86_64 2024-06-02T04:41:20.630 INFO:teuthology.orchestra.run.smithi119.stdout: librabbitmq-0.9.0-5.el8_9.x86_64 2024-06-02T04:41:20.631 INFO:teuthology.orchestra.run.smithi119.stdout: librados-devel-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T04:41:20.631 INFO:teuthology.orchestra.run.smithi119.stdout: libradosstriper1-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T04:41:20.631 INFO:teuthology.orchestra.run.smithi119.stdout: librdkafka-0.11.4-3.el8.x86_64 2024-06-02T04:41:20.631 INFO:teuthology.orchestra.run.smithi119.stdout: librgw2-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T04:41:20.631 INFO:teuthology.orchestra.run.smithi119.stdout: libselinux-devel-2.9-5.el8.x86_64 2024-06-02T04:41:20.631 INFO:teuthology.orchestra.run.smithi119.stdout: libsepol-devel-2.9-3.el8.x86_64 2024-06-02T04:41:20.631 INFO:teuthology.orchestra.run.smithi119.stdout: libtool-2.4.6-25.el8.x86_64 2024-06-02T04:41:20.631 INFO:teuthology.orchestra.run.smithi119.stdout: libunwind-1.3.1-3.el8.x86_64 2024-06-02T04:41:20.631 INFO:teuthology.orchestra.run.smithi119.stdout: libuuid-devel-2.32.1-44.el8_9.1.x86_64 2024-06-02T04:41:20.631 INFO:teuthology.orchestra.run.smithi119.stdout: libverto-devel-0.3.0-5.el8.x86_64 2024-06-02T04:41:20.631 INFO:teuthology.orchestra.run.smithi119.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2024-06-02T04:41:20.631 INFO:teuthology.orchestra.run.smithi119.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-06-02T04:41:20.632 INFO:teuthology.orchestra.run.smithi119.stdout: oniguruma-6.8.2-2.1.el8_9.x86_64 2024-06-02T04:41:20.632 INFO:teuthology.orchestra.run.smithi119.stdout: openblas-0.3.15-6.el8.x86_64 2024-06-02T04:41:20.632 INFO:teuthology.orchestra.run.smithi119.stdout: openblas-threads-0.3.15-6.el8.x86_64 2024-06-02T04:41:20.632 INFO:teuthology.orchestra.run.smithi119.stdout: openssl-devel-1:1.1.1k-12.el8_9.x86_64 2024-06-02T04:41:20.632 INFO:teuthology.orchestra.run.smithi119.stdout: pcre2-devel-10.32-2.el8.x86_64 2024-06-02T04:41:20.632 INFO:teuthology.orchestra.run.smithi119.stdout: pcre2-utf16-10.32-2.el8.x86_64 2024-06-02T04:41:20.632 INFO:teuthology.orchestra.run.smithi119.stdout: pcre2-utf32-10.32-2.el8.x86_64 2024-06-02T04:41:20.632 INFO:teuthology.orchestra.run.smithi119.stdout: postgresql-10.23-4.module+el8.9.0+21317+d2c6bf8a.x86_64 2024-06-02T04:41:20.632 INFO:teuthology.orchestra.run.smithi119.stdout: postgresql-contrib-10.23-4.module+el8.9.0+21317+d2c6bf8a.x86_64 2024-06-02T04:41:20.632 INFO:teuthology.orchestra.run.smithi119.stdout: postgresql-server-10.23-4.module+el8.9.0+21317+d2c6bf8a.x86_64 2024-06-02T04:41:20.632 INFO:teuthology.orchestra.run.smithi119.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2024-06-02T04:41:20.632 INFO:teuthology.orchestra.run.smithi119.stdout: python3-babel-2.5.1-7.el8.noarch 2024-06-02T04:41:20.632 INFO:teuthology.orchestra.run.smithi119.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-06-02T04:41:20.632 INFO:teuthology.orchestra.run.smithi119.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-06-02T04:41:20.633 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cachetools-3.1.1-4.el8.noarch 2024-06-02T04:41:20.633 INFO:teuthology.orchestra.run.smithi119.stdout: python3-ceph-argparse-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T04:41:20.633 INFO:teuthology.orchestra.run.smithi119.stdout: python3-ceph-common-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T04:41:20.633 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cephfs-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T04:41:20.633 INFO:teuthology.orchestra.run.smithi119.stdout: python3-certifi-2018.10.15-7.el8.noarch 2024-06-02T04:41:20.633 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-06-02T04:41:20.633 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-06-02T04:41:20.633 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-06-02T04:41:20.633 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cryptography-3.2.1-7.el8_9.x86_64 2024-06-02T04:41:20.633 INFO:teuthology.orchestra.run.smithi119.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2024-06-02T04:41:20.633 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-6.2-6.el8.noarch 2024-06-02T04:41:20.633 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-06-02T04:41:20.634 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jinja2-2.10.1-3.el8.noarch 2024-06-02T04:41:20.634 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jsonpatch-1.21-2.el8.noarch 2024-06-02T04:41:20.634 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jsonpointer-1.10-11.el8.noarch 2024-06-02T04:41:20.634 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jwt-1.6.1-2.el8.noarch 2024-06-02T04:41:20.634 INFO:teuthology.orchestra.run.smithi119.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2024-06-02T04:41:20.634 INFO:teuthology.orchestra.run.smithi119.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-06-02T04:41:20.634 INFO:teuthology.orchestra.run.smithi119.stdout: python3-mako-1.0.6-14.el8.noarch 2024-06-02T04:41:20.634 INFO:teuthology.orchestra.run.smithi119.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-06-02T04:41:20.634 INFO:teuthology.orchestra.run.smithi119.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-06-02T04:41:20.634 INFO:teuthology.orchestra.run.smithi119.stdout: python3-natsort-7.1.1-2.el8.noarch 2024-06-02T04:41:20.634 INFO:teuthology.orchestra.run.smithi119.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2024-06-02T04:41:20.634 INFO:teuthology.orchestra.run.smithi119.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2024-06-02T04:41:20.635 INFO:teuthology.orchestra.run.smithi119.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2024-06-02T04:41:20.635 INFO:teuthology.orchestra.run.smithi119.stdout: python3-packaging-16.8-9.el8.noarch 2024-06-02T04:41:20.635 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-06-02T04:41:20.635 INFO:teuthology.orchestra.run.smithi119.stdout: python3-portend-2.6-1.el8.noarch 2024-06-02T04:41:20.635 INFO:teuthology.orchestra.run.smithi119.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-06-02T04:41:20.635 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-06-02T04:41:20.636 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2024-06-02T04:41:20.636 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2024-06-02T04:41:20.636 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pycparser-2.14-14.el8.noarch 2024-06-02T04:41:20.636 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pytz-2017.2-11.el8.noarch 2024-06-02T04:41:20.636 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rados-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T04:41:20.636 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rbd-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T04:41:20.636 INFO:teuthology.orchestra.run.smithi119.stdout: python3-repoze-lru-0.7-6.el8.noarch 2024-06-02T04:41:20.636 INFO:teuthology.orchestra.run.smithi119.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2024-06-02T04:41:20.636 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rgw-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T04:41:20.636 INFO:teuthology.orchestra.run.smithi119.stdout: python3-routes-2.4.1-12.el8.noarch 2024-06-02T04:41:20.636 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rsa-4.9-2.el8.noarch 2024-06-02T04:41:20.636 INFO:teuthology.orchestra.run.smithi119.stdout: python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c38525.x86_64 2024-06-02T04:41:20.637 INFO:teuthology.orchestra.run.smithi119.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-06-02T04:41:20.637 INFO:teuthology.orchestra.run.smithi119.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-06-02T04:41:20.637 INFO:teuthology.orchestra.run.smithi119.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-06-02T04:41:20.637 INFO:teuthology.orchestra.run.smithi119.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-06-02T04:41:20.637 INFO:teuthology.orchestra.run.smithi119.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-06-02T04:41:20.637 INFO:teuthology.orchestra.run.smithi119.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-06-02T04:41:20.637 INFO:teuthology.orchestra.run.smithi119.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2024-06-02T04:41:20.637 INFO:teuthology.orchestra.run.smithi119.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-06-02T04:41:20.637 INFO:teuthology.orchestra.run.smithi119.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-06-02T04:41:20.637 INFO:teuthology.orchestra.run.smithi119.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-06-02T04:41:20.637 INFO:teuthology.orchestra.run.smithi119.stdout: rbd-fuse-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T04:41:20.637 INFO:teuthology.orchestra.run.smithi119.stdout: rbd-mirror-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T04:41:20.637 INFO:teuthology.orchestra.run.smithi119.stdout: rbd-nbd-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T04:41:20.638 INFO:teuthology.orchestra.run.smithi119.stdout: socat-1.7.4.1-1.el8.x86_64 2024-06-02T04:41:20.638 INFO:teuthology.orchestra.run.smithi119.stdout: thrift-0.13.0-2.el8.x86_64 2024-06-02T04:41:20.638 INFO:teuthology.orchestra.run.smithi119.stdout: uuid-1.6.2-43.el8.x86_64 2024-06-02T04:41:20.638 INFO:teuthology.orchestra.run.smithi119.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2024-06-02T04:41:20.638 INFO:teuthology.orchestra.run.smithi119.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2024-06-02T04:41:20.638 INFO:teuthology.orchestra.run.smithi119.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2024-06-02T04:41:20.638 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-06-02T04:41:20.639 INFO:teuthology.orchestra.run.smithi119.stdout:Complete! 2024-06-02T04:41:20.878 DEBUG:teuthology.parallel:result is None 2024-06-02T04:41:23.967 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : util-linux-user-2.32.1-35.el8.x86_64 162/162 2024-06-02T04:41:23.967 INFO:teuthology.orchestra.run.smithi076.stdout:Installed products updated. 2024-06-02T04:41:25.200 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:41:25.200 INFO:teuthology.orchestra.run.smithi076.stdout:Upgraded: 2024-06-02T04:41:25.200 INFO:teuthology.orchestra.run.smithi076.stdout: elfutils-libelf-0.189-3.el8.x86_64 2024-06-02T04:41:25.201 INFO:teuthology.orchestra.run.smithi076.stdout: elfutils-libs-0.189-3.el8.x86_64 2024-06-02T04:41:25.201 INFO:teuthology.orchestra.run.smithi076.stdout: iproute-6.2.0-5.el8_9.x86_64 2024-06-02T04:41:25.201 INFO:teuthology.orchestra.run.smithi076.stdout: libblkid-2.32.1-44.el8_9.1.x86_64 2024-06-02T04:41:25.201 INFO:teuthology.orchestra.run.smithi076.stdout: libfdisk-2.32.1-44.el8_9.1.x86_64 2024-06-02T04:41:25.201 INFO:teuthology.orchestra.run.smithi076.stdout: libmount-2.32.1-44.el8_9.1.x86_64 2024-06-02T04:41:25.201 INFO:teuthology.orchestra.run.smithi076.stdout: librados2-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T04:41:25.201 INFO:teuthology.orchestra.run.smithi076.stdout: librbd1-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T04:41:25.201 INFO:teuthology.orchestra.run.smithi076.stdout: libsmartcols-2.32.1-44.el8_9.1.x86_64 2024-06-02T04:41:25.201 INFO:teuthology.orchestra.run.smithi076.stdout: libuuid-2.32.1-44.el8_9.1.x86_64 2024-06-02T04:41:25.201 INFO:teuthology.orchestra.run.smithi076.stdout: openssl-1:1.1.1k-12.el8_9.x86_64 2024-06-02T04:41:25.201 INFO:teuthology.orchestra.run.smithi076.stdout: openssl-libs-1:1.1.1k-12.el8_9.x86_64 2024-06-02T04:41:25.201 INFO:teuthology.orchestra.run.smithi076.stdout: util-linux-2.32.1-44.el8_9.1.x86_64 2024-06-02T04:41:25.201 INFO:teuthology.orchestra.run.smithi076.stdout: util-linux-user-2.32.1-44.el8_9.1.x86_64 2024-06-02T04:41:25.202 INFO:teuthology.orchestra.run.smithi076.stdout: xfsdump-3.1.8-7.el8_9.x86_64 2024-06-02T04:41:25.202 INFO:teuthology.orchestra.run.smithi076.stdout: xfsprogs-5.0.0-12.el8.x86_64 2024-06-02T04:41:25.202 INFO:teuthology.orchestra.run.smithi076.stdout:Installed: 2024-06-02T04:41:25.202 INFO:teuthology.orchestra.run.smithi076.stdout: NetworkManager-initscripts-updown-1:1.40.16-15.el8_9.noarch 2024-06-02T04:41:25.202 INFO:teuthology.orchestra.run.smithi076.stdout: automake-1.16.1-8.el8.noarch 2024-06-02T04:41:25.202 INFO:teuthology.orchestra.run.smithi076.stdout: bison-3.0.4-10.el8.x86_64 2024-06-02T04:41:25.202 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T04:41:25.202 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-base-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T04:41:25.202 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-common-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T04:41:25.202 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-fuse-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T04:41:25.202 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-grafana-dashboards-2:18.2.2-1381.g3bb45379.el8.noarch 2024-06-02T04:41:25.202 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-immutable-object-cache-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T04:41:25.202 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-mds-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T04:41:25.203 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-mgr-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T04:41:25.203 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-mgr-cephadm-2:18.2.2-1381.g3bb45379.el8.noarch 2024-06-02T04:41:25.203 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-mgr-dashboard-2:18.2.2-1381.g3bb45379.el8.noarch 2024-06-02T04:41:25.203 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-mgr-diskprediction-local-2:18.2.2-1381.g3bb45379.el8.noarch 2024-06-02T04:41:25.203 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-mgr-modules-core-2:18.2.2-1381.g3bb45379.el8.noarch 2024-06-02T04:41:25.203 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-mgr-rook-2:18.2.2-1381.g3bb45379.el8.noarch 2024-06-02T04:41:25.203 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-mon-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T04:41:25.203 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-osd-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T04:41:25.203 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-prometheus-alerts-2:18.2.2-1381.g3bb45379.el8.noarch 2024-06-02T04:41:25.203 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-radosgw-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T04:41:25.203 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-selinux-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T04:41:25.203 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-test-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T04:41:25.203 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-volume-2:18.2.2-1381.g3bb45379.el8.noarch 2024-06-02T04:41:25.203 INFO:teuthology.orchestra.run.smithi076.stdout: cephadm-2:18.2.2-1381.g3bb45379.el8.noarch 2024-06-02T04:41:25.204 INFO:teuthology.orchestra.run.smithi076.stdout: cephfs-mirror-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T04:41:25.204 INFO:teuthology.orchestra.run.smithi076.stdout: cephfs-top-2:18.2.2-1381.g3bb45379.el8.noarch 2024-06-02T04:41:25.204 INFO:teuthology.orchestra.run.smithi076.stdout: elfutils-libelf-devel-0.189-3.el8.x86_64 2024-06-02T04:41:25.204 INFO:teuthology.orchestra.run.smithi076.stdout: flex-2.6.1-9.el8.x86_64 2024-06-02T04:41:25.204 INFO:teuthology.orchestra.run.smithi076.stdout: fuse-2.9.7-17.el8.x86_64 2024-06-02T04:41:25.204 INFO:teuthology.orchestra.run.smithi076.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-06-02T04:41:25.204 INFO:teuthology.orchestra.run.smithi076.stdout: jq-1.6-7.el8.x86_64 2024-06-02T04:41:25.204 INFO:teuthology.orchestra.run.smithi076.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2024-06-02T04:41:25.204 INFO:teuthology.orchestra.run.smithi076.stdout: krb5-devel-1.18.2-26.el8_9.x86_64 2024-06-02T04:41:25.204 INFO:teuthology.orchestra.run.smithi076.stdout: libaio-devel-0.3.112-1.el8.x86_64 2024-06-02T04:41:25.204 INFO:teuthology.orchestra.run.smithi076.stdout: libcephfs-devel-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T04:41:25.204 INFO:teuthology.orchestra.run.smithi076.stdout: libcephfs2-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T04:41:25.204 INFO:teuthology.orchestra.run.smithi076.stdout: libcephsqlite-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T04:41:25.205 INFO:teuthology.orchestra.run.smithi076.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2024-06-02T04:41:25.205 INFO:teuthology.orchestra.run.smithi076.stdout: libgfortran-8.5.0-20.el8.x86_64 2024-06-02T04:41:25.205 INFO:teuthology.orchestra.run.smithi076.stdout: liboath-2.6.2-3.el8.x86_64 2024-06-02T04:41:25.205 INFO:teuthology.orchestra.run.smithi076.stdout: libpq-13.11-1.el8.x86_64 2024-06-02T04:41:25.205 INFO:teuthology.orchestra.run.smithi076.stdout: libquadmath-8.5.0-20.el8.x86_64 2024-06-02T04:41:25.205 INFO:teuthology.orchestra.run.smithi076.stdout: librabbitmq-0.9.0-5.el8_9.x86_64 2024-06-02T04:41:25.205 INFO:teuthology.orchestra.run.smithi076.stdout: librados-devel-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T04:41:25.205 INFO:teuthology.orchestra.run.smithi076.stdout: libradosstriper1-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T04:41:25.205 INFO:teuthology.orchestra.run.smithi076.stdout: librdkafka-0.11.4-3.el8.x86_64 2024-06-02T04:41:25.205 INFO:teuthology.orchestra.run.smithi076.stdout: librgw2-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T04:41:25.205 INFO:teuthology.orchestra.run.smithi076.stdout: libselinux-devel-2.9-5.el8.x86_64 2024-06-02T04:41:25.205 INFO:teuthology.orchestra.run.smithi076.stdout: libsepol-devel-2.9-3.el8.x86_64 2024-06-02T04:41:25.205 INFO:teuthology.orchestra.run.smithi076.stdout: libtool-2.4.6-25.el8.x86_64 2024-06-02T04:41:25.205 INFO:teuthology.orchestra.run.smithi076.stdout: libunwind-1.3.1-3.el8.x86_64 2024-06-02T04:41:25.206 INFO:teuthology.orchestra.run.smithi076.stdout: libuuid-devel-2.32.1-44.el8_9.1.x86_64 2024-06-02T04:41:25.206 INFO:teuthology.orchestra.run.smithi076.stdout: libverto-devel-0.3.0-5.el8.x86_64 2024-06-02T04:41:25.206 INFO:teuthology.orchestra.run.smithi076.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2024-06-02T04:41:25.206 INFO:teuthology.orchestra.run.smithi076.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-06-02T04:41:25.206 INFO:teuthology.orchestra.run.smithi076.stdout: oniguruma-6.8.2-2.1.el8_9.x86_64 2024-06-02T04:41:25.206 INFO:teuthology.orchestra.run.smithi076.stdout: openblas-0.3.15-6.el8.x86_64 2024-06-02T04:41:25.206 INFO:teuthology.orchestra.run.smithi076.stdout: openblas-threads-0.3.15-6.el8.x86_64 2024-06-02T04:41:25.206 INFO:teuthology.orchestra.run.smithi076.stdout: openssl-devel-1:1.1.1k-12.el8_9.x86_64 2024-06-02T04:41:25.206 INFO:teuthology.orchestra.run.smithi076.stdout: pcre2-devel-10.32-2.el8.x86_64 2024-06-02T04:41:25.206 INFO:teuthology.orchestra.run.smithi076.stdout: pcre2-utf16-10.32-2.el8.x86_64 2024-06-02T04:41:25.206 INFO:teuthology.orchestra.run.smithi076.stdout: pcre2-utf32-10.32-2.el8.x86_64 2024-06-02T04:41:25.206 INFO:teuthology.orchestra.run.smithi076.stdout: postgresql-10.23-4.module+el8.9.0+21317+d2c6bf8a.x86_64 2024-06-02T04:41:25.207 INFO:teuthology.orchestra.run.smithi076.stdout: postgresql-contrib-10.23-4.module+el8.9.0+21317+d2c6bf8a.x86_64 2024-06-02T04:41:25.207 INFO:teuthology.orchestra.run.smithi076.stdout: postgresql-server-10.23-4.module+el8.9.0+21317+d2c6bf8a.x86_64 2024-06-02T04:41:25.207 INFO:teuthology.orchestra.run.smithi076.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2024-06-02T04:41:25.207 INFO:teuthology.orchestra.run.smithi076.stdout: python3-babel-2.5.1-7.el8.noarch 2024-06-02T04:41:25.207 INFO:teuthology.orchestra.run.smithi076.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-06-02T04:41:25.207 INFO:teuthology.orchestra.run.smithi076.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-06-02T04:41:25.207 INFO:teuthology.orchestra.run.smithi076.stdout: python3-cachetools-3.1.1-4.el8.noarch 2024-06-02T04:41:25.207 INFO:teuthology.orchestra.run.smithi076.stdout: python3-ceph-argparse-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T04:41:25.207 INFO:teuthology.orchestra.run.smithi076.stdout: python3-ceph-common-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T04:41:25.207 INFO:teuthology.orchestra.run.smithi076.stdout: python3-cephfs-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T04:41:25.207 INFO:teuthology.orchestra.run.smithi076.stdout: python3-certifi-2018.10.15-7.el8.noarch 2024-06-02T04:41:25.207 INFO:teuthology.orchestra.run.smithi076.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-06-02T04:41:25.207 INFO:teuthology.orchestra.run.smithi076.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-06-02T04:41:25.207 INFO:teuthology.orchestra.run.smithi076.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-06-02T04:41:25.208 INFO:teuthology.orchestra.run.smithi076.stdout: python3-cryptography-3.2.1-7.el8_9.x86_64 2024-06-02T04:41:25.208 INFO:teuthology.orchestra.run.smithi076.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2024-06-02T04:41:25.208 INFO:teuthology.orchestra.run.smithi076.stdout: python3-jaraco-6.2-6.el8.noarch 2024-06-02T04:41:25.208 INFO:teuthology.orchestra.run.smithi076.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-06-02T04:41:25.208 INFO:teuthology.orchestra.run.smithi076.stdout: python3-jinja2-2.10.1-3.el8.noarch 2024-06-02T04:41:25.208 INFO:teuthology.orchestra.run.smithi076.stdout: python3-jsonpatch-1.21-2.el8.noarch 2024-06-02T04:41:25.208 INFO:teuthology.orchestra.run.smithi076.stdout: python3-jsonpointer-1.10-11.el8.noarch 2024-06-02T04:41:25.208 INFO:teuthology.orchestra.run.smithi076.stdout: python3-jwt-1.6.1-2.el8.noarch 2024-06-02T04:41:25.208 INFO:teuthology.orchestra.run.smithi076.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2024-06-02T04:41:25.208 INFO:teuthology.orchestra.run.smithi076.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-06-02T04:41:25.208 INFO:teuthology.orchestra.run.smithi076.stdout: python3-mako-1.0.6-14.el8.noarch 2024-06-02T04:41:25.208 INFO:teuthology.orchestra.run.smithi076.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-06-02T04:41:25.208 INFO:teuthology.orchestra.run.smithi076.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-06-02T04:41:25.208 INFO:teuthology.orchestra.run.smithi076.stdout: python3-natsort-7.1.1-2.el8.noarch 2024-06-02T04:41:25.209 INFO:teuthology.orchestra.run.smithi076.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2024-06-02T04:41:25.209 INFO:teuthology.orchestra.run.smithi076.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2024-06-02T04:41:25.209 INFO:teuthology.orchestra.run.smithi076.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2024-06-02T04:41:25.209 INFO:teuthology.orchestra.run.smithi076.stdout: python3-packaging-16.8-9.el8.noarch 2024-06-02T04:41:25.209 INFO:teuthology.orchestra.run.smithi076.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-06-02T04:41:25.209 INFO:teuthology.orchestra.run.smithi076.stdout: python3-portend-2.6-1.el8.noarch 2024-06-02T04:41:25.209 INFO:teuthology.orchestra.run.smithi076.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-06-02T04:41:25.209 INFO:teuthology.orchestra.run.smithi076.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-06-02T04:41:25.209 INFO:teuthology.orchestra.run.smithi076.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2024-06-02T04:41:25.209 INFO:teuthology.orchestra.run.smithi076.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2024-06-02T04:41:25.209 INFO:teuthology.orchestra.run.smithi076.stdout: python3-pycparser-2.14-14.el8.noarch 2024-06-02T04:41:25.209 INFO:teuthology.orchestra.run.smithi076.stdout: python3-pytz-2017.2-11.el8.noarch 2024-06-02T04:41:25.209 INFO:teuthology.orchestra.run.smithi076.stdout: python3-rados-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T04:41:25.209 INFO:teuthology.orchestra.run.smithi076.stdout: python3-rbd-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T04:41:25.210 INFO:teuthology.orchestra.run.smithi076.stdout: python3-repoze-lru-0.7-6.el8.noarch 2024-06-02T04:41:25.210 INFO:teuthology.orchestra.run.smithi076.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2024-06-02T04:41:25.210 INFO:teuthology.orchestra.run.smithi076.stdout: python3-rgw-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T04:41:25.210 INFO:teuthology.orchestra.run.smithi076.stdout: python3-routes-2.4.1-12.el8.noarch 2024-06-02T04:41:25.210 INFO:teuthology.orchestra.run.smithi076.stdout: python3-rsa-4.9-2.el8.noarch 2024-06-02T04:41:25.210 INFO:teuthology.orchestra.run.smithi076.stdout: python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c38525.x86_64 2024-06-02T04:41:25.210 INFO:teuthology.orchestra.run.smithi076.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-06-02T04:41:25.210 INFO:teuthology.orchestra.run.smithi076.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-06-02T04:41:25.210 INFO:teuthology.orchestra.run.smithi076.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-06-02T04:41:25.210 INFO:teuthology.orchestra.run.smithi076.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-06-02T04:41:25.210 INFO:teuthology.orchestra.run.smithi076.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-06-02T04:41:25.210 INFO:teuthology.orchestra.run.smithi076.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-06-02T04:41:25.211 INFO:teuthology.orchestra.run.smithi076.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2024-06-02T04:41:25.211 INFO:teuthology.orchestra.run.smithi076.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-06-02T04:41:25.211 INFO:teuthology.orchestra.run.smithi076.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-06-02T04:41:25.211 INFO:teuthology.orchestra.run.smithi076.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-06-02T04:41:25.211 INFO:teuthology.orchestra.run.smithi076.stdout: rbd-fuse-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T04:41:25.211 INFO:teuthology.orchestra.run.smithi076.stdout: rbd-mirror-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T04:41:25.211 INFO:teuthology.orchestra.run.smithi076.stdout: rbd-nbd-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T04:41:25.211 INFO:teuthology.orchestra.run.smithi076.stdout: socat-1.7.4.1-1.el8.x86_64 2024-06-02T04:41:25.211 INFO:teuthology.orchestra.run.smithi076.stdout: thrift-0.13.0-2.el8.x86_64 2024-06-02T04:41:25.211 INFO:teuthology.orchestra.run.smithi076.stdout: uuid-1.6.2-43.el8.x86_64 2024-06-02T04:41:25.211 INFO:teuthology.orchestra.run.smithi076.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2024-06-02T04:41:25.211 INFO:teuthology.orchestra.run.smithi076.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2024-06-02T04:41:25.212 INFO:teuthology.orchestra.run.smithi076.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2024-06-02T04:41:25.212 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:41:25.212 INFO:teuthology.orchestra.run.smithi076.stdout:Complete! 2024-06-02T04:41:27.257 DEBUG:teuthology.parallel:result is None 2024-06-02T04:41:27.257 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=3bb45379356e8aa965152e0b8c663715c5df9bda 2024-06-02T04:41:27.409 DEBUG:teuthology.orchestra.run.smithi076:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-06-02T04:41:27.432 INFO:teuthology.orchestra.run.smithi076.stdout:18.2.2-1381.g3bb45379.el8 2024-06-02T04:41:27.433 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1381.g3bb45379.el8 2024-06-02T04:41:27.433 INFO:teuthology.task.install:The correct ceph version 18.2.2-1381.g3bb45379 is installed. 2024-06-02T04:41:27.435 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=3bb45379356e8aa965152e0b8c663715c5df9bda 2024-06-02T04:41:27.651 DEBUG:teuthology.orchestra.run.smithi119:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-06-02T04:41:27.682 INFO:teuthology.orchestra.run.smithi119.stdout:18.2.2-1381.g3bb45379.el8 2024-06-02T04:41:27.682 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1381.g3bb45379.el8 2024-06-02T04:41:27.682 INFO:teuthology.task.install:The correct ceph version 18.2.2-1381.g3bb45379 is installed. 2024-06-02T04:41:27.685 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=3bb45379356e8aa965152e0b8c663715c5df9bda 2024-06-02T04:41:27.910 DEBUG:teuthology.orchestra.run.smithi192:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-06-02T04:41:27.939 INFO:teuthology.orchestra.run.smithi192.stdout:18.2.2-1381.g3bb45379.el8 2024-06-02T04:41:27.939 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1381.g3bb45379.el8 2024-06-02T04:41:27.939 INFO:teuthology.task.install:The correct ceph version 18.2.2-1381.g3bb45379 is installed. 2024-06-02T04:41:27.941 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-06-02T04:41:27.941 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2024-06-02T04:41:27.941 DEBUG:teuthology.orchestra.run.smithi076:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-06-02T04:41:27.987 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-06-02T04:41:27.988 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-06-02T04:41:28.038 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-06-02T04:41:28.038 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-06-02T04:41:28.086 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-06-02T04:41:28.086 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2024-06-02T04:41:28.086 DEBUG:teuthology.orchestra.run.smithi076:> sudo dd of=/usr/bin/daemon-helper 2024-06-02T04:41:28.117 DEBUG:teuthology.orchestra.run.smithi076:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-06-02T04:41:28.185 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-06-02T04:41:28.185 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/usr/bin/daemon-helper 2024-06-02T04:41:28.216 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-06-02T04:41:28.285 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-06-02T04:41:28.285 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/usr/bin/daemon-helper 2024-06-02T04:41:28.316 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-06-02T04:41:28.385 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-06-02T04:41:28.385 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2024-06-02T04:41:28.386 DEBUG:teuthology.orchestra.run.smithi076:> sudo dd of=/usr/bin/adjust-ulimits 2024-06-02T04:41:28.415 DEBUG:teuthology.orchestra.run.smithi076:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-06-02T04:41:28.483 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-06-02T04:41:28.483 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/usr/bin/adjust-ulimits 2024-06-02T04:41:28.512 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-06-02T04:41:28.583 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-06-02T04:41:28.583 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/usr/bin/adjust-ulimits 2024-06-02T04:41:28.613 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-06-02T04:41:28.682 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-06-02T04:41:28.683 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2024-06-02T04:41:28.683 DEBUG:teuthology.orchestra.run.smithi076:> sudo dd of=/usr/bin/stdin-killer 2024-06-02T04:41:28.713 DEBUG:teuthology.orchestra.run.smithi076:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-06-02T04:41:28.781 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-06-02T04:41:28.781 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/usr/bin/stdin-killer 2024-06-02T04:41:28.811 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-06-02T04:41:28.879 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-06-02T04:41:28.879 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/usr/bin/stdin-killer 2024-06-02T04:41:28.908 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-06-02T04:41:28.976 INFO:teuthology.run_tasks:Running task cephadm... 2024-06-02T04:41:29.066 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': '3bb45379356e8aa965152e0b8c663715c5df9bda', 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2024-06-02T04:41:29.066 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda 2024-06-02T04:41:29.067 INFO:tasks.cephadm:Cluster fsid is 60ab6d30-209a-11ef-bc9b-c7b262605968 2024-06-02T04:41:29.067 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-06-02T04:41:29.067 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.76', 'mon.b': '172.21.15.119', 'mon.c': '172.21.15.192'} 2024-06-02T04:41:29.068 INFO:tasks.cephadm:First mon is mon.a on smithi076 2024-06-02T04:41:29.068 INFO:tasks.cephadm:First mgr is x 2024-06-02T04:41:29.068 INFO:tasks.cephadm:Normalizing hostnames... 2024-06-02T04:41:29.068 DEBUG:teuthology.orchestra.run.smithi076:> sudo hostname $(hostname -s) 2024-06-02T04:41:29.100 DEBUG:teuthology.orchestra.run.smithi119:> sudo hostname $(hostname -s) 2024-06-02T04:41:29.129 DEBUG:teuthology.orchestra.run.smithi192:> sudo hostname $(hostname -s) 2024-06-02T04:41:29.158 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-06-02T04:41:29.158 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=3bb45379356e8aa965152e0b8c663715c5df9bda 2024-06-02T04:41:29.373 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '3bb45379356e8aa965152e0b8c663715c5df9bda', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos8,DIST=centos8,MACHINE_SIZE=gigantic/55262/', 'root_build_cause': 'SCMTRIGGER', 'version': '18.2.2-1381-g3bb45379', 'node_name': '172.21.2.6+braggi06', 'job_name': 'ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos8,DIST=centos8,MACHINE_SIZE=gigantic', 'package_manager_version': '18.2.2-1381.g3bb45379'}, 'url': 'https://3.chacra.ceph.com/r/ceph/reef/3bb45379356e8aa965152e0b8c663715c5df9bda/centos/8/flavors/default/', 'distro_codename': None, 'modified': '2024-05-28 23:53:14.366628', 'distro_version': '8', 'project': 'ceph', 'flavor': 'default', 'ref': 'reef', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/reef/3bb45379356e8aa965152e0b8c663715c5df9bda/centos/8/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-06-02T04:41:29.591 INFO:tasks.util.chacra:got chacra host 3.chacra.ceph.com, ref reef, sha1 3bb45379356e8aa965152e0b8c663715c5df9bda from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F8%2Fx86_64&flavor=default&sha1=3bb45379356e8aa965152e0b8c663715c5df9bda 2024-06-02T04:41:29.592 INFO:tasks.cephadm:Discovered cachra url: https://3.chacra.ceph.com/binaries/ceph/reef/3bb45379356e8aa965152e0b8c663715c5df9bda/centos/8/x86_64/flavors/default/cephadm 2024-06-02T04:41:29.592 DEBUG:teuthology.orchestra.run.smithi076:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/reef/3bb45379356e8aa965152e0b8c663715c5df9bda/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-06-02T04:41:29.997 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-rw-r--. 1 ubuntu ubuntu 703022 Jun 2 04:41 /home/ubuntu/cephtest/cephadm 2024-06-02T04:41:29.998 DEBUG:teuthology.orchestra.run.smithi119:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/reef/3bb45379356e8aa965152e0b8c663715c5df9bda/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-06-02T04:41:30.544 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-rw-r--. 1 ubuntu ubuntu 703022 Jun 2 04:41 /home/ubuntu/cephtest/cephadm 2024-06-02T04:41:30.545 DEBUG:teuthology.orchestra.run.smithi192:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/reef/3bb45379356e8aa965152e0b8c663715c5df9bda/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-06-02T04:41:30.935 INFO:teuthology.orchestra.run.smithi192.stdout:-rw-rw-r--. 1 ubuntu ubuntu 703022 Jun 2 04:41 /home/ubuntu/cephtest/cephadm 2024-06-02T04:41:30.935 DEBUG:teuthology.orchestra.run.smithi076:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-06-02T04:41:30.957 DEBUG:teuthology.orchestra.run.smithi119:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-06-02T04:41:30.979 DEBUG:teuthology.orchestra.run.smithi192:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-06-02T04:41:31.017 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda on all hosts... 2024-06-02T04:41:31.017 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda pull 2024-06-02T04:41:31.020 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda pull 2024-06-02T04:41:31.022 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda pull 2024-06-02T04:41:31.974 INFO:teuthology.orchestra.run.smithi192.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda... 2024-06-02T04:41:32.368 INFO:teuthology.orchestra.run.smithi119.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda... 2024-06-02T04:41:32.724 INFO:teuthology.orchestra.run.smithi076.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda... 2024-06-02T04:42:09.977 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-06-02T04:42:09.977 INFO:teuthology.orchestra.run.smithi076.stdout: "ceph_version": "ceph version 18.2.2-1381-g3bb45379 (3bb45379356e8aa965152e0b8c663715c5df9bda) reef (stable)", 2024-06-02T04:42:09.977 INFO:teuthology.orchestra.run.smithi076.stdout: "image_id": "a7978103fbbed79c34d6bc7b19af74a59666b4fc905021cc8492bb6508b4172d", 2024-06-02T04:42:09.978 INFO:teuthology.orchestra.run.smithi076.stdout: "repo_digests": [ 2024-06-02T04:42:09.978 INFO:teuthology.orchestra.run.smithi076.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2fdde4b0b6d21699621ed825b2b34390739be611a75e53f0ca47d911ac0106eb" 2024-06-02T04:42:09.978 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-06-02T04:42:09.978 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-06-02T04:42:13.083 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-06-02T04:42:13.083 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_version": "ceph version 18.2.2-1381-g3bb45379 (3bb45379356e8aa965152e0b8c663715c5df9bda) reef (stable)", 2024-06-02T04:42:13.083 INFO:teuthology.orchestra.run.smithi119.stdout: "image_id": "a7978103fbbed79c34d6bc7b19af74a59666b4fc905021cc8492bb6508b4172d", 2024-06-02T04:42:13.083 INFO:teuthology.orchestra.run.smithi119.stdout: "repo_digests": [ 2024-06-02T04:42:13.083 INFO:teuthology.orchestra.run.smithi119.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2fdde4b0b6d21699621ed825b2b34390739be611a75e53f0ca47d911ac0106eb" 2024-06-02T04:42:13.083 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-06-02T04:42:13.084 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-06-02T04:42:14.453 INFO:teuthology.orchestra.run.smithi192.stdout:{ 2024-06-02T04:42:14.454 INFO:teuthology.orchestra.run.smithi192.stdout: "ceph_version": "ceph version 18.2.2-1381-g3bb45379 (3bb45379356e8aa965152e0b8c663715c5df9bda) reef (stable)", 2024-06-02T04:42:14.454 INFO:teuthology.orchestra.run.smithi192.stdout: "image_id": "a7978103fbbed79c34d6bc7b19af74a59666b4fc905021cc8492bb6508b4172d", 2024-06-02T04:42:14.454 INFO:teuthology.orchestra.run.smithi192.stdout: "repo_digests": [ 2024-06-02T04:42:14.454 INFO:teuthology.orchestra.run.smithi192.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2fdde4b0b6d21699621ed825b2b34390739be611a75e53f0ca47d911ac0106eb" 2024-06-02T04:42:14.454 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-06-02T04:42:14.454 INFO:teuthology.orchestra.run.smithi192.stdout:} 2024-06-02T04:42:14.473 DEBUG:teuthology.orchestra.run.smithi076:> sudo mkdir -p /etc/ceph 2024-06-02T04:42:14.510 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /etc/ceph 2024-06-02T04:42:14.548 DEBUG:teuthology.orchestra.run.smithi192:> sudo mkdir -p /etc/ceph 2024-06-02T04:42:14.579 DEBUG:teuthology.orchestra.run.smithi076:> sudo chmod 777 /etc/ceph 2024-06-02T04:42:14.609 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 777 /etc/ceph 2024-06-02T04:42:14.641 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 777 /etc/ceph 2024-06-02T04:42:14.668 INFO:tasks.cephadm:Writing seed config... 2024-06-02T04:42:14.669 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-06-02T04:42:14.670 INFO:tasks.cephadm: override: [client] debug client = 20 2024-06-02T04:42:14.670 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-06-02T04:42:14.670 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-06-02T04:42:14.670 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-06-02T04:42:14.670 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-06-02T04:42:14.670 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-06-02T04:42:14.670 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-06-02T04:42:14.670 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-06-02T04:42:14.670 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-06-02T04:42:14.670 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-06-02T04:42:14.671 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-06-02T04:42:14.671 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-06-02T04:42:14.671 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-06-02T04:42:14.671 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-06-02T04:42:14.671 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-06-02T04:42:14.671 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-06-02T04:42:14.671 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-06-02T04:42:14.671 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-06-02T04:42:14.671 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-06-02T04:42:14.672 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-06-02T04:42:14.672 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-06-02T04:42:14.672 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-06-02T04:42:14.672 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-06-02T04:42:14.672 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-06-02T04:42:14.672 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-06-02T04:42:14.672 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-06-02T04:42:14.672 INFO:tasks.cephadm: override: [osd] bluestore compression mode = aggressive 2024-06-02T04:42:14.672 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-06-02T04:42:14.672 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-06-02T04:42:14.673 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-06-02T04:42:14.673 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-06-02T04:42:14.673 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-06-02T04:42:14.673 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-06-02T04:42:14.673 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-06-02T04:42:14.673 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-06-02T04:42:14.673 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-06-02T04:42:14.673 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-06-02T04:42:14.673 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-06-02T04:42:14.673 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-06-02T04:42:14.673 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-06-02T04:42:14.674 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2024-06-02T04:42:14.674 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2024-06-02T04:42:14.675 DEBUG:teuthology.orchestra.run.smithi076:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-06-02T04:42:14.696 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 60ab6d30-209a-11ef-bc9b-c7b262605968 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore compression mode = aggressive bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-06-02T04:42:14.696 DEBUG:teuthology.orchestra.run.smithi076:mon.a> sudo journalctl -f -n 0 -u ceph-60ab6d30-209a-11ef-bc9b-c7b262605968@mon.a.service 2024-06-02T04:42:14.739 DEBUG:teuthology.orchestra.run.smithi076:mgr.x> sudo journalctl -f -n 0 -u ceph-60ab6d30-209a-11ef-bc9b-c7b262605968@mgr.x.service 2024-06-02T04:42:14.767 INFO:journalctl@ceph.mon.a.smithi076.stdout:-- Logs begin at Sun 2024-06-02 04:26:13 UTC. -- 2024-06-02T04:42:14.768 INFO:tasks.cephadm:Bootstrapping... 2024-06-02T04:42:14.768 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda -v bootstrap --fsid 60ab6d30-209a-11ef-bc9b-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.76 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-06-02T04:42:14.795 INFO:journalctl@ceph.mgr.x.smithi076.stdout:-- Logs begin at Sun 2024-06-02 04:26:13 UTC. -- 2024-06-02T04:42:14.930 INFO:teuthology.orchestra.run.smithi076.stdout:-------------------------------------------------------------------------------- 2024-06-02T04:42:14.931 INFO:teuthology.orchestra.run.smithi076.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda', '-v', 'bootstrap', '--fsid', '60ab6d30-209a-11ef-bc9b-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.76', '--skip-admin-label'] 2024-06-02T04:42:14.964 INFO:teuthology.orchestra.run.smithi076.stdout:/bin/podman: stdout 4.6.1 2024-06-02T04:42:14.965 INFO:teuthology.orchestra.run.smithi076.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-06-02T04:42:14.965 INFO:teuthology.orchestra.run.smithi076.stdout:Verifying podman|docker is present... 2024-06-02T04:42:15.005 INFO:teuthology.orchestra.run.smithi076.stdout:/bin/podman: stdout 4.6.1 2024-06-02T04:42:15.005 INFO:teuthology.orchestra.run.smithi076.stdout:Verifying lvm2 is present... 2024-06-02T04:42:15.005 INFO:teuthology.orchestra.run.smithi076.stdout:Verifying time synchronization is in place... 2024-06-02T04:42:15.012 INFO:teuthology.orchestra.run.smithi076.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-06-02T04:42:15.012 INFO:teuthology.orchestra.run.smithi076.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-06-02T04:42:15.018 INFO:teuthology.orchestra.run.smithi076.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-06-02T04:42:15.018 INFO:teuthology.orchestra.run.smithi076.stdout:systemctl: stdout inactive 2024-06-02T04:42:15.024 INFO:teuthology.orchestra.run.smithi076.stdout:systemctl: stdout enabled 2024-06-02T04:42:15.030 INFO:teuthology.orchestra.run.smithi076.stdout:systemctl: stdout active 2024-06-02T04:42:15.030 INFO:teuthology.orchestra.run.smithi076.stdout:Unit chronyd.service is enabled and running 2024-06-02T04:42:15.030 INFO:teuthology.orchestra.run.smithi076.stdout:Repeating the final host check... 2024-06-02T04:42:15.061 INFO:teuthology.orchestra.run.smithi076.stdout:/bin/podman: stdout 4.6.1 2024-06-02T04:42:15.061 INFO:teuthology.orchestra.run.smithi076.stdout:podman (/bin/podman) version 4.6.1 is present 2024-06-02T04:42:15.061 INFO:teuthology.orchestra.run.smithi076.stdout:systemctl is present 2024-06-02T04:42:15.061 INFO:teuthology.orchestra.run.smithi076.stdout:lvcreate is present 2024-06-02T04:42:15.066 INFO:teuthology.orchestra.run.smithi076.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-06-02T04:42:15.067 INFO:teuthology.orchestra.run.smithi076.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-06-02T04:42:15.072 INFO:teuthology.orchestra.run.smithi076.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-06-02T04:42:15.072 INFO:teuthology.orchestra.run.smithi076.stdout:systemctl: stdout inactive 2024-06-02T04:42:15.078 INFO:teuthology.orchestra.run.smithi076.stdout:systemctl: stdout enabled 2024-06-02T04:42:15.085 INFO:teuthology.orchestra.run.smithi076.stdout:systemctl: stdout active 2024-06-02T04:42:15.085 INFO:teuthology.orchestra.run.smithi076.stdout:Unit chronyd.service is enabled and running 2024-06-02T04:42:15.085 INFO:teuthology.orchestra.run.smithi076.stdout:Host looks OK 2024-06-02T04:42:15.085 INFO:teuthology.orchestra.run.smithi076.stdout:Cluster fsid: 60ab6d30-209a-11ef-bc9b-c7b262605968 2024-06-02T04:42:15.085 INFO:teuthology.orchestra.run.smithi076.stdout:Acquiring lock 139877709588968 on /run/cephadm/60ab6d30-209a-11ef-bc9b-c7b262605968.lock 2024-06-02T04:42:15.085 INFO:teuthology.orchestra.run.smithi076.stdout:Lock 139877709588968 acquired on /run/cephadm/60ab6d30-209a-11ef-bc9b-c7b262605968.lock 2024-06-02T04:42:15.086 INFO:teuthology.orchestra.run.smithi076.stdout:Verifying IP 172.21.15.76 port 3300 ... 2024-06-02T04:42:15.086 INFO:teuthology.orchestra.run.smithi076.stdout:Verifying IP 172.21.15.76 port 6789 ... 2024-06-02T04:42:15.086 INFO:teuthology.orchestra.run.smithi076.stdout:Base mon IP(s) is [172.21.15.76:3300, 172.21.15.76:6789], mon addrv is [v2:172.21.15.76:3300,v1:172.21.15.76:6789] 2024-06-02T04:42:15.089 INFO:teuthology.orchestra.run.smithi076.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp metric 100 2024-06-02T04:42:15.089 INFO:teuthology.orchestra.run.smithi076.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.76 metric 100 2024-06-02T04:42:15.092 INFO:teuthology.orchestra.run.smithi076.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-06-02T04:42:15.092 INFO:teuthology.orchestra.run.smithi076.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 1024 pref medium 2024-06-02T04:42:15.092 INFO:teuthology.orchestra.run.smithi076.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 pref medium 2024-06-02T04:42:15.094 INFO:teuthology.orchestra.run.smithi076.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-06-02T04:42:15.094 INFO:teuthology.orchestra.run.smithi076.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-06-02T04:42:15.094 INFO:teuthology.orchestra.run.smithi076.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-06-02T04:42:15.095 INFO:teuthology.orchestra.run.smithi076.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-06-02T04:42:15.095 INFO:teuthology.orchestra.run.smithi076.stdout:/sbin/ip: stdout inet6 fe80::e45d:bce6:31a8:760b/64 scope link noprefixroute 2024-06-02T04:42:15.095 INFO:teuthology.orchestra.run.smithi076.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-06-02T04:42:15.095 INFO:teuthology.orchestra.run.smithi076.stdout:Mon IP `172.21.15.76` is in CIDR network `172.21.0.0/20` 2024-06-02T04:42:15.095 INFO:teuthology.orchestra.run.smithi076.stdout:Mon IP `172.21.15.76` is in CIDR network `172.21.0.0/20` 2024-06-02T04:42:15.095 INFO:teuthology.orchestra.run.smithi076.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-06-02T04:42:15.096 INFO:teuthology.orchestra.run.smithi076.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-06-02T04:42:15.097 INFO:teuthology.orchestra.run.smithi076.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda... 2024-06-02T04:42:15.482 INFO:teuthology.orchestra.run.smithi076.stdout:/bin/podman: stdout a7978103fbbed79c34d6bc7b19af74a59666b4fc905021cc8492bb6508b4172d 2024-06-02T04:42:15.482 INFO:teuthology.orchestra.run.smithi076.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda... 2024-06-02T04:42:15.482 INFO:teuthology.orchestra.run.smithi076.stdout:/bin/podman: stderr Getting image source signatures 2024-06-02T04:42:15.482 INFO:teuthology.orchestra.run.smithi076.stdout:/bin/podman: stderr Copying blob sha256:e5de8de6d8f2d7ca5eeb313a98107a8ae774a9039c20e00677c2d4f3b8375b37 2024-06-02T04:42:15.482 INFO:teuthology.orchestra.run.smithi076.stdout:/bin/podman: stderr Copying blob sha256:3ca969c7b6d79946c6f10490fffc00028babe7df67f50ed53c7bc209325e0612 2024-06-02T04:42:15.482 INFO:teuthology.orchestra.run.smithi076.stdout:/bin/podman: stderr Copying config sha256:a7978103fbbed79c34d6bc7b19af74a59666b4fc905021cc8492bb6508b4172d 2024-06-02T04:42:15.483 INFO:teuthology.orchestra.run.smithi076.stdout:/bin/podman: stderr Writing manifest to image destination 2024-06-02T04:42:16.172 INFO:teuthology.orchestra.run.smithi076.stdout:ceph: stdout ceph version 18.2.2-1381-g3bb45379 (3bb45379356e8aa965152e0b8c663715c5df9bda) reef (stable) 2024-06-02T04:42:16.173 INFO:teuthology.orchestra.run.smithi076.stdout:Ceph version: ceph version 18.2.2-1381-g3bb45379 (3bb45379356e8aa965152e0b8c663715c5df9bda) reef (stable) 2024-06-02T04:42:16.173 INFO:teuthology.orchestra.run.smithi076.stdout:Extracting ceph user uid/gid from container image... 2024-06-02T04:42:16.815 INFO:teuthology.orchestra.run.smithi076.stdout:stat: stdout 167 167 2024-06-02T04:42:16.815 INFO:teuthology.orchestra.run.smithi076.stdout:Creating initial keys... 2024-06-02T04:42:17.414 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph-authtool: stdout AQAp+FtmGhmVAxAA+b8S3mNqeR5qr3aFBqQK2A== 2024-06-02T04:42:18.074 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph-authtool: stdout AQAp+FtmAX/XKBAAS05H3PiY4p6kTG+6cQAfjA== 2024-06-02T04:42:18.718 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph-authtool: stdout AQAq+FtmvY/wFRAAGOxwf/KnapA6zc1e7unMpA== 2024-06-02T04:42:18.719 INFO:teuthology.orchestra.run.smithi076.stdout:Creating initial monmap... 2024-06-02T04:42:19.321 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-06-02T04:42:19.321 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = pacific 2024-06-02T04:42:19.321 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 60ab6d30-209a-11ef-bc9b-c7b262605968 2024-06-02T04:42:19.321 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-06-02T04:42:19.322 INFO:teuthology.orchestra.run.smithi076.stdout:monmaptool for a [v2:172.21.15.76:3300,v1:172.21.15.76:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-06-02T04:42:19.322 INFO:teuthology.orchestra.run.smithi076.stdout:setting min_mon_release = pacific 2024-06-02T04:42:19.322 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/monmaptool: set fsid to 60ab6d30-209a-11ef-bc9b-c7b262605968 2024-06-02T04:42:19.322 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-06-02T04:42:19.322 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:42:19.323 INFO:teuthology.orchestra.run.smithi076.stdout:Creating mon... 2024-06-02T04:42:19.987 INFO:teuthology.orchestra.run.smithi076.stdout:create mon.a on 2024-06-02T04:42:20.117 INFO:teuthology.orchestra.run.smithi076.stdout:systemctl: stderr Removed /etc/systemd/system/multi-user.target.wants/ceph.target. 2024-06-02T04:42:20.206 INFO:teuthology.orchestra.run.smithi076.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-06-02T04:42:20.334 INFO:teuthology.orchestra.run.smithi076.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-60ab6d30-209a-11ef-bc9b-c7b262605968.target → /etc/systemd/system/ceph-60ab6d30-209a-11ef-bc9b-c7b262605968.target. 2024-06-02T04:42:20.334 INFO:teuthology.orchestra.run.smithi076.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-60ab6d30-209a-11ef-bc9b-c7b262605968.target → /etc/systemd/system/ceph-60ab6d30-209a-11ef-bc9b-c7b262605968.target. 2024-06-02T04:42:20.520 INFO:teuthology.orchestra.run.smithi076.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-60ab6d30-209a-11ef-bc9b-c7b262605968@mon.a 2024-06-02T04:42:20.521 INFO:teuthology.orchestra.run.smithi076.stdout:systemctl: stderr Failed to reset failed state of unit ceph-60ab6d30-209a-11ef-bc9b-c7b262605968@mon.a.service: Unit ceph-60ab6d30-209a-11ef-bc9b-c7b262605968@mon.a.service not loaded. 2024-06-02T04:42:20.607 INFO:teuthology.orchestra.run.smithi076.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-60ab6d30-209a-11ef-bc9b-c7b262605968.target.wants/ceph-60ab6d30-209a-11ef-bc9b-c7b262605968@mon.a.service → /etc/systemd/system/ceph-60ab6d30-209a-11ef-bc9b-c7b262605968@.service. 2024-06-02T04:42:21.026 INFO:teuthology.orchestra.run.smithi076.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-06-02T04:42:21.027 INFO:teuthology.orchestra.run.smithi076.stdout:systemctl: stdout disabled 2024-06-02T04:42:21.034 INFO:teuthology.orchestra.run.smithi076.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-06-02T04:42:21.034 INFO:teuthology.orchestra.run.smithi076.stdout:systemctl: stdout inactive 2024-06-02T04:42:21.034 INFO:teuthology.orchestra.run.smithi076.stdout:firewalld.service is not enabled 2024-06-02T04:42:21.034 INFO:teuthology.orchestra.run.smithi076.stdout:Not possible to enable service . firewalld.service is not available 2024-06-02T04:42:21.034 INFO:teuthology.orchestra.run.smithi076.stdout:Waiting for mon to start... 2024-06-02T04:42:21.035 INFO:teuthology.orchestra.run.smithi076.stdout:Waiting for mon... 2024-06-02T04:42:21.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:21 smithi076 bash[42411]: 96c71b7ae4a6434a052adcc9a8c794b275f8f6612f92b91eef851ab6d2b4a2bc 2024-06-02T04:42:21.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:21 smithi076 systemd[1]: Started Ceph mon.a for 60ab6d30-209a-11ef-bc9b-c7b262605968. 2024-06-02T04:42:21.873 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout cluster: 2024-06-02T04:42:21.873 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout id: 60ab6d30-209a-11ef-bc9b-c7b262605968 2024-06-02T04:42:21.873 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-06-02T04:42:21.873 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout 2024-06-02T04:42:21.873 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout services: 2024-06-02T04:42:21.873 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.505227s) 2024-06-02T04:42:21.873 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-06-02T04:42:21.874 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-06-02T04:42:21.874 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout 2024-06-02T04:42:21.874 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout data: 2024-06-02T04:42:21.874 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-06-02T04:42:21.874 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-06-02T04:42:21.874 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-06-02T04:42:21.874 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout pgs: 2024-06-02T04:42:21.874 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout 2024-06-02T04:42:21.874 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:21.433+0000 7f865bb66700 1 Processor -- start 2024-06-02T04:42:21.874 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:21.433+0000 7f865bb66700 1 -- start start 2024-06-02T04:42:21.874 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:21.433+0000 7f865bb66700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8654106f90 0x7f8654109380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:42:21.874 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:21.433+0000 7f865bb66700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8654079e90 con 0x7f8654106f90 2024-06-02T04:42:21.875 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:21.434+0000 7f8659902700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8654106f90 0x7f8654109380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:42:21.875 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:21.434+0000 7f8659902700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8654106f90 0x7f8654109380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:60220/0 (socket says 172.21.15.76:60220) 2024-06-02T04:42:21.875 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:21.434+0000 7f8659902700 1 -- 172.21.15.76:0/932376519 learned_addr learned my addr 172.21.15.76:0/932376519 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:42:21.875 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:21.434+0000 7f8659902700 1 -- 172.21.15.76:0/932376519 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86541098c0 con 0x7f8654106f90 2024-06-02T04:42:21.875 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:21.434+0000 7f8659902700 1 --2- 172.21.15.76:0/932376519 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8654106f90 0x7f8654109380 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f86440098a0 tx=0x7f8644009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d36191260797f87 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:42:21.875 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:21.434+0000 7f8658900700 1 -- 172.21.15.76:0/932376519 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8644004160 con 0x7f8654106f90 2024-06-02T04:42:21.875 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:21.434+0000 7f8658900700 1 -- 172.21.15.76:0/932376519 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86440042c0 con 0x7f8654106f90 2024-06-02T04:42:21.875 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:21.435+0000 7f8658900700 1 -- 172.21.15.76:0/932376519 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f86440045a0 con 0x7f8654106f90 2024-06-02T04:42:21.875 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:21.435+0000 7f865bb66700 1 -- 172.21.15.76:0/932376519 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8654106f90 msgr2=0x7f8654109380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:42:21.875 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:21.435+0000 7f865bb66700 1 --2- 172.21.15.76:0/932376519 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8654106f90 0x7f8654109380 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f86440098a0 tx=0x7f8644009bb0 comp rx=0 tx=0).stop 2024-06-02T04:42:21.875 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:21.435+0000 7f865bb66700 1 -- 172.21.15.76:0/932376519 shutdown_connections 2024-06-02T04:42:21.875 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:21.435+0000 7f865bb66700 1 --2- 172.21.15.76:0/932376519 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8654106f90 0x7f8654109380 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:42:21.875 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:21.435+0000 7f865bb66700 1 -- 172.21.15.76:0/932376519 >> 172.21.15.76:0/932376519 conn(0x7f8654100a00 msgr2=0x7f8654102e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:42:21.876 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:21.435+0000 7f865bb66700 1 -- 172.21.15.76:0/932376519 shutdown_connections 2024-06-02T04:42:21.876 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:21.435+0000 7f865bb66700 1 -- 172.21.15.76:0/932376519 wait complete. 2024-06-02T04:42:21.876 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:21.436+0000 7f865bb66700 1 Processor -- start 2024-06-02T04:42:21.876 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:21.436+0000 7f865bb66700 1 -- start start 2024-06-02T04:42:21.876 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:21.436+0000 7f865bb66700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8654106f90 0x7f86541067c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:42:21.876 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:21.436+0000 7f865bb66700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8654106d00 con 0x7f8654106f90 2024-06-02T04:42:21.876 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:21.436+0000 7f8659902700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8654106f90 0x7f86541067c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:42:21.876 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:21.436+0000 7f8659902700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8654106f90 0x7f86541067c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:60228/0 (socket says 172.21.15.76:60228) 2024-06-02T04:42:21.876 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:21.436+0000 7f8659902700 1 -- 172.21.15.76:0/2626822051 learned_addr learned my addr 172.21.15.76:0/2626822051 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:42:21.876 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:21.436+0000 7f8659902700 1 -- 172.21.15.76:0/2626822051 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8644009550 con 0x7f8654106f90 2024-06-02T04:42:21.876 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:21.436+0000 7f8659902700 1 --2- 172.21.15.76:0/2626822051 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8654106f90 0x7f86541067c0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f86540792d0 tx=0x7f8644004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:42:21.876 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:21.437+0000 7f864affd700 1 -- 172.21.15.76:0/2626822051 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8644011630 con 0x7f8654106f90 2024-06-02T04:42:21.876 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:21.437+0000 7f864affd700 1 -- 172.21.15.76:0/2626822051 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8644011790 con 0x7f8654106f90 2024-06-02T04:42:21.876 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:21.437+0000 7f865bb66700 1 -- 172.21.15.76:0/2626822051 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8654104f40 con 0x7f8654106f90 2024-06-02T04:42:21.877 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:21.437+0000 7f864affd700 1 -- 172.21.15.76:0/2626822051 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8644011a30 con 0x7f8654106f90 2024-06-02T04:42:21.877 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:21.437+0000 7f865bb66700 1 -- 172.21.15.76:0/2626822051 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86541053e0 con 0x7f8654106f90 2024-06-02T04:42:21.877 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:21.437+0000 7f864affd700 1 -- 172.21.15.76:0/2626822051 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f8644021070 con 0x7f8654106f90 2024-06-02T04:42:21.877 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:21.437+0000 7f864affd700 1 -- 172.21.15.76:0/2626822051 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f864401b440 con 0x7f8654106f90 2024-06-02T04:42:21.877 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:21.438+0000 7f865bb66700 1 -- 172.21.15.76:0/2626822051 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86540625d0 con 0x7f8654106f90 2024-06-02T04:42:21.877 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:21.440+0000 7f864affd700 1 -- 172.21.15.76:0/2626822051 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f864401a460 con 0x7f8654106f90 2024-06-02T04:42:21.877 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:21.510+0000 7f865bb66700 1 -- 172.21.15.76:0/2626822051 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f8654109df0 con 0x7f8654106f90 2024-06-02T04:42:21.877 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:21.510+0000 7f864affd700 1 -- 172.21.15.76:0/2626822051 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+317 (secure 0 0 0) 0x7f8654109df0 con 0x7f8654106f90 2024-06-02T04:42:21.877 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:21.511+0000 7f865bb66700 1 -- 172.21.15.76:0/2626822051 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8654106f90 msgr2=0x7f86541067c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:42:21.877 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:21.511+0000 7f865bb66700 1 --2- 172.21.15.76:0/2626822051 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8654106f90 0x7f86541067c0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f86540792d0 tx=0x7f8644004750 comp rx=0 tx=0).stop 2024-06-02T04:42:21.877 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:21.511+0000 7f865bb66700 1 -- 172.21.15.76:0/2626822051 shutdown_connections 2024-06-02T04:42:21.877 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:21.511+0000 7f865bb66700 1 --2- 172.21.15.76:0/2626822051 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8654106f90 0x7f86541067c0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:42:21.877 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:21.511+0000 7f865bb66700 1 -- 172.21.15.76:0/2626822051 >> 172.21.15.76:0/2626822051 conn(0x7f8654100a00 msgr2=0x7f8654102d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:42:21.878 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:21.511+0000 7f865bb66700 1 -- 172.21.15.76:0/2626822051 shutdown_connections 2024-06-02T04:42:21.878 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:21.511+0000 7f865bb66700 1 -- 172.21.15.76:0/2626822051 wait complete. 2024-06-02T04:42:21.878 INFO:teuthology.orchestra.run.smithi076.stdout:mon is available 2024-06-02T04:42:21.878 INFO:teuthology.orchestra.run.smithi076.stdout:Assimilating anything we can from ceph.conf... 2024-06-02T04:42:22.082 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:22 smithi076 ceph-mon[42448]: mon.a is new leader, mons a in quorum (ranks 0) 2024-06-02T04:42:22.082 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:22 smithi076 ceph-mon[42448]: monmap e1: 1 mons at {a=[v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-06-02T04:42:22.082 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:22 smithi076 ceph-mon[42448]: fsmap 2024-06-02T04:42:22.082 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:22 smithi076 ceph-mon[42448]: osdmap e1: 0 total, 0 up, 0 in 2024-06-02T04:42:22.082 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:22 smithi076 ceph-mon[42448]: mgrmap e1: no daemons active 2024-06-02T04:42:22.082 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:22 smithi076 ceph-mon[42448]: from='client.? 172.21.15.76:0/2626822051' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-06-02T04:42:22.730 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout 2024-06-02T04:42:22.731 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout [global] 2024-06-02T04:42:22.731 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout fsid = 60ab6d30-209a-11ef-bc9b-c7b262605968 2024-06-02T04:42:22.731 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.76:3300,v1:172.21.15.76:6789] 2024-06-02T04:42:22.731 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-06-02T04:42:22.731 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-06-02T04:42:22.731 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-06-02T04:42:22.731 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-06-02T04:42:22.731 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout 2024-06-02T04:42:22.731 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout [mgr] 2024-06-02T04:42:22.731 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-06-02T04:42:22.731 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout 2024-06-02T04:42:22.731 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout [osd] 2024-06-02T04:42:22.731 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-06-02T04:42:22.731 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-06-02T04:42:22.732 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-06-02T04:42:22.732 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-06-02T04:42:22.732 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-06-02T04:42:22.732 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:22.289+0000 7fcbadd2c700 1 Processor -- start 2024-06-02T04:42:22.732 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:22.289+0000 7fcbadd2c700 1 -- start start 2024-06-02T04:42:22.732 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:22.289+0000 7fcbadd2c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcba81047d0 0x7fcba8104bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:42:22.732 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:22.289+0000 7fcbadd2c700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcba81051c0 con 0x7fcba81047d0 2024-06-02T04:42:22.732 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:22.290+0000 7fcba77fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcba81047d0 0x7fcba8104bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:42:22.732 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:22.290+0000 7fcba77fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcba81047d0 0x7fcba8104bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:35138/0 (socket says 172.21.15.76:35138) 2024-06-02T04:42:22.732 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:22.290+0000 7fcba77fe700 1 -- 172.21.15.76:0/2007567552 learned_addr learned my addr 172.21.15.76:0/2007567552 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:42:22.732 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:22.290+0000 7fcba77fe700 1 -- 172.21.15.76:0/2007567552 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcba8107760 con 0x7fcba81047d0 2024-06-02T04:42:22.732 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:22.290+0000 7fcba77fe700 1 --2- 172.21.15.76:0/2007567552 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcba81047d0 0x7fcba8104bf0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fcba00098a0 tx=0x7fcba0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2788f2350187ce2c server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:42:22.732 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:22.290+0000 7fcba67fc700 1 -- 172.21.15.76:0/2007567552 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcba0004160 con 0x7fcba81047d0 2024-06-02T04:42:22.733 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:22.290+0000 7fcba67fc700 1 -- 172.21.15.76:0/2007567552 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcba00042c0 con 0x7fcba81047d0 2024-06-02T04:42:22.733 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:22.290+0000 7fcba67fc700 1 -- 172.21.15.76:0/2007567552 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcba00045a0 con 0x7fcba81047d0 2024-06-02T04:42:22.733 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:22.291+0000 7fcbadd2c700 1 -- 172.21.15.76:0/2007567552 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcba81047d0 msgr2=0x7fcba8104bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:42:22.733 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:22.291+0000 7fcbadd2c700 1 --2- 172.21.15.76:0/2007567552 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcba81047d0 0x7fcba8104bf0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fcba00098a0 tx=0x7fcba0009bb0 comp rx=0 tx=0).stop 2024-06-02T04:42:22.733 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:22.291+0000 7fcbadd2c700 1 -- 172.21.15.76:0/2007567552 shutdown_connections 2024-06-02T04:42:22.733 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:22.291+0000 7fcbadd2c700 1 --2- 172.21.15.76:0/2007567552 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcba81047d0 0x7fcba8104bf0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:42:22.733 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:22.291+0000 7fcbadd2c700 1 -- 172.21.15.76:0/2007567552 >> 172.21.15.76:0/2007567552 conn(0x7fcba8100100 msgr2=0x7fcba8102540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:42:22.733 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:22.291+0000 7fcbadd2c700 1 -- 172.21.15.76:0/2007567552 shutdown_connections 2024-06-02T04:42:22.733 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:22.291+0000 7fcbadd2c700 1 -- 172.21.15.76:0/2007567552 wait complete. 2024-06-02T04:42:22.733 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:22.291+0000 7fcbadd2c700 1 Processor -- start 2024-06-02T04:42:22.733 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:22.291+0000 7fcbadd2c700 1 -- start start 2024-06-02T04:42:22.733 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:22.292+0000 7fcbadd2c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcba81047d0 0x7fcba8199a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:42:22.733 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:22.292+0000 7fcbadd2c700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcba8199f40 con 0x7fcba81047d0 2024-06-02T04:42:22.734 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:22.292+0000 7fcba77fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcba81047d0 0x7fcba8199a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:42:22.734 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:22.292+0000 7fcba77fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcba81047d0 0x7fcba8199a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:35142/0 (socket says 172.21.15.76:35142) 2024-06-02T04:42:22.734 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:22.292+0000 7fcba77fe700 1 -- 172.21.15.76:0/1434555308 learned_addr learned my addr 172.21.15.76:0/1434555308 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:42:22.734 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:22.292+0000 7fcba77fe700 1 -- 172.21.15.76:0/1434555308 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcba0009550 con 0x7fcba81047d0 2024-06-02T04:42:22.734 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:22.292+0000 7fcba77fe700 1 --2- 172.21.15.76:0/1434555308 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcba81047d0 0x7fcba8199a00 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fcba0004000 tx=0x7fcba0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:42:22.734 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:22.292+0000 7fcba4ff9700 1 -- 172.21.15.76:0/1434555308 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcba0011630 con 0x7fcba81047d0 2024-06-02T04:42:22.734 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:22.292+0000 7fcba4ff9700 1 -- 172.21.15.76:0/1434555308 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcba0011790 con 0x7fcba81047d0 2024-06-02T04:42:22.734 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:22.292+0000 7fcba4ff9700 1 -- 172.21.15.76:0/1434555308 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcba0011a30 con 0x7fcba81047d0 2024-06-02T04:42:22.734 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:22.292+0000 7fcbadd2c700 1 -- 172.21.15.76:0/1434555308 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcba819a140 con 0x7fcba81047d0 2024-06-02T04:42:22.734 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:22.292+0000 7fcbadd2c700 1 -- 172.21.15.76:0/1434555308 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcba819a5e0 con 0x7fcba81047d0 2024-06-02T04:42:22.734 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:22.293+0000 7fcba4ff9700 1 -- 172.21.15.76:0/1434555308 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fcba0021070 con 0x7fcba81047d0 2024-06-02T04:42:22.734 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:22.293+0000 7fcba4ff9700 1 -- 172.21.15.76:0/1434555308 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fcba001b440 con 0x7fcba81047d0 2024-06-02T04:42:22.735 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:22.293+0000 7fcbadd2c700 1 -- 172.21.15.76:0/1434555308 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcba8193690 con 0x7fcba81047d0 2024-06-02T04:42:22.735 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:22.295+0000 7fcba4ff9700 1 -- 172.21.15.76:0/1434555308 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7fcba001a460 con 0x7fcba81047d0 2024-06-02T04:42:22.735 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:22.362+0000 7fcbadd2c700 1 -- 172.21.15.76:0/1434555308 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7fcba8107ad0 con 0x7fcba81047d0 2024-06-02T04:42:22.735 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:22.366+0000 7fcba4ff9700 1 -- 172.21.15.76:0/1434555308 <== mon.0 v2:172.21.15.76:3300/0 7 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fcba001a600 con 0x7fcba81047d0 2024-06-02T04:42:22.735 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:22.366+0000 7fcba4ff9700 1 -- 172.21.15.76:0/1434555308 <== mon.0 v2:172.21.15.76:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+429 (secure 0 0 0) 0x7fcba00334e0 con 0x7fcba81047d0 2024-06-02T04:42:22.735 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:22.367+0000 7fcbadd2c700 1 -- 172.21.15.76:0/1434555308 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcba81047d0 msgr2=0x7fcba8199a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:42:22.735 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:22.367+0000 7fcbadd2c700 1 --2- 172.21.15.76:0/1434555308 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcba81047d0 0x7fcba8199a00 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fcba0004000 tx=0x7fcba0004750 comp rx=0 tx=0).stop 2024-06-02T04:42:22.735 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:22.367+0000 7fcbadd2c700 1 -- 172.21.15.76:0/1434555308 shutdown_connections 2024-06-02T04:42:22.735 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:22.367+0000 7fcbadd2c700 1 --2- 172.21.15.76:0/1434555308 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcba81047d0 0x7fcba8199a00 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:42:22.735 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:22.367+0000 7fcbadd2c700 1 -- 172.21.15.76:0/1434555308 >> 172.21.15.76:0/1434555308 conn(0x7fcba8100100 msgr2=0x7fcba81907d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:42:22.735 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:22.367+0000 7fcbadd2c700 1 -- 172.21.15.76:0/1434555308 shutdown_connections 2024-06-02T04:42:22.735 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:22.367+0000 7fcbadd2c700 1 -- 172.21.15.76:0/1434555308 wait complete. 2024-06-02T04:42:22.735 INFO:teuthology.orchestra.run.smithi076.stdout:Generating new minimal ceph.conf... 2024-06-02T04:42:23.315 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:23 smithi076 ceph-mon[42448]: from='client.? 172.21.15.76:0/1434555308' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-06-02T04:42:23.315 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:23 smithi076 ceph-mon[42448]: from='client.? 172.21.15.76:0/1434555308' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-06-02T04:42:23.514 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:23.064+0000 7f6840db3700 1 Processor -- start 2024-06-02T04:42:23.515 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:23.064+0000 7f6840db3700 1 -- start start 2024-06-02T04:42:23.515 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:23.064+0000 7f6840db3700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f683c1053e0 0x7f683c105800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:42:23.515 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:23.064+0000 7f6840db3700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f683c105dd0 con 0x7f683c1053e0 2024-06-02T04:42:23.515 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:23.065+0000 7f683a59c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f683c1053e0 0x7f683c105800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:42:23.515 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:23.065+0000 7f683a59c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f683c1053e0 0x7f683c105800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:35158/0 (socket says 172.21.15.76:35158) 2024-06-02T04:42:23.516 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:23.065+0000 7f683a59c700 1 -- 172.21.15.76:0/3895407381 learned_addr learned my addr 172.21.15.76:0/3895407381 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:42:23.516 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:23.065+0000 7f683a59c700 1 -- 172.21.15.76:0/3895407381 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f683c1065e0 con 0x7f683c1053e0 2024-06-02T04:42:23.516 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:23.065+0000 7f683a59c700 1 --2- 172.21.15.76:0/3895407381 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f683c1053e0 0x7f683c105800 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f682c0098a0 tx=0x7f682c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d12e97c5cf25984b server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:42:23.516 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:23.065+0000 7f683959a700 1 -- 172.21.15.76:0/3895407381 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f682c004160 con 0x7f683c1053e0 2024-06-02T04:42:23.516 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:23.065+0000 7f683959a700 1 -- 172.21.15.76:0/3895407381 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f682c0042c0 con 0x7f683c1053e0 2024-06-02T04:42:23.517 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:23.065+0000 7f683959a700 1 -- 172.21.15.76:0/3895407381 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f682c011940 con 0x7f683c1053e0 2024-06-02T04:42:23.517 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:23.066+0000 7f6840db3700 1 -- 172.21.15.76:0/3895407381 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f683c1053e0 msgr2=0x7f683c105800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:42:23.517 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:23.066+0000 7f6840db3700 1 --2- 172.21.15.76:0/3895407381 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f683c1053e0 0x7f683c105800 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f682c0098a0 tx=0x7f682c009bb0 comp rx=0 tx=0).stop 2024-06-02T04:42:23.517 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:23.066+0000 7f6840db3700 1 -- 172.21.15.76:0/3895407381 shutdown_connections 2024-06-02T04:42:23.517 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:23.066+0000 7f6840db3700 1 --2- 172.21.15.76:0/3895407381 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f683c1053e0 0x7f683c105800 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:42:23.517 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:23.066+0000 7f6840db3700 1 -- 172.21.15.76:0/3895407381 >> 172.21.15.76:0/3895407381 conn(0x7f683c1009c0 msgr2=0x7f683c102de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:42:23.518 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:23.066+0000 7f6840db3700 1 -- 172.21.15.76:0/3895407381 shutdown_connections 2024-06-02T04:42:23.518 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:23.066+0000 7f6840db3700 1 -- 172.21.15.76:0/3895407381 wait complete. 2024-06-02T04:42:23.518 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:23.067+0000 7f6840db3700 1 Processor -- start 2024-06-02T04:42:23.518 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:23.067+0000 7f6840db3700 1 -- start start 2024-06-02T04:42:23.518 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:23.067+0000 7f6840db3700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f683c1053e0 0x7f683c0799d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:42:23.518 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:23.067+0000 7f6840db3700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f683c079f10 con 0x7f683c1053e0 2024-06-02T04:42:23.518 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:23.067+0000 7f683a59c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f683c1053e0 0x7f683c0799d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:42:23.518 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:23.067+0000 7f683a59c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f683c1053e0 0x7f683c0799d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:35170/0 (socket says 172.21.15.76:35170) 2024-06-02T04:42:23.518 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:23.067+0000 7f683a59c700 1 -- 172.21.15.76:0/1958887990 learned_addr learned my addr 172.21.15.76:0/1958887990 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:42:23.518 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:23.067+0000 7f683a59c700 1 -- 172.21.15.76:0/1958887990 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f682c009550 con 0x7f683c1053e0 2024-06-02T04:42:23.518 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:23.067+0000 7f683a59c700 1 --2- 172.21.15.76:0/1958887990 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f683c1053e0 0x7f683c0799d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f682c003f20 tx=0x7f682c011f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:42:23.518 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:23.067+0000 7f68337fe700 1 -- 172.21.15.76:0/1958887990 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f682c0036a0 con 0x7f683c1053e0 2024-06-02T04:42:23.519 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:23.067+0000 7f68337fe700 1 -- 172.21.15.76:0/1958887990 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f682c003c70 con 0x7f683c1053e0 2024-06-02T04:42:23.519 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:23.067+0000 7f68337fe700 1 -- 172.21.15.76:0/1958887990 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f682c01be80 con 0x7f683c1053e0 2024-06-02T04:42:23.519 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:23.067+0000 7f6840db3700 1 -- 172.21.15.76:0/1958887990 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f683c19ad40 con 0x7f683c1053e0 2024-06-02T04:42:23.519 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:23.067+0000 7f6840db3700 1 -- 172.21.15.76:0/1958887990 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f683c19f5a0 con 0x7f683c1053e0 2024-06-02T04:42:23.519 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:23.068+0000 7f68337fe700 1 -- 172.21.15.76:0/1958887990 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f682c0237e0 con 0x7f683c1053e0 2024-06-02T04:42:23.519 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:23.068+0000 7f68337fe700 1 -- 172.21.15.76:0/1958887990 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f682c02cda0 con 0x7f683c1053e0 2024-06-02T04:42:23.519 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:23.068+0000 7f6840db3700 1 -- 172.21.15.76:0/1958887990 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f683c109810 con 0x7f683c1053e0 2024-06-02T04:42:23.519 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:23.071+0000 7f68337fe700 1 -- 172.21.15.76:0/1958887990 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f682c01b440 con 0x7f683c1053e0 2024-06-02T04:42:23.519 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:23.137+0000 7f6840db3700 1 -- 172.21.15.76:0/1958887990 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f683c19f790 con 0x7f683c1053e0 2024-06-02T04:42:23.519 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:23.138+0000 7f68337fe700 1 -- 172.21.15.76:0/1958887990 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+175 (secure 0 0 0) 0x7f682c02c3f0 con 0x7f683c1053e0 2024-06-02T04:42:23.520 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:23.139+0000 7f6840db3700 1 -- 172.21.15.76:0/1958887990 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f683c1053e0 msgr2=0x7f683c0799d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:42:23.520 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:23.139+0000 7f6840db3700 1 --2- 172.21.15.76:0/1958887990 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f683c1053e0 0x7f683c0799d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f682c003f20 tx=0x7f682c011f00 comp rx=0 tx=0).stop 2024-06-02T04:42:23.520 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:23.139+0000 7f6840db3700 1 -- 172.21.15.76:0/1958887990 shutdown_connections 2024-06-02T04:42:23.520 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:23.139+0000 7f6840db3700 1 --2- 172.21.15.76:0/1958887990 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f683c1053e0 0x7f683c0799d0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:42:23.520 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:23.139+0000 7f6840db3700 1 -- 172.21.15.76:0/1958887990 >> 172.21.15.76:0/1958887990 conn(0x7f683c1009c0 msgr2=0x7f683c101550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:42:23.520 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:23.139+0000 7f6840db3700 1 -- 172.21.15.76:0/1958887990 shutdown_connections 2024-06-02T04:42:23.520 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:23.139+0000 7f6840db3700 1 -- 172.21.15.76:0/1958887990 wait complete. 2024-06-02T04:42:23.520 INFO:teuthology.orchestra.run.smithi076.stdout:Restarting the monitor... 2024-06-02T04:42:23.703 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:23 smithi076 systemd[1]: Stopping Ceph mon.a for 60ab6d30-209a-11ef-bc9b-c7b262605968... 2024-06-02T04:42:23.703 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:23 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mon-a[42425]: 2024-06-02T04:42:23.702+0000 7f856e607700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-06-02T04:42:23.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:23 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mon-a[42425]: 2024-06-02T04:42:23.702+0000 7f856e607700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-06-02T04:42:24.317 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 bash[42778]: ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mon-a 2024-06-02T04:42:24.588 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 systemd[1]: ceph-60ab6d30-209a-11ef-bc9b-c7b262605968@mon.a.service: Succeeded. 2024-06-02T04:42:24.588 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 systemd[1]: Stopped Ceph mon.a for 60ab6d30-209a-11ef-bc9b-c7b262605968. 2024-06-02T04:42:24.588 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 systemd[1]: Starting Ceph mon.a for 60ab6d30-209a-11ef-bc9b-c7b262605968... 2024-06-02T04:42:24.651 INFO:teuthology.orchestra.run.smithi076.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-06-02T04:42:24.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: set uid:gid to 167:167 (ceph:ceph) 2024-06-02T04:42:24.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: ceph version 18.2.2-1381-g3bb45379 (3bb45379356e8aa965152e0b8c663715c5df9bda) reef (stable), process ceph-mon, pid 7 2024-06-02T04:42:24.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: pidfile_write: ignore empty --pid-file 2024-06-02T04:42:24.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: load: jerasure load: lrc 2024-06-02T04:42:24.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 bash[42898]: 6fcc8af18c954aef64454374887a9bab166ea2771a721b4fec5885e5a2a732af 2024-06-02T04:42:24.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: RocksDB version: 7.9.2 2024-06-02T04:42:24.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Git sha 0 2024-06-02T04:42:24.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Compile date 2024-05-28 22:38:07 2024-06-02T04:42:24.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: DB SUMMARY 2024-06-02T04:42:24.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: DB Session ID: QBUX2S41EMETWZ71LFHQ 2024-06-02T04:42:24.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: CURRENT file: CURRENT 2024-06-02T04:42:24.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: IDENTITY file: IDENTITY 2024-06-02T04:42:24.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-06-02T04:42:24.985 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-06-02T04:42:24.985 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 96450 ; 2024-06-02T04:42:24.985 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.error_if_exists: 0 2024-06-02T04:42:24.985 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.create_if_missing: 0 2024-06-02T04:42:24.985 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.paranoid_checks: 1 2024-06-02T04:42:24.985 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.flush_verify_memtable_count: 1 2024-06-02T04:42:24.985 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-06-02T04:42:24.985 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-06-02T04:42:24.985 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.env: 0x5610a9ae7820 2024-06-02T04:42:24.985 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.fs: PosixFileSystem 2024-06-02T04:42:24.985 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.info_log: 0x5610ac321520 2024-06-02T04:42:24.985 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.max_file_opening_threads: 16 2024-06-02T04:42:24.985 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.statistics: (nil) 2024-06-02T04:42:24.986 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.use_fsync: 0 2024-06-02T04:42:24.986 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.max_log_file_size: 0 2024-06-02T04:42:24.986 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-06-02T04:42:24.986 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.log_file_time_to_roll: 0 2024-06-02T04:42:24.986 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.keep_log_file_num: 1000 2024-06-02T04:42:24.986 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.recycle_log_file_num: 0 2024-06-02T04:42:24.986 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.allow_fallocate: 1 2024-06-02T04:42:24.986 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.allow_mmap_reads: 0 2024-06-02T04:42:24.986 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.allow_mmap_writes: 0 2024-06-02T04:42:24.986 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.use_direct_reads: 0 2024-06-02T04:42:24.986 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-06-02T04:42:24.986 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.create_missing_column_families: 0 2024-06-02T04:42:24.987 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.db_log_dir: 2024-06-02T04:42:24.987 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.wal_dir: 2024-06-02T04:42:24.987 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.table_cache_numshardbits: 6 2024-06-02T04:42:24.987 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.WAL_ttl_seconds: 0 2024-06-02T04:42:24.987 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.WAL_size_limit_MB: 0 2024-06-02T04:42:24.987 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-06-02T04:42:24.987 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-06-02T04:42:24.987 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.is_fd_close_on_exec: 1 2024-06-02T04:42:24.987 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.advise_random_on_open: 1 2024-06-02T04:42:24.987 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.db_write_buffer_size: 0 2024-06-02T04:42:24.987 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.write_buffer_manager: 0x5610ab5b6320 2024-06-02T04:42:24.987 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-06-02T04:42:24.987 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-06-02T04:42:24.988 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.use_adaptive_mutex: 0 2024-06-02T04:42:24.988 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.rate_limiter: (nil) 2024-06-02T04:42:24.988 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-06-02T04:42:24.988 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.wal_recovery_mode: 2 2024-06-02T04:42:24.988 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.enable_thread_tracking: 0 2024-06-02T04:42:24.988 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.enable_pipelined_write: 0 2024-06-02T04:42:24.988 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.unordered_write: 0 2024-06-02T04:42:24.988 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-06-02T04:42:24.988 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-06-02T04:42:24.988 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-06-02T04:42:24.988 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-06-02T04:42:24.988 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.row_cache: None 2024-06-02T04:42:24.988 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.wal_filter: None 2024-06-02T04:42:24.989 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-06-02T04:42:24.989 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.allow_ingest_behind: 0 2024-06-02T04:42:24.989 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.two_write_queues: 0 2024-06-02T04:42:24.989 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.manual_wal_flush: 0 2024-06-02T04:42:24.989 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.wal_compression: 0 2024-06-02T04:42:24.989 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.atomic_flush: 0 2024-06-02T04:42:24.989 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-06-02T04:42:24.989 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.persist_stats_to_disk: 0 2024-06-02T04:42:24.989 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.write_dbid_to_manifest: 0 2024-06-02T04:42:24.989 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.log_readahead_size: 0 2024-06-02T04:42:24.989 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-06-02T04:42:24.989 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.best_efforts_recovery: 0 2024-06-02T04:42:24.989 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-06-02T04:42:24.989 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-06-02T04:42:24.989 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.allow_data_in_errors: 0 2024-06-02T04:42:24.990 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.db_host_id: __hostname__ 2024-06-02T04:42:24.991 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.enforce_single_del_contracts: true 2024-06-02T04:42:24.991 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.max_background_jobs: 2 2024-06-02T04:42:24.991 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.max_background_compactions: -1 2024-06-02T04:42:24.991 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.max_subcompactions: 1 2024-06-02T04:42:24.991 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-06-02T04:42:24.991 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-06-02T04:42:24.991 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.delayed_write_rate : 16777216 2024-06-02T04:42:24.991 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.max_total_wal_size: 0 2024-06-02T04:42:24.991 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-06-02T04:42:24.991 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.stats_dump_period_sec: 600 2024-06-02T04:42:24.992 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.stats_persist_period_sec: 600 2024-06-02T04:42:24.992 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-06-02T04:42:24.992 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.max_open_files: -1 2024-06-02T04:42:24.992 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.bytes_per_sync: 0 2024-06-02T04:42:24.992 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.wal_bytes_per_sync: 0 2024-06-02T04:42:24.992 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.strict_bytes_per_sync: 0 2024-06-02T04:42:24.992 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.compaction_readahead_size: 0 2024-06-02T04:42:24.992 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.max_background_flushes: -1 2024-06-02T04:42:24.992 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Compression algorithms supported: 2024-06-02T04:42:24.992 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-06-02T04:42:24.992 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: kZSTD supported: 0 2024-06-02T04:42:24.992 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: kXpressCompression supported: 0 2024-06-02T04:42:24.992 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: kLZ4HCCompression supported: 1 2024-06-02T04:42:24.993 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: kZlibCompression supported: 1 2024-06-02T04:42:24.993 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: kSnappyCompression supported: 1 2024-06-02T04:42:24.993 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: kLZ4Compression supported: 1 2024-06-02T04:42:24.993 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: kBZip2Compression supported: 0 2024-06-02T04:42:24.993 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Fast CRC32 supported: Supported on x86 2024-06-02T04:42:24.993 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: DMutex implementation: pthread_mutex_t 2024-06-02T04:42:24.993 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-06-02T04:42:24.993 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-06-02T04:42:24.993 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-06-02T04:42:24.993 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.merge_operator: 2024-06-02T04:42:24.993 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.compaction_filter: None 2024-06-02T04:42:24.993 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.compaction_filter_factory: None 2024-06-02T04:42:24.993 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.sst_partitioner_factory: None 2024-06-02T04:42:24.993 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.memtable_factory: SkipListFactory 2024-06-02T04:42:24.994 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.table_factory: BlockBasedTable 2024-06-02T04:42:24.994 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5610ac321620) 2024-06-02T04:42:24.994 INFO:journalctl@ceph.mon.a.smithi076.stdout: cache_index_and_filter_blocks: 1 2024-06-02T04:42:24.994 INFO:journalctl@ceph.mon.a.smithi076.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-06-02T04:42:24.994 INFO:journalctl@ceph.mon.a.smithi076.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-06-02T04:42:24.994 INFO:journalctl@ceph.mon.a.smithi076.stdout: pin_top_level_index_and_filter: 1 2024-06-02T04:42:24.994 INFO:journalctl@ceph.mon.a.smithi076.stdout: index_type: 0 2024-06-02T04:42:24.994 INFO:journalctl@ceph.mon.a.smithi076.stdout: data_block_index_type: 0 2024-06-02T04:42:24.994 INFO:journalctl@ceph.mon.a.smithi076.stdout: index_shortening: 1 2024-06-02T04:42:24.994 INFO:journalctl@ceph.mon.a.smithi076.stdout: data_block_hash_table_util_ratio: 0.750000 2024-06-02T04:42:24.994 INFO:journalctl@ceph.mon.a.smithi076.stdout: checksum: 4 2024-06-02T04:42:24.994 INFO:journalctl@ceph.mon.a.smithi076.stdout: no_block_cache: 0 2024-06-02T04:42:24.995 INFO:journalctl@ceph.mon.a.smithi076.stdout: block_cache: 0x5610ab6391f0 2024-06-02T04:42:24.995 INFO:journalctl@ceph.mon.a.smithi076.stdout: block_cache_name: BinnedLRUCache 2024-06-02T04:42:24.995 INFO:journalctl@ceph.mon.a.smithi076.stdout: block_cache_options: 2024-06-02T04:42:24.995 INFO:journalctl@ceph.mon.a.smithi076.stdout: capacity : 536870912 2024-06-02T04:42:24.995 INFO:journalctl@ceph.mon.a.smithi076.stdout: num_shard_bits : 4 2024-06-02T04:42:24.995 INFO:journalctl@ceph.mon.a.smithi076.stdout: strict_capacity_limit : 0 2024-06-02T04:42:24.995 INFO:journalctl@ceph.mon.a.smithi076.stdout: high_pri_pool_ratio: 0.000 2024-06-02T04:42:24.995 INFO:journalctl@ceph.mon.a.smithi076.stdout: block_cache_compressed: (nil) 2024-06-02T04:42:24.995 INFO:journalctl@ceph.mon.a.smithi076.stdout: persistent_cache: (nil) 2024-06-02T04:42:24.995 INFO:journalctl@ceph.mon.a.smithi076.stdout: block_size: 4096 2024-06-02T04:42:24.995 INFO:journalctl@ceph.mon.a.smithi076.stdout: block_size_deviation: 10 2024-06-02T04:42:24.995 INFO:journalctl@ceph.mon.a.smithi076.stdout: block_restart_interval: 16 2024-06-02T04:42:24.995 INFO:journalctl@ceph.mon.a.smithi076.stdout: index_block_restart_interval: 1 2024-06-02T04:42:24.995 INFO:journalctl@ceph.mon.a.smithi076.stdout: metadata_block_size: 4096 2024-06-02T04:42:24.996 INFO:journalctl@ceph.mon.a.smithi076.stdout: partition_filters: 0 2024-06-02T04:42:24.996 INFO:journalctl@ceph.mon.a.smithi076.stdout: use_delta_encoding: 1 2024-06-02T04:42:24.996 INFO:journalctl@ceph.mon.a.smithi076.stdout: filter_policy: bloomfilter 2024-06-02T04:42:24.996 INFO:journalctl@ceph.mon.a.smithi076.stdout: whole_key_filtering: 1 2024-06-02T04:42:24.996 INFO:journalctl@ceph.mon.a.smithi076.stdout: verify_compression: 0 2024-06-02T04:42:24.996 INFO:journalctl@ceph.mon.a.smithi076.stdout: read_amp_bytes_per_bit: 0 2024-06-02T04:42:24.996 INFO:journalctl@ceph.mon.a.smithi076.stdout: format_version: 5 2024-06-02T04:42:24.996 INFO:journalctl@ceph.mon.a.smithi076.stdout: enable_index_compression: 1 2024-06-02T04:42:24.996 INFO:journalctl@ceph.mon.a.smithi076.stdout: block_align: 0 2024-06-02T04:42:24.996 INFO:journalctl@ceph.mon.a.smithi076.stdout: max_auto_readahead_size: 262144 2024-06-02T04:42:24.996 INFO:journalctl@ceph.mon.a.smithi076.stdout: prepopulate_block_cache: 0 2024-06-02T04:42:24.996 INFO:journalctl@ceph.mon.a.smithi076.stdout: initial_auto_readahead_size: 8192 2024-06-02T04:42:24.996 INFO:journalctl@ceph.mon.a.smithi076.stdout: num_file_reads_for_auto_readahead: 2 2024-06-02T04:42:24.997 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.write_buffer_size: 33554432 2024-06-02T04:42:24.997 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.max_write_buffer_number: 2 2024-06-02T04:42:24.997 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.compression: NoCompression 2024-06-02T04:42:24.997 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.bottommost_compression: Disabled 2024-06-02T04:42:24.997 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.prefix_extractor: nullptr 2024-06-02T04:42:24.997 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-06-02T04:42:24.997 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.num_levels: 7 2024-06-02T04:42:24.997 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-06-02T04:42:24.997 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-06-02T04:42:24.997 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-06-02T04:42:24.997 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-06-02T04:42:24.997 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-06-02T04:42:24.997 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-06-02T04:42:24.997 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-06-02T04:42:24.998 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-06-02T04:42:24.998 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-06-02T04:42:24.998 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-06-02T04:42:24.998 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-06-02T04:42:24.998 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-06-02T04:42:24.998 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.compression_opts.window_bits: -14 2024-06-02T04:42:24.998 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.compression_opts.level: 32767 2024-06-02T04:42:24.998 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.compression_opts.strategy: 0 2024-06-02T04:42:24.998 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-06-02T04:42:24.998 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-06-02T04:42:24.998 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-06-02T04:42:24.998 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-06-02T04:42:24.999 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.compression_opts.enabled: false 2024-06-02T04:42:24.999 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-06-02T04:42:24.999 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-06-02T04:42:24.999 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-06-02T04:42:24.999 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-06-02T04:42:24.999 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.target_file_size_base: 67108864 2024-06-02T04:42:24.999 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.target_file_size_multiplier: 1 2024-06-02T04:42:24.999 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-06-02T04:42:24.999 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-06-02T04:42:24.999 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-06-02T04:42:24.999 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-06-02T04:42:24.999 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-06-02T04:42:25.000 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-06-02T04:42:25.000 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-06-02T04:42:25.000 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-06-02T04:42:25.000 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-06-02T04:42:25.000 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-06-02T04:42:25.000 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-06-02T04:42:25.000 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-06-02T04:42:25.000 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-06-02T04:42:25.000 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.arena_block_size: 1048576 2024-06-02T04:42:25.000 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-06-02T04:42:25.000 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-06-02T04:42:25.000 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.disable_auto_compactions: 0 2024-06-02T04:42:25.000 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-06-02T04:42:25.000 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-06-02T04:42:25.001 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-06-02T04:42:25.001 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-06-02T04:42:25.001 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-06-02T04:42:25.001 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-06-02T04:42:25.001 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-06-02T04:42:25.001 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-06-02T04:42:25.001 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-06-02T04:42:25.001 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-06-02T04:42:25.001 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.table_properties_collectors: 2024-06-02T04:42:25.001 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.inplace_update_support: 0 2024-06-02T04:42:25.001 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.inplace_update_num_locks: 10000 2024-06-02T04:42:25.001 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-06-02T04:42:25.001 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-06-02T04:42:25.001 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.memtable_huge_page_size: 0 2024-06-02T04:42:25.002 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.bloom_locality: 0 2024-06-02T04:42:25.002 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.max_successive_merges: 0 2024-06-02T04:42:25.002 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.optimize_filters_for_hits: 0 2024-06-02T04:42:25.002 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.paranoid_file_checks: 0 2024-06-02T04:42:25.002 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.force_consistency_checks: 1 2024-06-02T04:42:25.002 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.report_bg_io_stats: 0 2024-06-02T04:42:25.002 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.ttl: 2592000 2024-06-02T04:42:25.002 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.periodic_compaction_seconds: 0 2024-06-02T04:42:25.002 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-06-02T04:42:25.002 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-06-02T04:42:25.002 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.enable_blob_files: false 2024-06-02T04:42:25.002 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.min_blob_size: 0 2024-06-02T04:42:25.003 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.blob_file_size: 268435456 2024-06-02T04:42:25.003 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.blob_compression_type: NoCompression 2024-06-02T04:42:25.003 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.enable_blob_garbage_collection: false 2024-06-02T04:42:25.003 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-06-02T04:42:25.003 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-06-02T04:42:25.003 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-06-02T04:42:25.003 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.blob_file_starting_level: 0 2024-06-02T04:42:25.003 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-06-02T04:42:25.003 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-06-02T04:42:25.003 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-06-02T04:42:25.003 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: bf7e246a-4224-4595-81e6-bf1803b0e19f 2024-06-02T04:42:25.003 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 systemd[1]: Started Ceph mon.a for 60ab6d30-209a-11ef-bc9b-c7b262605968. 2024-06-02T04:42:25.003 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: EVENT_LOG_v1 {"time_micros": 1717303344650077, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-06-02T04:42:25.004 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-06-02T04:42:25.004 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: EVENT_LOG_v1 {"time_micros": 1717303344651496, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 91926, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 303, "table_properties": {"data_size": 89954, "index_size": 254, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13338, "raw_average_key_size": 50, "raw_value_size": 82690, "raw_average_value_size": 310, "num_data_blocks": 11, "num_entries": 266, "num_filter_entries": 266, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1717303344, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "bf7e246a-4224-4595-81e6-bf1803b0e19f", "db_session_id": "QBUX2S41EMETWZ71LFHQ", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-06-02T04:42:25.004 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: EVENT_LOG_v1 {"time_micros": 1717303344651589, "job": 1, "event": "recovery_finished"} 2024-06-02T04:42:25.004 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-06-02T04:42:25.004 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-06-02T04:42:25.004 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5610ab6d6000 2024-06-02T04:42:25.004 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: DB pointer 0x5610ab6c4000 2024-06-02T04:42:25.004 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-06-02T04:42:25.004 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-06-02T04:42:25.004 INFO:journalctl@ceph.mon.a.smithi076.stdout: ** DB Stats ** 2024-06-02T04:42:25.004 INFO:journalctl@ceph.mon.a.smithi076.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-06-02T04:42:25.004 INFO:journalctl@ceph.mon.a.smithi076.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-06-02T04:42:25.005 INFO:journalctl@ceph.mon.a.smithi076.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-06-02T04:42:25.005 INFO:journalctl@ceph.mon.a.smithi076.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-06-02T04:42:25.005 INFO:journalctl@ceph.mon.a.smithi076.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-06-02T04:42:25.005 INFO:journalctl@ceph.mon.a.smithi076.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-06-02T04:42:25.005 INFO:journalctl@ceph.mon.a.smithi076.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-06-02T04:42:25.005 INFO:journalctl@ceph.mon.a.smithi076.stdout: 2024-06-02T04:42:25.005 INFO:journalctl@ceph.mon.a.smithi076.stdout: ** Compaction Stats [default] ** 2024-06-02T04:42:25.005 INFO:journalctl@ceph.mon.a.smithi076.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-06-02T04:42:25.005 INFO:journalctl@ceph.mon.a.smithi076.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-06-02T04:42:25.005 INFO:journalctl@ceph.mon.a.smithi076.stdout: L0 2/0 91.61 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 105.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-06-02T04:42:25.005 INFO:journalctl@ceph.mon.a.smithi076.stdout: Sum 2/0 91.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 105.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-06-02T04:42:25.005 INFO:journalctl@ceph.mon.a.smithi076.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 105.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-06-02T04:42:25.005 INFO:journalctl@ceph.mon.a.smithi076.stdout: 2024-06-02T04:42:25.006 INFO:journalctl@ceph.mon.a.smithi076.stdout: ** Compaction Stats [default] ** 2024-06-02T04:42:25.006 INFO:journalctl@ceph.mon.a.smithi076.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-06-02T04:42:25.006 INFO:journalctl@ceph.mon.a.smithi076.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-06-02T04:42:25.006 INFO:journalctl@ceph.mon.a.smithi076.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 105.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-06-02T04:42:25.006 INFO:journalctl@ceph.mon.a.smithi076.stdout: 2024-06-02T04:42:25.006 INFO:journalctl@ceph.mon.a.smithi076.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-06-02T04:42:25.006 INFO:journalctl@ceph.mon.a.smithi076.stdout: 2024-06-02T04:42:25.006 INFO:journalctl@ceph.mon.a.smithi076.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-06-02T04:42:25.006 INFO:journalctl@ceph.mon.a.smithi076.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-06-02T04:42:25.006 INFO:journalctl@ceph.mon.a.smithi076.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-06-02T04:42:25.006 INFO:journalctl@ceph.mon.a.smithi076.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-06-02T04:42:25.006 INFO:journalctl@ceph.mon.a.smithi076.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-06-02T04:42:25.006 INFO:journalctl@ceph.mon.a.smithi076.stdout: AddFile(Keys): cumulative 0, interval 0 2024-06-02T04:42:25.006 INFO:journalctl@ceph.mon.a.smithi076.stdout: Cumulative compaction: 0.00 GB write, 22.19 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-06-02T04:42:25.007 INFO:journalctl@ceph.mon.a.smithi076.stdout: Interval compaction: 0.00 GB write, 22.19 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-06-02T04:42:25.007 INFO:journalctl@ceph.mon.a.smithi076.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-06-02T04:42:25.007 INFO:journalctl@ceph.mon.a.smithi076.stdout: Block cache BinnedLRUCache@0x5610ab6391f0#7 capacity: 512.00 MB usage: 1.33 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-06-02T04:42:25.007 INFO:journalctl@ceph.mon.a.smithi076.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.89 KB,0.000169873%) IndexBlock(2,0.44 KB,8.34465e-05%) Misc(1,0.00 KB,0%) 2024-06-02T04:42:25.007 INFO:journalctl@ceph.mon.a.smithi076.stdout: 2024-06-02T04:42:25.007 INFO:journalctl@ceph.mon.a.smithi076.stdout: ** File Read Latency Histogram By Level [default] ** 2024-06-02T04:42:25.007 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: starting mon.a rank 0 at public addrs [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] at bind addrs [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 60ab6d30-209a-11ef-bc9b-c7b262605968 2024-06-02T04:42:25.007 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: mon.a@-1(???) e1 preinit fsid 60ab6d30-209a-11ef-bc9b-c7b262605968 2024-06-02T04:42:25.007 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: mon.a@-1(???).mds e1 new map 2024-06-02T04:42:25.007 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: mon.a@-1(???).mds e1 print_map 2024-06-02T04:42:25.007 INFO:journalctl@ceph.mon.a.smithi076.stdout: e1 2024-06-02T04:42:25.007 INFO:journalctl@ceph.mon.a.smithi076.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-06-02T04:42:25.007 INFO:journalctl@ceph.mon.a.smithi076.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-06-02T04:42:25.008 INFO:journalctl@ceph.mon.a.smithi076.stdout: legacy client fscid: -1 2024-06-02T04:42:25.008 INFO:journalctl@ceph.mon.a.smithi076.stdout: 2024-06-02T04:42:25.008 INFO:journalctl@ceph.mon.a.smithi076.stdout: No filesystems configured 2024-06-02T04:42:25.008 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-06-02T04:42:25.008 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-06-02T04:42:25.008 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-06-02T04:42:25.008 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-06-02T04:42:25.008 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-06-02T04:42:25.008 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: mon.a is new leader, mons a in quorum (ranks 0) 2024-06-02T04:42:25.008 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: monmap e1: 1 mons at {a=[v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-06-02T04:42:25.008 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: fsmap 2024-06-02T04:42:25.008 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: osdmap e1: 0 total, 0 up, 0 in 2024-06-02T04:42:25.008 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:24 smithi076 ceph-mon[42935]: mgrmap e1: no daemons active 2024-06-02T04:42:25.523 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:25.046+0000 7f534d8d1700 1 Processor -- start 2024-06-02T04:42:25.524 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:25.046+0000 7f534d8d1700 1 -- start start 2024-06-02T04:42:25.524 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:25.046+0000 7f534d8d1700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5348106fb0 0x7f53481093a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:42:25.524 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:25.046+0000 7f534d8d1700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5348079e50 con 0x7f5348106fb0 2024-06-02T04:42:25.524 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:25.046+0000 7f5346ffd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5348106fb0 0x7f53481093a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:42:25.524 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:25.046+0000 7f5346ffd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5348106fb0 0x7f53481093a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:35182/0 (socket says 172.21.15.76:35182) 2024-06-02T04:42:25.524 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:25.046+0000 7f5346ffd700 1 -- 172.21.15.76:0/3082567735 learned_addr learned my addr 172.21.15.76:0/3082567735 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:42:25.524 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:25.047+0000 7f5346ffd700 1 -- 172.21.15.76:0/3082567735 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53481098e0 con 0x7f5348106fb0 2024-06-02T04:42:25.524 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:25.047+0000 7f5346ffd700 1 --2- 172.21.15.76:0/3082567735 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5348106fb0 0x7f53481093a0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f53380098a0 tx=0x7f5338009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5e340585da0aad8 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:42:25.524 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:25.047+0000 7f5345ffb700 1 -- 172.21.15.76:0/3082567735 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5338004160 con 0x7f5348106fb0 2024-06-02T04:42:25.524 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:25.047+0000 7f5345ffb700 1 -- 172.21.15.76:0/3082567735 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f53380042c0 con 0x7f5348106fb0 2024-06-02T04:42:25.525 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:25.047+0000 7f5345ffb700 1 -- 172.21.15.76:0/3082567735 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5338011940 con 0x7f5348106fb0 2024-06-02T04:42:25.525 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:25.048+0000 7f534d8d1700 1 -- 172.21.15.76:0/3082567735 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5348106fb0 msgr2=0x7f53481093a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:42:25.525 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:25.048+0000 7f534d8d1700 1 --2- 172.21.15.76:0/3082567735 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5348106fb0 0x7f53481093a0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f53380098a0 tx=0x7f5338009bb0 comp rx=0 tx=0).stop 2024-06-02T04:42:25.525 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:25.048+0000 7f534d8d1700 1 -- 172.21.15.76:0/3082567735 shutdown_connections 2024-06-02T04:42:25.525 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:25.048+0000 7f534d8d1700 1 --2- 172.21.15.76:0/3082567735 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5348106fb0 0x7f53481093a0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:42:25.525 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:25.048+0000 7f534d8d1700 1 -- 172.21.15.76:0/3082567735 >> 172.21.15.76:0/3082567735 conn(0x7f5348100980 msgr2=0x7f5348102da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:42:25.525 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:25.048+0000 7f534d8d1700 1 -- 172.21.15.76:0/3082567735 shutdown_connections 2024-06-02T04:42:25.525 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:25.048+0000 7f534d8d1700 1 -- 172.21.15.76:0/3082567735 wait complete. 2024-06-02T04:42:25.525 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:25.048+0000 7f534d8d1700 1 Processor -- start 2024-06-02T04:42:25.525 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:25.049+0000 7f534d8d1700 1 -- start start 2024-06-02T04:42:25.525 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:25.049+0000 7f534d8d1700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5348106fb0 0x7f534819a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:42:25.525 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:25.049+0000 7f534d8d1700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f534819a660 con 0x7f5348106fb0 2024-06-02T04:42:25.525 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:25.049+0000 7f5346ffd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5348106fb0 0x7f534819a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:42:25.525 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:25.049+0000 7f5346ffd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5348106fb0 0x7f534819a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:35192/0 (socket says 172.21.15.76:35192) 2024-06-02T04:42:25.526 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:25.049+0000 7f5346ffd700 1 -- 172.21.15.76:0/1224640164 learned_addr learned my addr 172.21.15.76:0/1224640164 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:42:25.526 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:25.049+0000 7f5346ffd700 1 -- 172.21.15.76:0/1224640164 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5338009550 con 0x7f5348106fb0 2024-06-02T04:42:25.526 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:25.049+0000 7f5346ffd700 1 --2- 172.21.15.76:0/1224640164 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5348106fb0 0x7f534819a120 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f5338006af0 tx=0x7f5338011a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:42:25.526 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:25.049+0000 7f534c8cf700 1 -- 172.21.15.76:0/1224640164 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5338003bf0 con 0x7f5348106fb0 2024-06-02T04:42:25.526 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:25.049+0000 7f534c8cf700 1 -- 172.21.15.76:0/1224640164 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f533801b8b0 con 0x7f5348106fb0 2024-06-02T04:42:25.526 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:25.049+0000 7f534d8d1700 1 -- 172.21.15.76:0/1224640164 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f534819a860 con 0x7f5348106fb0 2024-06-02T04:42:25.526 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:25.049+0000 7f534c8cf700 1 -- 172.21.15.76:0/1224640164 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5338023800 con 0x7f5348106fb0 2024-06-02T04:42:25.526 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:25.049+0000 7f534d8d1700 1 -- 172.21.15.76:0/1224640164 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f534819ad00 con 0x7f5348106fb0 2024-06-02T04:42:25.526 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:25.050+0000 7f534c8cf700 1 -- 172.21.15.76:0/1224640164 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f5338023c60 con 0x7f5348106fb0 2024-06-02T04:42:25.526 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:25.050+0000 7f534c8cf700 1 -- 172.21.15.76:0/1224640164 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f5338019710 con 0x7f5348106fb0 2024-06-02T04:42:25.526 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:25.050+0000 7f534d8d1700 1 -- 172.21.15.76:0/1224640164 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f534810a5d0 con 0x7f5348106fb0 2024-06-02T04:42:25.526 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:25.053+0000 7f534c8cf700 1 -- 172.21.15.76:0/1224640164 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f533801bd70 con 0x7f5348106fb0 2024-06-02T04:42:25.526 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:25.120+0000 7f534d8d1700 1 -- 172.21.15.76:0/1224640164 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7f534819d590 con 0x7f5348106fb0 2024-06-02T04:42:25.527 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:25.125+0000 7f534c8cf700 1 -- 172.21.15.76:0/1224640164 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7f533801ba20 con 0x7f5348106fb0 2024-06-02T04:42:25.527 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:25.126+0000 7f534d8d1700 1 -- 172.21.15.76:0/1224640164 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5348106fb0 msgr2=0x7f534819a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:42:25.527 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:25.126+0000 7f534d8d1700 1 --2- 172.21.15.76:0/1224640164 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5348106fb0 0x7f534819a120 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f5338006af0 tx=0x7f5338011a50 comp rx=0 tx=0).stop 2024-06-02T04:42:25.527 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:25.126+0000 7f534d8d1700 1 -- 172.21.15.76:0/1224640164 shutdown_connections 2024-06-02T04:42:25.527 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:25.126+0000 7f534d8d1700 1 --2- 172.21.15.76:0/1224640164 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5348106fb0 0x7f534819a120 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:42:25.527 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:25.126+0000 7f534d8d1700 1 -- 172.21.15.76:0/1224640164 >> 172.21.15.76:0/1224640164 conn(0x7f5348100980 msgr2=0x7f5348101450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:42:25.527 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:25.126+0000 7f534d8d1700 1 -- 172.21.15.76:0/1224640164 shutdown_connections 2024-06-02T04:42:25.527 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:25.126+0000 7f534d8d1700 1 -- 172.21.15.76:0/1224640164 wait complete. 2024-06-02T04:42:25.527 INFO:teuthology.orchestra.run.smithi076.stdout:Wrote config to /etc/ceph/ceph.conf 2024-06-02T04:42:25.552 INFO:teuthology.orchestra.run.smithi076.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-06-02T04:42:25.552 INFO:teuthology.orchestra.run.smithi076.stdout:Creating mgr... 2024-06-02T04:42:25.553 INFO:teuthology.orchestra.run.smithi076.stdout:Verifying port 0.0.0.0:9283 ... 2024-06-02T04:42:25.553 INFO:teuthology.orchestra.run.smithi076.stdout:Verifying port 0.0.0.0:8765 ... 2024-06-02T04:42:25.764 INFO:teuthology.orchestra.run.smithi076.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-60ab6d30-209a-11ef-bc9b-c7b262605968@mgr.x 2024-06-02T04:42:25.765 INFO:teuthology.orchestra.run.smithi076.stdout:systemctl: stderr Failed to reset failed state of unit ceph-60ab6d30-209a-11ef-bc9b-c7b262605968@mgr.x.service: Unit ceph-60ab6d30-209a-11ef-bc9b-c7b262605968@mgr.x.service not loaded. 2024-06-02T04:42:25.859 INFO:teuthology.orchestra.run.smithi076.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-60ab6d30-209a-11ef-bc9b-c7b262605968.target.wants/ceph-60ab6d30-209a-11ef-bc9b-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-60ab6d30-209a-11ef-bc9b-c7b262605968@.service. 2024-06-02T04:42:26.125 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Jun 02 04:42:25 smithi076 systemd[1]: Starting Ceph mgr.x for 60ab6d30-209a-11ef-bc9b-c7b262605968... 2024-06-02T04:42:26.301 INFO:teuthology.orchestra.run.smithi076.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-06-02T04:42:26.302 INFO:teuthology.orchestra.run.smithi076.stdout:systemctl: stdout disabled 2024-06-02T04:42:26.309 INFO:teuthology.orchestra.run.smithi076.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-06-02T04:42:26.309 INFO:teuthology.orchestra.run.smithi076.stdout:systemctl: stdout inactive 2024-06-02T04:42:26.309 INFO:teuthology.orchestra.run.smithi076.stdout:firewalld.service is not enabled 2024-06-02T04:42:26.309 INFO:teuthology.orchestra.run.smithi076.stdout:Not possible to enable service . firewalld.service is not available 2024-06-02T04:42:26.317 INFO:teuthology.orchestra.run.smithi076.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-06-02T04:42:26.317 INFO:teuthology.orchestra.run.smithi076.stdout:systemctl: stdout disabled 2024-06-02T04:42:26.325 INFO:teuthology.orchestra.run.smithi076.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-06-02T04:42:26.325 INFO:teuthology.orchestra.run.smithi076.stdout:systemctl: stdout inactive 2024-06-02T04:42:26.325 INFO:teuthology.orchestra.run.smithi076.stdout:firewalld.service is not enabled 2024-06-02T04:42:26.325 INFO:teuthology.orchestra.run.smithi076.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-06-02T04:42:26.325 INFO:teuthology.orchestra.run.smithi076.stdout:Waiting for mgr to start... 2024-06-02T04:42:26.325 INFO:teuthology.orchestra.run.smithi076.stdout:Waiting for mgr... 2024-06-02T04:42:26.441 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:26 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/1224640164' entity='client.admin' 2024-06-02T04:42:26.441 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Jun 02 04:42:26 smithi076 bash[43169]: eea40d32d809baa8b44e15ad974fb137beeddffab0bb40069d78c1097713bc77 2024-06-02T04:42:26.442 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Jun 02 04:42:26 smithi076 systemd[1]: Started Ceph mgr.x for 60ab6d30-209a-11ef-bc9b-c7b262605968. 2024-06-02T04:42:26.974 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Jun 02 04:42:26 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-x[43184]: 2024-06-02T04:42:26.696+0000 7f5b6c895200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-06-02T04:42:26.974 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Jun 02 04:42:26 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-x[43184]: 2024-06-02T04:42:26.794+0000 7f5b6c895200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-06-02T04:42:26.974 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Jun 02 04:42:26 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-x[43184]: 2024-06-02T04:42:26.886+0000 7f5b6c895200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-06-02T04:42:26.974 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Jun 02 04:42:26 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-x[43184]: 2024-06-02T04:42:26.973+0000 7f5b6c895200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-06-02T04:42:27.174 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout 2024-06-02T04:42:27.176 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout { 2024-06-02T04:42:27.176 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "fsid": "60ab6d30-209a-11ef-bc9b-c7b262605968", 2024-06-02T04:42:27.176 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "health": { 2024-06-02T04:42:27.176 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-06-02T04:42:27.177 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-06-02T04:42:27.177 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-06-02T04:42:27.177 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout }, 2024-06-02T04:42:27.177 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-06-02T04:42:27.177 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-06-02T04:42:27.177 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout 0 2024-06-02T04:42:27.177 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout ], 2024-06-02T04:42:27.177 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-06-02T04:42:27.177 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "a" 2024-06-02T04:42:27.177 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout ], 2024-06-02T04:42:27.177 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-06-02T04:42:27.177 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "monmap": { 2024-06-02T04:42:27.177 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-02T04:42:27.177 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-06-02T04:42:27.178 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-06-02T04:42:27.178 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout }, 2024-06-02T04:42:27.178 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-06-02T04:42:27.178 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-02T04:42:27.178 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-06-02T04:42:27.178 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-06-02T04:42:27.178 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-06-02T04:42:27.185 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-06-02T04:42:27.185 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-06-02T04:42:27.186 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-06-02T04:42:27.186 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout }, 2024-06-02T04:42:27.186 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-06-02T04:42:27.186 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-06-02T04:42:27.186 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-06-02T04:42:27.186 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-06-02T04:42:27.186 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-06-02T04:42:27.186 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-06-02T04:42:27.186 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-06-02T04:42:27.186 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-06-02T04:42:27.186 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-06-02T04:42:27.186 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout }, 2024-06-02T04:42:27.186 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-06-02T04:42:27.187 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-02T04:42:27.187 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-06-02T04:42:27.187 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-06-02T04:42:27.187 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout }, 2024-06-02T04:42:27.187 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-06-02T04:42:27.187 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "available": false, 2024-06-02T04:42:27.187 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-06-02T04:42:27.187 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "modules": [ 2024-06-02T04:42:27.187 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "iostat", 2024-06-02T04:42:27.187 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "nfs", 2024-06-02T04:42:27.187 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "restful" 2024-06-02T04:42:27.187 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout ], 2024-06-02T04:42:27.187 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "services": {} 2024-06-02T04:42:27.187 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout }, 2024-06-02T04:42:27.188 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-06-02T04:42:27.188 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-02T04:42:27.188 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "modified": "2024-06-02T04:42:21.007776+0000", 2024-06-02T04:42:27.188 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "services": {} 2024-06-02T04:42:27.188 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout }, 2024-06-02T04:42:27.188 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-06-02T04:42:27.188 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout } 2024-06-02T04:42:27.188 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:26.711+0000 7fdd0bc4b700 1 Processor -- start 2024-06-02T04:42:27.188 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:26.711+0000 7fdd0bc4b700 1 -- start start 2024-06-02T04:42:27.188 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:26.711+0000 7fdd0bc4b700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdd04106fd0 0x7fdd041093c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:42:27.188 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:26.711+0000 7fdd0bc4b700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd04079e50 con 0x7fdd04106fd0 2024-06-02T04:42:27.188 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:26.712+0000 7fdd099e7700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdd04106fd0 0x7fdd041093c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:42:27.188 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:26.712+0000 7fdd099e7700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdd04106fd0 0x7fdd041093c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:35220/0 (socket says 172.21.15.76:35220) 2024-06-02T04:42:27.188 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:26.712+0000 7fdd099e7700 1 -- 172.21.15.76:0/2470463050 learned_addr learned my addr 172.21.15.76:0/2470463050 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:42:27.189 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:26.712+0000 7fdd099e7700 1 -- 172.21.15.76:0/2470463050 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd04109900 con 0x7fdd04106fd0 2024-06-02T04:42:27.189 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:26.712+0000 7fdd099e7700 1 --2- 172.21.15.76:0/2470463050 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdd04106fd0 0x7fdd041093c0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fdd000098a0 tx=0x7fdd00009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97c31cef363752f2 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:42:27.189 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:26.712+0000 7fdd089e5700 1 -- 172.21.15.76:0/2470463050 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdd00004160 con 0x7fdd04106fd0 2024-06-02T04:42:27.189 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:26.712+0000 7fdd089e5700 1 -- 172.21.15.76:0/2470463050 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fdd000042c0 con 0x7fdd04106fd0 2024-06-02T04:42:27.189 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:26.712+0000 7fdd089e5700 1 -- 172.21.15.76:0/2470463050 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdd00011940 con 0x7fdd04106fd0 2024-06-02T04:42:27.189 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:26.713+0000 7fdd0bc4b700 1 -- 172.21.15.76:0/2470463050 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdd04106fd0 msgr2=0x7fdd041093c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:42:27.189 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:26.713+0000 7fdd0bc4b700 1 --2- 172.21.15.76:0/2470463050 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdd04106fd0 0x7fdd041093c0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fdd000098a0 tx=0x7fdd00009bb0 comp rx=0 tx=0).stop 2024-06-02T04:42:27.189 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:26.713+0000 7fdd0bc4b700 1 -- 172.21.15.76:0/2470463050 shutdown_connections 2024-06-02T04:42:27.189 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:26.713+0000 7fdd0bc4b700 1 --2- 172.21.15.76:0/2470463050 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdd04106fd0 0x7fdd041093c0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:42:27.189 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:26.713+0000 7fdd0bc4b700 1 -- 172.21.15.76:0/2470463050 >> 172.21.15.76:0/2470463050 conn(0x7fdd041009c0 msgr2=0x7fdd04102de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:42:27.189 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:26.713+0000 7fdd0bc4b700 1 -- 172.21.15.76:0/2470463050 shutdown_connections 2024-06-02T04:42:27.189 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:26.713+0000 7fdd0bc4b700 1 -- 172.21.15.76:0/2470463050 wait complete. 2024-06-02T04:42:27.189 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:26.714+0000 7fdd0bc4b700 1 Processor -- start 2024-06-02T04:42:27.189 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:26.714+0000 7fdd0bc4b700 1 -- start start 2024-06-02T04:42:27.190 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:26.714+0000 7fdd0bc4b700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdd04106fd0 0x7fdd0419a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:42:27.190 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:26.714+0000 7fdd0bc4b700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd0419a670 con 0x7fdd04106fd0 2024-06-02T04:42:27.190 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:26.715+0000 7fdd099e7700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdd04106fd0 0x7fdd0419a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:42:27.190 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:26.715+0000 7fdd099e7700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdd04106fd0 0x7fdd0419a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:35224/0 (socket says 172.21.15.76:35224) 2024-06-02T04:42:27.190 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:26.715+0000 7fdd099e7700 1 -- 172.21.15.76:0/2180133532 learned_addr learned my addr 172.21.15.76:0/2180133532 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:42:27.190 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:26.715+0000 7fdd099e7700 1 -- 172.21.15.76:0/2180133532 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd00009550 con 0x7fdd04106fd0 2024-06-02T04:42:27.190 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:26.715+0000 7fdd099e7700 1 --2- 172.21.15.76:0/2180133532 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdd04106fd0 0x7fdd0419a130 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fdd00006af0 tx=0x7fdd00011a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:42:27.190 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:26.715+0000 7fdcfaffd700 1 -- 172.21.15.76:0/2180133532 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdd00003bf0 con 0x7fdd04106fd0 2024-06-02T04:42:27.190 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:26.715+0000 7fdcfaffd700 1 -- 172.21.15.76:0/2180133532 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fdd0001b8b0 con 0x7fdd04106fd0 2024-06-02T04:42:27.190 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:26.715+0000 7fdcfaffd700 1 -- 172.21.15.76:0/2180133532 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdd00023800 con 0x7fdd04106fd0 2024-06-02T04:42:27.190 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:26.715+0000 7fdd0bc4b700 1 -- 172.21.15.76:0/2180133532 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd0419a870 con 0x7fdd04106fd0 2024-06-02T04:42:27.190 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:26.715+0000 7fdd0bc4b700 1 -- 172.21.15.76:0/2180133532 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd0419ad10 con 0x7fdd04106fd0 2024-06-02T04:42:27.190 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:26.715+0000 7fdcfaffd700 1 -- 172.21.15.76:0/2180133532 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fdd00023c60 con 0x7fdd04106fd0 2024-06-02T04:42:27.191 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:26.715+0000 7fdcfaffd700 1 -- 172.21.15.76:0/2180133532 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fdd00019710 con 0x7fdd04106fd0 2024-06-02T04:42:27.191 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:26.716+0000 7fdd0bc4b700 1 -- 172.21.15.76:0/2180133532 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd0410a5f0 con 0x7fdd04106fd0 2024-06-02T04:42:27.191 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:26.718+0000 7fdcfaffd700 1 -- 172.21.15.76:0/2180133532 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7fdd0001bd70 con 0x7fdd04106fd0 2024-06-02T04:42:27.191 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:26.790+0000 7fdd0bc4b700 1 -- 172.21.15.76:0/2180133532 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fdd0410a7b0 con 0x7fdd04106fd0 2024-06-02T04:42:27.191 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:26.791+0000 7fdcfaffd700 1 -- 172.21.15.76:0/2180133532 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7fdd0001ba20 con 0x7fdd04106fd0 2024-06-02T04:42:27.191 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:26.791+0000 7fdd0bc4b700 1 -- 172.21.15.76:0/2180133532 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdd04106fd0 msgr2=0x7fdd0419a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:42:27.191 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:26.791+0000 7fdd0bc4b700 1 --2- 172.21.15.76:0/2180133532 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdd04106fd0 0x7fdd0419a130 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fdd00006af0 tx=0x7fdd00011a50 comp rx=0 tx=0).stop 2024-06-02T04:42:27.191 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:26.791+0000 7fdd0bc4b700 1 -- 172.21.15.76:0/2180133532 shutdown_connections 2024-06-02T04:42:27.191 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:26.791+0000 7fdd0bc4b700 1 --2- 172.21.15.76:0/2180133532 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdd04106fd0 0x7fdd0419a130 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:42:27.191 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:26.791+0000 7fdd0bc4b700 1 -- 172.21.15.76:0/2180133532 >> 172.21.15.76:0/2180133532 conn(0x7fdd041009c0 msgr2=0x7fdd04101490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:42:27.191 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:26.792+0000 7fdd0bc4b700 1 -- 172.21.15.76:0/2180133532 shutdown_connections 2024-06-02T04:42:27.191 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:26.792+0000 7fdd0bc4b700 1 -- 172.21.15.76:0/2180133532 wait complete. 2024-06-02T04:42:27.191 INFO:teuthology.orchestra.run.smithi076.stdout:mgr not available, waiting (1/15)... 2024-06-02T04:42:27.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:27 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/2180133532' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-06-02T04:42:27.871 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Jun 02 04:42:27 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-x[43184]: 2024-06-02T04:42:27.620+0000 7f5b6c895200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-06-02T04:42:28.221 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Jun 02 04:42:27 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-x[43184]: 2024-06-02T04:42:27.871+0000 7f5b6c895200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-06-02T04:42:28.221 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Jun 02 04:42:27 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-x[43184]: 2024-06-02T04:42:27.956+0000 7f5b6c895200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-06-02T04:42:28.221 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Jun 02 04:42:28 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-x[43184]: 2024-06-02T04:42:28.065+0000 7f5b6c895200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-06-02T04:42:28.221 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Jun 02 04:42:28 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-x[43184]: 2024-06-02T04:42:28.221+0000 7f5b6c895200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-06-02T04:42:28.483 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Jun 02 04:42:28 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-x[43184]: 2024-06-02T04:42:28.348+0000 7f5b6c895200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-06-02T04:42:28.483 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Jun 02 04:42:28 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-x[43184]: 2024-06-02T04:42:28.432+0000 7f5b6c895200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-06-02T04:42:29.205 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Jun 02 04:42:28 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-x[43184]: 2024-06-02T04:42:28.820+0000 7f5b6c895200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-06-02T04:42:29.483 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Jun 02 04:42:29 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-x[43184]: 2024-06-02T04:42:29.205+0000 7f5b6c895200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-06-02T04:42:29.484 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Jun 02 04:42:29 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-x[43184]: 2024-06-02T04:42:29.411+0000 7f5b6c895200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-06-02T04:42:29.765 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Jun 02 04:42:29 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-x[43184]: 2024-06-02T04:42:29.507+0000 7f5b6c895200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-06-02T04:42:30.083 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout 2024-06-02T04:42:30.083 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout { 2024-06-02T04:42:30.083 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "fsid": "60ab6d30-209a-11ef-bc9b-c7b262605968", 2024-06-02T04:42:30.083 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "health": { 2024-06-02T04:42:30.083 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-06-02T04:42:30.083 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-06-02T04:42:30.083 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-06-02T04:42:30.083 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout }, 2024-06-02T04:42:30.084 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-06-02T04:42:30.084 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-06-02T04:42:30.084 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout 0 2024-06-02T04:42:30.084 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout ], 2024-06-02T04:42:30.084 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-06-02T04:42:30.084 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "a" 2024-06-02T04:42:30.084 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout ], 2024-06-02T04:42:30.085 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-06-02T04:42:30.085 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "monmap": { 2024-06-02T04:42:30.085 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-02T04:42:30.085 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-06-02T04:42:30.085 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-06-02T04:42:30.085 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout }, 2024-06-02T04:42:30.085 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-06-02T04:42:30.085 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-02T04:42:30.086 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-06-02T04:42:30.086 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-06-02T04:42:30.086 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-06-02T04:42:30.086 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-06-02T04:42:30.086 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-06-02T04:42:30.086 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-06-02T04:42:30.086 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout }, 2024-06-02T04:42:30.086 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-06-02T04:42:30.087 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-06-02T04:42:30.087 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-06-02T04:42:30.087 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-06-02T04:42:30.087 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-06-02T04:42:30.087 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-06-02T04:42:30.087 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-06-02T04:42:30.087 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-06-02T04:42:30.087 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-06-02T04:42:30.088 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout }, 2024-06-02T04:42:30.088 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-06-02T04:42:30.088 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-02T04:42:30.088 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-06-02T04:42:30.088 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-06-02T04:42:30.088 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout }, 2024-06-02T04:42:30.088 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-06-02T04:42:30.088 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "available": false, 2024-06-02T04:42:30.089 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-06-02T04:42:30.089 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "modules": [ 2024-06-02T04:42:30.089 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "iostat", 2024-06-02T04:42:30.089 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "nfs", 2024-06-02T04:42:30.089 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "restful" 2024-06-02T04:42:30.089 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout ], 2024-06-02T04:42:30.089 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "services": {} 2024-06-02T04:42:30.089 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout }, 2024-06-02T04:42:30.089 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-06-02T04:42:30.090 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-02T04:42:30.090 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "modified": "2024-06-02T04:42:21.007776+0000", 2024-06-02T04:42:30.090 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:29 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/613215025' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-06-02T04:42:30.098 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "services": {} 2024-06-02T04:42:30.098 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout }, 2024-06-02T04:42:30.098 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-06-02T04:42:30.098 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout } 2024-06-02T04:42:30.098 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:29.635+0000 7f0a2bfb1700 1 Processor -- start 2024-06-02T04:42:30.098 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:29.636+0000 7f0a2bfb1700 1 -- start start 2024-06-02T04:42:30.099 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:29.636+0000 7f0a2bfb1700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0a24104da0 0x7f0a241051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:42:30.099 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:29.636+0000 7f0a2bfb1700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a24079e70 con 0x7f0a24104da0 2024-06-02T04:42:30.099 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:29.636+0000 7f0a29d4d700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0a24104da0 0x7f0a241051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:42:30.099 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:29.636+0000 7f0a29d4d700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0a24104da0 0x7f0a241051c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:35230/0 (socket says 172.21.15.76:35230) 2024-06-02T04:42:30.099 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:29.636+0000 7f0a29d4d700 1 -- 172.21.15.76:0/3256514788 learned_addr learned my addr 172.21.15.76:0/3256514788 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:42:30.099 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:29.636+0000 7f0a29d4d700 1 -- 172.21.15.76:0/3256514788 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a24105700 con 0x7f0a24104da0 2024-06-02T04:42:30.099 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:29.636+0000 7f0a29d4d700 1 --2- 172.21.15.76:0/3256514788 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0a24104da0 0x7f0a241051c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0a180098a0 tx=0x7f0a18009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1140b8181ae9d249 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:42:30.099 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:29.637+0000 7f0a28d4b700 1 -- 172.21.15.76:0/3256514788 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0a18004160 con 0x7f0a24104da0 2024-06-02T04:42:30.100 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:29.637+0000 7f0a28d4b700 1 -- 172.21.15.76:0/3256514788 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f0a180042c0 con 0x7f0a24104da0 2024-06-02T04:42:30.100 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:29.637+0000 7f0a28d4b700 1 -- 172.21.15.76:0/3256514788 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0a18011940 con 0x7f0a24104da0 2024-06-02T04:42:30.100 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:29.637+0000 7f0a2bfb1700 1 -- 172.21.15.76:0/3256514788 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0a24104da0 msgr2=0x7f0a241051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:42:30.100 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:29.637+0000 7f0a2bfb1700 1 --2- 172.21.15.76:0/3256514788 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0a24104da0 0x7f0a241051c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0a180098a0 tx=0x7f0a18009bb0 comp rx=0 tx=0).stop 2024-06-02T04:42:30.100 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:29.637+0000 7f0a2bfb1700 1 -- 172.21.15.76:0/3256514788 shutdown_connections 2024-06-02T04:42:30.100 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:29.637+0000 7f0a2bfb1700 1 --2- 172.21.15.76:0/3256514788 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0a24104da0 0x7f0a241051c0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:42:30.100 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:29.637+0000 7f0a2bfb1700 1 -- 172.21.15.76:0/3256514788 >> 172.21.15.76:0/3256514788 conn(0x7f0a24100a00 msgr2=0x7f0a24102e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:42:30.100 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:29.637+0000 7f0a2bfb1700 1 -- 172.21.15.76:0/3256514788 shutdown_connections 2024-06-02T04:42:30.101 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:29.637+0000 7f0a2bfb1700 1 -- 172.21.15.76:0/3256514788 wait complete. 2024-06-02T04:42:30.101 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:29.638+0000 7f0a2bfb1700 1 Processor -- start 2024-06-02T04:42:30.101 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:29.638+0000 7f0a2bfb1700 1 -- start start 2024-06-02T04:42:30.101 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:29.638+0000 7f0a2bfb1700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0a24104da0 0x7f0a2419c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:42:30.101 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:29.638+0000 7f0a2bfb1700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a2419c8b0 con 0x7f0a24104da0 2024-06-02T04:42:30.101 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:29.638+0000 7f0a29d4d700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0a24104da0 0x7f0a2419c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:42:30.101 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:29.638+0000 7f0a29d4d700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0a24104da0 0x7f0a2419c370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:35240/0 (socket says 172.21.15.76:35240) 2024-06-02T04:42:30.101 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:29.638+0000 7f0a29d4d700 1 -- 172.21.15.76:0/613215025 learned_addr learned my addr 172.21.15.76:0/613215025 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:42:30.102 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:29.638+0000 7f0a29d4d700 1 -- 172.21.15.76:0/613215025 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a18009550 con 0x7f0a24104da0 2024-06-02T04:42:30.102 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:29.639+0000 7f0a29d4d700 1 --2- 172.21.15.76:0/613215025 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0a24104da0 0x7f0a2419c370 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0a18003f20 tx=0x7f0a18011f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:42:30.102 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:29.639+0000 7f0a16ffd700 1 -- 172.21.15.76:0/613215025 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0a180037d0 con 0x7f0a24104da0 2024-06-02T04:42:30.102 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:29.639+0000 7f0a2bfb1700 1 -- 172.21.15.76:0/613215025 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a2419cab0 con 0x7f0a24104da0 2024-06-02T04:42:30.102 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:29.639+0000 7f0a16ffd700 1 -- 172.21.15.76:0/613215025 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f0a1801b440 con 0x7f0a24104da0 2024-06-02T04:42:30.102 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:29.639+0000 7f0a16ffd700 1 -- 172.21.15.76:0/613215025 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0a18023590 con 0x7f0a24104da0 2024-06-02T04:42:30.102 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:29.639+0000 7f0a2bfb1700 1 -- 172.21.15.76:0/613215025 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a2419cf50 con 0x7f0a24104da0 2024-06-02T04:42:30.103 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:29.640+0000 7f0a2bfb1700 1 -- 172.21.15.76:0/613215025 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a24196080 con 0x7f0a24104da0 2024-06-02T04:42:30.103 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:29.640+0000 7f0a16ffd700 1 -- 172.21.15.76:0/613215025 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f0a18023800 con 0x7f0a24104da0 2024-06-02T04:42:30.103 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:29.640+0000 7f0a16ffd700 1 -- 172.21.15.76:0/613215025 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f0a1802c950 con 0x7f0a24104da0 2024-06-02T04:42:30.103 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:29.642+0000 7f0a16ffd700 1 -- 172.21.15.76:0/613215025 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f0a1801b5b0 con 0x7f0a24104da0 2024-06-02T04:42:30.103 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:29.714+0000 7f0a2bfb1700 1 -- 172.21.15.76:0/613215025 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f0a24106780 con 0x7f0a24104da0 2024-06-02T04:42:30.103 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:29.714+0000 7f0a16ffd700 1 -- 172.21.15.76:0/613215025 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7f0a18006d80 con 0x7f0a24104da0 2024-06-02T04:42:30.103 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:29.715+0000 7f0a2bfb1700 1 -- 172.21.15.76:0/613215025 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0a24104da0 msgr2=0x7f0a2419c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:42:30.103 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:29.715+0000 7f0a2bfb1700 1 --2- 172.21.15.76:0/613215025 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0a24104da0 0x7f0a2419c370 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0a18003f20 tx=0x7f0a18011f00 comp rx=0 tx=0).stop 2024-06-02T04:42:30.104 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:29.715+0000 7f0a2bfb1700 1 -- 172.21.15.76:0/613215025 shutdown_connections 2024-06-02T04:42:30.104 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:29.715+0000 7f0a2bfb1700 1 --2- 172.21.15.76:0/613215025 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0a24104da0 0x7f0a2419c370 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:42:30.104 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:29.715+0000 7f0a2bfb1700 1 -- 172.21.15.76:0/613215025 >> 172.21.15.76:0/613215025 conn(0x7f0a24100a00 msgr2=0x7f0a241931c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:42:30.104 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:29.715+0000 7f0a2bfb1700 1 -- 172.21.15.76:0/613215025 shutdown_connections 2024-06-02T04:42:30.104 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:29.715+0000 7f0a2bfb1700 1 -- 172.21.15.76:0/613215025 wait complete. 2024-06-02T04:42:30.104 INFO:teuthology.orchestra.run.smithi076.stdout:mgr not available, waiting (2/15)... 2024-06-02T04:42:30.389 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Jun 02 04:42:30 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-x[43184]: 2024-06-02T04:42:30.293+0000 7f5b6c895200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-06-02T04:42:30.733 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Jun 02 04:42:30 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-x[43184]: 2024-06-02T04:42:30.388+0000 7f5b6c895200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-06-02T04:42:30.733 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Jun 02 04:42:30 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-x[43184]: 2024-06-02T04:42:30.535+0000 7f5b6c895200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-06-02T04:42:31.483 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Jun 02 04:42:31 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-x[43184]: 2024-06-02T04:42:31.161+0000 7f5b6c895200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-06-02T04:42:31.483 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Jun 02 04:42:31 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-x[43184]: 2024-06-02T04:42:31.341+0000 7f5b6c895200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-06-02T04:42:31.983 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Jun 02 04:42:31 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-x[43184]: 2024-06-02T04:42:31.533+0000 7f5b6c895200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-06-02T04:42:32.801 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:32 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/1005082286' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-06-02T04:42:32.802 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Jun 02 04:42:32 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-x[43184]: 2024-06-02T04:42:32.506+0000 7f5b6c895200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-06-02T04:42:32.802 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Jun 02 04:42:32 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-x[43184]: 2024-06-02T04:42:32.801+0000 7f5b6c895200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-06-02T04:42:32.917 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout 2024-06-02T04:42:32.917 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout { 2024-06-02T04:42:32.917 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "fsid": "60ab6d30-209a-11ef-bc9b-c7b262605968", 2024-06-02T04:42:32.917 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "health": { 2024-06-02T04:42:32.917 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-06-02T04:42:32.918 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-06-02T04:42:32.918 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-06-02T04:42:32.918 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout }, 2024-06-02T04:42:32.918 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-06-02T04:42:32.918 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-06-02T04:42:32.918 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout 0 2024-06-02T04:42:32.918 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout ], 2024-06-02T04:42:32.918 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-06-02T04:42:32.918 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "a" 2024-06-02T04:42:32.918 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout ], 2024-06-02T04:42:32.918 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "quorum_age": 7, 2024-06-02T04:42:32.919 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "monmap": { 2024-06-02T04:42:32.919 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-02T04:42:32.919 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-06-02T04:42:32.919 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-06-02T04:42:32.919 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout }, 2024-06-02T04:42:32.919 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-06-02T04:42:32.919 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-02T04:42:32.919 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-06-02T04:42:32.919 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-06-02T04:42:32.919 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-06-02T04:42:32.919 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-06-02T04:42:32.919 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-06-02T04:42:32.920 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-06-02T04:42:32.920 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout }, 2024-06-02T04:42:32.920 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-06-02T04:42:32.920 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-06-02T04:42:32.920 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-06-02T04:42:32.920 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-06-02T04:42:32.920 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-06-02T04:42:32.920 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-06-02T04:42:32.920 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-06-02T04:42:32.920 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-06-02T04:42:32.920 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-06-02T04:42:32.921 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout }, 2024-06-02T04:42:32.921 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-06-02T04:42:32.921 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-02T04:42:32.921 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-06-02T04:42:32.921 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-06-02T04:42:32.921 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout }, 2024-06-02T04:42:32.921 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-06-02T04:42:32.921 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "available": false, 2024-06-02T04:42:32.921 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-06-02T04:42:32.921 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "modules": [ 2024-06-02T04:42:32.921 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "iostat", 2024-06-02T04:42:32.921 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "nfs", 2024-06-02T04:42:32.922 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "restful" 2024-06-02T04:42:32.922 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout ], 2024-06-02T04:42:32.922 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "services": {} 2024-06-02T04:42:32.922 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout }, 2024-06-02T04:42:32.922 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-06-02T04:42:32.922 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-02T04:42:32.922 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "modified": "2024-06-02T04:42:21.007776+0000", 2024-06-02T04:42:32.922 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "services": {} 2024-06-02T04:42:32.922 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout }, 2024-06-02T04:42:32.922 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-06-02T04:42:32.922 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout } 2024-06-02T04:42:32.923 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:32.468+0000 7fecfad99700 1 Processor -- start 2024-06-02T04:42:32.923 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:32.468+0000 7fecfad99700 1 -- start start 2024-06-02T04:42:32.923 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:32.468+0000 7fecfad99700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fecf4106f90 0x7fecf4109380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:42:32.923 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:32.468+0000 7fecfad99700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecf4079e90 con 0x7fecf4106f90 2024-06-02T04:42:32.923 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:32.468+0000 7fecf8b35700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fecf4106f90 0x7fecf4109380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:42:32.923 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:32.468+0000 7fecf8b35700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fecf4106f90 0x7fecf4109380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:38538/0 (socket says 172.21.15.76:38538) 2024-06-02T04:42:32.923 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:32.468+0000 7fecf8b35700 1 -- 172.21.15.76:0/3726786175 learned_addr learned my addr 172.21.15.76:0/3726786175 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:42:32.923 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:32.469+0000 7fecf8b35700 1 -- 172.21.15.76:0/3726786175 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecf41098c0 con 0x7fecf4106f90 2024-06-02T04:42:32.923 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:32.469+0000 7fecf8b35700 1 --2- 172.21.15.76:0/3726786175 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fecf4106f90 0x7fecf4109380 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fece80098a0 tx=0x7fece8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9f820ffbaa1633 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:42:32.923 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:32.469+0000 7fecf37fe700 1 -- 172.21.15.76:0/3726786175 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fece8004160 con 0x7fecf4106f90 2024-06-02T04:42:32.923 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:32.469+0000 7fecf37fe700 1 -- 172.21.15.76:0/3726786175 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fece80042c0 con 0x7fecf4106f90 2024-06-02T04:42:32.924 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:32.469+0000 7fecf37fe700 1 -- 172.21.15.76:0/3726786175 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fece8011940 con 0x7fecf4106f90 2024-06-02T04:42:32.924 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:32.470+0000 7fecfad99700 1 -- 172.21.15.76:0/3726786175 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fecf4106f90 msgr2=0x7fecf4109380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:42:32.924 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:32.470+0000 7fecfad99700 1 --2- 172.21.15.76:0/3726786175 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fecf4106f90 0x7fecf4109380 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fece80098a0 tx=0x7fece8009bb0 comp rx=0 tx=0).stop 2024-06-02T04:42:32.924 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:32.470+0000 7fecfad99700 1 -- 172.21.15.76:0/3726786175 shutdown_connections 2024-06-02T04:42:32.924 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:32.470+0000 7fecfad99700 1 --2- 172.21.15.76:0/3726786175 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fecf4106f90 0x7fecf4109380 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:42:32.924 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:32.470+0000 7fecfad99700 1 -- 172.21.15.76:0/3726786175 >> 172.21.15.76:0/3726786175 conn(0x7fecf41009c0 msgr2=0x7fecf4102de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:42:32.924 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:32.470+0000 7fecfad99700 1 -- 172.21.15.76:0/3726786175 shutdown_connections 2024-06-02T04:42:32.924 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:32.470+0000 7fecfad99700 1 -- 172.21.15.76:0/3726786175 wait complete. 2024-06-02T04:42:32.924 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:32.470+0000 7fecfad99700 1 Processor -- start 2024-06-02T04:42:32.924 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:32.470+0000 7fecfad99700 1 -- start start 2024-06-02T04:42:32.924 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:32.470+0000 7fecfad99700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fecf4106f90 0x7fecf41067c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:42:32.924 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:32.470+0000 7fecfad99700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecf4106d00 con 0x7fecf4106f90 2024-06-02T04:42:32.925 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:32.471+0000 7fecf8b35700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fecf4106f90 0x7fecf41067c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:42:32.925 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:32.471+0000 7fecf8b35700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fecf4106f90 0x7fecf41067c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:38550/0 (socket says 172.21.15.76:38550) 2024-06-02T04:42:32.925 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:32.471+0000 7fecf8b35700 1 -- 172.21.15.76:0/1005082286 learned_addr learned my addr 172.21.15.76:0/1005082286 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:42:32.925 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:32.471+0000 7fecf8b35700 1 -- 172.21.15.76:0/1005082286 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fece8009550 con 0x7fecf4106f90 2024-06-02T04:42:32.925 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:32.471+0000 7fecf8b35700 1 --2- 172.21.15.76:0/1005082286 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fecf4106f90 0x7fecf41067c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fece8003f20 tx=0x7fece8011f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:42:32.925 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:32.471+0000 7fecf1ffb700 1 -- 172.21.15.76:0/1005082286 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fece80037d0 con 0x7fecf4106f90 2024-06-02T04:42:32.925 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:32.471+0000 7fecf1ffb700 1 -- 172.21.15.76:0/1005082286 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fece801b440 con 0x7fecf4106f90 2024-06-02T04:42:32.925 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:32.471+0000 7fecfad99700 1 -- 172.21.15.76:0/1005082286 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecf4104f40 con 0x7fecf4106f90 2024-06-02T04:42:32.925 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:32.471+0000 7fecf1ffb700 1 -- 172.21.15.76:0/1005082286 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fece8023590 con 0x7fecf4106f90 2024-06-02T04:42:32.925 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:32.471+0000 7fecfad99700 1 -- 172.21.15.76:0/1005082286 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecf41053e0 con 0x7fecf4106f90 2024-06-02T04:42:32.926 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:32.472+0000 7fecf1ffb700 1 -- 172.21.15.76:0/1005082286 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fece8023b00 con 0x7fecf4106f90 2024-06-02T04:42:32.926 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:32.472+0000 7fecf1ffb700 1 -- 172.21.15.76:0/1005082286 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fece802cdb0 con 0x7fecf4106f90 2024-06-02T04:42:32.926 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:32.473+0000 7fecfad99700 1 -- 172.21.15.76:0/1005082286 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecf410a600 con 0x7fecf4106f90 2024-06-02T04:42:32.926 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:32.475+0000 7fecf1ffb700 1 -- 172.21.15.76:0/1005082286 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7fece801b5b0 con 0x7fecf4106f90 2024-06-02T04:42:32.926 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:32.563+0000 7fecfad99700 1 -- 172.21.15.76:0/1005082286 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fecf410a7f0 con 0x7fecf4106f90 2024-06-02T04:42:32.926 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:32.564+0000 7fecf1ffb700 1 -- 172.21.15.76:0/1005082286 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7fece801b750 con 0x7fecf4106f90 2024-06-02T04:42:32.926 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:32.565+0000 7fecfad99700 1 -- 172.21.15.76:0/1005082286 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fecf4106f90 msgr2=0x7fecf41067c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:42:32.926 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:32.565+0000 7fecfad99700 1 --2- 172.21.15.76:0/1005082286 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fecf4106f90 0x7fecf41067c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fece8003f20 tx=0x7fece8011f00 comp rx=0 tx=0).stop 2024-06-02T04:42:32.926 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:32.565+0000 7fecfad99700 1 -- 172.21.15.76:0/1005082286 shutdown_connections 2024-06-02T04:42:32.926 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:32.565+0000 7fecfad99700 1 --2- 172.21.15.76:0/1005082286 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fecf4106f90 0x7fecf41067c0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:42:32.926 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:32.565+0000 7fecfad99700 1 -- 172.21.15.76:0/1005082286 >> 172.21.15.76:0/1005082286 conn(0x7fecf41009c0 msgr2=0x7fecf41014b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:42:32.926 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:32.565+0000 7fecfad99700 1 -- 172.21.15.76:0/1005082286 shutdown_connections 2024-06-02T04:42:32.927 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:32.565+0000 7fecfad99700 1 -- 172.21.15.76:0/1005082286 wait complete. 2024-06-02T04:42:32.927 INFO:teuthology.orchestra.run.smithi076.stdout:mgr not available, waiting (3/15)... 2024-06-02T04:42:33.086 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Jun 02 04:42:32 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-x[43184]: 2024-06-02T04:42:32.891+0000 7f5b6c895200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-06-02T04:42:33.483 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Jun 02 04:42:33 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-x[43184]: 2024-06-02T04:42:33.085+0000 7f5b6c895200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-06-02T04:42:33.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:33 smithi076 ceph-mon[42935]: Activating manager daemon x 2024-06-02T04:42:33.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:33 smithi076 ceph-mon[42935]: mgrmap e2: x(active, starting, since 0.00300089s) 2024-06-02T04:42:33.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:33 smithi076 ceph-mon[42935]: from='mgr.14100 172.21.15.76:0/2836076077' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-06-02T04:42:33.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:33 smithi076 ceph-mon[42935]: from='mgr.14100 172.21.15.76:0/2836076077' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-06-02T04:42:33.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:33 smithi076 ceph-mon[42935]: from='mgr.14100 172.21.15.76:0/2836076077' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-06-02T04:42:33.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:33 smithi076 ceph-mon[42935]: from='mgr.14100 172.21.15.76:0/2836076077' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-02T04:42:33.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:33 smithi076 ceph-mon[42935]: from='mgr.14100 172.21.15.76:0/2836076077' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-06-02T04:42:33.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:33 smithi076 ceph-mon[42935]: Manager daemon x is now available 2024-06-02T04:42:33.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:33 smithi076 ceph-mon[42935]: from='mgr.14100 172.21.15.76:0/2836076077' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-06-02T04:42:33.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:33 smithi076 ceph-mon[42935]: from='mgr.14100 172.21.15.76:0/2836076077' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-06-02T04:42:33.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:33 smithi076 ceph-mon[42935]: from='mgr.14100 172.21.15.76:0/2836076077' entity='mgr.x' 2024-06-02T04:42:33.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:33 smithi076 ceph-mon[42935]: from='mgr.14100 172.21.15.76:0/2836076077' entity='mgr.x' 2024-06-02T04:42:33.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:33 smithi076 ceph-mon[42935]: from='mgr.14100 172.21.15.76:0/2836076077' entity='mgr.x' 2024-06-02T04:42:35.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:35 smithi076 ceph-mon[42935]: mgrmap e3: x(active, since 1.00934s) 2024-06-02T04:42:36.425 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:36 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/553769912' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-06-02T04:42:36.474 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout 2024-06-02T04:42:36.474 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout { 2024-06-02T04:42:36.474 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "fsid": "60ab6d30-209a-11ef-bc9b-c7b262605968", 2024-06-02T04:42:36.475 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "health": { 2024-06-02T04:42:36.475 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-06-02T04:42:36.475 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-06-02T04:42:36.475 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-06-02T04:42:36.475 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout }, 2024-06-02T04:42:36.475 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-06-02T04:42:36.475 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-06-02T04:42:36.475 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout 0 2024-06-02T04:42:36.475 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout ], 2024-06-02T04:42:36.475 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-06-02T04:42:36.475 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "a" 2024-06-02T04:42:36.475 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout ], 2024-06-02T04:42:36.475 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "quorum_age": 11, 2024-06-02T04:42:36.476 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "monmap": { 2024-06-02T04:42:36.476 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-02T04:42:36.476 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-06-02T04:42:36.476 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-06-02T04:42:36.476 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout }, 2024-06-02T04:42:36.476 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-06-02T04:42:36.476 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-02T04:42:36.476 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-06-02T04:42:36.476 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-06-02T04:42:36.484 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-06-02T04:42:36.484 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-06-02T04:42:36.484 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-06-02T04:42:36.484 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-06-02T04:42:36.484 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout }, 2024-06-02T04:42:36.484 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-06-02T04:42:36.484 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-06-02T04:42:36.484 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-06-02T04:42:36.484 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-06-02T04:42:36.485 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-06-02T04:42:36.485 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-06-02T04:42:36.485 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-06-02T04:42:36.485 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-06-02T04:42:36.485 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-06-02T04:42:36.485 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout }, 2024-06-02T04:42:36.485 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-06-02T04:42:36.485 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-02T04:42:36.485 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-06-02T04:42:36.485 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-06-02T04:42:36.485 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout }, 2024-06-02T04:42:36.485 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-06-02T04:42:36.485 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "available": true, 2024-06-02T04:42:36.486 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-06-02T04:42:36.486 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "modules": [ 2024-06-02T04:42:36.486 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "iostat", 2024-06-02T04:42:36.486 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "nfs", 2024-06-02T04:42:36.486 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "restful" 2024-06-02T04:42:36.486 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout ], 2024-06-02T04:42:36.486 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "services": {} 2024-06-02T04:42:36.486 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout }, 2024-06-02T04:42:36.486 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-06-02T04:42:36.486 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-02T04:42:36.486 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "modified": "2024-06-02T04:42:21.007776+0000", 2024-06-02T04:42:36.486 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "services": {} 2024-06-02T04:42:36.486 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout }, 2024-06-02T04:42:36.487 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-06-02T04:42:36.487 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout } 2024-06-02T04:42:36.487 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:35.805+0000 7f5ddf8bf700 1 Processor -- start 2024-06-02T04:42:36.487 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:35.805+0000 7f5ddf8bf700 1 -- start start 2024-06-02T04:42:36.487 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:35.805+0000 7f5ddf8bf700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5dd81053e0 0x7f5dd8105800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:42:36.487 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:35.805+0000 7f5ddf8bf700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd8105dd0 con 0x7f5dd81053e0 2024-06-02T04:42:36.487 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:35.806+0000 7f5ddd65b700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5dd81053e0 0x7f5dd8105800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:42:36.487 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:35.806+0000 7f5ddd65b700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5dd81053e0 0x7f5dd8105800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:38650/0 (socket says 172.21.15.76:38650) 2024-06-02T04:42:36.487 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:35.806+0000 7f5ddd65b700 1 -- 172.21.15.76:0/1531842664 learned_addr learned my addr 172.21.15.76:0/1531842664 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:42:36.487 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:35.806+0000 7f5ddd65b700 1 -- 172.21.15.76:0/1531842664 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dd81065e0 con 0x7f5dd81053e0 2024-06-02T04:42:36.487 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:35.806+0000 7f5ddd65b700 1 --2- 172.21.15.76:0/1531842664 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5dd81053e0 0x7f5dd8105800 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f5dc80098a0 tx=0x7f5dc8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9346d8add389658 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:42:36.487 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:35.806+0000 7f5dcffff700 1 -- 172.21.15.76:0/1531842664 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5dc8004160 con 0x7f5dd81053e0 2024-06-02T04:42:36.487 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:35.806+0000 7f5dcffff700 1 -- 172.21.15.76:0/1531842664 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f5dc80042c0 con 0x7f5dd81053e0 2024-06-02T04:42:36.488 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:35.806+0000 7f5dcffff700 1 -- 172.21.15.76:0/1531842664 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5dc8011940 con 0x7f5dd81053e0 2024-06-02T04:42:36.488 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:35.807+0000 7f5ddf8bf700 1 -- 172.21.15.76:0/1531842664 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5dd81053e0 msgr2=0x7f5dd8105800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:42:36.488 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:35.807+0000 7f5ddf8bf700 1 --2- 172.21.15.76:0/1531842664 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5dd81053e0 0x7f5dd8105800 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f5dc80098a0 tx=0x7f5dc8009bb0 comp rx=0 tx=0).stop 2024-06-02T04:42:36.488 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:35.807+0000 7f5ddf8bf700 1 -- 172.21.15.76:0/1531842664 shutdown_connections 2024-06-02T04:42:36.488 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:35.807+0000 7f5ddf8bf700 1 --2- 172.21.15.76:0/1531842664 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5dd81053e0 0x7f5dd8105800 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:42:36.488 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:35.807+0000 7f5ddf8bf700 1 -- 172.21.15.76:0/1531842664 >> 172.21.15.76:0/1531842664 conn(0x7f5dd81009c0 msgr2=0x7f5dd8102de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:42:36.488 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:35.807+0000 7f5ddf8bf700 1 -- 172.21.15.76:0/1531842664 shutdown_connections 2024-06-02T04:42:36.488 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:35.807+0000 7f5ddf8bf700 1 -- 172.21.15.76:0/1531842664 wait complete. 2024-06-02T04:42:36.488 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:35.807+0000 7f5ddf8bf700 1 Processor -- start 2024-06-02T04:42:36.488 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:35.807+0000 7f5ddf8bf700 1 -- start start 2024-06-02T04:42:36.488 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:35.808+0000 7f5ddf8bf700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5dd81053e0 0x7f5dd8190410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:42:36.488 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:35.808+0000 7f5ddf8bf700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd8190950 con 0x7f5dd81053e0 2024-06-02T04:42:36.489 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:35.808+0000 7f5ddd65b700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5dd81053e0 0x7f5dd8190410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:42:36.489 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:35.808+0000 7f5ddd65b700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5dd81053e0 0x7f5dd8190410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:38660/0 (socket says 172.21.15.76:38660) 2024-06-02T04:42:36.489 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:35.808+0000 7f5ddd65b700 1 -- 172.21.15.76:0/553769912 learned_addr learned my addr 172.21.15.76:0/553769912 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:42:36.489 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:35.808+0000 7f5ddd65b700 1 -- 172.21.15.76:0/553769912 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dc8009550 con 0x7f5dd81053e0 2024-06-02T04:42:36.489 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:35.808+0000 7f5ddd65b700 1 --2- 172.21.15.76:0/553769912 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5dd81053e0 0x7f5dd8190410 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f5dc8006af0 tx=0x7f5dc8011a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:42:36.489 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:35.808+0000 7f5dce7fc700 1 -- 172.21.15.76:0/553769912 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5dc8003bf0 con 0x7f5dd81053e0 2024-06-02T04:42:36.489 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:35.808+0000 7f5dce7fc700 1 -- 172.21.15.76:0/553769912 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f5dc801b8b0 con 0x7f5dd81053e0 2024-06-02T04:42:36.489 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:35.808+0000 7f5dce7fc700 1 -- 172.21.15.76:0/553769912 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5dc8023830 con 0x7f5dd81053e0 2024-06-02T04:42:36.489 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:35.808+0000 7f5ddf8bf700 1 -- 172.21.15.76:0/553769912 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dd818eb90 con 0x7f5dd81053e0 2024-06-02T04:42:36.489 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:35.808+0000 7f5ddf8bf700 1 -- 172.21.15.76:0/553769912 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dd818f030 con 0x7f5dd81053e0 2024-06-02T04:42:36.489 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:35.809+0000 7f5dce7fc700 1 -- 172.21.15.76:0/553769912 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 3) v1 ==== 45424+0+0 (secure 0 0 0) 0x7f5dc801b440 con 0x7f5dd81053e0 2024-06-02T04:42:36.489 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:35.809+0000 7f5ddf8bf700 1 -- 172.21.15.76:0/553769912 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dd818fa40 con 0x7f5dd81053e0 2024-06-02T04:42:36.489 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:35.809+0000 7f5dce7fc700 1 --2- 172.21.15.76:0/553769912 >> [v2:172.21.15.76:6800/2550846765,v1:172.21.15.76:6801/2550846765] conn(0x7f5dc4038540 0x7f5dc403aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:42:36.490 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:35.809+0000 7f5dce7fc700 1 -- 172.21.15.76:0/553769912 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f5dc804c8c0 con 0x7f5dd81053e0 2024-06-02T04:42:36.490 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:35.809+0000 7f5ddce5a700 1 --2- 172.21.15.76:0/553769912 >> [v2:172.21.15.76:6800/2550846765,v1:172.21.15.76:6801/2550846765] conn(0x7f5dc4038540 0x7f5dc403aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:42:36.490 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:35.810+0000 7f5ddce5a700 1 --2- 172.21.15.76:0/553769912 >> [v2:172.21.15.76:6800/2550846765,v1:172.21.15.76:6801/2550846765] conn(0x7f5dc4038540 0x7f5dc403aa00 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f5dd4006fd0 tx=0x7f5dd4006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:42:36.490 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:35.814+0000 7f5dce7fc700 1 -- 172.21.15.76:0/553769912 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f5dc801b6f0 con 0x7f5dd81053e0 2024-06-02T04:42:36.490 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:36.083+0000 7f5ddf8bf700 1 -- 172.21.15.76:0/553769912 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f5dd80625d0 con 0x7f5dd81053e0 2024-06-02T04:42:36.490 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:36.084+0000 7f5dce7fc700 1 -- 172.21.15.76:0/553769912 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7f5dc802b350 con 0x7f5dd81053e0 2024-06-02T04:42:36.490 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:36.086+0000 7f5ddf8bf700 1 -- 172.21.15.76:0/553769912 >> [v2:172.21.15.76:6800/2550846765,v1:172.21.15.76:6801/2550846765] conn(0x7f5dc4038540 msgr2=0x7f5dc403aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:42:36.490 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:36.086+0000 7f5ddf8bf700 1 --2- 172.21.15.76:0/553769912 >> [v2:172.21.15.76:6800/2550846765,v1:172.21.15.76:6801/2550846765] conn(0x7f5dc4038540 0x7f5dc403aa00 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f5dd4006fd0 tx=0x7f5dd4006e40 comp rx=0 tx=0).stop 2024-06-02T04:42:36.490 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:36.086+0000 7f5ddf8bf700 1 -- 172.21.15.76:0/553769912 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5dd81053e0 msgr2=0x7f5dd8190410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:42:36.490 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:36.086+0000 7f5ddf8bf700 1 --2- 172.21.15.76:0/553769912 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5dd81053e0 0x7f5dd8190410 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f5dc8006af0 tx=0x7f5dc8011a50 comp rx=0 tx=0).stop 2024-06-02T04:42:36.490 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:36.086+0000 7f5ddf8bf700 1 -- 172.21.15.76:0/553769912 shutdown_connections 2024-06-02T04:42:36.490 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:36.086+0000 7f5ddf8bf700 1 --2- 172.21.15.76:0/553769912 >> [v2:172.21.15.76:6800/2550846765,v1:172.21.15.76:6801/2550846765] conn(0x7f5dc4038540 0x7f5dc403aa00 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:42:36.490 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:36.086+0000 7f5ddf8bf700 1 --2- 172.21.15.76:0/553769912 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5dd81053e0 0x7f5dd8190410 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:42:36.491 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:36.086+0000 7f5ddf8bf700 1 -- 172.21.15.76:0/553769912 >> 172.21.15.76:0/553769912 conn(0x7f5dd81009c0 msgr2=0x7f5dd8101880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:42:36.491 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:36.086+0000 7f5ddf8bf700 1 -- 172.21.15.76:0/553769912 shutdown_connections 2024-06-02T04:42:36.491 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:36.086+0000 7f5ddf8bf700 1 -- 172.21.15.76:0/553769912 wait complete. 2024-06-02T04:42:36.491 INFO:teuthology.orchestra.run.smithi076.stdout:mgr is available 2024-06-02T04:42:37.333 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:37 smithi076 ceph-mon[42935]: mgrmap e4: x(active, since 3s) 2024-06-02T04:42:37.333 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:37 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/3185547182' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-06-02T04:42:37.362 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout 2024-06-02T04:42:37.363 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout [global] 2024-06-02T04:42:37.363 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout fsid = 60ab6d30-209a-11ef-bc9b-c7b262605968 2024-06-02T04:42:37.363 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-06-02T04:42:37.363 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-06-02T04:42:37.363 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-06-02T04:42:37.363 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-06-02T04:42:37.363 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout 2024-06-02T04:42:37.363 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout [mgr] 2024-06-02T04:42:37.363 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-06-02T04:42:37.363 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout 2024-06-02T04:42:37.363 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout [osd] 2024-06-02T04:42:37.363 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-06-02T04:42:37.364 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-06-02T04:42:37.364 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-06-02T04:42:37.364 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-06-02T04:42:37.364 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-06-02T04:42:37.364 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:36.812+0000 7f4406861700 1 Processor -- start 2024-06-02T04:42:37.364 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:36.812+0000 7f4406861700 1 -- start start 2024-06-02T04:42:37.364 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:36.812+0000 7f4406861700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4400104da0 0x7f44001051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:42:37.364 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:36.812+0000 7f4406861700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4400079e70 con 0x7f4400104da0 2024-06-02T04:42:37.364 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:36.813+0000 7f43fffff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4400104da0 0x7f44001051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:42:37.364 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:36.813+0000 7f43fffff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4400104da0 0x7f44001051c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:38666/0 (socket says 172.21.15.76:38666) 2024-06-02T04:42:37.364 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:36.813+0000 7f43fffff700 1 -- 172.21.15.76:0/3032065857 learned_addr learned my addr 172.21.15.76:0/3032065857 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:42:37.364 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:36.813+0000 7f43fffff700 1 -- 172.21.15.76:0/3032065857 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4400105700 con 0x7f4400104da0 2024-06-02T04:42:37.365 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:36.813+0000 7f43fffff700 1 --2- 172.21.15.76:0/3032065857 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4400104da0 0x7f44001051c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f43f40098a0 tx=0x7f43f4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89ed6db0ddc5a130 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:42:37.365 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:36.813+0000 7f43feffd700 1 -- 172.21.15.76:0/3032065857 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f43f4004160 con 0x7f4400104da0 2024-06-02T04:42:37.365 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:36.813+0000 7f43feffd700 1 -- 172.21.15.76:0/3032065857 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f43f40042c0 con 0x7f4400104da0 2024-06-02T04:42:37.365 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:36.813+0000 7f43feffd700 1 -- 172.21.15.76:0/3032065857 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f43f4011940 con 0x7f4400104da0 2024-06-02T04:42:37.365 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:36.814+0000 7f4406861700 1 -- 172.21.15.76:0/3032065857 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4400104da0 msgr2=0x7f44001051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:42:37.365 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:36.814+0000 7f4406861700 1 --2- 172.21.15.76:0/3032065857 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4400104da0 0x7f44001051c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f43f40098a0 tx=0x7f43f4009bb0 comp rx=0 tx=0).stop 2024-06-02T04:42:37.365 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:36.814+0000 7f4406861700 1 -- 172.21.15.76:0/3032065857 shutdown_connections 2024-06-02T04:42:37.365 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:36.814+0000 7f4406861700 1 --2- 172.21.15.76:0/3032065857 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4400104da0 0x7f44001051c0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:42:37.365 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:36.814+0000 7f4406861700 1 -- 172.21.15.76:0/3032065857 >> 172.21.15.76:0/3032065857 conn(0x7f44001009c0 msgr2=0x7f4400102de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:42:37.365 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:36.814+0000 7f4406861700 1 -- 172.21.15.76:0/3032065857 shutdown_connections 2024-06-02T04:42:37.365 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:36.814+0000 7f4406861700 1 -- 172.21.15.76:0/3032065857 wait complete. 2024-06-02T04:42:37.365 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:36.814+0000 7f4406861700 1 Processor -- start 2024-06-02T04:42:37.365 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:36.814+0000 7f4406861700 1 -- start start 2024-06-02T04:42:37.366 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:36.815+0000 7f4406861700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4400104da0 0x7f440019c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:42:37.366 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:36.815+0000 7f4406861700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f440019c8f0 con 0x7f4400104da0 2024-06-02T04:42:37.366 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:36.815+0000 7f43fffff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4400104da0 0x7f440019c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:42:37.366 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:36.815+0000 7f43fffff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4400104da0 0x7f440019c3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:38680/0 (socket says 172.21.15.76:38680) 2024-06-02T04:42:37.366 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:36.815+0000 7f43fffff700 1 -- 172.21.15.76:0/3185547182 learned_addr learned my addr 172.21.15.76:0/3185547182 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:42:37.366 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:36.815+0000 7f43fffff700 1 -- 172.21.15.76:0/3185547182 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43f4009550 con 0x7f4400104da0 2024-06-02T04:42:37.366 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:36.815+0000 7f43fffff700 1 --2- 172.21.15.76:0/3185547182 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4400104da0 0x7f440019c3b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f43f4003f20 tx=0x7f43f4011f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:42:37.366 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:36.815+0000 7f43fd7fa700 1 -- 172.21.15.76:0/3185547182 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f43f40037d0 con 0x7f4400104da0 2024-06-02T04:42:37.366 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:36.815+0000 7f43fd7fa700 1 -- 172.21.15.76:0/3185547182 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f43f401b440 con 0x7f4400104da0 2024-06-02T04:42:37.366 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:36.815+0000 7f4406861700 1 -- 172.21.15.76:0/3185547182 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f440019caf0 con 0x7f4400104da0 2024-06-02T04:42:37.366 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:36.815+0000 7f43fd7fa700 1 -- 172.21.15.76:0/3185547182 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f43f4023590 con 0x7f4400104da0 2024-06-02T04:42:37.366 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:36.816+0000 7f4406861700 1 -- 172.21.15.76:0/3185547182 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f440019cf90 con 0x7f4400104da0 2024-06-02T04:42:37.366 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:36.816+0000 7f43fd7fa700 1 -- 172.21.15.76:0/3185547182 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 4) v1 ==== 45530+0+0 (secure 0 0 0) 0x7f43f4023800 con 0x7f4400104da0 2024-06-02T04:42:37.367 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:36.816+0000 7f4406861700 1 -- 172.21.15.76:0/3185547182 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4400196080 con 0x7f4400104da0 2024-06-02T04:42:37.367 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:36.816+0000 7f43fd7fa700 1 --2- 172.21.15.76:0/3185547182 >> [v2:172.21.15.76:6800/2550846765,v1:172.21.15.76:6801/2550846765] conn(0x7f43e8038700 0x7f43e803abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:42:37.367 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:36.817+0000 7f43fd7fa700 1 -- 172.21.15.76:0/3185547182 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f43f404c5a0 con 0x7f4400104da0 2024-06-02T04:42:37.367 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:36.817+0000 7f43ff7fe700 1 --2- 172.21.15.76:0/3185547182 >> [v2:172.21.15.76:6800/2550846765,v1:172.21.15.76:6801/2550846765] conn(0x7f43e8038700 0x7f43e803abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:42:37.367 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:36.817+0000 7f43ff7fe700 1 --2- 172.21.15.76:0/3185547182 >> [v2:172.21.15.76:6800/2550846765,v1:172.21.15.76:6801/2550846765] conn(0x7f43e8038700 0x7f43e803abc0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f43f0006fd0 tx=0x7f43f0006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:42:37.367 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:36.821+0000 7f43fd7fa700 1 -- 172.21.15.76:0/3185547182 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f43f4018350 con 0x7f4400104da0 2024-06-02T04:42:37.367 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:37.011+0000 7f4406861700 1 -- 172.21.15.76:0/3185547182 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f440002cfa0 con 0x7f4400104da0 2024-06-02T04:42:37.367 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:37.012+0000 7f43fd7fa700 1 -- 172.21.15.76:0/3185547182 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+373 (secure 0 0 0) 0x7f43f402bb40 con 0x7f4400104da0 2024-06-02T04:42:37.367 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:37.014+0000 7f4406861700 1 -- 172.21.15.76:0/3185547182 >> [v2:172.21.15.76:6800/2550846765,v1:172.21.15.76:6801/2550846765] conn(0x7f43e8038700 msgr2=0x7f43e803abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:42:37.367 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:37.014+0000 7f4406861700 1 --2- 172.21.15.76:0/3185547182 >> [v2:172.21.15.76:6800/2550846765,v1:172.21.15.76:6801/2550846765] conn(0x7f43e8038700 0x7f43e803abc0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f43f0006fd0 tx=0x7f43f0006e40 comp rx=0 tx=0).stop 2024-06-02T04:42:37.367 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:37.014+0000 7f4406861700 1 -- 172.21.15.76:0/3185547182 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4400104da0 msgr2=0x7f440019c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:42:37.367 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:37.014+0000 7f4406861700 1 --2- 172.21.15.76:0/3185547182 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4400104da0 0x7f440019c3b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f43f4003f20 tx=0x7f43f4011f00 comp rx=0 tx=0).stop 2024-06-02T04:42:37.367 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:37.014+0000 7f4406861700 1 -- 172.21.15.76:0/3185547182 shutdown_connections 2024-06-02T04:42:37.368 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:37.014+0000 7f4406861700 1 --2- 172.21.15.76:0/3185547182 >> [v2:172.21.15.76:6800/2550846765,v1:172.21.15.76:6801/2550846765] conn(0x7f43e8038700 0x7f43e803abc0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:42:37.368 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:37.014+0000 7f4406861700 1 --2- 172.21.15.76:0/3185547182 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4400104da0 0x7f440019c3b0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:42:37.368 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:37.014+0000 7f4406861700 1 -- 172.21.15.76:0/3185547182 >> 172.21.15.76:0/3185547182 conn(0x7f44001009c0 msgr2=0x7f44001931c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:42:37.368 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:37.015+0000 7f4406861700 1 -- 172.21.15.76:0/3185547182 shutdown_connections 2024-06-02T04:42:37.368 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:37.015+0000 7f4406861700 1 -- 172.21.15.76:0/3185547182 wait complete. 2024-06-02T04:42:37.368 INFO:teuthology.orchestra.run.smithi076.stdout:Enabling cephadm module... 2024-06-02T04:42:38.458 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:38 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/2639330932' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-06-02T04:42:38.458 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Jun 02 04:42:38 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-x[43184]: ignoring --setuser ceph since I am not root 2024-06-02T04:42:38.458 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Jun 02 04:42:38 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-x[43184]: ignoring --setgroup ceph since I am not root 2024-06-02T04:42:38.526 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:37.746+0000 7f5a01188700 1 Processor -- start 2024-06-02T04:42:38.527 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:37.746+0000 7f5a01188700 1 -- start start 2024-06-02T04:42:38.527 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:37.747+0000 7f5a01188700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f59fc1053d0 0x7f59fc1057f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:42:38.527 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:37.747+0000 7f5a01188700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59fc105dc0 con 0x7f59fc1053d0 2024-06-02T04:42:38.527 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:37.747+0000 7f59fad9d700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f59fc1053d0 0x7f59fc1057f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:42:38.527 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:37.747+0000 7f59fad9d700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f59fc1053d0 0x7f59fc1057f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:38692/0 (socket says 172.21.15.76:38692) 2024-06-02T04:42:38.527 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:37.747+0000 7f59fad9d700 1 -- 172.21.15.76:0/3219946084 learned_addr learned my addr 172.21.15.76:0/3219946084 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:42:38.527 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:37.747+0000 7f59fad9d700 1 -- 172.21.15.76:0/3219946084 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59fc1065d0 con 0x7f59fc1053d0 2024-06-02T04:42:38.527 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:37.747+0000 7f59fad9d700 1 --2- 172.21.15.76:0/3219946084 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f59fc1053d0 0x7f59fc1057f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f59e400bb40 tx=0x7f59e400be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=125f907bb68f8c58 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:42:38.527 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:37.747+0000 7f59f9d9b700 1 -- 172.21.15.76:0/3219946084 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f59e400dbe0 con 0x7f59fc1053d0 2024-06-02T04:42:38.527 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:37.747+0000 7f59f9d9b700 1 -- 172.21.15.76:0/3219946084 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f59e40044a0 con 0x7f59fc1053d0 2024-06-02T04:42:38.527 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:37.747+0000 7f59f9d9b700 1 -- 172.21.15.76:0/3219946084 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f59e4003da0 con 0x7f59fc1053d0 2024-06-02T04:42:38.528 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:37.748+0000 7f5a01188700 1 -- 172.21.15.76:0/3219946084 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f59fc1053d0 msgr2=0x7f59fc1057f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:42:38.528 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:37.748+0000 7f5a01188700 1 --2- 172.21.15.76:0/3219946084 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f59fc1053d0 0x7f59fc1057f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f59e400bb40 tx=0x7f59e400be50 comp rx=0 tx=0).stop 2024-06-02T04:42:38.528 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:37.748+0000 7f5a01188700 1 -- 172.21.15.76:0/3219946084 shutdown_connections 2024-06-02T04:42:38.528 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:37.748+0000 7f5a01188700 1 --2- 172.21.15.76:0/3219946084 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f59fc1053d0 0x7f59fc1057f0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:42:38.528 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:37.748+0000 7f5a01188700 1 -- 172.21.15.76:0/3219946084 >> 172.21.15.76:0/3219946084 conn(0x7f59fc1009b0 msgr2=0x7f59fc102dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:42:38.528 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:37.748+0000 7f5a01188700 1 -- 172.21.15.76:0/3219946084 shutdown_connections 2024-06-02T04:42:38.528 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:37.748+0000 7f5a01188700 1 -- 172.21.15.76:0/3219946084 wait complete. 2024-06-02T04:42:38.528 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:37.749+0000 7f5a01188700 1 Processor -- start 2024-06-02T04:42:38.528 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:37.749+0000 7f5a01188700 1 -- start start 2024-06-02T04:42:38.528 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:37.749+0000 7f5a01188700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f59fc1053d0 0x7f59fc197ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:42:38.528 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:37.749+0000 7f5a01188700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59fc198530 con 0x7f59fc1053d0 2024-06-02T04:42:38.528 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:37.749+0000 7f59fad9d700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f59fc1053d0 0x7f59fc197ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:42:38.528 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:37.749+0000 7f59fad9d700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f59fc1053d0 0x7f59fc197ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:38704/0 (socket says 172.21.15.76:38704) 2024-06-02T04:42:38.529 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:37.749+0000 7f59fad9d700 1 -- 172.21.15.76:0/2639330932 learned_addr learned my addr 172.21.15.76:0/2639330932 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:42:38.529 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:37.749+0000 7f59fad9d700 1 -- 172.21.15.76:0/2639330932 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59e400b7f0 con 0x7f59fc1053d0 2024-06-02T04:42:38.529 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:37.750+0000 7f59fad9d700 1 --2- 172.21.15.76:0/2639330932 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f59fc1053d0 0x7f59fc197ff0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f59e400d650 tx=0x7f59e4003f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:42:38.529 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:37.750+0000 7f59f3fff700 1 -- 172.21.15.76:0/2639330932 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f59e401e070 con 0x7f59fc1053d0 2024-06-02T04:42:38.529 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:37.750+0000 7f59f3fff700 1 -- 172.21.15.76:0/2639330932 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f59e4010970 con 0x7f59fc1053d0 2024-06-02T04:42:38.529 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:37.750+0000 7f59f3fff700 1 -- 172.21.15.76:0/2639330932 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f59e4022940 con 0x7f59fc1053d0 2024-06-02T04:42:38.529 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:37.750+0000 7f5a01188700 1 -- 172.21.15.76:0/2639330932 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59fc198730 con 0x7f59fc1053d0 2024-06-02T04:42:38.529 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:37.750+0000 7f5a01188700 1 -- 172.21.15.76:0/2639330932 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59fc198bd0 con 0x7f59fc1053d0 2024-06-02T04:42:38.529 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:37.751+0000 7f59f3fff700 1 -- 172.21.15.76:0/2639330932 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 4) v1 ==== 45530+0+0 (secure 0 0 0) 0x7f59e402c440 con 0x7f59fc1053d0 2024-06-02T04:42:38.529 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:37.751+0000 7f5a01188700 1 -- 172.21.15.76:0/2639330932 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59fc078ff0 con 0x7f59fc1053d0 2024-06-02T04:42:38.529 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:37.751+0000 7f59f3fff700 1 --2- 172.21.15.76:0/2639330932 >> [v2:172.21.15.76:6800/2550846765,v1:172.21.15.76:6801/2550846765] conn(0x7f59e80386b0 0x7f59e803ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:42:38.529 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:37.751+0000 7f59f3fff700 1 -- 172.21.15.76:0/2639330932 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f59e404e6c0 con 0x7f59fc1053d0 2024-06-02T04:42:38.529 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:37.751+0000 7f59fa59c700 1 --2- 172.21.15.76:0/2639330932 >> [v2:172.21.15.76:6800/2550846765,v1:172.21.15.76:6801/2550846765] conn(0x7f59e80386b0 0x7f59e803ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:42:38.529 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:37.751+0000 7f59fa59c700 1 --2- 172.21.15.76:0/2639330932 >> [v2:172.21.15.76:6800/2550846765,v1:172.21.15.76:6801/2550846765] conn(0x7f59e80386b0 0x7f59e803ab70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f59ec006fd0 tx=0x7f59ec006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:42:38.530 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:37.756+0000 7f59f3fff700 1 -- 172.21.15.76:0/2639330932 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f59e40193f0 con 0x7f59fc1053d0 2024-06-02T04:42:38.530 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:38.000+0000 7f5a01188700 1 -- 172.21.15.76:0/2639330932 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7f59fc191730 con 0x7f59fc1053d0 2024-06-02T04:42:38.530 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:38.112+0000 7f59f3fff700 1 -- 172.21.15.76:0/2639330932 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mgrmap(e 5) v1 ==== 45541+0+0 (secure 0 0 0) 0x7f59e402cac0 con 0x7f59fc1053d0 2024-06-02T04:42:38.530 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:38.113+0000 7f59f3fff700 1 -- 172.21.15.76:0/2639330932 <== mon.0 v2:172.21.15.76:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7f59e404e420 con 0x7f59fc1053d0 2024-06-02T04:42:38.530 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:38.115+0000 7f5a01188700 1 -- 172.21.15.76:0/2639330932 >> [v2:172.21.15.76:6800/2550846765,v1:172.21.15.76:6801/2550846765] conn(0x7f59e80386b0 msgr2=0x7f59e803ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:42:38.530 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:38.115+0000 7f5a01188700 1 --2- 172.21.15.76:0/2639330932 >> [v2:172.21.15.76:6800/2550846765,v1:172.21.15.76:6801/2550846765] conn(0x7f59e80386b0 0x7f59e803ab70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f59ec006fd0 tx=0x7f59ec006e40 comp rx=0 tx=0).stop 2024-06-02T04:42:38.530 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:38.115+0000 7f5a01188700 1 -- 172.21.15.76:0/2639330932 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f59fc1053d0 msgr2=0x7f59fc197ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:42:38.530 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:38.115+0000 7f5a01188700 1 --2- 172.21.15.76:0/2639330932 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f59fc1053d0 0x7f59fc197ff0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f59e400d650 tx=0x7f59e4003f70 comp rx=0 tx=0).stop 2024-06-02T04:42:38.530 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:38.115+0000 7f5a01188700 1 -- 172.21.15.76:0/2639330932 shutdown_connections 2024-06-02T04:42:38.530 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:38.115+0000 7f5a01188700 1 --2- 172.21.15.76:0/2639330932 >> [v2:172.21.15.76:6800/2550846765,v1:172.21.15.76:6801/2550846765] conn(0x7f59e80386b0 0x7f59e803ab70 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:42:38.530 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:38.115+0000 7f5a01188700 1 --2- 172.21.15.76:0/2639330932 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f59fc1053d0 0x7f59fc197ff0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:42:38.530 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:38.115+0000 7f5a01188700 1 -- 172.21.15.76:0/2639330932 >> 172.21.15.76:0/2639330932 conn(0x7f59fc1009b0 msgr2=0x7f59fc18e7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:42:38.530 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:38.115+0000 7f5a01188700 1 -- 172.21.15.76:0/2639330932 shutdown_connections 2024-06-02T04:42:38.531 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:38.115+0000 7f5a01188700 1 -- 172.21.15.76:0/2639330932 wait complete. 2024-06-02T04:42:38.733 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Jun 02 04:42:38 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-x[43184]: 2024-06-02T04:42:38.545+0000 7f7070bbc200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-06-02T04:42:38.733 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Jun 02 04:42:38 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-x[43184]: 2024-06-02T04:42:38.643+0000 7f7070bbc200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-06-02T04:42:39.112 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Jun 02 04:42:38 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-x[43184]: 2024-06-02T04:42:38.733+0000 7f7070bbc200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-06-02T04:42:39.112 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Jun 02 04:42:38 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-x[43184]: 2024-06-02T04:42:38.820+0000 7f7070bbc200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-06-02T04:42:39.404 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:39 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/2639330932' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-06-02T04:42:39.404 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:39 smithi076 ceph-mon[42935]: mgrmap e5: x(active, since 5s) 2024-06-02T04:42:39.590 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout { 2024-06-02T04:42:39.590 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-06-02T04:42:39.590 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "available": true, 2024-06-02T04:42:39.591 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-06-02T04:42:39.591 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-06-02T04:42:39.591 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout } 2024-06-02T04:42:39.591 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:38.923+0000 7ff9aa340700 1 Processor -- start 2024-06-02T04:42:39.591 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:38.923+0000 7ff9aa340700 1 -- start start 2024-06-02T04:42:39.591 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:38.923+0000 7ff9aa340700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff9a4106f90 0x7ff9a4109380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:42:39.591 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:38.923+0000 7ff9aa340700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a4079e90 con 0x7ff9a4106f90 2024-06-02T04:42:39.599 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:38.923+0000 7ff9a3fff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff9a4106f90 0x7ff9a4109380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:42:39.599 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:38.923+0000 7ff9a3fff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff9a4106f90 0x7ff9a4109380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:38726/0 (socket says 172.21.15.76:38726) 2024-06-02T04:42:39.599 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:38.923+0000 7ff9a3fff700 1 -- 172.21.15.76:0/2939786651 learned_addr learned my addr 172.21.15.76:0/2939786651 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:42:39.599 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:38.923+0000 7ff9a3fff700 1 -- 172.21.15.76:0/2939786651 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9a41098c0 con 0x7ff9a4106f90 2024-06-02T04:42:39.599 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:38.923+0000 7ff9a3fff700 1 --2- 172.21.15.76:0/2939786651 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff9a4106f90 0x7ff9a4109380 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff9940098a0 tx=0x7ff994009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8d9fbf59af4d3fa server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:42:39.599 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:38.924+0000 7ff9a2ffd700 1 -- 172.21.15.76:0/2939786651 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff994004160 con 0x7ff9a4106f90 2024-06-02T04:42:39.599 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:38.924+0000 7ff9a2ffd700 1 -- 172.21.15.76:0/2939786651 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7ff9940042c0 con 0x7ff9a4106f90 2024-06-02T04:42:39.600 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:38.924+0000 7ff9a2ffd700 1 -- 172.21.15.76:0/2939786651 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff994011940 con 0x7ff9a4106f90 2024-06-02T04:42:39.600 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:38.924+0000 7ff9aa340700 1 -- 172.21.15.76:0/2939786651 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff9a4106f90 msgr2=0x7ff9a4109380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:42:39.600 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:38.924+0000 7ff9aa340700 1 --2- 172.21.15.76:0/2939786651 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff9a4106f90 0x7ff9a4109380 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff9940098a0 tx=0x7ff994009bb0 comp rx=0 tx=0).stop 2024-06-02T04:42:39.600 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:38.924+0000 7ff9aa340700 1 -- 172.21.15.76:0/2939786651 shutdown_connections 2024-06-02T04:42:39.600 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:38.924+0000 7ff9aa340700 1 --2- 172.21.15.76:0/2939786651 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff9a4106f90 0x7ff9a4109380 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:42:39.600 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:38.924+0000 7ff9aa340700 1 -- 172.21.15.76:0/2939786651 >> 172.21.15.76:0/2939786651 conn(0x7ff9a41009c0 msgr2=0x7ff9a4102de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:42:39.600 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:38.924+0000 7ff9aa340700 1 -- 172.21.15.76:0/2939786651 shutdown_connections 2024-06-02T04:42:39.600 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:38.924+0000 7ff9aa340700 1 -- 172.21.15.76:0/2939786651 wait complete. 2024-06-02T04:42:39.600 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:38.925+0000 7ff9aa340700 1 Processor -- start 2024-06-02T04:42:39.600 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:38.925+0000 7ff9aa340700 1 -- start start 2024-06-02T04:42:39.601 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:38.925+0000 7ff9aa340700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff9a4106f90 0x7ff9a419c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:42:39.601 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:38.925+0000 7ff9aa340700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a419c8e0 con 0x7ff9a4106f90 2024-06-02T04:42:39.601 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:38.925+0000 7ff9a3fff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff9a4106f90 0x7ff9a419c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:42:39.601 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:38.925+0000 7ff9a3fff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff9a4106f90 0x7ff9a419c3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:38734/0 (socket says 172.21.15.76:38734) 2024-06-02T04:42:39.601 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:38.925+0000 7ff9a3fff700 1 -- 172.21.15.76:0/2367175653 learned_addr learned my addr 172.21.15.76:0/2367175653 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:42:39.601 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:38.926+0000 7ff9a3fff700 1 -- 172.21.15.76:0/2367175653 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff994009550 con 0x7ff9a4106f90 2024-06-02T04:42:39.601 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:38.926+0000 7ff9a3fff700 1 --2- 172.21.15.76:0/2367175653 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff9a4106f90 0x7ff9a419c3a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff994006af0 tx=0x7ff994011a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:42:39.602 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:38.926+0000 7ff9a17fa700 1 -- 172.21.15.76:0/2367175653 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff994003bf0 con 0x7ff9a4106f90 2024-06-02T04:42:39.602 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:38.926+0000 7ff9a17fa700 1 -- 172.21.15.76:0/2367175653 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7ff99401b8b0 con 0x7ff9a4106f90 2024-06-02T04:42:39.602 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:38.926+0000 7ff9a17fa700 1 -- 172.21.15.76:0/2367175653 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff994023800 con 0x7ff9a4106f90 2024-06-02T04:42:39.602 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:38.926+0000 7ff9aa340700 1 -- 172.21.15.76:0/2367175653 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9a419cae0 con 0x7ff9a4106f90 2024-06-02T04:42:39.602 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:38.926+0000 7ff9aa340700 1 -- 172.21.15.76:0/2367175653 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9a419cf80 con 0x7ff9a4106f90 2024-06-02T04:42:39.602 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:38.927+0000 7ff9aa340700 1 -- 172.21.15.76:0/2367175653 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9a410a600 con 0x7ff9a4106f90 2024-06-02T04:42:39.602 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:38.927+0000 7ff9a17fa700 1 -- 172.21.15.76:0/2367175653 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 45541+0+0 (secure 0 0 0) 0x7ff99401b440 con 0x7ff9a4106f90 2024-06-02T04:42:39.602 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:38.927+0000 7ff9a17fa700 1 --2- 172.21.15.76:0/2367175653 >> [v2:172.21.15.76:6800/2550846765,v1:172.21.15.76:6801/2550846765] conn(0x7ff98c038700 0x7ff98c03abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:42:39.603 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:38.927+0000 7ff9a17fa700 1 -- 172.21.15.76:0/2367175653 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7ff99404cb80 con 0x7ff9a4106f90 2024-06-02T04:42:39.603 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:38.927+0000 7ff9a37fe700 1 -- 172.21.15.76:0/2367175653 >> [v2:172.21.15.76:6800/2550846765,v1:172.21.15.76:6801/2550846765] conn(0x7ff98c038700 msgr2=0x7ff98c03abc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.76:6800/2550846765 2024-06-02T04:42:39.603 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:38.927+0000 7ff9a37fe700 1 --2- 172.21.15.76:0/2367175653 >> [v2:172.21.15.76:6800/2550846765,v1:172.21.15.76:6801/2550846765] conn(0x7ff98c038700 0x7ff98c03abc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-06-02T04:42:39.603 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:38.932+0000 7ff9a17fa700 1 -- 172.21.15.76:0/2367175653 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7ff99404ee60 con 0x7ff9a4106f90 2024-06-02T04:42:39.603 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:39.128+0000 7ff9a37fe700 1 -- 172.21.15.76:0/2367175653 >> [v2:172.21.15.76:6800/2550846765,v1:172.21.15.76:6801/2550846765] conn(0x7ff98c038700 msgr2=0x7ff98c03abc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.76:6800/2550846765 2024-06-02T04:42:39.603 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:39.128+0000 7ff9a37fe700 1 --2- 172.21.15.76:0/2367175653 >> [v2:172.21.15.76:6800/2550846765,v1:172.21.15.76:6801/2550846765] conn(0x7ff98c038700 0x7ff98c03abc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-06-02T04:42:39.603 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:39.187+0000 7ff9aa340700 1 -- 172.21.15.76:0/2367175653 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7ff9a419f810 con 0x7ff9a4106f90 2024-06-02T04:42:39.603 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:39.187+0000 7ff9a17fa700 1 -- 172.21.15.76:0/2367175653 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+88 (secure 0 0 0) 0x7ff994023960 con 0x7ff9a4106f90 2024-06-02T04:42:39.603 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:39.190+0000 7ff9aa340700 1 -- 172.21.15.76:0/2367175653 >> [v2:172.21.15.76:6800/2550846765,v1:172.21.15.76:6801/2550846765] conn(0x7ff98c038700 msgr2=0x7ff98c03abc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-02T04:42:39.603 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:39.190+0000 7ff9aa340700 1 --2- 172.21.15.76:0/2367175653 >> [v2:172.21.15.76:6800/2550846765,v1:172.21.15.76:6801/2550846765] conn(0x7ff98c038700 0x7ff98c03abc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:42:39.603 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:39.190+0000 7ff9aa340700 1 -- 172.21.15.76:0/2367175653 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff9a4106f90 msgr2=0x7ff9a419c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:42:39.603 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:39.190+0000 7ff9aa340700 1 --2- 172.21.15.76:0/2367175653 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff9a4106f90 0x7ff9a419c3a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff994006af0 tx=0x7ff994011a50 comp rx=0 tx=0).stop 2024-06-02T04:42:39.604 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:39.190+0000 7ff9aa340700 1 -- 172.21.15.76:0/2367175653 shutdown_connections 2024-06-02T04:42:39.604 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:39.190+0000 7ff9aa340700 1 --2- 172.21.15.76:0/2367175653 >> [v2:172.21.15.76:6800/2550846765,v1:172.21.15.76:6801/2550846765] conn(0x7ff98c038700 0x7ff98c03abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:42:39.604 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:39.190+0000 7ff9aa340700 1 --2- 172.21.15.76:0/2367175653 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff9a4106f90 0x7ff9a419c3a0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:42:39.604 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:39.190+0000 7ff9aa340700 1 -- 172.21.15.76:0/2367175653 >> 172.21.15.76:0/2367175653 conn(0x7ff9a41009c0 msgr2=0x7ff9a4101450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:42:39.604 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:39.190+0000 7ff9aa340700 1 -- 172.21.15.76:0/2367175653 shutdown_connections 2024-06-02T04:42:39.604 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:39.190+0000 7ff9aa340700 1 -- 172.21.15.76:0/2367175653 wait complete. 2024-06-02T04:42:39.604 INFO:teuthology.orchestra.run.smithi076.stdout:Waiting for the mgr to restart... 2024-06-02T04:42:39.604 INFO:teuthology.orchestra.run.smithi076.stdout:Waiting for mgr epoch 5... 2024-06-02T04:42:39.713 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Jun 02 04:42:39 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-x[43184]: 2024-06-02T04:42:39.473+0000 7f7070bbc200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-06-02T04:42:39.983 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Jun 02 04:42:39 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-x[43184]: 2024-06-02T04:42:39.747+0000 7f7070bbc200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-06-02T04:42:39.983 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Jun 02 04:42:39 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-x[43184]: 2024-06-02T04:42:39.835+0000 7f7070bbc200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-06-02T04:42:39.983 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Jun 02 04:42:39 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-x[43184]: 2024-06-02T04:42:39.950+0000 7f7070bbc200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-06-02T04:42:40.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:40 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/2367175653' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-06-02T04:42:40.483 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Jun 02 04:42:40 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-x[43184]: 2024-06-02T04:42:40.109+0000 7f7070bbc200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-06-02T04:42:40.483 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Jun 02 04:42:40 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-x[43184]: 2024-06-02T04:42:40.236+0000 7f7070bbc200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-06-02T04:42:40.483 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Jun 02 04:42:40 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-x[43184]: 2024-06-02T04:42:40.322+0000 7f7070bbc200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-06-02T04:42:40.983 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Jun 02 04:42:40 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-x[43184]: 2024-06-02T04:42:40.690+0000 7f7070bbc200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-06-02T04:42:41.363 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Jun 02 04:42:41 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-x[43184]: 2024-06-02T04:42:41.077+0000 7f7070bbc200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-06-02T04:42:41.363 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Jun 02 04:42:41 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-x[43184]: 2024-06-02T04:42:41.271+0000 7f7070bbc200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-06-02T04:42:41.363 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Jun 02 04:42:41 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-x[43184]: 2024-06-02T04:42:41.363+0000 7f7070bbc200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-06-02T04:42:42.483 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Jun 02 04:42:42 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-x[43184]: 2024-06-02T04:42:42.124+0000 7f7070bbc200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-06-02T04:42:42.483 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Jun 02 04:42:42 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-x[43184]: 2024-06-02T04:42:42.220+0000 7f7070bbc200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-06-02T04:42:42.483 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Jun 02 04:42:42 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-x[43184]: 2024-06-02T04:42:42.369+0000 7f7070bbc200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-06-02T04:42:43.372 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Jun 02 04:42:42 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-x[43184]: 2024-06-02T04:42:42.996+0000 7f7070bbc200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-06-02T04:42:43.372 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Jun 02 04:42:43 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-x[43184]: 2024-06-02T04:42:43.178+0000 7f7070bbc200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-06-02T04:42:43.733 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Jun 02 04:42:43 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-x[43184]: 2024-06-02T04:42:43.371+0000 7f7070bbc200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-06-02T04:42:44.580 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Jun 02 04:42:44 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-x[43184]: 2024-06-02T04:42:44.296+0000 7f7070bbc200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-06-02T04:42:44.858 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Jun 02 04:42:44 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-x[43184]: 2024-06-02T04:42:44.580+0000 7f7070bbc200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-06-02T04:42:44.858 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Jun 02 04:42:44 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-x[43184]: 2024-06-02T04:42:44.667+0000 7f7070bbc200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-06-02T04:42:44.858 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Jun 02 04:42:44 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-x[43184]: 2024-06-02T04:42:44.858+0000 7f7070bbc200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-06-02T04:42:45.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:44 smithi076 ceph-mon[42935]: Active manager daemon x restarted 2024-06-02T04:42:45.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:44 smithi076 ceph-mon[42935]: Activating manager daemon x 2024-06-02T04:42:45.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:44 smithi076 ceph-mon[42935]: osdmap e2: 0 total, 0 up, 0 in 2024-06-02T04:42:45.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:44 smithi076 ceph-mon[42935]: mgrmap e6: x(active, starting, since 0.00349052s) 2024-06-02T04:42:45.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:44 smithi076 ceph-mon[42935]: from='mgr.14120 172.21.15.76:0/1374455932' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-02T04:42:45.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:44 smithi076 ceph-mon[42935]: from='mgr.14120 172.21.15.76:0/1374455932' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-06-02T04:42:45.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:44 smithi076 ceph-mon[42935]: from='mgr.14120 172.21.15.76:0/1374455932' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-06-02T04:42:45.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:44 smithi076 ceph-mon[42935]: from='mgr.14120 172.21.15.76:0/1374455932' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-06-02T04:42:45.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:44 smithi076 ceph-mon[42935]: from='mgr.14120 172.21.15.76:0/1374455932' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-06-02T04:42:45.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:44 smithi076 ceph-mon[42935]: Manager daemon x is now available 2024-06-02T04:42:45.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:44 smithi076 ceph-mon[42935]: from='mgr.14120 172.21.15.76:0/1374455932' entity='mgr.x' 2024-06-02T04:42:45.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:44 smithi076 ceph-mon[42935]: from='mgr.14120 172.21.15.76:0/1374455932' entity='mgr.x' 2024-06-02T04:42:45.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:44 smithi076 ceph-mon[42935]: from='mgr.14120 172.21.15.76:0/1374455932' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:42:46.199 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:45 smithi076 ceph-mon[42935]: Found migration_current of "None". Setting to last migration. 2024-06-02T04:42:46.199 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:45 smithi076 ceph-mon[42935]: from='mgr.14120 172.21.15.76:0/1374455932' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:42:46.199 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:45 smithi076 ceph-mon[42935]: from='mgr.14120 172.21.15.76:0/1374455932' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-06-02T04:42:46.199 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:45 smithi076 ceph-mon[42935]: from='mgr.14120 172.21.15.76:0/1374455932' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-06-02T04:42:46.199 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:45 smithi076 ceph-mon[42935]: from='mgr.14120 172.21.15.76:0/1374455932' entity='mgr.x' 2024-06-02T04:42:46.199 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:45 smithi076 ceph-mon[42935]: from='mgr.14120 172.21.15.76:0/1374455932' entity='mgr.x' 2024-06-02T04:42:46.199 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:45 smithi076 ceph-mon[42935]: mgrmap e7: x(active, since 1.00545s) 2024-06-02T04:42:46.253 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout { 2024-06-02T04:42:46.253 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-06-02T04:42:46.253 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "initialized": true 2024-06-02T04:42:46.253 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout } 2024-06-02T04:42:46.254 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:39.982+0000 7f98ee5dd700 1 Processor -- start 2024-06-02T04:42:46.254 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:39.982+0000 7f98ee5dd700 1 -- start start 2024-06-02T04:42:46.254 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:39.982+0000 7f98ee5dd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f98e8106f50 0x7f98e8109340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:42:46.254 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:39.982+0000 7f98ee5dd700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98e8079ed0 con 0x7f98e8106f50 2024-06-02T04:42:46.254 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:39.983+0000 7f98e7fff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f98e8106f50 0x7f98e8109340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:42:46.254 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:39.983+0000 7f98e7fff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f98e8106f50 0x7f98e8109340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:38744/0 (socket says 172.21.15.76:38744) 2024-06-02T04:42:46.254 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:39.983+0000 7f98e7fff700 1 -- 172.21.15.76:0/3301419895 learned_addr learned my addr 172.21.15.76:0/3301419895 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:42:46.254 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:39.983+0000 7f98e7fff700 1 -- 172.21.15.76:0/3301419895 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98e8109880 con 0x7f98e8106f50 2024-06-02T04:42:46.254 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:39.983+0000 7f98e7fff700 1 --2- 172.21.15.76:0/3301419895 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f98e8106f50 0x7f98e8109340 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f98d80098a0 tx=0x7f98d8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9b513889759eec2 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:42:46.254 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:39.983+0000 7f98e6ffd700 1 -- 172.21.15.76:0/3301419895 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f98d8004160 con 0x7f98e8106f50 2024-06-02T04:42:46.254 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:39.983+0000 7f98e6ffd700 1 -- 172.21.15.76:0/3301419895 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f98d80042c0 con 0x7f98e8106f50 2024-06-02T04:42:46.254 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:39.983+0000 7f98e6ffd700 1 -- 172.21.15.76:0/3301419895 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f98d8011940 con 0x7f98e8106f50 2024-06-02T04:42:46.255 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:39.984+0000 7f98ee5dd700 1 -- 172.21.15.76:0/3301419895 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f98e8106f50 msgr2=0x7f98e8109340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:42:46.255 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:39.984+0000 7f98ee5dd700 1 --2- 172.21.15.76:0/3301419895 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f98e8106f50 0x7f98e8109340 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f98d80098a0 tx=0x7f98d8009bb0 comp rx=0 tx=0).stop 2024-06-02T04:42:46.255 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:39.984+0000 7f98ee5dd700 1 -- 172.21.15.76:0/3301419895 shutdown_connections 2024-06-02T04:42:46.255 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:39.984+0000 7f98ee5dd700 1 --2- 172.21.15.76:0/3301419895 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f98e8106f50 0x7f98e8109340 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:42:46.255 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:39.984+0000 7f98ee5dd700 1 -- 172.21.15.76:0/3301419895 >> 172.21.15.76:0/3301419895 conn(0x7f98e81009c0 msgr2=0x7f98e8102de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:42:46.255 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:39.984+0000 7f98ee5dd700 1 -- 172.21.15.76:0/3301419895 shutdown_connections 2024-06-02T04:42:46.255 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:39.984+0000 7f98ee5dd700 1 -- 172.21.15.76:0/3301419895 wait complete. 2024-06-02T04:42:46.255 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:39.985+0000 7f98ee5dd700 1 Processor -- start 2024-06-02T04:42:46.255 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:39.985+0000 7f98ee5dd700 1 -- start start 2024-06-02T04:42:46.255 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:39.985+0000 7f98ee5dd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f98e8106f50 0x7f98e8106780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:42:46.255 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:39.985+0000 7f98ee5dd700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98e8106cc0 con 0x7f98e8106f50 2024-06-02T04:42:46.255 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:39.985+0000 7f98e7fff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f98e8106f50 0x7f98e8106780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:42:46.255 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:39.985+0000 7f98e7fff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f98e8106f50 0x7f98e8106780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:38746/0 (socket says 172.21.15.76:38746) 2024-06-02T04:42:46.256 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:39.985+0000 7f98e7fff700 1 -- 172.21.15.76:0/1155308540 learned_addr learned my addr 172.21.15.76:0/1155308540 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:42:46.256 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:39.985+0000 7f98e7fff700 1 -- 172.21.15.76:0/1155308540 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98d8009550 con 0x7f98e8106f50 2024-06-02T04:42:46.256 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:39.985+0000 7f98e7fff700 1 --2- 172.21.15.76:0/1155308540 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f98e8106f50 0x7f98e8106780 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f98d8006af0 tx=0x7f98d8011a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:42:46.256 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:39.986+0000 7f98e57fa700 1 -- 172.21.15.76:0/1155308540 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f98d8003bf0 con 0x7f98e8106f50 2024-06-02T04:42:46.256 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:39.986+0000 7f98e57fa700 1 -- 172.21.15.76:0/1155308540 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f98d801b8b0 con 0x7f98e8106f50 2024-06-02T04:42:46.256 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:39.986+0000 7f98ee5dd700 1 -- 172.21.15.76:0/1155308540 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98e8104f00 con 0x7f98e8106f50 2024-06-02T04:42:46.256 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:39.986+0000 7f98e57fa700 1 -- 172.21.15.76:0/1155308540 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f98d8023800 con 0x7f98e8106f50 2024-06-02T04:42:46.256 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:39.986+0000 7f98ee5dd700 1 -- 172.21.15.76:0/1155308540 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98e81053a0 con 0x7f98e8106f50 2024-06-02T04:42:46.256 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:39.987+0000 7f98e57fa700 1 -- 172.21.15.76:0/1155308540 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 45541+0+0 (secure 0 0 0) 0x7f98d801ba20 con 0x7f98e8106f50 2024-06-02T04:42:46.256 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:39.987+0000 7f98e57fa700 1 --2- 172.21.15.76:0/1155308540 >> [v2:172.21.15.76:6800/2550846765,v1:172.21.15.76:6801/2550846765] conn(0x7f98d00386b0 0x7f98d003ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:42:46.256 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:39.987+0000 7f98e57fa700 1 -- 172.21.15.76:0/1155308540 --> [v2:172.21.15.76:6800/2550846765,v1:172.21.15.76:6801/2550846765] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f98d003b280 con 0x7f98d00386b0 2024-06-02T04:42:46.256 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:39.987+0000 7f98e57fa700 1 -- 172.21.15.76:0/1155308540 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f98d804cc50 con 0x7f98e8106f50 2024-06-02T04:42:46.256 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:39.987+0000 7f98e77fe700 1 -- 172.21.15.76:0/1155308540 >> [v2:172.21.15.76:6800/2550846765,v1:172.21.15.76:6801/2550846765] conn(0x7f98d00386b0 msgr2=0x7f98d003ab70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.76:6800/2550846765 2024-06-02T04:42:46.257 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:39.987+0000 7f98e77fe700 1 --2- 172.21.15.76:0/1155308540 >> [v2:172.21.15.76:6800/2550846765,v1:172.21.15.76:6801/2550846765] conn(0x7f98d00386b0 0x7f98d003ab70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-06-02T04:42:46.257 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:40.188+0000 7f98e77fe700 1 -- 172.21.15.76:0/1155308540 >> [v2:172.21.15.76:6800/2550846765,v1:172.21.15.76:6801/2550846765] conn(0x7f98d00386b0 msgr2=0x7f98d003ab70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.76:6800/2550846765 2024-06-02T04:42:46.257 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:40.188+0000 7f98e77fe700 1 --2- 172.21.15.76:0/1155308540 >> [v2:172.21.15.76:6800/2550846765,v1:172.21.15.76:6801/2550846765] conn(0x7f98d00386b0 0x7f98d003ab70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-06-02T04:42:46.257 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:40.589+0000 7f98e77fe700 1 -- 172.21.15.76:0/1155308540 >> [v2:172.21.15.76:6800/2550846765,v1:172.21.15.76:6801/2550846765] conn(0x7f98d00386b0 msgr2=0x7f98d003ab70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.76:6800/2550846765 2024-06-02T04:42:46.257 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:40.589+0000 7f98e77fe700 1 --2- 172.21.15.76:0/1155308540 >> [v2:172.21.15.76:6800/2550846765,v1:172.21.15.76:6801/2550846765] conn(0x7f98d00386b0 0x7f98d003ab70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-06-02T04:42:46.257 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:41.390+0000 7f98e77fe700 1 -- 172.21.15.76:0/1155308540 >> [v2:172.21.15.76:6800/2550846765,v1:172.21.15.76:6801/2550846765] conn(0x7f98d00386b0 msgr2=0x7f98d003ab70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.76:6800/2550846765 2024-06-02T04:42:46.257 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:41.390+0000 7f98e77fe700 1 --2- 172.21.15.76:0/1155308540 >> [v2:172.21.15.76:6800/2550846765,v1:172.21.15.76:6801/2550846765] conn(0x7f98d00386b0 0x7f98d003ab70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-06-02T04:42:46.257 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:42.991+0000 7f98e77fe700 1 -- 172.21.15.76:0/1155308540 >> [v2:172.21.15.76:6800/2550846765,v1:172.21.15.76:6801/2550846765] conn(0x7f98d00386b0 msgr2=0x7f98d003ab70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.76:6800/2550846765 2024-06-02T04:42:46.257 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:42.991+0000 7f98e77fe700 1 --2- 172.21.15.76:0/1155308540 >> [v2:172.21.15.76:6800/2550846765,v1:172.21.15.76:6801/2550846765] conn(0x7f98d00386b0 0x7f98d003ab70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-06-02T04:42:46.257 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:44.873+0000 7f98e57fa700 1 -- 172.21.15.76:0/1155308540 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mgrmap(e 6) v1 ==== 45308+0+0 (secure 0 0 0) 0x7f98d801b440 con 0x7f98e8106f50 2024-06-02T04:42:46.257 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:44.873+0000 7f98e57fa700 1 -- 172.21.15.76:0/1155308540 >> [v2:172.21.15.76:6800/2550846765,v1:172.21.15.76:6801/2550846765] conn(0x7f98d00386b0 msgr2=0x7f98d003ab70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-02T04:42:46.257 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:44.873+0000 7f98e57fa700 1 --2- 172.21.15.76:0/1155308540 >> [v2:172.21.15.76:6800/2550846765,v1:172.21.15.76:6801/2550846765] conn(0x7f98d00386b0 0x7f98d003ab70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:42:46.258 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:45.874+0000 7f98e57fa700 1 -- 172.21.15.76:0/1155308540 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mgrmap(e 7) v1 ==== 45435+0+0 (secure 0 0 0) 0x7f98d800b3e0 con 0x7f98e8106f50 2024-06-02T04:42:46.258 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:45.874+0000 7f98e57fa700 1 --2- 172.21.15.76:0/1155308540 >> [v2:172.21.15.76:6800/4200406736,v1:172.21.15.76:6801/4200406736] conn(0x7f98d003bfe0 0x7f98d003e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:42:46.258 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:45.874+0000 7f98e57fa700 1 -- 172.21.15.76:0/1155308540 --> [v2:172.21.15.76:6800/4200406736,v1:172.21.15.76:6801/4200406736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f98d003b280 con 0x7f98d003bfe0 2024-06-02T04:42:46.258 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:45.875+0000 7f98e77fe700 1 --2- 172.21.15.76:0/1155308540 >> [v2:172.21.15.76:6800/4200406736,v1:172.21.15.76:6801/4200406736] conn(0x7f98d003bfe0 0x7f98d003e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:42:46.258 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:45.875+0000 7f98e77fe700 1 --2- 172.21.15.76:0/1155308540 >> [v2:172.21.15.76:6800/4200406736,v1:172.21.15.76:6801/4200406736] conn(0x7f98d003bfe0 0x7f98d003e3d0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f98dc003a10 tx=0x7f98dc009290 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:42:46.258 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:45.876+0000 7f98e57fa700 1 -- 172.21.15.76:0/1155308540 <== mgr.14120 v2:172.21.15.76:6800/4200406736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+7774 (secure 0 0 0) 0x7f98d003b280 con 0x7f98d003bfe0 2024-06-02T04:42:46.258 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:45.882+0000 7f98ee5dd700 1 -- 172.21.15.76:0/1155308540 --> [v2:172.21.15.76:6800/4200406736,v1:172.21.15.76:6801/4200406736] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f98e80625d0 con 0x7f98d003bfe0 2024-06-02T04:42:46.258 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:45.882+0000 7f98e57fa700 1 -- 172.21.15.76:0/1155308540 <== mgr.14120 v2:172.21.15.76:6800/4200406736 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f98e80625d0 con 0x7f98d003bfe0 2024-06-02T04:42:46.258 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:45.883+0000 7f98ee5dd700 1 -- 172.21.15.76:0/1155308540 >> [v2:172.21.15.76:6800/4200406736,v1:172.21.15.76:6801/4200406736] conn(0x7f98d003bfe0 msgr2=0x7f98d003e3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:42:46.258 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:45.883+0000 7f98ee5dd700 1 --2- 172.21.15.76:0/1155308540 >> [v2:172.21.15.76:6800/4200406736,v1:172.21.15.76:6801/4200406736] conn(0x7f98d003bfe0 0x7f98d003e3d0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f98dc003a10 tx=0x7f98dc009290 comp rx=0 tx=0).stop 2024-06-02T04:42:46.258 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:45.883+0000 7f98ee5dd700 1 -- 172.21.15.76:0/1155308540 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f98e8106f50 msgr2=0x7f98e8106780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:42:46.258 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:45.883+0000 7f98ee5dd700 1 --2- 172.21.15.76:0/1155308540 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f98e8106f50 0x7f98e8106780 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f98d8006af0 tx=0x7f98d8011a50 comp rx=0 tx=0).stop 2024-06-02T04:42:46.259 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:45.883+0000 7f98ee5dd700 1 -- 172.21.15.76:0/1155308540 shutdown_connections 2024-06-02T04:42:46.259 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:45.883+0000 7f98ee5dd700 1 --2- 172.21.15.76:0/1155308540 >> [v2:172.21.15.76:6800/4200406736,v1:172.21.15.76:6801/4200406736] conn(0x7f98d003bfe0 0x7f98d003e3d0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:42:46.259 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:45.883+0000 7f98ee5dd700 1 --2- 172.21.15.76:0/1155308540 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f98e8106f50 0x7f98e8106780 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:42:46.259 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:45.883+0000 7f98ee5dd700 1 --2- 172.21.15.76:0/1155308540 >> [v2:172.21.15.76:6800/2550846765,v1:172.21.15.76:6801/2550846765] conn(0x7f98d00386b0 0x7f98d003ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:42:46.259 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:45.883+0000 7f98ee5dd700 1 -- 172.21.15.76:0/1155308540 >> 172.21.15.76:0/1155308540 conn(0x7f98e81009c0 msgr2=0x7f98e81014f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:42:46.259 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:45.883+0000 7f98ee5dd700 1 -- 172.21.15.76:0/1155308540 shutdown_connections 2024-06-02T04:42:46.259 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:45.883+0000 7f98ee5dd700 1 -- 172.21.15.76:0/1155308540 wait complete. 2024-06-02T04:42:46.259 INFO:teuthology.orchestra.run.smithi076.stdout:mgr epoch 5 is available 2024-06-02T04:42:46.259 INFO:teuthology.orchestra.run.smithi076.stdout:Setting orchestrator backend to cephadm... 2024-06-02T04:42:47.140 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:46 smithi076 ceph-mon[42935]: [02/Jun/2024:04:42:45] ENGINE Bus STARTING 2024-06-02T04:42:47.141 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:46 smithi076 ceph-mon[42935]: [02/Jun/2024:04:42:45] ENGINE Serving on http://172.21.15.76:8765 2024-06-02T04:42:47.141 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:46 smithi076 ceph-mon[42935]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-06-02T04:42:47.141 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:46 smithi076 ceph-mon[42935]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-06-02T04:42:47.141 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:46 smithi076 ceph-mon[42935]: [02/Jun/2024:04:42:45] ENGINE Serving on https://172.21.15.76:7150 2024-06-02T04:42:47.141 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:46 smithi076 ceph-mon[42935]: [02/Jun/2024:04:42:45] ENGINE Bus STARTED 2024-06-02T04:42:47.141 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:46 smithi076 ceph-mon[42935]: from='mgr.14120 172.21.15.76:0/1374455932' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:42:47.141 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:46 smithi076 ceph-mon[42935]: from='mgr.14120 172.21.15.76:0/1374455932' entity='mgr.x' 2024-06-02T04:42:47.141 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:46 smithi076 ceph-mon[42935]: from='mgr.14120 172.21.15.76:0/1374455932' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:42:47.176 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:46.586+0000 7fefa8e72700 1 Processor -- start 2024-06-02T04:42:47.176 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:46.586+0000 7fefa8e72700 1 -- start start 2024-06-02T04:42:47.176 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:46.586+0000 7fefa8e72700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fefa4106f70 0x7fefa4109360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:42:47.176 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:46.586+0000 7fefa8e72700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefa4079e90 con 0x7fefa4106f70 2024-06-02T04:42:47.176 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:46.586+0000 7fefa259c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fefa4106f70 0x7fefa4109360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:42:47.176 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:46.586+0000 7fefa259c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fefa4106f70 0x7fefa4109360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:45574/0 (socket says 172.21.15.76:45574) 2024-06-02T04:42:47.176 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:46.586+0000 7fefa259c700 1 -- 172.21.15.76:0/890946127 learned_addr learned my addr 172.21.15.76:0/890946127 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:42:47.177 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:46.587+0000 7fefa259c700 1 -- 172.21.15.76:0/890946127 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefa41098a0 con 0x7fefa4106f70 2024-06-02T04:42:47.177 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:46.587+0000 7fefa259c700 1 --2- 172.21.15.76:0/890946127 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fefa4106f70 0x7fefa4109360 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fef940098a0 tx=0x7fef94009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82fbe892c4d683bf server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:42:47.177 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:46.587+0000 7fefa159a700 1 -- 172.21.15.76:0/890946127 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fef94004160 con 0x7fefa4106f70 2024-06-02T04:42:47.177 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:46.587+0000 7fefa159a700 1 -- 172.21.15.76:0/890946127 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fef940042c0 con 0x7fefa4106f70 2024-06-02T04:42:47.177 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:46.587+0000 7fefa159a700 1 -- 172.21.15.76:0/890946127 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fef94011940 con 0x7fefa4106f70 2024-06-02T04:42:47.177 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:46.587+0000 7fefa8e72700 1 -- 172.21.15.76:0/890946127 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fefa4106f70 msgr2=0x7fefa4109360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:42:47.177 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:46.587+0000 7fefa8e72700 1 --2- 172.21.15.76:0/890946127 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fefa4106f70 0x7fefa4109360 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fef940098a0 tx=0x7fef94009bb0 comp rx=0 tx=0).stop 2024-06-02T04:42:47.177 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:46.588+0000 7fefa8e72700 1 -- 172.21.15.76:0/890946127 shutdown_connections 2024-06-02T04:42:47.177 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:46.588+0000 7fefa8e72700 1 --2- 172.21.15.76:0/890946127 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fefa4106f70 0x7fefa4109360 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:42:47.177 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:46.588+0000 7fefa8e72700 1 -- 172.21.15.76:0/890946127 >> 172.21.15.76:0/890946127 conn(0x7fefa4100980 msgr2=0x7fefa4102da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:42:47.177 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:46.588+0000 7fefa8e72700 1 -- 172.21.15.76:0/890946127 shutdown_connections 2024-06-02T04:42:47.177 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:46.588+0000 7fefa8e72700 1 -- 172.21.15.76:0/890946127 wait complete. 2024-06-02T04:42:47.177 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:46.588+0000 7fefa8e72700 1 Processor -- start 2024-06-02T04:42:47.178 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:46.588+0000 7fefa8e72700 1 -- start start 2024-06-02T04:42:47.178 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:46.589+0000 7fefa8e72700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fefa4106f70 0x7fefa41067a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:42:47.178 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:46.589+0000 7fefa8e72700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefa4106ce0 con 0x7fefa4106f70 2024-06-02T04:42:47.178 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:46.589+0000 7fefa259c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fefa4106f70 0x7fefa41067a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:42:47.178 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:46.589+0000 7fefa259c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fefa4106f70 0x7fefa41067a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:45584/0 (socket says 172.21.15.76:45584) 2024-06-02T04:42:47.178 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:46.589+0000 7fefa259c700 1 -- 172.21.15.76:0/1180695301 learned_addr learned my addr 172.21.15.76:0/1180695301 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:42:47.178 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:46.589+0000 7fefa259c700 1 -- 172.21.15.76:0/1180695301 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef94009550 con 0x7fefa4106f70 2024-06-02T04:42:47.178 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:46.589+0000 7fefa259c700 1 --2- 172.21.15.76:0/1180695301 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fefa4106f70 0x7fefa41067a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fef94006af0 tx=0x7fef94011a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:42:47.178 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:46.589+0000 7fef937fe700 1 -- 172.21.15.76:0/1180695301 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fef94003bf0 con 0x7fefa4106f70 2024-06-02T04:42:47.178 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:46.589+0000 7fef937fe700 1 -- 172.21.15.76:0/1180695301 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fef9401b8b0 con 0x7fefa4106f70 2024-06-02T04:42:47.178 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:46.589+0000 7fefa8e72700 1 -- 172.21.15.76:0/1180695301 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefa4104f20 con 0x7fefa4106f70 2024-06-02T04:42:47.178 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:46.589+0000 7fef937fe700 1 -- 172.21.15.76:0/1180695301 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fef94023800 con 0x7fefa4106f70 2024-06-02T04:42:47.179 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:46.589+0000 7fefa8e72700 1 -- 172.21.15.76:0/1180695301 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefa41053c0 con 0x7fefa4106f70 2024-06-02T04:42:47.179 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:46.590+0000 7fef937fe700 1 -- 172.21.15.76:0/1180695301 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 7) v1 ==== 45435+0+0 (secure 0 0 0) 0x7fef9401b440 con 0x7fefa4106f70 2024-06-02T04:42:47.179 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:46.590+0000 7fefa8e72700 1 -- 172.21.15.76:0/1180695301 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefa410a5e0 con 0x7fefa4106f70 2024-06-02T04:42:47.179 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:46.590+0000 7fef937fe700 1 --2- 172.21.15.76:0/1180695301 >> [v2:172.21.15.76:6800/4200406736,v1:172.21.15.76:6801/4200406736] conn(0x7fef8c038590 0x7fef8c03aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:42:47.179 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:46.590+0000 7fef937fe700 1 -- 172.21.15.76:0/1180695301 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fef9404ca90 con 0x7fefa4106f70 2024-06-02T04:42:47.179 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:46.591+0000 7fefa1d9b700 1 --2- 172.21.15.76:0/1180695301 >> [v2:172.21.15.76:6800/4200406736,v1:172.21.15.76:6801/4200406736] conn(0x7fef8c038590 0x7fef8c03aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:42:47.179 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:46.591+0000 7fefa1d9b700 1 --2- 172.21.15.76:0/1180695301 >> [v2:172.21.15.76:6800/4200406736,v1:172.21.15.76:6801/4200406736] conn(0x7fef8c038590 0x7fef8c03aa50 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fef98006fd0 tx=0x7fef98006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:42:47.179 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:46.595+0000 7fef937fe700 1 -- 172.21.15.76:0/1180695301 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fef9402c3f0 con 0x7fefa4106f70 2024-06-02T04:42:47.179 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:46.805+0000 7fefa8e72700 1 -- 172.21.15.76:0/1180695301 --> [v2:172.21.15.76:6800/4200406736,v1:172.21.15.76:6801/4200406736] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7fefa4105bb0 con 0x7fef8c038590 2024-06-02T04:42:47.179 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:46.813+0000 7fef937fe700 1 -- 172.21.15.76:0/1180695301 <== mgr.14120 v2:172.21.15.76:6800/4200406736 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fefa4105bb0 con 0x7fef8c038590 2024-06-02T04:42:47.179 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:46.816+0000 7fefa8e72700 1 -- 172.21.15.76:0/1180695301 >> [v2:172.21.15.76:6800/4200406736,v1:172.21.15.76:6801/4200406736] conn(0x7fef8c038590 msgr2=0x7fef8c03aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:42:47.179 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:46.816+0000 7fefa8e72700 1 --2- 172.21.15.76:0/1180695301 >> [v2:172.21.15.76:6800/4200406736,v1:172.21.15.76:6801/4200406736] conn(0x7fef8c038590 0x7fef8c03aa50 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fef98006fd0 tx=0x7fef98006e40 comp rx=0 tx=0).stop 2024-06-02T04:42:47.179 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:46.816+0000 7fefa8e72700 1 -- 172.21.15.76:0/1180695301 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fefa4106f70 msgr2=0x7fefa41067a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:42:47.180 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:46.816+0000 7fefa8e72700 1 --2- 172.21.15.76:0/1180695301 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fefa4106f70 0x7fefa41067a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fef94006af0 tx=0x7fef94011a50 comp rx=0 tx=0).stop 2024-06-02T04:42:47.180 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:46.816+0000 7fefa8e72700 1 -- 172.21.15.76:0/1180695301 shutdown_connections 2024-06-02T04:42:47.180 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:46.816+0000 7fefa8e72700 1 --2- 172.21.15.76:0/1180695301 >> [v2:172.21.15.76:6800/4200406736,v1:172.21.15.76:6801/4200406736] conn(0x7fef8c038590 0x7fef8c03aa50 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:42:47.180 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:46.816+0000 7fefa8e72700 1 --2- 172.21.15.76:0/1180695301 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fefa4106f70 0x7fefa41067a0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:42:47.180 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:46.816+0000 7fefa8e72700 1 -- 172.21.15.76:0/1180695301 >> 172.21.15.76:0/1180695301 conn(0x7fefa4100980 msgr2=0x7fefa4101470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:42:47.180 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:46.816+0000 7fefa8e72700 1 -- 172.21.15.76:0/1180695301 shutdown_connections 2024-06-02T04:42:47.180 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:46.816+0000 7fefa8e72700 1 -- 172.21.15.76:0/1180695301 wait complete. 2024-06-02T04:42:48.015 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:47 smithi076 ceph-mon[42935]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:42:48.015 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:47 smithi076 ceph-mon[42935]: mgrmap e8: x(active, since 2s) 2024-06-02T04:42:48.076 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout value unchanged 2024-06-02T04:42:48.077 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:47.511+0000 7f2f04d5a700 1 Processor -- start 2024-06-02T04:42:48.077 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:47.511+0000 7f2f04d5a700 1 -- start start 2024-06-02T04:42:48.077 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:47.511+0000 7f2f04d5a700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2f00104de0 0x7f2f00105200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:42:48.077 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:47.511+0000 7f2f04d5a700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f00079e30 con 0x7f2f00104de0 2024-06-02T04:42:48.077 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:47.511+0000 7f2efe59c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2f00104de0 0x7f2f00105200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:42:48.077 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:47.511+0000 7f2efe59c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2f00104de0 0x7f2f00105200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:45586/0 (socket says 172.21.15.76:45586) 2024-06-02T04:42:48.077 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:47.511+0000 7f2efe59c700 1 -- 172.21.15.76:0/3431553418 learned_addr learned my addr 172.21.15.76:0/3431553418 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:42:48.077 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:47.512+0000 7f2efe59c700 1 -- 172.21.15.76:0/3431553418 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f00079f70 con 0x7f2f00104de0 2024-06-02T04:42:48.077 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:47.512+0000 7f2efe59c700 1 --2- 172.21.15.76:0/3431553418 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2f00104de0 0x7f2f00105200 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2ef00098a0 tx=0x7f2ef0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aeaeb1c5e37d897 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:42:48.077 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:47.512+0000 7f2efd59a700 1 -- 172.21.15.76:0/3431553418 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2ef0004160 con 0x7f2f00104de0 2024-06-02T04:42:48.078 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:47.512+0000 7f2efd59a700 1 -- 172.21.15.76:0/3431553418 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f2ef00042c0 con 0x7f2f00104de0 2024-06-02T04:42:48.078 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:47.512+0000 7f2efd59a700 1 -- 172.21.15.76:0/3431553418 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2ef0011940 con 0x7f2f00104de0 2024-06-02T04:42:48.078 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:47.512+0000 7f2f04d5a700 1 -- 172.21.15.76:0/3431553418 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2f00104de0 msgr2=0x7f2f00105200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:42:48.078 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:47.512+0000 7f2f04d5a700 1 --2- 172.21.15.76:0/3431553418 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2f00104de0 0x7f2f00105200 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2ef00098a0 tx=0x7f2ef0009bb0 comp rx=0 tx=0).stop 2024-06-02T04:42:48.078 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:47.512+0000 7f2f04d5a700 1 -- 172.21.15.76:0/3431553418 shutdown_connections 2024-06-02T04:42:48.078 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:47.512+0000 7f2f04d5a700 1 --2- 172.21.15.76:0/3431553418 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2f00104de0 0x7f2f00105200 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:42:48.078 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:47.512+0000 7f2f04d5a700 1 -- 172.21.15.76:0/3431553418 >> 172.21.15.76:0/3431553418 conn(0x7f2f001009c0 msgr2=0x7f2f00102de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:42:48.078 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:47.512+0000 7f2f04d5a700 1 -- 172.21.15.76:0/3431553418 shutdown_connections 2024-06-02T04:42:48.078 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:47.513+0000 7f2f04d5a700 1 -- 172.21.15.76:0/3431553418 wait complete. 2024-06-02T04:42:48.078 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:47.513+0000 7f2f04d5a700 1 Processor -- start 2024-06-02T04:42:48.078 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:47.513+0000 7f2f04d5a700 1 -- start start 2024-06-02T04:42:48.078 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:47.513+0000 7f2f04d5a700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2f00104de0 0x7f2f0019c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:42:48.078 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:47.513+0000 7f2f04d5a700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f0019c890 con 0x7f2f00104de0 2024-06-02T04:42:48.079 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:47.513+0000 7f2efe59c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2f00104de0 0x7f2f0019c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:42:48.079 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:47.514+0000 7f2efe59c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2f00104de0 0x7f2f0019c350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:45594/0 (socket says 172.21.15.76:45594) 2024-06-02T04:42:48.079 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:47.514+0000 7f2efe59c700 1 -- 172.21.15.76:0/315551066 learned_addr learned my addr 172.21.15.76:0/315551066 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:42:48.079 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:47.514+0000 7f2efe59c700 1 -- 172.21.15.76:0/315551066 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ef0009550 con 0x7f2f00104de0 2024-06-02T04:42:48.079 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:47.514+0000 7f2efe59c700 1 --2- 172.21.15.76:0/315551066 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2f00104de0 0x7f2f0019c350 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2ef0006af0 tx=0x7f2ef0011a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:42:48.079 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:47.514+0000 7f2eef7fe700 1 -- 172.21.15.76:0/315551066 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2ef0003bf0 con 0x7f2f00104de0 2024-06-02T04:42:48.079 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:47.514+0000 7f2eef7fe700 1 -- 172.21.15.76:0/315551066 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f2ef001b8b0 con 0x7f2f00104de0 2024-06-02T04:42:48.079 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:47.514+0000 7f2eef7fe700 1 -- 172.21.15.76:0/315551066 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2ef0023800 con 0x7f2f00104de0 2024-06-02T04:42:48.079 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:47.514+0000 7f2f04d5a700 1 -- 172.21.15.76:0/315551066 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f0019ca90 con 0x7f2f00104de0 2024-06-02T04:42:48.079 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:47.514+0000 7f2f04d5a700 1 -- 172.21.15.76:0/315551066 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f0019cf30 con 0x7f2f00104de0 2024-06-02T04:42:48.079 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:47.515+0000 7f2eef7fe700 1 -- 172.21.15.76:0/315551066 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 7) v1 ==== 45435+0+0 (secure 0 0 0) 0x7f2ef0023a70 con 0x7f2f00104de0 2024-06-02T04:42:48.079 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:47.515+0000 7f2eef7fe700 1 --2- 172.21.15.76:0/315551066 >> [v2:172.21.15.76:6800/4200406736,v1:172.21.15.76:6801/4200406736] conn(0x7f2ee8038590 0x7f2ee803aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:42:48.080 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:47.515+0000 7f2f04d5a700 1 -- 172.21.15.76:0/315551066 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f001960c0 con 0x7f2f00104de0 2024-06-02T04:42:48.080 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:47.515+0000 7f2eef7fe700 1 -- 172.21.15.76:0/315551066 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f2ef004ca00 con 0x7f2f00104de0 2024-06-02T04:42:48.080 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:47.515+0000 7f2efdd9b700 1 --2- 172.21.15.76:0/315551066 >> [v2:172.21.15.76:6800/4200406736,v1:172.21.15.76:6801/4200406736] conn(0x7f2ee8038590 0x7f2ee803aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:42:48.080 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:47.516+0000 7f2efdd9b700 1 --2- 172.21.15.76:0/315551066 >> [v2:172.21.15.76:6800/4200406736,v1:172.21.15.76:6801/4200406736] conn(0x7f2ee8038590 0x7f2ee803aa50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2ef4006fd0 tx=0x7f2ef4006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:42:48.080 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:47.520+0000 7f2eef7fe700 1 -- 172.21.15.76:0/315551066 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f2ef0018760 con 0x7f2f00104de0 2024-06-02T04:42:48.080 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:47.713+0000 7f2f04d5a700 1 -- 172.21.15.76:0/315551066 --> [v2:172.21.15.76:6800/4200406736,v1:172.21.15.76:6801/4200406736] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7f2f0002d010 con 0x7f2ee8038590 2024-06-02T04:42:48.080 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:47.713+0000 7f2eef7fe700 1 -- 172.21.15.76:0/315551066 <== mgr.14120 v2:172.21.15.76:6800/4200406736 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7f2f0002d010 con 0x7f2ee8038590 2024-06-02T04:42:48.080 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:47.715+0000 7f2f04d5a700 1 -- 172.21.15.76:0/315551066 >> [v2:172.21.15.76:6800/4200406736,v1:172.21.15.76:6801/4200406736] conn(0x7f2ee8038590 msgr2=0x7f2ee803aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:42:48.080 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:47.715+0000 7f2f04d5a700 1 --2- 172.21.15.76:0/315551066 >> [v2:172.21.15.76:6800/4200406736,v1:172.21.15.76:6801/4200406736] conn(0x7f2ee8038590 0x7f2ee803aa50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2ef4006fd0 tx=0x7f2ef4006e40 comp rx=0 tx=0).stop 2024-06-02T04:42:48.080 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:47.715+0000 7f2f04d5a700 1 -- 172.21.15.76:0/315551066 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2f00104de0 msgr2=0x7f2f0019c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:42:48.080 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:47.715+0000 7f2f04d5a700 1 --2- 172.21.15.76:0/315551066 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2f00104de0 0x7f2f0019c350 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2ef0006af0 tx=0x7f2ef0011a50 comp rx=0 tx=0).stop 2024-06-02T04:42:48.081 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:47.715+0000 7f2f04d5a700 1 -- 172.21.15.76:0/315551066 shutdown_connections 2024-06-02T04:42:48.081 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:47.715+0000 7f2f04d5a700 1 --2- 172.21.15.76:0/315551066 >> [v2:172.21.15.76:6800/4200406736,v1:172.21.15.76:6801/4200406736] conn(0x7f2ee8038590 0x7f2ee803aa50 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:42:48.081 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:47.715+0000 7f2f04d5a700 1 --2- 172.21.15.76:0/315551066 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2f00104de0 0x7f2f0019c350 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:42:48.081 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:47.715+0000 7f2f04d5a700 1 -- 172.21.15.76:0/315551066 >> 172.21.15.76:0/315551066 conn(0x7f2f001009c0 msgr2=0x7f2f00193200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:42:48.081 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:47.716+0000 7f2f04d5a700 1 -- 172.21.15.76:0/315551066 shutdown_connections 2024-06-02T04:42:48.081 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:47.716+0000 7f2f04d5a700 1 -- 172.21.15.76:0/315551066 wait complete. 2024-06-02T04:42:48.081 INFO:teuthology.orchestra.run.smithi076.stdout:Generating ssh key... 2024-06-02T04:42:48.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:48 smithi076 ceph-mon[42935]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:42:48.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:48 smithi076 ceph-mon[42935]: from='mgr.14120 172.21.15.76:0/1374455932' entity='mgr.x' 2024-06-02T04:42:48.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:48 smithi076 ceph-mon[42935]: from='mgr.14120 172.21.15.76:0/1374455932' entity='mgr.x' 2024-06-02T04:42:48.983 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Jun 02 04:42:48 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-x[43184]: Generating public/private rsa key pair. 2024-06-02T04:42:48.983 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Jun 02 04:42:48 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-x[43184]: Your identification has been saved in /tmp/tmpgk2f786_/key. 2024-06-02T04:42:48.984 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Jun 02 04:42:48 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-x[43184]: Your public key has been saved in /tmp/tmpgk2f786_/key.pub. 2024-06-02T04:42:48.984 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Jun 02 04:42:48 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-x[43184]: The key fingerprint is: 2024-06-02T04:42:48.984 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Jun 02 04:42:48 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-x[43184]: SHA256:9540soiXG4biCCJQdGDKHH0g5QYN/Dsrg4d5zP+DdYQ ceph-60ab6d30-209a-11ef-bc9b-c7b262605968 2024-06-02T04:42:48.984 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Jun 02 04:42:48 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-x[43184]: The key's randomart image is: 2024-06-02T04:42:48.984 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Jun 02 04:42:48 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-x[43184]: +---[RSA 3072]----+ 2024-06-02T04:42:48.984 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Jun 02 04:42:48 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-x[43184]: |.=O+o | 2024-06-02T04:42:48.984 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Jun 02 04:42:48 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-x[43184]: |o==+ . | 2024-06-02T04:42:48.984 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Jun 02 04:42:48 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-x[43184]: |.ooo. . | 2024-06-02T04:42:48.984 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Jun 02 04:42:48 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-x[43184]: | ... E . | 2024-06-02T04:42:48.984 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Jun 02 04:42:48 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-x[43184]: |. . .S . | 2024-06-02T04:42:48.984 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Jun 02 04:42:48 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-x[43184]: |. o .... . | 2024-06-02T04:42:48.984 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Jun 02 04:42:48 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-x[43184]: |== +o..o.. + | 2024-06-02T04:42:48.984 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Jun 02 04:42:48 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-x[43184]: |*+=+...ooo = o | 2024-06-02T04:42:48.985 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Jun 02 04:42:48 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-x[43184]: | o+.o.ooo.. o | 2024-06-02T04:42:48.985 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Jun 02 04:42:48 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-x[43184]: +----[SHA256]-----+ 2024-06-02T04:42:49.076 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:48.426+0000 7f0694b06700 1 Processor -- start 2024-06-02T04:42:49.077 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:48.426+0000 7f0694b06700 1 -- start start 2024-06-02T04:42:49.077 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:48.427+0000 7f0694b06700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0690106f90 0x7f0690109380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:42:49.077 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:48.427+0000 7f0694b06700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0690079e90 con 0x7f0690106f90 2024-06-02T04:42:49.077 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:48.427+0000 7f068e59c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0690106f90 0x7f0690109380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:42:49.077 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:48.427+0000 7f068e59c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0690106f90 0x7f0690109380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:45596/0 (socket says 172.21.15.76:45596) 2024-06-02T04:42:49.077 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:48.427+0000 7f068e59c700 1 -- 172.21.15.76:0/2758251644 learned_addr learned my addr 172.21.15.76:0/2758251644 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:42:49.077 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:48.427+0000 7f068e59c700 1 -- 172.21.15.76:0/2758251644 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06901098c0 con 0x7f0690106f90 2024-06-02T04:42:49.077 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:48.427+0000 7f068e59c700 1 --2- 172.21.15.76:0/2758251644 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0690106f90 0x7f0690109380 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f06840098a0 tx=0x7f0684009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1699c856b9f8c6fc server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:42:49.077 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:48.427+0000 7f068d59a700 1 -- 172.21.15.76:0/2758251644 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0684004160 con 0x7f0690106f90 2024-06-02T04:42:49.077 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:48.427+0000 7f068d59a700 1 -- 172.21.15.76:0/2758251644 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f06840042c0 con 0x7f0690106f90 2024-06-02T04:42:49.077 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:48.427+0000 7f068d59a700 1 -- 172.21.15.76:0/2758251644 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0684011940 con 0x7f0690106f90 2024-06-02T04:42:49.077 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:48.428+0000 7f0694b06700 1 -- 172.21.15.76:0/2758251644 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0690106f90 msgr2=0x7f0690109380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:42:49.078 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:48.428+0000 7f0694b06700 1 --2- 172.21.15.76:0/2758251644 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0690106f90 0x7f0690109380 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f06840098a0 tx=0x7f0684009bb0 comp rx=0 tx=0).stop 2024-06-02T04:42:49.078 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:48.428+0000 7f0694b06700 1 -- 172.21.15.76:0/2758251644 shutdown_connections 2024-06-02T04:42:49.078 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:48.428+0000 7f0694b06700 1 --2- 172.21.15.76:0/2758251644 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0690106f90 0x7f0690109380 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:42:49.078 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:48.428+0000 7f0694b06700 1 -- 172.21.15.76:0/2758251644 >> 172.21.15.76:0/2758251644 conn(0x7f0690100a00 msgr2=0x7f0690102e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:42:49.078 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:48.428+0000 7f0694b06700 1 -- 172.21.15.76:0/2758251644 shutdown_connections 2024-06-02T04:42:49.078 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:48.428+0000 7f0694b06700 1 -- 172.21.15.76:0/2758251644 wait complete. 2024-06-02T04:42:49.078 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:48.429+0000 7f0694b06700 1 Processor -- start 2024-06-02T04:42:49.078 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:48.429+0000 7f0694b06700 1 -- start start 2024-06-02T04:42:49.078 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:48.429+0000 7f0694b06700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0690106f90 0x7f069019a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:42:49.078 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:48.429+0000 7f0694b06700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f069019a6b0 con 0x7f0690106f90 2024-06-02T04:42:49.078 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:48.429+0000 7f068e59c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0690106f90 0x7f069019a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:42:49.078 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:48.429+0000 7f068e59c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0690106f90 0x7f069019a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:45608/0 (socket says 172.21.15.76:45608) 2024-06-02T04:42:49.078 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:48.429+0000 7f068e59c700 1 -- 172.21.15.76:0/3968424260 learned_addr learned my addr 172.21.15.76:0/3968424260 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:42:49.079 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:48.429+0000 7f068e59c700 1 -- 172.21.15.76:0/3968424260 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0684009550 con 0x7f0690106f90 2024-06-02T04:42:49.079 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:48.430+0000 7f068e59c700 1 --2- 172.21.15.76:0/3968424260 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0690106f90 0x7f069019a170 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0684006af0 tx=0x7f0684011a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:42:49.079 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:48.430+0000 7f067f7fe700 1 -- 172.21.15.76:0/3968424260 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0684003bf0 con 0x7f0690106f90 2024-06-02T04:42:49.079 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:48.430+0000 7f0694b06700 1 -- 172.21.15.76:0/3968424260 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f069019a8b0 con 0x7f0690106f90 2024-06-02T04:42:49.079 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:48.430+0000 7f067f7fe700 1 -- 172.21.15.76:0/3968424260 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f068401b8b0 con 0x7f0690106f90 2024-06-02T04:42:49.079 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:48.430+0000 7f067f7fe700 1 -- 172.21.15.76:0/3968424260 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0684023800 con 0x7f0690106f90 2024-06-02T04:42:49.079 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:48.430+0000 7f0694b06700 1 -- 172.21.15.76:0/3968424260 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f069019ad50 con 0x7f0690106f90 2024-06-02T04:42:49.079 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:48.431+0000 7f067f7fe700 1 -- 172.21.15.76:0/3968424260 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7f068401ba20 con 0x7f0690106f90 2024-06-02T04:42:49.079 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:48.431+0000 7f067f7fe700 1 --2- 172.21.15.76:0/3968424260 >> [v2:172.21.15.76:6800/4200406736,v1:172.21.15.76:6801/4200406736] conn(0x7f06780386b0 0x7f067803ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:42:49.079 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:48.431+0000 7f0694b06700 1 -- 172.21.15.76:0/3968424260 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f069010a600 con 0x7f0690106f90 2024-06-02T04:42:49.079 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:48.431+0000 7f067f7fe700 1 -- 172.21.15.76:0/3968424260 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f068404cc60 con 0x7f0690106f90 2024-06-02T04:42:49.079 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:48.431+0000 7f068dd9b700 1 --2- 172.21.15.76:0/3968424260 >> [v2:172.21.15.76:6800/4200406736,v1:172.21.15.76:6801/4200406736] conn(0x7f06780386b0 0x7f067803ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:42:49.080 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:48.431+0000 7f068dd9b700 1 --2- 172.21.15.76:0/3968424260 >> [v2:172.21.15.76:6800/4200406736,v1:172.21.15.76:6801/4200406736] conn(0x7f06780386b0 0x7f067803ab70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0680006fd0 tx=0x7f0680006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:42:49.080 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:48.436+0000 7f067f7fe700 1 -- 172.21.15.76:0/3968424260 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f068401bd70 con 0x7f0690106f90 2024-06-02T04:42:49.080 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:48.626+0000 7f0694b06700 1 -- 172.21.15.76:0/3968424260 --> [v2:172.21.15.76:6800/4200406736,v1:172.21.15.76:6801/4200406736] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f0690101c10 con 0x7f06780386b0 2024-06-02T04:42:49.080 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:48.719+0000 7f067f7fe700 1 -- 172.21.15.76:0/3968424260 <== mgr.14120 v2:172.21.15.76:6800/4200406736 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f0690101c10 con 0x7f06780386b0 2024-06-02T04:42:49.080 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:48.721+0000 7f0694b06700 1 -- 172.21.15.76:0/3968424260 >> [v2:172.21.15.76:6800/4200406736,v1:172.21.15.76:6801/4200406736] conn(0x7f06780386b0 msgr2=0x7f067803ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:42:49.080 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:48.721+0000 7f0694b06700 1 --2- 172.21.15.76:0/3968424260 >> [v2:172.21.15.76:6800/4200406736,v1:172.21.15.76:6801/4200406736] conn(0x7f06780386b0 0x7f067803ab70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0680006fd0 tx=0x7f0680006e40 comp rx=0 tx=0).stop 2024-06-02T04:42:49.080 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:48.721+0000 7f0694b06700 1 -- 172.21.15.76:0/3968424260 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0690106f90 msgr2=0x7f069019a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:42:49.080 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:48.721+0000 7f0694b06700 1 --2- 172.21.15.76:0/3968424260 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0690106f90 0x7f069019a170 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0684006af0 tx=0x7f0684011a50 comp rx=0 tx=0).stop 2024-06-02T04:42:49.080 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:48.722+0000 7f0694b06700 1 -- 172.21.15.76:0/3968424260 shutdown_connections 2024-06-02T04:42:49.080 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:48.722+0000 7f0694b06700 1 --2- 172.21.15.76:0/3968424260 >> [v2:172.21.15.76:6800/4200406736,v1:172.21.15.76:6801/4200406736] conn(0x7f06780386b0 0x7f067803ab70 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:42:49.080 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:48.722+0000 7f0694b06700 1 --2- 172.21.15.76:0/3968424260 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0690106f90 0x7f069019a170 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:42:49.080 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:48.722+0000 7f0694b06700 1 -- 172.21.15.76:0/3968424260 >> 172.21.15.76:0/3968424260 conn(0x7f0690100a00 msgr2=0x7f0690101500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:42:49.080 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:48.722+0000 7f0694b06700 1 -- 172.21.15.76:0/3968424260 shutdown_connections 2024-06-02T04:42:49.080 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:48.722+0000 7f0694b06700 1 -- 172.21.15.76:0/3968424260 wait complete. 2024-06-02T04:42:49.982 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:49 smithi076 ceph-mon[42935]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:42:49.982 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:49 smithi076 ceph-mon[42935]: Generating ssh key... 2024-06-02T04:42:50.040 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC91Y3ezbDwfnJ2IWKatbuskV4w6UZvCzgLUteTzaCa2LBoia5BBhoycCBnc+z+lSArvA2nZBw4ukgrXluao/5jxvEH/D5WG8ifnrKz0G6SPF008bRV1ckPKCFPEiJ37gHkPzXLrGZDtZDFdHXGtby1C6M1s5m+7IykRqJkkv7mwLOQ5RBsjzM+yrhkwXwYqiMcCCpsSh6cqLzENKtiJJC3QhZalqmHPIyLoGFKGl+bDDPVZARLLajudfAhvbneoswnzPiofATpq4UAKuG5E05wl4DK2VZoahBpN5O2/0gpWTzN3T9oGg3Y028e+WY+vBDVJdBnNmvh2HMP6WvK9duBbC4WsQ1xDOvX0GUUojPfFRSspWfMW9wvYJ+IVUQQ328og9NFSFGydrpX04Ux2BiU5FeMhAv2tiqIO+1eG8eg4fdqX/KOD+S+0Bu87c2gNrA496xkP/xh0fM0JQ7rZlS079JcmiKepxZb3MOgukjSnQ+mFquIiR8aM1NnRNxZ6Gs= ceph-60ab6d30-209a-11ef-bc9b-c7b262605968 2024-06-02T04:42:50.040 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:49.463+0000 7f1d10c41700 1 Processor -- start 2024-06-02T04:42:50.040 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:49.463+0000 7f1d10c41700 1 -- start start 2024-06-02T04:42:50.040 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:49.463+0000 7f1d10c41700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1d0c106f90 0x7f1d0c109380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:42:50.040 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:49.463+0000 7f1d10c41700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d0c079e90 con 0x7f1d0c106f90 2024-06-02T04:42:50.041 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:49.463+0000 7f1d0a59c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1d0c106f90 0x7f1d0c109380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:42:50.041 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:49.464+0000 7f1d0a59c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1d0c106f90 0x7f1d0c109380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:45612/0 (socket says 172.21.15.76:45612) 2024-06-02T04:42:50.041 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:49.464+0000 7f1d0a59c700 1 -- 172.21.15.76:0/2791793415 learned_addr learned my addr 172.21.15.76:0/2791793415 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:42:50.041 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:49.464+0000 7f1d0a59c700 1 -- 172.21.15.76:0/2791793415 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d0c1098c0 con 0x7f1d0c106f90 2024-06-02T04:42:50.041 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:49.464+0000 7f1d0a59c700 1 --2- 172.21.15.76:0/2791793415 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1d0c106f90 0x7f1d0c109380 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc0098a0 tx=0x7f1cfc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5550a68ceeb327c server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:42:50.041 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:49.464+0000 7f1d0959a700 1 -- 172.21.15.76:0/2791793415 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1cfc004160 con 0x7f1d0c106f90 2024-06-02T04:42:50.041 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:49.464+0000 7f1d0959a700 1 -- 172.21.15.76:0/2791793415 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f1cfc0042c0 con 0x7f1d0c106f90 2024-06-02T04:42:50.041 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:49.464+0000 7f1d0959a700 1 -- 172.21.15.76:0/2791793415 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1cfc011940 con 0x7f1d0c106f90 2024-06-02T04:42:50.041 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:49.465+0000 7f1d10c41700 1 -- 172.21.15.76:0/2791793415 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1d0c106f90 msgr2=0x7f1d0c109380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:42:50.041 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:49.465+0000 7f1d10c41700 1 --2- 172.21.15.76:0/2791793415 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1d0c106f90 0x7f1d0c109380 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc0098a0 tx=0x7f1cfc009bb0 comp rx=0 tx=0).stop 2024-06-02T04:42:50.041 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:49.465+0000 7f1d10c41700 1 -- 172.21.15.76:0/2791793415 shutdown_connections 2024-06-02T04:42:50.041 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:49.465+0000 7f1d10c41700 1 --2- 172.21.15.76:0/2791793415 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1d0c106f90 0x7f1d0c109380 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:42:50.050 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:49.465+0000 7f1d10c41700 1 -- 172.21.15.76:0/2791793415 >> 172.21.15.76:0/2791793415 conn(0x7f1d0c1009c0 msgr2=0x7f1d0c102de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:42:50.050 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:49.465+0000 7f1d10c41700 1 -- 172.21.15.76:0/2791793415 shutdown_connections 2024-06-02T04:42:50.050 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:49.465+0000 7f1d10c41700 1 -- 172.21.15.76:0/2791793415 wait complete. 2024-06-02T04:42:50.050 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:49.466+0000 7f1d10c41700 1 Processor -- start 2024-06-02T04:42:50.050 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:49.466+0000 7f1d10c41700 1 -- start start 2024-06-02T04:42:50.050 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:49.466+0000 7f1d10c41700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1d0c106f90 0x7f1d0c19a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:42:50.050 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:49.466+0000 7f1d10c41700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d0c19a6b0 con 0x7f1d0c106f90 2024-06-02T04:42:50.050 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:49.466+0000 7f1d0a59c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1d0c106f90 0x7f1d0c19a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:42:50.050 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:49.466+0000 7f1d0a59c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1d0c106f90 0x7f1d0c19a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:45616/0 (socket says 172.21.15.76:45616) 2024-06-02T04:42:50.051 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:49.466+0000 7f1d0a59c700 1 -- 172.21.15.76:0/2715648988 learned_addr learned my addr 172.21.15.76:0/2715648988 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:42:50.051 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:49.466+0000 7f1d0a59c700 1 -- 172.21.15.76:0/2715648988 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cfc009550 con 0x7f1d0c106f90 2024-06-02T04:42:50.051 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:49.466+0000 7f1d0a59c700 1 --2- 172.21.15.76:0/2715648988 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1d0c106f90 0x7f1d0c19a170 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc006af0 tx=0x7f1cfc011a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:42:50.051 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:49.467+0000 7f1d037fe700 1 -- 172.21.15.76:0/2715648988 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1cfc003bf0 con 0x7f1d0c106f90 2024-06-02T04:42:50.051 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:49.467+0000 7f1d037fe700 1 -- 172.21.15.76:0/2715648988 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f1cfc01b8b0 con 0x7f1d0c106f90 2024-06-02T04:42:50.051 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:49.467+0000 7f1d10c41700 1 -- 172.21.15.76:0/2715648988 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d0c19a8b0 con 0x7f1d0c106f90 2024-06-02T04:42:50.051 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:49.467+0000 7f1d037fe700 1 -- 172.21.15.76:0/2715648988 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1cfc023800 con 0x7f1d0c106f90 2024-06-02T04:42:50.051 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:49.467+0000 7f1d10c41700 1 -- 172.21.15.76:0/2715648988 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d0c19ad50 con 0x7f1d0c106f90 2024-06-02T04:42:50.051 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:49.468+0000 7f1d037fe700 1 -- 172.21.15.76:0/2715648988 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7f1cfc023960 con 0x7f1d0c106f90 2024-06-02T04:42:50.051 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:49.468+0000 7f1d10c41700 1 -- 172.21.15.76:0/2715648988 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d0c10a600 con 0x7f1d0c106f90 2024-06-02T04:42:50.051 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:49.468+0000 7f1d037fe700 1 --2- 172.21.15.76:0/2715648988 >> [v2:172.21.15.76:6800/4200406736,v1:172.21.15.76:6801/4200406736] conn(0x7f1cf8038700 0x7f1cf803abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:42:50.051 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:49.468+0000 7f1d037fe700 1 -- 172.21.15.76:0/2715648988 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f1cfc04cd40 con 0x7f1d0c106f90 2024-06-02T04:42:50.051 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:49.468+0000 7f1d09d9b700 1 --2- 172.21.15.76:0/2715648988 >> [v2:172.21.15.76:6800/4200406736,v1:172.21.15.76:6801/4200406736] conn(0x7f1cf8038700 0x7f1cf803abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:42:50.052 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:49.468+0000 7f1d09d9b700 1 --2- 172.21.15.76:0/2715648988 >> [v2:172.21.15.76:6800/4200406736,v1:172.21.15.76:6801/4200406736] conn(0x7f1cf8038700 0x7f1cf803abc0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1cf4006fd0 tx=0x7f1cf4006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:42:50.052 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:49.472+0000 7f1d037fe700 1 -- 172.21.15.76:0/2715648988 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f1cfc023c10 con 0x7f1d0c106f90 2024-06-02T04:42:50.052 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:49.664+0000 7f1d10c41700 1 -- 172.21.15.76:0/2715648988 --> [v2:172.21.15.76:6800/4200406736,v1:172.21.15.76:6801/4200406736] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f1d0c101bc0 con 0x7f1cf8038700 2024-06-02T04:42:50.052 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:49.665+0000 7f1d037fe700 1 -- 172.21.15.76:0/2715648988 <== mgr.14120 v2:172.21.15.76:6800/4200406736 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7f1d0c101bc0 con 0x7f1cf8038700 2024-06-02T04:42:50.052 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:49.667+0000 7f1d10c41700 1 -- 172.21.15.76:0/2715648988 >> [v2:172.21.15.76:6800/4200406736,v1:172.21.15.76:6801/4200406736] conn(0x7f1cf8038700 msgr2=0x7f1cf803abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:42:50.052 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:49.667+0000 7f1d10c41700 1 --2- 172.21.15.76:0/2715648988 >> [v2:172.21.15.76:6800/4200406736,v1:172.21.15.76:6801/4200406736] conn(0x7f1cf8038700 0x7f1cf803abc0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1cf4006fd0 tx=0x7f1cf4006e40 comp rx=0 tx=0).stop 2024-06-02T04:42:50.052 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:49.667+0000 7f1d10c41700 1 -- 172.21.15.76:0/2715648988 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1d0c106f90 msgr2=0x7f1d0c19a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:42:50.052 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:49.667+0000 7f1d10c41700 1 --2- 172.21.15.76:0/2715648988 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1d0c106f90 0x7f1d0c19a170 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc006af0 tx=0x7f1cfc011a50 comp rx=0 tx=0).stop 2024-06-02T04:42:50.052 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:49.667+0000 7f1d10c41700 1 -- 172.21.15.76:0/2715648988 shutdown_connections 2024-06-02T04:42:50.052 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:49.667+0000 7f1d10c41700 1 --2- 172.21.15.76:0/2715648988 >> [v2:172.21.15.76:6800/4200406736,v1:172.21.15.76:6801/4200406736] conn(0x7f1cf8038700 0x7f1cf803abc0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:42:50.052 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:49.667+0000 7f1d10c41700 1 --2- 172.21.15.76:0/2715648988 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1d0c106f90 0x7f1d0c19a170 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:42:50.052 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:49.667+0000 7f1d10c41700 1 -- 172.21.15.76:0/2715648988 >> 172.21.15.76:0/2715648988 conn(0x7f1d0c1009c0 msgr2=0x7f1d0c1014b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:42:50.052 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:49.667+0000 7f1d10c41700 1 -- 172.21.15.76:0/2715648988 shutdown_connections 2024-06-02T04:42:50.053 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:49.667+0000 7f1d10c41700 1 -- 172.21.15.76:0/2715648988 wait complete. 2024-06-02T04:42:50.053 INFO:teuthology.orchestra.run.smithi076.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-06-02T04:42:50.053 INFO:teuthology.orchestra.run.smithi076.stdout:Adding key to root@localhost authorized_keys... 2024-06-02T04:42:50.053 INFO:teuthology.orchestra.run.smithi076.stdout:Adding host smithi076... 2024-06-02T04:42:51.154 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:50 smithi076 ceph-mon[42935]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:42:52.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:51 smithi076 ceph-mon[42935]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi076", "addr": "172.21.15.76", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:42:52.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:51 smithi076 ceph-mon[42935]: Deploying cephadm binary to smithi076 2024-06-02T04:42:53.092 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout Added host 'smithi076' with addr '172.21.15.76' 2024-06-02T04:42:53.092 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:50.397+0000 7f97f007a700 1 Processor -- start 2024-06-02T04:42:53.092 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:50.397+0000 7f97f007a700 1 -- start start 2024-06-02T04:42:53.092 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:50.397+0000 7f97f007a700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f97e8105400 0x7f97e8105820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:42:53.093 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:50.397+0000 7f97f007a700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97e8105df0 con 0x7f97e8105400 2024-06-02T04:42:53.093 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:50.398+0000 7f97ede16700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f97e8105400 0x7f97e8105820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:42:53.093 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:50.398+0000 7f97ede16700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f97e8105400 0x7f97e8105820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:45624/0 (socket says 172.21.15.76:45624) 2024-06-02T04:42:53.093 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:50.398+0000 7f97ede16700 1 -- 172.21.15.76:0/161470923 learned_addr learned my addr 172.21.15.76:0/161470923 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:42:53.093 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:50.398+0000 7f97ede16700 1 -- 172.21.15.76:0/161470923 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97e8106600 con 0x7f97e8105400 2024-06-02T04:42:53.093 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:50.398+0000 7f97ede16700 1 --2- 172.21.15.76:0/161470923 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f97e8105400 0x7f97e8105820 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f97e40098a0 tx=0x7f97e4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ca991818e79f4a2 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:42:53.093 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:50.398+0000 7f97ece14700 1 -- 172.21.15.76:0/161470923 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f97e4004160 con 0x7f97e8105400 2024-06-02T04:42:53.093 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:50.398+0000 7f97ece14700 1 -- 172.21.15.76:0/161470923 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f97e40042c0 con 0x7f97e8105400 2024-06-02T04:42:53.093 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:50.398+0000 7f97ece14700 1 -- 172.21.15.76:0/161470923 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f97e4011940 con 0x7f97e8105400 2024-06-02T04:42:53.093 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:50.399+0000 7f97f007a700 1 -- 172.21.15.76:0/161470923 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f97e8105400 msgr2=0x7f97e8105820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:42:53.093 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:50.399+0000 7f97f007a700 1 --2- 172.21.15.76:0/161470923 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f97e8105400 0x7f97e8105820 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f97e40098a0 tx=0x7f97e4009bb0 comp rx=0 tx=0).stop 2024-06-02T04:42:53.093 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:50.399+0000 7f97f007a700 1 -- 172.21.15.76:0/161470923 shutdown_connections 2024-06-02T04:42:53.093 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:50.399+0000 7f97f007a700 1 --2- 172.21.15.76:0/161470923 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f97e8105400 0x7f97e8105820 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:42:53.094 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:50.399+0000 7f97f007a700 1 -- 172.21.15.76:0/161470923 >> 172.21.15.76:0/161470923 conn(0x7f97e8100a80 msgr2=0x7f97e8102ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:42:53.094 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:50.399+0000 7f97f007a700 1 -- 172.21.15.76:0/161470923 shutdown_connections 2024-06-02T04:42:53.094 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:50.399+0000 7f97f007a700 1 -- 172.21.15.76:0/161470923 wait complete. 2024-06-02T04:42:53.094 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:50.399+0000 7f97f007a700 1 Processor -- start 2024-06-02T04:42:53.094 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:50.399+0000 7f97f007a700 1 -- start start 2024-06-02T04:42:53.094 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:50.400+0000 7f97f007a700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f97e8105400 0x7f97e8190430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:42:53.094 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:50.400+0000 7f97f007a700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97e8190970 con 0x7f97e8105400 2024-06-02T04:42:53.094 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:50.400+0000 7f97ede16700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f97e8105400 0x7f97e8190430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:42:53.094 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:50.400+0000 7f97ede16700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f97e8105400 0x7f97e8190430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:45626/0 (socket says 172.21.15.76:45626) 2024-06-02T04:42:53.094 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:50.400+0000 7f97ede16700 1 -- 172.21.15.76:0/4242730218 learned_addr learned my addr 172.21.15.76:0/4242730218 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:42:53.094 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:50.400+0000 7f97ede16700 1 -- 172.21.15.76:0/4242730218 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97e4009550 con 0x7f97e8105400 2024-06-02T04:42:53.094 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:50.400+0000 7f97ede16700 1 --2- 172.21.15.76:0/4242730218 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f97e8105400 0x7f97e8190430 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f97e4003f20 tx=0x7f97e4011f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:42:53.095 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:50.400+0000 7f97deffd700 1 -- 172.21.15.76:0/4242730218 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f97e40036a0 con 0x7f97e8105400 2024-06-02T04:42:53.095 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:50.400+0000 7f97deffd700 1 -- 172.21.15.76:0/4242730218 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f97e4003c70 con 0x7f97e8105400 2024-06-02T04:42:53.095 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:50.400+0000 7f97f007a700 1 -- 172.21.15.76:0/4242730218 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97e818ebb0 con 0x7f97e8105400 2024-06-02T04:42:53.095 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:50.400+0000 7f97deffd700 1 -- 172.21.15.76:0/4242730218 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f97e401be80 con 0x7f97e8105400 2024-06-02T04:42:53.095 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:50.400+0000 7f97f007a700 1 -- 172.21.15.76:0/4242730218 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97e818f050 con 0x7f97e8105400 2024-06-02T04:42:53.095 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:50.401+0000 7f97deffd700 1 -- 172.21.15.76:0/4242730218 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7f97e4023490 con 0x7f97e8105400 2024-06-02T04:42:53.095 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:50.401+0000 7f97f007a700 1 -- 172.21.15.76:0/4242730218 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97e818fa60 con 0x7f97e8105400 2024-06-02T04:42:53.095 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:50.401+0000 7f97deffd700 1 --2- 172.21.15.76:0/4242730218 >> [v2:172.21.15.76:6800/4200406736,v1:172.21.15.76:6801/4200406736] conn(0x7f97d4038750 0x7f97d403ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:42:53.095 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:50.402+0000 7f97deffd700 1 -- 172.21.15.76:0/4242730218 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f97e404c7a0 con 0x7f97e8105400 2024-06-02T04:42:53.095 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:50.402+0000 7f97ed615700 1 --2- 172.21.15.76:0/4242730218 >> [v2:172.21.15.76:6800/4200406736,v1:172.21.15.76:6801/4200406736] conn(0x7f97d4038750 0x7f97d403ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:42:53.095 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:50.402+0000 7f97ed615700 1 --2- 172.21.15.76:0/4242730218 >> [v2:172.21.15.76:6800/4200406736,v1:172.21.15.76:6801/4200406736] conn(0x7f97d4038750 0x7f97d403ac10 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f97d8006fd0 tx=0x7f97d8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:42:53.095 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:50.406+0000 7f97deffd700 1 -- 172.21.15.76:0/4242730218 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f97e402b390 con 0x7f97e8105400 2024-06-02T04:42:53.095 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:50.600+0000 7f97f007a700 1 -- 172.21.15.76:0/4242730218 --> [v2:172.21.15.76:6800/4200406736,v1:172.21.15.76:6801/4200406736] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi076", "addr": "172.21.15.76", "target": ["mon-mgr", ""]}) v1 -- 0x7f97e818f290 con 0x7f97d4038750 2024-06-02T04:42:53.096 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:52.765+0000 7f97deffd700 1 -- 172.21.15.76:0/4242730218 <== mgr.14120 v2:172.21.15.76:6800/4200406736 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+48 (secure 0 0 0) 0x7f97e818f290 con 0x7f97d4038750 2024-06-02T04:42:53.096 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:52.768+0000 7f97f007a700 1 -- 172.21.15.76:0/4242730218 >> [v2:172.21.15.76:6800/4200406736,v1:172.21.15.76:6801/4200406736] conn(0x7f97d4038750 msgr2=0x7f97d403ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:42:53.096 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:52.768+0000 7f97f007a700 1 --2- 172.21.15.76:0/4242730218 >> [v2:172.21.15.76:6800/4200406736,v1:172.21.15.76:6801/4200406736] conn(0x7f97d4038750 0x7f97d403ac10 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f97d8006fd0 tx=0x7f97d8006e40 comp rx=0 tx=0).stop 2024-06-02T04:42:53.096 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:52.768+0000 7f97f007a700 1 -- 172.21.15.76:0/4242730218 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f97e8105400 msgr2=0x7f97e8190430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:42:53.096 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:52.768+0000 7f97f007a700 1 --2- 172.21.15.76:0/4242730218 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f97e8105400 0x7f97e8190430 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f97e4003f20 tx=0x7f97e4011f00 comp rx=0 tx=0).stop 2024-06-02T04:42:53.096 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:52.768+0000 7f97f007a700 1 -- 172.21.15.76:0/4242730218 shutdown_connections 2024-06-02T04:42:53.096 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:52.768+0000 7f97f007a700 1 --2- 172.21.15.76:0/4242730218 >> [v2:172.21.15.76:6800/4200406736,v1:172.21.15.76:6801/4200406736] conn(0x7f97d4038750 0x7f97d403ac10 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:42:53.096 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:52.768+0000 7f97f007a700 1 --2- 172.21.15.76:0/4242730218 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f97e8105400 0x7f97e8190430 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:42:53.096 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:52.768+0000 7f97f007a700 1 -- 172.21.15.76:0/4242730218 >> 172.21.15.76:0/4242730218 conn(0x7f97e8100a80 msgr2=0x7f97e8101960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:42:53.096 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:52.768+0000 7f97f007a700 1 -- 172.21.15.76:0/4242730218 shutdown_connections 2024-06-02T04:42:53.096 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:52.768+0000 7f97f007a700 1 -- 172.21.15.76:0/4242730218 wait complete. 2024-06-02T04:42:53.096 INFO:teuthology.orchestra.run.smithi076.stdout:Deploying unmanaged mon service... 2024-06-02T04:42:53.978 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:53 smithi076 ceph-mon[42935]: from='mgr.14120 172.21.15.76:0/1374455932' entity='mgr.x' 2024-06-02T04:42:53.979 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:53 smithi076 ceph-mon[42935]: Added host smithi076 2024-06-02T04:42:53.979 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:53 smithi076 ceph-mon[42935]: from='mgr.14120 172.21.15.76:0/1374455932' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:42:54.376 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-06-02T04:42:54.376 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:53.626+0000 7fd5a4de2700 1 Processor -- start 2024-06-02T04:42:54.376 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:53.626+0000 7fd5a4de2700 1 -- start start 2024-06-02T04:42:54.376 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:53.626+0000 7fd5a4de2700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd5a0104da0 0x7fd5a01051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:42:54.376 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:53.626+0000 7fd5a4de2700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a0079e50 con 0x7fd5a0104da0 2024-06-02T04:42:54.376 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:53.627+0000 7fd59e59c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd5a0104da0 0x7fd5a01051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:42:54.376 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:53.627+0000 7fd59e59c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd5a0104da0 0x7fd5a01051c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:40600/0 (socket says 172.21.15.76:40600) 2024-06-02T04:42:54.376 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:53.627+0000 7fd59e59c700 1 -- 172.21.15.76:0/9245785 learned_addr learned my addr 172.21.15.76:0/9245785 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:42:54.376 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:53.627+0000 7fd59e59c700 1 -- 172.21.15.76:0/9245785 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5a0105700 con 0x7fd5a0104da0 2024-06-02T04:42:54.376 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:53.627+0000 7fd59e59c700 1 --2- 172.21.15.76:0/9245785 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd5a0104da0 0x7fd5a01051c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd5900098a0 tx=0x7fd590009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfa994b32e1fa82d server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:42:54.377 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:53.628+0000 7fd59d59a700 1 -- 172.21.15.76:0/9245785 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd590004160 con 0x7fd5a0104da0 2024-06-02T04:42:54.377 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:53.628+0000 7fd59d59a700 1 -- 172.21.15.76:0/9245785 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fd5900042c0 con 0x7fd5a0104da0 2024-06-02T04:42:54.377 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:53.628+0000 7fd59d59a700 1 -- 172.21.15.76:0/9245785 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd590011940 con 0x7fd5a0104da0 2024-06-02T04:42:54.377 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:53.628+0000 7fd5a4de2700 1 -- 172.21.15.76:0/9245785 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd5a0104da0 msgr2=0x7fd5a01051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:42:54.377 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:53.628+0000 7fd5a4de2700 1 --2- 172.21.15.76:0/9245785 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd5a0104da0 0x7fd5a01051c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd5900098a0 tx=0x7fd590009bb0 comp rx=0 tx=0).stop 2024-06-02T04:42:54.377 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:53.628+0000 7fd5a4de2700 1 -- 172.21.15.76:0/9245785 shutdown_connections 2024-06-02T04:42:54.377 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:53.628+0000 7fd5a4de2700 1 --2- 172.21.15.76:0/9245785 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd5a0104da0 0x7fd5a01051c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:42:54.377 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:53.628+0000 7fd5a4de2700 1 -- 172.21.15.76:0/9245785 >> 172.21.15.76:0/9245785 conn(0x7fd5a0100980 msgr2=0x7fd5a0102da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:42:54.377 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:53.628+0000 7fd5a4de2700 1 -- 172.21.15.76:0/9245785 shutdown_connections 2024-06-02T04:42:54.377 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:53.629+0000 7fd5a4de2700 1 -- 172.21.15.76:0/9245785 wait complete. 2024-06-02T04:42:54.377 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:53.629+0000 7fd5a4de2700 1 Processor -- start 2024-06-02T04:42:54.377 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:53.630+0000 7fd5a4de2700 1 -- start start 2024-06-02T04:42:54.377 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:53.630+0000 7fd5a4de2700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd5a0104da0 0x7fd5a019c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:42:54.377 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:53.630+0000 7fd5a4de2700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a019c890 con 0x7fd5a0104da0 2024-06-02T04:42:54.378 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:53.630+0000 7fd59e59c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd5a0104da0 0x7fd5a019c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:42:54.378 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:53.630+0000 7fd59e59c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd5a0104da0 0x7fd5a019c350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:40604/0 (socket says 172.21.15.76:40604) 2024-06-02T04:42:54.378 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:53.630+0000 7fd59e59c700 1 -- 172.21.15.76:0/3812634942 learned_addr learned my addr 172.21.15.76:0/3812634942 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:42:54.378 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:53.630+0000 7fd59e59c700 1 -- 172.21.15.76:0/3812634942 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd590009550 con 0x7fd5a0104da0 2024-06-02T04:42:54.378 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:53.630+0000 7fd59e59c700 1 --2- 172.21.15.76:0/3812634942 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd5a0104da0 0x7fd5a019c350 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd590006af0 tx=0x7fd590011a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:42:54.378 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:53.630+0000 7fd58f7fe700 1 -- 172.21.15.76:0/3812634942 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd590003bf0 con 0x7fd5a0104da0 2024-06-02T04:42:54.378 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:53.631+0000 7fd5a4de2700 1 -- 172.21.15.76:0/3812634942 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5a019ca90 con 0x7fd5a0104da0 2024-06-02T04:42:54.378 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:53.631+0000 7fd58f7fe700 1 -- 172.21.15.76:0/3812634942 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fd59001b8b0 con 0x7fd5a0104da0 2024-06-02T04:42:54.378 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:53.631+0000 7fd58f7fe700 1 -- 172.21.15.76:0/3812634942 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd590023800 con 0x7fd5a0104da0 2024-06-02T04:42:54.378 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:53.631+0000 7fd5a4de2700 1 -- 172.21.15.76:0/3812634942 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5a019cf30 con 0x7fd5a0104da0 2024-06-02T04:42:54.378 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:53.631+0000 7fd58f7fe700 1 -- 172.21.15.76:0/3812634942 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7fd590023a70 con 0x7fd5a0104da0 2024-06-02T04:42:54.378 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:53.632+0000 7fd5a4de2700 1 -- 172.21.15.76:0/3812634942 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5a0196080 con 0x7fd5a0104da0 2024-06-02T04:42:54.378 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:53.632+0000 7fd58f7fe700 1 --2- 172.21.15.76:0/3812634942 >> [v2:172.21.15.76:6800/4200406736,v1:172.21.15.76:6801/4200406736] conn(0x7fd5880386b0 0x7fd58803ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:42:54.379 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:53.632+0000 7fd58f7fe700 1 -- 172.21.15.76:0/3812634942 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fd59004cc10 con 0x7fd5a0104da0 2024-06-02T04:42:54.379 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:53.632+0000 7fd59dd9b700 1 --2- 172.21.15.76:0/3812634942 >> [v2:172.21.15.76:6800/4200406736,v1:172.21.15.76:6801/4200406736] conn(0x7fd5880386b0 0x7fd58803ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:42:54.379 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:53.632+0000 7fd59dd9b700 1 --2- 172.21.15.76:0/3812634942 >> [v2:172.21.15.76:6800/4200406736,v1:172.21.15.76:6801/4200406736] conn(0x7fd5880386b0 0x7fd58803ab70 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd594006fd0 tx=0x7fd594006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:42:54.379 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:53.637+0000 7fd58f7fe700 1 -- 172.21.15.76:0/3812634942 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fd590023d20 con 0x7fd5a0104da0 2024-06-02T04:42:54.379 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:53.853+0000 7fd5a4de2700 1 -- 172.21.15.76:0/3812634942 --> [v2:172.21.15.76:6800/4200406736,v1:172.21.15.76:6801/4200406736] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) v1 -- 0x7fd5a002d010 con 0x7fd5880386b0 2024-06-02T04:42:54.379 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:53.857+0000 7fd58f7fe700 1 -- 172.21.15.76:0/3812634942 <== mgr.14120 v2:172.21.15.76:6800/4200406736 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fd5a002d010 con 0x7fd5880386b0 2024-06-02T04:42:54.379 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:53.859+0000 7fd5a4de2700 1 -- 172.21.15.76:0/3812634942 >> [v2:172.21.15.76:6800/4200406736,v1:172.21.15.76:6801/4200406736] conn(0x7fd5880386b0 msgr2=0x7fd58803ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:42:54.379 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:53.859+0000 7fd5a4de2700 1 --2- 172.21.15.76:0/3812634942 >> [v2:172.21.15.76:6800/4200406736,v1:172.21.15.76:6801/4200406736] conn(0x7fd5880386b0 0x7fd58803ab70 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd594006fd0 tx=0x7fd594006e40 comp rx=0 tx=0).stop 2024-06-02T04:42:54.379 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:53.859+0000 7fd5a4de2700 1 -- 172.21.15.76:0/3812634942 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd5a0104da0 msgr2=0x7fd5a019c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:42:54.379 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:53.859+0000 7fd5a4de2700 1 --2- 172.21.15.76:0/3812634942 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd5a0104da0 0x7fd5a019c350 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd590006af0 tx=0x7fd590011a50 comp rx=0 tx=0).stop 2024-06-02T04:42:54.379 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:53.859+0000 7fd5a4de2700 1 -- 172.21.15.76:0/3812634942 shutdown_connections 2024-06-02T04:42:54.379 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:53.859+0000 7fd5a4de2700 1 --2- 172.21.15.76:0/3812634942 >> [v2:172.21.15.76:6800/4200406736,v1:172.21.15.76:6801/4200406736] conn(0x7fd5880386b0 0x7fd58803ab70 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:42:54.379 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:53.859+0000 7fd5a4de2700 1 --2- 172.21.15.76:0/3812634942 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd5a0104da0 0x7fd5a019c350 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:42:54.380 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:53.859+0000 7fd5a4de2700 1 -- 172.21.15.76:0/3812634942 >> 172.21.15.76:0/3812634942 conn(0x7fd5a0100980 msgr2=0x7fd5a01931c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:42:54.380 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:53.859+0000 7fd5a4de2700 1 -- 172.21.15.76:0/3812634942 shutdown_connections 2024-06-02T04:42:54.380 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:53.859+0000 7fd5a4de2700 1 -- 172.21.15.76:0/3812634942 wait complete. 2024-06-02T04:42:54.380 INFO:teuthology.orchestra.run.smithi076.stdout:Deploying unmanaged mgr service... 2024-06-02T04:42:55.143 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:54 smithi076 ceph-mon[42935]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:42:55.143 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:54 smithi076 ceph-mon[42935]: Saving service mon spec with placement count:5 2024-06-02T04:42:55.143 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:54 smithi076 ceph-mon[42935]: from='mgr.14120 172.21.15.76:0/1374455932' entity='mgr.x' 2024-06-02T04:42:55.143 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:54 smithi076 ceph-mon[42935]: from='mgr.14120 172.21.15.76:0/1374455932' entity='mgr.x' 2024-06-02T04:42:55.144 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:54 smithi076 ceph-mon[42935]: from='mgr.14120 172.21.15.76:0/1374455932' entity='mgr.x' 2024-06-02T04:42:55.610 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-06-02T04:42:55.610 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:54.883+0000 7f6ca5e00700 1 Processor -- start 2024-06-02T04:42:55.611 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:54.883+0000 7f6ca5e00700 1 -- start start 2024-06-02T04:42:55.611 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:54.883+0000 7f6ca5e00700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6ca0106f80 0x7f6ca0109370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:42:55.611 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:54.883+0000 7f6ca5e00700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca0079e90 con 0x7f6ca0106f80 2024-06-02T04:42:55.611 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:54.883+0000 7f6c9f7fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6ca0106f80 0x7f6ca0109370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:42:55.611 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:54.883+0000 7f6c9f7fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6ca0106f80 0x7f6ca0109370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:40606/0 (socket says 172.21.15.76:40606) 2024-06-02T04:42:55.611 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:54.884+0000 7f6c9f7fe700 1 -- 172.21.15.76:0/2241205657 learned_addr learned my addr 172.21.15.76:0/2241205657 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:42:55.611 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:54.884+0000 7f6c9f7fe700 1 -- 172.21.15.76:0/2241205657 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ca01098b0 con 0x7f6ca0106f80 2024-06-02T04:42:55.611 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:54.884+0000 7f6c9f7fe700 1 --2- 172.21.15.76:0/2241205657 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6ca0106f80 0x7f6ca0109370 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6c900098a0 tx=0x7f6c90009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f42a92305d20e01c server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:42:55.611 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:54.884+0000 7f6c9e7fc700 1 -- 172.21.15.76:0/2241205657 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6c90004160 con 0x7f6ca0106f80 2024-06-02T04:42:55.611 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:54.884+0000 7f6c9e7fc700 1 -- 172.21.15.76:0/2241205657 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6c900042c0 con 0x7f6ca0106f80 2024-06-02T04:42:55.611 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:54.884+0000 7f6c9e7fc700 1 -- 172.21.15.76:0/2241205657 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6c900118e0 con 0x7f6ca0106f80 2024-06-02T04:42:55.611 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:54.885+0000 7f6ca5e00700 1 -- 172.21.15.76:0/2241205657 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6ca0106f80 msgr2=0x7f6ca0109370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:42:55.611 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:54.885+0000 7f6ca5e00700 1 --2- 172.21.15.76:0/2241205657 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6ca0106f80 0x7f6ca0109370 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6c900098a0 tx=0x7f6c90009bb0 comp rx=0 tx=0).stop 2024-06-02T04:42:55.612 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:54.885+0000 7f6ca5e00700 1 -- 172.21.15.76:0/2241205657 shutdown_connections 2024-06-02T04:42:55.612 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:54.885+0000 7f6ca5e00700 1 --2- 172.21.15.76:0/2241205657 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6ca0106f80 0x7f6ca0109370 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:42:55.612 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:54.885+0000 7f6ca5e00700 1 -- 172.21.15.76:0/2241205657 >> 172.21.15.76:0/2241205657 conn(0x7f6ca01009f0 msgr2=0x7f6ca0102e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:42:55.612 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:54.885+0000 7f6ca5e00700 1 -- 172.21.15.76:0/2241205657 shutdown_connections 2024-06-02T04:42:55.612 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:54.885+0000 7f6ca5e00700 1 -- 172.21.15.76:0/2241205657 wait complete. 2024-06-02T04:42:55.612 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:54.886+0000 7f6ca5e00700 1 Processor -- start 2024-06-02T04:42:55.612 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:54.886+0000 7f6ca5e00700 1 -- start start 2024-06-02T04:42:55.612 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:54.886+0000 7f6ca5e00700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6ca0106f80 0x7f6ca019a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:42:55.612 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:54.886+0000 7f6ca5e00700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca019a720 con 0x7f6ca0106f80 2024-06-02T04:42:55.612 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:54.886+0000 7f6c9f7fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6ca0106f80 0x7f6ca019a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:42:55.612 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:54.887+0000 7f6c9f7fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6ca0106f80 0x7f6ca019a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:40620/0 (socket says 172.21.15.76:40620) 2024-06-02T04:42:55.612 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:54.887+0000 7f6c9f7fe700 1 -- 172.21.15.76:0/1421608230 learned_addr learned my addr 172.21.15.76:0/1421608230 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:42:55.612 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:54.887+0000 7f6c9f7fe700 1 -- 172.21.15.76:0/1421608230 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c90009550 con 0x7f6ca0106f80 2024-06-02T04:42:55.612 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:54.887+0000 7f6c9f7fe700 1 --2- 172.21.15.76:0/1421608230 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6ca0106f80 0x7f6ca019a1e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6c90003e30 tx=0x7f6c90011e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:42:55.613 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:54.887+0000 7f6c9cff9700 1 -- 172.21.15.76:0/1421608230 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6c900036a0 con 0x7f6ca0106f80 2024-06-02T04:42:55.613 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:54.887+0000 7f6ca5e00700 1 -- 172.21.15.76:0/1421608230 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ca019a920 con 0x7f6ca0106f80 2024-06-02T04:42:55.613 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:54.887+0000 7f6c9cff9700 1 -- 172.21.15.76:0/1421608230 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6c9001b440 con 0x7f6ca0106f80 2024-06-02T04:42:55.613 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:54.887+0000 7f6c9cff9700 1 -- 172.21.15.76:0/1421608230 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6c900193d0 con 0x7f6ca0106f80 2024-06-02T04:42:55.613 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:54.887+0000 7f6ca5e00700 1 -- 172.21.15.76:0/1421608230 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ca019adc0 con 0x7f6ca0106f80 2024-06-02T04:42:55.613 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:54.888+0000 7f6c9cff9700 1 -- 172.21.15.76:0/1421608230 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7f6c90019690 con 0x7f6ca0106f80 2024-06-02T04:42:55.613 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:54.888+0000 7f6ca5e00700 1 -- 172.21.15.76:0/1421608230 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ca010a630 con 0x7f6ca0106f80 2024-06-02T04:42:55.613 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:54.888+0000 7f6c9cff9700 1 --2- 172.21.15.76:0/1421608230 >> [v2:172.21.15.76:6800/4200406736,v1:172.21.15.76:6801/4200406736] conn(0x7f6c880386b0 0x7f6c8803ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:42:55.613 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:54.888+0000 7f6c9cff9700 1 -- 172.21.15.76:0/1421608230 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f6c9004c550 con 0x7f6ca0106f80 2024-06-02T04:42:55.613 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:54.888+0000 7f6c9effd700 1 --2- 172.21.15.76:0/1421608230 >> [v2:172.21.15.76:6800/4200406736,v1:172.21.15.76:6801/4200406736] conn(0x7f6c880386b0 0x7f6c8803ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:42:55.613 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:54.889+0000 7f6c9effd700 1 --2- 172.21.15.76:0/1421608230 >> [v2:172.21.15.76:6800/4200406736,v1:172.21.15.76:6801/4200406736] conn(0x7f6c880386b0 0x7f6c8803ab70 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6c94006fd0 tx=0x7f6c94006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:42:55.613 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:54.897+0000 7f6c9cff9700 1 -- 172.21.15.76:0/1421608230 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f6c90018db0 con 0x7f6ca0106f80 2024-06-02T04:42:55.613 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:55.109+0000 7f6ca5e00700 1 -- 172.21.15.76:0/1421608230 --> [v2:172.21.15.76:6800/4200406736,v1:172.21.15.76:6801/4200406736] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f6ca019d650 con 0x7f6c880386b0 2024-06-02T04:42:55.614 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:55.115+0000 7f6c9cff9700 1 -- 172.21.15.76:0/1421608230 <== mgr.14120 v2:172.21.15.76:6800/4200406736 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f6ca019d650 con 0x7f6c880386b0 2024-06-02T04:42:55.614 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:55.117+0000 7f6ca5e00700 1 -- 172.21.15.76:0/1421608230 >> [v2:172.21.15.76:6800/4200406736,v1:172.21.15.76:6801/4200406736] conn(0x7f6c880386b0 msgr2=0x7f6c8803ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:42:55.614 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:55.117+0000 7f6ca5e00700 1 --2- 172.21.15.76:0/1421608230 >> [v2:172.21.15.76:6800/4200406736,v1:172.21.15.76:6801/4200406736] conn(0x7f6c880386b0 0x7f6c8803ab70 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6c94006fd0 tx=0x7f6c94006e40 comp rx=0 tx=0).stop 2024-06-02T04:42:55.614 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:55.117+0000 7f6ca5e00700 1 -- 172.21.15.76:0/1421608230 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6ca0106f80 msgr2=0x7f6ca019a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:42:55.614 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:55.117+0000 7f6ca5e00700 1 --2- 172.21.15.76:0/1421608230 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6ca0106f80 0x7f6ca019a1e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6c90003e30 tx=0x7f6c90011e80 comp rx=0 tx=0).stop 2024-06-02T04:42:55.614 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:55.117+0000 7f6ca5e00700 1 -- 172.21.15.76:0/1421608230 shutdown_connections 2024-06-02T04:42:55.614 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:55.117+0000 7f6ca5e00700 1 --2- 172.21.15.76:0/1421608230 >> [v2:172.21.15.76:6800/4200406736,v1:172.21.15.76:6801/4200406736] conn(0x7f6c880386b0 0x7f6c8803ab70 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:42:55.614 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:55.117+0000 7f6ca5e00700 1 --2- 172.21.15.76:0/1421608230 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6ca0106f80 0x7f6ca019a1e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:42:55.614 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:55.117+0000 7f6ca5e00700 1 -- 172.21.15.76:0/1421608230 >> 172.21.15.76:0/1421608230 conn(0x7f6ca01009f0 msgr2=0x7f6ca01015d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:42:55.614 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:55.117+0000 7f6ca5e00700 1 -- 172.21.15.76:0/1421608230 shutdown_connections 2024-06-02T04:42:55.614 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:55.117+0000 7f6ca5e00700 1 -- 172.21.15.76:0/1421608230 wait complete. 2024-06-02T04:42:56.419 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:56 smithi076 ceph-mon[42935]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:42:56.419 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:56 smithi076 ceph-mon[42935]: Saving service mgr spec with placement count:2 2024-06-02T04:42:56.419 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:56 smithi076 ceph-mon[42935]: from='mgr.14120 172.21.15.76:0/1374455932' entity='mgr.x' 2024-06-02T04:42:56.420 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:56 smithi076 ceph-mon[42935]: from='mgr.14120 172.21.15.76:0/1374455932' entity='mgr.x' 2024-06-02T04:42:56.601 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:55.981+0000 7f9e3fc3f700 1 Processor -- start 2024-06-02T04:42:56.601 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:55.981+0000 7f9e3fc3f700 1 -- start start 2024-06-02T04:42:56.601 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:55.981+0000 7f9e3fc3f700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9e38106fb0 0x7f9e381093a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:42:56.601 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:55.981+0000 7f9e3fc3f700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e38079e90 con 0x7f9e38106fb0 2024-06-02T04:42:56.602 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:55.982+0000 7f9e3d9db700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9e38106fb0 0x7f9e381093a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:42:56.602 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:55.982+0000 7f9e3d9db700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9e38106fb0 0x7f9e381093a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:40634/0 (socket says 172.21.15.76:40634) 2024-06-02T04:42:56.602 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:55.982+0000 7f9e3d9db700 1 -- 172.21.15.76:0/1468219681 learned_addr learned my addr 172.21.15.76:0/1468219681 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:42:56.602 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:55.982+0000 7f9e3d9db700 1 -- 172.21.15.76:0/1468219681 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e381098e0 con 0x7f9e38106fb0 2024-06-02T04:42:56.602 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:55.982+0000 7f9e3d9db700 1 --2- 172.21.15.76:0/1468219681 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9e38106fb0 0x7f9e381093a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9e300098a0 tx=0x7f9e30009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f32d133c5bed928 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:42:56.602 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:55.982+0000 7f9e3c9d9700 1 -- 172.21.15.76:0/1468219681 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9e30004160 con 0x7f9e38106fb0 2024-06-02T04:42:56.602 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:55.982+0000 7f9e3c9d9700 1 -- 172.21.15.76:0/1468219681 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9e300042c0 con 0x7f9e38106fb0 2024-06-02T04:42:56.602 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:55.982+0000 7f9e3c9d9700 1 -- 172.21.15.76:0/1468219681 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9e300118e0 con 0x7f9e38106fb0 2024-06-02T04:42:56.602 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:55.983+0000 7f9e3fc3f700 1 -- 172.21.15.76:0/1468219681 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9e38106fb0 msgr2=0x7f9e381093a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:42:56.602 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:55.983+0000 7f9e3fc3f700 1 --2- 172.21.15.76:0/1468219681 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9e38106fb0 0x7f9e381093a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9e300098a0 tx=0x7f9e30009bb0 comp rx=0 tx=0).stop 2024-06-02T04:42:56.603 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:55.983+0000 7f9e3fc3f700 1 -- 172.21.15.76:0/1468219681 shutdown_connections 2024-06-02T04:42:56.603 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:55.983+0000 7f9e3fc3f700 1 --2- 172.21.15.76:0/1468219681 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9e38106fb0 0x7f9e381093a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:42:56.603 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:55.983+0000 7f9e3fc3f700 1 -- 172.21.15.76:0/1468219681 >> 172.21.15.76:0/1468219681 conn(0x7f9e38100a80 msgr2=0x7f9e38102ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:42:56.603 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:55.983+0000 7f9e3fc3f700 1 -- 172.21.15.76:0/1468219681 shutdown_connections 2024-06-02T04:42:56.603 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:55.983+0000 7f9e3fc3f700 1 -- 172.21.15.76:0/1468219681 wait complete. 2024-06-02T04:42:56.603 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:55.983+0000 7f9e3fc3f700 1 Processor -- start 2024-06-02T04:42:56.603 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:55.983+0000 7f9e3fc3f700 1 -- start start 2024-06-02T04:42:56.603 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:55.984+0000 7f9e3fc3f700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9e38106fb0 0x7f9e381067e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:42:56.603 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:55.984+0000 7f9e3fc3f700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e38106d20 con 0x7f9e38106fb0 2024-06-02T04:42:56.603 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:55.984+0000 7f9e3d9db700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9e38106fb0 0x7f9e381067e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:42:56.603 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:55.984+0000 7f9e3d9db700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9e38106fb0 0x7f9e381067e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:40644/0 (socket says 172.21.15.76:40644) 2024-06-02T04:42:56.603 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:55.984+0000 7f9e3d9db700 1 -- 172.21.15.76:0/3969146651 learned_addr learned my addr 172.21.15.76:0/3969146651 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:42:56.604 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:55.984+0000 7f9e3d9db700 1 -- 172.21.15.76:0/3969146651 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e30009550 con 0x7f9e38106fb0 2024-06-02T04:42:56.604 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:55.984+0000 7f9e3d9db700 1 --2- 172.21.15.76:0/3969146651 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9e38106fb0 0x7f9e381067e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9e30003e30 tx=0x7f9e30011e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:42:56.604 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:55.984+0000 7f9e36ffd700 1 -- 172.21.15.76:0/3969146651 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9e300036a0 con 0x7f9e38106fb0 2024-06-02T04:42:56.604 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:55.984+0000 7f9e36ffd700 1 -- 172.21.15.76:0/3969146651 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9e3001b440 con 0x7f9e38106fb0 2024-06-02T04:42:56.604 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:55.984+0000 7f9e3fc3f700 1 -- 172.21.15.76:0/3969146651 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e38104f60 con 0x7f9e38106fb0 2024-06-02T04:42:56.604 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:55.984+0000 7f9e36ffd700 1 -- 172.21.15.76:0/3969146651 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9e300193d0 con 0x7f9e38106fb0 2024-06-02T04:42:56.604 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:55.984+0000 7f9e3fc3f700 1 -- 172.21.15.76:0/3969146651 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e38105400 con 0x7f9e38106fb0 2024-06-02T04:42:56.604 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:55.985+0000 7f9e36ffd700 1 -- 172.21.15.76:0/3969146651 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7f9e30003800 con 0x7f9e38106fb0 2024-06-02T04:42:56.604 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:55.985+0000 7f9e3fc3f700 1 -- 172.21.15.76:0/3969146651 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e380625d0 con 0x7f9e38106fb0 2024-06-02T04:42:56.604 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:55.985+0000 7f9e36ffd700 1 --2- 172.21.15.76:0/3969146651 >> [v2:172.21.15.76:6800/4200406736,v1:172.21.15.76:6801/4200406736] conn(0x7f9e20038700 0x7f9e2003abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:42:56.604 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:55.985+0000 7f9e36ffd700 1 -- 172.21.15.76:0/3969146651 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f9e3004c4e0 con 0x7f9e38106fb0 2024-06-02T04:42:56.604 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:55.985+0000 7f9e3d1da700 1 --2- 172.21.15.76:0/3969146651 >> [v2:172.21.15.76:6800/4200406736,v1:172.21.15.76:6801/4200406736] conn(0x7f9e20038700 0x7f9e2003abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:42:56.605 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:55.986+0000 7f9e3d1da700 1 --2- 172.21.15.76:0/3969146651 >> [v2:172.21.15.76:6800/4200406736,v1:172.21.15.76:6801/4200406736] conn(0x7f9e20038700 0x7f9e2003abc0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c006fd0 tx=0x7f9e2c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:42:56.605 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:55.990+0000 7f9e36ffd700 1 -- 172.21.15.76:0/3969146651 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f9e3002b7c0 con 0x7f9e38106fb0 2024-06-02T04:42:56.605 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:56.192+0000 7f9e3fc3f700 1 -- 172.21.15.76:0/3969146651 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7f9e380746d0 con 0x7f9e38106fb0 2024-06-02T04:42:56.605 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:56.196+0000 7f9e36ffd700 1 -- 172.21.15.76:0/3969146651 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7f9e3002b7c0 con 0x7f9e38106fb0 2024-06-02T04:42:56.605 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:56.198+0000 7f9e3fc3f700 1 -- 172.21.15.76:0/3969146651 >> [v2:172.21.15.76:6800/4200406736,v1:172.21.15.76:6801/4200406736] conn(0x7f9e20038700 msgr2=0x7f9e2003abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:42:56.605 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:56.198+0000 7f9e3fc3f700 1 --2- 172.21.15.76:0/3969146651 >> [v2:172.21.15.76:6800/4200406736,v1:172.21.15.76:6801/4200406736] conn(0x7f9e20038700 0x7f9e2003abc0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c006fd0 tx=0x7f9e2c006e40 comp rx=0 tx=0).stop 2024-06-02T04:42:56.605 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:56.198+0000 7f9e3fc3f700 1 -- 172.21.15.76:0/3969146651 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9e38106fb0 msgr2=0x7f9e381067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:42:56.605 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:56.198+0000 7f9e3fc3f700 1 --2- 172.21.15.76:0/3969146651 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9e38106fb0 0x7f9e381067e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9e30003e30 tx=0x7f9e30011e80 comp rx=0 tx=0).stop 2024-06-02T04:42:56.605 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:56.198+0000 7f9e3fc3f700 1 -- 172.21.15.76:0/3969146651 shutdown_connections 2024-06-02T04:42:56.605 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:56.198+0000 7f9e3fc3f700 1 --2- 172.21.15.76:0/3969146651 >> [v2:172.21.15.76:6800/4200406736,v1:172.21.15.76:6801/4200406736] conn(0x7f9e20038700 0x7f9e2003abc0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:42:56.605 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:56.198+0000 7f9e3fc3f700 1 --2- 172.21.15.76:0/3969146651 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9e38106fb0 0x7f9e381067e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:42:56.605 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:56.198+0000 7f9e3fc3f700 1 -- 172.21.15.76:0/3969146651 >> 172.21.15.76:0/3969146651 conn(0x7f9e38100a80 msgr2=0x7f9e38101860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:42:56.605 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:56.199+0000 7f9e3fc3f700 1 -- 172.21.15.76:0/3969146651 shutdown_connections 2024-06-02T04:42:56.606 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:56.199+0000 7f9e3fc3f700 1 -- 172.21.15.76:0/3969146651 wait complete. 2024-06-02T04:42:57.357 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:57 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/3969146651' entity='client.admin' 2024-06-02T04:42:57.357 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:57 smithi076 ceph-mon[42935]: from='mgr.14120 172.21.15.76:0/1374455932' entity='mgr.x' 2024-06-02T04:42:57.733 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:57.030+0000 7f6b57292700 1 Processor -- start 2024-06-02T04:42:57.733 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:57.031+0000 7f6b57292700 1 -- start start 2024-06-02T04:42:57.733 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:57.031+0000 7f6b57292700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6b50104d90 0x7f6b501051b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:42:57.733 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:57.031+0000 7f6b57292700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b50079e70 con 0x7f6b50104d90 2024-06-02T04:42:57.733 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:57.031+0000 7f6b5502e700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6b50104d90 0x7f6b501051b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:42:57.733 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:57.031+0000 7f6b5502e700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6b50104d90 0x7f6b501051b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:40658/0 (socket says 172.21.15.76:40658) 2024-06-02T04:42:57.733 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:57.031+0000 7f6b5502e700 1 -- 172.21.15.76:0/1838990284 learned_addr learned my addr 172.21.15.76:0/1838990284 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:42:57.733 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:57.032+0000 7f6b5502e700 1 -- 172.21.15.76:0/1838990284 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b501056f0 con 0x7f6b50104d90 2024-06-02T04:42:57.734 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:57.032+0000 7f6b5502e700 1 --2- 172.21.15.76:0/1838990284 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6b50104d90 0x7f6b501051b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6b4c0098a0 tx=0x7f6b4c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7430b1f78126d778 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:42:57.734 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:57.032+0000 7f6b47fff700 1 -- 172.21.15.76:0/1838990284 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6b4c004160 con 0x7f6b50104d90 2024-06-02T04:42:57.734 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:57.032+0000 7f6b47fff700 1 -- 172.21.15.76:0/1838990284 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6b4c0042c0 con 0x7f6b50104d90 2024-06-02T04:42:57.734 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:57.032+0000 7f6b47fff700 1 -- 172.21.15.76:0/1838990284 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6b4c0118e0 con 0x7f6b50104d90 2024-06-02T04:42:57.734 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:57.033+0000 7f6b57292700 1 -- 172.21.15.76:0/1838990284 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6b50104d90 msgr2=0x7f6b501051b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:42:57.734 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:57.033+0000 7f6b57292700 1 --2- 172.21.15.76:0/1838990284 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6b50104d90 0x7f6b501051b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6b4c0098a0 tx=0x7f6b4c009bb0 comp rx=0 tx=0).stop 2024-06-02T04:42:57.734 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:57.033+0000 7f6b57292700 1 -- 172.21.15.76:0/1838990284 shutdown_connections 2024-06-02T04:42:57.734 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:57.033+0000 7f6b57292700 1 --2- 172.21.15.76:0/1838990284 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6b50104d90 0x7f6b501051b0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:42:57.734 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:57.033+0000 7f6b57292700 1 -- 172.21.15.76:0/1838990284 >> 172.21.15.76:0/1838990284 conn(0x7f6b50100970 msgr2=0x7f6b50102db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:42:57.734 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:57.033+0000 7f6b57292700 1 -- 172.21.15.76:0/1838990284 shutdown_connections 2024-06-02T04:42:57.734 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:57.033+0000 7f6b57292700 1 -- 172.21.15.76:0/1838990284 wait complete. 2024-06-02T04:42:57.734 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:57.034+0000 7f6b57292700 1 Processor -- start 2024-06-02T04:42:57.735 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:57.034+0000 7f6b57292700 1 -- start start 2024-06-02T04:42:57.735 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:57.034+0000 7f6b57292700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6b50104d90 0x7f6b5019c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:42:57.735 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:57.034+0000 7f6b57292700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b5019c950 con 0x7f6b50104d90 2024-06-02T04:42:57.735 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:57.034+0000 7f6b5502e700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6b50104d90 0x7f6b5019c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:42:57.735 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:57.034+0000 7f6b5502e700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6b50104d90 0x7f6b5019c410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:40666/0 (socket says 172.21.15.76:40666) 2024-06-02T04:42:57.735 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:57.034+0000 7f6b5502e700 1 -- 172.21.15.76:0/3840859749 learned_addr learned my addr 172.21.15.76:0/3840859749 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:42:57.735 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:57.034+0000 7f6b5502e700 1 -- 172.21.15.76:0/3840859749 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b4c009550 con 0x7f6b50104d90 2024-06-02T04:42:57.735 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:57.034+0000 7f6b5502e700 1 --2- 172.21.15.76:0/3840859749 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6b50104d90 0x7f6b5019c410 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6b4c003e30 tx=0x7f6b4c011e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:42:57.735 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:57.035+0000 7f6b467fc700 1 -- 172.21.15.76:0/3840859749 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6b4c0036a0 con 0x7f6b50104d90 2024-06-02T04:42:57.735 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:57.035+0000 7f6b57292700 1 -- 172.21.15.76:0/3840859749 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b5019cb50 con 0x7f6b50104d90 2024-06-02T04:42:57.735 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:57.035+0000 7f6b57292700 1 -- 172.21.15.76:0/3840859749 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b5019cff0 con 0x7f6b50104d90 2024-06-02T04:42:57.735 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:57.035+0000 7f6b467fc700 1 -- 172.21.15.76:0/3840859749 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6b4c01b440 con 0x7f6b50104d90 2024-06-02T04:42:57.735 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:57.035+0000 7f6b467fc700 1 -- 172.21.15.76:0/3840859749 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6b4c0193d0 con 0x7f6b50104d90 2024-06-02T04:42:57.736 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:57.036+0000 7f6b467fc700 1 -- 172.21.15.76:0/3840859749 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7f6b4c019530 con 0x7f6b50104d90 2024-06-02T04:42:57.736 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:57.036+0000 7f6b467fc700 1 --2- 172.21.15.76:0/3840859749 >> [v2:172.21.15.76:6800/4200406736,v1:172.21.15.76:6801/4200406736] conn(0x7f6b3c038750 0x7f6b3c03ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:42:57.736 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:57.036+0000 7f6b467fc700 1 -- 172.21.15.76:0/3840859749 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f6b4c04d4c0 con 0x7f6b50104d90 2024-06-02T04:42:57.736 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:57.036+0000 7f6b57292700 1 -- 172.21.15.76:0/3840859749 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b34005320 con 0x7f6b50104d90 2024-06-02T04:42:57.736 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:57.036+0000 7f6b5482d700 1 --2- 172.21.15.76:0/3840859749 >> [v2:172.21.15.76:6800/4200406736,v1:172.21.15.76:6801/4200406736] conn(0x7f6b3c038750 0x7f6b3c03ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:42:57.736 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:57.037+0000 7f6b5482d700 1 --2- 172.21.15.76:0/3840859749 >> [v2:172.21.15.76:6800/4200406736,v1:172.21.15.76:6801/4200406736] conn(0x7f6b3c038750 0x7f6b3c03ac10 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f6b40006fd0 tx=0x7f6b40006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:42:57.736 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:57.042+0000 7f6b467fc700 1 -- 172.21.15.76:0/3840859749 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f6b4c018710 con 0x7f6b50104d90 2024-06-02T04:42:57.736 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:57.248+0000 7f6b57292700 1 -- 172.21.15.76:0/3840859749 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7f6b34005b50 con 0x7f6b50104d90 2024-06-02T04:42:57.736 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:57.253+0000 7f6b467fc700 1 -- 172.21.15.76:0/3840859749 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7f6b4c018350 con 0x7f6b50104d90 2024-06-02T04:42:57.736 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:57.256+0000 7f6b57292700 1 -- 172.21.15.76:0/3840859749 >> [v2:172.21.15.76:6800/4200406736,v1:172.21.15.76:6801/4200406736] conn(0x7f6b3c038750 msgr2=0x7f6b3c03ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:42:57.736 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:57.256+0000 7f6b57292700 1 --2- 172.21.15.76:0/3840859749 >> [v2:172.21.15.76:6800/4200406736,v1:172.21.15.76:6801/4200406736] conn(0x7f6b3c038750 0x7f6b3c03ac10 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f6b40006fd0 tx=0x7f6b40006e40 comp rx=0 tx=0).stop 2024-06-02T04:42:57.736 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:57.256+0000 7f6b57292700 1 -- 172.21.15.76:0/3840859749 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6b50104d90 msgr2=0x7f6b5019c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:42:57.736 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:57.256+0000 7f6b57292700 1 --2- 172.21.15.76:0/3840859749 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6b50104d90 0x7f6b5019c410 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6b4c003e30 tx=0x7f6b4c011e80 comp rx=0 tx=0).stop 2024-06-02T04:42:57.737 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:57.256+0000 7f6b57292700 1 -- 172.21.15.76:0/3840859749 shutdown_connections 2024-06-02T04:42:57.737 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:57.256+0000 7f6b57292700 1 --2- 172.21.15.76:0/3840859749 >> [v2:172.21.15.76:6800/4200406736,v1:172.21.15.76:6801/4200406736] conn(0x7f6b3c038750 0x7f6b3c03ac10 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:42:57.737 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:57.256+0000 7f6b57292700 1 --2- 172.21.15.76:0/3840859749 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6b50104d90 0x7f6b5019c410 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:42:57.737 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:57.256+0000 7f6b57292700 1 -- 172.21.15.76:0/3840859749 >> 172.21.15.76:0/3840859749 conn(0x7f6b50100970 msgr2=0x7f6b501932a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:42:57.737 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:57.256+0000 7f6b57292700 1 -- 172.21.15.76:0/3840859749 shutdown_connections 2024-06-02T04:42:57.737 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:57.256+0000 7f6b57292700 1 -- 172.21.15.76:0/3840859749 wait complete. 2024-06-02T04:42:57.737 INFO:teuthology.orchestra.run.smithi076.stdout:Enabling the dashboard module... 2024-06-02T04:42:58.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:58 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/3840859749' entity='client.admin' 2024-06-02T04:42:59.605 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:42:59 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/856062908' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-06-02T04:42:59.606 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Jun 02 04:42:59 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-x[43184]: ignoring --setuser ceph since I am not root 2024-06-02T04:42:59.606 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Jun 02 04:42:59 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-x[43184]: ignoring --setgroup ceph since I am not root 2024-06-02T04:42:59.641 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:58.269+0000 7f61ea868700 1 Processor -- start 2024-06-02T04:42:59.641 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:58.269+0000 7f61ea868700 1 -- start start 2024-06-02T04:42:59.641 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:58.269+0000 7f61ea868700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f61e4104b60 0x7f61e4104f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:42:59.642 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:58.269+0000 7f61ea868700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61e4105550 con 0x7f61e4104b60 2024-06-02T04:42:59.642 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:58.269+0000 7f61e3fff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f61e4104b60 0x7f61e4104f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:42:59.642 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:58.269+0000 7f61e3fff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f61e4104b60 0x7f61e4104f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:40676/0 (socket says 172.21.15.76:40676) 2024-06-02T04:42:59.642 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:58.269+0000 7f61e3fff700 1 -- 172.21.15.76:0/3301229240 learned_addr learned my addr 172.21.15.76:0/3301229240 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:42:59.642 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:58.270+0000 7f61e3fff700 1 -- 172.21.15.76:0/3301229240 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61e4105d60 con 0x7f61e4104b60 2024-06-02T04:42:59.642 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:58.270+0000 7f61e3fff700 1 --2- 172.21.15.76:0/3301229240 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f61e4104b60 0x7f61e4104f80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f61d40098a0 tx=0x7f61d4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f42e9777ecfdfd4b server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:42:59.642 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:58.270+0000 7f61e2ffd700 1 -- 172.21.15.76:0/3301229240 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f61d4004160 con 0x7f61e4104b60 2024-06-02T04:42:59.642 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:58.270+0000 7f61e2ffd700 1 -- 172.21.15.76:0/3301229240 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f61d40042c0 con 0x7f61e4104b60 2024-06-02T04:42:59.642 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:58.270+0000 7f61e2ffd700 1 -- 172.21.15.76:0/3301229240 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f61d40118e0 con 0x7f61e4104b60 2024-06-02T04:42:59.642 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:58.270+0000 7f61ea868700 1 -- 172.21.15.76:0/3301229240 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f61e4104b60 msgr2=0x7f61e4104f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:42:59.642 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:58.270+0000 7f61ea868700 1 --2- 172.21.15.76:0/3301229240 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f61e4104b60 0x7f61e4104f80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f61d40098a0 tx=0x7f61d4009bb0 comp rx=0 tx=0).stop 2024-06-02T04:42:59.643 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:58.270+0000 7f61ea868700 1 -- 172.21.15.76:0/3301229240 shutdown_connections 2024-06-02T04:42:59.643 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:58.270+0000 7f61ea868700 1 --2- 172.21.15.76:0/3301229240 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f61e4104b60 0x7f61e4104f80 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:42:59.643 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:58.270+0000 7f61ea868700 1 -- 172.21.15.76:0/3301229240 >> 172.21.15.76:0/3301229240 conn(0x7f61e4100100 msgr2=0x7f61e4102540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:42:59.643 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:58.270+0000 7f61ea868700 1 -- 172.21.15.76:0/3301229240 shutdown_connections 2024-06-02T04:42:59.643 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:58.271+0000 7f61ea868700 1 -- 172.21.15.76:0/3301229240 wait complete. 2024-06-02T04:42:59.643 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:58.271+0000 7f61ea868700 1 Processor -- start 2024-06-02T04:42:59.643 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:58.271+0000 7f61ea868700 1 -- start start 2024-06-02T04:42:59.643 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:58.271+0000 7f61ea868700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f61e4104b60 0x7f61e418fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:42:59.643 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:58.271+0000 7f61ea868700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61e4190100 con 0x7f61e4104b60 2024-06-02T04:42:59.643 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:58.272+0000 7f61e3fff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f61e4104b60 0x7f61e418fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:42:59.643 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:58.272+0000 7f61e3fff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f61e4104b60 0x7f61e418fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:40690/0 (socket says 172.21.15.76:40690) 2024-06-02T04:42:59.643 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:58.272+0000 7f61e3fff700 1 -- 172.21.15.76:0/856062908 learned_addr learned my addr 172.21.15.76:0/856062908 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:42:59.643 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:58.272+0000 7f61e3fff700 1 -- 172.21.15.76:0/856062908 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61d4009550 con 0x7f61e4104b60 2024-06-02T04:42:59.643 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:58.272+0000 7f61e3fff700 1 --2- 172.21.15.76:0/856062908 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f61e4104b60 0x7f61e418fbc0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f61d4003e30 tx=0x7f61d4011e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:42:59.644 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:58.272+0000 7f61e17fa700 1 -- 172.21.15.76:0/856062908 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f61d40036a0 con 0x7f61e4104b60 2024-06-02T04:42:59.644 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:58.272+0000 7f61e17fa700 1 -- 172.21.15.76:0/856062908 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f61d401b440 con 0x7f61e4104b60 2024-06-02T04:42:59.644 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:58.272+0000 7f61ea868700 1 -- 172.21.15.76:0/856062908 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61e418e340 con 0x7f61e4104b60 2024-06-02T04:42:59.644 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:58.272+0000 7f61e17fa700 1 -- 172.21.15.76:0/856062908 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f61d40193d0 con 0x7f61e4104b60 2024-06-02T04:42:59.644 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:58.272+0000 7f61ea868700 1 -- 172.21.15.76:0/856062908 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61e418e7e0 con 0x7f61e4104b60 2024-06-02T04:42:59.644 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:58.273+0000 7f61e17fa700 1 -- 172.21.15.76:0/856062908 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7f61d4019640 con 0x7f61e4104b60 2024-06-02T04:42:59.644 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:58.273+0000 7f61ea868700 1 -- 172.21.15.76:0/856062908 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61e418f1f0 con 0x7f61e4104b60 2024-06-02T04:42:59.644 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:58.273+0000 7f61e17fa700 1 --2- 172.21.15.76:0/856062908 >> [v2:172.21.15.76:6800/4200406736,v1:172.21.15.76:6801/4200406736] conn(0x7f61cc038700 0x7f61cc03abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:42:59.644 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:58.273+0000 7f61e17fa700 1 -- 172.21.15.76:0/856062908 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f61d404c550 con 0x7f61e4104b60 2024-06-02T04:42:59.644 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:58.273+0000 7f61e37fe700 1 --2- 172.21.15.76:0/856062908 >> [v2:172.21.15.76:6800/4200406736,v1:172.21.15.76:6801/4200406736] conn(0x7f61cc038700 0x7f61cc03abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:42:59.644 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:58.274+0000 7f61e37fe700 1 --2- 172.21.15.76:0/856062908 >> [v2:172.21.15.76:6800/4200406736,v1:172.21.15.76:6801/4200406736] conn(0x7f61cc038700 0x7f61cc03abc0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f61d8006fd0 tx=0x7f61d8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:42:59.644 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:58.278+0000 7f61e17fa700 1 -- 172.21.15.76:0/856062908 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f61d4018940 con 0x7f61e4104b60 2024-06-02T04:42:59.645 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:58.525+0000 7f61ea868700 1 -- 172.21.15.76:0/856062908 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7f61e40625d0 con 0x7f61e4104b60 2024-06-02T04:42:59.645 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:59.260+0000 7f61e17fa700 1 -- 172.21.15.76:0/856062908 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mgrmap(e 9) v1 ==== 45554+0+0 (secure 0 0 0) 0x7f61d401a430 con 0x7f61e4104b60 2024-06-02T04:42:59.645 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:59.261+0000 7f61e17fa700 1 -- 172.21.15.76:0/856062908 <== mon.0 v2:172.21.15.76:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7f61d40227c0 con 0x7f61e4104b60 2024-06-02T04:42:59.645 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:59.264+0000 7f61ea868700 1 -- 172.21.15.76:0/856062908 >> [v2:172.21.15.76:6800/4200406736,v1:172.21.15.76:6801/4200406736] conn(0x7f61cc038700 msgr2=0x7f61cc03abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:42:59.645 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:59.264+0000 7f61ea868700 1 --2- 172.21.15.76:0/856062908 >> [v2:172.21.15.76:6800/4200406736,v1:172.21.15.76:6801/4200406736] conn(0x7f61cc038700 0x7f61cc03abc0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f61d8006fd0 tx=0x7f61d8006e40 comp rx=0 tx=0).stop 2024-06-02T04:42:59.645 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:59.264+0000 7f61ea868700 1 -- 172.21.15.76:0/856062908 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f61e4104b60 msgr2=0x7f61e418fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:42:59.645 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:59.264+0000 7f61ea868700 1 --2- 172.21.15.76:0/856062908 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f61e4104b60 0x7f61e418fbc0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f61d4003e30 tx=0x7f61d4011e80 comp rx=0 tx=0).stop 2024-06-02T04:42:59.645 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:59.265+0000 7f61ea868700 1 -- 172.21.15.76:0/856062908 shutdown_connections 2024-06-02T04:42:59.645 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:59.265+0000 7f61ea868700 1 --2- 172.21.15.76:0/856062908 >> [v2:172.21.15.76:6800/4200406736,v1:172.21.15.76:6801/4200406736] conn(0x7f61cc038700 0x7f61cc03abc0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:42:59.645 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:59.265+0000 7f61ea868700 1 --2- 172.21.15.76:0/856062908 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f61e4104b60 0x7f61e418fbc0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:42:59.645 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:59.265+0000 7f61ea868700 1 -- 172.21.15.76:0/856062908 >> 172.21.15.76:0/856062908 conn(0x7f61e4100100 msgr2=0x7f61e41014b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:42:59.645 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:59.265+0000 7f61ea868700 1 -- 172.21.15.76:0/856062908 shutdown_connections 2024-06-02T04:42:59.645 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:42:59.265+0000 7f61ea868700 1 -- 172.21.15.76:0/856062908 wait complete. 2024-06-02T04:42:59.860 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Jun 02 04:42:59 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-x[43184]: 2024-06-02T04:42:59.720+0000 7fbeab6c9200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-06-02T04:42:59.860 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Jun 02 04:42:59 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-x[43184]: 2024-06-02T04:42:59.816+0000 7fbeab6c9200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-06-02T04:43:00.233 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Jun 02 04:42:59 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-x[43184]: 2024-06-02T04:42:59.908+0000 7fbeab6c9200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-06-02T04:43:00.233 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Jun 02 04:42:59 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-x[43184]: 2024-06-02T04:42:59.997+0000 7fbeab6c9200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-06-02T04:43:00.510 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:00 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/856062908' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-06-02T04:43:00.510 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:00 smithi076 ceph-mon[42935]: mgrmap e9: x(active, since 14s) 2024-06-02T04:43:00.727 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout { 2024-06-02T04:43:00.727 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-06-02T04:43:00.727 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "available": true, 2024-06-02T04:43:00.727 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-06-02T04:43:00.727 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-06-02T04:43:00.727 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout } 2024-06-02T04:43:00.728 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:00.079+0000 7f7777988700 1 Processor -- start 2024-06-02T04:43:00.728 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:00.079+0000 7f7777988700 1 -- start start 2024-06-02T04:43:00.728 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:00.079+0000 7f7777988700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f777007bee0 0x7f777007a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:43:00.728 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:00.079+0000 7f7777988700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f777007a910 con 0x7f777007bee0 2024-06-02T04:43:00.728 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:00.080+0000 7f7775724700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f777007bee0 0x7f777007a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:43:00.728 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:00.080+0000 7f7775724700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f777007bee0 0x7f777007a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:40726/0 (socket says 172.21.15.76:40726) 2024-06-02T04:43:00.728 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:00.080+0000 7f7775724700 1 -- 172.21.15.76:0/2206216867 learned_addr learned my addr 172.21.15.76:0/2206216867 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:43:00.728 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:00.080+0000 7f7775724700 1 -- 172.21.15.76:0/2206216867 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f777007aa50 con 0x7f777007bee0 2024-06-02T04:43:00.728 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:00.080+0000 7f7775724700 1 --2- 172.21.15.76:0/2206216867 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f777007bee0 0x7f777007a340 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f776c0098a0 tx=0x7f776c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc44fe5e3a1eb120 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:43:00.728 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:00.080+0000 7f7767fff700 1 -- 172.21.15.76:0/2206216867 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f776c004160 con 0x7f777007bee0 2024-06-02T04:43:00.728 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:00.080+0000 7f7767fff700 1 -- 172.21.15.76:0/2206216867 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f776c0042c0 con 0x7f777007bee0 2024-06-02T04:43:00.729 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:00.080+0000 7f7767fff700 1 -- 172.21.15.76:0/2206216867 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f776c0118e0 con 0x7f777007bee0 2024-06-02T04:43:00.729 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:00.081+0000 7f7777988700 1 -- 172.21.15.76:0/2206216867 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f777007bee0 msgr2=0x7f777007a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:43:00.729 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:00.081+0000 7f7777988700 1 --2- 172.21.15.76:0/2206216867 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f777007bee0 0x7f777007a340 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f776c0098a0 tx=0x7f776c009bb0 comp rx=0 tx=0).stop 2024-06-02T04:43:00.729 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:00.081+0000 7f7777988700 1 -- 172.21.15.76:0/2206216867 shutdown_connections 2024-06-02T04:43:00.729 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:00.081+0000 7f7777988700 1 --2- 172.21.15.76:0/2206216867 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f777007bee0 0x7f777007a340 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:43:00.729 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:00.081+0000 7f7777988700 1 -- 172.21.15.76:0/2206216867 >> 172.21.15.76:0/2206216867 conn(0x7f7770101ae0 msgr2=0x7f7770103f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:43:00.729 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:00.081+0000 7f7777988700 1 -- 172.21.15.76:0/2206216867 shutdown_connections 2024-06-02T04:43:00.729 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:00.081+0000 7f7777988700 1 -- 172.21.15.76:0/2206216867 wait complete. 2024-06-02T04:43:00.729 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:00.082+0000 7f7777988700 1 Processor -- start 2024-06-02T04:43:00.729 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:00.082+0000 7f7777988700 1 -- start start 2024-06-02T04:43:00.729 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:00.082+0000 7f7777988700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f777007bee0 0x7f777019c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:43:00.729 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:00.082+0000 7f7777988700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f777019cc90 con 0x7f777007bee0 2024-06-02T04:43:00.729 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:00.082+0000 7f7775724700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f777007bee0 0x7f777019c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:43:00.730 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:00.082+0000 7f7775724700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f777007bee0 0x7f777019c750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:40730/0 (socket says 172.21.15.76:40730) 2024-06-02T04:43:00.730 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:00.082+0000 7f7775724700 1 -- 172.21.15.76:0/2946804139 learned_addr learned my addr 172.21.15.76:0/2946804139 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:43:00.730 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:00.082+0000 7f7775724700 1 -- 172.21.15.76:0/2946804139 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f776c009550 con 0x7f777007bee0 2024-06-02T04:43:00.730 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:00.082+0000 7f7775724700 1 --2- 172.21.15.76:0/2946804139 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f777007bee0 0x7f777019c750 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f776c003e30 tx=0x7f776c011e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:43:00.730 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:00.082+0000 7f77667fc700 1 -- 172.21.15.76:0/2946804139 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f776c0036a0 con 0x7f777007bee0 2024-06-02T04:43:00.730 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:00.082+0000 7f7777988700 1 -- 172.21.15.76:0/2946804139 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f777019ce90 con 0x7f777007bee0 2024-06-02T04:43:00.730 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:00.082+0000 7f77667fc700 1 -- 172.21.15.76:0/2946804139 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f776c01b440 con 0x7f777007bee0 2024-06-02T04:43:00.730 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:00.082+0000 7f77667fc700 1 -- 172.21.15.76:0/2946804139 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f776c0193d0 con 0x7f777007bee0 2024-06-02T04:43:00.730 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:00.083+0000 7f7777988700 1 -- 172.21.15.76:0/2946804139 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f777019d330 con 0x7f777007bee0 2024-06-02T04:43:00.730 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:00.083+0000 7f77667fc700 1 -- 172.21.15.76:0/2946804139 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 9) v1 ==== 45554+0+0 (secure 0 0 0) 0x7f776c019690 con 0x7f777007bee0 2024-06-02T04:43:00.730 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:00.083+0000 7f77667fc700 1 --2- 172.21.15.76:0/2946804139 >> [v2:172.21.15.76:6800/4200406736,v1:172.21.15.76:6801/4200406736] conn(0x7f775c038700 0x7f775c03abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:43:00.730 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:00.083+0000 7f77667fc700 1 -- 172.21.15.76:0/2946804139 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f776c04c860 con 0x7f777007bee0 2024-06-02T04:43:00.730 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:00.083+0000 7f7774f23700 1 -- 172.21.15.76:0/2946804139 >> [v2:172.21.15.76:6800/4200406736,v1:172.21.15.76:6801/4200406736] conn(0x7f775c038700 msgr2=0x7f775c03abc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.76:6800/4200406736 2024-06-02T04:43:00.731 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:00.084+0000 7f7774f23700 1 --2- 172.21.15.76:0/2946804139 >> [v2:172.21.15.76:6800/4200406736,v1:172.21.15.76:6801/4200406736] conn(0x7f775c038700 0x7f775c03abc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-06-02T04:43:00.731 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:00.084+0000 7f7777988700 1 -- 172.21.15.76:0/2946804139 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77701964a0 con 0x7f777007bee0 2024-06-02T04:43:00.731 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:00.091+0000 7f77667fc700 1 -- 172.21.15.76:0/2946804139 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f776c01a3d0 con 0x7f777007bee0 2024-06-02T04:43:00.731 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:00.285+0000 7f7774f23700 1 -- 172.21.15.76:0/2946804139 >> [v2:172.21.15.76:6800/4200406736,v1:172.21.15.76:6801/4200406736] conn(0x7f775c038700 msgr2=0x7f775c03abc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.76:6800/4200406736 2024-06-02T04:43:00.731 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:00.285+0000 7f7774f23700 1 --2- 172.21.15.76:0/2946804139 >> [v2:172.21.15.76:6800/4200406736,v1:172.21.15.76:6801/4200406736] conn(0x7f775c038700 0x7f775c03abc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-06-02T04:43:00.731 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:00.345+0000 7f7777988700 1 -- 172.21.15.76:0/2946804139 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f77700625d0 con 0x7f777007bee0 2024-06-02T04:43:00.731 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:00.345+0000 7f77667fc700 1 -- 172.21.15.76:0/2946804139 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+88 (secure 0 0 0) 0x7f776c018350 con 0x7f777007bee0 2024-06-02T04:43:00.731 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:00.349+0000 7f7777988700 1 -- 172.21.15.76:0/2946804139 >> [v2:172.21.15.76:6800/4200406736,v1:172.21.15.76:6801/4200406736] conn(0x7f775c038700 msgr2=0x7f775c03abc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-02T04:43:00.731 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:00.349+0000 7f7777988700 1 --2- 172.21.15.76:0/2946804139 >> [v2:172.21.15.76:6800/4200406736,v1:172.21.15.76:6801/4200406736] conn(0x7f775c038700 0x7f775c03abc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:43:00.731 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:00.349+0000 7f7777988700 1 -- 172.21.15.76:0/2946804139 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f777007bee0 msgr2=0x7f777019c750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:43:00.731 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:00.349+0000 7f7777988700 1 --2- 172.21.15.76:0/2946804139 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f777007bee0 0x7f777019c750 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f776c003e30 tx=0x7f776c011e80 comp rx=0 tx=0).stop 2024-06-02T04:43:00.732 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:00.349+0000 7f7777988700 1 -- 172.21.15.76:0/2946804139 shutdown_connections 2024-06-02T04:43:00.732 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:00.349+0000 7f7777988700 1 --2- 172.21.15.76:0/2946804139 >> [v2:172.21.15.76:6800/4200406736,v1:172.21.15.76:6801/4200406736] conn(0x7f775c038700 0x7f775c03abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:43:00.732 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:00.349+0000 7f7777988700 1 --2- 172.21.15.76:0/2946804139 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f777007bee0 0x7f777019c750 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:43:00.732 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:00.349+0000 7f7777988700 1 -- 172.21.15.76:0/2946804139 >> 172.21.15.76:0/2946804139 conn(0x7f7770101ae0 msgr2=0x7f7770102910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:43:00.732 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:00.349+0000 7f7777988700 1 -- 172.21.15.76:0/2946804139 shutdown_connections 2024-06-02T04:43:00.732 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:00.349+0000 7f7777988700 1 -- 172.21.15.76:0/2946804139 wait complete. 2024-06-02T04:43:00.732 INFO:teuthology.orchestra.run.smithi076.stdout:Waiting for the mgr to restart... 2024-06-02T04:43:00.732 INFO:teuthology.orchestra.run.smithi076.stdout:Waiting for mgr epoch 9... 2024-06-02T04:43:00.826 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Jun 02 04:43:00 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-x[43184]: 2024-06-02T04:43:00.658+0000 7fbeab6c9200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-06-02T04:43:01.144 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Jun 02 04:43:00 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-x[43184]: 2024-06-02T04:43:00.939+0000 7fbeab6c9200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-06-02T04:43:01.145 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Jun 02 04:43:01 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-x[43184]: 2024-06-02T04:43:01.030+0000 7fbeab6c9200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-06-02T04:43:01.145 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Jun 02 04:43:01 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-x[43184]: 2024-06-02T04:43:01.144+0000 7fbeab6c9200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-06-02T04:43:01.429 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:01 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/2946804139' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-06-02T04:43:01.430 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Jun 02 04:43:01 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-x[43184]: 2024-06-02T04:43:01.302+0000 7fbeab6c9200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-06-02T04:43:01.733 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Jun 02 04:43:01 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-x[43184]: 2024-06-02T04:43:01.429+0000 7fbeab6c9200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-06-02T04:43:01.733 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Jun 02 04:43:01 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-x[43184]: 2024-06-02T04:43:01.516+0000 7fbeab6c9200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-06-02T04:43:02.233 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Jun 02 04:43:01 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-x[43184]: 2024-06-02T04:43:01.885+0000 7fbeab6c9200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-06-02T04:43:02.562 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Jun 02 04:43:02 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-x[43184]: 2024-06-02T04:43:02.273+0000 7fbeab6c9200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-06-02T04:43:02.563 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Jun 02 04:43:02 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-x[43184]: 2024-06-02T04:43:02.467+0000 7fbeab6c9200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-06-02T04:43:02.563 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Jun 02 04:43:02 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-x[43184]: 2024-06-02T04:43:02.562+0000 7fbeab6c9200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-06-02T04:43:03.733 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Jun 02 04:43:03 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-x[43184]: 2024-06-02T04:43:03.326+0000 7fbeab6c9200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-06-02T04:43:03.733 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Jun 02 04:43:03 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-x[43184]: 2024-06-02T04:43:03.423+0000 7fbeab6c9200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-06-02T04:43:03.733 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Jun 02 04:43:03 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-x[43184]: 2024-06-02T04:43:03.572+0000 7fbeab6c9200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-06-02T04:43:04.483 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Jun 02 04:43:04 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-x[43184]: 2024-06-02T04:43:04.198+0000 7fbeab6c9200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-06-02T04:43:04.483 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Jun 02 04:43:04 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-x[43184]: 2024-06-02T04:43:04.382+0000 7fbeab6c9200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-06-02T04:43:04.983 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Jun 02 04:43:04 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-x[43184]: 2024-06-02T04:43:04.578+0000 7fbeab6c9200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-06-02T04:43:05.799 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Jun 02 04:43:05 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-x[43184]: 2024-06-02T04:43:05.508+0000 7fbeab6c9200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-06-02T04:43:05.799 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Jun 02 04:43:05 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-x[43184]: 2024-06-02T04:43:05.795+0000 7fbeab6c9200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-06-02T04:43:06.079 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Jun 02 04:43:05 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-x[43184]: 2024-06-02T04:43:05.883+0000 7fbeab6c9200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-06-02T04:43:06.079 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Jun 02 04:43:06 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-x[43184]: 2024-06-02T04:43:06.079+0000 7fbeab6c9200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-06-02T04:43:06.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:06 smithi076 ceph-mon[42935]: Active manager daemon x restarted 2024-06-02T04:43:06.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:06 smithi076 ceph-mon[42935]: Activating manager daemon x 2024-06-02T04:43:06.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:06 smithi076 ceph-mon[42935]: osdmap e3: 0 total, 0 up, 0 in 2024-06-02T04:43:06.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:06 smithi076 ceph-mon[42935]: mgrmap e10: x(active, starting, since 0.00333697s) 2024-06-02T04:43:06.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:06 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-02T04:43:06.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:06 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-06-02T04:43:06.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:06 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-06-02T04:43:06.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:06 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-06-02T04:43:06.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:06 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-06-02T04:43:06.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:06 smithi076 ceph-mon[42935]: Manager daemon x is now available 2024-06-02T04:43:06.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:06 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:43:07.473 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:07 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-06-02T04:43:07.473 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:07 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-06-02T04:43:07.474 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:07 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:07.474 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:07 smithi076 ceph-mon[42935]: mgrmap e11: x(active, since 1.0078s) 2024-06-02T04:43:07.494 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout { 2024-06-02T04:43:07.494 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-06-02T04:43:07.494 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "initialized": true 2024-06-02T04:43:07.494 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout } 2024-06-02T04:43:07.494 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:01.071+0000 7fdc173d3700 1 Processor -- start 2024-06-02T04:43:07.494 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:01.071+0000 7fdc173d3700 1 -- start start 2024-06-02T04:43:07.494 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:01.071+0000 7fdc173d3700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdc10106f50 0x7fdc10109340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:43:07.494 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:01.071+0000 7fdc173d3700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc10079ed0 con 0x7fdc10106f50 2024-06-02T04:43:07.494 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:01.072+0000 7fdc1516f700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdc10106f50 0x7fdc10109340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:43:07.494 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:01.072+0000 7fdc1516f700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdc10106f50 0x7fdc10109340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:40734/0 (socket says 172.21.15.76:40734) 2024-06-02T04:43:07.494 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:01.072+0000 7fdc1516f700 1 -- 172.21.15.76:0/4069070714 learned_addr learned my addr 172.21.15.76:0/4069070714 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:43:07.495 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:01.072+0000 7fdc1516f700 1 -- 172.21.15.76:0/4069070714 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc10109880 con 0x7fdc10106f50 2024-06-02T04:43:07.495 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:01.072+0000 7fdc1516f700 1 --2- 172.21.15.76:0/4069070714 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdc10106f50 0x7fdc10109340 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fdc0c0098a0 tx=0x7fdc0c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=242e4abca5a0b866 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:43:07.495 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:01.072+0000 7fdc07fff700 1 -- 172.21.15.76:0/4069070714 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdc0c004160 con 0x7fdc10106f50 2024-06-02T04:43:07.495 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:01.072+0000 7fdc07fff700 1 -- 172.21.15.76:0/4069070714 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdc0c0042c0 con 0x7fdc10106f50 2024-06-02T04:43:07.495 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:01.072+0000 7fdc07fff700 1 -- 172.21.15.76:0/4069070714 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdc0c0118e0 con 0x7fdc10106f50 2024-06-02T04:43:07.495 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:01.073+0000 7fdc173d3700 1 -- 172.21.15.76:0/4069070714 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdc10106f50 msgr2=0x7fdc10109340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:43:07.495 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:01.073+0000 7fdc173d3700 1 --2- 172.21.15.76:0/4069070714 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdc10106f50 0x7fdc10109340 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fdc0c0098a0 tx=0x7fdc0c009bb0 comp rx=0 tx=0).stop 2024-06-02T04:43:07.495 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:01.073+0000 7fdc173d3700 1 -- 172.21.15.76:0/4069070714 shutdown_connections 2024-06-02T04:43:07.495 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:01.073+0000 7fdc173d3700 1 --2- 172.21.15.76:0/4069070714 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdc10106f50 0x7fdc10109340 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:43:07.495 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:01.073+0000 7fdc173d3700 1 -- 172.21.15.76:0/4069070714 >> 172.21.15.76:0/4069070714 conn(0x7fdc101009c0 msgr2=0x7fdc10102de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:43:07.496 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:01.073+0000 7fdc173d3700 1 -- 172.21.15.76:0/4069070714 shutdown_connections 2024-06-02T04:43:07.496 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:01.073+0000 7fdc173d3700 1 -- 172.21.15.76:0/4069070714 wait complete. 2024-06-02T04:43:07.496 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:01.073+0000 7fdc173d3700 1 Processor -- start 2024-06-02T04:43:07.496 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:01.074+0000 7fdc173d3700 1 -- start start 2024-06-02T04:43:07.496 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:01.074+0000 7fdc173d3700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdc10106f50 0x7fdc10106780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:43:07.496 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:01.074+0000 7fdc173d3700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc10106cc0 con 0x7fdc10106f50 2024-06-02T04:43:07.496 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:01.074+0000 7fdc1516f700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdc10106f50 0x7fdc10106780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:43:07.496 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:01.074+0000 7fdc1516f700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdc10106f50 0x7fdc10106780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:40742/0 (socket says 172.21.15.76:40742) 2024-06-02T04:43:07.496 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:01.074+0000 7fdc1516f700 1 -- 172.21.15.76:0/805592535 learned_addr learned my addr 172.21.15.76:0/805592535 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:43:07.496 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:01.074+0000 7fdc1516f700 1 -- 172.21.15.76:0/805592535 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc0c009550 con 0x7fdc10106f50 2024-06-02T04:43:07.496 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:01.074+0000 7fdc1516f700 1 --2- 172.21.15.76:0/805592535 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdc10106f50 0x7fdc10106780 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fdc0c0046e0 tx=0x7fdc0c0119a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:43:07.496 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:01.074+0000 7fdc067fc700 1 -- 172.21.15.76:0/805592535 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdc0c0037d0 con 0x7fdc10106f50 2024-06-02T04:43:07.497 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:01.074+0000 7fdc067fc700 1 -- 172.21.15.76:0/805592535 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdc0c01b440 con 0x7fdc10106f50 2024-06-02T04:43:07.497 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:01.074+0000 7fdc173d3700 1 -- 172.21.15.76:0/805592535 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc10104f00 con 0x7fdc10106f50 2024-06-02T04:43:07.497 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:01.074+0000 7fdc067fc700 1 -- 172.21.15.76:0/805592535 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdc0c023400 con 0x7fdc10106f50 2024-06-02T04:43:07.497 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:01.074+0000 7fdc173d3700 1 -- 172.21.15.76:0/805592535 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc101053a0 con 0x7fdc10106f50 2024-06-02T04:43:07.497 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:01.075+0000 7fdc067fc700 1 -- 172.21.15.76:0/805592535 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 9) v1 ==== 45554+0+0 (secure 0 0 0) 0x7fdc0c023630 con 0x7fdc10106f50 2024-06-02T04:43:07.497 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:01.075+0000 7fdc067fc700 1 --2- 172.21.15.76:0/805592535 >> [v2:172.21.15.76:6800/4200406736,v1:172.21.15.76:6801/4200406736] conn(0x7fdbfc0387a0 0x7fdbfc03ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:43:07.497 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:01.075+0000 7fdc173d3700 1 -- 172.21.15.76:0/805592535 --> [v2:172.21.15.76:6800/4200406736,v1:172.21.15.76:6801/4200406736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdc100625d0 con 0x7fdbfc0387a0 2024-06-02T04:43:07.497 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:01.075+0000 7fdc067fc700 1 -- 172.21.15.76:0/805592535 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fdc0c04d580 con 0x7fdc10106f50 2024-06-02T04:43:07.497 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:01.075+0000 7fdc1496e700 1 -- 172.21.15.76:0/805592535 >> [v2:172.21.15.76:6800/4200406736,v1:172.21.15.76:6801/4200406736] conn(0x7fdbfc0387a0 msgr2=0x7fdbfc03ac60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.76:6800/4200406736 2024-06-02T04:43:07.497 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:01.075+0000 7fdc1496e700 1 --2- 172.21.15.76:0/805592535 >> [v2:172.21.15.76:6800/4200406736,v1:172.21.15.76:6801/4200406736] conn(0x7fdbfc0387a0 0x7fdbfc03ac60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-06-02T04:43:07.497 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:01.277+0000 7fdc1496e700 1 -- 172.21.15.76:0/805592535 >> [v2:172.21.15.76:6800/4200406736,v1:172.21.15.76:6801/4200406736] conn(0x7fdbfc0387a0 msgr2=0x7fdbfc03ac60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.76:6800/4200406736 2024-06-02T04:43:07.497 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:01.277+0000 7fdc1496e700 1 --2- 172.21.15.76:0/805592535 >> [v2:172.21.15.76:6800/4200406736,v1:172.21.15.76:6801/4200406736] conn(0x7fdbfc0387a0 0x7fdbfc03ac60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-06-02T04:43:07.498 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:01.678+0000 7fdc1496e700 1 -- 172.21.15.76:0/805592535 >> [v2:172.21.15.76:6800/4200406736,v1:172.21.15.76:6801/4200406736] conn(0x7fdbfc0387a0 msgr2=0x7fdbfc03ac60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.76:6800/4200406736 2024-06-02T04:43:07.498 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:01.678+0000 7fdc1496e700 1 --2- 172.21.15.76:0/805592535 >> [v2:172.21.15.76:6800/4200406736,v1:172.21.15.76:6801/4200406736] conn(0x7fdbfc0387a0 0x7fdbfc03ac60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-06-02T04:43:07.498 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:02.479+0000 7fdc1496e700 1 -- 172.21.15.76:0/805592535 >> [v2:172.21.15.76:6800/4200406736,v1:172.21.15.76:6801/4200406736] conn(0x7fdbfc0387a0 msgr2=0x7fdbfc03ac60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.76:6800/4200406736 2024-06-02T04:43:07.498 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:02.479+0000 7fdc1496e700 1 --2- 172.21.15.76:0/805592535 >> [v2:172.21.15.76:6800/4200406736,v1:172.21.15.76:6801/4200406736] conn(0x7fdbfc0387a0 0x7fdbfc03ac60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-06-02T04:43:07.498 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:04.080+0000 7fdc1496e700 1 -- 172.21.15.76:0/805592535 >> [v2:172.21.15.76:6800/4200406736,v1:172.21.15.76:6801/4200406736] conn(0x7fdbfc0387a0 msgr2=0x7fdbfc03ac60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.76:6800/4200406736 2024-06-02T04:43:07.498 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:04.080+0000 7fdc1496e700 1 --2- 172.21.15.76:0/805592535 >> [v2:172.21.15.76:6800/4200406736,v1:172.21.15.76:6801/4200406736] conn(0x7fdbfc0387a0 0x7fdbfc03ac60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-06-02T04:43:07.498 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:06.094+0000 7fdc067fc700 1 -- 172.21.15.76:0/805592535 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mgrmap(e 10) v1 ==== 45321+0+0 (secure 0 0 0) 0x7fdc0c02c910 con 0x7fdc10106f50 2024-06-02T04:43:07.498 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:06.094+0000 7fdc067fc700 1 -- 172.21.15.76:0/805592535 >> [v2:172.21.15.76:6800/4200406736,v1:172.21.15.76:6801/4200406736] conn(0x7fdbfc0387a0 msgr2=0x7fdbfc03ac60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-02T04:43:07.498 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:06.094+0000 7fdc067fc700 1 --2- 172.21.15.76:0/805592535 >> [v2:172.21.15.76:6800/4200406736,v1:172.21.15.76:6801/4200406736] conn(0x7fdbfc0387a0 0x7fdbfc03ac60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:43:07.498 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:07.097+0000 7fdc067fc700 1 -- 172.21.15.76:0/805592535 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mgrmap(e 11) v1 ==== 45448+0+0 (secure 0 0 0) 0x7fdc0c04cac0 con 0x7fdc10106f50 2024-06-02T04:43:07.498 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:07.097+0000 7fdc067fc700 1 --2- 172.21.15.76:0/805592535 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fdbfc03bfc0 0x7fdbfc03e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:43:07.498 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:07.097+0000 7fdc067fc700 1 -- 172.21.15.76:0/805592535 --> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdc100625d0 con 0x7fdbfc03bfc0 2024-06-02T04:43:07.499 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:07.098+0000 7fdc1496e700 1 --2- 172.21.15.76:0/805592535 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fdbfc03bfc0 0x7fdbfc03e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:43:07.499 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:07.098+0000 7fdc1496e700 1 --2- 172.21.15.76:0/805592535 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fdbfc03bfc0 0x7fdbfc03e3b0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fdc00003a10 tx=0x7fdc00009270 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:43:07.499 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:07.099+0000 7fdc067fc700 1 -- 172.21.15.76:0/805592535 <== mgr.14152 v2:172.21.15.76:6800/2591353090 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+7774 (secure 0 0 0) 0x7fdc100625d0 con 0x7fdbfc03bfc0 2024-06-02T04:43:07.499 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:07.106+0000 7fdc173d3700 1 -- 172.21.15.76:0/805592535 --> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7fdc1010a660 con 0x7fdbfc03bfc0 2024-06-02T04:43:07.499 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:07.106+0000 7fdc067fc700 1 -- 172.21.15.76:0/805592535 <== mgr.14152 v2:172.21.15.76:6800/2591353090 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7fdc1010a660 con 0x7fdbfc03bfc0 2024-06-02T04:43:07.499 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:07.106+0000 7fdc173d3700 1 -- 172.21.15.76:0/805592535 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fdbfc03bfc0 msgr2=0x7fdbfc03e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:43:07.499 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:07.106+0000 7fdc173d3700 1 --2- 172.21.15.76:0/805592535 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fdbfc03bfc0 0x7fdbfc03e3b0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fdc00003a10 tx=0x7fdc00009270 comp rx=0 tx=0).stop 2024-06-02T04:43:07.499 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:07.106+0000 7fdc173d3700 1 -- 172.21.15.76:0/805592535 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdc10106f50 msgr2=0x7fdc10106780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:43:07.499 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:07.106+0000 7fdc173d3700 1 --2- 172.21.15.76:0/805592535 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdc10106f50 0x7fdc10106780 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fdc0c0046e0 tx=0x7fdc0c0119a0 comp rx=0 tx=0).stop 2024-06-02T04:43:07.499 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:07.106+0000 7fdc173d3700 1 -- 172.21.15.76:0/805592535 shutdown_connections 2024-06-02T04:43:07.499 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:07.106+0000 7fdc173d3700 1 --2- 172.21.15.76:0/805592535 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fdbfc03bfc0 0x7fdbfc03e3b0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:43:07.499 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:07.106+0000 7fdc173d3700 1 --2- 172.21.15.76:0/805592535 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdc10106f50 0x7fdc10106780 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:43:07.499 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:07.106+0000 7fdc173d3700 1 --2- 172.21.15.76:0/805592535 >> [v2:172.21.15.76:6800/4200406736,v1:172.21.15.76:6801/4200406736] conn(0x7fdbfc0387a0 0x7fdbfc03ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:43:07.500 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:07.106+0000 7fdc173d3700 1 -- 172.21.15.76:0/805592535 >> 172.21.15.76:0/805592535 conn(0x7fdc101009c0 msgr2=0x7fdc10101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:43:07.500 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:07.106+0000 7fdc173d3700 1 -- 172.21.15.76:0/805592535 shutdown_connections 2024-06-02T04:43:07.500 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:07.106+0000 7fdc173d3700 1 -- 172.21.15.76:0/805592535 wait complete. 2024-06-02T04:43:07.500 INFO:teuthology.orchestra.run.smithi076.stdout:mgr epoch 9 is available 2024-06-02T04:43:07.500 INFO:teuthology.orchestra.run.smithi076.stdout:Generating a dashboard self-signed certificate... 2024-06-02T04:43:08.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:08 smithi076 ceph-mon[42935]: [02/Jun/2024:04:43:06] ENGINE Bus STARTING 2024-06-02T04:43:08.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:08 smithi076 ceph-mon[42935]: [02/Jun/2024:04:43:06] ENGINE Serving on https://172.21.15.76:7150 2024-06-02T04:43:08.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:08 smithi076 ceph-mon[42935]: [02/Jun/2024:04:43:06] ENGINE Serving on http://172.21.15.76:8765 2024-06-02T04:43:08.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:08 smithi076 ceph-mon[42935]: [02/Jun/2024:04:43:06] ENGINE Bus STARTED 2024-06-02T04:43:08.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:08 smithi076 ceph-mon[42935]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-06-02T04:43:08.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:08 smithi076 ceph-mon[42935]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-06-02T04:43:08.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:08 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:08.840 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-06-02T04:43:08.840 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:07.881+0000 7fcf56a2c700 1 Processor -- start 2024-06-02T04:43:08.840 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:07.882+0000 7fcf56a2c700 1 -- start start 2024-06-02T04:43:08.840 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:07.882+0000 7fcf56a2c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcf501047c0 0x7fcf50104be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:43:08.840 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:07.882+0000 7fcf56a2c700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf501051b0 con 0x7fcf501047c0 2024-06-02T04:43:08.840 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:07.882+0000 7fcf4ffff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcf501047c0 0x7fcf50104be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:43:08.840 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:07.882+0000 7fcf4ffff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcf501047c0 0x7fcf50104be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:39030/0 (socket says 172.21.15.76:39030) 2024-06-02T04:43:08.840 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:07.882+0000 7fcf4ffff700 1 -- 172.21.15.76:0/2429873640 learned_addr learned my addr 172.21.15.76:0/2429873640 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:43:08.840 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:07.883+0000 7fcf4ffff700 1 -- 172.21.15.76:0/2429873640 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf501052f0 con 0x7fcf501047c0 2024-06-02T04:43:08.841 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:07.883+0000 7fcf4ffff700 1 --2- 172.21.15.76:0/2429873640 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcf501047c0 0x7fcf50104be0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fcf400098a0 tx=0x7fcf40009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dab74e730624f714 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:43:08.841 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:07.883+0000 7fcf4effd700 1 -- 172.21.15.76:0/2429873640 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcf40004160 con 0x7fcf501047c0 2024-06-02T04:43:08.841 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:07.883+0000 7fcf4effd700 1 -- 172.21.15.76:0/2429873640 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcf400042c0 con 0x7fcf501047c0 2024-06-02T04:43:08.841 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:07.883+0000 7fcf4effd700 1 -- 172.21.15.76:0/2429873640 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcf400118e0 con 0x7fcf501047c0 2024-06-02T04:43:08.841 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:07.884+0000 7fcf56a2c700 1 -- 172.21.15.76:0/2429873640 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcf501047c0 msgr2=0x7fcf50104be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:43:08.841 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:07.884+0000 7fcf56a2c700 1 --2- 172.21.15.76:0/2429873640 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcf501047c0 0x7fcf50104be0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fcf400098a0 tx=0x7fcf40009bb0 comp rx=0 tx=0).stop 2024-06-02T04:43:08.841 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:07.885+0000 7fcf56a2c700 1 -- 172.21.15.76:0/2429873640 shutdown_connections 2024-06-02T04:43:08.841 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:07.885+0000 7fcf56a2c700 1 --2- 172.21.15.76:0/2429873640 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcf501047c0 0x7fcf50104be0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:43:08.841 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:07.885+0000 7fcf56a2c700 1 -- 172.21.15.76:0/2429873640 >> 172.21.15.76:0/2429873640 conn(0x7fcf50100100 msgr2=0x7fcf50102540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:43:08.841 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:07.885+0000 7fcf56a2c700 1 -- 172.21.15.76:0/2429873640 shutdown_connections 2024-06-02T04:43:08.841 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:07.885+0000 7fcf56a2c700 1 -- 172.21.15.76:0/2429873640 wait complete. 2024-06-02T04:43:08.841 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:07.885+0000 7fcf56a2c700 1 Processor -- start 2024-06-02T04:43:08.841 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:07.885+0000 7fcf56a2c700 1 -- start start 2024-06-02T04:43:08.842 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:07.886+0000 7fcf56a2c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcf501047c0 0x7fcf50107070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:43:08.842 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:07.886+0000 7fcf56a2c700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf501075b0 con 0x7fcf501047c0 2024-06-02T04:43:08.842 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:07.886+0000 7fcf4ffff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcf501047c0 0x7fcf50107070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:43:08.842 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:07.886+0000 7fcf4ffff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcf501047c0 0x7fcf50107070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:39038/0 (socket says 172.21.15.76:39038) 2024-06-02T04:43:08.842 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:07.886+0000 7fcf4ffff700 1 -- 172.21.15.76:0/716743365 learned_addr learned my addr 172.21.15.76:0/716743365 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:43:08.842 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:07.886+0000 7fcf4ffff700 1 -- 172.21.15.76:0/716743365 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf40009550 con 0x7fcf501047c0 2024-06-02T04:43:08.842 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:07.886+0000 7fcf4ffff700 1 --2- 172.21.15.76:0/716743365 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcf501047c0 0x7fcf50107070 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fcf40003f70 tx=0x7fcf400119a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:43:08.842 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:07.886+0000 7fcf4d7fa700 1 -- 172.21.15.76:0/716743365 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcf400037d0 con 0x7fcf501047c0 2024-06-02T04:43:08.842 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:07.886+0000 7fcf56a2c700 1 -- 172.21.15.76:0/716743365 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf501057f0 con 0x7fcf501047c0 2024-06-02T04:43:08.842 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:07.886+0000 7fcf4d7fa700 1 -- 172.21.15.76:0/716743365 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcf4001b440 con 0x7fcf501047c0 2024-06-02T04:43:08.842 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:07.886+0000 7fcf4d7fa700 1 -- 172.21.15.76:0/716743365 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcf400193d0 con 0x7fcf501047c0 2024-06-02T04:43:08.842 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:07.886+0000 7fcf56a2c700 1 -- 172.21.15.76:0/716743365 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf50105cf0 con 0x7fcf501047c0 2024-06-02T04:43:08.842 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:07.887+0000 7fcf4d7fa700 1 -- 172.21.15.76:0/716743365 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 11) v1 ==== 45448+0+0 (secure 0 0 0) 0x7fcf400195d0 con 0x7fcf501047c0 2024-06-02T04:43:08.843 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:07.887+0000 7fcf56a2c700 1 -- 172.21.15.76:0/716743365 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf500625d0 con 0x7fcf501047c0 2024-06-02T04:43:08.843 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:07.888+0000 7fcf4d7fa700 1 --2- 172.21.15.76:0/716743365 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fcf38038620 0x7fcf3803aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:43:08.843 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:07.888+0000 7fcf4d7fa700 1 -- 172.21.15.76:0/716743365 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fcf4004c440 con 0x7fcf501047c0 2024-06-02T04:43:08.843 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:07.888+0000 7fcf4f7fe700 1 --2- 172.21.15.76:0/716743365 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fcf38038620 0x7fcf3803aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:43:08.843 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:07.888+0000 7fcf4f7fe700 1 --2- 172.21.15.76:0/716743365 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fcf38038620 0x7fcf3803aae0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fcf44006fd0 tx=0x7fcf44006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:43:08.843 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:07.893+0000 7fcf4d7fa700 1 -- 172.21.15.76:0/716743365 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fcf40019e40 con 0x7fcf501047c0 2024-06-02T04:43:08.843 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:08.114+0000 7fcf56a2c700 1 -- 172.21.15.76:0/716743365 --> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7fcf501064e0 con 0x7fcf38038620 2024-06-02T04:43:08.843 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:08.220+0000 7fcf4d7fa700 1 -- 172.21.15.76:0/716743365 <== mgr.14152 v2:172.21.15.76:6800/2591353090 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7fcf501064e0 con 0x7fcf38038620 2024-06-02T04:43:08.843 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:08.223+0000 7fcf56a2c700 1 -- 172.21.15.76:0/716743365 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fcf38038620 msgr2=0x7fcf3803aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:43:08.843 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:08.223+0000 7fcf56a2c700 1 --2- 172.21.15.76:0/716743365 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fcf38038620 0x7fcf3803aae0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fcf44006fd0 tx=0x7fcf44006e40 comp rx=0 tx=0).stop 2024-06-02T04:43:08.843 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:08.223+0000 7fcf56a2c700 1 -- 172.21.15.76:0/716743365 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcf501047c0 msgr2=0x7fcf50107070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:43:08.843 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:08.223+0000 7fcf56a2c700 1 --2- 172.21.15.76:0/716743365 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcf501047c0 0x7fcf50107070 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fcf40003f70 tx=0x7fcf400119a0 comp rx=0 tx=0).stop 2024-06-02T04:43:08.843 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:08.223+0000 7fcf56a2c700 1 -- 172.21.15.76:0/716743365 shutdown_connections 2024-06-02T04:43:08.844 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:08.223+0000 7fcf56a2c700 1 --2- 172.21.15.76:0/716743365 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fcf38038620 0x7fcf3803aae0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:43:08.844 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:08.223+0000 7fcf56a2c700 1 --2- 172.21.15.76:0/716743365 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcf501047c0 0x7fcf50107070 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:43:08.844 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:08.223+0000 7fcf56a2c700 1 -- 172.21.15.76:0/716743365 >> 172.21.15.76:0/716743365 conn(0x7fcf50100100 msgr2=0x7fcf50100d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:43:08.844 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:08.223+0000 7fcf56a2c700 1 -- 172.21.15.76:0/716743365 shutdown_connections 2024-06-02T04:43:08.844 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:08.223+0000 7fcf56a2c700 1 -- 172.21.15.76:0/716743365 wait complete. 2024-06-02T04:43:08.844 INFO:teuthology.orchestra.run.smithi076.stdout:Creating initial admin user... 2024-06-02T04:43:09.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:09 smithi076 ceph-mon[42935]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:43:09.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:09 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:09.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:09 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:09.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:09 smithi076 ceph-mon[42935]: mgrmap e12: x(active, since 2s) 2024-06-02T04:43:10.097 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$/2tjYxAGOXMEKtSOLiG/e.wyirHTbXzVmV.IBdV6GtV/N.ANqeVlm", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1717303389, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-06-02T04:43:10.097 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:09.188+0000 7fe98f59e700 1 Processor -- start 2024-06-02T04:43:10.097 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:09.188+0000 7fe98f59e700 1 -- start start 2024-06-02T04:43:10.097 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:09.189+0000 7fe98f59e700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe990106df0 0x7fe9901091e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:43:10.097 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:09.189+0000 7fe98f59e700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe990079e50 con 0x7fe990106df0 2024-06-02T04:43:10.097 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:09.189+0000 7fe98e59c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe990106df0 0x7fe9901091e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:43:10.097 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:09.189+0000 7fe98e59c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe990106df0 0x7fe9901091e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:39052/0 (socket says 172.21.15.76:39052) 2024-06-02T04:43:10.097 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:09.189+0000 7fe98e59c700 1 -- 172.21.15.76:0/904086382 learned_addr learned my addr 172.21.15.76:0/904086382 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:43:10.098 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:09.189+0000 7fe98e59c700 1 -- 172.21.15.76:0/904086382 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe990109720 con 0x7fe990106df0 2024-06-02T04:43:10.098 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:09.189+0000 7fe98e59c700 1 --2- 172.21.15.76:0/904086382 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe990106df0 0x7fe9901091e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe9780098a0 tx=0x7fe978009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f0ee3a7b8cd387c server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:43:10.098 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:09.189+0000 7fe98d59a700 1 -- 172.21.15.76:0/904086382 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe978004160 con 0x7fe990106df0 2024-06-02T04:43:10.098 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:09.190+0000 7fe98d59a700 1 -- 172.21.15.76:0/904086382 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe9780042c0 con 0x7fe990106df0 2024-06-02T04:43:10.098 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:09.190+0000 7fe98d59a700 1 -- 172.21.15.76:0/904086382 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe9780118e0 con 0x7fe990106df0 2024-06-02T04:43:10.098 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:09.190+0000 7fe98f59e700 1 -- 172.21.15.76:0/904086382 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe990106df0 msgr2=0x7fe9901091e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:43:10.098 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:09.190+0000 7fe98f59e700 1 --2- 172.21.15.76:0/904086382 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe990106df0 0x7fe9901091e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe9780098a0 tx=0x7fe978009bb0 comp rx=0 tx=0).stop 2024-06-02T04:43:10.098 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:09.190+0000 7fe98f59e700 1 -- 172.21.15.76:0/904086382 shutdown_connections 2024-06-02T04:43:10.099 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:09.190+0000 7fe98f59e700 1 --2- 172.21.15.76:0/904086382 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe990106df0 0x7fe9901091e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:43:10.099 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:09.190+0000 7fe98f59e700 1 -- 172.21.15.76:0/904086382 >> 172.21.15.76:0/904086382 conn(0x7fe9901007c0 msgr2=0x7fe990102be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:43:10.099 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:09.190+0000 7fe98f59e700 1 -- 172.21.15.76:0/904086382 shutdown_connections 2024-06-02T04:43:10.099 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:09.190+0000 7fe98f59e700 1 -- 172.21.15.76:0/904086382 wait complete. 2024-06-02T04:43:10.099 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:09.191+0000 7fe98f59e700 1 Processor -- start 2024-06-02T04:43:10.099 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:09.191+0000 7fe98f59e700 1 -- start start 2024-06-02T04:43:10.099 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:09.191+0000 7fe98f59e700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe990106df0 0x7fe990106620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:43:10.099 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:09.191+0000 7fe98f59e700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe990106b60 con 0x7fe990106df0 2024-06-02T04:43:10.099 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:09.191+0000 7fe98e59c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe990106df0 0x7fe990106620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:43:10.099 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:09.191+0000 7fe98e59c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe990106df0 0x7fe990106620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:39056/0 (socket says 172.21.15.76:39056) 2024-06-02T04:43:10.099 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:09.191+0000 7fe98e59c700 1 -- 172.21.15.76:0/698357339 learned_addr learned my addr 172.21.15.76:0/698357339 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:43:10.099 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:09.191+0000 7fe98e59c700 1 -- 172.21.15.76:0/698357339 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe978009550 con 0x7fe990106df0 2024-06-02T04:43:10.099 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:09.192+0000 7fe98e59c700 1 --2- 172.21.15.76:0/698357339 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe990106df0 0x7fe990106620 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe978003e30 tx=0x7fe978011e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:43:10.100 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:09.192+0000 7fe9877fe700 1 -- 172.21.15.76:0/698357339 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe9780036a0 con 0x7fe990106df0 2024-06-02T04:43:10.100 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:09.192+0000 7fe9877fe700 1 -- 172.21.15.76:0/698357339 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe97801b440 con 0x7fe990106df0 2024-06-02T04:43:10.100 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:09.192+0000 7fe9877fe700 1 -- 172.21.15.76:0/698357339 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe9780193d0 con 0x7fe990106df0 2024-06-02T04:43:10.100 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:09.192+0000 7fe98f59e700 1 -- 172.21.15.76:0/698357339 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe990104da0 con 0x7fe990106df0 2024-06-02T04:43:10.100 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:09.192+0000 7fe98f59e700 1 -- 172.21.15.76:0/698357339 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe990105240 con 0x7fe990106df0 2024-06-02T04:43:10.100 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:09.193+0000 7fe9877fe700 1 -- 172.21.15.76:0/698357339 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 12) v1 ==== 45554+0+0 (secure 0 0 0) 0x7fe978019690 con 0x7fe990106df0 2024-06-02T04:43:10.100 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:09.193+0000 7fe98f59e700 1 -- 172.21.15.76:0/698357339 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9900625d0 con 0x7fe990106df0 2024-06-02T04:43:10.100 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:09.193+0000 7fe9877fe700 1 --2- 172.21.15.76:0/698357339 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fe97c038700 0x7fe97c03abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:43:10.100 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:09.193+0000 7fe9877fe700 1 -- 172.21.15.76:0/698357339 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fe97804c6c0 con 0x7fe990106df0 2024-06-02T04:43:10.100 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:09.193+0000 7fe98dd9b700 1 --2- 172.21.15.76:0/698357339 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fe97c038700 0x7fe97c03abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:43:10.100 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:09.193+0000 7fe98dd9b700 1 --2- 172.21.15.76:0/698357339 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fe97c038700 0x7fe97c03abc0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe980006fd0 tx=0x7fe980006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:43:10.100 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:09.198+0000 7fe9877fe700 1 -- 172.21.15.76:0/698357339 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fe97801a750 con 0x7fe990106df0 2024-06-02T04:43:10.100 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:09.413+0000 7fe98f59e700 1 -- 172.21.15.76:0/698357339 --> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7fe9900623f0 con 0x7fe97c038700 2024-06-02T04:43:10.101 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:09.632+0000 7fe9877fe700 1 -- 172.21.15.76:0/698357339 <== mgr.14152 v2:172.21.15.76:6800/2591353090 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7fe9900623f0 con 0x7fe97c038700 2024-06-02T04:43:10.101 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:09.634+0000 7fe98f59e700 1 -- 172.21.15.76:0/698357339 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fe97c038700 msgr2=0x7fe97c03abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:43:10.101 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:09.634+0000 7fe98f59e700 1 --2- 172.21.15.76:0/698357339 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fe97c038700 0x7fe97c03abc0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe980006fd0 tx=0x7fe980006e40 comp rx=0 tx=0).stop 2024-06-02T04:43:10.101 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:09.634+0000 7fe98f59e700 1 -- 172.21.15.76:0/698357339 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe990106df0 msgr2=0x7fe990106620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:43:10.101 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:09.634+0000 7fe98f59e700 1 --2- 172.21.15.76:0/698357339 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe990106df0 0x7fe990106620 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe978003e30 tx=0x7fe978011e80 comp rx=0 tx=0).stop 2024-06-02T04:43:10.101 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:09.634+0000 7fe98f59e700 1 -- 172.21.15.76:0/698357339 shutdown_connections 2024-06-02T04:43:10.101 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:09.634+0000 7fe98f59e700 1 --2- 172.21.15.76:0/698357339 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fe97c038700 0x7fe97c03abc0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:43:10.101 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:09.634+0000 7fe98f59e700 1 --2- 172.21.15.76:0/698357339 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe990106df0 0x7fe990106620 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:43:10.101 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:09.634+0000 7fe98f59e700 1 -- 172.21.15.76:0/698357339 >> 172.21.15.76:0/698357339 conn(0x7fe9901007c0 msgr2=0x7fe990101630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:43:10.101 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:09.634+0000 7fe98f59e700 1 -- 172.21.15.76:0/698357339 shutdown_connections 2024-06-02T04:43:10.101 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:09.634+0000 7fe98f59e700 1 -- 172.21.15.76:0/698357339 wait complete. 2024-06-02T04:43:10.101 INFO:teuthology.orchestra.run.smithi076.stdout:Fetching dashboard port number... 2024-06-02T04:43:10.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:10 smithi076 ceph-mon[42935]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:43:10.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:10 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:11.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:11 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/2094906789' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-06-02T04:43:13.420 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout 8443 2024-06-02T04:43:13.420 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:11.379+0000 7f22525e6700 1 Processor -- start 2024-06-02T04:43:13.420 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:11.379+0000 7f22525e6700 1 -- start start 2024-06-02T04:43:13.420 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:11.379+0000 7f22525e6700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f224c106f90 0x7f224c109380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:43:13.420 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:11.379+0000 7f22525e6700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f224c079e70 con 0x7f224c106f90 2024-06-02T04:43:13.421 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:11.379+0000 7f224bfff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f224c106f90 0x7f224c109380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:43:13.421 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:11.379+0000 7f224bfff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f224c106f90 0x7f224c109380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:39062/0 (socket says 172.21.15.76:39062) 2024-06-02T04:43:13.421 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:11.379+0000 7f224bfff700 1 -- 172.21.15.76:0/1626778256 learned_addr learned my addr 172.21.15.76:0/1626778256 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:43:13.421 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:11.379+0000 7f224bfff700 1 -- 172.21.15.76:0/1626778256 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f224c1098c0 con 0x7f224c106f90 2024-06-02T04:43:13.421 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:11.380+0000 7f224bfff700 1 --2- 172.21.15.76:0/1626778256 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f224c106f90 0x7f224c109380 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f223c0098a0 tx=0x7f223c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63e6f1fa8e96d0a1 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:43:13.421 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:11.380+0000 7f224b7fe700 1 -- 172.21.15.76:0/1626778256 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f223c004160 con 0x7f224c106f90 2024-06-02T04:43:13.421 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:11.380+0000 7f224b7fe700 1 -- 172.21.15.76:0/1626778256 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f223c0042c0 con 0x7f224c106f90 2024-06-02T04:43:13.421 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:11.380+0000 7f224b7fe700 1 -- 172.21.15.76:0/1626778256 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f223c0118e0 con 0x7f224c106f90 2024-06-02T04:43:13.421 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:11.380+0000 7f22525e6700 1 -- 172.21.15.76:0/1626778256 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f224c106f90 msgr2=0x7f224c109380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:43:13.426 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:11.380+0000 7f22525e6700 1 --2- 172.21.15.76:0/1626778256 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f224c106f90 0x7f224c109380 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f223c0098a0 tx=0x7f223c009bb0 comp rx=0 tx=0).stop 2024-06-02T04:43:13.426 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:11.380+0000 7f22525e6700 1 -- 172.21.15.76:0/1626778256 shutdown_connections 2024-06-02T04:43:13.426 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:11.380+0000 7f22525e6700 1 --2- 172.21.15.76:0/1626778256 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f224c106f90 0x7f224c109380 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:43:13.426 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:11.380+0000 7f22525e6700 1 -- 172.21.15.76:0/1626778256 >> 172.21.15.76:0/1626778256 conn(0x7f224c100980 msgr2=0x7f224c102da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:43:13.426 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:11.380+0000 7f22525e6700 1 -- 172.21.15.76:0/1626778256 shutdown_connections 2024-06-02T04:43:13.426 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:11.380+0000 7f22525e6700 1 -- 172.21.15.76:0/1626778256 wait complete. 2024-06-02T04:43:13.426 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:11.381+0000 7f22525e6700 1 Processor -- start 2024-06-02T04:43:13.426 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:11.381+0000 7f22525e6700 1 -- start start 2024-06-02T04:43:13.426 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:11.381+0000 7f22525e6700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f224c106f90 0x7f224c1067c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:43:13.426 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:11.381+0000 7f22525e6700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f224c106d00 con 0x7f224c106f90 2024-06-02T04:43:13.426 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:11.381+0000 7f224bfff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f224c106f90 0x7f224c1067c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:43:13.427 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:11.381+0000 7f224bfff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f224c106f90 0x7f224c1067c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:39066/0 (socket says 172.21.15.76:39066) 2024-06-02T04:43:13.427 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:11.381+0000 7f224bfff700 1 -- 172.21.15.76:0/2094906789 learned_addr learned my addr 172.21.15.76:0/2094906789 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:43:13.427 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:11.381+0000 7f224bfff700 1 -- 172.21.15.76:0/2094906789 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f223c009550 con 0x7f224c106f90 2024-06-02T04:43:13.427 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:11.382+0000 7f224bfff700 1 --2- 172.21.15.76:0/2094906789 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f224c106f90 0x7f224c1067c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f223c0046e0 tx=0x7f223c0119a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:43:13.427 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:11.382+0000 7f2249ffb700 1 -- 172.21.15.76:0/2094906789 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f223c0037d0 con 0x7f224c106f90 2024-06-02T04:43:13.427 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:11.382+0000 7f2249ffb700 1 -- 172.21.15.76:0/2094906789 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f223c01b440 con 0x7f224c106f90 2024-06-02T04:43:13.427 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:11.382+0000 7f2249ffb700 1 -- 172.21.15.76:0/2094906789 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f223c023400 con 0x7f224c106f90 2024-06-02T04:43:13.427 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:11.382+0000 7f22525e6700 1 -- 172.21.15.76:0/2094906789 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f224c104f40 con 0x7f224c106f90 2024-06-02T04:43:13.427 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:11.382+0000 7f22525e6700 1 -- 172.21.15.76:0/2094906789 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f224c1053e0 con 0x7f224c106f90 2024-06-02T04:43:13.427 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:11.383+0000 7f2249ffb700 1 -- 172.21.15.76:0/2094906789 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 12) v1 ==== 45554+0+0 (secure 0 0 0) 0x7f223c01b840 con 0x7f224c106f90 2024-06-02T04:43:13.427 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:11.383+0000 7f22525e6700 1 -- 172.21.15.76:0/2094906789 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f224c10a640 con 0x7f224c106f90 2024-06-02T04:43:13.427 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:11.383+0000 7f2249ffb700 1 --2- 172.21.15.76:0/2094906789 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f2238038750 0x7f223803ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:43:13.427 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:11.383+0000 7f2249ffb700 1 -- 172.21.15.76:0/2094906789 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f223c04c6f0 con 0x7f224c106f90 2024-06-02T04:43:13.428 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:11.383+0000 7f2243fff700 1 --2- 172.21.15.76:0/2094906789 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f2238038750 0x7f223803ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:43:13.428 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:11.383+0000 7f2243fff700 1 --2- 172.21.15.76:0/2094906789 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f2238038750 0x7f223803ac10 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2234006fd0 tx=0x7f2234006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:43:13.428 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:11.388+0000 7f2249ffb700 1 -- 172.21.15.76:0/2094906789 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f223c02b760 con 0x7f224c106f90 2024-06-02T04:43:13.428 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:11.580+0000 7f22525e6700 1 -- 172.21.15.76:0/2094906789 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7f224c10a8b0 con 0x7f224c106f90 2024-06-02T04:43:13.428 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:11.580+0000 7f2249ffb700 1 -- 172.21.15.76:0/2094906789 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7f223c00b3e0 con 0x7f224c106f90 2024-06-02T04:43:13.428 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:11.582+0000 7f22525e6700 1 -- 172.21.15.76:0/2094906789 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f2238038750 msgr2=0x7f223803ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:43:13.428 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:11.582+0000 7f22525e6700 1 --2- 172.21.15.76:0/2094906789 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f2238038750 0x7f223803ac10 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2234006fd0 tx=0x7f2234006e40 comp rx=0 tx=0).stop 2024-06-02T04:43:13.428 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:11.582+0000 7f22525e6700 1 -- 172.21.15.76:0/2094906789 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f224c106f90 msgr2=0x7f224c1067c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:43:13.428 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:11.582+0000 7f22525e6700 1 --2- 172.21.15.76:0/2094906789 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f224c106f90 0x7f224c1067c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f223c0046e0 tx=0x7f223c0119a0 comp rx=0 tx=0).stop 2024-06-02T04:43:13.428 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:11.582+0000 7f22525e6700 1 -- 172.21.15.76:0/2094906789 shutdown_connections 2024-06-02T04:43:13.428 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:11.582+0000 7f22525e6700 1 --2- 172.21.15.76:0/2094906789 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f2238038750 0x7f223803ac10 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:43:13.428 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:11.582+0000 7f22525e6700 1 --2- 172.21.15.76:0/2094906789 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f224c106f90 0x7f224c1067c0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:43:13.429 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:11.582+0000 7f22525e6700 1 -- 172.21.15.76:0/2094906789 >> 172.21.15.76:0/2094906789 conn(0x7f224c100980 msgr2=0x7f224c101510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:43:13.429 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:11.582+0000 7f22525e6700 1 -- 172.21.15.76:0/2094906789 shutdown_connections 2024-06-02T04:43:13.429 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:11.582+0000 7f22525e6700 1 -- 172.21.15.76:0/2094906789 wait complete. 2024-06-02T04:43:13.435 INFO:teuthology.orchestra.run.smithi076.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-06-02T04:43:13.435 INFO:teuthology.orchestra.run.smithi076.stdout:systemctl: stdout disabled 2024-06-02T04:43:13.444 INFO:teuthology.orchestra.run.smithi076.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-06-02T04:43:13.444 INFO:teuthology.orchestra.run.smithi076.stdout:systemctl: stdout inactive 2024-06-02T04:43:13.444 INFO:teuthology.orchestra.run.smithi076.stdout:firewalld.service is not enabled 2024-06-02T04:43:13.444 INFO:teuthology.orchestra.run.smithi076.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-06-02T04:43:13.445 INFO:teuthology.orchestra.run.smithi076.stdout:Ceph Dashboard is now available at: 2024-06-02T04:43:13.445 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:43:13.446 INFO:teuthology.orchestra.run.smithi076.stdout: URL: https://smithi076:8443/ 2024-06-02T04:43:13.446 INFO:teuthology.orchestra.run.smithi076.stdout: User: admin 2024-06-02T04:43:13.446 INFO:teuthology.orchestra.run.smithi076.stdout: Password: by6bptas5n 2024-06-02T04:43:13.446 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:43:13.446 INFO:teuthology.orchestra.run.smithi076.stdout:Saving cluster configuration to /var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/config directory 2024-06-02T04:43:13.446 INFO:teuthology.orchestra.run.smithi076.stdout:Enabling autotune for osd_memory_target 2024-06-02T04:43:13.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:13 smithi076 ceph-mon[42935]: mgrmap e13: x(active, since 6s) 2024-06-02T04:43:14.382 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:13.814+0000 7f5963cd0700 1 Processor -- start 2024-06-02T04:43:14.382 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:13.814+0000 7f5963cd0700 1 -- start start 2024-06-02T04:43:14.382 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:13.814+0000 7f5963cd0700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f595c106f30 0x7f595c109320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:43:14.382 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:13.814+0000 7f5963cd0700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f595c079ed0 con 0x7f595c106f30 2024-06-02T04:43:14.382 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:13.815+0000 7f5961a6c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f595c106f30 0x7f595c109320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:43:14.382 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:13.815+0000 7f5961a6c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f595c106f30 0x7f595c109320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:36474/0 (socket says 172.21.15.76:36474) 2024-06-02T04:43:14.382 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:13.815+0000 7f5961a6c700 1 -- 172.21.15.76:0/1563505355 learned_addr learned my addr 172.21.15.76:0/1563505355 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:43:14.382 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:13.815+0000 7f5961a6c700 1 -- 172.21.15.76:0/1563505355 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f595c109860 con 0x7f595c106f30 2024-06-02T04:43:14.383 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:13.815+0000 7f5961a6c700 1 --2- 172.21.15.76:0/1563505355 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f595c106f30 0x7f595c109320 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f594c0098a0 tx=0x7f594c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e82c792bdee0095c server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:43:14.383 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:13.815+0000 7f5960a6a700 1 -- 172.21.15.76:0/1563505355 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f594c004160 con 0x7f595c106f30 2024-06-02T04:43:14.383 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:13.815+0000 7f5960a6a700 1 -- 172.21.15.76:0/1563505355 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f594c0042c0 con 0x7f595c106f30 2024-06-02T04:43:14.383 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:13.815+0000 7f5960a6a700 1 -- 172.21.15.76:0/1563505355 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f594c0118e0 con 0x7f595c106f30 2024-06-02T04:43:14.383 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:13.816+0000 7f5963cd0700 1 -- 172.21.15.76:0/1563505355 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f595c106f30 msgr2=0x7f595c109320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:43:14.383 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:13.816+0000 7f5963cd0700 1 --2- 172.21.15.76:0/1563505355 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f595c106f30 0x7f595c109320 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f594c0098a0 tx=0x7f594c009bb0 comp rx=0 tx=0).stop 2024-06-02T04:43:14.383 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:13.816+0000 7f5963cd0700 1 -- 172.21.15.76:0/1563505355 shutdown_connections 2024-06-02T04:43:14.383 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:13.816+0000 7f5963cd0700 1 --2- 172.21.15.76:0/1563505355 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f595c106f30 0x7f595c109320 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:43:14.383 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:13.816+0000 7f5963cd0700 1 -- 172.21.15.76:0/1563505355 >> 172.21.15.76:0/1563505355 conn(0x7f595c100980 msgr2=0x7f595c102da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:43:14.384 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:13.816+0000 7f5963cd0700 1 -- 172.21.15.76:0/1563505355 shutdown_connections 2024-06-02T04:43:14.384 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:13.816+0000 7f5963cd0700 1 -- 172.21.15.76:0/1563505355 wait complete. 2024-06-02T04:43:14.384 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:13.817+0000 7f5963cd0700 1 Processor -- start 2024-06-02T04:43:14.384 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:13.817+0000 7f5963cd0700 1 -- start start 2024-06-02T04:43:14.384 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:13.817+0000 7f5963cd0700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f595c106f30 0x7f595c19a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:43:14.384 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:13.817+0000 7f5963cd0700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f595c19a710 con 0x7f595c106f30 2024-06-02T04:43:14.384 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:13.817+0000 7f5961a6c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f595c106f30 0x7f595c19a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:43:14.384 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:13.817+0000 7f5961a6c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f595c106f30 0x7f595c19a1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:36480/0 (socket says 172.21.15.76:36480) 2024-06-02T04:43:14.384 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:13.817+0000 7f5961a6c700 1 -- 172.21.15.76:0/4166033011 learned_addr learned my addr 172.21.15.76:0/4166033011 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:43:14.384 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:13.817+0000 7f5961a6c700 1 -- 172.21.15.76:0/4166033011 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f594c009550 con 0x7f595c106f30 2024-06-02T04:43:14.384 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:13.817+0000 7f5961a6c700 1 --2- 172.21.15.76:0/4166033011 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f595c106f30 0x7f595c19a1d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f594c0046e0 tx=0x7f594c0119a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:43:14.385 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:13.818+0000 7f5952ffd700 1 -- 172.21.15.76:0/4166033011 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f594c0037d0 con 0x7f595c106f30 2024-06-02T04:43:14.385 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:13.818+0000 7f5952ffd700 1 -- 172.21.15.76:0/4166033011 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f594c01b440 con 0x7f595c106f30 2024-06-02T04:43:14.385 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:13.818+0000 7f5952ffd700 1 -- 172.21.15.76:0/4166033011 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f594c023400 con 0x7f595c106f30 2024-06-02T04:43:14.385 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:13.818+0000 7f5963cd0700 1 -- 172.21.15.76:0/4166033011 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f595c19a910 con 0x7f595c106f30 2024-06-02T04:43:14.385 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:13.818+0000 7f5963cd0700 1 -- 172.21.15.76:0/4166033011 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f595c19adb0 con 0x7f595c106f30 2024-06-02T04:43:14.385 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:13.818+0000 7f5952ffd700 1 -- 172.21.15.76:0/4166033011 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7f594c01b840 con 0x7f595c106f30 2024-06-02T04:43:14.385 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:13.819+0000 7f5963cd0700 1 -- 172.21.15.76:0/4166033011 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f595c10a640 con 0x7f595c106f30 2024-06-02T04:43:14.385 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:13.819+0000 7f5952ffd700 1 --2- 172.21.15.76:0/4166033011 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f59480387f0 0x7f594803acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:43:14.386 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:13.819+0000 7f5952ffd700 1 -- 172.21.15.76:0/4166033011 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f594c04c7a0 con 0x7f595c106f30 2024-06-02T04:43:14.386 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:13.819+0000 7f596126b700 1 --2- 172.21.15.76:0/4166033011 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f59480387f0 0x7f594803acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:43:14.386 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:13.819+0000 7f596126b700 1 --2- 172.21.15.76:0/4166033011 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f59480387f0 0x7f594803acb0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f5958006fd0 tx=0x7f5958006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:43:14.386 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:13.824+0000 7f5952ffd700 1 -- 172.21.15.76:0/4166033011 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f594c02b350 con 0x7f595c106f30 2024-06-02T04:43:14.386 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:14.015+0000 7f5963cd0700 1 -- 172.21.15.76:0/4166033011 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7f595c10a880 con 0x7f595c106f30 2024-06-02T04:43:14.386 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:14.015+0000 7f5952ffd700 1 -- 172.21.15.76:0/4166033011 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7f594c019bc0 con 0x7f595c106f30 2024-06-02T04:43:14.386 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:14.017+0000 7f5963cd0700 1 -- 172.21.15.76:0/4166033011 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f59480387f0 msgr2=0x7f594803acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:43:14.387 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:14.017+0000 7f5963cd0700 1 --2- 172.21.15.76:0/4166033011 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f59480387f0 0x7f594803acb0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f5958006fd0 tx=0x7f5958006e40 comp rx=0 tx=0).stop 2024-06-02T04:43:14.387 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:14.017+0000 7f5963cd0700 1 -- 172.21.15.76:0/4166033011 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f595c106f30 msgr2=0x7f595c19a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:43:14.387 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:14.017+0000 7f5963cd0700 1 --2- 172.21.15.76:0/4166033011 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f595c106f30 0x7f595c19a1d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f594c0046e0 tx=0x7f594c0119a0 comp rx=0 tx=0).stop 2024-06-02T04:43:14.387 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:14.017+0000 7f5963cd0700 1 -- 172.21.15.76:0/4166033011 shutdown_connections 2024-06-02T04:43:14.387 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:14.017+0000 7f5963cd0700 1 --2- 172.21.15.76:0/4166033011 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f59480387f0 0x7f594803acb0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:43:14.387 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:14.017+0000 7f5963cd0700 1 --2- 172.21.15.76:0/4166033011 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f595c106f30 0x7f595c19a1d0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:43:14.387 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:14.017+0000 7f5963cd0700 1 -- 172.21.15.76:0/4166033011 >> 172.21.15.76:0/4166033011 conn(0x7f595c100980 msgr2=0x7f595c101530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:43:14.387 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:14.018+0000 7f5963cd0700 1 -- 172.21.15.76:0/4166033011 shutdown_connections 2024-06-02T04:43:14.387 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:14.018+0000 7f5963cd0700 1 -- 172.21.15.76:0/4166033011 wait complete. 2024-06-02T04:43:15.389 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:14.719+0000 7f82ed63f700 1 Processor -- start 2024-06-02T04:43:15.389 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:14.719+0000 7f82ed63f700 1 -- start start 2024-06-02T04:43:15.389 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:14.719+0000 7f82ed63f700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f82e8106f90 0x7f82e8109380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:43:15.390 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:14.719+0000 7f82ed63f700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82e8079e90 con 0x7f82e8106f90 2024-06-02T04:43:15.390 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:14.719+0000 7f82e6ffd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f82e8106f90 0x7f82e8109380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:43:15.390 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:14.719+0000 7f82e6ffd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f82e8106f90 0x7f82e8109380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:36492/0 (socket says 172.21.15.76:36492) 2024-06-02T04:43:15.390 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:14.719+0000 7f82e6ffd700 1 -- 172.21.15.76:0/1123226452 learned_addr learned my addr 172.21.15.76:0/1123226452 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:43:15.390 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:14.720+0000 7f82e6ffd700 1 -- 172.21.15.76:0/1123226452 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82e81098c0 con 0x7f82e8106f90 2024-06-02T04:43:15.390 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:14.720+0000 7f82e6ffd700 1 --2- 172.21.15.76:0/1123226452 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f82e8106f90 0x7f82e8109380 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f82dc0098a0 tx=0x7f82dc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9cc0ba25ef3361 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:43:15.390 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:14.720+0000 7f82e5ffb700 1 -- 172.21.15.76:0/1123226452 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f82dc004160 con 0x7f82e8106f90 2024-06-02T04:43:15.390 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:14.720+0000 7f82e5ffb700 1 -- 172.21.15.76:0/1123226452 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f82dc0042c0 con 0x7f82e8106f90 2024-06-02T04:43:15.390 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:14.720+0000 7f82e5ffb700 1 -- 172.21.15.76:0/1123226452 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f82dc0118e0 con 0x7f82e8106f90 2024-06-02T04:43:15.390 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:14.720+0000 7f82ed63f700 1 -- 172.21.15.76:0/1123226452 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f82e8106f90 msgr2=0x7f82e8109380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:43:15.390 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:14.720+0000 7f82ed63f700 1 --2- 172.21.15.76:0/1123226452 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f82e8106f90 0x7f82e8109380 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f82dc0098a0 tx=0x7f82dc009bb0 comp rx=0 tx=0).stop 2024-06-02T04:43:15.391 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:14.721+0000 7f82ed63f700 1 -- 172.21.15.76:0/1123226452 shutdown_connections 2024-06-02T04:43:15.391 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:14.721+0000 7f82ed63f700 1 --2- 172.21.15.76:0/1123226452 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f82e8106f90 0x7f82e8109380 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:43:15.391 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:14.721+0000 7f82ed63f700 1 -- 172.21.15.76:0/1123226452 >> 172.21.15.76:0/1123226452 conn(0x7f82e81009c0 msgr2=0x7f82e8102de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:43:15.391 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:14.721+0000 7f82ed63f700 1 -- 172.21.15.76:0/1123226452 shutdown_connections 2024-06-02T04:43:15.391 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:14.721+0000 7f82ed63f700 1 -- 172.21.15.76:0/1123226452 wait complete. 2024-06-02T04:43:15.391 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:14.721+0000 7f82ed63f700 1 Processor -- start 2024-06-02T04:43:15.391 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:14.722+0000 7f82ed63f700 1 -- start start 2024-06-02T04:43:15.391 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:14.722+0000 7f82ed63f700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f82e8106f90 0x7f82e819a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:43:15.391 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:14.722+0000 7f82ed63f700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82e819a730 con 0x7f82e8106f90 2024-06-02T04:43:15.391 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:14.722+0000 7f82e6ffd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f82e8106f90 0x7f82e819a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:43:15.391 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:14.722+0000 7f82e6ffd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f82e8106f90 0x7f82e819a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:36506/0 (socket says 172.21.15.76:36506) 2024-06-02T04:43:15.391 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:14.722+0000 7f82e6ffd700 1 -- 172.21.15.76:0/3447550509 learned_addr learned my addr 172.21.15.76:0/3447550509 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:43:15.392 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:14.722+0000 7f82e6ffd700 1 -- 172.21.15.76:0/3447550509 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82dc009550 con 0x7f82e8106f90 2024-06-02T04:43:15.392 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:14.722+0000 7f82e6ffd700 1 --2- 172.21.15.76:0/3447550509 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f82e8106f90 0x7f82e819a1f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f82dc0046e0 tx=0x7f82dc0119a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:43:15.392 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:14.722+0000 7f82cffff700 1 -- 172.21.15.76:0/3447550509 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f82dc0037d0 con 0x7f82e8106f90 2024-06-02T04:43:15.392 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:14.722+0000 7f82cffff700 1 -- 172.21.15.76:0/3447550509 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f82dc01b440 con 0x7f82e8106f90 2024-06-02T04:43:15.392 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:14.722+0000 7f82ed63f700 1 -- 172.21.15.76:0/3447550509 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82e819a930 con 0x7f82e8106f90 2024-06-02T04:43:15.392 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:14.722+0000 7f82cffff700 1 -- 172.21.15.76:0/3447550509 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f82dc023400 con 0x7f82e8106f90 2024-06-02T04:43:15.392 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:14.723+0000 7f82ed63f700 1 -- 172.21.15.76:0/3447550509 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82e819add0 con 0x7f82e8106f90 2024-06-02T04:43:15.392 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:14.723+0000 7f82cffff700 1 -- 172.21.15.76:0/3447550509 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7f82dc023680 con 0x7f82e8106f90 2024-06-02T04:43:15.392 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:14.723+0000 7f82ed63f700 1 -- 172.21.15.76:0/3447550509 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82e810a640 con 0x7f82e8106f90 2024-06-02T04:43:15.392 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:14.723+0000 7f82cffff700 1 --2- 172.21.15.76:0/3447550509 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f82d00387f0 0x7f82d003acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:43:15.392 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:14.724+0000 7f82cffff700 1 -- 172.21.15.76:0/3447550509 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f82dc04c9a0 con 0x7f82e8106f90 2024-06-02T04:43:15.392 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:14.724+0000 7f82e67fc700 1 --2- 172.21.15.76:0/3447550509 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f82d00387f0 0x7f82d003acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:43:15.393 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:14.724+0000 7f82e67fc700 1 --2- 172.21.15.76:0/3447550509 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f82d00387f0 0x7f82d003acb0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f82d8006fd0 tx=0x7f82d8006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:43:15.393 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:14.729+0000 7f82cffff700 1 -- 172.21.15.76:0/3447550509 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f82dc02bb40 con 0x7f82e8106f90 2024-06-02T04:43:15.393 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:15.026+0000 7f82ed63f700 1 -- 172.21.15.76:0/3447550509 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7f82e810a8b0 con 0x7f82e8106f90 2024-06-02T04:43:15.393 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:15.028+0000 7f82cffff700 1 -- 172.21.15.76:0/3447550509 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) v1 ==== 153+0+0 (secure 0 0 0) 0x7f82dc02b6d0 con 0x7f82e8106f90 2024-06-02T04:43:15.393 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:15.030+0000 7f82ed63f700 1 -- 172.21.15.76:0/3447550509 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f82d00387f0 msgr2=0x7f82d003acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:43:15.393 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:15.030+0000 7f82ed63f700 1 --2- 172.21.15.76:0/3447550509 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f82d00387f0 0x7f82d003acb0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f82d8006fd0 tx=0x7f82d8006e40 comp rx=0 tx=0).stop 2024-06-02T04:43:15.393 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:15.030+0000 7f82ed63f700 1 -- 172.21.15.76:0/3447550509 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f82e8106f90 msgr2=0x7f82e819a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:43:15.394 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:15.030+0000 7f82ed63f700 1 --2- 172.21.15.76:0/3447550509 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f82e8106f90 0x7f82e819a1f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f82dc0046e0 tx=0x7f82dc0119a0 comp rx=0 tx=0).stop 2024-06-02T04:43:15.394 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:15.030+0000 7f82ed63f700 1 -- 172.21.15.76:0/3447550509 shutdown_connections 2024-06-02T04:43:15.394 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:15.030+0000 7f82ed63f700 1 --2- 172.21.15.76:0/3447550509 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f82d00387f0 0x7f82d003acb0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:43:15.394 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:15.030+0000 7f82ed63f700 1 --2- 172.21.15.76:0/3447550509 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f82e8106f90 0x7f82e819a1f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:43:15.394 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:15.030+0000 7f82ed63f700 1 -- 172.21.15.76:0/3447550509 >> 172.21.15.76:0/3447550509 conn(0x7f82e81009c0 msgr2=0x7f82e81015a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:43:15.394 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:15.031+0000 7f82ed63f700 1 -- 172.21.15.76:0/3447550509 shutdown_connections 2024-06-02T04:43:15.394 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-06-02T04:43:15.031+0000 7f82ed63f700 1 -- 172.21.15.76:0/3447550509 wait complete. 2024-06-02T04:43:15.394 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-06-02T04:43:15.394 INFO:teuthology.orchestra.run.smithi076.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-06-02T04:43:15.395 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:43:15.395 INFO:teuthology.orchestra.run.smithi076.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 60ab6d30-209a-11ef-bc9b-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-06-02T04:43:15.395 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:43:15.395 INFO:teuthology.orchestra.run.smithi076.stdout:Or, if you are only running a single cluster on this host: 2024-06-02T04:43:15.395 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:43:15.395 INFO:teuthology.orchestra.run.smithi076.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-06-02T04:43:15.395 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:43:15.395 INFO:teuthology.orchestra.run.smithi076.stdout:Please consider enabling telemetry to help improve Ceph: 2024-06-02T04:43:15.395 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:43:15.395 INFO:teuthology.orchestra.run.smithi076.stdout: ceph telemetry on 2024-06-02T04:43:15.395 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:43:15.395 INFO:teuthology.orchestra.run.smithi076.stdout:For more information see: 2024-06-02T04:43:15.395 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:43:15.395 INFO:teuthology.orchestra.run.smithi076.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-06-02T04:43:15.396 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:43:15.396 INFO:teuthology.orchestra.run.smithi076.stdout:Bootstrap complete. 2024-06-02T04:43:15.423 INFO:tasks.cephadm:Fetching config... 2024-06-02T04:43:15.424 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2024-06-02T04:43:15.424 DEBUG:teuthology.orchestra.run.smithi076:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-06-02T04:43:15.440 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-06-02T04:43:15.441 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2024-06-02T04:43:15.441 DEBUG:teuthology.orchestra.run.smithi076:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-06-02T04:43:15.499 INFO:tasks.cephadm:Fetching mon keyring... 2024-06-02T04:43:15.499 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2024-06-02T04:43:15.499 DEBUG:teuthology.orchestra.run.smithi076:> sudo dd if=/var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/mon.a/keyring of=/dev/stdout 2024-06-02T04:43:15.566 INFO:tasks.cephadm:Fetching pub ssh key... 2024-06-02T04:43:15.567 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2024-06-02T04:43:15.567 DEBUG:teuthology.orchestra.run.smithi076:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-06-02T04:43:15.624 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-06-02T04:43:15.625 DEBUG:teuthology.orchestra.run.smithi076:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC91Y3ezbDwfnJ2IWKatbuskV4w6UZvCzgLUteTzaCa2LBoia5BBhoycCBnc+z+lSArvA2nZBw4ukgrXluao/5jxvEH/D5WG8ifnrKz0G6SPF008bRV1ckPKCFPEiJ37gHkPzXLrGZDtZDFdHXGtby1C6M1s5m+7IykRqJkkv7mwLOQ5RBsjzM+yrhkwXwYqiMcCCpsSh6cqLzENKtiJJC3QhZalqmHPIyLoGFKGl+bDDPVZARLLajudfAhvbneoswnzPiofATpq4UAKuG5E05wl4DK2VZoahBpN5O2/0gpWTzN3T9oGg3Y028e+WY+vBDVJdBnNmvh2HMP6WvK9duBbC4WsQ1xDOvX0GUUojPfFRSspWfMW9wvYJ+IVUQQ328og9NFSFGydrpX04Ux2BiU5FeMhAv2tiqIO+1eG8eg4fdqX/KOD+S+0Bu87c2gNrA496xkP/xh0fM0JQ7rZlS079JcmiKepxZb3MOgukjSnQ+mFquIiR8aM1NnRNxZ6Gs= ceph-60ab6d30-209a-11ef-bc9b-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-06-02T04:43:15.705 INFO:teuthology.orchestra.run.smithi076.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC91Y3ezbDwfnJ2IWKatbuskV4w6UZvCzgLUteTzaCa2LBoia5BBhoycCBnc+z+lSArvA2nZBw4ukgrXluao/5jxvEH/D5WG8ifnrKz0G6SPF008bRV1ckPKCFPEiJ37gHkPzXLrGZDtZDFdHXGtby1C6M1s5m+7IykRqJkkv7mwLOQ5RBsjzM+yrhkwXwYqiMcCCpsSh6cqLzENKtiJJC3QhZalqmHPIyLoGFKGl+bDDPVZARLLajudfAhvbneoswnzPiofATpq4UAKuG5E05wl4DK2VZoahBpN5O2/0gpWTzN3T9oGg3Y028e+WY+vBDVJdBnNmvh2HMP6WvK9duBbC4WsQ1xDOvX0GUUojPfFRSspWfMW9wvYJ+IVUQQ328og9NFSFGydrpX04Ux2BiU5FeMhAv2tiqIO+1eG8eg4fdqX/KOD+S+0Bu87c2gNrA496xkP/xh0fM0JQ7rZlS079JcmiKepxZb3MOgukjSnQ+mFquIiR8aM1NnRNxZ6Gs= ceph-60ab6d30-209a-11ef-bc9b-c7b262605968 2024-06-02T04:43:15.717 DEBUG:teuthology.orchestra.run.smithi119:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC91Y3ezbDwfnJ2IWKatbuskV4w6UZvCzgLUteTzaCa2LBoia5BBhoycCBnc+z+lSArvA2nZBw4ukgrXluao/5jxvEH/D5WG8ifnrKz0G6SPF008bRV1ckPKCFPEiJ37gHkPzXLrGZDtZDFdHXGtby1C6M1s5m+7IykRqJkkv7mwLOQ5RBsjzM+yrhkwXwYqiMcCCpsSh6cqLzENKtiJJC3QhZalqmHPIyLoGFKGl+bDDPVZARLLajudfAhvbneoswnzPiofATpq4UAKuG5E05wl4DK2VZoahBpN5O2/0gpWTzN3T9oGg3Y028e+WY+vBDVJdBnNmvh2HMP6WvK9duBbC4WsQ1xDOvX0GUUojPfFRSspWfMW9wvYJ+IVUQQ328og9NFSFGydrpX04Ux2BiU5FeMhAv2tiqIO+1eG8eg4fdqX/KOD+S+0Bu87c2gNrA496xkP/xh0fM0JQ7rZlS079JcmiKepxZb3MOgukjSnQ+mFquIiR8aM1NnRNxZ6Gs= ceph-60ab6d30-209a-11ef-bc9b-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-06-02T04:43:15.762 INFO:teuthology.orchestra.run.smithi119.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC91Y3ezbDwfnJ2IWKatbuskV4w6UZvCzgLUteTzaCa2LBoia5BBhoycCBnc+z+lSArvA2nZBw4ukgrXluao/5jxvEH/D5WG8ifnrKz0G6SPF008bRV1ckPKCFPEiJ37gHkPzXLrGZDtZDFdHXGtby1C6M1s5m+7IykRqJkkv7mwLOQ5RBsjzM+yrhkwXwYqiMcCCpsSh6cqLzENKtiJJC3QhZalqmHPIyLoGFKGl+bDDPVZARLLajudfAhvbneoswnzPiofATpq4UAKuG5E05wl4DK2VZoahBpN5O2/0gpWTzN3T9oGg3Y028e+WY+vBDVJdBnNmvh2HMP6WvK9duBbC4WsQ1xDOvX0GUUojPfFRSspWfMW9wvYJ+IVUQQ328og9NFSFGydrpX04Ux2BiU5FeMhAv2tiqIO+1eG8eg4fdqX/KOD+S+0Bu87c2gNrA496xkP/xh0fM0JQ7rZlS079JcmiKepxZb3MOgukjSnQ+mFquIiR8aM1NnRNxZ6Gs= ceph-60ab6d30-209a-11ef-bc9b-c7b262605968 2024-06-02T04:43:15.775 DEBUG:teuthology.orchestra.run.smithi192:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC91Y3ezbDwfnJ2IWKatbuskV4w6UZvCzgLUteTzaCa2LBoia5BBhoycCBnc+z+lSArvA2nZBw4ukgrXluao/5jxvEH/D5WG8ifnrKz0G6SPF008bRV1ckPKCFPEiJ37gHkPzXLrGZDtZDFdHXGtby1C6M1s5m+7IykRqJkkv7mwLOQ5RBsjzM+yrhkwXwYqiMcCCpsSh6cqLzENKtiJJC3QhZalqmHPIyLoGFKGl+bDDPVZARLLajudfAhvbneoswnzPiofATpq4UAKuG5E05wl4DK2VZoahBpN5O2/0gpWTzN3T9oGg3Y028e+WY+vBDVJdBnNmvh2HMP6WvK9duBbC4WsQ1xDOvX0GUUojPfFRSspWfMW9wvYJ+IVUQQ328og9NFSFGydrpX04Ux2BiU5FeMhAv2tiqIO+1eG8eg4fdqX/KOD+S+0Bu87c2gNrA496xkP/xh0fM0JQ7rZlS079JcmiKepxZb3MOgukjSnQ+mFquIiR8aM1NnRNxZ6Gs= ceph-60ab6d30-209a-11ef-bc9b-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-06-02T04:43:15.822 INFO:teuthology.orchestra.run.smithi192.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC91Y3ezbDwfnJ2IWKatbuskV4w6UZvCzgLUteTzaCa2LBoia5BBhoycCBnc+z+lSArvA2nZBw4ukgrXluao/5jxvEH/D5WG8ifnrKz0G6SPF008bRV1ckPKCFPEiJ37gHkPzXLrGZDtZDFdHXGtby1C6M1s5m+7IykRqJkkv7mwLOQ5RBsjzM+yrhkwXwYqiMcCCpsSh6cqLzENKtiJJC3QhZalqmHPIyLoGFKGl+bDDPVZARLLajudfAhvbneoswnzPiofATpq4UAKuG5E05wl4DK2VZoahBpN5O2/0gpWTzN3T9oGg3Y028e+WY+vBDVJdBnNmvh2HMP6WvK9duBbC4WsQ1xDOvX0GUUojPfFRSspWfMW9wvYJ+IVUQQ328og9NFSFGydrpX04Ux2BiU5FeMhAv2tiqIO+1eG8eg4fdqX/KOD+S+0Bu87c2gNrA496xkP/xh0fM0JQ7rZlS079JcmiKepxZb3MOgukjSnQ+mFquIiR8aM1NnRNxZ6Gs= ceph-60ab6d30-209a-11ef-bc9b-c7b262605968 2024-06-02T04:43:15.835 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 60ab6d30-209a-11ef-bc9b-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-06-02T04:43:16.058 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T04:43:16.330 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:16 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/3447550509' entity='client.admin' 2024-06-02T04:43:17.390 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:17.358+0000 7f08a5d1b700 1 -- 172.21.15.76:0/3985055690 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f08a0101420 msgr2=0x7f08a0103810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:43:17.390 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:17.358+0000 7f08a5d1b700 1 --2- 172.21.15.76:0/3985055690 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f08a0101420 0x7f08a0103810 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0890009910 tx=0x7f0890009c20 comp rx=0 tx=0).stop 2024-06-02T04:43:17.390 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:17.358+0000 7f08a5d1b700 1 -- 172.21.15.76:0/3985055690 shutdown_connections 2024-06-02T04:43:17.390 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:17.358+0000 7f08a5d1b700 1 --2- 172.21.15.76:0/3985055690 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f08a0101420 0x7f08a0103810 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:43:17.391 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:17.358+0000 7f08a5d1b700 1 -- 172.21.15.76:0/3985055690 >> 172.21.15.76:0/3985055690 conn(0x7f08a00fadd0 msgr2=0x7f08a00fd210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:43:17.391 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:17.358+0000 7f08a5d1b700 1 -- 172.21.15.76:0/3985055690 shutdown_connections 2024-06-02T04:43:17.391 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:17.358+0000 7f08a5d1b700 1 -- 172.21.15.76:0/3985055690 wait complete. 2024-06-02T04:43:17.391 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:17.359+0000 7f08a5d1b700 1 Processor -- start 2024-06-02T04:43:17.391 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:17.359+0000 7f08a5d1b700 1 -- start start 2024-06-02T04:43:17.391 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:17.359+0000 7f08a5d1b700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f08a0101420 0x7f08a0195c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:43:17.391 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:17.359+0000 7f08a5d1b700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08a01961a0 con 0x7f08a0101420 2024-06-02T04:43:17.391 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:17.360+0000 7f089f7fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f08a0101420 0x7f08a0195c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:43:17.391 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:17.360+0000 7f089f7fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f08a0101420 0x7f08a0195c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:36514/0 (socket says 172.21.15.76:36514) 2024-06-02T04:43:17.391 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:17.360+0000 7f089f7fe700 1 -- 172.21.15.76:0/74101540 learned_addr learned my addr 172.21.15.76:0/74101540 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:43:17.392 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:17.360+0000 7f089f7fe700 1 -- 172.21.15.76:0/74101540 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08900095f0 con 0x7f08a0101420 2024-06-02T04:43:17.392 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:17.360+0000 7f089f7fe700 1 --2- 172.21.15.76:0/74101540 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f08a0101420 0x7f08a0195c60 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f089000b5c0 tx=0x7f0890005810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:43:17.392 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:17.360+0000 7f089cff9700 1 -- 172.21.15.76:0/74101540 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f089000b960 con 0x7f08a0101420 2024-06-02T04:43:17.392 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:17.360+0000 7f08a5d1b700 1 -- 172.21.15.76:0/74101540 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08a01963a0 con 0x7f08a0101420 2024-06-02T04:43:17.392 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:17.360+0000 7f089cff9700 1 -- 172.21.15.76:0/74101540 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f089000f460 con 0x7f08a0101420 2024-06-02T04:43:17.392 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:17.360+0000 7f089cff9700 1 -- 172.21.15.76:0/74101540 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0890017440 con 0x7f08a0101420 2024-06-02T04:43:17.392 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:17.360+0000 7f08a5d1b700 1 -- 172.21.15.76:0/74101540 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08a0196840 con 0x7f08a0101420 2024-06-02T04:43:17.392 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:17.361+0000 7f089cff9700 1 -- 172.21.15.76:0/74101540 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7f0890017700 con 0x7f08a0101420 2024-06-02T04:43:17.392 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:17.361+0000 7f089cff9700 1 --2- 172.21.15.76:0/74101540 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f08880387a0 0x7f088803ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:43:17.392 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:17.361+0000 7f08a5d1b700 1 -- 172.21.15.76:0/74101540 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08a018f500 con 0x7f08a0101420 2024-06-02T04:43:17.392 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:17.361+0000 7f089cff9700 1 -- 172.21.15.76:0/74101540 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f089004c850 con 0x7f08a0101420 2024-06-02T04:43:17.392 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:17.361+0000 7f089effd700 1 --2- 172.21.15.76:0/74101540 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f08880387a0 0x7f088803ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:43:17.392 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:17.362+0000 7f089effd700 1 --2- 172.21.15.76:0/74101540 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f08880387a0 0x7f088803ac60 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0894006fd0 tx=0x7f0894006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:43:17.393 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:17.366+0000 7f089cff9700 1 -- 172.21.15.76:0/74101540 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f0890027070 con 0x7f08a0101420 2024-06-02T04:43:17.584 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:17.584+0000 7f08a5d1b700 1 -- 172.21.15.76:0/74101540 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7f08a00625d0 con 0x7f08a0101420 2024-06-02T04:43:17.587 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:17.587+0000 7f089cff9700 1 -- 172.21.15.76:0/74101540 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7f089002c440 con 0x7f08a0101420 2024-06-02T04:43:17.589 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:17.589+0000 7f08a5d1b700 1 -- 172.21.15.76:0/74101540 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f08880387a0 msgr2=0x7f088803ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:43:17.589 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:17.589+0000 7f08a5d1b700 1 --2- 172.21.15.76:0/74101540 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f08880387a0 0x7f088803ac60 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0894006fd0 tx=0x7f0894006e40 comp rx=0 tx=0).stop 2024-06-02T04:43:17.589 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:17.589+0000 7f08a5d1b700 1 -- 172.21.15.76:0/74101540 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f08a0101420 msgr2=0x7f08a0195c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:43:17.590 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:17.589+0000 7f08a5d1b700 1 --2- 172.21.15.76:0/74101540 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f08a0101420 0x7f08a0195c60 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f089000b5c0 tx=0x7f0890005810 comp rx=0 tx=0).stop 2024-06-02T04:43:17.590 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:17.589+0000 7f08a5d1b700 1 -- 172.21.15.76:0/74101540 shutdown_connections 2024-06-02T04:43:17.590 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:17.589+0000 7f08a5d1b700 1 --2- 172.21.15.76:0/74101540 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f08880387a0 0x7f088803ac60 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:43:17.590 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:17.589+0000 7f08a5d1b700 1 --2- 172.21.15.76:0/74101540 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f08a0101420 0x7f08a0195c60 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:43:17.590 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:17.589+0000 7f08a5d1b700 1 -- 172.21.15.76:0/74101540 >> 172.21.15.76:0/74101540 conn(0x7f08a00fadd0 msgr2=0x7f08a00fb960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:43:17.590 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:17.589+0000 7f08a5d1b700 1 -- 172.21.15.76:0/74101540 shutdown_connections 2024-06-02T04:43:17.590 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:17.589+0000 7f08a5d1b700 1 -- 172.21.15.76:0/74101540 wait complete. 2024-06-02T04:43:18.004 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-06-02T04:43:18.005 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 60ab6d30-209a-11ef-bc9b-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-06-02T04:43:18.233 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T04:43:18.916 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:18 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/74101540' entity='client.admin' 2024-06-02T04:43:19.398 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:19.396+0000 7fcc74a93700 1 -- 172.21.15.76:0/1269466595 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcc700fefb0 msgr2=0x7fcc700ff3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:43:19.398 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:19.396+0000 7fcc74a93700 1 --2- 172.21.15.76:0/1269466595 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcc700fefb0 0x7fcc700ff3d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fcc60009910 tx=0x7fcc60009c20 comp rx=0 tx=0).stop 2024-06-02T04:43:19.399 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:19.396+0000 7fcc74a93700 1 -- 172.21.15.76:0/1269466595 shutdown_connections 2024-06-02T04:43:19.399 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:19.397+0000 7fcc74a93700 1 --2- 172.21.15.76:0/1269466595 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcc700fefb0 0x7fcc700ff3d0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:43:19.399 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:19.397+0000 7fcc74a93700 1 -- 172.21.15.76:0/1269466595 >> 172.21.15.76:0/1269466595 conn(0x7fcc700fa550 msgr2=0x7fcc700fc990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:43:19.399 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:19.397+0000 7fcc74a93700 1 -- 172.21.15.76:0/1269466595 shutdown_connections 2024-06-02T04:43:19.399 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:19.397+0000 7fcc74a93700 1 -- 172.21.15.76:0/1269466595 wait complete. 2024-06-02T04:43:19.399 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:19.397+0000 7fcc74a93700 1 Processor -- start 2024-06-02T04:43:19.399 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:19.397+0000 7fcc74a93700 1 -- start start 2024-06-02T04:43:19.399 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:19.397+0000 7fcc74a93700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcc700fefb0 0x7fcc700fc3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:43:19.399 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:19.398+0000 7fcc74a93700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc700fc900 con 0x7fcc700fefb0 2024-06-02T04:43:19.399 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:19.398+0000 7fcc6e59c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcc700fefb0 0x7fcc700fc3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:43:19.399 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:19.398+0000 7fcc6e59c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcc700fefb0 0x7fcc700fc3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:36534/0 (socket says 172.21.15.76:36534) 2024-06-02T04:43:19.400 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:19.398+0000 7fcc6e59c700 1 -- 172.21.15.76:0/1588383272 learned_addr learned my addr 172.21.15.76:0/1588383272 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:43:19.400 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:19.398+0000 7fcc6e59c700 1 -- 172.21.15.76:0/1588383272 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc600095f0 con 0x7fcc700fefb0 2024-06-02T04:43:19.400 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:19.398+0000 7fcc6e59c700 1 --2- 172.21.15.76:0/1588383272 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcc700fefb0 0x7fcc700fc3c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fcc60005790 tx=0x7fcc600047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:43:19.400 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:19.398+0000 7fcc5f7fe700 1 -- 172.21.15.76:0/1588383272 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcc6000b960 con 0x7fcc700fefb0 2024-06-02T04:43:19.400 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:19.398+0000 7fcc5f7fe700 1 -- 172.21.15.76:0/1588383272 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcc6000f460 con 0x7fcc700fefb0 2024-06-02T04:43:19.400 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:19.398+0000 7fcc5f7fe700 1 -- 172.21.15.76:0/1588383272 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcc600175d0 con 0x7fcc700fefb0 2024-06-02T04:43:19.400 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:19.398+0000 7fcc74a93700 1 -- 172.21.15.76:0/1588383272 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc700fab40 con 0x7fcc700fefb0 2024-06-02T04:43:19.400 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:19.398+0000 7fcc74a93700 1 -- 172.21.15.76:0/1588383272 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc700fafe0 con 0x7fcc700fefb0 2024-06-02T04:43:19.401 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:19.399+0000 7fcc5f7fe700 1 -- 172.21.15.76:0/1588383272 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7fcc600177c0 con 0x7fcc700fefb0 2024-06-02T04:43:19.401 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:19.399+0000 7fcc74a93700 1 -- 172.21.15.76:0/1588383272 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc70105d30 con 0x7fcc700fefb0 2024-06-02T04:43:19.401 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:19.399+0000 7fcc5f7fe700 1 --2- 172.21.15.76:0/1588383272 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fcc580387f0 0x7fcc5803acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:43:19.401 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:19.399+0000 7fcc5f7fe700 1 -- 172.21.15.76:0/1588383272 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fcc6004c840 con 0x7fcc700fefb0 2024-06-02T04:43:19.401 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:19.399+0000 7fcc6dd9b700 1 --2- 172.21.15.76:0/1588383272 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fcc580387f0 0x7fcc5803acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:43:19.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:19.400+0000 7fcc6dd9b700 1 --2- 172.21.15.76:0/1588383272 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fcc580387f0 0x7fcc5803acb0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fcc64006fd0 tx=0x7fcc64006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:43:19.404 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:19.404+0000 7fcc5f7fe700 1 -- 172.21.15.76:0/1588383272 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fcc600163a0 con 0x7fcc700fefb0 2024-06-02T04:43:19.598 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:19.598+0000 7fcc74a93700 1 -- 172.21.15.76:0/1588383272 --> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7fcc700fb350 con 0x7fcc580387f0 2024-06-02T04:43:19.602 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:19.602+0000 7fcc5f7fe700 1 -- 172.21.15.76:0/1588383272 <== mgr.14152 v2:172.21.15.76:6800/2591353090 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fcc700fb350 con 0x7fcc580387f0 2024-06-02T04:43:19.604 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:19.604+0000 7fcc74a93700 1 -- 172.21.15.76:0/1588383272 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fcc580387f0 msgr2=0x7fcc5803acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:43:19.604 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:19.604+0000 7fcc74a93700 1 --2- 172.21.15.76:0/1588383272 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fcc580387f0 0x7fcc5803acb0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fcc64006fd0 tx=0x7fcc64006e40 comp rx=0 tx=0).stop 2024-06-02T04:43:19.604 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:19.604+0000 7fcc74a93700 1 -- 172.21.15.76:0/1588383272 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcc700fefb0 msgr2=0x7fcc700fc3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:43:19.604 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:19.604+0000 7fcc74a93700 1 --2- 172.21.15.76:0/1588383272 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcc700fefb0 0x7fcc700fc3c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fcc60005790 tx=0x7fcc600047b0 comp rx=0 tx=0).stop 2024-06-02T04:43:19.604 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:19.604+0000 7fcc74a93700 1 -- 172.21.15.76:0/1588383272 shutdown_connections 2024-06-02T04:43:19.604 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:19.604+0000 7fcc74a93700 1 --2- 172.21.15.76:0/1588383272 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fcc580387f0 0x7fcc5803acb0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:43:19.604 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:19.604+0000 7fcc74a93700 1 --2- 172.21.15.76:0/1588383272 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcc700fefb0 0x7fcc700fc3c0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:43:19.604 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:19.604+0000 7fcc74a93700 1 -- 172.21.15.76:0/1588383272 >> 172.21.15.76:0/1588383272 conn(0x7fcc700fa550 msgr2=0x7fcc70103bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:43:19.605 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:19.604+0000 7fcc74a93700 1 -- 172.21.15.76:0/1588383272 shutdown_connections 2024-06-02T04:43:19.605 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:19.604+0000 7fcc74a93700 1 -- 172.21.15.76:0/1588383272 wait complete. 2024-06-02T04:43:19.928 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:19 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:19.928 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:19 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:19.928 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:19 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi076", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:43:19.929 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:19 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:19.929 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:19 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:43:19.929 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:19 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:19.929 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:19 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:19.929 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:19 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:43:19.929 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:19 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:43:19.930 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:19 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:43:19.991 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi119 2024-06-02T04:43:19.991 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-06-02T04:43:19.991 DEBUG:teuthology.orchestra.run.smithi119:> dd of=/etc/ceph/ceph.conf 2024-06-02T04:43:20.012 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-06-02T04:43:20.012 DEBUG:teuthology.orchestra.run.smithi119:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-06-02T04:43:20.072 INFO:tasks.cephadm:Adding host smithi119 to orchestrator... 2024-06-02T04:43:20.072 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 60ab6d30-209a-11ef-bc9b-c7b262605968 -- ceph orch host add smithi119 2024-06-02T04:43:20.320 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T04:43:21.167 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:20 smithi076 ceph-mon[42935]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:43:21.168 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:20 smithi076 ceph-mon[42935]: Updating smithi076:/etc/ceph/ceph.conf 2024-06-02T04:43:21.168 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:20 smithi076 ceph-mon[42935]: Updating smithi076:/var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-02T04:43:21.168 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:20 smithi076 ceph-mon[42935]: Updating smithi076:/etc/ceph/ceph.client.admin.keyring 2024-06-02T04:43:21.168 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:20 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:21.168 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:20 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:21.168 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:20 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:21.339 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:21.335+0000 7fdb1649f700 1 -- 172.21.15.76:0/673019322 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdb101068f0 msgr2=0x7fdb10106cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:43:21.339 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:21.335+0000 7fdb1649f700 1 --2- 172.21.15.76:0/673019322 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdb101068f0 0x7fdb10106cd0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fdb00009910 tx=0x7fdb00009c20 comp rx=0 tx=0).stop 2024-06-02T04:43:21.340 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:21.335+0000 7fdb1649f700 1 -- 172.21.15.76:0/673019322 shutdown_connections 2024-06-02T04:43:21.340 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:21.335+0000 7fdb1649f700 1 --2- 172.21.15.76:0/673019322 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdb101068f0 0x7fdb10106cd0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:43:21.340 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:21.335+0000 7fdb1649f700 1 -- 172.21.15.76:0/673019322 >> 172.21.15.76:0/673019322 conn(0x7fdb100fc420 msgr2=0x7fdb100fe840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:43:21.340 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:21.335+0000 7fdb1649f700 1 -- 172.21.15.76:0/673019322 shutdown_connections 2024-06-02T04:43:21.340 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:21.335+0000 7fdb1649f700 1 -- 172.21.15.76:0/673019322 wait complete. 2024-06-02T04:43:21.340 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:21.336+0000 7fdb1649f700 1 Processor -- start 2024-06-02T04:43:21.340 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:21.336+0000 7fdb1649f700 1 -- start start 2024-06-02T04:43:21.340 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:21.336+0000 7fdb1649f700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdb101068f0 0x7fdb10196080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:43:21.340 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:21.336+0000 7fdb1649f700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb101965c0 con 0x7fdb101068f0 2024-06-02T04:43:21.340 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:21.336+0000 7fdb0ffff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdb101068f0 0x7fdb10196080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:43:21.340 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:21.336+0000 7fdb0ffff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdb101068f0 0x7fdb10196080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:36550/0 (socket says 172.21.15.76:36550) 2024-06-02T04:43:21.340 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:21.336+0000 7fdb0ffff700 1 -- 172.21.15.76:0/2382978598 learned_addr learned my addr 172.21.15.76:0/2382978598 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:43:21.340 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:21.337+0000 7fdb0ffff700 1 -- 172.21.15.76:0/2382978598 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb000095f0 con 0x7fdb101068f0 2024-06-02T04:43:21.341 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:21.337+0000 7fdb0ffff700 1 --2- 172.21.15.76:0/2382978598 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdb101068f0 0x7fdb10196080 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fdb00005660 tx=0x7fdb00005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:43:21.341 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:21.337+0000 7fdb0d7fa700 1 -- 172.21.15.76:0/2382978598 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdb0001d070 con 0x7fdb101068f0 2024-06-02T04:43:21.341 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:21.337+0000 7fdb1649f700 1 -- 172.21.15.76:0/2382978598 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb10196820 con 0x7fdb101068f0 2024-06-02T04:43:21.341 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:21.337+0000 7fdb0d7fa700 1 -- 172.21.15.76:0/2382978598 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdb0000b6f0 con 0x7fdb101068f0 2024-06-02T04:43:21.341 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:21.337+0000 7fdb0d7fa700 1 -- 172.21.15.76:0/2382978598 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdb000037f0 con 0x7fdb101068f0 2024-06-02T04:43:21.341 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:21.337+0000 7fdb1649f700 1 -- 172.21.15.76:0/2382978598 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb10196ca0 con 0x7fdb101068f0 2024-06-02T04:43:21.341 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:21.338+0000 7fdb1649f700 1 -- 172.21.15.76:0/2382978598 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb10102030 con 0x7fdb101068f0 2024-06-02T04:43:21.341 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:21.338+0000 7fdb0d7fa700 1 -- 172.21.15.76:0/2382978598 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7fdb0000b860 con 0x7fdb101068f0 2024-06-02T04:43:21.341 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:21.338+0000 7fdb0d7fa700 1 --2- 172.21.15.76:0/2382978598 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fdaf80387a0 0x7fdaf803ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:43:21.341 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:21.338+0000 7fdb0d7fa700 1 -- 172.21.15.76:0/2382978598 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fdb0004c400 con 0x7fdb101068f0 2024-06-02T04:43:21.341 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:21.338+0000 7fdb0f7fe700 1 --2- 172.21.15.76:0/2382978598 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fdaf80387a0 0x7fdaf803ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:43:21.341 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:21.339+0000 7fdb0f7fe700 1 --2- 172.21.15.76:0/2382978598 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fdaf80387a0 0x7fdaf803ac60 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fdb04006fd0 tx=0x7fdb04006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:43:21.343 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:21.343+0000 7fdb0d7fa700 1 -- 172.21.15.76:0/2382978598 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fdb0002ab60 con 0x7fdb101068f0 2024-06-02T04:43:21.539 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:21.539+0000 7fdb1649f700 1 -- 172.21.15.76:0/2382978598 --> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi119", "target": ["mon-mgr", ""]}) v1 -- 0x7fdb1010aaa0 con 0x7fdaf80387a0 2024-06-02T04:43:22.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:21 smithi076 ceph-mon[42935]: Updating smithi076:/var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/config/ceph.client.admin.keyring 2024-06-02T04:43:23.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:22 smithi076 ceph-mon[42935]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi119", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:43:23.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:22 smithi076 ceph-mon[42935]: Deploying cephadm binary to smithi119 2024-06-02T04:43:23.752 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:23.752+0000 7fdb0d7fa700 1 -- 172.21.15.76:0/2382978598 <== mgr.14152 v2:172.21.15.76:6800/2591353090 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7fdb1010aaa0 con 0x7fdaf80387a0 2024-06-02T04:43:23.752 INFO:teuthology.orchestra.run.smithi076.stdout:Added host 'smithi119' with addr '172.21.15.119' 2024-06-02T04:43:23.754 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:23.754+0000 7fdb1649f700 1 -- 172.21.15.76:0/2382978598 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fdaf80387a0 msgr2=0x7fdaf803ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:43:23.754 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:23.754+0000 7fdb1649f700 1 --2- 172.21.15.76:0/2382978598 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fdaf80387a0 0x7fdaf803ac60 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fdb04006fd0 tx=0x7fdb04006e40 comp rx=0 tx=0).stop 2024-06-02T04:43:23.754 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:23.754+0000 7fdb1649f700 1 -- 172.21.15.76:0/2382978598 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdb101068f0 msgr2=0x7fdb10196080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:43:23.754 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:23.754+0000 7fdb1649f700 1 --2- 172.21.15.76:0/2382978598 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdb101068f0 0x7fdb10196080 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fdb00005660 tx=0x7fdb00005740 comp rx=0 tx=0).stop 2024-06-02T04:43:23.754 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:23.754+0000 7fdb1649f700 1 -- 172.21.15.76:0/2382978598 shutdown_connections 2024-06-02T04:43:23.754 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:23.754+0000 7fdb1649f700 1 --2- 172.21.15.76:0/2382978598 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fdaf80387a0 0x7fdaf803ac60 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:43:23.755 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:23.754+0000 7fdb1649f700 1 --2- 172.21.15.76:0/2382978598 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdb101068f0 0x7fdb10196080 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:43:23.755 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:23.754+0000 7fdb1649f700 1 -- 172.21.15.76:0/2382978598 >> 172.21.15.76:0/2382978598 conn(0x7fdb100fc420 msgr2=0x7fdb101085c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:43:23.755 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:23.754+0000 7fdb1649f700 1 -- 172.21.15.76:0/2382978598 shutdown_connections 2024-06-02T04:43:23.755 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:23.754+0000 7fdb1649f700 1 -- 172.21.15.76:0/2382978598 wait complete. 2024-06-02T04:43:24.139 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 60ab6d30-209a-11ef-bc9b-c7b262605968 -- ceph orch host ls --format=json 2024-06-02T04:43:24.356 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T04:43:25.142 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:24 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:25.142 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:24 smithi076 ceph-mon[42935]: Added host smithi119 2024-06-02T04:43:25.142 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:24 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:43:25.142 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:24 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:25.142 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:24 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:25.309 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:25.309+0000 7f96332cd700 1 -- 172.21.15.76:0/2443637864 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f962c1068e0 msgr2=0x7f962c106cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:43:25.309 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:25.309+0000 7f96332cd700 1 --2- 172.21.15.76:0/2443637864 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f962c1068e0 0x7f962c106cc0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f961c009910 tx=0x7f961c009c20 comp rx=0 tx=0).stop 2024-06-02T04:43:25.309 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:25.309+0000 7f96332cd700 1 -- 172.21.15.76:0/2443637864 shutdown_connections 2024-06-02T04:43:25.310 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:25.309+0000 7f96332cd700 1 --2- 172.21.15.76:0/2443637864 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f962c1068e0 0x7f962c106cc0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:43:25.310 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:25.309+0000 7f96332cd700 1 -- 172.21.15.76:0/2443637864 >> 172.21.15.76:0/2443637864 conn(0x7f962c0fc3f0 msgr2=0x7f962c0fe810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:43:25.310 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:25.309+0000 7f96332cd700 1 -- 172.21.15.76:0/2443637864 shutdown_connections 2024-06-02T04:43:25.310 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:25.309+0000 7f96332cd700 1 -- 172.21.15.76:0/2443637864 wait complete. 2024-06-02T04:43:25.310 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:25.309+0000 7f96332cd700 1 Processor -- start 2024-06-02T04:43:25.310 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:25.309+0000 7f96332cd700 1 -- start start 2024-06-02T04:43:25.310 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:25.310+0000 7f96332cd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f962c1068e0 0x7f962c0732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:43:25.310 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:25.310+0000 7f96332cd700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f962c075160 con 0x7f962c1068e0 2024-06-02T04:43:25.312 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:25.310+0000 7f9631069700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f962c1068e0 0x7f962c0732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:43:25.312 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:25.310+0000 7f9631069700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f962c1068e0 0x7f962c0732a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:45028/0 (socket says 172.21.15.76:45028) 2024-06-02T04:43:25.312 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:25.310+0000 7f9631069700 1 -- 172.21.15.76:0/572230384 learned_addr learned my addr 172.21.15.76:0/572230384 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:43:25.312 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:25.310+0000 7f9631069700 1 -- 172.21.15.76:0/572230384 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f961c0095f0 con 0x7f962c1068e0 2024-06-02T04:43:25.312 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:25.310+0000 7f9631069700 1 --2- 172.21.15.76:0/572230384 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f962c1068e0 0x7f962c0732a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f961c005660 tx=0x7f961c005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:43:25.312 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:25.310+0000 7f96227fc700 1 -- 172.21.15.76:0/572230384 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f961c01d070 con 0x7f962c1068e0 2024-06-02T04:43:25.312 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:25.310+0000 7f96227fc700 1 -- 172.21.15.76:0/572230384 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f961c00b6f0 con 0x7f962c1068e0 2024-06-02T04:43:25.312 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:25.310+0000 7f96332cd700 1 -- 172.21.15.76:0/572230384 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f962c0737e0 con 0x7f962c1068e0 2024-06-02T04:43:25.312 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:25.310+0000 7f96227fc700 1 -- 172.21.15.76:0/572230384 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f961c0037f0 con 0x7f962c1068e0 2024-06-02T04:43:25.312 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:25.310+0000 7f96332cd700 1 -- 172.21.15.76:0/572230384 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f962c073c60 con 0x7f962c1068e0 2024-06-02T04:43:25.312 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:25.311+0000 7f96332cd700 1 -- 172.21.15.76:0/572230384 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f962c102020 con 0x7f962c1068e0 2024-06-02T04:43:25.313 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:25.311+0000 7f96227fc700 1 -- 172.21.15.76:0/572230384 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7f961c004390 con 0x7f962c1068e0 2024-06-02T04:43:25.313 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:25.311+0000 7f96227fc700 1 --2- 172.21.15.76:0/572230384 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f96180387f0 0x7f961803acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:43:25.313 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:25.312+0000 7f96227fc700 1 -- 172.21.15.76:0/572230384 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f961c04c3a0 con 0x7f962c1068e0 2024-06-02T04:43:25.313 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:25.312+0000 7f9630868700 1 --2- 172.21.15.76:0/572230384 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f96180387f0 0x7f961803acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:43:25.313 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:25.312+0000 7f9630868700 1 --2- 172.21.15.76:0/572230384 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f96180387f0 0x7f961803acb0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f9628006fd0 tx=0x7f9628006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:43:25.316 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:25.316+0000 7f96227fc700 1 -- 172.21.15.76:0/572230384 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f961c029360 con 0x7f962c1068e0 2024-06-02T04:43:25.513 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:25.513+0000 7f96332cd700 1 -- 172.21.15.76:0/572230384 --> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f962c073ea0 con 0x7f96180387f0 2024-06-02T04:43:25.514 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:25.514+0000 7f96227fc700 1 -- 172.21.15.76:0/572230384 <== mgr.14152 v2:172.21.15.76:6800/2591353090 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+160 (secure 0 0 0) 0x7f962c073ea0 con 0x7f96180387f0 2024-06-02T04:43:25.514 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:43:25.514 INFO:teuthology.orchestra.run.smithi076.stdout:[{"addr": "172.21.15.76", "hostname": "smithi076", "labels": [], "status": ""}, {"addr": "172.21.15.119", "hostname": "smithi119", "labels": [], "status": ""}] 2024-06-02T04:43:25.516 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:25.516+0000 7f96332cd700 1 -- 172.21.15.76:0/572230384 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f96180387f0 msgr2=0x7f961803acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:43:25.517 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:25.516+0000 7f96332cd700 1 --2- 172.21.15.76:0/572230384 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f96180387f0 0x7f961803acb0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f9628006fd0 tx=0x7f9628006e40 comp rx=0 tx=0).stop 2024-06-02T04:43:25.517 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:25.516+0000 7f96332cd700 1 -- 172.21.15.76:0/572230384 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f962c1068e0 msgr2=0x7f962c0732a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:43:25.517 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:25.516+0000 7f96332cd700 1 --2- 172.21.15.76:0/572230384 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f962c1068e0 0x7f962c0732a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f961c005660 tx=0x7f961c005740 comp rx=0 tx=0).stop 2024-06-02T04:43:25.517 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:25.516+0000 7f96332cd700 1 -- 172.21.15.76:0/572230384 shutdown_connections 2024-06-02T04:43:25.517 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:25.516+0000 7f96332cd700 1 --2- 172.21.15.76:0/572230384 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f96180387f0 0x7f961803acb0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:43:25.517 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:25.516+0000 7f96332cd700 1 --2- 172.21.15.76:0/572230384 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f962c1068e0 0x7f962c0732a0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:43:25.517 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:25.516+0000 7f96332cd700 1 -- 172.21.15.76:0/572230384 >> 172.21.15.76:0/572230384 conn(0x7f962c0fc3f0 msgr2=0x7f962c108510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:43:25.517 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:25.517+0000 7f96332cd700 1 -- 172.21.15.76:0/572230384 shutdown_connections 2024-06-02T04:43:25.517 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:25.517+0000 7f96332cd700 1 -- 172.21.15.76:0/572230384 wait complete. 2024-06-02T04:43:25.928 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi192 2024-06-02T04:43:25.928 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-06-02T04:43:25.928 DEBUG:teuthology.orchestra.run.smithi192:> dd of=/etc/ceph/ceph.conf 2024-06-02T04:43:25.949 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-06-02T04:43:25.949 DEBUG:teuthology.orchestra.run.smithi192:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-06-02T04:43:26.009 INFO:tasks.cephadm:Adding host smithi192 to orchestrator... 2024-06-02T04:43:26.009 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 60ab6d30-209a-11ef-bc9b-c7b262605968 -- ceph orch host add smithi192 2024-06-02T04:43:26.231 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T04:43:26.384 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:26 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:27.162 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:27.160+0000 7f1a17014700 1 -- 172.21.15.76:0/2146811592 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1a10101b10 msgr2=0x7f1a10101ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:43:27.163 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:27.160+0000 7f1a17014700 1 --2- 172.21.15.76:0/2146811592 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1a10101b10 0x7f1a10101ef0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1a04009910 tx=0x7f1a04009c20 comp rx=0 tx=0).stop 2024-06-02T04:43:27.163 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:27.161+0000 7f1a17014700 1 -- 172.21.15.76:0/2146811592 shutdown_connections 2024-06-02T04:43:27.163 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:27.161+0000 7f1a17014700 1 --2- 172.21.15.76:0/2146811592 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1a10101b10 0x7f1a10101ef0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:43:27.163 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:27.161+0000 7f1a17014700 1 -- 172.21.15.76:0/2146811592 >> 172.21.15.76:0/2146811592 conn(0x7f1a100fb2e0 msgr2=0x7f1a100fd700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:43:27.163 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:27.161+0000 7f1a17014700 1 -- 172.21.15.76:0/2146811592 shutdown_connections 2024-06-02T04:43:27.163 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:27.161+0000 7f1a17014700 1 -- 172.21.15.76:0/2146811592 wait complete. 2024-06-02T04:43:27.163 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:27.161+0000 7f1a17014700 1 Processor -- start 2024-06-02T04:43:27.163 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:27.161+0000 7f1a17014700 1 -- start start 2024-06-02T04:43:27.163 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:27.161+0000 7f1a17014700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1a10101b10 0x7f1a100ff770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:43:27.163 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:27.161+0000 7f1a17014700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a10101630 con 0x7f1a10101b10 2024-06-02T04:43:27.163 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:27.161+0000 7f1a14db0700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1a10101b10 0x7f1a100ff770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:43:27.163 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:27.161+0000 7f1a14db0700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1a10101b10 0x7f1a100ff770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:45052/0 (socket says 172.21.15.76:45052) 2024-06-02T04:43:27.164 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:27.161+0000 7f1a14db0700 1 -- 172.21.15.76:0/330672922 learned_addr learned my addr 172.21.15.76:0/330672922 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:43:27.164 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:27.162+0000 7f1a14db0700 1 -- 172.21.15.76:0/330672922 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a040095f0 con 0x7f1a10101b10 2024-06-02T04:43:27.164 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:27.162+0000 7f1a14db0700 1 --2- 172.21.15.76:0/330672922 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1a10101b10 0x7f1a100ff770 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1a040055f0 tx=0x7f1a040056d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:43:27.164 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:27.162+0000 7f1a0dffb700 1 -- 172.21.15.76:0/330672922 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1a0401d070 con 0x7f1a10101b10 2024-06-02T04:43:27.164 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:27.162+0000 7f1a0dffb700 1 -- 172.21.15.76:0/330672922 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1a0400b750 con 0x7f1a10101b10 2024-06-02T04:43:27.164 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:27.162+0000 7f1a17014700 1 -- 172.21.15.76:0/330672922 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a100ffcb0 con 0x7f1a10101b10 2024-06-02T04:43:27.164 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:27.162+0000 7f1a0dffb700 1 -- 172.21.15.76:0/330672922 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1a040037b0 con 0x7f1a10101b10 2024-06-02T04:43:27.164 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:27.162+0000 7f1a17014700 1 -- 172.21.15.76:0/330672922 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a101000d0 con 0x7f1a10101b10 2024-06-02T04:43:27.165 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:27.163+0000 7f1a0dffb700 1 -- 172.21.15.76:0/330672922 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7f1a04003a70 con 0x7f1a10101b10 2024-06-02T04:43:27.165 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:27.163+0000 7f1a0dffb700 1 --2- 172.21.15.76:0/330672922 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f1a000387a0 0x7f1a0003ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:43:27.165 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:27.163+0000 7f1a0dffb700 1 -- 172.21.15.76:0/330672922 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f1a0404d390 con 0x7f1a10101b10 2024-06-02T04:43:27.165 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:27.163+0000 7f1a0ffff700 1 --2- 172.21.15.76:0/330672922 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f1a000387a0 0x7f1a0003ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:43:27.165 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:27.163+0000 7f1a17014700 1 -- 172.21.15.76:0/330672922 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a100695c0 con 0x7f1a10101b10 2024-06-02T04:43:27.165 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:27.164+0000 7f1a0ffff700 1 --2- 172.21.15.76:0/330672922 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f1a000387a0 0x7f1a0003ac60 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f19fc006fd0 tx=0x7f19fc006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:43:27.168 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:27.168+0000 7f1a0dffb700 1 -- 172.21.15.76:0/330672922 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f1a04026020 con 0x7f1a10101b10 2024-06-02T04:43:27.368 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:27.368+0000 7f1a17014700 1 -- 172.21.15.76:0/330672922 --> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi192", "target": ["mon-mgr", ""]}) v1 -- 0x7f1a10100d60 con 0x7f1a000387a0 2024-06-02T04:43:27.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:27 smithi076 ceph-mon[42935]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-02T04:43:27.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:27 smithi076 ceph-mon[42935]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T04:43:28.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:28 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:28.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:28 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:28.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:28 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:28.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:28 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:28.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:28 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi119", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:43:28.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:28 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:43:28.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:28 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:43:28.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:28 smithi076 ceph-mon[42935]: Updating smithi119:/etc/ceph/ceph.conf 2024-06-02T04:43:28.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:28 smithi076 ceph-mon[42935]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi192", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:43:28.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:28 smithi076 ceph-mon[42935]: Updating smithi119:/var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-02T04:43:28.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:28 smithi076 ceph-mon[42935]: Updating smithi119:/etc/ceph/ceph.client.admin.keyring 2024-06-02T04:43:28.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:28 smithi076 ceph-mon[42935]: Deploying cephadm binary to smithi192 2024-06-02T04:43:28.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:28 smithi076 ceph-mon[42935]: Updating smithi119:/var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/config/ceph.client.admin.keyring 2024-06-02T04:43:28.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:28 smithi076 ceph-mon[42935]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T04:43:28.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:28 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:28.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:28 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:28.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:28 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:29.538 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:29.534+0000 7f1a0dffb700 1 -- 172.21.15.76:0/330672922 <== mgr.14152 v2:172.21.15.76:6800/2591353090 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f1a10100d60 con 0x7f1a000387a0 2024-06-02T04:43:29.538 INFO:teuthology.orchestra.run.smithi076.stdout:Added host 'smithi192' with addr '172.21.15.192' 2024-06-02T04:43:29.539 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:29.537+0000 7f1a17014700 1 -- 172.21.15.76:0/330672922 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f1a000387a0 msgr2=0x7f1a0003ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:43:29.539 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:29.537+0000 7f1a17014700 1 --2- 172.21.15.76:0/330672922 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f1a000387a0 0x7f1a0003ac60 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f19fc006fd0 tx=0x7f19fc006e40 comp rx=0 tx=0).stop 2024-06-02T04:43:29.539 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:29.537+0000 7f1a17014700 1 -- 172.21.15.76:0/330672922 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1a10101b10 msgr2=0x7f1a100ff770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:43:29.539 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:29.537+0000 7f1a17014700 1 --2- 172.21.15.76:0/330672922 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1a10101b10 0x7f1a100ff770 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1a040055f0 tx=0x7f1a040056d0 comp rx=0 tx=0).stop 2024-06-02T04:43:29.539 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:29.537+0000 7f1a17014700 1 -- 172.21.15.76:0/330672922 shutdown_connections 2024-06-02T04:43:29.539 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:29.537+0000 7f1a17014700 1 --2- 172.21.15.76:0/330672922 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f1a000387a0 0x7f1a0003ac60 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:43:29.539 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:29.537+0000 7f1a17014700 1 --2- 172.21.15.76:0/330672922 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1a10101b10 0x7f1a100ff770 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:43:29.539 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:29.537+0000 7f1a17014700 1 -- 172.21.15.76:0/330672922 >> 172.21.15.76:0/330672922 conn(0x7f1a100fb2e0 msgr2=0x7f1a101048d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:43:29.539 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:29.537+0000 7f1a17014700 1 -- 172.21.15.76:0/330672922 shutdown_connections 2024-06-02T04:43:29.539 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:29.537+0000 7f1a17014700 1 -- 172.21.15.76:0/330672922 wait complete. 2024-06-02T04:43:29.910 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 60ab6d30-209a-11ef-bc9b-c7b262605968 -- ceph orch host ls --format=json 2024-06-02T04:43:30.125 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T04:43:30.907 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:30 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:30.907 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:30 smithi076 ceph-mon[42935]: Added host smithi192 2024-06-02T04:43:30.907 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:30 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:43:30.907 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:30 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:30.907 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:30 smithi076 ceph-mon[42935]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T04:43:30.907 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:30 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:31.076 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:31.076+0000 7f9c4d38f700 1 -- 172.21.15.76:0/668179468 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9c481057c0 msgr2=0x7f9c48105ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:43:31.076 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:31.076+0000 7f9c4d38f700 1 --2- 172.21.15.76:0/668179468 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9c481057c0 0x7f9c48105ba0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9c38009910 tx=0x7f9c38009c20 comp rx=0 tx=0).stop 2024-06-02T04:43:31.077 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:31.076+0000 7f9c4d38f700 1 -- 172.21.15.76:0/668179468 shutdown_connections 2024-06-02T04:43:31.077 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:31.076+0000 7f9c4d38f700 1 --2- 172.21.15.76:0/668179468 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9c481057c0 0x7f9c48105ba0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:43:31.077 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:31.076+0000 7f9c4d38f700 1 -- 172.21.15.76:0/668179468 >> 172.21.15.76:0/668179468 conn(0x7f9c480fb310 msgr2=0x7f9c480fd730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:43:31.077 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:31.076+0000 7f9c4d38f700 1 -- 172.21.15.76:0/668179468 shutdown_connections 2024-06-02T04:43:31.077 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:31.076+0000 7f9c4d38f700 1 -- 172.21.15.76:0/668179468 wait complete. 2024-06-02T04:43:31.079 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:31.077+0000 7f9c4d38f700 1 Processor -- start 2024-06-02T04:43:31.079 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:31.077+0000 7f9c4d38f700 1 -- start start 2024-06-02T04:43:31.079 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:31.077+0000 7f9c4d38f700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9c481057c0 0x7f9c48194f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:43:31.079 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:31.077+0000 7f9c4d38f700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c481954d0 con 0x7f9c481057c0 2024-06-02T04:43:31.079 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:31.077+0000 7f9c46ffd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9c481057c0 0x7f9c48194f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:43:31.079 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:31.077+0000 7f9c46ffd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9c481057c0 0x7f9c48194f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:45058/0 (socket says 172.21.15.76:45058) 2024-06-02T04:43:31.079 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:31.077+0000 7f9c46ffd700 1 -- 172.21.15.76:0/4011856077 learned_addr learned my addr 172.21.15.76:0/4011856077 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:43:31.079 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:31.078+0000 7f9c46ffd700 1 -- 172.21.15.76:0/4011856077 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c380095f0 con 0x7f9c481057c0 2024-06-02T04:43:31.080 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:31.078+0000 7f9c46ffd700 1 --2- 172.21.15.76:0/4011856077 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9c481057c0 0x7f9c48194f90 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9c38005660 tx=0x7f9c38005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:43:31.080 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:31.078+0000 7f9c2ffff700 1 -- 172.21.15.76:0/4011856077 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9c3801d070 con 0x7f9c481057c0 2024-06-02T04:43:31.080 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:31.078+0000 7f9c2ffff700 1 -- 172.21.15.76:0/4011856077 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9c3800b6f0 con 0x7f9c481057c0 2024-06-02T04:43:31.080 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:31.078+0000 7f9c4d38f700 1 -- 172.21.15.76:0/4011856077 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c48195730 con 0x7f9c481057c0 2024-06-02T04:43:31.080 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:31.078+0000 7f9c2ffff700 1 -- 172.21.15.76:0/4011856077 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9c380037f0 con 0x7f9c481057c0 2024-06-02T04:43:31.080 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:31.078+0000 7f9c4d38f700 1 -- 172.21.15.76:0/4011856077 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c48195bb0 con 0x7f9c481057c0 2024-06-02T04:43:31.080 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:31.079+0000 7f9c4d38f700 1 -- 172.21.15.76:0/4011856077 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c48100f00 con 0x7f9c481057c0 2024-06-02T04:43:31.081 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:31.079+0000 7f9c2ffff700 1 -- 172.21.15.76:0/4011856077 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7f9c3800b860 con 0x7f9c481057c0 2024-06-02T04:43:31.081 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:31.080+0000 7f9c2ffff700 1 --2- 172.21.15.76:0/4011856077 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f9c300387a0 0x7f9c3003ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:43:31.081 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:31.080+0000 7f9c2ffff700 1 -- 172.21.15.76:0/4011856077 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f9c3804c820 con 0x7f9c481057c0 2024-06-02T04:43:31.081 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:31.080+0000 7f9c467fc700 1 --2- 172.21.15.76:0/4011856077 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f9c300387a0 0x7f9c3003ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:43:31.081 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:31.080+0000 7f9c467fc700 1 --2- 172.21.15.76:0/4011856077 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f9c300387a0 0x7f9c3003ac60 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c006fd0 tx=0x7f9c3c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:43:31.084 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:31.084+0000 7f9c2ffff700 1 -- 172.21.15.76:0/4011856077 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f9c3800ebd0 con 0x7f9c481057c0 2024-06-02T04:43:31.280 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:31.280+0000 7f9c4d38f700 1 -- 172.21.15.76:0/4011856077 --> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9c48109970 con 0x7f9c300387a0 2024-06-02T04:43:31.281 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:31.282+0000 7f9c2ffff700 1 -- 172.21.15.76:0/4011856077 <== mgr.14152 v2:172.21.15.76:6800/2591353090 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+240 (secure 0 0 0) 0x7f9c48109970 con 0x7f9c300387a0 2024-06-02T04:43:31.282 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:43:31.282 INFO:teuthology.orchestra.run.smithi076.stdout:[{"addr": "172.21.15.76", "hostname": "smithi076", "labels": [], "status": ""}, {"addr": "172.21.15.119", "hostname": "smithi119", "labels": [], "status": ""}, {"addr": "172.21.15.192", "hostname": "smithi192", "labels": [], "status": ""}] 2024-06-02T04:43:31.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:31.284+0000 7f9c4d38f700 1 -- 172.21.15.76:0/4011856077 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f9c300387a0 msgr2=0x7f9c3003ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:43:31.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:31.284+0000 7f9c4d38f700 1 --2- 172.21.15.76:0/4011856077 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f9c300387a0 0x7f9c3003ac60 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c006fd0 tx=0x7f9c3c006e40 comp rx=0 tx=0).stop 2024-06-02T04:43:31.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:31.284+0000 7f9c4d38f700 1 -- 172.21.15.76:0/4011856077 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9c481057c0 msgr2=0x7f9c48194f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:43:31.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:31.284+0000 7f9c4d38f700 1 --2- 172.21.15.76:0/4011856077 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9c481057c0 0x7f9c48194f90 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9c38005660 tx=0x7f9c38005740 comp rx=0 tx=0).stop 2024-06-02T04:43:31.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:31.284+0000 7f9c4d38f700 1 -- 172.21.15.76:0/4011856077 shutdown_connections 2024-06-02T04:43:31.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:31.284+0000 7f9c4d38f700 1 --2- 172.21.15.76:0/4011856077 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f9c300387a0 0x7f9c3003ac60 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:43:31.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:31.284+0000 7f9c4d38f700 1 --2- 172.21.15.76:0/4011856077 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9c481057c0 0x7f9c48194f90 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:43:31.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:31.284+0000 7f9c4d38f700 1 -- 172.21.15.76:0/4011856077 >> 172.21.15.76:0/4011856077 conn(0x7f9c480fb310 msgr2=0x7f9c48107500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:43:31.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:31.284+0000 7f9c4d38f700 1 -- 172.21.15.76:0/4011856077 shutdown_connections 2024-06-02T04:43:31.285 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:31.284+0000 7f9c4d38f700 1 -- 172.21.15.76:0/4011856077 wait complete. 2024-06-02T04:43:31.695 INFO:tasks.cephadm:Setting crush tunables to default 2024-06-02T04:43:31.695 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 60ab6d30-209a-11ef-bc9b-c7b262605968 -- ceph osd crush tunables default 2024-06-02T04:43:31.911 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T04:43:32.160 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:31 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:32.160 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:31 smithi076 ceph-mon[42935]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-02T04:43:32.927 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:32.926+0000 7f04267bd700 1 -- 172.21.15.76:0/3879248234 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f04201068c0 msgr2=0x7f0420106ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:43:32.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:32.926+0000 7f04267bd700 1 --2- 172.21.15.76:0/3879248234 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f04201068c0 0x7f0420106ca0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0410009910 tx=0x7f0410009c20 comp rx=0 tx=0).stop 2024-06-02T04:43:32.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:32.926+0000 7f04267bd700 1 -- 172.21.15.76:0/3879248234 shutdown_connections 2024-06-02T04:43:32.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:32.926+0000 7f04267bd700 1 --2- 172.21.15.76:0/3879248234 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f04201068c0 0x7f0420106ca0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:43:32.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:32.926+0000 7f04267bd700 1 -- 172.21.15.76:0/3879248234 >> 172.21.15.76:0/3879248234 conn(0x7f04200fc3f0 msgr2=0x7f04200fe810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:43:32.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:32.926+0000 7f04267bd700 1 -- 172.21.15.76:0/3879248234 shutdown_connections 2024-06-02T04:43:32.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:32.926+0000 7f04267bd700 1 -- 172.21.15.76:0/3879248234 wait complete. 2024-06-02T04:43:32.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:32.927+0000 7f04267bd700 1 Processor -- start 2024-06-02T04:43:32.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:32.927+0000 7f04267bd700 1 -- start start 2024-06-02T04:43:32.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:32.927+0000 7f04267bd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f04201068c0 0x7f0420196120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:43:32.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:32.927+0000 7f04267bd700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0420196660 con 0x7f04201068c0 2024-06-02T04:43:32.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:32.927+0000 7f041ffff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f04201068c0 0x7f0420196120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:43:32.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:32.927+0000 7f041ffff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f04201068c0 0x7f0420196120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:41108/0 (socket says 172.21.15.76:41108) 2024-06-02T04:43:32.929 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:32.927+0000 7f041ffff700 1 -- 172.21.15.76:0/1011484839 learned_addr learned my addr 172.21.15.76:0/1011484839 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:43:32.929 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:32.928+0000 7f041ffff700 1 -- 172.21.15.76:0/1011484839 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04100095f0 con 0x7f04201068c0 2024-06-02T04:43:32.929 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:32.928+0000 7f041ffff700 1 --2- 172.21.15.76:0/1011484839 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f04201068c0 0x7f0420196120 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0410005660 tx=0x7f0410005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:43:32.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:32.928+0000 7f041dffb700 1 -- 172.21.15.76:0/1011484839 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f041001d070 con 0x7f04201068c0 2024-06-02T04:43:32.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:32.928+0000 7f041dffb700 1 -- 172.21.15.76:0/1011484839 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f041000b6f0 con 0x7f04201068c0 2024-06-02T04:43:32.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:32.928+0000 7f04267bd700 1 -- 172.21.15.76:0/1011484839 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04201968c0 con 0x7f04201068c0 2024-06-02T04:43:32.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:32.928+0000 7f041dffb700 1 -- 172.21.15.76:0/1011484839 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f04100037f0 con 0x7f04201068c0 2024-06-02T04:43:32.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:32.928+0000 7f04267bd700 1 -- 172.21.15.76:0/1011484839 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0420196d40 con 0x7f04201068c0 2024-06-02T04:43:32.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:32.929+0000 7f041dffb700 1 -- 172.21.15.76:0/1011484839 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7f0410003ab0 con 0x7f04201068c0 2024-06-02T04:43:32.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:32.929+0000 7f041dffb700 1 --2- 172.21.15.76:0/1011484839 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f040c0387a0 0x7f040c03ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:43:32.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:32.929+0000 7f041dffb700 1 -- 172.21.15.76:0/1011484839 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f041004c480 con 0x7f04201068c0 2024-06-02T04:43:32.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:32.929+0000 7f04267bd700 1 -- 172.21.15.76:0/1011484839 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0420102000 con 0x7f04201068c0 2024-06-02T04:43:32.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:32.929+0000 7f0417fff700 1 --2- 172.21.15.76:0/1011484839 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f040c0387a0 0x7f040c03ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:43:32.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:32.929+0000 7f0417fff700 1 --2- 172.21.15.76:0/1011484839 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f040c0387a0 0x7f040c03ac60 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f0408006fd0 tx=0x7f0408006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:43:32.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:32.934+0000 7f041dffb700 1 -- 172.21.15.76:0/1011484839 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f0410026020 con 0x7f04201068c0 2024-06-02T04:43:33.131 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:33.131+0000 7f04267bd700 1 -- 172.21.15.76:0/1011484839 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f0420197460 con 0x7f04201068c0 2024-06-02T04:43:33.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:32 smithi076 ceph-mon[42935]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T04:43:33.891 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:33.891+0000 7f041dffb700 1 -- 172.21.15.76:0/1011484839 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7f0410029360 con 0x7f04201068c0 2024-06-02T04:43:33.894 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:33.893+0000 7f04267bd700 1 -- 172.21.15.76:0/1011484839 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f040c0387a0 msgr2=0x7f040c03ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:43:33.894 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:33.893+0000 7f04267bd700 1 --2- 172.21.15.76:0/1011484839 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f040c0387a0 0x7f040c03ac60 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f0408006fd0 tx=0x7f0408006e40 comp rx=0 tx=0).stop 2024-06-02T04:43:33.894 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:33.893+0000 7f04267bd700 1 -- 172.21.15.76:0/1011484839 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f04201068c0 msgr2=0x7f0420196120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:43:33.894 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:33.893+0000 7f04267bd700 1 --2- 172.21.15.76:0/1011484839 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f04201068c0 0x7f0420196120 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0410005660 tx=0x7f0410005740 comp rx=0 tx=0).stop 2024-06-02T04:43:33.894 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:33.894+0000 7f04267bd700 1 -- 172.21.15.76:0/1011484839 shutdown_connections 2024-06-02T04:43:33.894 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:33.894+0000 7f04267bd700 1 --2- 172.21.15.76:0/1011484839 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f040c0387a0 0x7f040c03ac60 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:43:33.894 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:33.894+0000 7f04267bd700 1 --2- 172.21.15.76:0/1011484839 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f04201068c0 0x7f0420196120 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:43:33.894 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:33.894+0000 7f04267bd700 1 -- 172.21.15.76:0/1011484839 >> 172.21.15.76:0/1011484839 conn(0x7f04200fc3f0 msgr2=0x7f0420108550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:43:33.894 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:33.894+0000 7f04267bd700 1 -- 172.21.15.76:0/1011484839 shutdown_connections 2024-06-02T04:43:33.894 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:33.894+0000 7f04267bd700 1 -- 172.21.15.76:0/1011484839 wait complete. 2024-06-02T04:43:33.895 INFO:teuthology.orchestra.run.smithi076.stderr:adjusted tunables profile to default 2024-06-02T04:43:34.218 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:33 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/1011484839' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-06-02T04:43:34.218 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:33 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:34.218 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:33 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:34.218 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:33 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:34.218 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:33 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:34.218 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:33 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi192", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:43:34.218 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:33 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:43:34.219 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:33 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:43:34.219 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:33 smithi076 ceph-mon[42935]: Updating smithi192:/etc/ceph/ceph.conf 2024-06-02T04:43:34.318 INFO:tasks.cephadm:Adding mon.a on smithi076 2024-06-02T04:43:34.319 INFO:tasks.cephadm:Adding mon.b on smithi119 2024-06-02T04:43:34.319 INFO:tasks.cephadm:Adding mon.c on smithi192 2024-06-02T04:43:34.319 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 60ab6d30-209a-11ef-bc9b-c7b262605968 -- ceph orch apply mon '3;smithi076:172.21.15.76=a;smithi119:172.21.15.119=b;smithi192:172.21.15.192=c' 2024-06-02T04:43:34.572 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-02T04:43:35.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:34 smithi076 ceph-mon[42935]: Updating smithi192:/var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-02T04:43:35.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:34 smithi076 ceph-mon[42935]: Updating smithi192:/etc/ceph/ceph.client.admin.keyring 2024-06-02T04:43:35.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:34 smithi076 ceph-mon[42935]: Updating smithi192:/var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/config/ceph.client.admin.keyring 2024-06-02T04:43:35.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:34 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/1011484839' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-06-02T04:43:35.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:34 smithi076 ceph-mon[42935]: osdmap e4: 0 total, 0 up, 0 in 2024-06-02T04:43:35.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:34 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:35.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:34 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:35.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:34 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:35.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:34 smithi076 ceph-mon[42935]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T04:43:35.478 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:35.478+0000 7f5897986700 1 -- 172.21.15.192:0/3009072730 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5890106900 msgr2=0x7f5890106ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:43:35.482 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:35.478+0000 7f5897986700 1 --2- 172.21.15.192:0/3009072730 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5890106900 0x7f5890106ce0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5884009910 tx=0x7f5884009c20 comp rx=0 tx=0).stop 2024-06-02T04:43:35.482 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:35.478+0000 7f5897986700 1 -- 172.21.15.192:0/3009072730 shutdown_connections 2024-06-02T04:43:35.482 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:35.478+0000 7f5897986700 1 --2- 172.21.15.192:0/3009072730 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5890106900 0x7f5890106ce0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:43:35.482 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:35.478+0000 7f5897986700 1 -- 172.21.15.192:0/3009072730 >> 172.21.15.192:0/3009072730 conn(0x7f58900fc410 msgr2=0x7f58900fe830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:43:35.482 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:35.478+0000 7f5897986700 1 -- 172.21.15.192:0/3009072730 shutdown_connections 2024-06-02T04:43:35.482 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:35.478+0000 7f5897986700 1 -- 172.21.15.192:0/3009072730 wait complete. 2024-06-02T04:43:35.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:35.479+0000 7f5897986700 1 Processor -- start 2024-06-02T04:43:35.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:35.479+0000 7f5897986700 1 -- start start 2024-06-02T04:43:35.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:35.479+0000 7f5897986700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5890106900 0x7f58901960f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:43:35.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:35.479+0000 7f5897986700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5890196630 con 0x7f5890106900 2024-06-02T04:43:35.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:35.479+0000 7f5895722700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5890106900 0x7f58901960f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:43:35.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:35.479+0000 7f5895722700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5890106900 0x7f58901960f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.192:43552/0 (socket says 172.21.15.192:43552) 2024-06-02T04:43:35.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:35.479+0000 7f5895722700 1 -- 172.21.15.192:0/3468391500 learned_addr learned my addr 172.21.15.192:0/3468391500 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-06-02T04:43:35.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:35.480+0000 7f5895722700 1 -- 172.21.15.192:0/3468391500 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58840095f0 con 0x7f5890106900 2024-06-02T04:43:35.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:35.480+0000 7f5895722700 1 --2- 172.21.15.192:0/3468391500 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5890106900 0x7f58901960f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f58840098e0 tx=0x7f5884005710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:43:35.485 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:35.480+0000 7f58827fc700 1 -- 172.21.15.192:0/3468391500 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f588401d070 con 0x7f5890106900 2024-06-02T04:43:35.485 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:35.480+0000 7f5897986700 1 -- 172.21.15.192:0/3468391500 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5890196890 con 0x7f5890106900 2024-06-02T04:43:35.485 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:35.480+0000 7f58827fc700 1 -- 172.21.15.192:0/3468391500 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5884009e60 con 0x7f5890106900 2024-06-02T04:43:35.485 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:35.480+0000 7f58827fc700 1 -- 172.21.15.192:0/3468391500 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5884022b30 con 0x7f5890106900 2024-06-02T04:43:35.485 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:35.480+0000 7f5897986700 1 -- 172.21.15.192:0/3468391500 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5890196d10 con 0x7f5890106900 2024-06-02T04:43:35.485 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:35.481+0000 7f58827fc700 1 -- 172.21.15.192:0/3468391500 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7f588400f460 con 0x7f5890106900 2024-06-02T04:43:35.485 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:35.481+0000 7f5897986700 1 -- 172.21.15.192:0/3468391500 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5890102040 con 0x7f5890106900 2024-06-02T04:43:35.485 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:35.481+0000 7f58827fc700 1 --2- 172.21.15.192:0/3468391500 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f587c0387a0 0x7f587c03ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:43:35.485 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:35.481+0000 7f58827fc700 1 -- 172.21.15.192:0/3468391500 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f588404cbf0 con 0x7f5890106900 2024-06-02T04:43:35.485 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:35.482+0000 7f5894f21700 1 --2- 172.21.15.192:0/3468391500 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f587c0387a0 0x7f587c03ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:43:35.485 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:35.482+0000 7f5894f21700 1 --2- 172.21.15.192:0/3468391500 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f587c0387a0 0x7f587c03ac60 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f588c006fd0 tx=0x7f588c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:43:35.487 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:35.487+0000 7f58827fc700 1 -- 172.21.15.192:0/3468391500 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f5884020960 con 0x7f5890106900 2024-06-02T04:43:35.690 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:35.688+0000 7f5897986700 1 -- 172.21.15.192:0/3468391500 --> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi076:172.21.15.76=a;smithi119:172.21.15.119=b;smithi192:172.21.15.192=c", "target": ["mon-mgr", ""]}) v1 -- 0x7f589010ab70 con 0x7f587c0387a0 2024-06-02T04:43:35.695 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:35.695+0000 7f58827fc700 1 -- 172.21.15.192:0/3468391500 <== mgr.14152 v2:172.21.15.76:6800/2591353090 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f589010ab70 con 0x7f587c0387a0 2024-06-02T04:43:35.696 INFO:teuthology.orchestra.run.smithi192.stdout:Scheduled mon update... 2024-06-02T04:43:35.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:35.697+0000 7f5897986700 1 -- 172.21.15.192:0/3468391500 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f587c0387a0 msgr2=0x7f587c03ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:43:35.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:35.697+0000 7f5897986700 1 --2- 172.21.15.192:0/3468391500 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f587c0387a0 0x7f587c03ac60 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f588c006fd0 tx=0x7f588c006e40 comp rx=0 tx=0).stop 2024-06-02T04:43:35.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:35.697+0000 7f5897986700 1 -- 172.21.15.192:0/3468391500 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5890106900 msgr2=0x7f58901960f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:43:35.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:35.697+0000 7f5897986700 1 --2- 172.21.15.192:0/3468391500 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5890106900 0x7f58901960f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f58840098e0 tx=0x7f5884005710 comp rx=0 tx=0).stop 2024-06-02T04:43:35.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:35.697+0000 7f5897986700 1 -- 172.21.15.192:0/3468391500 shutdown_connections 2024-06-02T04:43:35.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:35.697+0000 7f5897986700 1 --2- 172.21.15.192:0/3468391500 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f587c0387a0 0x7f587c03ac60 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:43:35.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:35.697+0000 7f5897986700 1 --2- 172.21.15.192:0/3468391500 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5890106900 0x7f58901960f0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:43:35.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:35.698+0000 7f5897986700 1 -- 172.21.15.192:0/3468391500 >> 172.21.15.192:0/3468391500 conn(0x7f58900fc410 msgr2=0x7f5890108630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:43:35.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:35.698+0000 7f5897986700 1 -- 172.21.15.192:0/3468391500 shutdown_connections 2024-06-02T04:43:35.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:35.698+0000 7f5897986700 1 -- 172.21.15.192:0/3468391500 wait complete. 2024-06-02T04:43:36.084 DEBUG:teuthology.orchestra.run.smithi119:mon.b> sudo journalctl -f -n 0 -u ceph-60ab6d30-209a-11ef-bc9b-c7b262605968@mon.b.service 2024-06-02T04:43:36.087 DEBUG:teuthology.orchestra.run.smithi192:mon.c> sudo journalctl -f -n 0 -u ceph-60ab6d30-209a-11ef-bc9b-c7b262605968@mon.c.service 2024-06-02T04:43:36.089 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-06-02T04:43:36.090 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 60ab6d30-209a-11ef-bc9b-c7b262605968 -- ceph mon dump -f json 2024-06-02T04:43:36.120 INFO:journalctl@ceph.mon.c.smithi192.stdout:-- Logs begin at Sun 2024-06-02 04:25:37 UTC. -- 2024-06-02T04:43:36.123 INFO:journalctl@ceph.mon.b.smithi119.stdout:-- Logs begin at Sun 2024-06-02 04:25:42 UTC. -- 2024-06-02T04:43:36.403 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-02T04:43:36.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:36 smithi076 ceph-mon[42935]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi076:172.21.15.76=a;smithi119:172.21.15.119=b;smithi192:172.21.15.192=c", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:43:36.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:36 smithi076 ceph-mon[42935]: Saving service mon spec with placement smithi076:172.21.15.76=a;smithi119:172.21.15.119=b;smithi192:172.21.15.192=c;count:3 2024-06-02T04:43:36.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:36 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:36.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:36 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:43:36.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:36 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:43:36.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:36 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:43:36.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:36 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:36.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:36 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-02T04:43:36.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:36 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:43:36.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:36 smithi076 ceph-mon[42935]: Deploying daemon mon.c on smithi192 2024-06-02T04:43:36.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:36 smithi076 ceph-mon[42935]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T04:43:37.943 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:37.942+0000 7f77acb3c700 1 -- 172.21.15.192:0/3727006342 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f77a8101a90 msgr2=0x7f77a8101e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:43:37.943 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:37.942+0000 7f77acb3c700 1 --2- 172.21.15.192:0/3727006342 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f77a8101a90 0x7f77a8101e70 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7798009910 tx=0x7f7798009c20 comp rx=0 tx=0).stop 2024-06-02T04:43:37.944 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:37.942+0000 7f77acb3c700 1 -- 172.21.15.192:0/3727006342 shutdown_connections 2024-06-02T04:43:37.944 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:37.942+0000 7f77acb3c700 1 --2- 172.21.15.192:0/3727006342 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f77a8101a90 0x7f77a8101e70 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:43:37.944 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:37.942+0000 7f77acb3c700 1 -- 172.21.15.192:0/3727006342 >> 172.21.15.192:0/3727006342 conn(0x7f77a80fb300 msgr2=0x7f77a80fd720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:43:37.944 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:37.942+0000 7f77acb3c700 1 -- 172.21.15.192:0/3727006342 shutdown_connections 2024-06-02T04:43:37.944 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:37.942+0000 7f77acb3c700 1 -- 172.21.15.192:0/3727006342 wait complete. 2024-06-02T04:43:37.944 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:37.943+0000 7f77acb3c700 1 Processor -- start 2024-06-02T04:43:37.944 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:37.943+0000 7f77acb3c700 1 -- start start 2024-06-02T04:43:37.944 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:37.943+0000 7f77acb3c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f77a8101a90 0x7f77a8196110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:43:37.944 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:37.943+0000 7f77acb3c700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77a8196650 con 0x7f77a8101a90 2024-06-02T04:43:37.944 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:37.943+0000 7f77a659c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f77a8101a90 0x7f77a8196110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:43:37.944 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:37.943+0000 7f77a659c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f77a8101a90 0x7f77a8196110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.192:42346/0 (socket says 172.21.15.192:42346) 2024-06-02T04:43:37.944 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:37.943+0000 7f77a659c700 1 -- 172.21.15.192:0/3919156848 learned_addr learned my addr 172.21.15.192:0/3919156848 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-06-02T04:43:37.946 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:37.943+0000 7f77a659c700 1 -- 172.21.15.192:0/3919156848 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77980095f0 con 0x7f77a8101a90 2024-06-02T04:43:37.946 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:37.944+0000 7f77a659c700 1 --2- 172.21.15.192:0/3919156848 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f77a8101a90 0x7f77a8196110 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f77980055f0 tx=0x7f77980056d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:43:37.946 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:37.944+0000 7f77977fe700 1 -- 172.21.15.192:0/3919156848 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f779801d070 con 0x7f77a8101a90 2024-06-02T04:43:37.946 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:37.944+0000 7f77977fe700 1 -- 172.21.15.192:0/3919156848 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f779800b750 con 0x7f77a8101a90 2024-06-02T04:43:37.946 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:37.944+0000 7f77977fe700 1 -- 172.21.15.192:0/3919156848 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f77980037b0 con 0x7f77a8101a90 2024-06-02T04:43:37.946 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:37.944+0000 7f77acb3c700 1 -- 172.21.15.192:0/3919156848 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77a8196850 con 0x7f77a8101a90 2024-06-02T04:43:37.946 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:37.944+0000 7f77acb3c700 1 -- 172.21.15.192:0/3919156848 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77a8196c70 con 0x7f77a8101a90 2024-06-02T04:43:37.947 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:37.945+0000 7f77977fe700 1 -- 172.21.15.192:0/3919156848 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7f7798003a20 con 0x7f77a8101a90 2024-06-02T04:43:37.947 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:37.945+0000 7f77977fe700 1 --2- 172.21.15.192:0/3919156848 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f77900387f0 0x7f779003acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:43:37.947 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:37.945+0000 7f77acb3c700 1 -- 172.21.15.192:0/3919156848 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77a8107c30 con 0x7f77a8101a90 2024-06-02T04:43:37.947 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:37.945+0000 7f77977fe700 1 -- 172.21.15.192:0/3919156848 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f779804c490 con 0x7f77a8101a90 2024-06-02T04:43:37.947 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:37.945+0000 7f77a5d9b700 1 --2- 172.21.15.192:0/3919156848 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f77900387f0 0x7f779003acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:43:37.947 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:37.946+0000 7f77a5d9b700 1 --2- 172.21.15.192:0/3919156848 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f77900387f0 0x7f779003acb0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f779c006fd0 tx=0x7f779c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:43:37.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:37.951+0000 7f77977fe700 1 -- 172.21.15.192:0/3919156848 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f7798026070 con 0x7f77a8101a90 2024-06-02T04:43:38.253 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:38.251+0000 7f77acb3c700 1 -- 172.21.15.192:0/3919156848 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f77a8197530 con 0x7f77a8101a90 2024-06-02T04:43:38.253 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:38.252+0000 7f77977fe700 1 -- 172.21.15.192:0/3919156848 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+736 (secure 0 0 0) 0x7f7798029360 con 0x7f77a8101a90 2024-06-02T04:43:38.253 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-06-02T04:43:38.253 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":1,"fsid":"60ab6d30-209a-11ef-bc9b-c7b262605968","modified":"2024-06-02T04:42:18.974755Z","created":"2024-06-02T04:42:18.974755Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:3300","nonce":0},{"type":"v1","addr":"172.21.15.76:6789","nonce":0}]},"addr":"172.21.15.76:6789/0","public_addr":"172.21.15.76:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-06-02T04:43:38.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:38.255+0000 7f77acb3c700 1 -- 172.21.15.192:0/3919156848 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f77900387f0 msgr2=0x7f779003acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:43:38.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:38.255+0000 7f77acb3c700 1 --2- 172.21.15.192:0/3919156848 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f77900387f0 0x7f779003acb0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f779c006fd0 tx=0x7f779c006e40 comp rx=0 tx=0).stop 2024-06-02T04:43:38.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:38.255+0000 7f77acb3c700 1 -- 172.21.15.192:0/3919156848 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f77a8101a90 msgr2=0x7f77a8196110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:43:38.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:38.255+0000 7f77acb3c700 1 --2- 172.21.15.192:0/3919156848 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f77a8101a90 0x7f77a8196110 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f77980055f0 tx=0x7f77980056d0 comp rx=0 tx=0).stop 2024-06-02T04:43:38.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:38.255+0000 7f77acb3c700 1 -- 172.21.15.192:0/3919156848 shutdown_connections 2024-06-02T04:43:38.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:38.255+0000 7f77acb3c700 1 --2- 172.21.15.192:0/3919156848 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f77900387f0 0x7f779003acb0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:43:38.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:38.255+0000 7f77acb3c700 1 --2- 172.21.15.192:0/3919156848 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f77a8101a90 0x7f77a8196110 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:43:38.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:38.255+0000 7f77acb3c700 1 -- 172.21.15.192:0/3919156848 >> 172.21.15.192:0/3919156848 conn(0x7f77a80fb300 msgr2=0x7f77a8104850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:43:38.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:38.255+0000 7f77acb3c700 1 -- 172.21.15.192:0/3919156848 shutdown_connections 2024-06-02T04:43:38.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:38.255+0000 7f77acb3c700 1 -- 172.21.15.192:0/3919156848 wait complete. 2024-06-02T04:43:38.257 INFO:teuthology.orchestra.run.smithi192.stderr:dumped monmap epoch 1 2024-06-02T04:43:38.781 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:38 smithi192 systemd[1]: Started Ceph mon.c for 60ab6d30-209a-11ef-bc9b-c7b262605968. 2024-06-02T04:43:38.781 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:38 smithi192 ceph-mon[47933]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-06-02T04:43:38.781 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:38 smithi192 ceph-mon[47933]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-06-02T04:43:38.781 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:38 smithi192 ceph-mon[47933]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: c8e091ad-7766-4530-83bb-33adae6a6911 2024-06-02T04:43:38.781 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:38 smithi192 ceph-mon[47933]: rocksdb: EVENT_LOG_v1 {"time_micros": 1717303418760233, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-06-02T04:43:38.781 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:38 smithi192 ceph-mon[47933]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-06-02T04:43:38.781 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:38 smithi192 ceph-mon[47933]: rocksdb: EVENT_LOG_v1 {"time_micros": 1717303418760847, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1622, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1717303418, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "c8e091ad-7766-4530-83bb-33adae6a6911", "db_session_id": "31E4LG10GTEVJTW5QJ0S", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-06-02T04:43:38.781 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:38 smithi192 ceph-mon[47933]: rocksdb: EVENT_LOG_v1 {"time_micros": 1717303418760935, "job": 1, "event": "recovery_finished"} 2024-06-02T04:43:38.781 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:38 smithi192 ceph-mon[47933]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-06-02T04:43:38.782 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:38 smithi192 ceph-mon[47933]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-06-02T04:43:38.782 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:38 smithi192 ceph-mon[47933]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5580af38a000 2024-06-02T04:43:38.782 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:38 smithi192 ceph-mon[47933]: rocksdb: DB pointer 0x5580af378000 2024-06-02T04:43:38.782 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:38 smithi192 ceph-mon[47933]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-06-02T04:43:38.782 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:38 smithi192 ceph-mon[47933]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-06-02T04:43:38.782 INFO:journalctl@ceph.mon.c.smithi192.stdout: ** DB Stats ** 2024-06-02T04:43:38.782 INFO:journalctl@ceph.mon.c.smithi192.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-06-02T04:43:38.782 INFO:journalctl@ceph.mon.c.smithi192.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-06-02T04:43:38.782 INFO:journalctl@ceph.mon.c.smithi192.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-06-02T04:43:38.782 INFO:journalctl@ceph.mon.c.smithi192.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-06-02T04:43:38.782 INFO:journalctl@ceph.mon.c.smithi192.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-06-02T04:43:38.782 INFO:journalctl@ceph.mon.c.smithi192.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-06-02T04:43:38.783 INFO:journalctl@ceph.mon.c.smithi192.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-06-02T04:43:38.783 INFO:journalctl@ceph.mon.c.smithi192.stdout: 2024-06-02T04:43:38.783 INFO:journalctl@ceph.mon.c.smithi192.stdout: ** Compaction Stats [default] ** 2024-06-02T04:43:38.783 INFO:journalctl@ceph.mon.c.smithi192.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-06-02T04:43:38.783 INFO:journalctl@ceph.mon.c.smithi192.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-06-02T04:43:38.783 INFO:journalctl@ceph.mon.c.smithi192.stdout: L0 1/0 1.58 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-06-02T04:43:38.783 INFO:journalctl@ceph.mon.c.smithi192.stdout: Sum 1/0 1.58 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-06-02T04:43:38.783 INFO:journalctl@ceph.mon.c.smithi192.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-06-02T04:43:38.783 INFO:journalctl@ceph.mon.c.smithi192.stdout: 2024-06-02T04:43:38.783 INFO:journalctl@ceph.mon.c.smithi192.stdout: ** Compaction Stats [default] ** 2024-06-02T04:43:38.783 INFO:journalctl@ceph.mon.c.smithi192.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-06-02T04:43:38.783 INFO:journalctl@ceph.mon.c.smithi192.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-06-02T04:43:38.783 INFO:journalctl@ceph.mon.c.smithi192.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-06-02T04:43:38.784 INFO:journalctl@ceph.mon.c.smithi192.stdout: 2024-06-02T04:43:38.784 INFO:journalctl@ceph.mon.c.smithi192.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-06-02T04:43:38.784 INFO:journalctl@ceph.mon.c.smithi192.stdout: 2024-06-02T04:43:38.784 INFO:journalctl@ceph.mon.c.smithi192.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-06-02T04:43:38.784 INFO:journalctl@ceph.mon.c.smithi192.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-06-02T04:43:38.784 INFO:journalctl@ceph.mon.c.smithi192.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-06-02T04:43:38.784 INFO:journalctl@ceph.mon.c.smithi192.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-06-02T04:43:38.784 INFO:journalctl@ceph.mon.c.smithi192.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-06-02T04:43:38.784 INFO:journalctl@ceph.mon.c.smithi192.stdout: AddFile(Keys): cumulative 0, interval 0 2024-06-02T04:43:38.784 INFO:journalctl@ceph.mon.c.smithi192.stdout: Cumulative compaction: 0.00 GB write, 0.53 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-06-02T04:43:38.784 INFO:journalctl@ceph.mon.c.smithi192.stdout: Interval compaction: 0.00 GB write, 0.53 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-06-02T04:43:38.784 INFO:journalctl@ceph.mon.c.smithi192.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-06-02T04:43:38.784 INFO:journalctl@ceph.mon.c.smithi192.stdout: Block cache BinnedLRUCache@0x5580af2ed1f0#7 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-06-02T04:43:38.784 INFO:journalctl@ceph.mon.c.smithi192.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-06-02T04:43:38.785 INFO:journalctl@ceph.mon.c.smithi192.stdout: 2024-06-02T04:43:38.785 INFO:journalctl@ceph.mon.c.smithi192.stdout: ** File Read Latency Histogram By Level [default] ** 2024-06-02T04:43:38.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:38 smithi192 ceph-mon[47933]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-06-02T04:43:38.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:38 smithi192 ceph-mon[47933]: using public_addr v2:172.21.15.192:0/0 -> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] 2024-06-02T04:43:38.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:38 smithi192 ceph-mon[47933]: starting mon.c rank -1 at public addrs [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] at bind addrs [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid 60ab6d30-209a-11ef-bc9b-c7b262605968 2024-06-02T04:43:38.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:38 smithi192 ceph-mon[47933]: mon.c@-1(???) e0 preinit fsid 60ab6d30-209a-11ef-bc9b-c7b262605968 2024-06-02T04:43:38.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:38 smithi192 ceph-mon[47933]: mon.c@-1(synchronizing).mds e1 new map 2024-06-02T04:43:38.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:38 smithi192 ceph-mon[47933]: mon.c@-1(synchronizing).mds e1 print_map 2024-06-02T04:43:38.785 INFO:journalctl@ceph.mon.c.smithi192.stdout: e1 2024-06-02T04:43:38.785 INFO:journalctl@ceph.mon.c.smithi192.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-06-02T04:43:38.785 INFO:journalctl@ceph.mon.c.smithi192.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-06-02T04:43:38.785 INFO:journalctl@ceph.mon.c.smithi192.stdout: legacy client fscid: -1 2024-06-02T04:43:38.786 INFO:journalctl@ceph.mon.c.smithi192.stdout: 2024-06-02T04:43:38.786 INFO:journalctl@ceph.mon.c.smithi192.stdout: No filesystems configured 2024-06-02T04:43:38.786 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:38 smithi192 ceph-mon[47933]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-06-02T04:43:38.786 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:38 smithi192 ceph-mon[47933]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-06-02T04:43:38.786 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:38 smithi192 ceph-mon[47933]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-06-02T04:43:38.787 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:38 smithi192 ceph-mon[47933]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-06-02T04:43:38.787 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:38 smithi192 ceph-mon[47933]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-06-02T04:43:38.787 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:38 smithi192 ceph-mon[47933]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-06-02T04:43:38.787 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:38 smithi192 ceph-mon[47933]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-06-02T04:43:38.787 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:38 smithi192 ceph-mon[47933]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-06-02T04:43:38.787 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:38 smithi192 ceph-mon[47933]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-06-02T04:43:38.787 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:38 smithi192 ceph-mon[47933]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-06-02T04:43:38.787 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:38 smithi192 ceph-mon[47933]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T04:43:39.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:38 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/1011484839' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-06-02T04:43:39.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:38 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:39.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:38 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:39.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:38 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:39.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:38 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:39.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:38 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi192", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:43:39.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:38 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:43:39.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:38 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:43:39.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:38 smithi192 ceph-mon[47933]: Updating smithi192:/etc/ceph/ceph.conf 2024-06-02T04:43:39.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:38 smithi192 ceph-mon[47933]: Updating smithi192:/var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-02T04:43:39.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:38 smithi192 ceph-mon[47933]: Updating smithi192:/etc/ceph/ceph.client.admin.keyring 2024-06-02T04:43:39.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:38 smithi192 ceph-mon[47933]: Updating smithi192:/var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/config/ceph.client.admin.keyring 2024-06-02T04:43:39.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:38 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/1011484839' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-06-02T04:43:39.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:38 smithi192 ceph-mon[47933]: osdmap e4: 0 total, 0 up, 0 in 2024-06-02T04:43:39.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:38 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:39.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:38 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:39.183 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:38 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:39.183 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:38 smithi192 ceph-mon[47933]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T04:43:39.183 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:38 smithi192 ceph-mon[47933]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi076:172.21.15.76=a;smithi119:172.21.15.119=b;smithi192:172.21.15.192=c", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:43:39.183 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:38 smithi192 ceph-mon[47933]: Saving service mon spec with placement smithi076:172.21.15.76=a;smithi119:172.21.15.119=b;smithi192:172.21.15.192=c;count:3 2024-06-02T04:43:39.183 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:38 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:39.183 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:38 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:43:39.183 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:38 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:43:39.183 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:38 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:43:39.183 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:38 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:39.183 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:38 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-02T04:43:39.183 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:38 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:43:39.183 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:38 smithi192 ceph-mon[47933]: Deploying daemon mon.c on smithi192 2024-06-02T04:43:39.183 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:38 smithi192 ceph-mon[47933]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T04:43:39.184 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:38 smithi192 ceph-mon[47933]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-06-02T04:43:39.690 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-06-02T04:43:39.690 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 60ab6d30-209a-11ef-bc9b-c7b262605968 -- ceph mon dump -f json 2024-06-02T04:43:39.921 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/mon.c/config 2024-06-02T04:43:43.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:43.883+0000 7f2334a77700 1 -- 172.21.15.192:0/2831755787 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f231c0035c0 msgr2=0x7f231c005a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:43:43.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:43.883+0000 7f2334a77700 1 --2- 172.21.15.192:0/2831755787 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f231c0035c0 0x7f231c005a50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f23300ff830 tx=0x7f231800feb0 comp rx=0 tx=0).stop 2024-06-02T04:43:43.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:43.883+0000 7f2334a77700 1 -- 172.21.15.192:0/2831755787 shutdown_connections 2024-06-02T04:43:43.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:43.883+0000 7f2334a77700 1 --2- 172.21.15.192:0/2831755787 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f231c0035c0 0x7f231c005a50 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:43:43.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:43.883+0000 7f2334a77700 1 -- 172.21.15.192:0/2831755787 >> 172.21.15.192:0/2831755787 conn(0x7f23300fb3f0 msgr2=0x7f23300fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:43:43.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:43.883+0000 7f2334a77700 1 -- 172.21.15.192:0/2831755787 shutdown_connections 2024-06-02T04:43:43.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:43.883+0000 7f2334a77700 1 -- 172.21.15.192:0/2831755787 wait complete. 2024-06-02T04:43:43.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:43.885+0000 7f2334a77700 1 Processor -- start 2024-06-02T04:43:43.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:43.885+0000 7f2334a77700 1 -- start start 2024-06-02T04:43:43.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:43.885+0000 7f2334a77700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f231c0035c0 0x7f2330196270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:43:43.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:43.885+0000 7f2334a77700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f23301967b0 0x7f233019ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:43:43.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:43.885+0000 7f2334a77700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2330196d40 con 0x7f231c0035c0 2024-06-02T04:43:43.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:43.885+0000 7f2334a77700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2330196eb0 con 0x7f23301967b0 2024-06-02T04:43:43.887 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:43.885+0000 7f232dd9b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f23301967b0 0x7f233019ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:43:43.887 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:43.885+0000 7f232dd9b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f23301967b0 0x7f233019ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:40046/0 (socket says 172.21.15.192:40046) 2024-06-02T04:43:43.887 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:43.885+0000 7f232dd9b700 1 -- 172.21.15.192:0/505325184 learned_addr learned my addr 172.21.15.192:0/505325184 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-06-02T04:43:43.887 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:43.885+0000 7f232e59c700 1 --2- 172.21.15.192:0/505325184 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f231c0035c0 0x7f2330196270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:43:43.887 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:43.885+0000 7f232dd9b700 1 -- 172.21.15.192:0/505325184 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f23301967b0 msgr2=0x7f233019ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-06-02T04:43:43.888 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:43.885+0000 7f232dd9b700 1 -- 172.21.15.192:0/505325184 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f23301967b0 msgr2=0x7f233019ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-06-02T04:43:43.888 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:43.885+0000 7f232dd9b700 1 --2- 172.21.15.192:0/505325184 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f23301967b0 0x7f233019ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-06-02T04:43:43.888 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:43.885+0000 7f232dd9b700 1 --2- 172.21.15.192:0/505325184 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f23301967b0 0x7f233019ab60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-06-02T04:43:43.888 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:43.886+0000 7f232e59c700 1 -- 172.21.15.192:0/505325184 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f23301967b0 msgr2=0x7f233019ab60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-02T04:43:43.888 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:43.886+0000 7f232e59c700 1 --2- 172.21.15.192:0/505325184 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f23301967b0 0x7f233019ab60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:43:43.888 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:43.886+0000 7f232e59c700 1 -- 172.21.15.192:0/505325184 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f231800f900 con 0x7f231c0035c0 2024-06-02T04:43:43.888 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:43.886+0000 7f232e59c700 1 --2- 172.21.15.192:0/505325184 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f231c0035c0 0x7f2330196270 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f231800f800 tx=0x7f2318005510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:43:43.888 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:43.886+0000 7f23277fe700 1 -- 172.21.15.192:0/505325184 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7f2318013b00 con 0x7f231c0035c0 2024-06-02T04:43:43.888 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:43.886+0000 7f23277fe700 1 -- 172.21.15.192:0/505325184 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f23180044c0 con 0x7f231c0035c0 2024-06-02T04:43:43.888 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:43.886+0000 7f2334a77700 1 -- 172.21.15.192:0/505325184 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f233019b100 con 0x7f231c0035c0 2024-06-02T04:43:43.888 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:43.886+0000 7f23277fe700 1 -- 172.21.15.192:0/505325184 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7f2318003b00 con 0x7f231c0035c0 2024-06-02T04:43:43.888 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:43.886+0000 7f2334a77700 1 -- 172.21.15.192:0/505325184 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f233019b650 con 0x7f231c0035c0 2024-06-02T04:43:43.889 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:43.887+0000 7f23277fe700 1 -- 172.21.15.192:0/505325184 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7f2318003d00 con 0x7f231c0035c0 2024-06-02T04:43:43.889 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:43.887+0000 7f2334a77700 1 -- 172.21.15.192:0/505325184 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f233018fe30 con 0x7f231c0035c0 2024-06-02T04:43:43.890 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:43.887+0000 7f23277fe700 1 --2- 172.21.15.192:0/505325184 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f23100385e0 0x7f231003aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:43:43.890 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:43.887+0000 7f23277fe700 1 -- 172.21.15.192:0/505325184 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f231804dbe0 con 0x7f231c0035c0 2024-06-02T04:43:43.890 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:43.888+0000 7f232dd9b700 1 --2- 172.21.15.192:0/505325184 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f23100385e0 0x7f231003aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:43:43.890 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:43.888+0000 7f232dd9b700 1 --2- 172.21.15.192:0/505325184 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f23100385e0 0x7f231003aaa0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2320009180 tx=0x7f2320008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:43:43.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:43.893+0000 7f23277fe700 1 -- 172.21.15.192:0/505325184 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f23180107e0 con 0x7f231c0035c0 2024-06-02T04:43:44.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:44.169+0000 7f2334a77700 1 -- 172.21.15.192:0/505325184 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f23300fba70 con 0x7f231c0035c0 2024-06-02T04:43:44.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:44.169+0000 7f23277fe700 1 -- 172.21.15.192:0/505325184 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1006 (secure 0 0 0) 0x7f231801a390 con 0x7f231c0035c0 2024-06-02T04:43:44.170 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-06-02T04:43:44.170 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":2,"fsid":"60ab6d30-209a-11ef-bc9b-c7b262605968","modified":"2024-06-02T04:43:38.789770Z","created":"2024-06-02T04:42:18.974755Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:3300","nonce":0},{"type":"v1","addr":"172.21.15.76:6789","nonce":0}]},"addr":"172.21.15.76:6789/0","public_addr":"172.21.15.76:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:3300","nonce":0},{"type":"v1","addr":"172.21.15.192:6789","nonce":0}]},"addr":"172.21.15.192:6789/0","public_addr":"172.21.15.192:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-06-02T04:43:44.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:44.172+0000 7f2334a77700 1 -- 172.21.15.192:0/505325184 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f23100385e0 msgr2=0x7f231003aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:43:44.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:44.172+0000 7f2334a77700 1 --2- 172.21.15.192:0/505325184 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f23100385e0 0x7f231003aaa0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2320009180 tx=0x7f2320008040 comp rx=0 tx=0).stop 2024-06-02T04:43:44.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:44.172+0000 7f2334a77700 1 -- 172.21.15.192:0/505325184 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f231c0035c0 msgr2=0x7f2330196270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:43:44.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:44.172+0000 7f2334a77700 1 --2- 172.21.15.192:0/505325184 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f231c0035c0 0x7f2330196270 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f231800f800 tx=0x7f2318005510 comp rx=0 tx=0).stop 2024-06-02T04:43:44.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:44.172+0000 7f2334a77700 1 -- 172.21.15.192:0/505325184 shutdown_connections 2024-06-02T04:43:44.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:44.172+0000 7f2334a77700 1 --2- 172.21.15.192:0/505325184 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f23100385e0 0x7f231003aaa0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:43:44.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:44.172+0000 7f2334a77700 1 --2- 172.21.15.192:0/505325184 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f231c0035c0 0x7f2330196270 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:43:44.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:44.172+0000 7f2334a77700 1 --2- 172.21.15.192:0/505325184 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f23301967b0 0x7f233019ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:43:44.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:44.172+0000 7f2334a77700 1 -- 172.21.15.192:0/505325184 >> 172.21.15.192:0/505325184 conn(0x7f23300fb3f0 msgr2=0x7f2330069710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:43:44.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:44.172+0000 7f2334a77700 1 -- 172.21.15.192:0/505325184 shutdown_connections 2024-06-02T04:43:44.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:44.172+0000 7f2334a77700 1 -- 172.21.15.192:0/505325184 wait complete. 2024-06-02T04:43:44.173 INFO:teuthology.orchestra.run.smithi192.stderr:dumped monmap epoch 2 2024-06-02T04:43:44.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:43 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-02T04:43:44.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:43 smithi192 ceph-mon[47933]: mon.a calling monitor election 2024-06-02T04:43:44.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:43 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T04:43:44.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:43 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T04:43:44.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:43 smithi192 ceph-mon[47933]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T04:43:44.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:43 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T04:43:44.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:43 smithi192 ceph-mon[47933]: mon.c calling monitor election 2024-06-02T04:43:44.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:43 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T04:43:44.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:43 smithi192 ceph-mon[47933]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T04:43:44.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:43 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T04:43:44.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:43 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T04:43:44.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:43 smithi192 ceph-mon[47933]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-06-02T04:43:44.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:43 smithi192 ceph-mon[47933]: monmap e2: 2 mons at {a=[v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0],c=[v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-06-02T04:43:44.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:43 smithi192 ceph-mon[47933]: fsmap 2024-06-02T04:43:44.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:43 smithi192 ceph-mon[47933]: osdmap e4: 0 total, 0 up, 0 in 2024-06-02T04:43:44.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:43 smithi192 ceph-mon[47933]: mgrmap e13: x(active, since 37s) 2024-06-02T04:43:44.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:43 smithi192 ceph-mon[47933]: overall HEALTH_OK 2024-06-02T04:43:44.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:43 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:44.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:43 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:44.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:43 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:44.183 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:43 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-02T04:43:44.183 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:43 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:43:44.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:43 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-02T04:43:44.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:43 smithi076 ceph-mon[42935]: mon.a calling monitor election 2024-06-02T04:43:44.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:43 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T04:43:44.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:43 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T04:43:44.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:43 smithi076 ceph-mon[42935]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T04:43:44.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:43 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T04:43:44.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:43 smithi076 ceph-mon[42935]: mon.c calling monitor election 2024-06-02T04:43:44.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:43 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T04:43:44.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:43 smithi076 ceph-mon[42935]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T04:43:44.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:43 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T04:43:44.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:43 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T04:43:44.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:43 smithi076 ceph-mon[42935]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-06-02T04:43:44.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:43 smithi076 ceph-mon[42935]: monmap e2: 2 mons at {a=[v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0],c=[v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-06-02T04:43:44.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:43 smithi076 ceph-mon[42935]: fsmap 2024-06-02T04:43:44.235 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:43 smithi076 ceph-mon[42935]: osdmap e4: 0 total, 0 up, 0 in 2024-06-02T04:43:44.235 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:43 smithi076 ceph-mon[42935]: mgrmap e13: x(active, since 37s) 2024-06-02T04:43:44.235 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:43 smithi076 ceph-mon[42935]: overall HEALTH_OK 2024-06-02T04:43:44.235 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:43 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:44.235 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:43 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:44.235 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:43 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:44.235 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:43 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-02T04:43:44.235 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:43 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:43:45.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:44 smithi192 ceph-mon[47933]: Deploying daemon mon.b on smithi119 2024-06-02T04:43:45.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:44 smithi192 ceph-mon[47933]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T04:43:45.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:44 smithi192 ceph-mon[47933]: from='client.? 172.21.15.192:0/505325184' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-06-02T04:43:45.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:44 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T04:43:45.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:44 smithi076 ceph-mon[42935]: Deploying daemon mon.b on smithi119 2024-06-02T04:43:45.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:44 smithi076 ceph-mon[42935]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T04:43:45.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:44 smithi076 ceph-mon[42935]: from='client.? 172.21.15.192:0/505325184' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-06-02T04:43:45.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:44 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T04:43:45.530 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-06-02T04:43:45.530 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 60ab6d30-209a-11ef-bc9b-c7b262605968 -- ceph mon dump -f json 2024-06-02T04:43:45.761 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/mon.c/config 2024-06-02T04:43:46.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 systemd[1]: Starting Ceph mon.b for 60ab6d30-209a-11ef-bc9b-c7b262605968... 2024-06-02T04:43:46.368 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: set uid:gid to 167:167 (ceph:ceph) 2024-06-02T04:43:46.369 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: ceph version 18.2.2-1381-g3bb45379 (3bb45379356e8aa965152e0b8c663715c5df9bda) reef (stable), process ceph-mon, pid 7 2024-06-02T04:43:46.369 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: pidfile_write: ignore empty --pid-file 2024-06-02T04:43:46.369 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 bash[46594]: 40f4ecd9695161b204d4c0db923cebce03a7e69b30747e60f6827bc9c6415baf 2024-06-02T04:43:46.369 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: load: jerasure load: lrc 2024-06-02T04:43:46.369 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: RocksDB version: 7.9.2 2024-06-02T04:43:46.369 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Git sha 0 2024-06-02T04:43:46.369 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Compile date 2024-05-28 22:38:07 2024-06-02T04:43:46.369 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: DB SUMMARY 2024-06-02T04:43:46.370 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: DB Session ID: BUXKU3XOK7BIJPHMWAEQ 2024-06-02T04:43:46.370 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: CURRENT file: CURRENT 2024-06-02T04:43:46.370 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: IDENTITY file: IDENTITY 2024-06-02T04:43:46.370 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-06-02T04:43:46.370 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2024-06-02T04:43:46.370 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 636 ; 2024-06-02T04:43:46.370 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.error_if_exists: 0 2024-06-02T04:43:46.370 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.create_if_missing: 0 2024-06-02T04:43:46.370 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.paranoid_checks: 1 2024-06-02T04:43:46.370 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.flush_verify_memtable_count: 1 2024-06-02T04:43:46.370 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-06-02T04:43:46.370 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-06-02T04:43:46.371 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.env: 0x55c1ba1b7820 2024-06-02T04:43:46.371 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.fs: PosixFileSystem 2024-06-02T04:43:46.371 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.info_log: 0x55c1bc091520 2024-06-02T04:43:46.371 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.max_file_opening_threads: 16 2024-06-02T04:43:46.371 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.statistics: (nil) 2024-06-02T04:43:46.371 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.use_fsync: 0 2024-06-02T04:43:46.371 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.max_log_file_size: 0 2024-06-02T04:43:46.371 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-06-02T04:43:46.371 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.log_file_time_to_roll: 0 2024-06-02T04:43:46.371 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.keep_log_file_num: 1000 2024-06-02T04:43:46.371 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.recycle_log_file_num: 0 2024-06-02T04:43:46.371 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.allow_fallocate: 1 2024-06-02T04:43:46.371 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.allow_mmap_reads: 0 2024-06-02T04:43:46.372 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.allow_mmap_writes: 0 2024-06-02T04:43:46.372 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.use_direct_reads: 0 2024-06-02T04:43:46.372 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-06-02T04:43:46.372 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.create_missing_column_families: 0 2024-06-02T04:43:46.372 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.db_log_dir: 2024-06-02T04:43:46.372 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.wal_dir: 2024-06-02T04:43:46.372 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.table_cache_numshardbits: 6 2024-06-02T04:43:46.372 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.WAL_ttl_seconds: 0 2024-06-02T04:43:46.372 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.WAL_size_limit_MB: 0 2024-06-02T04:43:46.373 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-06-02T04:43:46.373 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-06-02T04:43:46.373 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.is_fd_close_on_exec: 1 2024-06-02T04:43:46.373 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.advise_random_on_open: 1 2024-06-02T04:43:46.373 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.db_write_buffer_size: 0 2024-06-02T04:43:46.373 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.write_buffer_manager: 0x55c1bb326320 2024-06-02T04:43:46.373 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-06-02T04:43:46.373 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-06-02T04:43:46.373 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.use_adaptive_mutex: 0 2024-06-02T04:43:46.373 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.rate_limiter: (nil) 2024-06-02T04:43:46.373 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-06-02T04:43:46.373 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.wal_recovery_mode: 2 2024-06-02T04:43:46.373 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.enable_thread_tracking: 0 2024-06-02T04:43:46.373 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.enable_pipelined_write: 0 2024-06-02T04:43:46.374 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.unordered_write: 0 2024-06-02T04:43:46.374 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-06-02T04:43:46.374 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-06-02T04:43:46.374 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-06-02T04:43:46.374 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-06-02T04:43:46.374 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.row_cache: None 2024-06-02T04:43:46.374 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.wal_filter: None 2024-06-02T04:43:46.374 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-06-02T04:43:46.374 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.allow_ingest_behind: 0 2024-06-02T04:43:46.374 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.two_write_queues: 0 2024-06-02T04:43:46.374 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.manual_wal_flush: 0 2024-06-02T04:43:46.374 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.wal_compression: 0 2024-06-02T04:43:46.374 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.atomic_flush: 0 2024-06-02T04:43:46.375 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-06-02T04:43:46.375 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.persist_stats_to_disk: 0 2024-06-02T04:43:46.375 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.write_dbid_to_manifest: 0 2024-06-02T04:43:46.375 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.log_readahead_size: 0 2024-06-02T04:43:46.375 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-06-02T04:43:46.375 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.best_efforts_recovery: 0 2024-06-02T04:43:46.375 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-06-02T04:43:46.375 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-06-02T04:43:46.375 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.allow_data_in_errors: 0 2024-06-02T04:43:46.375 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.db_host_id: __hostname__ 2024-06-02T04:43:46.375 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.enforce_single_del_contracts: true 2024-06-02T04:43:46.376 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.max_background_jobs: 2 2024-06-02T04:43:46.376 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.max_background_compactions: -1 2024-06-02T04:43:46.376 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.max_subcompactions: 1 2024-06-02T04:43:46.376 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-06-02T04:43:46.376 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-06-02T04:43:46.376 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.delayed_write_rate : 16777216 2024-06-02T04:43:46.376 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.max_total_wal_size: 0 2024-06-02T04:43:46.376 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-06-02T04:43:46.376 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.stats_dump_period_sec: 600 2024-06-02T04:43:46.376 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.stats_persist_period_sec: 600 2024-06-02T04:43:46.376 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-06-02T04:43:46.376 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.max_open_files: -1 2024-06-02T04:43:46.376 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.bytes_per_sync: 0 2024-06-02T04:43:46.377 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.wal_bytes_per_sync: 0 2024-06-02T04:43:46.377 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.strict_bytes_per_sync: 0 2024-06-02T04:43:46.377 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.compaction_readahead_size: 0 2024-06-02T04:43:46.377 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.max_background_flushes: -1 2024-06-02T04:43:46.377 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Compression algorithms supported: 2024-06-02T04:43:46.377 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-06-02T04:43:46.377 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: kZSTD supported: 0 2024-06-02T04:43:46.377 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: kXpressCompression supported: 0 2024-06-02T04:43:46.377 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: kLZ4HCCompression supported: 1 2024-06-02T04:43:46.377 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: kZlibCompression supported: 1 2024-06-02T04:43:46.378 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: kSnappyCompression supported: 1 2024-06-02T04:43:46.378 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: kLZ4Compression supported: 1 2024-06-02T04:43:46.378 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: kBZip2Compression supported: 0 2024-06-02T04:43:46.378 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Fast CRC32 supported: Supported on x86 2024-06-02T04:43:46.378 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: DMutex implementation: pthread_mutex_t 2024-06-02T04:43:46.378 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2024-06-02T04:43:46.378 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-06-02T04:43:46.378 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-06-02T04:43:46.378 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.merge_operator: 2024-06-02T04:43:46.378 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.compaction_filter: None 2024-06-02T04:43:46.378 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.compaction_filter_factory: None 2024-06-02T04:43:46.378 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.sst_partitioner_factory: None 2024-06-02T04:43:46.378 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.memtable_factory: SkipListFactory 2024-06-02T04:43:46.379 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.table_factory: BlockBasedTable 2024-06-02T04:43:46.379 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55c1bc091620) 2024-06-02T04:43:46.379 INFO:journalctl@ceph.mon.b.smithi119.stdout: cache_index_and_filter_blocks: 1 2024-06-02T04:43:46.379 INFO:journalctl@ceph.mon.b.smithi119.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-06-02T04:43:46.379 INFO:journalctl@ceph.mon.b.smithi119.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-06-02T04:43:46.379 INFO:journalctl@ceph.mon.b.smithi119.stdout: pin_top_level_index_and_filter: 1 2024-06-02T04:43:46.379 INFO:journalctl@ceph.mon.b.smithi119.stdout: index_type: 0 2024-06-02T04:43:46.379 INFO:journalctl@ceph.mon.b.smithi119.stdout: data_block_index_type: 0 2024-06-02T04:43:46.379 INFO:journalctl@ceph.mon.b.smithi119.stdout: index_shortening: 1 2024-06-02T04:43:46.379 INFO:journalctl@ceph.mon.b.smithi119.stdout: data_block_hash_table_util_ratio: 0.750000 2024-06-02T04:43:46.379 INFO:journalctl@ceph.mon.b.smithi119.stdout: checksum: 4 2024-06-02T04:43:46.379 INFO:journalctl@ceph.mon.b.smithi119.stdout: no_block_cache: 0 2024-06-02T04:43:46.379 INFO:journalctl@ceph.mon.b.smithi119.stdout: block_cache: 0x55c1bb3a91f0 2024-06-02T04:43:46.379 INFO:journalctl@ceph.mon.b.smithi119.stdout: block_cache_name: BinnedLRUCache 2024-06-02T04:43:46.380 INFO:journalctl@ceph.mon.b.smithi119.stdout: block_cache_options: 2024-06-02T04:43:46.380 INFO:journalctl@ceph.mon.b.smithi119.stdout: capacity : 536870912 2024-06-02T04:43:46.380 INFO:journalctl@ceph.mon.b.smithi119.stdout: num_shard_bits : 4 2024-06-02T04:43:46.380 INFO:journalctl@ceph.mon.b.smithi119.stdout: strict_capacity_limit : 0 2024-06-02T04:43:46.380 INFO:journalctl@ceph.mon.b.smithi119.stdout: high_pri_pool_ratio: 0.000 2024-06-02T04:43:46.380 INFO:journalctl@ceph.mon.b.smithi119.stdout: block_cache_compressed: (nil) 2024-06-02T04:43:46.380 INFO:journalctl@ceph.mon.b.smithi119.stdout: persistent_cache: (nil) 2024-06-02T04:43:46.380 INFO:journalctl@ceph.mon.b.smithi119.stdout: block_size: 4096 2024-06-02T04:43:46.380 INFO:journalctl@ceph.mon.b.smithi119.stdout: block_size_deviation: 10 2024-06-02T04:43:46.380 INFO:journalctl@ceph.mon.b.smithi119.stdout: block_restart_interval: 16 2024-06-02T04:43:46.380 INFO:journalctl@ceph.mon.b.smithi119.stdout: index_block_restart_interval: 1 2024-06-02T04:43:46.380 INFO:journalctl@ceph.mon.b.smithi119.stdout: metadata_block_size: 4096 2024-06-02T04:43:46.380 INFO:journalctl@ceph.mon.b.smithi119.stdout: partition_filters: 0 2024-06-02T04:43:46.380 INFO:journalctl@ceph.mon.b.smithi119.stdout: use_delta_encoding: 1 2024-06-02T04:43:46.381 INFO:journalctl@ceph.mon.b.smithi119.stdout: filter_policy: bloomfilter 2024-06-02T04:43:46.381 INFO:journalctl@ceph.mon.b.smithi119.stdout: whole_key_filtering: 1 2024-06-02T04:43:46.381 INFO:journalctl@ceph.mon.b.smithi119.stdout: verify_compression: 0 2024-06-02T04:43:46.381 INFO:journalctl@ceph.mon.b.smithi119.stdout: read_amp_bytes_per_bit: 0 2024-06-02T04:43:46.381 INFO:journalctl@ceph.mon.b.smithi119.stdout: format_version: 5 2024-06-02T04:43:46.381 INFO:journalctl@ceph.mon.b.smithi119.stdout: enable_index_compression: 1 2024-06-02T04:43:46.381 INFO:journalctl@ceph.mon.b.smithi119.stdout: block_align: 0 2024-06-02T04:43:46.381 INFO:journalctl@ceph.mon.b.smithi119.stdout: max_auto_readahead_size: 262144 2024-06-02T04:43:46.381 INFO:journalctl@ceph.mon.b.smithi119.stdout: prepopulate_block_cache: 0 2024-06-02T04:43:46.381 INFO:journalctl@ceph.mon.b.smithi119.stdout: initial_auto_readahead_size: 8192 2024-06-02T04:43:46.381 INFO:journalctl@ceph.mon.b.smithi119.stdout: num_file_reads_for_auto_readahead: 2 2024-06-02T04:43:46.381 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.write_buffer_size: 33554432 2024-06-02T04:43:46.381 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.max_write_buffer_number: 2 2024-06-02T04:43:46.381 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.compression: NoCompression 2024-06-02T04:43:46.382 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.bottommost_compression: Disabled 2024-06-02T04:43:46.382 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.prefix_extractor: nullptr 2024-06-02T04:43:46.382 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-06-02T04:43:46.382 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.num_levels: 7 2024-06-02T04:43:46.382 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-06-02T04:43:46.382 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-06-02T04:43:46.382 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-06-02T04:43:46.382 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-06-02T04:43:46.382 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-06-02T04:43:46.382 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-06-02T04:43:46.383 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-06-02T04:43:46.383 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-06-02T04:43:46.383 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-06-02T04:43:46.383 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-06-02T04:43:46.383 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-06-02T04:43:46.383 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-06-02T04:43:46.383 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.compression_opts.window_bits: -14 2024-06-02T04:43:46.383 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.compression_opts.level: 32767 2024-06-02T04:43:46.383 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.compression_opts.strategy: 0 2024-06-02T04:43:46.383 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-06-02T04:43:46.383 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-06-02T04:43:46.383 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-06-02T04:43:46.383 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-06-02T04:43:46.384 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.compression_opts.enabled: false 2024-06-02T04:43:46.384 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-06-02T04:43:46.384 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-06-02T04:43:46.384 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-06-02T04:43:46.384 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-06-02T04:43:46.384 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.target_file_size_base: 67108864 2024-06-02T04:43:46.384 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.target_file_size_multiplier: 1 2024-06-02T04:43:46.384 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-06-02T04:43:46.384 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-06-02T04:43:46.384 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-06-02T04:43:46.384 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-06-02T04:43:46.384 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-06-02T04:43:46.384 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-06-02T04:43:46.384 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-06-02T04:43:46.385 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-06-02T04:43:46.385 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-06-02T04:43:46.385 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-06-02T04:43:46.385 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-06-02T04:43:46.385 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-06-02T04:43:46.385 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-06-02T04:43:46.385 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.arena_block_size: 1048576 2024-06-02T04:43:46.385 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-06-02T04:43:46.385 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-06-02T04:43:46.385 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.disable_auto_compactions: 0 2024-06-02T04:43:46.385 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-06-02T04:43:46.385 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-06-02T04:43:46.385 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-06-02T04:43:46.385 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-06-02T04:43:46.386 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-06-02T04:43:46.386 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-06-02T04:43:46.386 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-06-02T04:43:46.386 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-06-02T04:43:46.386 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-06-02T04:43:46.386 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-06-02T04:43:46.386 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.table_properties_collectors: 2024-06-02T04:43:46.386 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.inplace_update_support: 0 2024-06-02T04:43:46.386 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.inplace_update_num_locks: 10000 2024-06-02T04:43:46.386 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-06-02T04:43:46.386 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-06-02T04:43:46.386 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.memtable_huge_page_size: 0 2024-06-02T04:43:46.386 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.bloom_locality: 0 2024-06-02T04:43:46.386 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.max_successive_merges: 0 2024-06-02T04:43:46.387 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.optimize_filters_for_hits: 0 2024-06-02T04:43:46.387 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.paranoid_file_checks: 0 2024-06-02T04:43:46.387 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.force_consistency_checks: 1 2024-06-02T04:43:46.387 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.report_bg_io_stats: 0 2024-06-02T04:43:46.387 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.ttl: 2592000 2024-06-02T04:43:46.387 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.periodic_compaction_seconds: 0 2024-06-02T04:43:46.387 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-06-02T04:43:46.387 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-06-02T04:43:46.387 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.enable_blob_files: false 2024-06-02T04:43:46.387 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.min_blob_size: 0 2024-06-02T04:43:46.387 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.blob_file_size: 268435456 2024-06-02T04:43:46.387 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.blob_compression_type: NoCompression 2024-06-02T04:43:46.387 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.enable_blob_garbage_collection: false 2024-06-02T04:43:46.387 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-06-02T04:43:46.388 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-06-02T04:43:46.388 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-06-02T04:43:46.388 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.blob_file_starting_level: 0 2024-06-02T04:43:46.388 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-06-02T04:43:46.388 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-06-02T04:43:46.388 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-06-02T04:43:46.389 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: decbc9a3-3d86-4127-b211-6c2053f4a6a1 2024-06-02T04:43:46.389 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: EVENT_LOG_v1 {"time_micros": 1717303426345808, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-06-02T04:43:46.389 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-06-02T04:43:46.389 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 systemd[1]: Started Ceph mon.b for 60ab6d30-209a-11ef-bc9b-c7b262605968. 2024-06-02T04:43:46.389 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: EVENT_LOG_v1 {"time_micros": 1717303426346248, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1747, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1717303426, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "decbc9a3-3d86-4127-b211-6c2053f4a6a1", "db_session_id": "BUXKU3XOK7BIJPHMWAEQ", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-06-02T04:43:46.389 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: EVENT_LOG_v1 {"time_micros": 1717303426346328, "job": 1, "event": "recovery_finished"} 2024-06-02T04:43:46.389 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-06-02T04:43:46.389 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-06-02T04:43:46.389 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55c1bb446000 2024-06-02T04:43:46.389 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: DB pointer 0x55c1bb434000 2024-06-02T04:43:46.390 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-06-02T04:43:46.390 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-06-02T04:43:46.390 INFO:journalctl@ceph.mon.b.smithi119.stdout: ** DB Stats ** 2024-06-02T04:43:46.390 INFO:journalctl@ceph.mon.b.smithi119.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-06-02T04:43:46.390 INFO:journalctl@ceph.mon.b.smithi119.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-06-02T04:43:46.390 INFO:journalctl@ceph.mon.b.smithi119.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-06-02T04:43:46.390 INFO:journalctl@ceph.mon.b.smithi119.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-06-02T04:43:46.390 INFO:journalctl@ceph.mon.b.smithi119.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-06-02T04:43:46.390 INFO:journalctl@ceph.mon.b.smithi119.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-06-02T04:43:46.390 INFO:journalctl@ceph.mon.b.smithi119.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-06-02T04:43:46.390 INFO:journalctl@ceph.mon.b.smithi119.stdout: 2024-06-02T04:43:46.390 INFO:journalctl@ceph.mon.b.smithi119.stdout: ** Compaction Stats [default] ** 2024-06-02T04:43:46.390 INFO:journalctl@ceph.mon.b.smithi119.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-06-02T04:43:46.391 INFO:journalctl@ceph.mon.b.smithi119.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-06-02T04:43:46.391 INFO:journalctl@ceph.mon.b.smithi119.stdout: L0 1/0 1.71 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-06-02T04:43:46.391 INFO:journalctl@ceph.mon.b.smithi119.stdout: Sum 1/0 1.71 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-06-02T04:43:46.391 INFO:journalctl@ceph.mon.b.smithi119.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-06-02T04:43:46.391 INFO:journalctl@ceph.mon.b.smithi119.stdout: 2024-06-02T04:43:46.391 INFO:journalctl@ceph.mon.b.smithi119.stdout: ** Compaction Stats [default] ** 2024-06-02T04:43:46.391 INFO:journalctl@ceph.mon.b.smithi119.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-06-02T04:43:46.391 INFO:journalctl@ceph.mon.b.smithi119.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-06-02T04:43:46.391 INFO:journalctl@ceph.mon.b.smithi119.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-06-02T04:43:46.391 INFO:journalctl@ceph.mon.b.smithi119.stdout: 2024-06-02T04:43:46.391 INFO:journalctl@ceph.mon.b.smithi119.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-06-02T04:43:46.391 INFO:journalctl@ceph.mon.b.smithi119.stdout: 2024-06-02T04:43:46.391 INFO:journalctl@ceph.mon.b.smithi119.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-06-02T04:43:46.391 INFO:journalctl@ceph.mon.b.smithi119.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-06-02T04:43:46.392 INFO:journalctl@ceph.mon.b.smithi119.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-06-02T04:43:46.392 INFO:journalctl@ceph.mon.b.smithi119.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-06-02T04:43:46.392 INFO:journalctl@ceph.mon.b.smithi119.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-06-02T04:43:46.392 INFO:journalctl@ceph.mon.b.smithi119.stdout: AddFile(Keys): cumulative 0, interval 0 2024-06-02T04:43:46.392 INFO:journalctl@ceph.mon.b.smithi119.stdout: Cumulative compaction: 0.00 GB write, 0.63 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-06-02T04:43:46.392 INFO:journalctl@ceph.mon.b.smithi119.stdout: Interval compaction: 0.00 GB write, 0.63 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-06-02T04:43:46.392 INFO:journalctl@ceph.mon.b.smithi119.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-06-02T04:43:46.392 INFO:journalctl@ceph.mon.b.smithi119.stdout: Block cache BinnedLRUCache@0x55c1bb3a91f0#7 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-06-02T04:43:46.392 INFO:journalctl@ceph.mon.b.smithi119.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-06-02T04:43:46.392 INFO:journalctl@ceph.mon.b.smithi119.stdout: 2024-06-02T04:43:46.392 INFO:journalctl@ceph.mon.b.smithi119.stdout: ** File Read Latency Histogram By Level [default] ** 2024-06-02T04:43:46.392 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: mon.b does not exist in monmap, will attempt to join an existing cluster 2024-06-02T04:43:46.393 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: using public_addr v2:172.21.15.119:0/0 -> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] 2024-06-02T04:43:46.393 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: starting mon.b rank -1 at public addrs [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] at bind addrs [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid 60ab6d30-209a-11ef-bc9b-c7b262605968 2024-06-02T04:43:46.393 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: mon.b@-1(???) e0 preinit fsid 60ab6d30-209a-11ef-bc9b-c7b262605968 2024-06-02T04:43:46.393 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: mon.b@-1(synchronizing).mds e1 new map 2024-06-02T04:43:46.393 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: mon.b@-1(synchronizing).mds e1 print_map 2024-06-02T04:43:46.393 INFO:journalctl@ceph.mon.b.smithi119.stdout: e1 2024-06-02T04:43:46.393 INFO:journalctl@ceph.mon.b.smithi119.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-06-02T04:43:46.393 INFO:journalctl@ceph.mon.b.smithi119.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-06-02T04:43:46.393 INFO:journalctl@ceph.mon.b.smithi119.stdout: legacy client fscid: -1 2024-06-02T04:43:46.393 INFO:journalctl@ceph.mon.b.smithi119.stdout: 2024-06-02T04:43:46.393 INFO:journalctl@ceph.mon.b.smithi119.stdout: No filesystems configured 2024-06-02T04:43:46.394 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-06-02T04:43:46.394 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-06-02T04:43:46.394 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-06-02T04:43:46.394 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-06-02T04:43:46.394 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-06-02T04:43:46.394 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-06-02T04:43:46.394 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-06-02T04:43:46.394 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-06-02T04:43:46.394 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-06-02T04:43:46.394 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-06-02T04:43:46.394 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T04:43:46.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/1011484839' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-06-02T04:43:46.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:46.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:46.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:46.847 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:46.847 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi192", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:43:46.847 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:43:46.847 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:43:46.847 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: Updating smithi192:/etc/ceph/ceph.conf 2024-06-02T04:43:46.847 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: Updating smithi192:/var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-02T04:43:46.847 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: Updating smithi192:/etc/ceph/ceph.client.admin.keyring 2024-06-02T04:43:46.847 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: Updating smithi192:/var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/config/ceph.client.admin.keyring 2024-06-02T04:43:46.847 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/1011484839' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-06-02T04:43:46.847 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: osdmap e4: 0 total, 0 up, 0 in 2024-06-02T04:43:46.847 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:46.847 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:46.847 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:46.848 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T04:43:46.848 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi076:172.21.15.76=a;smithi119:172.21.15.119=b;smithi192:172.21.15.192=c", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:43:46.848 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: Saving service mon spec with placement smithi076:172.21.15.76=a;smithi119:172.21.15.119=b;smithi192:172.21.15.192=c;count:3 2024-06-02T04:43:46.848 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:46.848 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:43:46.848 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:43:46.848 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:43:46.848 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:46.848 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-02T04:43:46.848 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:43:46.848 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: Deploying daemon mon.c on smithi192 2024-06-02T04:43:46.848 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T04:43:46.848 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-02T04:43:46.849 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: mon.a calling monitor election 2024-06-02T04:43:46.849 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T04:43:46.849 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T04:43:46.849 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T04:43:46.849 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T04:43:46.849 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: mon.c calling monitor election 2024-06-02T04:43:46.849 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T04:43:46.849 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T04:43:46.849 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T04:43:46.849 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T04:43:46.849 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-06-02T04:43:46.849 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: monmap e2: 2 mons at {a=[v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0],c=[v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-06-02T04:43:46.850 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: fsmap 2024-06-02T04:43:46.850 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: osdmap e4: 0 total, 0 up, 0 in 2024-06-02T04:43:46.850 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: mgrmap e13: x(active, since 37s) 2024-06-02T04:43:46.850 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: overall HEALTH_OK 2024-06-02T04:43:46.850 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:46.850 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:46.850 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:46.850 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-02T04:43:46.850 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:43:46.850 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: Deploying daemon mon.b on smithi119 2024-06-02T04:43:46.850 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T04:43:46.850 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: from='client.? 172.21.15.192:0/505325184' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-06-02T04:43:46.850 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T04:43:46.851 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:46 smithi119 ceph-mon[46633]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-06-02T04:43:51.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:51 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-02T04:43:51.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:51 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T04:43:51.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:51 smithi076 ceph-mon[42935]: mon.a calling monitor election 2024-06-02T04:43:51.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:51 smithi076 ceph-mon[42935]: mon.c calling monitor election 2024-06-02T04:43:51.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:51 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T04:43:51.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:51 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T04:43:51.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:51 smithi076 ceph-mon[42935]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T04:43:51.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:51 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T04:43:51.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:51 smithi076 ceph-mon[42935]: mon.b calling monitor election 2024-06-02T04:43:51.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:51 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T04:43:51.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:51 smithi076 ceph-mon[42935]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T04:43:51.735 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:51 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T04:43:51.735 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:51 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T04:43:51.735 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:51 smithi076 ceph-mon[42935]: mon.a calling monitor election 2024-06-02T04:43:51.735 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:51 smithi076 ceph-mon[42935]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-06-02T04:43:51.735 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:51 smithi076 ceph-mon[42935]: monmap e3: 3 mons at {a=[v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0],b=[v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0],c=[v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-06-02T04:43:51.735 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:51 smithi076 ceph-mon[42935]: fsmap 2024-06-02T04:43:51.735 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:51 smithi076 ceph-mon[42935]: osdmap e4: 0 total, 0 up, 0 in 2024-06-02T04:43:51.735 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:51 smithi076 ceph-mon[42935]: mgrmap e13: x(active, since 45s) 2024-06-02T04:43:51.735 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:51 smithi076 ceph-mon[42935]: overall HEALTH_OK 2024-06-02T04:43:51.735 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:51 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:51.735 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:51 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:51.735 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:51 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:51.735 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:51 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:51.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:51 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-02T04:43:51.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:51 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T04:43:51.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:51 smithi119 ceph-mon[46633]: mon.a calling monitor election 2024-06-02T04:43:51.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:51 smithi119 ceph-mon[46633]: mon.c calling monitor election 2024-06-02T04:43:51.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:51 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T04:43:51.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:51 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T04:43:51.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:51 smithi119 ceph-mon[46633]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T04:43:51.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:51 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T04:43:51.847 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:51 smithi119 ceph-mon[46633]: mon.b calling monitor election 2024-06-02T04:43:51.847 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:51 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T04:43:51.847 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:51 smithi119 ceph-mon[46633]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T04:43:51.847 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:51 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T04:43:51.847 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:51 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T04:43:51.847 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:51 smithi119 ceph-mon[46633]: mon.a calling monitor election 2024-06-02T04:43:51.847 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:51 smithi119 ceph-mon[46633]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-06-02T04:43:51.847 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:51 smithi119 ceph-mon[46633]: monmap e3: 3 mons at {a=[v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0],b=[v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0],c=[v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-06-02T04:43:51.847 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:51 smithi119 ceph-mon[46633]: fsmap 2024-06-02T04:43:51.847 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:51 smithi119 ceph-mon[46633]: osdmap e4: 0 total, 0 up, 0 in 2024-06-02T04:43:51.847 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:51 smithi119 ceph-mon[46633]: mgrmap e13: x(active, since 45s) 2024-06-02T04:43:51.847 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:51 smithi119 ceph-mon[46633]: overall HEALTH_OK 2024-06-02T04:43:51.847 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:51 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:51.848 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:51 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:51.848 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:51 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:51.848 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:51 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:51.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:51 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-02T04:43:51.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:51 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T04:43:51.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:51 smithi192 ceph-mon[47933]: mon.a calling monitor election 2024-06-02T04:43:51.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:51 smithi192 ceph-mon[47933]: mon.c calling monitor election 2024-06-02T04:43:51.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:51 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T04:43:51.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:51 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T04:43:51.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:51 smithi192 ceph-mon[47933]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T04:43:51.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:51 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T04:43:51.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:51 smithi192 ceph-mon[47933]: mon.b calling monitor election 2024-06-02T04:43:51.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:51 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T04:43:51.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:51 smithi192 ceph-mon[47933]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T04:43:51.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:51 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T04:43:51.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:51 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T04:43:51.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:51 smithi192 ceph-mon[47933]: mon.a calling monitor election 2024-06-02T04:43:51.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:51 smithi192 ceph-mon[47933]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-06-02T04:43:51.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:51 smithi192 ceph-mon[47933]: monmap e3: 3 mons at {a=[v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0],b=[v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0],c=[v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-06-02T04:43:51.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:51 smithi192 ceph-mon[47933]: fsmap 2024-06-02T04:43:51.933 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:51 smithi192 ceph-mon[47933]: osdmap e4: 0 total, 0 up, 0 in 2024-06-02T04:43:51.933 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:51 smithi192 ceph-mon[47933]: mgrmap e13: x(active, since 45s) 2024-06-02T04:43:51.933 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:51 smithi192 ceph-mon[47933]: overall HEALTH_OK 2024-06-02T04:43:51.933 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:51 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:51.933 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:51 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:51.933 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:51 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:51.933 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:51 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:52.658 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:52.657+0000 7f04a9bf9700 1 -- 172.21.15.192:0/3556223750 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f048c0062a0 msgr2=0x7f048c008710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:43:52.658 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:52.657+0000 7f04a9bf9700 1 --2- 172.21.15.192:0/3556223750 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f048c0062a0 0x7f048c008710 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f04a4100980 tx=0x7f049400fe90 comp rx=0 tx=0).stop 2024-06-02T04:43:52.658 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:52.657+0000 7f04a9bf9700 1 -- 172.21.15.192:0/3556223750 shutdown_connections 2024-06-02T04:43:52.658 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:52.657+0000 7f04a9bf9700 1 --2- 172.21.15.192:0/3556223750 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f048c0062a0 0x7f048c008710 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:43:52.658 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:52.657+0000 7f04a9bf9700 1 -- 172.21.15.192:0/3556223750 >> 172.21.15.192:0/3556223750 conn(0x7f04a4076570 msgr2=0x7f04a40fd890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:43:52.658 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:52.657+0000 7f04a9bf9700 1 -- 172.21.15.192:0/3556223750 shutdown_connections 2024-06-02T04:43:52.658 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:52.657+0000 7f04a9bf9700 1 -- 172.21.15.192:0/3556223750 wait complete. 2024-06-02T04:43:52.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:52.658+0000 7f04a9bf9700 1 Processor -- start 2024-06-02T04:43:52.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:52.658+0000 7f04a9bf9700 1 -- start start 2024-06-02T04:43:52.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:52.658+0000 7f04a9bf9700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f048c0062a0 0x7f04a4196360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:43:52.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:52.658+0000 7f04a9bf9700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f04a41968a0 0x7f04a419ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:43:52.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:52.658+0000 7f04a9bf9700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f04a419b190 0x7f04a419b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:43:52.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:52.658+0000 7f04a9bf9700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04a4196f90 con 0x7f048c0062a0 2024-06-02T04:43:52.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:52.658+0000 7f04a9bf9700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04a41a2f00 con 0x7f04a419b190 2024-06-02T04:43:52.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:52.658+0000 7f04a9bf9700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04a41a3040 con 0x7f04a41968a0 2024-06-02T04:43:52.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:52.658+0000 7f04a2ffd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f04a41968a0 0x7f04a419ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:43:52.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:52.658+0000 7f04a37fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f048c0062a0 0x7f04a4196360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:43:52.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:52.658+0000 7f04a2ffd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f04a41968a0 0x7f04a419ac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:44408/0 (socket says 172.21.15.192:44408) 2024-06-02T04:43:52.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:52.658+0000 7f04a2ffd700 1 -- 172.21.15.192:0/2945352681 learned_addr learned my addr 172.21.15.192:0/2945352681 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-06-02T04:43:52.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:52.658+0000 7f04a3fff700 1 --2- 172.21.15.192:0/2945352681 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f04a419b190 0x7f04a419b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:43:52.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:52.659+0000 7f04a2ffd700 1 -- 172.21.15.192:0/2945352681 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f04a41968a0 msgr2=0x7f04a419ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-06-02T04:43:52.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:52.659+0000 7f04a2ffd700 1 -- 172.21.15.192:0/2945352681 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f04a41968a0 msgr2=0x7f04a419ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-06-02T04:43:52.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:52.659+0000 7f04a2ffd700 1 --2- 172.21.15.192:0/2945352681 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f04a41968a0 0x7f04a419ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-06-02T04:43:52.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:52.659+0000 7f04a2ffd700 1 --2- 172.21.15.192:0/2945352681 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f04a41968a0 0x7f04a419ac50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-06-02T04:43:52.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:52.659+0000 7f04a3fff700 1 -- 172.21.15.192:0/2945352681 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f04a419b190 msgr2=0x7f04a419b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2024-06-02T04:43:52.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:52.659+0000 7f04a3fff700 1 -- 172.21.15.192:0/2945352681 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f04a419b190 msgr2=0x7f04a419b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-06-02T04:43:52.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:52.659+0000 7f04a3fff700 1 --2- 172.21.15.192:0/2945352681 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f04a419b190 0x7f04a419b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-06-02T04:43:52.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:52.659+0000 7f04a3fff700 1 --2- 172.21.15.192:0/2945352681 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f04a419b190 0x7f04a419b640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-06-02T04:43:52.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:52.659+0000 7f04a37fe700 1 -- 172.21.15.192:0/2945352681 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f04a41968a0 msgr2=0x7f04a419ac50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-02T04:43:52.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:52.659+0000 7f04a37fe700 1 --2- 172.21.15.192:0/2945352681 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f04a41968a0 0x7f04a419ac50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:43:52.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:52.659+0000 7f04a37fe700 1 -- 172.21.15.192:0/2945352681 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f04a419b190 msgr2=0x7f04a419b640 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-02T04:43:52.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:52.659+0000 7f04a37fe700 1 --2- 172.21.15.192:0/2945352681 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f04a419b190 0x7f04a419b640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:43:52.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:52.659+0000 7f04a37fe700 1 -- 172.21.15.192:0/2945352681 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f049400f8e0 con 0x7f048c0062a0 2024-06-02T04:43:52.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:52.659+0000 7f04a37fe700 1 --2- 172.21.15.192:0/2945352681 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f048c0062a0 0x7f04a4196360 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0494010010 tx=0x7f049401dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:43:52.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:52.659+0000 7f04a0ff9700 1 -- 172.21.15.192:0/2945352681 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0494005da0 con 0x7f048c0062a0 2024-06-02T04:43:52.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:52.659+0000 7f04a0ff9700 1 -- 172.21.15.192:0/2945352681 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0494005440 con 0x7f048c0062a0 2024-06-02T04:43:52.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:52.659+0000 7f04a9bf9700 1 -- 172.21.15.192:0/2945352681 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04a41a32c0 con 0x7f048c0062a0 2024-06-02T04:43:52.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:52.659+0000 7f04a0ff9700 1 -- 172.21.15.192:0/2945352681 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0494011730 con 0x7f048c0062a0 2024-06-02T04:43:52.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:52.659+0000 7f04a9bf9700 1 -- 172.21.15.192:0/2945352681 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04a41a37c0 con 0x7f048c0062a0 2024-06-02T04:43:52.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:52.660+0000 7f04a0ff9700 1 -- 172.21.15.192:0/2945352681 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7f0494011890 con 0x7f048c0062a0 2024-06-02T04:43:52.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:52.660+0000 7f04a0ff9700 1 --2- 172.21.15.192:0/2945352681 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f0490038c70 0x7f049003b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:43:52.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:52.660+0000 7f04a0ff9700 1 -- 172.21.15.192:0/2945352681 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f049404e310 con 0x7f048c0062a0 2024-06-02T04:43:52.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:52.660+0000 7f04a9bf9700 1 -- 172.21.15.192:0/2945352681 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04a40625d0 con 0x7f048c0062a0 2024-06-02T04:43:52.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:52.660+0000 7f04a2ffd700 1 --2- 172.21.15.192:0/2945352681 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f0490038c70 0x7f049003b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:43:52.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:52.661+0000 7f04a2ffd700 1 --2- 172.21.15.192:0/2945352681 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f0490038c70 0x7f049003b130 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0498009180 tx=0x7f0498008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:43:52.666 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:52.667+0000 7f04a0ff9700 1 -- 172.21.15.192:0/2945352681 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f0494024d70 con 0x7f048c0062a0 2024-06-02T04:43:52.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:52 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:43:52.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:52 smithi076 ceph-mon[42935]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T04:43:52.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:52 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:52.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:52 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:52.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:52 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:52.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:52 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T04:43:52.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:52 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:52.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:52 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:43:52.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:52 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:43:52.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:52 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:43:52.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:52 smithi119 ceph-mon[46633]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T04:43:52.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:52 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:52.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:52 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:52.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:52 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:52.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:52 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T04:43:52.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:52 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:52.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:52 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:43:52.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:52 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:43:52.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:52 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:43:52.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:52 smithi192 ceph-mon[47933]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T04:43:52.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:52 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:52.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:52 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:52.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:52 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:52.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:52 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T04:43:52.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:52 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:52.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:52 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:43:52.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:52 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:43:52.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:52.953+0000 7f04a9bf9700 1 -- 172.21.15.192:0/2945352681 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f04a4101060 con 0x7f048c0062a0 2024-06-02T04:43:52.954 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:52.954+0000 7f04a0ff9700 1 -- 172.21.15.192:0/2945352681 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) v1 ==== 95+0+1276 (secure 0 0 0) 0x7f0494024310 con 0x7f048c0062a0 2024-06-02T04:43:52.954 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-06-02T04:43:52.954 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":3,"fsid":"60ab6d30-209a-11ef-bc9b-c7b262605968","modified":"2024-06-02T04:43:46.378392Z","created":"2024-06-02T04:42:18.974755Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:3300","nonce":0},{"type":"v1","addr":"172.21.15.76:6789","nonce":0}]},"addr":"172.21.15.76:6789/0","public_addr":"172.21.15.76:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:3300","nonce":0},{"type":"v1","addr":"172.21.15.192:6789","nonce":0}]},"addr":"172.21.15.192:6789/0","public_addr":"172.21.15.192:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-06-02T04:43:52.956 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:52.956+0000 7f04a9bf9700 1 -- 172.21.15.192:0/2945352681 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f0490038c70 msgr2=0x7f049003b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:43:52.957 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:52.956+0000 7f04a9bf9700 1 --2- 172.21.15.192:0/2945352681 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f0490038c70 0x7f049003b130 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0498009180 tx=0x7f0498008040 comp rx=0 tx=0).stop 2024-06-02T04:43:52.957 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:52.956+0000 7f04a9bf9700 1 -- 172.21.15.192:0/2945352681 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f048c0062a0 msgr2=0x7f04a4196360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:43:52.957 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:52.956+0000 7f04a9bf9700 1 --2- 172.21.15.192:0/2945352681 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f048c0062a0 0x7f04a4196360 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0494010010 tx=0x7f049401dae0 comp rx=0 tx=0).stop 2024-06-02T04:43:52.957 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:52.956+0000 7f04a9bf9700 1 -- 172.21.15.192:0/2945352681 shutdown_connections 2024-06-02T04:43:52.957 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:52.956+0000 7f04a9bf9700 1 --2- 172.21.15.192:0/2945352681 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f0490038c70 0x7f049003b130 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:43:52.957 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:52.956+0000 7f04a9bf9700 1 --2- 172.21.15.192:0/2945352681 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f04a419b190 0x7f04a419b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:43:52.957 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:52.956+0000 7f04a9bf9700 1 --2- 172.21.15.192:0/2945352681 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f048c0062a0 0x7f04a4196360 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:43:52.957 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:52.956+0000 7f04a9bf9700 1 --2- 172.21.15.192:0/2945352681 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f04a41968a0 0x7f04a419ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:43:52.957 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:52.956+0000 7f04a9bf9700 1 -- 172.21.15.192:0/2945352681 >> 172.21.15.192:0/2945352681 conn(0x7f04a4076570 msgr2=0x7f04a40685f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:43:52.957 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:52.956+0000 7f04a9bf9700 1 -- 172.21.15.192:0/2945352681 shutdown_connections 2024-06-02T04:43:52.957 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:52.956+0000 7f04a9bf9700 1 -- 172.21.15.192:0/2945352681 wait complete. 2024-06-02T04:43:52.958 INFO:teuthology.orchestra.run.smithi192.stderr:dumped monmap epoch 3 2024-06-02T04:43:53.367 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-06-02T04:43:53.367 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 60ab6d30-209a-11ef-bc9b-c7b262605968 -- ceph config generate-minimal-conf 2024-06-02T04:43:53.946 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T04:43:53.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:53 smithi076 ceph-mon[42935]: Updating smithi076:/etc/ceph/ceph.conf 2024-06-02T04:43:53.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:53 smithi076 ceph-mon[42935]: Updating smithi119:/etc/ceph/ceph.conf 2024-06-02T04:43:53.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:53 smithi076 ceph-mon[42935]: Updating smithi192:/etc/ceph/ceph.conf 2024-06-02T04:43:53.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:53 smithi076 ceph-mon[42935]: Updating smithi119:/var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-02T04:43:53.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:53 smithi076 ceph-mon[42935]: Updating smithi192:/var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-02T04:43:53.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:53 smithi076 ceph-mon[42935]: Updating smithi076:/var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-02T04:43:53.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:53 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:53.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:53 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:53.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:53 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:53.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:53 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:53.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:53 smithi076 ceph-mon[42935]: from='client.? 172.21.15.192:0/2945352681' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-06-02T04:43:53.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:53 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:53.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:53 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:53.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:53 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:53.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:53 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:53.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:53 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:53.985 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:53 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:53.985 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:53 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:53.985 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:53 smithi076 ceph-mon[42935]: Reconfiguring mon.a (unknown last config time)... 2024-06-02T04:43:53.985 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:53 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-02T04:43:53.985 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:53 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-02T04:43:53.985 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:53 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:43:53.985 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:53 smithi076 ceph-mon[42935]: Reconfiguring daemon mon.a on smithi076 2024-06-02T04:43:54.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:53 smithi192 ceph-mon[47933]: Updating smithi076:/etc/ceph/ceph.conf 2024-06-02T04:43:54.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:53 smithi192 ceph-mon[47933]: Updating smithi119:/etc/ceph/ceph.conf 2024-06-02T04:43:54.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:53 smithi192 ceph-mon[47933]: Updating smithi192:/etc/ceph/ceph.conf 2024-06-02T04:43:54.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:53 smithi192 ceph-mon[47933]: Updating smithi119:/var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-02T04:43:54.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:53 smithi192 ceph-mon[47933]: Updating smithi192:/var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-02T04:43:54.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:53 smithi192 ceph-mon[47933]: Updating smithi076:/var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-02T04:43:54.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:53 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:54.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:53 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:54.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:53 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:54.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:53 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:54.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:53 smithi192 ceph-mon[47933]: from='client.? 172.21.15.192:0/2945352681' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-06-02T04:43:54.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:53 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:54.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:53 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:54.183 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:53 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:54.183 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:53 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:54.183 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:53 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:54.183 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:53 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:54.183 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:53 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:54.183 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:53 smithi192 ceph-mon[47933]: Reconfiguring mon.a (unknown last config time)... 2024-06-02T04:43:54.183 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:53 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-02T04:43:54.183 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:53 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-02T04:43:54.183 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:53 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:43:54.183 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:53 smithi192 ceph-mon[47933]: Reconfiguring daemon mon.a on smithi076 2024-06-02T04:43:54.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:53 smithi119 ceph-mon[46633]: Updating smithi076:/etc/ceph/ceph.conf 2024-06-02T04:43:54.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:53 smithi119 ceph-mon[46633]: Updating smithi119:/etc/ceph/ceph.conf 2024-06-02T04:43:54.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:53 smithi119 ceph-mon[46633]: Updating smithi192:/etc/ceph/ceph.conf 2024-06-02T04:43:54.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:53 smithi119 ceph-mon[46633]: Updating smithi119:/var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-02T04:43:54.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:53 smithi119 ceph-mon[46633]: Updating smithi192:/var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-02T04:43:54.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:53 smithi119 ceph-mon[46633]: Updating smithi076:/var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-02T04:43:54.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:53 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:54.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:53 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:54.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:53 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:54.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:53 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:54.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:53 smithi119 ceph-mon[46633]: from='client.? 172.21.15.192:0/2945352681' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-06-02T04:43:54.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:53 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:54.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:53 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:54.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:53 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:54.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:53 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:54.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:53 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:54.348 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:53 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:54.348 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:53 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:54.348 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:53 smithi119 ceph-mon[46633]: Reconfiguring mon.a (unknown last config time)... 2024-06-02T04:43:54.348 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:53 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-02T04:43:54.348 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:53 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-02T04:43:54.348 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:53 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:43:54.348 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:53 smithi119 ceph-mon[46633]: Reconfiguring daemon mon.a on smithi076 2024-06-02T04:43:55.008 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:55.006+0000 7f00c6aeb700 1 -- 172.21.15.76:0/1066178526 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f00c0105ff0 msgr2=0x7f00c01063d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:43:55.009 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:55.006+0000 7f00c6aeb700 1 --2- 172.21.15.76:0/1066178526 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f00c0105ff0 0x7f00c01063d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f00b4009990 tx=0x7f00b4009ca0 comp rx=0 tx=0).stop 2024-06-02T04:43:55.009 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:55.006+0000 7f00c6aeb700 1 -- 172.21.15.76:0/1066178526 shutdown_connections 2024-06-02T04:43:55.009 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:55.006+0000 7f00c6aeb700 1 --2- 172.21.15.76:0/1066178526 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f00c0100bb0 0x7f00c010ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:43:55.009 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:55.006+0000 7f00c6aeb700 1 --2- 172.21.15.76:0/1066178526 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f00c0105ff0 0x7f00c01063d0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:43:55.009 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:55.006+0000 7f00c6aeb700 1 --2- 172.21.15.76:0/1066178526 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f00c01001f0 0x7f00c0100670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:43:55.009 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:55.006+0000 7f00c6aeb700 1 -- 172.21.15.76:0/1066178526 >> 172.21.15.76:0/1066178526 conn(0x7f00c0075d10 msgr2=0x7f00c0076120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:43:55.009 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:55.006+0000 7f00c6aeb700 1 -- 172.21.15.76:0/1066178526 shutdown_connections 2024-06-02T04:43:55.009 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:55.006+0000 7f00c6aeb700 1 -- 172.21.15.76:0/1066178526 wait complete. 2024-06-02T04:43:55.009 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:55.006+0000 7f00c6aeb700 1 Processor -- start 2024-06-02T04:43:55.009 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:55.006+0000 7f00c6aeb700 1 -- start start 2024-06-02T04:43:55.009 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:55.007+0000 7f00c6aeb700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f00c01001f0 0x7f00c0199500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:43:55.009 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:55.007+0000 7f00c6aeb700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f00c0100bb0 0x7f00c0199a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:43:55.010 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:55.007+0000 7f00c6aeb700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f00c0105ff0 0x7f00c019ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:43:55.010 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:55.007+0000 7f00c6aeb700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00c019e400 con 0x7f00c0100bb0 2024-06-02T04:43:55.010 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:55.007+0000 7f00c6aeb700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00c019e570 con 0x7f00c01001f0 2024-06-02T04:43:55.010 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:55.007+0000 7f00c6aeb700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00c019e730 con 0x7f00c0105ff0 2024-06-02T04:43:55.010 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:55.007+0000 7f00bffff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f00c0100bb0 0x7f00c0199a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:43:55.010 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:55.007+0000 7f00bffff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f00c0100bb0 0x7f00c0199a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:45196/0 (socket says 172.21.15.76:45196) 2024-06-02T04:43:55.010 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:55.007+0000 7f00bffff700 1 -- 172.21.15.76:0/2457676857 learned_addr learned my addr 172.21.15.76:0/2457676857 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:43:55.010 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:55.007+0000 7f00c4887700 1 --2- 172.21.15.76:0/2457676857 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f00c01001f0 0x7f00c0199500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:43:55.010 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:55.007+0000 7f00c5088700 1 --2- 172.21.15.76:0/2457676857 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f00c0105ff0 0x7f00c019ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:43:55.010 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:55.007+0000 7f00bffff700 1 -- 172.21.15.76:0/2457676857 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f00c0105ff0 msgr2=0x7f00c019ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:43:55.010 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:55.007+0000 7f00bffff700 1 --2- 172.21.15.76:0/2457676857 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f00c0105ff0 0x7f00c019ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:43:55.011 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:55.007+0000 7f00bffff700 1 -- 172.21.15.76:0/2457676857 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f00c01001f0 msgr2=0x7f00c0199500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:43:55.011 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:55.007+0000 7f00bffff700 1 --2- 172.21.15.76:0/2457676857 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f00c01001f0 0x7f00c0199500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:43:55.011 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:55.007+0000 7f00bffff700 1 -- 172.21.15.76:0/2457676857 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00b40095f0 con 0x7f00c0100bb0 2024-06-02T04:43:55.011 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:55.007+0000 7f00c5088700 1 --2- 172.21.15.76:0/2457676857 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f00c0105ff0 0x7f00c019ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:43:55.011 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:55.007+0000 7f00bffff700 1 --2- 172.21.15.76:0/2457676857 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f00c0100bb0 0x7f00c0199a40 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f00ac00d980 tx=0x7f00ac00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:43:55.011 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:55.007+0000 7f00bdffb700 1 -- 172.21.15.76:0/2457676857 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00ac00b950 con 0x7f00c0100bb0 2024-06-02T04:43:55.011 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:55.007+0000 7f00bdffb700 1 -- 172.21.15.76:0/2457676857 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f00ac007640 con 0x7f00c0100bb0 2024-06-02T04:43:55.011 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:55.007+0000 7f00c6aeb700 1 -- 172.21.15.76:0/2457676857 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00c019ea10 con 0x7f00c0100bb0 2024-06-02T04:43:55.011 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:55.007+0000 7f00bdffb700 1 -- 172.21.15.76:0/2457676857 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00ac00f3c0 con 0x7f00c0100bb0 2024-06-02T04:43:55.011 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:55.008+0000 7f00c6aeb700 1 -- 172.21.15.76:0/2457676857 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00c01a6270 con 0x7f00c0100bb0 2024-06-02T04:43:55.011 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:55.008+0000 7f00bdffb700 1 -- 172.21.15.76:0/2457676857 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7f00ac00f520 con 0x7f00c0100bb0 2024-06-02T04:43:55.011 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:55.008+0000 7f00bdffb700 1 --2- 172.21.15.76:0/2457676857 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f00b00389d0 0x7f00b003ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:43:55.011 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:55.008+0000 7f00bdffb700 1 -- 172.21.15.76:0/2457676857 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f00ac04b620 con 0x7f00c0100bb0 2024-06-02T04:43:55.011 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:55.008+0000 7f00c6aeb700 1 -- 172.21.15.76:0/2457676857 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00c0103230 con 0x7f00c0100bb0 2024-06-02T04:43:55.012 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:55.009+0000 7f00c4887700 1 --2- 172.21.15.76:0/2457676857 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f00b00389d0 0x7f00b003ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:43:55.012 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:55.009+0000 7f00c4887700 1 --2- 172.21.15.76:0/2457676857 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f00b00389d0 0x7f00b003ae90 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f00b400b5c0 tx=0x7f00b4005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:43:55.013 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:55.013+0000 7f00bdffb700 1 -- 172.21.15.76:0/2457676857 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f00ac01a9a0 con 0x7f00c0100bb0 2024-06-02T04:43:55.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:54 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:55.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:54 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:55.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:54 smithi192 ceph-mon[47933]: Reconfiguring mon.b (monmap changed)... 2024-06-02T04:43:55.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:54 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-02T04:43:55.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:54 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-02T04:43:55.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:54 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:43:55.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:54 smithi192 ceph-mon[47933]: Reconfiguring daemon mon.b on smithi119 2024-06-02T04:43:55.183 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:54 smithi192 ceph-mon[47933]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T04:43:55.208 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:55.207+0000 7f00c6aeb700 1 -- 172.21.15.76:0/2457676857 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f00c019a810 con 0x7f00c0100bb0 2024-06-02T04:43:55.208 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:55.208+0000 7f00bdffb700 1 -- 172.21.15.76:0/2457676857 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) v1 ==== 76+0+275 (secure 0 0 0) 0x7f00ac023350 con 0x7f00c0100bb0 2024-06-02T04:43:55.208 INFO:teuthology.orchestra.run.smithi076.stdout:# minimal ceph.conf for 60ab6d30-209a-11ef-bc9b-c7b262605968 2024-06-02T04:43:55.209 INFO:teuthology.orchestra.run.smithi076.stdout:[global] 2024-06-02T04:43:55.209 INFO:teuthology.orchestra.run.smithi076.stdout: fsid = 60ab6d30-209a-11ef-bc9b-c7b262605968 2024-06-02T04:43:55.209 INFO:teuthology.orchestra.run.smithi076.stdout: mon_host = [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] 2024-06-02T04:43:55.211 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:55.210+0000 7f00c6aeb700 1 -- 172.21.15.76:0/2457676857 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f00b00389d0 msgr2=0x7f00b003ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:43:55.211 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:55.210+0000 7f00c6aeb700 1 --2- 172.21.15.76:0/2457676857 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f00b00389d0 0x7f00b003ae90 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f00b400b5c0 tx=0x7f00b4005fb0 comp rx=0 tx=0).stop 2024-06-02T04:43:55.212 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:55.210+0000 7f00c6aeb700 1 -- 172.21.15.76:0/2457676857 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f00c0100bb0 msgr2=0x7f00c0199a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:43:55.212 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:55.210+0000 7f00c6aeb700 1 --2- 172.21.15.76:0/2457676857 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f00c0100bb0 0x7f00c0199a40 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f00ac00d980 tx=0x7f00ac00dc90 comp rx=0 tx=0).stop 2024-06-02T04:43:55.212 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:55.210+0000 7f00c6aeb700 1 -- 172.21.15.76:0/2457676857 shutdown_connections 2024-06-02T04:43:55.212 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:55.210+0000 7f00c6aeb700 1 --2- 172.21.15.76:0/2457676857 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f00c0105ff0 0x7f00c019ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:43:55.212 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:55.210+0000 7f00c6aeb700 1 --2- 172.21.15.76:0/2457676857 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f00b00389d0 0x7f00b003ae90 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:43:55.212 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:55.210+0000 7f00c6aeb700 1 --2- 172.21.15.76:0/2457676857 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f00c01001f0 0x7f00c0199500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:43:55.212 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:55.210+0000 7f00c6aeb700 1 --2- 172.21.15.76:0/2457676857 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f00c0100bb0 0x7f00c0199a40 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:43:55.213 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:55.210+0000 7f00c6aeb700 1 -- 172.21.15.76:0/2457676857 >> 172.21.15.76:0/2457676857 conn(0x7f00c0075d10 msgr2=0x7f00c010da40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:43:55.213 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:55.210+0000 7f00c6aeb700 1 -- 172.21.15.76:0/2457676857 shutdown_connections 2024-06-02T04:43:55.213 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:43:55.210+0000 7f00c6aeb700 1 -- 172.21.15.76:0/2457676857 wait complete. 2024-06-02T04:43:55.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:54 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:55.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:54 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:55.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:54 smithi076 ceph-mon[42935]: Reconfiguring mon.b (monmap changed)... 2024-06-02T04:43:55.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:54 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-02T04:43:55.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:54 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-02T04:43:55.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:54 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:43:55.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:54 smithi076 ceph-mon[42935]: Reconfiguring daemon mon.b on smithi119 2024-06-02T04:43:55.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:54 smithi076 ceph-mon[42935]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T04:43:55.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:54 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:55.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:54 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:55.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:54 smithi119 ceph-mon[46633]: Reconfiguring mon.b (monmap changed)... 2024-06-02T04:43:55.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:54 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-02T04:43:55.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:54 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-02T04:43:55.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:54 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:43:55.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:54 smithi119 ceph-mon[46633]: Reconfiguring daemon mon.b on smithi119 2024-06-02T04:43:55.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:54 smithi119 ceph-mon[46633]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T04:43:55.625 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-06-02T04:43:55.625 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2024-06-02T04:43:55.625 DEBUG:teuthology.orchestra.run.smithi076:> sudo dd of=/etc/ceph/ceph.conf 2024-06-02T04:43:55.656 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2024-06-02T04:43:55.656 DEBUG:teuthology.orchestra.run.smithi076:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-06-02T04:43:55.723 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-06-02T04:43:55.723 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/etc/ceph/ceph.conf 2024-06-02T04:43:55.755 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-06-02T04:43:55.755 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-06-02T04:43:55.823 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-06-02T04:43:55.823 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/etc/ceph/ceph.conf 2024-06-02T04:43:55.853 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-06-02T04:43:55.853 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-06-02T04:43:55.921 INFO:tasks.cephadm:Adding mgr.x on smithi076 2024-06-02T04:43:55.921 INFO:tasks.cephadm:Adding mgr.y on smithi119 2024-06-02T04:43:55.921 INFO:tasks.cephadm:Adding mgr.z on smithi192 2024-06-02T04:43:55.921 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 60ab6d30-209a-11ef-bc9b-c7b262605968 -- ceph orch apply mgr '3;smithi076=x;smithi119=y;smithi192=z' 2024-06-02T04:43:56.175 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/mon.c/config 2024-06-02T04:43:56.262 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:56 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:56.262 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:56 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:56.263 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:56 smithi192 ceph-mon[47933]: Reconfiguring mon.c (monmap changed)... 2024-06-02T04:43:56.263 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:56 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-02T04:43:56.263 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:56 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-02T04:43:56.263 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:56 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:43:56.263 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:56 smithi192 ceph-mon[47933]: Reconfiguring daemon mon.c on smithi192 2024-06-02T04:43:56.263 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:56 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/2457676857' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:43:56.263 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:56 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:56.263 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:56 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:56.263 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:56 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:43:56.263 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:56 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:43:56.264 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:56 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:43:56.264 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:56 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:56.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:56 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:56.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:56 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:56.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:56 smithi076 ceph-mon[42935]: Reconfiguring mon.c (monmap changed)... 2024-06-02T04:43:56.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:56 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-02T04:43:56.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:56 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-02T04:43:56.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:56 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:43:56.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:56 smithi076 ceph-mon[42935]: Reconfiguring daemon mon.c on smithi192 2024-06-02T04:43:56.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:56 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/2457676857' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:43:56.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:56 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:56.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:56 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:56.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:56 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:43:56.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:56 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:43:56.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:56 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:43:56.485 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:56 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:56.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:56 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:56.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:56 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:56.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:56 smithi119 ceph-mon[46633]: Reconfiguring mon.c (monmap changed)... 2024-06-02T04:43:56.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:56 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-02T04:43:56.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:56 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-02T04:43:56.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:56 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:43:56.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:56 smithi119 ceph-mon[46633]: Reconfiguring daemon mon.c on smithi192 2024-06-02T04:43:56.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:56 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/2457676857' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:43:56.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:56 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:56.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:56 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:56.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:56 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:43:56.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:56 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:43:56.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:56 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:43:56.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:56 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:57.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:57.079+0000 7efe45158700 1 -- 172.21.15.192:0/2996549124 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efe40101a20 msgr2=0x7efe40108340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:43:57.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:57.079+0000 7efe45158700 1 --2- 172.21.15.192:0/2996549124 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efe40101a20 0x7efe40108340 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7efe3800b0a0 tx=0x7efe3800b3b0 comp rx=0 tx=0).stop 2024-06-02T04:43:57.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:57.079+0000 7efe45158700 1 -- 172.21.15.192:0/2996549124 shutdown_connections 2024-06-02T04:43:57.083 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:57.079+0000 7efe45158700 1 --2- 172.21.15.192:0/2996549124 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efe40101a20 0x7efe40108340 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:43:57.083 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:57.079+0000 7efe45158700 1 --2- 172.21.15.192:0/2996549124 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efe400fff00 0x7efe40100320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:43:57.083 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:57.079+0000 7efe45158700 1 --2- 172.21.15.192:0/2996549124 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efe40101060 0x7efe401014e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:43:57.083 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:57.079+0000 7efe45158700 1 -- 172.21.15.192:0/2996549124 >> 172.21.15.192:0/2996549124 conn(0x7efe400fb4c0 msgr2=0x7efe400fd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:43:57.083 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:57.079+0000 7efe45158700 1 -- 172.21.15.192:0/2996549124 shutdown_connections 2024-06-02T04:43:57.083 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:57.079+0000 7efe45158700 1 -- 172.21.15.192:0/2996549124 wait complete. 2024-06-02T04:43:57.083 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:57.080+0000 7efe45158700 1 Processor -- start 2024-06-02T04:43:57.083 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:57.080+0000 7efe45158700 1 -- start start 2024-06-02T04:43:57.083 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:57.080+0000 7efe45158700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efe400fff00 0x7efe40103e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:43:57.084 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:57.080+0000 7efe45158700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efe40101060 0x7efe401024d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:43:57.084 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:57.080+0000 7efe45158700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efe40101a20 0x7efe40102a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:43:57.084 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:57.080+0000 7efe45158700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe401031b0 con 0x7efe40101a20 2024-06-02T04:43:57.084 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:57.080+0000 7efe45158700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe40103320 con 0x7efe40101060 2024-06-02T04:43:57.084 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:57.080+0000 7efe45158700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe401a0d60 con 0x7efe400fff00 2024-06-02T04:43:57.084 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:57.081+0000 7efe3ed9d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efe400fff00 0x7efe40103e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:43:57.084 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:57.081+0000 7efe3ed9d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efe400fff00 0x7efe40103e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:56638/0 (socket says 172.21.15.192:56638) 2024-06-02T04:43:57.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:57.081+0000 7efe3ed9d700 1 -- 172.21.15.192:0/99747627 learned_addr learned my addr 172.21.15.192:0/99747627 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-06-02T04:43:57.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:57.081+0000 7efe3f59e700 1 --2- 172.21.15.192:0/99747627 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efe40101a20 0x7efe40102a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:43:57.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:57.081+0000 7efe3e59c700 1 --2- 172.21.15.192:0/99747627 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efe40101060 0x7efe401024d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:43:57.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:57.081+0000 7efe3ed9d700 1 -- 172.21.15.192:0/99747627 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efe40101060 msgr2=0x7efe401024d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:43:57.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:57.081+0000 7efe3ed9d700 1 --2- 172.21.15.192:0/99747627 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efe40101060 0x7efe401024d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:43:57.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:57.081+0000 7efe3ed9d700 1 -- 172.21.15.192:0/99747627 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efe40101a20 msgr2=0x7efe40102a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:43:57.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:57.081+0000 7efe3ed9d700 1 --2- 172.21.15.192:0/99747627 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efe40101a20 0x7efe40102a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:43:57.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:57.081+0000 7efe3ed9d700 1 -- 172.21.15.192:0/99747627 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe38009d00 con 0x7efe400fff00 2024-06-02T04:43:57.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:57.081+0000 7efe3ed9d700 1 --2- 172.21.15.192:0/99747627 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efe400fff00 0x7efe40103e30 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7efe3400d950 tx=0x7efe3400dc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:43:57.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:57.081+0000 7efe27fff700 1 -- 172.21.15.192:0/99747627 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe3400f890 con 0x7efe400fff00 2024-06-02T04:43:57.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:57.081+0000 7efe27fff700 1 -- 172.21.15.192:0/99747627 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efe3400fe80 con 0x7efe400fff00 2024-06-02T04:43:57.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:57.081+0000 7efe45158700 1 -- 172.21.15.192:0/99747627 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe401a0ff0 con 0x7efe400fff00 2024-06-02T04:43:57.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:57.081+0000 7efe27fff700 1 -- 172.21.15.192:0/99747627 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe3400e3b0 con 0x7efe400fff00 2024-06-02T04:43:57.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:57.081+0000 7efe45158700 1 -- 172.21.15.192:0/99747627 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe401a1400 con 0x7efe400fff00 2024-06-02T04:43:57.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:57.082+0000 7efe27fff700 1 -- 172.21.15.192:0/99747627 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7efe3400e510 con 0x7efe400fff00 2024-06-02T04:43:57.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:57.082+0000 7efe27fff700 1 --2- 172.21.15.192:0/99747627 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7efe280389d0 0x7efe2803ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:43:57.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:57.082+0000 7efe27fff700 1 -- 172.21.15.192:0/99747627 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7efe3404b040 con 0x7efe400fff00 2024-06-02T04:43:57.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:57.082+0000 7efe45158700 1 -- 172.21.15.192:0/99747627 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe4004ec60 con 0x7efe400fff00 2024-06-02T04:43:57.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:57.082+0000 7efe3e59c700 1 --2- 172.21.15.192:0/99747627 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7efe280389d0 0x7efe2803ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:43:57.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:57.083+0000 7efe3e59c700 1 --2- 172.21.15.192:0/99747627 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7efe280389d0 0x7efe2803ae90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7efe30009c60 tx=0x7efe30009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:43:57.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:57.087+0000 7efe27fff700 1 -- 172.21.15.192:0/99747627 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7efe340228f0 con 0x7efe400fff00 2024-06-02T04:43:57.290 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:57.291+0000 7efe45158700 1 -- 172.21.15.192:0/99747627 --> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi076=x;smithi119=y;smithi192=z", "target": ["mon-mgr", ""]}) v1 -- 0x7efe40069960 con 0x7efe280389d0 2024-06-02T04:43:57.297 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:57.297+0000 7efe27fff700 1 -- 172.21.15.192:0/99747627 <== mgr.14152 v2:172.21.15.76:6800/2591353090 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7efe40069960 con 0x7efe280389d0 2024-06-02T04:43:57.297 INFO:teuthology.orchestra.run.smithi192.stdout:Scheduled mgr update... 2024-06-02T04:43:57.299 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:57.299+0000 7efe45158700 1 -- 172.21.15.192:0/99747627 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7efe280389d0 msgr2=0x7efe2803ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:43:57.299 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:57.299+0000 7efe45158700 1 --2- 172.21.15.192:0/99747627 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7efe280389d0 0x7efe2803ae90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7efe30009c60 tx=0x7efe30009260 comp rx=0 tx=0).stop 2024-06-02T04:43:57.299 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:57.299+0000 7efe45158700 1 -- 172.21.15.192:0/99747627 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efe400fff00 msgr2=0x7efe40103e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:43:57.299 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:57.299+0000 7efe45158700 1 --2- 172.21.15.192:0/99747627 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efe400fff00 0x7efe40103e30 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7efe3400d950 tx=0x7efe3400dc60 comp rx=0 tx=0).stop 2024-06-02T04:43:57.299 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:57.299+0000 7efe45158700 1 -- 172.21.15.192:0/99747627 shutdown_connections 2024-06-02T04:43:57.299 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:57.299+0000 7efe45158700 1 --2- 172.21.15.192:0/99747627 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efe40101a20 0x7efe40102a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:43:57.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:57.299+0000 7efe45158700 1 --2- 172.21.15.192:0/99747627 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efe400fff00 0x7efe40103e30 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:43:57.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:57.299+0000 7efe45158700 1 --2- 172.21.15.192:0/99747627 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7efe280389d0 0x7efe2803ae90 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:43:57.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:57.299+0000 7efe45158700 1 --2- 172.21.15.192:0/99747627 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efe40101060 0x7efe401024d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:43:57.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:57.299+0000 7efe45158700 1 -- 172.21.15.192:0/99747627 >> 172.21.15.192:0/99747627 conn(0x7efe400fb4c0 msgr2=0x7efe40069250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:43:57.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:57.300+0000 7efe45158700 1 -- 172.21.15.192:0/99747627 shutdown_connections 2024-06-02T04:43:57.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:43:57.300+0000 7efe45158700 1 -- 172.21.15.192:0/99747627 wait complete. 2024-06-02T04:43:57.431 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:57 smithi192 ceph-mon[47933]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T04:43:57.431 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:57 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:57.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:57 smithi076 ceph-mon[42935]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T04:43:57.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:57 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:57.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:57 smithi119 ceph-mon[46633]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T04:43:57.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:57 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:57.734 DEBUG:teuthology.orchestra.run.smithi119:mgr.y> sudo journalctl -f -n 0 -u ceph-60ab6d30-209a-11ef-bc9b-c7b262605968@mgr.y.service 2024-06-02T04:43:57.737 DEBUG:teuthology.orchestra.run.smithi192:mgr.z> sudo journalctl -f -n 0 -u ceph-60ab6d30-209a-11ef-bc9b-c7b262605968@mgr.z.service 2024-06-02T04:43:57.739 INFO:tasks.cephadm:Deploying OSDs... 2024-06-02T04:43:57.739 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2024-06-02T04:43:57.739 DEBUG:teuthology.orchestra.run.smithi076:> dd if=/scratch_devs of=/dev/stdout 2024-06-02T04:43:57.759 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-06-02T04:43:57.759 DEBUG:teuthology.orchestra.run.smithi076:> stat /dev/vg_nvme/lv_1 2024-06-02T04:43:57.768 INFO:journalctl@ceph.mgr.z.smithi192.stdout:-- Logs begin at Sun 2024-06-02 04:25:37 UTC. -- 2024-06-02T04:43:57.769 INFO:journalctl@ceph.mgr.y.smithi119.stdout:-- Logs begin at Sun 2024-06-02 04:25:42 UTC. -- 2024-06-02T04:43:57.819 INFO:teuthology.orchestra.run.smithi076.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-06-02T04:43:57.819 INFO:teuthology.orchestra.run.smithi076.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-02T04:43:57.819 INFO:teuthology.orchestra.run.smithi076.stdout:Device: 6h/6d Inode: 184087 Links: 1 2024-06-02T04:43:57.819 INFO:teuthology.orchestra.run.smithi076.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-02T04:43:57.819 INFO:teuthology.orchestra.run.smithi076.stdout:Context: system_u:object_r:device_t:s0 2024-06-02T04:43:57.819 INFO:teuthology.orchestra.run.smithi076.stdout:Access: 2024-06-02 04:43:17.819810957 +0000 2024-06-02T04:43:57.819 INFO:teuthology.orchestra.run.smithi076.stdout:Modify: 2024-06-02 04:36:37.821964255 +0000 2024-06-02T04:43:57.820 INFO:teuthology.orchestra.run.smithi076.stdout:Change: 2024-06-02 04:36:37.821964255 +0000 2024-06-02T04:43:57.820 INFO:teuthology.orchestra.run.smithi076.stdout: Birth: - 2024-06-02T04:43:57.820 DEBUG:teuthology.orchestra.run.smithi076:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-06-02T04:43:57.886 INFO:teuthology.orchestra.run.smithi076.stderr:1+0 records in 2024-06-02T04:43:57.886 INFO:teuthology.orchestra.run.smithi076.stderr:1+0 records out 2024-06-02T04:43:57.887 INFO:teuthology.orchestra.run.smithi076.stderr:512 bytes copied, 0.00024184 s, 2.1 MB/s 2024-06-02T04:43:57.887 DEBUG:teuthology.orchestra.run.smithi076:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-06-02T04:43:57.947 DEBUG:teuthology.orchestra.run.smithi076:> stat /dev/vg_nvme/lv_2 2024-06-02T04:43:58.005 INFO:teuthology.orchestra.run.smithi076.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-06-02T04:43:58.005 INFO:teuthology.orchestra.run.smithi076.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-02T04:43:58.005 INFO:teuthology.orchestra.run.smithi076.stdout:Device: 6h/6d Inode: 189520 Links: 1 2024-06-02T04:43:58.005 INFO:teuthology.orchestra.run.smithi076.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-02T04:43:58.005 INFO:teuthology.orchestra.run.smithi076.stdout:Context: system_u:object_r:device_t:s0 2024-06-02T04:43:58.005 INFO:teuthology.orchestra.run.smithi076.stdout:Access: 2024-06-02 04:43:17.880809150 +0000 2024-06-02T04:43:58.005 INFO:teuthology.orchestra.run.smithi076.stdout:Modify: 2024-06-02 04:36:38.147954549 +0000 2024-06-02T04:43:58.005 INFO:teuthology.orchestra.run.smithi076.stdout:Change: 2024-06-02 04:36:38.147954549 +0000 2024-06-02T04:43:58.006 INFO:teuthology.orchestra.run.smithi076.stdout: Birth: - 2024-06-02T04:43:58.006 DEBUG:teuthology.orchestra.run.smithi076:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-06-02T04:43:58.071 INFO:teuthology.orchestra.run.smithi076.stderr:1+0 records in 2024-06-02T04:43:58.071 INFO:teuthology.orchestra.run.smithi076.stderr:1+0 records out 2024-06-02T04:43:58.071 INFO:teuthology.orchestra.run.smithi076.stderr:512 bytes copied, 0.000237636 s, 2.2 MB/s 2024-06-02T04:43:58.072 DEBUG:teuthology.orchestra.run.smithi076:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-06-02T04:43:58.131 DEBUG:teuthology.orchestra.run.smithi076:> stat /dev/vg_nvme/lv_3 2024-06-02T04:43:58.189 INFO:teuthology.orchestra.run.smithi076.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-06-02T04:43:58.189 INFO:teuthology.orchestra.run.smithi076.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-02T04:43:58.190 INFO:teuthology.orchestra.run.smithi076.stdout:Device: 6h/6d Inode: 181175 Links: 1 2024-06-02T04:43:58.190 INFO:teuthology.orchestra.run.smithi076.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-02T04:43:58.190 INFO:teuthology.orchestra.run.smithi076.stdout:Context: system_u:object_r:device_t:s0 2024-06-02T04:43:58.190 INFO:teuthology.orchestra.run.smithi076.stdout:Access: 2024-06-02 04:43:17.935807520 +0000 2024-06-02T04:43:58.190 INFO:teuthology.orchestra.run.smithi076.stdout:Modify: 2024-06-02 04:36:38.498944098 +0000 2024-06-02T04:43:58.190 INFO:teuthology.orchestra.run.smithi076.stdout:Change: 2024-06-02 04:36:38.498944098 +0000 2024-06-02T04:43:58.190 INFO:teuthology.orchestra.run.smithi076.stdout: Birth: - 2024-06-02T04:43:58.190 DEBUG:teuthology.orchestra.run.smithi076:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-06-02T04:43:58.255 INFO:teuthology.orchestra.run.smithi076.stderr:1+0 records in 2024-06-02T04:43:58.255 INFO:teuthology.orchestra.run.smithi076.stderr:1+0 records out 2024-06-02T04:43:58.255 INFO:teuthology.orchestra.run.smithi076.stderr:512 bytes copied, 0.000185007 s, 2.8 MB/s 2024-06-02T04:43:58.256 DEBUG:teuthology.orchestra.run.smithi076:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-06-02T04:43:58.314 DEBUG:teuthology.orchestra.run.smithi076:> stat /dev/vg_nvme/lv_4 2024-06-02T04:43:58.372 INFO:teuthology.orchestra.run.smithi076.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-06-02T04:43:58.372 INFO:teuthology.orchestra.run.smithi076.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-02T04:43:58.372 INFO:teuthology.orchestra.run.smithi076.stdout:Device: 6h/6d Inode: 188604 Links: 1 2024-06-02T04:43:58.372 INFO:teuthology.orchestra.run.smithi076.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-02T04:43:58.373 INFO:teuthology.orchestra.run.smithi076.stdout:Context: system_u:object_r:device_t:s0 2024-06-02T04:43:58.373 INFO:teuthology.orchestra.run.smithi076.stdout:Access: 2024-06-02 04:43:17.990805891 +0000 2024-06-02T04:43:58.373 INFO:teuthology.orchestra.run.smithi076.stdout:Modify: 2024-06-02 04:36:38.840933915 +0000 2024-06-02T04:43:58.373 INFO:teuthology.orchestra.run.smithi076.stdout:Change: 2024-06-02 04:36:38.840933915 +0000 2024-06-02T04:43:58.373 INFO:teuthology.orchestra.run.smithi076.stdout: Birth: - 2024-06-02T04:43:58.373 DEBUG:teuthology.orchestra.run.smithi076:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-06-02T04:43:58.375 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:58 smithi192 ceph-mon[47933]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi076=x;smithi119=y;smithi192=z", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:43:58.375 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:58 smithi192 ceph-mon[47933]: Saving service mgr spec with placement smithi076=x;smithi119=y;smithi192=z;count:3 2024-06-02T04:43:58.375 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:58 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:58.375 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:58 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:43:58.375 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:58 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:43:58.375 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:58 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:43:58.375 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:58 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:58.375 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:58 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-02T04:43:58.376 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:58 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-06-02T04:43:58.376 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:58 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-02T04:43:58.376 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:58 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:43:58.376 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:58 smithi192 ceph-mon[47933]: Deploying daemon mgr.z on smithi192 2024-06-02T04:43:58.438 INFO:teuthology.orchestra.run.smithi076.stderr:1+0 records in 2024-06-02T04:43:58.438 INFO:teuthology.orchestra.run.smithi076.stderr:1+0 records out 2024-06-02T04:43:58.438 INFO:teuthology.orchestra.run.smithi076.stderr:512 bytes copied, 0.000285602 s, 1.8 MB/s 2024-06-02T04:43:58.439 DEBUG:teuthology.orchestra.run.smithi076:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-06-02T04:43:58.499 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-06-02T04:43:58.499 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/scratch_devs of=/dev/stdout 2024-06-02T04:43:58.521 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-06-02T04:43:58.521 DEBUG:teuthology.orchestra.run.smithi119:> stat /dev/vg_nvme/lv_1 2024-06-02T04:43:58.581 INFO:teuthology.orchestra.run.smithi119.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-06-02T04:43:58.582 INFO:teuthology.orchestra.run.smithi119.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-02T04:43:58.582 INFO:teuthology.orchestra.run.smithi119.stdout:Device: 6h/6d Inode: 186095 Links: 1 2024-06-02T04:43:58.582 INFO:teuthology.orchestra.run.smithi119.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-02T04:43:58.582 INFO:teuthology.orchestra.run.smithi119.stdout:Context: system_u:object_r:device_t:s0 2024-06-02T04:43:58.582 INFO:teuthology.orchestra.run.smithi119.stdout:Access: 2024-06-02 04:43:45.955156457 +0000 2024-06-02T04:43:58.582 INFO:teuthology.orchestra.run.smithi119.stdout:Modify: 2024-06-02 04:36:53.754291939 +0000 2024-06-02T04:43:58.582 INFO:teuthology.orchestra.run.smithi119.stdout:Change: 2024-06-02 04:36:53.754291939 +0000 2024-06-02T04:43:58.582 INFO:teuthology.orchestra.run.smithi119.stdout: Birth: - 2024-06-02T04:43:58.582 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-06-02T04:43:58.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:58 smithi119 ceph-mon[46633]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi076=x;smithi119=y;smithi192=z", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:43:58.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:58 smithi119 ceph-mon[46633]: Saving service mgr spec with placement smithi076=x;smithi119=y;smithi192=z;count:3 2024-06-02T04:43:58.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:58 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:58.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:58 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:43:58.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:58 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:43:58.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:58 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:43:58.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:58 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:58.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:58 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-02T04:43:58.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:58 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-06-02T04:43:58.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:58 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-02T04:43:58.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:58 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:43:58.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:58 smithi119 ceph-mon[46633]: Deploying daemon mgr.z on smithi192 2024-06-02T04:43:58.625 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records in 2024-06-02T04:43:58.625 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records out 2024-06-02T04:43:58.625 INFO:teuthology.orchestra.run.smithi119.stderr:512 bytes copied, 0.00024139 s, 2.1 MB/s 2024-06-02T04:43:58.626 DEBUG:teuthology.orchestra.run.smithi119:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-06-02T04:43:58.681 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Jun 02 04:43:58 smithi192 systemd[1]: Starting Ceph mgr.z for 60ab6d30-209a-11ef-bc9b-c7b262605968... 2024-06-02T04:43:58.686 DEBUG:teuthology.orchestra.run.smithi119:> stat /dev/vg_nvme/lv_2 2024-06-02T04:43:58.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:58 smithi076 ceph-mon[42935]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi076=x;smithi119=y;smithi192=z", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:43:58.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:58 smithi076 ceph-mon[42935]: Saving service mgr spec with placement smithi076=x;smithi119=y;smithi192=z;count:3 2024-06-02T04:43:58.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:58 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:58.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:58 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:43:58.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:58 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:43:58.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:58 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:43:58.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:58 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:58.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:58 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-02T04:43:58.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:58 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-06-02T04:43:58.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:58 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-02T04:43:58.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:58 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:43:58.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:58 smithi076 ceph-mon[42935]: Deploying daemon mgr.z on smithi192 2024-06-02T04:43:58.745 INFO:teuthology.orchestra.run.smithi119.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-06-02T04:43:58.745 INFO:teuthology.orchestra.run.smithi119.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-02T04:43:58.745 INFO:teuthology.orchestra.run.smithi119.stdout:Device: 6h/6d Inode: 179934 Links: 1 2024-06-02T04:43:58.746 INFO:teuthology.orchestra.run.smithi119.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-02T04:43:58.746 INFO:teuthology.orchestra.run.smithi119.stdout:Context: system_u:object_r:device_t:s0 2024-06-02T04:43:58.746 INFO:teuthology.orchestra.run.smithi119.stdout:Access: 2024-06-02 04:43:45.955156457 +0000 2024-06-02T04:43:58.746 INFO:teuthology.orchestra.run.smithi119.stdout:Modify: 2024-06-02 04:36:54.101283409 +0000 2024-06-02T04:43:58.746 INFO:teuthology.orchestra.run.smithi119.stdout:Change: 2024-06-02 04:36:54.101283409 +0000 2024-06-02T04:43:58.746 INFO:teuthology.orchestra.run.smithi119.stdout: Birth: - 2024-06-02T04:43:58.746 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-06-02T04:43:58.813 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records in 2024-06-02T04:43:58.813 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records out 2024-06-02T04:43:58.813 INFO:teuthology.orchestra.run.smithi119.stderr:512 bytes copied, 0.000222409 s, 2.3 MB/s 2024-06-02T04:43:58.814 DEBUG:teuthology.orchestra.run.smithi119:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-06-02T04:43:58.874 DEBUG:teuthology.orchestra.run.smithi119:> stat /dev/vg_nvme/lv_3 2024-06-02T04:43:58.931 INFO:teuthology.orchestra.run.smithi119.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-06-02T04:43:58.932 INFO:teuthology.orchestra.run.smithi119.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-02T04:43:58.932 INFO:teuthology.orchestra.run.smithi119.stdout:Device: 6h/6d Inode: 186744 Links: 1 2024-06-02T04:43:58.932 INFO:teuthology.orchestra.run.smithi119.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-02T04:43:58.932 INFO:teuthology.orchestra.run.smithi119.stdout:Context: system_u:object_r:device_t:s0 2024-06-02T04:43:58.932 INFO:teuthology.orchestra.run.smithi119.stdout:Access: 2024-06-02 04:43:45.955156457 +0000 2024-06-02T04:43:58.932 INFO:teuthology.orchestra.run.smithi119.stdout:Modify: 2024-06-02 04:36:54.459274608 +0000 2024-06-02T04:43:58.933 INFO:teuthology.orchestra.run.smithi119.stdout:Change: 2024-06-02 04:36:54.459274608 +0000 2024-06-02T04:43:58.933 INFO:teuthology.orchestra.run.smithi119.stdout: Birth: - 2024-06-02T04:43:58.933 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-06-02T04:43:58.998 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records in 2024-06-02T04:43:58.998 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records out 2024-06-02T04:43:58.998 INFO:teuthology.orchestra.run.smithi119.stderr:512 bytes copied, 0.000223584 s, 2.3 MB/s 2024-06-02T04:43:58.999 DEBUG:teuthology.orchestra.run.smithi119:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-06-02T04:43:59.058 DEBUG:teuthology.orchestra.run.smithi119:> stat /dev/vg_nvme/lv_4 2024-06-02T04:43:59.115 INFO:teuthology.orchestra.run.smithi119.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-06-02T04:43:59.115 INFO:teuthology.orchestra.run.smithi119.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-02T04:43:59.115 INFO:teuthology.orchestra.run.smithi119.stdout:Device: 6h/6d Inode: 189788 Links: 1 2024-06-02T04:43:59.115 INFO:teuthology.orchestra.run.smithi119.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-02T04:43:59.115 INFO:teuthology.orchestra.run.smithi119.stdout:Context: system_u:object_r:device_t:s0 2024-06-02T04:43:59.115 INFO:teuthology.orchestra.run.smithi119.stdout:Access: 2024-06-02 04:43:45.956156432 +0000 2024-06-02T04:43:59.116 INFO:teuthology.orchestra.run.smithi119.stdout:Modify: 2024-06-02 04:36:54.811265955 +0000 2024-06-02T04:43:59.116 INFO:teuthology.orchestra.run.smithi119.stdout:Change: 2024-06-02 04:36:54.811265955 +0000 2024-06-02T04:43:59.116 INFO:teuthology.orchestra.run.smithi119.stdout: Birth: - 2024-06-02T04:43:59.116 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-06-02T04:43:59.182 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records in 2024-06-02T04:43:59.182 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records out 2024-06-02T04:43:59.182 INFO:teuthology.orchestra.run.smithi119.stderr:512 bytes copied, 0.000255747 s, 2.0 MB/s 2024-06-02T04:43:59.183 DEBUG:teuthology.orchestra.run.smithi119:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-06-02T04:43:59.242 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-06-02T04:43:59.242 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/scratch_devs of=/dev/stdout 2024-06-02T04:43:59.262 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-06-02T04:43:59.262 DEBUG:teuthology.orchestra.run.smithi192:> stat /dev/vg_nvme/lv_1 2024-06-02T04:43:59.316 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Jun 02 04:43:58 smithi192 ceph-mgr[49819]: -- 172.21.15.192:0/458391656 <== mon.1 v2:172.21.15.192:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55cc4d6061a0 con 0x55cc4d5dd000 2024-06-02T04:43:59.316 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Jun 02 04:43:58 smithi192 bash[49781]: 52f48ba77660f58868154d32aea7210e23e15ca936395ae05839a15670f8ef07 2024-06-02T04:43:59.316 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Jun 02 04:43:58 smithi192 systemd[1]: Started Ceph mgr.z for 60ab6d30-209a-11ef-bc9b-c7b262605968. 2024-06-02T04:43:59.321 INFO:teuthology.orchestra.run.smithi192.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-06-02T04:43:59.322 INFO:teuthology.orchestra.run.smithi192.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-02T04:43:59.322 INFO:teuthology.orchestra.run.smithi192.stdout:Device: 6h/6d Inode: 187026 Links: 1 2024-06-02T04:43:59.322 INFO:teuthology.orchestra.run.smithi192.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-02T04:43:59.322 INFO:teuthology.orchestra.run.smithi192.stdout:Context: system_u:object_r:device_t:s0 2024-06-02T04:43:59.322 INFO:teuthology.orchestra.run.smithi192.stdout:Access: 2024-06-02 04:43:58.561204767 +0000 2024-06-02T04:43:59.322 INFO:teuthology.orchestra.run.smithi192.stdout:Modify: 2024-06-02 04:36:36.514921334 +0000 2024-06-02T04:43:59.322 INFO:teuthology.orchestra.run.smithi192.stdout:Change: 2024-06-02 04:36:36.514921334 +0000 2024-06-02T04:43:59.322 INFO:teuthology.orchestra.run.smithi192.stdout: Birth: - 2024-06-02T04:43:59.323 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-06-02T04:43:59.391 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records in 2024-06-02T04:43:59.392 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records out 2024-06-02T04:43:59.392 INFO:teuthology.orchestra.run.smithi192.stderr:512 bytes copied, 0.000259886 s, 2.0 MB/s 2024-06-02T04:43:59.393 DEBUG:teuthology.orchestra.run.smithi192:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-06-02T04:43:59.453 DEBUG:teuthology.orchestra.run.smithi192:> stat /dev/vg_nvme/lv_2 2024-06-02T04:43:59.512 INFO:teuthology.orchestra.run.smithi192.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-06-02T04:43:59.513 INFO:teuthology.orchestra.run.smithi192.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-02T04:43:59.513 INFO:teuthology.orchestra.run.smithi192.stdout:Device: 6h/6d Inode: 175990 Links: 1 2024-06-02T04:43:59.513 INFO:teuthology.orchestra.run.smithi192.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-02T04:43:59.513 INFO:teuthology.orchestra.run.smithi192.stdout:Context: system_u:object_r:device_t:s0 2024-06-02T04:43:59.513 INFO:teuthology.orchestra.run.smithi192.stdout:Access: 2024-06-02 04:43:58.561204767 +0000 2024-06-02T04:43:59.513 INFO:teuthology.orchestra.run.smithi192.stdout:Modify: 2024-06-02 04:36:36.871914393 +0000 2024-06-02T04:43:59.513 INFO:teuthology.orchestra.run.smithi192.stdout:Change: 2024-06-02 04:36:36.871914393 +0000 2024-06-02T04:43:59.513 INFO:teuthology.orchestra.run.smithi192.stdout: Birth: - 2024-06-02T04:43:59.513 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-06-02T04:43:59.579 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Jun 02 04:43:59 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-z[49796]: 2024-06-02T04:43:59.364+0000 7feeb707a200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-06-02T04:43:59.579 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Jun 02 04:43:59 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-z[49796]: 2024-06-02T04:43:59.464+0000 7feeb707a200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-06-02T04:43:59.579 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Jun 02 04:43:59 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-z[49796]: 2024-06-02T04:43:59.555+0000 7feeb707a200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-06-02T04:43:59.579 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:59 smithi192 ceph-mon[47933]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T04:43:59.580 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:59 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:59.580 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:59 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:59.580 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:59 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:59.580 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:59 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-02T04:43:59.580 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:59 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-06-02T04:43:59.580 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:59 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-02T04:43:59.580 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:43:59 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:43:59.581 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records in 2024-06-02T04:43:59.581 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records out 2024-06-02T04:43:59.582 INFO:teuthology.orchestra.run.smithi192.stderr:512 bytes copied, 0.000210365 s, 2.4 MB/s 2024-06-02T04:43:59.583 DEBUG:teuthology.orchestra.run.smithi192:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-06-02T04:43:59.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:59 smithi119 ceph-mon[46633]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T04:43:59.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:59 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:59.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:59 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:59.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:59 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:59.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:59 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-02T04:43:59.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:59 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-06-02T04:43:59.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:59 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-02T04:43:59.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:43:59 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:43:59.643 DEBUG:teuthology.orchestra.run.smithi192:> stat /dev/vg_nvme/lv_3 2024-06-02T04:43:59.702 INFO:teuthology.orchestra.run.smithi192.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-06-02T04:43:59.702 INFO:teuthology.orchestra.run.smithi192.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-02T04:43:59.702 INFO:teuthology.orchestra.run.smithi192.stdout:Device: 6h/6d Inode: 184968 Links: 1 2024-06-02T04:43:59.702 INFO:teuthology.orchestra.run.smithi192.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-02T04:43:59.703 INFO:teuthology.orchestra.run.smithi192.stdout:Context: system_u:object_r:device_t:s0 2024-06-02T04:43:59.703 INFO:teuthology.orchestra.run.smithi192.stdout:Access: 2024-06-02 04:43:58.561204767 +0000 2024-06-02T04:43:59.703 INFO:teuthology.orchestra.run.smithi192.stdout:Modify: 2024-06-02 04:36:37.185908288 +0000 2024-06-02T04:43:59.703 INFO:teuthology.orchestra.run.smithi192.stdout:Change: 2024-06-02 04:36:37.185908288 +0000 2024-06-02T04:43:59.703 INFO:teuthology.orchestra.run.smithi192.stdout: Birth: - 2024-06-02T04:43:59.703 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-06-02T04:43:59.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:59 smithi076 ceph-mon[42935]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T04:43:59.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:59 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:59.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:59 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:59.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:59 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:43:59.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:59 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-02T04:43:59.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:59 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-06-02T04:43:59.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:59 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-02T04:43:59.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:43:59 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:43:59.769 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records in 2024-06-02T04:43:59.770 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records out 2024-06-02T04:43:59.770 INFO:teuthology.orchestra.run.smithi192.stderr:512 bytes copied, 0.000194977 s, 2.6 MB/s 2024-06-02T04:43:59.771 DEBUG:teuthology.orchestra.run.smithi192:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-06-02T04:43:59.831 DEBUG:teuthology.orchestra.run.smithi192:> stat /dev/vg_nvme/lv_4 2024-06-02T04:43:59.889 INFO:teuthology.orchestra.run.smithi192.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-06-02T04:43:59.889 INFO:teuthology.orchestra.run.smithi192.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-02T04:43:59.889 INFO:teuthology.orchestra.run.smithi192.stdout:Device: 6h/6d Inode: 187993 Links: 1 2024-06-02T04:43:59.889 INFO:teuthology.orchestra.run.smithi192.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-02T04:43:59.889 INFO:teuthology.orchestra.run.smithi192.stdout:Context: system_u:object_r:device_t:s0 2024-06-02T04:43:59.890 INFO:teuthology.orchestra.run.smithi192.stdout:Access: 2024-06-02 04:43:58.561204767 +0000 2024-06-02T04:43:59.890 INFO:teuthology.orchestra.run.smithi192.stdout:Modify: 2024-06-02 04:36:37.536901464 +0000 2024-06-02T04:43:59.890 INFO:teuthology.orchestra.run.smithi192.stdout:Change: 2024-06-02 04:36:37.536901464 +0000 2024-06-02T04:43:59.890 INFO:teuthology.orchestra.run.smithi192.stdout: Birth: - 2024-06-02T04:43:59.890 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-06-02T04:43:59.932 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Jun 02 04:43:59 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-z[49796]: 2024-06-02T04:43:59.647+0000 7feeb707a200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-06-02T04:43:59.955 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records in 2024-06-02T04:43:59.955 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records out 2024-06-02T04:43:59.955 INFO:teuthology.orchestra.run.smithi192.stderr:512 bytes copied, 0.000215186 s, 2.4 MB/s 2024-06-02T04:43:59.957 DEBUG:teuthology.orchestra.run.smithi192:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-06-02T04:44:00.014 INFO:tasks.cephadm:Deploying osd.0 on smithi076 with /dev/vg_nvme/lv_4... 2024-06-02T04:44:00.015 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 60ab6d30-209a-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-06-02T04:44:00.243 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T04:44:00.450 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:00 smithi119 ceph-mon[46633]: Deploying daemon mgr.y on smithi119 2024-06-02T04:44:00.450 INFO:journalctl@ceph.mgr.y.smithi119.stdout:Jun 02 04:44:00 smithi119 systemd[1]: Starting Ceph mgr.y for 60ab6d30-209a-11ef-bc9b-c7b262605968... 2024-06-02T04:44:00.559 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:00 smithi192 ceph-mon[47933]: Deploying daemon mgr.y on smithi119 2024-06-02T04:44:00.560 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Jun 02 04:44:00 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-z[49796]: 2024-06-02T04:44:00.308+0000 7feeb707a200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-06-02T04:44:00.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:00 smithi076 ceph-mon[42935]: Deploying daemon mgr.y on smithi119 2024-06-02T04:44:00.846 INFO:journalctl@ceph.mgr.y.smithi119.stdout:Jun 02 04:44:00 smithi119 ceph-mgr[48138]: -- 172.21.15.119:0/2578145839 <== mon.2 v2:172.21.15.119:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x555a5d4621a0 con 0x555a5d439000 2024-06-02T04:44:00.846 INFO:journalctl@ceph.mgr.y.smithi119.stdout:Jun 02 04:44:00 smithi119 bash[48100]: 1e908e3a1b89e7748e05445428274ccff3c47cd029e8562d1d2bd6ac28998568 2024-06-02T04:44:00.846 INFO:journalctl@ceph.mgr.y.smithi119.stdout:Jun 02 04:44:00 smithi119 systemd[1]: Started Ceph mgr.y for 60ab6d30-209a-11ef-bc9b-c7b262605968. 2024-06-02T04:44:00.925 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Jun 02 04:44:00 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-z[49796]: 2024-06-02T04:44:00.560+0000 7feeb707a200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-06-02T04:44:00.925 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Jun 02 04:44:00 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-z[49796]: 2024-06-02T04:44:00.644+0000 7feeb707a200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-06-02T04:44:00.925 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Jun 02 04:44:00 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-z[49796]: 2024-06-02T04:44:00.754+0000 7feeb707a200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-06-02T04:44:00.925 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Jun 02 04:44:00 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-z[49796]: 2024-06-02T04:44:00.926+0000 7feeb707a200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-06-02T04:44:01.181 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Jun 02 04:44:01 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-z[49796]: 2024-06-02T04:44:01.064+0000 7feeb707a200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-06-02T04:44:01.181 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Jun 02 04:44:01 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-z[49796]: 2024-06-02T04:44:01.162+0000 7feeb707a200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-06-02T04:44:01.322 INFO:journalctl@ceph.mgr.y.smithi119.stdout:Jun 02 04:44:01 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-y[48115]: 2024-06-02T04:44:01.038+0000 7fcb9a310200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-06-02T04:44:01.322 INFO:journalctl@ceph.mgr.y.smithi119.stdout:Jun 02 04:44:01 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-y[48115]: 2024-06-02T04:44:01.143+0000 7fcb9a310200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-06-02T04:44:01.322 INFO:journalctl@ceph.mgr.y.smithi119.stdout:Jun 02 04:44:01 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-y[48115]: 2024-06-02T04:44:01.240+0000 7fcb9a310200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-06-02T04:44:01.553 INFO:teuthology.orchestra.run.smithi076.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-06-02T04:44:01.553 INFO:teuthology.orchestra.run.smithi076.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-06-02T04:44:01.553 INFO:teuthology.orchestra.run.smithi076.stderr: stderr: 10+0 records in 2024-06-02T04:44:01.553 INFO:teuthology.orchestra.run.smithi076.stderr:10+0 records out 2024-06-02T04:44:01.553 INFO:teuthology.orchestra.run.smithi076.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0113448 s, 924 MB/s 2024-06-02T04:44:01.553 INFO:teuthology.orchestra.run.smithi076.stderr:--> Zapping successful for: 2024-06-02T04:44:01.594 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:01 smithi076 ceph-mon[42935]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T04:44:01.594 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:01 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:01.594 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:01 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:01.594 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:01 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:01.594 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:01 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:01.594 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:01 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:44:01.594 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:01 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:01.596 INFO:journalctl@ceph.mgr.y.smithi119.stdout:Jun 02 04:44:01 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-y[48115]: 2024-06-02T04:44:01.331+0000 7fcb9a310200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-06-02T04:44:01.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:01 smithi119 ceph-mon[46633]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T04:44:01.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:01 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:01.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:01 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:01.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:01 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:01.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:01 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:01.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:01 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:44:01.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:01 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:01.681 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Jun 02 04:44:01 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-z[49796]: 2024-06-02T04:44:01.564+0000 7feeb707a200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-06-02T04:44:01.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:01 smithi192 ceph-mon[47933]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T04:44:01.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:01 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:01.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:01 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:01.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:01 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:01.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:01 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:01.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:01 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:44:01.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:01 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:01.923 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 60ab6d30-209a-11ef-bc9b-c7b262605968 -- ceph orch daemon add osd smithi076:vg_nvme/lv_4 2024-06-02T04:44:02.239 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Jun 02 04:44:01 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-z[49796]: 2024-06-02T04:44:01.955+0000 7feeb707a200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-06-02T04:44:02.240 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Jun 02 04:44:02 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-z[49796]: 2024-06-02T04:44:02.148+0000 7feeb707a200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-06-02T04:44:02.240 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Jun 02 04:44:02 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-z[49796]: 2024-06-02T04:44:02.240+0000 7feeb707a200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-06-02T04:44:02.328 INFO:journalctl@ceph.mgr.y.smithi119.stdout:Jun 02 04:44:01 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-y[48115]: 2024-06-02T04:44:01.994+0000 7fcb9a310200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-06-02T04:44:02.328 INFO:journalctl@ceph.mgr.y.smithi119.stdout:Jun 02 04:44:02 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-y[48115]: 2024-06-02T04:44:02.243+0000 7fcb9a310200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-06-02T04:44:02.328 INFO:journalctl@ceph.mgr.y.smithi119.stdout:Jun 02 04:44:02 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-y[48115]: 2024-06-02T04:44:02.328+0000 7fcb9a310200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-06-02T04:44:02.359 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T04:44:02.596 INFO:journalctl@ceph.mgr.y.smithi119.stdout:Jun 02 04:44:02 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-y[48115]: 2024-06-02T04:44:02.439+0000 7fcb9a310200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-06-02T04:44:02.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:02 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:02.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:02 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:02.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:02 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:02.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:02 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:02.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:02 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:44:02.598 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:02 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:44:02.598 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:02 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:02.598 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:02 smithi119 ceph-mon[46633]: Reconfiguring mgr.x (unknown last config time)... 2024-06-02T04:44:02.598 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:02 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-02T04:44:02.598 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:02 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-02T04:44:02.598 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:02 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:44:02.599 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:02 smithi119 ceph-mon[46633]: Reconfiguring daemon mgr.x on smithi076 2024-06-02T04:44:02.599 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:02 smithi119 ceph-mon[46633]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T04:44:02.837 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:02 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:02.838 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:02 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:02.838 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:02 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:02.838 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:02 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:02.838 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:02 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:44:02.838 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:02 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:44:02.838 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:02 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:02.838 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:02 smithi076 ceph-mon[42935]: Reconfiguring mgr.x (unknown last config time)... 2024-06-02T04:44:02.838 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:02 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-02T04:44:02.838 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:02 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-02T04:44:02.838 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:02 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:44:02.838 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:02 smithi076 ceph-mon[42935]: Reconfiguring daemon mgr.x on smithi076 2024-06-02T04:44:02.838 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:02 smithi076 ceph-mon[42935]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T04:44:02.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:02 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:02.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:02 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:02.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:02 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:02.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:02 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:02.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:02 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:44:02.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:02 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:44:02.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:02 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:02.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:02 smithi192 ceph-mon[47933]: Reconfiguring mgr.x (unknown last config time)... 2024-06-02T04:44:02.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:02 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-02T04:44:02.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:02 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-02T04:44:02.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:02 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:44:02.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:02 smithi192 ceph-mon[47933]: Reconfiguring daemon mgr.x on smithi076 2024-06-02T04:44:02.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:02 smithi192 ceph-mon[47933]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T04:44:03.096 INFO:journalctl@ceph.mgr.y.smithi119.stdout:Jun 02 04:44:02 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-y[48115]: 2024-06-02T04:44:02.607+0000 7fcb9a310200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-06-02T04:44:03.096 INFO:journalctl@ceph.mgr.y.smithi119.stdout:Jun 02 04:44:02 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-y[48115]: 2024-06-02T04:44:02.737+0000 7fcb9a310200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-06-02T04:44:03.096 INFO:journalctl@ceph.mgr.y.smithi119.stdout:Jun 02 04:44:02 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-y[48115]: 2024-06-02T04:44:02.825+0000 7fcb9a310200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-06-02T04:44:03.431 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Jun 02 04:44:03 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-z[49796]: 2024-06-02T04:44:03.008+0000 7feeb707a200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-06-02T04:44:03.431 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Jun 02 04:44:03 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-z[49796]: 2024-06-02T04:44:03.104+0000 7feeb707a200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-06-02T04:44:03.431 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Jun 02 04:44:03 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-z[49796]: 2024-06-02T04:44:03.250+0000 7feeb707a200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-06-02T04:44:03.535 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:44:03.532+0000 7f58d4094700 1 -- 172.21.15.76:0/1835621074 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f58cc101060 msgr2=0x7f58cc1014e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:44:03.535 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:44:03.532+0000 7f58d4094700 1 --2- 172.21.15.76:0/1835621074 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f58cc101060 0x7f58cc1014e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f58c8009990 tx=0x7f58c8009ca0 comp rx=0 tx=0).stop 2024-06-02T04:44:03.535 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:44:03.532+0000 7f58d4094700 1 -- 172.21.15.76:0/1835621074 shutdown_connections 2024-06-02T04:44:03.535 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:44:03.532+0000 7f58d4094700 1 --2- 172.21.15.76:0/1835621074 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f58cc101a20 0x7f58cc108340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:44:03.535 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:44:03.532+0000 7f58d4094700 1 --2- 172.21.15.76:0/1835621074 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f58cc0fff00 0x7f58cc100320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:44:03.535 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:44:03.532+0000 7f58d4094700 1 --2- 172.21.15.76:0/1835621074 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f58cc101060 0x7f58cc1014e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:44:03.535 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:44:03.532+0000 7f58d4094700 1 -- 172.21.15.76:0/1835621074 >> 172.21.15.76:0/1835621074 conn(0x7f58cc0fb4c0 msgr2=0x7f58cc0fd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:44:03.536 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:44:03.532+0000 7f58d4094700 1 -- 172.21.15.76:0/1835621074 shutdown_connections 2024-06-02T04:44:03.536 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:44:03.532+0000 7f58d4094700 1 -- 172.21.15.76:0/1835621074 wait complete. 2024-06-02T04:44:03.536 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:44:03.533+0000 7f58d4094700 1 Processor -- start 2024-06-02T04:44:03.536 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:44:03.533+0000 7f58d4094700 1 -- start start 2024-06-02T04:44:03.536 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:44:03.533+0000 7f58d4094700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f58cc0fff00 0x7f58cc069cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:44:03.536 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:44:03.533+0000 7f58d4094700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f58cc101060 0x7f58cc19bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:44:03.536 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:44:03.533+0000 7f58d4094700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f58cc101a20 0x7f58cc19e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:44:03.536 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:44:03.533+0000 7f58d4094700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58cc19e940 con 0x7f58cc101060 2024-06-02T04:44:03.536 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:44:03.533+0000 7f58d4094700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58cc19eab0 con 0x7f58cc0fff00 2024-06-02T04:44:03.536 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:44:03.533+0000 7f58d4094700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58cc19ec70 con 0x7f58cc101a20 2024-06-02T04:44:03.537 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:44:03.533+0000 7f58d162f700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f58cc101060 0x7f58cc19bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:44:03.537 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:44:03.533+0000 7f58d1e30700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f58cc0fff00 0x7f58cc069cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:44:03.537 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:44:03.533+0000 7f58d162f700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f58cc101060 0x7f58cc19bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:51736/0 (socket says 172.21.15.76:51736) 2024-06-02T04:44:03.537 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:44:03.533+0000 7f58d162f700 1 -- 172.21.15.76:0/3155272865 learned_addr learned my addr 172.21.15.76:0/3155272865 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:44:03.537 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:44:03.533+0000 7f58d2631700 1 --2- 172.21.15.76:0/3155272865 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f58cc101a20 0x7f58cc19e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:44:03.537 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:44:03.533+0000 7f58d162f700 1 -- 172.21.15.76:0/3155272865 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f58cc101a20 msgr2=0x7f58cc19e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:44:03.537 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:44:03.533+0000 7f58d162f700 1 --2- 172.21.15.76:0/3155272865 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f58cc101a20 0x7f58cc19e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:44:03.537 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:44:03.533+0000 7f58d162f700 1 -- 172.21.15.76:0/3155272865 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f58cc0fff00 msgr2=0x7f58cc069cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:44:03.537 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:44:03.533+0000 7f58d162f700 1 --2- 172.21.15.76:0/3155272865 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f58cc0fff00 0x7f58cc069cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:44:03.537 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:44:03.533+0000 7f58d162f700 1 -- 172.21.15.76:0/3155272865 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58c80095f0 con 0x7f58cc101060 2024-06-02T04:44:03.537 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:44:03.533+0000 7f58d1e30700 1 --2- 172.21.15.76:0/3155272865 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f58cc0fff00 0x7f58cc069cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T04:44:03.537 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:44:03.534+0000 7f58d162f700 1 --2- 172.21.15.76:0/3155272865 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f58cc101060 0x7f58cc19bbf0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f58c8000c00 tx=0x7f58c8005b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:44:03.537 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:44:03.534+0000 7f58c2ffd700 1 -- 172.21.15.76:0/3155272865 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c801d070 con 0x7f58cc101060 2024-06-02T04:44:03.538 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:44:03.534+0000 7f58c2ffd700 1 -- 172.21.15.76:0/3155272865 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f58c800bd10 con 0x7f58cc101060 2024-06-02T04:44:03.538 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:44:03.534+0000 7f58d4094700 1 -- 172.21.15.76:0/3155272865 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58cc19eef0 con 0x7f58cc101060 2024-06-02T04:44:03.538 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:44:03.534+0000 7f58c2ffd700 1 -- 172.21.15.76:0/3155272865 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c8022b90 con 0x7f58cc101060 2024-06-02T04:44:03.538 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:44:03.534+0000 7f58d4094700 1 -- 172.21.15.76:0/3155272865 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58cc19f300 con 0x7f58cc101060 2024-06-02T04:44:03.538 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:44:03.535+0000 7f58c2ffd700 1 -- 172.21.15.76:0/3155272865 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7f58c800f460 con 0x7f58cc101060 2024-06-02T04:44:03.538 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:44:03.535+0000 7f58d4094700 1 -- 172.21.15.76:0/3155272865 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58cc107410 con 0x7f58cc101060 2024-06-02T04:44:03.538 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:44:03.535+0000 7f58c2ffd700 1 --2- 172.21.15.76:0/3155272865 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f58b80389d0 0x7f58b803ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:44:03.538 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:44:03.535+0000 7f58c2ffd700 1 -- 172.21.15.76:0/3155272865 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f58c804c940 con 0x7f58cc101060 2024-06-02T04:44:03.538 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:44:03.535+0000 7f58d1e30700 1 --2- 172.21.15.76:0/3155272865 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f58b80389d0 0x7f58b803ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:44:03.539 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:44:03.535+0000 7f58d1e30700 1 --2- 172.21.15.76:0/3155272865 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f58b80389d0 0x7f58b803ae90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f58bc005950 tx=0x7f58bc00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:44:03.540 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:44:03.540+0000 7f58c2ffd700 1 -- 172.21.15.76:0/3155272865 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f58c8016990 con 0x7f58cc101060 2024-06-02T04:44:03.595 INFO:journalctl@ceph.mgr.y.smithi119.stdout:Jun 02 04:44:03 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-y[48115]: 2024-06-02T04:44:03.194+0000 7fcb9a310200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-06-02T04:44:03.741 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:44:03.741+0000 7f58d4094700 1 -- 172.21.15.76:0/3155272865 --> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi076:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f58cc02cf00 con 0x7f58b80389d0 2024-06-02T04:44:03.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:03 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:03.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:03 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:03.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:03 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:44:03.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:03 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:44:03.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:03 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:44:03.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:03 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:03.846 INFO:journalctl@ceph.mgr.y.smithi119.stdout:Jun 02 04:44:03 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-y[48115]: 2024-06-02T04:44:03.595+0000 7fcb9a310200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-06-02T04:44:03.847 INFO:journalctl@ceph.mgr.y.smithi119.stdout:Jun 02 04:44:03 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-y[48115]: 2024-06-02T04:44:03.788+0000 7fcb9a310200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-06-02T04:44:03.931 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Jun 02 04:44:03 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-z[49796]: 2024-06-02T04:44:03.879+0000 7feeb707a200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-06-02T04:44:03.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:03 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:03.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:03 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:03.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:03 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:44:03.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:03 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:44:03.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:03 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:44:03.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:03 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:03.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:03 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:03.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:03 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:03.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:03 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:44:03.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:03 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:44:03.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:03 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:44:03.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:03 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:04.345 INFO:journalctl@ceph.mgr.y.smithi119.stdout:Jun 02 04:44:03 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-y[48115]: 2024-06-02T04:44:03.881+0000 7fcb9a310200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-06-02T04:44:04.431 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Jun 02 04:44:04 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-z[49796]: 2024-06-02T04:44:04.059+0000 7feeb707a200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-06-02T04:44:04.431 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Jun 02 04:44:04 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-z[49796]: 2024-06-02T04:44:04.250+0000 7feeb707a200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-06-02T04:44:04.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:04 smithi076 ceph-mon[42935]: from='client.14220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi076:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:44:04.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:04 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T04:44:04.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:04 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T04:44:04.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:04 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:44:04.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:04 smithi076 ceph-mon[42935]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T04:44:04.899 INFO:journalctl@ceph.mgr.y.smithi119.stdout:Jun 02 04:44:04 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-y[48115]: 2024-06-02T04:44:04.656+0000 7fcb9a310200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-06-02T04:44:04.899 INFO:journalctl@ceph.mgr.y.smithi119.stdout:Jun 02 04:44:04 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-y[48115]: 2024-06-02T04:44:04.752+0000 7fcb9a310200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-06-02T04:44:04.900 INFO:journalctl@ceph.mgr.y.smithi119.stdout:Jun 02 04:44:04 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-y[48115]: 2024-06-02T04:44:04.899+0000 7fcb9a310200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-06-02T04:44:04.900 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:04 smithi119 ceph-mon[46633]: from='client.14220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi076:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:44:04.900 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:04 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T04:44:04.900 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:04 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T04:44:04.900 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:04 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:44:04.900 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:04 smithi119 ceph-mon[46633]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T04:44:04.933 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:04 smithi192 ceph-mon[47933]: from='client.14220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi076:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:44:04.933 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:04 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T04:44:04.933 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:04 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T04:44:04.933 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:04 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:44:04.933 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:04 smithi192 ceph-mon[47933]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T04:44:05.431 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Jun 02 04:44:05 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-z[49796]: 2024-06-02T04:44:05.181+0000 7feeb707a200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-06-02T04:44:05.740 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:05 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/1965454396' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "33a51ba2-be5c-41d0-b5d1-8d6039f2ca4c"}]: dispatch 2024-06-02T04:44:05.740 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:05 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/1965454396' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "33a51ba2-be5c-41d0-b5d1-8d6039f2ca4c"}]': finished 2024-06-02T04:44:05.740 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:05 smithi192 ceph-mon[47933]: osdmap e5: 1 total, 0 up, 1 in 2024-06-02T04:44:05.740 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:05 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-02T04:44:05.741 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Jun 02 04:44:05 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-z[49796]: 2024-06-02T04:44:05.464+0000 7feeb707a200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-06-02T04:44:05.741 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Jun 02 04:44:05 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-z[49796]: 2024-06-02T04:44:05.551+0000 7feeb707a200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-06-02T04:44:05.741 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Jun 02 04:44:05 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-z[49796]: 2024-06-02T04:44:05.740+0000 7feeb707a200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-06-02T04:44:05.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:05 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/1965454396' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "33a51ba2-be5c-41d0-b5d1-8d6039f2ca4c"}]: dispatch 2024-06-02T04:44:05.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:05 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/1965454396' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "33a51ba2-be5c-41d0-b5d1-8d6039f2ca4c"}]': finished 2024-06-02T04:44:05.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:05 smithi119 ceph-mon[46633]: osdmap e5: 1 total, 0 up, 1 in 2024-06-02T04:44:05.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:05 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-02T04:44:05.846 INFO:journalctl@ceph.mgr.y.smithi119.stdout:Jun 02 04:44:05 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-y[48115]: 2024-06-02T04:44:05.549+0000 7fcb9a310200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-06-02T04:44:05.846 INFO:journalctl@ceph.mgr.y.smithi119.stdout:Jun 02 04:44:05 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-y[48115]: 2024-06-02T04:44:05.729+0000 7fcb9a310200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-06-02T04:44:05.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:05 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/1965454396' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "33a51ba2-be5c-41d0-b5d1-8d6039f2ca4c"}]: dispatch 2024-06-02T04:44:05.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:05 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/1965454396' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "33a51ba2-be5c-41d0-b5d1-8d6039f2ca4c"}]': finished 2024-06-02T04:44:05.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:05 smithi076 ceph-mon[42935]: osdmap e5: 1 total, 0 up, 1 in 2024-06-02T04:44:05.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:05 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-02T04:44:06.346 INFO:journalctl@ceph.mgr.y.smithi119.stdout:Jun 02 04:44:05 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-y[48115]: 2024-06-02T04:44:05.922+0000 7fcb9a310200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-06-02T04:44:06.658 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:44:06.658+0000 7f58c2ffd700 1 -- 172.21.15.76:0/3155272865 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mgrmap(e 14) v1 ==== 90707+0+0 (secure 0 0 0) 0x7f58c802c440 con 0x7f58cc101060 2024-06-02T04:44:06.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:06 smithi192 ceph-mon[47933]: Standby manager daemon z started 2024-06-02T04:44:06.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:06 smithi192 ceph-mon[47933]: from='mgr.? 172.21.15.192:0/788860110' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-06-02T04:44:06.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:06 smithi192 ceph-mon[47933]: from='mgr.? 172.21.15.192:0/788860110' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-02T04:44:06.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:06 smithi192 ceph-mon[47933]: from='mgr.? 172.21.15.192:0/788860110' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-06-02T04:44:06.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:06 smithi192 ceph-mon[47933]: from='mgr.? 172.21.15.192:0/788860110' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-02T04:44:06.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:06 smithi192 ceph-mon[47933]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T04:44:06.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:06 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/3847337954' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T04:44:06.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:06 smithi076 ceph-mon[42935]: Standby manager daemon z started 2024-06-02T04:44:06.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:06 smithi076 ceph-mon[42935]: from='mgr.? 172.21.15.192:0/788860110' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-06-02T04:44:06.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:06 smithi076 ceph-mon[42935]: from='mgr.? 172.21.15.192:0/788860110' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-02T04:44:06.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:06 smithi076 ceph-mon[42935]: from='mgr.? 172.21.15.192:0/788860110' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-06-02T04:44:06.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:06 smithi076 ceph-mon[42935]: from='mgr.? 172.21.15.192:0/788860110' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-02T04:44:06.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:06 smithi076 ceph-mon[42935]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T04:44:06.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:06 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/3847337954' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T04:44:07.096 INFO:journalctl@ceph.mgr.y.smithi119.stdout:Jun 02 04:44:06 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-y[48115]: 2024-06-02T04:44:06.846+0000 7fcb9a310200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-06-02T04:44:07.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:06 smithi119 ceph-mon[46633]: Standby manager daemon z started 2024-06-02T04:44:07.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:06 smithi119 ceph-mon[46633]: from='mgr.? 172.21.15.192:0/788860110' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-06-02T04:44:07.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:06 smithi119 ceph-mon[46633]: from='mgr.? 172.21.15.192:0/788860110' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-02T04:44:07.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:06 smithi119 ceph-mon[46633]: from='mgr.? 172.21.15.192:0/788860110' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-06-02T04:44:07.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:06 smithi119 ceph-mon[46633]: from='mgr.? 172.21.15.192:0/788860110' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-02T04:44:07.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:06 smithi119 ceph-mon[46633]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T04:44:07.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:06 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/3847337954' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T04:44:07.403 INFO:journalctl@ceph.mgr.y.smithi119.stdout:Jun 02 04:44:07 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-y[48115]: 2024-06-02T04:44:07.129+0000 7fcb9a310200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-06-02T04:44:07.404 INFO:journalctl@ceph.mgr.y.smithi119.stdout:Jun 02 04:44:07 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-y[48115]: 2024-06-02T04:44:07.216+0000 7fcb9a310200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-06-02T04:44:07.404 INFO:journalctl@ceph.mgr.y.smithi119.stdout:Jun 02 04:44:07 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-y[48115]: 2024-06-02T04:44:07.403+0000 7fcb9a310200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-06-02T04:44:07.665 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:44:07.665+0000 7f58c2ffd700 1 -- 172.21.15.76:0/3155272865 <== mon.0 v2:172.21.15.76:3300/0 8 ==== mgrmap(e 15) v1 ==== 135817+0+0 (secure 0 0 0) 0x7f58c8016bc0 con 0x7f58cc101060 2024-06-02T04:44:07.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:07 smithi192 ceph-mon[47933]: mgrmap e14: x(active, since 60s), standbys: z 2024-06-02T04:44:07.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:07 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-06-02T04:44:07.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:07 smithi192 ceph-mon[47933]: Standby manager daemon y started 2024-06-02T04:44:07.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:07 smithi192 ceph-mon[47933]: from='mgr.? 172.21.15.119:0/481411567' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-06-02T04:44:07.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:07 smithi192 ceph-mon[47933]: from='mgr.? 172.21.15.119:0/481411567' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-02T04:44:07.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:07 smithi192 ceph-mon[47933]: from='mgr.? 172.21.15.119:0/481411567' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-06-02T04:44:07.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:07 smithi192 ceph-mon[47933]: from='mgr.? 172.21.15.119:0/481411567' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-02T04:44:07.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:07 smithi076 ceph-mon[42935]: mgrmap e14: x(active, since 60s), standbys: z 2024-06-02T04:44:07.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:07 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-06-02T04:44:07.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:07 smithi076 ceph-mon[42935]: Standby manager daemon y started 2024-06-02T04:44:07.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:07 smithi076 ceph-mon[42935]: from='mgr.? 172.21.15.119:0/481411567' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-06-02T04:44:07.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:07 smithi076 ceph-mon[42935]: from='mgr.? 172.21.15.119:0/481411567' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-02T04:44:07.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:07 smithi076 ceph-mon[42935]: from='mgr.? 172.21.15.119:0/481411567' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-06-02T04:44:07.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:07 smithi076 ceph-mon[42935]: from='mgr.? 172.21.15.119:0/481411567' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-02T04:44:08.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:07 smithi119 ceph-mon[46633]: mgrmap e14: x(active, since 60s), standbys: z 2024-06-02T04:44:08.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:07 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-06-02T04:44:08.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:07 smithi119 ceph-mon[46633]: Standby manager daemon y started 2024-06-02T04:44:08.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:07 smithi119 ceph-mon[46633]: from='mgr.? 172.21.15.119:0/481411567' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-06-02T04:44:08.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:07 smithi119 ceph-mon[46633]: from='mgr.? 172.21.15.119:0/481411567' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-02T04:44:08.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:07 smithi119 ceph-mon[46633]: from='mgr.? 172.21.15.119:0/481411567' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-06-02T04:44:08.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:07 smithi119 ceph-mon[46633]: from='mgr.? 172.21.15.119:0/481411567' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-02T04:44:08.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:08 smithi192 ceph-mon[47933]: mgrmap e15: x(active, since 61s), standbys: z, y 2024-06-02T04:44:08.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:08 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-06-02T04:44:08.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:08 smithi192 ceph-mon[47933]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T04:44:08.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:08 smithi076 ceph-mon[42935]: mgrmap e15: x(active, since 61s), standbys: z, y 2024-06-02T04:44:08.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:08 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-06-02T04:44:08.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:08 smithi076 ceph-mon[42935]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T04:44:09.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:08 smithi119 ceph-mon[46633]: mgrmap e15: x(active, since 61s), standbys: z, y 2024-06-02T04:44:09.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:08 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-06-02T04:44:09.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:08 smithi119 ceph-mon[46633]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T04:44:11.330 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:11 smithi076 ceph-mon[42935]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T04:44:11.431 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:11 smithi192 ceph-mon[47933]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T04:44:11.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:11 smithi119 ceph-mon[46633]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T04:44:12.417 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:12 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-06-02T04:44:12.417 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:12 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:44:12.431 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:12 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-06-02T04:44:12.431 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:12 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:44:12.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:12 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-06-02T04:44:12.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:12 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:44:13.318 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:13 smithi076 ceph-mon[42935]: Deploying daemon osd.0 on smithi076 2024-06-02T04:44:13.319 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:13 smithi076 ceph-mon[42935]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T04:44:13.431 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:13 smithi192 ceph-mon[47933]: Deploying daemon osd.0 on smithi076 2024-06-02T04:44:13.431 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:13 smithi192 ceph-mon[47933]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T04:44:13.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:13 smithi119 ceph-mon[46633]: Deploying daemon osd.0 on smithi076 2024-06-02T04:44:13.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:13 smithi119 ceph-mon[46633]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T04:44:15.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:15 smithi076 ceph-mon[42935]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T04:44:15.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:15 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:15.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:15 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:15.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:15 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:44:15.431 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:15 smithi192 ceph-mon[47933]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T04:44:15.431 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:15 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:15.431 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:15 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:15.431 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:15 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:44:15.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:15 smithi119 ceph-mon[46633]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T04:44:15.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:15 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:15.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:15 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:15.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:15 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:44:17.312 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:16 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:17.312 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:16 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:17.312 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:16 smithi076 ceph-mon[42935]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T04:44:17.312 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:16 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:44:17.312 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:16 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:44:17.312 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:16 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:17.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:16 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:17.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:16 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:17.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:16 smithi119 ceph-mon[46633]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T04:44:17.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:16 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:44:17.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:16 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:44:17.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:16 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:17.385 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:44:17.385+0000 7f58c2ffd700 1 -- 172.21.15.76:0/3155272865 <== mgr.14152 v2:172.21.15.76:6800/2591353090 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f58cc02cf00 con 0x7f58b80389d0 2024-06-02T04:44:17.386 INFO:teuthology.orchestra.run.smithi076.stdout:Created osd(s) 0 on host 'smithi076' 2024-06-02T04:44:17.388 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:44:17.387+0000 7f58d4094700 1 -- 172.21.15.76:0/3155272865 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f58b80389d0 msgr2=0x7f58b803ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:44:17.388 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:44:17.387+0000 7f58d4094700 1 --2- 172.21.15.76:0/3155272865 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f58b80389d0 0x7f58b803ae90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f58bc005950 tx=0x7f58bc00b410 comp rx=0 tx=0).stop 2024-06-02T04:44:17.388 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:44:17.388+0000 7f58d4094700 1 -- 172.21.15.76:0/3155272865 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f58cc101060 msgr2=0x7f58cc19bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:44:17.388 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:44:17.388+0000 7f58d4094700 1 --2- 172.21.15.76:0/3155272865 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f58cc101060 0x7f58cc19bbf0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f58c8000c00 tx=0x7f58c8005b00 comp rx=0 tx=0).stop 2024-06-02T04:44:17.388 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:44:17.388+0000 7f58d4094700 1 -- 172.21.15.76:0/3155272865 shutdown_connections 2024-06-02T04:44:17.388 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:44:17.388+0000 7f58d4094700 1 --2- 172.21.15.76:0/3155272865 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f58cc101a20 0x7f58cc19e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:44:17.389 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:44:17.388+0000 7f58d4094700 1 --2- 172.21.15.76:0/3155272865 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f58b80389d0 0x7f58b803ae90 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:44:17.389 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:44:17.388+0000 7f58d4094700 1 --2- 172.21.15.76:0/3155272865 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f58cc0fff00 0x7f58cc069cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:44:17.389 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:44:17.388+0000 7f58d4094700 1 --2- 172.21.15.76:0/3155272865 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f58cc101060 0x7f58cc19bbf0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:44:17.389 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:44:17.388+0000 7f58d4094700 1 -- 172.21.15.76:0/3155272865 >> 172.21.15.76:0/3155272865 conn(0x7f58cc0fb4c0 msgr2=0x7f58cc104550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:44:17.389 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:44:17.388+0000 7f58d4094700 1 -- 172.21.15.76:0/3155272865 shutdown_connections 2024-06-02T04:44:17.389 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:44:17.388+0000 7f58d4094700 1 -- 172.21.15.76:0/3155272865 wait complete. 2024-06-02T04:44:17.431 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:16 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:17.431 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:16 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:17.431 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:16 smithi192 ceph-mon[47933]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T04:44:17.431 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:16 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:44:17.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:16 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:44:17.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:16 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:17.787 DEBUG:teuthology.orchestra.run.smithi076:osd.0> sudo journalctl -f -n 0 -u ceph-60ab6d30-209a-11ef-bc9b-c7b262605968@osd.0.service 2024-06-02T04:44:17.789 INFO:tasks.cephadm:Deploying osd.1 on smithi119 with /dev/vg_nvme/lv_4... 2024-06-02T04:44:17.789 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 60ab6d30-209a-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-06-02T04:44:17.821 INFO:journalctl@ceph.osd.0.smithi076.stdout:-- Logs begin at Sun 2024-06-02 04:26:13 UTC. -- 2024-06-02T04:44:18.017 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/mon.b/config 2024-06-02T04:44:18.421 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:18 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:18.422 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:18 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:18.422 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:18 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:44:18.422 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:18 smithi119 ceph-mon[46633]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T04:44:18.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:18 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:18.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:18 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:18.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:18 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:44:18.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:18 smithi076 ceph-mon[42935]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T04:44:18.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:18 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:18.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:18 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:18.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:18 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:44:18.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:18 smithi192 ceph-mon[47933]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T04:44:19.233 INFO:journalctl@ceph.osd.0.smithi076.stdout:Jun 02 04:44:18 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-0[61958]: 2024-06-02T04:44:18.941+0000 7f8e718877c0 -1 osd.0 0 log_to_monitors true 2024-06-02T04:44:19.243 INFO:teuthology.orchestra.run.smithi119.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-06-02T04:44:19.244 INFO:teuthology.orchestra.run.smithi119.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-06-02T04:44:19.244 INFO:teuthology.orchestra.run.smithi119.stderr: stderr: 10+0 records in 2024-06-02T04:44:19.244 INFO:teuthology.orchestra.run.smithi119.stderr:10+0 records out 2024-06-02T04:44:19.244 INFO:teuthology.orchestra.run.smithi119.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.010983 s, 955 MB/s 2024-06-02T04:44:19.244 INFO:teuthology.orchestra.run.smithi119.stderr:--> Zapping successful for: 2024-06-02T04:44:19.542 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:19 smithi119 ceph-mon[46633]: from='osd.0 [v2:172.21.15.76:6802/2869602045,v1:172.21.15.76:6803/2869602045]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-06-02T04:44:19.643 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 60ab6d30-209a-11ef-bc9b-c7b262605968 -- ceph orch daemon add osd smithi119:vg_nvme/lv_4 2024-06-02T04:44:19.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:19 smithi192 ceph-mon[47933]: from='osd.0 [v2:172.21.15.76:6802/2869602045,v1:172.21.15.76:6803/2869602045]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-06-02T04:44:19.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:19 smithi076 ceph-mon[42935]: from='osd.0 [v2:172.21.15.76:6802/2869602045,v1:172.21.15.76:6803/2869602045]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-06-02T04:44:19.858 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/mon.b/config 2024-06-02T04:44:20.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:20 smithi119 ceph-mon[46633]: from='osd.0 [v2:172.21.15.76:6802/2869602045,v1:172.21.15.76:6803/2869602045]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-06-02T04:44:20.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:20 smithi119 ceph-mon[46633]: osdmap e6: 1 total, 0 up, 1 in 2024-06-02T04:44:20.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:20 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-02T04:44:20.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:20 smithi119 ceph-mon[46633]: from='osd.0 [v2:172.21.15.76:6802/2869602045,v1:172.21.15.76:6803/2869602045]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi076", "root=default"]}]: dispatch 2024-06-02T04:44:20.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:20 smithi119 ceph-mon[46633]: Detected new or changed devices on smithi076 2024-06-02T04:44:20.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:20 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:20.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:20 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:20.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:20 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:44:20.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:20 smithi119 ceph-mon[46633]: Adjusting osd_memory_target on smithi076 to 17114M 2024-06-02T04:44:20.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:20 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:20.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:20 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:44:20.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:20 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:44:20.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:20 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:20.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:20 smithi119 ceph-mon[46633]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T04:44:20.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:20 smithi192 ceph-mon[47933]: from='osd.0 [v2:172.21.15.76:6802/2869602045,v1:172.21.15.76:6803/2869602045]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-06-02T04:44:20.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:20 smithi192 ceph-mon[47933]: osdmap e6: 1 total, 0 up, 1 in 2024-06-02T04:44:20.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:20 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-02T04:44:20.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:20 smithi192 ceph-mon[47933]: from='osd.0 [v2:172.21.15.76:6802/2869602045,v1:172.21.15.76:6803/2869602045]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi076", "root=default"]}]: dispatch 2024-06-02T04:44:20.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:20 smithi192 ceph-mon[47933]: Detected new or changed devices on smithi076 2024-06-02T04:44:20.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:20 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:20.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:20 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:20.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:20 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:44:20.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:20 smithi192 ceph-mon[47933]: Adjusting osd_memory_target on smithi076 to 17114M 2024-06-02T04:44:20.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:20 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:20.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:20 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:44:20.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:20 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:44:20.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:20 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:20.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:20 smithi192 ceph-mon[47933]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T04:44:20.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:20 smithi076 ceph-mon[42935]: from='osd.0 [v2:172.21.15.76:6802/2869602045,v1:172.21.15.76:6803/2869602045]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-06-02T04:44:20.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:20 smithi076 ceph-mon[42935]: osdmap e6: 1 total, 0 up, 1 in 2024-06-02T04:44:20.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:20 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-02T04:44:20.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:20 smithi076 ceph-mon[42935]: from='osd.0 [v2:172.21.15.76:6802/2869602045,v1:172.21.15.76:6803/2869602045]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi076", "root=default"]}]: dispatch 2024-06-02T04:44:20.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:20 smithi076 ceph-mon[42935]: Detected new or changed devices on smithi076 2024-06-02T04:44:20.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:20 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:20.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:20 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:20.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:20 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:44:20.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:20 smithi076 ceph-mon[42935]: Adjusting osd_memory_target on smithi076 to 17114M 2024-06-02T04:44:20.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:20 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:20.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:20 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:44:20.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:20 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:44:20.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:20 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:20.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:20 smithi076 ceph-mon[42935]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T04:44:20.773 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:44:20.773+0000 7f45451d7700 1 -- 172.21.15.119:0/3406243836 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f45400fff00 msgr2=0x7f4540100320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:44:20.773 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:44:20.773+0000 7f45451d7700 1 --2- 172.21.15.119:0/3406243836 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f45400fff00 0x7f4540100320 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f4530009990 tx=0x7f4530009ca0 comp rx=0 tx=0).stop 2024-06-02T04:44:20.774 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:44:20.773+0000 7f45451d7700 1 -- 172.21.15.119:0/3406243836 shutdown_connections 2024-06-02T04:44:20.774 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:44:20.773+0000 7f45451d7700 1 --2- 172.21.15.119:0/3406243836 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4540101a20 0x7f4540108340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:44:20.774 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:44:20.773+0000 7f45451d7700 1 --2- 172.21.15.119:0/3406243836 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f45400fff00 0x7f4540100320 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:44:20.774 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:44:20.773+0000 7f45451d7700 1 --2- 172.21.15.119:0/3406243836 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4540101060 0x7f45401014e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:44:20.774 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:44:20.773+0000 7f45451d7700 1 -- 172.21.15.119:0/3406243836 >> 172.21.15.119:0/3406243836 conn(0x7f45400fb4c0 msgr2=0x7f45400fd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:44:20.774 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:44:20.773+0000 7f45451d7700 1 -- 172.21.15.119:0/3406243836 shutdown_connections 2024-06-02T04:44:20.774 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:44:20.773+0000 7f45451d7700 1 -- 172.21.15.119:0/3406243836 wait complete. 2024-06-02T04:44:20.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:44:20.774+0000 7f45451d7700 1 Processor -- start 2024-06-02T04:44:20.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:44:20.774+0000 7f45451d7700 1 -- start start 2024-06-02T04:44:20.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:44:20.774+0000 7f45451d7700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f45400fff00 0x7f4540069d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:44:20.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:44:20.774+0000 7f45451d7700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4540101060 0x7f454019bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:44:20.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:44:20.774+0000 7f45451d7700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4540101a20 0x7f454019e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:44:20.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:44:20.774+0000 7f45451d7700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f454019e970 con 0x7f4540101060 2024-06-02T04:44:20.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:44:20.774+0000 7f45451d7700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f454019eae0 con 0x7f4540101a20 2024-06-02T04:44:20.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:44:20.774+0000 7f45451d7700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f454019eca0 con 0x7f45400fff00 2024-06-02T04:44:20.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:44:20.775+0000 7f453f59e700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4540101a20 0x7f454019e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:44:20.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:44:20.775+0000 7f453ed9d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f45400fff00 0x7f4540069d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:44:20.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:44:20.775+0000 7f453f59e700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4540101a20 0x7f454019e1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52548/0 (socket says 172.21.15.119:52548) 2024-06-02T04:44:20.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:44:20.775+0000 7f453e59c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4540101060 0x7f454019bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:44:20.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:44:20.775+0000 7f453f59e700 1 -- 172.21.15.119:0/1951654528 learned_addr learned my addr 172.21.15.119:0/1951654528 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-06-02T04:44:20.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:44:20.775+0000 7f453f59e700 1 -- 172.21.15.119:0/1951654528 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f45400fff00 msgr2=0x7f4540069d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:44:20.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:44:20.775+0000 7f453f59e700 1 --2- 172.21.15.119:0/1951654528 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f45400fff00 0x7f4540069d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:44:20.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:44:20.775+0000 7f453f59e700 1 -- 172.21.15.119:0/1951654528 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4540101060 msgr2=0x7f454019bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:44:20.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:44:20.775+0000 7f453f59e700 1 --2- 172.21.15.119:0/1951654528 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4540101060 0x7f454019bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:44:20.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:44:20.775+0000 7f453f59e700 1 -- 172.21.15.119:0/1951654528 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45300095f0 con 0x7f4540101a20 2024-06-02T04:44:20.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:44:20.775+0000 7f453f59e700 1 --2- 172.21.15.119:0/1951654528 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4540101a20 0x7f454019e1d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4538007ee0 tx=0x7f453800d3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:44:20.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:44:20.775+0000 7f4537fff700 1 -- 172.21.15.119:0/1951654528 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4538017070 con 0x7f4540101a20 2024-06-02T04:44:20.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:44:20.775+0000 7f4537fff700 1 -- 172.21.15.119:0/1951654528 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f453800f040 con 0x7f4540101a20 2024-06-02T04:44:20.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:44:20.775+0000 7f45451d7700 1 -- 172.21.15.119:0/1951654528 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f454019ef80 con 0x7f4540101a20 2024-06-02T04:44:20.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:44:20.775+0000 7f4537fff700 1 -- 172.21.15.119:0/1951654528 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4538005570 con 0x7f4540101a20 2024-06-02T04:44:20.779 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:44:20.775+0000 7f45451d7700 1 -- 172.21.15.119:0/1951654528 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f454019f3a0 con 0x7f4540101a20 2024-06-02T04:44:20.779 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:44:20.776+0000 7f45451d7700 1 -- 172.21.15.119:0/1951654528 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4540107470 con 0x7f4540101a20 2024-06-02T04:44:20.779 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:44:20.777+0000 7f4537fff700 1 -- 172.21.15.119:0/1951654528 <== mon.2 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 15) v1 ==== 135817+0+0 (secure 0 0 0) 0x7f453800db20 con 0x7f4540101a20 2024-06-02T04:44:20.779 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:44:20.778+0000 7f4537fff700 1 --2- 172.21.15.119:0/1951654528 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f452c0a1090 0x7f452c0a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:44:20.780 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:44:20.778+0000 7f4537fff700 1 -- 172.21.15.119:0/1951654528 <== mon.2 v2:172.21.15.119:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1487+0+0 (secure 0 0 0) 0x7f45380ca4b0 con 0x7f4540101a20 2024-06-02T04:44:20.780 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:44:20.778+0000 7f453ed9d700 1 --2- 172.21.15.119:0/1951654528 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f452c0a1090 0x7f452c0a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:44:20.780 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:44:20.778+0000 7f453ed9d700 1 --2- 172.21.15.119:0/1951654528 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f452c0a1090 0x7f452c0a3550 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f453000c010 tx=0x7f4530005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:44:20.782 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:44:20.782+0000 7f4537fff700 1 -- 172.21.15.119:0/1951654528 <== mon.2 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f45380957d0 con 0x7f4540101a20 2024-06-02T04:44:20.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:44:20.983+0000 7f45451d7700 1 -- 172.21.15.119:0/1951654528 --> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f454002ce10 con 0x7f452c0a1090 2024-06-02T04:44:21.233 INFO:journalctl@ceph.osd.0.smithi076.stdout:Jun 02 04:44:20 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-0[61958]: 2024-06-02T04:44:20.812+0000 7f8e66eeb700 -1 osd.0 0 waiting for initial osdmap 2024-06-02T04:44:21.233 INFO:journalctl@ceph.osd.0.smithi076.stdout:Jun 02 04:44:20 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-0[61958]: 2024-06-02T04:44:20.815+0000 7f8e5ecd8700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-02T04:44:21.655 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:21 smithi119 ceph-mon[46633]: from='osd.0 [v2:172.21.15.76:6802/2869602045,v1:172.21.15.76:6803/2869602045]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi076", "root=default"]}]': finished 2024-06-02T04:44:21.655 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:21 smithi119 ceph-mon[46633]: osdmap e7: 1 total, 0 up, 1 in 2024-06-02T04:44:21.655 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:21 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-02T04:44:21.655 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:21 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-02T04:44:21.655 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:21 smithi119 ceph-mon[46633]: from='osd.0 [v2:172.21.15.76:6802/2869602045,v1:172.21.15.76:6803/2869602045]' entity='osd.0' 2024-06-02T04:44:21.655 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:21 smithi119 ceph-mon[46633]: from='client.24155 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:44:21.655 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:21 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T04:44:21.655 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:21 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T04:44:21.655 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:21 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:44:21.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:21 smithi192 ceph-mon[47933]: from='osd.0 [v2:172.21.15.76:6802/2869602045,v1:172.21.15.76:6803/2869602045]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi076", "root=default"]}]': finished 2024-06-02T04:44:21.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:21 smithi192 ceph-mon[47933]: osdmap e7: 1 total, 0 up, 1 in 2024-06-02T04:44:21.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:21 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-02T04:44:21.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:21 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-02T04:44:21.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:21 smithi192 ceph-mon[47933]: from='osd.0 [v2:172.21.15.76:6802/2869602045,v1:172.21.15.76:6803/2869602045]' entity='osd.0' 2024-06-02T04:44:21.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:21 smithi192 ceph-mon[47933]: from='client.24155 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:44:21.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:21 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T04:44:21.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:21 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T04:44:21.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:21 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:44:21.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:21 smithi076 ceph-mon[42935]: from='osd.0 [v2:172.21.15.76:6802/2869602045,v1:172.21.15.76:6803/2869602045]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi076", "root=default"]}]': finished 2024-06-02T04:44:21.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:21 smithi076 ceph-mon[42935]: osdmap e7: 1 total, 0 up, 1 in 2024-06-02T04:44:21.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:21 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-02T04:44:21.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:21 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-02T04:44:21.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:21 smithi076 ceph-mon[42935]: from='osd.0 [v2:172.21.15.76:6802/2869602045,v1:172.21.15.76:6803/2869602045]' entity='osd.0' 2024-06-02T04:44:21.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:21 smithi076 ceph-mon[42935]: from='client.24155 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:44:21.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:21 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T04:44:21.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:21 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T04:44:21.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:21 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:44:22.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:22 smithi192 ceph-mon[47933]: purged_snaps scrub starts 2024-06-02T04:44:22.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:22 smithi192 ceph-mon[47933]: purged_snaps scrub ok 2024-06-02T04:44:22.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:22 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-02T04:44:22.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:22 smithi192 ceph-mon[47933]: osd.0 [v2:172.21.15.76:6802/2869602045,v1:172.21.15.76:6803/2869602045] boot 2024-06-02T04:44:22.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:22 smithi192 ceph-mon[47933]: osdmap e8: 1 total, 1 up, 1 in 2024-06-02T04:44:22.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:22 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-02T04:44:22.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:22 smithi192 ceph-mon[47933]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T04:44:22.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:22 smithi076 ceph-mon[42935]: purged_snaps scrub starts 2024-06-02T04:44:22.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:22 smithi076 ceph-mon[42935]: purged_snaps scrub ok 2024-06-02T04:44:22.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:22 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-02T04:44:22.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:22 smithi076 ceph-mon[42935]: osd.0 [v2:172.21.15.76:6802/2869602045,v1:172.21.15.76:6803/2869602045] boot 2024-06-02T04:44:22.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:22 smithi076 ceph-mon[42935]: osdmap e8: 1 total, 1 up, 1 in 2024-06-02T04:44:22.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:22 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-02T04:44:22.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:22 smithi076 ceph-mon[42935]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T04:44:22.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:22 smithi119 ceph-mon[46633]: purged_snaps scrub starts 2024-06-02T04:44:22.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:22 smithi119 ceph-mon[46633]: purged_snaps scrub ok 2024-06-02T04:44:22.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:22 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-02T04:44:22.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:22 smithi119 ceph-mon[46633]: osd.0 [v2:172.21.15.76:6802/2869602045,v1:172.21.15.76:6803/2869602045] boot 2024-06-02T04:44:22.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:22 smithi119 ceph-mon[46633]: osdmap e8: 1 total, 1 up, 1 in 2024-06-02T04:44:22.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:22 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-02T04:44:22.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:22 smithi119 ceph-mon[46633]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T04:44:23.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:23 smithi192 ceph-mon[47933]: from='client.? 172.21.15.119:0/2487546871' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ace46e13-3bb7-4103-973a-6860554df8b0"}]: dispatch 2024-06-02T04:44:23.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:23 smithi192 ceph-mon[47933]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ace46e13-3bb7-4103-973a-6860554df8b0"}]: dispatch 2024-06-02T04:44:23.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:23 smithi192 ceph-mon[47933]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ace46e13-3bb7-4103-973a-6860554df8b0"}]': finished 2024-06-02T04:44:23.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:23 smithi192 ceph-mon[47933]: osdmap e9: 2 total, 1 up, 2 in 2024-06-02T04:44:23.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:23 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-02T04:44:23.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:23 smithi076 ceph-mon[42935]: from='client.? 172.21.15.119:0/2487546871' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ace46e13-3bb7-4103-973a-6860554df8b0"}]: dispatch 2024-06-02T04:44:23.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:23 smithi076 ceph-mon[42935]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ace46e13-3bb7-4103-973a-6860554df8b0"}]: dispatch 2024-06-02T04:44:23.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:23 smithi076 ceph-mon[42935]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ace46e13-3bb7-4103-973a-6860554df8b0"}]': finished 2024-06-02T04:44:23.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:23 smithi076 ceph-mon[42935]: osdmap e9: 2 total, 1 up, 2 in 2024-06-02T04:44:23.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:23 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-02T04:44:23.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:23 smithi119 ceph-mon[46633]: from='client.? 172.21.15.119:0/2487546871' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ace46e13-3bb7-4103-973a-6860554df8b0"}]: dispatch 2024-06-02T04:44:23.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:23 smithi119 ceph-mon[46633]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ace46e13-3bb7-4103-973a-6860554df8b0"}]: dispatch 2024-06-02T04:44:23.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:23 smithi119 ceph-mon[46633]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ace46e13-3bb7-4103-973a-6860554df8b0"}]': finished 2024-06-02T04:44:23.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:23 smithi119 ceph-mon[46633]: osdmap e9: 2 total, 1 up, 2 in 2024-06-02T04:44:23.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:23 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-02T04:44:24.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:24 smithi192 ceph-mon[47933]: from='client.? 172.21.15.119:0/3287108962' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T04:44:24.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:24 smithi192 ceph-mon[47933]: pgmap v38: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-06-02T04:44:24.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:24 smithi076 ceph-mon[42935]: from='client.? 172.21.15.119:0/3287108962' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T04:44:24.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:24 smithi076 ceph-mon[42935]: pgmap v38: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-06-02T04:44:24.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:24 smithi119 ceph-mon[46633]: from='client.? 172.21.15.119:0/3287108962' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T04:44:24.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:24 smithi119 ceph-mon[46633]: pgmap v38: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-06-02T04:44:27.412 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:27 smithi119 ceph-mon[46633]: pgmap v39: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-06-02T04:44:27.431 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:27 smithi192 ceph-mon[47933]: pgmap v39: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-06-02T04:44:27.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:27 smithi076 ceph-mon[42935]: pgmap v39: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-06-02T04:44:29.431 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:29 smithi192 ceph-mon[47933]: pgmap v40: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-06-02T04:44:29.431 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:29 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-06-02T04:44:29.431 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:29 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:44:29.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:29 smithi076 ceph-mon[42935]: pgmap v40: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-06-02T04:44:29.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:29 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-06-02T04:44:29.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:29 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:44:29.487 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:29 smithi119 ceph-mon[46633]: pgmap v40: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-06-02T04:44:29.487 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:29 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-06-02T04:44:29.487 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:29 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:44:30.423 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:30 smithi119 ceph-mon[46633]: Deploying daemon osd.1 on smithi119 2024-06-02T04:44:30.431 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:30 smithi192 ceph-mon[47933]: Deploying daemon osd.1 on smithi119 2024-06-02T04:44:30.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:30 smithi076 ceph-mon[42935]: Deploying daemon osd.1 on smithi119 2024-06-02T04:44:31.431 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:31 smithi192 ceph-mon[47933]: pgmap v41: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-06-02T04:44:31.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:31 smithi076 ceph-mon[42935]: pgmap v41: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-06-02T04:44:31.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:31 smithi119 ceph-mon[46633]: pgmap v41: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-06-02T04:44:33.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:32 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:33.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:32 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:33.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:32 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:44:33.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:32 smithi192 ceph-mon[47933]: pgmap v42: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-06-02T04:44:33.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:32 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:33.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:32 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:33.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:32 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:44:33.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:32 smithi076 ceph-mon[42935]: pgmap v42: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-06-02T04:44:33.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:32 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:33.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:32 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:33.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:32 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:44:33.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:32 smithi119 ceph-mon[46633]: pgmap v42: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-06-02T04:44:33.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:44:33.781+0000 7f4537fff700 1 -- 172.21.15.119:0/1951654528 <== mgr.14152 v2:172.21.15.76:6800/2591353090 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f454002ce10 con 0x7f452c0a1090 2024-06-02T04:44:33.786 INFO:teuthology.orchestra.run.smithi119.stdout:Created osd(s) 1 on host 'smithi119' 2024-06-02T04:44:33.787 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:44:33.783+0000 7f45451d7700 1 -- 172.21.15.119:0/1951654528 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f452c0a1090 msgr2=0x7f452c0a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:44:33.787 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:44:33.783+0000 7f45451d7700 1 --2- 172.21.15.119:0/1951654528 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f452c0a1090 0x7f452c0a3550 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f453000c010 tx=0x7f4530005fd0 comp rx=0 tx=0).stop 2024-06-02T04:44:33.787 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:44:33.783+0000 7f45451d7700 1 -- 172.21.15.119:0/1951654528 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4540101a20 msgr2=0x7f454019e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:44:33.787 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:44:33.783+0000 7f45451d7700 1 --2- 172.21.15.119:0/1951654528 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4540101a20 0x7f454019e1d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4538007ee0 tx=0x7f453800d3b0 comp rx=0 tx=0).stop 2024-06-02T04:44:33.787 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:44:33.783+0000 7f45451d7700 1 -- 172.21.15.119:0/1951654528 shutdown_connections 2024-06-02T04:44:33.787 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:44:33.783+0000 7f45451d7700 1 --2- 172.21.15.119:0/1951654528 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f452c0a1090 0x7f452c0a3550 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:44:33.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:44:33.783+0000 7f45451d7700 1 --2- 172.21.15.119:0/1951654528 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4540101a20 0x7f454019e1d0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:44:33.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:44:33.783+0000 7f45451d7700 1 --2- 172.21.15.119:0/1951654528 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f45400fff00 0x7f4540069d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:44:33.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:44:33.783+0000 7f45451d7700 1 --2- 172.21.15.119:0/1951654528 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4540101060 0x7f454019bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:44:33.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:44:33.783+0000 7f45451d7700 1 -- 172.21.15.119:0/1951654528 >> 172.21.15.119:0/1951654528 conn(0x7f45400fb4c0 msgr2=0x7f45401045b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:44:33.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:44:33.783+0000 7f45451d7700 1 -- 172.21.15.119:0/1951654528 shutdown_connections 2024-06-02T04:44:33.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:44:33.783+0000 7f45451d7700 1 -- 172.21.15.119:0/1951654528 wait complete. 2024-06-02T04:44:34.145 DEBUG:teuthology.orchestra.run.smithi119:osd.1> sudo journalctl -f -n 0 -u ceph-60ab6d30-209a-11ef-bc9b-c7b262605968@osd.1.service 2024-06-02T04:44:34.148 INFO:tasks.cephadm:Deploying osd.2 on smithi192 with /dev/vg_nvme/lv_4... 2024-06-02T04:44:34.148 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 60ab6d30-209a-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-06-02T04:44:34.181 INFO:journalctl@ceph.osd.1.smithi119.stdout:-- Logs begin at Sun 2024-06-02 04:25:42 UTC. -- 2024-06-02T04:44:34.327 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:34 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:34.328 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:34 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:34.328 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:34 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:44:34.328 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:34 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:44:34.328 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:34 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:34.328 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:34 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:34.328 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:34 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:34.328 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:34 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:44:34.379 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/mon.c/config 2024-06-02T04:44:34.540 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:34 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:34.540 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:34 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:34.541 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:34 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:44:34.541 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:34 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:44:34.541 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:34 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:34.541 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:34 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:34.541 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:34 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:34.541 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:34 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:44:34.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:34 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:34.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:34 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:34.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:34 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:44:34.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:34 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:44:34.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:34 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:34.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:34 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:34.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:34 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:34.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:34 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:44:35.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:35 smithi119 ceph-mon[46633]: pgmap v43: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-06-02T04:44:35.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:35 smithi192 ceph-mon[47933]: pgmap v43: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-06-02T04:44:35.731 INFO:teuthology.orchestra.run.smithi192.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-06-02T04:44:35.731 INFO:teuthology.orchestra.run.smithi192.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-06-02T04:44:35.731 INFO:teuthology.orchestra.run.smithi192.stderr: stderr: 10+0 records in 2024-06-02T04:44:35.731 INFO:teuthology.orchestra.run.smithi192.stderr:10+0 records out 2024-06-02T04:44:35.731 INFO:teuthology.orchestra.run.smithi192.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0112168 s, 935 MB/s 2024-06-02T04:44:35.731 INFO:teuthology.orchestra.run.smithi192.stderr:--> Zapping successful for: 2024-06-02T04:44:35.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:35 smithi076 ceph-mon[42935]: pgmap v43: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-06-02T04:44:36.077 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 60ab6d30-209a-11ef-bc9b-c7b262605968 -- ceph orch daemon add osd smithi192:vg_nvme/lv_4 2024-06-02T04:44:36.218 INFO:journalctl@ceph.osd.1.smithi119.stdout:Jun 02 04:44:35 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-1[51608]: 2024-06-02T04:44:35.880+0000 7f32f43937c0 -1 osd.1 0 log_to_monitors true 2024-06-02T04:44:36.295 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/mon.c/config 2024-06-02T04:44:36.399 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:36 smithi192 ceph-mon[47933]: from='osd.1 [v2:172.21.15.119:6800/2353738098,v1:172.21.15.119:6801/2353738098]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-06-02T04:44:36.399 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:36 smithi192 ceph-mon[47933]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-06-02T04:44:36.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:36 smithi119 ceph-mon[46633]: from='osd.1 [v2:172.21.15.119:6800/2353738098,v1:172.21.15.119:6801/2353738098]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-06-02T04:44:36.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:36 smithi119 ceph-mon[46633]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-06-02T04:44:36.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:36 smithi076 ceph-mon[42935]: from='osd.1 [v2:172.21.15.119:6800/2353738098,v1:172.21.15.119:6801/2353738098]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-06-02T04:44:36.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:36 smithi076 ceph-mon[42935]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-06-02T04:44:37.235 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:44:37.235+0000 7f71f5e1b700 1 -- 172.21.15.192:0/515201180 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71f00fff00 msgr2=0x7f71f0100320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:44:37.236 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:44:37.235+0000 7f71f5e1b700 1 --2- 172.21.15.192:0/515201180 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71f00fff00 0x7f71f0100320 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f71d8009990 tx=0x7f71d8009ca0 comp rx=0 tx=0).stop 2024-06-02T04:44:37.236 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:44:37.235+0000 7f71f5e1b700 1 -- 172.21.15.192:0/515201180 shutdown_connections 2024-06-02T04:44:37.236 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:44:37.235+0000 7f71f5e1b700 1 --2- 172.21.15.192:0/515201180 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71f0101a20 0x7f71f0108340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:44:37.236 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:44:37.235+0000 7f71f5e1b700 1 --2- 172.21.15.192:0/515201180 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71f00fff00 0x7f71f0100320 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:44:37.236 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:44:37.235+0000 7f71f5e1b700 1 --2- 172.21.15.192:0/515201180 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f71f0101060 0x7f71f01014e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:44:37.236 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:44:37.235+0000 7f71f5e1b700 1 -- 172.21.15.192:0/515201180 >> 172.21.15.192:0/515201180 conn(0x7f71f00fb4a0 msgr2=0x7f71f00fd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:44:37.236 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:44:37.235+0000 7f71f5e1b700 1 -- 172.21.15.192:0/515201180 shutdown_connections 2024-06-02T04:44:37.236 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:44:37.235+0000 7f71f5e1b700 1 -- 172.21.15.192:0/515201180 wait complete. 2024-06-02T04:44:37.238 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:44:37.236+0000 7f71f5e1b700 1 Processor -- start 2024-06-02T04:44:37.238 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:44:37.236+0000 7f71f5e1b700 1 -- start start 2024-06-02T04:44:37.238 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:44:37.236+0000 7f71f5e1b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71f00fff00 0x7f71f0196de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:44:37.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:44:37.236+0000 7f71f5e1b700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f71f0101060 0x7f71f0197320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:44:37.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:44:37.236+0000 7f71f5e1b700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71f0101a20 0x7f71f019e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:44:37.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:44:37.236+0000 7f71f5e1b700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71f019e8e0 con 0x7f71f0101060 2024-06-02T04:44:37.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:44:37.236+0000 7f71f5e1b700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71f019ea20 con 0x7f71f0101a20 2024-06-02T04:44:37.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:44:37.236+0000 7f71f5e1b700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71f019ebe0 con 0x7f71f00fff00 2024-06-02T04:44:37.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:44:37.236+0000 7f71ef7fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71f00fff00 0x7f71f0196de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:44:37.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:44:37.236+0000 7f71ef7fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71f00fff00 0x7f71f0196de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:32802/0 (socket says 172.21.15.192:32802) 2024-06-02T04:44:37.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:44:37.236+0000 7f71ef7fe700 1 -- 172.21.15.192:0/2786365979 learned_addr learned my addr 172.21.15.192:0/2786365979 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-06-02T04:44:37.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:44:37.236+0000 7f71eeffd700 1 --2- 172.21.15.192:0/2786365979 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f71f0101060 0x7f71f0197320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:44:37.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:44:37.236+0000 7f71ef7fe700 1 -- 172.21.15.192:0/2786365979 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71f0101a20 msgr2=0x7f71f019e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:44:37.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:44:37.236+0000 7f71ef7fe700 1 --2- 172.21.15.192:0/2786365979 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71f0101a20 0x7f71f019e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:44:37.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:44:37.236+0000 7f71ef7fe700 1 -- 172.21.15.192:0/2786365979 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f71f0101060 msgr2=0x7f71f0197320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:44:37.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:44:37.236+0000 7f71ef7fe700 1 --2- 172.21.15.192:0/2786365979 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f71f0101060 0x7f71f0197320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:44:37.240 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:44:37.236+0000 7f71ef7fe700 1 -- 172.21.15.192:0/2786365979 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71d80095f0 con 0x7f71f00fff00 2024-06-02T04:44:37.240 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:44:37.237+0000 7f71ef7fe700 1 --2- 172.21.15.192:0/2786365979 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71f00fff00 0x7f71f0196de0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f71d80098e0 tx=0x7f71d8005f10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:44:37.240 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:44:37.237+0000 7f71ecff9700 1 -- 172.21.15.192:0/2786365979 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d801d070 con 0x7f71f00fff00 2024-06-02T04:44:37.240 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:44:37.237+0000 7f71ecff9700 1 -- 172.21.15.192:0/2786365979 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f71d8004080 con 0x7f71f00fff00 2024-06-02T04:44:37.240 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:44:37.237+0000 7f71f5e1b700 1 -- 172.21.15.192:0/2786365979 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71f0108c70 con 0x7f71f00fff00 2024-06-02T04:44:37.240 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:44:37.237+0000 7f71ecff9700 1 -- 172.21.15.192:0/2786365979 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d8022c90 con 0x7f71f00fff00 2024-06-02T04:44:37.240 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:44:37.237+0000 7f71f5e1b700 1 -- 172.21.15.192:0/2786365979 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71f0109170 con 0x7f71f00fff00 2024-06-02T04:44:37.240 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:44:37.238+0000 7f71f5e1b700 1 -- 172.21.15.192:0/2786365979 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71f0107320 con 0x7f71f00fff00 2024-06-02T04:44:37.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:44:37.239+0000 7f71ecff9700 1 -- 172.21.15.192:0/2786365979 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 15) v1 ==== 135817+0+0 (secure 0 0 0) 0x7f71d8022470 con 0x7f71f00fff00 2024-06-02T04:44:37.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:44:37.240+0000 7f71ecff9700 1 --2- 172.21.15.192:0/2786365979 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f71dc0a1090 0x7f71dc0a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:44:37.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:44:37.240+0000 7f71ecff9700 1 -- 172.21.15.192:0/2786365979 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1903+0+0 (secure 0 0 0) 0x7f71d80ccb80 con 0x7f71f00fff00 2024-06-02T04:44:37.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:44:37.240+0000 7f71eeffd700 1 --2- 172.21.15.192:0/2786365979 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f71dc0a1090 0x7f71dc0a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:44:37.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:44:37.241+0000 7f71eeffd700 1 --2- 172.21.15.192:0/2786365979 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f71dc0a1090 0x7f71dc0a3550 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f71e0005950 tx=0x7f71e00058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:44:37.244 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:44:37.244+0000 7f71ecff9700 1 -- 172.21.15.192:0/2786365979 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f71d8097d90 con 0x7f71f00fff00 2024-06-02T04:44:37.431 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:37 smithi192 ceph-mon[47933]: pgmap v44: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-06-02T04:44:37.431 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:37 smithi192 ceph-mon[47933]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-06-02T04:44:37.431 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:37 smithi192 ceph-mon[47933]: osdmap e10: 2 total, 1 up, 2 in 2024-06-02T04:44:37.431 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:37 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-02T04:44:37.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:37 smithi192 ceph-mon[47933]: from='osd.1 [v2:172.21.15.119:6800/2353738098,v1:172.21.15.119:6801/2353738098]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2024-06-02T04:44:37.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:37 smithi192 ceph-mon[47933]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2024-06-02T04:44:37.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:37 smithi192 ceph-mon[47933]: Detected new or changed devices on smithi119 2024-06-02T04:44:37.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:37 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:37.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:37 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:37.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:37 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:44:37.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:37 smithi192 ceph-mon[47933]: Adjusting osd_memory_target on smithi119 to 17113M 2024-06-02T04:44:37.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:37 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:37.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:37 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:44:37.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:37 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:44:37.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:37 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:37.445 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:44:37.445+0000 7f71f5e1b700 1 -- 172.21.15.192:0/2786365979 --> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi192:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f71f00613e0 con 0x7f71dc0a1090 2024-06-02T04:44:37.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:37 smithi119 ceph-mon[46633]: pgmap v44: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-06-02T04:44:37.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:37 smithi119 ceph-mon[46633]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-06-02T04:44:37.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:37 smithi119 ceph-mon[46633]: osdmap e10: 2 total, 1 up, 2 in 2024-06-02T04:44:37.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:37 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-02T04:44:37.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:37 smithi119 ceph-mon[46633]: from='osd.1 [v2:172.21.15.119:6800/2353738098,v1:172.21.15.119:6801/2353738098]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2024-06-02T04:44:37.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:37 smithi119 ceph-mon[46633]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2024-06-02T04:44:37.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:37 smithi119 ceph-mon[46633]: Detected new or changed devices on smithi119 2024-06-02T04:44:37.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:37 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:37.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:37 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:37.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:37 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:44:37.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:37 smithi119 ceph-mon[46633]: Adjusting osd_memory_target on smithi119 to 17113M 2024-06-02T04:44:37.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:37 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:37.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:37 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:44:37.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:37 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:44:37.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:37 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:37.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:37 smithi076 ceph-mon[42935]: pgmap v44: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-06-02T04:44:37.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:37 smithi076 ceph-mon[42935]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-06-02T04:44:37.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:37 smithi076 ceph-mon[42935]: osdmap e10: 2 total, 1 up, 2 in 2024-06-02T04:44:37.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:37 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-02T04:44:37.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:37 smithi076 ceph-mon[42935]: from='osd.1 [v2:172.21.15.119:6800/2353738098,v1:172.21.15.119:6801/2353738098]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2024-06-02T04:44:37.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:37 smithi076 ceph-mon[42935]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2024-06-02T04:44:37.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:37 smithi076 ceph-mon[42935]: Detected new or changed devices on smithi119 2024-06-02T04:44:37.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:37 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:37.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:37 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:37.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:37 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:44:37.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:37 smithi076 ceph-mon[42935]: Adjusting osd_memory_target on smithi119 to 17113M 2024-06-02T04:44:37.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:37 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:37.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:37 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:44:37.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:37 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:44:37.735 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:37 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:38.096 INFO:journalctl@ceph.osd.1.smithi119.stdout:Jun 02 04:44:37 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-1[51608]: 2024-06-02T04:44:37.715+0000 7f32e99f7700 -1 osd.1 0 waiting for initial osdmap 2024-06-02T04:44:38.096 INFO:journalctl@ceph.osd.1.smithi119.stdout:Jun 02 04:44:37 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-1[51608]: 2024-06-02T04:44:37.720+0000 7f32e17e4700 -1 osd.1 11 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-02T04:44:38.431 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:38 smithi192 ceph-mon[47933]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]': finished 2024-06-02T04:44:38.431 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:38 smithi192 ceph-mon[47933]: osdmap e11: 2 total, 1 up, 2 in 2024-06-02T04:44:38.431 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:38 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-02T04:44:38.431 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:38 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-02T04:44:38.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:38 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T04:44:38.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:38 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T04:44:38.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:38 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:44:38.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:38 smithi192 ceph-mon[47933]: from='osd.1 ' entity='osd.1' 2024-06-02T04:44:38.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:38 smithi119 ceph-mon[46633]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]': finished 2024-06-02T04:44:38.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:38 smithi119 ceph-mon[46633]: osdmap e11: 2 total, 1 up, 2 in 2024-06-02T04:44:38.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:38 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-02T04:44:38.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:38 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-02T04:44:38.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:38 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T04:44:38.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:38 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T04:44:38.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:38 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:44:38.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:38 smithi119 ceph-mon[46633]: from='osd.1 ' entity='osd.1' 2024-06-02T04:44:38.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:38 smithi076 ceph-mon[42935]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]': finished 2024-06-02T04:44:38.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:38 smithi076 ceph-mon[42935]: osdmap e11: 2 total, 1 up, 2 in 2024-06-02T04:44:38.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:38 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-02T04:44:38.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:38 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-02T04:44:38.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:38 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T04:44:38.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:38 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T04:44:38.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:38 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:44:38.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:38 smithi076 ceph-mon[42935]: from='osd.1 ' entity='osd.1' 2024-06-02T04:44:39.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:39 smithi119 ceph-mon[46633]: purged_snaps scrub starts 2024-06-02T04:44:39.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:39 smithi119 ceph-mon[46633]: purged_snaps scrub ok 2024-06-02T04:44:39.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:39 smithi119 ceph-mon[46633]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi192:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:44:39.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:39 smithi119 ceph-mon[46633]: pgmap v47: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-06-02T04:44:39.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:39 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-02T04:44:39.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:39 smithi119 ceph-mon[46633]: osd.1 [v2:172.21.15.119:6800/2353738098,v1:172.21.15.119:6801/2353738098] boot 2024-06-02T04:44:39.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:39 smithi119 ceph-mon[46633]: osdmap e12: 2 total, 2 up, 2 in 2024-06-02T04:44:39.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:39 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-02T04:44:39.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:39 smithi192 ceph-mon[47933]: purged_snaps scrub starts 2024-06-02T04:44:39.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:39 smithi192 ceph-mon[47933]: purged_snaps scrub ok 2024-06-02T04:44:39.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:39 smithi192 ceph-mon[47933]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi192:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:44:39.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:39 smithi192 ceph-mon[47933]: pgmap v47: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-06-02T04:44:39.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:39 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-02T04:44:39.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:39 smithi192 ceph-mon[47933]: osd.1 [v2:172.21.15.119:6800/2353738098,v1:172.21.15.119:6801/2353738098] boot 2024-06-02T04:44:39.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:39 smithi192 ceph-mon[47933]: osdmap e12: 2 total, 2 up, 2 in 2024-06-02T04:44:39.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:39 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-02T04:44:39.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:39 smithi076 ceph-mon[42935]: purged_snaps scrub starts 2024-06-02T04:44:39.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:39 smithi076 ceph-mon[42935]: purged_snaps scrub ok 2024-06-02T04:44:39.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:39 smithi076 ceph-mon[42935]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi192:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:44:39.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:39 smithi076 ceph-mon[42935]: pgmap v47: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-06-02T04:44:39.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:39 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-02T04:44:39.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:39 smithi076 ceph-mon[42935]: osd.1 [v2:172.21.15.119:6800/2353738098,v1:172.21.15.119:6801/2353738098] boot 2024-06-02T04:44:39.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:39 smithi076 ceph-mon[42935]: osdmap e12: 2 total, 2 up, 2 in 2024-06-02T04:44:39.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:39 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-02T04:44:40.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:40 smithi119 ceph-mon[46633]: from='client.? 172.21.15.192:0/4292286176' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4addc09e-77a9-428a-bcc4-38194f486cf6"}]: dispatch 2024-06-02T04:44:40.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:40 smithi119 ceph-mon[46633]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4addc09e-77a9-428a-bcc4-38194f486cf6"}]: dispatch 2024-06-02T04:44:40.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:40 smithi119 ceph-mon[46633]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4addc09e-77a9-428a-bcc4-38194f486cf6"}]': finished 2024-06-02T04:44:40.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:40 smithi119 ceph-mon[46633]: osdmap e13: 3 total, 2 up, 3 in 2024-06-02T04:44:40.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:40 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-02T04:44:40.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:40 smithi119 ceph-mon[46633]: from='client.? 172.21.15.192:0/4003773882' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T04:44:40.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:40 smithi192 ceph-mon[47933]: from='client.? 172.21.15.192:0/4292286176' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4addc09e-77a9-428a-bcc4-38194f486cf6"}]: dispatch 2024-06-02T04:44:40.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:40 smithi192 ceph-mon[47933]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4addc09e-77a9-428a-bcc4-38194f486cf6"}]: dispatch 2024-06-02T04:44:40.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:40 smithi192 ceph-mon[47933]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4addc09e-77a9-428a-bcc4-38194f486cf6"}]': finished 2024-06-02T04:44:40.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:40 smithi192 ceph-mon[47933]: osdmap e13: 3 total, 2 up, 3 in 2024-06-02T04:44:40.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:40 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-02T04:44:40.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:40 smithi192 ceph-mon[47933]: from='client.? 172.21.15.192:0/4003773882' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T04:44:40.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:40 smithi076 ceph-mon[42935]: from='client.? 172.21.15.192:0/4292286176' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4addc09e-77a9-428a-bcc4-38194f486cf6"}]: dispatch 2024-06-02T04:44:40.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:40 smithi076 ceph-mon[42935]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4addc09e-77a9-428a-bcc4-38194f486cf6"}]: dispatch 2024-06-02T04:44:40.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:40 smithi076 ceph-mon[42935]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4addc09e-77a9-428a-bcc4-38194f486cf6"}]': finished 2024-06-02T04:44:40.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:40 smithi076 ceph-mon[42935]: osdmap e13: 3 total, 2 up, 3 in 2024-06-02T04:44:40.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:40 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-02T04:44:40.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:40 smithi076 ceph-mon[42935]: from='client.? 172.21.15.192:0/4003773882' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T04:44:41.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:41 smithi119 ceph-mon[46633]: pgmap v50: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-02T04:44:41.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:41 smithi192 ceph-mon[47933]: pgmap v50: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-02T04:44:41.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:41 smithi076 ceph-mon[42935]: pgmap v50: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-02T04:44:43.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:43 smithi119 ceph-mon[46633]: pgmap v51: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-02T04:44:43.646 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:43 smithi192 ceph-mon[47933]: pgmap v51: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-02T04:44:43.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:43 smithi076 ceph-mon[42935]: pgmap v51: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-02T04:44:45.592 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:45 smithi192 ceph-mon[47933]: pgmap v52: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-02T04:44:45.592 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:45 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-06-02T04:44:45.592 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:45 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:44:45.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:45 smithi119 ceph-mon[46633]: pgmap v52: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-02T04:44:45.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:45 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-06-02T04:44:45.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:45 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:44:45.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:45 smithi076 ceph-mon[42935]: pgmap v52: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-02T04:44:45.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:45 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-06-02T04:44:45.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:45 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:44:46.431 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:46 smithi192 ceph-mon[47933]: Deploying daemon osd.2 on smithi192 2024-06-02T04:44:46.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:46 smithi119 ceph-mon[46633]: Deploying daemon osd.2 on smithi192 2024-06-02T04:44:46.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:46 smithi076 ceph-mon[42935]: Deploying daemon osd.2 on smithi192 2024-06-02T04:44:47.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:47 smithi119 ceph-mon[46633]: pgmap v53: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-02T04:44:47.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:47 smithi192 ceph-mon[47933]: pgmap v53: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-02T04:44:47.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:47 smithi076 ceph-mon[42935]: pgmap v53: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-02T04:44:49.431 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:49 smithi192 ceph-mon[47933]: pgmap v54: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-02T04:44:49.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:49 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:49.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:49 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:49.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:49 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:44:49.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:49 smithi119 ceph-mon[46633]: pgmap v54: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-02T04:44:49.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:49 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:49.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:49 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:49.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:49 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:44:49.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:49 smithi076 ceph-mon[42935]: pgmap v54: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-02T04:44:49.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:49 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:49.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:49 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:49.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:49 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:44:50.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:44:50.847+0000 7f71ecff9700 1 -- 172.21.15.192:0/2786365979 <== mgr.14152 v2:172.21.15.76:6800/2591353090 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f71f00613e0 con 0x7f71dc0a1090 2024-06-02T04:44:50.847 INFO:teuthology.orchestra.run.smithi192.stdout:Created osd(s) 2 on host 'smithi192' 2024-06-02T04:44:50.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:44:50.850+0000 7f71f5e1b700 1 -- 172.21.15.192:0/2786365979 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f71dc0a1090 msgr2=0x7f71dc0a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:44:50.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:44:50.850+0000 7f71f5e1b700 1 --2- 172.21.15.192:0/2786365979 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f71dc0a1090 0x7f71dc0a3550 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f71e0005950 tx=0x7f71e00058e0 comp rx=0 tx=0).stop 2024-06-02T04:44:50.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:44:50.850+0000 7f71f5e1b700 1 -- 172.21.15.192:0/2786365979 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71f00fff00 msgr2=0x7f71f0196de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:44:50.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:44:50.850+0000 7f71f5e1b700 1 --2- 172.21.15.192:0/2786365979 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71f00fff00 0x7f71f0196de0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f71d80098e0 tx=0x7f71d8005f10 comp rx=0 tx=0).stop 2024-06-02T04:44:50.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:44:50.850+0000 7f71f5e1b700 1 -- 172.21.15.192:0/2786365979 shutdown_connections 2024-06-02T04:44:50.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:44:50.850+0000 7f71f5e1b700 1 --2- 172.21.15.192:0/2786365979 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f71dc0a1090 0x7f71dc0a3550 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:44:50.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:44:50.850+0000 7f71f5e1b700 1 --2- 172.21.15.192:0/2786365979 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71f0101a20 0x7f71f019e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:44:50.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:44:50.850+0000 7f71f5e1b700 1 --2- 172.21.15.192:0/2786365979 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71f00fff00 0x7f71f0196de0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:44:50.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:44:50.850+0000 7f71f5e1b700 1 --2- 172.21.15.192:0/2786365979 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f71f0101060 0x7f71f0197320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:44:50.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:44:50.850+0000 7f71f5e1b700 1 -- 172.21.15.192:0/2786365979 >> 172.21.15.192:0/2786365979 conn(0x7f71f00fb4a0 msgr2=0x7f71f0104460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:44:50.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:44:50.850+0000 7f71f5e1b700 1 -- 172.21.15.192:0/2786365979 shutdown_connections 2024-06-02T04:44:50.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:44:50.850+0000 7f71f5e1b700 1 -- 172.21.15.192:0/2786365979 wait complete. 2024-06-02T04:44:51.139 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:50 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:51.139 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:50 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:51.139 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:50 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:44:51.139 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:50 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:44:51.139 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:50 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:51.139 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:50 smithi192 ceph-mon[47933]: pgmap v55: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-02T04:44:51.139 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:50 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:51.139 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:50 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:44:51.140 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:50 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:51.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:50 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:51.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:50 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:51.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:50 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:44:51.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:50 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:44:51.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:50 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:51.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:50 smithi076 ceph-mon[42935]: pgmap v55: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-02T04:44:51.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:50 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:51.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:50 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:44:51.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:50 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:51.335 DEBUG:teuthology.orchestra.run.smithi192:osd.2> sudo journalctl -f -n 0 -u ceph-60ab6d30-209a-11ef-bc9b-c7b262605968@osd.2.service 2024-06-02T04:44:51.337 INFO:tasks.cephadm:Deploying osd.3 on smithi076 with /dev/vg_nvme/lv_3... 2024-06-02T04:44:51.338 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 60ab6d30-209a-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-06-02T04:44:51.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:50 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:51.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:50 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:51.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:50 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:44:51.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:50 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:44:51.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:50 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:51.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:50 smithi119 ceph-mon[46633]: pgmap v55: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-02T04:44:51.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:50 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:51.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:50 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:44:51.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:50 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:51.368 INFO:journalctl@ceph.osd.2.smithi192.stdout:-- Logs begin at Sun 2024-06-02 04:25:37 UTC. -- 2024-06-02T04:44:51.580 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T04:44:52.861 INFO:teuthology.orchestra.run.smithi076.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-06-02T04:44:52.861 INFO:teuthology.orchestra.run.smithi076.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-06-02T04:44:52.861 INFO:teuthology.orchestra.run.smithi076.stderr: stderr: 10+0 records in 2024-06-02T04:44:52.861 INFO:teuthology.orchestra.run.smithi076.stderr:10+0 records out 2024-06-02T04:44:52.861 INFO:teuthology.orchestra.run.smithi076.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0132377 s, 792 MB/s 2024-06-02T04:44:52.861 INFO:teuthology.orchestra.run.smithi076.stderr:--> Zapping successful for: 2024-06-02T04:44:52.932 INFO:journalctl@ceph.osd.2.smithi192.stdout:Jun 02 04:44:52 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-2[53703]: 2024-06-02T04:44:52.649+0000 7fdbef30f7c0 -1 osd.2 0 log_to_monitors true 2024-06-02T04:44:53.285 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 60ab6d30-209a-11ef-bc9b-c7b262605968 -- ceph orch daemon add osd smithi076:vg_nvme/lv_3 2024-06-02T04:44:53.431 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:53 smithi192 ceph-mon[47933]: pgmap v56: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-02T04:44:53.431 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:53 smithi192 ceph-mon[47933]: from='osd.2 [v2:172.21.15.192:6800/3206918546,v1:172.21.15.192:6801/3206918546]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-06-02T04:44:53.431 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:53 smithi192 ceph-mon[47933]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-06-02T04:44:53.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:53 smithi076 ceph-mon[42935]: pgmap v56: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-02T04:44:53.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:53 smithi076 ceph-mon[42935]: from='osd.2 [v2:172.21.15.192:6800/3206918546,v1:172.21.15.192:6801/3206918546]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-06-02T04:44:53.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:53 smithi076 ceph-mon[42935]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-06-02T04:44:53.511 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T04:44:53.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:53 smithi119 ceph-mon[46633]: pgmap v56: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-02T04:44:53.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:53 smithi119 ceph-mon[46633]: from='osd.2 [v2:172.21.15.192:6800/3206918546,v1:172.21.15.192:6801/3206918546]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-06-02T04:44:53.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:53 smithi119 ceph-mon[46633]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-06-02T04:44:54.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:54 smithi076 ceph-mon[42935]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-06-02T04:44:54.289 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:54 smithi076 ceph-mon[42935]: osdmap e14: 3 total, 2 up, 3 in 2024-06-02T04:44:54.289 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:54 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-02T04:44:54.289 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:54 smithi076 ceph-mon[42935]: from='osd.2 [v2:172.21.15.192:6800/3206918546,v1:172.21.15.192:6801/3206918546]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]: dispatch 2024-06-02T04:44:54.289 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:54 smithi076 ceph-mon[42935]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]: dispatch 2024-06-02T04:44:54.289 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:54 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:54.289 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:54 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:54.289 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:54 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:44:54.290 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:54 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:54.290 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:54 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:44:54.290 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:54 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:44:54.290 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:54 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:54.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:54 smithi192 ceph-mon[47933]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-06-02T04:44:54.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:54 smithi192 ceph-mon[47933]: osdmap e14: 3 total, 2 up, 3 in 2024-06-02T04:44:54.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:54 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-02T04:44:54.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:54 smithi192 ceph-mon[47933]: from='osd.2 [v2:172.21.15.192:6800/3206918546,v1:172.21.15.192:6801/3206918546]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]: dispatch 2024-06-02T04:44:54.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:54 smithi192 ceph-mon[47933]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]: dispatch 2024-06-02T04:44:54.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:54 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:54.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:54 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:54.433 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:54 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:44:54.433 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:54 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:54.433 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:54 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:44:54.433 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:54 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:44:54.433 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:54 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:54.518 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:44:54.515+0000 7f72397f2700 1 -- 172.21.15.76:0/3844708419 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7234101a90 msgr2=0x7f7234103e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:44:54.518 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:44:54.515+0000 7f72397f2700 1 --2- 172.21.15.76:0/3844708419 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7234101a90 0x7f7234103e80 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7228009990 tx=0x7f7228009ca0 comp rx=0 tx=0).stop 2024-06-02T04:44:54.518 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:44:54.515+0000 7f72397f2700 1 -- 172.21.15.76:0/3844708419 shutdown_connections 2024-06-02T04:44:54.519 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:44:54.515+0000 7f72397f2700 1 --2- 172.21.15.76:0/3844708419 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7234106cf0 0x7f7234109160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:44:54.519 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:44:54.515+0000 7f72397f2700 1 --2- 172.21.15.76:0/3844708419 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7234101a90 0x7f7234103e80 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:44:54.519 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:44:54.515+0000 7f72397f2700 1 --2- 172.21.15.76:0/3844708419 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f72341043c0 0x7f72341067b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:44:54.519 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:44:54.515+0000 7f72397f2700 1 -- 172.21.15.76:0/3844708419 >> 172.21.15.76:0/3844708419 conn(0x7f72340fb4a0 msgr2=0x7f72340fd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:44:54.519 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:44:54.515+0000 7f72397f2700 1 -- 172.21.15.76:0/3844708419 shutdown_connections 2024-06-02T04:44:54.519 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:44:54.515+0000 7f72397f2700 1 -- 172.21.15.76:0/3844708419 wait complete. 2024-06-02T04:44:54.519 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:44:54.515+0000 7f72397f2700 1 Processor -- start 2024-06-02T04:44:54.519 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:44:54.516+0000 7f72397f2700 1 -- start start 2024-06-02T04:44:54.519 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:44:54.516+0000 7f72397f2700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7234101a90 0x7f7234196e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:44:54.519 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:44:54.516+0000 7f72397f2700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f72341043c0 0x7f7234197360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:44:54.519 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:44:54.516+0000 7f72397f2700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7234106cf0 0x7f723419e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:44:54.520 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:44:54.516+0000 7f72397f2700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f723419e960 con 0x7f7234101a90 2024-06-02T04:44:54.520 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:44:54.516+0000 7f72397f2700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f723419eaa0 con 0x7f7234106cf0 2024-06-02T04:44:54.520 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:44:54.516+0000 7f72397f2700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f723419ec30 con 0x7f72341043c0 2024-06-02T04:44:54.520 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:44:54.516+0000 7f7232ffd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7234101a90 0x7f7234196e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:44:54.520 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:44:54.516+0000 7f7232ffd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7234101a90 0x7f7234196e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:54252/0 (socket says 172.21.15.76:54252) 2024-06-02T04:44:54.520 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:44:54.516+0000 7f7232ffd700 1 -- 172.21.15.76:0/3569183377 learned_addr learned my addr 172.21.15.76:0/3569183377 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:44:54.520 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:44:54.516+0000 7f72337fe700 1 --2- 172.21.15.76:0/3569183377 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7234106cf0 0x7f723419e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:44:54.520 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:44:54.516+0000 7f72327fc700 1 --2- 172.21.15.76:0/3569183377 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f72341043c0 0x7f7234197360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:44:54.520 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:44:54.516+0000 7f7232ffd700 1 -- 172.21.15.76:0/3569183377 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f72341043c0 msgr2=0x7f7234197360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:44:54.520 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:44:54.516+0000 7f7232ffd700 1 --2- 172.21.15.76:0/3569183377 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f72341043c0 0x7f7234197360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:44:54.520 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:44:54.516+0000 7f7232ffd700 1 -- 172.21.15.76:0/3569183377 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7234106cf0 msgr2=0x7f723419e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:44:54.520 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:44:54.516+0000 7f7232ffd700 1 --2- 172.21.15.76:0/3569183377 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7234106cf0 0x7f723419e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:44:54.520 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:44:54.516+0000 7f7232ffd700 1 -- 172.21.15.76:0/3569183377 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72280095f0 con 0x7f7234101a90 2024-06-02T04:44:54.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:44:54.516+0000 7f72337fe700 1 --2- 172.21.15.76:0/3569183377 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7234106cf0 0x7f723419e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:44:54.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:44:54.516+0000 7f7232ffd700 1 --2- 172.21.15.76:0/3569183377 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7234101a90 0x7f7234196e20 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7228000c00 tx=0x7f7228003b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:44:54.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:44:54.517+0000 7f721bfff700 1 -- 172.21.15.76:0/3569183377 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f722801d070 con 0x7f7234101a90 2024-06-02T04:44:54.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:44:54.517+0000 7f721bfff700 1 -- 172.21.15.76:0/3569183377 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f722800bd90 con 0x7f7234101a90 2024-06-02T04:44:54.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:44:54.517+0000 7f72397f2700 1 -- 172.21.15.76:0/3569183377 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f723419eeb0 con 0x7f7234101a90 2024-06-02T04:44:54.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:44:54.517+0000 7f721bfff700 1 -- 172.21.15.76:0/3569183377 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7228022dc0 con 0x7f7234101a90 2024-06-02T04:44:54.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:44:54.517+0000 7f72397f2700 1 -- 172.21.15.76:0/3569183377 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f723419f210 con 0x7f7234101a90 2024-06-02T04:44:54.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:44:54.518+0000 7f72397f2700 1 -- 172.21.15.76:0/3569183377 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72340fd020 con 0x7f7234101a90 2024-06-02T04:44:54.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:44:54.519+0000 7f721bfff700 1 -- 172.21.15.76:0/3569183377 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 15) v1 ==== 135817+0+0 (secure 0 0 0) 0x7f7228022470 con 0x7f7234101a90 2024-06-02T04:44:54.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:44:54.519+0000 7f721bfff700 1 --2- 172.21.15.76:0/3569183377 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f721c0a1090 0x7f721c0a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:44:54.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:44:54.519+0000 7f72327fc700 1 --2- 172.21.15.76:0/3569183377 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f721c0a1090 0x7f721c0a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:44:54.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:44:54.519+0000 7f721bfff700 1 -- 172.21.15.76:0/3569183377 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2571+0+0 (secure 0 0 0) 0x7f72280cc6b0 con 0x7f7234101a90 2024-06-02T04:44:54.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:44:54.520+0000 7f72327fc700 1 --2- 172.21.15.76:0/3569183377 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f721c0a1090 0x7f721c0a3550 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7224005950 tx=0x7f72240058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:44:54.524 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:44:54.524+0000 7f721bfff700 1 -- 172.21.15.76:0/3569183377 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f7228097620 con 0x7f7234101a90 2024-06-02T04:44:54.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:54 smithi119 ceph-mon[46633]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-06-02T04:44:54.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:54 smithi119 ceph-mon[46633]: osdmap e14: 3 total, 2 up, 3 in 2024-06-02T04:44:54.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:54 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-02T04:44:54.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:54 smithi119 ceph-mon[46633]: from='osd.2 [v2:172.21.15.192:6800/3206918546,v1:172.21.15.192:6801/3206918546]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]: dispatch 2024-06-02T04:44:54.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:54 smithi119 ceph-mon[46633]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]: dispatch 2024-06-02T04:44:54.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:54 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:54.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:54 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:54.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:54 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:44:54.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:54 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:54.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:54 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:44:54.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:54 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:44:54.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:54 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:54.729 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:44:54.728+0000 7f72397f2700 1 -- 172.21.15.76:0/3569183377 --> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi076:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f723402ceb0 con 0x7f721c0a1090 2024-06-02T04:44:54.931 INFO:journalctl@ceph.osd.2.smithi192.stdout:Jun 02 04:44:54 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-2[53703]: 2024-06-02T04:44:54.600+0000 7fdbe5174700 -1 osd.2 0 waiting for initial osdmap 2024-06-02T04:44:54.931 INFO:journalctl@ceph.osd.2.smithi192.stdout:Jun 02 04:44:54 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-2[53703]: 2024-06-02T04:44:54.606+0000 7fdbdc760700 -1 osd.2 15 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-02T04:44:55.431 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:55 smithi192 ceph-mon[47933]: Detected new or changed devices on smithi192 2024-06-02T04:44:55.431 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:55 smithi192 ceph-mon[47933]: Adjusting osd_memory_target on smithi192 to 17113M 2024-06-02T04:44:55.431 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:55 smithi192 ceph-mon[47933]: pgmap v58: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-02T04:44:55.431 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:55 smithi192 ceph-mon[47933]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]': finished 2024-06-02T04:44:55.431 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:55 smithi192 ceph-mon[47933]: osdmap e15: 3 total, 2 up, 3 in 2024-06-02T04:44:55.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:55 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-02T04:44:55.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:55 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-02T04:44:55.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:55 smithi192 ceph-mon[47933]: from='osd.2 ' entity='osd.2' 2024-06-02T04:44:55.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:55 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T04:44:55.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:55 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T04:44:55.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:55 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:44:55.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:55 smithi076 ceph-mon[42935]: Detected new or changed devices on smithi192 2024-06-02T04:44:55.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:55 smithi076 ceph-mon[42935]: Adjusting osd_memory_target on smithi192 to 17113M 2024-06-02T04:44:55.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:55 smithi076 ceph-mon[42935]: pgmap v58: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-02T04:44:55.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:55 smithi076 ceph-mon[42935]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]': finished 2024-06-02T04:44:55.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:55 smithi076 ceph-mon[42935]: osdmap e15: 3 total, 2 up, 3 in 2024-06-02T04:44:55.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:55 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-02T04:44:55.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:55 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-02T04:44:55.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:55 smithi076 ceph-mon[42935]: from='osd.2 ' entity='osd.2' 2024-06-02T04:44:55.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:55 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T04:44:55.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:55 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T04:44:55.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:55 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:44:55.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:55 smithi119 ceph-mon[46633]: Detected new or changed devices on smithi192 2024-06-02T04:44:55.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:55 smithi119 ceph-mon[46633]: Adjusting osd_memory_target on smithi192 to 17113M 2024-06-02T04:44:55.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:55 smithi119 ceph-mon[46633]: pgmap v58: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-02T04:44:55.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:55 smithi119 ceph-mon[46633]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]': finished 2024-06-02T04:44:55.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:55 smithi119 ceph-mon[46633]: osdmap e15: 3 total, 2 up, 3 in 2024-06-02T04:44:55.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:55 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-02T04:44:55.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:55 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-02T04:44:55.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:55 smithi119 ceph-mon[46633]: from='osd.2 ' entity='osd.2' 2024-06-02T04:44:55.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:55 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T04:44:55.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:55 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T04:44:55.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:55 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:44:56.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:56 smithi192 ceph-mon[47933]: purged_snaps scrub starts 2024-06-02T04:44:56.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:56 smithi192 ceph-mon[47933]: purged_snaps scrub ok 2024-06-02T04:44:56.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:56 smithi192 ceph-mon[47933]: from='client.14286 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi076:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:44:56.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:56 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-02T04:44:56.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:56 smithi192 ceph-mon[47933]: osd.2 [v2:172.21.15.192:6800/3206918546,v1:172.21.15.192:6801/3206918546] boot 2024-06-02T04:44:56.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:56 smithi192 ceph-mon[47933]: osdmap e16: 3 total, 3 up, 3 in 2024-06-02T04:44:56.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:56 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-02T04:44:56.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:56 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-06-02T04:44:56.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:56 smithi076 ceph-mon[42935]: purged_snaps scrub starts 2024-06-02T04:44:56.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:56 smithi076 ceph-mon[42935]: purged_snaps scrub ok 2024-06-02T04:44:56.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:56 smithi076 ceph-mon[42935]: from='client.14286 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi076:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:44:56.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:56 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-02T04:44:56.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:56 smithi076 ceph-mon[42935]: osd.2 [v2:172.21.15.192:6800/3206918546,v1:172.21.15.192:6801/3206918546] boot 2024-06-02T04:44:56.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:56 smithi076 ceph-mon[42935]: osdmap e16: 3 total, 3 up, 3 in 2024-06-02T04:44:56.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:56 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-02T04:44:56.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:56 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-06-02T04:44:56.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:56 smithi119 ceph-mon[46633]: purged_snaps scrub starts 2024-06-02T04:44:56.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:56 smithi119 ceph-mon[46633]: purged_snaps scrub ok 2024-06-02T04:44:56.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:56 smithi119 ceph-mon[46633]: from='client.14286 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi076:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:44:56.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:56 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-02T04:44:56.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:56 smithi119 ceph-mon[46633]: osd.2 [v2:172.21.15.192:6800/3206918546,v1:172.21.15.192:6801/3206918546] boot 2024-06-02T04:44:56.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:56 smithi119 ceph-mon[46633]: osdmap e16: 3 total, 3 up, 3 in 2024-06-02T04:44:56.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:56 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-02T04:44:56.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:56 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-06-02T04:44:57.230 INFO:journalctl@ceph.osd.0.smithi076.stdout:Jun 02 04:44:56 smithi076 sudo[68442]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-06-02T04:44:57.231 INFO:journalctl@ceph.osd.0.smithi076.stdout:Jun 02 04:44:56 smithi076 sudo[68442]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-02T04:44:57.231 INFO:journalctl@ceph.osd.0.smithi076.stdout:Jun 02 04:44:56 smithi076 sudo[68442]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-02T04:44:57.231 INFO:journalctl@ceph.osd.0.smithi076.stdout:Jun 02 04:44:56 smithi076 sudo[68442]: pam_unix(sudo:session): session closed for user root 2024-06-02T04:44:57.483 INFO:journalctl@ceph.osd.0.smithi076.stdout:Jun 02 04:44:57 smithi076 sudo[68465]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-06-02T04:44:57.483 INFO:journalctl@ceph.osd.0.smithi076.stdout:Jun 02 04:44:57 smithi076 sudo[68465]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-02T04:44:57.483 INFO:journalctl@ceph.osd.0.smithi076.stdout:Jun 02 04:44:57 smithi076 sudo[68465]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-02T04:44:57.483 INFO:journalctl@ceph.osd.0.smithi076.stdout:Jun 02 04:44:57 smithi076 sudo[68465]: pam_unix(sudo:session): session closed for user root 2024-06-02T04:44:57.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:57 smithi076 ceph-mon[42935]: pgmap v61: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-02T04:44:57.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:57 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-06-02T04:44:57.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:57 smithi076 ceph-mon[42935]: osdmap e17: 3 total, 3 up, 3 in 2024-06-02T04:44:57.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:57 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-06-02T04:44:57.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:57 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/3173557532' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dc525518-82c6-49ed-8ca8-e3bd5bfc18d1"}]: dispatch 2024-06-02T04:44:57.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:57 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-06-02T04:44:57.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:57 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/3173557532' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dc525518-82c6-49ed-8ca8-e3bd5bfc18d1"}]': finished 2024-06-02T04:44:57.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:57 smithi076 ceph-mon[42935]: osdmap e18: 4 total, 3 up, 4 in 2024-06-02T04:44:57.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:57 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-02T04:44:57.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:57 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:57.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:57 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/2871012569' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T04:44:57.635 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:44:57.635+0000 7f721bfff700 1 -- 172.21.15.76:0/3569183377 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f72280979f0 con 0x7f7234101a90 2024-06-02T04:44:57.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:57 smithi192 ceph-mon[47933]: pgmap v61: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-02T04:44:57.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:57 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-06-02T04:44:57.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:57 smithi192 ceph-mon[47933]: osdmap e17: 3 total, 3 up, 3 in 2024-06-02T04:44:57.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:57 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-06-02T04:44:57.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:57 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/3173557532' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dc525518-82c6-49ed-8ca8-e3bd5bfc18d1"}]: dispatch 2024-06-02T04:44:57.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:57 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-06-02T04:44:57.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:57 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/3173557532' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dc525518-82c6-49ed-8ca8-e3bd5bfc18d1"}]': finished 2024-06-02T04:44:57.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:57 smithi192 ceph-mon[47933]: osdmap e18: 4 total, 3 up, 4 in 2024-06-02T04:44:57.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:57 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-02T04:44:57.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:57 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:57.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:57 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/2871012569' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T04:44:57.744 INFO:journalctl@ceph.osd.1.smithi119.stdout:Jun 02 04:44:57 smithi119 sudo[57193]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-06-02T04:44:57.745 INFO:journalctl@ceph.osd.1.smithi119.stdout:Jun 02 04:44:57 smithi119 sudo[57193]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-02T04:44:57.745 INFO:journalctl@ceph.osd.1.smithi119.stdout:Jun 02 04:44:57 smithi119 sudo[57193]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-02T04:44:57.745 INFO:journalctl@ceph.osd.1.smithi119.stdout:Jun 02 04:44:57 smithi119 sudo[57193]: pam_unix(sudo:session): session closed for user root 2024-06-02T04:44:57.745 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:57 smithi119 ceph-mon[46633]: pgmap v61: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-02T04:44:57.745 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:57 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-06-02T04:44:57.745 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:57 smithi119 ceph-mon[46633]: osdmap e17: 3 total, 3 up, 3 in 2024-06-02T04:44:57.745 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:57 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-06-02T04:44:57.746 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:57 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/3173557532' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dc525518-82c6-49ed-8ca8-e3bd5bfc18d1"}]: dispatch 2024-06-02T04:44:57.746 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:57 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-06-02T04:44:57.746 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:57 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/3173557532' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dc525518-82c6-49ed-8ca8-e3bd5bfc18d1"}]': finished 2024-06-02T04:44:57.746 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:57 smithi119 ceph-mon[46633]: osdmap e18: 4 total, 3 up, 4 in 2024-06-02T04:44:57.746 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:57 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-02T04:44:57.746 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:57 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:57.746 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:57 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/2871012569' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T04:44:58.096 INFO:journalctl@ceph.osd.1.smithi119.stdout:Jun 02 04:44:57 smithi119 sudo[57196]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-06-02T04:44:58.096 INFO:journalctl@ceph.osd.1.smithi119.stdout:Jun 02 04:44:57 smithi119 sudo[57196]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-02T04:44:58.096 INFO:journalctl@ceph.osd.1.smithi119.stdout:Jun 02 04:44:57 smithi119 sudo[57196]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-02T04:44:58.096 INFO:journalctl@ceph.osd.1.smithi119.stdout:Jun 02 04:44:57 smithi119 sudo[57196]: pam_unix(sudo:session): session closed for user root 2024-06-02T04:44:58.431 INFO:journalctl@ceph.osd.2.smithi192.stdout:Jun 02 04:44:58 smithi192 sudo[58361]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-06-02T04:44:58.431 INFO:journalctl@ceph.osd.2.smithi192.stdout:Jun 02 04:44:58 smithi192 sudo[58361]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-02T04:44:58.431 INFO:journalctl@ceph.osd.2.smithi192.stdout:Jun 02 04:44:58 smithi192 sudo[58361]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-02T04:44:58.432 INFO:journalctl@ceph.osd.2.smithi192.stdout:Jun 02 04:44:58 smithi192 sudo[58361]: pam_unix(sudo:session): session closed for user root 2024-06-02T04:44:58.432 INFO:journalctl@ceph.osd.2.smithi192.stdout:Jun 02 04:44:58 smithi192 sudo[58364]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-06-02T04:44:58.432 INFO:journalctl@ceph.osd.2.smithi192.stdout:Jun 02 04:44:58 smithi192 sudo[58364]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-02T04:44:58.432 INFO:journalctl@ceph.osd.2.smithi192.stdout:Jun 02 04:44:58 smithi192 sudo[58364]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-02T04:44:58.432 INFO:journalctl@ceph.osd.2.smithi192.stdout:Jun 02 04:44:58 smithi192 sudo[58364]: pam_unix(sudo:session): session closed for user root 2024-06-02T04:44:58.765 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:58 smithi076 sudo[68888]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-06-02T04:44:58.766 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:58 smithi076 sudo[68888]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-02T04:44:58.766 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:58 smithi076 sudo[68888]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-02T04:44:58.766 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:58 smithi076 sudo[68888]: pam_unix(sudo:session): session closed for user root 2024-06-02T04:44:59.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:58 smithi119 ceph-mon[46633]: mgrmap e16: x(active, since 111s), standbys: z, y 2024-06-02T04:44:59.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:58 smithi119 ceph-mon[46633]: osdmap e19: 4 total, 3 up, 4 in 2024-06-02T04:44:59.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:58 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-02T04:44:59.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:58 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:59.097 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:58 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:59.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:58 smithi192 ceph-mon[47933]: mgrmap e16: x(active, since 111s), standbys: z, y 2024-06-02T04:44:59.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:58 smithi192 ceph-mon[47933]: osdmap e19: 4 total, 3 up, 4 in 2024-06-02T04:44:59.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:58 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-02T04:44:59.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:58 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:59.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:58 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:59.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:59 smithi192 sudo[58367]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-06-02T04:44:59.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:59 smithi192 sudo[58367]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-02T04:44:59.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:59 smithi192 sudo[58367]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-02T04:44:59.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:59 smithi192 sudo[58367]: pam_unix(sudo:session): session closed for user root 2024-06-02T04:44:59.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:58 smithi076 sudo[69076]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-06-02T04:44:59.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:58 smithi076 sudo[69076]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-02T04:44:59.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:58 smithi076 sudo[69076]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-02T04:44:59.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:58 smithi076 sudo[69076]: pam_unix(sudo:session): session closed for user root 2024-06-02T04:44:59.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:58 smithi076 ceph-mon[42935]: mgrmap e16: x(active, since 111s), standbys: z, y 2024-06-02T04:44:59.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:58 smithi076 ceph-mon[42935]: osdmap e19: 4 total, 3 up, 4 in 2024-06-02T04:44:59.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:58 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-02T04:44:59.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:58 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:59.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:58 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:44:59.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:59 smithi192 sudo[58370]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-06-02T04:44:59.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:59 smithi192 sudo[58370]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-02T04:44:59.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:59 smithi192 sudo[58370]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-02T04:44:59.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:59 smithi192 sudo[58370]: pam_unix(sudo:session): session closed for user root 2024-06-02T04:44:59.773 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:59 smithi119 sudo[57199]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-06-02T04:44:59.773 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:59 smithi119 sudo[57199]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-02T04:44:59.773 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:59 smithi119 sudo[57199]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-02T04:44:59.773 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:59 smithi119 sudo[57199]: pam_unix(sudo:session): session closed for user root 2024-06-02T04:44:59.773 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:59 smithi119 sudo[57202]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-06-02T04:44:59.773 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:59 smithi119 sudo[57202]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-02T04:44:59.773 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:59 smithi119 sudo[57202]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-02T04:44:59.773 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:59 smithi119 sudo[57202]: pam_unix(sudo:session): session closed for user root 2024-06-02T04:44:59.774 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:59 smithi119 ceph-mon[46633]: pgmap v65: 1 pgs: 1 unknown; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-06-02T04:44:59.774 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:59 smithi119 ceph-mon[46633]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-06-02T04:45:00.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:59 smithi119 ceph-mon[46633]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-06-02T04:45:00.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:59 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-02T04:45:00.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:59 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T04:45:00.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:59 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T04:45:00.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:59 smithi119 ceph-mon[46633]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-06-02T04:45:00.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:59 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-02T04:45:00.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:59 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T04:45:00.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:59 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T04:45:00.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:59 smithi119 ceph-mon[46633]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-06-02T04:45:00.097 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:59 smithi119 ceph-mon[46633]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-06-02T04:45:00.097 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:59 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-02T04:45:00.097 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:59 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T04:45:00.097 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:59 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T04:45:00.097 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:44:59 smithi119 ceph-mon[46633]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-06-02T04:45:00.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:59 smithi192 ceph-mon[47933]: pgmap v65: 1 pgs: 1 unknown; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-06-02T04:45:00.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:59 smithi192 ceph-mon[47933]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-06-02T04:45:00.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:59 smithi192 ceph-mon[47933]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-06-02T04:45:00.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:59 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-02T04:45:00.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:59 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T04:45:00.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:59 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T04:45:00.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:59 smithi192 ceph-mon[47933]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-06-02T04:45:00.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:59 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-02T04:45:00.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:59 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T04:45:00.185 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:59 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T04:45:00.185 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:59 smithi192 ceph-mon[47933]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-06-02T04:45:00.185 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:59 smithi192 ceph-mon[47933]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-06-02T04:45:00.185 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:59 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-02T04:45:00.186 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:59 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T04:45:00.186 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:59 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T04:45:00.186 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:44:59 smithi192 ceph-mon[47933]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-06-02T04:45:00.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:59 smithi076 ceph-mon[42935]: pgmap v65: 1 pgs: 1 unknown; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-06-02T04:45:00.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:59 smithi076 ceph-mon[42935]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-06-02T04:45:00.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:59 smithi076 ceph-mon[42935]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-06-02T04:45:00.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:59 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-02T04:45:00.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:59 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T04:45:00.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:59 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T04:45:00.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:59 smithi076 ceph-mon[42935]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-06-02T04:45:00.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:59 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-02T04:45:00.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:59 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T04:45:00.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:59 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T04:45:00.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:59 smithi076 ceph-mon[42935]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-06-02T04:45:00.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:59 smithi076 ceph-mon[42935]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-06-02T04:45:00.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:59 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-02T04:45:00.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:59 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T04:45:00.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:59 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T04:45:00.235 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:44:59 smithi076 ceph-mon[42935]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-06-02T04:45:00.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:00 smithi076 ceph-mon[42935]: pgmap v66: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-06-02T04:45:01.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:00 smithi119 ceph-mon[46633]: pgmap v66: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-06-02T04:45:01.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:00 smithi192 ceph-mon[47933]: pgmap v66: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-06-02T04:45:03.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:03 smithi076 ceph-mon[42935]: pgmap v67: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-06-02T04:45:03.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:03 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-06-02T04:45:03.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:03 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:45:03.431 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:03 smithi192 ceph-mon[47933]: pgmap v67: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-06-02T04:45:03.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:03 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-06-02T04:45:03.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:03 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:45:03.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:03 smithi119 ceph-mon[46633]: pgmap v67: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-06-02T04:45:03.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:03 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-06-02T04:45:03.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:03 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:45:04.289 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:04 smithi076 ceph-mon[42935]: Deploying daemon osd.3 on smithi076 2024-06-02T04:45:04.431 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:04 smithi192 ceph-mon[47933]: Deploying daemon osd.3 on smithi076 2024-06-02T04:45:04.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:04 smithi119 ceph-mon[46633]: Deploying daemon osd.3 on smithi076 2024-06-02T04:45:05.431 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:05 smithi192 ceph-mon[47933]: pgmap v68: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-06-02T04:45:05.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:05 smithi076 ceph-mon[42935]: pgmap v68: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-06-02T04:45:05.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:05 smithi119 ceph-mon[46633]: pgmap v68: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-06-02T04:45:07.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:07 smithi076 ceph-mon[42935]: pgmap v69: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 44 KiB/s wr, 3 op/s 2024-06-02T04:45:07.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:07 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:07.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:07 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:07.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:07 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:45:07.431 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:07 smithi192 ceph-mon[47933]: pgmap v69: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 44 KiB/s wr, 3 op/s 2024-06-02T04:45:07.431 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:07 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:07.431 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:07 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:07.431 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:07 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:45:07.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:07 smithi119 ceph-mon[46633]: pgmap v69: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 44 KiB/s wr, 3 op/s 2024-06-02T04:45:07.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:07 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:07.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:07 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:07.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:07 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:45:08.222 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:45:08.222+0000 7f721bfff700 1 -- 172.21.15.76:0/3569183377 <== mgr.14152 v2:172.21.15.76:6800/2591353090 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f723402ceb0 con 0x7f721c0a1090 2024-06-02T04:45:08.223 INFO:teuthology.orchestra.run.smithi076.stdout:Created osd(s) 3 on host 'smithi076' 2024-06-02T04:45:08.225 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:45:08.224+0000 7f72397f2700 1 -- 172.21.15.76:0/3569183377 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f721c0a1090 msgr2=0x7f721c0a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:45:08.225 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:45:08.224+0000 7f72397f2700 1 --2- 172.21.15.76:0/3569183377 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f721c0a1090 0x7f721c0a3550 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7224005950 tx=0x7f72240058e0 comp rx=0 tx=0).stop 2024-06-02T04:45:08.225 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:45:08.224+0000 7f72397f2700 1 -- 172.21.15.76:0/3569183377 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7234101a90 msgr2=0x7f7234196e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:45:08.225 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:45:08.224+0000 7f72397f2700 1 --2- 172.21.15.76:0/3569183377 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7234101a90 0x7f7234196e20 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7228000c00 tx=0x7f7228003b00 comp rx=0 tx=0).stop 2024-06-02T04:45:08.225 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:45:08.225+0000 7f72397f2700 1 -- 172.21.15.76:0/3569183377 shutdown_connections 2024-06-02T04:45:08.225 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:45:08.225+0000 7f72397f2700 1 --2- 172.21.15.76:0/3569183377 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f721c0a1090 0x7f721c0a3550 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:45:08.225 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:45:08.225+0000 7f72397f2700 1 --2- 172.21.15.76:0/3569183377 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7234106cf0 0x7f723419e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:45:08.225 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:45:08.225+0000 7f72397f2700 1 --2- 172.21.15.76:0/3569183377 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7234101a90 0x7f7234196e20 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:45:08.225 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:45:08.225+0000 7f72397f2700 1 --2- 172.21.15.76:0/3569183377 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f72341043c0 0x7f7234197360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:45:08.226 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:45:08.225+0000 7f72397f2700 1 -- 172.21.15.76:0/3569183377 >> 172.21.15.76:0/3569183377 conn(0x7f72340fb4a0 msgr2=0x7f7234103980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:45:08.226 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:45:08.225+0000 7f72397f2700 1 -- 172.21.15.76:0/3569183377 shutdown_connections 2024-06-02T04:45:08.226 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:45:08.225+0000 7f72397f2700 1 -- 172.21.15.76:0/3569183377 wait complete. 2024-06-02T04:45:08.628 DEBUG:teuthology.orchestra.run.smithi076:osd.3> sudo journalctl -f -n 0 -u ceph-60ab6d30-209a-11ef-bc9b-c7b262605968@osd.3.service 2024-06-02T04:45:08.630 INFO:tasks.cephadm:Deploying osd.4 on smithi119 with /dev/vg_nvme/lv_3... 2024-06-02T04:45:08.630 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 60ab6d30-209a-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-06-02T04:45:08.661 INFO:journalctl@ceph.osd.3.smithi076.stdout:-- Logs begin at Sun 2024-06-02 04:26:13 UTC. -- 2024-06-02T04:45:08.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:08 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:08.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:08 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:08.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:08 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:45:08.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:08 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:45:08.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:08 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:08.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:08 smithi119 ceph-mon[46633]: pgmap v70: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 33 KiB/s wr, 2 op/s 2024-06-02T04:45:08.847 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:08 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:08.847 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:08 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:08.847 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:08 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:45:08.863 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/mon.b/config 2024-06-02T04:45:08.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:08 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:08.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:08 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:08.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:08 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:45:08.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:08 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:45:08.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:08 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:08.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:08 smithi192 ceph-mon[47933]: pgmap v70: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 33 KiB/s wr, 2 op/s 2024-06-02T04:45:08.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:08 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:08.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:08 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:08.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:08 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:45:08.932 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:08 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:08.932 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:08 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:08.932 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:08 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:45:08.932 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:08 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:45:08.933 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:08 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:08.933 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:08 smithi076 ceph-mon[42935]: pgmap v70: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 33 KiB/s wr, 2 op/s 2024-06-02T04:45:08.933 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:08 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:08.933 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:08 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:08.933 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:08 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:45:10.112 INFO:teuthology.orchestra.run.smithi119.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-06-02T04:45:10.112 INFO:teuthology.orchestra.run.smithi119.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-06-02T04:45:10.112 INFO:teuthology.orchestra.run.smithi119.stderr: stderr: 10+0 records in 2024-06-02T04:45:10.112 INFO:teuthology.orchestra.run.smithi119.stderr:10+0 records out 2024-06-02T04:45:10.113 INFO:teuthology.orchestra.run.smithi119.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0111454 s, 941 MB/s 2024-06-02T04:45:10.113 INFO:teuthology.orchestra.run.smithi119.stderr:--> Zapping successful for: 2024-06-02T04:45:10.431 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:10 smithi192 ceph-mon[47933]: from='osd.3 [v2:172.21.15.76:6810/3747864233,v1:172.21.15.76:6811/3747864233]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-06-02T04:45:10.482 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:10 smithi119 ceph-mon[46633]: from='osd.3 [v2:172.21.15.76:6810/3747864233,v1:172.21.15.76:6811/3747864233]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-06-02T04:45:10.483 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 60ab6d30-209a-11ef-bc9b-c7b262605968 -- ceph orch daemon add osd smithi119:vg_nvme/lv_3 2024-06-02T04:45:10.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:10 smithi076 ceph-mon[42935]: from='osd.3 [v2:172.21.15.76:6810/3747864233,v1:172.21.15.76:6811/3747864233]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-06-02T04:45:10.484 INFO:journalctl@ceph.osd.3.smithi076.stdout:Jun 02 04:45:10 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-3[70677]: 2024-06-02T04:45:10.119+0000 7f2baa6287c0 -1 osd.3 0 log_to_monitors true 2024-06-02T04:45:10.699 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/mon.b/config 2024-06-02T04:45:11.482 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:11 smithi119 ceph-mon[46633]: pgmap v71: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 921 B/s rd, 26 KiB/s wr, 2 op/s 2024-06-02T04:45:11.482 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:11 smithi119 ceph-mon[46633]: from='osd.3 [v2:172.21.15.76:6810/3747864233,v1:172.21.15.76:6811/3747864233]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-06-02T04:45:11.482 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:11 smithi119 ceph-mon[46633]: osdmap e20: 4 total, 3 up, 4 in 2024-06-02T04:45:11.482 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:11 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-02T04:45:11.482 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:11 smithi119 ceph-mon[46633]: from='osd.3 [v2:172.21.15.76:6810/3747864233,v1:172.21.15.76:6811/3747864233]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi076", "root=default"]}]: dispatch 2024-06-02T04:45:11.482 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:11 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:11.482 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:11 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:11.482 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:11 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:45:11.482 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:11 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:45:11.483 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:11 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:11.483 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:11 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:45:11.483 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:11 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:45:11.483 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:11 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:11.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:11 smithi076 ceph-mon[42935]: pgmap v71: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 921 B/s rd, 26 KiB/s wr, 2 op/s 2024-06-02T04:45:11.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:11 smithi076 ceph-mon[42935]: from='osd.3 [v2:172.21.15.76:6810/3747864233,v1:172.21.15.76:6811/3747864233]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-06-02T04:45:11.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:11 smithi076 ceph-mon[42935]: osdmap e20: 4 total, 3 up, 4 in 2024-06-02T04:45:11.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:11 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-02T04:45:11.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:11 smithi076 ceph-mon[42935]: from='osd.3 [v2:172.21.15.76:6810/3747864233,v1:172.21.15.76:6811/3747864233]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi076", "root=default"]}]: dispatch 2024-06-02T04:45:11.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:11 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:11.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:11 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:11.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:11 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:45:11.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:11 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:45:11.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:11 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:11.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:11 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:45:11.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:11 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:45:11.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:11 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:11.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:45:11.649+0000 7f454724a700 1 -- 172.21.15.119:0/2433739696 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4540101a20 msgr2=0x7f4540108340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:45:11.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:45:11.649+0000 7f454724a700 1 --2- 172.21.15.119:0/2433739696 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4540101a20 0x7f4540108340 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f453800d290 tx=0x7f453800d5a0 comp rx=0 tx=0).stop 2024-06-02T04:45:11.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:45:11.649+0000 7f454724a700 1 -- 172.21.15.119:0/2433739696 shutdown_connections 2024-06-02T04:45:11.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:45:11.649+0000 7f454724a700 1 --2- 172.21.15.119:0/2433739696 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4540101a20 0x7f4540108340 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:45:11.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:45:11.649+0000 7f454724a700 1 --2- 172.21.15.119:0/2433739696 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f45400fff00 0x7f4540100320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:45:11.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:45:11.649+0000 7f454724a700 1 --2- 172.21.15.119:0/2433739696 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4540101060 0x7f45401014e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:45:11.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:45:11.649+0000 7f454724a700 1 -- 172.21.15.119:0/2433739696 >> 172.21.15.119:0/2433739696 conn(0x7f45400fb4a0 msgr2=0x7f45400fd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:45:11.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:45:11.649+0000 7f454724a700 1 -- 172.21.15.119:0/2433739696 shutdown_connections 2024-06-02T04:45:11.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:45:11.649+0000 7f454724a700 1 -- 172.21.15.119:0/2433739696 wait complete. 2024-06-02T04:45:11.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:45:11.649+0000 7f454724a700 1 Processor -- start 2024-06-02T04:45:11.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:45:11.649+0000 7f454724a700 1 -- start start 2024-06-02T04:45:11.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:45:11.650+0000 7f454724a700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f45400fff00 0x7f4540194cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:45:11.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:45:11.650+0000 7f454724a700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4540101060 0x7f4540195210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:45:11.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:45:11.650+0000 7f454724a700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4540101a20 0x7f454019c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:45:11.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:45:11.650+0000 7f454724a700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f454019c800 con 0x7f4540101060 2024-06-02T04:45:11.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:45:11.650+0000 7f454724a700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f454019c940 con 0x7f4540101a20 2024-06-02T04:45:11.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:45:11.650+0000 7f454724a700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f454019cb00 con 0x7f45400fff00 2024-06-02T04:45:11.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:45:11.650+0000 7f453ffff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4540101060 0x7f4540195210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:45:11.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:45:11.650+0000 7f45457e7700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4540101a20 0x7f454019c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:45:11.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:45:11.650+0000 7f453ffff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4540101060 0x7f4540195210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.119:49988/0 (socket says 172.21.15.119:49988) 2024-06-02T04:45:11.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:45:11.650+0000 7f453ffff700 1 -- 172.21.15.119:0/3915428941 learned_addr learned my addr 172.21.15.119:0/3915428941 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-06-02T04:45:11.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:45:11.650+0000 7f45457e7700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4540101a20 0x7f454019c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:55778/0 (socket says 172.21.15.119:55778) 2024-06-02T04:45:11.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:45:11.650+0000 7f45457e7700 1 -- 172.21.15.119:0/3915428941 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f45400fff00 msgr2=0x7f4540194cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:45:11.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:45:11.650+0000 7f45457e7700 1 --2- 172.21.15.119:0/3915428941 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f45400fff00 0x7f4540194cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:45:11.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:45:11.650+0000 7f45457e7700 1 -- 172.21.15.119:0/3915428941 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4540101060 msgr2=0x7f4540195210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:45:11.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:45:11.650+0000 7f45457e7700 1 --2- 172.21.15.119:0/3915428941 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4540101060 0x7f4540195210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:45:11.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:45:11.650+0000 7f45457e7700 1 -- 172.21.15.119:0/3915428941 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45340095f0 con 0x7f4540101a20 2024-06-02T04:45:11.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:45:11.650+0000 7f45457e7700 1 --2- 172.21.15.119:0/3915428941 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4540101a20 0x7f454019c230 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4538007ba0 tx=0x7f4538003cb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:45:11.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:45:11.650+0000 7f453dffb700 1 -- 172.21.15.119:0/3915428941 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4538007710 con 0x7f4540101a20 2024-06-02T04:45:11.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:45:11.650+0000 7f453dffb700 1 -- 172.21.15.119:0/3915428941 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4538007870 con 0x7f4540101a20 2024-06-02T04:45:11.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:45:11.650+0000 7f454724a700 1 -- 172.21.15.119:0/3915428941 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4538009c40 con 0x7f4540101a20 2024-06-02T04:45:11.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:45:11.651+0000 7f453dffb700 1 -- 172.21.15.119:0/3915428941 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45380196a0 con 0x7f4540101a20 2024-06-02T04:45:11.653 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:45:11.651+0000 7f454724a700 1 -- 172.21.15.119:0/3915428941 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f454019d060 con 0x7f4540101a20 2024-06-02T04:45:11.653 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:45:11.652+0000 7f454724a700 1 -- 172.21.15.119:0/3915428941 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4540107380 con 0x7f4540101a20 2024-06-02T04:45:11.653 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:45:11.652+0000 7f453dffb700 1 -- 172.21.15.119:0/3915428941 <== mon.2 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f4538005050 con 0x7f4540101a20 2024-06-02T04:45:11.653 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:45:11.653+0000 7f453dffb700 1 --2- 172.21.15.119:0/3915428941 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f45300a1120 0x7f45300a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:45:11.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:45:11.653+0000 7f453dffb700 1 -- 172.21.15.119:0/3915428941 <== mon.2 v2:172.21.15.119:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3389+0+0 (secure 0 0 0) 0x7f45380cc5a0 con 0x7f4540101a20 2024-06-02T04:45:11.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:45:11.653+0000 7f4544fe6700 1 --2- 172.21.15.119:0/3915428941 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f45300a1120 0x7f45300a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:45:11.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:45:11.654+0000 7f4544fe6700 1 --2- 172.21.15.119:0/3915428941 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f45300a1120 0x7f45300a35e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f45340095c0 tx=0x7f4534009510 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:45:11.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:45:11.658+0000 7f453dffb700 1 -- 172.21.15.119:0/3915428941 <== mon.2 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f4538097100 con 0x7f4540101a20 2024-06-02T04:45:11.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:11 smithi192 ceph-mon[47933]: pgmap v71: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 921 B/s rd, 26 KiB/s wr, 2 op/s 2024-06-02T04:45:11.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:11 smithi192 ceph-mon[47933]: from='osd.3 [v2:172.21.15.76:6810/3747864233,v1:172.21.15.76:6811/3747864233]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-06-02T04:45:11.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:11 smithi192 ceph-mon[47933]: osdmap e20: 4 total, 3 up, 4 in 2024-06-02T04:45:11.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:11 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-02T04:45:11.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:11 smithi192 ceph-mon[47933]: from='osd.3 [v2:172.21.15.76:6810/3747864233,v1:172.21.15.76:6811/3747864233]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi076", "root=default"]}]: dispatch 2024-06-02T04:45:11.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:11 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:11.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:11 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:11.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:11 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:45:11.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:11 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:45:11.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:11 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:11.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:11 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:45:11.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:11 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:45:11.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:11 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:11.864 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:45:11.864+0000 7f454724a700 1 -- 172.21.15.119:0/3915428941 --> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f454002ce40 con 0x7f45300a1120 2024-06-02T04:45:11.983 INFO:journalctl@ceph.osd.3.smithi076.stdout:Jun 02 04:45:11 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-3[70677]: 2024-06-02T04:45:11.669+0000 7f2b9fc8c700 -1 osd.3 0 waiting for initial osdmap 2024-06-02T04:45:11.983 INFO:journalctl@ceph.osd.3.smithi076.stdout:Jun 02 04:45:11 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-3[70677]: 2024-06-02T04:45:11.674+0000 7f2b97a79700 -1 osd.3 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-02T04:45:12.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:12 smithi076 ceph-mon[42935]: Detected new or changed devices on smithi076 2024-06-02T04:45:12.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:12 smithi076 ceph-mon[42935]: Adjusting osd_memory_target on smithi076 to 8557M 2024-06-02T04:45:12.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:12 smithi076 ceph-mon[42935]: from='osd.3 [v2:172.21.15.76:6810/3747864233,v1:172.21.15.76:6811/3747864233]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi076", "root=default"]}]': finished 2024-06-02T04:45:12.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:12 smithi076 ceph-mon[42935]: osdmap e21: 4 total, 3 up, 4 in 2024-06-02T04:45:12.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:12 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-02T04:45:12.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:12 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-02T04:45:12.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:12 smithi076 ceph-mon[42935]: from='osd.3 [v2:172.21.15.76:6810/3747864233,v1:172.21.15.76:6811/3747864233]' entity='osd.3' 2024-06-02T04:45:12.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:12 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T04:45:12.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:12 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T04:45:12.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:12 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:45:12.521 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:12 smithi119 ceph-mon[46633]: Detected new or changed devices on smithi076 2024-06-02T04:45:12.521 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:12 smithi119 ceph-mon[46633]: Adjusting osd_memory_target on smithi076 to 8557M 2024-06-02T04:45:12.521 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:12 smithi119 ceph-mon[46633]: from='osd.3 [v2:172.21.15.76:6810/3747864233,v1:172.21.15.76:6811/3747864233]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi076", "root=default"]}]': finished 2024-06-02T04:45:12.521 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:12 smithi119 ceph-mon[46633]: osdmap e21: 4 total, 3 up, 4 in 2024-06-02T04:45:12.521 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:12 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-02T04:45:12.521 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:12 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-02T04:45:12.521 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:12 smithi119 ceph-mon[46633]: from='osd.3 [v2:172.21.15.76:6810/3747864233,v1:172.21.15.76:6811/3747864233]' entity='osd.3' 2024-06-02T04:45:12.521 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:12 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T04:45:12.522 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:12 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T04:45:12.522 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:12 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:45:12.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:12 smithi192 ceph-mon[47933]: Detected new or changed devices on smithi076 2024-06-02T04:45:12.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:12 smithi192 ceph-mon[47933]: Adjusting osd_memory_target on smithi076 to 8557M 2024-06-02T04:45:12.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:12 smithi192 ceph-mon[47933]: from='osd.3 [v2:172.21.15.76:6810/3747864233,v1:172.21.15.76:6811/3747864233]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi076", "root=default"]}]': finished 2024-06-02T04:45:12.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:12 smithi192 ceph-mon[47933]: osdmap e21: 4 total, 3 up, 4 in 2024-06-02T04:45:12.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:12 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-02T04:45:12.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:12 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-02T04:45:12.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:12 smithi192 ceph-mon[47933]: from='osd.3 [v2:172.21.15.76:6810/3747864233,v1:172.21.15.76:6811/3747864233]' entity='osd.3' 2024-06-02T04:45:12.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:12 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T04:45:12.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:12 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T04:45:12.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:12 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:45:13.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:13 smithi076 ceph-mon[42935]: purged_snaps scrub starts 2024-06-02T04:45:13.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:13 smithi076 ceph-mon[42935]: purged_snaps scrub ok 2024-06-02T04:45:13.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:13 smithi076 ceph-mon[42935]: from='client.24215 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:45:13.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:13 smithi076 ceph-mon[42935]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 33 KiB/s wr, 2 op/s 2024-06-02T04:45:13.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:13 smithi076 ceph-mon[42935]: osd.3 [v2:172.21.15.76:6810/3747864233,v1:172.21.15.76:6811/3747864233] boot 2024-06-02T04:45:13.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:13 smithi076 ceph-mon[42935]: osdmap e22: 4 total, 4 up, 4 in 2024-06-02T04:45:13.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:13 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-02T04:45:13.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:13 smithi119 ceph-mon[46633]: purged_snaps scrub starts 2024-06-02T04:45:13.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:13 smithi119 ceph-mon[46633]: purged_snaps scrub ok 2024-06-02T04:45:13.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:13 smithi119 ceph-mon[46633]: from='client.24215 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:45:13.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:13 smithi119 ceph-mon[46633]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 33 KiB/s wr, 2 op/s 2024-06-02T04:45:13.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:13 smithi119 ceph-mon[46633]: osd.3 [v2:172.21.15.76:6810/3747864233,v1:172.21.15.76:6811/3747864233] boot 2024-06-02T04:45:13.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:13 smithi119 ceph-mon[46633]: osdmap e22: 4 total, 4 up, 4 in 2024-06-02T04:45:13.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:13 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-02T04:45:13.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:13 smithi192 ceph-mon[47933]: purged_snaps scrub starts 2024-06-02T04:45:13.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:13 smithi192 ceph-mon[47933]: purged_snaps scrub ok 2024-06-02T04:45:13.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:13 smithi192 ceph-mon[47933]: from='client.24215 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:45:13.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:13 smithi192 ceph-mon[47933]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 33 KiB/s wr, 2 op/s 2024-06-02T04:45:13.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:13 smithi192 ceph-mon[47933]: osd.3 [v2:172.21.15.76:6810/3747864233,v1:172.21.15.76:6811/3747864233] boot 2024-06-02T04:45:13.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:13 smithi192 ceph-mon[47933]: osdmap e22: 4 total, 4 up, 4 in 2024-06-02T04:45:13.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:13 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-02T04:45:14.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:14 smithi076 ceph-mon[42935]: osdmap e23: 4 total, 4 up, 4 in 2024-06-02T04:45:14.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:14 smithi076 ceph-mon[42935]: from='client.? 172.21.15.119:0/1332610798' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "eef293d0-cb87-47b3-9751-c6437a1cf079"}]: dispatch 2024-06-02T04:45:14.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:14 smithi076 ceph-mon[42935]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "eef293d0-cb87-47b3-9751-c6437a1cf079"}]: dispatch 2024-06-02T04:45:14.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:14 smithi076 ceph-mon[42935]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "eef293d0-cb87-47b3-9751-c6437a1cf079"}]': finished 2024-06-02T04:45:14.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:14 smithi076 ceph-mon[42935]: osdmap e24: 5 total, 4 up, 5 in 2024-06-02T04:45:14.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:14 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-02T04:45:14.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:14 smithi119 ceph-mon[46633]: osdmap e23: 4 total, 4 up, 4 in 2024-06-02T04:45:14.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:14 smithi119 ceph-mon[46633]: from='client.? 172.21.15.119:0/1332610798' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "eef293d0-cb87-47b3-9751-c6437a1cf079"}]: dispatch 2024-06-02T04:45:14.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:14 smithi119 ceph-mon[46633]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "eef293d0-cb87-47b3-9751-c6437a1cf079"}]: dispatch 2024-06-02T04:45:14.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:14 smithi119 ceph-mon[46633]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "eef293d0-cb87-47b3-9751-c6437a1cf079"}]': finished 2024-06-02T04:45:14.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:14 smithi119 ceph-mon[46633]: osdmap e24: 5 total, 4 up, 5 in 2024-06-02T04:45:14.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:14 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-02T04:45:14.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:14 smithi192 ceph-mon[47933]: osdmap e23: 4 total, 4 up, 4 in 2024-06-02T04:45:14.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:14 smithi192 ceph-mon[47933]: from='client.? 172.21.15.119:0/1332610798' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "eef293d0-cb87-47b3-9751-c6437a1cf079"}]: dispatch 2024-06-02T04:45:14.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:14 smithi192 ceph-mon[47933]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "eef293d0-cb87-47b3-9751-c6437a1cf079"}]: dispatch 2024-06-02T04:45:14.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:14 smithi192 ceph-mon[47933]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "eef293d0-cb87-47b3-9751-c6437a1cf079"}]': finished 2024-06-02T04:45:14.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:14 smithi192 ceph-mon[47933]: osdmap e24: 5 total, 4 up, 5 in 2024-06-02T04:45:14.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:14 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-02T04:45:15.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:15 smithi076 ceph-mon[42935]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 122 MiB used, 357 GiB / 358 GiB avail 2024-06-02T04:45:15.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:15 smithi076 ceph-mon[42935]: from='client.? 172.21.15.119:0/3622000774' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T04:45:15.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:15 smithi076 ceph-mon[42935]: osdmap e25: 5 total, 4 up, 5 in 2024-06-02T04:45:15.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:15 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-02T04:45:15.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:15 smithi119 ceph-mon[46633]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 122 MiB used, 357 GiB / 358 GiB avail 2024-06-02T04:45:15.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:15 smithi119 ceph-mon[46633]: from='client.? 172.21.15.119:0/3622000774' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T04:45:15.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:15 smithi119 ceph-mon[46633]: osdmap e25: 5 total, 4 up, 5 in 2024-06-02T04:45:15.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:15 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-02T04:45:15.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:15 smithi192 ceph-mon[47933]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 122 MiB used, 357 GiB / 358 GiB avail 2024-06-02T04:45:15.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:15 smithi192 ceph-mon[47933]: from='client.? 172.21.15.119:0/3622000774' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T04:45:15.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:15 smithi192 ceph-mon[47933]: osdmap e25: 5 total, 4 up, 5 in 2024-06-02T04:45:15.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:15 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-02T04:45:16.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:16 smithi192 ceph-mon[47933]: osdmap e26: 5 total, 4 up, 5 in 2024-06-02T04:45:16.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:16 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-02T04:45:16.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:16 smithi192 ceph-mon[47933]: pgmap v81: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 122 MiB used, 357 GiB / 358 GiB avail; 147 KiB/s, 0 objects/s recovering 2024-06-02T04:45:16.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:16 smithi076 ceph-mon[42935]: osdmap e26: 5 total, 4 up, 5 in 2024-06-02T04:45:16.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:16 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-02T04:45:16.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:16 smithi076 ceph-mon[42935]: pgmap v81: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 122 MiB used, 357 GiB / 358 GiB avail; 147 KiB/s, 0 objects/s recovering 2024-06-02T04:45:17.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:16 smithi119 ceph-mon[46633]: osdmap e26: 5 total, 4 up, 5 in 2024-06-02T04:45:17.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:16 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-02T04:45:17.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:16 smithi119 ceph-mon[46633]: pgmap v81: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 122 MiB used, 357 GiB / 358 GiB avail; 147 KiB/s, 0 objects/s recovering 2024-06-02T04:45:19.373 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:19 smithi119 ceph-mon[46633]: pgmap v82: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 117 KiB/s, 0 objects/s recovering 2024-06-02T04:45:19.431 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:19 smithi192 ceph-mon[47933]: pgmap v82: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 117 KiB/s, 0 objects/s recovering 2024-06-02T04:45:19.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:19 smithi076 ceph-mon[42935]: pgmap v82: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 117 KiB/s, 0 objects/s recovering 2024-06-02T04:45:20.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:20 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-06-02T04:45:20.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:20 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:45:20.488 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:20 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-06-02T04:45:20.488 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:20 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:45:20.517 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:20 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-06-02T04:45:20.517 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:20 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:45:21.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:21 smithi119 ceph-mon[46633]: Deploying daemon osd.4 on smithi119 2024-06-02T04:45:21.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:21 smithi119 ceph-mon[46633]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-06-02T04:45:21.431 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:21 smithi192 ceph-mon[47933]: Deploying daemon osd.4 on smithi119 2024-06-02T04:45:21.431 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:21 smithi192 ceph-mon[47933]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-06-02T04:45:21.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:21 smithi076 ceph-mon[42935]: Deploying daemon osd.4 on smithi119 2024-06-02T04:45:21.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:21 smithi076 ceph-mon[42935]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-06-02T04:45:23.444 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:23 smithi119 ceph-mon[46633]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-06-02T04:45:23.444 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:23 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:23.444 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:23 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:45:23.444 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:23 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:23.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:23 smithi076 ceph-mon[42935]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-06-02T04:45:23.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:23 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:23.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:23 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:45:23.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:23 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:23.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:23 smithi192 ceph-mon[47933]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-06-02T04:45:23.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:23 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:23.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:23 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:45:23.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:23 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:25.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:45:25.065+0000 7f453dffb700 1 -- 172.21.15.119:0/3915428941 <== mgr.14152 v2:172.21.15.76:6800/2591353090 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f454002ce40 con 0x7f45300a1120 2024-06-02T04:45:25.066 INFO:teuthology.orchestra.run.smithi119.stdout:Created osd(s) 4 on host 'smithi119' 2024-06-02T04:45:25.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:45:25.067+0000 7f454724a700 1 -- 172.21.15.119:0/3915428941 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f45300a1120 msgr2=0x7f45300a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:45:25.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:45:25.067+0000 7f454724a700 1 --2- 172.21.15.119:0/3915428941 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f45300a1120 0x7f45300a35e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f45340095c0 tx=0x7f4534009510 comp rx=0 tx=0).stop 2024-06-02T04:45:25.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:45:25.067+0000 7f454724a700 1 -- 172.21.15.119:0/3915428941 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4540101a20 msgr2=0x7f454019c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:45:25.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:45:25.067+0000 7f454724a700 1 --2- 172.21.15.119:0/3915428941 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4540101a20 0x7f454019c230 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4538007ba0 tx=0x7f4538003cb0 comp rx=0 tx=0).stop 2024-06-02T04:45:25.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:45:25.067+0000 7f454724a700 1 -- 172.21.15.119:0/3915428941 shutdown_connections 2024-06-02T04:45:25.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:45:25.067+0000 7f454724a700 1 --2- 172.21.15.119:0/3915428941 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f45300a1120 0x7f45300a35e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:45:25.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:45:25.067+0000 7f454724a700 1 --2- 172.21.15.119:0/3915428941 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4540101a20 0x7f454019c230 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:45:25.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:45:25.067+0000 7f454724a700 1 --2- 172.21.15.119:0/3915428941 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f45400fff00 0x7f4540194cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:45:25.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:45:25.067+0000 7f454724a700 1 --2- 172.21.15.119:0/3915428941 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4540101060 0x7f4540195210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:45:25.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:45:25.067+0000 7f454724a700 1 -- 172.21.15.119:0/3915428941 >> 172.21.15.119:0/3915428941 conn(0x7f45400fb4a0 msgr2=0x7f45401044c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:45:25.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:45:25.067+0000 7f454724a700 1 -- 172.21.15.119:0/3915428941 shutdown_connections 2024-06-02T04:45:25.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:45:25.067+0000 7f454724a700 1 -- 172.21.15.119:0/3915428941 wait complete. 2024-06-02T04:45:25.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:25 smithi119 ceph-mon[46633]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-06-02T04:45:25.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:25 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:25.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:25 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:25.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:25 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:45:25.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:25 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:45:25.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:25 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:25.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:25 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:25.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:25 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:25.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:25 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:45:25.431 DEBUG:teuthology.orchestra.run.smithi119:osd.4> sudo journalctl -f -n 0 -u ceph-60ab6d30-209a-11ef-bc9b-c7b262605968@osd.4.service 2024-06-02T04:45:25.433 INFO:tasks.cephadm:Deploying osd.5 on smithi192 with /dev/vg_nvme/lv_3... 2024-06-02T04:45:25.433 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 60ab6d30-209a-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-06-02T04:45:25.463 INFO:journalctl@ceph.osd.4.smithi119.stdout:-- Logs begin at Sun 2024-06-02 04:25:42 UTC. -- 2024-06-02T04:45:25.466 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:25 smithi192 ceph-mon[47933]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-06-02T04:45:25.466 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:25 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:25.466 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:25 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:25.466 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:25 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:45:25.466 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:25 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:45:25.466 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:25 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:25.466 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:25 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:25.466 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:25 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:25.466 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:25 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:45:25.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:25 smithi076 ceph-mon[42935]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-06-02T04:45:25.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:25 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:25.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:25 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:25.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:25 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:45:25.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:25 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:45:25.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:25 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:25.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:25 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:25.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:25 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:25.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:25 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:45:25.664 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/mon.c/config 2024-06-02T04:45:26.982 INFO:teuthology.orchestra.run.smithi192.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-06-02T04:45:26.982 INFO:teuthology.orchestra.run.smithi192.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-06-02T04:45:26.982 INFO:teuthology.orchestra.run.smithi192.stderr: stderr: 10+0 records in 2024-06-02T04:45:26.982 INFO:teuthology.orchestra.run.smithi192.stderr:10+0 records out 2024-06-02T04:45:26.982 INFO:teuthology.orchestra.run.smithi192.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0111758 s, 938 MB/s 2024-06-02T04:45:26.982 INFO:teuthology.orchestra.run.smithi192.stderr:--> Zapping successful for: 2024-06-02T04:45:27.255 INFO:journalctl@ceph.osd.4.smithi119.stdout:Jun 02 04:45:26 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-4[60285]: 2024-06-02T04:45:26.958+0000 7f9e3d91f7c0 -1 osd.4 0 log_to_monitors true 2024-06-02T04:45:27.256 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:27 smithi119 ceph-mon[46633]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-06-02T04:45:27.256 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:27 smithi119 ceph-mon[46633]: from='osd.4 [v2:172.21.15.119:6808/2571629047,v1:172.21.15.119:6809/2571629047]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-06-02T04:45:27.256 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:27 smithi119 ceph-mon[46633]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-06-02T04:45:27.306 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:27 smithi192 ceph-mon[47933]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-06-02T04:45:27.306 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:27 smithi192 ceph-mon[47933]: from='osd.4 [v2:172.21.15.119:6808/2571629047,v1:172.21.15.119:6809/2571629047]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-06-02T04:45:27.306 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:27 smithi192 ceph-mon[47933]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-06-02T04:45:27.307 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 60ab6d30-209a-11ef-bc9b-c7b262605968 -- ceph orch daemon add osd smithi192:vg_nvme/lv_3 2024-06-02T04:45:27.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:27 smithi076 ceph-mon[42935]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-06-02T04:45:27.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:27 smithi076 ceph-mon[42935]: from='osd.4 [v2:172.21.15.119:6808/2571629047,v1:172.21.15.119:6809/2571629047]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-06-02T04:45:27.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:27 smithi076 ceph-mon[42935]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-06-02T04:45:27.567 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/mon.c/config 2024-06-02T04:45:28.367 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:28 smithi192 ceph-mon[47933]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-06-02T04:45:28.367 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:28 smithi192 ceph-mon[47933]: osdmap e27: 5 total, 4 up, 5 in 2024-06-02T04:45:28.368 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:28 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-02T04:45:28.368 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:28 smithi192 ceph-mon[47933]: from='osd.4 [v2:172.21.15.119:6808/2571629047,v1:172.21.15.119:6809/2571629047]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2024-06-02T04:45:28.368 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:28 smithi192 ceph-mon[47933]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2024-06-02T04:45:28.368 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:28 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:28.368 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:28 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:28.368 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:28 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:45:28.368 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:28 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:45:28.368 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:28 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:28.368 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:28 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:45:28.368 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:28 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:45:28.368 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:28 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:28.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:28 smithi076 ceph-mon[42935]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-06-02T04:45:28.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:28 smithi076 ceph-mon[42935]: osdmap e27: 5 total, 4 up, 5 in 2024-06-02T04:45:28.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:28 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-02T04:45:28.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:28 smithi076 ceph-mon[42935]: from='osd.4 [v2:172.21.15.119:6808/2571629047,v1:172.21.15.119:6809/2571629047]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2024-06-02T04:45:28.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:28 smithi076 ceph-mon[42935]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2024-06-02T04:45:28.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:28 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:28.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:28 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:28.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:28 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:45:28.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:28 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:45:28.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:28 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:28.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:28 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:45:28.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:28 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:45:28.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:28 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:28.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:45:28.544+0000 7f3aaae2e700 1 -- 172.21.15.192:0/3823690309 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3aa4102200 msgr2=0x7f3aa4102660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:45:28.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:45:28.544+0000 7f3aaae2e700 1 --2- 172.21.15.192:0/3823690309 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3aa4102200 0x7f3aa4102660 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3a90009990 tx=0x7f3a90009ca0 comp rx=0 tx=0).stop 2024-06-02T04:45:28.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:45:28.544+0000 7f3aaae2e700 1 -- 172.21.15.192:0/3823690309 shutdown_connections 2024-06-02T04:45:28.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:45:28.544+0000 7f3aaae2e700 1 --2- 172.21.15.192:0/3823690309 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3aa4102ba0 0x7f3aa4109450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:45:28.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:45:28.544+0000 7f3aaae2e700 1 --2- 172.21.15.192:0/3823690309 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3aa4101000 0x7f3aa4101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:45:28.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:45:28.544+0000 7f3aaae2e700 1 --2- 172.21.15.192:0/3823690309 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3aa4102200 0x7f3aa4102660 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:45:28.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:45:28.544+0000 7f3aaae2e700 1 -- 172.21.15.192:0/3823690309 >> 172.21.15.192:0/3823690309 conn(0x7f3aa40fc5a0 msgr2=0x7f3aa40fe9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:45:28.546 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:45:28.544+0000 7f3aaae2e700 1 -- 172.21.15.192:0/3823690309 shutdown_connections 2024-06-02T04:45:28.546 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:45:28.544+0000 7f3aaae2e700 1 -- 172.21.15.192:0/3823690309 wait complete. 2024-06-02T04:45:28.548 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:45:28.545+0000 7f3aaae2e700 1 Processor -- start 2024-06-02T04:45:28.548 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:45:28.545+0000 7f3aaae2e700 1 -- start start 2024-06-02T04:45:28.548 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:45:28.545+0000 7f3aaae2e700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3aa4101000 0x7f3aa4196d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:45:28.548 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:45:28.545+0000 7f3aaae2e700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3aa4102200 0x7f3aa41972c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:45:28.548 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:45:28.545+0000 7f3aaae2e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3aa4102ba0 0x7f3aa419e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:45:28.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:45:28.545+0000 7f3aaae2e700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa419e8c0 con 0x7f3aa4102200 2024-06-02T04:45:28.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:45:28.545+0000 7f3aaae2e700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa419ea00 con 0x7f3aa4101000 2024-06-02T04:45:28.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:45:28.545+0000 7f3aaae2e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa419eb90 con 0x7f3aa4102ba0 2024-06-02T04:45:28.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:45:28.545+0000 7f3aa93cb700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3aa4102ba0 0x7f3aa419e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:45:28.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:45:28.545+0000 7f3aa8bca700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3aa4101000 0x7f3aa4196d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:45:28.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:45:28.545+0000 7f3aa93cb700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3aa4102ba0 0x7f3aa419e2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:42180/0 (socket says 172.21.15.192:42180) 2024-06-02T04:45:28.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:45:28.545+0000 7f3aa93cb700 1 -- 172.21.15.192:0/2850777353 learned_addr learned my addr 172.21.15.192:0/2850777353 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-06-02T04:45:28.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:45:28.545+0000 7f3aa3fff700 1 --2- 172.21.15.192:0/2850777353 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3aa4102200 0x7f3aa41972c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:45:28.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:45:28.546+0000 7f3aa93cb700 1 -- 172.21.15.192:0/2850777353 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3aa4101000 msgr2=0x7f3aa4196d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:45:28.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:45:28.546+0000 7f3aa93cb700 1 --2- 172.21.15.192:0/2850777353 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3aa4101000 0x7f3aa4196d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:45:28.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:45:28.546+0000 7f3aa93cb700 1 -- 172.21.15.192:0/2850777353 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3aa4102200 msgr2=0x7f3aa41972c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:45:28.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:45:28.546+0000 7f3aa93cb700 1 --2- 172.21.15.192:0/2850777353 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3aa4102200 0x7f3aa41972c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:45:28.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:45:28.546+0000 7f3aa93cb700 1 -- 172.21.15.192:0/2850777353 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a900095f0 con 0x7f3aa4102ba0 2024-06-02T04:45:28.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:45:28.546+0000 7f3aa93cb700 1 --2- 172.21.15.192:0/2850777353 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3aa4102ba0 0x7f3aa419e2f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3a9c007f10 tx=0x7f3a9c00d3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:45:28.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:45:28.546+0000 7f3aa1ffb700 1 -- 172.21.15.192:0/2850777353 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a9c00ddd0 con 0x7f3aa4102ba0 2024-06-02T04:45:28.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:45:28.546+0000 7f3aa1ffb700 1 -- 172.21.15.192:0/2850777353 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3a9c00f040 con 0x7f3aa4102ba0 2024-06-02T04:45:28.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:45:28.546+0000 7f3aa1ffb700 1 -- 172.21.15.192:0/2850777353 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a9c004870 con 0x7f3aa4102ba0 2024-06-02T04:45:28.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:45:28.546+0000 7f3aaae2e700 1 -- 172.21.15.192:0/2850777353 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3aa419ee70 con 0x7f3aa4102ba0 2024-06-02T04:45:28.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:45:28.546+0000 7f3aaae2e700 1 -- 172.21.15.192:0/2850777353 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3aa419f290 con 0x7f3aa4102ba0 2024-06-02T04:45:28.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:45:28.547+0000 7f3aaae2e700 1 -- 172.21.15.192:0/2850777353 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3aa41084b0 con 0x7f3aa4102ba0 2024-06-02T04:45:28.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:45:28.548+0000 7f3aa1ffb700 1 -- 172.21.15.192:0/2850777353 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f3a9c003a00 con 0x7f3aa4102ba0 2024-06-02T04:45:28.551 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:45:28.548+0000 7f3aa1ffb700 1 --2- 172.21.15.192:0/2850777353 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f3a940a1220 0x7f3a940a36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:45:28.551 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:45:28.549+0000 7f3aa1ffb700 1 -- 172.21.15.192:0/2850777353 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 3821+0+0 (secure 0 0 0) 0x7f3a9c0cb080 con 0x7f3aa4102ba0 2024-06-02T04:45:28.551 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:45:28.549+0000 7f3aa8bca700 1 --2- 172.21.15.192:0/2850777353 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f3a940a1220 0x7f3a940a36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:45:28.551 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:45:28.549+0000 7f3aa8bca700 1 --2- 172.21.15.192:0/2850777353 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f3a940a1220 0x7f3a940a36e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3aa4102060 tx=0x7f3a9800a3b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:45:28.553 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:45:28.553+0000 7f3aa1ffb700 1 -- 172.21.15.192:0/2850777353 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f3a9c095900 con 0x7f3aa4102ba0 2024-06-02T04:45:28.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:28 smithi119 ceph-mon[46633]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-06-02T04:45:28.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:28 smithi119 ceph-mon[46633]: osdmap e27: 5 total, 4 up, 5 in 2024-06-02T04:45:28.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:28 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-02T04:45:28.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:28 smithi119 ceph-mon[46633]: from='osd.4 [v2:172.21.15.119:6808/2571629047,v1:172.21.15.119:6809/2571629047]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2024-06-02T04:45:28.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:28 smithi119 ceph-mon[46633]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2024-06-02T04:45:28.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:28 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:28.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:28 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:28.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:28 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:45:28.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:28 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:45:28.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:28 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:28.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:28 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:45:28.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:28 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:45:28.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:28 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:28.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:45:28.753+0000 7f3aaae2e700 1 -- 172.21.15.192:0/2850777353 --> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi192:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f3aa402ce60 con 0x7f3a940a1220 2024-06-02T04:45:29.096 INFO:journalctl@ceph.osd.4.smithi119.stdout:Jun 02 04:45:28 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-4[60285]: 2024-06-02T04:45:28.685+0000 7f9e32f83700 -1 osd.4 0 waiting for initial osdmap 2024-06-02T04:45:29.096 INFO:journalctl@ceph.osd.4.smithi119.stdout:Jun 02 04:45:28 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-4[60285]: 2024-06-02T04:45:28.691+0000 7f9e2ad70700 -1 osd.4 28 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-02T04:45:29.416 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:29 smithi192 ceph-mon[47933]: Detected new or changed devices on smithi119 2024-06-02T04:45:29.416 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:29 smithi192 ceph-mon[47933]: Adjusting osd_memory_target on smithi119 to 8556M 2024-06-02T04:45:29.416 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:29 smithi192 ceph-mon[47933]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-06-02T04:45:29.417 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:29 smithi192 ceph-mon[47933]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]': finished 2024-06-02T04:45:29.417 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:29 smithi192 ceph-mon[47933]: osdmap e28: 5 total, 4 up, 5 in 2024-06-02T04:45:29.417 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:29 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-02T04:45:29.417 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:29 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-02T04:45:29.417 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:29 smithi192 ceph-mon[47933]: from='osd.4 ' entity='osd.4' 2024-06-02T04:45:29.417 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:29 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T04:45:29.417 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:29 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T04:45:29.417 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:29 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:45:29.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:29 smithi076 ceph-mon[42935]: Detected new or changed devices on smithi119 2024-06-02T04:45:29.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:29 smithi076 ceph-mon[42935]: Adjusting osd_memory_target on smithi119 to 8556M 2024-06-02T04:45:29.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:29 smithi076 ceph-mon[42935]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-06-02T04:45:29.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:29 smithi076 ceph-mon[42935]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]': finished 2024-06-02T04:45:29.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:29 smithi076 ceph-mon[42935]: osdmap e28: 5 total, 4 up, 5 in 2024-06-02T04:45:29.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:29 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-02T04:45:29.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:29 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-02T04:45:29.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:29 smithi076 ceph-mon[42935]: from='osd.4 ' entity='osd.4' 2024-06-02T04:45:29.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:29 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T04:45:29.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:29 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T04:45:29.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:29 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:45:29.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:29 smithi119 ceph-mon[46633]: Detected new or changed devices on smithi119 2024-06-02T04:45:29.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:29 smithi119 ceph-mon[46633]: Adjusting osd_memory_target on smithi119 to 8556M 2024-06-02T04:45:29.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:29 smithi119 ceph-mon[46633]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-06-02T04:45:29.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:29 smithi119 ceph-mon[46633]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]': finished 2024-06-02T04:45:29.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:29 smithi119 ceph-mon[46633]: osdmap e28: 5 total, 4 up, 5 in 2024-06-02T04:45:29.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:29 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-02T04:45:29.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:29 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-02T04:45:29.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:29 smithi119 ceph-mon[46633]: from='osd.4 ' entity='osd.4' 2024-06-02T04:45:29.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:29 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T04:45:29.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:29 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T04:45:29.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:29 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:45:30.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:30 smithi076 ceph-mon[42935]: purged_snaps scrub starts 2024-06-02T04:45:30.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:30 smithi076 ceph-mon[42935]: purged_snaps scrub ok 2024-06-02T04:45:30.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:30 smithi076 ceph-mon[42935]: from='client.24232 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi192:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:45:30.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:30 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-02T04:45:30.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:30 smithi076 ceph-mon[42935]: osd.4 [v2:172.21.15.119:6808/2571629047,v1:172.21.15.119:6809/2571629047] boot 2024-06-02T04:45:30.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:30 smithi076 ceph-mon[42935]: osdmap e29: 5 total, 5 up, 5 in 2024-06-02T04:45:30.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:30 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-02T04:45:30.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:30 smithi119 ceph-mon[46633]: purged_snaps scrub starts 2024-06-02T04:45:30.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:30 smithi119 ceph-mon[46633]: purged_snaps scrub ok 2024-06-02T04:45:30.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:30 smithi119 ceph-mon[46633]: from='client.24232 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi192:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:45:30.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:30 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-02T04:45:30.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:30 smithi119 ceph-mon[46633]: osd.4 [v2:172.21.15.119:6808/2571629047,v1:172.21.15.119:6809/2571629047] boot 2024-06-02T04:45:30.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:30 smithi119 ceph-mon[46633]: osdmap e29: 5 total, 5 up, 5 in 2024-06-02T04:45:30.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:30 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-02T04:45:30.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:30 smithi192 ceph-mon[47933]: purged_snaps scrub starts 2024-06-02T04:45:30.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:30 smithi192 ceph-mon[47933]: purged_snaps scrub ok 2024-06-02T04:45:30.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:30 smithi192 ceph-mon[47933]: from='client.24232 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi192:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:45:30.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:30 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-02T04:45:30.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:30 smithi192 ceph-mon[47933]: osd.4 [v2:172.21.15.119:6808/2571629047,v1:172.21.15.119:6809/2571629047] boot 2024-06-02T04:45:30.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:30 smithi192 ceph-mon[47933]: osdmap e29: 5 total, 5 up, 5 in 2024-06-02T04:45:30.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:30 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-02T04:45:31.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:31 smithi076 ceph-mon[42935]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-06-02T04:45:31.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:31 smithi076 ceph-mon[42935]: from='client.? 172.21.15.192:0/1605035011' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "60eb8c6e-766c-49d0-9997-44f85776b3fb"}]: dispatch 2024-06-02T04:45:31.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:31 smithi076 ceph-mon[42935]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "60eb8c6e-766c-49d0-9997-44f85776b3fb"}]: dispatch 2024-06-02T04:45:31.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:31 smithi076 ceph-mon[42935]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "60eb8c6e-766c-49d0-9997-44f85776b3fb"}]': finished 2024-06-02T04:45:31.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:31 smithi076 ceph-mon[42935]: osdmap e30: 6 total, 5 up, 6 in 2024-06-02T04:45:31.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:31 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-02T04:45:31.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:31 smithi119 ceph-mon[46633]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-06-02T04:45:31.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:31 smithi119 ceph-mon[46633]: from='client.? 172.21.15.192:0/1605035011' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "60eb8c6e-766c-49d0-9997-44f85776b3fb"}]: dispatch 2024-06-02T04:45:31.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:31 smithi119 ceph-mon[46633]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "60eb8c6e-766c-49d0-9997-44f85776b3fb"}]: dispatch 2024-06-02T04:45:31.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:31 smithi119 ceph-mon[46633]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "60eb8c6e-766c-49d0-9997-44f85776b3fb"}]': finished 2024-06-02T04:45:31.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:31 smithi119 ceph-mon[46633]: osdmap e30: 6 total, 5 up, 6 in 2024-06-02T04:45:31.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:31 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-02T04:45:31.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:31 smithi192 ceph-mon[47933]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-06-02T04:45:31.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:31 smithi192 ceph-mon[47933]: from='client.? 172.21.15.192:0/1605035011' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "60eb8c6e-766c-49d0-9997-44f85776b3fb"}]: dispatch 2024-06-02T04:45:31.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:31 smithi192 ceph-mon[47933]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "60eb8c6e-766c-49d0-9997-44f85776b3fb"}]: dispatch 2024-06-02T04:45:31.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:31 smithi192 ceph-mon[47933]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "60eb8c6e-766c-49d0-9997-44f85776b3fb"}]': finished 2024-06-02T04:45:31.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:31 smithi192 ceph-mon[47933]: osdmap e30: 6 total, 5 up, 6 in 2024-06-02T04:45:31.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:31 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-02T04:45:32.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:32 smithi076 ceph-mon[42935]: from='client.? 172.21.15.192:0/3172756489' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T04:45:32.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:32 smithi119 ceph-mon[46633]: from='client.? 172.21.15.192:0/3172756489' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T04:45:32.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:32 smithi192 ceph-mon[47933]: from='client.? 172.21.15.192:0/3172756489' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T04:45:33.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:33 smithi076 ceph-mon[42935]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 153 MiB used, 447 GiB / 447 GiB avail 2024-06-02T04:45:33.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:33 smithi119 ceph-mon[46633]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 153 MiB used, 447 GiB / 447 GiB avail 2024-06-02T04:45:33.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:33 smithi192 ceph-mon[47933]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 153 MiB used, 447 GiB / 447 GiB avail 2024-06-02T04:45:35.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:35 smithi076 ceph-mon[42935]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 153 MiB used, 447 GiB / 447 GiB avail 2024-06-02T04:45:35.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:35 smithi119 ceph-mon[46633]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 153 MiB used, 447 GiB / 447 GiB avail 2024-06-02T04:45:35.624 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:35 smithi192 ceph-mon[47933]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 153 MiB used, 447 GiB / 447 GiB avail 2024-06-02T04:45:37.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:37 smithi076 ceph-mon[42935]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 153 MiB used, 447 GiB / 447 GiB avail 2024-06-02T04:45:37.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:37 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-06-02T04:45:37.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:37 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:45:37.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:37 smithi076 ceph-mon[42935]: Deploying daemon osd.5 on smithi192 2024-06-02T04:45:37.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:37 smithi119 ceph-mon[46633]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 153 MiB used, 447 GiB / 447 GiB avail 2024-06-02T04:45:37.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:37 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-06-02T04:45:37.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:37 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:45:37.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:37 smithi119 ceph-mon[46633]: Deploying daemon osd.5 on smithi192 2024-06-02T04:45:37.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:37 smithi192 ceph-mon[47933]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 153 MiB used, 447 GiB / 447 GiB avail 2024-06-02T04:45:37.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:37 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-06-02T04:45:37.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:37 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:45:37.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:37 smithi192 ceph-mon[47933]: Deploying daemon osd.5 on smithi192 2024-06-02T04:45:39.431 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:39 smithi192 ceph-mon[47933]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 153 MiB used, 447 GiB / 447 GiB avail 2024-06-02T04:45:39.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:39 smithi119 ceph-mon[46633]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 153 MiB used, 447 GiB / 447 GiB avail 2024-06-02T04:45:39.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:39 smithi076 ceph-mon[42935]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 153 MiB used, 447 GiB / 447 GiB avail 2024-06-02T04:45:40.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:40 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:40.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:40 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:40.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:40 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:45:40.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:40 smithi192 ceph-mon[47933]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 153 MiB used, 447 GiB / 447 GiB avail 2024-06-02T04:45:41.097 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:40 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:41.097 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:40 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:41.097 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:40 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:45:41.098 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:40 smithi119 ceph-mon[46633]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 153 MiB used, 447 GiB / 447 GiB avail 2024-06-02T04:45:41.238 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:40 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:41.238 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:40 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:41.238 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:40 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:45:41.238 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:40 smithi076 ceph-mon[42935]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 153 MiB used, 447 GiB / 447 GiB avail 2024-06-02T04:45:42.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:45:42.006+0000 7f3aa1ffb700 1 -- 172.21.15.192:0/2850777353 <== mgr.14152 v2:172.21.15.76:6800/2591353090 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f3aa402ce60 con 0x7f3a940a1220 2024-06-02T04:45:42.006 INFO:teuthology.orchestra.run.smithi192.stdout:Created osd(s) 5 on host 'smithi192' 2024-06-02T04:45:42.008 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:45:42.009+0000 7f3aaae2e700 1 -- 172.21.15.192:0/2850777353 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f3a940a1220 msgr2=0x7f3a940a36e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:45:42.008 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:45:42.009+0000 7f3aaae2e700 1 --2- 172.21.15.192:0/2850777353 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f3a940a1220 0x7f3a940a36e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3aa4102060 tx=0x7f3a9800a3b0 comp rx=0 tx=0).stop 2024-06-02T04:45:42.009 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:45:42.009+0000 7f3aaae2e700 1 -- 172.21.15.192:0/2850777353 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3aa4102ba0 msgr2=0x7f3aa419e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:45:42.009 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:45:42.009+0000 7f3aaae2e700 1 --2- 172.21.15.192:0/2850777353 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3aa4102ba0 0x7f3aa419e2f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3a9c007f10 tx=0x7f3a9c00d3b0 comp rx=0 tx=0).stop 2024-06-02T04:45:42.009 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:45:42.009+0000 7f3aaae2e700 1 -- 172.21.15.192:0/2850777353 shutdown_connections 2024-06-02T04:45:42.009 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:45:42.009+0000 7f3aaae2e700 1 --2- 172.21.15.192:0/2850777353 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3aa4102ba0 0x7f3aa419e2f0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:45:42.009 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:45:42.009+0000 7f3aaae2e700 1 --2- 172.21.15.192:0/2850777353 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f3a940a1220 0x7f3a940a36e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:45:42.009 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:45:42.009+0000 7f3aaae2e700 1 --2- 172.21.15.192:0/2850777353 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3aa4101000 0x7f3aa4196d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:45:42.009 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:45:42.009+0000 7f3aaae2e700 1 --2- 172.21.15.192:0/2850777353 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3aa4102200 0x7f3aa41972c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:45:42.009 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:45:42.009+0000 7f3aaae2e700 1 -- 172.21.15.192:0/2850777353 >> 172.21.15.192:0/2850777353 conn(0x7f3aa40fc5a0 msgr2=0x7f3aa41055f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:45:42.009 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:45:42.009+0000 7f3aaae2e700 1 -- 172.21.15.192:0/2850777353 shutdown_connections 2024-06-02T04:45:42.009 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:45:42.009+0000 7f3aaae2e700 1 -- 172.21.15.192:0/2850777353 wait complete. 2024-06-02T04:45:42.374 DEBUG:teuthology.orchestra.run.smithi192:osd.5> sudo journalctl -f -n 0 -u ceph-60ab6d30-209a-11ef-bc9b-c7b262605968@osd.5.service 2024-06-02T04:45:42.376 INFO:tasks.cephadm:Deploying osd.6 on smithi076 with /dev/vg_nvme/lv_2... 2024-06-02T04:45:42.376 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 60ab6d30-209a-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-06-02T04:45:42.407 INFO:journalctl@ceph.osd.5.smithi192.stdout:-- Logs begin at Sun 2024-06-02 04:25:37 UTC. -- 2024-06-02T04:45:42.595 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T04:45:42.642 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:42 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:42.642 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:42 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:42.642 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:42 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:45:42.642 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:42 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:45:42.642 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:42 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:42.642 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:42 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:42.642 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:42 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:42.642 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:42 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:45:42.643 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:42 smithi192 ceph-mon[47933]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 153 MiB used, 447 GiB / 447 GiB avail 2024-06-02T04:45:42.697 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:42 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:42.697 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:42 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:42.698 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:42 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:45:42.698 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:42 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:45:42.698 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:42 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:42.698 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:42 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:42.698 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:42 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:42.698 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:42 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:45:42.698 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:42 smithi076 ceph-mon[42935]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 153 MiB used, 447 GiB / 447 GiB avail 2024-06-02T04:45:42.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:42 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:42.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:42 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:42.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:42 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:45:42.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:42 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:45:42.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:42 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:42.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:42 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:42.847 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:42 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:42.847 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:42 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:45:42.847 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:42 smithi119 ceph-mon[46633]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 153 MiB used, 447 GiB / 447 GiB avail 2024-06-02T04:45:43.925 INFO:teuthology.orchestra.run.smithi076.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-06-02T04:45:43.926 INFO:teuthology.orchestra.run.smithi076.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-06-02T04:45:43.926 INFO:teuthology.orchestra.run.smithi076.stderr: stderr: 10+0 records in 2024-06-02T04:45:43.926 INFO:teuthology.orchestra.run.smithi076.stderr:10+0 records out 2024-06-02T04:45:43.926 INFO:teuthology.orchestra.run.smithi076.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0130482 s, 804 MB/s 2024-06-02T04:45:43.926 INFO:teuthology.orchestra.run.smithi076.stderr:--> Zapping successful for: 2024-06-02T04:45:44.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:44 smithi192 ceph-mon[47933]: from='osd.5 [v2:172.21.15.192:6808/3285065416,v1:172.21.15.192:6809/3285065416]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-06-02T04:45:44.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:44 smithi192 ceph-mon[47933]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-06-02T04:45:44.182 INFO:journalctl@ceph.osd.5.smithi192.stdout:Jun 02 04:45:43 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-5[61527]: 2024-06-02T04:45:43.826+0000 7fddf84ea7c0 -1 osd.5 0 log_to_monitors true 2024-06-02T04:45:44.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:44 smithi076 ceph-mon[42935]: from='osd.5 [v2:172.21.15.192:6808/3285065416,v1:172.21.15.192:6809/3285065416]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-06-02T04:45:44.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:44 smithi076 ceph-mon[42935]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-06-02T04:45:44.286 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 60ab6d30-209a-11ef-bc9b-c7b262605968 -- ceph orch daemon add osd smithi076:vg_nvme/lv_2 2024-06-02T04:45:44.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:44 smithi119 ceph-mon[46633]: from='osd.5 [v2:172.21.15.192:6808/3285065416,v1:172.21.15.192:6809/3285065416]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-06-02T04:45:44.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:44 smithi119 ceph-mon[46633]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-06-02T04:45:44.513 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T04:45:45.315 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:45 smithi076 ceph-mon[42935]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-06-02T04:45:45.315 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:45 smithi076 ceph-mon[42935]: osdmap e31: 6 total, 5 up, 6 in 2024-06-02T04:45:45.315 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:45 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-02T04:45:45.315 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:45 smithi076 ceph-mon[42935]: from='osd.5 [v2:172.21.15.192:6808/3285065416,v1:172.21.15.192:6809/3285065416]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]: dispatch 2024-06-02T04:45:45.315 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:45 smithi076 ceph-mon[42935]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]: dispatch 2024-06-02T04:45:45.315 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:45 smithi076 ceph-mon[42935]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 153 MiB used, 447 GiB / 447 GiB avail 2024-06-02T04:45:45.315 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:45 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:45.316 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:45 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:45.316 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:45 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:45:45.316 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:45 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:45:45.316 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:45 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:45.316 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:45 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:45:45.316 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:45 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:45:45.316 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:45 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:45.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:45 smithi119 ceph-mon[46633]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-06-02T04:45:45.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:45 smithi119 ceph-mon[46633]: osdmap e31: 6 total, 5 up, 6 in 2024-06-02T04:45:45.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:45 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-02T04:45:45.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:45 smithi119 ceph-mon[46633]: from='osd.5 [v2:172.21.15.192:6808/3285065416,v1:172.21.15.192:6809/3285065416]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]: dispatch 2024-06-02T04:45:45.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:45 smithi119 ceph-mon[46633]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]: dispatch 2024-06-02T04:45:45.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:45 smithi119 ceph-mon[46633]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 153 MiB used, 447 GiB / 447 GiB avail 2024-06-02T04:45:45.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:45 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:45.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:45 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:45.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:45 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:45:45.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:45 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:45:45.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:45 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:45.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:45 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:45:45.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:45 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:45:45.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:45 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:45.431 INFO:journalctl@ceph.osd.5.smithi192.stdout:Jun 02 04:45:45 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-5[61527]: 2024-06-02T04:45:45.021+0000 7fddedb4e700 -1 osd.5 0 waiting for initial osdmap 2024-06-02T04:45:45.431 INFO:journalctl@ceph.osd.5.smithi192.stdout:Jun 02 04:45:45 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-5[61527]: 2024-06-02T04:45:45.027+0000 7fdde9943700 -1 osd.5 32 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-02T04:45:45.431 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:45 smithi192 ceph-mon[47933]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-06-02T04:45:45.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:45 smithi192 ceph-mon[47933]: osdmap e31: 6 total, 5 up, 6 in 2024-06-02T04:45:45.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:45 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-02T04:45:45.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:45 smithi192 ceph-mon[47933]: from='osd.5 [v2:172.21.15.192:6808/3285065416,v1:172.21.15.192:6809/3285065416]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]: dispatch 2024-06-02T04:45:45.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:45 smithi192 ceph-mon[47933]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]: dispatch 2024-06-02T04:45:45.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:45 smithi192 ceph-mon[47933]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 153 MiB used, 447 GiB / 447 GiB avail 2024-06-02T04:45:45.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:45 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:45.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:45 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:45.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:45 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:45:45.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:45 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:45:45.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:45 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:45.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:45 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:45:45.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:45 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:45:45.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:45 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:45.494 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:45:45.492+0000 7f09f4bee700 1 -- 172.21.15.76:0/423984699 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f09f0102ba0 msgr2=0x7f09f0109450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:45:45.495 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:45:45.492+0000 7f09f4bee700 1 --2- 172.21.15.76:0/423984699 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f09f0102ba0 0x7f09f0109450 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f09e800b0d0 tx=0x7f09e800b3e0 comp rx=0 tx=0).stop 2024-06-02T04:45:45.495 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:45:45.492+0000 7f09f4bee700 1 -- 172.21.15.76:0/423984699 shutdown_connections 2024-06-02T04:45:45.495 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:45:45.492+0000 7f09f4bee700 1 --2- 172.21.15.76:0/423984699 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f09f0102ba0 0x7f09f0109450 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:45:45.495 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:45:45.492+0000 7f09f4bee700 1 --2- 172.21.15.76:0/423984699 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f09f0101000 0x7f09f0101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:45:45.495 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:45:45.492+0000 7f09f4bee700 1 --2- 172.21.15.76:0/423984699 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f09f0102200 0x7f09f0102660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:45:45.495 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:45:45.492+0000 7f09f4bee700 1 -- 172.21.15.76:0/423984699 >> 172.21.15.76:0/423984699 conn(0x7f09f00fc5a0 msgr2=0x7f09f00fe9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:45:45.495 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:45:45.492+0000 7f09f4bee700 1 -- 172.21.15.76:0/423984699 shutdown_connections 2024-06-02T04:45:45.495 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:45:45.492+0000 7f09f4bee700 1 -- 172.21.15.76:0/423984699 wait complete. 2024-06-02T04:45:45.495 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:45:45.493+0000 7f09f4bee700 1 Processor -- start 2024-06-02T04:45:45.495 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:45:45.493+0000 7f09f4bee700 1 -- start start 2024-06-02T04:45:45.496 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:45:45.493+0000 7f09f4bee700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f09f0101000 0x7f09f0199170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:45:45.496 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:45:45.493+0000 7f09f4bee700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f09f0102200 0x7f09f01996b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:45:45.496 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:45:45.493+0000 7f09f4bee700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f09f0102ba0 0x7f09f01a06e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:45:45.496 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:45:45.493+0000 7f09f4bee700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09f01a0cb0 con 0x7f09f0102200 2024-06-02T04:45:45.496 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:45:45.493+0000 7f09f4bee700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09f01a0df0 con 0x7f09f0101000 2024-06-02T04:45:45.496 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:45:45.493+0000 7f09f4bee700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09f01a0f80 con 0x7f09f0102ba0 2024-06-02T04:45:45.496 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:45:45.493+0000 7f09edd9b700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f09f0102200 0x7f09f01996b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:45:45.496 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:45:45.493+0000 7f09edd9b700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f09f0102200 0x7f09f01996b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:59362/0 (socket says 172.21.15.76:59362) 2024-06-02T04:45:45.496 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:45:45.493+0000 7f09edd9b700 1 -- 172.21.15.76:0/995547086 learned_addr learned my addr 172.21.15.76:0/995547086 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:45:45.496 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:45:45.494+0000 7f09ee59c700 1 --2- 172.21.15.76:0/995547086 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f09f0101000 0x7f09f0199170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:45:45.497 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:45:45.494+0000 7f09edd9b700 1 -- 172.21.15.76:0/995547086 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f09f0102ba0 msgr2=0x7f09f01a06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:45:45.497 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:45:45.494+0000 7f09edd9b700 1 --2- 172.21.15.76:0/995547086 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f09f0102ba0 0x7f09f01a06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:45:45.497 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:45:45.494+0000 7f09edd9b700 1 -- 172.21.15.76:0/995547086 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f09f0101000 msgr2=0x7f09f0199170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:45:45.497 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:45:45.494+0000 7f09edd9b700 1 --2- 172.21.15.76:0/995547086 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f09f0101000 0x7f09f0199170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:45:45.497 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:45:45.494+0000 7f09edd9b700 1 -- 172.21.15.76:0/995547086 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09e8009d00 con 0x7f09f0102200 2024-06-02T04:45:45.497 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:45:45.494+0000 7f09edd9b700 1 --2- 172.21.15.76:0/995547086 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f09f0102200 0x7f09f01996b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f09e000b560 tx=0x7f09e000b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:45:45.497 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:45:45.494+0000 7f09df7fe700 1 -- 172.21.15.76:0/995547086 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e0011830 con 0x7f09f0102200 2024-06-02T04:45:45.497 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:45:45.494+0000 7f09f4bee700 1 -- 172.21.15.76:0/995547086 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09f01a1260 con 0x7f09f0102200 2024-06-02T04:45:45.497 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:45:45.494+0000 7f09df7fe700 1 -- 172.21.15.76:0/995547086 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f09e0011e20 con 0x7f09f0102200 2024-06-02T04:45:45.497 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:45:45.494+0000 7f09df7fe700 1 -- 172.21.15.76:0/995547086 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e0010dd0 con 0x7f09f0102200 2024-06-02T04:45:45.497 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:45:45.494+0000 7f09f4bee700 1 -- 172.21.15.76:0/995547086 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09f01a1760 con 0x7f09f0102200 2024-06-02T04:45:45.498 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:45:45.495+0000 7f09f4bee700 1 -- 172.21.15.76:0/995547086 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09f004ec60 con 0x7f09f0102200 2024-06-02T04:45:45.498 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:45:45.497+0000 7f09df7fe700 1 -- 172.21.15.76:0/995547086 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f09e0011990 con 0x7f09f0102200 2024-06-02T04:45:45.498 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:45:45.497+0000 7f09df7fe700 1 --2- 172.21.15.76:0/995547086 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f09d80a1120 0x7f09d80a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:45:45.499 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:45:45.498+0000 7f09ee59c700 1 --2- 172.21.15.76:0/995547086 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f09d80a1120 0x7f09d80a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:45:45.499 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:45:45.498+0000 7f09df7fe700 1 -- 172.21.15.76:0/995547086 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4253+0+0 (secure 0 0 0) 0x7f09e00cb8a0 con 0x7f09f0102200 2024-06-02T04:45:45.499 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:45:45.498+0000 7f09ee59c700 1 --2- 172.21.15.76:0/995547086 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f09d80a1120 0x7f09d80a35e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f09e4005fd0 tx=0x7f09e4005dd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:45:45.501 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:45:45.501+0000 7f09df7fe700 1 -- 172.21.15.76:0/995547086 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f09e0095f70 con 0x7f09f0102200 2024-06-02T04:45:45.706 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:45:45.705+0000 7f09f4bee700 1 -- 172.21.15.76:0/995547086 --> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi076:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f09f00748f0 con 0x7f09d80a1120 2024-06-02T04:45:46.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:46 smithi119 ceph-mon[46633]: Detected new or changed devices on smithi192 2024-06-02T04:45:46.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:46 smithi119 ceph-mon[46633]: Adjusting osd_memory_target on smithi192 to 8556M 2024-06-02T04:45:46.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:46 smithi119 ceph-mon[46633]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]': finished 2024-06-02T04:45:46.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:46 smithi119 ceph-mon[46633]: osdmap e32: 6 total, 5 up, 6 in 2024-06-02T04:45:46.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:46 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-02T04:45:46.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:46 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-02T04:45:46.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:46 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T04:45:46.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:46 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T04:45:46.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:46 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:45:46.372 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:46 smithi076 ceph-mon[42935]: Detected new or changed devices on smithi192 2024-06-02T04:45:46.372 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:46 smithi076 ceph-mon[42935]: Adjusting osd_memory_target on smithi192 to 8556M 2024-06-02T04:45:46.372 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:46 smithi076 ceph-mon[42935]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]': finished 2024-06-02T04:45:46.372 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:46 smithi076 ceph-mon[42935]: osdmap e32: 6 total, 5 up, 6 in 2024-06-02T04:45:46.372 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:46 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-02T04:45:46.372 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:46 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-02T04:45:46.372 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:46 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T04:45:46.372 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:46 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T04:45:46.373 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:46 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:45:46.431 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:46 smithi192 ceph-mon[47933]: Detected new or changed devices on smithi192 2024-06-02T04:45:46.431 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:46 smithi192 ceph-mon[47933]: Adjusting osd_memory_target on smithi192 to 8556M 2024-06-02T04:45:46.431 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:46 smithi192 ceph-mon[47933]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]': finished 2024-06-02T04:45:46.431 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:46 smithi192 ceph-mon[47933]: osdmap e32: 6 total, 5 up, 6 in 2024-06-02T04:45:46.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:46 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-02T04:45:46.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:46 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-02T04:45:46.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:46 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T04:45:46.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:46 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T04:45:46.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:46 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:45:47.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:47 smithi119 ceph-mon[46633]: purged_snaps scrub starts 2024-06-02T04:45:47.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:47 smithi119 ceph-mon[46633]: purged_snaps scrub ok 2024-06-02T04:45:47.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:47 smithi119 ceph-mon[46633]: from='client.14364 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi076:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:45:47.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:47 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-02T04:45:47.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:47 smithi119 ceph-mon[46633]: osd.5 [v2:172.21.15.192:6808/3285065416,v1:172.21.15.192:6809/3285065416] boot 2024-06-02T04:45:47.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:47 smithi119 ceph-mon[46633]: osdmap e33: 6 total, 6 up, 6 in 2024-06-02T04:45:47.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:47 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-02T04:45:47.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:47 smithi119 ceph-mon[46633]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 153 MiB used, 447 GiB / 447 GiB avail 2024-06-02T04:45:47.431 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:47 smithi192 ceph-mon[47933]: purged_snaps scrub starts 2024-06-02T04:45:47.431 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:47 smithi192 ceph-mon[47933]: purged_snaps scrub ok 2024-06-02T04:45:47.431 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:47 smithi192 ceph-mon[47933]: from='client.14364 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi076:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:45:47.431 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:47 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-02T04:45:47.431 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:47 smithi192 ceph-mon[47933]: osd.5 [v2:172.21.15.192:6808/3285065416,v1:172.21.15.192:6809/3285065416] boot 2024-06-02T04:45:47.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:47 smithi192 ceph-mon[47933]: osdmap e33: 6 total, 6 up, 6 in 2024-06-02T04:45:47.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:47 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-02T04:45:47.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:47 smithi192 ceph-mon[47933]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 153 MiB used, 447 GiB / 447 GiB avail 2024-06-02T04:45:47.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:47 smithi076 ceph-mon[42935]: purged_snaps scrub starts 2024-06-02T04:45:47.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:47 smithi076 ceph-mon[42935]: purged_snaps scrub ok 2024-06-02T04:45:47.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:47 smithi076 ceph-mon[42935]: from='client.14364 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi076:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:45:47.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:47 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-02T04:45:47.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:47 smithi076 ceph-mon[42935]: osd.5 [v2:172.21.15.192:6808/3285065416,v1:172.21.15.192:6809/3285065416] boot 2024-06-02T04:45:47.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:47 smithi076 ceph-mon[42935]: osdmap e33: 6 total, 6 up, 6 in 2024-06-02T04:45:47.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:47 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-02T04:45:47.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:47 smithi076 ceph-mon[42935]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 153 MiB used, 447 GiB / 447 GiB avail 2024-06-02T04:45:48.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:48 smithi119 ceph-mon[46633]: osdmap e34: 6 total, 6 up, 6 in 2024-06-02T04:45:48.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:48 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/3270251929' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e6dc8b9d-dd06-4870-a506-def8201b7e6d"}]: dispatch 2024-06-02T04:45:48.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:48 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/3270251929' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e6dc8b9d-dd06-4870-a506-def8201b7e6d"}]': finished 2024-06-02T04:45:48.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:48 smithi119 ceph-mon[46633]: osdmap e35: 7 total, 6 up, 7 in 2024-06-02T04:45:48.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:48 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-02T04:45:48.431 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:48 smithi192 ceph-mon[47933]: osdmap e34: 6 total, 6 up, 6 in 2024-06-02T04:45:48.431 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:48 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/3270251929' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e6dc8b9d-dd06-4870-a506-def8201b7e6d"}]: dispatch 2024-06-02T04:45:48.431 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:48 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/3270251929' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e6dc8b9d-dd06-4870-a506-def8201b7e6d"}]': finished 2024-06-02T04:45:48.431 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:48 smithi192 ceph-mon[47933]: osdmap e35: 7 total, 6 up, 7 in 2024-06-02T04:45:48.431 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:48 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-02T04:45:48.486 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:48 smithi076 ceph-mon[42935]: osdmap e34: 6 total, 6 up, 6 in 2024-06-02T04:45:48.486 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:48 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/3270251929' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e6dc8b9d-dd06-4870-a506-def8201b7e6d"}]: dispatch 2024-06-02T04:45:48.486 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:48 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/3270251929' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e6dc8b9d-dd06-4870-a506-def8201b7e6d"}]': finished 2024-06-02T04:45:48.486 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:48 smithi076 ceph-mon[42935]: osdmap e35: 7 total, 6 up, 7 in 2024-06-02T04:45:48.486 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:48 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-02T04:45:49.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:49 smithi119 ceph-mon[46633]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 180 MiB used, 536 GiB / 536 GiB avail 2024-06-02T04:45:49.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:49 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/1000342602' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T04:45:49.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:49 smithi119 ceph-mon[46633]: osdmap e36: 7 total, 6 up, 7 in 2024-06-02T04:45:49.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:49 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-02T04:45:49.431 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:49 smithi192 ceph-mon[47933]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 180 MiB used, 536 GiB / 536 GiB avail 2024-06-02T04:45:49.431 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:49 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/1000342602' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T04:45:49.431 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:49 smithi192 ceph-mon[47933]: osdmap e36: 7 total, 6 up, 7 in 2024-06-02T04:45:49.431 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:49 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-02T04:45:49.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:49 smithi076 ceph-mon[42935]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 180 MiB used, 536 GiB / 536 GiB avail 2024-06-02T04:45:49.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:49 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/1000342602' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T04:45:49.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:49 smithi076 ceph-mon[42935]: osdmap e36: 7 total, 6 up, 7 in 2024-06-02T04:45:49.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:49 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-02T04:45:50.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:50 smithi119 ceph-mon[46633]: osdmap e37: 7 total, 6 up, 7 in 2024-06-02T04:45:50.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:50 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-02T04:45:50.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:50 smithi119 ceph-mon[46633]: pgmap v109: 1 pgs: 1 peering; 577 KiB data, 180 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-06-02T04:45:50.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:50 smithi192 ceph-mon[47933]: osdmap e37: 7 total, 6 up, 7 in 2024-06-02T04:45:50.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:50 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-02T04:45:50.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:50 smithi192 ceph-mon[47933]: pgmap v109: 1 pgs: 1 peering; 577 KiB data, 180 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-06-02T04:45:50.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:50 smithi076 ceph-mon[42935]: osdmap e37: 7 total, 6 up, 7 in 2024-06-02T04:45:50.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:50 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-02T04:45:50.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:50 smithi076 ceph-mon[42935]: pgmap v109: 1 pgs: 1 peering; 577 KiB data, 180 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-06-02T04:45:53.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:53 smithi076 ceph-mon[42935]: pgmap v110: 1 pgs: 1 peering; 577 KiB data, 180 MiB used, 536 GiB / 536 GiB avail; 113 KiB/s, 0 objects/s recovering 2024-06-02T04:45:53.431 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:53 smithi192 ceph-mon[47933]: pgmap v110: 1 pgs: 1 peering; 577 KiB data, 180 MiB used, 536 GiB / 536 GiB avail; 113 KiB/s, 0 objects/s recovering 2024-06-02T04:45:53.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:53 smithi119 ceph-mon[46633]: pgmap v110: 1 pgs: 1 peering; 577 KiB data, 180 MiB used, 536 GiB / 536 GiB avail; 113 KiB/s, 0 objects/s recovering 2024-06-02T04:45:54.421 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:54 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-06-02T04:45:54.422 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:54 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:45:54.422 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:54 smithi076 ceph-mon[42935]: Deploying daemon osd.6 on smithi076 2024-06-02T04:45:54.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:54 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-06-02T04:45:54.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:54 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:45:54.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:54 smithi119 ceph-mon[46633]: Deploying daemon osd.6 on smithi076 2024-06-02T04:45:54.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:54 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-06-02T04:45:54.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:54 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:45:54.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:54 smithi192 ceph-mon[47933]: Deploying daemon osd.6 on smithi076 2024-06-02T04:45:55.422 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:55 smithi076 ceph-mon[42935]: pgmap v111: 1 pgs: 1 peering; 577 KiB data, 180 MiB used, 536 GiB / 536 GiB avail; 87 KiB/s, 0 objects/s recovering 2024-06-02T04:45:55.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:55 smithi119 ceph-mon[46633]: pgmap v111: 1 pgs: 1 peering; 577 KiB data, 180 MiB used, 536 GiB / 536 GiB avail; 87 KiB/s, 0 objects/s recovering 2024-06-02T04:45:55.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:55 smithi192 ceph-mon[47933]: pgmap v111: 1 pgs: 1 peering; 577 KiB data, 180 MiB used, 536 GiB / 536 GiB avail; 87 KiB/s, 0 objects/s recovering 2024-06-02T04:45:57.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:57 smithi076 ceph-mon[42935]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 180 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-06-02T04:45:57.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:57 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:57.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:57 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:57.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:57 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:45:57.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:57 smithi119 ceph-mon[46633]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 180 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-06-02T04:45:57.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:57 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:57.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:57 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:57.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:57 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:45:57.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:57 smithi192 ceph-mon[47933]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 180 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-06-02T04:45:57.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:57 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:57.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:57 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:57.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:57 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:45:59.098 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:45:59.097+0000 7f09df7fe700 1 -- 172.21.15.76:0/995547086 <== mgr.14152 v2:172.21.15.76:6800/2591353090 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f09f00748f0 con 0x7f09d80a1120 2024-06-02T04:45:59.098 INFO:teuthology.orchestra.run.smithi076.stdout:Created osd(s) 6 on host 'smithi076' 2024-06-02T04:45:59.100 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:45:59.100+0000 7f09f4bee700 1 -- 172.21.15.76:0/995547086 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f09d80a1120 msgr2=0x7f09d80a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:45:59.100 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:45:59.100+0000 7f09f4bee700 1 --2- 172.21.15.76:0/995547086 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f09d80a1120 0x7f09d80a35e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f09e4005fd0 tx=0x7f09e4005dd0 comp rx=0 tx=0).stop 2024-06-02T04:45:59.100 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:45:59.100+0000 7f09f4bee700 1 -- 172.21.15.76:0/995547086 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f09f0102200 msgr2=0x7f09f01996b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:45:59.100 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:45:59.100+0000 7f09f4bee700 1 --2- 172.21.15.76:0/995547086 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f09f0102200 0x7f09f01996b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f09e000b560 tx=0x7f09e000b920 comp rx=0 tx=0).stop 2024-06-02T04:45:59.100 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:45:59.100+0000 7f09f4bee700 1 -- 172.21.15.76:0/995547086 shutdown_connections 2024-06-02T04:45:59.101 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:45:59.100+0000 7f09f4bee700 1 --2- 172.21.15.76:0/995547086 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f09f0102ba0 0x7f09f01a06e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:45:59.101 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:45:59.100+0000 7f09f4bee700 1 --2- 172.21.15.76:0/995547086 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f09d80a1120 0x7f09d80a35e0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:45:59.101 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:45:59.100+0000 7f09f4bee700 1 --2- 172.21.15.76:0/995547086 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f09f0101000 0x7f09f0199170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:45:59.101 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:45:59.100+0000 7f09f4bee700 1 --2- 172.21.15.76:0/995547086 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f09f0102200 0x7f09f01996b0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:45:59.101 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:45:59.100+0000 7f09f4bee700 1 -- 172.21.15.76:0/995547086 >> 172.21.15.76:0/995547086 conn(0x7f09f00fc5a0 msgr2=0x7f09f00731d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:45:59.101 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:45:59.100+0000 7f09f4bee700 1 -- 172.21.15.76:0/995547086 shutdown_connections 2024-06-02T04:45:59.101 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:45:59.100+0000 7f09f4bee700 1 -- 172.21.15.76:0/995547086 wait complete. 2024-06-02T04:45:59.304 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:59 smithi076 ceph-mon[42935]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 180 MiB used, 536 GiB / 536 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-06-02T04:45:59.304 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:59 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:59.304 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:59 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:59.304 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:59 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:45:59.304 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:59 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:45:59.304 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:59 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:59.304 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:59 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:45:59.304 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:59 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:59.304 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:45:59 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:59.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:59 smithi119 ceph-mon[46633]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 180 MiB used, 536 GiB / 536 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-06-02T04:45:59.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:59 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:59.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:59 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:59.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:59 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:45:59.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:59 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:45:59.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:59 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:59.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:59 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:45:59.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:59 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:59.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:45:59 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:59.670 DEBUG:teuthology.orchestra.run.smithi076:osd.6> sudo journalctl -f -n 0 -u ceph-60ab6d30-209a-11ef-bc9b-c7b262605968@osd.6.service 2024-06-02T04:45:59.672 INFO:tasks.cephadm:Deploying osd.7 on smithi119 with /dev/vg_nvme/lv_2... 2024-06-02T04:45:59.672 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 60ab6d30-209a-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-06-02T04:45:59.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:59 smithi192 ceph-mon[47933]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 180 MiB used, 536 GiB / 536 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-06-02T04:45:59.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:59 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:59.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:59 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:59.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:59 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:45:59.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:59 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:45:59.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:59 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:59.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:59 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:45:59.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:59 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:59.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:45:59 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:45:59.703 INFO:journalctl@ceph.osd.6.smithi076.stdout:-- Logs begin at Sun 2024-06-02 04:26:13 UTC. -- 2024-06-02T04:45:59.902 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/mon.b/config 2024-06-02T04:46:01.197 INFO:journalctl@ceph.osd.6.smithi076.stdout:Jun 02 04:46:01 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-6[79456]: 2024-06-02T04:46:00.999+0000 7f611ff5d7c0 -1 osd.6 0 log_to_monitors true 2024-06-02T04:46:01.230 INFO:teuthology.orchestra.run.smithi119.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-06-02T04:46:01.230 INFO:teuthology.orchestra.run.smithi119.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-06-02T04:46:01.230 INFO:teuthology.orchestra.run.smithi119.stderr: stderr: 10+0 records in 2024-06-02T04:46:01.230 INFO:teuthology.orchestra.run.smithi119.stderr:10+0 records out 2024-06-02T04:46:01.230 INFO:teuthology.orchestra.run.smithi119.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0112016 s, 936 MB/s 2024-06-02T04:46:01.230 INFO:teuthology.orchestra.run.smithi119.stderr:--> Zapping successful for: 2024-06-02T04:46:01.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:01 smithi076 ceph-mon[42935]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 180 MiB used, 536 GiB / 536 GiB avail 2024-06-02T04:46:01.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:01 smithi076 ceph-mon[42935]: from='osd.6 [v2:172.21.15.76:6818/2951381580,v1:172.21.15.76:6819/2951381580]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-06-02T04:46:01.536 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:01 smithi119 ceph-mon[46633]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 180 MiB used, 536 GiB / 536 GiB avail 2024-06-02T04:46:01.536 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:01 smithi119 ceph-mon[46633]: from='osd.6 [v2:172.21.15.76:6818/2951381580,v1:172.21.15.76:6819/2951381580]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-06-02T04:46:01.617 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 60ab6d30-209a-11ef-bc9b-c7b262605968 -- ceph orch daemon add osd smithi119:vg_nvme/lv_2 2024-06-02T04:46:01.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:01 smithi192 ceph-mon[47933]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 180 MiB used, 536 GiB / 536 GiB avail 2024-06-02T04:46:01.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:01 smithi192 ceph-mon[47933]: from='osd.6 [v2:172.21.15.76:6818/2951381580,v1:172.21.15.76:6819/2951381580]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-06-02T04:46:01.834 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/mon.b/config 2024-06-02T04:46:02.483 INFO:journalctl@ceph.osd.6.smithi076.stdout:Jun 02 04:46:02 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-6[79456]: 2024-06-02T04:46:02.198+0000 7f61155c1700 -1 osd.6 0 waiting for initial osdmap 2024-06-02T04:46:02.483 INFO:journalctl@ceph.osd.6.smithi076.stdout:Jun 02 04:46:02 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-6[79456]: 2024-06-02T04:46:02.211+0000 7f61113b6700 -1 osd.6 39 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-02T04:46:02.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:02 smithi076 ceph-mon[42935]: from='osd.6 [v2:172.21.15.76:6818/2951381580,v1:172.21.15.76:6819/2951381580]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-06-02T04:46:02.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:02 smithi076 ceph-mon[42935]: osdmap e38: 7 total, 6 up, 7 in 2024-06-02T04:46:02.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:02 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-02T04:46:02.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:02 smithi076 ceph-mon[42935]: from='osd.6 [v2:172.21.15.76:6818/2951381580,v1:172.21.15.76:6819/2951381580]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi076", "root=default"]}]: dispatch 2024-06-02T04:46:02.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:02 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:46:02.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:02 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:46:02.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:02 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:46:02.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:02 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:46:02.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:02 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:46:02.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:02 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:46:02.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:02 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:46:02.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:02 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:46:02.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:02 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:46:02.573 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:02 smithi119 ceph-mon[46633]: from='osd.6 [v2:172.21.15.76:6818/2951381580,v1:172.21.15.76:6819/2951381580]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-06-02T04:46:02.573 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:02 smithi119 ceph-mon[46633]: osdmap e38: 7 total, 6 up, 7 in 2024-06-02T04:46:02.573 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:02 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-02T04:46:02.573 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:02 smithi119 ceph-mon[46633]: from='osd.6 [v2:172.21.15.76:6818/2951381580,v1:172.21.15.76:6819/2951381580]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi076", "root=default"]}]: dispatch 2024-06-02T04:46:02.574 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:02 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:46:02.574 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:02 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:46:02.574 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:02 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:46:02.574 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:02 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:46:02.574 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:02 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:46:02.574 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:02 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:46:02.574 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:02 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:46:02.574 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:02 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:46:02.574 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:02 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:46:02.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:02 smithi192 ceph-mon[47933]: from='osd.6 [v2:172.21.15.76:6818/2951381580,v1:172.21.15.76:6819/2951381580]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-06-02T04:46:02.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:02 smithi192 ceph-mon[47933]: osdmap e38: 7 total, 6 up, 7 in 2024-06-02T04:46:02.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:02 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-02T04:46:02.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:02 smithi192 ceph-mon[47933]: from='osd.6 [v2:172.21.15.76:6818/2951381580,v1:172.21.15.76:6819/2951381580]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi076", "root=default"]}]: dispatch 2024-06-02T04:46:02.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:02 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:46:02.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:02 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:46:02.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:02 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:46:02.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:02 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:46:02.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:02 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:46:02.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:02 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:46:02.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:02 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:46:02.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:02 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:46:02.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:02 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:46:02.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:46:02.741+0000 7f3d9a4a6700 1 -- 172.21.15.119:0/3971092306 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d94102200 msgr2=0x7f3d94102660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:46:02.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:46:02.741+0000 7f3d9a4a6700 1 --2- 172.21.15.119:0/3971092306 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d94102200 0x7f3d94102660 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c0099c0 tx=0x7f3d7c009cd0 comp rx=0 tx=0).stop 2024-06-02T04:46:02.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:46:02.741+0000 7f3d9a4a6700 1 -- 172.21.15.119:0/3971092306 shutdown_connections 2024-06-02T04:46:02.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:46:02.741+0000 7f3d9a4a6700 1 --2- 172.21.15.119:0/3971092306 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3d94102ba0 0x7f3d94109450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:46:02.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:46:02.741+0000 7f3d9a4a6700 1 --2- 172.21.15.119:0/3971092306 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3d94101000 0x7f3d94101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:46:02.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:46:02.741+0000 7f3d9a4a6700 1 --2- 172.21.15.119:0/3971092306 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d94102200 0x7f3d94102660 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:46:02.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:46:02.741+0000 7f3d9a4a6700 1 -- 172.21.15.119:0/3971092306 >> 172.21.15.119:0/3971092306 conn(0x7f3d940fc5c0 msgr2=0x7f3d940fe9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:46:02.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:46:02.741+0000 7f3d9a4a6700 1 -- 172.21.15.119:0/3971092306 shutdown_connections 2024-06-02T04:46:02.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:46:02.741+0000 7f3d9a4a6700 1 -- 172.21.15.119:0/3971092306 wait complete. 2024-06-02T04:46:02.744 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:46:02.742+0000 7f3d9a4a6700 1 Processor -- start 2024-06-02T04:46:02.744 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:46:02.742+0000 7f3d9a4a6700 1 -- start start 2024-06-02T04:46:02.744 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:46:02.743+0000 7f3d9a4a6700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d94101000 0x7f3d94074cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:46:02.744 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:46:02.743+0000 7f3d9a4a6700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3d94102200 0x7f3d94073390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:46:02.744 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:46:02.743+0000 7f3d9a4a6700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3d94102ba0 0x7f3d940738d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:46:02.744 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:46:02.743+0000 7f3d9a4a6700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d94074070 con 0x7f3d94102200 2024-06-02T04:46:02.745 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:46:02.743+0000 7f3d9a4a6700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d940741e0 con 0x7f3d94101000 2024-06-02T04:46:02.745 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:46:02.743+0000 7f3d9a4a6700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d941a0ec0 con 0x7f3d94102ba0 2024-06-02T04:46:02.745 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:46:02.743+0000 7f3d93fff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d94101000 0x7f3d94074cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:46:02.745 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:46:02.743+0000 7f3d93fff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d94101000 0x7f3d94074cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:38682/0 (socket says 172.21.15.119:38682) 2024-06-02T04:46:02.745 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:46:02.743+0000 7f3d93fff700 1 -- 172.21.15.119:0/37844123 learned_addr learned my addr 172.21.15.119:0/37844123 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-06-02T04:46:02.745 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:46:02.743+0000 7f3d98a43700 1 --2- 172.21.15.119:0/37844123 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3d94102ba0 0x7f3d940738d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:46:02.745 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:46:02.743+0000 7f3d937fe700 1 --2- 172.21.15.119:0/37844123 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3d94102200 0x7f3d94073390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:46:02.745 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:46:02.743+0000 7f3d93fff700 1 -- 172.21.15.119:0/37844123 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3d94102ba0 msgr2=0x7f3d940738d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:46:02.745 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:46:02.743+0000 7f3d93fff700 1 --2- 172.21.15.119:0/37844123 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3d94102ba0 0x7f3d940738d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:46:02.746 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:46:02.743+0000 7f3d93fff700 1 -- 172.21.15.119:0/37844123 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3d94102200 msgr2=0x7f3d94073390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:46:02.746 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:46:02.743+0000 7f3d93fff700 1 --2- 172.21.15.119:0/37844123 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3d94102200 0x7f3d94073390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:46:02.746 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:46:02.743+0000 7f3d93fff700 1 -- 172.21.15.119:0/37844123 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d7c0095f0 con 0x7f3d94101000 2024-06-02T04:46:02.746 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:46:02.743+0000 7f3d937fe700 1 --2- 172.21.15.119:0/37844123 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3d94102200 0x7f3d94073390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:46:02.746 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:46:02.743+0000 7f3d93fff700 1 --2- 172.21.15.119:0/37844123 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d94101000 0x7f3d94074cf0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3d8400e950 tx=0x7f3d8400ec60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:46:02.746 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:46:02.743+0000 7f3d917fa700 1 -- 172.21.15.119:0/37844123 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d84009770 con 0x7f3d94101000 2024-06-02T04:46:02.746 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:46:02.743+0000 7f3d917fa700 1 -- 172.21.15.119:0/37844123 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3d8400eea0 con 0x7f3d94101000 2024-06-02T04:46:02.747 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:46:02.743+0000 7f3d917fa700 1 -- 172.21.15.119:0/37844123 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d84003cc0 con 0x7f3d94101000 2024-06-02T04:46:02.747 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:46:02.743+0000 7f3d9a4a6700 1 -- 172.21.15.119:0/37844123 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d941a1150 con 0x7f3d94101000 2024-06-02T04:46:02.747 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:46:02.743+0000 7f3d9a4a6700 1 -- 172.21.15.119:0/37844123 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d941a1600 con 0x7f3d94101000 2024-06-02T04:46:02.747 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:46:02.744+0000 7f3d9a4a6700 1 -- 172.21.15.119:0/37844123 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d941084d0 con 0x7f3d94101000 2024-06-02T04:46:02.748 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:46:02.745+0000 7f3d917fa700 1 -- 172.21.15.119:0/37844123 <== mon.2 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f3d84003e20 con 0x7f3d94101000 2024-06-02T04:46:02.748 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:46:02.746+0000 7f3d917fa700 1 --2- 172.21.15.119:0/37844123 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f3d800a11a0 0x7f3d800a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:46:02.748 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:46:02.746+0000 7f3d917fa700 1 -- 172.21.15.119:0/37844123 <== mon.2 v2:172.21.15.119:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4685+0+0 (secure 0 0 0) 0x7f3d84014070 con 0x7f3d94101000 2024-06-02T04:46:02.748 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:46:02.746+0000 7f3d937fe700 1 --2- 172.21.15.119:0/37844123 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f3d800a11a0 0x7f3d800a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:46:02.748 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:46:02.747+0000 7f3d937fe700 1 --2- 172.21.15.119:0/37844123 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f3d800a11a0 0x7f3d800a3660 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c006010 tx=0x7f3d7c00b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:46:02.749 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:46:02.749+0000 7f3d917fa700 1 -- 172.21.15.119:0/37844123 <== mon.2 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f3d84096370 con 0x7f3d94101000 2024-06-02T04:46:02.949 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:46:02.949+0000 7f3d9a4a6700 1 -- 172.21.15.119:0/37844123 --> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f3d940613e0 con 0x7f3d800a11a0 2024-06-02T04:46:03.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:03 smithi076 ceph-mon[42935]: Detected new or changed devices on smithi076 2024-06-02T04:46:03.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:03 smithi076 ceph-mon[42935]: Adjusting osd_memory_target on smithi076 to 5704M 2024-06-02T04:46:03.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:03 smithi076 ceph-mon[42935]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 180 MiB used, 536 GiB / 536 GiB avail 2024-06-02T04:46:03.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:03 smithi076 ceph-mon[42935]: from='osd.6 [v2:172.21.15.76:6818/2951381580,v1:172.21.15.76:6819/2951381580]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi076", "root=default"]}]': finished 2024-06-02T04:46:03.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:03 smithi076 ceph-mon[42935]: osdmap e39: 7 total, 6 up, 7 in 2024-06-02T04:46:03.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:03 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-02T04:46:03.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:03 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-02T04:46:03.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:03 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T04:46:03.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:03 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T04:46:03.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:03 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:46:03.500 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:03 smithi119 ceph-mon[46633]: Detected new or changed devices on smithi076 2024-06-02T04:46:03.500 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:03 smithi119 ceph-mon[46633]: Adjusting osd_memory_target on smithi076 to 5704M 2024-06-02T04:46:03.500 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:03 smithi119 ceph-mon[46633]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 180 MiB used, 536 GiB / 536 GiB avail 2024-06-02T04:46:03.500 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:03 smithi119 ceph-mon[46633]: from='osd.6 [v2:172.21.15.76:6818/2951381580,v1:172.21.15.76:6819/2951381580]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi076", "root=default"]}]': finished 2024-06-02T04:46:03.501 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:03 smithi119 ceph-mon[46633]: osdmap e39: 7 total, 6 up, 7 in 2024-06-02T04:46:03.501 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:03 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-02T04:46:03.501 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:03 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-02T04:46:03.501 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:03 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T04:46:03.501 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:03 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T04:46:03.501 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:03 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:46:03.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:03 smithi192 ceph-mon[47933]: Detected new or changed devices on smithi076 2024-06-02T04:46:03.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:03 smithi192 ceph-mon[47933]: Adjusting osd_memory_target on smithi076 to 5704M 2024-06-02T04:46:03.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:03 smithi192 ceph-mon[47933]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 180 MiB used, 536 GiB / 536 GiB avail 2024-06-02T04:46:03.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:03 smithi192 ceph-mon[47933]: from='osd.6 [v2:172.21.15.76:6818/2951381580,v1:172.21.15.76:6819/2951381580]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi076", "root=default"]}]': finished 2024-06-02T04:46:03.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:03 smithi192 ceph-mon[47933]: osdmap e39: 7 total, 6 up, 7 in 2024-06-02T04:46:03.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:03 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-02T04:46:03.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:03 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-02T04:46:03.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:03 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T04:46:03.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:03 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T04:46:03.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:03 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:46:04.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:04 smithi076 ceph-mon[42935]: purged_snaps scrub starts 2024-06-02T04:46:04.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:04 smithi076 ceph-mon[42935]: purged_snaps scrub ok 2024-06-02T04:46:04.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:04 smithi076 ceph-mon[42935]: from='client.24269 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:46:04.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:04 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-02T04:46:04.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:04 smithi076 ceph-mon[42935]: osd.6 [v2:172.21.15.76:6818/2951381580,v1:172.21.15.76:6819/2951381580] boot 2024-06-02T04:46:04.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:04 smithi076 ceph-mon[42935]: osdmap e40: 7 total, 7 up, 7 in 2024-06-02T04:46:04.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:04 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-02T04:46:04.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:04 smithi119 ceph-mon[46633]: purged_snaps scrub starts 2024-06-02T04:46:04.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:04 smithi119 ceph-mon[46633]: purged_snaps scrub ok 2024-06-02T04:46:04.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:04 smithi119 ceph-mon[46633]: from='client.24269 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:46:04.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:04 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-02T04:46:04.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:04 smithi119 ceph-mon[46633]: osd.6 [v2:172.21.15.76:6818/2951381580,v1:172.21.15.76:6819/2951381580] boot 2024-06-02T04:46:04.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:04 smithi119 ceph-mon[46633]: osdmap e40: 7 total, 7 up, 7 in 2024-06-02T04:46:04.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:04 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-02T04:46:04.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:04 smithi192 ceph-mon[47933]: purged_snaps scrub starts 2024-06-02T04:46:04.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:04 smithi192 ceph-mon[47933]: purged_snaps scrub ok 2024-06-02T04:46:04.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:04 smithi192 ceph-mon[47933]: from='client.24269 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:46:04.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:04 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-02T04:46:04.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:04 smithi192 ceph-mon[47933]: osd.6 [v2:172.21.15.76:6818/2951381580,v1:172.21.15.76:6819/2951381580] boot 2024-06-02T04:46:04.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:04 smithi192 ceph-mon[47933]: osdmap e40: 7 total, 7 up, 7 in 2024-06-02T04:46:04.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:04 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-02T04:46:05.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:05 smithi076 ceph-mon[42935]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 180 MiB used, 536 GiB / 536 GiB avail 2024-06-02T04:46:05.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:05 smithi076 ceph-mon[42935]: osdmap e41: 7 total, 7 up, 7 in 2024-06-02T04:46:05.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:05 smithi076 ceph-mon[42935]: from='client.? 172.21.15.119:0/4090566182' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2f5dccb3-39a1-4f25-8715-fa264d59db97"}]: dispatch 2024-06-02T04:46:05.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:05 smithi076 ceph-mon[42935]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2f5dccb3-39a1-4f25-8715-fa264d59db97"}]: dispatch 2024-06-02T04:46:05.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:05 smithi076 ceph-mon[42935]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2f5dccb3-39a1-4f25-8715-fa264d59db97"}]': finished 2024-06-02T04:46:05.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:05 smithi076 ceph-mon[42935]: osdmap e42: 8 total, 7 up, 8 in 2024-06-02T04:46:05.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:05 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-02T04:46:05.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:05 smithi119 ceph-mon[46633]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 180 MiB used, 536 GiB / 536 GiB avail 2024-06-02T04:46:05.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:05 smithi119 ceph-mon[46633]: osdmap e41: 7 total, 7 up, 7 in 2024-06-02T04:46:05.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:05 smithi119 ceph-mon[46633]: from='client.? 172.21.15.119:0/4090566182' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2f5dccb3-39a1-4f25-8715-fa264d59db97"}]: dispatch 2024-06-02T04:46:05.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:05 smithi119 ceph-mon[46633]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2f5dccb3-39a1-4f25-8715-fa264d59db97"}]: dispatch 2024-06-02T04:46:05.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:05 smithi119 ceph-mon[46633]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2f5dccb3-39a1-4f25-8715-fa264d59db97"}]': finished 2024-06-02T04:46:05.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:05 smithi119 ceph-mon[46633]: osdmap e42: 8 total, 7 up, 8 in 2024-06-02T04:46:05.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:05 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-02T04:46:05.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:05 smithi192 ceph-mon[47933]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 180 MiB used, 536 GiB / 536 GiB avail 2024-06-02T04:46:05.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:05 smithi192 ceph-mon[47933]: osdmap e41: 7 total, 7 up, 7 in 2024-06-02T04:46:05.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:05 smithi192 ceph-mon[47933]: from='client.? 172.21.15.119:0/4090566182' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2f5dccb3-39a1-4f25-8715-fa264d59db97"}]: dispatch 2024-06-02T04:46:05.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:05 smithi192 ceph-mon[47933]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2f5dccb3-39a1-4f25-8715-fa264d59db97"}]: dispatch 2024-06-02T04:46:05.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:05 smithi192 ceph-mon[47933]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2f5dccb3-39a1-4f25-8715-fa264d59db97"}]': finished 2024-06-02T04:46:05.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:05 smithi192 ceph-mon[47933]: osdmap e42: 8 total, 7 up, 8 in 2024-06-02T04:46:05.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:05 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-02T04:46:06.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:06 smithi076 ceph-mon[42935]: from='client.? 172.21.15.119:0/1239408716' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T04:46:06.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:06 smithi119 ceph-mon[46633]: from='client.? 172.21.15.119:0/1239408716' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T04:46:06.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:06 smithi192 ceph-mon[47933]: from='client.? 172.21.15.119:0/1239408716' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T04:46:07.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:07 smithi076 ceph-mon[42935]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 207 MiB used, 626 GiB / 626 GiB avail 2024-06-02T04:46:07.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:07 smithi119 ceph-mon[46633]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 207 MiB used, 626 GiB / 626 GiB avail 2024-06-02T04:46:07.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:07 smithi192 ceph-mon[47933]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 207 MiB used, 626 GiB / 626 GiB avail 2024-06-02T04:46:09.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:09 smithi119 ceph-mon[46633]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-06-02T04:46:09.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:09 smithi076 ceph-mon[42935]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-06-02T04:46:09.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:09 smithi192 ceph-mon[47933]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-06-02T04:46:11.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:11 smithi076 ceph-mon[42935]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-06-02T04:46:11.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:11 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-06-02T04:46:11.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:11 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:46:11.517 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:11 smithi119 ceph-mon[46633]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-06-02T04:46:11.517 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:11 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-06-02T04:46:11.517 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:11 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:46:11.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:11 smithi192 ceph-mon[47933]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-06-02T04:46:11.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:11 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-06-02T04:46:11.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:11 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:46:12.516 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:12 smithi119 ceph-mon[46633]: Deploying daemon osd.7 on smithi119 2024-06-02T04:46:12.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:12 smithi192 ceph-mon[47933]: Deploying daemon osd.7 on smithi119 2024-06-02T04:46:12.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:12 smithi076 ceph-mon[42935]: Deploying daemon osd.7 on smithi119 2024-06-02T04:46:13.495 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:13 smithi119 ceph-mon[46633]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-06-02T04:46:13.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:13 smithi192 ceph-mon[47933]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-06-02T04:46:13.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:13 smithi076 ceph-mon[42935]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-06-02T04:46:15.270 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:15 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:46:15.270 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:15 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:46:15.270 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:15 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:46:15.271 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:15 smithi119 ceph-mon[46633]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-06-02T04:46:15.431 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:15 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:46:15.431 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:15 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:46:15.431 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:15 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:46:15.431 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:15 smithi192 ceph-mon[47933]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-06-02T04:46:15.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:15 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:46:15.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:15 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:46:15.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:15 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:46:15.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:15 smithi076 ceph-mon[42935]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-06-02T04:46:16.204 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:46:16.204+0000 7f3d917fa700 1 -- 172.21.15.119:0/37844123 <== mgr.14152 v2:172.21.15.76:6800/2591353090 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f3d940613e0 con 0x7f3d800a11a0 2024-06-02T04:46:16.205 INFO:teuthology.orchestra.run.smithi119.stdout:Created osd(s) 7 on host 'smithi119' 2024-06-02T04:46:16.206 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:46:16.206+0000 7f3d9a4a6700 1 -- 172.21.15.119:0/37844123 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f3d800a11a0 msgr2=0x7f3d800a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:46:16.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:46:16.206+0000 7f3d9a4a6700 1 --2- 172.21.15.119:0/37844123 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f3d800a11a0 0x7f3d800a3660 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c006010 tx=0x7f3d7c00b540 comp rx=0 tx=0).stop 2024-06-02T04:46:16.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:46:16.206+0000 7f3d9a4a6700 1 -- 172.21.15.119:0/37844123 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d94101000 msgr2=0x7f3d94074cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:46:16.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:46:16.206+0000 7f3d9a4a6700 1 --2- 172.21.15.119:0/37844123 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d94101000 0x7f3d94074cf0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3d8400e950 tx=0x7f3d8400ec60 comp rx=0 tx=0).stop 2024-06-02T04:46:16.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:46:16.206+0000 7f3d9a4a6700 1 -- 172.21.15.119:0/37844123 shutdown_connections 2024-06-02T04:46:16.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:46:16.206+0000 7f3d9a4a6700 1 --2- 172.21.15.119:0/37844123 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3d94102ba0 0x7f3d940738d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:46:16.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:46:16.206+0000 7f3d9a4a6700 1 --2- 172.21.15.119:0/37844123 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f3d800a11a0 0x7f3d800a3660 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:46:16.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:46:16.206+0000 7f3d9a4a6700 1 --2- 172.21.15.119:0/37844123 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d94101000 0x7f3d94074cf0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:46:16.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:46:16.206+0000 7f3d9a4a6700 1 --2- 172.21.15.119:0/37844123 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3d94102200 0x7f3d94073390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:46:16.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:46:16.206+0000 7f3d9a4a6700 1 -- 172.21.15.119:0/37844123 >> 172.21.15.119:0/37844123 conn(0x7f3d940fc5c0 msgr2=0x7f3d94105610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:46:16.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:46:16.206+0000 7f3d9a4a6700 1 -- 172.21.15.119:0/37844123 shutdown_connections 2024-06-02T04:46:16.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:46:16.207+0000 7f3d9a4a6700 1 -- 172.21.15.119:0/37844123 wait complete. 2024-06-02T04:46:16.486 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:16 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:46:16.486 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:16 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:46:16.486 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:16 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:46:16.486 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:16 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:46:16.486 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:16 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:46:16.487 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:16 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:46:16.487 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:16 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:46:16.487 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:16 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:46:16.585 DEBUG:teuthology.orchestra.run.smithi119:osd.7> sudo journalctl -f -n 0 -u ceph-60ab6d30-209a-11ef-bc9b-c7b262605968@osd.7.service 2024-06-02T04:46:16.588 INFO:tasks.cephadm:Deploying osd.8 on smithi192 with /dev/vg_nvme/lv_2... 2024-06-02T04:46:16.588 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 60ab6d30-209a-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-06-02T04:46:16.618 INFO:journalctl@ceph.osd.7.smithi119.stdout:-- Logs begin at Sun 2024-06-02 04:25:42 UTC. -- 2024-06-02T04:46:16.622 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:16 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:46:16.622 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:16 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:46:16.622 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:16 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:46:16.622 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:16 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:46:16.622 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:16 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:46:16.622 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:16 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:46:16.622 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:16 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:46:16.622 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:16 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:46:16.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:16 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:46:16.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:16 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:46:16.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:16 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:46:16.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:16 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:46:16.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:16 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:46:16.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:16 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:46:16.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:16 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:46:16.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:16 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:46:16.821 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/mon.c/config 2024-06-02T04:46:17.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:17 smithi119 ceph-mon[46633]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-06-02T04:46:17.601 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:17 smithi192 ceph-mon[47933]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-06-02T04:46:17.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:17 smithi076 ceph-mon[42935]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-06-02T04:46:18.124 INFO:teuthology.orchestra.run.smithi192.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-06-02T04:46:18.124 INFO:teuthology.orchestra.run.smithi192.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-06-02T04:46:18.124 INFO:teuthology.orchestra.run.smithi192.stderr: stderr: 10+0 records in 2024-06-02T04:46:18.125 INFO:teuthology.orchestra.run.smithi192.stderr:10+0 records out 2024-06-02T04:46:18.125 INFO:teuthology.orchestra.run.smithi192.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0125382 s, 836 MB/s 2024-06-02T04:46:18.125 INFO:teuthology.orchestra.run.smithi192.stderr:--> Zapping successful for: 2024-06-02T04:46:18.346 INFO:journalctl@ceph.osd.7.smithi119.stdout:Jun 02 04:46:18 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-7[68256]: 2024-06-02T04:46:18.005+0000 7fc8b21a57c0 -1 osd.7 0 log_to_monitors true 2024-06-02T04:46:18.431 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:18 smithi192 ceph-mon[47933]: from='osd.7 [v2:172.21.15.119:6816/1802558756,v1:172.21.15.119:6817/1802558756]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-06-02T04:46:18.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:18 smithi192 ceph-mon[47933]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-06-02T04:46:18.504 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 60ab6d30-209a-11ef-bc9b-c7b262605968 -- ceph orch daemon add osd smithi192:vg_nvme/lv_2 2024-06-02T04:46:18.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:18 smithi076 ceph-mon[42935]: from='osd.7 [v2:172.21.15.119:6816/1802558756,v1:172.21.15.119:6817/1802558756]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-06-02T04:46:18.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:18 smithi076 ceph-mon[42935]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-06-02T04:46:18.764 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/mon.c/config 2024-06-02T04:46:18.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:18 smithi119 ceph-mon[46633]: from='osd.7 [v2:172.21.15.119:6816/1802558756,v1:172.21.15.119:6817/1802558756]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-06-02T04:46:18.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:18 smithi119 ceph-mon[46633]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-06-02T04:46:19.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:19 smithi192 ceph-mon[47933]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-06-02T04:46:19.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:19 smithi192 ceph-mon[47933]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-06-02T04:46:19.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:19 smithi192 ceph-mon[47933]: osdmap e43: 8 total, 7 up, 8 in 2024-06-02T04:46:19.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:19 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-02T04:46:19.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:19 smithi192 ceph-mon[47933]: from='osd.7 [v2:172.21.15.119:6816/1802558756,v1:172.21.15.119:6817/1802558756]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2024-06-02T04:46:19.535 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:19 smithi192 ceph-mon[47933]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2024-06-02T04:46:19.535 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:19 smithi192 ceph-mon[47933]: Detected new or changed devices on smithi119 2024-06-02T04:46:19.535 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:19 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:46:19.535 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:19 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:46:19.535 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:19 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:46:19.535 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:19 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:46:19.535 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:19 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:46:19.535 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:19 smithi192 ceph-mon[47933]: Adjusting osd_memory_target on smithi119 to 5704M 2024-06-02T04:46:19.535 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:19 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:46:19.535 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:19 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:46:19.535 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:19 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:46:19.535 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:19 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:46:19.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:46:19.713+0000 7f4c6544a700 1 -- 172.21.15.192:0/3515778013 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4c60104420 msgr2=0x7f4c60106810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:46:19.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:46:19.713+0000 7f4c6544a700 1 --2- 172.21.15.192:0/3515778013 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4c60104420 0x7f4c60106810 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f4c50009990 tx=0x7f4c50009ca0 comp rx=0 tx=0).stop 2024-06-02T04:46:19.716 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:46:19.713+0000 7f4c6544a700 1 -- 172.21.15.192:0/3515778013 shutdown_connections 2024-06-02T04:46:19.716 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:46:19.713+0000 7f4c6544a700 1 --2- 172.21.15.192:0/3515778013 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4c60106d50 0x7f4c60109160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:46:19.716 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:46:19.713+0000 7f4c6544a700 1 --2- 172.21.15.192:0/3515778013 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4c60101af0 0x7f4c60103ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:46:19.716 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:46:19.713+0000 7f4c6544a700 1 --2- 172.21.15.192:0/3515778013 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4c60104420 0x7f4c60106810 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:46:19.716 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:46:19.713+0000 7f4c6544a700 1 -- 172.21.15.192:0/3515778013 >> 172.21.15.192:0/3515778013 conn(0x7f4c600fb4a0 msgr2=0x7f4c600fd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:46:19.716 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:46:19.713+0000 7f4c6544a700 1 -- 172.21.15.192:0/3515778013 shutdown_connections 2024-06-02T04:46:19.716 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:46:19.713+0000 7f4c6544a700 1 -- 172.21.15.192:0/3515778013 wait complete. 2024-06-02T04:46:19.716 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:46:19.714+0000 7f4c6544a700 1 Processor -- start 2024-06-02T04:46:19.716 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:46:19.714+0000 7f4c6544a700 1 -- start start 2024-06-02T04:46:19.716 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:46:19.714+0000 7f4c6544a700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4c60101af0 0x7f4c60196e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:46:19.716 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:46:19.714+0000 7f4c6544a700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4c60104420 0x7f4c601973d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:46:19.716 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:46:19.714+0000 7f4c6544a700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4c60106d50 0x7f4c6019e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:46:19.717 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:46:19.714+0000 7f4c6544a700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c6019e9d0 con 0x7f4c60106d50 2024-06-02T04:46:19.717 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:46:19.714+0000 7f4c6544a700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c6019eb10 con 0x7f4c60104420 2024-06-02T04:46:19.717 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:46:19.714+0000 7f4c6544a700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c6019eca0 con 0x7f4c60101af0 2024-06-02T04:46:19.717 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:46:19.714+0000 7f4c5effd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4c60101af0 0x7f4c60196e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:46:19.717 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:46:19.714+0000 7f4c5effd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4c60101af0 0x7f4c60196e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:38482/0 (socket says 172.21.15.192:38482) 2024-06-02T04:46:19.717 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:46:19.714+0000 7f4c5effd700 1 -- 172.21.15.192:0/2173817719 learned_addr learned my addr 172.21.15.192:0/2173817719 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-06-02T04:46:19.717 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:46:19.714+0000 7f4c5e7fc700 1 --2- 172.21.15.192:0/2173817719 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4c60104420 0x7f4c601973d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:46:19.717 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:46:19.714+0000 7f4c5f7fe700 1 --2- 172.21.15.192:0/2173817719 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4c60106d50 0x7f4c6019e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:46:19.717 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:46:19.714+0000 7f4c5effd700 1 -- 172.21.15.192:0/2173817719 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4c60104420 msgr2=0x7f4c601973d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:46:19.717 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:46:19.714+0000 7f4c5effd700 1 --2- 172.21.15.192:0/2173817719 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4c60104420 0x7f4c601973d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:46:19.717 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:46:19.714+0000 7f4c5effd700 1 -- 172.21.15.192:0/2173817719 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4c60106d50 msgr2=0x7f4c6019e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:46:19.717 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:46:19.714+0000 7f4c5effd700 1 --2- 172.21.15.192:0/2173817719 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4c60106d50 0x7f4c6019e400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:46:19.717 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:46:19.714+0000 7f4c5effd700 1 -- 172.21.15.192:0/2173817719 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c500095f0 con 0x7f4c60101af0 2024-06-02T04:46:19.718 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:46:19.714+0000 7f4c5effd700 1 --2- 172.21.15.192:0/2173817719 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4c60101af0 0x7f4c60196e90 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f4c5400e9d0 tx=0x7f4c5400ece0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:46:19.718 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:46:19.715+0000 7f4c47fff700 1 -- 172.21.15.192:0/2173817719 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c54009790 con 0x7f4c60101af0 2024-06-02T04:46:19.718 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:46:19.715+0000 7f4c47fff700 1 -- 172.21.15.192:0/2173817719 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4c5400cbd0 con 0x7f4c60101af0 2024-06-02T04:46:19.718 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:46:19.715+0000 7f4c47fff700 1 -- 172.21.15.192:0/2173817719 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c54018680 con 0x7f4c60101af0 2024-06-02T04:46:19.718 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:46:19.715+0000 7f4c6544a700 1 -- 172.21.15.192:0/2173817719 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c6019ef80 con 0x7f4c60101af0 2024-06-02T04:46:19.718 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:46:19.715+0000 7f4c6544a700 1 -- 172.21.15.192:0/2173817719 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c6019f2e0 con 0x7f4c60101af0 2024-06-02T04:46:19.719 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:46:19.716+0000 7f4c6544a700 1 -- 172.21.15.192:0/2173817719 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c600fd020 con 0x7f4c60101af0 2024-06-02T04:46:19.719 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:46:19.717+0000 7f4c47fff700 1 -- 172.21.15.192:0/2173817719 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f4c5400cd40 con 0x7f4c60101af0 2024-06-02T04:46:19.719 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:46:19.717+0000 7f4c47fff700 1 --2- 172.21.15.192:0/2173817719 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f4c480a11a0 0x7f4c480a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:46:19.719 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:46:19.717+0000 7f4c47fff700 1 -- 172.21.15.192:0/2173817719 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5150+0+0 (secure 0 0 0) 0x7f4c54014070 con 0x7f4c60101af0 2024-06-02T04:46:19.719 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:46:19.717+0000 7f4c5e7fc700 1 --2- 172.21.15.192:0/2173817719 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f4c480a11a0 0x7f4c480a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:46:19.719 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:46:19.718+0000 7f4c5e7fc700 1 --2- 172.21.15.192:0/2173817719 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f4c480a11a0 0x7f4c480a3660 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4c50005910 tx=0x7f4c5000b610 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:46:19.721 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:46:19.721+0000 7f4c47fff700 1 -- 172.21.15.192:0/2173817719 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f4c54096650 con 0x7f4c60101af0 2024-06-02T04:46:19.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:19 smithi076 ceph-mon[42935]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-06-02T04:46:19.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:19 smithi076 ceph-mon[42935]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-06-02T04:46:19.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:19 smithi076 ceph-mon[42935]: osdmap e43: 8 total, 7 up, 8 in 2024-06-02T04:46:19.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:19 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-02T04:46:19.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:19 smithi076 ceph-mon[42935]: from='osd.7 [v2:172.21.15.119:6816/1802558756,v1:172.21.15.119:6817/1802558756]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2024-06-02T04:46:19.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:19 smithi076 ceph-mon[42935]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2024-06-02T04:46:19.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:19 smithi076 ceph-mon[42935]: Detected new or changed devices on smithi119 2024-06-02T04:46:19.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:19 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:46:19.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:19 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:46:19.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:19 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:46:19.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:19 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:46:19.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:19 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:46:19.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:19 smithi076 ceph-mon[42935]: Adjusting osd_memory_target on smithi119 to 5704M 2024-06-02T04:46:19.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:19 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:46:19.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:19 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:46:19.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:19 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:46:19.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:19 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:46:19.822 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:19 smithi119 ceph-mon[46633]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-06-02T04:46:19.822 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:19 smithi119 ceph-mon[46633]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-06-02T04:46:19.822 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:19 smithi119 ceph-mon[46633]: osdmap e43: 8 total, 7 up, 8 in 2024-06-02T04:46:19.822 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:19 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-02T04:46:19.823 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:19 smithi119 ceph-mon[46633]: from='osd.7 [v2:172.21.15.119:6816/1802558756,v1:172.21.15.119:6817/1802558756]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2024-06-02T04:46:19.823 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:19 smithi119 ceph-mon[46633]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2024-06-02T04:46:19.823 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:19 smithi119 ceph-mon[46633]: Detected new or changed devices on smithi119 2024-06-02T04:46:19.823 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:19 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:46:19.823 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:19 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:46:19.823 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:19 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:46:19.823 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:19 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:46:19.823 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:19 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:46:19.823 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:19 smithi119 ceph-mon[46633]: Adjusting osd_memory_target on smithi119 to 5704M 2024-06-02T04:46:19.823 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:19 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:46:19.823 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:19 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:46:19.823 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:19 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:46:19.823 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:19 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:46:19.924 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:46:19.924+0000 7f4c6544a700 1 -- 172.21.15.192:0/2173817719 --> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi192:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f4c6002cfd0 con 0x7f4c480a11a0 2024-06-02T04:46:20.096 INFO:journalctl@ceph.osd.7.smithi119.stdout:Jun 02 04:46:19 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-7[68256]: 2024-06-02T04:46:19.821+0000 7fc8a7809700 -1 osd.7 0 waiting for initial osdmap 2024-06-02T04:46:20.096 INFO:journalctl@ceph.osd.7.smithi119.stdout:Jun 02 04:46:19 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-7[68256]: 2024-06-02T04:46:19.833+0000 7fc89f5f6700 -1 osd.7 45 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-02T04:46:20.625 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:20 smithi192 ceph-mon[47933]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]': finished 2024-06-02T04:46:20.625 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:20 smithi192 ceph-mon[47933]: osdmap e44: 8 total, 7 up, 8 in 2024-06-02T04:46:20.625 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:20 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-02T04:46:20.625 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:20 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-02T04:46:20.626 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:20 smithi192 ceph-mon[47933]: osdmap e45: 8 total, 7 up, 8 in 2024-06-02T04:46:20.626 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:20 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-02T04:46:20.626 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:20 smithi192 ceph-mon[47933]: from='osd.7 ' entity='osd.7' 2024-06-02T04:46:20.626 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:20 smithi192 ceph-mon[47933]: from='client.24295 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi192:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:46:20.626 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:20 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T04:46:20.626 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:20 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T04:46:20.626 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:20 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:46:20.626 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:20 smithi192 ceph-mon[47933]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-06-02T04:46:20.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:20 smithi076 ceph-mon[42935]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]': finished 2024-06-02T04:46:20.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:20 smithi076 ceph-mon[42935]: osdmap e44: 8 total, 7 up, 8 in 2024-06-02T04:46:20.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:20 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-02T04:46:20.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:20 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-02T04:46:20.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:20 smithi076 ceph-mon[42935]: osdmap e45: 8 total, 7 up, 8 in 2024-06-02T04:46:20.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:20 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-02T04:46:20.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:20 smithi076 ceph-mon[42935]: from='osd.7 ' entity='osd.7' 2024-06-02T04:46:20.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:20 smithi076 ceph-mon[42935]: from='client.24295 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi192:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:46:20.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:20 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T04:46:20.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:20 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T04:46:20.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:20 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:46:20.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:20 smithi076 ceph-mon[42935]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-06-02T04:46:20.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:20 smithi119 ceph-mon[46633]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]': finished 2024-06-02T04:46:20.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:20 smithi119 ceph-mon[46633]: osdmap e44: 8 total, 7 up, 8 in 2024-06-02T04:46:20.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:20 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-02T04:46:20.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:20 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-02T04:46:20.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:20 smithi119 ceph-mon[46633]: osdmap e45: 8 total, 7 up, 8 in 2024-06-02T04:46:20.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:20 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-02T04:46:20.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:20 smithi119 ceph-mon[46633]: from='osd.7 ' entity='osd.7' 2024-06-02T04:46:20.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:20 smithi119 ceph-mon[46633]: from='client.24295 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi192:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:46:20.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:20 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T04:46:20.847 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:20 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T04:46:20.847 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:20 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:46:20.847 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:20 smithi119 ceph-mon[46633]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-06-02T04:46:21.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:21 smithi192 ceph-mon[47933]: purged_snaps scrub starts 2024-06-02T04:46:21.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:21 smithi192 ceph-mon[47933]: purged_snaps scrub ok 2024-06-02T04:46:21.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:21 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-02T04:46:21.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:21 smithi192 ceph-mon[47933]: osd.7 [v2:172.21.15.119:6816/1802558756,v1:172.21.15.119:6817/1802558756] boot 2024-06-02T04:46:21.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:21 smithi192 ceph-mon[47933]: osdmap e46: 8 total, 8 up, 8 in 2024-06-02T04:46:21.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:21 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-02T04:46:21.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:21 smithi076 ceph-mon[42935]: purged_snaps scrub starts 2024-06-02T04:46:21.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:21 smithi076 ceph-mon[42935]: purged_snaps scrub ok 2024-06-02T04:46:21.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:21 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-02T04:46:21.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:21 smithi076 ceph-mon[42935]: osd.7 [v2:172.21.15.119:6816/1802558756,v1:172.21.15.119:6817/1802558756] boot 2024-06-02T04:46:21.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:21 smithi076 ceph-mon[42935]: osdmap e46: 8 total, 8 up, 8 in 2024-06-02T04:46:21.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:21 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-02T04:46:21.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:21 smithi119 ceph-mon[46633]: purged_snaps scrub starts 2024-06-02T04:46:21.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:21 smithi119 ceph-mon[46633]: purged_snaps scrub ok 2024-06-02T04:46:21.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:21 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-02T04:46:21.847 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:21 smithi119 ceph-mon[46633]: osd.7 [v2:172.21.15.119:6816/1802558756,v1:172.21.15.119:6817/1802558756] boot 2024-06-02T04:46:21.847 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:21 smithi119 ceph-mon[46633]: osdmap e46: 8 total, 8 up, 8 in 2024-06-02T04:46:21.847 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:21 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-02T04:46:22.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:22 smithi076 ceph-mon[42935]: osdmap e47: 8 total, 8 up, 8 in 2024-06-02T04:46:22.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:22 smithi076 ceph-mon[42935]: from='client.? 172.21.15.192:0/1473105888' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "39b6ccd0-16e7-4cd5-87e0-d827e9172984"}]: dispatch 2024-06-02T04:46:22.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:22 smithi076 ceph-mon[42935]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "39b6ccd0-16e7-4cd5-87e0-d827e9172984"}]: dispatch 2024-06-02T04:46:22.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:22 smithi076 ceph-mon[42935]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "39b6ccd0-16e7-4cd5-87e0-d827e9172984"}]': finished 2024-06-02T04:46:22.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:22 smithi076 ceph-mon[42935]: osdmap e48: 9 total, 8 up, 9 in 2024-06-02T04:46:22.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:22 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-02T04:46:22.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:22 smithi076 ceph-mon[42935]: pgmap v136: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-06-02T04:46:22.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:22 smithi076 ceph-mon[42935]: from='client.? 172.21.15.192:0/2790744574' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T04:46:23.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:22 smithi119 ceph-mon[46633]: osdmap e47: 8 total, 8 up, 8 in 2024-06-02T04:46:23.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:22 smithi119 ceph-mon[46633]: from='client.? 172.21.15.192:0/1473105888' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "39b6ccd0-16e7-4cd5-87e0-d827e9172984"}]: dispatch 2024-06-02T04:46:23.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:22 smithi119 ceph-mon[46633]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "39b6ccd0-16e7-4cd5-87e0-d827e9172984"}]: dispatch 2024-06-02T04:46:23.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:22 smithi119 ceph-mon[46633]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "39b6ccd0-16e7-4cd5-87e0-d827e9172984"}]': finished 2024-06-02T04:46:23.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:22 smithi119 ceph-mon[46633]: osdmap e48: 9 total, 8 up, 9 in 2024-06-02T04:46:23.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:22 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-02T04:46:23.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:22 smithi119 ceph-mon[46633]: pgmap v136: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-06-02T04:46:23.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:22 smithi119 ceph-mon[46633]: from='client.? 172.21.15.192:0/2790744574' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T04:46:23.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:22 smithi192 ceph-mon[47933]: osdmap e47: 8 total, 8 up, 8 in 2024-06-02T04:46:23.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:22 smithi192 ceph-mon[47933]: from='client.? 172.21.15.192:0/1473105888' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "39b6ccd0-16e7-4cd5-87e0-d827e9172984"}]: dispatch 2024-06-02T04:46:23.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:22 smithi192 ceph-mon[47933]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "39b6ccd0-16e7-4cd5-87e0-d827e9172984"}]: dispatch 2024-06-02T04:46:23.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:22 smithi192 ceph-mon[47933]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "39b6ccd0-16e7-4cd5-87e0-d827e9172984"}]': finished 2024-06-02T04:46:23.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:22 smithi192 ceph-mon[47933]: osdmap e48: 9 total, 8 up, 9 in 2024-06-02T04:46:23.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:22 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-02T04:46:23.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:22 smithi192 ceph-mon[47933]: pgmap v136: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-06-02T04:46:23.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:22 smithi192 ceph-mon[47933]: from='client.? 172.21.15.192:0/2790744574' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T04:46:24.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:23 smithi119 ceph-mon[46633]: osdmap e49: 9 total, 8 up, 9 in 2024-06-02T04:46:24.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:23 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-02T04:46:24.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:23 smithi192 ceph-mon[47933]: osdmap e49: 9 total, 8 up, 9 in 2024-06-02T04:46:24.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:23 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-02T04:46:24.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:23 smithi076 ceph-mon[42935]: osdmap e49: 9 total, 8 up, 9 in 2024-06-02T04:46:24.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:23 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-02T04:46:25.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:24 smithi119 ceph-mon[46633]: osdmap e50: 9 total, 8 up, 9 in 2024-06-02T04:46:25.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:24 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-02T04:46:25.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:24 smithi119 ceph-mon[46633]: pgmap v139: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-06-02T04:46:25.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:24 smithi192 ceph-mon[47933]: osdmap e50: 9 total, 8 up, 9 in 2024-06-02T04:46:25.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:24 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-02T04:46:25.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:24 smithi192 ceph-mon[47933]: pgmap v139: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-06-02T04:46:25.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:24 smithi076 ceph-mon[42935]: osdmap e50: 9 total, 8 up, 9 in 2024-06-02T04:46:25.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:24 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-02T04:46:25.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:24 smithi076 ceph-mon[42935]: pgmap v139: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-06-02T04:46:27.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:27 smithi076 ceph-mon[42935]: pgmap v140: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-06-02T04:46:27.495 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:27 smithi192 ceph-mon[47933]: pgmap v140: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-06-02T04:46:27.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:27 smithi119 ceph-mon[46633]: pgmap v140: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-06-02T04:46:28.240 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:28 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-06-02T04:46:28.240 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:28 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:46:28.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:28 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-06-02T04:46:28.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:28 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:46:28.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:28 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-06-02T04:46:28.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:28 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:46:29.431 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:29 smithi192 ceph-mon[47933]: Deploying daemon osd.8 on smithi192 2024-06-02T04:46:29.431 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:29 smithi192 ceph-mon[47933]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-06-02T04:46:29.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:29 smithi076 ceph-mon[42935]: Deploying daemon osd.8 on smithi192 2024-06-02T04:46:29.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:29 smithi076 ceph-mon[42935]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-06-02T04:46:29.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:29 smithi119 ceph-mon[46633]: Deploying daemon osd.8 on smithi192 2024-06-02T04:46:29.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:29 smithi119 ceph-mon[46633]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-06-02T04:46:31.431 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:31 smithi192 ceph-mon[47933]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-06-02T04:46:31.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:31 smithi076 ceph-mon[42935]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-06-02T04:46:31.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:31 smithi119 ceph-mon[46633]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-06-02T04:46:32.310 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:32 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:46:32.310 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:32 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:46:32.311 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:32 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:46:32.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:32 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:46:32.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:32 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:46:32.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:32 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:46:32.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:32 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:46:32.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:32 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:46:32.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:32 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:46:33.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:33 smithi076 ceph-mon[42935]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-06-02T04:46:33.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:33 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:46:33.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:33 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:46:33.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:33 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:46:33.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:33 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:46:33.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:33 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:46:33.485 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:33 smithi192 ceph-mon[47933]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-06-02T04:46:33.485 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:33 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:46:33.485 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:33 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:46:33.485 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:33 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:46:33.486 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:33 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:46:33.486 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:33 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:46:33.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:33 smithi119 ceph-mon[46633]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-06-02T04:46:33.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:33 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:46:33.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:33 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:46:33.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:33 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:46:33.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:33 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:46:33.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:33 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:46:33.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:46:33.626+0000 7f4c47fff700 1 -- 172.21.15.192:0/2173817719 <== mgr.14152 v2:172.21.15.76:6800/2591353090 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f4c6002cfd0 con 0x7f4c480a11a0 2024-06-02T04:46:33.625 INFO:teuthology.orchestra.run.smithi192.stdout:Created osd(s) 8 on host 'smithi192' 2024-06-02T04:46:33.628 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:46:33.628+0000 7f4c6544a700 1 -- 172.21.15.192:0/2173817719 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f4c480a11a0 msgr2=0x7f4c480a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:46:33.628 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:46:33.628+0000 7f4c6544a700 1 --2- 172.21.15.192:0/2173817719 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f4c480a11a0 0x7f4c480a3660 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4c50005910 tx=0x7f4c5000b610 comp rx=0 tx=0).stop 2024-06-02T04:46:33.628 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:46:33.628+0000 7f4c6544a700 1 -- 172.21.15.192:0/2173817719 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4c60101af0 msgr2=0x7f4c60196e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:46:33.628 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:46:33.628+0000 7f4c6544a700 1 --2- 172.21.15.192:0/2173817719 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4c60101af0 0x7f4c60196e90 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f4c5400e9d0 tx=0x7f4c5400ece0 comp rx=0 tx=0).stop 2024-06-02T04:46:33.628 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:46:33.628+0000 7f4c6544a700 1 -- 172.21.15.192:0/2173817719 shutdown_connections 2024-06-02T04:46:33.628 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:46:33.628+0000 7f4c6544a700 1 --2- 172.21.15.192:0/2173817719 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4c60106d50 0x7f4c6019e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:46:33.628 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:46:33.628+0000 7f4c6544a700 1 --2- 172.21.15.192:0/2173817719 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4c60101af0 0x7f4c60196e90 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:46:33.628 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:46:33.628+0000 7f4c6544a700 1 --2- 172.21.15.192:0/2173817719 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f4c480a11a0 0x7f4c480a3660 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:46:33.628 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:46:33.628+0000 7f4c6544a700 1 --2- 172.21.15.192:0/2173817719 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4c60104420 0x7f4c601973d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:46:33.629 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:46:33.628+0000 7f4c6544a700 1 -- 172.21.15.192:0/2173817719 >> 172.21.15.192:0/2173817719 conn(0x7f4c600fb4a0 msgr2=0x7f4c60102390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:46:33.629 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:46:33.628+0000 7f4c6544a700 1 -- 172.21.15.192:0/2173817719 shutdown_connections 2024-06-02T04:46:33.629 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:46:33.628+0000 7f4c6544a700 1 -- 172.21.15.192:0/2173817719 wait complete. 2024-06-02T04:46:34.041 DEBUG:teuthology.orchestra.run.smithi192:osd.8> sudo journalctl -f -n 0 -u ceph-60ab6d30-209a-11ef-bc9b-c7b262605968@osd.8.service 2024-06-02T04:46:34.043 INFO:tasks.cephadm:Deploying osd.9 on smithi076 with /dev/vg_nvme/lv_1... 2024-06-02T04:46:34.043 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 60ab6d30-209a-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-06-02T04:46:34.086 INFO:journalctl@ceph.osd.8.smithi192.stdout:-- Logs begin at Sun 2024-06-02 04:25:37 UTC. -- 2024-06-02T04:46:34.294 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T04:46:34.716 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:34 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:46:34.716 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:34 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:46:34.716 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:34 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:46:34.716 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:34 smithi076 ceph-mon[42935]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-06-02T04:46:34.740 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:34 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:46:34.740 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:34 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:46:34.741 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:34 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:46:34.741 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:34 smithi192 ceph-mon[47933]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-06-02T04:46:34.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:34 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:46:34.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:34 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:46:34.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:34 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:46:34.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:34 smithi119 ceph-mon[46633]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-06-02T04:46:35.584 INFO:teuthology.orchestra.run.smithi076.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-06-02T04:46:35.584 INFO:teuthology.orchestra.run.smithi076.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-06-02T04:46:35.584 INFO:teuthology.orchestra.run.smithi076.stderr: stderr: 10+0 records in 2024-06-02T04:46:35.584 INFO:teuthology.orchestra.run.smithi076.stderr:10+0 records out 2024-06-02T04:46:35.584 INFO:teuthology.orchestra.run.smithi076.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0150272 s, 698 MB/s 2024-06-02T04:46:35.584 INFO:teuthology.orchestra.run.smithi076.stderr:--> Zapping successful for: 2024-06-02T04:46:35.598 INFO:journalctl@ceph.osd.8.smithi192.stdout:Jun 02 04:46:35 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-8[69456]: 2024-06-02T04:46:35.219+0000 7f12b37a87c0 -1 osd.8 0 log_to_monitors true 2024-06-02T04:46:35.898 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:35 smithi192 ceph-mon[47933]: from='osd.8 [v2:172.21.15.192:6816/1214972276,v1:172.21.15.192:6817/1214972276]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-06-02T04:46:35.898 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:35 smithi192 ceph-mon[47933]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-06-02T04:46:35.935 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:35 smithi076 ceph-mon[42935]: from='osd.8 [v2:172.21.15.192:6816/1214972276,v1:172.21.15.192:6817/1214972276]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-06-02T04:46:35.935 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:35 smithi076 ceph-mon[42935]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-06-02T04:46:36.008 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 60ab6d30-209a-11ef-bc9b-c7b262605968 -- ceph orch daemon add osd smithi076:vg_nvme/lv_1 2024-06-02T04:46:36.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:35 smithi119 ceph-mon[46633]: from='osd.8 [v2:172.21.15.192:6816/1214972276,v1:172.21.15.192:6817/1214972276]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-06-02T04:46:36.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:35 smithi119 ceph-mon[46633]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-06-02T04:46:36.240 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T04:46:36.607 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:36 smithi076 ceph-mon[42935]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-06-02T04:46:36.608 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:36 smithi076 ceph-mon[42935]: osdmap e51: 9 total, 8 up, 9 in 2024-06-02T04:46:36.608 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:36 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-02T04:46:36.931 INFO:journalctl@ceph.osd.8.smithi192.stdout:Jun 02 04:46:36 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-8[69456]: 2024-06-02T04:46:36.613+0000 7f12a8e0c700 -1 osd.8 0 waiting for initial osdmap 2024-06-02T04:46:36.931 INFO:journalctl@ceph.osd.8.smithi192.stdout:Jun 02 04:46:36 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-8[69456]: 2024-06-02T04:46:36.624+0000 7f12a4c01700 -1 osd.8 52 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-02T04:46:36.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:36 smithi192 ceph-mon[47933]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-06-02T04:46:36.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:36 smithi192 ceph-mon[47933]: osdmap e51: 9 total, 8 up, 9 in 2024-06-02T04:46:36.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:36 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-02T04:46:36.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:36 smithi192 ceph-mon[47933]: from='osd.8 [v2:172.21.15.192:6816/1214972276,v1:172.21.15.192:6817/1214972276]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]: dispatch 2024-06-02T04:46:36.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:36 smithi192 ceph-mon[47933]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]: dispatch 2024-06-02T04:46:36.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:36 smithi192 ceph-mon[47933]: Detected new or changed devices on smithi192 2024-06-02T04:46:36.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:36 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:46:36.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:36 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:46:36.933 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:36 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:46:36.933 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:36 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:46:36.933 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:36 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:46:36.933 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:36 smithi192 ceph-mon[47933]: Adjusting osd_memory_target on smithi192 to 5704M 2024-06-02T04:46:36.933 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:36 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:46:36.933 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:36 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:46:36.933 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:36 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:46:36.933 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:36 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:46:36.933 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:36 smithi192 ceph-mon[47933]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-06-02T04:46:36.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:36 smithi076 ceph-mon[42935]: from='osd.8 [v2:172.21.15.192:6816/1214972276,v1:172.21.15.192:6817/1214972276]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]: dispatch 2024-06-02T04:46:36.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:36 smithi076 ceph-mon[42935]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]: dispatch 2024-06-02T04:46:36.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:36 smithi076 ceph-mon[42935]: Detected new or changed devices on smithi192 2024-06-02T04:46:36.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:36 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:46:36.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:36 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:46:36.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:36 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:46:36.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:36 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:46:36.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:36 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:46:36.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:36 smithi076 ceph-mon[42935]: Adjusting osd_memory_target on smithi192 to 5704M 2024-06-02T04:46:36.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:36 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:46:36.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:36 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:46:36.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:36 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:46:36.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:36 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:46:36.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:36 smithi076 ceph-mon[42935]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-06-02T04:46:37.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:36 smithi119 ceph-mon[46633]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-06-02T04:46:37.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:36 smithi119 ceph-mon[46633]: osdmap e51: 9 total, 8 up, 9 in 2024-06-02T04:46:37.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:36 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-02T04:46:37.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:36 smithi119 ceph-mon[46633]: from='osd.8 [v2:172.21.15.192:6816/1214972276,v1:172.21.15.192:6817/1214972276]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]: dispatch 2024-06-02T04:46:37.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:36 smithi119 ceph-mon[46633]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]: dispatch 2024-06-02T04:46:37.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:36 smithi119 ceph-mon[46633]: Detected new or changed devices on smithi192 2024-06-02T04:46:37.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:36 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:46:37.097 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:36 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:46:37.097 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:36 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:46:37.097 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:36 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:46:37.097 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:36 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:46:37.097 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:36 smithi119 ceph-mon[46633]: Adjusting osd_memory_target on smithi192 to 5704M 2024-06-02T04:46:37.097 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:36 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:46:37.097 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:36 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:46:37.097 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:36 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:46:37.097 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:36 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:46:37.097 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:36 smithi119 ceph-mon[46633]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-06-02T04:46:37.194 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:46:37.194+0000 7f005ad4f700 1 -- 172.21.15.76:0/2837284919 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0054101a20 msgr2=0x7f0054108340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:46:37.195 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:46:37.194+0000 7f005ad4f700 1 --2- 172.21.15.76:0/2837284919 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0054101a20 0x7f0054108340 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f004c00b0a0 tx=0x7f004c00b3b0 comp rx=0 tx=0).stop 2024-06-02T04:46:37.195 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:46:37.194+0000 7f005ad4f700 1 -- 172.21.15.76:0/2837284919 shutdown_connections 2024-06-02T04:46:37.195 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:46:37.194+0000 7f005ad4f700 1 --2- 172.21.15.76:0/2837284919 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0054101a20 0x7f0054108340 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:46:37.195 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:46:37.194+0000 7f005ad4f700 1 --2- 172.21.15.76:0/2837284919 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f00540fff00 0x7f0054100320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:46:37.195 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:46:37.194+0000 7f005ad4f700 1 --2- 172.21.15.76:0/2837284919 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0054101060 0x7f00541014e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:46:37.195 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:46:37.194+0000 7f005ad4f700 1 -- 172.21.15.76:0/2837284919 >> 172.21.15.76:0/2837284919 conn(0x7f00540fb4a0 msgr2=0x7f00540fd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:46:37.195 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:46:37.194+0000 7f005ad4f700 1 -- 172.21.15.76:0/2837284919 shutdown_connections 2024-06-02T04:46:37.195 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:46:37.194+0000 7f005ad4f700 1 -- 172.21.15.76:0/2837284919 wait complete. 2024-06-02T04:46:37.197 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:46:37.195+0000 7f005ad4f700 1 Processor -- start 2024-06-02T04:46:37.197 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:46:37.195+0000 7f005ad4f700 1 -- start start 2024-06-02T04:46:37.197 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:46:37.195+0000 7f005ad4f700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f00540fff00 0x7f005406a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:46:37.197 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:46:37.195+0000 7f005ad4f700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0054101060 0x7f005419bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:46:37.197 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:46:37.195+0000 7f005ad4f700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0054101a20 0x7f005419e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:46:37.198 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:46:37.195+0000 7f005ad4f700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f005419e960 con 0x7f0054101060 2024-06-02T04:46:37.198 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:46:37.195+0000 7f005ad4f700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f005419ead0 con 0x7f0054101a20 2024-06-02T04:46:37.198 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:46:37.195+0000 7f005ad4f700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f005419ec90 con 0x7f00540fff00 2024-06-02T04:46:37.198 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:46:37.195+0000 7f0053fff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0054101060 0x7f005419bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:46:37.198 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:46:37.195+0000 7f0053fff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0054101060 0x7f005419bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:57412/0 (socket says 172.21.15.76:57412) 2024-06-02T04:46:37.198 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:46:37.195+0000 7f0053fff700 1 -- 172.21.15.76:0/3868969346 learned_addr learned my addr 172.21.15.76:0/3868969346 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:46:37.198 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:46:37.195+0000 7f00592ec700 1 --2- 172.21.15.76:0/3868969346 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0054101a20 0x7f005419e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:46:37.198 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:46:37.195+0000 7f0058aeb700 1 --2- 172.21.15.76:0/3868969346 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f00540fff00 0x7f005406a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:46:37.198 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:46:37.196+0000 7f0053fff700 1 -- 172.21.15.76:0/3868969346 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f00540fff00 msgr2=0x7f005406a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:46:37.198 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:46:37.196+0000 7f0053fff700 1 --2- 172.21.15.76:0/3868969346 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f00540fff00 0x7f005406a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:46:37.198 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:46:37.196+0000 7f0053fff700 1 -- 172.21.15.76:0/3868969346 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0054101a20 msgr2=0x7f005419e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:46:37.199 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:46:37.196+0000 7f0053fff700 1 --2- 172.21.15.76:0/3868969346 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0054101a20 0x7f005419e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:46:37.199 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:46:37.196+0000 7f0053fff700 1 -- 172.21.15.76:0/3868969346 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f004c009d00 con 0x7f0054101060 2024-06-02T04:46:37.199 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:46:37.196+0000 7f0053fff700 1 --2- 172.21.15.76:0/3868969346 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0054101060 0x7f005419bbf0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f004000c920 tx=0x7f004000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:46:37.199 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:46:37.196+0000 7f0051ffb700 1 -- 172.21.15.76:0/3868969346 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0040004a30 con 0x7f0054101060 2024-06-02T04:46:37.199 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:46:37.196+0000 7f0051ffb700 1 -- 172.21.15.76:0/3868969346 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f00400054b0 con 0x7f0054101060 2024-06-02T04:46:37.199 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:46:37.196+0000 7f005ad4f700 1 -- 172.21.15.76:0/3868969346 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f005419ef70 con 0x7f0054101060 2024-06-02T04:46:37.199 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:46:37.196+0000 7f0051ffb700 1 -- 172.21.15.76:0/3868969346 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0040007b50 con 0x7f0054101060 2024-06-02T04:46:37.199 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:46:37.196+0000 7f005ad4f700 1 -- 172.21.15.76:0/3868969346 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f005419f430 con 0x7f0054101060 2024-06-02T04:46:37.199 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:46:37.197+0000 7f005ad4f700 1 -- 172.21.15.76:0/3868969346 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0054107330 con 0x7f0054101060 2024-06-02T04:46:37.200 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:46:37.198+0000 7f0051ffb700 1 -- 172.21.15.76:0/3868969346 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f0040007cb0 con 0x7f0054101060 2024-06-02T04:46:37.200 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:46:37.199+0000 7f0051ffb700 1 --2- 172.21.15.76:0/3868969346 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f00440a11a0 0x7f00440a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:46:37.200 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:46:37.199+0000 7f0058aeb700 1 --2- 172.21.15.76:0/3868969346 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f00440a11a0 0x7f00440a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:46:37.200 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:46:37.199+0000 7f0051ffb700 1 -- 172.21.15.76:0/3868969346 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5549+0+0 (secure 0 0 0) 0x7f00400cbc60 con 0x7f0054101060 2024-06-02T04:46:37.200 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:46:37.199+0000 7f0058aeb700 1 --2- 172.21.15.76:0/3868969346 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f00440a11a0 0x7f00440a3660 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f004800ac50 tx=0x7f004800a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:46:37.203 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:46:37.203+0000 7f0051ffb700 1 -- 172.21.15.76:0/3868969346 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f0040095f40 con 0x7f0054101060 2024-06-02T04:46:37.405 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:46:37.405+0000 7f005ad4f700 1 -- 172.21.15.76:0/3868969346 --> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi076:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f005402ce10 con 0x7f00440a11a0 2024-06-02T04:46:37.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:37 smithi076 ceph-mon[42935]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]': finished 2024-06-02T04:46:37.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:37 smithi076 ceph-mon[42935]: osdmap e52: 9 total, 8 up, 9 in 2024-06-02T04:46:37.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:37 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-02T04:46:37.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:37 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-02T04:46:37.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:37 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T04:46:37.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:37 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T04:46:37.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:37 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:46:37.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:37 smithi076 ceph-mon[42935]: osd.8 [v2:172.21.15.192:6816/1214972276,v1:172.21.15.192:6817/1214972276] boot 2024-06-02T04:46:37.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:37 smithi076 ceph-mon[42935]: osdmap e53: 9 total, 9 up, 9 in 2024-06-02T04:46:37.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:37 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-02T04:46:37.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:37 smithi192 ceph-mon[47933]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]': finished 2024-06-02T04:46:37.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:37 smithi192 ceph-mon[47933]: osdmap e52: 9 total, 8 up, 9 in 2024-06-02T04:46:37.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:37 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-02T04:46:37.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:37 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-02T04:46:37.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:37 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T04:46:37.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:37 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T04:46:37.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:37 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:46:37.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:37 smithi192 ceph-mon[47933]: osd.8 [v2:172.21.15.192:6816/1214972276,v1:172.21.15.192:6817/1214972276] boot 2024-06-02T04:46:37.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:37 smithi192 ceph-mon[47933]: osdmap e53: 9 total, 9 up, 9 in 2024-06-02T04:46:37.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:37 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-02T04:46:38.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:37 smithi119 ceph-mon[46633]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]': finished 2024-06-02T04:46:38.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:37 smithi119 ceph-mon[46633]: osdmap e52: 9 total, 8 up, 9 in 2024-06-02T04:46:38.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:37 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-02T04:46:38.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:37 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-02T04:46:38.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:37 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T04:46:38.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:37 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T04:46:38.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:37 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:46:38.097 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:37 smithi119 ceph-mon[46633]: osd.8 [v2:172.21.15.192:6816/1214972276,v1:172.21.15.192:6817/1214972276] boot 2024-06-02T04:46:38.097 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:37 smithi119 ceph-mon[46633]: osdmap e53: 9 total, 9 up, 9 in 2024-06-02T04:46:38.097 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:37 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-02T04:46:38.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:38 smithi192 ceph-mon[47933]: purged_snaps scrub starts 2024-06-02T04:46:38.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:38 smithi192 ceph-mon[47933]: purged_snaps scrub ok 2024-06-02T04:46:38.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:38 smithi192 ceph-mon[47933]: from='client.14421 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi076:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:46:38.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:38 smithi192 ceph-mon[47933]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 266 MiB used, 804 GiB / 805 GiB avail 2024-06-02T04:46:38.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:38 smithi076 ceph-mon[42935]: purged_snaps scrub starts 2024-06-02T04:46:38.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:38 smithi076 ceph-mon[42935]: purged_snaps scrub ok 2024-06-02T04:46:38.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:38 smithi076 ceph-mon[42935]: from='client.14421 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi076:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:46:38.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:38 smithi076 ceph-mon[42935]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 266 MiB used, 804 GiB / 805 GiB avail 2024-06-02T04:46:39.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:38 smithi119 ceph-mon[46633]: purged_snaps scrub starts 2024-06-02T04:46:39.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:38 smithi119 ceph-mon[46633]: purged_snaps scrub ok 2024-06-02T04:46:39.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:38 smithi119 ceph-mon[46633]: from='client.14421 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi076:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:46:39.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:38 smithi119 ceph-mon[46633]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 266 MiB used, 804 GiB / 805 GiB avail 2024-06-02T04:46:39.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:39 smithi192 ceph-mon[47933]: osdmap e54: 9 total, 9 up, 9 in 2024-06-02T04:46:39.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:39 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/3719209704' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "851b2155-07bd-45de-bfe0-53021fda733f"}]: dispatch 2024-06-02T04:46:39.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:39 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/3719209704' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "851b2155-07bd-45de-bfe0-53021fda733f"}]': finished 2024-06-02T04:46:39.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:39 smithi192 ceph-mon[47933]: osdmap e55: 10 total, 9 up, 10 in 2024-06-02T04:46:39.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:39 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-02T04:46:39.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:39 smithi076 ceph-mon[42935]: osdmap e54: 9 total, 9 up, 9 in 2024-06-02T04:46:39.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:39 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/3719209704' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "851b2155-07bd-45de-bfe0-53021fda733f"}]: dispatch 2024-06-02T04:46:39.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:39 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/3719209704' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "851b2155-07bd-45de-bfe0-53021fda733f"}]': finished 2024-06-02T04:46:39.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:39 smithi076 ceph-mon[42935]: osdmap e55: 10 total, 9 up, 10 in 2024-06-02T04:46:39.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:39 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-02T04:46:40.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:39 smithi119 ceph-mon[46633]: osdmap e54: 9 total, 9 up, 9 in 2024-06-02T04:46:40.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:39 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/3719209704' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "851b2155-07bd-45de-bfe0-53021fda733f"}]: dispatch 2024-06-02T04:46:40.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:39 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/3719209704' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "851b2155-07bd-45de-bfe0-53021fda733f"}]': finished 2024-06-02T04:46:40.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:39 smithi119 ceph-mon[46633]: osdmap e55: 10 total, 9 up, 10 in 2024-06-02T04:46:40.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:39 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-02T04:46:40.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:40 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/972858667' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T04:46:40.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:40 smithi192 ceph-mon[47933]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 266 MiB used, 804 GiB / 805 GiB avail 2024-06-02T04:46:40.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:40 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/972858667' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T04:46:40.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:40 smithi076 ceph-mon[42935]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 266 MiB used, 804 GiB / 805 GiB avail 2024-06-02T04:46:41.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:40 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/972858667' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T04:46:41.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:40 smithi119 ceph-mon[46633]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 266 MiB used, 804 GiB / 805 GiB avail 2024-06-02T04:46:41.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:41 smithi192 ceph-mon[47933]: osdmap e56: 10 total, 9 up, 10 in 2024-06-02T04:46:41.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:41 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-02T04:46:41.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:41 smithi076 ceph-mon[42935]: osdmap e56: 10 total, 9 up, 10 in 2024-06-02T04:46:41.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:41 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-02T04:46:42.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:41 smithi119 ceph-mon[46633]: osdmap e56: 10 total, 9 up, 10 in 2024-06-02T04:46:42.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:41 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-02T04:46:42.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:42 smithi192 ceph-mon[47933]: osdmap e57: 10 total, 9 up, 10 in 2024-06-02T04:46:42.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:42 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-02T04:46:42.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:42 smithi192 ceph-mon[47933]: pgmap v155: 1 pgs: 1 peering; 577 KiB data, 266 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-06-02T04:46:42.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:42 smithi076 ceph-mon[42935]: osdmap e57: 10 total, 9 up, 10 in 2024-06-02T04:46:42.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:42 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-02T04:46:42.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:42 smithi076 ceph-mon[42935]: pgmap v155: 1 pgs: 1 peering; 577 KiB data, 266 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-06-02T04:46:43.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:42 smithi119 ceph-mon[46633]: osdmap e57: 10 total, 9 up, 10 in 2024-06-02T04:46:43.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:42 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-02T04:46:43.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:42 smithi119 ceph-mon[46633]: pgmap v155: 1 pgs: 1 peering; 577 KiB data, 266 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-06-02T04:46:45.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:45 smithi076 ceph-mon[42935]: pgmap v156: 1 pgs: 1 peering; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 104 KiB/s, 0 objects/s recovering 2024-06-02T04:46:45.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:45 smithi119 ceph-mon[46633]: pgmap v156: 1 pgs: 1 peering; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 104 KiB/s, 0 objects/s recovering 2024-06-02T04:46:45.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:45 smithi192 ceph-mon[47933]: pgmap v156: 1 pgs: 1 peering; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 104 KiB/s, 0 objects/s recovering 2024-06-02T04:46:46.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:46 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-06-02T04:46:46.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:46 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:46:46.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:46 smithi076 ceph-mon[42935]: Deploying daemon osd.9 on smithi076 2024-06-02T04:46:46.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:46 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-06-02T04:46:46.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:46 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:46:46.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:46 smithi119 ceph-mon[46633]: Deploying daemon osd.9 on smithi076 2024-06-02T04:46:46.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:46 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-06-02T04:46:46.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:46 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:46:46.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:46 smithi192 ceph-mon[47933]: Deploying daemon osd.9 on smithi076 2024-06-02T04:46:47.378 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:47 smithi076 ceph-mon[42935]: pgmap v157: 1 pgs: 1 peering; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 85 KiB/s, 0 objects/s recovering 2024-06-02T04:46:47.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:47 smithi119 ceph-mon[46633]: pgmap v157: 1 pgs: 1 peering; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 85 KiB/s, 0 objects/s recovering 2024-06-02T04:46:47.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:47 smithi192 ceph-mon[47933]: pgmap v157: 1 pgs: 1 peering; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 85 KiB/s, 0 objects/s recovering 2024-06-02T04:46:49.464 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:49 smithi076 ceph-mon[42935]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-06-02T04:46:49.464 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:49 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:46:49.465 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:49 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:46:49.465 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:49 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:46:49.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:49 smithi119 ceph-mon[46633]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-06-02T04:46:49.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:49 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:46:49.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:49 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:46:49.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:49 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:46:49.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:49 smithi192 ceph-mon[47933]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-06-02T04:46:49.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:49 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:46:49.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:49 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:46:49.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:49 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:46:51.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:51 smithi076 ceph-mon[42935]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-06-02T04:46:51.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:51 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:46:51.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:51 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:46:51.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:51 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:46:51.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:51 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:46:51.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:51 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:46:51.353 INFO:teuthology.orchestra.run.smithi076.stdout:Created osd(s) 9 on host 'smithi076' 2024-06-02T04:46:51.354 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:46:51.353+0000 7f0051ffb700 1 -- 172.21.15.76:0/3868969346 <== mgr.14152 v2:172.21.15.76:6800/2591353090 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f005402ce10 con 0x7f00440a11a0 2024-06-02T04:46:51.356 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:46:51.355+0000 7f005ad4f700 1 -- 172.21.15.76:0/3868969346 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f00440a11a0 msgr2=0x7f00440a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:46:51.356 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:46:51.355+0000 7f005ad4f700 1 --2- 172.21.15.76:0/3868969346 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f00440a11a0 0x7f00440a3660 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f004800ac50 tx=0x7f004800a380 comp rx=0 tx=0).stop 2024-06-02T04:46:51.356 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:46:51.355+0000 7f005ad4f700 1 -- 172.21.15.76:0/3868969346 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0054101060 msgr2=0x7f005419bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:46:51.356 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:46:51.355+0000 7f005ad4f700 1 --2- 172.21.15.76:0/3868969346 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0054101060 0x7f005419bbf0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f004000c920 tx=0x7f004000cc30 comp rx=0 tx=0).stop 2024-06-02T04:46:51.356 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:46:51.356+0000 7f005ad4f700 1 -- 172.21.15.76:0/3868969346 shutdown_connections 2024-06-02T04:46:51.356 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:46:51.356+0000 7f005ad4f700 1 --2- 172.21.15.76:0/3868969346 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f00440a11a0 0x7f00440a3660 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:46:51.356 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:46:51.356+0000 7f005ad4f700 1 --2- 172.21.15.76:0/3868969346 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0054101a20 0x7f005419e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:46:51.356 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:46:51.356+0000 7f005ad4f700 1 --2- 172.21.15.76:0/3868969346 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f00540fff00 0x7f005406a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:46:51.356 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:46:51.356+0000 7f005ad4f700 1 --2- 172.21.15.76:0/3868969346 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0054101060 0x7f005419bbf0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:46:51.357 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:46:51.356+0000 7f005ad4f700 1 -- 172.21.15.76:0/3868969346 >> 172.21.15.76:0/3868969346 conn(0x7f00540fb4a0 msgr2=0x7f0054104470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:46:51.357 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:46:51.356+0000 7f005ad4f700 1 -- 172.21.15.76:0/3868969346 shutdown_connections 2024-06-02T04:46:51.357 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:46:51.356+0000 7f005ad4f700 1 -- 172.21.15.76:0/3868969346 wait complete. 2024-06-02T04:46:51.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:51 smithi119 ceph-mon[46633]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-06-02T04:46:51.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:51 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:46:51.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:51 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:46:51.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:51 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:46:51.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:51 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:46:51.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:51 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:46:51.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:51 smithi192 ceph-mon[47933]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-06-02T04:46:51.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:51 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:46:51.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:51 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:46:51.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:51 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:46:51.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:51 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:46:51.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:51 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:46:51.735 DEBUG:teuthology.orchestra.run.smithi076:osd.9> sudo journalctl -f -n 0 -u ceph-60ab6d30-209a-11ef-bc9b-c7b262605968@osd.9.service 2024-06-02T04:46:51.737 INFO:tasks.cephadm:Deploying osd.10 on smithi119 with /dev/vg_nvme/lv_1... 2024-06-02T04:46:51.737 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 60ab6d30-209a-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-06-02T04:46:51.769 INFO:journalctl@ceph.osd.9.smithi076.stdout:-- Logs begin at Sun 2024-06-02 04:26:13 UTC. -- 2024-06-02T04:46:51.981 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/mon.b/config 2024-06-02T04:46:52.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:52 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:46:52.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:52 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:46:52.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:52 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:46:52.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:52 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:46:52.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:52 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:46:52.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:52 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:46:52.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:52 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:46:52.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:52 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:46:52.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:52 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:46:53.234 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 04:46:52 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T04:46:52.963+0000 7f41dc5f47c0 -1 osd.9 0 log_to_monitors true 2024-06-02T04:46:53.305 INFO:teuthology.orchestra.run.smithi119.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-06-02T04:46:53.305 INFO:teuthology.orchestra.run.smithi119.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-06-02T04:46:53.305 INFO:teuthology.orchestra.run.smithi119.stderr: stderr: 10+0 records in 2024-06-02T04:46:53.305 INFO:teuthology.orchestra.run.smithi119.stderr:10+0 records out 2024-06-02T04:46:53.305 INFO:teuthology.orchestra.run.smithi119.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0111209 s, 943 MB/s 2024-06-02T04:46:53.305 INFO:teuthology.orchestra.run.smithi119.stderr:--> Zapping successful for: 2024-06-02T04:46:53.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:53 smithi119 ceph-mon[46633]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-06-02T04:46:53.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:53 smithi119 ceph-mon[46633]: from='osd.9 [v2:172.21.15.76:6826/3095501821,v1:172.21.15.76:6827/3095501821]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-06-02T04:46:53.631 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 60ab6d30-209a-11ef-bc9b-c7b262605968 -- ceph orch daemon add osd smithi119:vg_nvme/lv_1 2024-06-02T04:46:53.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:53 smithi192 ceph-mon[47933]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-06-02T04:46:53.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:53 smithi192 ceph-mon[47933]: from='osd.9 [v2:172.21.15.76:6826/3095501821,v1:172.21.15.76:6827/3095501821]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-06-02T04:46:53.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:53 smithi076 ceph-mon[42935]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-06-02T04:46:53.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:53 smithi076 ceph-mon[42935]: from='osd.9 [v2:172.21.15.76:6826/3095501821,v1:172.21.15.76:6827/3095501821]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-06-02T04:46:53.850 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/mon.b/config 2024-06-02T04:46:54.580 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:54 smithi119 ceph-mon[46633]: from='osd.9 [v2:172.21.15.76:6826/3095501821,v1:172.21.15.76:6827/3095501821]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-06-02T04:46:54.580 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:54 smithi119 ceph-mon[46633]: osdmap e58: 10 total, 9 up, 10 in 2024-06-02T04:46:54.580 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:54 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-02T04:46:54.580 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:54 smithi119 ceph-mon[46633]: from='osd.9 [v2:172.21.15.76:6826/3095501821,v1:172.21.15.76:6827/3095501821]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi076", "root=default"]}]: dispatch 2024-06-02T04:46:54.580 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:54 smithi119 ceph-mon[46633]: Detected new or changed devices on smithi076 2024-06-02T04:46:54.581 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:54 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:46:54.581 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:54 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:46:54.581 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:54 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:46:54.581 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:54 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:46:54.581 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:54 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:46:54.581 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:54 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:46:54.581 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:54 smithi119 ceph-mon[46633]: Adjusting osd_memory_target on smithi076 to 4278M 2024-06-02T04:46:54.581 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:54 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:46:54.581 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:54 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:46:54.581 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:54 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:46:54.581 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:54 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:46:54.581 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:54 smithi119 ceph-mon[46633]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-06-02T04:46:54.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:54 smithi192 ceph-mon[47933]: from='osd.9 [v2:172.21.15.76:6826/3095501821,v1:172.21.15.76:6827/3095501821]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-06-02T04:46:54.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:54 smithi192 ceph-mon[47933]: osdmap e58: 10 total, 9 up, 10 in 2024-06-02T04:46:54.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:54 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-02T04:46:54.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:54 smithi192 ceph-mon[47933]: from='osd.9 [v2:172.21.15.76:6826/3095501821,v1:172.21.15.76:6827/3095501821]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi076", "root=default"]}]: dispatch 2024-06-02T04:46:54.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:54 smithi192 ceph-mon[47933]: Detected new or changed devices on smithi076 2024-06-02T04:46:54.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:54 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:46:54.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:54 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:46:54.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:54 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:46:54.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:54 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:46:54.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:54 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:46:54.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:54 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:46:54.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:54 smithi192 ceph-mon[47933]: Adjusting osd_memory_target on smithi076 to 4278M 2024-06-02T04:46:54.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:54 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:46:54.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:54 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:46:54.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:54 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:46:54.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:54 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:46:54.683 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:54 smithi192 ceph-mon[47933]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-06-02T04:46:54.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:54 smithi076 ceph-mon[42935]: from='osd.9 [v2:172.21.15.76:6826/3095501821,v1:172.21.15.76:6827/3095501821]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-06-02T04:46:54.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:54 smithi076 ceph-mon[42935]: osdmap e58: 10 total, 9 up, 10 in 2024-06-02T04:46:54.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:54 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-02T04:46:54.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:54 smithi076 ceph-mon[42935]: from='osd.9 [v2:172.21.15.76:6826/3095501821,v1:172.21.15.76:6827/3095501821]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi076", "root=default"]}]: dispatch 2024-06-02T04:46:54.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:54 smithi076 ceph-mon[42935]: Detected new or changed devices on smithi076 2024-06-02T04:46:54.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:54 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:46:54.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:54 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:46:54.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:54 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:46:54.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:54 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:46:54.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:54 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:46:54.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:54 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:46:54.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:54 smithi076 ceph-mon[42935]: Adjusting osd_memory_target on smithi076 to 4278M 2024-06-02T04:46:54.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:54 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:46:54.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:54 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:46:54.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:54 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:46:54.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:54 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:46:54.735 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:54 smithi076 ceph-mon[42935]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-06-02T04:46:54.750 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:46:54.750+0000 7f795c9d2700 1 -- 172.21.15.119:0/1035793115 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f79581043c0 msgr2=0x7f79581067b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:46:54.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:46:54.750+0000 7f795c9d2700 1 --2- 172.21.15.119:0/1035793115 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f79581043c0 0x7f79581067b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f7948009990 tx=0x7f7948009ca0 comp rx=0 tx=0).stop 2024-06-02T04:46:54.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:46:54.750+0000 7f795c9d2700 1 -- 172.21.15.119:0/1035793115 shutdown_connections 2024-06-02T04:46:54.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:46:54.750+0000 7f795c9d2700 1 --2- 172.21.15.119:0/1035793115 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7958106cf0 0x7f7958109160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:46:54.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:46:54.750+0000 7f795c9d2700 1 --2- 172.21.15.119:0/1035793115 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7958101a90 0x7f7958103e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:46:54.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:46:54.750+0000 7f795c9d2700 1 --2- 172.21.15.119:0/1035793115 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f79581043c0 0x7f79581067b0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:46:54.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:46:54.750+0000 7f795c9d2700 1 -- 172.21.15.119:0/1035793115 >> 172.21.15.119:0/1035793115 conn(0x7f79580fb4a0 msgr2=0x7f79580fd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:46:54.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:46:54.750+0000 7f795c9d2700 1 -- 172.21.15.119:0/1035793115 shutdown_connections 2024-06-02T04:46:54.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:46:54.750+0000 7f795c9d2700 1 -- 172.21.15.119:0/1035793115 wait complete. 2024-06-02T04:46:54.753 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:46:54.751+0000 7f795c9d2700 1 Processor -- start 2024-06-02T04:46:54.753 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:46:54.751+0000 7f795c9d2700 1 -- start start 2024-06-02T04:46:54.753 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:46:54.751+0000 7f795c9d2700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7958101a90 0x7f7958196f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:46:54.753 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:46:54.751+0000 7f795c9d2700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f79581043c0 0x7f7958197480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:46:54.753 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:46:54.751+0000 7f795c9d2700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7958106cf0 0x7f795819e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:46:54.753 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:46:54.751+0000 7f795c9d2700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f795819ea80 con 0x7f79581043c0 2024-06-02T04:46:54.753 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:46:54.751+0000 7f795c9d2700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f795819ebc0 con 0x7f7958101a90 2024-06-02T04:46:54.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:46:54.751+0000 7f795c9d2700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f795819ed50 con 0x7f7958106cf0 2024-06-02T04:46:54.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:46:54.751+0000 7f795659c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7958101a90 0x7f7958196f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:46:54.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:46:54.751+0000 7f795659c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7958101a90 0x7f7958196f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:48862/0 (socket says 172.21.15.119:48862) 2024-06-02T04:46:54.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:46:54.751+0000 7f795659c700 1 -- 172.21.15.119:0/456322832 learned_addr learned my addr 172.21.15.119:0/456322832 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-06-02T04:46:54.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:46:54.751+0000 7f7955d9b700 1 --2- 172.21.15.119:0/456322832 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f79581043c0 0x7f7958197480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:46:54.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:46:54.751+0000 7f7956d9d700 1 --2- 172.21.15.119:0/456322832 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7958106cf0 0x7f795819e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:46:54.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:46:54.751+0000 7f795659c700 1 -- 172.21.15.119:0/456322832 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7958106cf0 msgr2=0x7f795819e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:46:54.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:46:54.751+0000 7f795659c700 1 --2- 172.21.15.119:0/456322832 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7958106cf0 0x7f795819e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:46:54.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:46:54.751+0000 7f795659c700 1 -- 172.21.15.119:0/456322832 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f79581043c0 msgr2=0x7f7958197480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:46:54.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:46:54.751+0000 7f795659c700 1 --2- 172.21.15.119:0/456322832 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f79581043c0 0x7f7958197480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:46:54.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:46:54.751+0000 7f795659c700 1 -- 172.21.15.119:0/456322832 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79480095f0 con 0x7f7958101a90 2024-06-02T04:46:54.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:46:54.751+0000 7f7956d9d700 1 --2- 172.21.15.119:0/456322832 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7958106cf0 0x7f795819e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:46:54.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:46:54.752+0000 7f795659c700 1 --2- 172.21.15.119:0/456322832 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7958101a90 0x7f7958196f40 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f794c00b530 tx=0x7f794c00b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:46:54.755 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:46:54.752+0000 7f79477fe700 1 -- 172.21.15.119:0/456322832 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f794c011830 con 0x7f7958101a90 2024-06-02T04:46:54.755 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:46:54.752+0000 7f795c9d2700 1 -- 172.21.15.119:0/456322832 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f795819efd0 con 0x7f7958101a90 2024-06-02T04:46:54.755 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:46:54.752+0000 7f79477fe700 1 -- 172.21.15.119:0/456322832 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f794c011e20 con 0x7f7958101a90 2024-06-02T04:46:54.755 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:46:54.752+0000 7f79477fe700 1 -- 172.21.15.119:0/456322832 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f794c00f2e0 con 0x7f7958101a90 2024-06-02T04:46:54.755 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:46:54.752+0000 7f795c9d2700 1 -- 172.21.15.119:0/456322832 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f795819f490 con 0x7f7958101a90 2024-06-02T04:46:54.755 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:46:54.753+0000 7f795c9d2700 1 -- 172.21.15.119:0/456322832 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79580fd020 con 0x7f7958101a90 2024-06-02T04:46:54.756 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:46:54.754+0000 7f79477fe700 1 -- 172.21.15.119:0/456322832 <== mon.2 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f794c011990 con 0x7f7958101a90 2024-06-02T04:46:54.756 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:46:54.754+0000 7f79477fe700 1 --2- 172.21.15.119:0/456322832 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f79400a1120 0x7f79400a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:46:54.756 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:46:54.755+0000 7f79477fe700 1 -- 172.21.15.119:0/456322832 <== mon.2 v2:172.21.15.119:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5981+0+0 (secure 0 0 0) 0x7f794c0cbe80 con 0x7f7958101a90 2024-06-02T04:46:54.756 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:46:54.755+0000 7f7955d9b700 1 --2- 172.21.15.119:0/456322832 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f79400a1120 0x7f79400a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:46:54.756 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:46:54.755+0000 7f7955d9b700 1 --2- 172.21.15.119:0/456322832 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f79400a1120 0x7f79400a35e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7948003780 tx=0x7f7948005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:46:54.758 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:46:54.758+0000 7f79477fe700 1 -- 172.21.15.119:0/456322832 <== mon.2 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f794c095f30 con 0x7f7958101a90 2024-06-02T04:46:54.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:46:54.961+0000 7f795c9d2700 1 -- 172.21.15.119:0/456322832 --> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f795802ce10 con 0x7f79400a1120 2024-06-02T04:46:55.233 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 04:46:54 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T04:46:54.785+0000 7f41d2459700 -1 osd.9 0 waiting for initial osdmap 2024-06-02T04:46:55.233 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 04:46:54 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T04:46:54.798+0000 7f41c9a45700 -1 osd.9 59 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-02T04:46:55.646 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:55 smithi119 ceph-mon[46633]: from='osd.9 [v2:172.21.15.76:6826/3095501821,v1:172.21.15.76:6827/3095501821]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi076", "root=default"]}]': finished 2024-06-02T04:46:55.646 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:55 smithi119 ceph-mon[46633]: osdmap e59: 10 total, 9 up, 10 in 2024-06-02T04:46:55.646 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:55 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-02T04:46:55.646 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:55 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-02T04:46:55.646 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:55 smithi119 ceph-mon[46633]: from='osd.9 [v2:172.21.15.76:6826/3095501821,v1:172.21.15.76:6827/3095501821]' entity='osd.9' 2024-06-02T04:46:55.646 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:55 smithi119 ceph-mon[46633]: from='client.24335 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:46:55.646 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:55 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T04:46:55.647 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:55 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T04:46:55.647 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:55 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:46:55.647 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:55 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-02T04:46:55.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:55 smithi192 ceph-mon[47933]: from='osd.9 [v2:172.21.15.76:6826/3095501821,v1:172.21.15.76:6827/3095501821]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi076", "root=default"]}]': finished 2024-06-02T04:46:55.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:55 smithi192 ceph-mon[47933]: osdmap e59: 10 total, 9 up, 10 in 2024-06-02T04:46:55.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:55 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-02T04:46:55.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:55 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-02T04:46:55.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:55 smithi192 ceph-mon[47933]: from='osd.9 [v2:172.21.15.76:6826/3095501821,v1:172.21.15.76:6827/3095501821]' entity='osd.9' 2024-06-02T04:46:55.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:55 smithi192 ceph-mon[47933]: from='client.24335 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:46:55.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:55 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T04:46:55.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:55 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T04:46:55.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:55 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:46:55.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:55 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-02T04:46:55.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:55 smithi076 ceph-mon[42935]: from='osd.9 [v2:172.21.15.76:6826/3095501821,v1:172.21.15.76:6827/3095501821]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi076", "root=default"]}]': finished 2024-06-02T04:46:55.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:55 smithi076 ceph-mon[42935]: osdmap e59: 10 total, 9 up, 10 in 2024-06-02T04:46:55.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:55 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-02T04:46:55.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:55 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-02T04:46:55.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:55 smithi076 ceph-mon[42935]: from='osd.9 [v2:172.21.15.76:6826/3095501821,v1:172.21.15.76:6827/3095501821]' entity='osd.9' 2024-06-02T04:46:55.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:55 smithi076 ceph-mon[42935]: from='client.24335 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:46:55.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:55 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T04:46:55.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:55 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T04:46:55.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:55 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:46:55.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:55 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-02T04:46:57.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:56 smithi119 ceph-mon[46633]: purged_snaps scrub starts 2024-06-02T04:46:57.097 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:56 smithi119 ceph-mon[46633]: purged_snaps scrub ok 2024-06-02T04:46:57.097 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:56 smithi119 ceph-mon[46633]: osd.9 [v2:172.21.15.76:6826/3095501821,v1:172.21.15.76:6827/3095501821] boot 2024-06-02T04:46:57.097 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:56 smithi119 ceph-mon[46633]: osdmap e60: 10 total, 10 up, 10 in 2024-06-02T04:46:57.097 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:56 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-02T04:46:57.097 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:56 smithi119 ceph-mon[46633]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-06-02T04:46:57.097 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:56 smithi119 ceph-mon[46633]: from='client.? 172.21.15.119:0/948537487' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e4b18e7e-bddf-4dd4-84f6-7902ea327cbe"}]: dispatch 2024-06-02T04:46:57.097 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:56 smithi119 ceph-mon[46633]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e4b18e7e-bddf-4dd4-84f6-7902ea327cbe"}]: dispatch 2024-06-02T04:46:57.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:56 smithi192 ceph-mon[47933]: purged_snaps scrub starts 2024-06-02T04:46:57.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:56 smithi192 ceph-mon[47933]: purged_snaps scrub ok 2024-06-02T04:46:57.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:56 smithi192 ceph-mon[47933]: osd.9 [v2:172.21.15.76:6826/3095501821,v1:172.21.15.76:6827/3095501821] boot 2024-06-02T04:46:57.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:56 smithi192 ceph-mon[47933]: osdmap e60: 10 total, 10 up, 10 in 2024-06-02T04:46:57.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:56 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-02T04:46:57.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:56 smithi192 ceph-mon[47933]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-06-02T04:46:57.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:56 smithi192 ceph-mon[47933]: from='client.? 172.21.15.119:0/948537487' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e4b18e7e-bddf-4dd4-84f6-7902ea327cbe"}]: dispatch 2024-06-02T04:46:57.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:56 smithi192 ceph-mon[47933]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e4b18e7e-bddf-4dd4-84f6-7902ea327cbe"}]: dispatch 2024-06-02T04:46:57.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:56 smithi076 ceph-mon[42935]: purged_snaps scrub starts 2024-06-02T04:46:57.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:56 smithi076 ceph-mon[42935]: purged_snaps scrub ok 2024-06-02T04:46:57.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:56 smithi076 ceph-mon[42935]: osd.9 [v2:172.21.15.76:6826/3095501821,v1:172.21.15.76:6827/3095501821] boot 2024-06-02T04:46:57.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:56 smithi076 ceph-mon[42935]: osdmap e60: 10 total, 10 up, 10 in 2024-06-02T04:46:57.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:56 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-02T04:46:57.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:56 smithi076 ceph-mon[42935]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-06-02T04:46:57.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:56 smithi076 ceph-mon[42935]: from='client.? 172.21.15.119:0/948537487' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e4b18e7e-bddf-4dd4-84f6-7902ea327cbe"}]: dispatch 2024-06-02T04:46:57.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:56 smithi076 ceph-mon[42935]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e4b18e7e-bddf-4dd4-84f6-7902ea327cbe"}]: dispatch 2024-06-02T04:46:58.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:57 smithi119 ceph-mon[46633]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e4b18e7e-bddf-4dd4-84f6-7902ea327cbe"}]': finished 2024-06-02T04:46:58.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:57 smithi119 ceph-mon[46633]: osdmap e61: 11 total, 10 up, 11 in 2024-06-02T04:46:58.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:57 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-02T04:46:58.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:57 smithi119 ceph-mon[46633]: from='client.? 172.21.15.119:0/633709758' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T04:46:58.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:57 smithi192 ceph-mon[47933]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e4b18e7e-bddf-4dd4-84f6-7902ea327cbe"}]': finished 2024-06-02T04:46:58.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:57 smithi192 ceph-mon[47933]: osdmap e61: 11 total, 10 up, 11 in 2024-06-02T04:46:58.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:57 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-02T04:46:58.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:57 smithi192 ceph-mon[47933]: from='client.? 172.21.15.119:0/633709758' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T04:46:58.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:57 smithi076 ceph-mon[42935]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e4b18e7e-bddf-4dd4-84f6-7902ea327cbe"}]': finished 2024-06-02T04:46:58.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:57 smithi076 ceph-mon[42935]: osdmap e61: 11 total, 10 up, 11 in 2024-06-02T04:46:58.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:57 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-02T04:46:58.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:57 smithi076 ceph-mon[42935]: from='client.? 172.21.15.119:0/633709758' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T04:46:59.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:46:58 smithi119 ceph-mon[46633]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-06-02T04:46:59.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:46:58 smithi192 ceph-mon[47933]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-06-02T04:46:59.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:46:58 smithi076 ceph-mon[42935]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-06-02T04:47:01.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:01 smithi076 ceph-mon[42935]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-06-02T04:47:01.485 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:01 smithi119 ceph-mon[46633]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-06-02T04:47:01.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:01 smithi192 ceph-mon[47933]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-06-02T04:47:03.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:03 smithi076 ceph-mon[42935]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-06-02T04:47:03.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:03 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-06-02T04:47:03.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:03 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:47:03.552 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:03 smithi119 ceph-mon[46633]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-06-02T04:47:03.553 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:03 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-06-02T04:47:03.553 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:03 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:47:03.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:03 smithi192 ceph-mon[47933]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-06-02T04:47:03.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:03 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-06-02T04:47:03.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:03 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:47:04.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:04 smithi076 ceph-mon[42935]: Deploying daemon osd.10 on smithi119 2024-06-02T04:47:04.539 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:04 smithi119 ceph-mon[46633]: Deploying daemon osd.10 on smithi119 2024-06-02T04:47:04.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:04 smithi192 ceph-mon[47933]: Deploying daemon osd.10 on smithi119 2024-06-02T04:47:05.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:05 smithi076 ceph-mon[42935]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-06-02T04:47:05.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:05 smithi119 ceph-mon[46633]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-06-02T04:47:05.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:05 smithi192 ceph-mon[47933]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-06-02T04:47:07.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:07 smithi076 ceph-mon[42935]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-06-02T04:47:07.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:07 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:07.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:07 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:07.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:07 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:47:07.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:07 smithi119 ceph-mon[46633]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-06-02T04:47:07.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:07 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:07.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:07 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:07.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:07 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:47:07.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:07 smithi192 ceph-mon[47933]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-06-02T04:47:07.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:07 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:07.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:07 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:07.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:07 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:47:08.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:47:08.662+0000 7f79477fe700 1 -- 172.21.15.119:0/456322832 <== mgr.14152 v2:172.21.15.76:6800/2591353090 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7f795802ce10 con 0x7f79400a1120 2024-06-02T04:47:09.067 INFO:teuthology.orchestra.run.smithi119.stdout:Created osd(s) 10 on host 'smithi119' 2024-06-02T04:47:09.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:47:08.665+0000 7f795c9d2700 1 -- 172.21.15.119:0/456322832 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f79400a1120 msgr2=0x7f79400a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:47:09.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:47:08.665+0000 7f795c9d2700 1 --2- 172.21.15.119:0/456322832 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f79400a1120 0x7f79400a35e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7948003780 tx=0x7f7948005fb0 comp rx=0 tx=0).stop 2024-06-02T04:47:09.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:47:08.665+0000 7f795c9d2700 1 -- 172.21.15.119:0/456322832 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7958101a90 msgr2=0x7f7958196f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:47:09.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:47:08.665+0000 7f795c9d2700 1 --2- 172.21.15.119:0/456322832 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7958101a90 0x7f7958196f40 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f794c00b530 tx=0x7f794c00b840 comp rx=0 tx=0).stop 2024-06-02T04:47:09.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:47:08.665+0000 7f795c9d2700 1 -- 172.21.15.119:0/456322832 shutdown_connections 2024-06-02T04:47:09.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:47:08.665+0000 7f795c9d2700 1 --2- 172.21.15.119:0/456322832 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7958106cf0 0x7f795819e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:09.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:47:08.665+0000 7f795c9d2700 1 --2- 172.21.15.119:0/456322832 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f79400a1120 0x7f79400a35e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:09.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:47:08.665+0000 7f795c9d2700 1 --2- 172.21.15.119:0/456322832 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7958101a90 0x7f7958196f40 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:09.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:47:08.665+0000 7f795c9d2700 1 --2- 172.21.15.119:0/456322832 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f79581043c0 0x7f7958197480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:09.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:47:08.665+0000 7f795c9d2700 1 -- 172.21.15.119:0/456322832 >> 172.21.15.119:0/456322832 conn(0x7f79580fb4a0 msgr2=0x7f7958102510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:47:09.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:47:08.665+0000 7f795c9d2700 1 -- 172.21.15.119:0/456322832 shutdown_connections 2024-06-02T04:47:09.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-06-02T04:47:08.665+0000 7f795c9d2700 1 -- 172.21.15.119:0/456322832 wait complete. 2024-06-02T04:47:09.107 DEBUG:teuthology.orchestra.run.smithi119:osd.10> sudo journalctl -f -n 0 -u ceph-60ab6d30-209a-11ef-bc9b-c7b262605968@osd.10.service 2024-06-02T04:47:09.109 INFO:tasks.cephadm:Deploying osd.11 on smithi192 with /dev/vg_nvme/lv_1... 2024-06-02T04:47:09.110 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 60ab6d30-209a-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-06-02T04:47:09.141 INFO:journalctl@ceph.osd.10.smithi119.stdout:-- Logs begin at Sun 2024-06-02 04:25:42 UTC. -- 2024-06-02T04:47:09.342 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/mon.c/config 2024-06-02T04:47:09.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:09 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:09.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:09 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:09.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:09 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:47:09.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:09 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:47:09.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:09 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:09.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:09 smithi119 ceph-mon[46633]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-06-02T04:47:09.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:09 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:09.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:09 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:09.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:09 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:47:09.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:09 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:09.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:09 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:09.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:09 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:47:09.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:09 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:47:09.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:09 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:09.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:09 smithi192 ceph-mon[47933]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-06-02T04:47:09.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:09 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:09.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:09 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:09.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:09 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:47:09.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:09 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:09.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:09 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:09.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:09 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:47:09.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:09 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:47:09.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:09 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:09.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:09 smithi076 ceph-mon[42935]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-06-02T04:47:09.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:09 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:09.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:09 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:09.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:09 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:47:10.657 INFO:teuthology.orchestra.run.smithi192.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-06-02T04:47:10.657 INFO:teuthology.orchestra.run.smithi192.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-06-02T04:47:10.657 INFO:teuthology.orchestra.run.smithi192.stderr: stderr: 10+0 records in 2024-06-02T04:47:10.657 INFO:teuthology.orchestra.run.smithi192.stderr:10+0 records out 2024-06-02T04:47:10.657 INFO:teuthology.orchestra.run.smithi192.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0112387 s, 933 MB/s 2024-06-02T04:47:10.658 INFO:teuthology.orchestra.run.smithi192.stderr:--> Zapping successful for: 2024-06-02T04:47:10.846 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 04:47:10 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T04:47:10.546+0000 7f6930b397c0 -1 osd.10 0 log_to_monitors true 2024-06-02T04:47:11.040 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 60ab6d30-209a-11ef-bc9b-c7b262605968 -- ceph orch daemon add osd smithi192:vg_nvme/lv_1 2024-06-02T04:47:11.265 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/mon.c/config 2024-06-02T04:47:11.401 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:11 smithi192 ceph-mon[47933]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-06-02T04:47:11.401 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:11 smithi192 ceph-mon[47933]: from='osd.10 [v2:172.21.15.119:6824/4082130894,v1:172.21.15.119:6825/4082130894]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-06-02T04:47:11.401 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:11 smithi192 ceph-mon[47933]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-06-02T04:47:11.401 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:11 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:11.401 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:11 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:11.401 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:11 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:47:11.401 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:11 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:47:11.401 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:11 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:47:11.401 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:11 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:47:11.401 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:11 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:11.402 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:11 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:47:11.402 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:11 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:47:11.402 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:11 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:11.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:11 smithi076 ceph-mon[42935]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-06-02T04:47:11.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:11 smithi076 ceph-mon[42935]: from='osd.10 [v2:172.21.15.119:6824/4082130894,v1:172.21.15.119:6825/4082130894]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-06-02T04:47:11.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:11 smithi076 ceph-mon[42935]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-06-02T04:47:11.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:11 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:11.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:11 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:11.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:11 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:47:11.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:11 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:47:11.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:11 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:47:11.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:11 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:47:11.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:11 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:11.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:11 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:47:11.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:11 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:47:11.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:11 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:11.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:11 smithi119 ceph-mon[46633]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-06-02T04:47:11.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:11 smithi119 ceph-mon[46633]: from='osd.10 [v2:172.21.15.119:6824/4082130894,v1:172.21.15.119:6825/4082130894]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-06-02T04:47:11.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:11 smithi119 ceph-mon[46633]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-06-02T04:47:11.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:11 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:11.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:11 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:11.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:11 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:47:11.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:11 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:47:11.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:11 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:47:11.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:11 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:47:11.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:11 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:11.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:11 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:47:11.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:11 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:47:11.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:11 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:12.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:47:12.239+0000 7f66156ec700 1 -- 172.21.15.192:0/2889599214 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6610073980 msgr2=0x7f6610073e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:47:12.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:47:12.239+0000 7f66156ec700 1 --2- 172.21.15.192:0/2889599214 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6610073980 0x7f6610073e00 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6600009990 tx=0x7f6600009ca0 comp rx=0 tx=0).stop 2024-06-02T04:47:12.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:47:12.239+0000 7f66156ec700 1 -- 172.21.15.192:0/2889599214 shutdown_connections 2024-06-02T04:47:12.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:47:12.239+0000 7f66156ec700 1 --2- 172.21.15.192:0/2889599214 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6610108ee0 0x7f661010b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:12.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:47:12.239+0000 7f66156ec700 1 --2- 172.21.15.192:0/2889599214 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6610074f50 0x7f66100733b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:12.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:47:12.239+0000 7f66156ec700 1 --2- 172.21.15.192:0/2889599214 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6610073980 0x7f6610073e00 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:12.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:47:12.239+0000 7f66156ec700 1 -- 172.21.15.192:0/2889599214 >> 172.21.15.192:0/2889599214 conn(0x7f66100fc580 msgr2=0x7f66100fe9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:47:12.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:47:12.239+0000 7f66156ec700 1 -- 172.21.15.192:0/2889599214 shutdown_connections 2024-06-02T04:47:12.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:47:12.239+0000 7f66156ec700 1 -- 172.21.15.192:0/2889599214 wait complete. 2024-06-02T04:47:12.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:47:12.240+0000 7f66156ec700 1 Processor -- start 2024-06-02T04:47:12.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:47:12.240+0000 7f66156ec700 1 -- start start 2024-06-02T04:47:12.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:47:12.240+0000 7f66156ec700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6610073980 0x7f6610199060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:47:12.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:47:12.240+0000 7f66156ec700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6610074f50 0x7f66101995a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:47:12.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:47:12.240+0000 7f66156ec700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6610108ee0 0x7f66101a05d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:47:12.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:47:12.240+0000 7f66156ec700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66101a0ba0 con 0x7f6610074f50 2024-06-02T04:47:12.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:47:12.240+0000 7f66156ec700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66101a0ce0 con 0x7f6610108ee0 2024-06-02T04:47:12.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:47:12.240+0000 7f66156ec700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66101a0e70 con 0x7f6610073980 2024-06-02T04:47:12.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:47:12.240+0000 7f660effd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6610073980 0x7f6610199060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:47:12.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:47:12.240+0000 7f660effd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6610073980 0x7f6610199060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:44012/0 (socket says 172.21.15.192:44012) 2024-06-02T04:47:12.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:47:12.240+0000 7f660effd700 1 -- 172.21.15.192:0/3811579331 learned_addr learned my addr 172.21.15.192:0/3811579331 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-06-02T04:47:12.244 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:47:12.240+0000 7f660f7fe700 1 --2- 172.21.15.192:0/3811579331 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6610108ee0 0x7f66101a05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:47:12.244 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:47:12.240+0000 7f660effd700 1 -- 172.21.15.192:0/3811579331 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6610108ee0 msgr2=0x7f66101a05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:47:12.244 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:47:12.241+0000 7f660effd700 1 --2- 172.21.15.192:0/3811579331 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6610108ee0 0x7f66101a05d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:12.244 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:47:12.241+0000 7f660effd700 1 -- 172.21.15.192:0/3811579331 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6610074f50 msgr2=0x7f66101995a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:47:12.244 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:47:12.241+0000 7f660effd700 1 --2- 172.21.15.192:0/3811579331 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6610074f50 0x7f66101995a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:12.244 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:47:12.241+0000 7f660effd700 1 -- 172.21.15.192:0/3811579331 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66000095f0 con 0x7f6610073980 2024-06-02T04:47:12.244 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:47:12.241+0000 7f660effd700 1 --2- 172.21.15.192:0/3811579331 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6610073980 0x7f6610199060 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f660400b560 tx=0x7f660400b870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:47:12.244 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:47:12.241+0000 7f65f7fff700 1 -- 172.21.15.192:0/3811579331 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6604011830 con 0x7f6610073980 2024-06-02T04:47:12.244 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:47:12.241+0000 7f65f7fff700 1 -- 172.21.15.192:0/3811579331 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6604011e20 con 0x7f6610073980 2024-06-02T04:47:12.244 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:47:12.241+0000 7f66156ec700 1 -- 172.21.15.192:0/3811579331 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66101a1150 con 0x7f6610073980 2024-06-02T04:47:12.244 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:47:12.241+0000 7f65f7fff700 1 -- 172.21.15.192:0/3811579331 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6604010dd0 con 0x7f6610073980 2024-06-02T04:47:12.244 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:47:12.241+0000 7f66156ec700 1 -- 172.21.15.192:0/3811579331 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66101a1650 con 0x7f6610073980 2024-06-02T04:47:12.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:47:12.242+0000 7f66156ec700 1 -- 172.21.15.192:0/3811579331 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6610107cf0 con 0x7f6610073980 2024-06-02T04:47:12.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:47:12.243+0000 7f65f7fff700 1 -- 172.21.15.192:0/3811579331 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f6604011990 con 0x7f6610073980 2024-06-02T04:47:12.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:47:12.243+0000 7f65f7fff700 1 --2- 172.21.15.192:0/3811579331 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f65f80a1120 0x7f65f80a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:47:12.246 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:47:12.244+0000 7f65f7fff700 1 -- 172.21.15.192:0/3811579331 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f66040cbc20 con 0x7f6610073980 2024-06-02T04:47:12.246 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:47:12.244+0000 7f660e7fc700 1 --2- 172.21.15.192:0/3811579331 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f65f80a1120 0x7f65f80a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:47:12.246 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:47:12.244+0000 7f660e7fc700 1 --2- 172.21.15.192:0/3811579331 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f65f80a1120 0x7f65f80a35e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f66000098e0 tx=0x7f6600000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:47:12.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:47:12.248+0000 7f65f7fff700 1 -- 172.21.15.192:0/3811579331 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f6604095b20 con 0x7f6610073980 2024-06-02T04:47:12.431 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:12 smithi192 ceph-mon[47933]: Detected new or changed devices on smithi119 2024-06-02T04:47:12.431 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:12 smithi192 ceph-mon[47933]: Adjusting osd_memory_target on smithi119 to 4278M 2024-06-02T04:47:12.431 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:12 smithi192 ceph-mon[47933]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-06-02T04:47:12.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:12 smithi192 ceph-mon[47933]: osdmap e62: 11 total, 10 up, 11 in 2024-06-02T04:47:12.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:12 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-02T04:47:12.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:12 smithi192 ceph-mon[47933]: from='osd.10 [v2:172.21.15.119:6824/4082130894,v1:172.21.15.119:6825/4082130894]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2024-06-02T04:47:12.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:12 smithi192 ceph-mon[47933]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2024-06-02T04:47:12.449 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:47:12.449+0000 7f66156ec700 1 -- 172.21.15.192:0/3811579331 --> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi192:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f661002ce10 con 0x7f65f80a1120 2024-06-02T04:47:12.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:12 smithi076 ceph-mon[42935]: Detected new or changed devices on smithi119 2024-06-02T04:47:12.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:12 smithi076 ceph-mon[42935]: Adjusting osd_memory_target on smithi119 to 4278M 2024-06-02T04:47:12.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:12 smithi076 ceph-mon[42935]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-06-02T04:47:12.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:12 smithi076 ceph-mon[42935]: osdmap e62: 11 total, 10 up, 11 in 2024-06-02T04:47:12.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:12 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-02T04:47:12.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:12 smithi076 ceph-mon[42935]: from='osd.10 [v2:172.21.15.119:6824/4082130894,v1:172.21.15.119:6825/4082130894]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2024-06-02T04:47:12.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:12 smithi076 ceph-mon[42935]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2024-06-02T04:47:12.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:12 smithi119 ceph-mon[46633]: Detected new or changed devices on smithi119 2024-06-02T04:47:12.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:12 smithi119 ceph-mon[46633]: Adjusting osd_memory_target on smithi119 to 4278M 2024-06-02T04:47:12.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:12 smithi119 ceph-mon[46633]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-06-02T04:47:12.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:12 smithi119 ceph-mon[46633]: osdmap e62: 11 total, 10 up, 11 in 2024-06-02T04:47:12.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:12 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-02T04:47:12.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:12 smithi119 ceph-mon[46633]: from='osd.10 [v2:172.21.15.119:6824/4082130894,v1:172.21.15.119:6825/4082130894]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2024-06-02T04:47:12.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:12 smithi119 ceph-mon[46633]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2024-06-02T04:47:13.096 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 04:47:12 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T04:47:12.669+0000 7f692619d700 -1 osd.10 0 waiting for initial osdmap 2024-06-02T04:47:13.096 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 04:47:12 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T04:47:12.681+0000 7f691df8a700 -1 osd.10 63 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-02T04:47:13.431 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:13 smithi192 ceph-mon[47933]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-06-02T04:47:13.431 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:13 smithi192 ceph-mon[47933]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]': finished 2024-06-02T04:47:13.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:13 smithi192 ceph-mon[47933]: osdmap e63: 11 total, 10 up, 11 in 2024-06-02T04:47:13.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:13 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-02T04:47:13.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:13 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-02T04:47:13.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:13 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T04:47:13.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:13 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T04:47:13.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:13 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:47:13.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:13 smithi192 ceph-mon[47933]: from='osd.10 ' entity='osd.10' 2024-06-02T04:47:13.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:13 smithi076 ceph-mon[42935]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-06-02T04:47:13.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:13 smithi076 ceph-mon[42935]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]': finished 2024-06-02T04:47:13.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:13 smithi076 ceph-mon[42935]: osdmap e63: 11 total, 10 up, 11 in 2024-06-02T04:47:13.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:13 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-02T04:47:13.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:13 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-02T04:47:13.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:13 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T04:47:13.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:13 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T04:47:13.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:13 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:47:13.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:13 smithi076 ceph-mon[42935]: from='osd.10 ' entity='osd.10' 2024-06-02T04:47:13.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:13 smithi119 ceph-mon[46633]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-06-02T04:47:13.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:13 smithi119 ceph-mon[46633]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]': finished 2024-06-02T04:47:13.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:13 smithi119 ceph-mon[46633]: osdmap e63: 11 total, 10 up, 11 in 2024-06-02T04:47:13.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:13 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-02T04:47:13.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:13 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-02T04:47:13.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:13 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T04:47:13.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:13 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T04:47:13.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:13 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:47:13.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:13 smithi119 ceph-mon[46633]: from='osd.10 ' entity='osd.10' 2024-06-02T04:47:14.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:14 smithi076 ceph-mon[42935]: purged_snaps scrub starts 2024-06-02T04:47:14.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:14 smithi076 ceph-mon[42935]: purged_snaps scrub ok 2024-06-02T04:47:14.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:14 smithi076 ceph-mon[42935]: from='client.24367 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi192:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:47:14.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:14 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-02T04:47:14.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:14 smithi076 ceph-mon[42935]: osd.10 [v2:172.21.15.119:6824/4082130894,v1:172.21.15.119:6825/4082130894] boot 2024-06-02T04:47:14.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:14 smithi076 ceph-mon[42935]: osdmap e64: 11 total, 11 up, 11 in 2024-06-02T04:47:14.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:14 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-02T04:47:14.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:14 smithi119 ceph-mon[46633]: purged_snaps scrub starts 2024-06-02T04:47:14.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:14 smithi119 ceph-mon[46633]: purged_snaps scrub ok 2024-06-02T04:47:14.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:14 smithi119 ceph-mon[46633]: from='client.24367 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi192:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:47:14.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:14 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-02T04:47:14.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:14 smithi119 ceph-mon[46633]: osd.10 [v2:172.21.15.119:6824/4082130894,v1:172.21.15.119:6825/4082130894] boot 2024-06-02T04:47:14.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:14 smithi119 ceph-mon[46633]: osdmap e64: 11 total, 11 up, 11 in 2024-06-02T04:47:14.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:14 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-02T04:47:14.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:14 smithi192 ceph-mon[47933]: purged_snaps scrub starts 2024-06-02T04:47:14.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:14 smithi192 ceph-mon[47933]: purged_snaps scrub ok 2024-06-02T04:47:14.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:14 smithi192 ceph-mon[47933]: from='client.24367 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi192:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:47:14.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:14 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-02T04:47:14.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:14 smithi192 ceph-mon[47933]: osd.10 [v2:172.21.15.119:6824/4082130894,v1:172.21.15.119:6825/4082130894] boot 2024-06-02T04:47:14.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:14 smithi192 ceph-mon[47933]: osdmap e64: 11 total, 11 up, 11 in 2024-06-02T04:47:14.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:14 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-02T04:47:15.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:15 smithi076 ceph-mon[42935]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-06-02T04:47:15.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:15 smithi076 ceph-mon[42935]: osdmap e65: 11 total, 11 up, 11 in 2024-06-02T04:47:15.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:15 smithi076 ceph-mon[42935]: from='client.? 172.21.15.192:0/821909775' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "54567e18-920c-4ae9-9557-0efba5a1a820"}]: dispatch 2024-06-02T04:47:15.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:15 smithi076 ceph-mon[42935]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "54567e18-920c-4ae9-9557-0efba5a1a820"}]: dispatch 2024-06-02T04:47:15.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:15 smithi076 ceph-mon[42935]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "54567e18-920c-4ae9-9557-0efba5a1a820"}]': finished 2024-06-02T04:47:15.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:15 smithi076 ceph-mon[42935]: osdmap e66: 12 total, 11 up, 12 in 2024-06-02T04:47:15.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:15 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-02T04:47:15.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:15 smithi076 ceph-mon[42935]: osdmap e67: 12 total, 11 up, 12 in 2024-06-02T04:47:15.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:15 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-02T04:47:15.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:15 smithi076 ceph-mon[42935]: from='client.? 172.21.15.192:0/135721747' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T04:47:15.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:15 smithi119 ceph-mon[46633]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-06-02T04:47:15.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:15 smithi119 ceph-mon[46633]: osdmap e65: 11 total, 11 up, 11 in 2024-06-02T04:47:15.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:15 smithi119 ceph-mon[46633]: from='client.? 172.21.15.192:0/821909775' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "54567e18-920c-4ae9-9557-0efba5a1a820"}]: dispatch 2024-06-02T04:47:15.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:15 smithi119 ceph-mon[46633]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "54567e18-920c-4ae9-9557-0efba5a1a820"}]: dispatch 2024-06-02T04:47:15.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:15 smithi119 ceph-mon[46633]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "54567e18-920c-4ae9-9557-0efba5a1a820"}]': finished 2024-06-02T04:47:15.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:15 smithi119 ceph-mon[46633]: osdmap e66: 12 total, 11 up, 12 in 2024-06-02T04:47:15.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:15 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-02T04:47:15.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:15 smithi119 ceph-mon[46633]: osdmap e67: 12 total, 11 up, 12 in 2024-06-02T04:47:15.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:15 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-02T04:47:15.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:15 smithi119 ceph-mon[46633]: from='client.? 172.21.15.192:0/135721747' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T04:47:15.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:15 smithi192 ceph-mon[47933]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-06-02T04:47:15.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:15 smithi192 ceph-mon[47933]: osdmap e65: 11 total, 11 up, 11 in 2024-06-02T04:47:15.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:15 smithi192 ceph-mon[47933]: from='client.? 172.21.15.192:0/821909775' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "54567e18-920c-4ae9-9557-0efba5a1a820"}]: dispatch 2024-06-02T04:47:15.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:15 smithi192 ceph-mon[47933]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "54567e18-920c-4ae9-9557-0efba5a1a820"}]: dispatch 2024-06-02T04:47:15.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:15 smithi192 ceph-mon[47933]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "54567e18-920c-4ae9-9557-0efba5a1a820"}]': finished 2024-06-02T04:47:15.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:15 smithi192 ceph-mon[47933]: osdmap e66: 12 total, 11 up, 12 in 2024-06-02T04:47:15.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:15 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-02T04:47:15.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:15 smithi192 ceph-mon[47933]: osdmap e67: 12 total, 11 up, 12 in 2024-06-02T04:47:15.683 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:15 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-02T04:47:15.683 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:15 smithi192 ceph-mon[47933]: from='client.? 172.21.15.192:0/135721747' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T04:47:16.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:16 smithi076 ceph-mon[42935]: osdmap e68: 12 total, 11 up, 12 in 2024-06-02T04:47:16.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:16 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-02T04:47:16.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:16 smithi076 ceph-mon[42935]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-06-02T04:47:17.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:16 smithi119 ceph-mon[46633]: osdmap e68: 12 total, 11 up, 12 in 2024-06-02T04:47:17.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:16 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-02T04:47:17.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:16 smithi119 ceph-mon[46633]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-06-02T04:47:17.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:16 smithi192 ceph-mon[47933]: osdmap e68: 12 total, 11 up, 12 in 2024-06-02T04:47:17.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:16 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-02T04:47:17.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:16 smithi192 ceph-mon[47933]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-06-02T04:47:19.350 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:19 smithi192 ceph-mon[47933]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-06-02T04:47:19.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:19 smithi076 ceph-mon[42935]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-06-02T04:47:19.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:19 smithi119 ceph-mon[46633]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-06-02T04:47:20.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:20 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-06-02T04:47:20.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:20 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:47:20.531 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:20 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-06-02T04:47:20.531 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:20 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:47:20.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:20 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-06-02T04:47:20.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:20 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:47:21.318 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:21 smithi192 ceph-mon[47933]: Deploying daemon osd.11 on smithi192 2024-06-02T04:47:21.318 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:21 smithi192 ceph-mon[47933]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-06-02T04:47:21.486 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:21 smithi076 ceph-mon[42935]: Deploying daemon osd.11 on smithi192 2024-06-02T04:47:21.487 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:21 smithi076 ceph-mon[42935]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-06-02T04:47:21.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:21 smithi119 ceph-mon[46633]: Deploying daemon osd.11 on smithi192 2024-06-02T04:47:21.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:21 smithi119 ceph-mon[46633]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-06-02T04:47:23.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:23 smithi192 ceph-mon[47933]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-06-02T04:47:23.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:23 smithi076 ceph-mon[42935]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-06-02T04:47:23.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:23 smithi119 ceph-mon[46633]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-06-02T04:47:24.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:24 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:24.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:24 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:24.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:24 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:47:24.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:24 smithi192 ceph-mon[47933]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-06-02T04:47:25.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:24 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:25.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:24 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:25.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:24 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:47:25.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:24 smithi119 ceph-mon[46633]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-06-02T04:47:25.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:24 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:25.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:24 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:25.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:24 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:47:25.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:24 smithi076 ceph-mon[42935]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-06-02T04:47:25.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:47:25.849+0000 7f65f7fff700 1 -- 172.21.15.192:0/3811579331 <== mgr.14152 v2:172.21.15.76:6800/2591353090 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7f661002ce10 con 0x7f65f80a1120 2024-06-02T04:47:25.850 INFO:teuthology.orchestra.run.smithi192.stdout:Created osd(s) 11 on host 'smithi192' 2024-06-02T04:47:25.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:47:25.852+0000 7f66156ec700 1 -- 172.21.15.192:0/3811579331 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f65f80a1120 msgr2=0x7f65f80a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:47:25.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:47:25.852+0000 7f66156ec700 1 --2- 172.21.15.192:0/3811579331 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f65f80a1120 0x7f65f80a35e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f66000098e0 tx=0x7f6600000bc0 comp rx=0 tx=0).stop 2024-06-02T04:47:25.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:47:25.852+0000 7f66156ec700 1 -- 172.21.15.192:0/3811579331 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6610073980 msgr2=0x7f6610199060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:47:25.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:47:25.852+0000 7f66156ec700 1 --2- 172.21.15.192:0/3811579331 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6610073980 0x7f6610199060 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f660400b560 tx=0x7f660400b870 comp rx=0 tx=0).stop 2024-06-02T04:47:25.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:47:25.852+0000 7f66156ec700 1 -- 172.21.15.192:0/3811579331 shutdown_connections 2024-06-02T04:47:25.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:47:25.852+0000 7f66156ec700 1 --2- 172.21.15.192:0/3811579331 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f65f80a1120 0x7f65f80a35e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:25.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:47:25.852+0000 7f66156ec700 1 --2- 172.21.15.192:0/3811579331 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6610108ee0 0x7f66101a05d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:25.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:47:25.852+0000 7f66156ec700 1 --2- 172.21.15.192:0/3811579331 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6610073980 0x7f6610199060 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:25.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:47:25.852+0000 7f66156ec700 1 --2- 172.21.15.192:0/3811579331 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6610074f50 0x7f66101995a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:25.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:47:25.852+0000 7f66156ec700 1 -- 172.21.15.192:0/3811579331 >> 172.21.15.192:0/3811579331 conn(0x7f66100fc580 msgr2=0x7f6610104e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:47:25.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:47:25.852+0000 7f66156ec700 1 -- 172.21.15.192:0/3811579331 shutdown_connections 2024-06-02T04:47:25.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:47:25.852+0000 7f66156ec700 1 -- 172.21.15.192:0/3811579331 wait complete. 2024-06-02T04:47:26.235 DEBUG:teuthology.orchestra.run.smithi192:osd.11> sudo journalctl -f -n 0 -u ceph-60ab6d30-209a-11ef-bc9b-c7b262605968@osd.11.service 2024-06-02T04:47:26.237 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-06-02T04:47:26.237 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 60ab6d30-209a-11ef-bc9b-c7b262605968 -- ceph osd stat -f json 2024-06-02T04:47:26.269 INFO:journalctl@ceph.osd.11.smithi192.stdout:-- Logs begin at Sun 2024-06-02 04:25:37 UTC. -- 2024-06-02T04:47:26.431 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:26 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:26.431 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:26 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:26.431 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:26 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:47:26.431 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:26 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:47:26.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:26 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:26.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:26 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:26.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:26 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:26.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:26 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:47:26.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:26 smithi192 ceph-mon[47933]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-06-02T04:47:26.479 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T04:47:26.626 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:26 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:26.626 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:26 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:26.626 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:26 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:47:26.627 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:26 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:47:26.627 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:26 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:26.627 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:26 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:26.627 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:26 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:26.627 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:26 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:47:26.627 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:26 smithi076 ceph-mon[42935]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-06-02T04:47:26.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:26 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:26.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:26 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:26.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:26 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:47:26.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:26 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:47:26.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:26 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:26.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:26 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:26.847 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:26 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:26.847 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:26 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:47:26.847 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:26 smithi119 ceph-mon[46633]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-06-02T04:47:27.518 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:27.518+0000 7f07e4920700 1 -- 172.21.15.76:0/1910511067 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f07e0101a90 msgr2=0x7f07e0103e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:47:27.518 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:27.518+0000 7f07e4920700 1 --2- 172.21.15.76:0/1910511067 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f07e0101a90 0x7f07e0103e80 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f07d0009990 tx=0x7f07d0009ca0 comp rx=0 tx=0).stop 2024-06-02T04:47:27.518 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:27.518+0000 7f07e4920700 1 -- 172.21.15.76:0/1910511067 shutdown_connections 2024-06-02T04:47:27.518 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:27.518+0000 7f07e4920700 1 --2- 172.21.15.76:0/1910511067 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f07e0106cf0 0x7f07e0109160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:27.518 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:27.518+0000 7f07e4920700 1 --2- 172.21.15.76:0/1910511067 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f07e0101a90 0x7f07e0103e80 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:27.519 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:27.518+0000 7f07e4920700 1 --2- 172.21.15.76:0/1910511067 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07e01043c0 0x7f07e01067b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:27.519 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:27.518+0000 7f07e4920700 1 -- 172.21.15.76:0/1910511067 >> 172.21.15.76:0/1910511067 conn(0x7f07e00fb4a0 msgr2=0x7f07e00fd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:47:27.519 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:27.518+0000 7f07e4920700 1 -- 172.21.15.76:0/1910511067 shutdown_connections 2024-06-02T04:47:27.519 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:27.518+0000 7f07e4920700 1 -- 172.21.15.76:0/1910511067 wait complete. 2024-06-02T04:47:27.520 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:27.519+0000 7f07e4920700 1 Processor -- start 2024-06-02T04:47:27.520 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:27.519+0000 7f07e4920700 1 -- start start 2024-06-02T04:47:27.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:27.519+0000 7f07e4920700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f07e0101a90 0x7f07e0196e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:47:27.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:27.519+0000 7f07e4920700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f07e01043c0 0x7f07e0197340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:47:27.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:27.519+0000 7f07e4920700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07e0106cf0 0x7f07e019e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:47:27.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:27.519+0000 7f07e4920700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07e019e940 con 0x7f07e01043c0 2024-06-02T04:47:27.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:27.519+0000 7f07e4920700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07e019ea80 con 0x7f07e0106cf0 2024-06-02T04:47:27.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:27.519+0000 7f07e4920700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07e019ec10 con 0x7f07e0101a90 2024-06-02T04:47:27.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:27.519+0000 7f07ddd9b700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f07e01043c0 0x7f07e0197340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:47:27.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:27.519+0000 7f07ddd9b700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f07e01043c0 0x7f07e0197340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:43860/0 (socket says 172.21.15.76:43860) 2024-06-02T04:47:27.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:27.519+0000 7f07ddd9b700 1 -- 172.21.15.76:0/1630449483 learned_addr learned my addr 172.21.15.76:0/1630449483 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:47:27.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:27.519+0000 7f07de59c700 1 --2- 172.21.15.76:0/1630449483 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f07e0101a90 0x7f07e0196e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:47:27.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:27.519+0000 7f07ded9d700 1 --2- 172.21.15.76:0/1630449483 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07e0106cf0 0x7f07e019e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:47:27.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:27.519+0000 7f07ddd9b700 1 -- 172.21.15.76:0/1630449483 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f07e0101a90 msgr2=0x7f07e0196e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:47:27.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:27.519+0000 7f07ddd9b700 1 --2- 172.21.15.76:0/1630449483 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f07e0101a90 0x7f07e0196e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:27.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:27.519+0000 7f07ddd9b700 1 -- 172.21.15.76:0/1630449483 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07e0106cf0 msgr2=0x7f07e019e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:47:27.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:27.519+0000 7f07ddd9b700 1 --2- 172.21.15.76:0/1630449483 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07e0106cf0 0x7f07e019e370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:27.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:27.519+0000 7f07ddd9b700 1 -- 172.21.15.76:0/1630449483 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07d00095f0 con 0x7f07e01043c0 2024-06-02T04:47:27.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:27.520+0000 7f07ddd9b700 1 --2- 172.21.15.76:0/1630449483 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f07e01043c0 0x7f07e0197340 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f07d400c9e0 tx=0x7f07d400ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:47:27.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:27.520+0000 7f07cf7fe700 1 -- 172.21.15.76:0/1630449483 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d4007ac0 con 0x7f07e01043c0 2024-06-02T04:47:27.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:27.520+0000 7f07e4920700 1 -- 172.21.15.76:0/1630449483 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07e019eef0 con 0x7f07e01043c0 2024-06-02T04:47:27.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:27.520+0000 7f07cf7fe700 1 -- 172.21.15.76:0/1630449483 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f07d4007c20 con 0x7f07e01043c0 2024-06-02T04:47:27.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:27.520+0000 7f07cf7fe700 1 -- 172.21.15.76:0/1630449483 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d4018660 con 0x7f07e01043c0 2024-06-02T04:47:27.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:27.520+0000 7f07e4920700 1 -- 172.21.15.76:0/1630449483 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07e019f360 con 0x7f07e01043c0 2024-06-02T04:47:27.523 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:27.521+0000 7f07e4920700 1 -- 172.21.15.76:0/1630449483 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07e00fd020 con 0x7f07e01043c0 2024-06-02T04:47:27.523 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:27.522+0000 7f07cf7fe700 1 -- 172.21.15.76:0/1630449483 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f07d400f450 con 0x7f07e01043c0 2024-06-02T04:47:27.523 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:27.522+0000 7f07cf7fe700 1 --2- 172.21.15.76:0/1630449483 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f07c80a1120 0x7f07c80a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:47:27.523 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:27.522+0000 7f07de59c700 1 --2- 172.21.15.76:0/1630449483 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f07c80a1120 0x7f07c80a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:47:27.523 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:27.522+0000 7f07cf7fe700 1 -- 172.21.15.76:0/1630449483 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f07d40cc280 con 0x7f07e01043c0 2024-06-02T04:47:27.523 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:27.523+0000 7f07de59c700 1 --2- 172.21.15.76:0/1630449483 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f07c80a1120 0x7f07c80a35e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f07d0006010 tx=0x7f07d000b610 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:47:27.527 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:27.527+0000 7f07cf7fe700 1 -- 172.21.15.76:0/1630449483 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f07d4095ff0 con 0x7f07e01043c0 2024-06-02T04:47:27.718 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:27.718+0000 7f07e4920700 1 -- 172.21.15.76:0/1630449483 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f07e004ec60 con 0x7f07e01043c0 2024-06-02T04:47:27.719 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:27.718+0000 7f07cf7fe700 1 -- 172.21.15.76:0/1630449483 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v68) v1 ==== 74+0+133 (secure 0 0 0) 0x7f07d400fe60 con 0x7f07e01043c0 2024-06-02T04:47:27.719 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:47:27.721 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:27.720+0000 7f07e4920700 1 -- 172.21.15.76:0/1630449483 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f07c80a1120 msgr2=0x7f07c80a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:47:27.721 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:27.720+0000 7f07e4920700 1 --2- 172.21.15.76:0/1630449483 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f07c80a1120 0x7f07c80a35e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f07d0006010 tx=0x7f07d000b610 comp rx=0 tx=0).stop 2024-06-02T04:47:27.721 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:27.720+0000 7f07e4920700 1 -- 172.21.15.76:0/1630449483 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f07e01043c0 msgr2=0x7f07e0197340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:47:27.721 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:27.720+0000 7f07e4920700 1 --2- 172.21.15.76:0/1630449483 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f07e01043c0 0x7f07e0197340 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f07d400c9e0 tx=0x7f07d400ccf0 comp rx=0 tx=0).stop 2024-06-02T04:47:27.721 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:27.720+0000 7f07e4920700 1 -- 172.21.15.76:0/1630449483 shutdown_connections 2024-06-02T04:47:27.721 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:27.720+0000 7f07e4920700 1 --2- 172.21.15.76:0/1630449483 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f07c80a1120 0x7f07c80a35e0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:27.721 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:27.720+0000 7f07e4920700 1 --2- 172.21.15.76:0/1630449483 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07e0106cf0 0x7f07e019e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:27.721 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:27.720+0000 7f07e4920700 1 --2- 172.21.15.76:0/1630449483 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f07e0101a90 0x7f07e0196e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:27.721 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:27.720+0000 7f07e4920700 1 --2- 172.21.15.76:0/1630449483 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f07e01043c0 0x7f07e0197340 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:27.721 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:27.720+0000 7f07e4920700 1 -- 172.21.15.76:0/1630449483 >> 172.21.15.76:0/1630449483 conn(0x7f07e00fb4a0 msgr2=0x7f07e0102590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:47:27.721 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:27.720+0000 7f07e4920700 1 -- 172.21.15.76:0/1630449483 shutdown_connections 2024-06-02T04:47:27.721 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:27.720+0000 7f07e4920700 1 -- 172.21.15.76:0/1630449483 wait complete. 2024-06-02T04:47:28.037 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:27 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/1630449483' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-06-02T04:47:28.037 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:27 smithi076 ceph-mon[42935]: from='osd.11 [v2:172.21.15.192:6824/439693921,v1:172.21.15.192:6825/439693921]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-06-02T04:47:28.037 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:27 smithi076 ceph-mon[42935]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-06-02T04:47:28.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:27 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/1630449483' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-06-02T04:47:28.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:27 smithi119 ceph-mon[46633]: from='osd.11 [v2:172.21.15.192:6824/439693921,v1:172.21.15.192:6825/439693921]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-06-02T04:47:28.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:27 smithi119 ceph-mon[46633]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-06-02T04:47:28.104 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":68,"num_osds":12,"num_up_osds":11,"osd_up_since":1717303633,"num_in_osds":12,"osd_in_since":1717303634,"num_remapped_pgs":0} 2024-06-02T04:47:28.107 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 04:47:27 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T04:47:27.794+0000 7f96398e67c0 -1 osd.11 0 log_to_monitors true 2024-06-02T04:47:28.107 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:27 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/1630449483' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-06-02T04:47:28.107 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:27 smithi192 ceph-mon[47933]: from='osd.11 [v2:172.21.15.192:6824/439693921,v1:172.21.15.192:6825/439693921]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-06-02T04:47:28.107 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:27 smithi192 ceph-mon[47933]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-06-02T04:47:29.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:28 smithi119 ceph-mon[46633]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-06-02T04:47:29.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:28 smithi119 ceph-mon[46633]: osdmap e69: 12 total, 11 up, 12 in 2024-06-02T04:47:29.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:28 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-02T04:47:29.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:28 smithi119 ceph-mon[46633]: from='osd.11 [v2:172.21.15.192:6824/439693921,v1:172.21.15.192:6825/439693921]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]: dispatch 2024-06-02T04:47:29.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:28 smithi119 ceph-mon[46633]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]: dispatch 2024-06-02T04:47:29.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:28 smithi119 ceph-mon[46633]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-06-02T04:47:29.097 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:28 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:29.097 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:28 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:29.097 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:28 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:47:29.097 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:28 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:47:29.097 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:28 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:47:29.097 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:28 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:47:29.097 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:28 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:29.097 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:28 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:47:29.097 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:28 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:47:29.097 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:28 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:29.106 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 60ab6d30-209a-11ef-bc9b-c7b262605968 -- ceph osd stat -f json 2024-06-02T04:47:29.135 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:28 smithi076 ceph-mon[42935]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-06-02T04:47:29.135 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:28 smithi076 ceph-mon[42935]: osdmap e69: 12 total, 11 up, 12 in 2024-06-02T04:47:29.135 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:28 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-02T04:47:29.135 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:28 smithi076 ceph-mon[42935]: from='osd.11 [v2:172.21.15.192:6824/439693921,v1:172.21.15.192:6825/439693921]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]: dispatch 2024-06-02T04:47:29.135 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:28 smithi076 ceph-mon[42935]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]: dispatch 2024-06-02T04:47:29.135 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:28 smithi076 ceph-mon[42935]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-06-02T04:47:29.135 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:28 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:29.135 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:28 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:29.135 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:28 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:47:29.135 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:28 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:47:29.136 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:28 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:47:29.136 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:28 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:47:29.136 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:28 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:29.136 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:28 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:47:29.136 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:28 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:47:29.136 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:28 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:29.181 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 04:47:28 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T04:47:28.833+0000 7f962ef4a700 -1 osd.11 0 waiting for initial osdmap 2024-06-02T04:47:29.181 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 04:47:28 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T04:47:28.846+0000 7f962ad3f700 -1 osd.11 70 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-02T04:47:29.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:28 smithi192 ceph-mon[47933]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-06-02T04:47:29.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:28 smithi192 ceph-mon[47933]: osdmap e69: 12 total, 11 up, 12 in 2024-06-02T04:47:29.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:28 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-02T04:47:29.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:28 smithi192 ceph-mon[47933]: from='osd.11 [v2:172.21.15.192:6824/439693921,v1:172.21.15.192:6825/439693921]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]: dispatch 2024-06-02T04:47:29.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:28 smithi192 ceph-mon[47933]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]: dispatch 2024-06-02T04:47:29.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:28 smithi192 ceph-mon[47933]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-06-02T04:47:29.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:28 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:29.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:28 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:29.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:28 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:47:29.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:28 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:47:29.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:28 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:47:29.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:28 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:47:29.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:28 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:29.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:28 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:47:29.183 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:28 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:47:29.183 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:28 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:29.332 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T04:47:30.092 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:29 smithi076 ceph-mon[42935]: Detected new or changed devices on smithi192 2024-06-02T04:47:30.093 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:29 smithi076 ceph-mon[42935]: Adjusting osd_memory_target on smithi192 to 4278M 2024-06-02T04:47:30.093 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:29 smithi076 ceph-mon[42935]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]': finished 2024-06-02T04:47:30.093 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:29 smithi076 ceph-mon[42935]: osdmap e70: 12 total, 11 up, 12 in 2024-06-02T04:47:30.093 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:29 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-02T04:47:30.093 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:29 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-02T04:47:30.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:29 smithi119 ceph-mon[46633]: Detected new or changed devices on smithi192 2024-06-02T04:47:30.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:29 smithi119 ceph-mon[46633]: Adjusting osd_memory_target on smithi192 to 4278M 2024-06-02T04:47:30.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:29 smithi119 ceph-mon[46633]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]': finished 2024-06-02T04:47:30.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:29 smithi119 ceph-mon[46633]: osdmap e70: 12 total, 11 up, 12 in 2024-06-02T04:47:30.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:29 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-02T04:47:30.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:29 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-02T04:47:30.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:29 smithi192 ceph-mon[47933]: Detected new or changed devices on smithi192 2024-06-02T04:47:30.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:29 smithi192 ceph-mon[47933]: Adjusting osd_memory_target on smithi192 to 4278M 2024-06-02T04:47:30.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:29 smithi192 ceph-mon[47933]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]': finished 2024-06-02T04:47:30.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:29 smithi192 ceph-mon[47933]: osdmap e70: 12 total, 11 up, 12 in 2024-06-02T04:47:30.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:29 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-02T04:47:30.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:29 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-02T04:47:30.269 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:30.268+0000 7f4c20400700 1 -- 172.21.15.76:0/167250080 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4c18101060 msgr2=0x7f4c181014e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:47:30.269 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:30.268+0000 7f4c20400700 1 --2- 172.21.15.76:0/167250080 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4c18101060 0x7f4c181014e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4c14009990 tx=0x7f4c14009ca0 comp rx=0 tx=0).stop 2024-06-02T04:47:30.269 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:30.268+0000 7f4c20400700 1 -- 172.21.15.76:0/167250080 shutdown_connections 2024-06-02T04:47:30.269 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:30.268+0000 7f4c20400700 1 --2- 172.21.15.76:0/167250080 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4c18101a20 0x7f4c18108340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:30.269 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:30.268+0000 7f4c20400700 1 --2- 172.21.15.76:0/167250080 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4c180fff00 0x7f4c18100320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:30.269 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:30.268+0000 7f4c20400700 1 --2- 172.21.15.76:0/167250080 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4c18101060 0x7f4c181014e0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:30.269 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:30.268+0000 7f4c20400700 1 -- 172.21.15.76:0/167250080 >> 172.21.15.76:0/167250080 conn(0x7f4c180fb4a0 msgr2=0x7f4c180fd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:47:30.269 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:30.268+0000 7f4c20400700 1 -- 172.21.15.76:0/167250080 shutdown_connections 2024-06-02T04:47:30.270 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:30.268+0000 7f4c20400700 1 -- 172.21.15.76:0/167250080 wait complete. 2024-06-02T04:47:30.272 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:30.269+0000 7f4c20400700 1 Processor -- start 2024-06-02T04:47:30.272 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:30.269+0000 7f4c20400700 1 -- start start 2024-06-02T04:47:30.272 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:30.269+0000 7f4c20400700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4c180fff00 0x7f4c18195e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:47:30.272 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:30.269+0000 7f4c20400700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4c18101060 0x7f4c18196390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:47:30.272 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:30.269+0000 7f4c20400700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4c18101a20 0x7f4c1819d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:47:30.272 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:30.269+0000 7f4c20400700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c1819d990 con 0x7f4c18101a20 2024-06-02T04:47:30.272 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:30.269+0000 7f4c20400700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c1819dad0 con 0x7f4c180fff00 2024-06-02T04:47:30.272 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:30.269+0000 7f4c20400700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c1819dc60 con 0x7f4c18101060 2024-06-02T04:47:30.272 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:30.269+0000 7f4c1e99d700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4c18101a20 0x7f4c1819d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:47:30.272 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:30.270+0000 7f4c1e99d700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4c18101a20 0x7f4c1819d3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:43878/0 (socket says 172.21.15.76:43878) 2024-06-02T04:47:30.273 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:30.270+0000 7f4c1e99d700 1 -- 172.21.15.76:0/684465567 learned_addr learned my addr 172.21.15.76:0/684465567 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:47:30.273 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:30.270+0000 7f4c1e19c700 1 --2- 172.21.15.76:0/684465567 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4c180fff00 0x7f4c18195e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:47:30.273 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:30.270+0000 7f4c1d99b700 1 --2- 172.21.15.76:0/684465567 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4c18101060 0x7f4c18196390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:47:30.273 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:30.270+0000 7f4c1e99d700 1 -- 172.21.15.76:0/684465567 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4c18101060 msgr2=0x7f4c18196390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:47:30.273 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:30.270+0000 7f4c1e99d700 1 --2- 172.21.15.76:0/684465567 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4c18101060 0x7f4c18196390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:30.273 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:30.270+0000 7f4c1e99d700 1 -- 172.21.15.76:0/684465567 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4c180fff00 msgr2=0x7f4c18195e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:47:30.273 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:30.270+0000 7f4c1e99d700 1 --2- 172.21.15.76:0/684465567 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4c180fff00 0x7f4c18195e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:30.273 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:30.270+0000 7f4c1e99d700 1 -- 172.21.15.76:0/684465567 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c140095f0 con 0x7f4c18101a20 2024-06-02T04:47:30.273 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:30.270+0000 7f4c1e99d700 1 --2- 172.21.15.76:0/684465567 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4c18101a20 0x7f4c1819d3c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4c1000b9a0 tx=0x7f4c1000bcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:47:30.273 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:30.270+0000 7f4c0b7fe700 1 -- 172.21.15.76:0/684465567 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c1000c930 con 0x7f4c18101a20 2024-06-02T04:47:30.273 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:30.270+0000 7f4c20400700 1 -- 172.21.15.76:0/684465567 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c1819df40 con 0x7f4c18101a20 2024-06-02T04:47:30.273 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:30.270+0000 7f4c0b7fe700 1 -- 172.21.15.76:0/684465567 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4c10014440 con 0x7f4c18101a20 2024-06-02T04:47:30.274 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:30.270+0000 7f4c0b7fe700 1 -- 172.21.15.76:0/684465567 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c100075d0 con 0x7f4c18101a20 2024-06-02T04:47:30.274 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:30.270+0000 7f4c20400700 1 -- 172.21.15.76:0/684465567 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c1819e480 con 0x7f4c18101a20 2024-06-02T04:47:30.274 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:30.271+0000 7f4c20400700 1 -- 172.21.15.76:0/684465567 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c181073c0 con 0x7f4c18101a20 2024-06-02T04:47:30.274 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:30.272+0000 7f4c0b7fe700 1 -- 172.21.15.76:0/684465567 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f4c100145b0 con 0x7f4c18101a20 2024-06-02T04:47:30.275 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:30.273+0000 7f4c0b7fe700 1 --2- 172.21.15.76:0/684465567 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f4c040a1120 0x7f4c040a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:47:30.275 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:30.273+0000 7f4c1e19c700 1 --2- 172.21.15.76:0/684465567 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f4c040a1120 0x7f4c040a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:47:30.275 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:30.273+0000 7f4c0b7fe700 1 -- 172.21.15.76:0/684465567 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f4c10006e40 con 0x7f4c18101a20 2024-06-02T04:47:30.275 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:30.273+0000 7f4c1e19c700 1 --2- 172.21.15.76:0/684465567 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f4c040a1120 0x7f4c040a35e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c009a10 tx=0x7f4c0c009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:47:30.277 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:30.277+0000 7f4c0b7fe700 1 -- 172.21.15.76:0/684465567 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f4c10095930 con 0x7f4c18101a20 2024-06-02T04:47:30.472 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:30.472+0000 7f4c20400700 1 -- 172.21.15.76:0/684465567 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f4c1810b710 con 0x7f4c18101a20 2024-06-02T04:47:30.472 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:30.472+0000 7f4c0b7fe700 1 -- 172.21.15.76:0/684465567 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v71) v1 ==== 74+0+133 (secure 0 0 0) 0x7f4c10098f50 con 0x7f4c18101a20 2024-06-02T04:47:30.473 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:47:30.474 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:30.474+0000 7f4c20400700 1 -- 172.21.15.76:0/684465567 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f4c040a1120 msgr2=0x7f4c040a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:47:30.475 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:30.474+0000 7f4c20400700 1 --2- 172.21.15.76:0/684465567 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f4c040a1120 0x7f4c040a35e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c009a10 tx=0x7f4c0c009190 comp rx=0 tx=0).stop 2024-06-02T04:47:30.475 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:30.474+0000 7f4c20400700 1 -- 172.21.15.76:0/684465567 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4c18101a20 msgr2=0x7f4c1819d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:47:30.475 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:30.474+0000 7f4c20400700 1 --2- 172.21.15.76:0/684465567 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4c18101a20 0x7f4c1819d3c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4c1000b9a0 tx=0x7f4c1000bcb0 comp rx=0 tx=0).stop 2024-06-02T04:47:30.475 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:30.474+0000 7f4c20400700 1 -- 172.21.15.76:0/684465567 shutdown_connections 2024-06-02T04:47:30.475 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:30.474+0000 7f4c20400700 1 --2- 172.21.15.76:0/684465567 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4c18101a20 0x7f4c1819d3c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:30.475 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:30.474+0000 7f4c20400700 1 --2- 172.21.15.76:0/684465567 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f4c040a1120 0x7f4c040a35e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:30.475 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:30.474+0000 7f4c20400700 1 --2- 172.21.15.76:0/684465567 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4c180fff00 0x7f4c18195e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:30.475 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:30.474+0000 7f4c20400700 1 --2- 172.21.15.76:0/684465567 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4c18101060 0x7f4c18196390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:30.475 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:30.474+0000 7f4c20400700 1 -- 172.21.15.76:0/684465567 >> 172.21.15.76:0/684465567 conn(0x7f4c180fb4a0 msgr2=0x7f4c18104500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:47:30.475 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:30.474+0000 7f4c20400700 1 -- 172.21.15.76:0/684465567 shutdown_connections 2024-06-02T04:47:30.475 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:30.474+0000 7f4c20400700 1 -- 172.21.15.76:0/684465567 wait complete. 2024-06-02T04:47:30.861 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":71,"num_osds":12,"num_up_osds":12,"osd_up_since":1717303649,"num_in_osds":12,"osd_in_since":1717303634,"num_remapped_pgs":0} 2024-06-02T04:47:30.862 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell --fsid 60ab6d30-209a-11ef-bc9b-c7b262605968 -- ceph osd dump --format=json 2024-06-02T04:47:31.097 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:30 smithi119 ceph-mon[46633]: purged_snaps scrub starts 2024-06-02T04:47:31.097 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:30 smithi119 ceph-mon[46633]: purged_snaps scrub ok 2024-06-02T04:47:31.097 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:30 smithi119 ceph-mon[46633]: osd.11 [v2:172.21.15.192:6824/439693921,v1:172.21.15.192:6825/439693921] boot 2024-06-02T04:47:31.097 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:30 smithi119 ceph-mon[46633]: osdmap e71: 12 total, 12 up, 12 in 2024-06-02T04:47:31.098 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:30 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-02T04:47:31.098 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:30 smithi119 ceph-mon[46633]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T04:47:31.098 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:30 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/684465567' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-06-02T04:47:31.121 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T04:47:31.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:30 smithi192 ceph-mon[47933]: purged_snaps scrub starts 2024-06-02T04:47:31.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:30 smithi192 ceph-mon[47933]: purged_snaps scrub ok 2024-06-02T04:47:31.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:30 smithi192 ceph-mon[47933]: osd.11 [v2:172.21.15.192:6824/439693921,v1:172.21.15.192:6825/439693921] boot 2024-06-02T04:47:31.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:30 smithi192 ceph-mon[47933]: osdmap e71: 12 total, 12 up, 12 in 2024-06-02T04:47:31.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:30 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-02T04:47:31.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:30 smithi192 ceph-mon[47933]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T04:47:31.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:30 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/684465567' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-06-02T04:47:31.215 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:30 smithi076 ceph-mon[42935]: purged_snaps scrub starts 2024-06-02T04:47:31.215 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:30 smithi076 ceph-mon[42935]: purged_snaps scrub ok 2024-06-02T04:47:31.215 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:30 smithi076 ceph-mon[42935]: osd.11 [v2:172.21.15.192:6824/439693921,v1:172.21.15.192:6825/439693921] boot 2024-06-02T04:47:31.215 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:30 smithi076 ceph-mon[42935]: osdmap e71: 12 total, 12 up, 12 in 2024-06-02T04:47:31.216 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:30 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-02T04:47:31.216 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:30 smithi076 ceph-mon[42935]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T04:47:31.216 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:30 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/684465567' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-06-02T04:47:32.084 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:32.083+0000 7f458e48c700 1 -- 172.21.15.76:0/2567521454 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f45880ffe80 msgr2=0x7f4588100300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:47:32.084 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:32.083+0000 7f458e48c700 1 --2- 172.21.15.76:0/2567521454 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f45880ffe80 0x7f4588100300 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4570009990 tx=0x7f4570009ca0 comp rx=0 tx=0).stop 2024-06-02T04:47:32.084 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:32.083+0000 7f458e48c700 1 -- 172.21.15.76:0/2567521454 shutdown_connections 2024-06-02T04:47:32.084 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:32.083+0000 7f458e48c700 1 --2- 172.21.15.76:0/2567521454 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4588100840 0x7f458810cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:32.084 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:32.083+0000 7f458e48c700 1 --2- 172.21.15.76:0/2567521454 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4588105f30 0x7f4588106310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:32.084 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:32.083+0000 7f458e48c700 1 --2- 172.21.15.76:0/2567521454 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f45880ffe80 0x7f4588100300 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:32.084 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:32.083+0000 7f458e48c700 1 -- 172.21.15.76:0/2567521454 >> 172.21.15.76:0/2567521454 conn(0x7f4588076ec0 msgr2=0x7f45880772d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:47:32.084 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:32.083+0000 7f458e48c700 1 -- 172.21.15.76:0/2567521454 shutdown_connections 2024-06-02T04:47:32.084 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:32.083+0000 7f458e48c700 1 -- 172.21.15.76:0/2567521454 wait complete. 2024-06-02T04:47:32.086 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:32.084+0000 7f458e48c700 1 Processor -- start 2024-06-02T04:47:32.086 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:32.084+0000 7f458e48c700 1 -- start start 2024-06-02T04:47:32.086 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:32.084+0000 7f458e48c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f45880ffe80 0x7f45881980e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:47:32.086 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:32.084+0000 7f458e48c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4588100840 0x7f4588198620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:47:32.086 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:32.084+0000 7f458e48c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4588105f30 0x7f45881a3160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:47:32.086 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:32.084+0000 7f458e48c700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4588198ee0 con 0x7f4588105f30 2024-06-02T04:47:32.087 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:32.084+0000 7f458e48c700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45881a36a0 con 0x7f4588100840 2024-06-02T04:47:32.087 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:32.084+0000 7f458e48c700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45881a37e0 con 0x7f45880ffe80 2024-06-02T04:47:32.087 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:32.084+0000 7f458ca29700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4588105f30 0x7f45881a3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:47:32.087 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:32.084+0000 7f458ca29700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4588105f30 0x7f45881a3160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:43902/0 (socket says 172.21.15.76:43902) 2024-06-02T04:47:32.087 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:32.084+0000 7f458ca29700 1 -- 172.21.15.76:0/339840048 learned_addr learned my addr 172.21.15.76:0/339840048 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:47:32.087 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:32.085+0000 7f45877fe700 1 --2- 172.21.15.76:0/339840048 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4588100840 0x7f4588198620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:47:32.087 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:32.085+0000 7f4587fff700 1 --2- 172.21.15.76:0/339840048 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f45880ffe80 0x7f45881980e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:47:32.087 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:32.085+0000 7f458ca29700 1 -- 172.21.15.76:0/339840048 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f45880ffe80 msgr2=0x7f45881980e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:47:32.087 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:32.085+0000 7f458ca29700 1 --2- 172.21.15.76:0/339840048 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f45880ffe80 0x7f45881980e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:32.087 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:32.085+0000 7f458ca29700 1 -- 172.21.15.76:0/339840048 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4588100840 msgr2=0x7f4588198620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:47:32.087 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:32.085+0000 7f458ca29700 1 --2- 172.21.15.76:0/339840048 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4588100840 0x7f4588198620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:32.087 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:32.085+0000 7f458ca29700 1 -- 172.21.15.76:0/339840048 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45700095f0 con 0x7f4588105f30 2024-06-02T04:47:32.087 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:32.085+0000 7f458ca29700 1 --2- 172.21.15.76:0/339840048 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4588105f30 0x7f45881a3160 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4580007ee0 tx=0x7f458000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:47:32.088 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:32.085+0000 7f45857fa700 1 -- 172.21.15.76:0/339840048 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4580017070 con 0x7f4588105f30 2024-06-02T04:47:32.088 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:32.085+0000 7f458e48c700 1 -- 172.21.15.76:0/339840048 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45881a3a60 con 0x7f4588105f30 2024-06-02T04:47:32.088 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:32.085+0000 7f45857fa700 1 -- 172.21.15.76:0/339840048 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f458000f040 con 0x7f4588105f30 2024-06-02T04:47:32.088 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:32.085+0000 7f45857fa700 1 -- 172.21.15.76:0/339840048 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4580005710 con 0x7f4588105f30 2024-06-02T04:47:32.088 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:32.085+0000 7f458e48c700 1 -- 172.21.15.76:0/339840048 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45881a3f60 con 0x7f4588105f30 2024-06-02T04:47:32.088 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:32.086+0000 7f458e48c700 1 -- 172.21.15.76:0/339840048 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4588108310 con 0x7f4588105f30 2024-06-02T04:47:32.089 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:32.087+0000 7f45857fa700 1 -- 172.21.15.76:0/339840048 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f4580005870 con 0x7f4588105f30 2024-06-02T04:47:32.089 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:32.087+0000 7f45857fa700 1 --2- 172.21.15.76:0/339840048 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f45740a1120 0x7f45740a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:47:32.089 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:32.088+0000 7f4587fff700 1 --2- 172.21.15.76:0/339840048 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f45740a1120 0x7f45740a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:47:32.089 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:32.088+0000 7f45857fa700 1 -- 172.21.15.76:0/339840048 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f45800cbd00 con 0x7f4588105f30 2024-06-02T04:47:32.089 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:32.088+0000 7f4587fff700 1 --2- 172.21.15.76:0/339840048 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f45740a1120 0x7f45740a35e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4578005950 tx=0x7f4578005c70 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:47:32.092 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:32.092+0000 7f45857fa700 1 -- 172.21.15.76:0/339840048 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f4580095930 con 0x7f4588105f30 2024-06-02T04:47:32.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:31 smithi119 ceph-mon[46633]: osdmap e72: 12 total, 12 up, 12 in 2024-06-02T04:47:32.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:31 smithi192 ceph-mon[47933]: osdmap e72: 12 total, 12 up, 12 in 2024-06-02T04:47:32.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:31 smithi076 ceph-mon[42935]: osdmap e72: 12 total, 12 up, 12 in 2024-06-02T04:47:32.286 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:32.285+0000 7f458e48c700 1 -- 172.21.15.76:0/339840048 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4588069c50 con 0x7f4588105f30 2024-06-02T04:47:32.287 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:32.286+0000 7f45857fa700 1 -- 172.21.15.76:0/339840048 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+18446 (secure 0 0 0) 0x7f4580098f50 con 0x7f4588105f30 2024-06-02T04:47:32.287 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:47:32.287 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":72,"fsid":"60ab6d30-209a-11ef-bc9b-c7b262605968","created":"2024-06-02T04:42:21.007333+0000","modified":"2024-06-02T04:47:30.832570+0000","last_up_change":"2024-06-02T04:47:29.822242+0000","last_in_change":"2024-06-02T04:47:14.253449+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T04:44:56.408602+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"33a51ba2-be5c-41d0-b5d1-8d6039f2ca4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6802","nonce":2869602045},{"type":"v1","addr":"172.21.15.76:6803","nonce":2869602045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6804","nonce":2869602045},{"type":"v1","addr":"172.21.15.76:6805","nonce":2869602045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6808","nonce":2869602045},{"type":"v1","addr":"172.21.15.76:6809","nonce":2869602045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6806","nonce":2869602045},{"type":"v1","addr":"172.21.15.76:6807","nonce":2869602045}]},"public_addr":"172.21.15.76:6803/2869602045","cluster_addr":"172.21.15.76:6805/2869602045","heartbeat_back_addr":"172.21.15.76:6809/2869602045","heartbeat_front_addr":"172.21.15.76:6807/2869602045","state":["exists","up"]},{"osd":1,"uuid":"ace46e13-3bb7-4103-973a-6860554df8b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":2353738098},{"type":"v1","addr":"172.21.15.119:6801","nonce":2353738098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":2353738098},{"type":"v1","addr":"172.21.15.119:6803","nonce":2353738098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":2353738098},{"type":"v1","addr":"172.21.15.119:6807","nonce":2353738098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":2353738098},{"type":"v1","addr":"172.21.15.119:6805","nonce":2353738098}]},"public_addr":"172.21.15.119:6801/2353738098","cluster_addr":"172.21.15.119:6803/2353738098","heartbeat_back_addr":"172.21.15.119:6807/2353738098","heartbeat_front_addr":"172.21.15.119:6805/2353738098","state":["exists","up"]},{"osd":2,"uuid":"4addc09e-77a9-428a-bcc4-38194f486cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":3206918546},{"type":"v1","addr":"172.21.15.192:6801","nonce":3206918546}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":3206918546},{"type":"v1","addr":"172.21.15.192:6803","nonce":3206918546}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":3206918546},{"type":"v1","addr":"172.21.15.192:6807","nonce":3206918546}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":3206918546},{"type":"v1","addr":"172.21.15.192:6805","nonce":3206918546}]},"public_addr":"172.21.15.192:6801/3206918546","cluster_addr":"172.21.15.192:6803/3206918546","heartbeat_back_addr":"172.21.15.192:6807/3206918546","heartbeat_front_addr":"172.21.15.192:6805/3206918546","state":["exists","up"]},{"osd":3,"uuid":"dc525518-82c6-49ed-8ca8-e3bd5bfc18d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6810","nonce":3747864233},{"type":"v1","addr":"172.21.15.76:6811","nonce":3747864233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6812","nonce":3747864233},{"type":"v1","addr":"172.21.15.76:6813","nonce":3747864233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6816","nonce":3747864233},{"type":"v1","addr":"172.21.15.76:6817","nonce":3747864233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6814","nonce":3747864233},{"type":"v1","addr":"172.21.15.76:6815","nonce":3747864233}]},"public_addr":"172.21.15.76:6811/3747864233","cluster_addr":"172.21.15.76:6813/3747864233","heartbeat_back_addr":"172.21.15.76:6817/3747864233","heartbeat_front_addr":"172.21.15.76:6815/3747864233","state":["exists","up"]},{"osd":4,"uuid":"eef293d0-cb87-47b3-9751-c6437a1cf079","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":2571629047},{"type":"v1","addr":"172.21.15.119:6809","nonce":2571629047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":2571629047},{"type":"v1","addr":"172.21.15.119:6811","nonce":2571629047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":2571629047},{"type":"v1","addr":"172.21.15.119:6815","nonce":2571629047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":2571629047},{"type":"v1","addr":"172.21.15.119:6813","nonce":2571629047}]},"public_addr":"172.21.15.119:6809/2571629047","cluster_addr":"172.21.15.119:6811/2571629047","heartbeat_back_addr":"172.21.15.119:6815/2571629047","heartbeat_front_addr":"172.21.15.119:6813/2571629047","state":["exists","up"]},{"osd":5,"uuid":"60eb8c6e-766c-49d0-9997-44f85776b3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3285065416},{"type":"v1","addr":"172.21.15.192:6809","nonce":3285065416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":3285065416},{"type":"v1","addr":"172.21.15.192:6811","nonce":3285065416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3285065416},{"type":"v1","addr":"172.21.15.192:6815","nonce":3285065416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":3285065416},{"type":"v1","addr":"172.21.15.192:6813","nonce":3285065416}]},"public_addr":"172.21.15.192:6809/3285065416","cluster_addr":"172.21.15.192:6811/3285065416","heartbeat_back_addr":"172.21.15.192:6815/3285065416","heartbeat_front_addr":"172.21.15.192:6813/3285065416","state":["exists","up"]},{"osd":6,"uuid":"e6dc8b9d-dd06-4870-a506-def8201b7e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6818","nonce":2951381580},{"type":"v1","addr":"172.21.15.76:6819","nonce":2951381580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6820","nonce":2951381580},{"type":"v1","addr":"172.21.15.76:6821","nonce":2951381580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6824","nonce":2951381580},{"type":"v1","addr":"172.21.15.76:6825","nonce":2951381580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6822","nonce":2951381580},{"type":"v1","addr":"172.21.15.76:6823","nonce":2951381580}]},"public_addr":"172.21.15.76:6819/2951381580","cluster_addr":"172.21.15.76:6821/2951381580","heartbeat_back_addr":"172.21.15.76:6825/2951381580","heartbeat_front_addr":"172.21.15.76:6823/2951381580","state":["exists","up"]},{"osd":7,"uuid":"2f5dccb3-39a1-4f25-8715-fa264d59db97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1802558756},{"type":"v1","addr":"172.21.15.119:6817","nonce":1802558756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1802558756},{"type":"v1","addr":"172.21.15.119:6819","nonce":1802558756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1802558756},{"type":"v1","addr":"172.21.15.119:6823","nonce":1802558756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1802558756},{"type":"v1","addr":"172.21.15.119:6821","nonce":1802558756}]},"public_addr":"172.21.15.119:6817/1802558756","cluster_addr":"172.21.15.119:6819/1802558756","heartbeat_back_addr":"172.21.15.119:6823/1802558756","heartbeat_front_addr":"172.21.15.119:6821/1802558756","state":["exists","up"]},{"osd":8,"uuid":"39b6ccd0-16e7-4cd5-87e0-d827e9172984","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":1214972276},{"type":"v1","addr":"172.21.15.192:6817","nonce":1214972276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":1214972276},{"type":"v1","addr":"172.21.15.192:6819","nonce":1214972276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":1214972276},{"type":"v1","addr":"172.21.15.192:6823","nonce":1214972276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":1214972276},{"type":"v1","addr":"172.21.15.192:6821","nonce":1214972276}]},"public_addr":"172.21.15.192:6817/1214972276","cluster_addr":"172.21.15.192:6819/1214972276","heartbeat_back_addr":"172.21.15.192:6823/1214972276","heartbeat_front_addr":"172.21.15.192:6821/1214972276","state":["exists","up"]},{"osd":9,"uuid":"851b2155-07bd-45de-bfe0-53021fda733f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6826","nonce":3095501821},{"type":"v1","addr":"172.21.15.76:6827","nonce":3095501821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6828","nonce":3095501821},{"type":"v1","addr":"172.21.15.76:6829","nonce":3095501821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":3095501821},{"type":"v1","addr":"172.21.15.76:6833","nonce":3095501821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6830","nonce":3095501821},{"type":"v1","addr":"172.21.15.76:6831","nonce":3095501821}]},"public_addr":"172.21.15.76:6827/3095501821","cluster_addr":"172.21.15.76:6829/3095501821","heartbeat_back_addr":"172.21.15.76:6833/3095501821","heartbeat_front_addr":"172.21.15.76:6831/3095501821","state":["exists","up"]},{"osd":10,"uuid":"e4b18e7e-bddf-4dd4-84f6-7902ea327cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":4082130894},{"type":"v1","addr":"172.21.15.119:6825","nonce":4082130894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":4082130894},{"type":"v1","addr":"172.21.15.119:6827","nonce":4082130894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":4082130894},{"type":"v1","addr":"172.21.15.119:6831","nonce":4082130894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":4082130894},{"type":"v1","addr":"172.21.15.119:6829","nonce":4082130894}]},"public_addr":"172.21.15.119:6825/4082130894","cluster_addr":"172.21.15.119:6827/4082130894","heartbeat_back_addr":"172.21.15.119:6831/4082130894","heartbeat_front_addr":"172.21.15.119:6829/4082130894","state":["exists","up"]},{"osd":11,"uuid":"54567e18-920c-4ae9-9557-0efba5a1a820","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":439693921},{"type":"v1","addr":"172.21.15.192:6825","nonce":439693921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":439693921},{"type":"v1","addr":"172.21.15.192:6827","nonce":439693921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":439693921},{"type":"v1","addr":"172.21.15.192:6831","nonce":439693921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":439693921},{"type":"v1","addr":"172.21.15.192:6829","nonce":439693921}]},"public_addr":"172.21.15.192:6825/439693921","cluster_addr":"172.21.15.192:6827/439693921","heartbeat_back_addr":"172.21.15.192:6831/439693921","heartbeat_front_addr":"172.21.15.192:6829/439693921","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:44:19.922390+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:44:36.895563+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:44:53.699019+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:45:11.167404+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:45:27.955899+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:45:44.850368+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:46:02.003588+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:46:19.019217+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:46:36.189670+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:46:53.919365+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:47:11.563053+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:47:28.822443+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.76:6801/4200406736":"2024-06-03T04:43:06.092916+0000","172.21.15.76:6800/4200406736":"2024-06-03T04:43:06.092916+0000","172.21.15.76:0/1524144593":"2024-06-03T04:43:06.092916+0000","172.21.15.76:0/3269372590":"2024-06-03T04:43:06.092916+0000","172.21.15.76:0/3570893846":"2024-06-03T04:42:44.872236+0000","172.21.15.76:0/902035790":"2024-06-03T04:43:06.092916+0000","172.21.15.76:6800/2550846765":"2024-06-03T04:42:44.872236+0000","172.21.15.76:6801/2550846765":"2024-06-03T04:42:44.872236+0000","172.21.15.76:0/2646712763":"2024-06-03T04:42:44.872236+0000","172.21.15.76:0/964578813":"2024-06-03T04:42:44.872236+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T04:47:32.289 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:32.288+0000 7f458e48c700 1 -- 172.21.15.76:0/339840048 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f45740a1120 msgr2=0x7f45740a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:47:32.289 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:32.288+0000 7f458e48c700 1 --2- 172.21.15.76:0/339840048 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f45740a1120 0x7f45740a35e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4578005950 tx=0x7f4578005c70 comp rx=0 tx=0).stop 2024-06-02T04:47:32.289 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:32.288+0000 7f458e48c700 1 -- 172.21.15.76:0/339840048 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4588105f30 msgr2=0x7f45881a3160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:47:32.289 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:32.288+0000 7f458e48c700 1 --2- 172.21.15.76:0/339840048 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4588105f30 0x7f45881a3160 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4580007ee0 tx=0x7f458000d3b0 comp rx=0 tx=0).stop 2024-06-02T04:47:32.289 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:32.289+0000 7f458e48c700 1 -- 172.21.15.76:0/339840048 shutdown_connections 2024-06-02T04:47:32.289 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:32.289+0000 7f458e48c700 1 --2- 172.21.15.76:0/339840048 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4588105f30 0x7f45881a3160 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:32.289 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:32.289+0000 7f458e48c700 1 --2- 172.21.15.76:0/339840048 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f45880ffe80 0x7f45881980e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:32.289 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:32.289+0000 7f458e48c700 1 --2- 172.21.15.76:0/339840048 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f45740a1120 0x7f45740a35e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:32.290 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:32.289+0000 7f458e48c700 1 --2- 172.21.15.76:0/339840048 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4588100840 0x7f4588198620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:32.290 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:32.289+0000 7f458e48c700 1 -- 172.21.15.76:0/339840048 >> 172.21.15.76:0/339840048 conn(0x7f4588076ec0 msgr2=0x7f45880fef40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:47:32.290 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:32.289+0000 7f458e48c700 1 -- 172.21.15.76:0/339840048 shutdown_connections 2024-06-02T04:47:32.290 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:32.289+0000 7f458e48c700 1 -- 172.21.15.76:0/339840048 wait complete. 2024-06-02T04:47:32.723 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-06-02T04:44:56.408602+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-06-02T04:47:32.723 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell --fsid 60ab6d30-209a-11ef-bc9b-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-06-02T04:47:32.945 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T04:47:32.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:32 smithi076 ceph-mon[42935]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T04:47:32.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:32 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/339840048' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:47:33.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:32 smithi192 ceph-mon[47933]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T04:47:33.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:32 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/339840048' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:47:33.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:32 smithi119 ceph-mon[46633]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T04:47:33.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:32 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/339840048' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:47:33.922 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:33.919+0000 7ffaa80fc700 1 -- 172.21.15.76:0/3732935529 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ffaa0100890 msgr2=0x7ffaa010cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:47:33.922 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:33.919+0000 7ffaa80fc700 1 --2- 172.21.15.76:0/3732935529 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ffaa0100890 0x7ffaa010cd40 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ffa9000b0a0 tx=0x7ffa9000b3b0 comp rx=0 tx=0).stop 2024-06-02T04:47:33.922 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:33.919+0000 7ffaa80fc700 1 -- 172.21.15.76:0/3732935529 shutdown_connections 2024-06-02T04:47:33.922 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:33.919+0000 7ffaa80fc700 1 --2- 172.21.15.76:0/3732935529 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ffaa0100890 0x7ffaa010cd40 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:33.922 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:33.920+0000 7ffaa80fc700 1 --2- 172.21.15.76:0/3732935529 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffaa0105f00 0x7ffaa01062e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:33.922 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:33.920+0000 7ffaa80fc700 1 --2- 172.21.15.76:0/3732935529 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffaa00ffed0 0x7ffaa0100350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:33.922 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:33.920+0000 7ffaa80fc700 1 -- 172.21.15.76:0/3732935529 >> 172.21.15.76:0/3732935529 conn(0x7ffaa0075f80 msgr2=0x7ffaa0076390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:47:33.922 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:33.920+0000 7ffaa80fc700 1 -- 172.21.15.76:0/3732935529 shutdown_connections 2024-06-02T04:47:33.923 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:33.920+0000 7ffaa80fc700 1 -- 172.21.15.76:0/3732935529 wait complete. 2024-06-02T04:47:33.923 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:33.920+0000 7ffaa80fc700 1 Processor -- start 2024-06-02T04:47:33.923 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:33.920+0000 7ffaa80fc700 1 -- start start 2024-06-02T04:47:33.923 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:33.920+0000 7ffaa80fc700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffaa00ffed0 0x7ffaa0198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:47:33.923 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:33.920+0000 7ffaa80fc700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ffaa0100890 0x7ffaa01989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:47:33.923 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:33.920+0000 7ffaa80fc700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffaa0105f00 0x7ffaa01a34e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:47:33.923 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:33.920+0000 7ffaa80fc700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa0199260 con 0x7ffaa0100890 2024-06-02T04:47:33.923 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:33.920+0000 7ffaa80fc700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa01a3a20 con 0x7ffaa0105f00 2024-06-02T04:47:33.923 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:33.920+0000 7ffaa80fc700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa01a3b60 con 0x7ffaa00ffed0 2024-06-02T04:47:33.923 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:33.920+0000 7ffaa5697700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ffaa0100890 0x7ffaa01989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:47:33.923 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:33.921+0000 7ffaa5697700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ffaa0100890 0x7ffaa01989a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:49062/0 (socket says 172.21.15.76:49062) 2024-06-02T04:47:33.923 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:33.921+0000 7ffaa5697700 1 -- 172.21.15.76:0/1694905709 learned_addr learned my addr 172.21.15.76:0/1694905709 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:47:33.923 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:33.921+0000 7ffaa6699700 1 --2- 172.21.15.76:0/1694905709 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffaa0105f00 0x7ffaa01a34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:47:33.924 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:33.921+0000 7ffaa5e98700 1 --2- 172.21.15.76:0/1694905709 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffaa00ffed0 0x7ffaa0198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:47:33.924 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:33.921+0000 7ffaa5697700 1 -- 172.21.15.76:0/1694905709 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffaa00ffed0 msgr2=0x7ffaa0198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:47:33.924 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:33.921+0000 7ffaa5697700 1 --2- 172.21.15.76:0/1694905709 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffaa00ffed0 0x7ffaa0198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:33.924 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:33.921+0000 7ffaa5697700 1 -- 172.21.15.76:0/1694905709 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffaa0105f00 msgr2=0x7ffaa01a34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:47:33.924 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:33.921+0000 7ffaa5697700 1 --2- 172.21.15.76:0/1694905709 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffaa0105f00 0x7ffaa01a34e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:33.924 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:33.921+0000 7ffaa5697700 1 -- 172.21.15.76:0/1694905709 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa90009d00 con 0x7ffaa0100890 2024-06-02T04:47:33.924 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:33.921+0000 7ffaa5697700 1 --2- 172.21.15.76:0/1694905709 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ffaa0100890 0x7ffaa01989a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ffa9400b530 tx=0x7ffa9400b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:47:33.924 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:33.921+0000 7ffa9effd700 1 -- 172.21.15.76:0/1694905709 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa94011830 con 0x7ffaa0100890 2024-06-02T04:47:33.924 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:33.921+0000 7ffa9effd700 1 -- 172.21.15.76:0/1694905709 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ffa94011e20 con 0x7ffaa0100890 2024-06-02T04:47:33.924 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:33.921+0000 7ffaa80fc700 1 -- 172.21.15.76:0/1694905709 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaa01a3de0 con 0x7ffaa0100890 2024-06-02T04:47:33.924 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:33.921+0000 7ffa9effd700 1 -- 172.21.15.76:0/1694905709 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa9400f2e0 con 0x7ffaa0100890 2024-06-02T04:47:33.924 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:33.921+0000 7ffaa80fc700 1 -- 172.21.15.76:0/1694905709 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaa01a4250 con 0x7ffaa0100890 2024-06-02T04:47:33.925 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:33.922+0000 7ffaa80fc700 1 -- 172.21.15.76:0/1694905709 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffaa0108420 con 0x7ffaa0100890 2024-06-02T04:47:33.925 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:33.923+0000 7ffa9effd700 1 -- 172.21.15.76:0/1694905709 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7ffa94011990 con 0x7ffaa0100890 2024-06-02T04:47:33.925 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:33.924+0000 7ffa9effd700 1 --2- 172.21.15.76:0/1694905709 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7ffa880a1120 0x7ffa880a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:47:33.926 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:33.924+0000 7ffaa5e98700 1 --2- 172.21.15.76:0/1694905709 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7ffa880a1120 0x7ffa880a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:47:33.926 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:33.924+0000 7ffa9effd700 1 -- 172.21.15.76:0/1694905709 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 7127+0+0 (secure 0 0 0) 0x7ffa940cbf60 con 0x7ffaa0100890 2024-06-02T04:47:33.926 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:33.924+0000 7ffaa5e98700 1 --2- 172.21.15.76:0/1694905709 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7ffa880a1120 0x7ffa880a35e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ffa98006fd0 tx=0x7ffa98008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:47:33.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:33.928+0000 7ffa9effd700 1 -- 172.21.15.76:0/1694905709 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7ffa94095b90 con 0x7ffaa0100890 2024-06-02T04:47:34.120 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:34.119+0000 7ffaa80fc700 1 -- 172.21.15.76:0/1694905709 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ffaa0068f10 con 0x7ffaa0100890 2024-06-02T04:47:34.120 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:34.120+0000 7ffa9effd700 1 -- 172.21.15.76:0/1694905709 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v72) v1 ==== 93+0+10 (secure 0 0 0) 0x7ffa940991b0 con 0x7ffaa0100890 2024-06-02T04:47:34.120 INFO:teuthology.orchestra.run.smithi076.stdout:pg_num: 1 2024-06-02T04:47:34.122 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:34.122+0000 7ffaa80fc700 1 -- 172.21.15.76:0/1694905709 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7ffa880a1120 msgr2=0x7ffa880a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:47:34.122 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:34.122+0000 7ffaa80fc700 1 --2- 172.21.15.76:0/1694905709 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7ffa880a1120 0x7ffa880a35e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ffa98006fd0 tx=0x7ffa98008040 comp rx=0 tx=0).stop 2024-06-02T04:47:34.122 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:34.122+0000 7ffaa80fc700 1 -- 172.21.15.76:0/1694905709 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ffaa0100890 msgr2=0x7ffaa01989a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:47:34.122 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:34.122+0000 7ffaa80fc700 1 --2- 172.21.15.76:0/1694905709 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ffaa0100890 0x7ffaa01989a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ffa9400b530 tx=0x7ffa9400b840 comp rx=0 tx=0).stop 2024-06-02T04:47:34.122 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:34.122+0000 7ffaa80fc700 1 -- 172.21.15.76:0/1694905709 shutdown_connections 2024-06-02T04:47:34.123 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:34.122+0000 7ffaa80fc700 1 --2- 172.21.15.76:0/1694905709 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7ffa880a1120 0x7ffa880a35e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:34.123 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:34.122+0000 7ffaa80fc700 1 --2- 172.21.15.76:0/1694905709 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffaa0105f00 0x7ffaa01a34e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:34.123 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:34.122+0000 7ffaa80fc700 1 --2- 172.21.15.76:0/1694905709 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffaa00ffed0 0x7ffaa0198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:34.123 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:34.122+0000 7ffaa80fc700 1 --2- 172.21.15.76:0/1694905709 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ffaa0100890 0x7ffaa01989a0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:34.123 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:34.122+0000 7ffaa80fc700 1 -- 172.21.15.76:0/1694905709 >> 172.21.15.76:0/1694905709 conn(0x7ffaa0075f80 msgr2=0x7ffaa00fee20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:47:34.123 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:34.122+0000 7ffaa80fc700 1 -- 172.21.15.76:0/1694905709 shutdown_connections 2024-06-02T04:47:34.123 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:34.122+0000 7ffaa80fc700 1 -- 172.21.15.76:0/1694905709 wait complete. 2024-06-02T04:47:34.431 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:34 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/1694905709' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-02T04:47:34.476 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:34 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/1694905709' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-02T04:47:34.553 INFO:tasks.cephadm:Adding mds.a on smithi076 2024-06-02T04:47:34.553 INFO:tasks.cephadm:Adding mds.d on smithi076 2024-06-02T04:47:34.553 INFO:tasks.cephadm:Adding mds.g on smithi076 2024-06-02T04:47:34.553 INFO:tasks.cephadm:Adding mds.j on smithi076 2024-06-02T04:47:34.553 INFO:tasks.cephadm:Adding mds.b on smithi119 2024-06-02T04:47:34.553 INFO:tasks.cephadm:Adding mds.e on smithi119 2024-06-02T04:47:34.553 INFO:tasks.cephadm:Adding mds.h on smithi119 2024-06-02T04:47:34.553 INFO:tasks.cephadm:Adding mds.k on smithi119 2024-06-02T04:47:34.553 INFO:tasks.cephadm:Adding mds.c on smithi192 2024-06-02T04:47:34.553 INFO:tasks.cephadm:Adding mds.f on smithi192 2024-06-02T04:47:34.554 INFO:tasks.cephadm:Adding mds.i on smithi192 2024-06-02T04:47:34.554 INFO:tasks.cephadm:Adding mds.l on smithi192 2024-06-02T04:47:34.554 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 60ab6d30-209a-11ef-bc9b-c7b262605968 -- ceph orch apply mds all '12;smithi076=a;smithi076=d;smithi076=g;smithi076=j;smithi119=b;smithi119=e;smithi119=h;smithi119=k;smithi192=c;smithi192=f;smithi192=i;smithi192=l' 2024-06-02T04:47:34.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:34 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/1694905709' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-02T04:47:34.788 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/mon.c/config 2024-06-02T04:47:35.431 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:35 smithi192 ceph-mon[47933]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T04:47:35.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:35 smithi076 ceph-mon[42935]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T04:47:35.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:35 smithi119 ceph-mon[46633]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T04:47:35.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:47:35.700+0000 7ff0ca2e3700 1 -- 172.21.15.192:0/4294036460 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff0c4102c40 msgr2=0x7ff0c41094f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:47:35.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:47:35.700+0000 7ff0ca2e3700 1 --2- 172.21.15.192:0/4294036460 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff0c4102c40 0x7ff0c41094f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc00b0a0 tx=0x7ff0bc00b3b0 comp rx=0 tx=0).stop 2024-06-02T04:47:35.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:47:35.701+0000 7ff0ca2e3700 1 -- 172.21.15.192:0/4294036460 shutdown_connections 2024-06-02T04:47:35.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:47:35.701+0000 7ff0ca2e3700 1 --2- 172.21.15.192:0/4294036460 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff0c4102c40 0x7ff0c41094f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:35.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:47:35.701+0000 7ff0ca2e3700 1 --2- 172.21.15.192:0/4294036460 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff0c40ff2c0 0x7ff0c40ff6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:35.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:47:35.701+0000 7ff0ca2e3700 1 --2- 172.21.15.192:0/4294036460 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff0c41022a0 0x7ff0c4102700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:35.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:47:35.701+0000 7ff0ca2e3700 1 -- 172.21.15.192:0/4294036460 >> 172.21.15.192:0/4294036460 conn(0x7ff0c40fac40 msgr2=0x7ff0c40fd060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:47:35.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:47:35.701+0000 7ff0ca2e3700 1 -- 172.21.15.192:0/4294036460 shutdown_connections 2024-06-02T04:47:35.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:47:35.701+0000 7ff0ca2e3700 1 -- 172.21.15.192:0/4294036460 wait complete. 2024-06-02T04:47:35.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:47:35.701+0000 7ff0ca2e3700 1 Processor -- start 2024-06-02T04:47:35.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:47:35.701+0000 7ff0ca2e3700 1 -- start start 2024-06-02T04:47:35.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:47:35.702+0000 7ff0ca2e3700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff0c40ff2c0 0x7ff0c4101bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:47:35.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:47:35.702+0000 7ff0ca2e3700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff0c41022a0 0x7ff0c4100250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:47:35.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:47:35.702+0000 7ff0ca2e3700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff0c4102c40 0x7ff0c4100790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:47:35.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:47:35.702+0000 7ff0ca2e3700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c4100f30 con 0x7ff0c41022a0 2024-06-02T04:47:35.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:47:35.702+0000 7ff0ca2e3700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c41010a0 con 0x7ff0c40ff2c0 2024-06-02T04:47:35.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:47:35.702+0000 7ff0ca2e3700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c41a0ff0 con 0x7ff0c4102c40 2024-06-02T04:47:35.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:47:35.702+0000 7ff0c8880700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff0c4102c40 0x7ff0c4100790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:47:35.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:47:35.702+0000 7ff0c8880700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff0c4102c40 0x7ff0c4100790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:45632/0 (socket says 172.21.15.192:45632) 2024-06-02T04:47:35.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:47:35.702+0000 7ff0c8880700 1 -- 172.21.15.192:0/3358366718 learned_addr learned my addr 172.21.15.192:0/3358366718 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-06-02T04:47:35.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:47:35.702+0000 7ff0c37fe700 1 --2- 172.21.15.192:0/3358366718 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff0c41022a0 0x7ff0c4100250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:47:35.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:47:35.702+0000 7ff0c3fff700 1 --2- 172.21.15.192:0/3358366718 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff0c40ff2c0 0x7ff0c4101bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:47:35.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:47:35.702+0000 7ff0c8880700 1 -- 172.21.15.192:0/3358366718 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff0c40ff2c0 msgr2=0x7ff0c4101bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:47:35.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:47:35.702+0000 7ff0c8880700 1 --2- 172.21.15.192:0/3358366718 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff0c40ff2c0 0x7ff0c4101bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:35.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:47:35.702+0000 7ff0c8880700 1 -- 172.21.15.192:0/3358366718 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff0c41022a0 msgr2=0x7ff0c4100250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:47:35.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:47:35.702+0000 7ff0c8880700 1 --2- 172.21.15.192:0/3358366718 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff0c41022a0 0x7ff0c4100250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:35.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:47:35.702+0000 7ff0c8880700 1 -- 172.21.15.192:0/3358366718 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0bc009d00 con 0x7ff0c4102c40 2024-06-02T04:47:35.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:47:35.702+0000 7ff0c8880700 1 --2- 172.21.15.192:0/3358366718 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff0c4102c40 0x7ff0c4100790 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc004d00 tx=0x7ff0bc004de0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:47:35.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:47:35.702+0000 7ff0c17fa700 1 -- 172.21.15.192:0/3358366718 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0bc00e040 con 0x7ff0c4102c40 2024-06-02T04:47:35.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:47:35.702+0000 7ff0c17fa700 1 -- 172.21.15.192:0/3358366718 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff0bc01db20 con 0x7ff0c4102c40 2024-06-02T04:47:35.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:47:35.702+0000 7ff0ca2e3700 1 -- 172.21.15.192:0/3358366718 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0c41a1220 con 0x7ff0c4102c40 2024-06-02T04:47:35.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:47:35.702+0000 7ff0c17fa700 1 -- 172.21.15.192:0/3358366718 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0bc01bac0 con 0x7ff0c4102c40 2024-06-02T04:47:35.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:47:35.702+0000 7ff0ca2e3700 1 -- 172.21.15.192:0/3358366718 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0c41a1640 con 0x7ff0c4102c40 2024-06-02T04:47:35.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:47:35.703+0000 7ff0ca2e3700 1 -- 172.21.15.192:0/3358366718 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0c41085d0 con 0x7ff0c4102c40 2024-06-02T04:47:35.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:47:35.704+0000 7ff0c17fa700 1 -- 172.21.15.192:0/3358366718 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7ff0bc01dc90 con 0x7ff0c4102c40 2024-06-02T04:47:35.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:47:35.705+0000 7ff0c17fa700 1 --2- 172.21.15.192:0/3358366718 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7ff0ac0a1120 0x7ff0ac0a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:47:35.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:47:35.705+0000 7ff0c17fa700 1 -- 172.21.15.192:0/3358366718 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 7127+0+0 (secure 0 0 0) 0x7ff0bc0ce490 con 0x7ff0c4102c40 2024-06-02T04:47:35.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:47:35.705+0000 7ff0c3fff700 1 --2- 172.21.15.192:0/3358366718 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7ff0ac0a1120 0x7ff0ac0a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:47:35.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:47:35.706+0000 7ff0c3fff700 1 --2- 172.21.15.192:0/3358366718 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7ff0ac0a1120 0x7ff0ac0a35e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff0b4005950 tx=0x7ff0b40058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:47:35.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:47:35.709+0000 7ff0c17fa700 1 -- 172.21.15.192:0/3358366718 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7ff0bc098150 con 0x7ff0c4102c40 2024-06-02T04:47:35.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:47:35.914+0000 7ff0ca2e3700 1 -- 172.21.15.192:0/3358366718 --> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi076=a;smithi076=d;smithi076=g;smithi076=j;smithi119=b;smithi119=e;smithi119=h;smithi119=k;smithi192=c;smithi192=f;smithi192=i;smithi192=l", "target": ["mon-mgr", ""]}) v1 -- 0x7ff0c402cf60 con 0x7ff0ac0a1120 2024-06-02T04:47:35.923 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:47:35.922+0000 7ff0c17fa700 1 -- 172.21.15.192:0/3358366718 <== mgr.14152 v2:172.21.15.76:6800/2591353090 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7ff0c402cf60 con 0x7ff0ac0a1120 2024-06-02T04:47:35.923 INFO:teuthology.orchestra.run.smithi192.stdout:Scheduled mds.all update... 2024-06-02T04:47:35.925 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:47:35.925+0000 7ff0ca2e3700 1 -- 172.21.15.192:0/3358366718 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7ff0ac0a1120 msgr2=0x7ff0ac0a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:47:35.926 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:47:35.925+0000 7ff0ca2e3700 1 --2- 172.21.15.192:0/3358366718 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7ff0ac0a1120 0x7ff0ac0a35e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff0b4005950 tx=0x7ff0b40058e0 comp rx=0 tx=0).stop 2024-06-02T04:47:35.926 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:47:35.925+0000 7ff0ca2e3700 1 -- 172.21.15.192:0/3358366718 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff0c4102c40 msgr2=0x7ff0c4100790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:47:35.926 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:47:35.925+0000 7ff0ca2e3700 1 --2- 172.21.15.192:0/3358366718 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff0c4102c40 0x7ff0c4100790 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc004d00 tx=0x7ff0bc004de0 comp rx=0 tx=0).stop 2024-06-02T04:47:35.926 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:47:35.925+0000 7ff0ca2e3700 1 -- 172.21.15.192:0/3358366718 shutdown_connections 2024-06-02T04:47:35.926 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:47:35.925+0000 7ff0ca2e3700 1 --2- 172.21.15.192:0/3358366718 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff0c4102c40 0x7ff0c4100790 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:35.926 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:47:35.925+0000 7ff0ca2e3700 1 --2- 172.21.15.192:0/3358366718 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7ff0ac0a1120 0x7ff0ac0a35e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:35.926 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:47:35.925+0000 7ff0ca2e3700 1 --2- 172.21.15.192:0/3358366718 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff0c40ff2c0 0x7ff0c4101bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:35.926 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:47:35.925+0000 7ff0ca2e3700 1 --2- 172.21.15.192:0/3358366718 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff0c41022a0 0x7ff0c4100250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:35.926 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:47:35.925+0000 7ff0ca2e3700 1 -- 172.21.15.192:0/3358366718 >> 172.21.15.192:0/3358366718 conn(0x7ff0c40fac40 msgr2=0x7ff0c4105710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:47:35.926 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:47:35.925+0000 7ff0ca2e3700 1 -- 172.21.15.192:0/3358366718 shutdown_connections 2024-06-02T04:47:35.926 INFO:teuthology.orchestra.run.smithi192.stderr:2024-06-02T04:47:35.925+0000 7ff0ca2e3700 1 -- 172.21.15.192:0/3358366718 wait complete. 2024-06-02T04:47:36.334 DEBUG:teuthology.orchestra.run.smithi076:mds.a> sudo journalctl -f -n 0 -u ceph-60ab6d30-209a-11ef-bc9b-c7b262605968@mds.a.service 2024-06-02T04:47:36.336 DEBUG:teuthology.orchestra.run.smithi076:mds.d> sudo journalctl -f -n 0 -u ceph-60ab6d30-209a-11ef-bc9b-c7b262605968@mds.d.service 2024-06-02T04:47:36.367 INFO:journalctl@ceph.mds.a.smithi076.stdout:-- Logs begin at Sun 2024-06-02 04:26:13 UTC. -- 2024-06-02T04:47:36.368 DEBUG:teuthology.orchestra.run.smithi076:mds.g> sudo journalctl -f -n 0 -u ceph-60ab6d30-209a-11ef-bc9b-c7b262605968@mds.g.service 2024-06-02T04:47:36.395 INFO:journalctl@ceph.mds.d.smithi076.stdout:-- Logs begin at Sun 2024-06-02 04:26:13 UTC. -- 2024-06-02T04:47:36.396 DEBUG:teuthology.orchestra.run.smithi076:mds.j> sudo journalctl -f -n 0 -u ceph-60ab6d30-209a-11ef-bc9b-c7b262605968@mds.j.service 2024-06-02T04:47:36.421 INFO:journalctl@ceph.mds.g.smithi076.stdout:-- Logs begin at Sun 2024-06-02 04:26:13 UTC. -- 2024-06-02T04:47:36.422 DEBUG:teuthology.orchestra.run.smithi119:mds.b> sudo journalctl -f -n 0 -u ceph-60ab6d30-209a-11ef-bc9b-c7b262605968@mds.b.service 2024-06-02T04:47:36.425 DEBUG:teuthology.orchestra.run.smithi119:mds.e> sudo journalctl -f -n 0 -u ceph-60ab6d30-209a-11ef-bc9b-c7b262605968@mds.e.service 2024-06-02T04:47:36.448 INFO:journalctl@ceph.mds.j.smithi076.stdout:-- Logs begin at Sun 2024-06-02 04:26:13 UTC. -- 2024-06-02T04:47:36.462 INFO:journalctl@ceph.mds.b.smithi119.stdout:-- Logs begin at Sun 2024-06-02 04:25:42 UTC. -- 2024-06-02T04:47:36.464 DEBUG:teuthology.orchestra.run.smithi119:mds.h> sudo journalctl -f -n 0 -u ceph-60ab6d30-209a-11ef-bc9b-c7b262605968@mds.h.service 2024-06-02T04:47:36.493 INFO:journalctl@ceph.mds.e.smithi119.stdout:-- Logs begin at Sun 2024-06-02 04:25:42 UTC. -- 2024-06-02T04:47:36.494 DEBUG:teuthology.orchestra.run.smithi119:mds.k> sudo journalctl -f -n 0 -u ceph-60ab6d30-209a-11ef-bc9b-c7b262605968@mds.k.service 2024-06-02T04:47:36.522 INFO:journalctl@ceph.mds.h.smithi119.stdout:-- Logs begin at Sun 2024-06-02 04:25:42 UTC. -- 2024-06-02T04:47:36.523 DEBUG:teuthology.orchestra.run.smithi192:mds.c> sudo journalctl -f -n 0 -u ceph-60ab6d30-209a-11ef-bc9b-c7b262605968@mds.c.service 2024-06-02T04:47:36.525 DEBUG:teuthology.orchestra.run.smithi192:mds.f> sudo journalctl -f -n 0 -u ceph-60ab6d30-209a-11ef-bc9b-c7b262605968@mds.f.service 2024-06-02T04:47:36.549 INFO:journalctl@ceph.mds.k.smithi119.stdout:-- Logs begin at Sun 2024-06-02 04:25:42 UTC. -- 2024-06-02T04:47:36.558 INFO:journalctl@ceph.mds.c.smithi192.stdout:-- Logs begin at Sun 2024-06-02 04:25:37 UTC. -- 2024-06-02T04:47:36.559 DEBUG:teuthology.orchestra.run.smithi192:mds.i> sudo journalctl -f -n 0 -u ceph-60ab6d30-209a-11ef-bc9b-c7b262605968@mds.i.service 2024-06-02T04:47:36.587 INFO:journalctl@ceph.mds.f.smithi192.stdout:-- Logs begin at Sun 2024-06-02 04:25:37 UTC. -- 2024-06-02T04:47:36.589 DEBUG:teuthology.orchestra.run.smithi192:mds.l> sudo journalctl -f -n 0 -u ceph-60ab6d30-209a-11ef-bc9b-c7b262605968@mds.l.service 2024-06-02T04:47:36.617 INFO:journalctl@ceph.mds.i.smithi192.stdout:-- Logs begin at Sun 2024-06-02 04:25:37 UTC. -- 2024-06-02T04:47:36.617 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-06-02T04:47:36.618 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-02T04:47:36.645 INFO:journalctl@ceph.mds.l.smithi192.stdout:-- Logs begin at Sun 2024-06-02 04:25:37 UTC. -- 2024-06-02T04:47:36.762 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:36.760+0000 7fa9dc51e700 1 -- 172.21.15.76:0/1325397094 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa9d41006d0 msgr2=0x7fa9d4100b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:47:36.762 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:36.760+0000 7fa9dc51e700 1 --2- 172.21.15.76:0/1325397094 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa9d41006d0 0x7fa9d4100b30 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa9c40099c0 tx=0x7fa9c4009cd0 comp rx=0 tx=0).stop 2024-06-02T04:47:36.762 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:36.760+0000 7fa9dc51e700 1 -- 172.21.15.76:0/1325397094 shutdown_connections 2024-06-02T04:47:36.762 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:36.760+0000 7fa9dc51e700 1 --2- 172.21.15.76:0/1325397094 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa9d4101070 0x7fa9d4107920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:36.763 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:36.760+0000 7fa9dc51e700 1 --2- 172.21.15.76:0/1325397094 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa9d40ff4e0 0x7fa9d40ff900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:36.763 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:36.760+0000 7fa9dc51e700 1 --2- 172.21.15.76:0/1325397094 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa9d41006d0 0x7fa9d4100b30 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:36.763 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:36.760+0000 7fa9dc51e700 1 -- 172.21.15.76:0/1325397094 >> 172.21.15.76:0/1325397094 conn(0x7fa9d40faa70 msgr2=0x7fa9d40fce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:47:36.763 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:36.760+0000 7fa9dc51e700 1 -- 172.21.15.76:0/1325397094 shutdown_connections 2024-06-02T04:47:36.763 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:36.760+0000 7fa9dc51e700 1 -- 172.21.15.76:0/1325397094 wait complete. 2024-06-02T04:47:36.763 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:36.760+0000 7fa9dc51e700 1 Processor -- start 2024-06-02T04:47:36.763 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:36.760+0000 7fa9dc51e700 1 -- start start 2024-06-02T04:47:36.763 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:36.761+0000 7fa9dc51e700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa9d40ff4e0 0x7fa9d41035b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:47:36.763 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:36.761+0000 7fa9dc51e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa9d41006d0 0x7fa9d4101c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:47:36.763 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:36.761+0000 7fa9dc51e700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa9d4101070 0x7fa9d4102180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:47:36.763 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:36.761+0000 7fa9dc51e700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d4102920 con 0x7fa9d40ff4e0 2024-06-02T04:47:36.763 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:36.761+0000 7fa9dc51e700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d4102a90 con 0x7fa9d4101070 2024-06-02T04:47:36.763 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:36.761+0000 7fa9dc51e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d41a0d60 con 0x7fa9d41006d0 2024-06-02T04:47:36.764 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:36.761+0000 7fa9da2ba700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa9d40ff4e0 0x7fa9d41035b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:47:36.764 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:36.761+0000 7fa9da2ba700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa9d40ff4e0 0x7fa9d41035b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:49072/0 (socket says 172.21.15.76:49072) 2024-06-02T04:47:36.764 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:36.761+0000 7fa9da2ba700 1 -- 172.21.15.76:0/3633923556 learned_addr learned my addr 172.21.15.76:0/3633923556 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:47:36.764 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:36.761+0000 7fa9daabb700 1 --2- 172.21.15.76:0/3633923556 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa9d4101070 0x7fa9d4102180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:47:36.764 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:36.761+0000 7fa9d9ab9700 1 --2- 172.21.15.76:0/3633923556 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa9d41006d0 0x7fa9d4101c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:47:36.764 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:36.761+0000 7fa9da2ba700 1 -- 172.21.15.76:0/3633923556 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa9d41006d0 msgr2=0x7fa9d4101c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:47:36.764 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:36.761+0000 7fa9da2ba700 1 --2- 172.21.15.76:0/3633923556 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa9d41006d0 0x7fa9d4101c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:36.764 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:36.761+0000 7fa9da2ba700 1 -- 172.21.15.76:0/3633923556 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa9d4101070 msgr2=0x7fa9d4102180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:47:36.764 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:36.761+0000 7fa9da2ba700 1 --2- 172.21.15.76:0/3633923556 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa9d4101070 0x7fa9d4102180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:36.764 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:36.761+0000 7fa9da2ba700 1 -- 172.21.15.76:0/3633923556 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9c40095f0 con 0x7fa9d40ff4e0 2024-06-02T04:47:36.764 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:36.761+0000 7fa9da2ba700 1 --2- 172.21.15.76:0/3633923556 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa9d40ff4e0 0x7fa9d41035b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa9d000e950 tx=0x7fa9d000ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:47:36.764 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:36.761+0000 7fa9cb7fe700 1 -- 172.21.15.76:0/3633923556 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d0009770 con 0x7fa9d40ff4e0 2024-06-02T04:47:36.764 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:36.761+0000 7fa9cb7fe700 1 -- 172.21.15.76:0/3633923556 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa9d0004030 con 0x7fa9d40ff4e0 2024-06-02T04:47:36.764 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:36.761+0000 7fa9dc51e700 1 -- 172.21.15.76:0/3633923556 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9d41a0ff0 con 0x7fa9d40ff4e0 2024-06-02T04:47:36.765 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:36.761+0000 7fa9cb7fe700 1 -- 172.21.15.76:0/3633923556 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d0003cc0 con 0x7fa9d40ff4e0 2024-06-02T04:47:36.765 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:36.761+0000 7fa9dc51e700 1 -- 172.21.15.76:0/3633923556 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9d41a13c0 con 0x7fa9d40ff4e0 2024-06-02T04:47:36.765 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:36.762+0000 7fa9dc51e700 1 -- 172.21.15.76:0/3633923556 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9d4067380 con 0x7fa9d40ff4e0 2024-06-02T04:47:36.765 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:36.763+0000 7fa9cb7fe700 1 -- 172.21.15.76:0/3633923556 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fa9d00041a0 con 0x7fa9d40ff4e0 2024-06-02T04:47:36.765 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:36.764+0000 7fa9cb7fe700 1 --2- 172.21.15.76:0/3633923556 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fa9c00a1120 0x7fa9c00a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:47:36.766 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:36.764+0000 7fa9d9ab9700 1 --2- 172.21.15.76:0/3633923556 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fa9c00a1120 0x7fa9c00a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:47:36.766 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:36.764+0000 7fa9cb7fe700 1 -- 172.21.15.76:0/3633923556 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fa9d0014070 con 0x7fa9d40ff4e0 2024-06-02T04:47:36.766 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:36.764+0000 7fa9d9ab9700 1 --2- 172.21.15.76:0/3633923556 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fa9c00a1120 0x7fa9c00a35e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa9c400b580 tx=0x7fa9c401a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:47:36.768 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:36.768+0000 7fa9cb7fe700 1 -- 172.21.15.76:0/3633923556 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fa9d0096440 con 0x7fa9d40ff4e0 2024-06-02T04:47:36.970 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:36.970+0000 7fa9dc51e700 1 -- 172.21.15.76:0/3633923556 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa9d410a3b0 con 0x7fa9d40ff4e0 2024-06-02T04:47:36.971 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:36.971+0000 7fa9cb7fe700 1 -- 172.21.15.76:0/3633923556 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+18446 (secure 0 0 0) 0x7fa9d0099a60 con 0x7fa9d40ff4e0 2024-06-02T04:47:36.972 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:47:36.972 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":72,"fsid":"60ab6d30-209a-11ef-bc9b-c7b262605968","created":"2024-06-02T04:42:21.007333+0000","modified":"2024-06-02T04:47:30.832570+0000","last_up_change":"2024-06-02T04:47:29.822242+0000","last_in_change":"2024-06-02T04:47:14.253449+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T04:44:56.408602+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"33a51ba2-be5c-41d0-b5d1-8d6039f2ca4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6802","nonce":2869602045},{"type":"v1","addr":"172.21.15.76:6803","nonce":2869602045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6804","nonce":2869602045},{"type":"v1","addr":"172.21.15.76:6805","nonce":2869602045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6808","nonce":2869602045},{"type":"v1","addr":"172.21.15.76:6809","nonce":2869602045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6806","nonce":2869602045},{"type":"v1","addr":"172.21.15.76:6807","nonce":2869602045}]},"public_addr":"172.21.15.76:6803/2869602045","cluster_addr":"172.21.15.76:6805/2869602045","heartbeat_back_addr":"172.21.15.76:6809/2869602045","heartbeat_front_addr":"172.21.15.76:6807/2869602045","state":["exists","up"]},{"osd":1,"uuid":"ace46e13-3bb7-4103-973a-6860554df8b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":2353738098},{"type":"v1","addr":"172.21.15.119:6801","nonce":2353738098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":2353738098},{"type":"v1","addr":"172.21.15.119:6803","nonce":2353738098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":2353738098},{"type":"v1","addr":"172.21.15.119:6807","nonce":2353738098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":2353738098},{"type":"v1","addr":"172.21.15.119:6805","nonce":2353738098}]},"public_addr":"172.21.15.119:6801/2353738098","cluster_addr":"172.21.15.119:6803/2353738098","heartbeat_back_addr":"172.21.15.119:6807/2353738098","heartbeat_front_addr":"172.21.15.119:6805/2353738098","state":["exists","up"]},{"osd":2,"uuid":"4addc09e-77a9-428a-bcc4-38194f486cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":3206918546},{"type":"v1","addr":"172.21.15.192:6801","nonce":3206918546}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":3206918546},{"type":"v1","addr":"172.21.15.192:6803","nonce":3206918546}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":3206918546},{"type":"v1","addr":"172.21.15.192:6807","nonce":3206918546}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":3206918546},{"type":"v1","addr":"172.21.15.192:6805","nonce":3206918546}]},"public_addr":"172.21.15.192:6801/3206918546","cluster_addr":"172.21.15.192:6803/3206918546","heartbeat_back_addr":"172.21.15.192:6807/3206918546","heartbeat_front_addr":"172.21.15.192:6805/3206918546","state":["exists","up"]},{"osd":3,"uuid":"dc525518-82c6-49ed-8ca8-e3bd5bfc18d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6810","nonce":3747864233},{"type":"v1","addr":"172.21.15.76:6811","nonce":3747864233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6812","nonce":3747864233},{"type":"v1","addr":"172.21.15.76:6813","nonce":3747864233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6816","nonce":3747864233},{"type":"v1","addr":"172.21.15.76:6817","nonce":3747864233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6814","nonce":3747864233},{"type":"v1","addr":"172.21.15.76:6815","nonce":3747864233}]},"public_addr":"172.21.15.76:6811/3747864233","cluster_addr":"172.21.15.76:6813/3747864233","heartbeat_back_addr":"172.21.15.76:6817/3747864233","heartbeat_front_addr":"172.21.15.76:6815/3747864233","state":["exists","up"]},{"osd":4,"uuid":"eef293d0-cb87-47b3-9751-c6437a1cf079","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":2571629047},{"type":"v1","addr":"172.21.15.119:6809","nonce":2571629047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":2571629047},{"type":"v1","addr":"172.21.15.119:6811","nonce":2571629047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":2571629047},{"type":"v1","addr":"172.21.15.119:6815","nonce":2571629047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":2571629047},{"type":"v1","addr":"172.21.15.119:6813","nonce":2571629047}]},"public_addr":"172.21.15.119:6809/2571629047","cluster_addr":"172.21.15.119:6811/2571629047","heartbeat_back_addr":"172.21.15.119:6815/2571629047","heartbeat_front_addr":"172.21.15.119:6813/2571629047","state":["exists","up"]},{"osd":5,"uuid":"60eb8c6e-766c-49d0-9997-44f85776b3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3285065416},{"type":"v1","addr":"172.21.15.192:6809","nonce":3285065416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":3285065416},{"type":"v1","addr":"172.21.15.192:6811","nonce":3285065416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3285065416},{"type":"v1","addr":"172.21.15.192:6815","nonce":3285065416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":3285065416},{"type":"v1","addr":"172.21.15.192:6813","nonce":3285065416}]},"public_addr":"172.21.15.192:6809/3285065416","cluster_addr":"172.21.15.192:6811/3285065416","heartbeat_back_addr":"172.21.15.192:6815/3285065416","heartbeat_front_addr":"172.21.15.192:6813/3285065416","state":["exists","up"]},{"osd":6,"uuid":"e6dc8b9d-dd06-4870-a506-def8201b7e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6818","nonce":2951381580},{"type":"v1","addr":"172.21.15.76:6819","nonce":2951381580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6820","nonce":2951381580},{"type":"v1","addr":"172.21.15.76:6821","nonce":2951381580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6824","nonce":2951381580},{"type":"v1","addr":"172.21.15.76:6825","nonce":2951381580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6822","nonce":2951381580},{"type":"v1","addr":"172.21.15.76:6823","nonce":2951381580}]},"public_addr":"172.21.15.76:6819/2951381580","cluster_addr":"172.21.15.76:6821/2951381580","heartbeat_back_addr":"172.21.15.76:6825/2951381580","heartbeat_front_addr":"172.21.15.76:6823/2951381580","state":["exists","up"]},{"osd":7,"uuid":"2f5dccb3-39a1-4f25-8715-fa264d59db97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1802558756},{"type":"v1","addr":"172.21.15.119:6817","nonce":1802558756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1802558756},{"type":"v1","addr":"172.21.15.119:6819","nonce":1802558756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1802558756},{"type":"v1","addr":"172.21.15.119:6823","nonce":1802558756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1802558756},{"type":"v1","addr":"172.21.15.119:6821","nonce":1802558756}]},"public_addr":"172.21.15.119:6817/1802558756","cluster_addr":"172.21.15.119:6819/1802558756","heartbeat_back_addr":"172.21.15.119:6823/1802558756","heartbeat_front_addr":"172.21.15.119:6821/1802558756","state":["exists","up"]},{"osd":8,"uuid":"39b6ccd0-16e7-4cd5-87e0-d827e9172984","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":1214972276},{"type":"v1","addr":"172.21.15.192:6817","nonce":1214972276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":1214972276},{"type":"v1","addr":"172.21.15.192:6819","nonce":1214972276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":1214972276},{"type":"v1","addr":"172.21.15.192:6823","nonce":1214972276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":1214972276},{"type":"v1","addr":"172.21.15.192:6821","nonce":1214972276}]},"public_addr":"172.21.15.192:6817/1214972276","cluster_addr":"172.21.15.192:6819/1214972276","heartbeat_back_addr":"172.21.15.192:6823/1214972276","heartbeat_front_addr":"172.21.15.192:6821/1214972276","state":["exists","up"]},{"osd":9,"uuid":"851b2155-07bd-45de-bfe0-53021fda733f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6826","nonce":3095501821},{"type":"v1","addr":"172.21.15.76:6827","nonce":3095501821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6828","nonce":3095501821},{"type":"v1","addr":"172.21.15.76:6829","nonce":3095501821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":3095501821},{"type":"v1","addr":"172.21.15.76:6833","nonce":3095501821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6830","nonce":3095501821},{"type":"v1","addr":"172.21.15.76:6831","nonce":3095501821}]},"public_addr":"172.21.15.76:6827/3095501821","cluster_addr":"172.21.15.76:6829/3095501821","heartbeat_back_addr":"172.21.15.76:6833/3095501821","heartbeat_front_addr":"172.21.15.76:6831/3095501821","state":["exists","up"]},{"osd":10,"uuid":"e4b18e7e-bddf-4dd4-84f6-7902ea327cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":4082130894},{"type":"v1","addr":"172.21.15.119:6825","nonce":4082130894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":4082130894},{"type":"v1","addr":"172.21.15.119:6827","nonce":4082130894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":4082130894},{"type":"v1","addr":"172.21.15.119:6831","nonce":4082130894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":4082130894},{"type":"v1","addr":"172.21.15.119:6829","nonce":4082130894}]},"public_addr":"172.21.15.119:6825/4082130894","cluster_addr":"172.21.15.119:6827/4082130894","heartbeat_back_addr":"172.21.15.119:6831/4082130894","heartbeat_front_addr":"172.21.15.119:6829/4082130894","state":["exists","up"]},{"osd":11,"uuid":"54567e18-920c-4ae9-9557-0efba5a1a820","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":439693921},{"type":"v1","addr":"172.21.15.192:6825","nonce":439693921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":439693921},{"type":"v1","addr":"172.21.15.192:6827","nonce":439693921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":439693921},{"type":"v1","addr":"172.21.15.192:6831","nonce":439693921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":439693921},{"type":"v1","addr":"172.21.15.192:6829","nonce":439693921}]},"public_addr":"172.21.15.192:6825/439693921","cluster_addr":"172.21.15.192:6827/439693921","heartbeat_back_addr":"172.21.15.192:6831/439693921","heartbeat_front_addr":"172.21.15.192:6829/439693921","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:44:19.922390+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:44:36.895563+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:44:53.699019+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:45:11.167404+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:45:27.955899+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:45:44.850368+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:46:02.003588+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:46:19.019217+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:46:36.189670+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:46:53.919365+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:47:11.563053+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:47:28.822443+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.76:6801/4200406736":"2024-06-03T04:43:06.092916+0000","172.21.15.76:6800/4200406736":"2024-06-03T04:43:06.092916+0000","172.21.15.76:0/1524144593":"2024-06-03T04:43:06.092916+0000","172.21.15.76:0/3269372590":"2024-06-03T04:43:06.092916+0000","172.21.15.76:0/3570893846":"2024-06-03T04:42:44.872236+0000","172.21.15.76:0/902035790":"2024-06-03T04:43:06.092916+0000","172.21.15.76:6800/2550846765":"2024-06-03T04:42:44.872236+0000","172.21.15.76:6801/2550846765":"2024-06-03T04:42:44.872236+0000","172.21.15.76:0/2646712763":"2024-06-03T04:42:44.872236+0000","172.21.15.76:0/964578813":"2024-06-03T04:42:44.872236+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T04:47:36.974 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:36.973+0000 7fa9dc51e700 1 -- 172.21.15.76:0/3633923556 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fa9c00a1120 msgr2=0x7fa9c00a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:47:36.974 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:36.973+0000 7fa9dc51e700 1 --2- 172.21.15.76:0/3633923556 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fa9c00a1120 0x7fa9c00a35e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa9c400b580 tx=0x7fa9c401a040 comp rx=0 tx=0).stop 2024-06-02T04:47:36.974 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:36.973+0000 7fa9dc51e700 1 -- 172.21.15.76:0/3633923556 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa9d40ff4e0 msgr2=0x7fa9d41035b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:47:36.974 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:36.973+0000 7fa9dc51e700 1 --2- 172.21.15.76:0/3633923556 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa9d40ff4e0 0x7fa9d41035b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa9d000e950 tx=0x7fa9d000ed10 comp rx=0 tx=0).stop 2024-06-02T04:47:36.974 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:36.973+0000 7fa9dc51e700 1 -- 172.21.15.76:0/3633923556 shutdown_connections 2024-06-02T04:47:36.974 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:36.973+0000 7fa9dc51e700 1 --2- 172.21.15.76:0/3633923556 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fa9c00a1120 0x7fa9c00a35e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:36.974 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:36.973+0000 7fa9dc51e700 1 --2- 172.21.15.76:0/3633923556 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa9d4101070 0x7fa9d4102180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:36.974 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:36.973+0000 7fa9dc51e700 1 --2- 172.21.15.76:0/3633923556 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa9d40ff4e0 0x7fa9d41035b0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:36.974 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:36.973+0000 7fa9dc51e700 1 --2- 172.21.15.76:0/3633923556 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa9d41006d0 0x7fa9d4101c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:36.974 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:36.973+0000 7fa9dc51e700 1 -- 172.21.15.76:0/3633923556 >> 172.21.15.76:0/3633923556 conn(0x7fa9d40faa70 msgr2=0x7fa9d4105ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:47:36.974 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:36.973+0000 7fa9dc51e700 1 -- 172.21.15.76:0/3633923556 shutdown_connections 2024-06-02T04:47:36.975 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:36.973+0000 7fa9dc51e700 1 -- 172.21.15.76:0/3633923556 wait complete. 2024-06-02T04:47:36.986 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-06-02T04:44:56.408602+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-06-02T04:47:36.987 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-06-02T04:47:37.113 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:37.111+0000 7fc2802bf700 1 -- 172.21.15.76:0/3392001325 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc2781022b0 msgr2=0x7fc278102710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:47:37.113 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:37.111+0000 7fc2802bf700 1 --2- 172.21.15.76:0/3392001325 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc2781022b0 0x7fc278102710 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc274009990 tx=0x7fc274009ca0 comp rx=0 tx=0).stop 2024-06-02T04:47:37.113 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:37.111+0000 7fc2802bf700 1 -- 172.21.15.76:0/3392001325 shutdown_connections 2024-06-02T04:47:37.113 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:37.111+0000 7fc2802bf700 1 --2- 172.21.15.76:0/3392001325 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc278102c50 0x7fc278109500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:37.114 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:37.111+0000 7fc2802bf700 1 --2- 172.21.15.76:0/3392001325 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc2780ff240 0x7fc2780ff660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:37.114 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:37.111+0000 7fc2802bf700 1 --2- 172.21.15.76:0/3392001325 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc2781022b0 0x7fc278102710 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:37.114 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:37.111+0000 7fc2802bf700 1 -- 172.21.15.76:0/3392001325 >> 172.21.15.76:0/3392001325 conn(0x7fc2780fab50 msgr2=0x7fc2780fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:47:37.114 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:37.111+0000 7fc2802bf700 1 -- 172.21.15.76:0/3392001325 shutdown_connections 2024-06-02T04:47:37.114 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:37.111+0000 7fc2802bf700 1 -- 172.21.15.76:0/3392001325 wait complete. 2024-06-02T04:47:37.114 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:37.112+0000 7fc2802bf700 1 Processor -- start 2024-06-02T04:47:37.114 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:37.112+0000 7fc2802bf700 1 -- start start 2024-06-02T04:47:37.114 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:37.112+0000 7fc2802bf700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc2780ff240 0x7fc278196e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:47:37.114 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:37.112+0000 7fc2802bf700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc2781022b0 0x7fc278197360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:47:37.114 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:37.112+0000 7fc2802bf700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc278102c50 0x7fc27819e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:47:37.114 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:37.112+0000 7fc2802bf700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc27819e950 con 0x7fc2780ff240 2024-06-02T04:47:37.114 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:37.112+0000 7fc2802bf700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc27819ea90 con 0x7fc2781022b0 2024-06-02T04:47:37.115 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:37.112+0000 7fc2802bf700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc27819ec20 con 0x7fc278102c50 2024-06-02T04:47:37.115 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:37.112+0000 7fc27e05b700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc2780ff240 0x7fc278196e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:47:37.115 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:37.112+0000 7fc27e05b700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc2780ff240 0x7fc278196e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:49086/0 (socket says 172.21.15.76:49086) 2024-06-02T04:47:37.115 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:37.112+0000 7fc27e05b700 1 -- 172.21.15.76:0/86293042 learned_addr learned my addr 172.21.15.76:0/86293042 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:47:37.115 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:37.112+0000 7fc27d85a700 1 --2- 172.21.15.76:0/86293042 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc2781022b0 0x7fc278197360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:47:37.115 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:37.112+0000 7fc27e05b700 1 -- 172.21.15.76:0/86293042 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc278102c50 msgr2=0x7fc27819e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:47:37.115 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:37.112+0000 7fc27e05b700 1 --2- 172.21.15.76:0/86293042 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc278102c50 0x7fc27819e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:37.115 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:37.112+0000 7fc27e05b700 1 -- 172.21.15.76:0/86293042 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc2781022b0 msgr2=0x7fc278197360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:47:37.115 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:37.112+0000 7fc27e05b700 1 --2- 172.21.15.76:0/86293042 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc2781022b0 0x7fc278197360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:37.115 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:37.112+0000 7fc27e05b700 1 -- 172.21.15.76:0/86293042 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2740095f0 con 0x7fc2780ff240 2024-06-02T04:47:37.115 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:37.112+0000 7fc27e05b700 1 --2- 172.21.15.76:0/86293042 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc2780ff240 0x7fc278196e20 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc26c00c970 tx=0x7fc26c00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:47:37.116 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:37.112+0000 7fc26b7fe700 1 -- 172.21.15.76:0/86293042 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc26c004220 con 0x7fc2780ff240 2024-06-02T04:47:37.116 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:37.112+0000 7fc26b7fe700 1 -- 172.21.15.76:0/86293042 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc26c007d30 con 0x7fc2780ff240 2024-06-02T04:47:37.116 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:37.112+0000 7fc2802bf700 1 -- 172.21.15.76:0/86293042 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc27819ef00 con 0x7fc2780ff240 2024-06-02T04:47:37.116 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:37.112+0000 7fc26b7fe700 1 -- 172.21.15.76:0/86293042 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc26c003b80 con 0x7fc2780ff240 2024-06-02T04:47:37.117 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:37.113+0000 7fc2802bf700 1 -- 172.21.15.76:0/86293042 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc27819f320 con 0x7fc2780ff240 2024-06-02T04:47:37.117 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:37.113+0000 7fc2802bf700 1 -- 172.21.15.76:0/86293042 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc278108530 con 0x7fc2780ff240 2024-06-02T04:47:37.117 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:37.115+0000 7fc26b7fe700 1 -- 172.21.15.76:0/86293042 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fc26c003ce0 con 0x7fc2780ff240 2024-06-02T04:47:37.117 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:37.115+0000 7fc26b7fe700 1 --2- 172.21.15.76:0/86293042 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fc2640a1120 0x7fc2640a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:47:37.117 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:37.115+0000 7fc27d85a700 1 --2- 172.21.15.76:0/86293042 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fc2640a1120 0x7fc2640a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:47:37.117 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:37.115+0000 7fc26b7fe700 1 -- 172.21.15.76:0/86293042 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fc26c0cc430 con 0x7fc2780ff240 2024-06-02T04:47:37.117 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:37.116+0000 7fc27d85a700 1 --2- 172.21.15.76:0/86293042 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fc2640a1120 0x7fc2640a35e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc274000c00 tx=0x7fc274005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:47:37.119 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:37.119+0000 7fc26b7fe700 1 -- 172.21.15.76:0/86293042 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fc26c096060 con 0x7fc2780ff240 2024-06-02T04:47:37.125 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:36 smithi192 ceph-mon[47933]: from='client.24406 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi076=a;smithi076=d;smithi076=g;smithi076=j;smithi119=b;smithi119=e;smithi119=h;smithi119=k;smithi192=c;smithi192=f;smithi192=i;smithi192=l", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:47:37.125 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:36 smithi192 ceph-mon[47933]: Saving service mds.all spec with placement smithi076=a;smithi076=d;smithi076=g;smithi076=j;smithi119=b;smithi119=e;smithi119=h;smithi119=k;smithi192=c;smithi192=f;smithi192=i;smithi192=l;count:12 2024-06-02T04:47:37.125 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:36 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:37.125 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:36 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:47:37.125 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:36 smithi192 ceph-mon[47933]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T04:47:37.126 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:36 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:47:37.126 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:36 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:47:37.126 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:36 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:37.126 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:36 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T04:47:37.126 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:36 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T04:47:37.126 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:36 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:47:37.127 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:36 smithi192 ceph-mon[47933]: Deploying daemon mds.l on smithi192 2024-06-02T04:47:37.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:36 smithi076 ceph-mon[42935]: from='client.24406 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi076=a;smithi076=d;smithi076=g;smithi076=j;smithi119=b;smithi119=e;smithi119=h;smithi119=k;smithi192=c;smithi192=f;smithi192=i;smithi192=l", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:47:37.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:36 smithi076 ceph-mon[42935]: Saving service mds.all spec with placement smithi076=a;smithi076=d;smithi076=g;smithi076=j;smithi119=b;smithi119=e;smithi119=h;smithi119=k;smithi192=c;smithi192=f;smithi192=i;smithi192=l;count:12 2024-06-02T04:47:37.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:36 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:37.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:36 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:47:37.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:36 smithi076 ceph-mon[42935]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T04:47:37.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:36 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:47:37.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:36 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:47:37.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:36 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:37.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:36 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T04:47:37.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:36 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T04:47:37.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:36 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:47:37.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:36 smithi076 ceph-mon[42935]: Deploying daemon mds.l on smithi192 2024-06-02T04:47:37.315 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:37.315+0000 7fc2802bf700 1 -- 172.21.15.76:0/86293042 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc27810c680 con 0x7fc2780ff240 2024-06-02T04:47:37.315 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:37.315+0000 7fc26b7fe700 1 -- 172.21.15.76:0/86293042 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v72) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc26c099680 con 0x7fc2780ff240 2024-06-02T04:47:37.315 INFO:teuthology.orchestra.run.smithi076.stdout:pg_num: 1 2024-06-02T04:47:37.318 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:37.317+0000 7fc2802bf700 1 -- 172.21.15.76:0/86293042 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fc2640a1120 msgr2=0x7fc2640a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:47:37.318 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:37.317+0000 7fc2802bf700 1 --2- 172.21.15.76:0/86293042 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fc2640a1120 0x7fc2640a35e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc274000c00 tx=0x7fc274005fb0 comp rx=0 tx=0).stop 2024-06-02T04:47:37.318 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:37.317+0000 7fc2802bf700 1 -- 172.21.15.76:0/86293042 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc2780ff240 msgr2=0x7fc278196e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:47:37.318 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:37.317+0000 7fc2802bf700 1 --2- 172.21.15.76:0/86293042 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc2780ff240 0x7fc278196e20 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc26c00c970 tx=0x7fc26c00cc80 comp rx=0 tx=0).stop 2024-06-02T04:47:37.318 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:37.317+0000 7fc2802bf700 1 -- 172.21.15.76:0/86293042 shutdown_connections 2024-06-02T04:47:37.318 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:37.317+0000 7fc2802bf700 1 --2- 172.21.15.76:0/86293042 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc278102c50 0x7fc27819e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:37.318 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:37.317+0000 7fc2802bf700 1 --2- 172.21.15.76:0/86293042 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc2780ff240 0x7fc278196e20 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:37.318 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:37.317+0000 7fc2802bf700 1 --2- 172.21.15.76:0/86293042 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fc2640a1120 0x7fc2640a35e0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:37.318 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:37.317+0000 7fc2802bf700 1 --2- 172.21.15.76:0/86293042 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc2781022b0 0x7fc278197360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:37.318 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:37.317+0000 7fc2802bf700 1 -- 172.21.15.76:0/86293042 >> 172.21.15.76:0/86293042 conn(0x7fc2780fab50 msgr2=0x7fc278105670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:47:37.318 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:37.317+0000 7fc2802bf700 1 -- 172.21.15.76:0/86293042 shutdown_connections 2024-06-02T04:47:37.319 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:37.317+0000 7fc2802bf700 1 -- 172.21.15.76:0/86293042 wait complete. 2024-06-02T04:47:37.330 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T04:47:37.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:36 smithi119 ceph-mon[46633]: from='client.24406 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi076=a;smithi076=d;smithi076=g;smithi076=j;smithi119=b;smithi119=e;smithi119=h;smithi119=k;smithi192=c;smithi192=f;smithi192=i;smithi192=l", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:47:37.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:36 smithi119 ceph-mon[46633]: Saving service mds.all spec with placement smithi076=a;smithi076=d;smithi076=g;smithi076=j;smithi119=b;smithi119=e;smithi119=h;smithi119=k;smithi192=c;smithi192=f;smithi192=i;smithi192=l;count:12 2024-06-02T04:47:37.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:36 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:37.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:36 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:47:37.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:36 smithi119 ceph-mon[46633]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T04:47:37.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:36 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:47:37.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:36 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:47:37.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:36 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:37.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:36 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T04:47:37.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:36 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T04:47:37.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:36 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:47:37.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:36 smithi119 ceph-mon[46633]: Deploying daemon mds.l on smithi192 2024-06-02T04:47:37.454 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:37.452+0000 7f1b8cc06700 1 -- 172.21.15.76:0/2627967532 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1b88102990 msgr2=0x7f1b881092b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:47:37.454 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:37.452+0000 7f1b8cc06700 1 --2- 172.21.15.76:0/2627967532 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1b88102990 0x7f1b881092b0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f1b8000b0a0 tx=0x7f1b8000b3b0 comp rx=0 tx=0).stop 2024-06-02T04:47:37.455 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:37.452+0000 7f1b8cc06700 1 -- 172.21.15.76:0/2627967532 shutdown_connections 2024-06-02T04:47:37.455 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:37.452+0000 7f1b8cc06700 1 --2- 172.21.15.76:0/2627967532 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1b88102990 0x7f1b881092b0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:37.455 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:37.452+0000 7f1b8cc06700 1 --2- 172.21.15.76:0/2627967532 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1b88100e80 0x7f1b881012a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:37.455 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:37.452+0000 7f1b8cc06700 1 --2- 172.21.15.76:0/2627967532 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1b88101fd0 0x7f1b88102450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:37.455 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:37.452+0000 7f1b8cc06700 1 -- 172.21.15.76:0/2627967532 >> 172.21.15.76:0/2627967532 conn(0x7f1b880fc410 msgr2=0x7f1b880fe830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:47:37.455 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:37.452+0000 7f1b8cc06700 1 -- 172.21.15.76:0/2627967532 shutdown_connections 2024-06-02T04:47:37.455 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:37.452+0000 7f1b8cc06700 1 -- 172.21.15.76:0/2627967532 wait complete. 2024-06-02T04:47:37.455 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:37.453+0000 7f1b8cc06700 1 Processor -- start 2024-06-02T04:47:37.455 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:37.453+0000 7f1b8cc06700 1 -- start start 2024-06-02T04:47:37.455 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:37.453+0000 7f1b8cc06700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1b88100e80 0x7f1b88196e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:47:37.455 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:37.453+0000 7f1b8cc06700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1b88101fd0 0x7f1b88197380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:47:37.455 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:37.453+0000 7f1b8cc06700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1b88102990 0x7f1b8819e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:47:37.455 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:37.453+0000 7f1b8cc06700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b8819e970 con 0x7f1b88102990 2024-06-02T04:47:37.456 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:37.453+0000 7f1b8cc06700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b8819eab0 con 0x7f1b88101fd0 2024-06-02T04:47:37.456 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:37.453+0000 7f1b8cc06700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b8819ec40 con 0x7f1b88100e80 2024-06-02T04:47:37.456 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:37.453+0000 7f1b86d9d700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1b88102990 0x7f1b8819e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:47:37.456 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:37.453+0000 7f1b86d9d700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1b88102990 0x7f1b8819e3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:49094/0 (socket says 172.21.15.76:49094) 2024-06-02T04:47:37.456 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:37.453+0000 7f1b86d9d700 1 -- 172.21.15.76:0/2627952301 learned_addr learned my addr 172.21.15.76:0/2627952301 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:47:37.456 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:37.453+0000 7f1b85d9b700 1 --2- 172.21.15.76:0/2627952301 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1b88101fd0 0x7f1b88197380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:47:37.456 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:37.453+0000 7f1b86d9d700 1 -- 172.21.15.76:0/2627952301 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1b88100e80 msgr2=0x7f1b88196e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:47:37.456 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:37.453+0000 7f1b86d9d700 1 --2- 172.21.15.76:0/2627952301 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1b88100e80 0x7f1b88196e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:37.456 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:37.453+0000 7f1b86d9d700 1 -- 172.21.15.76:0/2627952301 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1b88101fd0 msgr2=0x7f1b88197380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:47:37.456 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:37.453+0000 7f1b86d9d700 1 --2- 172.21.15.76:0/2627952301 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1b88101fd0 0x7f1b88197380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:37.456 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:37.453+0000 7f1b86d9d700 1 -- 172.21.15.76:0/2627952301 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b80009d00 con 0x7f1b88102990 2024-06-02T04:47:37.456 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:37.453+0000 7f1b86d9d700 1 --2- 172.21.15.76:0/2627952301 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1b88102990 0x7f1b8819e3a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1b80004ce0 tx=0x7f1b80004dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:47:37.457 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:37.454+0000 7f1b777fe700 1 -- 172.21.15.76:0/2627952301 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b8000e040 con 0x7f1b88102990 2024-06-02T04:47:37.457 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:37.454+0000 7f1b777fe700 1 -- 172.21.15.76:0/2627952301 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1b8000ce60 con 0x7f1b88102990 2024-06-02T04:47:37.457 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:37.454+0000 7f1b8cc06700 1 -- 172.21.15.76:0/2627952301 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b8819eec0 con 0x7f1b88102990 2024-06-02T04:47:37.457 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:37.454+0000 7f1b777fe700 1 -- 172.21.15.76:0/2627952301 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b8001bb20 con 0x7f1b88102990 2024-06-02T04:47:37.457 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:37.454+0000 7f1b8cc06700 1 -- 172.21.15.76:0/2627952301 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b8819f2f0 con 0x7f1b88102990 2024-06-02T04:47:37.458 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:37.455+0000 7f1b8cc06700 1 -- 172.21.15.76:0/2627952301 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b881082f0 con 0x7f1b88102990 2024-06-02T04:47:37.458 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:37.456+0000 7f1b777fe700 1 -- 172.21.15.76:0/2627952301 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f1b8001bc80 con 0x7f1b88102990 2024-06-02T04:47:37.458 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:37.456+0000 7f1b777fe700 1 --2- 172.21.15.76:0/2627952301 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f1b700a11a0 0x7f1b700a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:47:37.458 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:37.456+0000 7f1b8659c700 1 --2- 172.21.15.76:0/2627952301 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f1b700a11a0 0x7f1b700a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:47:37.458 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:37.456+0000 7f1b777fe700 1 -- 172.21.15.76:0/2627952301 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f1b800ce260 con 0x7f1b88102990 2024-06-02T04:47:37.458 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:37.456+0000 7f1b8659c700 1 --2- 172.21.15.76:0/2627952301 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f1b700a11a0 0x7f1b700a3660 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c0097b0 tx=0x7f1b7c006d20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:47:37.460 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:37.460+0000 7f1b777fe700 1 -- 172.21.15.76:0/2627952301 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f1b80097f20 con 0x7f1b88102990 2024-06-02T04:47:37.700 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:37.699+0000 7f1b8cc06700 1 -- 172.21.15.76:0/2627952301 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1b88067c10 con 0x7f1b88102990 2024-06-02T04:47:37.700 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:37.700+0000 7f1b777fe700 1 -- 172.21.15.76:0/2627952301 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) v1 ==== 93+0+501 (secure 0 0 0) 0x7f1b8009b540 con 0x7f1b88102990 2024-06-02T04:47:37.700 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:47:37.701 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-06-02T04:47:37.702 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:37.702+0000 7f1b8cc06700 1 -- 172.21.15.76:0/2627952301 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f1b700a11a0 msgr2=0x7f1b700a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:47:37.702 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:37.702+0000 7f1b8cc06700 1 --2- 172.21.15.76:0/2627952301 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f1b700a11a0 0x7f1b700a3660 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c0097b0 tx=0x7f1b7c006d20 comp rx=0 tx=0).stop 2024-06-02T04:47:37.703 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:37.702+0000 7f1b8cc06700 1 -- 172.21.15.76:0/2627952301 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1b88102990 msgr2=0x7f1b8819e3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:47:37.703 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:37.702+0000 7f1b8cc06700 1 --2- 172.21.15.76:0/2627952301 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1b88102990 0x7f1b8819e3a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1b80004ce0 tx=0x7f1b80004dc0 comp rx=0 tx=0).stop 2024-06-02T04:47:37.703 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:37.702+0000 7f1b8cc06700 1 -- 172.21.15.76:0/2627952301 shutdown_connections 2024-06-02T04:47:37.703 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:37.702+0000 7f1b8cc06700 1 --2- 172.21.15.76:0/2627952301 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1b88102990 0x7f1b8819e3a0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:37.703 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:37.702+0000 7f1b8cc06700 1 --2- 172.21.15.76:0/2627952301 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1b88100e80 0x7f1b88196e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:37.703 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:37.702+0000 7f1b8cc06700 1 --2- 172.21.15.76:0/2627952301 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f1b700a11a0 0x7f1b700a3660 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:37.703 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:37.702+0000 7f1b8cc06700 1 --2- 172.21.15.76:0/2627952301 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1b88101fd0 0x7f1b88197380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:37.703 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:37.702+0000 7f1b8cc06700 1 -- 172.21.15.76:0/2627952301 >> 172.21.15.76:0/2627952301 conn(0x7f1b880fc410 msgr2=0x7f1b88105430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:47:37.703 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:37.702+0000 7f1b8cc06700 1 -- 172.21.15.76:0/2627952301 shutdown_connections 2024-06-02T04:47:37.703 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:37.702+0000 7f1b8cc06700 1 -- 172.21.15.76:0/2627952301 wait complete. 2024-06-02T04:47:37.704 INFO:teuthology.orchestra.run.smithi076.stderr:dumped fsmap epoch 1 2024-06-02T04:47:37.786 INFO:journalctl@ceph.mds.l.smithi192.stdout:Jun 02 04:47:37 smithi192 systemd[1]: Starting Ceph mds.l for 60ab6d30-209a-11ef-bc9b-c7b262605968... 2024-06-02T04:47:37.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:37 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/3633923556' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:47:37.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:37 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/86293042' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-02T04:47:37.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:37 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/2627952301' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:47:38.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:37 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/3633923556' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:47:38.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:37 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/86293042' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-02T04:47:38.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:37 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/2627952301' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:47:38.182 INFO:journalctl@ceph.mds.l.smithi192.stdout:Jun 02 04:47:37 smithi192 ceph-mds[83627]: -- 172.21.15.192:0/2758284181 <== mon.1 v2:172.21.15.192:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x555a08b6a1a0 con 0x555a08b41000 2024-06-02T04:47:38.182 INFO:journalctl@ceph.mds.l.smithi192.stdout:Jun 02 04:47:37 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-l[83604]: starting mds.l at 2024-06-02T04:47:38.182 INFO:journalctl@ceph.mds.l.smithi192.stdout:Jun 02 04:47:37 smithi192 bash[83589]: 7cf3fdb293688ae3e78e839794fa723d0ad2764515eaf5fff258b5b07b75826d 2024-06-02T04:47:38.182 INFO:journalctl@ceph.mds.l.smithi192.stdout:Jun 02 04:47:37 smithi192 systemd[1]: Started Ceph mds.l for 60ab6d30-209a-11ef-bc9b-c7b262605968. 2024-06-02T04:47:38.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:37 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/3633923556' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:47:38.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:37 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/86293042' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-02T04:47:38.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:37 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/2627952301' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:47:39.170 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:38 smithi119 ceph-mon[46633]: mds.? [v2:172.21.15.192:6832/1527921393,v1:172.21.15.192:6833/1527921393] up:boot 2024-06-02T04:47:39.170 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:38 smithi119 ceph-mon[46633]: fsmap 1 up:standby 2024-06-02T04:47:39.170 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:38 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-06-02T04:47:39.170 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:38 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:39.170 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:38 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:39.171 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:38 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:39.171 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:38 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T04:47:39.171 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:38 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T04:47:39.171 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:38 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:47:39.171 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:38 smithi119 ceph-mon[46633]: Deploying daemon mds.k on smithi119 2024-06-02T04:47:39.171 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:38 smithi119 ceph-mon[46633]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T04:47:39.171 INFO:journalctl@ceph.mds.k.smithi119.stdout:Jun 02 04:47:39 smithi119 systemd[1]: Starting Ceph mds.k for 60ab6d30-209a-11ef-bc9b-c7b262605968... 2024-06-02T04:47:39.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:38 smithi076 ceph-mon[42935]: mds.? [v2:172.21.15.192:6832/1527921393,v1:172.21.15.192:6833/1527921393] up:boot 2024-06-02T04:47:39.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:38 smithi076 ceph-mon[42935]: fsmap 1 up:standby 2024-06-02T04:47:39.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:38 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-06-02T04:47:39.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:38 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:39.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:38 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:39.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:38 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:39.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:38 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T04:47:39.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:38 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T04:47:39.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:38 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:47:39.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:38 smithi076 ceph-mon[42935]: Deploying daemon mds.k on smithi119 2024-06-02T04:47:39.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:38 smithi076 ceph-mon[42935]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T04:47:39.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:38 smithi192 ceph-mon[47933]: mds.? [v2:172.21.15.192:6832/1527921393,v1:172.21.15.192:6833/1527921393] up:boot 2024-06-02T04:47:39.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:38 smithi192 ceph-mon[47933]: fsmap 1 up:standby 2024-06-02T04:47:39.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:38 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-06-02T04:47:39.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:38 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:39.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:38 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:39.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:38 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:39.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:38 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T04:47:39.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:38 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T04:47:39.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:38 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:47:39.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:38 smithi192 ceph-mon[47933]: Deploying daemon mds.k on smithi119 2024-06-02T04:47:39.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:38 smithi192 ceph-mon[47933]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T04:47:39.715 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T04:47:39.846 INFO:journalctl@ceph.mds.k.smithi119.stdout:Jun 02 04:47:39 smithi119 ceph-mds[82271]: -- 172.21.15.119:0/1510791344 <== mon.2 v2:172.21.15.119:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55a4a3e721a0 con 0x55a4a3e48c00 2024-06-02T04:47:39.847 INFO:journalctl@ceph.mds.k.smithi119.stdout:Jun 02 04:47:39 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-k[82248]: starting mds.k at 2024-06-02T04:47:39.847 INFO:journalctl@ceph.mds.k.smithi119.stdout:Jun 02 04:47:39 smithi119 bash[82233]: 63f53794290ea075075cf00b629125194d3e17f5de6a0682834431978f84c442 2024-06-02T04:47:39.847 INFO:journalctl@ceph.mds.k.smithi119.stdout:Jun 02 04:47:39 smithi119 systemd[1]: Started Ceph mds.k for 60ab6d30-209a-11ef-bc9b-c7b262605968. 2024-06-02T04:47:39.867 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:39.866+0000 7fd67afe2700 1 -- 172.21.15.76:0/3009888117 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd6741018e0 msgr2=0x7fd674103cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:47:39.868 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:39.866+0000 7fd67afe2700 1 --2- 172.21.15.76:0/3009888117 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd6741018e0 0x7fd674103cd0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd668009990 tx=0x7fd668009ca0 comp rx=0 tx=0).stop 2024-06-02T04:47:39.868 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:39.866+0000 7fd67afe2700 1 -- 172.21.15.76:0/3009888117 shutdown_connections 2024-06-02T04:47:39.868 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:39.866+0000 7fd67afe2700 1 --2- 172.21.15.76:0/3009888117 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd674106b40 0x7fd674108fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:39.868 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:39.866+0000 7fd67afe2700 1 --2- 172.21.15.76:0/3009888117 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd6741018e0 0x7fd674103cd0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:39.868 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:39.866+0000 7fd67afe2700 1 --2- 172.21.15.76:0/3009888117 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd674104210 0x7fd674106600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:39.868 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:39.866+0000 7fd67afe2700 1 -- 172.21.15.76:0/3009888117 >> 172.21.15.76:0/3009888117 conn(0x7fd6740fb2f0 msgr2=0x7fd6740fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:47:39.869 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:39.866+0000 7fd67afe2700 1 -- 172.21.15.76:0/3009888117 shutdown_connections 2024-06-02T04:47:39.869 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:39.866+0000 7fd67afe2700 1 -- 172.21.15.76:0/3009888117 wait complete. 2024-06-02T04:47:39.869 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:39.867+0000 7fd67afe2700 1 Processor -- start 2024-06-02T04:47:39.869 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:39.867+0000 7fd67afe2700 1 -- start start 2024-06-02T04:47:39.873 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:39.868+0000 7fd67afe2700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd6741018e0 0x7fd674196cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:47:39.874 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:39.868+0000 7fd67afe2700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd674104210 0x7fd674197230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:47:39.874 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:39.868+0000 7fd67afe2700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd674106b40 0x7fd67419e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:47:39.874 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:39.868+0000 7fd67afe2700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd67419e810 con 0x7fd674106b40 2024-06-02T04:47:39.874 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:39.868+0000 7fd67afe2700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd67419e980 con 0x7fd674104210 2024-06-02T04:47:39.877 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:39.868+0000 7fd67afe2700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd67419eb40 con 0x7fd6741018e0 2024-06-02T04:47:39.878 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:39.868+0000 7fd67957f700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd674106b40 0x7fd67419e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:47:39.878 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:39.868+0000 7fd67957f700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd674106b40 0x7fd67419e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:49110/0 (socket says 172.21.15.76:49110) 2024-06-02T04:47:39.878 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:39.868+0000 7fd67957f700 1 -- 172.21.15.76:0/1415153805 learned_addr learned my addr 172.21.15.76:0/1415153805 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:47:39.878 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:39.868+0000 7fd673fff700 1 --2- 172.21.15.76:0/1415153805 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd674104210 0x7fd674197230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:47:39.878 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:39.868+0000 7fd678d7e700 1 --2- 172.21.15.76:0/1415153805 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd6741018e0 0x7fd674196cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:47:39.878 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:39.868+0000 7fd673fff700 1 -- 172.21.15.76:0/1415153805 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd6741018e0 msgr2=0x7fd674196cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:47:39.878 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:39.868+0000 7fd673fff700 1 --2- 172.21.15.76:0/1415153805 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd6741018e0 0x7fd674196cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:39.878 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:39.868+0000 7fd673fff700 1 -- 172.21.15.76:0/1415153805 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd674106b40 msgr2=0x7fd67419e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:47:39.879 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:39.868+0000 7fd673fff700 1 --2- 172.21.15.76:0/1415153805 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd674106b40 0x7fd67419e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:39.879 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:39.868+0000 7fd673fff700 1 -- 172.21.15.76:0/1415153805 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6680095f0 con 0x7fd674104210 2024-06-02T04:47:39.879 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:39.868+0000 7fd67957f700 1 --2- 172.21.15.76:0/1415153805 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd674106b40 0x7fd67419e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T04:47:39.879 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:39.869+0000 7fd673fff700 1 --2- 172.21.15.76:0/1415153805 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd674104210 0x7fd674197230 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd66000e9f0 tx=0x7fd66000ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:47:39.879 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:39.869+0000 7fd671ffb700 1 -- 172.21.15.76:0/1415153805 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd66000c9c0 con 0x7fd674104210 2024-06-02T04:47:39.879 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:39.869+0000 7fd671ffb700 1 -- 172.21.15.76:0/1415153805 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd660010430 con 0x7fd674104210 2024-06-02T04:47:39.879 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:39.869+0000 7fd67afe2700 1 -- 172.21.15.76:0/1415153805 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd67419ee20 con 0x7fd674104210 2024-06-02T04:47:39.879 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:39.869+0000 7fd671ffb700 1 -- 172.21.15.76:0/1415153805 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd660018680 con 0x7fd674104210 2024-06-02T04:47:39.879 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:39.869+0000 7fd67afe2700 1 -- 172.21.15.76:0/1415153805 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd67419f2a0 con 0x7fd674104210 2024-06-02T04:47:39.880 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:39.870+0000 7fd67afe2700 1 -- 172.21.15.76:0/1415153805 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6740fce70 con 0x7fd674104210 2024-06-02T04:47:39.880 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:39.871+0000 7fd671ffb700 1 -- 172.21.15.76:0/1415153805 <== mon.2 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fd66000cb20 con 0x7fd674104210 2024-06-02T04:47:39.880 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:39.871+0000 7fd671ffb700 1 --2- 172.21.15.76:0/1415153805 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fd6640a1120 0x7fd6640a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:47:39.880 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:39.872+0000 7fd678d7e700 1 --2- 172.21.15.76:0/1415153805 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fd6640a1120 0x7fd6640a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:47:39.880 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:39.872+0000 7fd671ffb700 1 -- 172.21.15.76:0/1415153805 <== mon.2 v2:172.21.15.119:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fd660014070 con 0x7fd674104210 2024-06-02T04:47:39.880 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:39.872+0000 7fd678d7e700 1 --2- 172.21.15.76:0/1415153805 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fd6640a1120 0x7fd6640a35e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd6741031d0 tx=0x7fd66800b610 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:47:39.881 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:39.876+0000 7fd671ffb700 1 -- 172.21.15.76:0/1415153805 <== mon.2 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fd660052d60 con 0x7fd674104210 2024-06-02T04:47:40.149 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:40.148+0000 7fd67afe2700 1 -- 172.21.15.76:0/1415153805 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd67402cda0 con 0x7fd674104210 2024-06-02T04:47:40.149 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:40.149+0000 7fd671ffb700 1 -- 172.21.15.76:0/1415153805 <== mon.2 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+2020 (secure 0 0 0) 0x7fd660096180 con 0x7fd674104210 2024-06-02T04:47:40.153 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:47:40.154 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/1543944863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":1543944863},{"type":"v1","addr":"172.21.15.119:6833","nonce":1543944863}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24418,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6833/1527921393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1527921393},{"type":"v1","addr":"172.21.15.192:6833","nonce":1527921393}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2024-06-02T04:47:40.155 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:40.152+0000 7fd67afe2700 1 -- 172.21.15.76:0/1415153805 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fd6640a1120 msgr2=0x7fd6640a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:47:40.155 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:40.152+0000 7fd67afe2700 1 --2- 172.21.15.76:0/1415153805 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fd6640a1120 0x7fd6640a35e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd6741031d0 tx=0x7fd66800b610 comp rx=0 tx=0).stop 2024-06-02T04:47:40.155 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:40.152+0000 7fd67afe2700 1 -- 172.21.15.76:0/1415153805 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd674104210 msgr2=0x7fd674197230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:47:40.155 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:40.152+0000 7fd67afe2700 1 --2- 172.21.15.76:0/1415153805 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd674104210 0x7fd674197230 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd66000e9f0 tx=0x7fd66000ed00 comp rx=0 tx=0).stop 2024-06-02T04:47:40.155 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:40.152+0000 7fd67afe2700 1 -- 172.21.15.76:0/1415153805 shutdown_connections 2024-06-02T04:47:40.155 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:40.152+0000 7fd67afe2700 1 --2- 172.21.15.76:0/1415153805 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd674106b40 0x7fd67419e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:40.155 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:40.152+0000 7fd67afe2700 1 --2- 172.21.15.76:0/1415153805 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd6741018e0 0x7fd674196cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:40.155 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:40.152+0000 7fd67afe2700 1 --2- 172.21.15.76:0/1415153805 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fd6640a1120 0x7fd6640a35e0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:40.155 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:40.152+0000 7fd67afe2700 1 --2- 172.21.15.76:0/1415153805 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd674104210 0x7fd674197230 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:40.156 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:40.152+0000 7fd67afe2700 1 -- 172.21.15.76:0/1415153805 >> 172.21.15.76:0/1415153805 conn(0x7fd6740fb2f0 msgr2=0x7fd674103830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:47:40.156 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:40.152+0000 7fd67afe2700 1 -- 172.21.15.76:0/1415153805 shutdown_connections 2024-06-02T04:47:40.156 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:40.152+0000 7fd67afe2700 1 -- 172.21.15.76:0/1415153805 wait complete. 2024-06-02T04:47:40.158 INFO:teuthology.orchestra.run.smithi076.stderr:dumped fsmap epoch 3 2024-06-02T04:47:40.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:40 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:40.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:40 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:40.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:40 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:40.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:40 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T04:47:40.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:40 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T04:47:40.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:40 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:47:40.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:40 smithi076 ceph-mon[42935]: Deploying daemon mds.j on smithi076 2024-06-02T04:47:40.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:40 smithi076 ceph-mon[42935]: mds.? [v2:172.21.15.119:6832/1543944863,v1:172.21.15.119:6833/1543944863] up:boot 2024-06-02T04:47:40.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:40 smithi076 ceph-mon[42935]: fsmap 2 up:standby 2024-06-02T04:47:40.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:40 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-06-02T04:47:40.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:40 smithi076 ceph-mon[42935]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T04:47:40.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:40 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/1415153805' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:47:40.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:40 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:40.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:40 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:40.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:40 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:40.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:40 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T04:47:40.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:40 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T04:47:40.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:40 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:47:40.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:40 smithi192 ceph-mon[47933]: Deploying daemon mds.j on smithi076 2024-06-02T04:47:40.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:40 smithi192 ceph-mon[47933]: mds.? [v2:172.21.15.119:6832/1543944863,v1:172.21.15.119:6833/1543944863] up:boot 2024-06-02T04:47:40.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:40 smithi192 ceph-mon[47933]: fsmap 2 up:standby 2024-06-02T04:47:40.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:40 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-06-02T04:47:40.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:40 smithi192 ceph-mon[47933]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T04:47:40.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:40 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/1415153805' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:47:41.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:40 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:41.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:40 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:41.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:40 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:41.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:40 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T04:47:41.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:40 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T04:47:41.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:40 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:47:41.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:40 smithi119 ceph-mon[46633]: Deploying daemon mds.j on smithi076 2024-06-02T04:47:41.097 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:40 smithi119 ceph-mon[46633]: mds.? [v2:172.21.15.119:6832/1543944863,v1:172.21.15.119:6833/1543944863] up:boot 2024-06-02T04:47:41.097 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:40 smithi119 ceph-mon[46633]: fsmap 2 up:standby 2024-06-02T04:47:41.097 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:40 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-06-02T04:47:41.097 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:40 smithi119 ceph-mon[46633]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T04:47:41.097 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:40 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/1415153805' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:47:41.233 INFO:journalctl@ceph.mds.j.smithi076.stdout:Jun 02 04:47:40 smithi076 systemd[1]: Starting Ceph mds.j for 60ab6d30-209a-11ef-bc9b-c7b262605968... 2024-06-02T04:47:41.733 INFO:journalctl@ceph.mds.j.smithi076.stdout:Jun 02 04:47:41 smithi076 ceph-mds[94047]: -- 172.21.15.76:0/1036456245 <== mon.0 v2:172.21.15.76:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5594d94fc1a0 con 0x5594d94d2c00 2024-06-02T04:47:41.733 INFO:journalctl@ceph.mds.j.smithi076.stdout:Jun 02 04:47:41 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-j[94024]: starting mds.j at 2024-06-02T04:47:41.734 INFO:journalctl@ceph.mds.j.smithi076.stdout:Jun 02 04:47:41 smithi076 bash[94009]: 856156f3b5fdbfbee10f029cdc06a96b6435a4c0206684150b96def885a07c7c 2024-06-02T04:47:41.734 INFO:journalctl@ceph.mds.j.smithi076.stdout:Jun 02 04:47:41 smithi076 systemd[1]: Started Ceph mds.j for 60ab6d30-209a-11ef-bc9b-c7b262605968. 2024-06-02T04:47:42.167 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T04:47:42.301 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:42.297+0000 7fe5828e8700 1 -- 172.21.15.76:0/164020643 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe57c1018e0 msgr2=0x7fe57c103cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:47:42.301 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:42.297+0000 7fe5828e8700 1 --2- 172.21.15.76:0/164020643 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe57c1018e0 0x7fe57c103cd0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe570009990 tx=0x7fe570009ca0 comp rx=0 tx=0).stop 2024-06-02T04:47:42.301 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:42.297+0000 7fe5828e8700 1 -- 172.21.15.76:0/164020643 shutdown_connections 2024-06-02T04:47:42.301 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:42.297+0000 7fe5828e8700 1 --2- 172.21.15.76:0/164020643 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe57c106b40 0x7fe57c108fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:42.301 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:42.297+0000 7fe5828e8700 1 --2- 172.21.15.76:0/164020643 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe57c1018e0 0x7fe57c103cd0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:42.301 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:42.297+0000 7fe5828e8700 1 --2- 172.21.15.76:0/164020643 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe57c104210 0x7fe57c106600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:42.301 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:42.297+0000 7fe5828e8700 1 -- 172.21.15.76:0/164020643 >> 172.21.15.76:0/164020643 conn(0x7fe57c0fb2f0 msgr2=0x7fe57c0fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:47:42.301 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:42.297+0000 7fe5828e8700 1 -- 172.21.15.76:0/164020643 shutdown_connections 2024-06-02T04:47:42.301 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:42.298+0000 7fe5828e8700 1 -- 172.21.15.76:0/164020643 wait complete. 2024-06-02T04:47:42.302 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:42.298+0000 7fe5828e8700 1 Processor -- start 2024-06-02T04:47:42.302 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:42.298+0000 7fe5828e8700 1 -- start start 2024-06-02T04:47:42.302 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:42.298+0000 7fe5828e8700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe57c1018e0 0x7fe57c196cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:47:42.302 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:42.298+0000 7fe5828e8700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe57c104210 0x7fe57c197230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:47:42.302 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:42.298+0000 7fe5828e8700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe57c106b40 0x7fe57c19e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:47:42.302 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:42.298+0000 7fe5828e8700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe57c19e810 con 0x7fe57c104210 2024-06-02T04:47:42.302 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:42.298+0000 7fe5828e8700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe57c19e980 con 0x7fe57c106b40 2024-06-02T04:47:42.302 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:42.298+0000 7fe5828e8700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe57c19eb40 con 0x7fe57c1018e0 2024-06-02T04:47:42.302 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:42.298+0000 7fe57b7fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe57c104210 0x7fe57c197230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:47:42.302 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:42.299+0000 7fe57b7fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe57c104210 0x7fe57c197230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:48666/0 (socket says 172.21.15.76:48666) 2024-06-02T04:47:42.302 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:42.299+0000 7fe57b7fe700 1 -- 172.21.15.76:0/2769053207 learned_addr learned my addr 172.21.15.76:0/2769053207 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:47:42.302 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:42.299+0000 7fe57bfff700 1 --2- 172.21.15.76:0/2769053207 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe57c1018e0 0x7fe57c196cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:47:42.303 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:42.299+0000 7fe580e85700 1 --2- 172.21.15.76:0/2769053207 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe57c106b40 0x7fe57c19e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:47:42.303 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:42.299+0000 7fe57b7fe700 1 -- 172.21.15.76:0/2769053207 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe57c1018e0 msgr2=0x7fe57c196cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:47:42.303 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:42.299+0000 7fe57b7fe700 1 --2- 172.21.15.76:0/2769053207 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe57c1018e0 0x7fe57c196cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:42.303 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:42.299+0000 7fe57b7fe700 1 -- 172.21.15.76:0/2769053207 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe57c106b40 msgr2=0x7fe57c19e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:47:42.303 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:42.299+0000 7fe57b7fe700 1 --2- 172.21.15.76:0/2769053207 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe57c106b40 0x7fe57c19e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:42.303 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:42.299+0000 7fe57b7fe700 1 -- 172.21.15.76:0/2769053207 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5700095f0 con 0x7fe57c104210 2024-06-02T04:47:42.303 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:42.299+0000 7fe57b7fe700 1 --2- 172.21.15.76:0/2769053207 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe57c104210 0x7fe57c197230 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fe56c00c920 tx=0x7fe56c00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:47:42.303 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:42.299+0000 7fe5797fa700 1 -- 172.21.15.76:0/2769053207 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe56c004a30 con 0x7fe57c104210 2024-06-02T04:47:42.303 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:42.299+0000 7fe5797fa700 1 -- 172.21.15.76:0/2769053207 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe56c0054b0 con 0x7fe57c104210 2024-06-02T04:47:42.303 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:42.299+0000 7fe5797fa700 1 -- 172.21.15.76:0/2769053207 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe56c007ab0 con 0x7fe57c104210 2024-06-02T04:47:42.303 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:42.299+0000 7fe5828e8700 1 -- 172.21.15.76:0/2769053207 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe57c19ee20 con 0x7fe57c104210 2024-06-02T04:47:42.303 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:42.299+0000 7fe5828e8700 1 -- 172.21.15.76:0/2769053207 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe57c19f250 con 0x7fe57c104210 2024-06-02T04:47:42.304 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:42.300+0000 7fe5828e8700 1 -- 172.21.15.76:0/2769053207 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe57c0fce70 con 0x7fe57c104210 2024-06-02T04:47:42.304 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:42.302+0000 7fe5797fa700 1 -- 172.21.15.76:0/2769053207 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fe56c007c50 con 0x7fe57c104210 2024-06-02T04:47:42.305 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:42.303+0000 7fe5797fa700 1 --2- 172.21.15.76:0/2769053207 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fe5640a1120 0x7fe5640a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:47:42.305 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:42.303+0000 7fe57bfff700 1 --2- 172.21.15.76:0/2769053207 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fe5640a1120 0x7fe5640a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:47:42.305 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:42.303+0000 7fe5797fa700 1 -- 172.21.15.76:0/2769053207 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fe56c0cc420 con 0x7fe57c104210 2024-06-02T04:47:42.305 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:42.303+0000 7fe57bfff700 1 --2- 172.21.15.76:0/2769053207 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fe5640a1120 0x7fe5640a35e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe570000c00 tx=0x7fe570005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:47:42.307 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:42.306+0000 7fe5797fa700 1 -- 172.21.15.76:0/2769053207 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fe56c095fb0 con 0x7fe57c104210 2024-06-02T04:47:42.559 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:42.557+0000 7fe5828e8700 1 -- 172.21.15.76:0/2769053207 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe57c067c10 con 0x7fe57c104210 2024-06-02T04:47:42.559 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:42.558+0000 7fe5797fa700 1 -- 172.21.15.76:0/2769053207 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) v1 ==== 93+0+2777 (secure 0 0 0) 0x7fe56c01daf0 con 0x7fe57c104210 2024-06-02T04:47:42.559 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:47:42.560 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":4,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6835/3029342152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3029342152},{"type":"v1","addr":"172.21.15.76:6835","nonce":3029342152}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/1543944863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":1543944863},{"type":"v1","addr":"172.21.15.119:6833","nonce":1543944863}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24418,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6833/1527921393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1527921393},{"type":"v1","addr":"172.21.15.192:6833","nonce":1527921393}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2024-06-02T04:47:42.561 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:42.560+0000 7fe5828e8700 1 -- 172.21.15.76:0/2769053207 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fe5640a1120 msgr2=0x7fe5640a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:47:42.562 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:42.560+0000 7fe5828e8700 1 --2- 172.21.15.76:0/2769053207 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fe5640a1120 0x7fe5640a35e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe570000c00 tx=0x7fe570005fb0 comp rx=0 tx=0).stop 2024-06-02T04:47:42.562 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:42.560+0000 7fe5828e8700 1 -- 172.21.15.76:0/2769053207 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe57c104210 msgr2=0x7fe57c197230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:47:42.562 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:42.560+0000 7fe5828e8700 1 --2- 172.21.15.76:0/2769053207 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe57c104210 0x7fe57c197230 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fe56c00c920 tx=0x7fe56c00cc30 comp rx=0 tx=0).stop 2024-06-02T04:47:42.562 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:42.560+0000 7fe5828e8700 1 -- 172.21.15.76:0/2769053207 shutdown_connections 2024-06-02T04:47:42.562 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:42.560+0000 7fe5828e8700 1 --2- 172.21.15.76:0/2769053207 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fe5640a1120 0x7fe5640a35e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:42.562 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:42.560+0000 7fe5828e8700 1 --2- 172.21.15.76:0/2769053207 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe57c106b40 0x7fe57c19e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:42.562 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:42.560+0000 7fe5828e8700 1 --2- 172.21.15.76:0/2769053207 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe57c1018e0 0x7fe57c196cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:42.562 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:42.560+0000 7fe5828e8700 1 --2- 172.21.15.76:0/2769053207 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe57c104210 0x7fe57c197230 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:42.562 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:42.560+0000 7fe5828e8700 1 -- 172.21.15.76:0/2769053207 >> 172.21.15.76:0/2769053207 conn(0x7fe57c0fb2f0 msgr2=0x7fe57c103830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:47:42.562 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:42.560+0000 7fe5828e8700 1 -- 172.21.15.76:0/2769053207 shutdown_connections 2024-06-02T04:47:42.562 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:42.560+0000 7fe5828e8700 1 -- 172.21.15.76:0/2769053207 wait complete. 2024-06-02T04:47:42.563 INFO:teuthology.orchestra.run.smithi076.stderr:dumped fsmap epoch 4 2024-06-02T04:47:42.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:42 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:42.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:42 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:42.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:42 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:42.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:42 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T04:47:42.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:42 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T04:47:42.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:42 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:47:42.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:42 smithi076 ceph-mon[42935]: Deploying daemon mds.d on smithi076 2024-06-02T04:47:42.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:42 smithi076 ceph-mon[42935]: mds.? [v2:172.21.15.76:6834/3029342152,v1:172.21.15.76:6835/3029342152] up:boot 2024-06-02T04:47:42.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:42 smithi076 ceph-mon[42935]: fsmap 3 up:standby 2024-06-02T04:47:42.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:42 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-06-02T04:47:42.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:42 smithi076 ceph-mon[42935]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T04:47:42.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:42 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:42.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:42 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:42.847 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:42 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:42.847 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:42 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T04:47:42.847 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:42 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T04:47:42.847 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:42 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:47:42.847 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:42 smithi119 ceph-mon[46633]: Deploying daemon mds.d on smithi076 2024-06-02T04:47:42.847 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:42 smithi119 ceph-mon[46633]: mds.? [v2:172.21.15.76:6834/3029342152,v1:172.21.15.76:6835/3029342152] up:boot 2024-06-02T04:47:42.847 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:42 smithi119 ceph-mon[46633]: fsmap 3 up:standby 2024-06-02T04:47:42.848 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:42 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-06-02T04:47:42.848 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:42 smithi119 ceph-mon[46633]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T04:47:42.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:42 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:42.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:42 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:42.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:42 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:42.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:42 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T04:47:42.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:42 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T04:47:42.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:42 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:47:42.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:42 smithi192 ceph-mon[47933]: Deploying daemon mds.d on smithi076 2024-06-02T04:47:42.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:42 smithi192 ceph-mon[47933]: mds.? [v2:172.21.15.76:6834/3029342152,v1:172.21.15.76:6835/3029342152] up:boot 2024-06-02T04:47:42.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:42 smithi192 ceph-mon[47933]: fsmap 3 up:standby 2024-06-02T04:47:42.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:42 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-06-02T04:47:42.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:42 smithi192 ceph-mon[47933]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T04:47:43.096 INFO:journalctl@ceph.mds.d.smithi076.stdout:Jun 02 04:47:42 smithi076 systemd[1]: Starting Ceph mds.d for 60ab6d30-209a-11ef-bc9b-c7b262605968... 2024-06-02T04:47:43.483 INFO:journalctl@ceph.mds.d.smithi076.stdout:Jun 02 04:47:43 smithi076 ceph-mds[94432]: -- 172.21.15.76:0/1998254423 <== mon.0 v2:172.21.15.76:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55df04a941a0 con 0x55df04a6b000 2024-06-02T04:47:43.484 INFO:journalctl@ceph.mds.d.smithi076.stdout:Jun 02 04:47:43 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-d[94410]: starting mds.d at 2024-06-02T04:47:43.484 INFO:journalctl@ceph.mds.d.smithi076.stdout:Jun 02 04:47:43 smithi076 bash[94395]: 799e51b9e312bdad5f6739bc0582b2591f287ec039865db48cd2238cdd24f1d4 2024-06-02T04:47:43.484 INFO:journalctl@ceph.mds.d.smithi076.stdout:Jun 02 04:47:43 smithi076 systemd[1]: Started Ceph mds.d for 60ab6d30-209a-11ef-bc9b-c7b262605968. 2024-06-02T04:47:43.778 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:43 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/2769053207' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:47:43.778 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:43 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:43.778 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:43 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:43.778 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:43 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:43.779 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:43 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T04:47:43.779 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:43 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T04:47:43.779 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:43 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:47:43.779 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:43 smithi119 ceph-mon[46633]: Deploying daemon mds.e on smithi119 2024-06-02T04:47:43.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:43 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/2769053207' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:47:43.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:43 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:43.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:43 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:43.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:43 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:43.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:43 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T04:47:43.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:43 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T04:47:43.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:43 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:47:43.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:43 smithi192 ceph-mon[47933]: Deploying daemon mds.e on smithi119 2024-06-02T04:47:43.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:43 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/2769053207' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:47:43.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:43 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:43.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:43 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:43.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:43 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:43.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:43 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T04:47:43.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:43 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T04:47:43.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:43 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:47:43.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:43 smithi076 ceph-mon[42935]: Deploying daemon mds.e on smithi119 2024-06-02T04:47:44.575 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T04:47:44.596 INFO:journalctl@ceph.mds.e.smithi119.stdout:Jun 02 04:47:44 smithi119 systemd[1]: Starting Ceph mds.e for 60ab6d30-209a-11ef-bc9b-c7b262605968... 2024-06-02T04:47:44.716 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:44.713+0000 7f0ed2ffe700 1 -- 172.21.15.76:0/2963388939 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0ecc101920 msgr2=0x7f0ecc1081d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:47:44.716 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:44.713+0000 7f0ed2ffe700 1 --2- 172.21.15.76:0/2963388939 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0ecc101920 0x7f0ecc1081d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0ec400b0d0 tx=0x7f0ec400b3e0 comp rx=0 tx=0).stop 2024-06-02T04:47:44.716 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:44.713+0000 7f0ed2ffe700 1 -- 172.21.15.76:0/2963388939 shutdown_connections 2024-06-02T04:47:44.716 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:44.713+0000 7f0ed2ffe700 1 --2- 172.21.15.76:0/2963388939 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0ecc101920 0x7f0ecc1081d0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:44.716 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:44.713+0000 7f0ed2ffe700 1 --2- 172.21.15.76:0/2963388939 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0ecc0ffd90 0x7f0ecc1001b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:44.716 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:44.713+0000 7f0ed2ffe700 1 --2- 172.21.15.76:0/2963388939 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ecc100f80 0x7f0ecc1013e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:44.716 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:44.713+0000 7f0ed2ffe700 1 -- 172.21.15.76:0/2963388939 >> 172.21.15.76:0/2963388939 conn(0x7f0ecc0fb300 msgr2=0x7f0ecc0fd740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:47:44.716 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:44.713+0000 7f0ed2ffe700 1 -- 172.21.15.76:0/2963388939 shutdown_connections 2024-06-02T04:47:44.716 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:44.713+0000 7f0ed2ffe700 1 -- 172.21.15.76:0/2963388939 wait complete. 2024-06-02T04:47:44.716 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:44.713+0000 7f0ed2ffe700 1 Processor -- start 2024-06-02T04:47:44.717 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:44.713+0000 7f0ed2ffe700 1 -- start start 2024-06-02T04:47:44.717 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:44.714+0000 7f0ed2ffe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0ecc0ffd90 0x7f0ecc069ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:47:44.717 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:44.714+0000 7f0ed2ffe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0ecc100f80 0x7f0ecc19df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:47:44.717 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:44.714+0000 7f0ed2ffe700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ecc101920 0x7f0ecc1a04e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:47:44.717 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:44.714+0000 7f0ed2ffe700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ecc1a0b40 con 0x7f0ecc100f80 2024-06-02T04:47:44.717 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:44.714+0000 7f0ed2ffe700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ecc1a0cb0 con 0x7f0ecc101920 2024-06-02T04:47:44.717 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:44.714+0000 7f0ed2ffe700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ecc1a0e70 con 0x7f0ecc0ffd90 2024-06-02T04:47:44.717 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:44.714+0000 7f0ecbfff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0ecc100f80 0x7f0ecc19df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:47:44.717 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:44.714+0000 7f0ecbfff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0ecc100f80 0x7f0ecc19df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:48704/0 (socket says 172.21.15.76:48704) 2024-06-02T04:47:44.717 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:44.714+0000 7f0ecbfff700 1 -- 172.21.15.76:0/2884660625 learned_addr learned my addr 172.21.15.76:0/2884660625 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:47:44.718 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:44.714+0000 7f0ed0d9a700 1 --2- 172.21.15.76:0/2884660625 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0ecc0ffd90 0x7f0ecc069ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:47:44.718 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:44.714+0000 7f0ed159b700 1 --2- 172.21.15.76:0/2884660625 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ecc101920 0x7f0ecc1a04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:47:44.718 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:44.714+0000 7f0ecbfff700 1 -- 172.21.15.76:0/2884660625 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0ecc0ffd90 msgr2=0x7f0ecc069ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:47:44.718 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:44.714+0000 7f0ecbfff700 1 --2- 172.21.15.76:0/2884660625 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0ecc0ffd90 0x7f0ecc069ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:44.718 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:44.714+0000 7f0ecbfff700 1 -- 172.21.15.76:0/2884660625 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ecc101920 msgr2=0x7f0ecc1a04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:47:44.718 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:44.714+0000 7f0ecbfff700 1 --2- 172.21.15.76:0/2884660625 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ecc101920 0x7f0ecc1a04e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:44.718 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:44.714+0000 7f0ecbfff700 1 -- 172.21.15.76:0/2884660625 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ec4009d00 con 0x7f0ecc100f80 2024-06-02T04:47:44.718 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:44.714+0000 7f0ecbfff700 1 --2- 172.21.15.76:0/2884660625 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0ecc100f80 0x7f0ecc19df90 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0eb800b530 tx=0x7f0eb800b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:47:44.718 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:44.714+0000 7f0ec9ffb700 1 -- 172.21.15.76:0/2884660625 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb8011830 con 0x7f0ecc100f80 2024-06-02T04:47:44.718 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:44.714+0000 7f0ec9ffb700 1 -- 172.21.15.76:0/2884660625 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0eb8011e20 con 0x7f0ecc100f80 2024-06-02T04:47:44.718 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:44.714+0000 7f0ed2ffe700 1 -- 172.21.15.76:0/2884660625 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ecc1a1150 con 0x7f0ecc100f80 2024-06-02T04:47:44.719 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:44.714+0000 7f0ec9ffb700 1 -- 172.21.15.76:0/2884660625 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb800f2e0 con 0x7f0ecc100f80 2024-06-02T04:47:44.719 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:44.715+0000 7f0ed2ffe700 1 -- 172.21.15.76:0/2884660625 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ecc1a16e0 con 0x7f0ecc100f80 2024-06-02T04:47:44.719 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:44.715+0000 7f0ed2ffe700 1 -- 172.21.15.76:0/2884660625 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ecc107160 con 0x7f0ecc100f80 2024-06-02T04:47:44.720 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:44.716+0000 7f0ec9ffb700 1 -- 172.21.15.76:0/2884660625 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f0eb8011990 con 0x7f0ecc100f80 2024-06-02T04:47:44.720 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:44.717+0000 7f0ec9ffb700 1 --2- 172.21.15.76:0/2884660625 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f0ebc0a1120 0x7f0ebc0a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:47:44.720 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:44.717+0000 7f0ec9ffb700 1 -- 172.21.15.76:0/2884660625 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f0eb80cc3a0 con 0x7f0ecc100f80 2024-06-02T04:47:44.720 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:44.717+0000 7f0ed0d9a700 1 --2- 172.21.15.76:0/2884660625 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f0ebc0a1120 0x7f0ebc0a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:47:44.720 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:44.717+0000 7f0ed0d9a700 1 --2- 172.21.15.76:0/2884660625 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f0ebc0a1120 0x7f0ebc0a35e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc100de0 tx=0x7f0ec0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:47:44.721 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:44.721+0000 7f0ec9ffb700 1 -- 172.21.15.76:0/2884660625 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f0eb8095fd0 con 0x7f0ecc100f80 2024-06-02T04:47:44.962 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:44.962+0000 7f0ed2ffe700 1 -- 172.21.15.76:0/2884660625 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0ecc068060 con 0x7f0ecc100f80 2024-06-02T04:47:44.962 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:44.962+0000 7f0ec9ffb700 1 -- 172.21.15.76:0/2884660625 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+3534 (secure 0 0 0) 0x7f0eb8015de0 con 0x7f0ecc100f80 2024-06-02T04:47:44.963 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:47:44.963 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":5,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6835/3029342152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3029342152},{"type":"v1","addr":"172.21.15.76:6835","nonce":3029342152}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6837/1207985317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":1207985317},{"type":"v1","addr":"172.21.15.76:6837","nonce":1207985317}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/1543944863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":1543944863},{"type":"v1","addr":"172.21.15.119:6833","nonce":1543944863}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24418,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6833/1527921393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1527921393},{"type":"v1","addr":"172.21.15.192:6833","nonce":1527921393}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2024-06-02T04:47:44.965 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:44.964+0000 7f0ed2ffe700 1 -- 172.21.15.76:0/2884660625 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f0ebc0a1120 msgr2=0x7f0ebc0a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:47:44.965 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:44.964+0000 7f0ed2ffe700 1 --2- 172.21.15.76:0/2884660625 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f0ebc0a1120 0x7f0ebc0a35e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc100de0 tx=0x7f0ec0009260 comp rx=0 tx=0).stop 2024-06-02T04:47:44.965 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:44.964+0000 7f0ed2ffe700 1 -- 172.21.15.76:0/2884660625 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0ecc100f80 msgr2=0x7f0ecc19df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:47:44.965 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:44.964+0000 7f0ed2ffe700 1 --2- 172.21.15.76:0/2884660625 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0ecc100f80 0x7f0ecc19df90 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0eb800b530 tx=0x7f0eb800b840 comp rx=0 tx=0).stop 2024-06-02T04:47:44.965 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:44.964+0000 7f0ed2ffe700 1 -- 172.21.15.76:0/2884660625 shutdown_connections 2024-06-02T04:47:44.965 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:44.964+0000 7f0ed2ffe700 1 --2- 172.21.15.76:0/2884660625 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f0ebc0a1120 0x7f0ebc0a35e0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:44.965 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:44.964+0000 7f0ed2ffe700 1 --2- 172.21.15.76:0/2884660625 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ecc101920 0x7f0ecc1a04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:44.965 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:44.964+0000 7f0ed2ffe700 1 --2- 172.21.15.76:0/2884660625 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0ecc0ffd90 0x7f0ecc069ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:44.965 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:44.964+0000 7f0ed2ffe700 1 --2- 172.21.15.76:0/2884660625 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0ecc100f80 0x7f0ecc19df90 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:44.965 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:44.964+0000 7f0ed2ffe700 1 -- 172.21.15.76:0/2884660625 >> 172.21.15.76:0/2884660625 conn(0x7f0ecc0fb300 msgr2=0x7f0ecc1042a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:47:44.966 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:44.965+0000 7f0ed2ffe700 1 -- 172.21.15.76:0/2884660625 shutdown_connections 2024-06-02T04:47:44.966 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:44.965+0000 7f0ed2ffe700 1 -- 172.21.15.76:0/2884660625 wait complete. 2024-06-02T04:47:44.966 INFO:teuthology.orchestra.run.smithi076.stderr:dumped fsmap epoch 5 2024-06-02T04:47:45.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:44 smithi076 ceph-mon[42935]: mds.? [v2:172.21.15.76:6836/1207985317,v1:172.21.15.76:6837/1207985317] up:boot 2024-06-02T04:47:45.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:44 smithi076 ceph-mon[42935]: fsmap 4 up:standby 2024-06-02T04:47:45.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:44 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-06-02T04:47:45.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:44 smithi076 ceph-mon[42935]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T04:47:45.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:44 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/2884660625' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:47:45.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:44 smithi119 ceph-mon[46633]: mds.? [v2:172.21.15.76:6836/1207985317,v1:172.21.15.76:6837/1207985317] up:boot 2024-06-02T04:47:45.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:44 smithi119 ceph-mon[46633]: fsmap 4 up:standby 2024-06-02T04:47:45.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:44 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-06-02T04:47:45.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:44 smithi119 ceph-mon[46633]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T04:47:45.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:44 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/2884660625' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:47:45.347 INFO:journalctl@ceph.mds.e.smithi119.stdout:Jun 02 04:47:44 smithi119 ceph-mds[82611]: -- 172.21.15.119:0/2050394546 <== mon.2 v2:172.21.15.119:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55564ce6c1a0 con 0x55564ce43000 2024-06-02T04:47:45.347 INFO:journalctl@ceph.mds.e.smithi119.stdout:Jun 02 04:47:44 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-e[82588]: starting mds.e at 2024-06-02T04:47:45.347 INFO:journalctl@ceph.mds.e.smithi119.stdout:Jun 02 04:47:44 smithi119 bash[82573]: 82eb49f8f5d31ea25d0a1a1a6a1d7f35b3ac33ff1cce8d23d10f0220140484da 2024-06-02T04:47:45.347 INFO:journalctl@ceph.mds.e.smithi119.stdout:Jun 02 04:47:44 smithi119 systemd[1]: Started Ceph mds.e for 60ab6d30-209a-11ef-bc9b-c7b262605968. 2024-06-02T04:47:45.413 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:44 smithi192 ceph-mon[47933]: mds.? [v2:172.21.15.76:6836/1207985317,v1:172.21.15.76:6837/1207985317] up:boot 2024-06-02T04:47:45.413 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:44 smithi192 ceph-mon[47933]: fsmap 4 up:standby 2024-06-02T04:47:45.413 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:44 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-06-02T04:47:45.413 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:44 smithi192 ceph-mon[47933]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T04:47:45.413 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:44 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/2884660625' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:47:46.032 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:45 smithi192 ceph-mon[47933]: mds.? [v2:172.21.15.119:6834/2746840347,v1:172.21.15.119:6835/2746840347] up:boot 2024-06-02T04:47:46.032 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:45 smithi192 ceph-mon[47933]: fsmap 5 up:standby 2024-06-02T04:47:46.032 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:45 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-06-02T04:47:46.032 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:45 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:46.032 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:45 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:46.032 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:45 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:46.032 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:45 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T04:47:46.032 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:45 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T04:47:46.032 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:45 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:47:46.032 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:45 smithi192 ceph-mon[47933]: Deploying daemon mds.f on smithi192 2024-06-02T04:47:46.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:45 smithi119 ceph-mon[46633]: mds.? [v2:172.21.15.119:6834/2746840347,v1:172.21.15.119:6835/2746840347] up:boot 2024-06-02T04:47:46.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:45 smithi119 ceph-mon[46633]: fsmap 5 up:standby 2024-06-02T04:47:46.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:45 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-06-02T04:47:46.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:45 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:46.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:45 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:46.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:45 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:46.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:45 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T04:47:46.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:45 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T04:47:46.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:45 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:47:46.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:45 smithi119 ceph-mon[46633]: Deploying daemon mds.f on smithi192 2024-06-02T04:47:46.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:45 smithi076 ceph-mon[42935]: mds.? [v2:172.21.15.119:6834/2746840347,v1:172.21.15.119:6835/2746840347] up:boot 2024-06-02T04:47:46.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:45 smithi076 ceph-mon[42935]: fsmap 5 up:standby 2024-06-02T04:47:46.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:45 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-06-02T04:47:46.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:45 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:46.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:45 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:46.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:45 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:46.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:45 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T04:47:46.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:45 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T04:47:46.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:45 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:47:46.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:45 smithi076 ceph-mon[42935]: Deploying daemon mds.f on smithi192 2024-06-02T04:47:46.931 INFO:journalctl@ceph.mds.f.smithi192.stdout:Jun 02 04:47:46 smithi192 bash[83938]: 253f4e41a734d3e7de16051b3b9eeb6292df04edea5a405dd18d2faa675b39b9 2024-06-02T04:47:46.931 INFO:journalctl@ceph.mds.f.smithi192.stdout:Jun 02 04:47:46 smithi192 systemd[1]: Started Ceph mds.f for 60ab6d30-209a-11ef-bc9b-c7b262605968. 2024-06-02T04:47:46.978 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T04:47:47.121 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:47.118+0000 7f2f8d21d700 1 -- 172.21.15.76:0/630202228 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2f88104220 msgr2=0x7f2f88106610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:47:47.122 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:47.118+0000 7f2f8d21d700 1 --2- 172.21.15.76:0/630202228 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2f88104220 0x7f2f88106610 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c009990 tx=0x7f2f7c009ca0 comp rx=0 tx=0).stop 2024-06-02T04:47:47.122 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:47.118+0000 7f2f8d21d700 1 -- 172.21.15.76:0/630202228 shutdown_connections 2024-06-02T04:47:47.122 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:47.118+0000 7f2f8d21d700 1 --2- 172.21.15.76:0/630202228 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2f88106b50 0x7f2f88108fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:47.122 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:47.118+0000 7f2f8d21d700 1 --2- 172.21.15.76:0/630202228 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f881018f0 0x7f2f88103ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:47.122 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:47.118+0000 7f2f8d21d700 1 --2- 172.21.15.76:0/630202228 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2f88104220 0x7f2f88106610 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:47.122 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:47.118+0000 7f2f8d21d700 1 -- 172.21.15.76:0/630202228 >> 172.21.15.76:0/630202228 conn(0x7f2f880fb2e0 msgr2=0x7f2f880fd720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:47:47.122 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:47.118+0000 7f2f8d21d700 1 -- 172.21.15.76:0/630202228 shutdown_connections 2024-06-02T04:47:47.122 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:47.118+0000 7f2f8d21d700 1 -- 172.21.15.76:0/630202228 wait complete. 2024-06-02T04:47:47.122 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:47.118+0000 7f2f8d21d700 1 Processor -- start 2024-06-02T04:47:47.122 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:47.119+0000 7f2f8d21d700 1 -- start start 2024-06-02T04:47:47.122 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:47.119+0000 7f2f8d21d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f881018f0 0x7f2f88101210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:47:47.122 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:47.119+0000 7f2f8d21d700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2f88104220 0x7f2f880ff8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:47:47.123 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:47.119+0000 7f2f8d21d700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2f88106b50 0x7f2f880ffde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:47:47.123 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:47.119+0000 7f2f8d21d700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f88100580 con 0x7f2f88104220 2024-06-02T04:47:47.123 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:47.119+0000 7f2f8d21d700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f881006f0 con 0x7f2f88106b50 2024-06-02T04:47:47.123 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:47.119+0000 7f2f8d21d700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f881a0cb0 con 0x7f2f881018f0 2024-06-02T04:47:47.123 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:47.119+0000 7f2f8659c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2f88104220 0x7f2f880ff8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:47:47.123 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:47.119+0000 7f2f86d9d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f881018f0 0x7f2f88101210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:47:47.123 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:47.119+0000 7f2f8659c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2f88104220 0x7f2f880ff8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:48730/0 (socket says 172.21.15.76:48730) 2024-06-02T04:47:47.123 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:47.119+0000 7f2f86d9d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f881018f0 0x7f2f88101210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:49536/0 (socket says 172.21.15.76:49536) 2024-06-02T04:47:47.123 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:47.119+0000 7f2f8659c700 1 -- 172.21.15.76:0/1773715350 learned_addr learned my addr 172.21.15.76:0/1773715350 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:47:47.123 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:47.119+0000 7f2f8759e700 1 --2- 172.21.15.76:0/1773715350 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2f88106b50 0x7f2f880ffde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:47:47.123 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:47.119+0000 7f2f8659c700 1 -- 172.21.15.76:0/1773715350 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f881018f0 msgr2=0x7f2f88101210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:47:47.123 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:47.119+0000 7f2f8659c700 1 --2- 172.21.15.76:0/1773715350 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f881018f0 0x7f2f88101210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:47.124 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:47.119+0000 7f2f8659c700 1 -- 172.21.15.76:0/1773715350 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2f88106b50 msgr2=0x7f2f880ffde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:47:47.124 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:47.119+0000 7f2f8659c700 1 --2- 172.21.15.76:0/1773715350 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2f88106b50 0x7f2f880ffde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:47.124 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:47.119+0000 7f2f8659c700 1 -- 172.21.15.76:0/1773715350 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f7c0095f0 con 0x7f2f88104220 2024-06-02T04:47:47.124 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:47.119+0000 7f2f8759e700 1 --2- 172.21.15.76:0/1773715350 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2f88106b50 0x7f2f880ffde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:47:47.124 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:47.119+0000 7f2f86d9d700 1 --2- 172.21.15.76:0/1773715350 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f881018f0 0x7f2f88101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T04:47:47.124 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:47.119+0000 7f2f8659c700 1 --2- 172.21.15.76:0/1773715350 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2f88104220 0x7f2f880ff8a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c0098e0 tx=0x7f2f7c003a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:47:47.124 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:47.120+0000 7f2f6ffff700 1 -- 172.21.15.76:0/1773715350 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f7c01d070 con 0x7f2f88104220 2024-06-02T04:47:47.124 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:47.120+0000 7f2f8d21d700 1 -- 172.21.15.76:0/1773715350 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f881a0ee0 con 0x7f2f88104220 2024-06-02T04:47:47.124 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:47.120+0000 7f2f6ffff700 1 -- 172.21.15.76:0/1773715350 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2f7c00bd90 con 0x7f2f88104220 2024-06-02T04:47:47.124 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:47.120+0000 7f2f6ffff700 1 -- 172.21.15.76:0/1773715350 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f7c022d20 con 0x7f2f88104220 2024-06-02T04:47:47.124 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:47.120+0000 7f2f8d21d700 1 -- 172.21.15.76:0/1773715350 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f881a1250 con 0x7f2f88104220 2024-06-02T04:47:47.124 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:47.121+0000 7f2f8d21d700 1 -- 172.21.15.76:0/1773715350 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f880fce60 con 0x7f2f88104220 2024-06-02T04:47:47.125 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:47.122+0000 7f2f6ffff700 1 -- 172.21.15.76:0/1773715350 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f2f7c003f40 con 0x7f2f88104220 2024-06-02T04:47:47.125 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:47.123+0000 7f2f6ffff700 1 --2- 172.21.15.76:0/1773715350 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f2f700a1120 0x7f2f700a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:47:47.125 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:47.123+0000 7f2f6ffff700 1 -- 172.21.15.76:0/1773715350 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f2f7c0ce100 con 0x7f2f88104220 2024-06-02T04:47:47.125 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:47.123+0000 7f2f86d9d700 1 --2- 172.21.15.76:0/1773715350 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f2f700a1120 0x7f2f700a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:47:47.125 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:47.123+0000 7f2f86d9d700 1 --2- 172.21.15.76:0/1773715350 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f2f700a1120 0x7f2f700a35e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2f78005950 tx=0x7f2f7800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:47:47.126 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:47.126+0000 7f2f6ffff700 1 -- 172.21.15.76:0/1773715350 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f2f7c097dc0 con 0x7f2f88104220 2024-06-02T04:47:47.303 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:47 smithi192 ceph-mon[47933]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T04:47:47.303 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:47 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:47.303 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:47 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:47.303 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:47 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:47.303 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:47 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T04:47:47.303 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:47 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T04:47:47.303 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:47 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:47:47.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:47 smithi119 ceph-mon[46633]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T04:47:47.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:47 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:47.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:47 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:47.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:47 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:47.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:47 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T04:47:47.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:47 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T04:47:47.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:47 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:47:47.368 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:47.368+0000 7f2f8d21d700 1 -- 172.21.15.76:0/1773715350 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2f88067380 con 0x7f2f88104220 2024-06-02T04:47:47.368 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:47.368+0000 7f2f6ffff700 1 -- 172.21.15.76:0/1773715350 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+5051 (secure 0 0 0) 0x7f2f7c09b3e0 con 0x7f2f88104220 2024-06-02T04:47:47.369 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:47:47.369 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":7,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6835/3029342152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3029342152},{"type":"v1","addr":"172.21.15.76:6835","nonce":3029342152}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6837/1207985317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":1207985317},{"type":"v1","addr":"172.21.15.76:6837","nonce":1207985317}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/1543944863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":1543944863},{"type":"v1","addr":"172.21.15.119:6833","nonce":1543944863}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24418,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6833/1527921393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1527921393},{"type":"v1","addr":"172.21.15.192:6833","nonce":1527921393}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24434,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/2746840347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":2746840347},{"type":"v1","addr":"172.21.15.119:6835","nonce":2746840347}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24451,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/783181340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":783181340},{"type":"v1","addr":"172.21.15.192:6835","nonce":783181340}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7}],"filesystems":[]} 2024-06-02T04:47:47.371 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:47.370+0000 7f2f8d21d700 1 -- 172.21.15.76:0/1773715350 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f2f700a1120 msgr2=0x7f2f700a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:47:47.371 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:47.370+0000 7f2f8d21d700 1 --2- 172.21.15.76:0/1773715350 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f2f700a1120 0x7f2f700a35e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2f78005950 tx=0x7f2f7800b410 comp rx=0 tx=0).stop 2024-06-02T04:47:47.371 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:47.370+0000 7f2f8d21d700 1 -- 172.21.15.76:0/1773715350 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2f88104220 msgr2=0x7f2f880ff8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:47:47.371 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:47.370+0000 7f2f8d21d700 1 --2- 172.21.15.76:0/1773715350 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2f88104220 0x7f2f880ff8a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c0098e0 tx=0x7f2f7c003a50 comp rx=0 tx=0).stop 2024-06-02T04:47:47.371 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:47.370+0000 7f2f8d21d700 1 -- 172.21.15.76:0/1773715350 shutdown_connections 2024-06-02T04:47:47.371 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:47.370+0000 7f2f8d21d700 1 --2- 172.21.15.76:0/1773715350 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f2f700a1120 0x7f2f700a35e0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:47.371 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:47.370+0000 7f2f8d21d700 1 --2- 172.21.15.76:0/1773715350 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2f88106b50 0x7f2f880ffde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:47.371 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:47.370+0000 7f2f8d21d700 1 --2- 172.21.15.76:0/1773715350 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f881018f0 0x7f2f88101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:47.371 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:47.370+0000 7f2f8d21d700 1 --2- 172.21.15.76:0/1773715350 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2f88104220 0x7f2f880ff8a0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:47.371 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:47.370+0000 7f2f8d21d700 1 -- 172.21.15.76:0/1773715350 >> 172.21.15.76:0/1773715350 conn(0x7f2f880fb2e0 msgr2=0x7f2f88102190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:47:47.371 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:47.370+0000 7f2f8d21d700 1 -- 172.21.15.76:0/1773715350 shutdown_connections 2024-06-02T04:47:47.371 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:47.370+0000 7f2f8d21d700 1 -- 172.21.15.76:0/1773715350 wait complete. 2024-06-02T04:47:47.372 INFO:teuthology.orchestra.run.smithi076.stderr:dumped fsmap epoch 7 2024-06-02T04:47:47.381 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:47 smithi076 ceph-mon[42935]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T04:47:47.381 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:47 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:47.382 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:47 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:47.382 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:47 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:47.382 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:47 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T04:47:47.382 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:47 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T04:47:47.382 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:47 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:47:48.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:48 smithi192 ceph-mon[47933]: Deploying daemon mds.c on smithi192 2024-06-02T04:47:48.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:48 smithi192 ceph-mon[47933]: mds.? [v2:172.21.15.192:6834/783181340,v1:172.21.15.192:6835/783181340] up:boot 2024-06-02T04:47:48.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:48 smithi192 ceph-mon[47933]: fsmap 6 up:standby 2024-06-02T04:47:48.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:48 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-06-02T04:47:48.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:48 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/1773715350' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:47:48.182 INFO:journalctl@ceph.mds.c.smithi192.stdout:Jun 02 04:47:48 smithi192 systemd[1]: Starting Ceph mds.c for 60ab6d30-209a-11ef-bc9b-c7b262605968... 2024-06-02T04:47:48.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:48 smithi119 ceph-mon[46633]: Deploying daemon mds.c on smithi192 2024-06-02T04:47:48.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:48 smithi119 ceph-mon[46633]: mds.? [v2:172.21.15.192:6834/783181340,v1:172.21.15.192:6835/783181340] up:boot 2024-06-02T04:47:48.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:48 smithi119 ceph-mon[46633]: fsmap 6 up:standby 2024-06-02T04:47:48.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:48 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-06-02T04:47:48.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:48 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/1773715350' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:47:48.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:48 smithi076 ceph-mon[42935]: Deploying daemon mds.c on smithi192 2024-06-02T04:47:48.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:48 smithi076 ceph-mon[42935]: mds.? [v2:172.21.15.192:6834/783181340,v1:172.21.15.192:6835/783181340] up:boot 2024-06-02T04:47:48.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:48 smithi076 ceph-mon[42935]: fsmap 6 up:standby 2024-06-02T04:47:48.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:48 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-06-02T04:47:48.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:48 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/1773715350' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:47:48.681 INFO:journalctl@ceph.mds.c.smithi192.stdout:Jun 02 04:47:48 smithi192 ceph-mds[84315]: -- 172.21.15.192:0/353197850 <== mon.1 v2:172.21.15.192:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x561e7c8581a0 con 0x561e7c82e800 2024-06-02T04:47:48.681 INFO:journalctl@ceph.mds.c.smithi192.stdout:Jun 02 04:47:48 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-c[84292]: starting mds.c at 2024-06-02T04:47:48.681 INFO:journalctl@ceph.mds.c.smithi192.stdout:Jun 02 04:47:48 smithi192 bash[84277]: 3d552265f6947ee1b4680b1c1ada488cd076979a07d10db5005fc6b710982d77 2024-06-02T04:47:48.681 INFO:journalctl@ceph.mds.c.smithi192.stdout:Jun 02 04:47:48 smithi192 systemd[1]: Started Ceph mds.c for 60ab6d30-209a-11ef-bc9b-c7b262605968. 2024-06-02T04:47:49.204 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:49 smithi119 ceph-mon[46633]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T04:47:49.204 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:49 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:49.204 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:49 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:49.204 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:49 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:49.204 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:49 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T04:47:49.204 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:49 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T04:47:49.204 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:49 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:47:49.384 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T04:47:49.415 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:49 smithi076 ceph-mon[42935]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T04:47:49.415 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:49 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:49.415 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:49 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:49.415 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:49 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:49.415 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:49 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T04:47:49.415 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:49 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T04:47:49.415 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:49 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:47:49.431 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:49 smithi192 ceph-mon[47933]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T04:47:49.431 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:49 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:49.431 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:49 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:49.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:49 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:49.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:49 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T04:47:49.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:49 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T04:47:49.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:49 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:47:49.530 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:49.528+0000 7f0d9ebbc700 1 -- 172.21.15.76:0/1103938511 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0d980ff120 msgr2=0x7f0d980ff540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:47:49.531 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:49.528+0000 7f0d9ebbc700 1 --2- 172.21.15.76:0/1103938511 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0d980ff120 0x7f0d980ff540 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0d8c009990 tx=0x7f0d8c009ca0 comp rx=0 tx=0).stop 2024-06-02T04:47:49.531 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:49.528+0000 7f0d9ebbc700 1 -- 172.21.15.76:0/1103938511 shutdown_connections 2024-06-02T04:47:49.531 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:49.528+0000 7f0d9ebbc700 1 --2- 172.21.15.76:0/1103938511 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d98102b30 0x7f0d981093e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:49.531 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:49.528+0000 7f0d9ebbc700 1 --2- 172.21.15.76:0/1103938511 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0d980ff120 0x7f0d980ff540 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:49.531 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:49.528+0000 7f0d9ebbc700 1 --2- 172.21.15.76:0/1103938511 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0d98102190 0x7f0d981025f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:49.531 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:49.528+0000 7f0d9ebbc700 1 -- 172.21.15.76:0/1103938511 >> 172.21.15.76:0/1103938511 conn(0x7f0d980faa70 msgr2=0x7f0d980fce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:47:49.531 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:49.528+0000 7f0d9ebbc700 1 -- 172.21.15.76:0/1103938511 shutdown_connections 2024-06-02T04:47:49.531 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:49.528+0000 7f0d9ebbc700 1 -- 172.21.15.76:0/1103938511 wait complete. 2024-06-02T04:47:49.532 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:49.528+0000 7f0d9ebbc700 1 Processor -- start 2024-06-02T04:47:49.532 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:49.528+0000 7f0d9ebbc700 1 -- start start 2024-06-02T04:47:49.532 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:49.529+0000 7f0d9ebbc700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0d980ff120 0x7f0d98101ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:47:49.532 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:49.529+0000 7f0d9ebbc700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0d98102190 0x7f0d98100140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:47:49.532 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:49.529+0000 7f0d9ebbc700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d98102b30 0x7f0d98100680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:47:49.532 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:49.529+0000 7f0d9ebbc700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d98100e20 con 0x7f0d98102190 2024-06-02T04:47:49.532 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:49.529+0000 7f0d9ebbc700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d98100f90 con 0x7f0d98102b30 2024-06-02T04:47:49.532 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:49.529+0000 7f0d9ebbc700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d981a0d90 con 0x7f0d980ff120 2024-06-02T04:47:49.532 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:49.529+0000 7f0d97fff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0d98102190 0x7f0d98100140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:47:49.532 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:49.529+0000 7f0d97fff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0d98102190 0x7f0d98100140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:48760/0 (socket says 172.21.15.76:48760) 2024-06-02T04:47:49.532 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:49.529+0000 7f0d97fff700 1 -- 172.21.15.76:0/1132457582 learned_addr learned my addr 172.21.15.76:0/1132457582 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:47:49.532 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:49.529+0000 7f0d9d159700 1 --2- 172.21.15.76:0/1132457582 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d98102b30 0x7f0d98100680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:47:49.533 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:49.529+0000 7f0d9c958700 1 --2- 172.21.15.76:0/1132457582 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0d980ff120 0x7f0d98101ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:47:49.533 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:49.529+0000 7f0d97fff700 1 -- 172.21.15.76:0/1132457582 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0d980ff120 msgr2=0x7f0d98101ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:47:49.533 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:49.529+0000 7f0d97fff700 1 --2- 172.21.15.76:0/1132457582 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0d980ff120 0x7f0d98101ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:49.533 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:49.529+0000 7f0d97fff700 1 -- 172.21.15.76:0/1132457582 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d98102b30 msgr2=0x7f0d98100680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:47:49.533 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:49.529+0000 7f0d97fff700 1 --2- 172.21.15.76:0/1132457582 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d98102b30 0x7f0d98100680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:49.533 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:49.529+0000 7f0d97fff700 1 -- 172.21.15.76:0/1132457582 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d8c0095f0 con 0x7f0d98102190 2024-06-02T04:47:49.533 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:49.529+0000 7f0d9d159700 1 --2- 172.21.15.76:0/1132457582 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d98102b30 0x7f0d98100680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T04:47:49.533 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:49.529+0000 7f0d97fff700 1 --2- 172.21.15.76:0/1132457582 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0d98102190 0x7f0d98100140 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0d8400c920 tx=0x7f0d8400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:47:49.533 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:49.529+0000 7f0d95ffb700 1 -- 172.21.15.76:0/1132457582 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d84007aa0 con 0x7f0d98102190 2024-06-02T04:47:49.533 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:49.529+0000 7f0d9ebbc700 1 -- 172.21.15.76:0/1132457582 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d981a0fc0 con 0x7f0d98102190 2024-06-02T04:47:49.533 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:49.529+0000 7f0d95ffb700 1 -- 172.21.15.76:0/1132457582 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0d8400ce70 con 0x7f0d98102190 2024-06-02T04:47:49.534 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:49.529+0000 7f0d95ffb700 1 -- 172.21.15.76:0/1132457582 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d84005330 con 0x7f0d98102190 2024-06-02T04:47:49.534 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:49.530+0000 7f0d9ebbc700 1 -- 172.21.15.76:0/1132457582 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d981a14a0 con 0x7f0d98102190 2024-06-02T04:47:49.534 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:49.531+0000 7f0d9ebbc700 1 -- 172.21.15.76:0/1132457582 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d98108470 con 0x7f0d98102190 2024-06-02T04:47:49.535 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:49.531+0000 7f0d95ffb700 1 -- 172.21.15.76:0/1132457582 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f0d840055a0 con 0x7f0d98102190 2024-06-02T04:47:49.535 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:49.532+0000 7f0d95ffb700 1 --2- 172.21.15.76:0/1132457582 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f0d880a1120 0x7f0d880a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:47:49.535 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:49.532+0000 7f0d9c958700 1 --2- 172.21.15.76:0/1132457582 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f0d880a1120 0x7f0d880a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:47:49.535 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:49.532+0000 7f0d95ffb700 1 -- 172.21.15.76:0/1132457582 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f0d840cc000 con 0x7f0d98102190 2024-06-02T04:47:49.535 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:49.533+0000 7f0d9c958700 1 --2- 172.21.15.76:0/1132457582 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f0d880a1120 0x7f0d880a35e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0d8c005910 tx=0x7f0d8c005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:47:49.537 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:49.537+0000 7f0d95ffb700 1 -- 172.21.15.76:0/1132457582 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f0d84095c30 con 0x7f0d98102190 2024-06-02T04:47:49.710 INFO:journalctl@ceph.mds.h.smithi119.stdout:Jun 02 04:47:49 smithi119 systemd[1]: Starting Ceph mds.h for 60ab6d30-209a-11ef-bc9b-c7b262605968... 2024-06-02T04:47:49.779 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:49.779+0000 7f0d9ebbc700 1 -- 172.21.15.76:0/1132457582 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0d9810c550 con 0x7f0d98102190 2024-06-02T04:47:49.780 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:49.780+0000 7f0d95ffb700 1 -- 172.21.15.76:0/1132457582 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+5808 (secure 0 0 0) 0x7f0d84099250 con 0x7f0d98102190 2024-06-02T04:47:49.780 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:47:49.780 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":8,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6835/3029342152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3029342152},{"type":"v1","addr":"172.21.15.76:6835","nonce":3029342152}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6837/1207985317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":1207985317},{"type":"v1","addr":"172.21.15.76:6837","nonce":1207985317}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/1543944863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":1543944863},{"type":"v1","addr":"172.21.15.119:6833","nonce":1543944863}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24418,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6833/1527921393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1527921393},{"type":"v1","addr":"172.21.15.192:6833","nonce":1527921393}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24434,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/2746840347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":2746840347},{"type":"v1","addr":"172.21.15.119:6835","nonce":2746840347}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24451,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/783181340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":783181340},{"type":"v1","addr":"172.21.15.192:6835","nonce":783181340}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24463,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/960773710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":960773710},{"type":"v1","addr":"172.21.15.192:6837","nonce":960773710}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8}],"filesystems":[]} 2024-06-02T04:47:49.782 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:49.782+0000 7f0d9ebbc700 1 -- 172.21.15.76:0/1132457582 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f0d880a1120 msgr2=0x7f0d880a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:47:49.783 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:49.782+0000 7f0d9ebbc700 1 --2- 172.21.15.76:0/1132457582 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f0d880a1120 0x7f0d880a35e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0d8c005910 tx=0x7f0d8c005fb0 comp rx=0 tx=0).stop 2024-06-02T04:47:49.783 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:49.782+0000 7f0d9ebbc700 1 -- 172.21.15.76:0/1132457582 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0d98102190 msgr2=0x7f0d98100140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:47:49.783 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:49.782+0000 7f0d9ebbc700 1 --2- 172.21.15.76:0/1132457582 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0d98102190 0x7f0d98100140 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0d8400c920 tx=0x7f0d8400cc30 comp rx=0 tx=0).stop 2024-06-02T04:47:49.783 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:49.782+0000 7f0d9ebbc700 1 -- 172.21.15.76:0/1132457582 shutdown_connections 2024-06-02T04:47:49.783 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:49.782+0000 7f0d9ebbc700 1 --2- 172.21.15.76:0/1132457582 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f0d880a1120 0x7f0d880a35e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:49.783 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:49.782+0000 7f0d9ebbc700 1 --2- 172.21.15.76:0/1132457582 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d98102b30 0x7f0d98100680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:49.783 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:49.782+0000 7f0d9ebbc700 1 --2- 172.21.15.76:0/1132457582 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0d980ff120 0x7f0d98101ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:49.783 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:49.782+0000 7f0d9ebbc700 1 --2- 172.21.15.76:0/1132457582 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0d98102190 0x7f0d98100140 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:49.783 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:49.782+0000 7f0d9ebbc700 1 -- 172.21.15.76:0/1132457582 >> 172.21.15.76:0/1132457582 conn(0x7f0d980faa70 msgr2=0x7f0d981055b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:47:49.783 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:49.782+0000 7f0d9ebbc700 1 -- 172.21.15.76:0/1132457582 shutdown_connections 2024-06-02T04:47:49.783 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:49.782+0000 7f0d9ebbc700 1 -- 172.21.15.76:0/1132457582 wait complete. 2024-06-02T04:47:49.784 INFO:teuthology.orchestra.run.smithi076.stderr:dumped fsmap epoch 8 2024-06-02T04:47:50.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:50 smithi076 ceph-mon[42935]: Deploying daemon mds.h on smithi119 2024-06-02T04:47:50.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:50 smithi076 ceph-mon[42935]: mds.? [v2:172.21.15.192:6836/960773710,v1:172.21.15.192:6837/960773710] up:boot 2024-06-02T04:47:50.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:50 smithi076 ceph-mon[42935]: fsmap 7 up:standby 2024-06-02T04:47:50.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:50 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-06-02T04:47:50.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:50 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/1132457582' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:47:50.346 INFO:journalctl@ceph.mds.h.smithi119.stdout:Jun 02 04:47:50 smithi119 ceph-mds[82949]: -- 172.21.15.119:0/2124935978 <== mon.2 v2:172.21.15.119:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x556a5d66e1a0 con 0x556a5d644c00 2024-06-02T04:47:50.346 INFO:journalctl@ceph.mds.h.smithi119.stdout:Jun 02 04:47:50 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-h[82925]: starting mds.h at 2024-06-02T04:47:50.346 INFO:journalctl@ceph.mds.h.smithi119.stdout:Jun 02 04:47:50 smithi119 bash[82911]: 5ae75b6c981b6c3fb69e737480bcb23274ea6f57673b84b29ab3484e2c43615b 2024-06-02T04:47:50.347 INFO:journalctl@ceph.mds.h.smithi119.stdout:Jun 02 04:47:50 smithi119 systemd[1]: Started Ceph mds.h for 60ab6d30-209a-11ef-bc9b-c7b262605968. 2024-06-02T04:47:50.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:50 smithi119 ceph-mon[46633]: Deploying daemon mds.h on smithi119 2024-06-02T04:47:50.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:50 smithi119 ceph-mon[46633]: mds.? [v2:172.21.15.192:6836/960773710,v1:172.21.15.192:6837/960773710] up:boot 2024-06-02T04:47:50.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:50 smithi119 ceph-mon[46633]: fsmap 7 up:standby 2024-06-02T04:47:50.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:50 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-06-02T04:47:50.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:50 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/1132457582' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:47:50.431 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:50 smithi192 ceph-mon[47933]: Deploying daemon mds.h on smithi119 2024-06-02T04:47:50.431 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:50 smithi192 ceph-mon[47933]: mds.? [v2:172.21.15.192:6836/960773710,v1:172.21.15.192:6837/960773710] up:boot 2024-06-02T04:47:50.431 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:50 smithi192 ceph-mon[47933]: fsmap 7 up:standby 2024-06-02T04:47:50.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:50 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-06-02T04:47:50.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:50 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/1132457582' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:47:51.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:51 smithi192 ceph-mon[47933]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T04:47:51.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:51 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:51.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:51 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:51.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:51 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:51.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:51 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T04:47:51.363 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:51 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T04:47:51.363 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:51 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:47:51.363 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:51 smithi192 ceph-mon[47933]: Deploying daemon mds.i on smithi192 2024-06-02T04:47:51.363 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:51 smithi192 ceph-mon[47933]: mds.? [v2:172.21.15.119:6836/2171687478,v1:172.21.15.119:6837/2171687478] up:boot 2024-06-02T04:47:51.363 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:51 smithi192 ceph-mon[47933]: fsmap 8 up:standby 2024-06-02T04:47:51.363 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:51 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-06-02T04:47:51.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:51 smithi076 ceph-mon[42935]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T04:47:51.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:51 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:51.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:51 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:51.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:51 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:51.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:51 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T04:47:51.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:51 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T04:47:51.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:51 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:47:51.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:51 smithi076 ceph-mon[42935]: Deploying daemon mds.i on smithi192 2024-06-02T04:47:51.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:51 smithi076 ceph-mon[42935]: mds.? [v2:172.21.15.119:6836/2171687478,v1:172.21.15.119:6837/2171687478] up:boot 2024-06-02T04:47:51.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:51 smithi076 ceph-mon[42935]: fsmap 8 up:standby 2024-06-02T04:47:51.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:51 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-06-02T04:47:51.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:51 smithi119 ceph-mon[46633]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T04:47:51.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:51 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:51.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:51 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:51.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:51 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:51.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:51 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T04:47:51.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:51 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T04:47:51.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:51 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:47:51.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:51 smithi119 ceph-mon[46633]: Deploying daemon mds.i on smithi192 2024-06-02T04:47:51.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:51 smithi119 ceph-mon[46633]: mds.? [v2:172.21.15.119:6836/2171687478,v1:172.21.15.119:6837/2171687478] up:boot 2024-06-02T04:47:51.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:51 smithi119 ceph-mon[46633]: fsmap 8 up:standby 2024-06-02T04:47:51.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:51 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-06-02T04:47:51.681 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:47:51 smithi192 systemd[1]: Starting Ceph mds.i for 60ab6d30-209a-11ef-bc9b-c7b262605968... 2024-06-02T04:47:51.796 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T04:47:51.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:51.944+0000 7f7aee7e8700 1 -- 172.21.15.76:0/2362160179 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7ae8106b40 msgr2=0x7f7ae8108fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:47:51.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:51.944+0000 7f7aee7e8700 1 --2- 172.21.15.76:0/2362160179 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7ae8106b40 0x7f7ae8108fb0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7ae000b0a0 tx=0x7f7ae000b3b0 comp rx=0 tx=0).stop 2024-06-02T04:47:51.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:51.944+0000 7f7aee7e8700 1 -- 172.21.15.76:0/2362160179 shutdown_connections 2024-06-02T04:47:51.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:51.944+0000 7f7aee7e8700 1 --2- 172.21.15.76:0/2362160179 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7ae8106b40 0x7f7ae8108fb0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:51.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:51.944+0000 7f7aee7e8700 1 --2- 172.21.15.76:0/2362160179 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ae81018e0 0x7f7ae8103cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:51.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:51.944+0000 7f7aee7e8700 1 --2- 172.21.15.76:0/2362160179 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7ae8104210 0x7f7ae8106600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:51.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:51.944+0000 7f7aee7e8700 1 -- 172.21.15.76:0/2362160179 >> 172.21.15.76:0/2362160179 conn(0x7f7ae80fb2f0 msgr2=0x7f7ae80fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:47:51.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:51.944+0000 7f7aee7e8700 1 -- 172.21.15.76:0/2362160179 shutdown_connections 2024-06-02T04:47:51.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:51.944+0000 7f7aee7e8700 1 -- 172.21.15.76:0/2362160179 wait complete. 2024-06-02T04:47:51.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:51.945+0000 7f7aee7e8700 1 Processor -- start 2024-06-02T04:47:51.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:51.945+0000 7f7aee7e8700 1 -- start start 2024-06-02T04:47:51.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:51.945+0000 7f7aee7e8700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7ae81018e0 0x7f7ae8196d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:47:51.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:51.945+0000 7f7aee7e8700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ae8104210 0x7f7ae8197280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:47:51.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:51.945+0000 7f7aee7e8700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7ae8106b40 0x7f7ae819e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:47:51.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:51.945+0000 7f7aee7e8700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae819e830 con 0x7f7ae81018e0 2024-06-02T04:47:51.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:51.945+0000 7f7aee7e8700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae819e9a0 con 0x7f7ae8104210 2024-06-02T04:47:51.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:51.945+0000 7f7aee7e8700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae819eb60 con 0x7f7ae8106b40 2024-06-02T04:47:51.949 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:51.945+0000 7f7ae7fff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7ae81018e0 0x7f7ae8196d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:47:51.949 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:51.945+0000 7f7ae7fff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7ae81018e0 0x7f7ae8196d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:48784/0 (socket says 172.21.15.76:48784) 2024-06-02T04:47:51.949 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:51.945+0000 7f7ae7fff700 1 -- 172.21.15.76:0/3379106626 learned_addr learned my addr 172.21.15.76:0/3379106626 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:47:51.949 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:51.945+0000 7f7aecd85700 1 --2- 172.21.15.76:0/3379106626 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7ae8106b40 0x7f7ae819e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:47:51.949 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:51.945+0000 7f7ae77fe700 1 --2- 172.21.15.76:0/3379106626 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ae8104210 0x7f7ae8197280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:47:51.949 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:51.946+0000 7f7ae7fff700 1 -- 172.21.15.76:0/3379106626 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7ae8106b40 msgr2=0x7f7ae819e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:47:51.949 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:51.946+0000 7f7ae7fff700 1 --2- 172.21.15.76:0/3379106626 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7ae8106b40 0x7f7ae819e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:51.949 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:51.946+0000 7f7ae7fff700 1 -- 172.21.15.76:0/3379106626 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ae8104210 msgr2=0x7f7ae8197280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:47:51.949 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:51.946+0000 7f7ae7fff700 1 --2- 172.21.15.76:0/3379106626 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ae8104210 0x7f7ae8197280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:51.949 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:51.946+0000 7f7ae7fff700 1 -- 172.21.15.76:0/3379106626 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ae0009d00 con 0x7f7ae81018e0 2024-06-02T04:47:51.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:51.946+0000 7f7ae7fff700 1 --2- 172.21.15.76:0/3379106626 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7ae81018e0 0x7f7ae8196d40 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f7ad800e9a0 tx=0x7f7ad800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:47:51.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:51.946+0000 7f7ae57fa700 1 -- 172.21.15.76:0/3379106626 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad8009790 con 0x7f7ae81018e0 2024-06-02T04:47:51.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:51.946+0000 7f7ae57fa700 1 -- 172.21.15.76:0/3379106626 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7ad800cbd0 con 0x7f7ae81018e0 2024-06-02T04:47:51.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:51.946+0000 7f7ae57fa700 1 -- 172.21.15.76:0/3379106626 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad8018680 con 0x7f7ae81018e0 2024-06-02T04:47:51.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:51.946+0000 7f7aee7e8700 1 -- 172.21.15.76:0/3379106626 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ae819ee40 con 0x7f7ae81018e0 2024-06-02T04:47:51.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:51.946+0000 7f7aee7e8700 1 -- 172.21.15.76:0/3379106626 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ae819f260 con 0x7f7ae81018e0 2024-06-02T04:47:51.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:51.947+0000 7f7aee7e8700 1 -- 172.21.15.76:0/3379106626 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ae80fce70 con 0x7f7ae81018e0 2024-06-02T04:47:51.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:51.948+0000 7f7ae57fa700 1 -- 172.21.15.76:0/3379106626 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f7ad800cd40 con 0x7f7ae81018e0 2024-06-02T04:47:51.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:51.949+0000 7f7ae57fa700 1 --2- 172.21.15.76:0/3379106626 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f7ad00a11a0 0x7f7ad00a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:47:51.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:51.949+0000 7f7ae77fe700 1 --2- 172.21.15.76:0/3379106626 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f7ad00a11a0 0x7f7ad00a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:47:51.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:51.949+0000 7f7ae57fa700 1 -- 172.21.15.76:0/3379106626 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f7ad8014070 con 0x7f7ae81018e0 2024-06-02T04:47:51.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:51.949+0000 7f7ae77fe700 1 --2- 172.21.15.76:0/3379106626 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f7ad00a11a0 0x7f7ad00a3660 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7adc005950 tx=0x7f7adc0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:47:51.953 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:51.953+0000 7f7ae57fa700 1 -- 172.21.15.76:0/3379106626 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f7ad8052d60 con 0x7f7ae81018e0 2024-06-02T04:47:52.181 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:47:51 smithi192 ceph-mds[84657]: -- 172.21.15.192:0/2620305240 <== mon.1 v2:172.21.15.192:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x56376c6021a0 con 0x56376c5d8c00 2024-06-02T04:47:52.181 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:47:51 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: starting mds.i at 2024-06-02T04:47:52.181 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:47:51 smithi192 bash[84619]: 74426b90584f39e937785a94765e292c5ee1e7587a5037bcf1610be172aa4f7f 2024-06-02T04:47:52.181 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:47:51 smithi192 systemd[1]: Started Ceph mds.i for 60ab6d30-209a-11ef-bc9b-c7b262605968. 2024-06-02T04:47:52.224 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:52.223+0000 7f7aee7e8700 1 -- 172.21.15.76:0/3379106626 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7ae8067c10 con 0x7f7ae81018e0 2024-06-02T04:47:52.224 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:52.224+0000 7f7ae57fa700 1 -- 172.21.15.76:0/3379106626 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+7330 (secure 0 0 0) 0x7f7ad8096230 con 0x7f7ae81018e0 2024-06-02T04:47:52.224 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:47:52.224 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":10,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6835/3029342152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3029342152},{"type":"v1","addr":"172.21.15.76:6835","nonce":3029342152}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6837/1207985317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":1207985317},{"type":"v1","addr":"172.21.15.76:6837","nonce":1207985317}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/1543944863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":1543944863},{"type":"v1","addr":"172.21.15.119:6833","nonce":1543944863}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24418,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6833/1527921393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1527921393},{"type":"v1","addr":"172.21.15.192:6833","nonce":1527921393}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24434,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/2746840347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":2746840347},{"type":"v1","addr":"172.21.15.119:6835","nonce":2746840347}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24451,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/783181340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":783181340},{"type":"v1","addr":"172.21.15.192:6835","nonce":783181340}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24458,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/2171687478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":2171687478},{"type":"v1","addr":"172.21.15.119:6837","nonce":2171687478}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24463,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/960773710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":960773710},{"type":"v1","addr":"172.21.15.192:6837","nonce":960773710}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24475,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/3978681402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":3978681402},{"type":"v1","addr":"172.21.15.192:6839","nonce":3978681402}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[]} 2024-06-02T04:47:52.227 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:52.226+0000 7f7aee7e8700 1 -- 172.21.15.76:0/3379106626 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f7ad00a11a0 msgr2=0x7f7ad00a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:47:52.227 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:52.226+0000 7f7aee7e8700 1 --2- 172.21.15.76:0/3379106626 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f7ad00a11a0 0x7f7ad00a3660 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7adc005950 tx=0x7f7adc0058e0 comp rx=0 tx=0).stop 2024-06-02T04:47:52.227 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:52.226+0000 7f7aee7e8700 1 -- 172.21.15.76:0/3379106626 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7ae81018e0 msgr2=0x7f7ae8196d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:47:52.227 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:52.226+0000 7f7aee7e8700 1 --2- 172.21.15.76:0/3379106626 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7ae81018e0 0x7f7ae8196d40 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f7ad800e9a0 tx=0x7f7ad800ecb0 comp rx=0 tx=0).stop 2024-06-02T04:47:52.227 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:52.227+0000 7f7aee7e8700 1 -- 172.21.15.76:0/3379106626 shutdown_connections 2024-06-02T04:47:52.227 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:52.227+0000 7f7aee7e8700 1 --2- 172.21.15.76:0/3379106626 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7ae8106b40 0x7f7ae819e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:52.228 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:52.227+0000 7f7aee7e8700 1 --2- 172.21.15.76:0/3379106626 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7ae81018e0 0x7f7ae8196d40 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:52.228 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:52.227+0000 7f7aee7e8700 1 --2- 172.21.15.76:0/3379106626 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f7ad00a11a0 0x7f7ad00a3660 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:52.228 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:52.227+0000 7f7aee7e8700 1 --2- 172.21.15.76:0/3379106626 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ae8104210 0x7f7ae8197280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:52.228 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:52.227+0000 7f7aee7e8700 1 -- 172.21.15.76:0/3379106626 >> 172.21.15.76:0/3379106626 conn(0x7f7ae80fb2f0 msgr2=0x7f7ae81022e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:47:52.228 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:52.227+0000 7f7aee7e8700 1 -- 172.21.15.76:0/3379106626 shutdown_connections 2024-06-02T04:47:52.228 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:52.227+0000 7f7aee7e8700 1 -- 172.21.15.76:0/3379106626 wait complete. 2024-06-02T04:47:52.228 INFO:teuthology.orchestra.run.smithi076.stderr:dumped fsmap epoch 10 2024-06-02T04:47:52.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:52 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:52.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:52 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:52.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:52 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:52.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:52 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T04:47:52.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:52 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T04:47:52.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:52 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:47:52.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:52 smithi076 ceph-mon[42935]: Deploying daemon mds.g on smithi076 2024-06-02T04:47:52.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:52 smithi076 ceph-mon[42935]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T04:47:52.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:52 smithi076 ceph-mon[42935]: mds.? [v2:172.21.15.192:6838/3978681402,v1:172.21.15.192:6839/3978681402] up:boot 2024-06-02T04:47:52.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:52 smithi076 ceph-mon[42935]: fsmap 9 up:standby 2024-06-02T04:47:52.985 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:52 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-06-02T04:47:52.985 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:52 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/3379106626' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:47:53.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:52 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:53.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:52 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:53.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:52 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:53.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:52 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T04:47:53.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:52 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T04:47:53.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:52 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:47:53.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:52 smithi192 ceph-mon[47933]: Deploying daemon mds.g on smithi076 2024-06-02T04:47:53.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:52 smithi192 ceph-mon[47933]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T04:47:53.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:52 smithi192 ceph-mon[47933]: mds.? [v2:172.21.15.192:6838/3978681402,v1:172.21.15.192:6839/3978681402] up:boot 2024-06-02T04:47:53.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:52 smithi192 ceph-mon[47933]: fsmap 9 up:standby 2024-06-02T04:47:53.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:52 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-06-02T04:47:53.183 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:52 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/3379106626' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:47:53.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:52 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:53.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:52 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:53.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:52 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:53.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:52 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T04:47:53.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:52 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T04:47:53.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:52 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:47:53.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:52 smithi119 ceph-mon[46633]: Deploying daemon mds.g on smithi076 2024-06-02T04:47:53.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:52 smithi119 ceph-mon[46633]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T04:47:53.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:52 smithi119 ceph-mon[46633]: mds.? [v2:172.21.15.192:6838/3978681402,v1:172.21.15.192:6839/3978681402] up:boot 2024-06-02T04:47:53.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:52 smithi119 ceph-mon[46633]: fsmap 9 up:standby 2024-06-02T04:47:53.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:52 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-06-02T04:47:53.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:52 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/3379106626' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:47:53.483 INFO:journalctl@ceph.mds.g.smithi076.stdout:Jun 02 04:47:53 smithi076 systemd[1]: Starting Ceph mds.g for 60ab6d30-209a-11ef-bc9b-c7b262605968... 2024-06-02T04:47:53.983 INFO:journalctl@ceph.mds.g.smithi076.stdout:Jun 02 04:47:53 smithi076 ceph-mds[94963]: -- 172.21.15.76:0/2907915176 <== mon.0 v2:172.21.15.76:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5555997c01a0 con 0x555599797000 2024-06-02T04:47:53.983 INFO:journalctl@ceph.mds.g.smithi076.stdout:Jun 02 04:47:53 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-g[94940]: starting mds.g at 2024-06-02T04:47:53.984 INFO:journalctl@ceph.mds.g.smithi076.stdout:Jun 02 04:47:53 smithi076 bash[94925]: 1d13153c1882ef5e729da7b3c38e02f0797b8dc595ac7d9cad2fcf0aaf6b6de6 2024-06-02T04:47:53.984 INFO:journalctl@ceph.mds.g.smithi076.stdout:Jun 02 04:47:53 smithi076 systemd[1]: Started Ceph mds.g for 60ab6d30-209a-11ef-bc9b-c7b262605968. 2024-06-02T04:47:54.241 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T04:47:54.372 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:54.371+0000 7f0969503700 1 -- 172.21.15.76:0/3071532906 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0964106c00 msgr2=0x7f0964108ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:47:54.372 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:54.371+0000 7f0969503700 1 --2- 172.21.15.76:0/3071532906 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0964106c00 0x7f0964108ff0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f095c00b0a0 tx=0x7f095c00b3b0 comp rx=0 tx=0).stop 2024-06-02T04:47:54.372 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:54.371+0000 7f0969503700 1 -- 172.21.15.76:0/3071532906 shutdown_connections 2024-06-02T04:47:54.372 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:54.371+0000 7f0969503700 1 --2- 172.21.15.76:0/3071532906 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0964106c00 0x7f0964108ff0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:54.372 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:54.371+0000 7f0969503700 1 --2- 172.21.15.76:0/3071532906 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f09641019a0 0x7f0964103d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:54.372 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:54.371+0000 7f0969503700 1 --2- 172.21.15.76:0/3071532906 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f09641042d0 0x7f09641066c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:54.373 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:54.371+0000 7f0969503700 1 -- 172.21.15.76:0/3071532906 >> 172.21.15.76:0/3071532906 conn(0x7f09640fb2f0 msgr2=0x7f09640fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:47:54.373 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:54.371+0000 7f0969503700 1 -- 172.21.15.76:0/3071532906 shutdown_connections 2024-06-02T04:47:54.373 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:54.371+0000 7f0969503700 1 -- 172.21.15.76:0/3071532906 wait complete. 2024-06-02T04:47:54.373 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:54.372+0000 7f0969503700 1 Processor -- start 2024-06-02T04:47:54.373 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:54.372+0000 7f0969503700 1 -- start start 2024-06-02T04:47:54.375 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:54.372+0000 7f0969503700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f09641019a0 0x7f09641012c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:47:54.375 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:54.372+0000 7f0969503700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f09641042d0 0x7f09640ff950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:47:54.375 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:54.372+0000 7f0969503700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0964106c00 0x7f09640ffe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:47:54.375 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:54.372+0000 7f0969503700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0964100630 con 0x7f09641019a0 2024-06-02T04:47:54.375 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:54.372+0000 7f0969503700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09641007a0 con 0x7f09641042d0 2024-06-02T04:47:54.375 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:54.372+0000 7f0969503700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09641a0df0 con 0x7f0964106c00 2024-06-02T04:47:54.375 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:54.373+0000 7f0962ffd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f09641019a0 0x7f09641012c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:47:54.375 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:54.373+0000 7f0962ffd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f09641019a0 0x7f09641012c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:49000/0 (socket says 172.21.15.76:49000) 2024-06-02T04:47:54.375 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:54.373+0000 7f0962ffd700 1 -- 172.21.15.76:0/2621693968 learned_addr learned my addr 172.21.15.76:0/2621693968 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:47:54.376 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:54.373+0000 7f09627fc700 1 --2- 172.21.15.76:0/2621693968 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f09641042d0 0x7f09640ff950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:47:54.376 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:54.373+0000 7f09637fe700 1 --2- 172.21.15.76:0/2621693968 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0964106c00 0x7f09640ffe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:47:54.376 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:54.373+0000 7f0962ffd700 1 -- 172.21.15.76:0/2621693968 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0964106c00 msgr2=0x7f09640ffe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:47:54.376 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:54.373+0000 7f0962ffd700 1 --2- 172.21.15.76:0/2621693968 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0964106c00 0x7f09640ffe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:54.376 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:54.373+0000 7f0962ffd700 1 -- 172.21.15.76:0/2621693968 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f09641042d0 msgr2=0x7f09640ff950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:47:54.376 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:54.373+0000 7f0962ffd700 1 --2- 172.21.15.76:0/2621693968 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f09641042d0 0x7f09640ff950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:54.376 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:54.373+0000 7f0962ffd700 1 -- 172.21.15.76:0/2621693968 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f095c009d00 con 0x7f09641019a0 2024-06-02T04:47:54.376 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:54.373+0000 7f09637fe700 1 --2- 172.21.15.76:0/2621693968 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0964106c00 0x7f09640ffe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:47:54.376 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:54.373+0000 7f09627fc700 1 --2- 172.21.15.76:0/2621693968 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f09641042d0 0x7f09640ff950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T04:47:54.376 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:54.373+0000 7f0962ffd700 1 --2- 172.21.15.76:0/2621693968 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f09641019a0 0x7f09641012c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f095400e9a0 tx=0x7f095400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:47:54.376 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:54.373+0000 7f094bfff700 1 -- 172.21.15.76:0/2621693968 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0954009790 con 0x7f09641019a0 2024-06-02T04:47:54.376 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:54.373+0000 7f0969503700 1 -- 172.21.15.76:0/2621693968 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09641a1080 con 0x7f09641019a0 2024-06-02T04:47:54.376 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:54.373+0000 7f094bfff700 1 -- 172.21.15.76:0/2621693968 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0954010430 con 0x7f09641019a0 2024-06-02T04:47:54.377 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:54.373+0000 7f094bfff700 1 -- 172.21.15.76:0/2621693968 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0954018680 con 0x7f09641019a0 2024-06-02T04:47:54.377 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:54.373+0000 7f0969503700 1 -- 172.21.15.76:0/2621693968 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09641a15e0 con 0x7f09641019a0 2024-06-02T04:47:54.377 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:54.374+0000 7f0969503700 1 -- 172.21.15.76:0/2621693968 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09640fce70 con 0x7f09641019a0 2024-06-02T04:47:54.377 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:54.375+0000 7f094bfff700 1 -- 172.21.15.76:0/2621693968 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f095400cb70 con 0x7f09641019a0 2024-06-02T04:47:54.378 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:54.376+0000 7f094bfff700 1 --2- 172.21.15.76:0/2621693968 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f094c0a1120 0x7f094c0a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:47:54.378 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:54.376+0000 7f094bfff700 1 -- 172.21.15.76:0/2621693968 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f0954014070 con 0x7f09641019a0 2024-06-02T04:47:54.378 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:54.376+0000 7f09627fc700 1 --2- 172.21.15.76:0/2621693968 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f094c0a1120 0x7f094c0a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:47:54.378 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:54.376+0000 7f09627fc700 1 --2- 172.21.15.76:0/2621693968 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f094c0a1120 0x7f094c0a35e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0958011490 tx=0x7f0958009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:47:54.382 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:54.380+0000 7f094bfff700 1 -- 172.21.15.76:0/2621693968 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f0954052d60 con 0x7f09641019a0 2024-06-02T04:47:54.629 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:54.629+0000 7f0969503700 1 -- 172.21.15.76:0/2621693968 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f096410c730 con 0x7f09641019a0 2024-06-02T04:47:54.630 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:54.630+0000 7f094bfff700 1 -- 172.21.15.76:0/2621693968 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+8085 (secure 0 0 0) 0x7f09540962a0 con 0x7f09641019a0 2024-06-02T04:47:54.630 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:47:54.630 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":11,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6835/3029342152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3029342152},{"type":"v1","addr":"172.21.15.76:6835","nonce":3029342152}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6837/1207985317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":1207985317},{"type":"v1","addr":"172.21.15.76:6837","nonce":1207985317}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14607,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6839/928709755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":928709755},{"type":"v1","addr":"172.21.15.76:6839","nonce":928709755}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/1543944863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":1543944863},{"type":"v1","addr":"172.21.15.119:6833","nonce":1543944863}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24418,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6833/1527921393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1527921393},{"type":"v1","addr":"172.21.15.192:6833","nonce":1527921393}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24434,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/2746840347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":2746840347},{"type":"v1","addr":"172.21.15.119:6835","nonce":2746840347}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24451,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/783181340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":783181340},{"type":"v1","addr":"172.21.15.192:6835","nonce":783181340}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24458,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/2171687478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":2171687478},{"type":"v1","addr":"172.21.15.119:6837","nonce":2171687478}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24463,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/960773710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":960773710},{"type":"v1","addr":"172.21.15.192:6837","nonce":960773710}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24475,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/3978681402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":3978681402},{"type":"v1","addr":"172.21.15.192:6839","nonce":3978681402}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[]} 2024-06-02T04:47:54.632 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:54.632+0000 7f0969503700 1 -- 172.21.15.76:0/2621693968 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f094c0a1120 msgr2=0x7f094c0a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:47:54.632 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:54.632+0000 7f0969503700 1 --2- 172.21.15.76:0/2621693968 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f094c0a1120 0x7f094c0a35e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0958011490 tx=0x7f0958009260 comp rx=0 tx=0).stop 2024-06-02T04:47:54.632 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:54.632+0000 7f0969503700 1 -- 172.21.15.76:0/2621693968 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f09641019a0 msgr2=0x7f09641012c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:47:54.633 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:54.632+0000 7f0969503700 1 --2- 172.21.15.76:0/2621693968 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f09641019a0 0x7f09641012c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f095400e9a0 tx=0x7f095400ecb0 comp rx=0 tx=0).stop 2024-06-02T04:47:54.633 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:54.632+0000 7f0969503700 1 -- 172.21.15.76:0/2621693968 shutdown_connections 2024-06-02T04:47:54.633 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:54.632+0000 7f0969503700 1 --2- 172.21.15.76:0/2621693968 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0964106c00 0x7f09640ffe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:54.633 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:54.632+0000 7f0969503700 1 --2- 172.21.15.76:0/2621693968 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f09641019a0 0x7f09641012c0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:54.633 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:54.632+0000 7f0969503700 1 --2- 172.21.15.76:0/2621693968 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f094c0a1120 0x7f094c0a35e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:54.633 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:54.632+0000 7f0969503700 1 --2- 172.21.15.76:0/2621693968 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f09641042d0 0x7f09640ff950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:54.633 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:54.632+0000 7f0969503700 1 -- 172.21.15.76:0/2621693968 >> 172.21.15.76:0/2621693968 conn(0x7f09640fb2f0 msgr2=0x7f09641023e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:47:54.633 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:54.632+0000 7f0969503700 1 -- 172.21.15.76:0/2621693968 shutdown_connections 2024-06-02T04:47:54.633 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:54.632+0000 7f0969503700 1 -- 172.21.15.76:0/2621693968 wait complete. 2024-06-02T04:47:54.634 INFO:teuthology.orchestra.run.smithi076.stderr:dumped fsmap epoch 11 2024-06-02T04:47:54.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:54 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:54.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:54 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:54.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:54 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:54.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:54 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T04:47:54.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:54 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T04:47:54.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:54 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:47:54.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:54 smithi076 ceph-mon[42935]: Deploying daemon mds.a on smithi076 2024-06-02T04:47:54.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:54 smithi076 ceph-mon[42935]: mds.? [v2:172.21.15.76:6838/928709755,v1:172.21.15.76:6839/928709755] up:boot 2024-06-02T04:47:54.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:54 smithi076 ceph-mon[42935]: fsmap 10 up:standby 2024-06-02T04:47:54.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:54 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-06-02T04:47:54.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:54 smithi076 ceph-mon[42935]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T04:47:54.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:54 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/2621693968' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:47:55.013 INFO:journalctl@ceph.mds.a.smithi076.stdout:Jun 02 04:47:55 smithi076 systemd[1]: Starting Ceph mds.a for 60ab6d30-209a-11ef-bc9b-c7b262605968... 2024-06-02T04:47:55.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:54 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:55.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:54 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:55.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:54 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:55.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:54 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T04:47:55.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:54 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T04:47:55.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:54 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:47:55.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:54 smithi119 ceph-mon[46633]: Deploying daemon mds.a on smithi076 2024-06-02T04:47:55.097 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:54 smithi119 ceph-mon[46633]: mds.? [v2:172.21.15.76:6838/928709755,v1:172.21.15.76:6839/928709755] up:boot 2024-06-02T04:47:55.097 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:54 smithi119 ceph-mon[46633]: fsmap 10 up:standby 2024-06-02T04:47:55.097 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:54 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-06-02T04:47:55.097 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:54 smithi119 ceph-mon[46633]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T04:47:55.097 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:54 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/2621693968' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:47:55.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:54 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:55.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:54 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:55.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:54 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:55.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:54 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T04:47:55.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:54 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T04:47:55.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:54 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:47:55.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:54 smithi192 ceph-mon[47933]: Deploying daemon mds.a on smithi076 2024-06-02T04:47:55.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:54 smithi192 ceph-mon[47933]: mds.? [v2:172.21.15.76:6838/928709755,v1:172.21.15.76:6839/928709755] up:boot 2024-06-02T04:47:55.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:54 smithi192 ceph-mon[47933]: fsmap 10 up:standby 2024-06-02T04:47:55.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:54 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-06-02T04:47:55.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:54 smithi192 ceph-mon[47933]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T04:47:55.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:54 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/2621693968' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:47:55.733 INFO:journalctl@ceph.mds.a.smithi076.stdout:Jun 02 04:47:55 smithi076 ceph-mds[95350]: -- 172.21.15.76:0/1527662424 <== mon.0 v2:172.21.15.76:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55d9eb32a1a0 con 0x55d9eb301000 2024-06-02T04:47:55.733 INFO:journalctl@ceph.mds.a.smithi076.stdout:Jun 02 04:47:55 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-a[95327]: starting mds.a at 2024-06-02T04:47:55.734 INFO:journalctl@ceph.mds.a.smithi076.stdout:Jun 02 04:47:55 smithi076 bash[95312]: d733ffc5d229c6c140de1172bf9e4edbd3c6dc548fbc4d2626c23ba3e4840ebe 2024-06-02T04:47:55.734 INFO:journalctl@ceph.mds.a.smithi076.stdout:Jun 02 04:47:55 smithi076 systemd[1]: Started Ceph mds.a for 60ab6d30-209a-11ef-bc9b-c7b262605968. 2024-06-02T04:47:56.646 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T04:47:56.710 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:56 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:56.710 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:56 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:56.710 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:56 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:56.710 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:56 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T04:47:56.710 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:56 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T04:47:56.710 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:56 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:47:56.710 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:56 smithi119 ceph-mon[46633]: Deploying daemon mds.b on smithi119 2024-06-02T04:47:56.710 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:56 smithi119 ceph-mon[46633]: mds.? [v2:172.21.15.76:6840/4162178633,v1:172.21.15.76:6841/4162178633] up:boot 2024-06-02T04:47:56.711 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:56 smithi119 ceph-mon[46633]: fsmap 11 up:standby 2024-06-02T04:47:56.711 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:56 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-06-02T04:47:56.711 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:56 smithi119 ceph-mon[46633]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T04:47:56.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:56 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:56.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:56 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:56.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:56 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:56.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:56 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T04:47:56.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:56 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T04:47:56.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:56 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:47:56.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:56 smithi076 ceph-mon[42935]: Deploying daemon mds.b on smithi119 2024-06-02T04:47:56.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:56 smithi076 ceph-mon[42935]: mds.? [v2:172.21.15.76:6840/4162178633,v1:172.21.15.76:6841/4162178633] up:boot 2024-06-02T04:47:56.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:56 smithi076 ceph-mon[42935]: fsmap 11 up:standby 2024-06-02T04:47:56.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:56 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-06-02T04:47:56.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:56 smithi076 ceph-mon[42935]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T04:47:56.792 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:56.789+0000 7ff219823700 1 -- 172.21.15.76:0/3739249060 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff2141018f0 msgr2=0x7ff214103ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:47:56.792 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:56.789+0000 7ff219823700 1 --2- 172.21.15.76:0/3739249060 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff2141018f0 0x7ff214103ce0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff208009990 tx=0x7ff208009ca0 comp rx=0 tx=0).stop 2024-06-02T04:47:56.792 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:56.789+0000 7ff219823700 1 -- 172.21.15.76:0/3739249060 shutdown_connections 2024-06-02T04:47:56.792 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:56.789+0000 7ff219823700 1 --2- 172.21.15.76:0/3739249060 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff214106b50 0x7ff214108fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:56.792 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:56.789+0000 7ff219823700 1 --2- 172.21.15.76:0/3739249060 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff2141018f0 0x7ff214103ce0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:56.792 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:56.789+0000 7ff219823700 1 --2- 172.21.15.76:0/3739249060 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff214104220 0x7ff214106610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:56.792 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:56.789+0000 7ff219823700 1 -- 172.21.15.76:0/3739249060 >> 172.21.15.76:0/3739249060 conn(0x7ff2140fb2e0 msgr2=0x7ff2140fd720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:47:56.792 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:56.789+0000 7ff219823700 1 -- 172.21.15.76:0/3739249060 shutdown_connections 2024-06-02T04:47:56.792 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:56.789+0000 7ff219823700 1 -- 172.21.15.76:0/3739249060 wait complete. 2024-06-02T04:47:56.792 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:56.790+0000 7ff219823700 1 Processor -- start 2024-06-02T04:47:56.792 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:56.790+0000 7ff219823700 1 -- start start 2024-06-02T04:47:56.793 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:56.790+0000 7ff219823700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff2141018f0 0x7ff214196d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:47:56.793 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:56.790+0000 7ff219823700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff214104220 0x7ff214197240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:47:56.793 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:56.790+0000 7ff219823700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff214106b50 0x7ff21419e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:47:56.793 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:56.790+0000 7ff219823700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff21419e820 con 0x7ff2141018f0 2024-06-02T04:47:56.793 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:56.790+0000 7ff219823700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff21419e990 con 0x7ff214104220 2024-06-02T04:47:56.793 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:56.790+0000 7ff219823700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff21419eb50 con 0x7ff214106b50 2024-06-02T04:47:56.793 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:56.790+0000 7ff212ffd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff2141018f0 0x7ff214196d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:47:56.793 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:56.790+0000 7ff212ffd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff2141018f0 0x7ff214196d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:49046/0 (socket says 172.21.15.76:49046) 2024-06-02T04:47:56.793 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:56.790+0000 7ff212ffd700 1 -- 172.21.15.76:0/1559833005 learned_addr learned my addr 172.21.15.76:0/1559833005 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:47:56.793 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:56.790+0000 7ff2127fc700 1 --2- 172.21.15.76:0/1559833005 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff214104220 0x7ff214197240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:47:56.793 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:56.790+0000 7ff2137fe700 1 --2- 172.21.15.76:0/1559833005 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff214106b50 0x7ff21419e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:47:56.793 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:56.790+0000 7ff212ffd700 1 -- 172.21.15.76:0/1559833005 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff214106b50 msgr2=0x7ff21419e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:47:56.793 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:56.790+0000 7ff212ffd700 1 --2- 172.21.15.76:0/1559833005 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff214106b50 0x7ff21419e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:56.793 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:56.790+0000 7ff212ffd700 1 -- 172.21.15.76:0/1559833005 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff214104220 msgr2=0x7ff214197240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:47:56.794 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:56.790+0000 7ff212ffd700 1 --2- 172.21.15.76:0/1559833005 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff214104220 0x7ff214197240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:56.794 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:56.790+0000 7ff212ffd700 1 -- 172.21.15.76:0/1559833005 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2080095f0 con 0x7ff2141018f0 2024-06-02T04:47:56.794 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:56.790+0000 7ff212ffd700 1 --2- 172.21.15.76:0/1559833005 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff2141018f0 0x7ff214196d00 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff208005950 tx=0x7ff2080039f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:47:56.794 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:56.791+0000 7ff218821700 1 -- 172.21.15.76:0/1559833005 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff20801d070 con 0x7ff2141018f0 2024-06-02T04:47:56.794 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:56.791+0000 7ff219823700 1 -- 172.21.15.76:0/1559833005 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff21419edd0 con 0x7ff2141018f0 2024-06-02T04:47:56.794 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:56.791+0000 7ff218821700 1 -- 172.21.15.76:0/1559833005 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff20800be50 con 0x7ff2141018f0 2024-06-02T04:47:56.794 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:56.791+0000 7ff218821700 1 -- 172.21.15.76:0/1559833005 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff208004b10 con 0x7ff2141018f0 2024-06-02T04:47:56.794 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:56.791+0000 7ff219823700 1 -- 172.21.15.76:0/1559833005 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff21419f1a0 con 0x7ff2141018f0 2024-06-02T04:47:56.794 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:56.792+0000 7ff219823700 1 -- 172.21.15.76:0/1559833005 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2140fce60 con 0x7ff2141018f0 2024-06-02T04:47:56.795 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:56.793+0000 7ff218821700 1 -- 172.21.15.76:0/1559833005 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7ff208005330 con 0x7ff2141018f0 2024-06-02T04:47:56.795 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:56.793+0000 7ff218821700 1 --2- 172.21.15.76:0/1559833005 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7ff1fc0a1120 0x7ff1fc0a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:47:56.795 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:56.793+0000 7ff2127fc700 1 --2- 172.21.15.76:0/1559833005 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7ff1fc0a1120 0x7ff1fc0a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:47:56.795 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:56.793+0000 7ff218821700 1 -- 172.21.15.76:0/1559833005 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 7127+0+0 (secure 0 0 0) 0x7ff2080cd9c0 con 0x7ff2141018f0 2024-06-02T04:47:56.795 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:56.794+0000 7ff2127fc700 1 --2- 172.21.15.76:0/1559833005 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7ff1fc0a1120 0x7ff1fc0a35e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff2141981b0 tx=0x7ff204009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:47:56.797 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:56.797+0000 7ff218821700 1 -- 172.21.15.76:0/1559833005 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7ff208097680 con 0x7ff2141018f0 2024-06-02T04:47:56.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:56 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:56.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:56 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:56.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:56 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:56.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:56 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T04:47:56.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:56 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T04:47:56.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:56 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:47:56.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:56 smithi192 ceph-mon[47933]: Deploying daemon mds.b on smithi119 2024-06-02T04:47:56.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:56 smithi192 ceph-mon[47933]: mds.? [v2:172.21.15.76:6840/4162178633,v1:172.21.15.76:6841/4162178633] up:boot 2024-06-02T04:47:56.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:56 smithi192 ceph-mon[47933]: fsmap 11 up:standby 2024-06-02T04:47:56.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:56 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-06-02T04:47:56.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:56 smithi192 ceph-mon[47933]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T04:47:57.043 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:57.043+0000 7ff219823700 1 -- 172.21.15.76:0/1559833005 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff214068060 con 0x7ff2141018f0 2024-06-02T04:47:57.044 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:57.043+0000 7ff218821700 1 -- 172.21.15.76:0/1559833005 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+8843 (secure 0 0 0) 0x7ff20809aca0 con 0x7ff2141018f0 2024-06-02T04:47:57.044 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:47:57.044 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":12,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6835/3029342152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3029342152},{"type":"v1","addr":"172.21.15.76:6835","nonce":3029342152}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6837/1207985317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":1207985317},{"type":"v1","addr":"172.21.15.76:6837","nonce":1207985317}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14607,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6839/928709755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":928709755},{"type":"v1","addr":"172.21.15.76:6839","nonce":928709755}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6841/4162178633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6840","nonce":4162178633},{"type":"v1","addr":"172.21.15.76:6841","nonce":4162178633}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/1543944863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":1543944863},{"type":"v1","addr":"172.21.15.119:6833","nonce":1543944863}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24418,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6833/1527921393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1527921393},{"type":"v1","addr":"172.21.15.192:6833","nonce":1527921393}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24434,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/2746840347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":2746840347},{"type":"v1","addr":"172.21.15.119:6835","nonce":2746840347}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24451,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/783181340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":783181340},{"type":"v1","addr":"172.21.15.192:6835","nonce":783181340}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24458,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/2171687478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":2171687478},{"type":"v1","addr":"172.21.15.119:6837","nonce":2171687478}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24463,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/960773710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":960773710},{"type":"v1","addr":"172.21.15.192:6837","nonce":960773710}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24475,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/3978681402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":3978681402},{"type":"v1","addr":"172.21.15.192:6839","nonce":3978681402}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[]} 2024-06-02T04:47:57.046 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:57.045+0000 7ff219823700 1 -- 172.21.15.76:0/1559833005 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7ff1fc0a1120 msgr2=0x7ff1fc0a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:47:57.046 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:57.045+0000 7ff219823700 1 --2- 172.21.15.76:0/1559833005 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7ff1fc0a1120 0x7ff1fc0a35e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff2141981b0 tx=0x7ff204009260 comp rx=0 tx=0).stop 2024-06-02T04:47:57.046 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:57.045+0000 7ff219823700 1 -- 172.21.15.76:0/1559833005 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff2141018f0 msgr2=0x7ff214196d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:47:57.046 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:57.045+0000 7ff219823700 1 --2- 172.21.15.76:0/1559833005 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff2141018f0 0x7ff214196d00 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff208005950 tx=0x7ff2080039f0 comp rx=0 tx=0).stop 2024-06-02T04:47:57.046 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:57.046+0000 7ff219823700 1 -- 172.21.15.76:0/1559833005 shutdown_connections 2024-06-02T04:47:57.046 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:57.046+0000 7ff219823700 1 --2- 172.21.15.76:0/1559833005 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff214106b50 0x7ff21419e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:57.047 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:57.046+0000 7ff219823700 1 --2- 172.21.15.76:0/1559833005 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff2141018f0 0x7ff214196d00 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:57.047 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:57.046+0000 7ff219823700 1 --2- 172.21.15.76:0/1559833005 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7ff1fc0a1120 0x7ff1fc0a35e0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:57.047 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:57.046+0000 7ff219823700 1 --2- 172.21.15.76:0/1559833005 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff214104220 0x7ff214197240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:57.047 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:57.046+0000 7ff219823700 1 -- 172.21.15.76:0/1559833005 >> 172.21.15.76:0/1559833005 conn(0x7ff2140fb2e0 msgr2=0x7ff2141022f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:47:57.047 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:57.046+0000 7ff219823700 1 -- 172.21.15.76:0/1559833005 shutdown_connections 2024-06-02T04:47:57.047 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:57.046+0000 7ff219823700 1 -- 172.21.15.76:0/1559833005 wait complete. 2024-06-02T04:47:57.047 INFO:teuthology.orchestra.run.smithi076.stderr:dumped fsmap epoch 12 2024-06-02T04:47:57.096 INFO:journalctl@ceph.mds.b.smithi119.stdout:Jun 02 04:47:56 smithi119 systemd[1]: Starting Ceph mds.b for 60ab6d30-209a-11ef-bc9b-c7b262605968... 2024-06-02T04:47:57.596 INFO:journalctl@ceph.mds.b.smithi119.stdout:Jun 02 04:47:57 smithi119 ceph-mds[83288]: -- 172.21.15.119:0/3217891875 <== mon.2 v2:172.21.15.119:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55c0601e61a0 con 0x55c0601bcc00 2024-06-02T04:47:57.596 INFO:journalctl@ceph.mds.b.smithi119.stdout:Jun 02 04:47:57 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-b[83265]: starting mds.b at 2024-06-02T04:47:57.596 INFO:journalctl@ceph.mds.b.smithi119.stdout:Jun 02 04:47:57 smithi119 bash[83251]: 975190c26554542926175ec5c84a246032458b8cbaabdd033892f39d1abfe95d 2024-06-02T04:47:57.596 INFO:journalctl@ceph.mds.b.smithi119.stdout:Jun 02 04:47:57 smithi119 systemd[1]: Started Ceph mds.b for 60ab6d30-209a-11ef-bc9b-c7b262605968. 2024-06-02T04:47:58.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:57 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/1559833005' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:47:58.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:57 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:58.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:57 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:58.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:57 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:58.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:57 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:58.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:57 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:58.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:57 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:47:58.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:57 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/1559833005' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:47:58.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:57 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:58.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:57 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:58.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:57 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:58.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:57 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:58.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:57 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:58.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:57 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:47:58.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:57 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/1559833005' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:47:58.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:57 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:58.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:57 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:58.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:57 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:58.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:57 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:58.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:57 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:58.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:57 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:47:59.059 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T04:47:59.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:58 smithi192 ceph-mon[47933]: mds.? [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] up:boot 2024-06-02T04:47:59.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:58 smithi192 ceph-mon[47933]: fsmap 12 up:standby 2024-06-02T04:47:59.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:58 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-06-02T04:47:59.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:58 smithi192 ceph-mon[47933]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T04:47:59.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:58 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:59.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:58 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:59.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:58 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:59.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:58 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:59.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:58 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:59.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:58 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:59.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:58 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:47:59.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:58 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:47:59.183 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:58 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:59.193 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:59.192+0000 7fbce63a4700 1 -- 172.21.15.76:0/1073137245 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbce01021b0 msgr2=0x7fbce0102610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:47:59.193 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:59.192+0000 7fbce63a4700 1 --2- 172.21.15.76:0/1073137245 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbce01021b0 0x7fbce0102610 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fbcd4009990 tx=0x7fbcd4009ca0 comp rx=0 tx=0).stop 2024-06-02T04:47:59.193 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:59.192+0000 7fbce63a4700 1 -- 172.21.15.76:0/1073137245 shutdown_connections 2024-06-02T04:47:59.193 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:59.192+0000 7fbce63a4700 1 --2- 172.21.15.76:0/1073137245 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbce0102b50 0x7fbce0109400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:59.193 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:59.192+0000 7fbce63a4700 1 --2- 172.21.15.76:0/1073137245 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbce00ff140 0x7fbce00ff560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:59.193 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:59.192+0000 7fbce63a4700 1 --2- 172.21.15.76:0/1073137245 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbce01021b0 0x7fbce0102610 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:59.193 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:59.192+0000 7fbce63a4700 1 -- 172.21.15.76:0/1073137245 >> 172.21.15.76:0/1073137245 conn(0x7fbce00faa70 msgr2=0x7fbce00fce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:47:59.193 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:59.192+0000 7fbce63a4700 1 -- 172.21.15.76:0/1073137245 shutdown_connections 2024-06-02T04:47:59.193 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:59.192+0000 7fbce63a4700 1 -- 172.21.15.76:0/1073137245 wait complete. 2024-06-02T04:47:59.193 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:59.193+0000 7fbce63a4700 1 Processor -- start 2024-06-02T04:47:59.194 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:59.193+0000 7fbce63a4700 1 -- start start 2024-06-02T04:47:59.195 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:59.193+0000 7fbce63a4700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbce00ff140 0x7fbce0196d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:47:59.195 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:59.193+0000 7fbce63a4700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbce01021b0 0x7fbce0197240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:47:59.196 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:59.193+0000 7fbce63a4700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbce0102b50 0x7fbce019e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:47:59.196 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:59.193+0000 7fbce63a4700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbce019e820 con 0x7fbce00ff140 2024-06-02T04:47:59.196 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:59.193+0000 7fbce63a4700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbce019e990 con 0x7fbce0102b50 2024-06-02T04:47:59.196 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:59.193+0000 7fbce63a4700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbce019eb50 con 0x7fbce01021b0 2024-06-02T04:47:59.196 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:59.193+0000 7fbcdffff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbce00ff140 0x7fbce0196d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:47:59.196 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:59.193+0000 7fbcdffff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbce00ff140 0x7fbce0196d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:49070/0 (socket says 172.21.15.76:49070) 2024-06-02T04:47:59.196 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:59.193+0000 7fbcdffff700 1 -- 172.21.15.76:0/3078708746 learned_addr learned my addr 172.21.15.76:0/3078708746 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:47:59.196 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:59.193+0000 7fbce4941700 1 --2- 172.21.15.76:0/3078708746 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbce0102b50 0x7fbce019e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:47:59.196 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:59.193+0000 7fbcdf7fe700 1 --2- 172.21.15.76:0/3078708746 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbce01021b0 0x7fbce0197240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:47:59.196 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:59.193+0000 7fbcdffff700 1 -- 172.21.15.76:0/3078708746 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbce01021b0 msgr2=0x7fbce0197240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:47:59.196 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:59.193+0000 7fbcdffff700 1 --2- 172.21.15.76:0/3078708746 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbce01021b0 0x7fbce0197240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:59.197 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:59.193+0000 7fbcdffff700 1 -- 172.21.15.76:0/3078708746 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbce0102b50 msgr2=0x7fbce019e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:47:59.197 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:59.193+0000 7fbcdffff700 1 --2- 172.21.15.76:0/3078708746 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbce0102b50 0x7fbce019e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:59.197 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:59.193+0000 7fbcdffff700 1 -- 172.21.15.76:0/3078708746 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcd40095f0 con 0x7fbce00ff140 2024-06-02T04:47:59.197 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:59.193+0000 7fbce4941700 1 --2- 172.21.15.76:0/3078708746 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbce0102b50 0x7fbce019e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T04:47:59.197 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:59.194+0000 7fbcdffff700 1 --2- 172.21.15.76:0/3078708746 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbce00ff140 0x7fbce0196d00 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fbcd000e970 tx=0x7fbcd000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:47:59.197 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:59.194+0000 7fbcdd7fa700 1 -- 172.21.15.76:0/3078708746 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcd0009790 con 0x7fbce00ff140 2024-06-02T04:47:59.197 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:59.194+0000 7fbcdd7fa700 1 -- 172.21.15.76:0/3078708746 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbcd000c7e0 con 0x7fbce00ff140 2024-06-02T04:47:59.197 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:59.194+0000 7fbce63a4700 1 -- 172.21.15.76:0/3078708746 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbce019ee30 con 0x7fbce00ff140 2024-06-02T04:47:59.197 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:59.194+0000 7fbcdd7fa700 1 -- 172.21.15.76:0/3078708746 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcd0003bd0 con 0x7fbce00ff140 2024-06-02T04:47:59.197 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:59.194+0000 7fbce63a4700 1 -- 172.21.15.76:0/3078708746 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbce019f250 con 0x7fbce00ff140 2024-06-02T04:47:59.197 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:59.195+0000 7fbce63a4700 1 -- 172.21.15.76:0/3078708746 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbce01084e0 con 0x7fbce00ff140 2024-06-02T04:47:59.198 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:59.196+0000 7fbcdd7fa700 1 -- 172.21.15.76:0/3078708746 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fbcd000c950 con 0x7fbce00ff140 2024-06-02T04:47:59.198 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:59.197+0000 7fbcdd7fa700 1 --2- 172.21.15.76:0/3078708746 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fbcc80a1120 0x7fbcc80a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:47:59.198 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:59.197+0000 7fbcdd7fa700 1 -- 172.21.15.76:0/3078708746 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fbcd0014070 con 0x7fbce00ff140 2024-06-02T04:47:59.198 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:59.197+0000 7fbcdf7fe700 1 --2- 172.21.15.76:0/3078708746 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fbcc80a1120 0x7fbcc80a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:47:59.198 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:59.197+0000 7fbcdf7fe700 1 --2- 172.21.15.76:0/3078708746 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fbcc80a1120 0x7fbcc80a35e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fbcd4006010 tx=0x7fbcd400b610 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:47:59.202 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:59.202+0000 7fbcdd7fa700 1 -- 172.21.15.76:0/3078708746 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fbcd0096220 con 0x7fbce00ff140 2024-06-02T04:47:59.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:58 smithi076 ceph-mon[42935]: mds.? [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] up:boot 2024-06-02T04:47:59.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:58 smithi076 ceph-mon[42935]: fsmap 12 up:standby 2024-06-02T04:47:59.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:58 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-06-02T04:47:59.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:58 smithi076 ceph-mon[42935]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T04:47:59.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:58 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:59.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:58 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:59.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:58 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:59.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:58 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:59.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:58 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:59.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:58 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:59.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:58 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:47:59.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:58 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:47:59.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:58 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:59.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:58 smithi119 ceph-mon[46633]: mds.? [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] up:boot 2024-06-02T04:47:59.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:58 smithi119 ceph-mon[46633]: fsmap 12 up:standby 2024-06-02T04:47:59.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:58 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-06-02T04:47:59.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:58 smithi119 ceph-mon[46633]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T04:47:59.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:58 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:59.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:58 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:59.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:58 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:59.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:58 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:59.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:58 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:59.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:58 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:59.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:58 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:47:59.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:58 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:47:59.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:58 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:47:59.479 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:59.479+0000 7fbce63a4700 1 -- 172.21.15.76:0/3078708746 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbce0067380 con 0x7fbce00ff140 2024-06-02T04:47:59.480 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:59.480+0000 7fbcdd7fa700 1 -- 172.21.15.76:0/3078708746 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+9604 (secure 0 0 0) 0x7fbcd0099840 con 0x7fbce00ff140 2024-06-02T04:47:59.481 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:47:59.481 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":13,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6835/3029342152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3029342152},{"type":"v1","addr":"172.21.15.76:6835","nonce":3029342152}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6837/1207985317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":1207985317},{"type":"v1","addr":"172.21.15.76:6837","nonce":1207985317}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14607,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6839/928709755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":928709755},{"type":"v1","addr":"172.21.15.76:6839","nonce":928709755}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6841/4162178633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6840","nonce":4162178633},{"type":"v1","addr":"172.21.15.76:6841","nonce":4162178633}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/1543944863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":1543944863},{"type":"v1","addr":"172.21.15.119:6833","nonce":1543944863}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24418,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6833/1527921393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1527921393},{"type":"v1","addr":"172.21.15.192:6833","nonce":1527921393}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24434,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/2746840347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":2746840347},{"type":"v1","addr":"172.21.15.119:6835","nonce":2746840347}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24451,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/783181340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":783181340},{"type":"v1","addr":"172.21.15.192:6835","nonce":783181340}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24458,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/2171687478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":2171687478},{"type":"v1","addr":"172.21.15.119:6837","nonce":2171687478}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24463,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/960773710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":960773710},{"type":"v1","addr":"172.21.15.192:6837","nonce":960773710}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24475,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/3978681402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":3978681402},{"type":"v1","addr":"172.21.15.192:6839","nonce":3978681402}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":24491,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6839/4098406903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":4098406903},{"type":"v1","addr":"172.21.15.119:6839","nonce":4098406903}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[]} 2024-06-02T04:47:59.483 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:59.483+0000 7fbce63a4700 1 -- 172.21.15.76:0/3078708746 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fbcc80a1120 msgr2=0x7fbcc80a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:47:59.483 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:59.483+0000 7fbce63a4700 1 --2- 172.21.15.76:0/3078708746 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fbcc80a1120 0x7fbcc80a35e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fbcd4006010 tx=0x7fbcd400b610 comp rx=0 tx=0).stop 2024-06-02T04:47:59.483 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:59.483+0000 7fbce63a4700 1 -- 172.21.15.76:0/3078708746 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbce00ff140 msgr2=0x7fbce0196d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:47:59.483 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:59.483+0000 7fbce63a4700 1 --2- 172.21.15.76:0/3078708746 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbce00ff140 0x7fbce0196d00 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fbcd000e970 tx=0x7fbcd000ec80 comp rx=0 tx=0).stop 2024-06-02T04:47:59.483 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:59.483+0000 7fbce63a4700 1 -- 172.21.15.76:0/3078708746 shutdown_connections 2024-06-02T04:47:59.483 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:59.483+0000 7fbce63a4700 1 --2- 172.21.15.76:0/3078708746 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fbcc80a1120 0x7fbcc80a35e0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:59.484 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:59.483+0000 7fbce63a4700 1 --2- 172.21.15.76:0/3078708746 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbce0102b50 0x7fbce019e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:59.484 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:59.483+0000 7fbce63a4700 1 --2- 172.21.15.76:0/3078708746 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbce00ff140 0x7fbce0196d00 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:59.484 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:59.483+0000 7fbce63a4700 1 --2- 172.21.15.76:0/3078708746 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbce01021b0 0x7fbce0197240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:59.484 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:59.483+0000 7fbce63a4700 1 -- 172.21.15.76:0/3078708746 >> 172.21.15.76:0/3078708746 conn(0x7fbce00faa70 msgr2=0x7fbce0105620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:47:59.484 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:59.483+0000 7fbce63a4700 1 -- 172.21.15.76:0/3078708746 shutdown_connections 2024-06-02T04:47:59.484 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:59.483+0000 7fbce63a4700 1 -- 172.21.15.76:0/3078708746 wait complete. 2024-06-02T04:47:59.484 INFO:teuthology.orchestra.run.smithi076.stderr:dumped fsmap epoch 13 2024-06-02T04:47:59.496 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-02T04:47:59.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:59.626+0000 7ff279edd700 1 -- 172.21.15.76:0/2521794020 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff274106be0 msgr2=0x7ff274108ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:47:59.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:59.626+0000 7ff279edd700 1 --2- 172.21.15.76:0/2521794020 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff274106be0 0x7ff274108ff0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff26c00b0a0 tx=0x7ff26c00b3b0 comp rx=0 tx=0).stop 2024-06-02T04:47:59.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:59.626+0000 7ff279edd700 1 -- 172.21.15.76:0/2521794020 shutdown_connections 2024-06-02T04:47:59.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:59.626+0000 7ff279edd700 1 --2- 172.21.15.76:0/2521794020 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff274106be0 0x7ff274108ff0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:59.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:59.626+0000 7ff279edd700 1 --2- 172.21.15.76:0/2521794020 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff274101980 0x7ff274103d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:59.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:59.626+0000 7ff279edd700 1 --2- 172.21.15.76:0/2521794020 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff2741042b0 0x7ff2741066a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:59.628 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:59.626+0000 7ff279edd700 1 -- 172.21.15.76:0/2521794020 >> 172.21.15.76:0/2521794020 conn(0x7ff2740fb330 msgr2=0x7ff2740fd750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:47:59.628 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:59.626+0000 7ff279edd700 1 -- 172.21.15.76:0/2521794020 shutdown_connections 2024-06-02T04:47:59.628 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:59.627+0000 7ff279edd700 1 -- 172.21.15.76:0/2521794020 wait complete. 2024-06-02T04:47:59.628 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:59.627+0000 7ff279edd700 1 Processor -- start 2024-06-02T04:47:59.630 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:59.627+0000 7ff279edd700 1 -- start start 2024-06-02T04:47:59.630 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:59.627+0000 7ff279edd700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff274101980 0x7ff274196e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:47:59.630 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:59.627+0000 7ff279edd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff2741042b0 0x7ff274197380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:47:59.630 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:59.627+0000 7ff279edd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff274106be0 0x7ff27419e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:47:59.630 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:59.627+0000 7ff279edd700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff27419e8e0 con 0x7ff2741042b0 2024-06-02T04:47:59.630 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:59.627+0000 7ff279edd700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff27419ea50 con 0x7ff274101980 2024-06-02T04:47:59.630 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:59.627+0000 7ff279edd700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff27419ec10 con 0x7ff274106be0 2024-06-02T04:47:59.630 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:59.628+0000 7ff272ffd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff2741042b0 0x7ff274197380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:47:59.630 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:59.628+0000 7ff2737fe700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff274101980 0x7ff274196e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:47:59.630 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:59.628+0000 7ff272ffd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff2741042b0 0x7ff274197380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:49088/0 (socket says 172.21.15.76:49088) 2024-06-02T04:47:59.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:59.628+0000 7ff272ffd700 1 -- 172.21.15.76:0/346443224 learned_addr learned my addr 172.21.15.76:0/346443224 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:47:59.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:59.628+0000 7ff273fff700 1 --2- 172.21.15.76:0/346443224 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff274106be0 0x7ff27419e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:47:59.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:59.628+0000 7ff2737fe700 1 -- 172.21.15.76:0/346443224 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff274106be0 msgr2=0x7ff27419e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:47:59.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:59.628+0000 7ff2737fe700 1 --2- 172.21.15.76:0/346443224 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff274106be0 0x7ff27419e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:59.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:59.628+0000 7ff2737fe700 1 -- 172.21.15.76:0/346443224 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff2741042b0 msgr2=0x7ff274197380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:47:59.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:59.628+0000 7ff2737fe700 1 --2- 172.21.15.76:0/346443224 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff2741042b0 0x7ff274197380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:59.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:59.628+0000 7ff2737fe700 1 -- 172.21.15.76:0/346443224 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff26c009d00 con 0x7ff274101980 2024-06-02T04:47:59.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:59.628+0000 7ff2737fe700 1 --2- 172.21.15.76:0/346443224 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff274101980 0x7ff274196e40 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff26400e9f0 tx=0x7ff26400ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:47:59.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:59.628+0000 7ff270ff9700 1 -- 172.21.15.76:0/346443224 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff26400c9c0 con 0x7ff274101980 2024-06-02T04:47:59.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:59.628+0000 7ff270ff9700 1 -- 172.21.15.76:0/346443224 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff264010430 con 0x7ff274101980 2024-06-02T04:47:59.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:59.628+0000 7ff279edd700 1 -- 172.21.15.76:0/346443224 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff27419eef0 con 0x7ff274101980 2024-06-02T04:47:59.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:59.628+0000 7ff270ff9700 1 -- 172.21.15.76:0/346443224 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff264018680 con 0x7ff274101980 2024-06-02T04:47:59.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:59.628+0000 7ff279edd700 1 -- 172.21.15.76:0/346443224 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff27419f310 con 0x7ff274101980 2024-06-02T04:47:59.632 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:59.629+0000 7ff279edd700 1 -- 172.21.15.76:0/346443224 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2740fceb0 con 0x7ff274101980 2024-06-02T04:47:59.632 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:59.630+0000 7ff270ff9700 1 -- 172.21.15.76:0/346443224 <== mon.2 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7ff2640105a0 con 0x7ff274101980 2024-06-02T04:47:59.632 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:59.631+0000 7ff270ff9700 1 --2- 172.21.15.76:0/346443224 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7ff25c0a1120 0x7ff25c0a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:47:59.632 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:59.631+0000 7ff270ff9700 1 -- 172.21.15.76:0/346443224 <== mon.2 v2:172.21.15.119:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 7127+0+0 (secure 0 0 0) 0x7ff264014070 con 0x7ff274101980 2024-06-02T04:47:59.632 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:59.631+0000 7ff272ffd700 1 --2- 172.21.15.76:0/346443224 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7ff25c0a1120 0x7ff25c0a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:47:59.633 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:59.631+0000 7ff272ffd700 1 --2- 172.21.15.76:0/346443224 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7ff25c0a1120 0x7ff25c0a35e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff268009d20 tx=0x7ff268009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:47:59.634 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:59.634+0000 7ff270ff9700 1 -- 172.21.15.76:0/346443224 <== mon.2 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7ff2640961d0 con 0x7ff274101980 2024-06-02T04:47:59.854 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:59.853+0000 7ff279edd700 1 -- 172.21.15.76:0/346443224 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff27410c560 con 0x7ff274101980 2024-06-02T04:47:59.855 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:59.855+0000 7ff270ff9700 1 -- 172.21.15.76:0/346443224 <== mon.2 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+18446 (secure 0 0 0) 0x7ff2640997f0 con 0x7ff274101980 2024-06-02T04:47:59.855 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:47:59.855 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":72,"fsid":"60ab6d30-209a-11ef-bc9b-c7b262605968","created":"2024-06-02T04:42:21.007333+0000","modified":"2024-06-02T04:47:30.832570+0000","last_up_change":"2024-06-02T04:47:29.822242+0000","last_in_change":"2024-06-02T04:47:14.253449+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T04:44:56.408602+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"33a51ba2-be5c-41d0-b5d1-8d6039f2ca4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6802","nonce":2869602045},{"type":"v1","addr":"172.21.15.76:6803","nonce":2869602045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6804","nonce":2869602045},{"type":"v1","addr":"172.21.15.76:6805","nonce":2869602045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6808","nonce":2869602045},{"type":"v1","addr":"172.21.15.76:6809","nonce":2869602045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6806","nonce":2869602045},{"type":"v1","addr":"172.21.15.76:6807","nonce":2869602045}]},"public_addr":"172.21.15.76:6803/2869602045","cluster_addr":"172.21.15.76:6805/2869602045","heartbeat_back_addr":"172.21.15.76:6809/2869602045","heartbeat_front_addr":"172.21.15.76:6807/2869602045","state":["exists","up"]},{"osd":1,"uuid":"ace46e13-3bb7-4103-973a-6860554df8b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":2353738098},{"type":"v1","addr":"172.21.15.119:6801","nonce":2353738098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":2353738098},{"type":"v1","addr":"172.21.15.119:6803","nonce":2353738098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":2353738098},{"type":"v1","addr":"172.21.15.119:6807","nonce":2353738098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":2353738098},{"type":"v1","addr":"172.21.15.119:6805","nonce":2353738098}]},"public_addr":"172.21.15.119:6801/2353738098","cluster_addr":"172.21.15.119:6803/2353738098","heartbeat_back_addr":"172.21.15.119:6807/2353738098","heartbeat_front_addr":"172.21.15.119:6805/2353738098","state":["exists","up"]},{"osd":2,"uuid":"4addc09e-77a9-428a-bcc4-38194f486cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":3206918546},{"type":"v1","addr":"172.21.15.192:6801","nonce":3206918546}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":3206918546},{"type":"v1","addr":"172.21.15.192:6803","nonce":3206918546}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":3206918546},{"type":"v1","addr":"172.21.15.192:6807","nonce":3206918546}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":3206918546},{"type":"v1","addr":"172.21.15.192:6805","nonce":3206918546}]},"public_addr":"172.21.15.192:6801/3206918546","cluster_addr":"172.21.15.192:6803/3206918546","heartbeat_back_addr":"172.21.15.192:6807/3206918546","heartbeat_front_addr":"172.21.15.192:6805/3206918546","state":["exists","up"]},{"osd":3,"uuid":"dc525518-82c6-49ed-8ca8-e3bd5bfc18d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6810","nonce":3747864233},{"type":"v1","addr":"172.21.15.76:6811","nonce":3747864233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6812","nonce":3747864233},{"type":"v1","addr":"172.21.15.76:6813","nonce":3747864233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6816","nonce":3747864233},{"type":"v1","addr":"172.21.15.76:6817","nonce":3747864233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6814","nonce":3747864233},{"type":"v1","addr":"172.21.15.76:6815","nonce":3747864233}]},"public_addr":"172.21.15.76:6811/3747864233","cluster_addr":"172.21.15.76:6813/3747864233","heartbeat_back_addr":"172.21.15.76:6817/3747864233","heartbeat_front_addr":"172.21.15.76:6815/3747864233","state":["exists","up"]},{"osd":4,"uuid":"eef293d0-cb87-47b3-9751-c6437a1cf079","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":2571629047},{"type":"v1","addr":"172.21.15.119:6809","nonce":2571629047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":2571629047},{"type":"v1","addr":"172.21.15.119:6811","nonce":2571629047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":2571629047},{"type":"v1","addr":"172.21.15.119:6815","nonce":2571629047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":2571629047},{"type":"v1","addr":"172.21.15.119:6813","nonce":2571629047}]},"public_addr":"172.21.15.119:6809/2571629047","cluster_addr":"172.21.15.119:6811/2571629047","heartbeat_back_addr":"172.21.15.119:6815/2571629047","heartbeat_front_addr":"172.21.15.119:6813/2571629047","state":["exists","up"]},{"osd":5,"uuid":"60eb8c6e-766c-49d0-9997-44f85776b3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3285065416},{"type":"v1","addr":"172.21.15.192:6809","nonce":3285065416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":3285065416},{"type":"v1","addr":"172.21.15.192:6811","nonce":3285065416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3285065416},{"type":"v1","addr":"172.21.15.192:6815","nonce":3285065416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":3285065416},{"type":"v1","addr":"172.21.15.192:6813","nonce":3285065416}]},"public_addr":"172.21.15.192:6809/3285065416","cluster_addr":"172.21.15.192:6811/3285065416","heartbeat_back_addr":"172.21.15.192:6815/3285065416","heartbeat_front_addr":"172.21.15.192:6813/3285065416","state":["exists","up"]},{"osd":6,"uuid":"e6dc8b9d-dd06-4870-a506-def8201b7e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6818","nonce":2951381580},{"type":"v1","addr":"172.21.15.76:6819","nonce":2951381580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6820","nonce":2951381580},{"type":"v1","addr":"172.21.15.76:6821","nonce":2951381580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6824","nonce":2951381580},{"type":"v1","addr":"172.21.15.76:6825","nonce":2951381580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6822","nonce":2951381580},{"type":"v1","addr":"172.21.15.76:6823","nonce":2951381580}]},"public_addr":"172.21.15.76:6819/2951381580","cluster_addr":"172.21.15.76:6821/2951381580","heartbeat_back_addr":"172.21.15.76:6825/2951381580","heartbeat_front_addr":"172.21.15.76:6823/2951381580","state":["exists","up"]},{"osd":7,"uuid":"2f5dccb3-39a1-4f25-8715-fa264d59db97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1802558756},{"type":"v1","addr":"172.21.15.119:6817","nonce":1802558756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1802558756},{"type":"v1","addr":"172.21.15.119:6819","nonce":1802558756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1802558756},{"type":"v1","addr":"172.21.15.119:6823","nonce":1802558756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1802558756},{"type":"v1","addr":"172.21.15.119:6821","nonce":1802558756}]},"public_addr":"172.21.15.119:6817/1802558756","cluster_addr":"172.21.15.119:6819/1802558756","heartbeat_back_addr":"172.21.15.119:6823/1802558756","heartbeat_front_addr":"172.21.15.119:6821/1802558756","state":["exists","up"]},{"osd":8,"uuid":"39b6ccd0-16e7-4cd5-87e0-d827e9172984","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":1214972276},{"type":"v1","addr":"172.21.15.192:6817","nonce":1214972276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":1214972276},{"type":"v1","addr":"172.21.15.192:6819","nonce":1214972276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":1214972276},{"type":"v1","addr":"172.21.15.192:6823","nonce":1214972276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":1214972276},{"type":"v1","addr":"172.21.15.192:6821","nonce":1214972276}]},"public_addr":"172.21.15.192:6817/1214972276","cluster_addr":"172.21.15.192:6819/1214972276","heartbeat_back_addr":"172.21.15.192:6823/1214972276","heartbeat_front_addr":"172.21.15.192:6821/1214972276","state":["exists","up"]},{"osd":9,"uuid":"851b2155-07bd-45de-bfe0-53021fda733f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6826","nonce":3095501821},{"type":"v1","addr":"172.21.15.76:6827","nonce":3095501821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6828","nonce":3095501821},{"type":"v1","addr":"172.21.15.76:6829","nonce":3095501821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":3095501821},{"type":"v1","addr":"172.21.15.76:6833","nonce":3095501821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6830","nonce":3095501821},{"type":"v1","addr":"172.21.15.76:6831","nonce":3095501821}]},"public_addr":"172.21.15.76:6827/3095501821","cluster_addr":"172.21.15.76:6829/3095501821","heartbeat_back_addr":"172.21.15.76:6833/3095501821","heartbeat_front_addr":"172.21.15.76:6831/3095501821","state":["exists","up"]},{"osd":10,"uuid":"e4b18e7e-bddf-4dd4-84f6-7902ea327cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":4082130894},{"type":"v1","addr":"172.21.15.119:6825","nonce":4082130894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":4082130894},{"type":"v1","addr":"172.21.15.119:6827","nonce":4082130894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":4082130894},{"type":"v1","addr":"172.21.15.119:6831","nonce":4082130894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":4082130894},{"type":"v1","addr":"172.21.15.119:6829","nonce":4082130894}]},"public_addr":"172.21.15.119:6825/4082130894","cluster_addr":"172.21.15.119:6827/4082130894","heartbeat_back_addr":"172.21.15.119:6831/4082130894","heartbeat_front_addr":"172.21.15.119:6829/4082130894","state":["exists","up"]},{"osd":11,"uuid":"54567e18-920c-4ae9-9557-0efba5a1a820","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":439693921},{"type":"v1","addr":"172.21.15.192:6825","nonce":439693921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":439693921},{"type":"v1","addr":"172.21.15.192:6827","nonce":439693921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":439693921},{"type":"v1","addr":"172.21.15.192:6831","nonce":439693921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":439693921},{"type":"v1","addr":"172.21.15.192:6829","nonce":439693921}]},"public_addr":"172.21.15.192:6825/439693921","cluster_addr":"172.21.15.192:6827/439693921","heartbeat_back_addr":"172.21.15.192:6831/439693921","heartbeat_front_addr":"172.21.15.192:6829/439693921","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:44:19.922390+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:44:36.895563+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:44:53.699019+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:45:11.167404+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:45:27.955899+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:45:44.850368+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:46:02.003588+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:46:19.019217+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:46:36.189670+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:46:53.919365+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:47:11.563053+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:47:28.822443+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.76:6801/4200406736":"2024-06-03T04:43:06.092916+0000","172.21.15.76:6800/4200406736":"2024-06-03T04:43:06.092916+0000","172.21.15.76:0/1524144593":"2024-06-03T04:43:06.092916+0000","172.21.15.76:0/3269372590":"2024-06-03T04:43:06.092916+0000","172.21.15.76:0/3570893846":"2024-06-03T04:42:44.872236+0000","172.21.15.76:0/902035790":"2024-06-03T04:43:06.092916+0000","172.21.15.76:6800/2550846765":"2024-06-03T04:42:44.872236+0000","172.21.15.76:6801/2550846765":"2024-06-03T04:42:44.872236+0000","172.21.15.76:0/2646712763":"2024-06-03T04:42:44.872236+0000","172.21.15.76:0/964578813":"2024-06-03T04:42:44.872236+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T04:47:59.857 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:59.857+0000 7ff279edd700 1 -- 172.21.15.76:0/346443224 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7ff25c0a1120 msgr2=0x7ff25c0a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:47:59.858 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:59.857+0000 7ff279edd700 1 --2- 172.21.15.76:0/346443224 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7ff25c0a1120 0x7ff25c0a35e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff268009d20 tx=0x7ff268009260 comp rx=0 tx=0).stop 2024-06-02T04:47:59.858 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:59.857+0000 7ff279edd700 1 -- 172.21.15.76:0/346443224 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff274101980 msgr2=0x7ff274196e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:47:59.858 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:59.857+0000 7ff279edd700 1 --2- 172.21.15.76:0/346443224 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff274101980 0x7ff274196e40 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff26400e9f0 tx=0x7ff26400ed00 comp rx=0 tx=0).stop 2024-06-02T04:47:59.858 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:59.857+0000 7ff279edd700 1 -- 172.21.15.76:0/346443224 shutdown_connections 2024-06-02T04:47:59.858 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:59.857+0000 7ff279edd700 1 --2- 172.21.15.76:0/346443224 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff274106be0 0x7ff27419e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:59.858 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:59.857+0000 7ff279edd700 1 --2- 172.21.15.76:0/346443224 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7ff25c0a1120 0x7ff25c0a35e0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:59.858 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:59.857+0000 7ff279edd700 1 --2- 172.21.15.76:0/346443224 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff274101980 0x7ff274196e40 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:59.858 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:59.857+0000 7ff279edd700 1 --2- 172.21.15.76:0/346443224 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff2741042b0 0x7ff274197380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:47:59.858 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:59.857+0000 7ff279edd700 1 -- 172.21.15.76:0/346443224 >> 172.21.15.76:0/346443224 conn(0x7ff2740fb330 msgr2=0x7ff2741022e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:47:59.858 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:59.857+0000 7ff279edd700 1 -- 172.21.15.76:0/346443224 shutdown_connections 2024-06-02T04:47:59.858 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:47:59.857+0000 7ff279edd700 1 -- 172.21.15.76:0/346443224 wait complete. 2024-06-02T04:47:59.873 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-06-02T04:44:56.408602+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-06-02T04:47:59.873 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-06-02T04:48:00.015 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.014+0000 7f7365d2e700 1 -- 172.21.15.76:0/430848591 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7360100b70 msgr2=0x7f7360100ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:00.015 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.014+0000 7f7365d2e700 1 --2- 172.21.15.76:0/430848591 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7360100b70 0x7f7360100ff0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f735800b0d0 tx=0x7f735800b3e0 comp rx=0 tx=0).stop 2024-06-02T04:48:00.015 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.014+0000 7f7365d2e700 1 -- 172.21.15.76:0/430848591 shutdown_connections 2024-06-02T04:48:00.015 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.014+0000 7f7365d2e700 1 --2- 172.21.15.76:0/430848591 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7360100b70 0x7f7360100ff0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:00.015 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.014+0000 7f7365d2e700 1 --2- 172.21.15.76:0/430848591 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f73600ff850 0x7f73600ffc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:00.015 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.014+0000 7f7365d2e700 1 --2- 172.21.15.76:0/430848591 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f73601001b0 0x7f7360100630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:00.015 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.014+0000 7f7365d2e700 1 -- 172.21.15.76:0/430848591 >> 172.21.15.76:0/430848591 conn(0x7f73600fb3f0 msgr2=0x7f73600fd830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:00.016 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.014+0000 7f7365d2e700 1 -- 172.21.15.76:0/430848591 shutdown_connections 2024-06-02T04:48:00.016 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.014+0000 7f7365d2e700 1 -- 172.21.15.76:0/430848591 wait complete. 2024-06-02T04:48:00.016 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.015+0000 7f7365d2e700 1 Processor -- start 2024-06-02T04:48:00.016 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.015+0000 7f7365d2e700 1 -- start start 2024-06-02T04:48:00.017 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.015+0000 7f7365d2e700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f73600ff850 0x7f73601990f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:00.018 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.015+0000 7f7365d2e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f73601001b0 0x7f7360199630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:00.018 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.015+0000 7f7365d2e700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7360100b70 0x7f73601a0650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:00.018 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.015+0000 7f7365d2e700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73601a0c20 con 0x7f73600ff850 2024-06-02T04:48:00.018 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.015+0000 7f7365d2e700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73601a0d60 con 0x7f7360100b70 2024-06-02T04:48:00.018 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.015+0000 7f7365d2e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73601a0ef0 con 0x7f73601001b0 2024-06-02T04:48:00.018 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.015+0000 7f735f7fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f73600ff850 0x7f73601990f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:00.018 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.015+0000 7f735f7fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f73600ff850 0x7f73601990f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:49096/0 (socket says 172.21.15.76:49096) 2024-06-02T04:48:00.018 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.015+0000 7f735f7fe700 1 -- 172.21.15.76:0/3429449578 learned_addr learned my addr 172.21.15.76:0/3429449578 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:48:00.018 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.015+0000 7f735effd700 1 --2- 172.21.15.76:0/3429449578 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f73601001b0 0x7f7360199630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:00.018 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.015+0000 7f735ffff700 1 --2- 172.21.15.76:0/3429449578 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7360100b70 0x7f73601a0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:00.018 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.016+0000 7f735f7fe700 1 -- 172.21.15.76:0/3429449578 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f73601001b0 msgr2=0x7f7360199630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:00.018 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.016+0000 7f735f7fe700 1 --2- 172.21.15.76:0/3429449578 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f73601001b0 0x7f7360199630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:00.019 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.016+0000 7f735f7fe700 1 -- 172.21.15.76:0/3429449578 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7360100b70 msgr2=0x7f73601a0650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:00.019 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.016+0000 7f735f7fe700 1 --2- 172.21.15.76:0/3429449578 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7360100b70 0x7f73601a0650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:00.019 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.016+0000 7f735f7fe700 1 -- 172.21.15.76:0/3429449578 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7358009d00 con 0x7f73600ff850 2024-06-02T04:48:00.019 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.016+0000 7f735f7fe700 1 --2- 172.21.15.76:0/3429449578 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f73600ff850 0x7f73601990f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f735000e9a0 tx=0x7f735000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:00.019 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.016+0000 7f735cff9700 1 -- 172.21.15.76:0/3429449578 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7350009790 con 0x7f73600ff850 2024-06-02T04:48:00.019 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.016+0000 7f735cff9700 1 -- 172.21.15.76:0/3429449578 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7350010430 con 0x7f73600ff850 2024-06-02T04:48:00.019 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.016+0000 7f7365d2e700 1 -- 172.21.15.76:0/3429449578 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7360101ac0 con 0x7f73600ff850 2024-06-02T04:48:00.019 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.016+0000 7f735cff9700 1 -- 172.21.15.76:0/3429449578 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f735000cea0 con 0x7f73600ff850 2024-06-02T04:48:00.019 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.016+0000 7f7365d2e700 1 -- 172.21.15.76:0/3429449578 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7360102020 con 0x7f73600ff850 2024-06-02T04:48:00.019 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.017+0000 7f7365d2e700 1 -- 172.21.15.76:0/3429449578 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f736010a630 con 0x7f73600ff850 2024-06-02T04:48:00.020 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.018+0000 7f735cff9700 1 -- 172.21.15.76:0/3429449578 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f73500105a0 con 0x7f73600ff850 2024-06-02T04:48:00.020 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.019+0000 7f735cff9700 1 --2- 172.21.15.76:0/3429449578 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f73480a1220 0x7f73480a36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:00.020 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.019+0000 7f735effd700 1 --2- 172.21.15.76:0/3429449578 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f73480a1220 0x7f73480a36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:00.020 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.019+0000 7f735cff9700 1 -- 172.21.15.76:0/3429449578 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f7350014070 con 0x7f73600ff850 2024-06-02T04:48:00.020 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.019+0000 7f735effd700 1 --2- 172.21.15.76:0/3429449578 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f73480a1220 0x7f73480a36e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7354005950 tx=0x7f735400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:00.024 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.024+0000 7f735cff9700 1 -- 172.21.15.76:0/3429449578 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f73500961d0 con 0x7f73600ff850 2024-06-02T04:48:00.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:59 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:48:00.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:59 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/3078708746' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:48:00.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:47:59 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/346443224' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:48:00.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:59 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:48:00.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:59 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/3078708746' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:48:00.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:47:59 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/346443224' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:48:00.266 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.266+0000 7f7365d2e700 1 -- 172.21.15.76:0/3429449578 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7360068140 con 0x7f73600ff850 2024-06-02T04:48:00.267 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.267+0000 7f735cff9700 1 -- 172.21.15.76:0/3429449578 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v72) v1 ==== 93+0+10 (secure 0 0 0) 0x7f73500997f0 con 0x7f73600ff850 2024-06-02T04:48:00.267 INFO:teuthology.orchestra.run.smithi076.stdout:pg_num: 1 2024-06-02T04:48:00.269 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.269+0000 7f7365d2e700 1 -- 172.21.15.76:0/3429449578 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f73480a1220 msgr2=0x7f73480a36e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:00.269 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.269+0000 7f7365d2e700 1 --2- 172.21.15.76:0/3429449578 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f73480a1220 0x7f73480a36e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7354005950 tx=0x7f735400b410 comp rx=0 tx=0).stop 2024-06-02T04:48:00.269 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.269+0000 7f7365d2e700 1 -- 172.21.15.76:0/3429449578 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f73600ff850 msgr2=0x7f73601990f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:00.269 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.269+0000 7f7365d2e700 1 --2- 172.21.15.76:0/3429449578 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f73600ff850 0x7f73601990f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f735000e9a0 tx=0x7f735000ecb0 comp rx=0 tx=0).stop 2024-06-02T04:48:00.269 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.269+0000 7f7365d2e700 1 -- 172.21.15.76:0/3429449578 shutdown_connections 2024-06-02T04:48:00.270 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.269+0000 7f7365d2e700 1 --2- 172.21.15.76:0/3429449578 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f73480a1220 0x7f73480a36e0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:00.270 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.269+0000 7f7365d2e700 1 --2- 172.21.15.76:0/3429449578 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7360100b70 0x7f73601a0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:00.270 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.269+0000 7f7365d2e700 1 --2- 172.21.15.76:0/3429449578 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f73600ff850 0x7f73601990f0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:00.270 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.269+0000 7f7365d2e700 1 --2- 172.21.15.76:0/3429449578 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f73601001b0 0x7f7360199630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:00.270 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.269+0000 7f7365d2e700 1 -- 172.21.15.76:0/3429449578 >> 172.21.15.76:0/3429449578 conn(0x7f73600fb3f0 msgr2=0x7f73600fcef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:00.270 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.269+0000 7f7365d2e700 1 -- 172.21.15.76:0/3429449578 shutdown_connections 2024-06-02T04:48:00.270 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.269+0000 7f7365d2e700 1 -- 172.21.15.76:0/3429449578 wait complete. 2024-06-02T04:48:00.282 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-06-02T04:48:00.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:59 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:48:00.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:59 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/3078708746' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:48:00.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:47:59 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/346443224' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:48:00.407 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.405+0000 7fa15adc5700 1 -- 172.21.15.76:0/559141412 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa1541018f0 msgr2=0x7fa1541081a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:00.407 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.405+0000 7fa15adc5700 1 --2- 172.21.15.76:0/559141412 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa1541018f0 0x7fa1541081a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa14c0099c0 tx=0x7fa14c009cd0 comp rx=0 tx=0).stop 2024-06-02T04:48:00.407 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.405+0000 7fa15adc5700 1 -- 172.21.15.76:0/559141412 shutdown_connections 2024-06-02T04:48:00.407 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.405+0000 7fa15adc5700 1 --2- 172.21.15.76:0/559141412 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa1541018f0 0x7fa1541081a0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:00.408 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.405+0000 7fa15adc5700 1 --2- 172.21.15.76:0/559141412 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1540ffd60 0x7fa154100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:00.408 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.405+0000 7fa15adc5700 1 --2- 172.21.15.76:0/559141412 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa154100f50 0x7fa1541013b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:00.408 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.405+0000 7fa15adc5700 1 -- 172.21.15.76:0/559141412 >> 172.21.15.76:0/559141412 conn(0x7fa1540fb2f0 msgr2=0x7fa1540fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:00.408 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.405+0000 7fa15adc5700 1 -- 172.21.15.76:0/559141412 shutdown_connections 2024-06-02T04:48:00.408 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.405+0000 7fa15adc5700 1 -- 172.21.15.76:0/559141412 wait complete. 2024-06-02T04:48:00.408 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.405+0000 7fa15adc5700 1 Processor -- start 2024-06-02T04:48:00.408 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.406+0000 7fa15adc5700 1 -- start start 2024-06-02T04:48:00.408 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.406+0000 7fa15adc5700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa1540ffd60 0x7fa154195b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:00.408 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.406+0000 7fa15adc5700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa154100f50 0x7fa1541960b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:00.408 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.406+0000 7fa15adc5700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1541018f0 0x7fa15419d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:00.408 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.406+0000 7fa15adc5700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa15419d6a0 con 0x7fa1540ffd60 2024-06-02T04:48:00.408 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.406+0000 7fa15adc5700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa15419d7e0 con 0x7fa1541018f0 2024-06-02T04:48:00.409 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.406+0000 7fa15adc5700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa15419d970 con 0x7fa154100f50 2024-06-02T04:48:00.409 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.406+0000 7fa158b61700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa1540ffd60 0x7fa154195b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:00.409 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.406+0000 7fa158b61700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa1540ffd60 0x7fa154195b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:49112/0 (socket says 172.21.15.76:49112) 2024-06-02T04:48:00.409 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.406+0000 7fa158b61700 1 -- 172.21.15.76:0/1005034029 learned_addr learned my addr 172.21.15.76:0/1005034029 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:48:00.409 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.406+0000 7fa153fff700 1 --2- 172.21.15.76:0/1005034029 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa154100f50 0x7fa1541960b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:00.409 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.406+0000 7fa159362700 1 --2- 172.21.15.76:0/1005034029 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1541018f0 0x7fa15419d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:00.409 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.406+0000 7fa158b61700 1 -- 172.21.15.76:0/1005034029 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa154100f50 msgr2=0x7fa1541960b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:00.409 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.406+0000 7fa158b61700 1 --2- 172.21.15.76:0/1005034029 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa154100f50 0x7fa1541960b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:00.409 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.406+0000 7fa158b61700 1 -- 172.21.15.76:0/1005034029 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1541018f0 msgr2=0x7fa15419d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:00.409 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.406+0000 7fa158b61700 1 --2- 172.21.15.76:0/1005034029 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1541018f0 0x7fa15419d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:00.409 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.406+0000 7fa158b61700 1 -- 172.21.15.76:0/1005034029 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa14c0095f0 con 0x7fa1540ffd60 2024-06-02T04:48:00.409 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.406+0000 7fa158b61700 1 --2- 172.21.15.76:0/1005034029 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa1540ffd60 0x7fa154195b70 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa14400efc0 tx=0x7fa14400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:00.410 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.406+0000 7fa151ffb700 1 -- 172.21.15.76:0/1005034029 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa144018070 con 0x7fa1540ffd60 2024-06-02T04:48:00.410 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.406+0000 7fa151ffb700 1 -- 172.21.15.76:0/1005034029 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa14400f040 con 0x7fa1540ffd60 2024-06-02T04:48:00.410 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.406+0000 7fa15adc5700 1 -- 172.21.15.76:0/1005034029 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa15419dbf0 con 0x7fa1540ffd60 2024-06-02T04:48:00.410 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.406+0000 7fa151ffb700 1 -- 172.21.15.76:0/1005034029 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa144004280 con 0x7fa1540ffd60 2024-06-02T04:48:00.410 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.407+0000 7fa15adc5700 1 -- 172.21.15.76:0/1005034029 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa15419e150 con 0x7fa1540ffd60 2024-06-02T04:48:00.411 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.408+0000 7fa15adc5700 1 -- 172.21.15.76:0/1005034029 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1541071b0 con 0x7fa1540ffd60 2024-06-02T04:48:00.411 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.408+0000 7fa151ffb700 1 -- 172.21.15.76:0/1005034029 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fa14400ca70 con 0x7fa1540ffd60 2024-06-02T04:48:00.411 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.409+0000 7fa151ffb700 1 --2- 172.21.15.76:0/1005034029 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fa13c0a11a0 0x7fa13c0a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:00.411 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.409+0000 7fa153fff700 1 --2- 172.21.15.76:0/1005034029 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fa13c0a11a0 0x7fa13c0a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:00.411 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.409+0000 7fa151ffb700 1 -- 172.21.15.76:0/1005034029 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fa1440cc360 con 0x7fa1540ffd60 2024-06-02T04:48:00.411 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.410+0000 7fa153fff700 1 --2- 172.21.15.76:0/1005034029 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fa13c0a11a0 0x7fa13c0a3660 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa148009c60 tx=0x7fa148009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:00.414 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.414+0000 7fa151ffb700 1 -- 172.21.15.76:0/1005034029 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fa144096020 con 0x7fa1540ffd60 2024-06-02T04:48:00.616 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.616+0000 7fa15adc5700 1 -- 172.21.15.76:0/1005034029 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fa15410b430 con 0x7fa1540ffd60 2024-06-02T04:48:00.617 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.617+0000 7fa151ffb700 1 -- 172.21.15.76:0/1005034029 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v72) v1 ==== 84+0+65 (secure 0 0 0) 0x7fa144099640 con 0x7fa1540ffd60 2024-06-02T04:48:00.617 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:48:00.617 INFO:teuthology.orchestra.run.smithi076.stdout:[ 2024-06-02T04:48:00.617 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:48:00.617 INFO:teuthology.orchestra.run.smithi076.stdout: "poolnum": 1, 2024-06-02T04:48:00.617 INFO:teuthology.orchestra.run.smithi076.stdout: "poolname": ".mgr" 2024-06-02T04:48:00.617 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T04:48:00.618 INFO:teuthology.orchestra.run.smithi076.stdout:] 2024-06-02T04:48:00.619 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.619+0000 7fa15adc5700 1 -- 172.21.15.76:0/1005034029 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fa13c0a11a0 msgr2=0x7fa13c0a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:00.619 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.619+0000 7fa15adc5700 1 --2- 172.21.15.76:0/1005034029 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fa13c0a11a0 0x7fa13c0a3660 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa148009c60 tx=0x7fa148009260 comp rx=0 tx=0).stop 2024-06-02T04:48:00.619 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.619+0000 7fa15adc5700 1 -- 172.21.15.76:0/1005034029 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa1540ffd60 msgr2=0x7fa154195b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:00.619 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.619+0000 7fa15adc5700 1 --2- 172.21.15.76:0/1005034029 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa1540ffd60 0x7fa154195b70 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa14400efc0 tx=0x7fa14400c3a0 comp rx=0 tx=0).stop 2024-06-02T04:48:00.619 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.619+0000 7fa15adc5700 1 -- 172.21.15.76:0/1005034029 shutdown_connections 2024-06-02T04:48:00.620 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.619+0000 7fa15adc5700 1 --2- 172.21.15.76:0/1005034029 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fa13c0a11a0 0x7fa13c0a3660 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:00.620 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.619+0000 7fa15adc5700 1 --2- 172.21.15.76:0/1005034029 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1541018f0 0x7fa15419d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:00.620 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.619+0000 7fa15adc5700 1 --2- 172.21.15.76:0/1005034029 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa1540ffd60 0x7fa154195b70 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:00.620 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.619+0000 7fa15adc5700 1 --2- 172.21.15.76:0/1005034029 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa154100f50 0x7fa1541960b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:00.620 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.619+0000 7fa15adc5700 1 -- 172.21.15.76:0/1005034029 >> 172.21.15.76:0/1005034029 conn(0x7fa1540fb2f0 msgr2=0x7fa1541042f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:00.620 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.619+0000 7fa15adc5700 1 -- 172.21.15.76:0/1005034029 shutdown_connections 2024-06-02T04:48:00.620 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.619+0000 7fa15adc5700 1 -- 172.21.15.76:0/1005034029 wait complete. 2024-06-02T04:48:00.631 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-06-02T04:48:00.631 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-06-02T04:48:00.760 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.757+0000 7f584cca8700 1 -- 172.21.15.76:0/48547398 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5848102170 msgr2=0x7f58481025d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:00.760 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.757+0000 7f584cca8700 1 --2- 172.21.15.76:0/48547398 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5848102170 0x7f58481025d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f58380099c0 tx=0x7f5838009cd0 comp rx=0 tx=0).stop 2024-06-02T04:48:00.760 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.757+0000 7f584cca8700 1 -- 172.21.15.76:0/48547398 shutdown_connections 2024-06-02T04:48:00.760 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.757+0000 7f584cca8700 1 --2- 172.21.15.76:0/48547398 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5848102b10 0x7f58481093c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:00.760 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.757+0000 7f584cca8700 1 --2- 172.21.15.76:0/48547398 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5848100f80 0x7f58481013a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:00.760 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.757+0000 7f584cca8700 1 --2- 172.21.15.76:0/48547398 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5848102170 0x7f58481025d0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:00.760 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.757+0000 7f584cca8700 1 -- 172.21.15.76:0/48547398 >> 172.21.15.76:0/48547398 conn(0x7f58480fc4f0 msgr2=0x7f58480fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:00.760 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.757+0000 7f584cca8700 1 -- 172.21.15.76:0/48547398 shutdown_connections 2024-06-02T04:48:00.760 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.757+0000 7f584cca8700 1 -- 172.21.15.76:0/48547398 wait complete. 2024-06-02T04:48:00.760 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.758+0000 7f584cca8700 1 Processor -- start 2024-06-02T04:48:00.760 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.758+0000 7f584cca8700 1 -- start start 2024-06-02T04:48:00.761 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.758+0000 7f584cca8700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5848100f80 0x7f5848074d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:00.761 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.758+0000 7f584cca8700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5848102170 0x7f5848073390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:00.761 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.758+0000 7f584cca8700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5848102b10 0x7f58480738d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:00.761 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.758+0000 7f584cca8700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5848074070 con 0x7f5848102b10 2024-06-02T04:48:00.761 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.758+0000 7f584cca8700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58480741e0 con 0x7f5848102170 2024-06-02T04:48:00.761 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.758+0000 7f584cca8700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58481a0ea0 con 0x7f5848100f80 2024-06-02T04:48:00.761 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.758+0000 7f5846d9d700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5848102b10 0x7f58480738d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:00.761 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.758+0000 7f5846d9d700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5848102b10 0x7f58480738d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:49128/0 (socket says 172.21.15.76:49128) 2024-06-02T04:48:00.761 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.758+0000 7f5846d9d700 1 -- 172.21.15.76:0/3713098028 learned_addr learned my addr 172.21.15.76:0/3713098028 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:48:00.761 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.758+0000 7f584659c700 1 --2- 172.21.15.76:0/3713098028 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5848100f80 0x7f5848074d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:00.761 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.758+0000 7f5845d9b700 1 --2- 172.21.15.76:0/3713098028 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5848102170 0x7f5848073390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:00.761 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.759+0000 7f5846d9d700 1 -- 172.21.15.76:0/3713098028 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5848100f80 msgr2=0x7f5848074d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:00.761 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.759+0000 7f5846d9d700 1 --2- 172.21.15.76:0/3713098028 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5848100f80 0x7f5848074d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:00.762 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.759+0000 7f5846d9d700 1 -- 172.21.15.76:0/3713098028 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5848102170 msgr2=0x7f5848073390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:00.762 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.759+0000 7f5846d9d700 1 --2- 172.21.15.76:0/3713098028 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5848102170 0x7f5848073390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:00.762 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.759+0000 7f5846d9d700 1 -- 172.21.15.76:0/3713098028 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58380095f0 con 0x7f5848102b10 2024-06-02T04:48:00.762 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.759+0000 7f5846d9d700 1 --2- 172.21.15.76:0/3713098028 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5848102b10 0x7f58480738d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5840007ee0 tx=0x7f584000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:00.762 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.759+0000 7f58377fe700 1 -- 172.21.15.76:0/3713098028 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f584000dcc0 con 0x7f5848102b10 2024-06-02T04:48:00.762 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.759+0000 7f58377fe700 1 -- 172.21.15.76:0/3713098028 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f584000f040 con 0x7f5848102b10 2024-06-02T04:48:00.762 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.759+0000 7f584cca8700 1 -- 172.21.15.76:0/3713098028 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58481a1130 con 0x7f5848102b10 2024-06-02T04:48:00.762 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.759+0000 7f58377fe700 1 -- 172.21.15.76:0/3713098028 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58400046e0 con 0x7f5848102b10 2024-06-02T04:48:00.762 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.759+0000 7f584cca8700 1 -- 172.21.15.76:0/3713098028 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58481a15f0 con 0x7f5848102b10 2024-06-02T04:48:00.763 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.760+0000 7f584cca8700 1 -- 172.21.15.76:0/3713098028 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58481084a0 con 0x7f5848102b10 2024-06-02T04:48:00.763 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.761+0000 7f58377fe700 1 -- 172.21.15.76:0/3713098028 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f5840003a00 con 0x7f5848102b10 2024-06-02T04:48:00.763 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.762+0000 7f58377fe700 1 --2- 172.21.15.76:0/3713098028 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f58300a1120 0x7f58300a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:00.763 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.762+0000 7f584659c700 1 --2- 172.21.15.76:0/3713098028 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f58300a1120 0x7f58300a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:00.763 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.762+0000 7f58377fe700 1 -- 172.21.15.76:0/3713098028 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f58400cc4e0 con 0x7f5848102b10 2024-06-02T04:48:00.763 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.762+0000 7f584659c700 1 --2- 172.21.15.76:0/3713098028 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f58300a1120 0x7f58300a35e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5848101fd0 tx=0x7f583c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:00.765 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.766+0000 7f58377fe700 1 -- 172.21.15.76:0/3713098028 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f58400960f0 con 0x7f5848102b10 2024-06-02T04:48:00.964 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:00.964+0000 7f584cca8700 1 -- 172.21.15.76:0/3713098028 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f5848067cf0 con 0x7f5848102b10 2024-06-02T04:48:01.248 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:01.248+0000 7f58377fe700 1 -- 172.21.15.76:0/3713098028 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v73) v1 ==== 138+0+0 (secure 0 0 0) 0x7f5840003cb0 con 0x7f5848102b10 2024-06-02T04:48:01.253 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:01.252+0000 7f584cca8700 1 -- 172.21.15.76:0/3713098028 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f58300a1120 msgr2=0x7f58300a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:01.253 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:01.252+0000 7f584cca8700 1 --2- 172.21.15.76:0/3713098028 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f58300a1120 0x7f58300a35e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5848101fd0 tx=0x7f583c009260 comp rx=0 tx=0).stop 2024-06-02T04:48:01.253 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:01.252+0000 7f584cca8700 1 -- 172.21.15.76:0/3713098028 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5848102b10 msgr2=0x7f58480738d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:01.253 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:01.252+0000 7f584cca8700 1 --2- 172.21.15.76:0/3713098028 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5848102b10 0x7f58480738d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5840007ee0 tx=0x7f584000d3b0 comp rx=0 tx=0).stop 2024-06-02T04:48:01.253 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:01.252+0000 7f584cca8700 1 -- 172.21.15.76:0/3713098028 shutdown_connections 2024-06-02T04:48:01.253 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:01.252+0000 7f584cca8700 1 --2- 172.21.15.76:0/3713098028 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5848102b10 0x7f58480738d0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:01.253 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:01.252+0000 7f584cca8700 1 --2- 172.21.15.76:0/3713098028 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5848100f80 0x7f5848074d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:01.253 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:01.252+0000 7f584cca8700 1 --2- 172.21.15.76:0/3713098028 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f58300a1120 0x7f58300a35e0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:01.254 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:01.252+0000 7f584cca8700 1 --2- 172.21.15.76:0/3713098028 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5848102170 0x7f5848073390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:01.254 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:01.252+0000 7f584cca8700 1 -- 172.21.15.76:0/3713098028 >> 172.21.15.76:0/3713098028 conn(0x7f58480fc4f0 msgr2=0x7f58481055e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:01.254 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:01.253+0000 7f584cca8700 1 -- 172.21.15.76:0/3713098028 shutdown_connections 2024-06-02T04:48:01.254 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:01.253+0000 7f584cca8700 1 -- 172.21.15.76:0/3713098028 wait complete. 2024-06-02T04:48:01.254 INFO:teuthology.orchestra.run.smithi076.stderr:pool 'cephfs_metadata' created 2024-06-02T04:48:01.265 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-06-02T04:48:01.396 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:01.394+0000 7fccf30c1700 1 -- 172.21.15.76:0/1571243455 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fccec102170 msgr2=0x7fccec1025d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:01.396 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:01.394+0000 7fccf30c1700 1 --2- 172.21.15.76:0/1571243455 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fccec102170 0x7fccec1025d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fccd80099c0 tx=0x7fccd8009cd0 comp rx=0 tx=0).stop 2024-06-02T04:48:01.396 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:01.394+0000 7fccf30c1700 1 -- 172.21.15.76:0/1571243455 shutdown_connections 2024-06-02T04:48:01.396 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:01.394+0000 7fccf30c1700 1 --2- 172.21.15.76:0/1571243455 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fccec102b10 0x7fccec1093c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:01.397 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:01.394+0000 7fccf30c1700 1 --2- 172.21.15.76:0/1571243455 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fccec100f80 0x7fccec1013a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:01.397 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:01.394+0000 7fccf30c1700 1 --2- 172.21.15.76:0/1571243455 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fccec102170 0x7fccec1025d0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:01.397 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:01.394+0000 7fccf30c1700 1 -- 172.21.15.76:0/1571243455 >> 172.21.15.76:0/1571243455 conn(0x7fccec0fc4f0 msgr2=0x7fccec0fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:01.397 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:01.394+0000 7fccf30c1700 1 -- 172.21.15.76:0/1571243455 shutdown_connections 2024-06-02T04:48:01.397 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:01.394+0000 7fccf30c1700 1 -- 172.21.15.76:0/1571243455 wait complete. 2024-06-02T04:48:01.397 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:01.394+0000 7fccf30c1700 1 Processor -- start 2024-06-02T04:48:01.397 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:01.394+0000 7fccf30c1700 1 -- start start 2024-06-02T04:48:01.397 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:01.395+0000 7fccf30c1700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fccec100f80 0x7fccec074d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:01.397 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:01.395+0000 7fccf30c1700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fccec102170 0x7fccec073390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:01.397 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:01.395+0000 7fccf30c1700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fccec102b10 0x7fccec0738d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:01.397 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:01.395+0000 7fccf30c1700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccec074070 con 0x7fccec102170 2024-06-02T04:48:01.397 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:01.395+0000 7fccf30c1700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccec0741e0 con 0x7fccec100f80 2024-06-02T04:48:01.397 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:01.395+0000 7fccf30c1700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccec1a0e20 con 0x7fccec102b10 2024-06-02T04:48:01.397 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:01.395+0000 7fccebfff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fccec102170 0x7fccec073390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:01.398 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:01.395+0000 7fccebfff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fccec102170 0x7fccec073390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:49146/0 (socket says 172.21.15.76:49146) 2024-06-02T04:48:01.398 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:01.395+0000 7fccebfff700 1 -- 172.21.15.76:0/1707885643 learned_addr learned my addr 172.21.15.76:0/1707885643 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:48:01.398 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:01.395+0000 7fccf0e5d700 1 --2- 172.21.15.76:0/1707885643 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fccec100f80 0x7fccec074d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:01.398 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:01.395+0000 7fccebfff700 1 -- 172.21.15.76:0/1707885643 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fccec102b10 msgr2=0x7fccec0738d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:01.398 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:01.395+0000 7fccebfff700 1 --2- 172.21.15.76:0/1707885643 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fccec102b10 0x7fccec0738d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:01.398 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:01.395+0000 7fccebfff700 1 -- 172.21.15.76:0/1707885643 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fccec100f80 msgr2=0x7fccec074d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:01.398 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:01.395+0000 7fccebfff700 1 --2- 172.21.15.76:0/1707885643 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fccec100f80 0x7fccec074d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:01.398 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:01.395+0000 7fccebfff700 1 -- 172.21.15.76:0/1707885643 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccd80095f0 con 0x7fccec102170 2024-06-02T04:48:01.398 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:01.395+0000 7fccebfff700 1 --2- 172.21.15.76:0/1707885643 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fccec102170 0x7fccec073390 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fccd8000c00 tx=0x7fccd8005b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:01.398 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:01.395+0000 7fcce9ffb700 1 -- 172.21.15.76:0/1707885643 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd801d070 con 0x7fccec102170 2024-06-02T04:48:01.398 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:01.395+0000 7fcce9ffb700 1 -- 172.21.15.76:0/1707885643 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fccd800bd30 con 0x7fccec102170 2024-06-02T04:48:01.398 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:01.395+0000 7fccf30c1700 1 -- 172.21.15.76:0/1707885643 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccec1a1050 con 0x7fccec102170 2024-06-02T04:48:01.399 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:01.395+0000 7fcce9ffb700 1 -- 172.21.15.76:0/1707885643 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd8022d60 con 0x7fccec102170 2024-06-02T04:48:01.399 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:01.396+0000 7fccf30c1700 1 -- 172.21.15.76:0/1707885643 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccec1a14a0 con 0x7fccec102170 2024-06-02T04:48:01.399 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:01.397+0000 7fccf30c1700 1 -- 172.21.15.76:0/1707885643 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccec108450 con 0x7fccec102170 2024-06-02T04:48:01.400 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:01.398+0000 7fcce9ffb700 1 -- 172.21.15.76:0/1707885643 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fccd8004000 con 0x7fccec102170 2024-06-02T04:48:01.400 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:01.398+0000 7fcce9ffb700 1 --2- 172.21.15.76:0/1707885643 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fccdc0a1120 0x7fccdc0a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:01.400 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:01.398+0000 7fcce9ffb700 1 -- 172.21.15.76:0/1707885643 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 7497+0+0 (secure 0 0 0) 0x7fccd80cdda0 con 0x7fccec102170 2024-06-02T04:48:01.400 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:01.398+0000 7fccf0e5d700 1 --2- 172.21.15.76:0/1707885643 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fccdc0a1120 0x7fccdc0a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:01.400 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:01.399+0000 7fccf0e5d700 1 --2- 172.21.15.76:0/1707885643 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fccdc0a1120 0x7fccdc0a35e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fccec101fd0 tx=0x7fcce000b5b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:01.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:01.402+0000 7fcce9ffb700 1 -- 172.21.15.76:0/1707885643 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fccd80978f0 con 0x7fccec102170 2024-06-02T04:48:01.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:01 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:48:01.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:01 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:48:01.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:01 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:48:01.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:01 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:48:01.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:01 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:48:01.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:01 smithi076 ceph-mon[42935]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T04:48:01.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:01 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:48:01.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:01 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:48:01.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:01 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:48:01.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:01 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:48:01.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:01 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/3429449578' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-02T04:48:01.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:01 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/1005034029' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-06-02T04:48:01.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:01 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:48:01.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:01 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:48:01.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:01 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:48:01.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:01 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:48:01.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:01 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:48:01.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:01 smithi119 ceph-mon[46633]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T04:48:01.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:01 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:48:01.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:01 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:48:01.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:01 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:48:01.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:01 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:48:01.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:01 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/3429449578' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-02T04:48:01.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:01 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/1005034029' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-06-02T04:48:01.602 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:01.601+0000 7fccf30c1700 1 -- 172.21.15.76:0/1707885643 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7fccec067cf0 con 0x7fccec102170 2024-06-02T04:48:01.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:01 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:48:01.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:01 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:48:01.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:01 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:48:01.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:01 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:48:01.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:01 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:48:01.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:01 smithi192 ceph-mon[47933]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T04:48:01.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:01 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:48:01.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:01 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:48:01.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:01 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:48:01.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:01 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:48:01.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:01 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/3429449578' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-02T04:48:01.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:01 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/1005034029' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-06-02T04:48:02.253 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:02.253+0000 7fcce9ffb700 1 -- 172.21.15.76:0/1707885643 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v74) v1 ==== 171+0+0 (secure 0 0 0) 0x7fccd809af10 con 0x7fccec102170 2024-06-02T04:48:02.266 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:02.261+0000 7fccf30c1700 1 -- 172.21.15.76:0/1707885643 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fccdc0a1120 msgr2=0x7fccdc0a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:02.266 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:02.261+0000 7fccf30c1700 1 --2- 172.21.15.76:0/1707885643 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fccdc0a1120 0x7fccdc0a35e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fccec101fd0 tx=0x7fcce000b5b0 comp rx=0 tx=0).stop 2024-06-02T04:48:02.266 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:02.261+0000 7fccf30c1700 1 -- 172.21.15.76:0/1707885643 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fccec102170 msgr2=0x7fccec073390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:02.266 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:02.261+0000 7fccf30c1700 1 --2- 172.21.15.76:0/1707885643 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fccec102170 0x7fccec073390 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fccd8000c00 tx=0x7fccd8005b00 comp rx=0 tx=0).stop 2024-06-02T04:48:02.266 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:02.263+0000 7fccf30c1700 1 -- 172.21.15.76:0/1707885643 shutdown_connections 2024-06-02T04:48:02.266 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:02.263+0000 7fccf30c1700 1 --2- 172.21.15.76:0/1707885643 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fccec102b10 0x7fccec0738d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:02.266 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:02.263+0000 7fccf30c1700 1 --2- 172.21.15.76:0/1707885643 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fccdc0a1120 0x7fccdc0a35e0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:02.266 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:02.263+0000 7fccf30c1700 1 --2- 172.21.15.76:0/1707885643 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fccec100f80 0x7fccec074d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:02.266 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:02.263+0000 7fccf30c1700 1 --2- 172.21.15.76:0/1707885643 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fccec102170 0x7fccec073390 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:02.266 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:02.263+0000 7fccf30c1700 1 -- 172.21.15.76:0/1707885643 >> 172.21.15.76:0/1707885643 conn(0x7fccec0fc4f0 msgr2=0x7fccec105590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:02.267 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:02.264+0000 7fccf30c1700 1 -- 172.21.15.76:0/1707885643 shutdown_connections 2024-06-02T04:48:02.267 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:02.264+0000 7fccf30c1700 1 -- 172.21.15.76:0/1707885643 wait complete. 2024-06-02T04:48:02.269 INFO:teuthology.orchestra.run.smithi076.stderr:pool 'cephfs_data' created 2024-06-02T04:48:02.283 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-06-02T04:48:02.411 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:02.408+0000 7f37cb14f700 1 -- 172.21.15.76:0/4187463802 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f37c40ffe80 msgr2=0x7f37c41002a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:02.411 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:02.408+0000 7f37cb14f700 1 --2- 172.21.15.76:0/4187463802 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f37c40ffe80 0x7f37c41002a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f37b8009990 tx=0x7f37b8009ca0 comp rx=0 tx=0).stop 2024-06-02T04:48:02.411 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:02.408+0000 7f37cb14f700 1 -- 172.21.15.76:0/4187463802 shutdown_connections 2024-06-02T04:48:02.411 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:02.408+0000 7f37cb14f700 1 --2- 172.21.15.76:0/4187463802 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f37c4101990 0x7f37c41082b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:02.411 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:02.408+0000 7f37cb14f700 1 --2- 172.21.15.76:0/4187463802 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f37c40ffe80 0x7f37c41002a0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:02.411 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:02.408+0000 7f37cb14f700 1 --2- 172.21.15.76:0/4187463802 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f37c4100fd0 0x7f37c4101450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:02.411 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:02.408+0000 7f37cb14f700 1 -- 172.21.15.76:0/4187463802 >> 172.21.15.76:0/4187463802 conn(0x7f37c40fb3f0 msgr2=0x7f37c40fd830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:02.411 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:02.408+0000 7f37cb14f700 1 -- 172.21.15.76:0/4187463802 shutdown_connections 2024-06-02T04:48:02.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:02.408+0000 7f37cb14f700 1 -- 172.21.15.76:0/4187463802 wait complete. 2024-06-02T04:48:02.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:02.409+0000 7f37cb14f700 1 Processor -- start 2024-06-02T04:48:02.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:02.409+0000 7f37cb14f700 1 -- start start 2024-06-02T04:48:02.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:02.409+0000 7f37cb14f700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f37c40ffe80 0x7f37c4069d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:02.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:02.409+0000 7f37cb14f700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f37c4100fd0 0x7f37c419bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:02.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:02.409+0000 7f37cb14f700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f37c4101990 0x7f37c419e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:02.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:02.409+0000 7f37cb14f700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37c419e9b0 con 0x7f37c4101990 2024-06-02T04:48:02.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:02.409+0000 7f37cb14f700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37c419eb20 con 0x7f37c4100fd0 2024-06-02T04:48:02.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:02.409+0000 7f37cb14f700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37c419ece0 con 0x7f37c40ffe80 2024-06-02T04:48:02.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:02.409+0000 7f37c96ec700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f37c4101990 0x7f37c419e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:02.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:02.409+0000 7f37c96ec700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f37c4101990 0x7f37c419e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:52802/0 (socket says 172.21.15.76:52802) 2024-06-02T04:48:02.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:02.409+0000 7f37c96ec700 1 -- 172.21.15.76:0/2722638909 learned_addr learned my addr 172.21.15.76:0/2722638909 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:48:02.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:02.409+0000 7f37c8eeb700 1 --2- 172.21.15.76:0/2722638909 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f37c40ffe80 0x7f37c4069d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:02.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:02.410+0000 7f37c96ec700 1 -- 172.21.15.76:0/2722638909 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f37c40ffe80 msgr2=0x7f37c4069d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:02.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:02.410+0000 7f37c96ec700 1 --2- 172.21.15.76:0/2722638909 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f37c40ffe80 0x7f37c4069d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:02.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:02.410+0000 7f37c96ec700 1 -- 172.21.15.76:0/2722638909 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f37c4100fd0 msgr2=0x7f37c419bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:02.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:02.410+0000 7f37c96ec700 1 --2- 172.21.15.76:0/2722638909 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f37c4100fd0 0x7f37c419bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:02.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:02.410+0000 7f37c96ec700 1 -- 172.21.15.76:0/2722638909 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37b80095f0 con 0x7f37c4101990 2024-06-02T04:48:02.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:02.410+0000 7f37c96ec700 1 --2- 172.21.15.76:0/2722638909 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f37c4101990 0x7f37c419e210 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f37bc00b970 tx=0x7f37bc00bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:02.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:02.410+0000 7f37c1ffb700 1 -- 172.21.15.76:0/2722638909 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37bc00c930 con 0x7f37c4101990 2024-06-02T04:48:02.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:02.410+0000 7f37c1ffb700 1 -- 172.21.15.76:0/2722638909 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f37bc014440 con 0x7f37c4101990 2024-06-02T04:48:02.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:02.410+0000 7f37c1ffb700 1 -- 172.21.15.76:0/2722638909 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37bc0075d0 con 0x7f37c4101990 2024-06-02T04:48:02.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:02.410+0000 7f37cb14f700 1 -- 172.21.15.76:0/2722638909 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37c419efc0 con 0x7f37c4101990 2024-06-02T04:48:02.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:02.410+0000 7f37cb14f700 1 -- 172.21.15.76:0/2722638909 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37c419f450 con 0x7f37c4101990 2024-06-02T04:48:02.414 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:02.411+0000 7f37cb14f700 1 -- 172.21.15.76:0/2722638909 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37c4107330 con 0x7f37c4101990 2024-06-02T04:48:02.414 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:02.412+0000 7f37c1ffb700 1 -- 172.21.15.76:0/2722638909 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f37bc0145b0 con 0x7f37c4101990 2024-06-02T04:48:02.414 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:02.413+0000 7f37c1ffb700 1 --2- 172.21.15.76:0/2722638909 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f37b40a1120 0x7f37b40a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:02.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:02.413+0000 7f37c8eeb700 1 --2- 172.21.15.76:0/2722638909 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f37b40a1120 0x7f37b40a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:02.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:02.413+0000 7f37c1ffb700 1 -- 172.21.15.76:0/2722638909 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 7879+0+0 (secure 0 0 0) 0x7f37bc006e40 con 0x7f37c4101990 2024-06-02T04:48:02.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:02.413+0000 7f37c8eeb700 1 --2- 172.21.15.76:0/2722638909 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f37b40a1120 0x7f37b40a35e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f37b800c010 tx=0x7f37b8003720 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:02.417 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:02.417+0000 7f37c1ffb700 1 -- 172.21.15.76:0/2722638909 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f37bc095ff0 con 0x7f37c4101990 2024-06-02T04:48:02.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:02 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/3713098028' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-06-02T04:48:02.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:02 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:48:02.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:02 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/3713098028' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-06-02T04:48:02.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:02 smithi076 ceph-mon[42935]: osdmap e73: 12 total, 12 up, 12 in 2024-06-02T04:48:02.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:02 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/1707885643' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-06-02T04:48:02.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:02 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/3713098028' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-06-02T04:48:02.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:02 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:48:02.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:02 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/3713098028' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-06-02T04:48:02.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:02 smithi119 ceph-mon[46633]: osdmap e73: 12 total, 12 up, 12 in 2024-06-02T04:48:02.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:02 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/1707885643' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-06-02T04:48:02.661 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:02.661+0000 7f37cb14f700 1 -- 172.21.15.76:0/2722638909 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f37c4067460 con 0x7f37c4101990 2024-06-02T04:48:02.669 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:02.669+0000 7f37c1ffb700 1 -- 172.21.15.76:0/2722638909 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) v1 ==== 172+0+0 (secure 0 0 0) 0x7f37bc0190c0 con 0x7f37c4101990 2024-06-02T04:48:02.679 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:02.674+0000 7f37cb14f700 1 -- 172.21.15.76:0/2722638909 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f37b40a1120 msgr2=0x7f37b40a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:02.679 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:02.674+0000 7f37cb14f700 1 --2- 172.21.15.76:0/2722638909 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f37b40a1120 0x7f37b40a35e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f37b800c010 tx=0x7f37b8003720 comp rx=0 tx=0).stop 2024-06-02T04:48:02.679 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:02.674+0000 7f37cb14f700 1 -- 172.21.15.76:0/2722638909 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f37c4101990 msgr2=0x7f37c419e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:02.679 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:02.674+0000 7f37cb14f700 1 --2- 172.21.15.76:0/2722638909 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f37c4101990 0x7f37c419e210 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f37bc00b970 tx=0x7f37bc00bc80 comp rx=0 tx=0).stop 2024-06-02T04:48:02.679 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:02.674+0000 7f37cb14f700 1 -- 172.21.15.76:0/2722638909 shutdown_connections 2024-06-02T04:48:02.679 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:02.674+0000 7f37cb14f700 1 --2- 172.21.15.76:0/2722638909 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f37c4101990 0x7f37c419e210 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:02.679 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:02.674+0000 7f37cb14f700 1 --2- 172.21.15.76:0/2722638909 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f37c40ffe80 0x7f37c4069d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:02.679 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:02.674+0000 7f37cb14f700 1 --2- 172.21.15.76:0/2722638909 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f37b40a1120 0x7f37b40a35e0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:02.679 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:02.674+0000 7f37cb14f700 1 --2- 172.21.15.76:0/2722638909 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f37c4100fd0 0x7f37c419bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:02.679 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:02.674+0000 7f37cb14f700 1 -- 172.21.15.76:0/2722638909 >> 172.21.15.76:0/2722638909 conn(0x7f37c40fb3f0 msgr2=0x7f37c4104470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:02.679 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:02.674+0000 7f37cb14f700 1 -- 172.21.15.76:0/2722638909 shutdown_connections 2024-06-02T04:48:02.680 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:02.674+0000 7f37cb14f700 1 -- 172.21.15.76:0/2722638909 wait complete. 2024-06-02T04:48:02.680 INFO:teuthology.orchestra.run.smithi076.stderr:new fs with metadata pool 2 and data pool 3 2024-06-02T04:48:02.683 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:02 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/3713098028' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-06-02T04:48:02.683 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:02 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:48:02.683 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:02 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/3713098028' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-06-02T04:48:02.683 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:02 smithi192 ceph-mon[47933]: osdmap e73: 12 total, 12 up, 12 in 2024-06-02T04:48:02.683 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:02 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/1707885643' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-06-02T04:48:02.697 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-06-02T04:48:02.697 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-06-02T04:48:02.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:02.827+0000 7fd40f75f700 1 -- 172.21.15.76:0/2781009203 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd408101990 msgr2=0x7fd4081082b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:02.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:02.827+0000 7fd40f75f700 1 --2- 172.21.15.76:0/2781009203 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd408101990 0x7fd4081082b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd40000b0a0 tx=0x7fd40000b3b0 comp rx=0 tx=0).stop 2024-06-02T04:48:02.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:02.827+0000 7fd40f75f700 1 -- 172.21.15.76:0/2781009203 shutdown_connections 2024-06-02T04:48:02.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:02.827+0000 7fd40f75f700 1 --2- 172.21.15.76:0/2781009203 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd408101990 0x7fd4081082b0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:02.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:02.827+0000 7fd40f75f700 1 --2- 172.21.15.76:0/2781009203 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd4080ffe80 0x7fd4081002a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:02.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:02.827+0000 7fd40f75f700 1 --2- 172.21.15.76:0/2781009203 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd408100fd0 0x7fd408101450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:02.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:02.827+0000 7fd40f75f700 1 -- 172.21.15.76:0/2781009203 >> 172.21.15.76:0/2781009203 conn(0x7fd4080fb3f0 msgr2=0x7fd4080fd830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:02.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:02.827+0000 7fd40f75f700 1 -- 172.21.15.76:0/2781009203 shutdown_connections 2024-06-02T04:48:02.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:02.827+0000 7fd40f75f700 1 -- 172.21.15.76:0/2781009203 wait complete. 2024-06-02T04:48:02.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:02.828+0000 7fd40f75f700 1 Processor -- start 2024-06-02T04:48:02.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:02.828+0000 7fd40f75f700 1 -- start start 2024-06-02T04:48:02.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:02.828+0000 7fd40f75f700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd4080ffe80 0x7fd408199080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:02.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:02.828+0000 7fd40f75f700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd408100fd0 0x7fd4081995c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:02.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:02.828+0000 7fd40f75f700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd408101990 0x7fd4081a05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:02.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:02.828+0000 7fd40f75f700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4081a0bb0 con 0x7fd4080ffe80 2024-06-02T04:48:02.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:02.828+0000 7fd40f75f700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4081a0cf0 con 0x7fd408100fd0 2024-06-02T04:48:02.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:02.828+0000 7fd40f75f700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4081a0e80 con 0x7fd408101990 2024-06-02T04:48:02.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:02.828+0000 7fd40d4fb700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd4080ffe80 0x7fd408199080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:02.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:02.828+0000 7fd40d4fb700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd4080ffe80 0x7fd408199080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:52812/0 (socket says 172.21.15.76:52812) 2024-06-02T04:48:02.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:02.828+0000 7fd40d4fb700 1 -- 172.21.15.76:0/1274212857 learned_addr learned my addr 172.21.15.76:0/1274212857 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:48:02.832 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:02.828+0000 7fd40ccfa700 1 --2- 172.21.15.76:0/1274212857 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd408100fd0 0x7fd4081995c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:02.832 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:02.828+0000 7fd40dcfc700 1 --2- 172.21.15.76:0/1274212857 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd408101990 0x7fd4081a05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:02.832 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:02.828+0000 7fd40d4fb700 1 -- 172.21.15.76:0/1274212857 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd408101990 msgr2=0x7fd4081a05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:02.832 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:02.828+0000 7fd40d4fb700 1 --2- 172.21.15.76:0/1274212857 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd408101990 0x7fd4081a05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:02.832 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:02.828+0000 7fd40d4fb700 1 -- 172.21.15.76:0/1274212857 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd408100fd0 msgr2=0x7fd4081995c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:02.832 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:02.828+0000 7fd40d4fb700 1 --2- 172.21.15.76:0/1274212857 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd408100fd0 0x7fd4081995c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:02.832 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:02.828+0000 7fd40d4fb700 1 -- 172.21.15.76:0/1274212857 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd400009d00 con 0x7fd4080ffe80 2024-06-02T04:48:02.832 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:02.828+0000 7fd40dcfc700 1 --2- 172.21.15.76:0/1274212857 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd408101990 0x7fd4081a05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:48:02.832 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:02.829+0000 7fd40d4fb700 1 --2- 172.21.15.76:0/1274212857 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd4080ffe80 0x7fd408199080 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd40400c9b0 tx=0x7fd40400cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:02.832 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:02.829+0000 7fd3fa7fc700 1 -- 172.21.15.76:0/1274212857 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd404007b00 con 0x7fd4080ffe80 2024-06-02T04:48:02.832 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:02.829+0000 7fd3fa7fc700 1 -- 172.21.15.76:0/1274212857 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd404007c60 con 0x7fd4080ffe80 2024-06-02T04:48:02.832 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:02.829+0000 7fd40f75f700 1 -- 172.21.15.76:0/1274212857 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4081a1160 con 0x7fd4080ffe80 2024-06-02T04:48:02.833 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:02.829+0000 7fd3fa7fc700 1 -- 172.21.15.76:0/1274212857 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd404018660 con 0x7fd4080ffe80 2024-06-02T04:48:02.833 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:02.829+0000 7fd40f75f700 1 -- 172.21.15.76:0/1274212857 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4081a1670 con 0x7fd4080ffe80 2024-06-02T04:48:02.833 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:02.830+0000 7fd40f75f700 1 -- 172.21.15.76:0/1274212857 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd408068140 con 0x7fd4080ffe80 2024-06-02T04:48:02.833 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:02.831+0000 7fd3fa7fc700 1 -- 172.21.15.76:0/1274212857 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fd40400f450 con 0x7fd4080ffe80 2024-06-02T04:48:02.834 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:02.831+0000 7fd3fa7fc700 1 --2- 172.21.15.76:0/1274212857 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fd3f40a1120 0x7fd3f40a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:02.834 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:02.831+0000 7fd40ccfa700 1 --2- 172.21.15.76:0/1274212857 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fd3f40a1120 0x7fd3f40a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:02.834 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:02.831+0000 7fd3fa7fc700 1 -- 172.21.15.76:0/1274212857 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fd4040cc7f0 con 0x7fd4080ffe80 2024-06-02T04:48:02.834 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:02.832+0000 7fd40ccfa700 1 --2- 172.21.15.76:0/1274212857 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fd3f40a1120 0x7fd3f40a35e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc005950 tx=0x7fd3fc0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:02.836 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:02.836+0000 7fd3fa7fc700 1 -- 172.21.15.76:0/1274212857 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fd4040960d0 con 0x7fd4080ffe80 2024-06-02T04:48:03.045 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:03.044+0000 7fd40f75f700 1 -- 172.21.15.76:0/1274212857 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7fd40810b530 con 0x7fd4080ffe80 2024-06-02T04:48:03.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:03 smithi076 ceph-mon[42935]: pgmap v211: 33 pgs: 11 creating+peering, 21 unknown, 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T04:48:03.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:03 smithi076 ceph-mon[42935]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-06-02T04:48:03.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:03 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/1707885643' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-06-02T04:48:03.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:03 smithi076 ceph-mon[42935]: osdmap e74: 12 total, 12 up, 12 in 2024-06-02T04:48:03.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:03 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/2722638909' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-06-02T04:48:03.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:03 smithi076 ceph-mon[42935]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-06-02T04:48:03.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:03 smithi076 ceph-mon[42935]: osdmap e75: 12 total, 12 up, 12 in 2024-06-02T04:48:03.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:03 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/2722638909' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-06-02T04:48:03.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:03 smithi076 ceph-mon[42935]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-06-02T04:48:03.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:03 smithi076 ceph-mon[42935]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-06-02T04:48:03.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:03 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/1274212857' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-06-02T04:48:03.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:03 smithi119 ceph-mon[46633]: pgmap v211: 33 pgs: 11 creating+peering, 21 unknown, 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T04:48:03.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:03 smithi119 ceph-mon[46633]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-06-02T04:48:03.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:03 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/1707885643' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-06-02T04:48:03.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:03 smithi119 ceph-mon[46633]: osdmap e74: 12 total, 12 up, 12 in 2024-06-02T04:48:03.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:03 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/2722638909' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-06-02T04:48:03.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:03 smithi119 ceph-mon[46633]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-06-02T04:48:03.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:03 smithi119 ceph-mon[46633]: osdmap e75: 12 total, 12 up, 12 in 2024-06-02T04:48:03.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:03 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/2722638909' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-06-02T04:48:03.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:03 smithi119 ceph-mon[46633]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-06-02T04:48:03.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:03 smithi119 ceph-mon[46633]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-06-02T04:48:03.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:03 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/1274212857' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-06-02T04:48:03.676 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:03.676+0000 7fd3fa7fc700 1 -- 172.21.15.76:0/1274212857 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v76) v1 ==== 157+0+0 (secure 0 0 0) 0x7fd4040996f0 con 0x7fd4080ffe80 2024-06-02T04:48:03.679 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:03.678+0000 7fd40f75f700 1 -- 172.21.15.76:0/1274212857 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fd3f40a1120 msgr2=0x7fd3f40a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:03.679 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:03.678+0000 7fd40f75f700 1 --2- 172.21.15.76:0/1274212857 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fd3f40a1120 0x7fd3f40a35e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc005950 tx=0x7fd3fc0058e0 comp rx=0 tx=0).stop 2024-06-02T04:48:03.679 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:03.678+0000 7fd40f75f700 1 -- 172.21.15.76:0/1274212857 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd4080ffe80 msgr2=0x7fd408199080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:03.679 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:03.678+0000 7fd40f75f700 1 --2- 172.21.15.76:0/1274212857 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd4080ffe80 0x7fd408199080 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd40400c9b0 tx=0x7fd40400cd70 comp rx=0 tx=0).stop 2024-06-02T04:48:03.679 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:03.679+0000 7fd40f75f700 1 -- 172.21.15.76:0/1274212857 shutdown_connections 2024-06-02T04:48:03.679 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:03.679+0000 7fd40f75f700 1 --2- 172.21.15.76:0/1274212857 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd408101990 0x7fd4081a05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:03.679 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:03.679+0000 7fd40f75f700 1 --2- 172.21.15.76:0/1274212857 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd4080ffe80 0x7fd408199080 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:03.679 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:03.679+0000 7fd40f75f700 1 --2- 172.21.15.76:0/1274212857 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fd3f40a1120 0x7fd3f40a35e0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:03.679 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:03.679+0000 7fd40f75f700 1 --2- 172.21.15.76:0/1274212857 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd408100fd0 0x7fd4081995c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:03.680 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:03.679+0000 7fd40f75f700 1 -- 172.21.15.76:0/1274212857 >> 172.21.15.76:0/1274212857 conn(0x7fd4080fb3f0 msgr2=0x7fd408069450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:03.680 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:03.679+0000 7fd40f75f700 1 -- 172.21.15.76:0/1274212857 shutdown_connections 2024-06-02T04:48:03.680 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:03.679+0000 7fd40f75f700 1 -- 172.21.15.76:0/1274212857 wait complete. 2024-06-02T04:48:03.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:03 smithi192 ceph-mon[47933]: pgmap v211: 33 pgs: 11 creating+peering, 21 unknown, 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T04:48:03.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:03 smithi192 ceph-mon[47933]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-06-02T04:48:03.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:03 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/1707885643' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-06-02T04:48:03.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:03 smithi192 ceph-mon[47933]: osdmap e74: 12 total, 12 up, 12 in 2024-06-02T04:48:03.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:03 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/2722638909' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-06-02T04:48:03.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:03 smithi192 ceph-mon[47933]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-06-02T04:48:03.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:03 smithi192 ceph-mon[47933]: osdmap e75: 12 total, 12 up, 12 in 2024-06-02T04:48:03.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:03 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/2722638909' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-06-02T04:48:03.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:03 smithi192 ceph-mon[47933]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-06-02T04:48:03.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:03 smithi192 ceph-mon[47933]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-06-02T04:48:03.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:03 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/1274212857' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-06-02T04:48:03.693 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-06-02T04:48:03.829 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:03.826+0000 7efc105b7700 1 -- 172.21.15.76:0/2547374144 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efc08104220 msgr2=0x7efc08106610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:03.829 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:03.826+0000 7efc105b7700 1 --2- 172.21.15.76:0/2547374144 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efc08104220 0x7efc08106610 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7efc04009990 tx=0x7efc04009ca0 comp rx=0 tx=0).stop 2024-06-02T04:48:03.829 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:03.827+0000 7efc105b7700 1 -- 172.21.15.76:0/2547374144 shutdown_connections 2024-06-02T04:48:03.829 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:03.827+0000 7efc105b7700 1 --2- 172.21.15.76:0/2547374144 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efc08106b50 0x7efc08108fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:03.829 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:03.827+0000 7efc105b7700 1 --2- 172.21.15.76:0/2547374144 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efc081018f0 0x7efc08103ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:03.829 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:03.827+0000 7efc105b7700 1 --2- 172.21.15.76:0/2547374144 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efc08104220 0x7efc08106610 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:03.829 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:03.827+0000 7efc105b7700 1 -- 172.21.15.76:0/2547374144 >> 172.21.15.76:0/2547374144 conn(0x7efc080fb2e0 msgr2=0x7efc080fd720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:03.829 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:03.827+0000 7efc105b7700 1 -- 172.21.15.76:0/2547374144 shutdown_connections 2024-06-02T04:48:03.829 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:03.827+0000 7efc105b7700 1 -- 172.21.15.76:0/2547374144 wait complete. 2024-06-02T04:48:03.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:03.827+0000 7efc105b7700 1 Processor -- start 2024-06-02T04:48:03.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:03.827+0000 7efc105b7700 1 -- start start 2024-06-02T04:48:03.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:03.827+0000 7efc105b7700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efc081018f0 0x7efc08101210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:03.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:03.827+0000 7efc105b7700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efc08104220 0x7efc080ff8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:03.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:03.827+0000 7efc105b7700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efc08106b50 0x7efc080ffde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:03.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:03.827+0000 7efc105b7700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc08100580 con 0x7efc08104220 2024-06-02T04:48:03.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:03.827+0000 7efc105b7700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc081006f0 con 0x7efc08106b50 2024-06-02T04:48:03.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:03.827+0000 7efc105b7700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc081a0d80 con 0x7efc081018f0 2024-06-02T04:48:03.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:03.827+0000 7efc0db52700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efc08104220 0x7efc080ff8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:03.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:03.828+0000 7efc0db52700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efc08104220 0x7efc080ff8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:52828/0 (socket says 172.21.15.76:52828) 2024-06-02T04:48:03.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:03.828+0000 7efc0db52700 1 -- 172.21.15.76:0/1061580924 learned_addr learned my addr 172.21.15.76:0/1061580924 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:48:03.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:03.828+0000 7efc0e353700 1 --2- 172.21.15.76:0/1061580924 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efc081018f0 0x7efc08101210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:03.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:03.828+0000 7efc0eb54700 1 --2- 172.21.15.76:0/1061580924 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efc08106b50 0x7efc080ffde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:03.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:03.828+0000 7efc0db52700 1 -- 172.21.15.76:0/1061580924 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efc081018f0 msgr2=0x7efc08101210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:03.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:03.828+0000 7efc0db52700 1 --2- 172.21.15.76:0/1061580924 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efc081018f0 0x7efc08101210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:03.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:03.828+0000 7efc0db52700 1 -- 172.21.15.76:0/1061580924 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efc08106b50 msgr2=0x7efc080ffde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:03.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:03.828+0000 7efc0db52700 1 --2- 172.21.15.76:0/1061580924 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efc08106b50 0x7efc080ffde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:03.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:03.828+0000 7efc0db52700 1 -- 172.21.15.76:0/1061580924 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc040095f0 con 0x7efc08104220 2024-06-02T04:48:03.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:03.828+0000 7efc0db52700 1 --2- 172.21.15.76:0/1061580924 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efc08104220 0x7efc080ff8a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7efc040098e0 tx=0x7efc04003a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:03.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:03.828+0000 7efbff7fe700 1 -- 172.21.15.76:0/1061580924 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc0401d070 con 0x7efc08104220 2024-06-02T04:48:03.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:03.828+0000 7efbff7fe700 1 -- 172.21.15.76:0/1061580924 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efc0400bd90 con 0x7efc08104220 2024-06-02T04:48:03.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:03.828+0000 7efc105b7700 1 -- 172.21.15.76:0/1061580924 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc081a0fb0 con 0x7efc08104220 2024-06-02T04:48:03.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:03.828+0000 7efbff7fe700 1 -- 172.21.15.76:0/1061580924 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc04022d20 con 0x7efc08104220 2024-06-02T04:48:03.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:03.828+0000 7efc105b7700 1 -- 172.21.15.76:0/1061580924 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc081a13a0 con 0x7efc08104220 2024-06-02T04:48:03.832 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:03.829+0000 7efc105b7700 1 -- 172.21.15.76:0/1061580924 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc080fce60 con 0x7efc08104220 2024-06-02T04:48:03.832 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:03.830+0000 7efbff7fe700 1 -- 172.21.15.76:0/1061580924 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7efc04003f40 con 0x7efc08104220 2024-06-02T04:48:03.832 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:03.831+0000 7efbff7fe700 1 --2- 172.21.15.76:0/1061580924 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7efbf40a1190 0x7efbf40a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:03.832 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:03.831+0000 7efc0e353700 1 --2- 172.21.15.76:0/1061580924 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7efbf40a1190 0x7efbf40a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:03.833 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:03.831+0000 7efbff7fe700 1 -- 172.21.15.76:0/1061580924 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 8205+0+0 (secure 0 0 0) 0x7efc040cded0 con 0x7efc08104220 2024-06-02T04:48:03.833 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:03.831+0000 7efc0e353700 1 --2- 172.21.15.76:0/1061580924 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7efbf40a1190 0x7efbf40a3650 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7efbf8005950 tx=0x7efbf800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:03.835 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:03.835+0000 7efbff7fe700 1 -- 172.21.15.76:0/1061580924 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7efc040976b0 con 0x7efc08104220 2024-06-02T04:48:04.036 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:04.036+0000 7efc105b7700 1 -- 172.21.15.76:0/1061580924 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7efc08067c10 con 0x7efc08104220 2024-06-02T04:48:04.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:04 smithi192 ceph-mon[47933]: mds.? [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] up:active 2024-06-02T04:48:04.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:04 smithi192 ceph-mon[47933]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-06-02T04:48:04.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:04 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/1274212857' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-06-02T04:48:04.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:04 smithi192 ceph-mon[47933]: osdmap e76: 12 total, 12 up, 12 in 2024-06-02T04:48:04.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:04 smithi192 ceph-mon[47933]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-06-02T04:48:04.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:04 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/1061580924' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-06-02T04:48:04.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:04 smithi192 ceph-mon[47933]: pgmap v215: 97 pgs: 25 creating+peering, 65 unknown, 7 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T04:48:04.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:04 smithi076 ceph-mon[42935]: mds.? [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] up:active 2024-06-02T04:48:04.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:04 smithi076 ceph-mon[42935]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-06-02T04:48:04.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:04 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/1274212857' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-06-02T04:48:04.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:04 smithi076 ceph-mon[42935]: osdmap e76: 12 total, 12 up, 12 in 2024-06-02T04:48:04.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:04 smithi076 ceph-mon[42935]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-06-02T04:48:04.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:04 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/1061580924' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-06-02T04:48:04.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:04 smithi076 ceph-mon[42935]: pgmap v215: 97 pgs: 25 creating+peering, 65 unknown, 7 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T04:48:05.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:04 smithi119 ceph-mon[46633]: mds.? [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] up:active 2024-06-02T04:48:05.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:04 smithi119 ceph-mon[46633]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-06-02T04:48:05.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:04 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/1274212857' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-06-02T04:48:05.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:04 smithi119 ceph-mon[46633]: osdmap e76: 12 total, 12 up, 12 in 2024-06-02T04:48:05.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:04 smithi119 ceph-mon[46633]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-06-02T04:48:05.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:04 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/1061580924' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-06-02T04:48:05.097 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:04 smithi119 ceph-mon[46633]: pgmap v215: 97 pgs: 25 creating+peering, 65 unknown, 7 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T04:48:05.686 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:05.685+0000 7efbff7fe700 1 -- 172.21.15.76:0/1061580924 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v78) v1 ==== 228+0+0 (secure 0 0 0) 0x7efc0409acd0 con 0x7efc08104220 2024-06-02T04:48:05.690 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:05.690+0000 7efc105b7700 1 -- 172.21.15.76:0/1061580924 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7efbf40a1190 msgr2=0x7efbf40a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:05.690 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:05.690+0000 7efc105b7700 1 --2- 172.21.15.76:0/1061580924 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7efbf40a1190 0x7efbf40a3650 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7efbf8005950 tx=0x7efbf800b410 comp rx=0 tx=0).stop 2024-06-02T04:48:05.690 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:05.690+0000 7efc105b7700 1 -- 172.21.15.76:0/1061580924 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efc08104220 msgr2=0x7efc080ff8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:05.690 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:05.690+0000 7efc105b7700 1 --2- 172.21.15.76:0/1061580924 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efc08104220 0x7efc080ff8a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7efc040098e0 tx=0x7efc04003a50 comp rx=0 tx=0).stop 2024-06-02T04:48:05.692 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:05.692+0000 7efc105b7700 1 -- 172.21.15.76:0/1061580924 shutdown_connections 2024-06-02T04:48:05.692 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:05.692+0000 7efc105b7700 1 --2- 172.21.15.76:0/1061580924 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7efbf40a1190 0x7efbf40a3650 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:05.693 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:05.692+0000 7efc105b7700 1 --2- 172.21.15.76:0/1061580924 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efc08106b50 0x7efc080ffde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:05.693 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:05.692+0000 7efc105b7700 1 --2- 172.21.15.76:0/1061580924 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efc081018f0 0x7efc08101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:05.693 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:05.692+0000 7efc105b7700 1 --2- 172.21.15.76:0/1061580924 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efc08104220 0x7efc080ff8a0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:05.693 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:05.692+0000 7efc105b7700 1 -- 172.21.15.76:0/1061580924 >> 172.21.15.76:0/1061580924 conn(0x7efc080fb2e0 msgr2=0x7efc08102310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:05.695 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:05.695+0000 7efc105b7700 1 -- 172.21.15.76:0/1061580924 shutdown_connections 2024-06-02T04:48:05.696 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:05.695+0000 7efc105b7700 1 -- 172.21.15.76:0/1061580924 wait complete. 2024-06-02T04:48:05.696 INFO:teuthology.orchestra.run.smithi076.stderr:pool 'cephfs_data_ec' created 2024-06-02T04:48:05.709 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-06-02T04:48:05.840 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:05.837+0000 7f08ce455700 1 -- 172.21.15.76:0/718968891 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f08c8101180 msgr2=0x7f08c8107a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:05.840 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:05.837+0000 7f08ce455700 1 --2- 172.21.15.76:0/718968891 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f08c8101180 0x7f08c8107a30 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f08c000b0d0 tx=0x7f08c000b3e0 comp rx=0 tx=0).stop 2024-06-02T04:48:05.841 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:05.837+0000 7f08ce455700 1 -- 172.21.15.76:0/718968891 shutdown_connections 2024-06-02T04:48:05.841 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:05.837+0000 7f08ce455700 1 --2- 172.21.15.76:0/718968891 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f08c8101180 0x7f08c8107a30 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:05.841 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:05.837+0000 7f08ce455700 1 --2- 172.21.15.76:0/718968891 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08c80ff5f0 0x7f08c80ffa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:05.841 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:05.837+0000 7f08ce455700 1 --2- 172.21.15.76:0/718968891 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f08c81007e0 0x7f08c8100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:05.841 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:05.837+0000 7f08ce455700 1 -- 172.21.15.76:0/718968891 >> 172.21.15.76:0/718968891 conn(0x7f08c80fab80 msgr2=0x7f08c80fcfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:05.841 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:05.837+0000 7f08ce455700 1 -- 172.21.15.76:0/718968891 shutdown_connections 2024-06-02T04:48:05.841 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:05.837+0000 7f08ce455700 1 -- 172.21.15.76:0/718968891 wait complete. 2024-06-02T04:48:05.841 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:05.838+0000 7f08ce455700 1 Processor -- start 2024-06-02T04:48:05.841 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:05.838+0000 7f08ce455700 1 -- start start 2024-06-02T04:48:05.841 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:05.838+0000 7f08ce455700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f08c80ff5f0 0x7f08c8196f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:05.841 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:05.838+0000 7f08ce455700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08c81007e0 0x7f08c81974c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:05.842 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:05.838+0000 7f08ce455700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f08c8101180 0x7f08c819e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:05.842 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:05.838+0000 7f08ce455700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08c819eab0 con 0x7f08c80ff5f0 2024-06-02T04:48:05.842 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:05.838+0000 7f08ce455700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08c819ebf0 con 0x7f08c8101180 2024-06-02T04:48:05.842 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:05.838+0000 7f08ce455700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08c819ed80 con 0x7f08c81007e0 2024-06-02T04:48:05.842 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:05.838+0000 7f08c7fff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f08c80ff5f0 0x7f08c8196f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:05.842 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:05.838+0000 7f08c7fff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f08c80ff5f0 0x7f08c8196f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:52838/0 (socket says 172.21.15.76:52838) 2024-06-02T04:48:05.842 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:05.838+0000 7f08c7fff700 1 -- 172.21.15.76:0/104058207 learned_addr learned my addr 172.21.15.76:0/104058207 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:48:05.842 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:05.838+0000 7f08cc9f2700 1 --2- 172.21.15.76:0/104058207 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f08c8101180 0x7f08c819e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:05.842 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:05.838+0000 7f08c77fe700 1 --2- 172.21.15.76:0/104058207 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08c81007e0 0x7f08c81974c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:05.842 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:05.838+0000 7f08c7fff700 1 -- 172.21.15.76:0/104058207 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08c81007e0 msgr2=0x7f08c81974c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:05.843 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:05.838+0000 7f08c7fff700 1 --2- 172.21.15.76:0/104058207 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08c81007e0 0x7f08c81974c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:05.843 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:05.838+0000 7f08c7fff700 1 -- 172.21.15.76:0/104058207 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f08c8101180 msgr2=0x7f08c819e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:05.843 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:05.838+0000 7f08c7fff700 1 --2- 172.21.15.76:0/104058207 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f08c8101180 0x7f08c819e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:05.843 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:05.838+0000 7f08c7fff700 1 -- 172.21.15.76:0/104058207 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08c0009d00 con 0x7f08c80ff5f0 2024-06-02T04:48:05.843 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:05.838+0000 7f08cc9f2700 1 --2- 172.21.15.76:0/104058207 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f08c8101180 0x7f08c819e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:48:05.843 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:05.839+0000 7f08c7fff700 1 --2- 172.21.15.76:0/104058207 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f08c80ff5f0 0x7f08c8196f80 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f08bc00c970 tx=0x7f08bc00cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:05.843 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:05.839+0000 7f08c57fa700 1 -- 172.21.15.76:0/104058207 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08bc004220 con 0x7f08c80ff5f0 2024-06-02T04:48:05.843 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:05.839+0000 7f08c57fa700 1 -- 172.21.15.76:0/104058207 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f08bc007d30 con 0x7f08c80ff5f0 2024-06-02T04:48:05.843 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:05.839+0000 7f08ce455700 1 -- 172.21.15.76:0/104058207 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08c819f060 con 0x7f08c80ff5f0 2024-06-02T04:48:05.843 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:05.839+0000 7f08c57fa700 1 -- 172.21.15.76:0/104058207 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08bc003bf0 con 0x7f08c80ff5f0 2024-06-02T04:48:05.843 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:05.839+0000 7f08ce455700 1 -- 172.21.15.76:0/104058207 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08c819f570 con 0x7f08c80ff5f0 2024-06-02T04:48:05.843 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:05.840+0000 7f08ce455700 1 -- 172.21.15.76:0/104058207 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08c8068140 con 0x7f08c80ff5f0 2024-06-02T04:48:05.844 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:05.841+0000 7f08c57fa700 1 -- 172.21.15.76:0/104058207 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f08bc003d70 con 0x7f08c80ff5f0 2024-06-02T04:48:05.844 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:05.842+0000 7f08c57fa700 1 --2- 172.21.15.76:0/104058207 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f08b00a1120 0x7f08b00a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:05.845 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:05.842+0000 7f08c77fe700 1 --2- 172.21.15.76:0/104058207 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f08b00a1120 0x7f08b00a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:05.845 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:05.842+0000 7f08c57fa700 1 -- 172.21.15.76:0/104058207 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 8698+0+0 (secure 0 0 0) 0x7f08bc0ccb80 con 0x7f08c80ff5f0 2024-06-02T04:48:05.845 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:05.842+0000 7f08c77fe700 1 --2- 172.21.15.76:0/104058207 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f08b00a1120 0x7f08b00a35e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f08b8005950 tx=0x7f08b8005cf0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:05.846 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:05.846+0000 7f08c57fa700 1 -- 172.21.15.76:0/104058207 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f08bc0960e0 con 0x7f08c80ff5f0 2024-06-02T04:48:05.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:05 smithi192 ceph-mon[47933]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-06-02T04:48:05.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:05 smithi192 ceph-mon[47933]: Cluster is now healthy 2024-06-02T04:48:05.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:05 smithi192 ceph-mon[47933]: osdmap e77: 12 total, 12 up, 12 in 2024-06-02T04:48:05.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:05 smithi076 ceph-mon[42935]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-06-02T04:48:05.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:05 smithi076 ceph-mon[42935]: Cluster is now healthy 2024-06-02T04:48:05.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:05 smithi076 ceph-mon[42935]: osdmap e77: 12 total, 12 up, 12 in 2024-06-02T04:48:06.045 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:06.045+0000 7f08ce455700 1 -- 172.21.15.76:0/104058207 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f08c810ad10 con 0x7f08c80ff5f0 2024-06-02T04:48:06.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:05 smithi119 ceph-mon[46633]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-06-02T04:48:06.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:05 smithi119 ceph-mon[46633]: Cluster is now healthy 2024-06-02T04:48:06.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:05 smithi119 ceph-mon[46633]: osdmap e77: 12 total, 12 up, 12 in 2024-06-02T04:48:06.693 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:06.693+0000 7f08c57fa700 1 -- 172.21.15.76:0/104058207 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v79) v1 ==== 169+0+0 (secure 0 0 0) 0x7f08bc01d0c0 con 0x7f08c80ff5f0 2024-06-02T04:48:06.697 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:06.697+0000 7f08ce455700 1 -- 172.21.15.76:0/104058207 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f08b00a1120 msgr2=0x7f08b00a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:06.698 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:06.697+0000 7f08ce455700 1 --2- 172.21.15.76:0/104058207 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f08b00a1120 0x7f08b00a35e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f08b8005950 tx=0x7f08b8005cf0 comp rx=0 tx=0).stop 2024-06-02T04:48:06.698 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:06.697+0000 7f08ce455700 1 -- 172.21.15.76:0/104058207 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f08c80ff5f0 msgr2=0x7f08c8196f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:06.698 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:06.697+0000 7f08ce455700 1 --2- 172.21.15.76:0/104058207 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f08c80ff5f0 0x7f08c8196f80 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f08bc00c970 tx=0x7f08bc00cd30 comp rx=0 tx=0).stop 2024-06-02T04:48:06.698 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:06.697+0000 7f08ce455700 1 -- 172.21.15.76:0/104058207 shutdown_connections 2024-06-02T04:48:06.698 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:06.697+0000 7f08ce455700 1 --2- 172.21.15.76:0/104058207 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f08b00a1120 0x7f08b00a35e0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:06.698 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:06.697+0000 7f08ce455700 1 --2- 172.21.15.76:0/104058207 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f08c8101180 0x7f08c819e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:06.698 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:06.697+0000 7f08ce455700 1 --2- 172.21.15.76:0/104058207 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f08c80ff5f0 0x7f08c8196f80 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:06.698 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:06.697+0000 7f08ce455700 1 --2- 172.21.15.76:0/104058207 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08c81007e0 0x7f08c81974c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:06.698 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:06.697+0000 7f08ce455700 1 -- 172.21.15.76:0/104058207 >> 172.21.15.76:0/104058207 conn(0x7f08c80fab80 msgr2=0x7f08c80fc1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:06.698 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:06.697+0000 7f08ce455700 1 -- 172.21.15.76:0/104058207 shutdown_connections 2024-06-02T04:48:06.699 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:06.698+0000 7f08ce455700 1 -- 172.21.15.76:0/104058207 wait complete. 2024-06-02T04:48:06.707 INFO:teuthology.orchestra.run.smithi076.stderr:set pool 4 allow_ec_overwrites to true 2024-06-02T04:48:06.719 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-06-02T04:48:06.846 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:06.844+0000 7efd177dd700 1 -- 172.21.15.76:0/3496296371 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efd100ff850 msgr2=0x7efd100ffc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:06.850 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:06.844+0000 7efd177dd700 1 --2- 172.21.15.76:0/3496296371 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efd100ff850 0x7efd100ffc70 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7efd000099c0 tx=0x7efd00009cd0 comp rx=0 tx=0).stop 2024-06-02T04:48:06.850 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:06.844+0000 7efd177dd700 1 -- 172.21.15.76:0/3496296371 shutdown_connections 2024-06-02T04:48:06.850 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:06.844+0000 7efd177dd700 1 --2- 172.21.15.76:0/3496296371 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efd10100b70 0x7efd10100ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:06.850 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:06.844+0000 7efd177dd700 1 --2- 172.21.15.76:0/3496296371 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efd100ff850 0x7efd100ffc70 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:06.850 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:06.844+0000 7efd177dd700 1 --2- 172.21.15.76:0/3496296371 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efd101001b0 0x7efd10100630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:06.850 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:06.844+0000 7efd177dd700 1 -- 172.21.15.76:0/3496296371 >> 172.21.15.76:0/3496296371 conn(0x7efd100fb3f0 msgr2=0x7efd100fd830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:06.850 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:06.844+0000 7efd177dd700 1 -- 172.21.15.76:0/3496296371 shutdown_connections 2024-06-02T04:48:06.850 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:06.844+0000 7efd177dd700 1 -- 172.21.15.76:0/3496296371 wait complete. 2024-06-02T04:48:06.851 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:06.845+0000 7efd177dd700 1 Processor -- start 2024-06-02T04:48:06.851 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:06.845+0000 7efd177dd700 1 -- start start 2024-06-02T04:48:06.851 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:06.845+0000 7efd177dd700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efd100ff850 0x7efd10199020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:06.851 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:06.845+0000 7efd177dd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efd101001b0 0x7efd10199560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:06.851 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:06.845+0000 7efd177dd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efd10100b70 0x7efd101a0580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:06.851 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:06.845+0000 7efd177dd700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd101a0b50 con 0x7efd101001b0 2024-06-02T04:48:06.851 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:06.845+0000 7efd177dd700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd101a0c90 con 0x7efd100ff850 2024-06-02T04:48:06.851 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:06.845+0000 7efd177dd700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd101a0e20 con 0x7efd10100b70 2024-06-02T04:48:06.851 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:06.845+0000 7efd14d78700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efd101001b0 0x7efd10199560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:06.851 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:06.845+0000 7efd14d78700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efd101001b0 0x7efd10199560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:52858/0 (socket says 172.21.15.76:52858) 2024-06-02T04:48:06.851 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:06.845+0000 7efd14d78700 1 -- 172.21.15.76:0/3199159614 learned_addr learned my addr 172.21.15.76:0/3199159614 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:48:06.851 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:06.845+0000 7efd15d7a700 1 --2- 172.21.15.76:0/3199159614 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efd10100b70 0x7efd101a0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:06.851 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:06.845+0000 7efd15579700 1 --2- 172.21.15.76:0/3199159614 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efd100ff850 0x7efd10199020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:06.852 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:06.845+0000 7efd14d78700 1 -- 172.21.15.76:0/3199159614 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efd10100b70 msgr2=0x7efd101a0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:06.852 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:06.845+0000 7efd14d78700 1 --2- 172.21.15.76:0/3199159614 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efd10100b70 0x7efd101a0580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:06.852 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:06.845+0000 7efd14d78700 1 -- 172.21.15.76:0/3199159614 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efd100ff850 msgr2=0x7efd10199020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:06.852 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:06.845+0000 7efd14d78700 1 --2- 172.21.15.76:0/3199159614 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efd100ff850 0x7efd10199020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:06.852 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:06.845+0000 7efd14d78700 1 -- 172.21.15.76:0/3199159614 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd000095f0 con 0x7efd101001b0 2024-06-02T04:48:06.852 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:06.845+0000 7efd15579700 1 --2- 172.21.15.76:0/3199159614 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efd100ff850 0x7efd10199020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:48:06.852 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:06.845+0000 7efd14d78700 1 --2- 172.21.15.76:0/3199159614 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efd101001b0 0x7efd10199560 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7efd0c00d950 tx=0x7efd0c00dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:06.852 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:06.846+0000 7efd067fc700 1 -- 172.21.15.76:0/3199159614 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd0c009b40 con 0x7efd101001b0 2024-06-02T04:48:06.852 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:06.846+0000 7efd177dd700 1 -- 172.21.15.76:0/3199159614 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd101a1100 con 0x7efd101001b0 2024-06-02T04:48:06.852 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:06.846+0000 7efd067fc700 1 -- 172.21.15.76:0/3199159614 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efd0c009ca0 con 0x7efd101001b0 2024-06-02T04:48:06.852 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:06.846+0000 7efd067fc700 1 -- 172.21.15.76:0/3199159614 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd0c00f620 con 0x7efd101001b0 2024-06-02T04:48:06.852 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:06.846+0000 7efd177dd700 1 -- 172.21.15.76:0/3199159614 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd101a1660 con 0x7efd101001b0 2024-06-02T04:48:06.853 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:06.847+0000 7efd177dd700 1 -- 172.21.15.76:0/3199159614 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd1010a910 con 0x7efd101001b0 2024-06-02T04:48:06.853 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:06.848+0000 7efd067fc700 1 -- 172.21.15.76:0/3199159614 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7efd0c010460 con 0x7efd101001b0 2024-06-02T04:48:06.853 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:06.848+0000 7efd067fc700 1 --2- 172.21.15.76:0/3199159614 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7efcfc0a1120 0x7efcfc0a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:06.854 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:06.848+0000 7efd067fc700 1 -- 172.21.15.76:0/3199159614 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 8698+0+0 (secure 0 0 0) 0x7efd0c0cce20 con 0x7efd101001b0 2024-06-02T04:48:06.854 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:06.848+0000 7efd15579700 1 --2- 172.21.15.76:0/3199159614 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7efcfc0a1120 0x7efcfc0a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:06.854 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:06.849+0000 7efd15579700 1 --2- 172.21.15.76:0/3199159614 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7efcfc0a1120 0x7efcfc0a35e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7efd00003780 tx=0x7efd00000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:06.854 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:06.853+0000 7efd067fc700 1 -- 172.21.15.76:0/3199159614 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7efd0c0963e0 con 0x7efd101001b0 2024-06-02T04:48:06.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:06 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/1061580924' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-06-02T04:48:06.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:06 smithi076 ceph-mon[42935]: osdmap e78: 12 total, 12 up, 12 in 2024-06-02T04:48:06.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:06 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/104058207' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-06-02T04:48:06.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:06 smithi076 ceph-mon[42935]: pgmap v218: 129 pgs: 25 creating+peering, 62 unknown, 42 active+clean; 578 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 788 B/s wr, 3 op/s 2024-06-02T04:48:07.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:06 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/1061580924' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-06-02T04:48:07.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:06 smithi119 ceph-mon[46633]: osdmap e78: 12 total, 12 up, 12 in 2024-06-02T04:48:07.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:06 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/104058207' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-06-02T04:48:07.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:06 smithi119 ceph-mon[46633]: pgmap v218: 129 pgs: 25 creating+peering, 62 unknown, 42 active+clean; 578 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 788 B/s wr, 3 op/s 2024-06-02T04:48:07.100 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.099+0000 7efd177dd700 1 -- 172.21.15.76:0/3199159614 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7efd1010ea20 con 0x7efd101001b0 2024-06-02T04:48:07.105 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.105+0000 7efd067fc700 1 -- 172.21.15.76:0/3199159614 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v17) v1 ==== 137+0+0 (secure 0 0 0) 0x7efd0c0200b0 con 0x7efd101001b0 2024-06-02T04:48:07.108 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.107+0000 7efd177dd700 1 -- 172.21.15.76:0/3199159614 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7efcfc0a1120 msgr2=0x7efcfc0a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:07.108 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.107+0000 7efd177dd700 1 --2- 172.21.15.76:0/3199159614 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7efcfc0a1120 0x7efcfc0a35e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7efd00003780 tx=0x7efd00000bc0 comp rx=0 tx=0).stop 2024-06-02T04:48:07.108 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.107+0000 7efd177dd700 1 -- 172.21.15.76:0/3199159614 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efd101001b0 msgr2=0x7efd10199560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:07.108 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.107+0000 7efd177dd700 1 --2- 172.21.15.76:0/3199159614 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efd101001b0 0x7efd10199560 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7efd0c00d950 tx=0x7efd0c00dd10 comp rx=0 tx=0).stop 2024-06-02T04:48:07.108 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.107+0000 7efd177dd700 1 -- 172.21.15.76:0/3199159614 shutdown_connections 2024-06-02T04:48:07.108 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.107+0000 7efd177dd700 1 --2- 172.21.15.76:0/3199159614 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efd10100b70 0x7efd101a0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:07.108 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.107+0000 7efd177dd700 1 --2- 172.21.15.76:0/3199159614 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7efcfc0a1120 0x7efcfc0a35e0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:07.108 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.107+0000 7efd177dd700 1 --2- 172.21.15.76:0/3199159614 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efd100ff850 0x7efd10199020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:07.108 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.107+0000 7efd177dd700 1 --2- 172.21.15.76:0/3199159614 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efd101001b0 0x7efd10199560 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:07.108 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.107+0000 7efd177dd700 1 -- 172.21.15.76:0/3199159614 >> 172.21.15.76:0/3199159614 conn(0x7efd100fb3f0 msgr2=0x7efd100fcc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:07.108 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.107+0000 7efd177dd700 1 -- 172.21.15.76:0/3199159614 shutdown_connections 2024-06-02T04:48:07.109 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.107+0000 7efd177dd700 1 -- 172.21.15.76:0/3199159614 wait complete. 2024-06-02T04:48:07.109 INFO:teuthology.orchestra.run.smithi076.stderr:added data pool 4 to fsmap 2024-06-02T04:48:07.121 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T04:48:07.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:06 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/1061580924' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-06-02T04:48:07.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:06 smithi192 ceph-mon[47933]: osdmap e78: 12 total, 12 up, 12 in 2024-06-02T04:48:07.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:06 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/104058207' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-06-02T04:48:07.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:06 smithi192 ceph-mon[47933]: pgmap v218: 129 pgs: 25 creating+peering, 62 unknown, 42 active+clean; 578 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 788 B/s wr, 3 op/s 2024-06-02T04:48:07.245 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.244+0000 7f8f3e390700 1 -- 172.21.15.76:0/1342818140 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8f381029a0 msgr2=0x7f8f381092c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:07.245 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.244+0000 7f8f3e390700 1 --2- 172.21.15.76:0/1342818140 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8f381029a0 0x7f8f381092c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f8f3000b0a0 tx=0x7f8f3000b3b0 comp rx=0 tx=0).stop 2024-06-02T04:48:07.245 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.244+0000 7f8f3e390700 1 -- 172.21.15.76:0/1342818140 shutdown_connections 2024-06-02T04:48:07.245 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.244+0000 7f8f3e390700 1 --2- 172.21.15.76:0/1342818140 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8f381029a0 0x7f8f381092c0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:07.245 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.244+0000 7f8f3e390700 1 --2- 172.21.15.76:0/1342818140 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8f38100e90 0x7f8f381012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:07.245 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.244+0000 7f8f3e390700 1 --2- 172.21.15.76:0/1342818140 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8f38101fe0 0x7f8f38102460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:07.245 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.244+0000 7f8f3e390700 1 -- 172.21.15.76:0/1342818140 >> 172.21.15.76:0/1342818140 conn(0x7f8f380fc400 msgr2=0x7f8f380fe840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:07.245 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.244+0000 7f8f3e390700 1 -- 172.21.15.76:0/1342818140 shutdown_connections 2024-06-02T04:48:07.245 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.244+0000 7f8f3e390700 1 -- 172.21.15.76:0/1342818140 wait complete. 2024-06-02T04:48:07.246 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.245+0000 7f8f3e390700 1 Processor -- start 2024-06-02T04:48:07.246 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.245+0000 7f8f3e390700 1 -- start start 2024-06-02T04:48:07.247 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.245+0000 7f8f3e390700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8f38100e90 0x7f8f38196d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:07.248 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.245+0000 7f8f3e390700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8f38101fe0 0x7f8f38197250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:07.248 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.245+0000 7f8f3e390700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8f381029a0 0x7f8f3819e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:07.248 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.245+0000 7f8f3e390700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f3819e830 con 0x7f8f38100e90 2024-06-02T04:48:07.248 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.245+0000 7f8f3e390700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f3819e9a0 con 0x7f8f38101fe0 2024-06-02T04:48:07.248 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.245+0000 7f8f3e390700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f3819eb60 con 0x7f8f381029a0 2024-06-02T04:48:07.248 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.245+0000 7f8f37fff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8f38100e90 0x7f8f38196d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:07.248 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.245+0000 7f8f37fff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8f38100e90 0x7f8f38196d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:52876/0 (socket says 172.21.15.76:52876) 2024-06-02T04:48:07.248 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.245+0000 7f8f37fff700 1 -- 172.21.15.76:0/421864100 learned_addr learned my addr 172.21.15.76:0/421864100 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:48:07.248 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.246+0000 7f8f3c92d700 1 --2- 172.21.15.76:0/421864100 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8f381029a0 0x7f8f3819e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:07.248 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.246+0000 7f8f37fff700 1 -- 172.21.15.76:0/421864100 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8f381029a0 msgr2=0x7f8f3819e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:07.248 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.246+0000 7f8f37fff700 1 --2- 172.21.15.76:0/421864100 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8f381029a0 0x7f8f3819e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:07.248 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.246+0000 7f8f37fff700 1 -- 172.21.15.76:0/421864100 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8f38101fe0 msgr2=0x7f8f38197250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:07.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.246+0000 7f8f37fff700 1 --2- 172.21.15.76:0/421864100 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8f38101fe0 0x7f8f38197250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:07.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.246+0000 7f8f37fff700 1 -- 172.21.15.76:0/421864100 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f30009d00 con 0x7f8f38100e90 2024-06-02T04:48:07.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.246+0000 7f8f37fff700 1 --2- 172.21.15.76:0/421864100 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8f38100e90 0x7f8f38196d10 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f8f2800c9b0 tx=0x7f8f2800cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:07.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.246+0000 7f8f357fa700 1 -- 172.21.15.76:0/421864100 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f28007b00 con 0x7f8f38100e90 2024-06-02T04:48:07.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.246+0000 7f8f3e390700 1 -- 172.21.15.76:0/421864100 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f3819ee40 con 0x7f8f38100e90 2024-06-02T04:48:07.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.246+0000 7f8f357fa700 1 -- 172.21.15.76:0/421864100 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8f28007c60 con 0x7f8f38100e90 2024-06-02T04:48:07.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.246+0000 7f8f357fa700 1 -- 172.21.15.76:0/421864100 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f28018660 con 0x7f8f38100e90 2024-06-02T04:48:07.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.246+0000 7f8f3e390700 1 -- 172.21.15.76:0/421864100 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f3819f2c0 con 0x7f8f38100e90 2024-06-02T04:48:07.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.247+0000 7f8f3e390700 1 -- 172.21.15.76:0/421864100 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f381081d0 con 0x7f8f38100e90 2024-06-02T04:48:07.250 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.248+0000 7f8f357fa700 1 -- 172.21.15.76:0/421864100 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f8f2800f450 con 0x7f8f38100e90 2024-06-02T04:48:07.250 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.249+0000 7f8f357fa700 1 --2- 172.21.15.76:0/421864100 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f8f200a1120 0x7f8f200a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:07.250 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.249+0000 7f8f377fe700 1 --2- 172.21.15.76:0/421864100 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f8f200a1120 0x7f8f200a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:07.250 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.249+0000 7f8f357fa700 1 -- 172.21.15.76:0/421864100 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f8f280ccdf0 con 0x7f8f38100e90 2024-06-02T04:48:07.250 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.249+0000 7f8f377fe700 1 --2- 172.21.15.76:0/421864100 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f8f200a1120 0x7f8f200a35e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c005fd0 tx=0x7f8f2c005d00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:07.253 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.253+0000 7f8f357fa700 1 -- 172.21.15.76:0/421864100 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f8f28096400 con 0x7f8f38100e90 2024-06-02T04:48:07.498 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.498+0000 7f8f3e390700 1 -- 172.21.15.76:0/421864100 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8f3810c870 con 0x7f8f38100e90 2024-06-02T04:48:07.498 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.498+0000 7f8f357fa700 1 -- 172.21.15.76:0/421864100 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+10813 (secure 0 0 0) 0x7f8f3810c870 con 0x7f8f38100e90 2024-06-02T04:48:07.499 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:48:07.499 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6835/3029342152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3029342152},{"type":"v1","addr":"172.21.15.76:6835","nonce":3029342152}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6837/1207985317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":1207985317},{"type":"v1","addr":"172.21.15.76:6837","nonce":1207985317}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14607,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6839/928709755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":928709755},{"type":"v1","addr":"172.21.15.76:6839","nonce":928709755}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6841/4162178633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6840","nonce":4162178633},{"type":"v1","addr":"172.21.15.76:6841","nonce":4162178633}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/1543944863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":1543944863},{"type":"v1","addr":"172.21.15.119:6833","nonce":1543944863}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24418,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6833/1527921393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1527921393},{"type":"v1","addr":"172.21.15.192:6833","nonce":1527921393}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24434,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/2746840347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":2746840347},{"type":"v1","addr":"172.21.15.119:6835","nonce":2746840347}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24451,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/783181340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":783181340},{"type":"v1","addr":"172.21.15.192:6835","nonce":783181340}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24458,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/2171687478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":2171687478},{"type":"v1","addr":"172.21.15.119:6837","nonce":2171687478}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24463,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/960773710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":960773710},{"type":"v1","addr":"172.21.15.192:6837","nonce":960773710}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24475,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/3978681402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":3978681402},{"type":"v1","addr":"172.21.15.192:6839","nonce":3978681402}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-02T04:48:02.662812+0000","modified":"2024-06-02T04:48:07.101678+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24491},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.119:6839/4098406903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":4098406903},{"type":"v1","addr":"172.21.15.119:6839","nonce":4098406903}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-06-02T04:48:07.501 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.501+0000 7f8f3e390700 1 -- 172.21.15.76:0/421864100 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f8f200a1120 msgr2=0x7f8f200a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:07.501 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.501+0000 7f8f3e390700 1 --2- 172.21.15.76:0/421864100 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f8f200a1120 0x7f8f200a35e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c005fd0 tx=0x7f8f2c005d00 comp rx=0 tx=0).stop 2024-06-02T04:48:07.501 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.501+0000 7f8f3e390700 1 -- 172.21.15.76:0/421864100 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8f38100e90 msgr2=0x7f8f38196d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:07.501 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.501+0000 7f8f3e390700 1 --2- 172.21.15.76:0/421864100 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8f38100e90 0x7f8f38196d10 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f8f2800c9b0 tx=0x7f8f2800cd70 comp rx=0 tx=0).stop 2024-06-02T04:48:07.502 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.501+0000 7f8f3e390700 1 -- 172.21.15.76:0/421864100 shutdown_connections 2024-06-02T04:48:07.502 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.501+0000 7f8f3e390700 1 --2- 172.21.15.76:0/421864100 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8f381029a0 0x7f8f3819e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:07.502 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.501+0000 7f8f3e390700 1 --2- 172.21.15.76:0/421864100 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8f38100e90 0x7f8f38196d10 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:07.502 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.501+0000 7f8f3e390700 1 --2- 172.21.15.76:0/421864100 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f8f200a1120 0x7f8f200a35e0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:07.502 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.501+0000 7f8f3e390700 1 --2- 172.21.15.76:0/421864100 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8f38101fe0 0x7f8f38197250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:07.502 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.501+0000 7f8f3e390700 1 -- 172.21.15.76:0/421864100 >> 172.21.15.76:0/421864100 conn(0x7f8f380fc400 msgr2=0x7f8f38105310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:07.502 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.501+0000 7f8f3e390700 1 -- 172.21.15.76:0/421864100 shutdown_connections 2024-06-02T04:48:07.502 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.501+0000 7f8f3e390700 1 -- 172.21.15.76:0/421864100 wait complete. 2024-06-02T04:48:07.503 INFO:teuthology.orchestra.run.smithi076.stderr:dumped fsmap epoch 17 2024-06-02T04:48:07.514 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-02T04:48:07.636 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.635+0000 7fa5d9bbd700 1 -- 172.21.15.76:0/774843286 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa5d4101990 msgr2=0x7fa5d4108220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:07.636 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.635+0000 7fa5d9bbd700 1 --2- 172.21.15.76:0/774843286 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa5d4101990 0x7fa5d4108220 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa5cc00b0a0 tx=0x7fa5cc00b3b0 comp rx=0 tx=0).stop 2024-06-02T04:48:07.636 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.635+0000 7fa5d9bbd700 1 -- 172.21.15.76:0/774843286 shutdown_connections 2024-06-02T04:48:07.636 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.635+0000 7fa5d9bbd700 1 --2- 172.21.15.76:0/774843286 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa5d4101990 0x7fa5d4108220 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:07.636 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.635+0000 7fa5d9bbd700 1 --2- 172.21.15.76:0/774843286 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa5d41002c0 0x7fa5d41006e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:07.636 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.635+0000 7fa5d9bbd700 1 --2- 172.21.15.76:0/774843286 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa5d4100fd0 0x7fa5d4101450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:07.637 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.636+0000 7fa5d9bbd700 1 -- 172.21.15.76:0/774843286 >> 172.21.15.76:0/774843286 conn(0x7fa5d40faab0 msgr2=0x7fa5d40fced0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:07.637 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.636+0000 7fa5d9bbd700 1 -- 172.21.15.76:0/774843286 shutdown_connections 2024-06-02T04:48:07.637 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.636+0000 7fa5d9bbd700 1 -- 172.21.15.76:0/774843286 wait complete. 2024-06-02T04:48:07.637 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.636+0000 7fa5d9bbd700 1 Processor -- start 2024-06-02T04:48:07.639 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.636+0000 7fa5d9bbd700 1 -- start start 2024-06-02T04:48:07.639 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.636+0000 7fa5d9bbd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa5d41002c0 0x7fa5d4195cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:07.639 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.636+0000 7fa5d9bbd700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa5d4100fd0 0x7fa5d4196230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:07.639 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.636+0000 7fa5d9bbd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa5d4101990 0x7fa5d419d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:07.639 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.636+0000 7fa5d9bbd700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d419d810 con 0x7fa5d41002c0 2024-06-02T04:48:07.639 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.636+0000 7fa5d9bbd700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d419d980 con 0x7fa5d4100fd0 2024-06-02T04:48:07.639 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.636+0000 7fa5d9bbd700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d419db40 con 0x7fa5d4101990 2024-06-02T04:48:07.639 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.637+0000 7fa5d37fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa5d41002c0 0x7fa5d4195cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:07.640 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.637+0000 7fa5d37fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa5d41002c0 0x7fa5d4195cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:52892/0 (socket says 172.21.15.76:52892) 2024-06-02T04:48:07.640 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.637+0000 7fa5d37fe700 1 -- 172.21.15.76:0/2604113958 learned_addr learned my addr 172.21.15.76:0/2604113958 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:48:07.640 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.637+0000 7fa5d2ffd700 1 --2- 172.21.15.76:0/2604113958 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa5d4100fd0 0x7fa5d4196230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:07.640 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.637+0000 7fa5d3fff700 1 --2- 172.21.15.76:0/2604113958 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa5d4101990 0x7fa5d419d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:07.640 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.637+0000 7fa5d37fe700 1 -- 172.21.15.76:0/2604113958 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa5d4101990 msgr2=0x7fa5d419d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:07.640 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.637+0000 7fa5d37fe700 1 --2- 172.21.15.76:0/2604113958 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa5d4101990 0x7fa5d419d240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:07.640 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.637+0000 7fa5d37fe700 1 -- 172.21.15.76:0/2604113958 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa5d4100fd0 msgr2=0x7fa5d4196230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:07.640 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.637+0000 7fa5d37fe700 1 --2- 172.21.15.76:0/2604113958 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa5d4100fd0 0x7fa5d4196230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:07.640 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.637+0000 7fa5d37fe700 1 -- 172.21.15.76:0/2604113958 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5cc009d00 con 0x7fa5d41002c0 2024-06-02T04:48:07.640 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.637+0000 7fa5d37fe700 1 --2- 172.21.15.76:0/2604113958 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa5d41002c0 0x7fa5d4195cf0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa5c400d980 tx=0x7fa5c400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:07.640 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.637+0000 7fa5d0ff9700 1 -- 172.21.15.76:0/2604113958 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c4004020 con 0x7fa5d41002c0 2024-06-02T04:48:07.640 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.637+0000 7fa5d0ff9700 1 -- 172.21.15.76:0/2604113958 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa5c4009730 con 0x7fa5d41002c0 2024-06-02T04:48:07.641 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.637+0000 7fa5d9bbd700 1 -- 172.21.15.76:0/2604113958 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5d419de20 con 0x7fa5d41002c0 2024-06-02T04:48:07.641 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.637+0000 7fa5d0ff9700 1 -- 172.21.15.76:0/2604113958 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c4003a00 con 0x7fa5d41002c0 2024-06-02T04:48:07.641 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.637+0000 7fa5d9bbd700 1 -- 172.21.15.76:0/2604113958 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5d419e240 con 0x7fa5d41002c0 2024-06-02T04:48:07.641 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.638+0000 7fa5d9bbd700 1 -- 172.21.15.76:0/2604113958 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5d4107210 con 0x7fa5d41002c0 2024-06-02T04:48:07.642 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.639+0000 7fa5d0ff9700 1 -- 172.21.15.76:0/2604113958 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fa5c40098a0 con 0x7fa5d41002c0 2024-06-02T04:48:07.642 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.640+0000 7fa5d0ff9700 1 --2- 172.21.15.76:0/2604113958 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fa5bc0a1120 0x7fa5bc0a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:07.642 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.640+0000 7fa5d2ffd700 1 --2- 172.21.15.76:0/2604113958 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fa5bc0a1120 0x7fa5bc0a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:07.642 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.640+0000 7fa5d0ff9700 1 -- 172.21.15.76:0/2604113958 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fa5c40ccb80 con 0x7fa5d41002c0 2024-06-02T04:48:07.642 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.640+0000 7fa5d2ffd700 1 --2- 172.21.15.76:0/2604113958 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fa5bc0a1120 0x7fa5bc0a35e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa5d41971a0 tx=0x7fa5c8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:07.643 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.643+0000 7fa5d0ff9700 1 -- 172.21.15.76:0/2604113958 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fa5c40960c0 con 0x7fa5d41002c0 2024-06-02T04:48:07.843 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.843+0000 7fa5d9bbd700 1 -- 172.21.15.76:0/2604113958 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa5d410b4b0 con 0x7fa5d41002c0 2024-06-02T04:48:07.845 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.845+0000 7fa5d0ff9700 1 -- 172.21.15.76:0/2604113958 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+23984 (secure 0 0 0) 0x7fa5c40996e0 con 0x7fa5d41002c0 2024-06-02T04:48:07.845 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:48:07.845 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":80,"fsid":"60ab6d30-209a-11ef-bc9b-c7b262605968","created":"2024-06-02T04:42:21.007333+0000","modified":"2024-06-02T04:48:07.101373+0000","last_up_change":"2024-06-02T04:47:29.822242+0000","last_in_change":"2024-06-02T04:47:14.253449+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T04:44:56.408602+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-02T04:48:01.194954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-02T04:48:01.828863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-02T04:48:04.916565+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"33a51ba2-be5c-41d0-b5d1-8d6039f2ca4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6802","nonce":2869602045},{"type":"v1","addr":"172.21.15.76:6803","nonce":2869602045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6804","nonce":2869602045},{"type":"v1","addr":"172.21.15.76:6805","nonce":2869602045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6808","nonce":2869602045},{"type":"v1","addr":"172.21.15.76:6809","nonce":2869602045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6806","nonce":2869602045},{"type":"v1","addr":"172.21.15.76:6807","nonce":2869602045}]},"public_addr":"172.21.15.76:6803/2869602045","cluster_addr":"172.21.15.76:6805/2869602045","heartbeat_back_addr":"172.21.15.76:6809/2869602045","heartbeat_front_addr":"172.21.15.76:6807/2869602045","state":["exists","up"]},{"osd":1,"uuid":"ace46e13-3bb7-4103-973a-6860554df8b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":2353738098},{"type":"v1","addr":"172.21.15.119:6801","nonce":2353738098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":2353738098},{"type":"v1","addr":"172.21.15.119:6803","nonce":2353738098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":2353738098},{"type":"v1","addr":"172.21.15.119:6807","nonce":2353738098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":2353738098},{"type":"v1","addr":"172.21.15.119:6805","nonce":2353738098}]},"public_addr":"172.21.15.119:6801/2353738098","cluster_addr":"172.21.15.119:6803/2353738098","heartbeat_back_addr":"172.21.15.119:6807/2353738098","heartbeat_front_addr":"172.21.15.119:6805/2353738098","state":["exists","up"]},{"osd":2,"uuid":"4addc09e-77a9-428a-bcc4-38194f486cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":3206918546},{"type":"v1","addr":"172.21.15.192:6801","nonce":3206918546}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":3206918546},{"type":"v1","addr":"172.21.15.192:6803","nonce":3206918546}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":3206918546},{"type":"v1","addr":"172.21.15.192:6807","nonce":3206918546}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":3206918546},{"type":"v1","addr":"172.21.15.192:6805","nonce":3206918546}]},"public_addr":"172.21.15.192:6801/3206918546","cluster_addr":"172.21.15.192:6803/3206918546","heartbeat_back_addr":"172.21.15.192:6807/3206918546","heartbeat_front_addr":"172.21.15.192:6805/3206918546","state":["exists","up"]},{"osd":3,"uuid":"dc525518-82c6-49ed-8ca8-e3bd5bfc18d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6810","nonce":3747864233},{"type":"v1","addr":"172.21.15.76:6811","nonce":3747864233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6812","nonce":3747864233},{"type":"v1","addr":"172.21.15.76:6813","nonce":3747864233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6816","nonce":3747864233},{"type":"v1","addr":"172.21.15.76:6817","nonce":3747864233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6814","nonce":3747864233},{"type":"v1","addr":"172.21.15.76:6815","nonce":3747864233}]},"public_addr":"172.21.15.76:6811/3747864233","cluster_addr":"172.21.15.76:6813/3747864233","heartbeat_back_addr":"172.21.15.76:6817/3747864233","heartbeat_front_addr":"172.21.15.76:6815/3747864233","state":["exists","up"]},{"osd":4,"uuid":"eef293d0-cb87-47b3-9751-c6437a1cf079","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":2571629047},{"type":"v1","addr":"172.21.15.119:6809","nonce":2571629047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":2571629047},{"type":"v1","addr":"172.21.15.119:6811","nonce":2571629047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":2571629047},{"type":"v1","addr":"172.21.15.119:6815","nonce":2571629047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":2571629047},{"type":"v1","addr":"172.21.15.119:6813","nonce":2571629047}]},"public_addr":"172.21.15.119:6809/2571629047","cluster_addr":"172.21.15.119:6811/2571629047","heartbeat_back_addr":"172.21.15.119:6815/2571629047","heartbeat_front_addr":"172.21.15.119:6813/2571629047","state":["exists","up"]},{"osd":5,"uuid":"60eb8c6e-766c-49d0-9997-44f85776b3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3285065416},{"type":"v1","addr":"172.21.15.192:6809","nonce":3285065416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":3285065416},{"type":"v1","addr":"172.21.15.192:6811","nonce":3285065416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3285065416},{"type":"v1","addr":"172.21.15.192:6815","nonce":3285065416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":3285065416},{"type":"v1","addr":"172.21.15.192:6813","nonce":3285065416}]},"public_addr":"172.21.15.192:6809/3285065416","cluster_addr":"172.21.15.192:6811/3285065416","heartbeat_back_addr":"172.21.15.192:6815/3285065416","heartbeat_front_addr":"172.21.15.192:6813/3285065416","state":["exists","up"]},{"osd":6,"uuid":"e6dc8b9d-dd06-4870-a506-def8201b7e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6818","nonce":2951381580},{"type":"v1","addr":"172.21.15.76:6819","nonce":2951381580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6820","nonce":2951381580},{"type":"v1","addr":"172.21.15.76:6821","nonce":2951381580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6824","nonce":2951381580},{"type":"v1","addr":"172.21.15.76:6825","nonce":2951381580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6822","nonce":2951381580},{"type":"v1","addr":"172.21.15.76:6823","nonce":2951381580}]},"public_addr":"172.21.15.76:6819/2951381580","cluster_addr":"172.21.15.76:6821/2951381580","heartbeat_back_addr":"172.21.15.76:6825/2951381580","heartbeat_front_addr":"172.21.15.76:6823/2951381580","state":["exists","up"]},{"osd":7,"uuid":"2f5dccb3-39a1-4f25-8715-fa264d59db97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1802558756},{"type":"v1","addr":"172.21.15.119:6817","nonce":1802558756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1802558756},{"type":"v1","addr":"172.21.15.119:6819","nonce":1802558756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1802558756},{"type":"v1","addr":"172.21.15.119:6823","nonce":1802558756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1802558756},{"type":"v1","addr":"172.21.15.119:6821","nonce":1802558756}]},"public_addr":"172.21.15.119:6817/1802558756","cluster_addr":"172.21.15.119:6819/1802558756","heartbeat_back_addr":"172.21.15.119:6823/1802558756","heartbeat_front_addr":"172.21.15.119:6821/1802558756","state":["exists","up"]},{"osd":8,"uuid":"39b6ccd0-16e7-4cd5-87e0-d827e9172984","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":1214972276},{"type":"v1","addr":"172.21.15.192:6817","nonce":1214972276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":1214972276},{"type":"v1","addr":"172.21.15.192:6819","nonce":1214972276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":1214972276},{"type":"v1","addr":"172.21.15.192:6823","nonce":1214972276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":1214972276},{"type":"v1","addr":"172.21.15.192:6821","nonce":1214972276}]},"public_addr":"172.21.15.192:6817/1214972276","cluster_addr":"172.21.15.192:6819/1214972276","heartbeat_back_addr":"172.21.15.192:6823/1214972276","heartbeat_front_addr":"172.21.15.192:6821/1214972276","state":["exists","up"]},{"osd":9,"uuid":"851b2155-07bd-45de-bfe0-53021fda733f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6826","nonce":3095501821},{"type":"v1","addr":"172.21.15.76:6827","nonce":3095501821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6828","nonce":3095501821},{"type":"v1","addr":"172.21.15.76:6829","nonce":3095501821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":3095501821},{"type":"v1","addr":"172.21.15.76:6833","nonce":3095501821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6830","nonce":3095501821},{"type":"v1","addr":"172.21.15.76:6831","nonce":3095501821}]},"public_addr":"172.21.15.76:6827/3095501821","cluster_addr":"172.21.15.76:6829/3095501821","heartbeat_back_addr":"172.21.15.76:6833/3095501821","heartbeat_front_addr":"172.21.15.76:6831/3095501821","state":["exists","up"]},{"osd":10,"uuid":"e4b18e7e-bddf-4dd4-84f6-7902ea327cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":4082130894},{"type":"v1","addr":"172.21.15.119:6825","nonce":4082130894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":4082130894},{"type":"v1","addr":"172.21.15.119:6827","nonce":4082130894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":4082130894},{"type":"v1","addr":"172.21.15.119:6831","nonce":4082130894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":4082130894},{"type":"v1","addr":"172.21.15.119:6829","nonce":4082130894}]},"public_addr":"172.21.15.119:6825/4082130894","cluster_addr":"172.21.15.119:6827/4082130894","heartbeat_back_addr":"172.21.15.119:6831/4082130894","heartbeat_front_addr":"172.21.15.119:6829/4082130894","state":["exists","up"]},{"osd":11,"uuid":"54567e18-920c-4ae9-9557-0efba5a1a820","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":439693921},{"type":"v1","addr":"172.21.15.192:6825","nonce":439693921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":439693921},{"type":"v1","addr":"172.21.15.192:6827","nonce":439693921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":439693921},{"type":"v1","addr":"172.21.15.192:6831","nonce":439693921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":439693921},{"type":"v1","addr":"172.21.15.192:6829","nonce":439693921}]},"public_addr":"172.21.15.192:6825/439693921","cluster_addr":"172.21.15.192:6827/439693921","heartbeat_back_addr":"172.21.15.192:6831/439693921","heartbeat_front_addr":"172.21.15.192:6829/439693921","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:44:19.922390+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:44:36.895563+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:44:53.699019+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:45:11.167404+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:45:27.955899+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:45:44.850368+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:46:02.003588+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:46:19.019217+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:46:36.189670+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:46:53.919365+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:47:11.563053+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:47:28.822443+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.76:6801/4200406736":"2024-06-03T04:43:06.092916+0000","172.21.15.76:6800/4200406736":"2024-06-03T04:43:06.092916+0000","172.21.15.76:0/1524144593":"2024-06-03T04:43:06.092916+0000","172.21.15.76:0/3269372590":"2024-06-03T04:43:06.092916+0000","172.21.15.76:0/3570893846":"2024-06-03T04:42:44.872236+0000","172.21.15.76:0/902035790":"2024-06-03T04:43:06.092916+0000","172.21.15.76:6800/2550846765":"2024-06-03T04:42:44.872236+0000","172.21.15.76:6801/2550846765":"2024-06-03T04:42:44.872236+0000","172.21.15.76:0/2646712763":"2024-06-03T04:42:44.872236+0000","172.21.15.76:0/964578813":"2024-06-03T04:42:44.872236+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T04:48:07.847 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.847+0000 7fa5d9bbd700 1 -- 172.21.15.76:0/2604113958 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fa5bc0a1120 msgr2=0x7fa5bc0a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:07.847 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.847+0000 7fa5d9bbd700 1 --2- 172.21.15.76:0/2604113958 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fa5bc0a1120 0x7fa5bc0a35e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa5d41971a0 tx=0x7fa5c8009260 comp rx=0 tx=0).stop 2024-06-02T04:48:07.847 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.847+0000 7fa5d9bbd700 1 -- 172.21.15.76:0/2604113958 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa5d41002c0 msgr2=0x7fa5d4195cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:07.847 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.847+0000 7fa5d9bbd700 1 --2- 172.21.15.76:0/2604113958 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa5d41002c0 0x7fa5d4195cf0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa5c400d980 tx=0x7fa5c400dc90 comp rx=0 tx=0).stop 2024-06-02T04:48:07.847 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.847+0000 7fa5d9bbd700 1 -- 172.21.15.76:0/2604113958 shutdown_connections 2024-06-02T04:48:07.848 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.847+0000 7fa5d9bbd700 1 --2- 172.21.15.76:0/2604113958 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa5d4101990 0x7fa5d419d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:07.848 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.847+0000 7fa5d9bbd700 1 --2- 172.21.15.76:0/2604113958 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa5d41002c0 0x7fa5d4195cf0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:07.848 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.847+0000 7fa5d9bbd700 1 --2- 172.21.15.76:0/2604113958 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fa5bc0a1120 0x7fa5bc0a35e0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:07.848 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.847+0000 7fa5d9bbd700 1 --2- 172.21.15.76:0/2604113958 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa5d4100fd0 0x7fa5d4196230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:07.848 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.847+0000 7fa5d9bbd700 1 -- 172.21.15.76:0/2604113958 >> 172.21.15.76:0/2604113958 conn(0x7fa5d40faab0 msgr2=0x7fa5d4104350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:07.848 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.847+0000 7fa5d9bbd700 1 -- 172.21.15.76:0/2604113958 shutdown_connections 2024-06-02T04:48:07.848 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.847+0000 7fa5d9bbd700 1 -- 172.21.15.76:0/2604113958 wait complete. 2024-06-02T04:48:07.858 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:07 smithi076 ceph-mon[42935]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-06-02T04:48:07.858 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:07 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/104058207' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-06-02T04:48:07.858 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:07 smithi076 ceph-mon[42935]: osdmap e79: 12 total, 12 up, 12 in 2024-06-02T04:48:07.858 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:07 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/3199159614' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-06-02T04:48:07.859 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:07 smithi076 ceph-mon[42935]: osdmap e80: 12 total, 12 up, 12 in 2024-06-02T04:48:07.859 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:07 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/3199159614' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-06-02T04:48:07.859 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:07 smithi076 ceph-mon[42935]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-06-02T04:48:07.859 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:07 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/421864100' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:48:07.860 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-02T04:48:07.988 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.982+0000 7fc8e21f0700 1 -- 172.21.15.76:0/816195062 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc8dc1029a0 msgr2=0x7fc8dc1092c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:07.988 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.982+0000 7fc8e21f0700 1 --2- 172.21.15.76:0/816195062 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc8dc1029a0 0x7fc8dc1092c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc8d400b0a0 tx=0x7fc8d400b3b0 comp rx=0 tx=0).stop 2024-06-02T04:48:07.988 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.982+0000 7fc8e21f0700 1 -- 172.21.15.76:0/816195062 shutdown_connections 2024-06-02T04:48:07.988 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.982+0000 7fc8e21f0700 1 --2- 172.21.15.76:0/816195062 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc8dc1029a0 0x7fc8dc1092c0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:07.989 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.982+0000 7fc8e21f0700 1 --2- 172.21.15.76:0/816195062 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc8dc100e90 0x7fc8dc1012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:07.989 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.982+0000 7fc8e21f0700 1 --2- 172.21.15.76:0/816195062 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc8dc101fe0 0x7fc8dc102460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:07.989 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.982+0000 7fc8e21f0700 1 -- 172.21.15.76:0/816195062 >> 172.21.15.76:0/816195062 conn(0x7fc8dc0fc400 msgr2=0x7fc8dc0fe840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:07.989 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.982+0000 7fc8e21f0700 1 -- 172.21.15.76:0/816195062 shutdown_connections 2024-06-02T04:48:07.989 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.982+0000 7fc8e21f0700 1 -- 172.21.15.76:0/816195062 wait complete. 2024-06-02T04:48:07.989 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.983+0000 7fc8e21f0700 1 Processor -- start 2024-06-02T04:48:07.990 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.983+0000 7fc8e21f0700 1 -- start start 2024-06-02T04:48:07.990 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.983+0000 7fc8e21f0700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc8dc100e90 0x7fc8dc196da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:07.990 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.983+0000 7fc8e21f0700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc8dc101fe0 0x7fc8dc1972e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:07.990 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.983+0000 7fc8e21f0700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc8dc1029a0 0x7fc8dc19e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:07.990 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.983+0000 7fc8e21f0700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8dc19e8d0 con 0x7fc8dc1029a0 2024-06-02T04:48:07.991 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.983+0000 7fc8e21f0700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8dc19ea10 con 0x7fc8dc101fe0 2024-06-02T04:48:07.991 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.983+0000 7fc8e21f0700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8dc19eba0 con 0x7fc8dc100e90 2024-06-02T04:48:07.991 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.983+0000 7fc8dbfff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc8dc1029a0 0x7fc8dc19e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:07.991 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.983+0000 7fc8dbfff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc8dc1029a0 0x7fc8dc19e300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:52908/0 (socket says 172.21.15.76:52908) 2024-06-02T04:48:07.991 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.983+0000 7fc8dbfff700 1 -- 172.21.15.76:0/2760148877 learned_addr learned my addr 172.21.15.76:0/2760148877 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:48:07.991 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.983+0000 7fc8daffd700 1 --2- 172.21.15.76:0/2760148877 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc8dc101fe0 0x7fc8dc1972e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:07.992 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.984+0000 7fc8db7fe700 1 --2- 172.21.15.76:0/2760148877 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc8dc100e90 0x7fc8dc196da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:07.992 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.984+0000 7fc8dbfff700 1 -- 172.21.15.76:0/2760148877 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc8dc100e90 msgr2=0x7fc8dc196da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:07.992 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.984+0000 7fc8dbfff700 1 --2- 172.21.15.76:0/2760148877 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc8dc100e90 0x7fc8dc196da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:07.992 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.984+0000 7fc8dbfff700 1 -- 172.21.15.76:0/2760148877 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc8dc101fe0 msgr2=0x7fc8dc1972e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:07.992 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.984+0000 7fc8dbfff700 1 --2- 172.21.15.76:0/2760148877 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc8dc101fe0 0x7fc8dc1972e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:07.993 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.984+0000 7fc8dbfff700 1 -- 172.21.15.76:0/2760148877 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8d4009d00 con 0x7fc8dc1029a0 2024-06-02T04:48:07.993 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.984+0000 7fc8daffd700 1 --2- 172.21.15.76:0/2760148877 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc8dc101fe0 0x7fc8dc1972e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:48:07.993 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.984+0000 7fc8dbfff700 1 --2- 172.21.15.76:0/2760148877 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc8dc1029a0 0x7fc8dc19e300 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc8d4004ce0 tx=0x7fc8d4004dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:07.993 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.984+0000 7fc8d8ff9700 1 -- 172.21.15.76:0/2760148877 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d400e040 con 0x7fc8dc1029a0 2024-06-02T04:48:07.993 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.984+0000 7fc8d8ff9700 1 -- 172.21.15.76:0/2760148877 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc8d400ce60 con 0x7fc8dc1029a0 2024-06-02T04:48:07.993 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.984+0000 7fc8e21f0700 1 -- 172.21.15.76:0/2760148877 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8dc19ee20 con 0x7fc8dc1029a0 2024-06-02T04:48:07.994 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.984+0000 7fc8d8ff9700 1 -- 172.21.15.76:0/2760148877 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d401bb20 con 0x7fc8dc1029a0 2024-06-02T04:48:07.994 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.984+0000 7fc8e21f0700 1 -- 172.21.15.76:0/2760148877 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8dc19f240 con 0x7fc8dc1029a0 2024-06-02T04:48:07.994 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.985+0000 7fc8e21f0700 1 -- 172.21.15.76:0/2760148877 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8dc1082d0 con 0x7fc8dc1029a0 2024-06-02T04:48:07.994 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.986+0000 7fc8d8ff9700 1 -- 172.21.15.76:0/2760148877 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fc8d401bc80 con 0x7fc8dc1029a0 2024-06-02T04:48:07.994 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.986+0000 7fc8d8ff9700 1 --2- 172.21.15.76:0/2760148877 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fc8c40a1120 0x7fc8c40a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:07.995 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.987+0000 7fc8db7fe700 1 --2- 172.21.15.76:0/2760148877 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fc8c40a1120 0x7fc8c40a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:07.995 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.987+0000 7fc8d8ff9700 1 -- 172.21.15.76:0/2760148877 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fc8d40ce970 con 0x7fc8dc1029a0 2024-06-02T04:48:07.995 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.987+0000 7fc8db7fe700 1 --2- 172.21.15.76:0/2760148877 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fc8c40a1120 0x7fc8c40a35e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc8cc005950 tx=0x7fc8cc0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:07.995 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:07.991+0000 7fc8d8ff9700 1 -- 172.21.15.76:0/2760148877 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fc8d4097fa0 con 0x7fc8dc1029a0 2024-06-02T04:48:08.096 INFO:journalctl@ceph.mds.b.smithi119.stdout:Jun 02 04:48:07 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-b[83265]: 2024-06-02T04:48:07.911+0000 7f60dba50700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-06-02T04:48:08.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:07 smithi119 ceph-mon[46633]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-06-02T04:48:08.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:07 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/104058207' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-06-02T04:48:08.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:07 smithi119 ceph-mon[46633]: osdmap e79: 12 total, 12 up, 12 in 2024-06-02T04:48:08.097 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:07 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/3199159614' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-06-02T04:48:08.097 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:07 smithi119 ceph-mon[46633]: osdmap e80: 12 total, 12 up, 12 in 2024-06-02T04:48:08.097 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:07 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/3199159614' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-06-02T04:48:08.097 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:07 smithi119 ceph-mon[46633]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-06-02T04:48:08.097 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:07 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/421864100' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:48:08.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:07 smithi192 ceph-mon[47933]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-06-02T04:48:08.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:07 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/104058207' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-06-02T04:48:08.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:07 smithi192 ceph-mon[47933]: osdmap e79: 12 total, 12 up, 12 in 2024-06-02T04:48:08.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:07 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/3199159614' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-06-02T04:48:08.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:07 smithi192 ceph-mon[47933]: osdmap e80: 12 total, 12 up, 12 in 2024-06-02T04:48:08.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:07 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/3199159614' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-06-02T04:48:08.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:07 smithi192 ceph-mon[47933]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-06-02T04:48:08.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:07 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/421864100' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:48:08.188 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.188+0000 7fc8e21f0700 1 -- 172.21.15.76:0/2760148877 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc8dc068060 con 0x7fc8dc1029a0 2024-06-02T04:48:08.190 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.190+0000 7fc8d8ff9700 1 -- 172.21.15.76:0/2760148877 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+23984 (secure 0 0 0) 0x7fc8d409b5c0 con 0x7fc8dc1029a0 2024-06-02T04:48:08.190 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:48:08.190 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":80,"fsid":"60ab6d30-209a-11ef-bc9b-c7b262605968","created":"2024-06-02T04:42:21.007333+0000","modified":"2024-06-02T04:48:07.101373+0000","last_up_change":"2024-06-02T04:47:29.822242+0000","last_in_change":"2024-06-02T04:47:14.253449+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T04:44:56.408602+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-02T04:48:01.194954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-02T04:48:01.828863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-02T04:48:04.916565+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"33a51ba2-be5c-41d0-b5d1-8d6039f2ca4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6802","nonce":2869602045},{"type":"v1","addr":"172.21.15.76:6803","nonce":2869602045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6804","nonce":2869602045},{"type":"v1","addr":"172.21.15.76:6805","nonce":2869602045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6808","nonce":2869602045},{"type":"v1","addr":"172.21.15.76:6809","nonce":2869602045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6806","nonce":2869602045},{"type":"v1","addr":"172.21.15.76:6807","nonce":2869602045}]},"public_addr":"172.21.15.76:6803/2869602045","cluster_addr":"172.21.15.76:6805/2869602045","heartbeat_back_addr":"172.21.15.76:6809/2869602045","heartbeat_front_addr":"172.21.15.76:6807/2869602045","state":["exists","up"]},{"osd":1,"uuid":"ace46e13-3bb7-4103-973a-6860554df8b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":2353738098},{"type":"v1","addr":"172.21.15.119:6801","nonce":2353738098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":2353738098},{"type":"v1","addr":"172.21.15.119:6803","nonce":2353738098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":2353738098},{"type":"v1","addr":"172.21.15.119:6807","nonce":2353738098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":2353738098},{"type":"v1","addr":"172.21.15.119:6805","nonce":2353738098}]},"public_addr":"172.21.15.119:6801/2353738098","cluster_addr":"172.21.15.119:6803/2353738098","heartbeat_back_addr":"172.21.15.119:6807/2353738098","heartbeat_front_addr":"172.21.15.119:6805/2353738098","state":["exists","up"]},{"osd":2,"uuid":"4addc09e-77a9-428a-bcc4-38194f486cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":3206918546},{"type":"v1","addr":"172.21.15.192:6801","nonce":3206918546}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":3206918546},{"type":"v1","addr":"172.21.15.192:6803","nonce":3206918546}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":3206918546},{"type":"v1","addr":"172.21.15.192:6807","nonce":3206918546}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":3206918546},{"type":"v1","addr":"172.21.15.192:6805","nonce":3206918546}]},"public_addr":"172.21.15.192:6801/3206918546","cluster_addr":"172.21.15.192:6803/3206918546","heartbeat_back_addr":"172.21.15.192:6807/3206918546","heartbeat_front_addr":"172.21.15.192:6805/3206918546","state":["exists","up"]},{"osd":3,"uuid":"dc525518-82c6-49ed-8ca8-e3bd5bfc18d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6810","nonce":3747864233},{"type":"v1","addr":"172.21.15.76:6811","nonce":3747864233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6812","nonce":3747864233},{"type":"v1","addr":"172.21.15.76:6813","nonce":3747864233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6816","nonce":3747864233},{"type":"v1","addr":"172.21.15.76:6817","nonce":3747864233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6814","nonce":3747864233},{"type":"v1","addr":"172.21.15.76:6815","nonce":3747864233}]},"public_addr":"172.21.15.76:6811/3747864233","cluster_addr":"172.21.15.76:6813/3747864233","heartbeat_back_addr":"172.21.15.76:6817/3747864233","heartbeat_front_addr":"172.21.15.76:6815/3747864233","state":["exists","up"]},{"osd":4,"uuid":"eef293d0-cb87-47b3-9751-c6437a1cf079","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":2571629047},{"type":"v1","addr":"172.21.15.119:6809","nonce":2571629047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":2571629047},{"type":"v1","addr":"172.21.15.119:6811","nonce":2571629047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":2571629047},{"type":"v1","addr":"172.21.15.119:6815","nonce":2571629047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":2571629047},{"type":"v1","addr":"172.21.15.119:6813","nonce":2571629047}]},"public_addr":"172.21.15.119:6809/2571629047","cluster_addr":"172.21.15.119:6811/2571629047","heartbeat_back_addr":"172.21.15.119:6815/2571629047","heartbeat_front_addr":"172.21.15.119:6813/2571629047","state":["exists","up"]},{"osd":5,"uuid":"60eb8c6e-766c-49d0-9997-44f85776b3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3285065416},{"type":"v1","addr":"172.21.15.192:6809","nonce":3285065416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":3285065416},{"type":"v1","addr":"172.21.15.192:6811","nonce":3285065416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3285065416},{"type":"v1","addr":"172.21.15.192:6815","nonce":3285065416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":3285065416},{"type":"v1","addr":"172.21.15.192:6813","nonce":3285065416}]},"public_addr":"172.21.15.192:6809/3285065416","cluster_addr":"172.21.15.192:6811/3285065416","heartbeat_back_addr":"172.21.15.192:6815/3285065416","heartbeat_front_addr":"172.21.15.192:6813/3285065416","state":["exists","up"]},{"osd":6,"uuid":"e6dc8b9d-dd06-4870-a506-def8201b7e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6818","nonce":2951381580},{"type":"v1","addr":"172.21.15.76:6819","nonce":2951381580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6820","nonce":2951381580},{"type":"v1","addr":"172.21.15.76:6821","nonce":2951381580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6824","nonce":2951381580},{"type":"v1","addr":"172.21.15.76:6825","nonce":2951381580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6822","nonce":2951381580},{"type":"v1","addr":"172.21.15.76:6823","nonce":2951381580}]},"public_addr":"172.21.15.76:6819/2951381580","cluster_addr":"172.21.15.76:6821/2951381580","heartbeat_back_addr":"172.21.15.76:6825/2951381580","heartbeat_front_addr":"172.21.15.76:6823/2951381580","state":["exists","up"]},{"osd":7,"uuid":"2f5dccb3-39a1-4f25-8715-fa264d59db97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1802558756},{"type":"v1","addr":"172.21.15.119:6817","nonce":1802558756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1802558756},{"type":"v1","addr":"172.21.15.119:6819","nonce":1802558756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1802558756},{"type":"v1","addr":"172.21.15.119:6823","nonce":1802558756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1802558756},{"type":"v1","addr":"172.21.15.119:6821","nonce":1802558756}]},"public_addr":"172.21.15.119:6817/1802558756","cluster_addr":"172.21.15.119:6819/1802558756","heartbeat_back_addr":"172.21.15.119:6823/1802558756","heartbeat_front_addr":"172.21.15.119:6821/1802558756","state":["exists","up"]},{"osd":8,"uuid":"39b6ccd0-16e7-4cd5-87e0-d827e9172984","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":1214972276},{"type":"v1","addr":"172.21.15.192:6817","nonce":1214972276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":1214972276},{"type":"v1","addr":"172.21.15.192:6819","nonce":1214972276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":1214972276},{"type":"v1","addr":"172.21.15.192:6823","nonce":1214972276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":1214972276},{"type":"v1","addr":"172.21.15.192:6821","nonce":1214972276}]},"public_addr":"172.21.15.192:6817/1214972276","cluster_addr":"172.21.15.192:6819/1214972276","heartbeat_back_addr":"172.21.15.192:6823/1214972276","heartbeat_front_addr":"172.21.15.192:6821/1214972276","state":["exists","up"]},{"osd":9,"uuid":"851b2155-07bd-45de-bfe0-53021fda733f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6826","nonce":3095501821},{"type":"v1","addr":"172.21.15.76:6827","nonce":3095501821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6828","nonce":3095501821},{"type":"v1","addr":"172.21.15.76:6829","nonce":3095501821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":3095501821},{"type":"v1","addr":"172.21.15.76:6833","nonce":3095501821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6830","nonce":3095501821},{"type":"v1","addr":"172.21.15.76:6831","nonce":3095501821}]},"public_addr":"172.21.15.76:6827/3095501821","cluster_addr":"172.21.15.76:6829/3095501821","heartbeat_back_addr":"172.21.15.76:6833/3095501821","heartbeat_front_addr":"172.21.15.76:6831/3095501821","state":["exists","up"]},{"osd":10,"uuid":"e4b18e7e-bddf-4dd4-84f6-7902ea327cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":4082130894},{"type":"v1","addr":"172.21.15.119:6825","nonce":4082130894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":4082130894},{"type":"v1","addr":"172.21.15.119:6827","nonce":4082130894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":4082130894},{"type":"v1","addr":"172.21.15.119:6831","nonce":4082130894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":4082130894},{"type":"v1","addr":"172.21.15.119:6829","nonce":4082130894}]},"public_addr":"172.21.15.119:6825/4082130894","cluster_addr":"172.21.15.119:6827/4082130894","heartbeat_back_addr":"172.21.15.119:6831/4082130894","heartbeat_front_addr":"172.21.15.119:6829/4082130894","state":["exists","up"]},{"osd":11,"uuid":"54567e18-920c-4ae9-9557-0efba5a1a820","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":439693921},{"type":"v1","addr":"172.21.15.192:6825","nonce":439693921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":439693921},{"type":"v1","addr":"172.21.15.192:6827","nonce":439693921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":439693921},{"type":"v1","addr":"172.21.15.192:6831","nonce":439693921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":439693921},{"type":"v1","addr":"172.21.15.192:6829","nonce":439693921}]},"public_addr":"172.21.15.192:6825/439693921","cluster_addr":"172.21.15.192:6827/439693921","heartbeat_back_addr":"172.21.15.192:6831/439693921","heartbeat_front_addr":"172.21.15.192:6829/439693921","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:44:19.922390+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:44:36.895563+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:44:53.699019+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:45:11.167404+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:45:27.955899+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:45:44.850368+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:46:02.003588+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:46:19.019217+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:46:36.189670+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:46:53.919365+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:47:11.563053+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:47:28.822443+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.76:6801/4200406736":"2024-06-03T04:43:06.092916+0000","172.21.15.76:6800/4200406736":"2024-06-03T04:43:06.092916+0000","172.21.15.76:0/1524144593":"2024-06-03T04:43:06.092916+0000","172.21.15.76:0/3269372590":"2024-06-03T04:43:06.092916+0000","172.21.15.76:0/3570893846":"2024-06-03T04:42:44.872236+0000","172.21.15.76:0/902035790":"2024-06-03T04:43:06.092916+0000","172.21.15.76:6800/2550846765":"2024-06-03T04:42:44.872236+0000","172.21.15.76:6801/2550846765":"2024-06-03T04:42:44.872236+0000","172.21.15.76:0/2646712763":"2024-06-03T04:42:44.872236+0000","172.21.15.76:0/964578813":"2024-06-03T04:42:44.872236+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T04:48:08.192 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.192+0000 7fc8e21f0700 1 -- 172.21.15.76:0/2760148877 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fc8c40a1120 msgr2=0x7fc8c40a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:08.192 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.192+0000 7fc8e21f0700 1 --2- 172.21.15.76:0/2760148877 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fc8c40a1120 0x7fc8c40a35e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc8cc005950 tx=0x7fc8cc0058e0 comp rx=0 tx=0).stop 2024-06-02T04:48:08.192 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.192+0000 7fc8e21f0700 1 -- 172.21.15.76:0/2760148877 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc8dc1029a0 msgr2=0x7fc8dc19e300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:08.192 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.192+0000 7fc8e21f0700 1 --2- 172.21.15.76:0/2760148877 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc8dc1029a0 0x7fc8dc19e300 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc8d4004ce0 tx=0x7fc8d4004dc0 comp rx=0 tx=0).stop 2024-06-02T04:48:08.192 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.192+0000 7fc8e21f0700 1 -- 172.21.15.76:0/2760148877 shutdown_connections 2024-06-02T04:48:08.192 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.192+0000 7fc8e21f0700 1 --2- 172.21.15.76:0/2760148877 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc8dc1029a0 0x7fc8dc19e300 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:08.193 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.192+0000 7fc8e21f0700 1 --2- 172.21.15.76:0/2760148877 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc8dc100e90 0x7fc8dc196da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:08.193 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.192+0000 7fc8e21f0700 1 --2- 172.21.15.76:0/2760148877 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fc8c40a1120 0x7fc8c40a35e0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:08.193 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.192+0000 7fc8e21f0700 1 --2- 172.21.15.76:0/2760148877 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc8dc101fe0 0x7fc8dc1972e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:08.193 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.192+0000 7fc8e21f0700 1 -- 172.21.15.76:0/2760148877 >> 172.21.15.76:0/2760148877 conn(0x7fc8dc0fc400 msgr2=0x7fc8dc105410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:08.193 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.192+0000 7fc8e21f0700 1 -- 172.21.15.76:0/2760148877 shutdown_connections 2024-06-02T04:48:08.193 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.192+0000 7fc8e21f0700 1 -- 172.21.15.76:0/2760148877 wait complete. 2024-06-02T04:48:08.221 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T04:48:08.343 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.343+0000 7f85461d9700 1 -- 172.21.15.76:0/4200259066 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8540100a70 msgr2=0x7f8540100ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:08.344 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.343+0000 7f85461d9700 1 --2- 172.21.15.76:0/4200259066 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8540100a70 0x7f8540100ef0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f853800b0a0 tx=0x7f853800b3b0 comp rx=0 tx=0).stop 2024-06-02T04:48:08.344 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.343+0000 7f85461d9700 1 -- 172.21.15.76:0/4200259066 shutdown_connections 2024-06-02T04:48:08.344 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.343+0000 7f85461d9700 1 --2- 172.21.15.76:0/4200259066 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8540100a70 0x7f8540100ef0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:08.344 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.343+0000 7f85461d9700 1 --2- 172.21.15.76:0/4200259066 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f85400ff750 0x7f85400ffb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:08.344 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.343+0000 7f85461d9700 1 --2- 172.21.15.76:0/4200259066 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f85401000b0 0x7f8540100530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:08.344 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.343+0000 7f85461d9700 1 -- 172.21.15.76:0/4200259066 >> 172.21.15.76:0/4200259066 conn(0x7f85400fb2f0 msgr2=0x7f85400fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:08.344 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.343+0000 7f85461d9700 1 -- 172.21.15.76:0/4200259066 shutdown_connections 2024-06-02T04:48:08.344 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.343+0000 7f85461d9700 1 -- 172.21.15.76:0/4200259066 wait complete. 2024-06-02T04:48:08.344 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.344+0000 7f85461d9700 1 Processor -- start 2024-06-02T04:48:08.347 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.344+0000 7f85461d9700 1 -- start start 2024-06-02T04:48:08.347 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.344+0000 7f85461d9700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f85400ff750 0x7f8540198f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:08.347 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.344+0000 7f85461d9700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f85401000b0 0x7f85401994b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:08.347 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.344+0000 7f85461d9700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8540100a70 0x7f85401a04d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:08.347 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.344+0000 7f85461d9700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85401a0aa0 con 0x7f85400ff750 2024-06-02T04:48:08.347 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.344+0000 7f85461d9700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85401a0be0 con 0x7f8540100a70 2024-06-02T04:48:08.347 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.344+0000 7f85461d9700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85401a0d70 con 0x7f85401000b0 2024-06-02T04:48:08.347 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.344+0000 7f853f7fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f85400ff750 0x7f8540198f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:08.347 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.344+0000 7f853f7fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f85400ff750 0x7f8540198f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:52928/0 (socket says 172.21.15.76:52928) 2024-06-02T04:48:08.347 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.344+0000 7f853f7fe700 1 -- 172.21.15.76:0/2183410166 learned_addr learned my addr 172.21.15.76:0/2183410166 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:48:08.347 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.344+0000 7f853effd700 1 --2- 172.21.15.76:0/2183410166 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f85401000b0 0x7f85401994b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:08.348 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.344+0000 7f853f7fe700 1 -- 172.21.15.76:0/2183410166 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f85401000b0 msgr2=0x7f85401994b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:08.348 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.344+0000 7f853f7fe700 1 --2- 172.21.15.76:0/2183410166 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f85401000b0 0x7f85401994b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:08.348 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.344+0000 7f853f7fe700 1 -- 172.21.15.76:0/2183410166 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8540100a70 msgr2=0x7f85401a04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:08.348 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.344+0000 7f853f7fe700 1 --2- 172.21.15.76:0/2183410166 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8540100a70 0x7f85401a04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:08.348 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.344+0000 7f853f7fe700 1 -- 172.21.15.76:0/2183410166 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8538009d00 con 0x7f85400ff750 2024-06-02T04:48:08.348 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.344+0000 7f853effd700 1 --2- 172.21.15.76:0/2183410166 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f85401000b0 0x7f85401994b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:48:08.348 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.345+0000 7f853f7fe700 1 --2- 172.21.15.76:0/2183410166 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f85400ff750 0x7f8540198f70 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f853000e9a0 tx=0x7f853000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:08.348 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.345+0000 7f853cff9700 1 -- 172.21.15.76:0/2183410166 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8530009790 con 0x7f85400ff750 2024-06-02T04:48:08.348 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.345+0000 7f853cff9700 1 -- 172.21.15.76:0/2183410166 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f853000cbd0 con 0x7f85400ff750 2024-06-02T04:48:08.348 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.345+0000 7f85461d9700 1 -- 172.21.15.76:0/2183410166 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85401a0ff0 con 0x7f85400ff750 2024-06-02T04:48:08.348 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.345+0000 7f853cff9700 1 -- 172.21.15.76:0/2183410166 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8530018680 con 0x7f85400ff750 2024-06-02T04:48:08.348 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.345+0000 7f85461d9700 1 -- 172.21.15.76:0/2183410166 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85401a14c0 con 0x7f85400ff750 2024-06-02T04:48:08.348 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.346+0000 7f85461d9700 1 -- 172.21.15.76:0/2183410166 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f854010a770 con 0x7f85400ff750 2024-06-02T04:48:08.349 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.347+0000 7f853cff9700 1 -- 172.21.15.76:0/2183410166 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f853000cd40 con 0x7f85400ff750 2024-06-02T04:48:08.349 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.347+0000 7f853cff9700 1 --2- 172.21.15.76:0/2183410166 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f85280a11a0 0x7f85280a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:08.349 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.347+0000 7f853effd700 1 --2- 172.21.15.76:0/2183410166 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f85280a11a0 0x7f85280a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:08.349 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.347+0000 7f853cff9700 1 -- 172.21.15.76:0/2183410166 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f8530014070 con 0x7f85400ff750 2024-06-02T04:48:08.349 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.348+0000 7f853effd700 1 --2- 172.21.15.76:0/2183410166 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f85280a11a0 0x7f85280a3660 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8534005fd0 tx=0x7f8534005e20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:08.351 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.351+0000 7f853cff9700 1 -- 172.21.15.76:0/2183410166 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f8530096500 con 0x7f85400ff750 2024-06-02T04:48:08.596 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.596+0000 7f85461d9700 1 -- 172.21.15.76:0/2183410166 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f854010e700 con 0x7f85400ff750 2024-06-02T04:48:08.597 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.597+0000 7f853cff9700 1 -- 172.21.15.76:0/2183410166 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+10813 (secure 0 0 0) 0x7f8530026070 con 0x7f85400ff750 2024-06-02T04:48:08.597 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:48:08.597 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6835/3029342152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3029342152},{"type":"v1","addr":"172.21.15.76:6835","nonce":3029342152}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6837/1207985317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":1207985317},{"type":"v1","addr":"172.21.15.76:6837","nonce":1207985317}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14607,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6839/928709755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":928709755},{"type":"v1","addr":"172.21.15.76:6839","nonce":928709755}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6841/4162178633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6840","nonce":4162178633},{"type":"v1","addr":"172.21.15.76:6841","nonce":4162178633}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/1543944863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":1543944863},{"type":"v1","addr":"172.21.15.119:6833","nonce":1543944863}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24418,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6833/1527921393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1527921393},{"type":"v1","addr":"172.21.15.192:6833","nonce":1527921393}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24434,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/2746840347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":2746840347},{"type":"v1","addr":"172.21.15.119:6835","nonce":2746840347}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24451,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/783181340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":783181340},{"type":"v1","addr":"172.21.15.192:6835","nonce":783181340}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24458,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/2171687478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":2171687478},{"type":"v1","addr":"172.21.15.119:6837","nonce":2171687478}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24463,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/960773710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":960773710},{"type":"v1","addr":"172.21.15.192:6837","nonce":960773710}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24475,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/3978681402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":3978681402},{"type":"v1","addr":"172.21.15.192:6839","nonce":3978681402}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-02T04:48:02.662812+0000","modified":"2024-06-02T04:48:07.101678+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24491},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.119:6839/4098406903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":4098406903},{"type":"v1","addr":"172.21.15.119:6839","nonce":4098406903}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-06-02T04:48:08.599 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.599+0000 7f85461d9700 1 -- 172.21.15.76:0/2183410166 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f85280a11a0 msgr2=0x7f85280a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:08.599 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.599+0000 7f85461d9700 1 --2- 172.21.15.76:0/2183410166 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f85280a11a0 0x7f85280a3660 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8534005fd0 tx=0x7f8534005e20 comp rx=0 tx=0).stop 2024-06-02T04:48:08.600 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.599+0000 7f85461d9700 1 -- 172.21.15.76:0/2183410166 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f85400ff750 msgr2=0x7f8540198f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:08.600 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.599+0000 7f85461d9700 1 --2- 172.21.15.76:0/2183410166 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f85400ff750 0x7f8540198f70 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f853000e9a0 tx=0x7f853000ed60 comp rx=0 tx=0).stop 2024-06-02T04:48:08.600 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.599+0000 7f85461d9700 1 -- 172.21.15.76:0/2183410166 shutdown_connections 2024-06-02T04:48:08.600 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.599+0000 7f85461d9700 1 --2- 172.21.15.76:0/2183410166 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f85280a11a0 0x7f85280a3660 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:08.600 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.599+0000 7f85461d9700 1 --2- 172.21.15.76:0/2183410166 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8540100a70 0x7f85401a04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:08.600 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.599+0000 7f85461d9700 1 --2- 172.21.15.76:0/2183410166 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f85400ff750 0x7f8540198f70 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:08.600 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.599+0000 7f85461d9700 1 --2- 172.21.15.76:0/2183410166 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f85401000b0 0x7f85401994b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:08.600 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.599+0000 7f85461d9700 1 -- 172.21.15.76:0/2183410166 >> 172.21.15.76:0/2183410166 conn(0x7f85400fb2f0 msgr2=0x7f85400fca50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:08.600 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.599+0000 7f85461d9700 1 -- 172.21.15.76:0/2183410166 shutdown_connections 2024-06-02T04:48:08.600 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.599+0000 7f85461d9700 1 -- 172.21.15.76:0/2183410166 wait complete. 2024-06-02T04:48:08.601 INFO:teuthology.orchestra.run.smithi076.stderr:dumped fsmap epoch 17 2024-06-02T04:48:08.612 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-02T04:48:08.737 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.736+0000 7f9151a4b700 1 -- 172.21.15.76:0/1351005754 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f914c100710 msgr2=0x7f914c100b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:08.737 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.736+0000 7f9151a4b700 1 --2- 172.21.15.76:0/1351005754 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f914c100710 0x7f914c100b70 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f91400099c0 tx=0x7f9140009cd0 comp rx=0 tx=0).stop 2024-06-02T04:48:08.737 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.736+0000 7f9151a4b700 1 -- 172.21.15.76:0/1351005754 shutdown_connections 2024-06-02T04:48:08.737 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.736+0000 7f9151a4b700 1 --2- 172.21.15.76:0/1351005754 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f914c1010b0 0x7f914c107960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:08.737 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.736+0000 7f9151a4b700 1 --2- 172.21.15.76:0/1351005754 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f914c0ff520 0x7f914c0ff940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:08.737 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.736+0000 7f9151a4b700 1 --2- 172.21.15.76:0/1351005754 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f914c100710 0x7f914c100b70 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:08.737 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.736+0000 7f9151a4b700 1 -- 172.21.15.76:0/1351005754 >> 172.21.15.76:0/1351005754 conn(0x7f914c0faa90 msgr2=0x7f914c0fced0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:08.737 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.736+0000 7f9151a4b700 1 -- 172.21.15.76:0/1351005754 shutdown_connections 2024-06-02T04:48:08.737 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.736+0000 7f9151a4b700 1 -- 172.21.15.76:0/1351005754 wait complete. 2024-06-02T04:48:08.737 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.737+0000 7f9151a4b700 1 Processor -- start 2024-06-02T04:48:08.737 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.737+0000 7f9151a4b700 1 -- start start 2024-06-02T04:48:08.740 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.737+0000 7f9151a4b700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f914c0ff520 0x7f914c196e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:08.740 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.737+0000 7f9151a4b700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f914c100710 0x7f914c1973a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:08.740 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.737+0000 7f9151a4b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f914c1010b0 0x7f914c19e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:08.740 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.737+0000 7f9151a4b700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f914c19e900 con 0x7f914c100710 2024-06-02T04:48:08.740 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.737+0000 7f9151a4b700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f914c19ea70 con 0x7f914c0ff520 2024-06-02T04:48:08.740 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.737+0000 7f9151a4b700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f914c19ec30 con 0x7f914c1010b0 2024-06-02T04:48:08.740 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.737+0000 7f914a7fc700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f914c100710 0x7f914c1973a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:08.740 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.737+0000 7f914a7fc700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f914c100710 0x7f914c1973a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:52946/0 (socket says 172.21.15.76:52946) 2024-06-02T04:48:08.740 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.737+0000 7f914a7fc700 1 -- 172.21.15.76:0/2658726283 learned_addr learned my addr 172.21.15.76:0/2658726283 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:48:08.740 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.737+0000 7f914b7fe700 1 --2- 172.21.15.76:0/2658726283 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f914c1010b0 0x7f914c19e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:08.741 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.737+0000 7f914a7fc700 1 -- 172.21.15.76:0/2658726283 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f914c1010b0 msgr2=0x7f914c19e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:08.741 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.737+0000 7f914a7fc700 1 --2- 172.21.15.76:0/2658726283 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f914c1010b0 0x7f914c19e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:08.741 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.737+0000 7f914a7fc700 1 -- 172.21.15.76:0/2658726283 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f914c0ff520 msgr2=0x7f914c196e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:08.741 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.737+0000 7f914affd700 1 --2- 172.21.15.76:0/2658726283 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f914c0ff520 0x7f914c196e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:08.741 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.737+0000 7f914a7fc700 1 --2- 172.21.15.76:0/2658726283 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f914c0ff520 0x7f914c196e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:08.741 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.737+0000 7f914a7fc700 1 -- 172.21.15.76:0/2658726283 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91400095f0 con 0x7f914c100710 2024-06-02T04:48:08.741 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.737+0000 7f914b7fe700 1 --2- 172.21.15.76:0/2658726283 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f914c1010b0 0x7f914c19e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:48:08.741 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.738+0000 7f914a7fc700 1 --2- 172.21.15.76:0/2658726283 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f914c100710 0x7f914c1973a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f914000b580 tx=0x7f91400047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:08.741 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.738+0000 7f9150a49700 1 -- 172.21.15.76:0/2658726283 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9140003d60 con 0x7f914c100710 2024-06-02T04:48:08.741 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.738+0000 7f9151a4b700 1 -- 172.21.15.76:0/2658726283 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f914c19eeb0 con 0x7f914c100710 2024-06-02T04:48:08.741 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.738+0000 7f9150a49700 1 -- 172.21.15.76:0/2658726283 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f914000e450 con 0x7f914c100710 2024-06-02T04:48:08.741 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.738+0000 7f9150a49700 1 -- 172.21.15.76:0/2658726283 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9140016680 con 0x7f914c100710 2024-06-02T04:48:08.741 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.738+0000 7f9151a4b700 1 -- 172.21.15.76:0/2658726283 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f914c19f2f0 con 0x7f914c100710 2024-06-02T04:48:08.742 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.739+0000 7f9151a4b700 1 -- 172.21.15.76:0/2658726283 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f914c1069f0 con 0x7f914c100710 2024-06-02T04:48:08.742 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.740+0000 7f9150a49700 1 -- 172.21.15.76:0/2658726283 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f914000e5c0 con 0x7f914c100710 2024-06-02T04:48:08.742 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.741+0000 7f9150a49700 1 --2- 172.21.15.76:0/2658726283 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f91340a1120 0x7f91340a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:08.742 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.741+0000 7f914affd700 1 --2- 172.21.15.76:0/2658726283 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f91340a1120 0x7f91340a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:08.742 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.741+0000 7f9150a49700 1 -- 172.21.15.76:0/2658726283 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f9140012070 con 0x7f914c100710 2024-06-02T04:48:08.743 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.741+0000 7f914affd700 1 --2- 172.21.15.76:0/2658726283 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f91340a1120 0x7f91340a35e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f914c198290 tx=0x7f913c008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:08.744 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.744+0000 7f9150a49700 1 -- 172.21.15.76:0/2658726283 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f9140098110 con 0x7f914c100710 2024-06-02T04:48:08.944 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.944+0000 7f9151a4b700 1 -- 172.21.15.76:0/2658726283 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f914c068060 con 0x7f914c100710 2024-06-02T04:48:08.945 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.945+0000 7f9150a49700 1 -- 172.21.15.76:0/2658726283 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+23984 (secure 0 0 0) 0x7f914009b730 con 0x7f914c100710 2024-06-02T04:48:08.946 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:48:08.946 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":80,"fsid":"60ab6d30-209a-11ef-bc9b-c7b262605968","created":"2024-06-02T04:42:21.007333+0000","modified":"2024-06-02T04:48:07.101373+0000","last_up_change":"2024-06-02T04:47:29.822242+0000","last_in_change":"2024-06-02T04:47:14.253449+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T04:44:56.408602+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-02T04:48:01.194954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-02T04:48:01.828863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-02T04:48:04.916565+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"33a51ba2-be5c-41d0-b5d1-8d6039f2ca4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6802","nonce":2869602045},{"type":"v1","addr":"172.21.15.76:6803","nonce":2869602045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6804","nonce":2869602045},{"type":"v1","addr":"172.21.15.76:6805","nonce":2869602045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6808","nonce":2869602045},{"type":"v1","addr":"172.21.15.76:6809","nonce":2869602045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6806","nonce":2869602045},{"type":"v1","addr":"172.21.15.76:6807","nonce":2869602045}]},"public_addr":"172.21.15.76:6803/2869602045","cluster_addr":"172.21.15.76:6805/2869602045","heartbeat_back_addr":"172.21.15.76:6809/2869602045","heartbeat_front_addr":"172.21.15.76:6807/2869602045","state":["exists","up"]},{"osd":1,"uuid":"ace46e13-3bb7-4103-973a-6860554df8b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":2353738098},{"type":"v1","addr":"172.21.15.119:6801","nonce":2353738098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":2353738098},{"type":"v1","addr":"172.21.15.119:6803","nonce":2353738098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":2353738098},{"type":"v1","addr":"172.21.15.119:6807","nonce":2353738098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":2353738098},{"type":"v1","addr":"172.21.15.119:6805","nonce":2353738098}]},"public_addr":"172.21.15.119:6801/2353738098","cluster_addr":"172.21.15.119:6803/2353738098","heartbeat_back_addr":"172.21.15.119:6807/2353738098","heartbeat_front_addr":"172.21.15.119:6805/2353738098","state":["exists","up"]},{"osd":2,"uuid":"4addc09e-77a9-428a-bcc4-38194f486cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":3206918546},{"type":"v1","addr":"172.21.15.192:6801","nonce":3206918546}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":3206918546},{"type":"v1","addr":"172.21.15.192:6803","nonce":3206918546}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":3206918546},{"type":"v1","addr":"172.21.15.192:6807","nonce":3206918546}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":3206918546},{"type":"v1","addr":"172.21.15.192:6805","nonce":3206918546}]},"public_addr":"172.21.15.192:6801/3206918546","cluster_addr":"172.21.15.192:6803/3206918546","heartbeat_back_addr":"172.21.15.192:6807/3206918546","heartbeat_front_addr":"172.21.15.192:6805/3206918546","state":["exists","up"]},{"osd":3,"uuid":"dc525518-82c6-49ed-8ca8-e3bd5bfc18d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6810","nonce":3747864233},{"type":"v1","addr":"172.21.15.76:6811","nonce":3747864233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6812","nonce":3747864233},{"type":"v1","addr":"172.21.15.76:6813","nonce":3747864233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6816","nonce":3747864233},{"type":"v1","addr":"172.21.15.76:6817","nonce":3747864233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6814","nonce":3747864233},{"type":"v1","addr":"172.21.15.76:6815","nonce":3747864233}]},"public_addr":"172.21.15.76:6811/3747864233","cluster_addr":"172.21.15.76:6813/3747864233","heartbeat_back_addr":"172.21.15.76:6817/3747864233","heartbeat_front_addr":"172.21.15.76:6815/3747864233","state":["exists","up"]},{"osd":4,"uuid":"eef293d0-cb87-47b3-9751-c6437a1cf079","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":2571629047},{"type":"v1","addr":"172.21.15.119:6809","nonce":2571629047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":2571629047},{"type":"v1","addr":"172.21.15.119:6811","nonce":2571629047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":2571629047},{"type":"v1","addr":"172.21.15.119:6815","nonce":2571629047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":2571629047},{"type":"v1","addr":"172.21.15.119:6813","nonce":2571629047}]},"public_addr":"172.21.15.119:6809/2571629047","cluster_addr":"172.21.15.119:6811/2571629047","heartbeat_back_addr":"172.21.15.119:6815/2571629047","heartbeat_front_addr":"172.21.15.119:6813/2571629047","state":["exists","up"]},{"osd":5,"uuid":"60eb8c6e-766c-49d0-9997-44f85776b3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3285065416},{"type":"v1","addr":"172.21.15.192:6809","nonce":3285065416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":3285065416},{"type":"v1","addr":"172.21.15.192:6811","nonce":3285065416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3285065416},{"type":"v1","addr":"172.21.15.192:6815","nonce":3285065416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":3285065416},{"type":"v1","addr":"172.21.15.192:6813","nonce":3285065416}]},"public_addr":"172.21.15.192:6809/3285065416","cluster_addr":"172.21.15.192:6811/3285065416","heartbeat_back_addr":"172.21.15.192:6815/3285065416","heartbeat_front_addr":"172.21.15.192:6813/3285065416","state":["exists","up"]},{"osd":6,"uuid":"e6dc8b9d-dd06-4870-a506-def8201b7e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6818","nonce":2951381580},{"type":"v1","addr":"172.21.15.76:6819","nonce":2951381580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6820","nonce":2951381580},{"type":"v1","addr":"172.21.15.76:6821","nonce":2951381580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6824","nonce":2951381580},{"type":"v1","addr":"172.21.15.76:6825","nonce":2951381580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6822","nonce":2951381580},{"type":"v1","addr":"172.21.15.76:6823","nonce":2951381580}]},"public_addr":"172.21.15.76:6819/2951381580","cluster_addr":"172.21.15.76:6821/2951381580","heartbeat_back_addr":"172.21.15.76:6825/2951381580","heartbeat_front_addr":"172.21.15.76:6823/2951381580","state":["exists","up"]},{"osd":7,"uuid":"2f5dccb3-39a1-4f25-8715-fa264d59db97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1802558756},{"type":"v1","addr":"172.21.15.119:6817","nonce":1802558756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1802558756},{"type":"v1","addr":"172.21.15.119:6819","nonce":1802558756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1802558756},{"type":"v1","addr":"172.21.15.119:6823","nonce":1802558756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1802558756},{"type":"v1","addr":"172.21.15.119:6821","nonce":1802558756}]},"public_addr":"172.21.15.119:6817/1802558756","cluster_addr":"172.21.15.119:6819/1802558756","heartbeat_back_addr":"172.21.15.119:6823/1802558756","heartbeat_front_addr":"172.21.15.119:6821/1802558756","state":["exists","up"]},{"osd":8,"uuid":"39b6ccd0-16e7-4cd5-87e0-d827e9172984","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":1214972276},{"type":"v1","addr":"172.21.15.192:6817","nonce":1214972276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":1214972276},{"type":"v1","addr":"172.21.15.192:6819","nonce":1214972276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":1214972276},{"type":"v1","addr":"172.21.15.192:6823","nonce":1214972276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":1214972276},{"type":"v1","addr":"172.21.15.192:6821","nonce":1214972276}]},"public_addr":"172.21.15.192:6817/1214972276","cluster_addr":"172.21.15.192:6819/1214972276","heartbeat_back_addr":"172.21.15.192:6823/1214972276","heartbeat_front_addr":"172.21.15.192:6821/1214972276","state":["exists","up"]},{"osd":9,"uuid":"851b2155-07bd-45de-bfe0-53021fda733f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6826","nonce":3095501821},{"type":"v1","addr":"172.21.15.76:6827","nonce":3095501821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6828","nonce":3095501821},{"type":"v1","addr":"172.21.15.76:6829","nonce":3095501821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":3095501821},{"type":"v1","addr":"172.21.15.76:6833","nonce":3095501821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6830","nonce":3095501821},{"type":"v1","addr":"172.21.15.76:6831","nonce":3095501821}]},"public_addr":"172.21.15.76:6827/3095501821","cluster_addr":"172.21.15.76:6829/3095501821","heartbeat_back_addr":"172.21.15.76:6833/3095501821","heartbeat_front_addr":"172.21.15.76:6831/3095501821","state":["exists","up"]},{"osd":10,"uuid":"e4b18e7e-bddf-4dd4-84f6-7902ea327cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":4082130894},{"type":"v1","addr":"172.21.15.119:6825","nonce":4082130894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":4082130894},{"type":"v1","addr":"172.21.15.119:6827","nonce":4082130894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":4082130894},{"type":"v1","addr":"172.21.15.119:6831","nonce":4082130894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":4082130894},{"type":"v1","addr":"172.21.15.119:6829","nonce":4082130894}]},"public_addr":"172.21.15.119:6825/4082130894","cluster_addr":"172.21.15.119:6827/4082130894","heartbeat_back_addr":"172.21.15.119:6831/4082130894","heartbeat_front_addr":"172.21.15.119:6829/4082130894","state":["exists","up"]},{"osd":11,"uuid":"54567e18-920c-4ae9-9557-0efba5a1a820","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":439693921},{"type":"v1","addr":"172.21.15.192:6825","nonce":439693921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":439693921},{"type":"v1","addr":"172.21.15.192:6827","nonce":439693921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":439693921},{"type":"v1","addr":"172.21.15.192:6831","nonce":439693921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":439693921},{"type":"v1","addr":"172.21.15.192:6829","nonce":439693921}]},"public_addr":"172.21.15.192:6825/439693921","cluster_addr":"172.21.15.192:6827/439693921","heartbeat_back_addr":"172.21.15.192:6831/439693921","heartbeat_front_addr":"172.21.15.192:6829/439693921","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:44:19.922390+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:44:36.895563+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:44:53.699019+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:45:11.167404+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:45:27.955899+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:45:44.850368+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:46:02.003588+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:46:19.019217+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:46:36.189670+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:46:53.919365+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:47:11.563053+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:47:28.822443+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.76:6801/4200406736":"2024-06-03T04:43:06.092916+0000","172.21.15.76:6800/4200406736":"2024-06-03T04:43:06.092916+0000","172.21.15.76:0/1524144593":"2024-06-03T04:43:06.092916+0000","172.21.15.76:0/3269372590":"2024-06-03T04:43:06.092916+0000","172.21.15.76:0/3570893846":"2024-06-03T04:42:44.872236+0000","172.21.15.76:0/902035790":"2024-06-03T04:43:06.092916+0000","172.21.15.76:6800/2550846765":"2024-06-03T04:42:44.872236+0000","172.21.15.76:6801/2550846765":"2024-06-03T04:42:44.872236+0000","172.21.15.76:0/2646712763":"2024-06-03T04:42:44.872236+0000","172.21.15.76:0/964578813":"2024-06-03T04:42:44.872236+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T04:48:08.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.947+0000 7f9151a4b700 1 -- 172.21.15.76:0/2658726283 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f91340a1120 msgr2=0x7f91340a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:08.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.947+0000 7f9151a4b700 1 --2- 172.21.15.76:0/2658726283 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f91340a1120 0x7f91340a35e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f914c198290 tx=0x7f913c008040 comp rx=0 tx=0).stop 2024-06-02T04:48:08.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.947+0000 7f9151a4b700 1 -- 172.21.15.76:0/2658726283 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f914c100710 msgr2=0x7f914c1973a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:08.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.947+0000 7f9151a4b700 1 --2- 172.21.15.76:0/2658726283 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f914c100710 0x7f914c1973a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f914000b580 tx=0x7f91400047b0 comp rx=0 tx=0).stop 2024-06-02T04:48:08.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.948+0000 7f9151a4b700 1 -- 172.21.15.76:0/2658726283 shutdown_connections 2024-06-02T04:48:08.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.948+0000 7f9151a4b700 1 --2- 172.21.15.76:0/2658726283 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f914c1010b0 0x7f914c19e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:08.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.948+0000 7f9151a4b700 1 --2- 172.21.15.76:0/2658726283 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f91340a1120 0x7f91340a35e0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:08.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.948+0000 7f9151a4b700 1 --2- 172.21.15.76:0/2658726283 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f914c0ff520 0x7f914c196e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:08.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.948+0000 7f9151a4b700 1 --2- 172.21.15.76:0/2658726283 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f914c100710 0x7f914c1973a0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:08.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.948+0000 7f9151a4b700 1 -- 172.21.15.76:0/2658726283 >> 172.21.15.76:0/2658726283 conn(0x7f914c0faa90 msgr2=0x7f914c103b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:08.949 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.948+0000 7f9151a4b700 1 -- 172.21.15.76:0/2658726283 shutdown_connections 2024-06-02T04:48:08.949 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:08.948+0000 7f9151a4b700 1 -- 172.21.15.76:0/2658726283 wait complete. 2024-06-02T04:48:08.959 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:08 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/2604113958' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:48:08.959 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:08 smithi076 ceph-mon[42935]: pgmap v221: 129 pgs: 9 creating+peering, 14 unknown, 106 active+clean; 579 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s wr, 10 op/s 2024-06-02T04:48:08.959 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:08 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/2760148877' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:48:08.959 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:08 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/2183410166' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:48:08.961 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-06-02T04:48:02.662812+0000', 'modified': '2024-06-02T04:48:07.101678+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24491}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24491': {'gid': 24491, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.119:6839/4098406903', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.119:6838', 'nonce': 4098406903}, {'type': 'v1', 'addr': '172.21.15.119:6839', 'nonce': 4098406903}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2024-06-02T04:48:08.961 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-06-02T04:48:08.961 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-06-02T04:48:09.086 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.083+0000 7fd27b97e700 1 -- 172.21.15.76:0/553174440 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd2741007d0 msgr2=0x7fd274100c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:09.086 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.083+0000 7fd27b97e700 1 --2- 172.21.15.76:0/553174440 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd2741007d0 0x7fd274100c30 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd2640099c0 tx=0x7fd264009cd0 comp rx=0 tx=0).stop 2024-06-02T04:48:09.086 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.083+0000 7fd27b97e700 1 -- 172.21.15.76:0/553174440 shutdown_connections 2024-06-02T04:48:09.086 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.083+0000 7fd27b97e700 1 --2- 172.21.15.76:0/553174440 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd274101170 0x7fd274107a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:09.086 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.083+0000 7fd27b97e700 1 --2- 172.21.15.76:0/553174440 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd2740ff5e0 0x7fd2740ffa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:09.086 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.083+0000 7fd27b97e700 1 --2- 172.21.15.76:0/553174440 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd2741007d0 0x7fd274100c30 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:09.087 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.084+0000 7fd27b97e700 1 -- 172.21.15.76:0/553174440 >> 172.21.15.76:0/553174440 conn(0x7fd2740fab50 msgr2=0x7fd2740fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:09.087 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.084+0000 7fd27b97e700 1 -- 172.21.15.76:0/553174440 shutdown_connections 2024-06-02T04:48:09.087 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.084+0000 7fd27b97e700 1 -- 172.21.15.76:0/553174440 wait complete. 2024-06-02T04:48:09.087 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.084+0000 7fd27b97e700 1 Processor -- start 2024-06-02T04:48:09.087 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.084+0000 7fd27b97e700 1 -- start start 2024-06-02T04:48:09.087 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.084+0000 7fd27b97e700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd2740ff5e0 0x7fd274195d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:09.087 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.084+0000 7fd27b97e700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd2741007d0 0x7fd274196290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:09.087 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.084+0000 7fd27b97e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd274101170 0x7fd27419d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:09.087 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.084+0000 7fd27b97e700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd27419d840 con 0x7fd2740ff5e0 2024-06-02T04:48:09.087 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.084+0000 7fd27b97e700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd27419d9b0 con 0x7fd2741007d0 2024-06-02T04:48:09.087 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.084+0000 7fd27b97e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd27419db70 con 0x7fd274101170 2024-06-02T04:48:09.087 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.084+0000 7fd27971a700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd2740ff5e0 0x7fd274195d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:09.088 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.084+0000 7fd27971a700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd2740ff5e0 0x7fd274195d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:52972/0 (socket says 172.21.15.76:52972) 2024-06-02T04:48:09.088 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.084+0000 7fd27971a700 1 -- 172.21.15.76:0/2448752599 learned_addr learned my addr 172.21.15.76:0/2448752599 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:48:09.088 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.085+0000 7fd279f1b700 1 --2- 172.21.15.76:0/2448752599 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd274101170 0x7fd27419d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:09.088 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.085+0000 7fd27971a700 1 -- 172.21.15.76:0/2448752599 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd274101170 msgr2=0x7fd27419d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:09.088 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.085+0000 7fd278f19700 1 --2- 172.21.15.76:0/2448752599 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd2741007d0 0x7fd274196290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:09.088 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.085+0000 7fd27971a700 1 --2- 172.21.15.76:0/2448752599 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd274101170 0x7fd27419d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:09.088 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.085+0000 7fd27971a700 1 -- 172.21.15.76:0/2448752599 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd2741007d0 msgr2=0x7fd274196290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:09.088 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.085+0000 7fd27971a700 1 --2- 172.21.15.76:0/2448752599 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd2741007d0 0x7fd274196290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:09.088 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.085+0000 7fd27971a700 1 -- 172.21.15.76:0/2448752599 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2640095f0 con 0x7fd2740ff5e0 2024-06-02T04:48:09.088 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.085+0000 7fd279f1b700 1 --2- 172.21.15.76:0/2448752599 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd274101170 0x7fd27419d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:48:09.088 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.085+0000 7fd27971a700 1 --2- 172.21.15.76:0/2448752599 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd2740ff5e0 0x7fd274195d50 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd27000c970 tx=0x7fd27000cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:09.088 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.085+0000 7fd26a7fc700 1 -- 172.21.15.76:0/2448752599 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd270004220 con 0x7fd2740ff5e0 2024-06-02T04:48:09.089 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.085+0000 7fd26a7fc700 1 -- 172.21.15.76:0/2448752599 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd270007d30 con 0x7fd2740ff5e0 2024-06-02T04:48:09.089 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.085+0000 7fd27b97e700 1 -- 172.21.15.76:0/2448752599 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd27419de50 con 0x7fd2740ff5e0 2024-06-02T04:48:09.089 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.085+0000 7fd26a7fc700 1 -- 172.21.15.76:0/2448752599 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd270003bf0 con 0x7fd2740ff5e0 2024-06-02T04:48:09.089 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.085+0000 7fd27b97e700 1 -- 172.21.15.76:0/2448752599 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd27419e270 con 0x7fd2740ff5e0 2024-06-02T04:48:09.096 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.087+0000 7fd26a7fc700 1 -- 172.21.15.76:0/2448752599 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fd2700078a0 con 0x7fd2740ff5e0 2024-06-02T04:48:09.096 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.087+0000 7fd26a7fc700 1 --2- 172.21.15.76:0/2448752599 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fd2600a1120 0x7fd2600a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:09.096 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.088+0000 7fd278f19700 1 --2- 172.21.15.76:0/2448752599 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fd2600a1120 0x7fd2600a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:09.096 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.088+0000 7fd26a7fc700 1 -- 172.21.15.76:0/2448752599 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fd2700cc760 con 0x7fd2740ff5e0 2024-06-02T04:48:09.096 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.088+0000 7fd278f19700 1 --2- 172.21.15.76:0/2448752599 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fd2600a1120 0x7fd2600a35e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd26400bf10 tx=0x7fd26400b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:09.096 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.089+0000 7fd287b39b80 1 Processor -- start 2024-06-02T04:48:09.096 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.089+0000 7fd287b39b80 1 -- start start 2024-06-02T04:48:09.096 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.089+0000 7fd287b39b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559e8b5b1700 0x559e8b5b1b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:09.096 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.089+0000 7fd287b39b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559e8b5b2060 0x559e8b5b24e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:09.096 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.089+0000 7fd287b39b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559e8b5b2a20 0x559e8b5b2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:09.096 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.089+0000 7fd287b39b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e8b506100 con 0x559e8b5b2060 2024-06-02T04:48:09.096 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.089+0000 7fd287b39b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e8b503ac0 con 0x559e8b5b1700 2024-06-02T04:48:09.097 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.089+0000 7fd287b39b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e8b4ff3b0 con 0x559e8b5b2a20 2024-06-02T04:48:09.097 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.089+0000 7fd278f19700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559e8b5b2060 0x559e8b5b24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:09.097 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.089+0000 7fd278f19700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559e8b5b2060 0x559e8b5b24e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:52974/0 (socket says 172.21.15.76:52974) 2024-06-02T04:48:09.097 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.089+0000 7fd278f19700 1 -- 172.21.15.76:0/3540140448 learned_addr learned my addr 172.21.15.76:0/3540140448 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:48:09.097 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.089+0000 7fd279f1b700 1 --2- 172.21.15.76:0/3540140448 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559e8b5b2a20 0x559e8b5b2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:09.097 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.089+0000 7fd27971a700 1 --2- 172.21.15.76:0/3540140448 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559e8b5b1700 0x559e8b5b1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:09.097 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.089+0000 7fd278f19700 1 -- 172.21.15.76:0/3540140448 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559e8b5b2a20 msgr2=0x559e8b5b2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:48:09.097 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.089+0000 7fd278f19700 1 --2- 172.21.15.76:0/3540140448 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559e8b5b2a20 0x559e8b5b2ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:09.097 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.089+0000 7fd278f19700 1 -- 172.21.15.76:0/3540140448 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559e8b5b1700 msgr2=0x559e8b5b1b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:48:09.097 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.089+0000 7fd278f19700 1 --2- 172.21.15.76:0/3540140448 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559e8b5b1700 0x559e8b5b1b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:09.097 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.089+0000 7fd278f19700 1 -- 172.21.15.76:0/3540140448 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559e8b380360 con 0x559e8b5b2060 2024-06-02T04:48:09.097 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.089+0000 7fd27971a700 1 --2- 172.21.15.76:0/3540140448 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559e8b5b1700 0x559e8b5b1b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:48:09.098 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.090+0000 7fd278f19700 1 --2- 172.21.15.76:0/3540140448 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559e8b5b2060 0x559e8b5b24e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd26400bb20 tx=0x7fd264009cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7eedd787e60cafc1 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:09.098 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.090+0000 7fd25f7fe700 1 -- 172.21.15.76:0/3540140448 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd26401d070 con 0x559e8b5b2060 2024-06-02T04:48:09.098 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.090+0000 7fd25f7fe700 1 -- 172.21.15.76:0/3540140448 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd264005530 con 0x559e8b5b2060 2024-06-02T04:48:09.098 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.090+0000 7fd25f7fe700 1 -- 172.21.15.76:0/3540140448 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd26400f840 con 0x559e8b5b2060 2024-06-02T04:48:09.098 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.090+0000 7fd287b39b80 1 -- 172.21.15.76:0/3540140448 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559e8b5b2060 msgr2=0x559e8b5b24e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:09.098 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.090+0000 7fd287b39b80 1 --2- 172.21.15.76:0/3540140448 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559e8b5b2060 0x559e8b5b24e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd26400bb20 tx=0x7fd264009cd0 comp rx=0 tx=0).stop 2024-06-02T04:48:09.098 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.090+0000 7fd287b39b80 1 -- 172.21.15.76:0/3540140448 shutdown_connections 2024-06-02T04:48:09.098 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.090+0000 7fd287b39b80 1 --2- 172.21.15.76:0/3540140448 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559e8b5b2a20 0x559e8b5b2ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:09.098 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.090+0000 7fd287b39b80 1 --2- 172.21.15.76:0/3540140448 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559e8b5b1700 0x559e8b5b1b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:09.098 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.090+0000 7fd287b39b80 1 --2- 172.21.15.76:0/3540140448 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559e8b5b2060 0x559e8b5b24e0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:09.098 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.090+0000 7fd287b39b80 1 -- 172.21.15.76:0/3540140448 >> 172.21.15.76:0/3540140448 conn(0x559e8b50d1c0 msgr2=0x559e8b5a9d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:09.098 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.091+0000 7fd287b39b80 1 -- 172.21.15.76:0/3540140448 shutdown_connections 2024-06-02T04:48:09.099 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.091+0000 7fd287b39b80 1 -- 172.21.15.76:0/3540140448 wait complete. 2024-06-02T04:48:09.099 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.091+0000 7fd287b39b80 1 -- start start 2024-06-02T04:48:09.099 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.091+0000 7fd287b39b80 1 Processor -- start 2024-06-02T04:48:09.099 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.091+0000 7fd287b39b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559e8b5b1700 0x559e8b5baf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:09.099 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.091+0000 7fd287b39b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559e8b5b2060 0x559e8b5bb440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:09.099 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.091+0000 7fd287b39b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559e8b5b2a20 0x559e8b5c2480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:09.099 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.091+0000 7fd287b39b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e8b49b510 con 0x559e8b5b1700 2024-06-02T04:48:09.099 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.091+0000 7fd287b39b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e8b49b1b0 con 0x559e8b5b2060 2024-06-02T04:48:09.099 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.091+0000 7fd287b39b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e8b382650 con 0x559e8b5b2a20 2024-06-02T04:48:09.099 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.091+0000 7fd287b39b80 10 client.0 _ll_register_callbacks cb 0x559e8b4a4ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:48:09.099 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.091+0000 7fd27971a700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559e8b5b1700 0x559e8b5baf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:09.099 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.091+0000 7fd27971a700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559e8b5b1700 0x559e8b5baf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:52976/0 (socket says 172.21.15.76:52976) 2024-06-02T04:48:09.100 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.091+0000 7fd27971a700 1 -- 172.21.15.76:0/1057913672 learned_addr learned my addr 172.21.15.76:0/1057913672 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:48:09.100 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.092+0000 7fd279f1b700 1 --2- 172.21.15.76:0/1057913672 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559e8b5b2a20 0x559e8b5c2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:09.100 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.092+0000 7fd278f19700 1 --2- 172.21.15.76:0/1057913672 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559e8b5b2060 0x559e8b5bb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:09.100 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.092+0000 7fd27971a700 1 -- 172.21.15.76:0/1057913672 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559e8b5b2a20 msgr2=0x559e8b5c2480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:48:09.100 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.092+0000 7fd27971a700 1 --2- 172.21.15.76:0/1057913672 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559e8b5b2a20 0x559e8b5c2480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:09.100 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.092+0000 7fd27971a700 1 -- 172.21.15.76:0/1057913672 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559e8b5b2060 msgr2=0x559e8b5bb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:48:09.100 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.092+0000 7fd27971a700 1 --2- 172.21.15.76:0/1057913672 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559e8b5b2060 0x559e8b5bb440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:09.100 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.092+0000 7fd27971a700 1 -- 172.21.15.76:0/1057913672 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd274108370 con 0x559e8b5b1700 2024-06-02T04:48:09.100 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.092+0000 7fd279f1b700 1 --2- 172.21.15.76:0/1057913672 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559e8b5b2a20 0x559e8b5c2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:48:09.100 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.092+0000 7fd278f19700 1 --2- 172.21.15.76:0/1057913672 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559e8b5b2060 0x559e8b5bb440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:48:09.100 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.092+0000 7fd27971a700 1 --2- 172.21.15.76:0/1057913672 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559e8b5b1700 0x559e8b5baf00 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd270096430 tx=0x7fd270004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a5e7558755a91c8 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:09.100 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.092+0000 7fd25cff9700 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-06-02T04:48:09.101 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.092+0000 7fd25cff9700 1 -- 172.21.15.76:0/1057913672 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2700999c0 con 0x559e8b5b1700 2024-06-02T04:48:09.101 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.092+0000 7fd25cff9700 1 -- 172.21.15.76:0/1057913672 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(80..80 src has 1..80) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fd27009d7f0 con 0x559e8b5b1700 2024-06-02T04:48:09.101 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.092+0000 7fd287b39b80 1 -- 172.21.15.76:0/1057913672 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559e8b458220 con 0x559e8b5b1700 2024-06-02T04:48:09.101 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.092+0000 7fd25cff9700 1 -- 172.21.15.76:0/1057913672 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd2700a1e40 con 0x559e8b5b1700 2024-06-02T04:48:09.101 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.092+0000 7fd287b39b80 10 client.14736 fetch_fsmap learned FSMap version 17 2024-06-02T04:48:09.101 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.092+0000 7fd287b39b80 1 -- 172.21.15.76:0/1057913672 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) v3 -- 0x559e8b32cb10 con 0x559e8b5b1700 2024-06-02T04:48:09.101 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.092+0000 7fd25cff9700 1 -- 172.21.15.76:0/1057913672 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd2700b6080 con 0x559e8b5b1700 2024-06-02T04:48:09.101 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.092+0000 7fd25cff9700 1 -- 172.21.15.76:0/1057913672 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 17) v1 ==== 7482+0+0 (secure 0 0 0) 0x7fd2700a19b0 con 0x559e8b5b1700 2024-06-02T04:48:09.101 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.092+0000 7fd287b39b80 10 client.14736 fetch_fsmap finished waiting for FSMap version 17 2024-06-02T04:48:09.101 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.092+0000 7fd287b39b80 10 client.14736 resolve_mds: resolved name 'b' to daemon mds.b 2024-06-02T04:48:09.101 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.092+0000 7fd287b39b80 20 client.14736 populate_metadata read hostname 'smithi076' 2024-06-02T04:48:09.101 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.092+0000 7fd287b39b80 1 --2- 172.21.15.76:0/1057913672 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x559e8b5c60c0 0x559e8b5cb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:09.101 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.092+0000 7fd287b39b80 4 client.14736 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T04:48:09.101 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.092+0000 7fd287b39b80 1 -- 172.21.15.76:0/1057913672 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559e8b57e7c0 con 0x559e8b5c60c0 2024-06-02T04:48:09.102 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.093+0000 7fd278f19700 1 --2- 172.21.15.76:0/1057913672 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x559e8b5c60c0 0x559e8b5cb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:09.102 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.093+0000 7fd278f19700 1 --2- 172.21.15.76:0/1057913672 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x559e8b5c60c0 0x559e8b5cb3e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=856c77fd12c338f server_cookie=4f6592036d15578d in_seq=0 out_seq=0 2024-06-02T04:48:09.102 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.093+0000 7fd25cff9700 10 client.14736 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:48:09.102 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.094+0000 7fd25cff9700 1 -- 172.21.15.76:0/1057913672 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x559e8b57e7c0 con 0x559e8b5c60c0 2024-06-02T04:48:09.102 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.094+0000 7fd25cff9700 10 client.14736 handle_command_reply: tid=0 2024-06-02T04:48:09.102 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.094+0000 7fd287b39b80 1 client.14736 shutdown 2024-06-02T04:48:09.102 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.094+0000 7fd287b39b80 1 -- 172.21.15.76:0/1057913672 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559e8b5b1700 msgr2=0x559e8b5baf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:09.102 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.094+0000 7fd287b39b80 1 --2- 172.21.15.76:0/1057913672 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559e8b5b1700 0x559e8b5baf00 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd270096430 tx=0x7fd270004430 comp rx=0 tx=0).stop 2024-06-02T04:48:09.102 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.094+0000 7fd287b39b80 1 -- 172.21.15.76:0/1057913672 shutdown_connections 2024-06-02T04:48:09.102 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.094+0000 7fd287b39b80 1 --2- 172.21.15.76:0/1057913672 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x559e8b5c60c0 0x559e8b5cb3e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:09.102 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.094+0000 7fd287b39b80 1 --2- 172.21.15.76:0/1057913672 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559e8b5b2a20 0x559e8b5c2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:09.102 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.094+0000 7fd287b39b80 1 --2- 172.21.15.76:0/1057913672 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559e8b5b1700 0x559e8b5baf00 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:09.102 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.094+0000 7fd25cff9700 0 client.14736 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:48:09.103 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.094+0000 7fd287b39b80 1 --2- 172.21.15.76:0/1057913672 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559e8b5b2060 0x559e8b5bb440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:09.103 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.094+0000 7fd287b39b80 1 -- 172.21.15.76:0/1057913672 >> 172.21.15.76:0/1057913672 conn(0x559e8b50d1c0 msgr2=0x559e8b5a9550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:09.103 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.094+0000 7fd287b39b80 1 -- 172.21.15.76:0/1057913672 shutdown_connections 2024-06-02T04:48:09.103 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.094+0000 7fd287b39b80 1 -- 172.21.15.76:0/1057913672 wait complete. 2024-06-02T04:48:09.103 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.094+0000 7fd287b39b80 20 client.14736 trim_cache size 0 max 16384 2024-06-02T04:48:09.103 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:08 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/2604113958' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:48:09.103 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:08 smithi119 ceph-mon[46633]: pgmap v221: 129 pgs: 9 creating+peering, 14 unknown, 106 active+clean; 579 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s wr, 10 op/s 2024-06-02T04:48:09.103 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:08 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/2760148877' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:48:09.103 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:08 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/2183410166' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:48:09.118 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.112+0000 7fd287b39b80 1 Processor -- start 2024-06-02T04:48:09.118 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.112+0000 7fd287b39b80 1 -- start start 2024-06-02T04:48:09.118 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.112+0000 7fd287b39b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559e8b5b1700 0x559e8b5b1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:09.118 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.112+0000 7fd287b39b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559e8b5b2060 0x559e8b5c2440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:09.118 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.112+0000 7fd287b39b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559e8b5b2a20 0x559e8b5ba410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:09.118 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.112+0000 7fd287b39b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e8b57e7c0 con 0x559e8b5b2a20 2024-06-02T04:48:09.119 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.112+0000 7fd287b39b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e8b4bd2b0 con 0x559e8b5b1700 2024-06-02T04:48:09.119 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.112+0000 7fd287b39b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e8b4f8150 con 0x559e8b5b2060 2024-06-02T04:48:09.119 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.112+0000 7fd279f1b700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559e8b5b2a20 0x559e8b5ba410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:09.119 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.113+0000 7fd279f1b700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559e8b5b2a20 0x559e8b5ba410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:52988/0 (socket says 172.21.15.76:52988) 2024-06-02T04:48:09.119 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.113+0000 7fd279f1b700 1 -- 172.21.15.76:0/1496481385 learned_addr learned my addr 172.21.15.76:0/1496481385 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:48:09.119 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.113+0000 7fd27971a700 1 --2- 172.21.15.76:0/1496481385 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559e8b5b1700 0x559e8b5b1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:09.119 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.113+0000 7fd278f19700 1 --2- 172.21.15.76:0/1496481385 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559e8b5b2060 0x559e8b5c2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:09.119 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.113+0000 7fd279f1b700 1 -- 172.21.15.76:0/1496481385 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559e8b5b2060 msgr2=0x559e8b5c2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:48:09.119 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.113+0000 7fd279f1b700 1 --2- 172.21.15.76:0/1496481385 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559e8b5b2060 0x559e8b5c2440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:09.119 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.113+0000 7fd279f1b700 1 -- 172.21.15.76:0/1496481385 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559e8b5b1700 msgr2=0x559e8b5b1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:48:09.120 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.113+0000 7fd279f1b700 1 --2- 172.21.15.76:0/1496481385 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559e8b5b1700 0x559e8b5b1ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:09.120 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.113+0000 7fd279f1b700 1 -- 172.21.15.76:0/1496481385 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559e8b4c5510 con 0x559e8b5b2a20 2024-06-02T04:48:09.120 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.113+0000 7fd278f19700 1 --2- 172.21.15.76:0/1496481385 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559e8b5b2060 0x559e8b5c2440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:48:09.120 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.113+0000 7fd279f1b700 1 --2- 172.21.15.76:0/1496481385 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559e8b5b2a20 0x559e8b5ba410 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd26c008550 tx=0x7fd26c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9cf6164d4cca893 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:09.120 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.113+0000 7fd25ffff700 1 -- 172.21.15.76:0/1496481385 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd26c016670 con 0x559e8b5b2a20 2024-06-02T04:48:09.120 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.113+0000 7fd25ffff700 1 -- 172.21.15.76:0/1496481385 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd26c00f070 con 0x559e8b5b2a20 2024-06-02T04:48:09.120 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.113+0000 7fd25ffff700 1 -- 172.21.15.76:0/1496481385 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd26c007b60 con 0x559e8b5b2a20 2024-06-02T04:48:09.120 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.114+0000 7fd287b39b80 1 -- 172.21.15.76:0/1496481385 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559e8b5b2a20 msgr2=0x559e8b5ba410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:09.120 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.114+0000 7fd287b39b80 1 --2- 172.21.15.76:0/1496481385 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559e8b5b2a20 0x559e8b5ba410 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd26c008550 tx=0x7fd26c00b040 comp rx=0 tx=0).stop 2024-06-02T04:48:09.120 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.114+0000 7fd287b39b80 1 -- 172.21.15.76:0/1496481385 shutdown_connections 2024-06-02T04:48:09.120 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.114+0000 7fd287b39b80 1 --2- 172.21.15.76:0/1496481385 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559e8b5b2a20 0x559e8b5ba410 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:09.120 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.114+0000 7fd287b39b80 1 --2- 172.21.15.76:0/1496481385 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559e8b5b1700 0x559e8b5b1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:09.120 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.114+0000 7fd287b39b80 1 --2- 172.21.15.76:0/1496481385 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559e8b5b2060 0x559e8b5c2440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:09.121 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.114+0000 7fd287b39b80 1 -- 172.21.15.76:0/1496481385 >> 172.21.15.76:0/1496481385 conn(0x559e8b50d1c0 msgr2=0x559e8b5b2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:09.121 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.114+0000 7fd287b39b80 1 -- 172.21.15.76:0/1496481385 shutdown_connections 2024-06-02T04:48:09.121 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.114+0000 7fd287b39b80 1 -- 172.21.15.76:0/1496481385 wait complete. 2024-06-02T04:48:09.121 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.114+0000 7fd287b39b80 1 -- start start 2024-06-02T04:48:09.121 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.114+0000 7fd287b39b80 1 Processor -- start 2024-06-02T04:48:09.121 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.114+0000 7fd287b39b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559e8b5b1700 0x559e8b5bcd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:09.121 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.114+0000 7fd287b39b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559e8b5b2060 0x559e8b5c2250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:09.121 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.114+0000 7fd287b39b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559e8b5b2a20 0x559e8b5bd250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:09.121 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.114+0000 7fd287b39b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e8b5bd790 con 0x559e8b5b2060 2024-06-02T04:48:09.121 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.114+0000 7fd287b39b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e8b5bd900 con 0x559e8b5b2a20 2024-06-02T04:48:09.121 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.114+0000 7fd287b39b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e8b61d0a0 con 0x559e8b5b1700 2024-06-02T04:48:09.121 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.115+0000 7fd287b39b80 10 client.0 _ll_register_callbacks cb 0x559e8b4a4ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:48:09.122 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.115+0000 7fd278f19700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559e8b5b2060 0x559e8b5c2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:09.122 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.115+0000 7fd278f19700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559e8b5b2060 0x559e8b5c2250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:52998/0 (socket says 172.21.15.76:52998) 2024-06-02T04:48:09.122 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.115+0000 7fd278f19700 1 -- 172.21.15.76:0/2778345536 learned_addr learned my addr 172.21.15.76:0/2778345536 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:48:09.122 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.115+0000 7fd279f1b700 1 --2- 172.21.15.76:0/2778345536 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559e8b5b2a20 0x559e8b5bd250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:09.122 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.115+0000 7fd27971a700 1 --2- 172.21.15.76:0/2778345536 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559e8b5b1700 0x559e8b5bcd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:09.122 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.115+0000 7fd278f19700 1 -- 172.21.15.76:0/2778345536 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559e8b5b1700 msgr2=0x559e8b5bcd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:48:09.122 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.115+0000 7fd278f19700 1 --2- 172.21.15.76:0/2778345536 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559e8b5b1700 0x559e8b5bcd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:09.122 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.115+0000 7fd278f19700 1 -- 172.21.15.76:0/2778345536 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559e8b5b2a20 msgr2=0x559e8b5bd250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:48:09.122 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.115+0000 7fd278f19700 1 --2- 172.21.15.76:0/2778345536 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559e8b5b2a20 0x559e8b5bd250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:09.122 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.115+0000 7fd278f19700 1 -- 172.21.15.76:0/2778345536 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd26c0092f0 con 0x559e8b5b2060 2024-06-02T04:48:09.122 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.115+0000 7fd27971a700 1 --2- 172.21.15.76:0/2778345536 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559e8b5b1700 0x559e8b5bcd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:48:09.122 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.115+0000 7fd278f19700 1 --2- 172.21.15.76:0/2778345536 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559e8b5b2060 0x559e8b5c2250 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd26402e000 tx=0x7fd264005f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e46aaeec9e70cfa server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:09.123 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.115+0000 7fd25cff9700 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-06-02T04:48:09.123 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.115+0000 7fd25cff9700 1 -- 172.21.15.76:0/2778345536 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd26401d040 con 0x559e8b5b2060 2024-06-02T04:48:09.123 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.115+0000 7fd25cff9700 1 -- 172.21.15.76:0/2778345536 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(80..80 src has 1..80) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fd264003760 con 0x559e8b5b2060 2024-06-02T04:48:09.123 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.115+0000 7fd287b39b80 1 -- 172.21.15.76:0/2778345536 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559e8b5b9f10 con 0x559e8b5b2060 2024-06-02T04:48:09.123 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.115+0000 7fd25cff9700 1 -- 172.21.15.76:0/2778345536 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd264035040 con 0x559e8b5b2060 2024-06-02T04:48:09.123 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.115+0000 7fd287b39b80 10 client.14742 fetch_fsmap learned FSMap version 17 2024-06-02T04:48:09.123 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.115+0000 7fd287b39b80 1 -- 172.21.15.76:0/2778345536 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) v3 -- 0x559e8b384c80 con 0x559e8b5b2060 2024-06-02T04:48:09.123 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.115+0000 7fd25cff9700 1 -- 172.21.15.76:0/2778345536 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x559e8b5b9f10 con 0x559e8b5b2060 2024-06-02T04:48:09.123 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.116+0000 7fd25cff9700 1 -- 172.21.15.76:0/2778345536 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 17) v1 ==== 7482+0+0 (secure 0 0 0) 0x7fd264030620 con 0x559e8b5b2060 2024-06-02T04:48:09.123 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.116+0000 7fd287b39b80 10 client.14742 fetch_fsmap finished waiting for FSMap version 17 2024-06-02T04:48:09.123 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.116+0000 7fd287b39b80 10 client.14742 resolve_mds: resolved name 'b' to daemon mds.b 2024-06-02T04:48:09.123 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.116+0000 7fd287b39b80 20 client.14742 populate_metadata read hostname 'smithi076' 2024-06-02T04:48:09.123 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.116+0000 7fd287b39b80 1 --2- 172.21.15.76:0/2778345536 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x559e8b621ab0 0x559e8b61e400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:09.124 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.116+0000 7fd287b39b80 4 client.14742 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "status"}] 2024-06-02T04:48:09.124 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.116+0000 7fd287b39b80 1 -- 172.21.15.76:0/2778345536 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7fd264005530 con 0x559e8b621ab0 2024-06-02T04:48:09.124 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.116+0000 7fd27971a700 1 --2- 172.21.15.76:0/2778345536 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x559e8b621ab0 0x559e8b61e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:09.124 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.116+0000 7fd25cff9700 10 client.14742 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:48:09.124 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.116+0000 7fd27971a700 1 --2- 172.21.15.76:0/2778345536 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x559e8b621ab0 0x559e8b61e400 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a774f31640353f51 server_cookie=c050618db92af128 in_seq=0 out_seq=0 2024-06-02T04:48:09.124 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.116+0000 7fd25cff9700 1 -- 172.21.15.76:0/2778345536 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+326 (crc 0 0 0) 0x7fd264005530 con 0x559e8b621ab0 2024-06-02T04:48:09.124 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.116+0000 7fd25cff9700 10 client.14742 handle_command_reply: tid=0 2024-06-02T04:48:09.124 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.116+0000 7fd287b39b80 1 client.14742 shutdown 2024-06-02T04:48:09.124 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.117+0000 7fd287b39b80 1 -- 172.21.15.76:0/2778345536 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559e8b5b2060 msgr2=0x559e8b5c2250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:09.124 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.117+0000 7fd287b39b80 1 --2- 172.21.15.76:0/2778345536 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559e8b5b2060 0x559e8b5c2250 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd26402e000 tx=0x7fd264005f00 comp rx=0 tx=0).stop 2024-06-02T04:48:09.124 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.117+0000 7fd287b39b80 1 -- 172.21.15.76:0/2778345536 shutdown_connections 2024-06-02T04:48:09.124 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.117+0000 7fd287b39b80 1 --2- 172.21.15.76:0/2778345536 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x559e8b621ab0 0x559e8b61e400 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:09.124 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.117+0000 7fd287b39b80 1 --2- 172.21.15.76:0/2778345536 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559e8b5b2a20 0x559e8b5bd250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:09.125 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.117+0000 7fd25cff9700 0 client.14742 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:48:09.125 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.117+0000 7fd287b39b80 1 --2- 172.21.15.76:0/2778345536 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559e8b5b1700 0x559e8b5bcd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:09.125 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.117+0000 7fd287b39b80 1 --2- 172.21.15.76:0/2778345536 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559e8b5b2060 0x559e8b5c2250 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:09.125 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.117+0000 7fd287b39b80 1 -- 172.21.15.76:0/2778345536 >> 172.21.15.76:0/2778345536 conn(0x559e8b50d1c0 msgr2=0x559e8b5ba410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:09.125 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.117+0000 7fd287b39b80 1 -- 172.21.15.76:0/2778345536 shutdown_connections 2024-06-02T04:48:09.125 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.117+0000 7fd287b39b80 1 -- 172.21.15.76:0/2778345536 wait complete. 2024-06-02T04:48:09.125 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.117+0000 7fd287b39b80 20 client.14742 trim_cache size 0 max 16384 2024-06-02T04:48:09.125 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-06-02T04:48:09.125 INFO:teuthology.orchestra.run.smithi076.stdout: "cluster_fsid": "60ab6d30-209a-11ef-bc9b-c7b262605968", 2024-06-02T04:48:09.125 INFO:teuthology.orchestra.run.smithi076.stdout: "whoami": 0, 2024-06-02T04:48:09.126 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 24491, 2024-06-02T04:48:09.126 INFO:teuthology.orchestra.run.smithi076.stdout: "want_state": "up:active", 2024-06-02T04:48:09.126 INFO:teuthology.orchestra.run.smithi076.stdout: "state": "up:active", 2024-06-02T04:48:09.126 INFO:teuthology.orchestra.run.smithi076.stdout: "fs_name": "cephfs", 2024-06-02T04:48:09.126 INFO:teuthology.orchestra.run.smithi076.stdout: "rank_uptime": 6.4515053069999997, 2024-06-02T04:48:09.126 INFO:teuthology.orchestra.run.smithi076.stdout: "mdsmap_epoch": 17, 2024-06-02T04:48:09.126 INFO:teuthology.orchestra.run.smithi076.stdout: "osdmap_epoch": 80, 2024-06-02T04:48:09.126 INFO:teuthology.orchestra.run.smithi076.stdout: "osdmap_epoch_barrier": 79, 2024-06-02T04:48:09.126 INFO:teuthology.orchestra.run.smithi076.stdout: "uptime": 12.008868758 2024-06-02T04:48:09.126 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-06-02T04:48:09.127 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.117+0000 7fd27b97e700 1 -- 172.21.15.76:0/2448752599 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fd2600a1120 msgr2=0x7fd2600a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:09.127 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.117+0000 7fd27b97e700 1 --2- 172.21.15.76:0/2448752599 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fd2600a1120 0x7fd2600a35e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd26400bf10 tx=0x7fd26400b540 comp rx=0 tx=0).stop 2024-06-02T04:48:09.127 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.117+0000 7fd27b97e700 1 -- 172.21.15.76:0/2448752599 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd2740ff5e0 msgr2=0x7fd274195d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:09.127 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.117+0000 7fd27b97e700 1 --2- 172.21.15.76:0/2448752599 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd2740ff5e0 0x7fd274195d50 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd27000c970 tx=0x7fd27000cd30 comp rx=0 tx=0).stop 2024-06-02T04:48:09.127 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.117+0000 7fd27b97e700 1 -- 172.21.15.76:0/2448752599 shutdown_connections 2024-06-02T04:48:09.127 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.117+0000 7fd27b97e700 1 --2- 172.21.15.76:0/2448752599 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd274101170 0x7fd27419d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:09.127 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.117+0000 7fd27b97e700 1 --2- 172.21.15.76:0/2448752599 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd2740ff5e0 0x7fd274195d50 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:09.127 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.117+0000 7fd27b97e700 1 --2- 172.21.15.76:0/2448752599 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fd2600a1120 0x7fd2600a35e0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:09.128 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.117+0000 7fd27b97e700 1 --2- 172.21.15.76:0/2448752599 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd2741007d0 0x7fd274196290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:09.128 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.117+0000 7fd27b97e700 1 -- 172.21.15.76:0/2448752599 >> 172.21.15.76:0/2448752599 conn(0x7fd2740fab50 msgr2=0x7fd2740fbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:09.128 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.117+0000 7fd27b97e700 1 -- 172.21.15.76:0/2448752599 shutdown_connections 2024-06-02T04:48:09.128 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:09.117+0000 7fd27b97e700 1 -- 172.21.15.76:0/2448752599 wait complete. 2024-06-02T04:48:09.130 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-06-02T04:48:09.130 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-06-02T04:48:09.130 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell --fsid 60ab6d30-209a-11ef-bc9b-c7b262605968 -- ceph fs ls 2024-06-02T04:48:09.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:08 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/2604113958' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:48:09.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:08 smithi192 ceph-mon[47933]: pgmap v221: 129 pgs: 9 creating+peering, 14 unknown, 106 active+clean; 579 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s wr, 10 op/s 2024-06-02T04:48:09.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:08 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/2760148877' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:48:09.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:08 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/2183410166' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:48:09.347 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T04:48:09.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:09 smithi076 ceph-mon[42935]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-06-02T04:48:09.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:09 smithi076 ceph-mon[42935]: Cluster is now healthy 2024-06-02T04:48:09.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:09 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/2658726283' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:48:10.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:09 smithi119 ceph-mon[46633]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-06-02T04:48:10.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:09 smithi119 ceph-mon[46633]: Cluster is now healthy 2024-06-02T04:48:10.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:09 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/2658726283' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:48:10.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:09 smithi192 ceph-mon[47933]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-06-02T04:48:10.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:09 smithi192 ceph-mon[47933]: Cluster is now healthy 2024-06-02T04:48:10.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:09 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/2658726283' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:48:10.397 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:10.396+0000 7f91361f5700 1 -- 172.21.15.76:0/1362266904 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9130104650 msgr2=0x7f9130104a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:10.397 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:10.396+0000 7f91361f5700 1 --2- 172.21.15.76:0/1362266904 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9130104650 0x7f9130104a30 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f911800aaa0 tx=0x7f911800adb0 comp rx=0 tx=0).stop 2024-06-02T04:48:10.397 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:10.396+0000 7f91361f5700 1 -- 172.21.15.76:0/1362266904 shutdown_connections 2024-06-02T04:48:10.397 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:10.396+0000 7f91361f5700 1 --2- 172.21.15.76:0/1362266904 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9130100300 0x7f913010c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:10.397 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:10.396+0000 7f91361f5700 1 --2- 172.21.15.76:0/1362266904 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9130104650 0x7f9130104a30 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:10.397 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:10.396+0000 7f91361f5700 1 --2- 172.21.15.76:0/1362266904 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f91300ff940 0x7f91300ffdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:10.397 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:10.396+0000 7f91361f5700 1 -- 172.21.15.76:0/1362266904 >> 172.21.15.76:0/1362266904 conn(0x7f9130075260 msgr2=0x7f9130075670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:10.397 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:10.396+0000 7f91361f5700 1 -- 172.21.15.76:0/1362266904 shutdown_connections 2024-06-02T04:48:10.397 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:10.396+0000 7f91361f5700 1 -- 172.21.15.76:0/1362266904 wait complete. 2024-06-02T04:48:10.397 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:10.396+0000 7f91361f5700 1 Processor -- start 2024-06-02T04:48:10.398 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:10.397+0000 7f91361f5700 1 -- start start 2024-06-02T04:48:10.399 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:10.397+0000 7f91361f5700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f91300ff940 0x7f9130197310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:10.399 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:10.397+0000 7f91361f5700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9130100300 0x7f9130197850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:10.400 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:10.397+0000 7f91361f5700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9130104650 0x7f913019bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:10.400 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:10.397+0000 7f91361f5700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f913019c1c0 con 0x7f91300ff940 2024-06-02T04:48:10.400 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:10.397+0000 7f91361f5700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f913019c330 con 0x7f9130104650 2024-06-02T04:48:10.400 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:10.397+0000 7f91361f5700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f913019c4f0 con 0x7f9130100300 2024-06-02T04:48:10.400 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:10.397+0000 7f912f7fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f91300ff940 0x7f9130197310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:10.400 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:10.397+0000 7f912f7fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f91300ff940 0x7f9130197310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:53026/0 (socket says 172.21.15.76:53026) 2024-06-02T04:48:10.400 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:10.397+0000 7f912f7fe700 1 -- 172.21.15.76:0/2436371287 learned_addr learned my addr 172.21.15.76:0/2436371287 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:48:10.400 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:10.397+0000 7f912effd700 1 --2- 172.21.15.76:0/2436371287 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9130100300 0x7f9130197850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:10.400 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:10.397+0000 7f912ffff700 1 --2- 172.21.15.76:0/2436371287 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9130104650 0x7f913019bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:10.400 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:10.397+0000 7f912f7fe700 1 -- 172.21.15.76:0/2436371287 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9130100300 msgr2=0x7f9130197850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:10.400 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:10.397+0000 7f912f7fe700 1 --2- 172.21.15.76:0/2436371287 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9130100300 0x7f9130197850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:10.400 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:10.397+0000 7f912f7fe700 1 -- 172.21.15.76:0/2436371287 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9130104650 msgr2=0x7f913019bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:10.401 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:10.397+0000 7f912f7fe700 1 --2- 172.21.15.76:0/2436371287 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9130104650 0x7f913019bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:10.401 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:10.397+0000 7f912f7fe700 1 -- 172.21.15.76:0/2436371287 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f911800a700 con 0x7f91300ff940 2024-06-02T04:48:10.401 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:10.397+0000 7f912ffff700 1 --2- 172.21.15.76:0/2436371287 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9130104650 0x7f913019bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:48:10.401 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:10.397+0000 7f912f7fe700 1 --2- 172.21.15.76:0/2436371287 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f91300ff940 0x7f9130197310 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f9118003b90 tx=0x7f911800e450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:10.401 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:10.398+0000 7f912cff9700 1 -- 172.21.15.76:0/2436371287 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f911800e970 con 0x7f91300ff940 2024-06-02T04:48:10.401 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:10.398+0000 7f91361f5700 1 -- 172.21.15.76:0/2436371287 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f913019c770 con 0x7f91300ff940 2024-06-02T04:48:10.401 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:10.398+0000 7f912cff9700 1 -- 172.21.15.76:0/2436371287 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f91180050d0 con 0x7f91300ff940 2024-06-02T04:48:10.401 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:10.398+0000 7f912cff9700 1 -- 172.21.15.76:0/2436371287 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91180168b0 con 0x7f91300ff940 2024-06-02T04:48:10.401 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:10.398+0000 7f91361f5700 1 -- 172.21.15.76:0/2436371287 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91301a4030 con 0x7f91300ff940 2024-06-02T04:48:10.401 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:10.399+0000 7f91361f5700 1 -- 172.21.15.76:0/2436371287 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9130107c20 con 0x7f91300ff940 2024-06-02T04:48:10.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:10.400+0000 7f912cff9700 1 -- 172.21.15.76:0/2436371287 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f9118005240 con 0x7f91300ff940 2024-06-02T04:48:10.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:10.400+0000 7f912cff9700 1 --2- 172.21.15.76:0/2436371287 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f911c0a1120 0x7f911c0a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:10.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:10.400+0000 7f912effd700 1 --2- 172.21.15.76:0/2436371287 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f911c0a1120 0x7f911c0a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:10.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:10.400+0000 7f912cff9700 1 -- 172.21.15.76:0/2436371287 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f9118012070 con 0x7f91300ff940 2024-06-02T04:48:10.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:10.401+0000 7f912effd700 1 --2- 172.21.15.76:0/2436371287 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f911c0a1120 0x7f911c0a35e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f9130198820 tx=0x7f912000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:10.404 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:10.404+0000 7f912cff9700 1 -- 172.21.15.76:0/2436371287 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f91180981d0 con 0x7f91300ff940 2024-06-02T04:48:10.641 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:10.639+0000 7f91361f5700 1 -- 172.21.15.76:0/2436371287 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f91301985d0 con 0x7f91300ff940 2024-06-02T04:48:10.641 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:10.639+0000 7f912cff9700 1 -- 172.21.15.76:0/2436371287 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+88 (secure 0 0 0) 0x7f911809b7f0 con 0x7f91300ff940 2024-06-02T04:48:10.641 INFO:teuthology.orchestra.run.smithi076.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-06-02T04:48:10.642 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:10.641+0000 7f91361f5700 1 -- 172.21.15.76:0/2436371287 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f911c0a1120 msgr2=0x7f911c0a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:10.643 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:10.641+0000 7f91361f5700 1 --2- 172.21.15.76:0/2436371287 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f911c0a1120 0x7f911c0a35e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f9130198820 tx=0x7f912000b410 comp rx=0 tx=0).stop 2024-06-02T04:48:10.643 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:10.641+0000 7f91361f5700 1 -- 172.21.15.76:0/2436371287 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f91300ff940 msgr2=0x7f9130197310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:10.643 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:10.641+0000 7f91361f5700 1 --2- 172.21.15.76:0/2436371287 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f91300ff940 0x7f9130197310 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f9118003b90 tx=0x7f911800e450 comp rx=0 tx=0).stop 2024-06-02T04:48:10.643 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:10.641+0000 7f91361f5700 1 -- 172.21.15.76:0/2436371287 shutdown_connections 2024-06-02T04:48:10.643 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:10.641+0000 7f91361f5700 1 --2- 172.21.15.76:0/2436371287 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f911c0a1120 0x7f911c0a35e0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:10.643 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:10.641+0000 7f91361f5700 1 --2- 172.21.15.76:0/2436371287 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9130104650 0x7f913019bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:10.643 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:10.641+0000 7f91361f5700 1 --2- 172.21.15.76:0/2436371287 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f91300ff940 0x7f9130197310 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:10.644 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:10.641+0000 7f91361f5700 1 --2- 172.21.15.76:0/2436371287 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9130100300 0x7f9130197850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:10.644 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:10.641+0000 7f91361f5700 1 -- 172.21.15.76:0/2436371287 >> 172.21.15.76:0/2436371287 conn(0x7f9130075260 msgr2=0x7f91300fda30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:10.644 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:10.642+0000 7f91361f5700 1 -- 172.21.15.76:0/2436371287 shutdown_connections 2024-06-02T04:48:10.644 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:10.642+0000 7f91361f5700 1 -- 172.21.15.76:0/2436371287 wait complete. 2024-06-02T04:48:10.981 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:10 smithi076 ceph-mon[42935]: pgmap v222: 129 pgs: 9 creating+peering, 7 unknown, 113 active+clean; 579 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 6 op/s 2024-06-02T04:48:10.981 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:10 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/2436371287' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-06-02T04:48:11.025 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-06-02T04:48:11.025 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-06-02T04:48:11.026 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi076.front.sepia.ceph.com 2024-06-02T04:48:11.026 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-06-02T04:48:11.026 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-06-02T04:48:11.026 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-06-02T04:48:11.026 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-06-02T04:48:11.026 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-06-02T04:48:11.026 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-06-02T04:48:11.026 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T04:48:11.026 DEBUG:teuthology.orchestra.run.smithi076:> ip addr 2024-06-02T04:48:11.045 INFO:teuthology.orchestra.run.smithi076.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-06-02T04:48:11.046 INFO:teuthology.orchestra.run.smithi076.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-06-02T04:48:11.046 INFO:teuthology.orchestra.run.smithi076.stdout: inet 127.0.0.1/8 scope host lo 2024-06-02T04:48:11.046 INFO:teuthology.orchestra.run.smithi076.stdout: valid_lft forever preferred_lft forever 2024-06-02T04:48:11.046 INFO:teuthology.orchestra.run.smithi076.stdout: inet6 ::1/128 scope host 2024-06-02T04:48:11.046 INFO:teuthology.orchestra.run.smithi076.stdout: valid_lft forever preferred_lft forever 2024-06-02T04:48:11.046 INFO:teuthology.orchestra.run.smithi076.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-02T04:48:11.046 INFO:teuthology.orchestra.run.smithi076.stdout: link/ether 0c:c4:7a:d8:da:66 brd ff:ff:ff:ff:ff:ff 2024-06-02T04:48:11.046 INFO:teuthology.orchestra.run.smithi076.stdout: altname enp7s0f0 2024-06-02T04:48:11.046 INFO:teuthology.orchestra.run.smithi076.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-02T04:48:11.046 INFO:teuthology.orchestra.run.smithi076.stdout: link/ether 0c:c4:7a:d8:da:67 brd ff:ff:ff:ff:ff:ff 2024-06-02T04:48:11.046 INFO:teuthology.orchestra.run.smithi076.stdout: altname enp7s0f1 2024-06-02T04:48:11.046 INFO:teuthology.orchestra.run.smithi076.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-02T04:48:11.046 INFO:teuthology.orchestra.run.smithi076.stdout: link/ether 0c:c4:7a:8f:47:e0 brd ff:ff:ff:ff:ff:ff 2024-06-02T04:48:11.047 INFO:teuthology.orchestra.run.smithi076.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-06-02T04:48:11.047 INFO:teuthology.orchestra.run.smithi076.stdout: link/ether 0c:c4:7a:8f:47:e1 brd ff:ff:ff:ff:ff:ff 2024-06-02T04:48:11.047 INFO:teuthology.orchestra.run.smithi076.stdout: inet 172.21.15.76/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-06-02T04:48:11.047 INFO:teuthology.orchestra.run.smithi076.stdout: valid_lft 41895sec preferred_lft 41895sec 2024-06-02T04:48:11.047 INFO:teuthology.orchestra.run.smithi076.stdout: inet6 fe80::e45d:bce6:31a8:760b/64 scope link noprefixroute 2024-06-02T04:48:11.047 INFO:teuthology.orchestra.run.smithi076.stdout: valid_lft forever preferred_lft forever 2024-06-02T04:48:11.048 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-06-02T04:48:11.048 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T04:48:11.048 DEBUG:teuthology.orchestra.run.smithi076:> (cd / && exec bash -c ' 2024-06-02T04:48:11.048 DEBUG:teuthology.orchestra.run.smithi076:> set -e 2024-06-02T04:48:11.048 DEBUG:teuthology.orchestra.run.smithi076:> sudo ip link add name ceph-brx type bridge 2024-06-02T04:48:11.048 DEBUG:teuthology.orchestra.run.smithi076:> sudo ip addr flush dev ceph-brx 2024-06-02T04:48:11.048 DEBUG:teuthology.orchestra.run.smithi076:> sudo ip link set ceph-brx up 2024-06-02T04:48:11.048 DEBUG:teuthology.orchestra.run.smithi076:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-06-02T04:48:11.048 DEBUG:teuthology.orchestra.run.smithi076:> ') 2024-06-02T04:48:11.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:10 smithi119 ceph-mon[46633]: pgmap v222: 129 pgs: 9 creating+peering, 7 unknown, 113 active+clean; 579 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 6 op/s 2024-06-02T04:48:11.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:10 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/2436371287' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-06-02T04:48:11.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:10 smithi192 ceph-mon[47933]: pgmap v222: 129 pgs: 9 creating+peering, 7 unknown, 113 active+clean; 579 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 6 op/s 2024-06-02T04:48:11.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:10 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/2436371287' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-06-02T04:48:11.225 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T04:48:11.225 DEBUG:teuthology.orchestra.run.smithi076:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-06-02T04:48:11.256 INFO:teuthology.orchestra.run.smithi076.stdout:1 2024-06-02T04:48:11.257 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T04:48:11.257 DEBUG:teuthology.orchestra.run.smithi076:> route 2024-06-02T04:48:11.334 INFO:teuthology.orchestra.run.smithi076.stdout:Kernel IP routing table 2024-06-02T04:48:11.334 INFO:teuthology.orchestra.run.smithi076.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-06-02T04:48:11.334 INFO:teuthology.orchestra.run.smithi076.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-06-02T04:48:11.335 INFO:teuthology.orchestra.run.smithi076.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-06-02T04:48:11.335 INFO:teuthology.orchestra.run.smithi076.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-06-02T04:48:11.335 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T04:48:11.336 DEBUG:teuthology.orchestra.run.smithi076:> (cd / && exec bash -c ' 2024-06-02T04:48:11.336 DEBUG:teuthology.orchestra.run.smithi076:> set -e 2024-06-02T04:48:11.336 DEBUG:teuthology.orchestra.run.smithi076:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-06-02T04:48:11.336 DEBUG:teuthology.orchestra.run.smithi076:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-06-02T04:48:11.337 DEBUG:teuthology.orchestra.run.smithi076:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-06-02T04:48:11.337 DEBUG:teuthology.orchestra.run.smithi076:> ') 2024-06-02T04:48:11.623 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T04:48:11.623 DEBUG:teuthology.orchestra.run.smithi076:> ip netns list 2024-06-02T04:48:11.642 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T04:48:11.642 DEBUG:teuthology.orchestra.run.smithi076:> ip netns list-id 2024-06-02T04:48:11.699 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T04:48:11.699 DEBUG:teuthology.orchestra.run.smithi076:> (cd / && exec bash -c ' 2024-06-02T04:48:11.699 DEBUG:teuthology.orchestra.run.smithi076:> set -e 2024-06-02T04:48:11.699 DEBUG:teuthology.orchestra.run.smithi076:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-06-02T04:48:11.700 DEBUG:teuthology.orchestra.run.smithi076:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-06-02T04:48:11.700 DEBUG:teuthology.orchestra.run.smithi076:> ') 2024-06-02T04:48:11.797 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-06-02T04:48:11.797 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T04:48:11.797 DEBUG:teuthology.orchestra.run.smithi076:> (cd / && exec bash -c ' 2024-06-02T04:48:11.797 DEBUG:teuthology.orchestra.run.smithi076:> set -e 2024-06-02T04:48:11.797 DEBUG:teuthology.orchestra.run.smithi076:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-06-02T04:48:11.797 DEBUG:teuthology.orchestra.run.smithi076:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-06-02T04:48:11.798 DEBUG:teuthology.orchestra.run.smithi076:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-06-02T04:48:11.798 DEBUG:teuthology.orchestra.run.smithi076:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-06-02T04:48:11.798 DEBUG:teuthology.orchestra.run.smithi076:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-06-02T04:48:11.798 DEBUG:teuthology.orchestra.run.smithi076:> ') 2024-06-02T04:48:11.994 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T04:48:11.994 DEBUG:teuthology.orchestra.run.smithi076:> (cd / && exec bash -c ' 2024-06-02T04:48:11.994 DEBUG:teuthology.orchestra.run.smithi076:> set -e 2024-06-02T04:48:11.995 DEBUG:teuthology.orchestra.run.smithi076:> sudo ip link set brx.0 up 2024-06-02T04:48:11.995 DEBUG:teuthology.orchestra.run.smithi076:> sudo ip link set dev brx.0 master ceph-brx 2024-06-02T04:48:11.995 DEBUG:teuthology.orchestra.run.smithi076:> ') 2024-06-02T04:48:12.093 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-06-02T04:48:12.094 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-02T04:48:12.094 DEBUG:teuthology.orchestra.run.smithi076:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-06-02T04:48:12.111 INFO:teuthology.orchestra.run.smithi076.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-06-02T04:48:12.111 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-02T04:48:12.111 DEBUG:teuthology.orchestra.run.smithi076:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-06-02T04:48:12.168 DEBUG:teuthology.orchestra.run.smithi076:> sudo modprobe fuse 2024-06-02T04:48:12.236 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-06-02T04:48:12.236 DEBUG:teuthology.orchestra.run.smithi076:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-06-02T04:48:12.303 INFO:teuthology.orchestra.run.smithi076.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-06-02T04:48:12.304 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-06-02T04:48:12.305 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T04:48:12.305 DEBUG:teuthology.orchestra.run.smithi076:> ls /sys/fs/fuse/connections 2024-06-02T04:48:12.362 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-06-02T04:48:12.363 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-06-02T04:48:12.405 DEBUG:teuthology.orchestra.run.smithi076:> sudo modprobe fuse 2024-06-02T04:48:12.431 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-06-02T04:48:12.431 DEBUG:teuthology.orchestra.run.smithi076:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-06-02T04:48:12.494 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi076.stderr:2024-06-02T04:48:12.494+0000 7f25c3e345c0 -1 init, newargv = 0x55be728a2970 newargc=15 2024-06-02T04:48:12.494 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi076.stderr:ceph-fuse[97746]: starting ceph client 2024-06-02T04:48:12.499 INFO:teuthology.orchestra.run.smithi076.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-06-02T04:48:12.500 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-06-02T04:48:12.500 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T04:48:12.500 DEBUG:teuthology.orchestra.run.smithi076:> ls /sys/fs/fuse/connections 2024-06-02T04:48:12.501 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi076.stderr:ceph-fuse[97746]: starting fuse 2024-06-02T04:48:12.558 INFO:teuthology.orchestra.run.smithi076.stdout:124 2024-06-02T04:48:12.558 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [124] 2024-06-02T04:48:12.558 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-06-02T04:48:12.558 DEBUG:teuthology.orchestra.run.smithi076:> import glob 2024-06-02T04:48:12.558 DEBUG:teuthology.orchestra.run.smithi076:> import re 2024-06-02T04:48:12.558 DEBUG:teuthology.orchestra.run.smithi076:> import os 2024-06-02T04:48:12.558 DEBUG:teuthology.orchestra.run.smithi076:> import subprocess 2024-06-02T04:48:12.558 DEBUG:teuthology.orchestra.run.smithi076:> 2024-06-02T04:48:12.559 DEBUG:teuthology.orchestra.run.smithi076:> def _find_admin_socket(client_name): 2024-06-02T04:48:12.559 DEBUG:teuthology.orchestra.run.smithi076:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-06-02T04:48:12.559 DEBUG:teuthology.orchestra.run.smithi076:> files = glob.glob(asok_path) 2024-06-02T04:48:12.559 DEBUG:teuthology.orchestra.run.smithi076:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-06-02T04:48:12.559 DEBUG:teuthology.orchestra.run.smithi076:> 2024-06-02T04:48:12.559 DEBUG:teuthology.orchestra.run.smithi076:> # Given a non-glob path, it better be there 2024-06-02T04:48:12.559 DEBUG:teuthology.orchestra.run.smithi076:> if "*" not in asok_path: 2024-06-02T04:48:12.559 DEBUG:teuthology.orchestra.run.smithi076:> assert(len(files) == 1) 2024-06-02T04:48:12.559 DEBUG:teuthology.orchestra.run.smithi076:> return files[0] 2024-06-02T04:48:12.559 DEBUG:teuthology.orchestra.run.smithi076:> 2024-06-02T04:48:12.559 DEBUG:teuthology.orchestra.run.smithi076:> for f in files: 2024-06-02T04:48:12.559 DEBUG:teuthology.orchestra.run.smithi076:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-06-02T04:48:12.559 DEBUG:teuthology.orchestra.run.smithi076:> if os.path.exists("/proc/{0}".format(pid)): 2024-06-02T04:48:12.559 DEBUG:teuthology.orchestra.run.smithi076:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-06-02T04:48:12.560 DEBUG:teuthology.orchestra.run.smithi076:> contents = proc_f.read() 2024-06-02T04:48:12.560 DEBUG:teuthology.orchestra.run.smithi076:> if mountpoint in contents: 2024-06-02T04:48:12.560 DEBUG:teuthology.orchestra.run.smithi076:> return f 2024-06-02T04:48:12.560 DEBUG:teuthology.orchestra.run.smithi076:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-06-02T04:48:12.560 DEBUG:teuthology.orchestra.run.smithi076:> 2024-06-02T04:48:12.560 DEBUG:teuthology.orchestra.run.smithi076:> print(_find_admin_socket("client.admin")) 2024-06-02T04:48:12.560 DEBUG:teuthology.orchestra.run.smithi076:> ' 2024-06-02T04:48:12.681 INFO:teuthology.orchestra.run.smithi076.stdout:/var/run/ceph/ceph-client.admin.97746.asok 2024-06-02T04:48:12.865 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.97746.asok 2024-06-02T04:48:12.865 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T04:48:12.865 DEBUG:teuthology.orchestra.run.smithi076:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.97746.asok status 2024-06-02T04:48:13.023 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-06-02T04:48:13.023 INFO:teuthology.orchestra.run.smithi076.stdout: "metadata": { 2024-06-02T04:48:13.023 INFO:teuthology.orchestra.run.smithi076.stdout: "ceph_sha1": "3bb45379356e8aa965152e0b8c663715c5df9bda", 2024-06-02T04:48:13.023 INFO:teuthology.orchestra.run.smithi076.stdout: "ceph_version": "ceph version 18.2.2-1381-g3bb45379 (3bb45379356e8aa965152e0b8c663715c5df9bda) reef (stable)", 2024-06-02T04:48:13.023 INFO:teuthology.orchestra.run.smithi076.stdout: "entity_id": "admin", 2024-06-02T04:48:13.023 INFO:teuthology.orchestra.run.smithi076.stdout: "hostname": "smithi076", 2024-06-02T04:48:13.023 INFO:teuthology.orchestra.run.smithi076.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-06-02T04:48:13.023 INFO:teuthology.orchestra.run.smithi076.stdout: "pid": "97746", 2024-06-02T04:48:13.023 INFO:teuthology.orchestra.run.smithi076.stdout: "root": "/" 2024-06-02T04:48:13.024 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:48:13.024 INFO:teuthology.orchestra.run.smithi076.stdout: "dentry_count": 0, 2024-06-02T04:48:13.024 INFO:teuthology.orchestra.run.smithi076.stdout: "dentry_pinned_count": 0, 2024-06-02T04:48:13.024 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 14754, 2024-06-02T04:48:13.024 INFO:teuthology.orchestra.run.smithi076.stdout: "inst": { 2024-06-02T04:48:13.024 INFO:teuthology.orchestra.run.smithi076.stdout: "name": { 2024-06-02T04:48:13.024 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "client", 2024-06-02T04:48:13.024 INFO:teuthology.orchestra.run.smithi076.stdout: "num": 14754 2024-06-02T04:48:13.024 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:48:13.024 INFO:teuthology.orchestra.run.smithi076.stdout: "addr": { 2024-06-02T04:48:13.024 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "v1", 2024-06-02T04:48:13.024 INFO:teuthology.orchestra.run.smithi076.stdout: "addr": "192.168.0.1:0", 2024-06-02T04:48:13.024 INFO:teuthology.orchestra.run.smithi076.stdout: "nonce": 1404755894 2024-06-02T04:48:13.024 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T04:48:13.025 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:48:13.025 INFO:teuthology.orchestra.run.smithi076.stdout: "addr": { 2024-06-02T04:48:13.025 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "v1", 2024-06-02T04:48:13.025 INFO:teuthology.orchestra.run.smithi076.stdout: "addr": "192.168.0.1:0", 2024-06-02T04:48:13.025 INFO:teuthology.orchestra.run.smithi076.stdout: "nonce": 1404755894 2024-06-02T04:48:13.025 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:48:13.025 INFO:teuthology.orchestra.run.smithi076.stdout: "inst_str": "client.14754 192.168.0.1:0/1404755894", 2024-06-02T04:48:13.025 INFO:teuthology.orchestra.run.smithi076.stdout: "addr_str": "192.168.0.1:0/1404755894", 2024-06-02T04:48:13.025 INFO:teuthology.orchestra.run.smithi076.stdout: "inode_count": 1, 2024-06-02T04:48:13.025 INFO:teuthology.orchestra.run.smithi076.stdout: "mds_epoch": 17, 2024-06-02T04:48:13.025 INFO:teuthology.orchestra.run.smithi076.stdout: "osd_epoch": 80, 2024-06-02T04:48:13.025 INFO:teuthology.orchestra.run.smithi076.stdout: "osd_epoch_barrier": 0, 2024-06-02T04:48:13.025 INFO:teuthology.orchestra.run.smithi076.stdout: "blocklisted": false, 2024-06-02T04:48:13.026 INFO:teuthology.orchestra.run.smithi076.stdout: "fs_name": "cephfs" 2024-06-02T04:48:13.026 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-06-02T04:48:13.033 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T04:48:13.033 DEBUG:teuthology.orchestra.run.smithi076:> stat --file-system '--printf=%T 2024-06-02T04:48:13.033 DEBUG:teuthology.orchestra.run.smithi076:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-06-02T04:48:13.050 INFO:teuthology.orchestra.run.smithi076.stdout:fuseblk 2024-06-02T04:48:13.050 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-06-02T04:48:13.050 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T04:48:13.051 DEBUG:teuthology.orchestra.run.smithi076:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-06-02T04:48:13.120 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T04:48:13.120 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-06-02T04:48:13.223 INFO:teuthology.orchestra.run.smithi076.stdout:# file: . 2024-06-02T04:48:13.223 INFO:teuthology.orchestra.run.smithi076.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-06-02T04:48:13.223 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:48:13.223 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2024-06-02T04:48:13.224 DEBUG:teuthology.orchestra.run.smithi076:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T04:48:13.242 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-02T04:48:13.406 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:13.403+0000 7fb59872b700 1 -- 172.21.15.76:0/293307553 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb590101900 msgr2=0x7fb5901081b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:13.406 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:13.403+0000 7fb59872b700 1 --2- 172.21.15.76:0/293307553 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb590101900 0x7fb5901081b0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb58800b0d0 tx=0x7fb58800b3e0 comp rx=0 tx=0).stop 2024-06-02T04:48:13.406 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:13.404+0000 7fb59872b700 1 -- 172.21.15.76:0/293307553 shutdown_connections 2024-06-02T04:48:13.406 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:13.404+0000 7fb59872b700 1 --2- 172.21.15.76:0/293307553 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb590101900 0x7fb5901081b0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:13.406 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:13.404+0000 7fb59872b700 1 --2- 172.21.15.76:0/293307553 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb5900ffd70 0x7fb590100190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:13.406 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:13.404+0000 7fb59872b700 1 --2- 172.21.15.76:0/293307553 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb590100f60 0x7fb5901013c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:13.406 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:13.404+0000 7fb59872b700 1 -- 172.21.15.76:0/293307553 >> 172.21.15.76:0/293307553 conn(0x7fb5900fb2e0 msgr2=0x7fb5900fd720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:13.406 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:13.404+0000 7fb59872b700 1 -- 172.21.15.76:0/293307553 shutdown_connections 2024-06-02T04:48:13.407 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:13.404+0000 7fb59872b700 1 -- 172.21.15.76:0/293307553 wait complete. 2024-06-02T04:48:13.407 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:13.404+0000 7fb59872b700 1 Processor -- start 2024-06-02T04:48:13.407 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:13.404+0000 7fb59872b700 1 -- start start 2024-06-02T04:48:13.407 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:13.404+0000 7fb59872b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb5900ffd70 0x7fb590069d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:13.407 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:13.404+0000 7fb59872b700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb590100f60 0x7fb59019bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:13.407 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:13.404+0000 7fb59872b700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb590101900 0x7fb59019e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:13.407 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:13.404+0000 7fb59872b700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb59019e950 con 0x7fb590100f60 2024-06-02T04:48:13.407 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:13.404+0000 7fb59872b700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb59019eac0 con 0x7fb590101900 2024-06-02T04:48:13.407 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:13.404+0000 7fb59872b700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb59019ec80 con 0x7fb5900ffd70 2024-06-02T04:48:13.407 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:13.405+0000 7fb595cc6700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb590100f60 0x7fb59019bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:13.407 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:13.405+0000 7fb595cc6700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb590100f60 0x7fb59019bb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:39018/0 (socket says 172.21.15.76:39018) 2024-06-02T04:48:13.407 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:13.405+0000 7fb595cc6700 1 -- 172.21.15.76:0/3335406867 learned_addr learned my addr 172.21.15.76:0/3335406867 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:48:13.408 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:13.405+0000 7fb596cc8700 1 --2- 172.21.15.76:0/3335406867 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb590101900 0x7fb59019e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:13.408 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:13.405+0000 7fb5964c7700 1 --2- 172.21.15.76:0/3335406867 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb5900ffd70 0x7fb590069d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:13.408 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:13.405+0000 7fb595cc6700 1 -- 172.21.15.76:0/3335406867 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb5900ffd70 msgr2=0x7fb590069d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:13.408 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:13.405+0000 7fb595cc6700 1 --2- 172.21.15.76:0/3335406867 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb5900ffd70 0x7fb590069d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:13.408 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:13.405+0000 7fb595cc6700 1 -- 172.21.15.76:0/3335406867 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb590101900 msgr2=0x7fb59019e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:13.408 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:13.405+0000 7fb595cc6700 1 --2- 172.21.15.76:0/3335406867 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb590101900 0x7fb59019e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:13.408 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:13.405+0000 7fb595cc6700 1 -- 172.21.15.76:0/3335406867 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb588009d00 con 0x7fb590100f60 2024-06-02T04:48:13.408 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:13.405+0000 7fb595cc6700 1 --2- 172.21.15.76:0/3335406867 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb590100f60 0x7fb59019bb40 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb58000d950 tx=0x7fb58000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:13.408 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:13.405+0000 7fb5877fe700 1 -- 172.21.15.76:0/3335406867 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb58000f890 con 0x7fb590100f60 2024-06-02T04:48:13.408 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:13.405+0000 7fb59872b700 1 -- 172.21.15.76:0/3335406867 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb59019ef00 con 0x7fb590100f60 2024-06-02T04:48:13.408 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:13.405+0000 7fb5877fe700 1 -- 172.21.15.76:0/3335406867 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb58000fe80 con 0x7fb590100f60 2024-06-02T04:48:13.408 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:13.405+0000 7fb5877fe700 1 -- 172.21.15.76:0/3335406867 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb58000e3b0 con 0x7fb590100f60 2024-06-02T04:48:13.408 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:13.405+0000 7fb59872b700 1 -- 172.21.15.76:0/3335406867 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb59019f380 con 0x7fb590100f60 2024-06-02T04:48:13.409 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:13.406+0000 7fb59872b700 1 -- 172.21.15.76:0/3335406867 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb590107290 con 0x7fb590100f60 2024-06-02T04:48:13.409 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:13.407+0000 7fb5877fe700 1 -- 172.21.15.76:0/3335406867 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fb580010460 con 0x7fb590100f60 2024-06-02T04:48:13.409 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:13.408+0000 7fb5877fe700 1 --2- 172.21.15.76:0/3335406867 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fb57c0a1120 0x7fb57c0a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:13.409 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:13.408+0000 7fb5877fe700 1 -- 172.21.15.76:0/3335406867 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fb5800cc820 con 0x7fb590100f60 2024-06-02T04:48:13.410 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:13.408+0000 7fb5964c7700 1 --2- 172.21.15.76:0/3335406867 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fb57c0a1120 0x7fb57c0a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:13.410 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:13.408+0000 7fb5964c7700 1 --2- 172.21.15.76:0/3335406867 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fb57c0a1120 0x7fb57c0a35e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb590100dc0 tx=0x7fb58c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:13.411 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:13.411+0000 7fb5877fe700 1 -- 172.21.15.76:0/3335406867 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fb580095dc0 con 0x7fb590100f60 2024-06-02T04:48:13.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:13 smithi076 ceph-mon[42935]: pgmap v223: 129 pgs: 129 active+clean; 579 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-06-02T04:48:13.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:13 smithi119 ceph-mon[46633]: pgmap v223: 129 pgs: 129 active+clean; 579 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-06-02T04:48:13.612 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:13.612+0000 7fb59872b700 1 -- 172.21.15.76:0/3335406867 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb590067380 con 0x7fb590100f60 2024-06-02T04:48:13.614 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:13.614+0000 7fb5877fe700 1 -- 172.21.15.76:0/3335406867 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+23984 (secure 0 0 0) 0x7fb580016090 con 0x7fb590100f60 2024-06-02T04:48:13.614 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:48:13.615 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":80,"fsid":"60ab6d30-209a-11ef-bc9b-c7b262605968","created":"2024-06-02T04:42:21.007333+0000","modified":"2024-06-02T04:48:07.101373+0000","last_up_change":"2024-06-02T04:47:29.822242+0000","last_in_change":"2024-06-02T04:47:14.253449+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T04:44:56.408602+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-02T04:48:01.194954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-02T04:48:01.828863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-02T04:48:04.916565+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"33a51ba2-be5c-41d0-b5d1-8d6039f2ca4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6802","nonce":2869602045},{"type":"v1","addr":"172.21.15.76:6803","nonce":2869602045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6804","nonce":2869602045},{"type":"v1","addr":"172.21.15.76:6805","nonce":2869602045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6808","nonce":2869602045},{"type":"v1","addr":"172.21.15.76:6809","nonce":2869602045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6806","nonce":2869602045},{"type":"v1","addr":"172.21.15.76:6807","nonce":2869602045}]},"public_addr":"172.21.15.76:6803/2869602045","cluster_addr":"172.21.15.76:6805/2869602045","heartbeat_back_addr":"172.21.15.76:6809/2869602045","heartbeat_front_addr":"172.21.15.76:6807/2869602045","state":["exists","up"]},{"osd":1,"uuid":"ace46e13-3bb7-4103-973a-6860554df8b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":2353738098},{"type":"v1","addr":"172.21.15.119:6801","nonce":2353738098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":2353738098},{"type":"v1","addr":"172.21.15.119:6803","nonce":2353738098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":2353738098},{"type":"v1","addr":"172.21.15.119:6807","nonce":2353738098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":2353738098},{"type":"v1","addr":"172.21.15.119:6805","nonce":2353738098}]},"public_addr":"172.21.15.119:6801/2353738098","cluster_addr":"172.21.15.119:6803/2353738098","heartbeat_back_addr":"172.21.15.119:6807/2353738098","heartbeat_front_addr":"172.21.15.119:6805/2353738098","state":["exists","up"]},{"osd":2,"uuid":"4addc09e-77a9-428a-bcc4-38194f486cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":3206918546},{"type":"v1","addr":"172.21.15.192:6801","nonce":3206918546}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":3206918546},{"type":"v1","addr":"172.21.15.192:6803","nonce":3206918546}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":3206918546},{"type":"v1","addr":"172.21.15.192:6807","nonce":3206918546}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":3206918546},{"type":"v1","addr":"172.21.15.192:6805","nonce":3206918546}]},"public_addr":"172.21.15.192:6801/3206918546","cluster_addr":"172.21.15.192:6803/3206918546","heartbeat_back_addr":"172.21.15.192:6807/3206918546","heartbeat_front_addr":"172.21.15.192:6805/3206918546","state":["exists","up"]},{"osd":3,"uuid":"dc525518-82c6-49ed-8ca8-e3bd5bfc18d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6810","nonce":3747864233},{"type":"v1","addr":"172.21.15.76:6811","nonce":3747864233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6812","nonce":3747864233},{"type":"v1","addr":"172.21.15.76:6813","nonce":3747864233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6816","nonce":3747864233},{"type":"v1","addr":"172.21.15.76:6817","nonce":3747864233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6814","nonce":3747864233},{"type":"v1","addr":"172.21.15.76:6815","nonce":3747864233}]},"public_addr":"172.21.15.76:6811/3747864233","cluster_addr":"172.21.15.76:6813/3747864233","heartbeat_back_addr":"172.21.15.76:6817/3747864233","heartbeat_front_addr":"172.21.15.76:6815/3747864233","state":["exists","up"]},{"osd":4,"uuid":"eef293d0-cb87-47b3-9751-c6437a1cf079","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":2571629047},{"type":"v1","addr":"172.21.15.119:6809","nonce":2571629047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":2571629047},{"type":"v1","addr":"172.21.15.119:6811","nonce":2571629047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":2571629047},{"type":"v1","addr":"172.21.15.119:6815","nonce":2571629047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":2571629047},{"type":"v1","addr":"172.21.15.119:6813","nonce":2571629047}]},"public_addr":"172.21.15.119:6809/2571629047","cluster_addr":"172.21.15.119:6811/2571629047","heartbeat_back_addr":"172.21.15.119:6815/2571629047","heartbeat_front_addr":"172.21.15.119:6813/2571629047","state":["exists","up"]},{"osd":5,"uuid":"60eb8c6e-766c-49d0-9997-44f85776b3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3285065416},{"type":"v1","addr":"172.21.15.192:6809","nonce":3285065416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":3285065416},{"type":"v1","addr":"172.21.15.192:6811","nonce":3285065416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3285065416},{"type":"v1","addr":"172.21.15.192:6815","nonce":3285065416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":3285065416},{"type":"v1","addr":"172.21.15.192:6813","nonce":3285065416}]},"public_addr":"172.21.15.192:6809/3285065416","cluster_addr":"172.21.15.192:6811/3285065416","heartbeat_back_addr":"172.21.15.192:6815/3285065416","heartbeat_front_addr":"172.21.15.192:6813/3285065416","state":["exists","up"]},{"osd":6,"uuid":"e6dc8b9d-dd06-4870-a506-def8201b7e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6818","nonce":2951381580},{"type":"v1","addr":"172.21.15.76:6819","nonce":2951381580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6820","nonce":2951381580},{"type":"v1","addr":"172.21.15.76:6821","nonce":2951381580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6824","nonce":2951381580},{"type":"v1","addr":"172.21.15.76:6825","nonce":2951381580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6822","nonce":2951381580},{"type":"v1","addr":"172.21.15.76:6823","nonce":2951381580}]},"public_addr":"172.21.15.76:6819/2951381580","cluster_addr":"172.21.15.76:6821/2951381580","heartbeat_back_addr":"172.21.15.76:6825/2951381580","heartbeat_front_addr":"172.21.15.76:6823/2951381580","state":["exists","up"]},{"osd":7,"uuid":"2f5dccb3-39a1-4f25-8715-fa264d59db97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1802558756},{"type":"v1","addr":"172.21.15.119:6817","nonce":1802558756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1802558756},{"type":"v1","addr":"172.21.15.119:6819","nonce":1802558756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1802558756},{"type":"v1","addr":"172.21.15.119:6823","nonce":1802558756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1802558756},{"type":"v1","addr":"172.21.15.119:6821","nonce":1802558756}]},"public_addr":"172.21.15.119:6817/1802558756","cluster_addr":"172.21.15.119:6819/1802558756","heartbeat_back_addr":"172.21.15.119:6823/1802558756","heartbeat_front_addr":"172.21.15.119:6821/1802558756","state":["exists","up"]},{"osd":8,"uuid":"39b6ccd0-16e7-4cd5-87e0-d827e9172984","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":1214972276},{"type":"v1","addr":"172.21.15.192:6817","nonce":1214972276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":1214972276},{"type":"v1","addr":"172.21.15.192:6819","nonce":1214972276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":1214972276},{"type":"v1","addr":"172.21.15.192:6823","nonce":1214972276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":1214972276},{"type":"v1","addr":"172.21.15.192:6821","nonce":1214972276}]},"public_addr":"172.21.15.192:6817/1214972276","cluster_addr":"172.21.15.192:6819/1214972276","heartbeat_back_addr":"172.21.15.192:6823/1214972276","heartbeat_front_addr":"172.21.15.192:6821/1214972276","state":["exists","up"]},{"osd":9,"uuid":"851b2155-07bd-45de-bfe0-53021fda733f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6826","nonce":3095501821},{"type":"v1","addr":"172.21.15.76:6827","nonce":3095501821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6828","nonce":3095501821},{"type":"v1","addr":"172.21.15.76:6829","nonce":3095501821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":3095501821},{"type":"v1","addr":"172.21.15.76:6833","nonce":3095501821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6830","nonce":3095501821},{"type":"v1","addr":"172.21.15.76:6831","nonce":3095501821}]},"public_addr":"172.21.15.76:6827/3095501821","cluster_addr":"172.21.15.76:6829/3095501821","heartbeat_back_addr":"172.21.15.76:6833/3095501821","heartbeat_front_addr":"172.21.15.76:6831/3095501821","state":["exists","up"]},{"osd":10,"uuid":"e4b18e7e-bddf-4dd4-84f6-7902ea327cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":4082130894},{"type":"v1","addr":"172.21.15.119:6825","nonce":4082130894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":4082130894},{"type":"v1","addr":"172.21.15.119:6827","nonce":4082130894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":4082130894},{"type":"v1","addr":"172.21.15.119:6831","nonce":4082130894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":4082130894},{"type":"v1","addr":"172.21.15.119:6829","nonce":4082130894}]},"public_addr":"172.21.15.119:6825/4082130894","cluster_addr":"172.21.15.119:6827/4082130894","heartbeat_back_addr":"172.21.15.119:6831/4082130894","heartbeat_front_addr":"172.21.15.119:6829/4082130894","state":["exists","up"]},{"osd":11,"uuid":"54567e18-920c-4ae9-9557-0efba5a1a820","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":439693921},{"type":"v1","addr":"172.21.15.192:6825","nonce":439693921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":439693921},{"type":"v1","addr":"172.21.15.192:6827","nonce":439693921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":439693921},{"type":"v1","addr":"172.21.15.192:6831","nonce":439693921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":439693921},{"type":"v1","addr":"172.21.15.192:6829","nonce":439693921}]},"public_addr":"172.21.15.192:6825/439693921","cluster_addr":"172.21.15.192:6827/439693921","heartbeat_back_addr":"172.21.15.192:6831/439693921","heartbeat_front_addr":"172.21.15.192:6829/439693921","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:44:19.922390+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:44:36.895563+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:44:53.699019+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:45:11.167404+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:45:27.955899+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:45:44.850368+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:46:02.003588+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:46:19.019217+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:46:36.189670+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:46:53.919365+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:47:11.563053+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:47:28.822443+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.76:6801/4200406736":"2024-06-03T04:43:06.092916+0000","172.21.15.76:6800/4200406736":"2024-06-03T04:43:06.092916+0000","172.21.15.76:0/1524144593":"2024-06-03T04:43:06.092916+0000","172.21.15.76:0/3269372590":"2024-06-03T04:43:06.092916+0000","172.21.15.76:0/3570893846":"2024-06-03T04:42:44.872236+0000","172.21.15.76:0/902035790":"2024-06-03T04:43:06.092916+0000","172.21.15.76:6800/2550846765":"2024-06-03T04:42:44.872236+0000","172.21.15.76:6801/2550846765":"2024-06-03T04:42:44.872236+0000","172.21.15.76:0/2646712763":"2024-06-03T04:42:44.872236+0000","172.21.15.76:0/964578813":"2024-06-03T04:42:44.872236+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T04:48:13.616 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:13.616+0000 7fb59872b700 1 -- 172.21.15.76:0/3335406867 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fb57c0a1120 msgr2=0x7fb57c0a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:13.616 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:13.616+0000 7fb59872b700 1 --2- 172.21.15.76:0/3335406867 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fb57c0a1120 0x7fb57c0a35e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb590100dc0 tx=0x7fb58c009260 comp rx=0 tx=0).stop 2024-06-02T04:48:13.617 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:13.616+0000 7fb59872b700 1 -- 172.21.15.76:0/3335406867 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb590100f60 msgr2=0x7fb59019bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:13.617 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:13.616+0000 7fb59872b700 1 --2- 172.21.15.76:0/3335406867 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb590100f60 0x7fb59019bb40 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb58000d950 tx=0x7fb58000dc60 comp rx=0 tx=0).stop 2024-06-02T04:48:13.617 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:13.616+0000 7fb59872b700 1 -- 172.21.15.76:0/3335406867 shutdown_connections 2024-06-02T04:48:13.617 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:13.616+0000 7fb59872b700 1 --2- 172.21.15.76:0/3335406867 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fb57c0a1120 0x7fb57c0a35e0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:13.617 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:13.616+0000 7fb59872b700 1 --2- 172.21.15.76:0/3335406867 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb590101900 0x7fb59019e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:13.617 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:13.616+0000 7fb59872b700 1 --2- 172.21.15.76:0/3335406867 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb5900ffd70 0x7fb590069d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:13.617 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:13.616+0000 7fb59872b700 1 --2- 172.21.15.76:0/3335406867 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb590100f60 0x7fb59019bb40 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:13.617 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:13.616+0000 7fb59872b700 1 -- 172.21.15.76:0/3335406867 >> 172.21.15.76:0/3335406867 conn(0x7fb5900fb2e0 msgr2=0x7fb5901043d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:13.617 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:13.616+0000 7fb59872b700 1 -- 172.21.15.76:0/3335406867 shutdown_connections 2024-06-02T04:48:13.617 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:13.616+0000 7fb59872b700 1 -- 172.21.15.76:0/3335406867 wait complete. 2024-06-02T04:48:13.628 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-06-02T04:44:56.408602+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-06-02T04:48:01.194954+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-06-02T04:48:01.828863+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '76', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-06-02T04:48:04.916565+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-06-02T04:48:13.629 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-06-02T04:48:13.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:13 smithi192 ceph-mon[47933]: pgmap v223: 129 pgs: 129 active+clean; 579 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-06-02T04:48:13.756 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:13.754+0000 7ffa81b8d700 1 -- 172.21.15.76:0/603987854 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ffa7c101970 msgr2=0x7ffa7c108290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:13.756 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:13.754+0000 7ffa81b8d700 1 --2- 172.21.15.76:0/603987854 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ffa7c101970 0x7ffa7c108290 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ffa7400b0a0 tx=0x7ffa7400b3b0 comp rx=0 tx=0).stop 2024-06-02T04:48:13.756 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:13.754+0000 7ffa81b8d700 1 -- 172.21.15.76:0/603987854 shutdown_connections 2024-06-02T04:48:13.756 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:13.754+0000 7ffa81b8d700 1 --2- 172.21.15.76:0/603987854 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ffa7c101970 0x7ffa7c108290 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:13.757 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:13.754+0000 7ffa81b8d700 1 --2- 172.21.15.76:0/603987854 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffa7c0ffe60 0x7ffa7c100280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:13.757 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:13.754+0000 7ffa81b8d700 1 --2- 172.21.15.76:0/603987854 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffa7c100fb0 0x7ffa7c101430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:13.757 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:13.754+0000 7ffa81b8d700 1 -- 172.21.15.76:0/603987854 >> 172.21.15.76:0/603987854 conn(0x7ffa7c0fb3f0 msgr2=0x7ffa7c0fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:13.757 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:13.754+0000 7ffa81b8d700 1 -- 172.21.15.76:0/603987854 shutdown_connections 2024-06-02T04:48:13.757 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:13.754+0000 7ffa81b8d700 1 -- 172.21.15.76:0/603987854 wait complete. 2024-06-02T04:48:13.757 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:13.754+0000 7ffa81b8d700 1 Processor -- start 2024-06-02T04:48:13.757 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:13.755+0000 7ffa81b8d700 1 -- start start 2024-06-02T04:48:13.757 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:13.755+0000 7ffa81b8d700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffa7c0ffe60 0x7ffa7c195e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:13.757 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:13.755+0000 7ffa81b8d700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ffa7c100fb0 0x7ffa7c196380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:13.757 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:13.755+0000 7ffa81b8d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffa7c101970 0x7ffa7c19d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:13.757 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:13.755+0000 7ffa81b8d700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa7c19d970 con 0x7ffa7c100fb0 2024-06-02T04:48:13.757 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:13.755+0000 7ffa81b8d700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa7c19dab0 con 0x7ffa7c0ffe60 2024-06-02T04:48:13.757 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:13.755+0000 7ffa81b8d700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa7c19dc40 con 0x7ffa7c101970 2024-06-02T04:48:13.758 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:13.755+0000 7ffa7affd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ffa7c100fb0 0x7ffa7c196380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:13.758 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:13.755+0000 7ffa7affd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ffa7c100fb0 0x7ffa7c196380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:39030/0 (socket says 172.21.15.76:39030) 2024-06-02T04:48:13.758 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:13.755+0000 7ffa7affd700 1 -- 172.21.15.76:0/575421191 learned_addr learned my addr 172.21.15.76:0/575421191 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:48:13.758 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:13.755+0000 7ffa7b7fe700 1 --2- 172.21.15.76:0/575421191 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffa7c0ffe60 0x7ffa7c195e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:13.758 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:13.755+0000 7ffa7bfff700 1 --2- 172.21.15.76:0/575421191 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffa7c101970 0x7ffa7c19d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:13.758 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:13.755+0000 7ffa7affd700 1 -- 172.21.15.76:0/575421191 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffa7c101970 msgr2=0x7ffa7c19d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:13.758 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:13.755+0000 7ffa7affd700 1 --2- 172.21.15.76:0/575421191 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffa7c101970 0x7ffa7c19d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:13.758 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:13.755+0000 7ffa7affd700 1 -- 172.21.15.76:0/575421191 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffa7c0ffe60 msgr2=0x7ffa7c195e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:13.758 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:13.755+0000 7ffa7affd700 1 --2- 172.21.15.76:0/575421191 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffa7c0ffe60 0x7ffa7c195e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:13.758 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:13.755+0000 7ffa7affd700 1 -- 172.21.15.76:0/575421191 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa74009d00 con 0x7ffa7c100fb0 2024-06-02T04:48:13.758 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:13.755+0000 7ffa7bfff700 1 --2- 172.21.15.76:0/575421191 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffa7c101970 0x7ffa7c19d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:48:13.758 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:13.755+0000 7ffa7affd700 1 --2- 172.21.15.76:0/575421191 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ffa7c100fb0 0x7ffa7c196380 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c00e9a0 tx=0x7ffa6c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:13.758 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:13.755+0000 7ffa78ff9700 1 -- 172.21.15.76:0/575421191 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa6c009790 con 0x7ffa7c100fb0 2024-06-02T04:48:13.759 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:13.755+0000 7ffa78ff9700 1 -- 172.21.15.76:0/575421191 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ffa6c00cbd0 con 0x7ffa7c100fb0 2024-06-02T04:48:13.759 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:13.755+0000 7ffa81b8d700 1 -- 172.21.15.76:0/575421191 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa7c19df20 con 0x7ffa7c100fb0 2024-06-02T04:48:13.759 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:13.756+0000 7ffa78ff9700 1 -- 172.21.15.76:0/575421191 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa6c018680 con 0x7ffa7c100fb0 2024-06-02T04:48:13.759 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:13.756+0000 7ffa81b8d700 1 -- 172.21.15.76:0/575421191 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa7c19e3f0 con 0x7ffa7c100fb0 2024-06-02T04:48:13.760 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:13.757+0000 7ffa81b8d700 1 -- 172.21.15.76:0/575421191 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa7c1072d0 con 0x7ffa7c100fb0 2024-06-02T04:48:13.760 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:13.758+0000 7ffa78ff9700 1 -- 172.21.15.76:0/575421191 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7ffa6c00cd40 con 0x7ffa7c100fb0 2024-06-02T04:48:13.760 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:13.759+0000 7ffa78ff9700 1 --2- 172.21.15.76:0/575421191 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7ffa680a11a0 0x7ffa680a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:13.760 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:13.759+0000 7ffa78ff9700 1 -- 172.21.15.76:0/575421191 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 8730+0+0 (secure 0 0 0) 0x7ffa6c014070 con 0x7ffa7c100fb0 2024-06-02T04:48:13.760 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:13.759+0000 7ffa7b7fe700 1 --2- 172.21.15.76:0/575421191 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7ffa680a11a0 0x7ffa680a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:13.760 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:13.759+0000 7ffa7b7fe700 1 --2- 172.21.15.76:0/575421191 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7ffa680a11a0 0x7ffa680a3660 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ffa64005950 tx=0x7ffa6400a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:13.762 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:13.762+0000 7ffa78ff9700 1 -- 172.21.15.76:0/575421191 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7ffa6c0965c0 con 0x7ffa7c100fb0 2024-06-02T04:48:13.960 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:13.960+0000 7ffa81b8d700 1 -- 172.21.15.76:0/575421191 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ffa7c10b560 con 0x7ffa7c100fb0 2024-06-02T04:48:13.961 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:13.961+0000 7ffa78ff9700 1 -- 172.21.15.76:0/575421191 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v80) v1 ==== 93+0+10 (secure 0 0 0) 0x7ffa6c026020 con 0x7ffa7c100fb0 2024-06-02T04:48:13.961 INFO:teuthology.orchestra.run.smithi076.stdout:pg_num: 1 2024-06-02T04:48:13.963 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:13.963+0000 7ffa81b8d700 1 -- 172.21.15.76:0/575421191 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7ffa680a11a0 msgr2=0x7ffa680a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:13.963 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:13.963+0000 7ffa81b8d700 1 --2- 172.21.15.76:0/575421191 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7ffa680a11a0 0x7ffa680a3660 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ffa64005950 tx=0x7ffa6400a300 comp rx=0 tx=0).stop 2024-06-02T04:48:13.964 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:13.963+0000 7ffa81b8d700 1 -- 172.21.15.76:0/575421191 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ffa7c100fb0 msgr2=0x7ffa7c196380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:13.964 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:13.963+0000 7ffa81b8d700 1 --2- 172.21.15.76:0/575421191 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ffa7c100fb0 0x7ffa7c196380 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c00e9a0 tx=0x7ffa6c00ecb0 comp rx=0 tx=0).stop 2024-06-02T04:48:13.964 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:13.963+0000 7ffa81b8d700 1 -- 172.21.15.76:0/575421191 shutdown_connections 2024-06-02T04:48:13.964 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:13.963+0000 7ffa81b8d700 1 --2- 172.21.15.76:0/575421191 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffa7c101970 0x7ffa7c19d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:13.964 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:13.963+0000 7ffa81b8d700 1 --2- 172.21.15.76:0/575421191 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7ffa680a11a0 0x7ffa680a3660 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:13.964 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:13.963+0000 7ffa81b8d700 1 --2- 172.21.15.76:0/575421191 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffa7c0ffe60 0x7ffa7c195e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:13.964 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:13.963+0000 7ffa81b8d700 1 --2- 172.21.15.76:0/575421191 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ffa7c100fb0 0x7ffa7c196380 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:13.964 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:13.963+0000 7ffa81b8d700 1 -- 172.21.15.76:0/575421191 >> 172.21.15.76:0/575421191 conn(0x7ffa7c0fb3f0 msgr2=0x7ffa7c104410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:13.964 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:13.963+0000 7ffa81b8d700 1 -- 172.21.15.76:0/575421191 shutdown_connections 2024-06-02T04:48:13.964 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:13.963+0000 7ffa81b8d700 1 -- 172.21.15.76:0/575421191 wait complete. 2024-06-02T04:48:13.975 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-06-02T04:48:14.103 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.101+0000 7f42cc61a700 1 -- 172.21.15.76:0/2321049198 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f42c4100f70 msgr2=0x7f42c41013d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:14.104 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.101+0000 7f42cc61a700 1 --2- 172.21.15.76:0/2321049198 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f42c4100f70 0x7f42c41013d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f42b40099c0 tx=0x7f42b4009cd0 comp rx=0 tx=0).stop 2024-06-02T04:48:14.104 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.101+0000 7f42cc61a700 1 -- 172.21.15.76:0/2321049198 shutdown_connections 2024-06-02T04:48:14.104 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.101+0000 7f42cc61a700 1 --2- 172.21.15.76:0/2321049198 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f42c4101910 0x7f42c41081c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:14.104 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.101+0000 7f42cc61a700 1 --2- 172.21.15.76:0/2321049198 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f42c40ffd80 0x7f42c41001a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:14.104 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.101+0000 7f42cc61a700 1 --2- 172.21.15.76:0/2321049198 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f42c4100f70 0x7f42c41013d0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:14.104 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.101+0000 7f42cc61a700 1 -- 172.21.15.76:0/2321049198 >> 172.21.15.76:0/2321049198 conn(0x7f42c40fb310 msgr2=0x7f42c40fd730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:14.104 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.101+0000 7f42cc61a700 1 -- 172.21.15.76:0/2321049198 shutdown_connections 2024-06-02T04:48:14.104 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.101+0000 7f42cc61a700 1 -- 172.21.15.76:0/2321049198 wait complete. 2024-06-02T04:48:14.104 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.102+0000 7f42cc61a700 1 Processor -- start 2024-06-02T04:48:14.104 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.102+0000 7f42cc61a700 1 -- start start 2024-06-02T04:48:14.105 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.102+0000 7f42cc61a700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f42c40ffd80 0x7f42c4103cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:14.105 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.102+0000 7f42cc61a700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f42c4100f70 0x7f42c4102350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:14.105 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.102+0000 7f42cc61a700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f42c4101910 0x7f42c4102890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:14.105 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.102+0000 7f42cc61a700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42c4103030 con 0x7f42c4101910 2024-06-02T04:48:14.105 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.102+0000 7f42cc61a700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42c41031a0 con 0x7f42c4100f70 2024-06-02T04:48:14.105 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.102+0000 7f42cc61a700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42c41a0e20 con 0x7f42c40ffd80 2024-06-02T04:48:14.105 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.102+0000 7f42cabb7700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f42c4101910 0x7f42c4102890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:14.105 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.102+0000 7f42cabb7700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f42c4101910 0x7f42c4102890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:39048/0 (socket says 172.21.15.76:39048) 2024-06-02T04:48:14.105 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.102+0000 7f42cabb7700 1 -- 172.21.15.76:0/3332210736 learned_addr learned my addr 172.21.15.76:0/3332210736 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:48:14.105 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.102+0000 7f42ca3b6700 1 --2- 172.21.15.76:0/3332210736 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f42c40ffd80 0x7f42c4103cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:14.105 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.102+0000 7f42c9bb5700 1 --2- 172.21.15.76:0/3332210736 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f42c4100f70 0x7f42c4102350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:14.105 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.102+0000 7f42cabb7700 1 -- 172.21.15.76:0/3332210736 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f42c40ffd80 msgr2=0x7f42c4103cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:14.105 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.102+0000 7f42cabb7700 1 --2- 172.21.15.76:0/3332210736 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f42c40ffd80 0x7f42c4103cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:14.106 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.102+0000 7f42cabb7700 1 -- 172.21.15.76:0/3332210736 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f42c4100f70 msgr2=0x7f42c4102350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:14.106 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.102+0000 7f42cabb7700 1 --2- 172.21.15.76:0/3332210736 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f42c4100f70 0x7f42c4102350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:14.106 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.102+0000 7f42cabb7700 1 -- 172.21.15.76:0/3332210736 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42b40095f0 con 0x7f42c4101910 2024-06-02T04:48:14.106 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.102+0000 7f42ca3b6700 1 --2- 172.21.15.76:0/3332210736 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f42c40ffd80 0x7f42c4103cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:48:14.106 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.102+0000 7f42c9bb5700 1 --2- 172.21.15.76:0/3332210736 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f42c4100f70 0x7f42c4102350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:48:14.106 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.102+0000 7f42cabb7700 1 --2- 172.21.15.76:0/3332210736 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f42c4101910 0x7f42c4102890 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f42bc007ee0 tx=0x7f42bc00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:14.106 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.103+0000 7f42bb7fe700 1 -- 172.21.15.76:0/3332210736 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42bc00dd70 con 0x7f42c4101910 2024-06-02T04:48:14.106 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.103+0000 7f42bb7fe700 1 -- 172.21.15.76:0/3332210736 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f42bc00f040 con 0x7f42c4101910 2024-06-02T04:48:14.106 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.103+0000 7f42cc61a700 1 -- 172.21.15.76:0/3332210736 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42c41a10b0 con 0x7f42c4101910 2024-06-02T04:48:14.106 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.103+0000 7f42bb7fe700 1 -- 172.21.15.76:0/3332210736 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42bc004870 con 0x7f42c4101910 2024-06-02T04:48:14.106 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.103+0000 7f42cc61a700 1 -- 172.21.15.76:0/3332210736 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42c41a1570 con 0x7f42c4101910 2024-06-02T04:48:14.106 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.103+0000 7f42cc61a700 1 -- 172.21.15.76:0/3332210736 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42c4067c10 con 0x7f42c4101910 2024-06-02T04:48:14.107 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.105+0000 7f42bb7fe700 1 -- 172.21.15.76:0/3332210736 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f42bc003a00 con 0x7f42c4101910 2024-06-02T04:48:14.107 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.105+0000 7f42bb7fe700 1 --2- 172.21.15.76:0/3332210736 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f42b00a1110 0x7f42b00a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:14.107 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.105+0000 7f42bb7fe700 1 -- 172.21.15.76:0/3332210736 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f42bc0ccd30 con 0x7f42c4101910 2024-06-02T04:48:14.107 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.105+0000 7f42ca3b6700 1 --2- 172.21.15.76:0/3332210736 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f42b00a1110 0x7f42b00a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:14.108 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.106+0000 7f42ca3b6700 1 --2- 172.21.15.76:0/3332210736 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f42b00a1110 0x7f42b00a35d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f42c4100dd0 tx=0x7f42c0008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:14.109 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.109+0000 7f42bb7fe700 1 -- 172.21.15.76:0/3332210736 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f42bc0962d0 con 0x7f42c4101910 2024-06-02T04:48:14.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:14 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/3335406867' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:48:14.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:14 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/575421191' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-02T04:48:14.310 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.309+0000 7f42cc61a700 1 -- 172.21.15.76:0/3332210736 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f42c410b730 con 0x7f42c4101910 2024-06-02T04:48:14.310 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.310+0000 7f42bb7fe700 1 -- 172.21.15.76:0/3332210736 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v80) v1 ==== 104+0+11 (secure 0 0 0) 0x7f42bc023020 con 0x7f42c4101910 2024-06-02T04:48:14.310 INFO:teuthology.orchestra.run.smithi076.stdout:pg_num: 32 2024-06-02T04:48:14.312 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.312+0000 7f42cc61a700 1 -- 172.21.15.76:0/3332210736 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f42b00a1110 msgr2=0x7f42b00a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:14.312 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.312+0000 7f42cc61a700 1 --2- 172.21.15.76:0/3332210736 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f42b00a1110 0x7f42b00a35d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f42c4100dd0 tx=0x7f42c0008040 comp rx=0 tx=0).stop 2024-06-02T04:48:14.313 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.312+0000 7f42cc61a700 1 -- 172.21.15.76:0/3332210736 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f42c4101910 msgr2=0x7f42c4102890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:14.313 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.312+0000 7f42cc61a700 1 --2- 172.21.15.76:0/3332210736 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f42c4101910 0x7f42c4102890 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f42bc007ee0 tx=0x7f42bc00d3b0 comp rx=0 tx=0).stop 2024-06-02T04:48:14.313 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.312+0000 7f42cc61a700 1 -- 172.21.15.76:0/3332210736 shutdown_connections 2024-06-02T04:48:14.313 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.312+0000 7f42cc61a700 1 --2- 172.21.15.76:0/3332210736 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f42c4101910 0x7f42c4102890 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:14.313 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.312+0000 7f42cc61a700 1 --2- 172.21.15.76:0/3332210736 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f42c40ffd80 0x7f42c4103cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:14.313 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.312+0000 7f42cc61a700 1 --2- 172.21.15.76:0/3332210736 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f42b00a1110 0x7f42b00a35d0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:14.313 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.312+0000 7f42cc61a700 1 --2- 172.21.15.76:0/3332210736 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f42c4100f70 0x7f42c4102350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:14.313 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.312+0000 7f42cc61a700 1 -- 172.21.15.76:0/3332210736 >> 172.21.15.76:0/3332210736 conn(0x7f42c40fb310 msgr2=0x7f42c4068020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:14.313 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.312+0000 7f42cc61a700 1 -- 172.21.15.76:0/3332210736 shutdown_connections 2024-06-02T04:48:14.313 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.312+0000 7f42cc61a700 1 -- 172.21.15.76:0/3332210736 wait complete. 2024-06-02T04:48:14.324 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-06-02T04:48:14.451 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.449+0000 7f36bb3e3700 1 -- 172.21.15.76:0/1577550695 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f36b40fffe0 msgr2=0x7f36b4100460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:14.451 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.449+0000 7f36bb3e3700 1 --2- 172.21.15.76:0/1577550695 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f36b40fffe0 0x7f36b4100460 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f36b0009990 tx=0x7f36b0009ca0 comp rx=0 tx=0).stop 2024-06-02T04:48:14.451 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.449+0000 7f36bb3e3700 1 -- 172.21.15.76:0/1577550695 shutdown_connections 2024-06-02T04:48:14.452 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.449+0000 7f36bb3e3700 1 --2- 172.21.15.76:0/1577550695 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f36b41009a0 0x7f36b41082d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:14.452 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.449+0000 7f36bb3e3700 1 --2- 172.21.15.76:0/1577550695 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f36b4101390 0x7f36b41017b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:14.452 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.449+0000 7f36bb3e3700 1 --2- 172.21.15.76:0/1577550695 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f36b40fffe0 0x7f36b4100460 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:14.452 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.449+0000 7f36bb3e3700 1 -- 172.21.15.76:0/1577550695 >> 172.21.15.76:0/1577550695 conn(0x7f36b40fab50 msgr2=0x7f36b40fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:14.452 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.449+0000 7f36bb3e3700 1 -- 172.21.15.76:0/1577550695 shutdown_connections 2024-06-02T04:48:14.452 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.449+0000 7f36bb3e3700 1 -- 172.21.15.76:0/1577550695 wait complete. 2024-06-02T04:48:14.452 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.449+0000 7f36bb3e3700 1 Processor -- start 2024-06-02T04:48:14.452 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.449+0000 7f36bb3e3700 1 -- start start 2024-06-02T04:48:14.452 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.450+0000 7f36bb3e3700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f36b40fffe0 0x7f36b40ff9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:14.452 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.450+0000 7f36bb3e3700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f36b41009a0 0x7f36b419bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:14.452 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.450+0000 7f36bb3e3700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f36b4101390 0x7f36b419e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:14.452 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.450+0000 7f36bb3e3700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36b419ea60 con 0x7f36b41009a0 2024-06-02T04:48:14.452 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.450+0000 7f36bb3e3700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36b419ebd0 con 0x7f36b40fffe0 2024-06-02T04:48:14.453 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.450+0000 7f36bb3e3700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36b419ed90 con 0x7f36b4101390 2024-06-02T04:48:14.453 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.450+0000 7f36b897e700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f36b41009a0 0x7f36b419bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:14.453 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.450+0000 7f36b897e700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f36b41009a0 0x7f36b419bcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:39068/0 (socket says 172.21.15.76:39068) 2024-06-02T04:48:14.453 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.450+0000 7f36b897e700 1 -- 172.21.15.76:0/3475531288 learned_addr learned my addr 172.21.15.76:0/3475531288 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:48:14.453 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.450+0000 7f36b917f700 1 --2- 172.21.15.76:0/3475531288 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f36b40fffe0 0x7f36b40ff9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:14.453 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.450+0000 7f36b9980700 1 --2- 172.21.15.76:0/3475531288 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f36b4101390 0x7f36b419e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:14.453 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.450+0000 7f36b897e700 1 -- 172.21.15.76:0/3475531288 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f36b4101390 msgr2=0x7f36b419e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:14.453 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.450+0000 7f36b897e700 1 --2- 172.21.15.76:0/3475531288 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f36b4101390 0x7f36b419e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:14.453 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.450+0000 7f36b897e700 1 -- 172.21.15.76:0/3475531288 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f36b40fffe0 msgr2=0x7f36b40ff9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:14.453 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.450+0000 7f36b897e700 1 --2- 172.21.15.76:0/3475531288 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f36b40fffe0 0x7f36b40ff9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:14.453 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.450+0000 7f36b897e700 1 -- 172.21.15.76:0/3475531288 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36b00095f0 con 0x7f36b41009a0 2024-06-02T04:48:14.453 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.450+0000 7f36b9980700 1 --2- 172.21.15.76:0/3475531288 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f36b4101390 0x7f36b419e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:48:14.453 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.450+0000 7f36b897e700 1 --2- 172.21.15.76:0/3475531288 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f36b41009a0 0x7f36b419bcd0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f36b0006010 tx=0x7f36b0005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:14.454 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.450+0000 7f36aa7fc700 1 -- 172.21.15.76:0/3475531288 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36b001d070 con 0x7f36b41009a0 2024-06-02T04:48:14.454 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.450+0000 7f36bb3e3700 1 -- 172.21.15.76:0/3475531288 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36b419f010 con 0x7f36b41009a0 2024-06-02T04:48:14.454 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.450+0000 7f36aa7fc700 1 -- 172.21.15.76:0/3475531288 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f36b0004080 con 0x7f36b41009a0 2024-06-02T04:48:14.454 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.450+0000 7f36aa7fc700 1 -- 172.21.15.76:0/3475531288 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36b0022c70 con 0x7f36b41009a0 2024-06-02T04:48:14.454 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.450+0000 7f36bb3e3700 1 -- 172.21.15.76:0/3475531288 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36b419f440 con 0x7f36b41009a0 2024-06-02T04:48:14.454 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.451+0000 7f36bb3e3700 1 -- 172.21.15.76:0/3475531288 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36b41073b0 con 0x7f36b41009a0 2024-06-02T04:48:14.455 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.452+0000 7f36aa7fc700 1 -- 172.21.15.76:0/3475531288 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f36b0022470 con 0x7f36b41009a0 2024-06-02T04:48:14.455 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.453+0000 7f36aa7fc700 1 --2- 172.21.15.76:0/3475531288 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f36a00a1120 0x7f36a00a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:14.455 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.453+0000 7f36b917f700 1 --2- 172.21.15.76:0/3475531288 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f36a00a1120 0x7f36a00a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:14.455 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.453+0000 7f36aa7fc700 1 -- 172.21.15.76:0/3475531288 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f36b00ce820 con 0x7f36b41009a0 2024-06-02T04:48:14.455 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.453+0000 7f36b917f700 1 --2- 172.21.15.76:0/3475531288 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f36a00a1120 0x7f36a00a35e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f36b4067b60 tx=0x7f36a4009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:14.457 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.457+0000 7f36aa7fc700 1 -- 172.21.15.76:0/3475531288 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f36b0097e50 con 0x7f36b41009a0 2024-06-02T04:48:14.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:14 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/3335406867' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:48:14.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:14 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/575421191' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-02T04:48:14.652 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.652+0000 7f36bb3e3700 1 -- 172.21.15.76:0/3475531288 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f36b410b6a0 con 0x7f36b41009a0 2024-06-02T04:48:14.652 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.652+0000 7f36aa7fc700 1 -- 172.21.15.76:0/3475531288 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v80) v1 ==== 100+0+11 (secure 0 0 0) 0x7f36b0027020 con 0x7f36b41009a0 2024-06-02T04:48:14.653 INFO:teuthology.orchestra.run.smithi076.stdout:pg_num: 64 2024-06-02T04:48:14.655 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.654+0000 7f36bb3e3700 1 -- 172.21.15.76:0/3475531288 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f36a00a1120 msgr2=0x7f36a00a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:14.655 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.654+0000 7f36bb3e3700 1 --2- 172.21.15.76:0/3475531288 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f36a00a1120 0x7f36a00a35e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f36b4067b60 tx=0x7f36a4009190 comp rx=0 tx=0).stop 2024-06-02T04:48:14.655 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.654+0000 7f36bb3e3700 1 -- 172.21.15.76:0/3475531288 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f36b41009a0 msgr2=0x7f36b419bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:14.655 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.654+0000 7f36bb3e3700 1 --2- 172.21.15.76:0/3475531288 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f36b41009a0 0x7f36b419bcd0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f36b0006010 tx=0x7f36b0005740 comp rx=0 tx=0).stop 2024-06-02T04:48:14.655 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.654+0000 7f36bb3e3700 1 -- 172.21.15.76:0/3475531288 shutdown_connections 2024-06-02T04:48:14.655 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.654+0000 7f36bb3e3700 1 --2- 172.21.15.76:0/3475531288 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f36b4101390 0x7f36b419e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:14.655 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.654+0000 7f36bb3e3700 1 --2- 172.21.15.76:0/3475531288 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f36a00a1120 0x7f36a00a35e0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:14.655 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.654+0000 7f36bb3e3700 1 --2- 172.21.15.76:0/3475531288 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f36b40fffe0 0x7f36b40ff9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:14.655 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.654+0000 7f36bb3e3700 1 --2- 172.21.15.76:0/3475531288 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f36b41009a0 0x7f36b419bcd0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:14.655 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.654+0000 7f36bb3e3700 1 -- 172.21.15.76:0/3475531288 >> 172.21.15.76:0/3475531288 conn(0x7f36b40fab50 msgr2=0x7f36b41044f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:14.656 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.654+0000 7f36bb3e3700 1 -- 172.21.15.76:0/3475531288 shutdown_connections 2024-06-02T04:48:14.656 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.654+0000 7f36bb3e3700 1 -- 172.21.15.76:0/3475531288 wait complete. 2024-06-02T04:48:14.666 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-06-02T04:48:14.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:14 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/3335406867' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:48:14.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:14 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/575421191' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-02T04:48:14.796 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.794+0000 7f672056d700 1 -- 172.21.15.76:0/2321223398 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6718104390 msgr2=0x7f6718106780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:14.797 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.794+0000 7f672056d700 1 --2- 172.21.15.76:0/2321223398 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6718104390 0x7f6718106780 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f6714009990 tx=0x7f6714009ca0 comp rx=0 tx=0).stop 2024-06-02T04:48:14.797 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.794+0000 7f672056d700 1 -- 172.21.15.76:0/2321223398 shutdown_connections 2024-06-02T04:48:14.797 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.794+0000 7f672056d700 1 --2- 172.21.15.76:0/2321223398 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6718106cc0 0x7f67181090d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:14.797 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.794+0000 7f672056d700 1 --2- 172.21.15.76:0/2321223398 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6718101a60 0x7f6718103e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:14.797 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.794+0000 7f672056d700 1 --2- 172.21.15.76:0/2321223398 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6718104390 0x7f6718106780 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:14.797 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.794+0000 7f672056d700 1 -- 172.21.15.76:0/2321223398 >> 172.21.15.76:0/2321223398 conn(0x7f67180fb3f0 msgr2=0x7f67180fd830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:14.797 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.794+0000 7f672056d700 1 -- 172.21.15.76:0/2321223398 shutdown_connections 2024-06-02T04:48:14.797 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.794+0000 7f672056d700 1 -- 172.21.15.76:0/2321223398 wait complete. 2024-06-02T04:48:14.797 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.795+0000 7f672056d700 1 Processor -- start 2024-06-02T04:48:14.798 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.795+0000 7f672056d700 1 -- start start 2024-06-02T04:48:14.798 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.795+0000 7f672056d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6718101a60 0x7f6718196e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:14.798 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.795+0000 7f672056d700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6718104390 0x7f6718197370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:14.798 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.795+0000 7f672056d700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6718106cc0 0x7f671819e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:14.798 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.795+0000 7f672056d700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f671819e960 con 0x7f6718104390 2024-06-02T04:48:14.798 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.795+0000 7f672056d700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f671819eaa0 con 0x7f6718106cc0 2024-06-02T04:48:14.798 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.795+0000 7f672056d700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f671819ec30 con 0x7f6718101a60 2024-06-02T04:48:14.798 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.795+0000 7f671db08700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6718104390 0x7f6718197370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:14.798 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.795+0000 7f671db08700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6718104390 0x7f6718197370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:39094/0 (socket says 172.21.15.76:39094) 2024-06-02T04:48:14.798 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.795+0000 7f671db08700 1 -- 172.21.15.76:0/2717906587 learned_addr learned my addr 172.21.15.76:0/2717906587 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:48:14.799 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.795+0000 7f671e309700 1 --2- 172.21.15.76:0/2717906587 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6718101a60 0x7f6718196e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:14.799 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.795+0000 7f671eb0a700 1 --2- 172.21.15.76:0/2717906587 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6718106cc0 0x7f671819e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:14.799 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.795+0000 7f671db08700 1 -- 172.21.15.76:0/2717906587 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6718101a60 msgr2=0x7f6718196e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:14.799 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.795+0000 7f671db08700 1 --2- 172.21.15.76:0/2717906587 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6718101a60 0x7f6718196e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:14.799 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.795+0000 7f671db08700 1 -- 172.21.15.76:0/2717906587 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6718106cc0 msgr2=0x7f671819e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:14.799 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.795+0000 7f671db08700 1 --2- 172.21.15.76:0/2717906587 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6718106cc0 0x7f671819e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:14.799 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.795+0000 7f671db08700 1 -- 172.21.15.76:0/2717906587 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67140095f0 con 0x7f6718104390 2024-06-02T04:48:14.799 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.795+0000 7f671e309700 1 --2- 172.21.15.76:0/2717906587 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6718101a60 0x7f6718196e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:48:14.799 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.795+0000 7f671db08700 1 --2- 172.21.15.76:0/2717906587 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6718104390 0x7f6718197370 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f67140098e0 tx=0x7f6714003b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:14.799 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.796+0000 7f670f7fe700 1 -- 172.21.15.76:0/2717906587 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f671401d070 con 0x7f6718104390 2024-06-02T04:48:14.799 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.796+0000 7f672056d700 1 -- 172.21.15.76:0/2717906587 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f671819eeb0 con 0x7f6718104390 2024-06-02T04:48:14.799 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.796+0000 7f670f7fe700 1 -- 172.21.15.76:0/2717906587 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f671400bd90 con 0x7f6718104390 2024-06-02T04:48:14.800 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.796+0000 7f670f7fe700 1 -- 172.21.15.76:0/2717906587 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6714022dc0 con 0x7f6718104390 2024-06-02T04:48:14.800 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.796+0000 7f672056d700 1 -- 172.21.15.76:0/2717906587 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f671819f270 con 0x7f6718104390 2024-06-02T04:48:14.800 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.796+0000 7f672056d700 1 -- 172.21.15.76:0/2717906587 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67180fcf70 con 0x7f6718104390 2024-06-02T04:48:14.801 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.798+0000 7f670f7fe700 1 -- 172.21.15.76:0/2717906587 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f6714003ff0 con 0x7f6718104390 2024-06-02T04:48:14.801 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.798+0000 7f670f7fe700 1 --2- 172.21.15.76:0/2717906587 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f67040a1120 0x7f67040a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:14.801 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.798+0000 7f671e309700 1 --2- 172.21.15.76:0/2717906587 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f67040a1120 0x7f67040a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:14.801 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.798+0000 7f670f7fe700 1 -- 172.21.15.76:0/2717906587 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f67140ce710 con 0x7f6718104390 2024-06-02T04:48:14.801 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.799+0000 7f671e309700 1 --2- 172.21.15.76:0/2717906587 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f67040a1120 0x7f67040a35e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f6708005950 tx=0x7f67080058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:14.802 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:14.802+0000 7f670f7fe700 1 -- 172.21.15.76:0/2717906587 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f6714097d40 con 0x7f6718104390 2024-06-02T04:48:15.002 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.002+0000 7f672056d700 1 -- 172.21.15.76:0/2717906587 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f671810c940 con 0x7f6718104390 2024-06-02T04:48:15.002 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.002+0000 7f670f7fe700 1 -- 172.21.15.76:0/2717906587 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v80) v1 ==== 103+0+11 (secure 0 0 0) 0x7f671409b360 con 0x7f6718104390 2024-06-02T04:48:15.003 INFO:teuthology.orchestra.run.smithi076.stdout:pg_num: 32 2024-06-02T04:48:15.005 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.004+0000 7f672056d700 1 -- 172.21.15.76:0/2717906587 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f67040a1120 msgr2=0x7f67040a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:15.005 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.004+0000 7f672056d700 1 --2- 172.21.15.76:0/2717906587 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f67040a1120 0x7f67040a35e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f6708005950 tx=0x7f67080058e0 comp rx=0 tx=0).stop 2024-06-02T04:48:15.005 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.004+0000 7f672056d700 1 -- 172.21.15.76:0/2717906587 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6718104390 msgr2=0x7f6718197370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:15.005 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.004+0000 7f672056d700 1 --2- 172.21.15.76:0/2717906587 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6718104390 0x7f6718197370 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f67140098e0 tx=0x7f6714003b00 comp rx=0 tx=0).stop 2024-06-02T04:48:15.005 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.004+0000 7f672056d700 1 -- 172.21.15.76:0/2717906587 shutdown_connections 2024-06-02T04:48:15.005 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.004+0000 7f672056d700 1 --2- 172.21.15.76:0/2717906587 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f67040a1120 0x7f67040a35e0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:15.005 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.004+0000 7f672056d700 1 --2- 172.21.15.76:0/2717906587 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6718106cc0 0x7f671819e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:15.005 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.004+0000 7f672056d700 1 --2- 172.21.15.76:0/2717906587 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6718101a60 0x7f6718196e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:15.005 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.004+0000 7f672056d700 1 --2- 172.21.15.76:0/2717906587 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6718104390 0x7f6718197370 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:15.005 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.004+0000 7f672056d700 1 -- 172.21.15.76:0/2717906587 >> 172.21.15.76:0/2717906587 conn(0x7f67180fb3f0 msgr2=0x7f6718102300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:15.006 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.004+0000 7f672056d700 1 -- 172.21.15.76:0/2717906587 shutdown_connections 2024-06-02T04:48:15.006 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.004+0000 7f672056d700 1 -- 172.21.15.76:0/2717906587 wait complete. 2024-06-02T04:48:15.017 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-06-02T04:48:15.140 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.139+0000 7f31635e1700 1 -- 172.21.15.76:0/1719198416 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f315c102160 msgr2=0x7f315c1045f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:15.140 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.139+0000 7f31635e1700 1 --2- 172.21.15.76:0/1719198416 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f315c102160 0x7f315c1045f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3150009990 tx=0x7f3150009ca0 comp rx=0 tx=0).stop 2024-06-02T04:48:15.141 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.139+0000 7f31635e1700 1 -- 172.21.15.76:0/1719198416 shutdown_connections 2024-06-02T04:48:15.141 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.139+0000 7f31635e1700 1 --2- 172.21.15.76:0/1719198416 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f315c104b30 0x7f315c104fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:15.141 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.139+0000 7f31635e1700 1 --2- 172.21.15.76:0/1719198416 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f315c0ff7f0 0x7f315c101c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:15.141 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.139+0000 7f31635e1700 1 --2- 172.21.15.76:0/1719198416 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f315c102160 0x7f315c1045f0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:15.141 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.139+0000 7f31635e1700 1 -- 172.21.15.76:0/1719198416 >> 172.21.15.76:0/1719198416 conn(0x7f315c0fb3f0 msgr2=0x7f315c0fd830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:15.141 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.140+0000 7f31635e1700 1 -- 172.21.15.76:0/1719198416 shutdown_connections 2024-06-02T04:48:15.141 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.140+0000 7f31635e1700 1 -- 172.21.15.76:0/1719198416 wait complete. 2024-06-02T04:48:15.141 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.140+0000 7f31635e1700 1 Processor -- start 2024-06-02T04:48:15.141 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.140+0000 7f31635e1700 1 -- start start 2024-06-02T04:48:15.144 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.141+0000 7f31635e1700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f315c0ff7f0 0x7f315c19d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:15.144 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.141+0000 7f31635e1700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f315c102160 0x7f315c19d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:15.144 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.141+0000 7f31635e1700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f315c104b30 0x7f315c1a4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:15.144 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.141+0000 7f31635e1700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f315c1a4f30 con 0x7f315c104b30 2024-06-02T04:48:15.144 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.141+0000 7f31635e1700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f315c1a5070 con 0x7f315c0ff7f0 2024-06-02T04:48:15.144 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.141+0000 7f31635e1700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f315c1a5200 con 0x7f315c102160 2024-06-02T04:48:15.144 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.141+0000 7f3161b7e700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f315c104b30 0x7f315c1a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:15.144 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.141+0000 7f3161b7e700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f315c104b30 0x7f315c1a4960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:39110/0 (socket says 172.21.15.76:39110) 2024-06-02T04:48:15.144 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.141+0000 7f3161b7e700 1 -- 172.21.15.76:0/444156103 learned_addr learned my addr 172.21.15.76:0/444156103 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:48:15.144 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.141+0000 7f316137d700 1 --2- 172.21.15.76:0/444156103 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f315c0ff7f0 0x7f315c19d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:15.144 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.141+0000 7f3161b7e700 1 -- 172.21.15.76:0/444156103 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f315c102160 msgr2=0x7f315c19d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:15.144 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.141+0000 7f3160b7c700 1 --2- 172.21.15.76:0/444156103 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f315c102160 0x7f315c19d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:15.145 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.141+0000 7f3161b7e700 1 --2- 172.21.15.76:0/444156103 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f315c102160 0x7f315c19d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:15.145 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.141+0000 7f3161b7e700 1 -- 172.21.15.76:0/444156103 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f315c0ff7f0 msgr2=0x7f315c19d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:15.145 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.141+0000 7f3161b7e700 1 --2- 172.21.15.76:0/444156103 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f315c0ff7f0 0x7f315c19d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:15.145 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.141+0000 7f3161b7e700 1 -- 172.21.15.76:0/444156103 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31500095f0 con 0x7f315c104b30 2024-06-02T04:48:15.145 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.141+0000 7f316137d700 1 --2- 172.21.15.76:0/444156103 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f315c0ff7f0 0x7f315c19d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:48:15.145 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.141+0000 7f3161b7e700 1 --2- 172.21.15.76:0/444156103 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f315c104b30 0x7f315c1a4960 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f314c00d980 tx=0x7f314c00dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:15.145 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.141+0000 7f315a7fc700 1 -- 172.21.15.76:0/444156103 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f314c009940 con 0x7f315c104b30 2024-06-02T04:48:15.145 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.141+0000 7f315a7fc700 1 -- 172.21.15.76:0/444156103 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f314c004830 con 0x7f315c104b30 2024-06-02T04:48:15.145 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.141+0000 7f31635e1700 1 -- 172.21.15.76:0/444156103 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f315c1a54e0 con 0x7f315c104b30 2024-06-02T04:48:15.145 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.141+0000 7f315a7fc700 1 -- 172.21.15.76:0/444156103 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f314c005410 con 0x7f315c104b30 2024-06-02T04:48:15.145 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.141+0000 7f31635e1700 1 -- 172.21.15.76:0/444156103 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f315c1a59a0 con 0x7f315c104b30 2024-06-02T04:48:15.145 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.142+0000 7f31635e1700 1 -- 172.21.15.76:0/444156103 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f315c0fcf70 con 0x7f315c104b30 2024-06-02T04:48:15.146 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.143+0000 7f315a7fc700 1 -- 172.21.15.76:0/444156103 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f314c0049a0 con 0x7f315c104b30 2024-06-02T04:48:15.146 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.144+0000 7f315a7fc700 1 --2- 172.21.15.76:0/444156103 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f31440a11a0 0x7f31440a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:15.146 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.144+0000 7f316137d700 1 --2- 172.21.15.76:0/444156103 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f31440a11a0 0x7f31440a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:15.146 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.144+0000 7f315a7fc700 1 -- 172.21.15.76:0/444156103 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f314c0ccdf0 con 0x7f315c104b30 2024-06-02T04:48:15.146 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.144+0000 7f316137d700 1 --2- 172.21.15.76:0/444156103 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f31440a11a0 0x7f31440a3660 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f3154009550 tx=0x7f3154009040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:15.148 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.148+0000 7f315a7fc700 1 -- 172.21.15.76:0/444156103 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f314c096330 con 0x7f315c104b30 2024-06-02T04:48:15.359 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.359+0000 7f31635e1700 1 -- 172.21.15.76:0/444156103 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f315c068140 con 0x7f315c104b30 2024-06-02T04:48:15.359 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.359+0000 7f315a7fc700 1 -- 172.21.15.76:0/444156103 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v80) v1 ==== 81+0+590 (secure 0 0 0) 0x7f314c017070 con 0x7f315c104b30 2024-06-02T04:48:15.359 INFO:teuthology.orchestra.run.smithi076.stdout:172.21.15.76:6801/4200406736 2024-06-03T04:43:06.092916+0000 2024-06-02T04:48:15.360 INFO:teuthology.orchestra.run.smithi076.stdout:172.21.15.76:6800/4200406736 2024-06-03T04:43:06.092916+0000 2024-06-02T04:48:15.360 INFO:teuthology.orchestra.run.smithi076.stdout:172.21.15.76:0/1524144593 2024-06-03T04:43:06.092916+0000 2024-06-02T04:48:15.360 INFO:teuthology.orchestra.run.smithi076.stdout:172.21.15.76:0/3269372590 2024-06-03T04:43:06.092916+0000 2024-06-02T04:48:15.360 INFO:teuthology.orchestra.run.smithi076.stdout:172.21.15.76:0/3570893846 2024-06-03T04:42:44.872236+0000 2024-06-02T04:48:15.360 INFO:teuthology.orchestra.run.smithi076.stdout:172.21.15.76:0/902035790 2024-06-03T04:43:06.092916+0000 2024-06-02T04:48:15.360 INFO:teuthology.orchestra.run.smithi076.stdout:172.21.15.76:6800/2550846765 2024-06-03T04:42:44.872236+0000 2024-06-02T04:48:15.360 INFO:teuthology.orchestra.run.smithi076.stdout:172.21.15.76:6801/2550846765 2024-06-03T04:42:44.872236+0000 2024-06-02T04:48:15.360 INFO:teuthology.orchestra.run.smithi076.stdout:172.21.15.76:0/2646712763 2024-06-03T04:42:44.872236+0000 2024-06-02T04:48:15.360 INFO:teuthology.orchestra.run.smithi076.stdout:172.21.15.76:0/964578813 2024-06-03T04:42:44.872236+0000 2024-06-02T04:48:15.361 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.361+0000 7f31635e1700 1 -- 172.21.15.76:0/444156103 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f31440a11a0 msgr2=0x7f31440a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:15.361 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.361+0000 7f31635e1700 1 --2- 172.21.15.76:0/444156103 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f31440a11a0 0x7f31440a3660 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f3154009550 tx=0x7f3154009040 comp rx=0 tx=0).stop 2024-06-02T04:48:15.361 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.361+0000 7f31635e1700 1 -- 172.21.15.76:0/444156103 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f315c104b30 msgr2=0x7f315c1a4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:15.362 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.361+0000 7f31635e1700 1 --2- 172.21.15.76:0/444156103 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f315c104b30 0x7f315c1a4960 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f314c00d980 tx=0x7f314c00dd40 comp rx=0 tx=0).stop 2024-06-02T04:48:15.362 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.361+0000 7f31635e1700 1 -- 172.21.15.76:0/444156103 shutdown_connections 2024-06-02T04:48:15.362 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.361+0000 7f31635e1700 1 --2- 172.21.15.76:0/444156103 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f315c104b30 0x7f315c1a4960 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:15.362 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.361+0000 7f31635e1700 1 --2- 172.21.15.76:0/444156103 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f31440a11a0 0x7f31440a3660 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:15.362 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.361+0000 7f31635e1700 1 --2- 172.21.15.76:0/444156103 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f315c0ff7f0 0x7f315c19d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:15.362 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.361+0000 7f31635e1700 1 --2- 172.21.15.76:0/444156103 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f315c102160 0x7f315c19d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:15.362 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.361+0000 7f31635e1700 1 -- 172.21.15.76:0/444156103 >> 172.21.15.76:0/444156103 conn(0x7f315c0fb3f0 msgr2=0x7f315c100370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:15.362 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.361+0000 7f31635e1700 1 -- 172.21.15.76:0/444156103 shutdown_connections 2024-06-02T04:48:15.362 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.361+0000 7f31635e1700 1 -- 172.21.15.76:0/444156103 wait complete. 2024-06-02T04:48:15.363 INFO:teuthology.orchestra.run.smithi076.stderr:listed 10 entries 2024-06-02T04:48:15.372 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:15 smithi076 ceph-mon[42935]: pgmap v224: 129 pgs: 129 active+clean; 579 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 4 op/s 2024-06-02T04:48:15.372 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:15 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/3332210736' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-06-02T04:48:15.372 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:15 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/3475531288' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-06-02T04:48:15.372 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:15 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/2717906587' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-06-02T04:48:15.373 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2024-06-02T04:48:15.373 DEBUG:teuthology.orchestra.run.smithi076:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T04:48:15.392 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-02T04:48:15.557 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.554+0000 7f9b5335a700 1 -- 172.21.15.76:0/886452659 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9b4c101fd0 msgr2=0x7f9b4c102450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:15.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.554+0000 7f9b5335a700 1 --2- 172.21.15.76:0/886452659 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9b4c101fd0 0x7f9b4c102450 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9b48009990 tx=0x7f9b48009ca0 comp rx=0 tx=0).stop 2024-06-02T04:48:15.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.554+0000 7f9b5335a700 1 -- 172.21.15.76:0/886452659 shutdown_connections 2024-06-02T04:48:15.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.554+0000 7f9b5335a700 1 --2- 172.21.15.76:0/886452659 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9b4c102990 0x7f9b4c1092b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:15.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.554+0000 7f9b5335a700 1 --2- 172.21.15.76:0/886452659 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9b4c100e80 0x7f9b4c1012a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:15.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.554+0000 7f9b5335a700 1 --2- 172.21.15.76:0/886452659 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9b4c101fd0 0x7f9b4c102450 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:15.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.554+0000 7f9b5335a700 1 -- 172.21.15.76:0/886452659 >> 172.21.15.76:0/886452659 conn(0x7f9b4c0fc410 msgr2=0x7f9b4c0fe830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:15.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.554+0000 7f9b5335a700 1 -- 172.21.15.76:0/886452659 shutdown_connections 2024-06-02T04:48:15.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.554+0000 7f9b5335a700 1 -- 172.21.15.76:0/886452659 wait complete. 2024-06-02T04:48:15.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.554+0000 7f9b5335a700 1 Processor -- start 2024-06-02T04:48:15.559 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.555+0000 7f9b5335a700 1 -- start start 2024-06-02T04:48:15.559 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.555+0000 7f9b5335a700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9b4c100e80 0x7f9b4c196d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:15.559 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.555+0000 7f9b5335a700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9b4c101fd0 0x7f9b4c197290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:15.559 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.555+0000 7f9b5335a700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9b4c102990 0x7f9b4c19e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:15.559 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.555+0000 7f9b5335a700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b4c19e840 con 0x7f9b4c102990 2024-06-02T04:48:15.559 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.555+0000 7f9b5335a700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b4c19e9b0 con 0x7f9b4c101fd0 2024-06-02T04:48:15.559 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.555+0000 7f9b5335a700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b4c19eb70 con 0x7f9b4c100e80 2024-06-02T04:48:15.560 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.555+0000 7f9b518f7700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9b4c102990 0x7f9b4c19e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:15.560 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.555+0000 7f9b518f7700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9b4c102990 0x7f9b4c19e270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:39126/0 (socket says 172.21.15.76:39126) 2024-06-02T04:48:15.560 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.555+0000 7f9b518f7700 1 -- 172.21.15.76:0/1460845273 learned_addr learned my addr 172.21.15.76:0/1460845273 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:48:15.560 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.555+0000 7f9b508f5700 1 --2- 172.21.15.76:0/1460845273 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9b4c101fd0 0x7f9b4c197290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:15.560 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.555+0000 7f9b510f6700 1 --2- 172.21.15.76:0/1460845273 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9b4c100e80 0x7f9b4c196d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:15.560 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.555+0000 7f9b518f7700 1 -- 172.21.15.76:0/1460845273 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9b4c100e80 msgr2=0x7f9b4c196d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:15.560 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.555+0000 7f9b518f7700 1 --2- 172.21.15.76:0/1460845273 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9b4c100e80 0x7f9b4c196d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:15.561 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.555+0000 7f9b518f7700 1 -- 172.21.15.76:0/1460845273 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9b4c101fd0 msgr2=0x7f9b4c197290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:15.561 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.555+0000 7f9b518f7700 1 --2- 172.21.15.76:0/1460845273 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9b4c101fd0 0x7f9b4c197290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:15.561 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.555+0000 7f9b518f7700 1 -- 172.21.15.76:0/1460845273 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b480095f0 con 0x7f9b4c102990 2024-06-02T04:48:15.561 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.555+0000 7f9b518f7700 1 --2- 172.21.15.76:0/1460845273 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9b4c102990 0x7f9b4c19e270 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f9b4400ada0 tx=0x7f9b4400c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:15.561 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.555+0000 7f9b427fc700 1 -- 172.21.15.76:0/1460845273 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b4400f070 con 0x7f9b4c102990 2024-06-02T04:48:15.561 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.555+0000 7f9b427fc700 1 -- 172.21.15.76:0/1460845273 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9b44007b30 con 0x7f9b4c102990 2024-06-02T04:48:15.561 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.555+0000 7f9b5335a700 1 -- 172.21.15.76:0/1460845273 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b4c19ee50 con 0x7f9b4c102990 2024-06-02T04:48:15.561 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.555+0000 7f9b427fc700 1 -- 172.21.15.76:0/1460845273 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b44005280 con 0x7f9b4c102990 2024-06-02T04:48:15.561 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.555+0000 7f9b5335a700 1 -- 172.21.15.76:0/1460845273 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b4c19f220 con 0x7f9b4c102990 2024-06-02T04:48:15.561 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.556+0000 7f9b5335a700 1 -- 172.21.15.76:0/1460845273 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b4c108340 con 0x7f9b4c102990 2024-06-02T04:48:15.562 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.557+0000 7f9b427fc700 1 -- 172.21.15.76:0/1460845273 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f9b4400c980 con 0x7f9b4c102990 2024-06-02T04:48:15.562 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.558+0000 7f9b427fc700 1 --2- 172.21.15.76:0/1460845273 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f9b380a1120 0x7f9b380a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:15.562 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.558+0000 7f9b510f6700 1 --2- 172.21.15.76:0/1460845273 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f9b380a1120 0x7f9b380a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:15.562 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.558+0000 7f9b427fc700 1 -- 172.21.15.76:0/1460845273 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f9b440cc180 con 0x7f9b4c102990 2024-06-02T04:48:15.562 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.559+0000 7f9b510f6700 1 --2- 172.21.15.76:0/1460845273 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f9b380a1120 0x7f9b380a35e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c005950 tx=0x7f9b3c0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:15.564 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.563+0000 7f9b427fc700 1 -- 172.21.15.76:0/1460845273 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f9b440957b0 con 0x7f9b4c102990 2024-06-02T04:48:15.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:15 smithi119 ceph-mon[46633]: pgmap v224: 129 pgs: 129 active+clean; 579 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 4 op/s 2024-06-02T04:48:15.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:15 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/3332210736' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-06-02T04:48:15.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:15 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/3475531288' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-06-02T04:48:15.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:15 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/2717906587' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-06-02T04:48:15.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:15 smithi192 ceph-mon[47933]: pgmap v224: 129 pgs: 129 active+clean; 579 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 4 op/s 2024-06-02T04:48:15.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:15 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/3332210736' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-06-02T04:48:15.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:15 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/3475531288' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-06-02T04:48:15.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:15 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/2717906587' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-06-02T04:48:15.764 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.763+0000 7f9b5335a700 1 -- 172.21.15.76:0/1460845273 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9b4c067c10 con 0x7f9b4c102990 2024-06-02T04:48:15.765 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.764+0000 7f9b427fc700 1 -- 172.21.15.76:0/1460845273 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+23984 (secure 0 0 0) 0x7f9b4400cc30 con 0x7f9b4c102990 2024-06-02T04:48:15.766 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:48:15.766 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":80,"fsid":"60ab6d30-209a-11ef-bc9b-c7b262605968","created":"2024-06-02T04:42:21.007333+0000","modified":"2024-06-02T04:48:07.101373+0000","last_up_change":"2024-06-02T04:47:29.822242+0000","last_in_change":"2024-06-02T04:47:14.253449+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T04:44:56.408602+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-02T04:48:01.194954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-02T04:48:01.828863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-02T04:48:04.916565+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"33a51ba2-be5c-41d0-b5d1-8d6039f2ca4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6802","nonce":2869602045},{"type":"v1","addr":"172.21.15.76:6803","nonce":2869602045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6804","nonce":2869602045},{"type":"v1","addr":"172.21.15.76:6805","nonce":2869602045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6808","nonce":2869602045},{"type":"v1","addr":"172.21.15.76:6809","nonce":2869602045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6806","nonce":2869602045},{"type":"v1","addr":"172.21.15.76:6807","nonce":2869602045}]},"public_addr":"172.21.15.76:6803/2869602045","cluster_addr":"172.21.15.76:6805/2869602045","heartbeat_back_addr":"172.21.15.76:6809/2869602045","heartbeat_front_addr":"172.21.15.76:6807/2869602045","state":["exists","up"]},{"osd":1,"uuid":"ace46e13-3bb7-4103-973a-6860554df8b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":2353738098},{"type":"v1","addr":"172.21.15.119:6801","nonce":2353738098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":2353738098},{"type":"v1","addr":"172.21.15.119:6803","nonce":2353738098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":2353738098},{"type":"v1","addr":"172.21.15.119:6807","nonce":2353738098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":2353738098},{"type":"v1","addr":"172.21.15.119:6805","nonce":2353738098}]},"public_addr":"172.21.15.119:6801/2353738098","cluster_addr":"172.21.15.119:6803/2353738098","heartbeat_back_addr":"172.21.15.119:6807/2353738098","heartbeat_front_addr":"172.21.15.119:6805/2353738098","state":["exists","up"]},{"osd":2,"uuid":"4addc09e-77a9-428a-bcc4-38194f486cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":3206918546},{"type":"v1","addr":"172.21.15.192:6801","nonce":3206918546}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":3206918546},{"type":"v1","addr":"172.21.15.192:6803","nonce":3206918546}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":3206918546},{"type":"v1","addr":"172.21.15.192:6807","nonce":3206918546}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":3206918546},{"type":"v1","addr":"172.21.15.192:6805","nonce":3206918546}]},"public_addr":"172.21.15.192:6801/3206918546","cluster_addr":"172.21.15.192:6803/3206918546","heartbeat_back_addr":"172.21.15.192:6807/3206918546","heartbeat_front_addr":"172.21.15.192:6805/3206918546","state":["exists","up"]},{"osd":3,"uuid":"dc525518-82c6-49ed-8ca8-e3bd5bfc18d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6810","nonce":3747864233},{"type":"v1","addr":"172.21.15.76:6811","nonce":3747864233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6812","nonce":3747864233},{"type":"v1","addr":"172.21.15.76:6813","nonce":3747864233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6816","nonce":3747864233},{"type":"v1","addr":"172.21.15.76:6817","nonce":3747864233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6814","nonce":3747864233},{"type":"v1","addr":"172.21.15.76:6815","nonce":3747864233}]},"public_addr":"172.21.15.76:6811/3747864233","cluster_addr":"172.21.15.76:6813/3747864233","heartbeat_back_addr":"172.21.15.76:6817/3747864233","heartbeat_front_addr":"172.21.15.76:6815/3747864233","state":["exists","up"]},{"osd":4,"uuid":"eef293d0-cb87-47b3-9751-c6437a1cf079","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":2571629047},{"type":"v1","addr":"172.21.15.119:6809","nonce":2571629047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":2571629047},{"type":"v1","addr":"172.21.15.119:6811","nonce":2571629047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":2571629047},{"type":"v1","addr":"172.21.15.119:6815","nonce":2571629047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":2571629047},{"type":"v1","addr":"172.21.15.119:6813","nonce":2571629047}]},"public_addr":"172.21.15.119:6809/2571629047","cluster_addr":"172.21.15.119:6811/2571629047","heartbeat_back_addr":"172.21.15.119:6815/2571629047","heartbeat_front_addr":"172.21.15.119:6813/2571629047","state":["exists","up"]},{"osd":5,"uuid":"60eb8c6e-766c-49d0-9997-44f85776b3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3285065416},{"type":"v1","addr":"172.21.15.192:6809","nonce":3285065416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":3285065416},{"type":"v1","addr":"172.21.15.192:6811","nonce":3285065416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3285065416},{"type":"v1","addr":"172.21.15.192:6815","nonce":3285065416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":3285065416},{"type":"v1","addr":"172.21.15.192:6813","nonce":3285065416}]},"public_addr":"172.21.15.192:6809/3285065416","cluster_addr":"172.21.15.192:6811/3285065416","heartbeat_back_addr":"172.21.15.192:6815/3285065416","heartbeat_front_addr":"172.21.15.192:6813/3285065416","state":["exists","up"]},{"osd":6,"uuid":"e6dc8b9d-dd06-4870-a506-def8201b7e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6818","nonce":2951381580},{"type":"v1","addr":"172.21.15.76:6819","nonce":2951381580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6820","nonce":2951381580},{"type":"v1","addr":"172.21.15.76:6821","nonce":2951381580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6824","nonce":2951381580},{"type":"v1","addr":"172.21.15.76:6825","nonce":2951381580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6822","nonce":2951381580},{"type":"v1","addr":"172.21.15.76:6823","nonce":2951381580}]},"public_addr":"172.21.15.76:6819/2951381580","cluster_addr":"172.21.15.76:6821/2951381580","heartbeat_back_addr":"172.21.15.76:6825/2951381580","heartbeat_front_addr":"172.21.15.76:6823/2951381580","state":["exists","up"]},{"osd":7,"uuid":"2f5dccb3-39a1-4f25-8715-fa264d59db97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1802558756},{"type":"v1","addr":"172.21.15.119:6817","nonce":1802558756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1802558756},{"type":"v1","addr":"172.21.15.119:6819","nonce":1802558756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1802558756},{"type":"v1","addr":"172.21.15.119:6823","nonce":1802558756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1802558756},{"type":"v1","addr":"172.21.15.119:6821","nonce":1802558756}]},"public_addr":"172.21.15.119:6817/1802558756","cluster_addr":"172.21.15.119:6819/1802558756","heartbeat_back_addr":"172.21.15.119:6823/1802558756","heartbeat_front_addr":"172.21.15.119:6821/1802558756","state":["exists","up"]},{"osd":8,"uuid":"39b6ccd0-16e7-4cd5-87e0-d827e9172984","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":1214972276},{"type":"v1","addr":"172.21.15.192:6817","nonce":1214972276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":1214972276},{"type":"v1","addr":"172.21.15.192:6819","nonce":1214972276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":1214972276},{"type":"v1","addr":"172.21.15.192:6823","nonce":1214972276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":1214972276},{"type":"v1","addr":"172.21.15.192:6821","nonce":1214972276}]},"public_addr":"172.21.15.192:6817/1214972276","cluster_addr":"172.21.15.192:6819/1214972276","heartbeat_back_addr":"172.21.15.192:6823/1214972276","heartbeat_front_addr":"172.21.15.192:6821/1214972276","state":["exists","up"]},{"osd":9,"uuid":"851b2155-07bd-45de-bfe0-53021fda733f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6826","nonce":3095501821},{"type":"v1","addr":"172.21.15.76:6827","nonce":3095501821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6828","nonce":3095501821},{"type":"v1","addr":"172.21.15.76:6829","nonce":3095501821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":3095501821},{"type":"v1","addr":"172.21.15.76:6833","nonce":3095501821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6830","nonce":3095501821},{"type":"v1","addr":"172.21.15.76:6831","nonce":3095501821}]},"public_addr":"172.21.15.76:6827/3095501821","cluster_addr":"172.21.15.76:6829/3095501821","heartbeat_back_addr":"172.21.15.76:6833/3095501821","heartbeat_front_addr":"172.21.15.76:6831/3095501821","state":["exists","up"]},{"osd":10,"uuid":"e4b18e7e-bddf-4dd4-84f6-7902ea327cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":4082130894},{"type":"v1","addr":"172.21.15.119:6825","nonce":4082130894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":4082130894},{"type":"v1","addr":"172.21.15.119:6827","nonce":4082130894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":4082130894},{"type":"v1","addr":"172.21.15.119:6831","nonce":4082130894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":4082130894},{"type":"v1","addr":"172.21.15.119:6829","nonce":4082130894}]},"public_addr":"172.21.15.119:6825/4082130894","cluster_addr":"172.21.15.119:6827/4082130894","heartbeat_back_addr":"172.21.15.119:6831/4082130894","heartbeat_front_addr":"172.21.15.119:6829/4082130894","state":["exists","up"]},{"osd":11,"uuid":"54567e18-920c-4ae9-9557-0efba5a1a820","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":439693921},{"type":"v1","addr":"172.21.15.192:6825","nonce":439693921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":439693921},{"type":"v1","addr":"172.21.15.192:6827","nonce":439693921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":439693921},{"type":"v1","addr":"172.21.15.192:6831","nonce":439693921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":439693921},{"type":"v1","addr":"172.21.15.192:6829","nonce":439693921}]},"public_addr":"172.21.15.192:6825/439693921","cluster_addr":"172.21.15.192:6827/439693921","heartbeat_back_addr":"172.21.15.192:6831/439693921","heartbeat_front_addr":"172.21.15.192:6829/439693921","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:44:19.922390+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:44:36.895563+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:44:53.699019+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:45:11.167404+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:45:27.955899+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:45:44.850368+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:46:02.003588+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:46:19.019217+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:46:36.189670+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:46:53.919365+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:47:11.563053+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:47:28.822443+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.76:6801/4200406736":"2024-06-03T04:43:06.092916+0000","172.21.15.76:6800/4200406736":"2024-06-03T04:43:06.092916+0000","172.21.15.76:0/1524144593":"2024-06-03T04:43:06.092916+0000","172.21.15.76:0/3269372590":"2024-06-03T04:43:06.092916+0000","172.21.15.76:0/3570893846":"2024-06-03T04:42:44.872236+0000","172.21.15.76:0/902035790":"2024-06-03T04:43:06.092916+0000","172.21.15.76:6800/2550846765":"2024-06-03T04:42:44.872236+0000","172.21.15.76:6801/2550846765":"2024-06-03T04:42:44.872236+0000","172.21.15.76:0/2646712763":"2024-06-03T04:42:44.872236+0000","172.21.15.76:0/964578813":"2024-06-03T04:42:44.872236+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T04:48:15.768 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.766+0000 7f9b5335a700 1 -- 172.21.15.76:0/1460845273 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f9b380a1120 msgr2=0x7f9b380a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:15.768 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.766+0000 7f9b5335a700 1 --2- 172.21.15.76:0/1460845273 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f9b380a1120 0x7f9b380a35e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c005950 tx=0x7f9b3c0058e0 comp rx=0 tx=0).stop 2024-06-02T04:48:15.768 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.766+0000 7f9b5335a700 1 -- 172.21.15.76:0/1460845273 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9b4c102990 msgr2=0x7f9b4c19e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:15.768 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.766+0000 7f9b5335a700 1 --2- 172.21.15.76:0/1460845273 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9b4c102990 0x7f9b4c19e270 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f9b4400ada0 tx=0x7f9b4400c330 comp rx=0 tx=0).stop 2024-06-02T04:48:15.769 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.767+0000 7f9b5335a700 1 -- 172.21.15.76:0/1460845273 shutdown_connections 2024-06-02T04:48:15.769 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.767+0000 7f9b5335a700 1 --2- 172.21.15.76:0/1460845273 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9b4c102990 0x7f9b4c19e270 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:15.769 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.767+0000 7f9b5335a700 1 --2- 172.21.15.76:0/1460845273 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9b4c100e80 0x7f9b4c196d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:15.769 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.767+0000 7f9b5335a700 1 --2- 172.21.15.76:0/1460845273 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f9b380a1120 0x7f9b380a35e0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:15.769 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.767+0000 7f9b5335a700 1 --2- 172.21.15.76:0/1460845273 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9b4c101fd0 0x7f9b4c197290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:15.769 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.767+0000 7f9b5335a700 1 -- 172.21.15.76:0/1460845273 >> 172.21.15.76:0/1460845273 conn(0x7f9b4c0fc410 msgr2=0x7f9b4c105480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:15.769 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.767+0000 7f9b5335a700 1 -- 172.21.15.76:0/1460845273 shutdown_connections 2024-06-02T04:48:15.769 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.767+0000 7f9b5335a700 1 -- 172.21.15.76:0/1460845273 wait complete. 2024-06-02T04:48:15.780 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-06-02T04:44:56.408602+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-06-02T04:48:01.194954+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-06-02T04:48:01.828863+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '76', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-06-02T04:48:04.916565+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-06-02T04:48:15.781 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-06-02T04:48:15.907 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.905+0000 7ff113990700 1 -- 172.21.15.76:0/2395586635 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff10c101990 msgr2=0x7ff10c1082b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:15.907 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.905+0000 7ff113990700 1 --2- 172.21.15.76:0/2395586635 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff10c101990 0x7ff10c1082b0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff10400b0a0 tx=0x7ff10400b3b0 comp rx=0 tx=0).stop 2024-06-02T04:48:15.907 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.905+0000 7ff113990700 1 -- 172.21.15.76:0/2395586635 shutdown_connections 2024-06-02T04:48:15.907 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.905+0000 7ff113990700 1 --2- 172.21.15.76:0/2395586635 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff10c101990 0x7ff10c1082b0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:15.907 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.905+0000 7ff113990700 1 --2- 172.21.15.76:0/2395586635 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff10c0ffe80 0x7ff10c1002a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:15.907 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.905+0000 7ff113990700 1 --2- 172.21.15.76:0/2395586635 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff10c100fd0 0x7ff10c101450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:15.907 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.905+0000 7ff113990700 1 -- 172.21.15.76:0/2395586635 >> 172.21.15.76:0/2395586635 conn(0x7ff10c0fb3f0 msgr2=0x7ff10c0fd830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:15.907 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.905+0000 7ff113990700 1 -- 172.21.15.76:0/2395586635 shutdown_connections 2024-06-02T04:48:15.907 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.905+0000 7ff113990700 1 -- 172.21.15.76:0/2395586635 wait complete. 2024-06-02T04:48:15.907 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.906+0000 7ff113990700 1 Processor -- start 2024-06-02T04:48:15.907 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.906+0000 7ff113990700 1 -- start start 2024-06-02T04:48:15.910 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.906+0000 7ff113990700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff10c0ffe80 0x7ff10c195dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:15.910 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.906+0000 7ff113990700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff10c100fd0 0x7ff10c196300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:15.910 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.906+0000 7ff113990700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff10c101990 0x7ff10c19d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:15.910 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.906+0000 7ff113990700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff10c19d8f0 con 0x7ff10c0ffe80 2024-06-02T04:48:15.910 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.906+0000 7ff113990700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff10c19da30 con 0x7ff10c101990 2024-06-02T04:48:15.910 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.906+0000 7ff113990700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff10c19dbc0 con 0x7ff10c100fd0 2024-06-02T04:48:15.910 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.906+0000 7ff11172c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff10c0ffe80 0x7ff10c195dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:15.910 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.906+0000 7ff11172c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff10c0ffe80 0x7ff10c195dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:39140/0 (socket says 172.21.15.76:39140) 2024-06-02T04:48:15.910 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.906+0000 7ff11172c700 1 -- 172.21.15.76:0/3975444560 learned_addr learned my addr 172.21.15.76:0/3975444560 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:48:15.911 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.906+0000 7ff110f2b700 1 --2- 172.21.15.76:0/3975444560 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff10c100fd0 0x7ff10c196300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:15.911 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.906+0000 7ff111f2d700 1 --2- 172.21.15.76:0/3975444560 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff10c101990 0x7ff10c19d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:15.911 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.906+0000 7ff11172c700 1 -- 172.21.15.76:0/3975444560 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff10c100fd0 msgr2=0x7ff10c196300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:15.911 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.906+0000 7ff11172c700 1 --2- 172.21.15.76:0/3975444560 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff10c100fd0 0x7ff10c196300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:15.911 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.906+0000 7ff11172c700 1 -- 172.21.15.76:0/3975444560 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff10c101990 msgr2=0x7ff10c19d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:15.911 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.906+0000 7ff11172c700 1 --2- 172.21.15.76:0/3975444560 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff10c101990 0x7ff10c19d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:15.911 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.906+0000 7ff11172c700 1 -- 172.21.15.76:0/3975444560 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff104009d00 con 0x7ff10c0ffe80 2024-06-02T04:48:15.911 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.906+0000 7ff111f2d700 1 --2- 172.21.15.76:0/3975444560 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff10c101990 0x7ff10c19d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:48:15.911 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.906+0000 7ff11172c700 1 --2- 172.21.15.76:0/3975444560 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff10c0ffe80 0x7ff10c195dc0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc00d950 tx=0x7ff0fc00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:15.911 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.907+0000 7ff1027fc700 1 -- 172.21.15.76:0/3975444560 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0fc009940 con 0x7ff10c0ffe80 2024-06-02T04:48:15.911 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.907+0000 7ff1027fc700 1 -- 172.21.15.76:0/3975444560 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff0fc010460 con 0x7ff10c0ffe80 2024-06-02T04:48:15.911 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.907+0000 7ff1027fc700 1 -- 172.21.15.76:0/3975444560 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0fc00f620 con 0x7ff10c0ffe80 2024-06-02T04:48:15.911 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.907+0000 7ff113990700 1 -- 172.21.15.76:0/3975444560 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff10c19dea0 con 0x7ff10c0ffe80 2024-06-02T04:48:15.912 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.907+0000 7ff113990700 1 -- 172.21.15.76:0/3975444560 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff10c19e2c0 con 0x7ff10c0ffe80 2024-06-02T04:48:15.912 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.908+0000 7ff113990700 1 -- 172.21.15.76:0/3975444560 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff10c1072c0 con 0x7ff10c0ffe80 2024-06-02T04:48:15.912 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.909+0000 7ff1027fc700 1 -- 172.21.15.76:0/3975444560 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7ff0fc0105d0 con 0x7ff10c0ffe80 2024-06-02T04:48:15.912 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.909+0000 7ff1027fc700 1 --2- 172.21.15.76:0/3975444560 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7ff0f80a11a0 0x7ff0f80a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:15.913 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.909+0000 7ff110f2b700 1 --2- 172.21.15.76:0/3975444560 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7ff0f80a11a0 0x7ff0f80a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:15.913 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.909+0000 7ff1027fc700 1 -- 172.21.15.76:0/3975444560 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 8730+0+0 (secure 0 0 0) 0x7ff0fc0cc8a0 con 0x7ff10c0ffe80 2024-06-02T04:48:15.913 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.910+0000 7ff110f2b700 1 --2- 172.21.15.76:0/3975444560 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7ff0f80a11a0 0x7ff0f80a3660 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff108009c60 tx=0x7ff108009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:15.914 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:15.914+0000 7ff1027fc700 1 -- 172.21.15.76:0/3975444560 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7ff0fc095e40 con 0x7ff10c0ffe80 2024-06-02T04:48:16.111 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.110+0000 7ff113990700 1 -- 172.21.15.76:0/3975444560 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff10c02ce40 con 0x7ff10c0ffe80 2024-06-02T04:48:16.112 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.111+0000 7ff1027fc700 1 -- 172.21.15.76:0/3975444560 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v80) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff0fc0160a0 con 0x7ff10c0ffe80 2024-06-02T04:48:16.112 INFO:teuthology.orchestra.run.smithi076.stdout:pg_num: 1 2024-06-02T04:48:16.114 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.113+0000 7ff113990700 1 -- 172.21.15.76:0/3975444560 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7ff0f80a11a0 msgr2=0x7ff0f80a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:16.114 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.113+0000 7ff113990700 1 --2- 172.21.15.76:0/3975444560 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7ff0f80a11a0 0x7ff0f80a3660 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff108009c60 tx=0x7ff108009260 comp rx=0 tx=0).stop 2024-06-02T04:48:16.114 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.113+0000 7ff113990700 1 -- 172.21.15.76:0/3975444560 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff10c0ffe80 msgr2=0x7ff10c195dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:16.114 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.113+0000 7ff113990700 1 --2- 172.21.15.76:0/3975444560 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff10c0ffe80 0x7ff10c195dc0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc00d950 tx=0x7ff0fc00dc60 comp rx=0 tx=0).stop 2024-06-02T04:48:16.114 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.113+0000 7ff113990700 1 -- 172.21.15.76:0/3975444560 shutdown_connections 2024-06-02T04:48:16.114 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.113+0000 7ff113990700 1 --2- 172.21.15.76:0/3975444560 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7ff0f80a11a0 0x7ff0f80a3660 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:16.115 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.113+0000 7ff113990700 1 --2- 172.21.15.76:0/3975444560 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff10c101990 0x7ff10c19d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:16.115 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.113+0000 7ff113990700 1 --2- 172.21.15.76:0/3975444560 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff10c0ffe80 0x7ff10c195dc0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:16.115 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.113+0000 7ff113990700 1 --2- 172.21.15.76:0/3975444560 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff10c100fd0 0x7ff10c196300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:16.115 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.113+0000 7ff113990700 1 -- 172.21.15.76:0/3975444560 >> 172.21.15.76:0/3975444560 conn(0x7ff10c0fb3f0 msgr2=0x7ff10c104400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:16.115 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.113+0000 7ff113990700 1 -- 172.21.15.76:0/3975444560 shutdown_connections 2024-06-02T04:48:16.115 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.113+0000 7ff113990700 1 -- 172.21.15.76:0/3975444560 wait complete. 2024-06-02T04:48:16.126 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-06-02T04:48:16.255 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.252+0000 7f039d547700 1 -- 172.21.15.76:0/3085500141 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0398102c80 msgr2=0x7f0398109530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:16.255 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.252+0000 7f039d547700 1 --2- 172.21.15.76:0/3085500141 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0398102c80 0x7f0398109530 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f039000b0a0 tx=0x7f039000b3b0 comp rx=0 tx=0).stop 2024-06-02T04:48:16.256 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.252+0000 7f039d547700 1 -- 172.21.15.76:0/3085500141 shutdown_connections 2024-06-02T04:48:16.256 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.252+0000 7f039d547700 1 --2- 172.21.15.76:0/3085500141 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0398102c80 0x7f0398109530 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:16.256 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.252+0000 7f039d547700 1 --2- 172.21.15.76:0/3085500141 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f03980ff270 0x7f03980ff690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:16.256 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.252+0000 7f039d547700 1 --2- 172.21.15.76:0/3085500141 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f03981022e0 0x7f0398102740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:16.256 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.252+0000 7f039d547700 1 -- 172.21.15.76:0/3085500141 >> 172.21.15.76:0/3085500141 conn(0x7f03980fab80 msgr2=0x7f03980fcfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:16.256 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.252+0000 7f039d547700 1 -- 172.21.15.76:0/3085500141 shutdown_connections 2024-06-02T04:48:16.256 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.252+0000 7f039d547700 1 -- 172.21.15.76:0/3085500141 wait complete. 2024-06-02T04:48:16.256 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.253+0000 7f039d547700 1 Processor -- start 2024-06-02T04:48:16.256 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.253+0000 7f039d547700 1 -- start start 2024-06-02T04:48:16.256 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.253+0000 7f039d547700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f03980ff270 0x7f0398196ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:16.256 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.253+0000 7f039d547700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f03981022e0 0x7f0398197400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:16.256 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.253+0000 7f039d547700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0398102c80 0x7f039819e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:16.256 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.253+0000 7f039d547700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f039819e9f0 con 0x7f03981022e0 2024-06-02T04:48:16.257 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.253+0000 7f039d547700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f039819eb30 con 0x7f03980ff270 2024-06-02T04:48:16.257 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.253+0000 7f039d547700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f039819ecc0 con 0x7f0398102c80 2024-06-02T04:48:16.257 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.253+0000 7f03967fc700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f03981022e0 0x7f0398197400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:16.257 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.253+0000 7f03967fc700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f03981022e0 0x7f0398197400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:39156/0 (socket says 172.21.15.76:39156) 2024-06-02T04:48:16.257 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.253+0000 7f03967fc700 1 -- 172.21.15.76:0/1918327190 learned_addr learned my addr 172.21.15.76:0/1918327190 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:48:16.257 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.253+0000 7f0396ffd700 1 --2- 172.21.15.76:0/1918327190 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f03980ff270 0x7f0398196ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:16.257 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.253+0000 7f03977fe700 1 --2- 172.21.15.76:0/1918327190 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0398102c80 0x7f039819e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:16.257 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.253+0000 7f03967fc700 1 -- 172.21.15.76:0/1918327190 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0398102c80 msgr2=0x7f039819e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:16.257 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.253+0000 7f03967fc700 1 --2- 172.21.15.76:0/1918327190 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0398102c80 0x7f039819e420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:16.257 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.253+0000 7f03967fc700 1 -- 172.21.15.76:0/1918327190 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f03980ff270 msgr2=0x7f0398196ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:16.257 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.253+0000 7f03967fc700 1 --2- 172.21.15.76:0/1918327190 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f03980ff270 0x7f0398196ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:16.257 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.254+0000 7f03967fc700 1 -- 172.21.15.76:0/1918327190 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0390009d00 con 0x7f03981022e0 2024-06-02T04:48:16.257 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.254+0000 7f03967fc700 1 --2- 172.21.15.76:0/1918327190 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f03981022e0 0x7f0398197400 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f038c00d980 tx=0x7f038c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:16.258 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.254+0000 7f037ffff700 1 -- 172.21.15.76:0/1918327190 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f038c004220 con 0x7f03981022e0 2024-06-02T04:48:16.258 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.254+0000 7f037ffff700 1 -- 172.21.15.76:0/1918327190 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f038c007640 con 0x7f03981022e0 2024-06-02T04:48:16.258 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.254+0000 7f039d547700 1 -- 172.21.15.76:0/1918327190 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f039819efa0 con 0x7f03981022e0 2024-06-02T04:48:16.258 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.254+0000 7f037ffff700 1 -- 172.21.15.76:0/1918327190 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f038c0055e0 con 0x7f03981022e0 2024-06-02T04:48:16.258 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.254+0000 7f039d547700 1 -- 172.21.15.76:0/1918327190 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f039819f420 con 0x7f03981022e0 2024-06-02T04:48:16.259 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.255+0000 7f039d547700 1 -- 172.21.15.76:0/1918327190 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03981084a0 con 0x7f03981022e0 2024-06-02T04:48:16.259 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.256+0000 7f037ffff700 1 -- 172.21.15.76:0/1918327190 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f038c004750 con 0x7f03981022e0 2024-06-02T04:48:16.259 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.256+0000 7f037ffff700 1 --2- 172.21.15.76:0/1918327190 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f03800a1120 0x7f03800a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:16.259 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.257+0000 7f0396ffd700 1 --2- 172.21.15.76:0/1918327190 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f03800a1120 0x7f03800a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:16.259 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.257+0000 7f037ffff700 1 -- 172.21.15.76:0/1918327190 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f038c0cce00 con 0x7f03981022e0 2024-06-02T04:48:16.259 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.257+0000 7f0396ffd700 1 --2- 172.21.15.76:0/1918327190 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f03800a1120 0x7f03800a35e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0398069210 tx=0x7f038800a3b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:16.261 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.260+0000 7f037ffff700 1 -- 172.21.15.76:0/1918327190 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f038c096340 con 0x7f03981022e0 2024-06-02T04:48:16.460 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.458+0000 7f039d547700 1 -- 172.21.15.76:0/1918327190 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f039810c690 con 0x7f03981022e0 2024-06-02T04:48:16.460 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.459+0000 7f037ffff700 1 -- 172.21.15.76:0/1918327190 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v80) v1 ==== 104+0+11 (secure 0 0 0) 0x7f038c0160a0 con 0x7f03981022e0 2024-06-02T04:48:16.460 INFO:teuthology.orchestra.run.smithi076.stdout:pg_num: 32 2024-06-02T04:48:16.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.461+0000 7f039d547700 1 -- 172.21.15.76:0/1918327190 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f03800a1120 msgr2=0x7f03800a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:16.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.461+0000 7f039d547700 1 --2- 172.21.15.76:0/1918327190 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f03800a1120 0x7f03800a35e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0398069210 tx=0x7f038800a3b0 comp rx=0 tx=0).stop 2024-06-02T04:48:16.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.461+0000 7f039d547700 1 -- 172.21.15.76:0/1918327190 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f03981022e0 msgr2=0x7f0398197400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:16.463 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.461+0000 7f039d547700 1 --2- 172.21.15.76:0/1918327190 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f03981022e0 0x7f0398197400 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f038c00d980 tx=0x7f038c00dc90 comp rx=0 tx=0).stop 2024-06-02T04:48:16.463 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.461+0000 7f039d547700 1 -- 172.21.15.76:0/1918327190 shutdown_connections 2024-06-02T04:48:16.463 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.461+0000 7f039d547700 1 --2- 172.21.15.76:0/1918327190 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0398102c80 0x7f039819e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:16.463 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.461+0000 7f039d547700 1 --2- 172.21.15.76:0/1918327190 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f03800a1120 0x7f03800a35e0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:16.463 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.461+0000 7f039d547700 1 --2- 172.21.15.76:0/1918327190 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f03980ff270 0x7f0398196ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:16.463 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.461+0000 7f039d547700 1 --2- 172.21.15.76:0/1918327190 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f03981022e0 0x7f0398197400 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:16.463 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.461+0000 7f039d547700 1 -- 172.21.15.76:0/1918327190 >> 172.21.15.76:0/1918327190 conn(0x7f03980fab80 msgr2=0x7f03981055e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:16.463 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.461+0000 7f039d547700 1 -- 172.21.15.76:0/1918327190 shutdown_connections 2024-06-02T04:48:16.463 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.461+0000 7f039d547700 1 -- 172.21.15.76:0/1918327190 wait complete. 2024-06-02T04:48:16.473 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:16 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/444156103' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-06-02T04:48:16.473 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:16 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/1460845273' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:48:16.473 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:16 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/3975444560' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-02T04:48:16.474 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-06-02T04:48:16.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:16 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/444156103' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-06-02T04:48:16.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:16 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/1460845273' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:48:16.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:16 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/3975444560' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-02T04:48:16.601 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.597+0000 7f8d4d92f700 1 -- 172.21.15.76:0/800795963 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8d48101990 msgr2=0x7f8d481082b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:16.601 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.597+0000 7f8d4d92f700 1 --2- 172.21.15.76:0/800795963 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8d48101990 0x7f8d481082b0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f8d4000b0a0 tx=0x7f8d4000b3b0 comp rx=0 tx=0).stop 2024-06-02T04:48:16.601 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.597+0000 7f8d4d92f700 1 -- 172.21.15.76:0/800795963 shutdown_connections 2024-06-02T04:48:16.601 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.597+0000 7f8d4d92f700 1 --2- 172.21.15.76:0/800795963 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8d48101990 0x7f8d481082b0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:16.601 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.597+0000 7f8d4d92f700 1 --2- 172.21.15.76:0/800795963 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8d480ffe80 0x7f8d481002a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:16.601 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.597+0000 7f8d4d92f700 1 --2- 172.21.15.76:0/800795963 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d48100fd0 0x7f8d48101450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:16.601 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.598+0000 7f8d4d92f700 1 -- 172.21.15.76:0/800795963 >> 172.21.15.76:0/800795963 conn(0x7f8d480fb3f0 msgr2=0x7f8d480fd830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:16.601 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.598+0000 7f8d4d92f700 1 -- 172.21.15.76:0/800795963 shutdown_connections 2024-06-02T04:48:16.601 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.598+0000 7f8d4d92f700 1 -- 172.21.15.76:0/800795963 wait complete. 2024-06-02T04:48:16.602 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.598+0000 7f8d4d92f700 1 Processor -- start 2024-06-02T04:48:16.602 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.598+0000 7f8d4d92f700 1 -- start start 2024-06-02T04:48:16.602 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.598+0000 7f8d4d92f700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d480ffe80 0x7f8d48195dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:16.602 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.598+0000 7f8d4d92f700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8d48100fd0 0x7f8d48196300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:16.602 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.598+0000 7f8d4d92f700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8d48101990 0x7f8d4819d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:16.602 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.598+0000 7f8d4d92f700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d4819d8f0 con 0x7f8d48101990 2024-06-02T04:48:16.602 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.598+0000 7f8d4d92f700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d4819da30 con 0x7f8d48100fd0 2024-06-02T04:48:16.602 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.598+0000 7f8d4d92f700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d4819dbc0 con 0x7f8d480ffe80 2024-06-02T04:48:16.602 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.599+0000 7f8d477fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8d48101990 0x7f8d4819d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:16.602 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.599+0000 7f8d477fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8d48101990 0x7f8d4819d320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:39176/0 (socket says 172.21.15.76:39176) 2024-06-02T04:48:16.602 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.599+0000 7f8d477fe700 1 -- 172.21.15.76:0/1888693802 learned_addr learned my addr 172.21.15.76:0/1888693802 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:48:16.602 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.599+0000 7f8d467fc700 1 --2- 172.21.15.76:0/1888693802 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8d48100fd0 0x7f8d48196300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:16.602 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.599+0000 7f8d46ffd700 1 --2- 172.21.15.76:0/1888693802 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d480ffe80 0x7f8d48195dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:16.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.599+0000 7f8d477fe700 1 -- 172.21.15.76:0/1888693802 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d480ffe80 msgr2=0x7f8d48195dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:16.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.599+0000 7f8d477fe700 1 --2- 172.21.15.76:0/1888693802 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d480ffe80 0x7f8d48195dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:16.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.599+0000 7f8d477fe700 1 -- 172.21.15.76:0/1888693802 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8d48100fd0 msgr2=0x7f8d48196300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:16.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.599+0000 7f8d477fe700 1 --2- 172.21.15.76:0/1888693802 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8d48100fd0 0x7f8d48196300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:16.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.599+0000 7f8d477fe700 1 -- 172.21.15.76:0/1888693802 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d40009d00 con 0x7f8d48101990 2024-06-02T04:48:16.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.599+0000 7f8d477fe700 1 --2- 172.21.15.76:0/1888693802 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8d48101990 0x7f8d4819d320 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f8d40004ce0 tx=0x7f8d40004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:16.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.599+0000 7f8d4c92d700 1 -- 172.21.15.76:0/1888693802 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d4000e040 con 0x7f8d48101990 2024-06-02T04:48:16.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.599+0000 7f8d4c92d700 1 -- 172.21.15.76:0/1888693802 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8d4000ce60 con 0x7f8d48101990 2024-06-02T04:48:16.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.599+0000 7f8d4c92d700 1 -- 172.21.15.76:0/1888693802 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d4001bae0 con 0x7f8d48101990 2024-06-02T04:48:16.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.599+0000 7f8d4d92f700 1 -- 172.21.15.76:0/1888693802 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d4819de40 con 0x7f8d48101990 2024-06-02T04:48:16.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.599+0000 7f8d4d92f700 1 -- 172.21.15.76:0/1888693802 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d4819e260 con 0x7f8d48101990 2024-06-02T04:48:16.604 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.600+0000 7f8d4d92f700 1 -- 172.21.15.76:0/1888693802 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d481072c0 con 0x7f8d48101990 2024-06-02T04:48:16.604 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.601+0000 7f8d4c92d700 1 -- 172.21.15.76:0/1888693802 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f8d4001bc40 con 0x7f8d48101990 2024-06-02T04:48:16.604 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.602+0000 7f8d4c92d700 1 --2- 172.21.15.76:0/1888693802 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f8d300a11a0 0x7f8d300a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:16.604 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.602+0000 7f8d46ffd700 1 --2- 172.21.15.76:0/1888693802 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f8d300a11a0 0x7f8d300a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:16.604 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.602+0000 7f8d4c92d700 1 -- 172.21.15.76:0/1888693802 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f8d400ce910 con 0x7f8d48101990 2024-06-02T04:48:16.605 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.602+0000 7f8d46ffd700 1 --2- 172.21.15.76:0/1888693802 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f8d300a11a0 0x7f8d300a3660 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f8d3c005950 tx=0x7f8d3c0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:16.607 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.606+0000 7f8d4c92d700 1 -- 172.21.15.76:0/1888693802 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f8d40097ee0 con 0x7f8d48101990 2024-06-02T04:48:16.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:16 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/444156103' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-06-02T04:48:16.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:16 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/1460845273' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:48:16.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:16 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/3975444560' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-02T04:48:16.803 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.802+0000 7f8d4d92f700 1 -- 172.21.15.76:0/1888693802 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8d4802cda0 con 0x7f8d48101990 2024-06-02T04:48:16.804 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.803+0000 7f8d4c92d700 1 -- 172.21.15.76:0/1888693802 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v80) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8d4009b500 con 0x7f8d48101990 2024-06-02T04:48:16.804 INFO:teuthology.orchestra.run.smithi076.stdout:pg_num: 64 2024-06-02T04:48:16.806 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.805+0000 7f8d4d92f700 1 -- 172.21.15.76:0/1888693802 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f8d300a11a0 msgr2=0x7f8d300a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:16.807 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.805+0000 7f8d4d92f700 1 --2- 172.21.15.76:0/1888693802 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f8d300a11a0 0x7f8d300a3660 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f8d3c005950 tx=0x7f8d3c0058e0 comp rx=0 tx=0).stop 2024-06-02T04:48:16.807 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.805+0000 7f8d4d92f700 1 -- 172.21.15.76:0/1888693802 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8d48101990 msgr2=0x7f8d4819d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:16.807 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.805+0000 7f8d4d92f700 1 --2- 172.21.15.76:0/1888693802 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8d48101990 0x7f8d4819d320 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f8d40004ce0 tx=0x7f8d40004d10 comp rx=0 tx=0).stop 2024-06-02T04:48:16.807 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.805+0000 7f8d4d92f700 1 -- 172.21.15.76:0/1888693802 shutdown_connections 2024-06-02T04:48:16.807 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.805+0000 7f8d4d92f700 1 --2- 172.21.15.76:0/1888693802 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8d48101990 0x7f8d4819d320 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:16.807 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.805+0000 7f8d4d92f700 1 --2- 172.21.15.76:0/1888693802 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d480ffe80 0x7f8d48195dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:16.807 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.805+0000 7f8d4d92f700 1 --2- 172.21.15.76:0/1888693802 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f8d300a11a0 0x7f8d300a3660 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:16.807 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.805+0000 7f8d4d92f700 1 --2- 172.21.15.76:0/1888693802 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8d48100fd0 0x7f8d48196300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:16.807 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.805+0000 7f8d4d92f700 1 -- 172.21.15.76:0/1888693802 >> 172.21.15.76:0/1888693802 conn(0x7f8d480fb3f0 msgr2=0x7f8d48104400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:16.807 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.805+0000 7f8d4d92f700 1 -- 172.21.15.76:0/1888693802 shutdown_connections 2024-06-02T04:48:16.808 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.805+0000 7f8d4d92f700 1 -- 172.21.15.76:0/1888693802 wait complete. 2024-06-02T04:48:16.818 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-06-02T04:48:16.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.942+0000 7fc1212e2700 1 -- 172.21.15.76:0/549675521 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc11c100f80 msgr2=0x7fc11c1013a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:16.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.942+0000 7fc1212e2700 1 --2- 172.21.15.76:0/549675521 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc11c100f80 0x7fc11c1013a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fc1100099c0 tx=0x7fc110009cd0 comp rx=0 tx=0).stop 2024-06-02T04:48:16.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.943+0000 7fc1212e2700 1 -- 172.21.15.76:0/549675521 shutdown_connections 2024-06-02T04:48:16.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.943+0000 7fc1212e2700 1 --2- 172.21.15.76:0/549675521 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc11c102b10 0x7fc11c1093c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:16.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.943+0000 7fc1212e2700 1 --2- 172.21.15.76:0/549675521 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc11c100f80 0x7fc11c1013a0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:16.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.943+0000 7fc1212e2700 1 --2- 172.21.15.76:0/549675521 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc11c102170 0x7fc11c1025d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:16.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.943+0000 7fc1212e2700 1 -- 172.21.15.76:0/549675521 >> 172.21.15.76:0/549675521 conn(0x7fc11c0fc4f0 msgr2=0x7fc11c0fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:16.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.943+0000 7fc1212e2700 1 -- 172.21.15.76:0/549675521 shutdown_connections 2024-06-02T04:48:16.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.943+0000 7fc1212e2700 1 -- 172.21.15.76:0/549675521 wait complete. 2024-06-02T04:48:16.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.943+0000 7fc1212e2700 1 Processor -- start 2024-06-02T04:48:16.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.943+0000 7fc1212e2700 1 -- start start 2024-06-02T04:48:16.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.943+0000 7fc1212e2700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc11c100f80 0x7fc11c074d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:16.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.943+0000 7fc1212e2700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc11c102170 0x7fc11c073390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:16.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.943+0000 7fc1212e2700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc11c102b10 0x7fc11c0738d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:16.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.943+0000 7fc1212e2700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc11c074070 con 0x7fc11c100f80 2024-06-02T04:48:16.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.943+0000 7fc1212e2700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc11c0741e0 con 0x7fc11c102170 2024-06-02T04:48:16.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.943+0000 7fc1212e2700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc11c1a0ed0 con 0x7fc11c102b10 2024-06-02T04:48:16.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.944+0000 7fc11affd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc11c100f80 0x7fc11c074d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:16.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.944+0000 7fc11affd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc11c100f80 0x7fc11c074d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:39198/0 (socket says 172.21.15.76:39198) 2024-06-02T04:48:16.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.944+0000 7fc11affd700 1 -- 172.21.15.76:0/1222891532 learned_addr learned my addr 172.21.15.76:0/1222891532 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:48:16.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.944+0000 7fc11a7fc700 1 --2- 172.21.15.76:0/1222891532 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc11c102170 0x7fc11c073390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:16.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.944+0000 7fc11affd700 1 -- 172.21.15.76:0/1222891532 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc11c102b10 msgr2=0x7fc11c0738d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:16.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.944+0000 7fc11affd700 1 --2- 172.21.15.76:0/1222891532 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc11c102b10 0x7fc11c0738d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:16.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.944+0000 7fc11affd700 1 -- 172.21.15.76:0/1222891532 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc11c102170 msgr2=0x7fc11c073390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:16.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.944+0000 7fc11affd700 1 --2- 172.21.15.76:0/1222891532 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc11c102170 0x7fc11c073390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:16.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.944+0000 7fc11affd700 1 -- 172.21.15.76:0/1222891532 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1100095f0 con 0x7fc11c100f80 2024-06-02T04:48:16.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.944+0000 7fc11affd700 1 --2- 172.21.15.76:0/1222891532 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc11c100f80 0x7fc11c074d00 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fc1100098e0 tx=0x7fc110003b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:16.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.944+0000 7fc103fff700 1 -- 172.21.15.76:0/1222891532 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc11001d070 con 0x7fc11c100f80 2024-06-02T04:48:16.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.944+0000 7fc1212e2700 1 -- 172.21.15.76:0/1222891532 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc11c1a1100 con 0x7fc11c100f80 2024-06-02T04:48:16.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.944+0000 7fc103fff700 1 -- 172.21.15.76:0/1222891532 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc11000bd50 con 0x7fc11c100f80 2024-06-02T04:48:16.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.944+0000 7fc103fff700 1 -- 172.21.15.76:0/1222891532 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc110022d90 con 0x7fc11c100f80 2024-06-02T04:48:16.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.944+0000 7fc1212e2700 1 -- 172.21.15.76:0/1222891532 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc11c1a1550 con 0x7fc11c100f80 2024-06-02T04:48:16.949 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.945+0000 7fc1212e2700 1 -- 172.21.15.76:0/1222891532 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc11c108450 con 0x7fc11c100f80 2024-06-02T04:48:16.949 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.946+0000 7fc103fff700 1 -- 172.21.15.76:0/1222891532 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fc110022470 con 0x7fc11c100f80 2024-06-02T04:48:16.949 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.947+0000 7fc103fff700 1 --2- 172.21.15.76:0/1222891532 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fc1040a1120 0x7fc1040a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:16.949 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.947+0000 7fc11a7fc700 1 --2- 172.21.15.76:0/1222891532 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fc1040a1120 0x7fc1040a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:16.949 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.947+0000 7fc103fff700 1 -- 172.21.15.76:0/1222891532 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fc1100ce8c0 con 0x7fc11c100f80 2024-06-02T04:48:16.949 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.947+0000 7fc11a7fc700 1 --2- 172.21.15.76:0/1222891532 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fc1040a1120 0x7fc1040a35e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc10c006fd0 tx=0x7fc10c008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:16.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:16.951+0000 7fc103fff700 1 -- 172.21.15.76:0/1222891532 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fc110097e90 con 0x7fc11c100f80 2024-06-02T04:48:17.149 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:17.148+0000 7fc1212e2700 1 -- 172.21.15.76:0/1222891532 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fc11c10c7d0 con 0x7fc11c100f80 2024-06-02T04:48:17.150 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:17.148+0000 7fc103fff700 1 -- 172.21.15.76:0/1222891532 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v80) v1 ==== 103+0+11 (secure 0 0 0) 0x7fc1100270a0 con 0x7fc11c100f80 2024-06-02T04:48:17.150 INFO:teuthology.orchestra.run.smithi076.stdout:pg_num: 32 2024-06-02T04:48:17.152 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:17.150+0000 7fc1212e2700 1 -- 172.21.15.76:0/1222891532 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fc1040a1120 msgr2=0x7fc1040a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:17.152 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:17.150+0000 7fc1212e2700 1 --2- 172.21.15.76:0/1222891532 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fc1040a1120 0x7fc1040a35e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc10c006fd0 tx=0x7fc10c008040 comp rx=0 tx=0).stop 2024-06-02T04:48:17.152 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:17.150+0000 7fc1212e2700 1 -- 172.21.15.76:0/1222891532 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc11c100f80 msgr2=0x7fc11c074d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:17.152 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:17.150+0000 7fc1212e2700 1 --2- 172.21.15.76:0/1222891532 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc11c100f80 0x7fc11c074d00 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fc1100098e0 tx=0x7fc110003b80 comp rx=0 tx=0).stop 2024-06-02T04:48:17.152 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:17.150+0000 7fc1212e2700 1 -- 172.21.15.76:0/1222891532 shutdown_connections 2024-06-02T04:48:17.152 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:17.150+0000 7fc1212e2700 1 --2- 172.21.15.76:0/1222891532 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc11c102b10 0x7fc11c0738d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:17.152 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:17.151+0000 7fc1212e2700 1 --2- 172.21.15.76:0/1222891532 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc11c100f80 0x7fc11c074d00 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:17.152 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:17.151+0000 7fc1212e2700 1 --2- 172.21.15.76:0/1222891532 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fc1040a1120 0x7fc1040a35e0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:17.152 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:17.151+0000 7fc1212e2700 1 --2- 172.21.15.76:0/1222891532 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc11c102170 0x7fc11c073390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:17.152 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:17.151+0000 7fc1212e2700 1 -- 172.21.15.76:0/1222891532 >> 172.21.15.76:0/1222891532 conn(0x7fc11c0fc4f0 msgr2=0x7fc11c105590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:17.153 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:17.151+0000 7fc1212e2700 1 -- 172.21.15.76:0/1222891532 shutdown_connections 2024-06-02T04:48:17.153 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:17.151+0000 7fc1212e2700 1 -- 172.21.15.76:0/1222891532 wait complete. 2024-06-02T04:48:17.164 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-06-02T04:48:17.289 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:17.288+0000 7f1ddd228700 1 -- 172.21.15.76:0/429114368 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1dd8102b10 msgr2=0x7f1dd81093c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:17.290 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:17.288+0000 7f1ddd228700 1 --2- 172.21.15.76:0/429114368 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1dd8102b10 0x7f1dd81093c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f1dd000b0d0 tx=0x7f1dd000b3e0 comp rx=0 tx=0).stop 2024-06-02T04:48:17.290 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:17.288+0000 7f1ddd228700 1 -- 172.21.15.76:0/429114368 shutdown_connections 2024-06-02T04:48:17.290 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:17.288+0000 7f1ddd228700 1 --2- 172.21.15.76:0/429114368 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1dd8102b10 0x7f1dd81093c0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:17.290 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:17.288+0000 7f1ddd228700 1 --2- 172.21.15.76:0/429114368 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1dd8100f80 0x7f1dd81013a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:17.290 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:17.288+0000 7f1ddd228700 1 --2- 172.21.15.76:0/429114368 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1dd8102170 0x7f1dd81025d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:17.290 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:17.288+0000 7f1ddd228700 1 -- 172.21.15.76:0/429114368 >> 172.21.15.76:0/429114368 conn(0x7f1dd80fc4f0 msgr2=0x7f1dd80fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:17.290 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:17.288+0000 7f1ddd228700 1 -- 172.21.15.76:0/429114368 shutdown_connections 2024-06-02T04:48:17.290 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:17.288+0000 7f1ddd228700 1 -- 172.21.15.76:0/429114368 wait complete. 2024-06-02T04:48:17.293 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:17.289+0000 7f1ddd228700 1 Processor -- start 2024-06-02T04:48:17.293 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:17.289+0000 7f1ddd228700 1 -- start start 2024-06-02T04:48:17.293 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:17.289+0000 7f1ddd228700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1dd8100f80 0x7f1dd8196ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:17.293 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:17.289+0000 7f1ddd228700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1dd8102170 0x7f1dd8197420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:17.293 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:17.289+0000 7f1ddd228700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1dd8102b10 0x7f1dd819e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:17.293 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:17.289+0000 7f1ddd228700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd819ea10 con 0x7f1dd8102170 2024-06-02T04:48:17.293 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:17.289+0000 7f1ddd228700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd819eb50 con 0x7f1dd8102b10 2024-06-02T04:48:17.293 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:17.289+0000 7f1ddd228700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd819ece0 con 0x7f1dd8100f80 2024-06-02T04:48:17.293 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:17.289+0000 7f1dd659c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1dd8102170 0x7f1dd8197420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:17.293 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:17.289+0000 7f1dd659c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1dd8102170 0x7f1dd8197420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:39226/0 (socket says 172.21.15.76:39226) 2024-06-02T04:48:17.293 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:17.289+0000 7f1dd659c700 1 -- 172.21.15.76:0/1804877792 learned_addr learned my addr 172.21.15.76:0/1804877792 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:48:17.294 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:17.289+0000 7f1dd759e700 1 --2- 172.21.15.76:0/1804877792 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1dd8102b10 0x7f1dd819e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:17.294 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:17.289+0000 7f1dd6d9d700 1 --2- 172.21.15.76:0/1804877792 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1dd8100f80 0x7f1dd8196ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:17.294 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:17.289+0000 7f1dd659c700 1 -- 172.21.15.76:0/1804877792 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1dd8100f80 msgr2=0x7f1dd8196ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:17.294 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:17.289+0000 7f1dd659c700 1 --2- 172.21.15.76:0/1804877792 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1dd8100f80 0x7f1dd8196ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:17.294 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:17.289+0000 7f1dd659c700 1 -- 172.21.15.76:0/1804877792 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1dd8102b10 msgr2=0x7f1dd819e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:17.294 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:17.289+0000 7f1dd659c700 1 --2- 172.21.15.76:0/1804877792 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1dd8102b10 0x7f1dd819e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:17.294 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:17.290+0000 7f1dd659c700 1 -- 172.21.15.76:0/1804877792 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dd0009d00 con 0x7f1dd8102170 2024-06-02T04:48:17.294 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:17.290+0000 7f1dd6d9d700 1 --2- 172.21.15.76:0/1804877792 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1dd8100f80 0x7f1dd8196ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:48:17.294 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:17.290+0000 7f1dd659c700 1 --2- 172.21.15.76:0/1804877792 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1dd8102170 0x7f1dd8197420 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1dc800d980 tx=0x7f1dc800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:17.294 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:17.290+0000 7f1dbffff700 1 -- 172.21.15.76:0/1804877792 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc8004220 con 0x7f1dd8102170 2024-06-02T04:48:17.294 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:17.290+0000 7f1dbffff700 1 -- 172.21.15.76:0/1804877792 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1dc8007640 con 0x7f1dd8102170 2024-06-02T04:48:17.294 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:17.290+0000 7f1dbffff700 1 -- 172.21.15.76:0/1804877792 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc80055e0 con 0x7f1dd8102170 2024-06-02T04:48:17.294 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:17.290+0000 7f1ddd228700 1 -- 172.21.15.76:0/1804877792 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dd819efc0 con 0x7f1dd8102170 2024-06-02T04:48:17.295 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:17.290+0000 7f1ddd228700 1 -- 172.21.15.76:0/1804877792 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dd819f3f0 con 0x7f1dd8102170 2024-06-02T04:48:17.295 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:17.291+0000 7f1ddd228700 1 -- 172.21.15.76:0/1804877792 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dd81083d0 con 0x7f1dd8102170 2024-06-02T04:48:17.295 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:17.292+0000 7f1dbffff700 1 -- 172.21.15.76:0/1804877792 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f1dc8004750 con 0x7f1dd8102170 2024-06-02T04:48:17.295 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:17.292+0000 7f1dbffff700 1 --2- 172.21.15.76:0/1804877792 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f1dc00a1120 0x7f1dc00a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:17.295 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:17.292+0000 7f1dbffff700 1 -- 172.21.15.76:0/1804877792 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f1dc80ccda0 con 0x7f1dd8102170 2024-06-02T04:48:17.295 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:17.292+0000 7f1dd6d9d700 1 --2- 172.21.15.76:0/1804877792 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f1dc00a1120 0x7f1dc00a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:17.295 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:17.293+0000 7f1dd6d9d700 1 --2- 172.21.15.76:0/1804877792 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f1dc00a1120 0x7f1dc00a35e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc005fd0 tx=0x7f1dcc005dc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:17.297 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:17.297+0000 7f1dbffff700 1 -- 172.21.15.76:0/1804877792 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f1dc8096340 con 0x7f1dd8102170 2024-06-02T04:48:17.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:17 smithi076 ceph-mon[42935]: pgmap v225: 129 pgs: 129 active+clean; 581 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 649 B/s wr, 2 op/s 2024-06-02T04:48:17.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:17 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/1918327190' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-06-02T04:48:17.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:17 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/1888693802' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-06-02T04:48:17.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:17 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/1222891532' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-06-02T04:48:17.510 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:17.509+0000 7f1ddd228700 1 -- 172.21.15.76:0/1804877792 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f1dd8067cf0 con 0x7f1dd8102170 2024-06-02T04:48:17.510 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:17.509+0000 7f1dbffff700 1 -- 172.21.15.76:0/1804877792 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v80) v1 ==== 81+0+590 (secure 0 0 0) 0x7f1dc8016020 con 0x7f1dd8102170 2024-06-02T04:48:17.511 INFO:teuthology.orchestra.run.smithi076.stdout:172.21.15.76:6801/4200406736 2024-06-03T04:43:06.092916+0000 2024-06-02T04:48:17.511 INFO:teuthology.orchestra.run.smithi076.stdout:172.21.15.76:6800/4200406736 2024-06-03T04:43:06.092916+0000 2024-06-02T04:48:17.511 INFO:teuthology.orchestra.run.smithi076.stdout:172.21.15.76:0/1524144593 2024-06-03T04:43:06.092916+0000 2024-06-02T04:48:17.511 INFO:teuthology.orchestra.run.smithi076.stdout:172.21.15.76:0/3269372590 2024-06-03T04:43:06.092916+0000 2024-06-02T04:48:17.511 INFO:teuthology.orchestra.run.smithi076.stdout:172.21.15.76:0/3570893846 2024-06-03T04:42:44.872236+0000 2024-06-02T04:48:17.511 INFO:teuthology.orchestra.run.smithi076.stdout:172.21.15.76:0/902035790 2024-06-03T04:43:06.092916+0000 2024-06-02T04:48:17.511 INFO:teuthology.orchestra.run.smithi076.stdout:172.21.15.76:6800/2550846765 2024-06-03T04:42:44.872236+0000 2024-06-02T04:48:17.511 INFO:teuthology.orchestra.run.smithi076.stdout:172.21.15.76:6801/2550846765 2024-06-03T04:42:44.872236+0000 2024-06-02T04:48:17.511 INFO:teuthology.orchestra.run.smithi076.stdout:172.21.15.76:0/2646712763 2024-06-03T04:42:44.872236+0000 2024-06-02T04:48:17.511 INFO:teuthology.orchestra.run.smithi076.stdout:172.21.15.76:0/964578813 2024-06-03T04:42:44.872236+0000 2024-06-02T04:48:17.513 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:17.511+0000 7f1ddd228700 1 -- 172.21.15.76:0/1804877792 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f1dc00a1120 msgr2=0x7f1dc00a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:17.513 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:17.511+0000 7f1ddd228700 1 --2- 172.21.15.76:0/1804877792 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f1dc00a1120 0x7f1dc00a35e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc005fd0 tx=0x7f1dcc005dc0 comp rx=0 tx=0).stop 2024-06-02T04:48:17.513 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:17.511+0000 7f1ddd228700 1 -- 172.21.15.76:0/1804877792 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1dd8102170 msgr2=0x7f1dd8197420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:17.513 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:17.511+0000 7f1ddd228700 1 --2- 172.21.15.76:0/1804877792 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1dd8102170 0x7f1dd8197420 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1dc800d980 tx=0x7f1dc800dc90 comp rx=0 tx=0).stop 2024-06-02T04:48:17.513 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:17.511+0000 7f1ddd228700 1 -- 172.21.15.76:0/1804877792 shutdown_connections 2024-06-02T04:48:17.513 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:17.511+0000 7f1ddd228700 1 --2- 172.21.15.76:0/1804877792 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f1dc00a1120 0x7f1dc00a35e0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:17.513 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:17.511+0000 7f1ddd228700 1 --2- 172.21.15.76:0/1804877792 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1dd8102b10 0x7f1dd819e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:17.513 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:17.511+0000 7f1ddd228700 1 --2- 172.21.15.76:0/1804877792 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1dd8100f80 0x7f1dd8196ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:17.513 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:17.511+0000 7f1ddd228700 1 --2- 172.21.15.76:0/1804877792 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1dd8102170 0x7f1dd8197420 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:17.513 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:17.511+0000 7f1ddd228700 1 -- 172.21.15.76:0/1804877792 >> 172.21.15.76:0/1804877792 conn(0x7f1dd80fc4f0 msgr2=0x7f1dd8105510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:17.514 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:17.511+0000 7f1ddd228700 1 -- 172.21.15.76:0/1804877792 shutdown_connections 2024-06-02T04:48:17.514 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:17.512+0000 7f1ddd228700 1 -- 172.21.15.76:0/1804877792 wait complete. 2024-06-02T04:48:17.514 INFO:teuthology.orchestra.run.smithi076.stderr:listed 10 entries 2024-06-02T04:48:17.524 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi076.front.sepia.ceph.com... 2024-06-02T04:48:17.525 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T04:48:17.525 DEBUG:teuthology.orchestra.run.smithi076:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-06-02T04:48:17.564 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi076.stderr:ceph-fuse[97746]: fuse finished with error 0 and tester_r 0 2024-06-02T04:48:17.565 INFO:teuthology.orchestra.run:waiting for 300 2024-06-02T04:48:17.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:17 smithi119 ceph-mon[46633]: pgmap v225: 129 pgs: 129 active+clean; 581 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 649 B/s wr, 2 op/s 2024-06-02T04:48:17.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:17 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/1918327190' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-06-02T04:48:17.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:17 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/1888693802' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-06-02T04:48:17.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:17 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/1222891532' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-06-02T04:48:17.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:17 smithi192 ceph-mon[47933]: pgmap v225: 129 pgs: 129 active+clean; 581 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 649 B/s wr, 2 op/s 2024-06-02T04:48:17.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:17 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/1918327190' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-06-02T04:48:17.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:17 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/1888693802' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-06-02T04:48:17.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:17 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/1222891532' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-06-02T04:48:18.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:18 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/1804877792' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-06-02T04:48:18.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:18 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/1804877792' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-06-02T04:48:18.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:18 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/1804877792' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-06-02T04:48:19.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:19 smithi076 ceph-mon[42935]: pgmap v226: 129 pgs: 129 active+clean; 581 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 370 B/s wr, 2 op/s 2024-06-02T04:48:19.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:19 smithi119 ceph-mon[46633]: pgmap v226: 129 pgs: 129 active+clean; 581 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 370 B/s wr, 2 op/s 2024-06-02T04:48:19.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:19 smithi192 ceph-mon[47933]: pgmap v226: 129 pgs: 129 active+clean; 581 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 370 B/s wr, 2 op/s 2024-06-02T04:48:21.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:21 smithi076 ceph-mon[42935]: pgmap v227: 129 pgs: 129 active+clean; 581 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-06-02T04:48:21.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:21 smithi119 ceph-mon[46633]: pgmap v227: 129 pgs: 129 active+clean; 581 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-06-02T04:48:21.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:21 smithi192 ceph-mon[47933]: pgmap v227: 129 pgs: 129 active+clean; 581 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-06-02T04:48:23.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:23 smithi119 ceph-mon[46633]: pgmap v228: 129 pgs: 129 active+clean; 581 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-06-02T04:48:23.667 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi076.front.sepia.ceph.com 2024-06-02T04:48:23.667 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T04:48:23.667 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-06-02T04:48:23.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:23 smithi192 ceph-mon[47933]: pgmap v228: 129 pgs: 129 active+clean; 581 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-06-02T04:48:23.705 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-02T04:48:23.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:23 smithi076 ceph-mon[42935]: pgmap v228: 129 pgs: 129 active+clean; 581 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-06-02T04:48:23.876 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:23.873+0000 7fe0a8438700 1 -- 172.21.15.76:0/3565939957 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe0a0100e90 msgr2=0x7fe0a01012b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:23.876 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:23.873+0000 7fe0a8438700 1 --2- 172.21.15.76:0/3565939957 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe0a0100e90 0x7fe0a01012b0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fe094009990 tx=0x7fe094009ca0 comp rx=0 tx=0).stop 2024-06-02T04:48:23.876 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:23.873+0000 7fe0a8438700 1 -- 172.21.15.76:0/3565939957 shutdown_connections 2024-06-02T04:48:23.876 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:23.873+0000 7fe0a8438700 1 --2- 172.21.15.76:0/3565939957 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe0a01029a0 0x7fe0a01092c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:23.876 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:23.873+0000 7fe0a8438700 1 --2- 172.21.15.76:0/3565939957 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe0a0100e90 0x7fe0a01012b0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:23.876 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:23.873+0000 7fe0a8438700 1 --2- 172.21.15.76:0/3565939957 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe0a0101fe0 0x7fe0a0102460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:23.876 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:23.873+0000 7fe0a8438700 1 -- 172.21.15.76:0/3565939957 >> 172.21.15.76:0/3565939957 conn(0x7fe0a00fc400 msgr2=0x7fe0a00fe840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:23.876 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:23.873+0000 7fe0a8438700 1 -- 172.21.15.76:0/3565939957 shutdown_connections 2024-06-02T04:48:23.876 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:23.873+0000 7fe0a8438700 1 -- 172.21.15.76:0/3565939957 wait complete. 2024-06-02T04:48:23.877 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:23.874+0000 7fe0a8438700 1 Processor -- start 2024-06-02T04:48:23.877 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:23.874+0000 7fe0a8438700 1 -- start start 2024-06-02T04:48:23.877 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:23.874+0000 7fe0a8438700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe0a0100e90 0x7fe0a0074d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:23.877 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:23.874+0000 7fe0a8438700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe0a0101fe0 0x7fe0a0073390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:23.877 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:23.874+0000 7fe0a8438700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe0a01029a0 0x7fe0a00738d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:23.877 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:23.874+0000 7fe0a8438700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a0074070 con 0x7fe0a0100e90 2024-06-02T04:48:23.877 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:23.874+0000 7fe0a8438700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a00741e0 con 0x7fe0a0101fe0 2024-06-02T04:48:23.877 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:23.874+0000 7fe0a8438700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a01a0cf0 con 0x7fe0a01029a0 2024-06-02T04:48:23.877 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:23.874+0000 7fe0a61d4700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe0a0100e90 0x7fe0a0074d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:23.877 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:23.874+0000 7fe0a61d4700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe0a0100e90 0x7fe0a0074d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:40674/0 (socket says 172.21.15.76:40674) 2024-06-02T04:48:23.877 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:23.874+0000 7fe0a61d4700 1 -- 172.21.15.76:0/3920165661 learned_addr learned my addr 172.21.15.76:0/3920165661 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:48:23.877 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:23.874+0000 7fe0a69d5700 1 --2- 172.21.15.76:0/3920165661 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe0a01029a0 0x7fe0a00738d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:23.878 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:23.874+0000 7fe0a59d3700 1 --2- 172.21.15.76:0/3920165661 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe0a0101fe0 0x7fe0a0073390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:23.878 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:23.875+0000 7fe0a61d4700 1 -- 172.21.15.76:0/3920165661 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe0a01029a0 msgr2=0x7fe0a00738d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:23.878 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:23.875+0000 7fe0a61d4700 1 --2- 172.21.15.76:0/3920165661 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe0a01029a0 0x7fe0a00738d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:23.878 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:23.875+0000 7fe0a61d4700 1 -- 172.21.15.76:0/3920165661 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe0a0101fe0 msgr2=0x7fe0a0073390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:23.878 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:23.875+0000 7fe0a61d4700 1 --2- 172.21.15.76:0/3920165661 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe0a0101fe0 0x7fe0a0073390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:23.878 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:23.875+0000 7fe0a61d4700 1 -- 172.21.15.76:0/3920165661 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0940095f0 con 0x7fe0a0100e90 2024-06-02T04:48:23.878 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:23.875+0000 7fe0a59d3700 1 --2- 172.21.15.76:0/3920165661 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe0a0101fe0 0x7fe0a0073390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:48:23.878 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:23.875+0000 7fe0a61d4700 1 --2- 172.21.15.76:0/3920165661 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe0a0100e90 0x7fe0a0074d00 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fe0940092e0 tx=0x7fe0940057a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:23.878 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:23.875+0000 7fe0937fe700 1 -- 172.21.15.76:0/3920165661 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe09401d070 con 0x7fe0a0100e90 2024-06-02T04:48:23.878 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:23.875+0000 7fe0937fe700 1 -- 172.21.15.76:0/3920165661 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe09400f460 con 0x7fe0a0100e90 2024-06-02T04:48:23.878 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:23.875+0000 7fe0a8438700 1 -- 172.21.15.76:0/3920165661 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0a01a0f20 con 0x7fe0a0100e90 2024-06-02T04:48:23.878 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:23.875+0000 7fe0937fe700 1 -- 172.21.15.76:0/3920165661 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe094021670 con 0x7fe0a0100e90 2024-06-02T04:48:23.879 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:23.875+0000 7fe0a8438700 1 -- 172.21.15.76:0/3920165661 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0a01a1290 con 0x7fe0a0100e90 2024-06-02T04:48:23.880 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:23.876+0000 7fe0a8438700 1 -- 172.21.15.76:0/3920165661 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0a0108300 con 0x7fe0a0100e90 2024-06-02T04:48:23.880 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:23.877+0000 7fe0937fe700 1 -- 172.21.15.76:0/3920165661 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fe09400f5d0 con 0x7fe0a0100e90 2024-06-02T04:48:23.880 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:23.878+0000 7fe0937fe700 1 --2- 172.21.15.76:0/3920165661 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fe08c0a1120 0x7fe08c0a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:23.880 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:23.878+0000 7fe0937fe700 1 -- 172.21.15.76:0/3920165661 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fe0940ce1e0 con 0x7fe0a0100e90 2024-06-02T04:48:23.880 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:23.878+0000 7fe0a59d3700 1 --2- 172.21.15.76:0/3920165661 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fe08c0a1120 0x7fe08c0a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:23.880 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:23.878+0000 7fe0a59d3700 1 --2- 172.21.15.76:0/3920165661 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fe08c0a1120 0x7fe08c0a35e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fe09c005fd0 tx=0x7fe09c005e30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:23.881 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:23.881+0000 7fe0937fe700 1 -- 172.21.15.76:0/3920165661 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fe0940978b0 con 0x7fe0a0100e90 2024-06-02T04:48:24.084 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:24.084+0000 7fe0a8438700 1 -- 172.21.15.76:0/3920165661 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe0a010c540 con 0x7fe0a0100e90 2024-06-02T04:48:24.085 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:24.085+0000 7fe0937fe700 1 -- 172.21.15.76:0/3920165661 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+23984 (secure 0 0 0) 0x7fe09409aed0 con 0x7fe0a0100e90 2024-06-02T04:48:24.086 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:48:24.086 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":80,"fsid":"60ab6d30-209a-11ef-bc9b-c7b262605968","created":"2024-06-02T04:42:21.007333+0000","modified":"2024-06-02T04:48:07.101373+0000","last_up_change":"2024-06-02T04:47:29.822242+0000","last_in_change":"2024-06-02T04:47:14.253449+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T04:44:56.408602+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-02T04:48:01.194954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-02T04:48:01.828863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-02T04:48:04.916565+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"33a51ba2-be5c-41d0-b5d1-8d6039f2ca4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6802","nonce":2869602045},{"type":"v1","addr":"172.21.15.76:6803","nonce":2869602045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6804","nonce":2869602045},{"type":"v1","addr":"172.21.15.76:6805","nonce":2869602045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6808","nonce":2869602045},{"type":"v1","addr":"172.21.15.76:6809","nonce":2869602045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6806","nonce":2869602045},{"type":"v1","addr":"172.21.15.76:6807","nonce":2869602045}]},"public_addr":"172.21.15.76:6803/2869602045","cluster_addr":"172.21.15.76:6805/2869602045","heartbeat_back_addr":"172.21.15.76:6809/2869602045","heartbeat_front_addr":"172.21.15.76:6807/2869602045","state":["exists","up"]},{"osd":1,"uuid":"ace46e13-3bb7-4103-973a-6860554df8b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":2353738098},{"type":"v1","addr":"172.21.15.119:6801","nonce":2353738098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":2353738098},{"type":"v1","addr":"172.21.15.119:6803","nonce":2353738098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":2353738098},{"type":"v1","addr":"172.21.15.119:6807","nonce":2353738098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":2353738098},{"type":"v1","addr":"172.21.15.119:6805","nonce":2353738098}]},"public_addr":"172.21.15.119:6801/2353738098","cluster_addr":"172.21.15.119:6803/2353738098","heartbeat_back_addr":"172.21.15.119:6807/2353738098","heartbeat_front_addr":"172.21.15.119:6805/2353738098","state":["exists","up"]},{"osd":2,"uuid":"4addc09e-77a9-428a-bcc4-38194f486cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":3206918546},{"type":"v1","addr":"172.21.15.192:6801","nonce":3206918546}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":3206918546},{"type":"v1","addr":"172.21.15.192:6803","nonce":3206918546}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":3206918546},{"type":"v1","addr":"172.21.15.192:6807","nonce":3206918546}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":3206918546},{"type":"v1","addr":"172.21.15.192:6805","nonce":3206918546}]},"public_addr":"172.21.15.192:6801/3206918546","cluster_addr":"172.21.15.192:6803/3206918546","heartbeat_back_addr":"172.21.15.192:6807/3206918546","heartbeat_front_addr":"172.21.15.192:6805/3206918546","state":["exists","up"]},{"osd":3,"uuid":"dc525518-82c6-49ed-8ca8-e3bd5bfc18d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6810","nonce":3747864233},{"type":"v1","addr":"172.21.15.76:6811","nonce":3747864233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6812","nonce":3747864233},{"type":"v1","addr":"172.21.15.76:6813","nonce":3747864233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6816","nonce":3747864233},{"type":"v1","addr":"172.21.15.76:6817","nonce":3747864233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6814","nonce":3747864233},{"type":"v1","addr":"172.21.15.76:6815","nonce":3747864233}]},"public_addr":"172.21.15.76:6811/3747864233","cluster_addr":"172.21.15.76:6813/3747864233","heartbeat_back_addr":"172.21.15.76:6817/3747864233","heartbeat_front_addr":"172.21.15.76:6815/3747864233","state":["exists","up"]},{"osd":4,"uuid":"eef293d0-cb87-47b3-9751-c6437a1cf079","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":2571629047},{"type":"v1","addr":"172.21.15.119:6809","nonce":2571629047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":2571629047},{"type":"v1","addr":"172.21.15.119:6811","nonce":2571629047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":2571629047},{"type":"v1","addr":"172.21.15.119:6815","nonce":2571629047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":2571629047},{"type":"v1","addr":"172.21.15.119:6813","nonce":2571629047}]},"public_addr":"172.21.15.119:6809/2571629047","cluster_addr":"172.21.15.119:6811/2571629047","heartbeat_back_addr":"172.21.15.119:6815/2571629047","heartbeat_front_addr":"172.21.15.119:6813/2571629047","state":["exists","up"]},{"osd":5,"uuid":"60eb8c6e-766c-49d0-9997-44f85776b3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3285065416},{"type":"v1","addr":"172.21.15.192:6809","nonce":3285065416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":3285065416},{"type":"v1","addr":"172.21.15.192:6811","nonce":3285065416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3285065416},{"type":"v1","addr":"172.21.15.192:6815","nonce":3285065416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":3285065416},{"type":"v1","addr":"172.21.15.192:6813","nonce":3285065416}]},"public_addr":"172.21.15.192:6809/3285065416","cluster_addr":"172.21.15.192:6811/3285065416","heartbeat_back_addr":"172.21.15.192:6815/3285065416","heartbeat_front_addr":"172.21.15.192:6813/3285065416","state":["exists","up"]},{"osd":6,"uuid":"e6dc8b9d-dd06-4870-a506-def8201b7e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6818","nonce":2951381580},{"type":"v1","addr":"172.21.15.76:6819","nonce":2951381580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6820","nonce":2951381580},{"type":"v1","addr":"172.21.15.76:6821","nonce":2951381580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6824","nonce":2951381580},{"type":"v1","addr":"172.21.15.76:6825","nonce":2951381580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6822","nonce":2951381580},{"type":"v1","addr":"172.21.15.76:6823","nonce":2951381580}]},"public_addr":"172.21.15.76:6819/2951381580","cluster_addr":"172.21.15.76:6821/2951381580","heartbeat_back_addr":"172.21.15.76:6825/2951381580","heartbeat_front_addr":"172.21.15.76:6823/2951381580","state":["exists","up"]},{"osd":7,"uuid":"2f5dccb3-39a1-4f25-8715-fa264d59db97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1802558756},{"type":"v1","addr":"172.21.15.119:6817","nonce":1802558756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1802558756},{"type":"v1","addr":"172.21.15.119:6819","nonce":1802558756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1802558756},{"type":"v1","addr":"172.21.15.119:6823","nonce":1802558756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1802558756},{"type":"v1","addr":"172.21.15.119:6821","nonce":1802558756}]},"public_addr":"172.21.15.119:6817/1802558756","cluster_addr":"172.21.15.119:6819/1802558756","heartbeat_back_addr":"172.21.15.119:6823/1802558756","heartbeat_front_addr":"172.21.15.119:6821/1802558756","state":["exists","up"]},{"osd":8,"uuid":"39b6ccd0-16e7-4cd5-87e0-d827e9172984","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":1214972276},{"type":"v1","addr":"172.21.15.192:6817","nonce":1214972276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":1214972276},{"type":"v1","addr":"172.21.15.192:6819","nonce":1214972276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":1214972276},{"type":"v1","addr":"172.21.15.192:6823","nonce":1214972276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":1214972276},{"type":"v1","addr":"172.21.15.192:6821","nonce":1214972276}]},"public_addr":"172.21.15.192:6817/1214972276","cluster_addr":"172.21.15.192:6819/1214972276","heartbeat_back_addr":"172.21.15.192:6823/1214972276","heartbeat_front_addr":"172.21.15.192:6821/1214972276","state":["exists","up"]},{"osd":9,"uuid":"851b2155-07bd-45de-bfe0-53021fda733f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6826","nonce":3095501821},{"type":"v1","addr":"172.21.15.76:6827","nonce":3095501821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6828","nonce":3095501821},{"type":"v1","addr":"172.21.15.76:6829","nonce":3095501821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":3095501821},{"type":"v1","addr":"172.21.15.76:6833","nonce":3095501821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6830","nonce":3095501821},{"type":"v1","addr":"172.21.15.76:6831","nonce":3095501821}]},"public_addr":"172.21.15.76:6827/3095501821","cluster_addr":"172.21.15.76:6829/3095501821","heartbeat_back_addr":"172.21.15.76:6833/3095501821","heartbeat_front_addr":"172.21.15.76:6831/3095501821","state":["exists","up"]},{"osd":10,"uuid":"e4b18e7e-bddf-4dd4-84f6-7902ea327cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":4082130894},{"type":"v1","addr":"172.21.15.119:6825","nonce":4082130894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":4082130894},{"type":"v1","addr":"172.21.15.119:6827","nonce":4082130894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":4082130894},{"type":"v1","addr":"172.21.15.119:6831","nonce":4082130894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":4082130894},{"type":"v1","addr":"172.21.15.119:6829","nonce":4082130894}]},"public_addr":"172.21.15.119:6825/4082130894","cluster_addr":"172.21.15.119:6827/4082130894","heartbeat_back_addr":"172.21.15.119:6831/4082130894","heartbeat_front_addr":"172.21.15.119:6829/4082130894","state":["exists","up"]},{"osd":11,"uuid":"54567e18-920c-4ae9-9557-0efba5a1a820","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":439693921},{"type":"v1","addr":"172.21.15.192:6825","nonce":439693921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":439693921},{"type":"v1","addr":"172.21.15.192:6827","nonce":439693921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":439693921},{"type":"v1","addr":"172.21.15.192:6831","nonce":439693921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":439693921},{"type":"v1","addr":"172.21.15.192:6829","nonce":439693921}]},"public_addr":"172.21.15.192:6825/439693921","cluster_addr":"172.21.15.192:6827/439693921","heartbeat_back_addr":"172.21.15.192:6831/439693921","heartbeat_front_addr":"172.21.15.192:6829/439693921","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:44:19.922390+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:44:36.895563+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:44:53.699019+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:45:11.167404+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:45:27.955899+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:45:44.850368+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:46:02.003588+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:46:19.019217+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:46:36.189670+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:46:53.919365+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:47:11.563053+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:47:28.822443+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.76:6801/4200406736":"2024-06-03T04:43:06.092916+0000","172.21.15.76:6800/4200406736":"2024-06-03T04:43:06.092916+0000","172.21.15.76:0/1524144593":"2024-06-03T04:43:06.092916+0000","172.21.15.76:0/3269372590":"2024-06-03T04:43:06.092916+0000","172.21.15.76:0/3570893846":"2024-06-03T04:42:44.872236+0000","172.21.15.76:0/902035790":"2024-06-03T04:43:06.092916+0000","172.21.15.76:6800/2550846765":"2024-06-03T04:42:44.872236+0000","172.21.15.76:6801/2550846765":"2024-06-03T04:42:44.872236+0000","172.21.15.76:0/2646712763":"2024-06-03T04:42:44.872236+0000","172.21.15.76:0/964578813":"2024-06-03T04:42:44.872236+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T04:48:24.087 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:24.087+0000 7fe0a8438700 1 -- 172.21.15.76:0/3920165661 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fe08c0a1120 msgr2=0x7fe08c0a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:24.088 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:24.087+0000 7fe0a8438700 1 --2- 172.21.15.76:0/3920165661 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fe08c0a1120 0x7fe08c0a35e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fe09c005fd0 tx=0x7fe09c005e30 comp rx=0 tx=0).stop 2024-06-02T04:48:24.088 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:24.087+0000 7fe0a8438700 1 -- 172.21.15.76:0/3920165661 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe0a0100e90 msgr2=0x7fe0a0074d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:24.088 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:24.087+0000 7fe0a8438700 1 --2- 172.21.15.76:0/3920165661 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe0a0100e90 0x7fe0a0074d00 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fe0940092e0 tx=0x7fe0940057a0 comp rx=0 tx=0).stop 2024-06-02T04:48:24.088 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:24.087+0000 7fe0a8438700 1 -- 172.21.15.76:0/3920165661 shutdown_connections 2024-06-02T04:48:24.088 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:24.087+0000 7fe0a8438700 1 --2- 172.21.15.76:0/3920165661 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe0a01029a0 0x7fe0a00738d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:24.088 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:24.087+0000 7fe0a8438700 1 --2- 172.21.15.76:0/3920165661 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe0a0100e90 0x7fe0a0074d00 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:24.088 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:24.087+0000 7fe0a8438700 1 --2- 172.21.15.76:0/3920165661 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fe08c0a1120 0x7fe08c0a35e0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:24.088 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:24.087+0000 7fe0a8438700 1 --2- 172.21.15.76:0/3920165661 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe0a0101fe0 0x7fe0a0073390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:24.088 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:24.087+0000 7fe0a8438700 1 -- 172.21.15.76:0/3920165661 >> 172.21.15.76:0/3920165661 conn(0x7fe0a00fc400 msgr2=0x7fe0a0105440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:24.088 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:24.087+0000 7fe0a8438700 1 -- 172.21.15.76:0/3920165661 shutdown_connections 2024-06-02T04:48:24.088 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:24.087+0000 7fe0a8438700 1 -- 172.21.15.76:0/3920165661 wait complete. 2024-06-02T04:48:24.100 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-02T04:48:24.225 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:24.223+0000 7f6e18771700 1 -- 172.21.15.76:0/2573368178 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6e100fffa0 msgr2=0x7f6e10100420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:24.226 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:24.223+0000 7f6e18771700 1 --2- 172.21.15.76:0/2573368178 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6e100fffa0 0x7f6e10100420 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c009990 tx=0x7f6e0c009ca0 comp rx=0 tx=0).stop 2024-06-02T04:48:24.226 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:24.223+0000 7f6e18771700 1 -- 172.21.15.76:0/2573368178 shutdown_connections 2024-06-02T04:48:24.226 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:24.223+0000 7f6e18771700 1 --2- 172.21.15.76:0/2573368178 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6e10100960 0x7f6e10108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:24.226 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:24.223+0000 7f6e18771700 1 --2- 172.21.15.76:0/2573368178 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6e101013e0 0x7f6e10101800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:24.226 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:24.223+0000 7f6e18771700 1 --2- 172.21.15.76:0/2573368178 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6e100fffa0 0x7f6e10100420 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:24.226 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:24.223+0000 7f6e18771700 1 -- 172.21.15.76:0/2573368178 >> 172.21.15.76:0/2573368178 conn(0x7f6e100faa70 msgr2=0x7f6e100fce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:24.226 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:24.223+0000 7f6e18771700 1 -- 172.21.15.76:0/2573368178 shutdown_connections 2024-06-02T04:48:24.226 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:24.223+0000 7f6e18771700 1 -- 172.21.15.76:0/2573368178 wait complete. 2024-06-02T04:48:24.226 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:24.224+0000 7f6e18771700 1 Processor -- start 2024-06-02T04:48:24.226 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:24.224+0000 7f6e18771700 1 -- start start 2024-06-02T04:48:24.227 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:24.224+0000 7f6e18771700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6e100fffa0 0x7f6e10196c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:24.227 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:24.224+0000 7f6e18771700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6e10100960 0x7f6e101971d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:24.227 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:24.224+0000 7f6e18771700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6e101013e0 0x7f6e1019e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:24.227 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:24.224+0000 7f6e18771700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e1019e780 con 0x7f6e101013e0 2024-06-02T04:48:24.227 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:24.224+0000 7f6e18771700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e1019e8f0 con 0x7f6e100fffa0 2024-06-02T04:48:24.227 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:24.224+0000 7f6e18771700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e1019eab0 con 0x7f6e10100960 2024-06-02T04:48:24.227 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:24.224+0000 7f6e16d0e700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6e101013e0 0x7f6e1019e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:24.227 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:24.224+0000 7f6e16d0e700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6e101013e0 0x7f6e1019e1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:40696/0 (socket says 172.21.15.76:40696) 2024-06-02T04:48:24.227 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:24.224+0000 7f6e16d0e700 1 -- 172.21.15.76:0/943058070 learned_addr learned my addr 172.21.15.76:0/943058070 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:48:24.228 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:24.224+0000 7f6e15d0c700 1 --2- 172.21.15.76:0/943058070 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6e10100960 0x7f6e101971d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:24.228 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:24.225+0000 7f6e1650d700 1 --2- 172.21.15.76:0/943058070 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6e100fffa0 0x7f6e10196c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:24.228 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:24.225+0000 7f6e16d0e700 1 -- 172.21.15.76:0/943058070 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6e10100960 msgr2=0x7f6e101971d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:24.228 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:24.225+0000 7f6e16d0e700 1 --2- 172.21.15.76:0/943058070 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6e10100960 0x7f6e101971d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:24.228 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:24.225+0000 7f6e16d0e700 1 -- 172.21.15.76:0/943058070 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6e100fffa0 msgr2=0x7f6e10196c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:24.228 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:24.225+0000 7f6e16d0e700 1 --2- 172.21.15.76:0/943058070 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6e100fffa0 0x7f6e10196c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:24.228 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:24.225+0000 7f6e16d0e700 1 -- 172.21.15.76:0/943058070 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e0c0095f0 con 0x7f6e101013e0 2024-06-02T04:48:24.228 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:24.225+0000 7f6e1650d700 1 --2- 172.21.15.76:0/943058070 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6e100fffa0 0x7f6e10196c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:48:24.228 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:24.225+0000 7f6e16d0e700 1 --2- 172.21.15.76:0/943058070 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6e101013e0 0x7f6e1019e1b0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f6e0800ada0 tx=0x7f6e0800c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:24.228 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:24.225+0000 7f6e077fe700 1 -- 172.21.15.76:0/943058070 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e0800f070 con 0x7f6e101013e0 2024-06-02T04:48:24.228 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:24.225+0000 7f6e077fe700 1 -- 172.21.15.76:0/943058070 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6e08007b30 con 0x7f6e101013e0 2024-06-02T04:48:24.229 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:24.225+0000 7f6e18771700 1 -- 172.21.15.76:0/943058070 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e1019ed90 con 0x7f6e101013e0 2024-06-02T04:48:24.229 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:24.225+0000 7f6e077fe700 1 -- 172.21.15.76:0/943058070 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e080053e0 con 0x7f6e101013e0 2024-06-02T04:48:24.229 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:24.225+0000 7f6e18771700 1 -- 172.21.15.76:0/943058070 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e1019f1e0 con 0x7f6e101013e0 2024-06-02T04:48:24.230 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:24.226+0000 7f6e18771700 1 -- 172.21.15.76:0/943058070 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e10067380 con 0x7f6e101013e0 2024-06-02T04:48:24.230 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:24.227+0000 7f6e077fe700 1 -- 172.21.15.76:0/943058070 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f6e0800c980 con 0x7f6e101013e0 2024-06-02T04:48:24.230 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:24.228+0000 7f6e077fe700 1 --2- 172.21.15.76:0/943058070 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f6dfc0a11a0 0x7f6dfc0a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:24.230 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:24.228+0000 7f6e1650d700 1 --2- 172.21.15.76:0/943058070 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f6dfc0a11a0 0x7f6dfc0a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:24.230 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:24.228+0000 7f6e077fe700 1 -- 172.21.15.76:0/943058070 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f6e080cc1b0 con 0x7f6e101013e0 2024-06-02T04:48:24.230 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:24.228+0000 7f6e1650d700 1 --2- 172.21.15.76:0/943058070 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f6dfc0a11a0 0x7f6dfc0a3660 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6e00005fd0 tx=0x7f6e00005e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:24.232 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:24.232+0000 7f6e077fe700 1 -- 172.21.15.76:0/943058070 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f6e080957e0 con 0x7f6e101013e0 2024-06-02T04:48:24.431 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:24.431+0000 7f6e18771700 1 -- 172.21.15.76:0/943058070 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6e1010b400 con 0x7f6e101013e0 2024-06-02T04:48:24.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:24.433+0000 7f6e077fe700 1 -- 172.21.15.76:0/943058070 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+23984 (secure 0 0 0) 0x7f6e0800cc30 con 0x7f6e101013e0 2024-06-02T04:48:24.433 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:48:24.433 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":80,"fsid":"60ab6d30-209a-11ef-bc9b-c7b262605968","created":"2024-06-02T04:42:21.007333+0000","modified":"2024-06-02T04:48:07.101373+0000","last_up_change":"2024-06-02T04:47:29.822242+0000","last_in_change":"2024-06-02T04:47:14.253449+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T04:44:56.408602+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-02T04:48:01.194954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-02T04:48:01.828863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-02T04:48:04.916565+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"33a51ba2-be5c-41d0-b5d1-8d6039f2ca4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6802","nonce":2869602045},{"type":"v1","addr":"172.21.15.76:6803","nonce":2869602045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6804","nonce":2869602045},{"type":"v1","addr":"172.21.15.76:6805","nonce":2869602045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6808","nonce":2869602045},{"type":"v1","addr":"172.21.15.76:6809","nonce":2869602045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6806","nonce":2869602045},{"type":"v1","addr":"172.21.15.76:6807","nonce":2869602045}]},"public_addr":"172.21.15.76:6803/2869602045","cluster_addr":"172.21.15.76:6805/2869602045","heartbeat_back_addr":"172.21.15.76:6809/2869602045","heartbeat_front_addr":"172.21.15.76:6807/2869602045","state":["exists","up"]},{"osd":1,"uuid":"ace46e13-3bb7-4103-973a-6860554df8b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":2353738098},{"type":"v1","addr":"172.21.15.119:6801","nonce":2353738098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":2353738098},{"type":"v1","addr":"172.21.15.119:6803","nonce":2353738098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":2353738098},{"type":"v1","addr":"172.21.15.119:6807","nonce":2353738098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":2353738098},{"type":"v1","addr":"172.21.15.119:6805","nonce":2353738098}]},"public_addr":"172.21.15.119:6801/2353738098","cluster_addr":"172.21.15.119:6803/2353738098","heartbeat_back_addr":"172.21.15.119:6807/2353738098","heartbeat_front_addr":"172.21.15.119:6805/2353738098","state":["exists","up"]},{"osd":2,"uuid":"4addc09e-77a9-428a-bcc4-38194f486cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":3206918546},{"type":"v1","addr":"172.21.15.192:6801","nonce":3206918546}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":3206918546},{"type":"v1","addr":"172.21.15.192:6803","nonce":3206918546}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":3206918546},{"type":"v1","addr":"172.21.15.192:6807","nonce":3206918546}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":3206918546},{"type":"v1","addr":"172.21.15.192:6805","nonce":3206918546}]},"public_addr":"172.21.15.192:6801/3206918546","cluster_addr":"172.21.15.192:6803/3206918546","heartbeat_back_addr":"172.21.15.192:6807/3206918546","heartbeat_front_addr":"172.21.15.192:6805/3206918546","state":["exists","up"]},{"osd":3,"uuid":"dc525518-82c6-49ed-8ca8-e3bd5bfc18d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6810","nonce":3747864233},{"type":"v1","addr":"172.21.15.76:6811","nonce":3747864233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6812","nonce":3747864233},{"type":"v1","addr":"172.21.15.76:6813","nonce":3747864233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6816","nonce":3747864233},{"type":"v1","addr":"172.21.15.76:6817","nonce":3747864233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6814","nonce":3747864233},{"type":"v1","addr":"172.21.15.76:6815","nonce":3747864233}]},"public_addr":"172.21.15.76:6811/3747864233","cluster_addr":"172.21.15.76:6813/3747864233","heartbeat_back_addr":"172.21.15.76:6817/3747864233","heartbeat_front_addr":"172.21.15.76:6815/3747864233","state":["exists","up"]},{"osd":4,"uuid":"eef293d0-cb87-47b3-9751-c6437a1cf079","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":2571629047},{"type":"v1","addr":"172.21.15.119:6809","nonce":2571629047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":2571629047},{"type":"v1","addr":"172.21.15.119:6811","nonce":2571629047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":2571629047},{"type":"v1","addr":"172.21.15.119:6815","nonce":2571629047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":2571629047},{"type":"v1","addr":"172.21.15.119:6813","nonce":2571629047}]},"public_addr":"172.21.15.119:6809/2571629047","cluster_addr":"172.21.15.119:6811/2571629047","heartbeat_back_addr":"172.21.15.119:6815/2571629047","heartbeat_front_addr":"172.21.15.119:6813/2571629047","state":["exists","up"]},{"osd":5,"uuid":"60eb8c6e-766c-49d0-9997-44f85776b3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3285065416},{"type":"v1","addr":"172.21.15.192:6809","nonce":3285065416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":3285065416},{"type":"v1","addr":"172.21.15.192:6811","nonce":3285065416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3285065416},{"type":"v1","addr":"172.21.15.192:6815","nonce":3285065416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":3285065416},{"type":"v1","addr":"172.21.15.192:6813","nonce":3285065416}]},"public_addr":"172.21.15.192:6809/3285065416","cluster_addr":"172.21.15.192:6811/3285065416","heartbeat_back_addr":"172.21.15.192:6815/3285065416","heartbeat_front_addr":"172.21.15.192:6813/3285065416","state":["exists","up"]},{"osd":6,"uuid":"e6dc8b9d-dd06-4870-a506-def8201b7e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6818","nonce":2951381580},{"type":"v1","addr":"172.21.15.76:6819","nonce":2951381580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6820","nonce":2951381580},{"type":"v1","addr":"172.21.15.76:6821","nonce":2951381580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6824","nonce":2951381580},{"type":"v1","addr":"172.21.15.76:6825","nonce":2951381580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6822","nonce":2951381580},{"type":"v1","addr":"172.21.15.76:6823","nonce":2951381580}]},"public_addr":"172.21.15.76:6819/2951381580","cluster_addr":"172.21.15.76:6821/2951381580","heartbeat_back_addr":"172.21.15.76:6825/2951381580","heartbeat_front_addr":"172.21.15.76:6823/2951381580","state":["exists","up"]},{"osd":7,"uuid":"2f5dccb3-39a1-4f25-8715-fa264d59db97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1802558756},{"type":"v1","addr":"172.21.15.119:6817","nonce":1802558756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1802558756},{"type":"v1","addr":"172.21.15.119:6819","nonce":1802558756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1802558756},{"type":"v1","addr":"172.21.15.119:6823","nonce":1802558756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1802558756},{"type":"v1","addr":"172.21.15.119:6821","nonce":1802558756}]},"public_addr":"172.21.15.119:6817/1802558756","cluster_addr":"172.21.15.119:6819/1802558756","heartbeat_back_addr":"172.21.15.119:6823/1802558756","heartbeat_front_addr":"172.21.15.119:6821/1802558756","state":["exists","up"]},{"osd":8,"uuid":"39b6ccd0-16e7-4cd5-87e0-d827e9172984","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":1214972276},{"type":"v1","addr":"172.21.15.192:6817","nonce":1214972276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":1214972276},{"type":"v1","addr":"172.21.15.192:6819","nonce":1214972276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":1214972276},{"type":"v1","addr":"172.21.15.192:6823","nonce":1214972276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":1214972276},{"type":"v1","addr":"172.21.15.192:6821","nonce":1214972276}]},"public_addr":"172.21.15.192:6817/1214972276","cluster_addr":"172.21.15.192:6819/1214972276","heartbeat_back_addr":"172.21.15.192:6823/1214972276","heartbeat_front_addr":"172.21.15.192:6821/1214972276","state":["exists","up"]},{"osd":9,"uuid":"851b2155-07bd-45de-bfe0-53021fda733f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6826","nonce":3095501821},{"type":"v1","addr":"172.21.15.76:6827","nonce":3095501821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6828","nonce":3095501821},{"type":"v1","addr":"172.21.15.76:6829","nonce":3095501821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":3095501821},{"type":"v1","addr":"172.21.15.76:6833","nonce":3095501821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6830","nonce":3095501821},{"type":"v1","addr":"172.21.15.76:6831","nonce":3095501821}]},"public_addr":"172.21.15.76:6827/3095501821","cluster_addr":"172.21.15.76:6829/3095501821","heartbeat_back_addr":"172.21.15.76:6833/3095501821","heartbeat_front_addr":"172.21.15.76:6831/3095501821","state":["exists","up"]},{"osd":10,"uuid":"e4b18e7e-bddf-4dd4-84f6-7902ea327cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":4082130894},{"type":"v1","addr":"172.21.15.119:6825","nonce":4082130894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":4082130894},{"type":"v1","addr":"172.21.15.119:6827","nonce":4082130894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":4082130894},{"type":"v1","addr":"172.21.15.119:6831","nonce":4082130894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":4082130894},{"type":"v1","addr":"172.21.15.119:6829","nonce":4082130894}]},"public_addr":"172.21.15.119:6825/4082130894","cluster_addr":"172.21.15.119:6827/4082130894","heartbeat_back_addr":"172.21.15.119:6831/4082130894","heartbeat_front_addr":"172.21.15.119:6829/4082130894","state":["exists","up"]},{"osd":11,"uuid":"54567e18-920c-4ae9-9557-0efba5a1a820","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":439693921},{"type":"v1","addr":"172.21.15.192:6825","nonce":439693921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":439693921},{"type":"v1","addr":"172.21.15.192:6827","nonce":439693921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":439693921},{"type":"v1","addr":"172.21.15.192:6831","nonce":439693921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":439693921},{"type":"v1","addr":"172.21.15.192:6829","nonce":439693921}]},"public_addr":"172.21.15.192:6825/439693921","cluster_addr":"172.21.15.192:6827/439693921","heartbeat_back_addr":"172.21.15.192:6831/439693921","heartbeat_front_addr":"172.21.15.192:6829/439693921","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:44:19.922390+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:44:36.895563+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:44:53.699019+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:45:11.167404+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:45:27.955899+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:45:44.850368+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:46:02.003588+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:46:19.019217+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:46:36.189670+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:46:53.919365+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:47:11.563053+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:47:28.822443+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.76:6801/4200406736":"2024-06-03T04:43:06.092916+0000","172.21.15.76:6800/4200406736":"2024-06-03T04:43:06.092916+0000","172.21.15.76:0/1524144593":"2024-06-03T04:43:06.092916+0000","172.21.15.76:0/3269372590":"2024-06-03T04:43:06.092916+0000","172.21.15.76:0/3570893846":"2024-06-03T04:42:44.872236+0000","172.21.15.76:0/902035790":"2024-06-03T04:43:06.092916+0000","172.21.15.76:6800/2550846765":"2024-06-03T04:42:44.872236+0000","172.21.15.76:6801/2550846765":"2024-06-03T04:42:44.872236+0000","172.21.15.76:0/2646712763":"2024-06-03T04:42:44.872236+0000","172.21.15.76:0/964578813":"2024-06-03T04:42:44.872236+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T04:48:24.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:24.435+0000 7f6e18771700 1 -- 172.21.15.76:0/943058070 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f6dfc0a11a0 msgr2=0x7f6dfc0a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:24.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:24.435+0000 7f6e18771700 1 --2- 172.21.15.76:0/943058070 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f6dfc0a11a0 0x7f6dfc0a3660 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6e00005fd0 tx=0x7f6e00005e40 comp rx=0 tx=0).stop 2024-06-02T04:48:24.436 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:24.435+0000 7f6e18771700 1 -- 172.21.15.76:0/943058070 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6e101013e0 msgr2=0x7f6e1019e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:24.436 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:24.435+0000 7f6e18771700 1 --2- 172.21.15.76:0/943058070 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6e101013e0 0x7f6e1019e1b0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f6e0800ada0 tx=0x7f6e0800c330 comp rx=0 tx=0).stop 2024-06-02T04:48:24.436 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:24.435+0000 7f6e18771700 1 -- 172.21.15.76:0/943058070 shutdown_connections 2024-06-02T04:48:24.436 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:24.435+0000 7f6e18771700 1 --2- 172.21.15.76:0/943058070 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6e101013e0 0x7f6e1019e1b0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:24.436 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:24.435+0000 7f6e18771700 1 --2- 172.21.15.76:0/943058070 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f6dfc0a11a0 0x7f6dfc0a3660 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:24.436 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:24.435+0000 7f6e18771700 1 --2- 172.21.15.76:0/943058070 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6e100fffa0 0x7f6e10196c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:24.436 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:24.435+0000 7f6e18771700 1 --2- 172.21.15.76:0/943058070 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6e10100960 0x7f6e101971d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:24.436 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:24.435+0000 7f6e18771700 1 -- 172.21.15.76:0/943058070 >> 172.21.15.76:0/943058070 conn(0x7f6e100faa70 msgr2=0x7f6e100feec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:24.436 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:24.435+0000 7f6e18771700 1 -- 172.21.15.76:0/943058070 shutdown_connections 2024-06-02T04:48:24.436 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:24.435+0000 7f6e18771700 1 -- 172.21.15.76:0/943058070 wait complete. 2024-06-02T04:48:24.446 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:24 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/3920165661' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:48:24.448 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-06-02T04:48:24.573 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:24.573+0000 7fac38fa7700 1 -- 172.21.15.76:0/1499709700 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fac34100fb0 msgr2=0x7fac34101430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:24.574 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:24.573+0000 7fac38fa7700 1 --2- 172.21.15.76:0/1499709700 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fac34100fb0 0x7fac34101430 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fac28009990 tx=0x7fac28009ca0 comp rx=0 tx=0).stop 2024-06-02T04:48:24.574 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:24.573+0000 7fac38fa7700 1 -- 172.21.15.76:0/1499709700 shutdown_connections 2024-06-02T04:48:24.574 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:24.573+0000 7fac38fa7700 1 --2- 172.21.15.76:0/1499709700 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac34101970 0x7fac34108290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:24.574 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:24.573+0000 7fac38fa7700 1 --2- 172.21.15.76:0/1499709700 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fac340ffe60 0x7fac34100280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:24.574 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:24.573+0000 7fac38fa7700 1 --2- 172.21.15.76:0/1499709700 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fac34100fb0 0x7fac34101430 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:24.574 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:24.573+0000 7fac38fa7700 1 -- 172.21.15.76:0/1499709700 >> 172.21.15.76:0/1499709700 conn(0x7fac340fb3f0 msgr2=0x7fac340fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:24.574 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:24.573+0000 7fac38fa7700 1 -- 172.21.15.76:0/1499709700 shutdown_connections 2024-06-02T04:48:24.574 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:24.573+0000 7fac38fa7700 1 -- 172.21.15.76:0/1499709700 wait complete. 2024-06-02T04:48:24.577 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:24.574+0000 7fac38fa7700 1 Processor -- start 2024-06-02T04:48:24.577 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:24.574+0000 7fac38fa7700 1 -- start start 2024-06-02T04:48:24.577 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:24.574+0000 7fac38fa7700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fac340ffe60 0x7fac34068b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:24.577 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:24.574+0000 7fac38fa7700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fac34100fb0 0x7fac3419bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:24.577 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:24.574+0000 7fac38fa7700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac34101970 0x7fac3419e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:24.577 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:24.574+0000 7fac38fa7700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac3419e9f0 con 0x7fac340ffe60 2024-06-02T04:48:24.577 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:24.574+0000 7fac38fa7700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac3419eb60 con 0x7fac34101970 2024-06-02T04:48:24.577 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:24.574+0000 7fac38fa7700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac3419ed20 con 0x7fac34100fb0 2024-06-02T04:48:24.577 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:24.574+0000 7fac3259c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fac340ffe60 0x7fac34068b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:24.578 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:24.575+0000 7fac3259c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fac340ffe60 0x7fac34068b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:40708/0 (socket says 172.21.15.76:40708) 2024-06-02T04:48:24.578 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:24.575+0000 7fac3259c700 1 -- 172.21.15.76:0/3722527171 learned_addr learned my addr 172.21.15.76:0/3722527171 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:48:24.578 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:24.575+0000 7fac32d9d700 1 --2- 172.21.15.76:0/3722527171 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac34101970 0x7fac3419e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:24.578 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:24.575+0000 7fac31d9b700 1 --2- 172.21.15.76:0/3722527171 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fac34100fb0 0x7fac3419bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:24.578 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:24.575+0000 7fac3259c700 1 -- 172.21.15.76:0/3722527171 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fac34100fb0 msgr2=0x7fac3419bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:24.578 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:24.575+0000 7fac3259c700 1 --2- 172.21.15.76:0/3722527171 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fac34100fb0 0x7fac3419bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:24.578 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:24.575+0000 7fac3259c700 1 -- 172.21.15.76:0/3722527171 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac34101970 msgr2=0x7fac3419e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:24.578 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:24.575+0000 7fac3259c700 1 --2- 172.21.15.76:0/3722527171 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac34101970 0x7fac3419e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:24.578 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:24.575+0000 7fac3259c700 1 -- 172.21.15.76:0/3722527171 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac280095f0 con 0x7fac340ffe60 2024-06-02T04:48:24.578 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:24.575+0000 7fac31d9b700 1 --2- 172.21.15.76:0/3722527171 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fac34100fb0 0x7fac3419bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:48:24.578 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:24.575+0000 7fac3259c700 1 --2- 172.21.15.76:0/3722527171 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fac340ffe60 0x7fac34068b30 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fac2c00ba50 tx=0x7fac2c00be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:24.578 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:24.575+0000 7fac237fe700 1 -- 172.21.15.76:0/3722527171 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac2c00cab0 con 0x7fac340ffe60 2024-06-02T04:48:24.578 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:24.575+0000 7fac237fe700 1 -- 172.21.15.76:0/3722527171 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fac2c00cc10 con 0x7fac340ffe60 2024-06-02T04:48:24.579 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:24.575+0000 7fac38fa7700 1 -- 172.21.15.76:0/3722527171 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac3419efa0 con 0x7fac340ffe60 2024-06-02T04:48:24.579 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:24.575+0000 7fac237fe700 1 -- 172.21.15.76:0/3722527171 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac2c0075d0 con 0x7fac340ffe60 2024-06-02T04:48:24.579 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:24.575+0000 7fac38fa7700 1 -- 172.21.15.76:0/3722527171 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac3419f3c0 con 0x7fac340ffe60 2024-06-02T04:48:24.579 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:24.576+0000 7fac38fa7700 1 -- 172.21.15.76:0/3722527171 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac341072c0 con 0x7fac340ffe60 2024-06-02T04:48:24.579 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:24.577+0000 7fac237fe700 1 -- 172.21.15.76:0/3722527171 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fac2c014440 con 0x7fac340ffe60 2024-06-02T04:48:24.580 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:24.578+0000 7fac237fe700 1 --2- 172.21.15.76:0/3722527171 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fac1c0a1120 0x7fac1c0a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:24.580 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:24.578+0000 7fac31d9b700 1 --2- 172.21.15.76:0/3722527171 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fac1c0a1120 0x7fac1c0a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:24.580 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:24.578+0000 7fac237fe700 1 -- 172.21.15.76:0/3722527171 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fac2c006e40 con 0x7fac340ffe60 2024-06-02T04:48:24.580 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:24.579+0000 7fac31d9b700 1 --2- 172.21.15.76:0/3722527171 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fac1c0a1120 0x7fac1c0a35e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fac28000c00 tx=0x7fac28005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:24.582 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:24.582+0000 7fac237fe700 1 -- 172.21.15.76:0/3722527171 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fac2c0960a0 con 0x7fac340ffe60 2024-06-02T04:48:24.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:24 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/3920165661' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:48:24.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:24 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/3920165661' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:48:24.823 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:24.823+0000 7fac38fa7700 1 -- 172.21.15.76:0/3722527171 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fac3410b610 con 0x7fac340ffe60 2024-06-02T04:48:25.245 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:25.245+0000 7fac237fe700 1 -- 172.21.15.76:0/3722527171 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v18) v1 ==== 118+0+0 (secure 0 0 0) 0x7fac2c0190b0 con 0x7fac340ffe60 2024-06-02T04:48:25.248 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:25.248+0000 7fac38fa7700 1 -- 172.21.15.76:0/3722527171 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fac1c0a1120 msgr2=0x7fac1c0a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:25.248 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:25.248+0000 7fac38fa7700 1 --2- 172.21.15.76:0/3722527171 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fac1c0a1120 0x7fac1c0a35e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fac28000c00 tx=0x7fac28005fb0 comp rx=0 tx=0).stop 2024-06-02T04:48:25.248 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:25.248+0000 7fac38fa7700 1 -- 172.21.15.76:0/3722527171 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fac340ffe60 msgr2=0x7fac34068b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:25.248 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:25.248+0000 7fac38fa7700 1 --2- 172.21.15.76:0/3722527171 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fac340ffe60 0x7fac34068b30 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fac2c00ba50 tx=0x7fac2c00be10 comp rx=0 tx=0).stop 2024-06-02T04:48:25.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:25.248+0000 7fac38fa7700 1 -- 172.21.15.76:0/3722527171 shutdown_connections 2024-06-02T04:48:25.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:25.248+0000 7fac38fa7700 1 --2- 172.21.15.76:0/3722527171 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fac1c0a1120 0x7fac1c0a35e0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:25.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:25.248+0000 7fac38fa7700 1 --2- 172.21.15.76:0/3722527171 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac34101970 0x7fac3419e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:25.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:25.248+0000 7fac38fa7700 1 --2- 172.21.15.76:0/3722527171 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fac340ffe60 0x7fac34068b30 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:25.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:25.248+0000 7fac38fa7700 1 --2- 172.21.15.76:0/3722527171 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fac34100fb0 0x7fac3419bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:25.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:25.248+0000 7fac38fa7700 1 -- 172.21.15.76:0/3722527171 >> 172.21.15.76:0/3722527171 conn(0x7fac340fb3f0 msgr2=0x7fac34104400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:25.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:25.248+0000 7fac38fa7700 1 -- 172.21.15.76:0/3722527171 shutdown_connections 2024-06-02T04:48:25.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:25.248+0000 7fac38fa7700 1 -- 172.21.15.76:0/3722527171 wait complete. 2024-06-02T04:48:25.261 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2024-06-02T04:48:25.262 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 3 2024-06-02T04:48:25.390 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:25.388+0000 7f018dee7700 1 -- 172.21.15.76:0/3176423912 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0188102570 msgr2=0x7f0188102990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:25.391 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:25.388+0000 7f018dee7700 1 --2- 172.21.15.76:0/3176423912 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0188102570 0x7f0188102990 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f017c0099c0 tx=0x7f017c009cd0 comp rx=0 tx=0).stop 2024-06-02T04:48:25.391 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:25.388+0000 7f018dee7700 1 -- 172.21.15.76:0/3176423912 shutdown_connections 2024-06-02T04:48:25.391 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:25.388+0000 7f018dee7700 1 --2- 172.21.15.76:0/3176423912 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f01880ff980 0x7f0188109550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:25.391 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:25.388+0000 7f018dee7700 1 --2- 172.21.15.76:0/3176423912 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0188102570 0x7f0188102990 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:25.391 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:25.388+0000 7f018dee7700 1 --2- 172.21.15.76:0/3176423912 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f01880fefe0 0x7f01880ff440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:25.391 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:25.388+0000 7f018dee7700 1 -- 172.21.15.76:0/3176423912 >> 172.21.15.76:0/3176423912 conn(0x7f01880fab80 msgr2=0x7f01880fcfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:25.391 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:25.388+0000 7f018dee7700 1 -- 172.21.15.76:0/3176423912 shutdown_connections 2024-06-02T04:48:25.391 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:25.388+0000 7f018dee7700 1 -- 172.21.15.76:0/3176423912 wait complete. 2024-06-02T04:48:25.391 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:25.388+0000 7f018dee7700 1 Processor -- start 2024-06-02T04:48:25.391 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:25.388+0000 7f018dee7700 1 -- start start 2024-06-02T04:48:25.391 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:25.389+0000 7f018dee7700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f01880fefe0 0x7f0188196e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:25.392 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:25.389+0000 7f018dee7700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f01880ff980 0x7f0188197340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:25.392 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:25.389+0000 7f018dee7700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0188102570 0x7f018819e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:25.392 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:25.389+0000 7f018dee7700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f018819e8f0 con 0x7f0188102570 2024-06-02T04:48:25.392 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:25.389+0000 7f018dee7700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f018819ea60 con 0x7f01880fefe0 2024-06-02T04:48:25.392 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:25.389+0000 7f018dee7700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f018819ec20 con 0x7f01880ff980 2024-06-02T04:48:25.392 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:25.389+0000 7f0187fff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0188102570 0x7f018819e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:25.392 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:25.389+0000 7f0187fff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0188102570 0x7f018819e320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:40726/0 (socket says 172.21.15.76:40726) 2024-06-02T04:48:25.392 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:25.389+0000 7f0187fff700 1 -- 172.21.15.76:0/355474299 learned_addr learned my addr 172.21.15.76:0/355474299 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:48:25.392 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:25.389+0000 7f0186ffd700 1 --2- 172.21.15.76:0/355474299 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f01880ff980 0x7f0188197340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:25.392 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:25.389+0000 7f0187fff700 1 -- 172.21.15.76:0/355474299 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f01880ff980 msgr2=0x7f0188197340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:25.392 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:25.389+0000 7f01877fe700 1 --2- 172.21.15.76:0/355474299 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f01880fefe0 0x7f0188196e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:25.393 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:25.389+0000 7f0187fff700 1 --2- 172.21.15.76:0/355474299 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f01880ff980 0x7f0188197340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:25.393 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:25.389+0000 7f0187fff700 1 -- 172.21.15.76:0/355474299 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f01880fefe0 msgr2=0x7f0188196e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:25.393 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:25.389+0000 7f0187fff700 1 --2- 172.21.15.76:0/355474299 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f01880fefe0 0x7f0188196e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:25.393 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:25.389+0000 7f0187fff700 1 -- 172.21.15.76:0/355474299 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f017c0095f0 con 0x7f0188102570 2024-06-02T04:48:25.393 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:25.389+0000 7f0186ffd700 1 --2- 172.21.15.76:0/355474299 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f01880ff980 0x7f0188197340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:48:25.393 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:25.389+0000 7f01877fe700 1 --2- 172.21.15.76:0/355474299 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f01880fefe0 0x7f0188196e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:48:25.393 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:25.389+0000 7f0187fff700 1 --2- 172.21.15.76:0/355474299 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0188102570 0x7f018819e320 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f0180007d70 tx=0x7f018000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:25.393 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:25.389+0000 7f0184ff9700 1 -- 172.21.15.76:0/355474299 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f018000ad40 con 0x7f0188102570 2024-06-02T04:48:25.393 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:25.389+0000 7f0184ff9700 1 -- 172.21.15.76:0/355474299 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f01800128b0 con 0x7f0188102570 2024-06-02T04:48:25.393 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:25.389+0000 7f018dee7700 1 -- 172.21.15.76:0/355474299 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f018819ef00 con 0x7f0188102570 2024-06-02T04:48:25.393 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:25.389+0000 7f0184ff9700 1 -- 172.21.15.76:0/355474299 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01800116b0 con 0x7f0188102570 2024-06-02T04:48:25.393 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:25.389+0000 7f018dee7700 1 -- 172.21.15.76:0/355474299 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f018819f2d0 con 0x7f0188102570 2024-06-02T04:48:25.394 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:25.390+0000 7f018dee7700 1 -- 172.21.15.76:0/355474299 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0188108590 con 0x7f0188102570 2024-06-02T04:48:25.394 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:25.391+0000 7f0184ff9700 1 -- 172.21.15.76:0/355474299 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f0180012a20 con 0x7f0188102570 2024-06-02T04:48:25.394 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:25.392+0000 7f0184ff9700 1 --2- 172.21.15.76:0/355474299 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f01700a1120 0x7f01700a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:25.395 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:25.392+0000 7f01877fe700 1 --2- 172.21.15.76:0/355474299 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f01700a1120 0x7f01700a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:25.395 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:25.392+0000 7f0184ff9700 1 -- 172.21.15.76:0/355474299 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f01800cd220 con 0x7f0188102570 2024-06-02T04:48:25.395 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:25.392+0000 7f01877fe700 1 --2- 172.21.15.76:0/355474299 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f01700a1120 0x7f01700a35e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f017c003780 tx=0x7f017c009510 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:25.395 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:25.395+0000 7f0184ff9700 1 -- 172.21.15.76:0/355474299 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f01800967c0 con 0x7f0188102570 2024-06-02T04:48:25.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:25 smithi119 ceph-mon[46633]: pgmap v229: 129 pgs: 129 active+clean; 581 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-06-02T04:48:25.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:25 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/943058070' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:48:25.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:25 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/3722527171' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-06-02T04:48:25.641 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:25.641+0000 7f018dee7700 1 -- 172.21.15.76:0/355474299 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) v1 -- 0x7f0188107f70 con 0x7f0188102570 2024-06-02T04:48:25.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:25 smithi192 ceph-mon[47933]: pgmap v229: 129 pgs: 129 active+clean; 581 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-06-02T04:48:25.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:25 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/943058070' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:48:25.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:25 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/3722527171' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-06-02T04:48:25.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:25 smithi076 ceph-mon[42935]: pgmap v229: 129 pgs: 129 active+clean; 581 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-06-02T04:48:25.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:25 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/943058070' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:48:25.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:25 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/3722527171' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-06-02T04:48:26.260 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:26.259+0000 7f0184ff9700 1 -- 172.21.15.76:0/355474299 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v19) v1 ==== 105+0+0 (secure 0 0 0) 0x7f0180099de0 con 0x7f0188102570 2024-06-02T04:48:26.264 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:26.263+0000 7f018dee7700 1 -- 172.21.15.76:0/355474299 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f01700a1120 msgr2=0x7f01700a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:26.264 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:26.263+0000 7f018dee7700 1 --2- 172.21.15.76:0/355474299 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f01700a1120 0x7f01700a35e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f017c003780 tx=0x7f017c009510 comp rx=0 tx=0).stop 2024-06-02T04:48:26.264 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:26.263+0000 7f018dee7700 1 -- 172.21.15.76:0/355474299 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0188102570 msgr2=0x7f018819e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:26.264 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:26.263+0000 7f018dee7700 1 --2- 172.21.15.76:0/355474299 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0188102570 0x7f018819e320 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f0180007d70 tx=0x7f018000a340 comp rx=0 tx=0).stop 2024-06-02T04:48:26.264 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:26.264+0000 7f018dee7700 1 -- 172.21.15.76:0/355474299 shutdown_connections 2024-06-02T04:48:26.264 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:26.264+0000 7f018dee7700 1 --2- 172.21.15.76:0/355474299 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0188102570 0x7f018819e320 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:26.264 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:26.264+0000 7f018dee7700 1 --2- 172.21.15.76:0/355474299 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f01700a1120 0x7f01700a35e0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:26.265 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:26.264+0000 7f018dee7700 1 --2- 172.21.15.76:0/355474299 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f01880fefe0 0x7f0188196e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:26.265 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:26.264+0000 7f018dee7700 1 --2- 172.21.15.76:0/355474299 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f01880ff980 0x7f0188197340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:26.265 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:26.264+0000 7f018dee7700 1 -- 172.21.15.76:0/355474299 >> 172.21.15.76:0/355474299 conn(0x7f01880fab80 msgr2=0x7f01881056d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:26.265 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:26.264+0000 7f018dee7700 1 -- 172.21.15.76:0/355474299 shutdown_connections 2024-06-02T04:48:26.265 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:26.264+0000 7f018dee7700 1 -- 172.21.15.76:0/355474299 wait complete. 2024-06-02T04:48:26.283 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay true 2024-06-02T04:48:26.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:26.414+0000 7f8158909700 1 -- 172.21.15.76:0/2279332039 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f81540ffe60 msgr2=0x7f8154100280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:26.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:26.414+0000 7f8158909700 1 --2- 172.21.15.76:0/2279332039 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f81540ffe60 0x7f8154100280 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f813c009990 tx=0x7f813c009ca0 comp rx=0 tx=0).stop 2024-06-02T04:48:26.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:26.414+0000 7f8158909700 1 -- 172.21.15.76:0/2279332039 shutdown_connections 2024-06-02T04:48:26.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:26.414+0000 7f8158909700 1 --2- 172.21.15.76:0/2279332039 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8154101970 0x7f8154108290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:26.416 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:26.414+0000 7f8158909700 1 --2- 172.21.15.76:0/2279332039 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f81540ffe60 0x7f8154100280 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:26.416 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:26.414+0000 7f8158909700 1 --2- 172.21.15.76:0/2279332039 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8154100fb0 0x7f8154101430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:26.416 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:26.414+0000 7f8158909700 1 -- 172.21.15.76:0/2279332039 >> 172.21.15.76:0/2279332039 conn(0x7f81540fb3f0 msgr2=0x7f81540fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:26.416 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:26.414+0000 7f8158909700 1 -- 172.21.15.76:0/2279332039 shutdown_connections 2024-06-02T04:48:26.416 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:26.414+0000 7f8158909700 1 -- 172.21.15.76:0/2279332039 wait complete. 2024-06-02T04:48:26.418 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:26.415+0000 7f8158909700 1 Processor -- start 2024-06-02T04:48:26.418 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:26.415+0000 7f8158909700 1 -- start start 2024-06-02T04:48:26.418 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:26.415+0000 7f8158909700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f81540ffe60 0x7f8154068b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:26.418 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:26.416+0000 7f8158909700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8154100fb0 0x7f815419bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:26.418 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:26.416+0000 7f8158909700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8154101970 0x7f815419e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:26.418 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:26.416+0000 7f8158909700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f815419e960 con 0x7f8154101970 2024-06-02T04:48:26.419 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:26.416+0000 7f8158909700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f815419ead0 con 0x7f8154100fb0 2024-06-02T04:48:26.419 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:26.416+0000 7f8158909700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f815419ec90 con 0x7f81540ffe60 2024-06-02T04:48:26.419 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:26.416+0000 7f8152d9d700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8154101970 0x7f815419e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:26.419 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:26.416+0000 7f8152d9d700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8154101970 0x7f815419e170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:40752/0 (socket says 172.21.15.76:40752) 2024-06-02T04:48:26.419 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:26.416+0000 7f8152d9d700 1 -- 172.21.15.76:0/969032831 learned_addr learned my addr 172.21.15.76:0/969032831 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:48:26.419 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:26.416+0000 7f8151d9b700 1 --2- 172.21.15.76:0/969032831 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8154100fb0 0x7f815419bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:26.419 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:26.416+0000 7f815259c700 1 --2- 172.21.15.76:0/969032831 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f81540ffe60 0x7f8154068b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:26.419 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:26.416+0000 7f8152d9d700 1 -- 172.21.15.76:0/969032831 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f81540ffe60 msgr2=0x7f8154068b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:26.419 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:26.416+0000 7f8152d9d700 1 --2- 172.21.15.76:0/969032831 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f81540ffe60 0x7f8154068b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:26.419 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:26.416+0000 7f8152d9d700 1 -- 172.21.15.76:0/969032831 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8154100fb0 msgr2=0x7f815419bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:26.419 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:26.416+0000 7f8152d9d700 1 --2- 172.21.15.76:0/969032831 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8154100fb0 0x7f815419bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:26.419 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:26.416+0000 7f8152d9d700 1 -- 172.21.15.76:0/969032831 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f813c0095f0 con 0x7f8154101970 2024-06-02T04:48:26.419 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:26.416+0000 7f8152d9d700 1 --2- 172.21.15.76:0/969032831 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8154101970 0x7f815419e170 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f814c007ee0 tx=0x7f814c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:26.419 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:26.416+0000 7f814b7fe700 1 -- 172.21.15.76:0/969032831 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f814c00dd20 con 0x7f8154101970 2024-06-02T04:48:26.420 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:26.416+0000 7f8158909700 1 -- 172.21.15.76:0/969032831 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f815419ef10 con 0x7f8154101970 2024-06-02T04:48:26.420 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:26.416+0000 7f814b7fe700 1 -- 172.21.15.76:0/969032831 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f814c00f040 con 0x7f8154101970 2024-06-02T04:48:26.420 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:26.416+0000 7f814b7fe700 1 -- 172.21.15.76:0/969032831 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f814c004750 con 0x7f8154101970 2024-06-02T04:48:26.420 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:26.416+0000 7f8158909700 1 -- 172.21.15.76:0/969032831 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f815419f390 con 0x7f8154101970 2024-06-02T04:48:26.420 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:26.417+0000 7f8158909700 1 -- 172.21.15.76:0/969032831 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8154107340 con 0x7f8154101970 2024-06-02T04:48:26.421 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:26.418+0000 7f814b7fe700 1 -- 172.21.15.76:0/969032831 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f814c003a00 con 0x7f8154101970 2024-06-02T04:48:26.421 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:26.419+0000 7f814b7fe700 1 --2- 172.21.15.76:0/969032831 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f81400a1120 0x7f81400a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:26.421 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:26.419+0000 7f815259c700 1 --2- 172.21.15.76:0/969032831 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f81400a1120 0x7f81400a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:26.421 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:26.419+0000 7f814b7fe700 1 -- 172.21.15.76:0/969032831 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f814c0cc3a0 con 0x7f8154101970 2024-06-02T04:48:26.421 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:26.420+0000 7f815259c700 1 --2- 172.21.15.76:0/969032831 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f81400a1120 0x7f81400a35e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f813c00c010 tx=0x7f813c003720 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:26.424 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:26.424+0000 7f814b7fe700 1 -- 172.21.15.76:0/969032831 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f814c095940 con 0x7f8154101970 2024-06-02T04:48:26.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:26 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/3722527171' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-06-02T04:48:26.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:26 smithi119 ceph-mon[46633]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-06-02T04:48:26.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:26 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/355474299' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-06-02T04:48:26.666 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:26.665+0000 7f8158909700 1 -- 172.21.15.76:0/969032831 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) v1 -- 0x7f8154067cf0 con 0x7f8154101970 2024-06-02T04:48:26.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:26 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/3722527171' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-06-02T04:48:26.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:26 smithi192 ceph-mon[47933]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-06-02T04:48:26.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:26 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/355474299' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-06-02T04:48:26.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:26 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/3722527171' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-06-02T04:48:26.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:26 smithi076 ceph-mon[42935]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-06-02T04:48:26.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:26 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/355474299' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-06-02T04:48:27.264 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:27.264+0000 7f814b7fe700 1 -- 172.21.15.76:0/969032831 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v21) v1 ==== 121+0+0 (secure 0 0 0) 0x7f814c0048b0 con 0x7f8154101970 2024-06-02T04:48:27.270 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:27.267+0000 7f8158909700 1 -- 172.21.15.76:0/969032831 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f81400a1120 msgr2=0x7f81400a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:27.270 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:27.267+0000 7f8158909700 1 --2- 172.21.15.76:0/969032831 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f81400a1120 0x7f81400a35e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f813c00c010 tx=0x7f813c003720 comp rx=0 tx=0).stop 2024-06-02T04:48:27.270 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:27.267+0000 7f8158909700 1 -- 172.21.15.76:0/969032831 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8154101970 msgr2=0x7f815419e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:27.270 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:27.267+0000 7f8158909700 1 --2- 172.21.15.76:0/969032831 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8154101970 0x7f815419e170 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f814c007ee0 tx=0x7f814c00d3b0 comp rx=0 tx=0).stop 2024-06-02T04:48:27.270 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:27.267+0000 7f8158909700 1 -- 172.21.15.76:0/969032831 shutdown_connections 2024-06-02T04:48:27.271 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:27.267+0000 7f8158909700 1 --2- 172.21.15.76:0/969032831 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8154101970 0x7f815419e170 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:27.271 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:27.267+0000 7f8158909700 1 --2- 172.21.15.76:0/969032831 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f81540ffe60 0x7f8154068b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:27.271 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:27.267+0000 7f8158909700 1 --2- 172.21.15.76:0/969032831 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f81400a1120 0x7f81400a35e0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:27.271 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:27.267+0000 7f8158909700 1 --2- 172.21.15.76:0/969032831 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8154100fb0 0x7f815419bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:27.271 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:27.267+0000 7f8158909700 1 -- 172.21.15.76:0/969032831 >> 172.21.15.76:0/969032831 conn(0x7f81540fb3f0 msgr2=0x7f8154104480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:27.271 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:27.267+0000 7f8158909700 1 -- 172.21.15.76:0/969032831 shutdown_connections 2024-06-02T04:48:27.271 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:27.267+0000 7f8158909700 1 -- 172.21.15.76:0/969032831 wait complete. 2024-06-02T04:48:27.283 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2024-06-02T04:48:27.409 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:27.409+0000 7fdca7cda700 1 -- 172.21.15.76:0/2541603916 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdca0100fb0 msgr2=0x7fdca0101430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:27.410 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:27.409+0000 7fdca7cda700 1 --2- 172.21.15.76:0/2541603916 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdca0100fb0 0x7fdca0101430 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fdc94009990 tx=0x7fdc94009ca0 comp rx=0 tx=0).stop 2024-06-02T04:48:27.410 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:27.409+0000 7fdca7cda700 1 -- 172.21.15.76:0/2541603916 shutdown_connections 2024-06-02T04:48:27.410 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:27.409+0000 7fdca7cda700 1 --2- 172.21.15.76:0/2541603916 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdca0101970 0x7fdca0108290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:27.410 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:27.409+0000 7fdca7cda700 1 --2- 172.21.15.76:0/2541603916 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdca00ffe60 0x7fdca0100280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:27.410 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:27.409+0000 7fdca7cda700 1 --2- 172.21.15.76:0/2541603916 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdca0100fb0 0x7fdca0101430 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:27.410 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:27.409+0000 7fdca7cda700 1 -- 172.21.15.76:0/2541603916 >> 172.21.15.76:0/2541603916 conn(0x7fdca00fb3f0 msgr2=0x7fdca00fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:27.410 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:27.409+0000 7fdca7cda700 1 -- 172.21.15.76:0/2541603916 shutdown_connections 2024-06-02T04:48:27.410 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:27.409+0000 7fdca7cda700 1 -- 172.21.15.76:0/2541603916 wait complete. 2024-06-02T04:48:27.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:27.410+0000 7fdca7cda700 1 Processor -- start 2024-06-02T04:48:27.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:27.410+0000 7fdca7cda700 1 -- start start 2024-06-02T04:48:27.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:27.410+0000 7fdca7cda700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdca00ffe60 0x7fdca0068b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:27.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:27.410+0000 7fdca7cda700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdca0100fb0 0x7fdca019bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:27.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:27.410+0000 7fdca7cda700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdca0101970 0x7fdca019e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:27.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:27.410+0000 7fdca7cda700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdca019e990 con 0x7fdca0100fb0 2024-06-02T04:48:27.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:27.410+0000 7fdca7cda700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdca019eb00 con 0x7fdca0101970 2024-06-02T04:48:27.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:27.410+0000 7fdca7cda700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdca019ecc0 con 0x7fdca00ffe60 2024-06-02T04:48:27.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:27.410+0000 7fdca5275700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdca0100fb0 0x7fdca019bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:27.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:27.410+0000 7fdca5275700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdca0100fb0 0x7fdca019bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:40778/0 (socket says 172.21.15.76:40778) 2024-06-02T04:48:27.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:27.410+0000 7fdca5275700 1 -- 172.21.15.76:0/1089328990 learned_addr learned my addr 172.21.15.76:0/1089328990 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:48:27.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:27.410+0000 7fdca5a76700 1 --2- 172.21.15.76:0/1089328990 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdca00ffe60 0x7fdca0068b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:27.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:27.410+0000 7fdca5275700 1 -- 172.21.15.76:0/1089328990 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdca00ffe60 msgr2=0x7fdca0068b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:27.414 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:27.410+0000 7fdca5275700 1 --2- 172.21.15.76:0/1089328990 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdca00ffe60 0x7fdca0068b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:27.414 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:27.410+0000 7fdca5275700 1 -- 172.21.15.76:0/1089328990 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdca0101970 msgr2=0x7fdca019e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:27.414 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:27.410+0000 7fdca5275700 1 --2- 172.21.15.76:0/1089328990 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdca0101970 0x7fdca019e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:27.414 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:27.410+0000 7fdca5275700 1 -- 172.21.15.76:0/1089328990 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc940095f0 con 0x7fdca0100fb0 2024-06-02T04:48:27.414 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:27.411+0000 7fdca5275700 1 --2- 172.21.15.76:0/1089328990 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdca0100fb0 0x7fdca019bc00 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fdc9400b5c0 tx=0x7fdc94003a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:27.414 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:27.411+0000 7fdc9effd700 1 -- 172.21.15.76:0/1089328990 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc9401d070 con 0x7fdca0100fb0 2024-06-02T04:48:27.414 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:27.411+0000 7fdc9effd700 1 -- 172.21.15.76:0/1089328990 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdc9400bd10 con 0x7fdca0100fb0 2024-06-02T04:48:27.414 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:27.411+0000 7fdc9effd700 1 -- 172.21.15.76:0/1089328990 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc9400f460 con 0x7fdca0100fb0 2024-06-02T04:48:27.414 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:27.411+0000 7fdca7cda700 1 -- 172.21.15.76:0/1089328990 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdca019ef40 con 0x7fdca0100fb0 2024-06-02T04:48:27.414 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:27.411+0000 7fdca7cda700 1 -- 172.21.15.76:0/1089328990 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdca019f2b0 con 0x7fdca0100fb0 2024-06-02T04:48:27.414 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:27.412+0000 7fdca7cda700 1 -- 172.21.15.76:0/1089328990 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdca0067d60 con 0x7fdca0100fb0 2024-06-02T04:48:27.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:27.413+0000 7fdc9effd700 1 -- 172.21.15.76:0/1089328990 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fdc94022470 con 0x7fdca0100fb0 2024-06-02T04:48:27.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:27.414+0000 7fdc9effd700 1 --2- 172.21.15.76:0/1089328990 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fdc880a1120 0x7fdc880a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:27.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:27.414+0000 7fdc9effd700 1 -- 172.21.15.76:0/1089328990 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fdc940ce1d0 con 0x7fdca0100fb0 2024-06-02T04:48:27.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:27.414+0000 7fdca5a76700 1 --2- 172.21.15.76:0/1089328990 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fdc880a1120 0x7fdc880a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:27.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:27.414+0000 7fdca5a76700 1 --2- 172.21.15.76:0/1089328990 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fdc880a1120 0x7fdc880a35e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fdc98009a10 tx=0x7fdc98009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:27.417 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:27.417+0000 7fdc9effd700 1 -- 172.21.15.76:0/1089328990 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fdc940978a0 con 0x7fdca0100fb0 2024-06-02T04:48:27.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:27 smithi119 ceph-mon[46633]: pgmap v230: 129 pgs: 129 active+clean; 581 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-06-02T04:48:27.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:27 smithi119 ceph-mon[46633]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-06-02T04:48:27.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:27 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/355474299' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-06-02T04:48:27.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:27 smithi119 ceph-mon[46633]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-06-02T04:48:27.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:27 smithi119 ceph-mon[46633]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-06-02T04:48:27.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:27 smithi119 ceph-mon[46633]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-06-02T04:48:27.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:27 smithi119 ceph-mon[46633]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-06-02T04:48:27.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:27 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/969032831' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-06-02T04:48:27.665 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:27.665+0000 7fdca7cda700 1 -- 172.21.15.76:0/1089328990 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7fdca0067d60 con 0x7fdca0100fb0 2024-06-02T04:48:27.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:27 smithi192 ceph-mon[47933]: pgmap v230: 129 pgs: 129 active+clean; 581 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-06-02T04:48:27.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:27 smithi192 ceph-mon[47933]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-06-02T04:48:27.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:27 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/355474299' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-06-02T04:48:27.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:27 smithi192 ceph-mon[47933]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-06-02T04:48:27.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:27 smithi192 ceph-mon[47933]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-06-02T04:48:27.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:27 smithi192 ceph-mon[47933]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-06-02T04:48:27.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:27 smithi192 ceph-mon[47933]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-06-02T04:48:27.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:27 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/969032831' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-06-02T04:48:27.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:27 smithi076 ceph-mon[42935]: pgmap v230: 129 pgs: 129 active+clean; 581 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-06-02T04:48:27.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:27 smithi076 ceph-mon[42935]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-06-02T04:48:27.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:27 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/355474299' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-06-02T04:48:27.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:27 smithi076 ceph-mon[42935]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-06-02T04:48:27.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:27 smithi076 ceph-mon[42935]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-06-02T04:48:27.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:27 smithi076 ceph-mon[42935]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-06-02T04:48:27.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:27 smithi076 ceph-mon[42935]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-06-02T04:48:27.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:27 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/969032831' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-06-02T04:48:28.265 INFO:journalctl@ceph.mds.b.smithi119.stdout:Jun 02 04:48:27 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-b[83265]: 2024-06-02T04:48:27.913+0000 7f60dba50700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-06-02T04:48:28.274 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:28.273+0000 7fdc9effd700 1 -- 172.21.15.76:0/1089328990 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v23) v1 ==== 115+0+0 (secure 0 0 0) 0x7fdca0067d60 con 0x7fdca0100fb0 2024-06-02T04:48:28.277 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:28.276+0000 7fdca7cda700 1 -- 172.21.15.76:0/1089328990 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fdc880a1120 msgr2=0x7fdc880a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:28.277 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:28.276+0000 7fdca7cda700 1 --2- 172.21.15.76:0/1089328990 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fdc880a1120 0x7fdc880a35e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fdc98009a10 tx=0x7fdc98009190 comp rx=0 tx=0).stop 2024-06-02T04:48:28.277 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:28.276+0000 7fdca7cda700 1 -- 172.21.15.76:0/1089328990 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdca0100fb0 msgr2=0x7fdca019bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:28.277 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:28.276+0000 7fdca7cda700 1 --2- 172.21.15.76:0/1089328990 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdca0100fb0 0x7fdca019bc00 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fdc9400b5c0 tx=0x7fdc94003a50 comp rx=0 tx=0).stop 2024-06-02T04:48:28.277 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:28.277+0000 7fdca7cda700 1 -- 172.21.15.76:0/1089328990 shutdown_connections 2024-06-02T04:48:28.277 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:28.277+0000 7fdca7cda700 1 --2- 172.21.15.76:0/1089328990 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fdc880a1120 0x7fdc880a35e0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:28.277 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:28.277+0000 7fdca7cda700 1 --2- 172.21.15.76:0/1089328990 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdca0101970 0x7fdca019e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:28.277 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:28.277+0000 7fdca7cda700 1 --2- 172.21.15.76:0/1089328990 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdca00ffe60 0x7fdca0068b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:28.278 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:28.277+0000 7fdca7cda700 1 --2- 172.21.15.76:0/1089328990 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdca0100fb0 0x7fdca019bc00 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:28.278 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:28.277+0000 7fdca7cda700 1 -- 172.21.15.76:0/1089328990 >> 172.21.15.76:0/1089328990 conn(0x7fdca00fb3f0 msgr2=0x7fdca0104400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:28.278 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:28.277+0000 7fdca7cda700 1 -- 172.21.15.76:0/1089328990 shutdown_connections 2024-06-02T04:48:28.278 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:28.277+0000 7fdca7cda700 1 -- 172.21.15.76:0/1089328990 wait complete. 2024-06-02T04:48:28.293 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--size 25000000000'} subvols for filesystem 'cephfs' 2024-06-02T04:48:28.293 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup create cephfs qa 2024-06-02T04:48:28.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:28.425+0000 7f2f47884700 1 -- 172.21.15.76:0/3329911269 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2f40101990 msgr2=0x7f2f401082b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:28.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:28.425+0000 7f2f47884700 1 --2- 172.21.15.76:0/3329911269 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2f40101990 0x7f2f401082b0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f2f3800b0a0 tx=0x7f2f3800b3b0 comp rx=0 tx=0).stop 2024-06-02T04:48:28.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:28.425+0000 7f2f47884700 1 -- 172.21.15.76:0/3329911269 shutdown_connections 2024-06-02T04:48:28.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:28.425+0000 7f2f47884700 1 --2- 172.21.15.76:0/3329911269 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2f40101990 0x7f2f401082b0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:28.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:28.425+0000 7f2f47884700 1 --2- 172.21.15.76:0/3329911269 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f400ffe80 0x7f2f401002a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:28.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:28.425+0000 7f2f47884700 1 --2- 172.21.15.76:0/3329911269 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2f40100fd0 0x7f2f40101450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:28.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:28.425+0000 7f2f47884700 1 -- 172.21.15.76:0/3329911269 >> 172.21.15.76:0/3329911269 conn(0x7f2f400fb3f0 msgr2=0x7f2f400fd830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:28.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:28.425+0000 7f2f47884700 1 -- 172.21.15.76:0/3329911269 shutdown_connections 2024-06-02T04:48:28.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:28.425+0000 7f2f47884700 1 -- 172.21.15.76:0/3329911269 wait complete. 2024-06-02T04:48:28.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:28.425+0000 7f2f47884700 1 Processor -- start 2024-06-02T04:48:28.430 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:28.425+0000 7f2f47884700 1 -- start start 2024-06-02T04:48:28.430 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:28.426+0000 7f2f47884700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2f400ffe80 0x7f2f40199160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:28.430 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:28.426+0000 7f2f47884700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2f40100fd0 0x7f2f401996a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:28.430 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:28.426+0000 7f2f47884700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f40101990 0x7f2f401a06c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:28.430 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:28.426+0000 7f2f47884700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f401a0c90 con 0x7f2f400ffe80 2024-06-02T04:48:28.430 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:28.426+0000 7f2f47884700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f401a0dd0 con 0x7f2f40100fd0 2024-06-02T04:48:28.430 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:28.426+0000 7f2f47884700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f401a0f60 con 0x7f2f40101990 2024-06-02T04:48:28.430 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:28.426+0000 7f2f45620700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2f400ffe80 0x7f2f40199160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:28.430 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:28.426+0000 7f2f45620700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2f400ffe80 0x7f2f40199160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:40788/0 (socket says 172.21.15.76:40788) 2024-06-02T04:48:28.431 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:28.426+0000 7f2f45620700 1 -- 172.21.15.76:0/1680204772 learned_addr learned my addr 172.21.15.76:0/1680204772 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:48:28.431 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:28.426+0000 7f2f44e1f700 1 --2- 172.21.15.76:0/1680204772 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2f40100fd0 0x7f2f401996a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:28.431 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:28.426+0000 7f2f45620700 1 -- 172.21.15.76:0/1680204772 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f40101990 msgr2=0x7f2f401a06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:28.431 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:28.426+0000 7f2f45620700 1 --2- 172.21.15.76:0/1680204772 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f40101990 0x7f2f401a06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:28.431 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:28.426+0000 7f2f45620700 1 -- 172.21.15.76:0/1680204772 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2f40100fd0 msgr2=0x7f2f401996a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:28.431 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:28.426+0000 7f2f45620700 1 --2- 172.21.15.76:0/1680204772 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2f40100fd0 0x7f2f401996a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:28.431 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:28.426+0000 7f2f45620700 1 -- 172.21.15.76:0/1680204772 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f38009d00 con 0x7f2f400ffe80 2024-06-02T04:48:28.431 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:28.426+0000 7f2f44e1f700 1 --2- 172.21.15.76:0/1680204772 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2f40100fd0 0x7f2f401996a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:48:28.431 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:28.426+0000 7f2f45620700 1 --2- 172.21.15.76:0/1680204772 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2f400ffe80 0x7f2f40199160 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f2f3000c920 tx=0x7f2f3000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:28.431 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:28.426+0000 7f2f367fc700 1 -- 172.21.15.76:0/1680204772 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f30007b00 con 0x7f2f400ffe80 2024-06-02T04:48:28.431 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:28.426+0000 7f2f367fc700 1 -- 172.21.15.76:0/1680204772 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2f30004cc0 con 0x7f2f400ffe80 2024-06-02T04:48:28.431 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:28.426+0000 7f2f47884700 1 -- 172.21.15.76:0/1680204772 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f401a1240 con 0x7f2f400ffe80 2024-06-02T04:48:28.432 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:28.426+0000 7f2f367fc700 1 -- 172.21.15.76:0/1680204772 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f30005590 con 0x7f2f400ffe80 2024-06-02T04:48:28.432 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:28.426+0000 7f2f47884700 1 -- 172.21.15.76:0/1680204772 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f401a17a0 con 0x7f2f400ffe80 2024-06-02T04:48:28.432 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:28.427+0000 7f2f47884700 1 -- 172.21.15.76:0/1680204772 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f40067460 con 0x7f2f400ffe80 2024-06-02T04:48:28.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:28.428+0000 7f2f367fc700 1 -- 172.21.15.76:0/1680204772 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f2f30004750 con 0x7f2f400ffe80 2024-06-02T04:48:28.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:28.429+0000 7f2f367fc700 1 --2- 172.21.15.76:0/1680204772 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f2f2c0a11a0 0x7f2f2c0a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:28.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:28.429+0000 7f2f44e1f700 1 --2- 172.21.15.76:0/1680204772 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f2f2c0a11a0 0x7f2f2c0a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:28.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:28.429+0000 7f2f367fc700 1 -- 172.21.15.76:0/1680204772 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f2f300cca60 con 0x7f2f400ffe80 2024-06-02T04:48:28.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:28.429+0000 7f2f44e1f700 1 --2- 172.21.15.76:0/1680204772 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f2f2c0a11a0 0x7f2f2c0a3660 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c005fd0 tx=0x7f2f3c005e20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:28.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:28.433+0000 7f2f367fc700 1 -- 172.21.15.76:0/1680204772 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f2f30096080 con 0x7f2f400ffe80 2024-06-02T04:48:28.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:28 smithi119 ceph-mon[46633]: mds.? [v2:172.21.15.192:6838/3978681402,v1:172.21.15.192:6839/3978681402] up:active 2024-06-02T04:48:28.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:28 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/969032831' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-06-02T04:48:28.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:28 smithi119 ceph-mon[46633]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-06-02T04:48:28.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:28 smithi119 ceph-mon[46633]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-06-02T04:48:28.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:28 smithi119 ceph-mon[46633]: Cluster is now healthy 2024-06-02T04:48:28.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:28 smithi119 ceph-mon[46633]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-06-02T04:48:28.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:28 smithi119 ceph-mon[46633]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:creating} 9 up:standby 2024-06-02T04:48:28.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:28 smithi119 ceph-mon[46633]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-06-02T04:48:28.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:28 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/1089328990' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-06-02T04:48:28.660 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:28.660+0000 7f2f47884700 1 -- 172.21.15.76:0/1680204772 --> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) v1 -- 0x7f2f400fd5e0 con 0x7f2f2c0a11a0 2024-06-02T04:48:28.666 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:28 smithi076 ceph-mon[42935]: mds.? [v2:172.21.15.192:6838/3978681402,v1:172.21.15.192:6839/3978681402] up:active 2024-06-02T04:48:28.666 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:28 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/969032831' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-06-02T04:48:28.666 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:28 smithi076 ceph-mon[42935]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-06-02T04:48:28.666 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:28 smithi076 ceph-mon[42935]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-06-02T04:48:28.666 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:28 smithi076 ceph-mon[42935]: Cluster is now healthy 2024-06-02T04:48:28.666 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:28 smithi076 ceph-mon[42935]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-06-02T04:48:28.666 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:28 smithi076 ceph-mon[42935]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:creating} 9 up:standby 2024-06-02T04:48:28.667 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:28 smithi076 ceph-mon[42935]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-06-02T04:48:28.667 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:28 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/1089328990' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-06-02T04:48:28.667 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Jun 02 04:48:28 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-x[43184]: 2024-06-02T04:48:28.665+0000 7fbe0dd1d700 -1 client.0 error registering admin socket command: (17) File exists 2024-06-02T04:48:28.667 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Jun 02 04:48:28 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-x[43184]: 2024-06-02T04:48:28.665+0000 7fbe0dd1d700 -1 client.0 error registering admin socket command: (17) File exists 2024-06-02T04:48:28.667 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Jun 02 04:48:28 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-x[43184]: 2024-06-02T04:48:28.665+0000 7fbe0dd1d700 -1 client.0 error registering admin socket command: (17) File exists 2024-06-02T04:48:28.667 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Jun 02 04:48:28 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-x[43184]: 2024-06-02T04:48:28.665+0000 7fbe0dd1d700 -1 client.0 error registering admin socket command: (17) File exists 2024-06-02T04:48:28.667 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Jun 02 04:48:28 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-x[43184]: 2024-06-02T04:48:28.665+0000 7fbe0dd1d700 -1 client.0 error registering admin socket command: (17) File exists 2024-06-02T04:48:28.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:28 smithi192 ceph-mon[47933]: mds.? [v2:172.21.15.192:6838/3978681402,v1:172.21.15.192:6839/3978681402] up:active 2024-06-02T04:48:28.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:28 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/969032831' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-06-02T04:48:28.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:28 smithi192 ceph-mon[47933]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-06-02T04:48:28.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:28 smithi192 ceph-mon[47933]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-06-02T04:48:28.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:28 smithi192 ceph-mon[47933]: Cluster is now healthy 2024-06-02T04:48:28.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:28 smithi192 ceph-mon[47933]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-06-02T04:48:28.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:28 smithi192 ceph-mon[47933]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:creating} 9 up:standby 2024-06-02T04:48:28.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:28 smithi192 ceph-mon[47933]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-06-02T04:48:28.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:28 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/1089328990' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-06-02T04:48:28.685 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:28.685+0000 7f2f367fc700 1 -- 172.21.15.76:0/1680204772 <== mgr.14152 v2:172.21.15.76:6800/2591353090 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f2f400fd5e0 con 0x7f2f2c0a11a0 2024-06-02T04:48:28.687 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:28.687+0000 7f2f47884700 1 -- 172.21.15.76:0/1680204772 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f2f2c0a11a0 msgr2=0x7f2f2c0a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:28.688 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:28.687+0000 7f2f47884700 1 --2- 172.21.15.76:0/1680204772 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f2f2c0a11a0 0x7f2f2c0a3660 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c005fd0 tx=0x7f2f3c005e20 comp rx=0 tx=0).stop 2024-06-02T04:48:28.688 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:28.687+0000 7f2f47884700 1 -- 172.21.15.76:0/1680204772 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2f400ffe80 msgr2=0x7f2f40199160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:28.688 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:28.687+0000 7f2f47884700 1 --2- 172.21.15.76:0/1680204772 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2f400ffe80 0x7f2f40199160 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f2f3000c920 tx=0x7f2f3000cce0 comp rx=0 tx=0).stop 2024-06-02T04:48:28.688 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:28.687+0000 7f2f47884700 1 -- 172.21.15.76:0/1680204772 shutdown_connections 2024-06-02T04:48:28.688 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:28.687+0000 7f2f47884700 1 --2- 172.21.15.76:0/1680204772 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f40101990 0x7f2f401a06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:28.688 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:28.687+0000 7f2f47884700 1 --2- 172.21.15.76:0/1680204772 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2f400ffe80 0x7f2f40199160 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:28.688 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:28.687+0000 7f2f47884700 1 --2- 172.21.15.76:0/1680204772 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f2f2c0a11a0 0x7f2f2c0a3660 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:28.688 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:28.687+0000 7f2f47884700 1 --2- 172.21.15.76:0/1680204772 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2f40100fd0 0x7f2f401996a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:28.688 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:28.687+0000 7f2f47884700 1 -- 172.21.15.76:0/1680204772 >> 172.21.15.76:0/1680204772 conn(0x7f2f400fb3f0 msgr2=0x7f2f400fced0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:28.688 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:28.687+0000 7f2f47884700 1 -- 172.21.15.76:0/1680204772 shutdown_connections 2024-06-02T04:48:28.688 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:28.687+0000 7f2f47884700 1 -- 172.21.15.76:0/1680204772 wait complete. 2024-06-02T04:48:28.700 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_0 --group_name qa 2024-06-02T04:48:28.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:28.827+0000 7fb5d47ba700 1 -- 172.21.15.76:0/2785608265 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb5cc102170 msgr2=0x7fb5cc1025d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:28.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:28.827+0000 7fb5d47ba700 1 --2- 172.21.15.76:0/2785608265 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb5cc102170 0x7fb5cc1025d0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc0099c0 tx=0x7fb5bc009cd0 comp rx=0 tx=0).stop 2024-06-02T04:48:28.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:28.828+0000 7fb5d47ba700 1 -- 172.21.15.76:0/2785608265 shutdown_connections 2024-06-02T04:48:28.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:28.828+0000 7fb5d47ba700 1 --2- 172.21.15.76:0/2785608265 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb5cc102b10 0x7fb5cc1093c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:28.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:28.828+0000 7fb5d47ba700 1 --2- 172.21.15.76:0/2785608265 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5cc100f80 0x7fb5cc1013a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:28.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:28.828+0000 7fb5d47ba700 1 --2- 172.21.15.76:0/2785608265 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb5cc102170 0x7fb5cc1025d0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:28.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:28.828+0000 7fb5d47ba700 1 -- 172.21.15.76:0/2785608265 >> 172.21.15.76:0/2785608265 conn(0x7fb5cc0fc4f0 msgr2=0x7fb5cc0fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:28.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:28.828+0000 7fb5d47ba700 1 -- 172.21.15.76:0/2785608265 shutdown_connections 2024-06-02T04:48:28.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:28.828+0000 7fb5d47ba700 1 -- 172.21.15.76:0/2785608265 wait complete. 2024-06-02T04:48:28.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:28.828+0000 7fb5d47ba700 1 Processor -- start 2024-06-02T04:48:28.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:28.828+0000 7fb5d47ba700 1 -- start start 2024-06-02T04:48:28.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:28.828+0000 7fb5d47ba700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5cc100f80 0x7fb5cc196d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:28.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:28.828+0000 7fb5d47ba700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb5cc102170 0x7fb5cc197290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:28.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:28.828+0000 7fb5d47ba700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb5cc102b10 0x7fb5cc19e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:28.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:28.828+0000 7fb5d47ba700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5cc19e840 con 0x7fb5cc102170 2024-06-02T04:48:28.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:28.828+0000 7fb5d47ba700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5cc19e9b0 con 0x7fb5cc100f80 2024-06-02T04:48:28.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:28.828+0000 7fb5d47ba700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5cc19eb70 con 0x7fb5cc102b10 2024-06-02T04:48:28.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:28.829+0000 7fb5d1d55700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb5cc102170 0x7fb5cc197290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:28.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:28.829+0000 7fb5d1d55700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb5cc102170 0x7fb5cc197290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:40826/0 (socket says 172.21.15.76:40826) 2024-06-02T04:48:28.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:28.829+0000 7fb5d1d55700 1 -- 172.21.15.76:0/2702080075 learned_addr learned my addr 172.21.15.76:0/2702080075 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:48:28.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:28.829+0000 7fb5d2556700 1 --2- 172.21.15.76:0/2702080075 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5cc100f80 0x7fb5cc196d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:28.832 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:28.829+0000 7fb5d2d57700 1 --2- 172.21.15.76:0/2702080075 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb5cc102b10 0x7fb5cc19e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:28.832 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:28.829+0000 7fb5d1d55700 1 -- 172.21.15.76:0/2702080075 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb5cc102b10 msgr2=0x7fb5cc19e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:28.832 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:28.829+0000 7fb5d1d55700 1 --2- 172.21.15.76:0/2702080075 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb5cc102b10 0x7fb5cc19e270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:28.832 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:28.829+0000 7fb5d1d55700 1 -- 172.21.15.76:0/2702080075 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5cc100f80 msgr2=0x7fb5cc196d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:28.832 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:28.829+0000 7fb5d1d55700 1 --2- 172.21.15.76:0/2702080075 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5cc100f80 0x7fb5cc196d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:28.832 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:28.829+0000 7fb5d1d55700 1 -- 172.21.15.76:0/2702080075 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5bc0095f0 con 0x7fb5cc102170 2024-06-02T04:48:28.832 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:28.829+0000 7fb5d1d55700 1 --2- 172.21.15.76:0/2702080075 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb5cc102170 0x7fb5cc197290 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc000c00 tx=0x7fb5bc003a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:28.832 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:28.829+0000 7fb5c37fe700 1 -- 172.21.15.76:0/2702080075 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5bc01d070 con 0x7fb5cc102170 2024-06-02T04:48:28.832 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:28.829+0000 7fb5c37fe700 1 -- 172.21.15.76:0/2702080075 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb5bc00bd30 con 0x7fb5cc102170 2024-06-02T04:48:28.832 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:28.829+0000 7fb5d47ba700 1 -- 172.21.15.76:0/2702080075 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5cc19edf0 con 0x7fb5cc102170 2024-06-02T04:48:28.832 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:28.829+0000 7fb5c37fe700 1 -- 172.21.15.76:0/2702080075 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5bc022d20 con 0x7fb5cc102170 2024-06-02T04:48:28.832 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:28.829+0000 7fb5d47ba700 1 -- 172.21.15.76:0/2702080075 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5cc19f1c0 con 0x7fb5cc102170 2024-06-02T04:48:28.833 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:28.830+0000 7fb5d47ba700 1 -- 172.21.15.76:0/2702080075 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5cc108400 con 0x7fb5cc102170 2024-06-02T04:48:28.833 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:28.831+0000 7fb5c37fe700 1 -- 172.21.15.76:0/2702080075 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fb5bc003f40 con 0x7fb5cc102170 2024-06-02T04:48:28.833 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:28.832+0000 7fb5c37fe700 1 --2- 172.21.15.76:0/2702080075 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fb5b80a1220 0x7fb5b80a36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:28.833 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:28.832+0000 7fb5d2556700 1 --2- 172.21.15.76:0/2702080075 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fb5b80a1220 0x7fb5b80a36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:28.834 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:28.832+0000 7fb5c37fe700 1 -- 172.21.15.76:0/2702080075 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fb5bc0ce760 con 0x7fb5cc102170 2024-06-02T04:48:28.834 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:28.832+0000 7fb5d2556700 1 --2- 172.21.15.76:0/2702080075 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fb5b80a1220 0x7fb5b80a36e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc1981d0 tx=0x7fb5c800a3b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:28.836 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:28.836+0000 7fb5c37fe700 1 -- 172.21.15.76:0/2702080075 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fb5bc097d30 con 0x7fb5cc102170 2024-06-02T04:48:29.065 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.065+0000 7fb5d47ba700 1 -- 172.21.15.76:0/2702080075 --> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) v1 -- 0x7fb5cc0613e0 con 0x7fb5b80a1220 2024-06-02T04:48:29.087 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.087+0000 7fb5c37fe700 1 -- 172.21.15.76:0/2702080075 <== mgr.14152 v2:172.21.15.76:6800/2591353090 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fb5cc0613e0 con 0x7fb5b80a1220 2024-06-02T04:48:29.089 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.089+0000 7fb5d47ba700 1 -- 172.21.15.76:0/2702080075 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fb5b80a1220 msgr2=0x7fb5b80a36e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:29.089 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.089+0000 7fb5d47ba700 1 --2- 172.21.15.76:0/2702080075 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fb5b80a1220 0x7fb5b80a36e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc1981d0 tx=0x7fb5c800a3b0 comp rx=0 tx=0).stop 2024-06-02T04:48:29.089 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.089+0000 7fb5d47ba700 1 -- 172.21.15.76:0/2702080075 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb5cc102170 msgr2=0x7fb5cc197290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:29.090 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.089+0000 7fb5d47ba700 1 --2- 172.21.15.76:0/2702080075 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb5cc102170 0x7fb5cc197290 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc000c00 tx=0x7fb5bc003a50 comp rx=0 tx=0).stop 2024-06-02T04:48:29.090 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.089+0000 7fb5d47ba700 1 -- 172.21.15.76:0/2702080075 shutdown_connections 2024-06-02T04:48:29.090 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.089+0000 7fb5d47ba700 1 --2- 172.21.15.76:0/2702080075 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb5cc102b10 0x7fb5cc19e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:29.090 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.089+0000 7fb5d47ba700 1 --2- 172.21.15.76:0/2702080075 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fb5b80a1220 0x7fb5b80a36e0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:29.090 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.089+0000 7fb5d47ba700 1 --2- 172.21.15.76:0/2702080075 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5cc100f80 0x7fb5cc196d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:29.090 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.089+0000 7fb5d47ba700 1 --2- 172.21.15.76:0/2702080075 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb5cc102170 0x7fb5cc197290 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:29.090 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.089+0000 7fb5d47ba700 1 -- 172.21.15.76:0/2702080075 >> 172.21.15.76:0/2702080075 conn(0x7fb5cc0fc4f0 msgr2=0x7fb5cc105540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:29.090 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.089+0000 7fb5d47ba700 1 -- 172.21.15.76:0/2702080075 shutdown_connections 2024-06-02T04:48:29.090 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.089+0000 7fb5d47ba700 1 -- 172.21.15.76:0/2702080075 wait complete. 2024-06-02T04:48:29.101 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-06-02T04:48:29.231 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.229+0000 7efdcb566700 1 -- 172.21.15.76:0/1790055 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efdc4100f80 msgr2=0x7efdc41013a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:29.231 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.229+0000 7efdcb566700 1 --2- 172.21.15.76:0/1790055 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efdc4100f80 0x7efdc41013a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7efdb400b0d0 tx=0x7efdb400b3e0 comp rx=0 tx=0).stop 2024-06-02T04:48:29.231 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.229+0000 7efdcb566700 1 -- 172.21.15.76:0/1790055 shutdown_connections 2024-06-02T04:48:29.232 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.229+0000 7efdcb566700 1 --2- 172.21.15.76:0/1790055 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efdc4102b10 0x7efdc41093c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:29.232 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.229+0000 7efdcb566700 1 --2- 172.21.15.76:0/1790055 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efdc4100f80 0x7efdc41013a0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:29.232 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.229+0000 7efdcb566700 1 --2- 172.21.15.76:0/1790055 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efdc4102170 0x7efdc41025d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:29.232 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.229+0000 7efdcb566700 1 -- 172.21.15.76:0/1790055 >> 172.21.15.76:0/1790055 conn(0x7efdc40fc4f0 msgr2=0x7efdc40fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:29.232 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.229+0000 7efdcb566700 1 -- 172.21.15.76:0/1790055 shutdown_connections 2024-06-02T04:48:29.232 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.229+0000 7efdcb566700 1 -- 172.21.15.76:0/1790055 wait complete. 2024-06-02T04:48:29.232 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.230+0000 7efdcb566700 1 Processor -- start 2024-06-02T04:48:29.232 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.230+0000 7efdcb566700 1 -- start start 2024-06-02T04:48:29.232 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.230+0000 7efdcb566700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efdc4100f80 0x7efdc4074d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:29.232 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.230+0000 7efdcb566700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efdc4102170 0x7efdc4073390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:29.232 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.230+0000 7efdcb566700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efdc4102b10 0x7efdc40738d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:29.232 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.230+0000 7efdcb566700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdc4074070 con 0x7efdc4102b10 2024-06-02T04:48:29.232 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.230+0000 7efdcb566700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdc40741e0 con 0x7efdc4102170 2024-06-02T04:48:29.233 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.230+0000 7efdcb566700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdc41a0fc0 con 0x7efdc4100f80 2024-06-02T04:48:29.233 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.230+0000 7efdc9b03700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efdc4102b10 0x7efdc40738d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:29.233 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.230+0000 7efdc9b03700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efdc4102b10 0x7efdc40738d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:40858/0 (socket says 172.21.15.76:40858) 2024-06-02T04:48:29.233 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.230+0000 7efdc9b03700 1 -- 172.21.15.76:0/3235285739 learned_addr learned my addr 172.21.15.76:0/3235285739 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:48:29.233 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.230+0000 7efdc9302700 1 --2- 172.21.15.76:0/3235285739 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efdc4100f80 0x7efdc4074d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:29.233 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.230+0000 7efdc8b01700 1 --2- 172.21.15.76:0/3235285739 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efdc4102170 0x7efdc4073390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:29.233 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.230+0000 7efdc9b03700 1 -- 172.21.15.76:0/3235285739 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efdc4100f80 msgr2=0x7efdc4074d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:29.233 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.230+0000 7efdc9b03700 1 --2- 172.21.15.76:0/3235285739 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efdc4100f80 0x7efdc4074d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:29.233 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.230+0000 7efdc9b03700 1 -- 172.21.15.76:0/3235285739 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efdc4102170 msgr2=0x7efdc4073390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:29.233 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.230+0000 7efdc9b03700 1 --2- 172.21.15.76:0/3235285739 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efdc4102170 0x7efdc4073390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:29.233 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.230+0000 7efdc9b03700 1 -- 172.21.15.76:0/3235285739 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdb4009d00 con 0x7efdc4102b10 2024-06-02T04:48:29.233 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.231+0000 7efdc9b03700 1 --2- 172.21.15.76:0/3235285739 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efdc4102b10 0x7efdc40738d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7efdbc00d980 tx=0x7efdbc00dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:29.233 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.231+0000 7efdc27fc700 1 -- 172.21.15.76:0/3235285739 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdbc0098e0 con 0x7efdc4102b10 2024-06-02T04:48:29.233 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.231+0000 7efdc27fc700 1 -- 172.21.15.76:0/3235285739 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efdbc004830 con 0x7efdc4102b10 2024-06-02T04:48:29.234 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.231+0000 7efdcb566700 1 -- 172.21.15.76:0/3235285739 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdc41a1250 con 0x7efdc4102b10 2024-06-02T04:48:29.234 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.231+0000 7efdc27fc700 1 -- 172.21.15.76:0/3235285739 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdbc005380 con 0x7efdc4102b10 2024-06-02T04:48:29.234 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.231+0000 7efdcb566700 1 -- 172.21.15.76:0/3235285739 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdc41a1710 con 0x7efdc4102b10 2024-06-02T04:48:29.235 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.232+0000 7efdcb566700 1 -- 172.21.15.76:0/3235285739 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdc41084a0 con 0x7efdc4102b10 2024-06-02T04:48:29.235 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.233+0000 7efdc27fc700 1 -- 172.21.15.76:0/3235285739 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7efdbc0049a0 con 0x7efdc4102b10 2024-06-02T04:48:29.235 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.233+0000 7efdc27fc700 1 --2- 172.21.15.76:0/3235285739 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7efdac0a1120 0x7efdac0a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:29.235 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.233+0000 7efdc27fc700 1 -- 172.21.15.76:0/3235285739 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 8730+0+0 (secure 0 0 0) 0x7efdbc0cce60 con 0x7efdc4102b10 2024-06-02T04:48:29.235 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.233+0000 7efdc9302700 1 --2- 172.21.15.76:0/3235285739 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7efdac0a1120 0x7efdac0a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:29.235 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.234+0000 7efdc9302700 1 --2- 172.21.15.76:0/3235285739 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7efdac0a1120 0x7efdac0a35e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7efdb4007a30 tx=0x7efdb400b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:29.237 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.237+0000 7efdc27fc700 1 -- 172.21.15.76:0/3235285739 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7efdbc096400 con 0x7efdc4102b10 2024-06-02T04:48:29.473 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.473+0000 7efdcb566700 1 -- 172.21.15.76:0/3235285739 --> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) v1 -- 0x7efdc40613e0 con 0x7efdac0a1120 2024-06-02T04:48:29.478 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.478+0000 7efdc27fc700 1 -- 172.21.15.76:0/3235285739 <== mgr.14152 v2:172.21.15.76:6800/2591353090 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+54 (secure 0 0 0) 0x7efdc40613e0 con 0x7efdac0a1120 2024-06-02T04:48:29.478 INFO:teuthology.orchestra.run.smithi076.stdout:/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e 2024-06-02T04:48:29.480 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.480+0000 7efdcb566700 1 -- 172.21.15.76:0/3235285739 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7efdac0a1120 msgr2=0x7efdac0a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:29.480 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.480+0000 7efdcb566700 1 --2- 172.21.15.76:0/3235285739 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7efdac0a1120 0x7efdac0a35e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7efdb4007a30 tx=0x7efdb400b040 comp rx=0 tx=0).stop 2024-06-02T04:48:29.480 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.480+0000 7efdcb566700 1 -- 172.21.15.76:0/3235285739 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efdc4102b10 msgr2=0x7efdc40738d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:29.480 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.480+0000 7efdcb566700 1 --2- 172.21.15.76:0/3235285739 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efdc4102b10 0x7efdc40738d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7efdbc00d980 tx=0x7efdbc00dd40 comp rx=0 tx=0).stop 2024-06-02T04:48:29.480 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.480+0000 7efdcb566700 1 -- 172.21.15.76:0/3235285739 shutdown_connections 2024-06-02T04:48:29.480 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.480+0000 7efdcb566700 1 --2- 172.21.15.76:0/3235285739 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efdc4102b10 0x7efdc40738d0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:29.480 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.480+0000 7efdcb566700 1 --2- 172.21.15.76:0/3235285739 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efdc4100f80 0x7efdc4074d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:29.481 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.480+0000 7efdcb566700 1 --2- 172.21.15.76:0/3235285739 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7efdac0a1120 0x7efdac0a35e0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:29.481 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.480+0000 7efdcb566700 1 --2- 172.21.15.76:0/3235285739 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efdc4102170 0x7efdc4073390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:29.481 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.480+0000 7efdcb566700 1 -- 172.21.15.76:0/3235285739 >> 172.21.15.76:0/3235285739 conn(0x7efdc40fc4f0 msgr2=0x7efdc41055e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:29.481 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.480+0000 7efdcb566700 1 -- 172.21.15.76:0/3235285739 shutdown_connections 2024-06-02T04:48:29.481 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.480+0000 7efdcb566700 1 -- 172.21.15.76:0/3235285739 wait complete. 2024-06-02T04:48:29.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:29 smithi076 ceph-mon[42935]: pgmap v231: 129 pgs: 129 active+clean; 582 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 2 op/s 2024-06-02T04:48:29.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:29 smithi076 ceph-mon[42935]: mds.? [v2:172.21.15.192:6836/960773710,v1:172.21.15.192:6837/960773710] up:active 2024-06-02T04:48:29.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:29 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/1089328990' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-06-02T04:48:29.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:29 smithi076 ceph-mon[42935]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 9 up:standby 2024-06-02T04:48:29.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:29 smithi076 ceph-mon[42935]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-06-02T04:48:29.492 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_1 --group_name qa 2024-06-02T04:48:29.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:29 smithi119 ceph-mon[46633]: pgmap v231: 129 pgs: 129 active+clean; 582 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 2 op/s 2024-06-02T04:48:29.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:29 smithi119 ceph-mon[46633]: mds.? [v2:172.21.15.192:6836/960773710,v1:172.21.15.192:6837/960773710] up:active 2024-06-02T04:48:29.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:29 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/1089328990' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-06-02T04:48:29.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:29 smithi119 ceph-mon[46633]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 9 up:standby 2024-06-02T04:48:29.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:29 smithi119 ceph-mon[46633]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-06-02T04:48:29.623 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.620+0000 7f2ab1264700 1 -- 172.21.15.76:0/3623217847 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2aac101980 msgr2=0x7f2aac1082a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:29.623 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.620+0000 7f2ab1264700 1 --2- 172.21.15.76:0/3623217847 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2aac101980 0x7f2aac1082a0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f2aa400b0a0 tx=0x7f2aa400b3b0 comp rx=0 tx=0).stop 2024-06-02T04:48:29.623 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.620+0000 7f2ab1264700 1 -- 172.21.15.76:0/3623217847 shutdown_connections 2024-06-02T04:48:29.623 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.620+0000 7f2ab1264700 1 --2- 172.21.15.76:0/3623217847 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2aac101980 0x7f2aac1082a0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:29.623 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.620+0000 7f2ab1264700 1 --2- 172.21.15.76:0/3623217847 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2aac0ffe70 0x7f2aac100290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:29.623 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.620+0000 7f2ab1264700 1 --2- 172.21.15.76:0/3623217847 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2aac100fc0 0x7f2aac101440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:29.623 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.620+0000 7f2ab1264700 1 -- 172.21.15.76:0/3623217847 >> 172.21.15.76:0/3623217847 conn(0x7f2aac0fb3e0 msgr2=0x7f2aac0fd820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:29.623 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.620+0000 7f2ab1264700 1 -- 172.21.15.76:0/3623217847 shutdown_connections 2024-06-02T04:48:29.623 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.620+0000 7f2ab1264700 1 -- 172.21.15.76:0/3623217847 wait complete. 2024-06-02T04:48:29.623 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.621+0000 7f2ab1264700 1 Processor -- start 2024-06-02T04:48:29.624 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.621+0000 7f2ab1264700 1 -- start start 2024-06-02T04:48:29.624 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.621+0000 7f2ab1264700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2aac0ffe70 0x7f2aac06a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:29.624 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.621+0000 7f2ab1264700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2aac100fc0 0x7f2aac19bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:29.624 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.621+0000 7f2ab1264700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2aac101980 0x7f2aac19e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:29.624 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.621+0000 7f2ab1264700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aac19e9d0 con 0x7f2aac0ffe70 2024-06-02T04:48:29.624 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.621+0000 7f2ab1264700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aac19eb40 con 0x7f2aac101980 2024-06-02T04:48:29.624 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.621+0000 7f2ab1264700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aac19ed00 con 0x7f2aac100fc0 2024-06-02T04:48:29.624 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.621+0000 7f2aaaffd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2aac0ffe70 0x7f2aac06a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:29.624 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.621+0000 7f2aaaffd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2aac0ffe70 0x7f2aac06a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:40872/0 (socket says 172.21.15.76:40872) 2024-06-02T04:48:29.624 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.621+0000 7f2aaaffd700 1 -- 172.21.15.76:0/711138727 learned_addr learned my addr 172.21.15.76:0/711138727 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:48:29.624 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.622+0000 7f2aab7fe700 1 --2- 172.21.15.76:0/711138727 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2aac101980 0x7f2aac19e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:29.624 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.622+0000 7f2aaaffd700 1 -- 172.21.15.76:0/711138727 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2aac100fc0 msgr2=0x7f2aac19bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:29.624 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.622+0000 7f2aaa7fc700 1 --2- 172.21.15.76:0/711138727 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2aac100fc0 0x7f2aac19bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:29.625 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.622+0000 7f2aaaffd700 1 --2- 172.21.15.76:0/711138727 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2aac100fc0 0x7f2aac19bbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:29.625 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.622+0000 7f2aaaffd700 1 -- 172.21.15.76:0/711138727 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2aac101980 msgr2=0x7f2aac19e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:29.625 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.622+0000 7f2aaaffd700 1 --2- 172.21.15.76:0/711138727 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2aac101980 0x7f2aac19e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:29.625 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.622+0000 7f2aaaffd700 1 -- 172.21.15.76:0/711138727 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aa4009d00 con 0x7f2aac0ffe70 2024-06-02T04:48:29.625 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.622+0000 7f2aaaffd700 1 --2- 172.21.15.76:0/711138727 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2aac0ffe70 0x7f2aac06a010 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f2a9c00c920 tx=0x7f2a9c00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:29.625 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.622+0000 7f2a93fff700 1 -- 172.21.15.76:0/711138727 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a9c007b00 con 0x7f2aac0ffe70 2024-06-02T04:48:29.625 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.622+0000 7f2a93fff700 1 -- 172.21.15.76:0/711138727 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2a9c00ce70 con 0x7f2aac0ffe70 2024-06-02T04:48:29.625 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.622+0000 7f2ab1264700 1 -- 172.21.15.76:0/711138727 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2aac19ef80 con 0x7f2aac0ffe70 2024-06-02T04:48:29.625 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.622+0000 7f2a93fff700 1 -- 172.21.15.76:0/711138727 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a9c005440 con 0x7f2aac0ffe70 2024-06-02T04:48:29.625 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.622+0000 7f2ab1264700 1 -- 172.21.15.76:0/711138727 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2aac19f3a0 con 0x7f2aac0ffe70 2024-06-02T04:48:29.626 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.623+0000 7f2ab1264700 1 -- 172.21.15.76:0/711138727 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2aac107290 con 0x7f2aac0ffe70 2024-06-02T04:48:29.626 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.624+0000 7f2a93fff700 1 -- 172.21.15.76:0/711138727 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f2a9c0055a0 con 0x7f2aac0ffe70 2024-06-02T04:48:29.626 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.625+0000 7f2a93fff700 1 --2- 172.21.15.76:0/711138727 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f2a940a11a0 0x7f2a940a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:29.626 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.625+0000 7f2aaa7fc700 1 --2- 172.21.15.76:0/711138727 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f2a940a11a0 0x7f2a940a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:29.626 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.625+0000 7f2a93fff700 1 -- 172.21.15.76:0/711138727 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f2a9c0cc710 con 0x7f2aac0ffe70 2024-06-02T04:48:29.626 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.625+0000 7f2aaa7fc700 1 --2- 172.21.15.76:0/711138727 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f2a940a11a0 0x7f2a940a3660 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2aa0005950 tx=0x7f2aa00058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:29.629 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.629+0000 7f2a93fff700 1 -- 172.21.15.76:0/711138727 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f2a9c095c50 con 0x7f2aac0ffe70 2024-06-02T04:48:29.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:29 smithi192 ceph-mon[47933]: pgmap v231: 129 pgs: 129 active+clean; 582 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 2 op/s 2024-06-02T04:48:29.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:29 smithi192 ceph-mon[47933]: mds.? [v2:172.21.15.192:6836/960773710,v1:172.21.15.192:6837/960773710] up:active 2024-06-02T04:48:29.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:29 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/1089328990' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-06-02T04:48:29.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:29 smithi192 ceph-mon[47933]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 9 up:standby 2024-06-02T04:48:29.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:29 smithi192 ceph-mon[47933]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-06-02T04:48:29.866 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.865+0000 7f2ab1264700 1 -- 172.21.15.76:0/711138727 --> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) v1 -- 0x7f2aac02ceb0 con 0x7f2a940a11a0 2024-06-02T04:48:29.888 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.888+0000 7f2a93fff700 1 -- 172.21.15.76:0/711138727 <== mgr.14152 v2:172.21.15.76:6800/2591353090 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f2aac02ceb0 con 0x7f2a940a11a0 2024-06-02T04:48:29.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.890+0000 7f2ab1264700 1 -- 172.21.15.76:0/711138727 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f2a940a11a0 msgr2=0x7f2a940a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:29.891 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.890+0000 7f2ab1264700 1 --2- 172.21.15.76:0/711138727 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f2a940a11a0 0x7f2a940a3660 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2aa0005950 tx=0x7f2aa00058e0 comp rx=0 tx=0).stop 2024-06-02T04:48:29.891 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.890+0000 7f2ab1264700 1 -- 172.21.15.76:0/711138727 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2aac0ffe70 msgr2=0x7f2aac06a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:29.891 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.890+0000 7f2ab1264700 1 --2- 172.21.15.76:0/711138727 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2aac0ffe70 0x7f2aac06a010 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f2a9c00c920 tx=0x7f2a9c00cc30 comp rx=0 tx=0).stop 2024-06-02T04:48:29.891 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.890+0000 7f2ab1264700 1 -- 172.21.15.76:0/711138727 shutdown_connections 2024-06-02T04:48:29.891 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.890+0000 7f2ab1264700 1 --2- 172.21.15.76:0/711138727 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f2a940a11a0 0x7f2a940a3660 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:29.891 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.890+0000 7f2ab1264700 1 --2- 172.21.15.76:0/711138727 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2aac101980 0x7f2aac19e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:29.891 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.890+0000 7f2ab1264700 1 --2- 172.21.15.76:0/711138727 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2aac0ffe70 0x7f2aac06a010 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:29.891 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.890+0000 7f2ab1264700 1 --2- 172.21.15.76:0/711138727 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2aac100fc0 0x7f2aac19bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:29.891 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.890+0000 7f2ab1264700 1 -- 172.21.15.76:0/711138727 >> 172.21.15.76:0/711138727 conn(0x7f2aac0fb3e0 msgr2=0x7f2aac1043d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:29.891 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.890+0000 7f2ab1264700 1 -- 172.21.15.76:0/711138727 shutdown_connections 2024-06-02T04:48:29.891 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:29.890+0000 7f2ab1264700 1 -- 172.21.15.76:0/711138727 wait complete. 2024-06-02T04:48:29.903 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-06-02T04:48:30.030 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.030+0000 7f427323a700 1 -- 172.21.15.76:0/1279997171 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f426c0ffe60 msgr2=0x7f426c100280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:30.031 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.030+0000 7f427323a700 1 --2- 172.21.15.76:0/1279997171 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f426c0ffe60 0x7f426c100280 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f4260009990 tx=0x7f4260009ca0 comp rx=0 tx=0).stop 2024-06-02T04:48:30.031 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.030+0000 7f427323a700 1 -- 172.21.15.76:0/1279997171 shutdown_connections 2024-06-02T04:48:30.031 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.030+0000 7f427323a700 1 --2- 172.21.15.76:0/1279997171 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f426c101970 0x7f426c108290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:30.031 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.030+0000 7f427323a700 1 --2- 172.21.15.76:0/1279997171 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f426c0ffe60 0x7f426c100280 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:30.031 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.030+0000 7f427323a700 1 --2- 172.21.15.76:0/1279997171 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f426c100fb0 0x7f426c101430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:30.031 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.030+0000 7f427323a700 1 -- 172.21.15.76:0/1279997171 >> 172.21.15.76:0/1279997171 conn(0x7f426c0fb3f0 msgr2=0x7f426c0fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:30.031 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.030+0000 7f427323a700 1 -- 172.21.15.76:0/1279997171 shutdown_connections 2024-06-02T04:48:30.031 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.030+0000 7f427323a700 1 -- 172.21.15.76:0/1279997171 wait complete. 2024-06-02T04:48:30.033 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.031+0000 7f427323a700 1 Processor -- start 2024-06-02T04:48:30.033 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.031+0000 7f427323a700 1 -- start start 2024-06-02T04:48:30.033 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.031+0000 7f427323a700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f426c0ffe60 0x7f426c068b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:30.034 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.031+0000 7f427323a700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f426c100fb0 0x7f426c19bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:30.034 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.031+0000 7f427323a700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f426c101970 0x7f426c19e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:30.034 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.031+0000 7f427323a700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f426c19e860 con 0x7f426c0ffe60 2024-06-02T04:48:30.034 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.031+0000 7f427323a700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f426c19e9d0 con 0x7f426c101970 2024-06-02T04:48:30.034 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.031+0000 7f427323a700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f426c19eb90 con 0x7f426c100fb0 2024-06-02T04:48:30.034 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.031+0000 7f4270fd6700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f426c0ffe60 0x7f426c068b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:30.034 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.031+0000 7f4270fd6700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f426c0ffe60 0x7f426c068b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:40884/0 (socket says 172.21.15.76:40884) 2024-06-02T04:48:30.034 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.031+0000 7f4270fd6700 1 -- 172.21.15.76:0/624864916 learned_addr learned my addr 172.21.15.76:0/624864916 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:48:30.034 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.031+0000 7f426bfff700 1 --2- 172.21.15.76:0/624864916 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f426c100fb0 0x7f426c19bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:30.034 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.031+0000 7f42717d7700 1 --2- 172.21.15.76:0/624864916 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f426c101970 0x7f426c19e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:30.034 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.031+0000 7f4270fd6700 1 -- 172.21.15.76:0/624864916 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f426c100fb0 msgr2=0x7f426c19bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:30.034 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.032+0000 7f4270fd6700 1 --2- 172.21.15.76:0/624864916 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f426c100fb0 0x7f426c19bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:30.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.032+0000 7f4270fd6700 1 -- 172.21.15.76:0/624864916 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f426c101970 msgr2=0x7f426c19e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:30.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.032+0000 7f4270fd6700 1 --2- 172.21.15.76:0/624864916 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f426c101970 0x7f426c19e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:30.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.032+0000 7f4270fd6700 1 -- 172.21.15.76:0/624864916 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42600095f0 con 0x7f426c0ffe60 2024-06-02T04:48:30.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.032+0000 7f4270fd6700 1 --2- 172.21.15.76:0/624864916 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f426c0ffe60 0x7f426c068b10 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f426000b5c0 tx=0x7f4260003a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:30.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.032+0000 7f4269ffb700 1 -- 172.21.15.76:0/624864916 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f426001d070 con 0x7f426c0ffe60 2024-06-02T04:48:30.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.032+0000 7f4269ffb700 1 -- 172.21.15.76:0/624864916 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f426000bd10 con 0x7f426c0ffe60 2024-06-02T04:48:30.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.032+0000 7f427323a700 1 -- 172.21.15.76:0/624864916 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f426c19ee10 con 0x7f426c0ffe60 2024-06-02T04:48:30.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.032+0000 7f4269ffb700 1 -- 172.21.15.76:0/624864916 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4260022d20 con 0x7f426c0ffe60 2024-06-02T04:48:30.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.032+0000 7f427323a700 1 -- 172.21.15.76:0/624864916 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f426c19f1d0 con 0x7f426c0ffe60 2024-06-02T04:48:30.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.033+0000 7f427323a700 1 -- 172.21.15.76:0/624864916 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f426c1072d0 con 0x7f426c0ffe60 2024-06-02T04:48:30.036 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.034+0000 7f4269ffb700 1 -- 172.21.15.76:0/624864916 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f4260003f40 con 0x7f426c0ffe60 2024-06-02T04:48:30.036 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.035+0000 7f4269ffb700 1 --2- 172.21.15.76:0/624864916 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f425c0a11a0 0x7f425c0a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:30.036 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.035+0000 7f426bfff700 1 --2- 172.21.15.76:0/624864916 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f425c0a11a0 0x7f425c0a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:30.036 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.035+0000 7f4269ffb700 1 -- 172.21.15.76:0/624864916 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f42600cdae0 con 0x7f426c0ffe60 2024-06-02T04:48:30.036 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.035+0000 7f426bfff700 1 --2- 172.21.15.76:0/624864916 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f425c0a11a0 0x7f425c0a3660 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f426c0690d0 tx=0x7f425800a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:30.040 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.039+0000 7f4269ffb700 1 -- 172.21.15.76:0/624864916 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f4260097110 con 0x7f426c0ffe60 2024-06-02T04:48:30.276 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.276+0000 7f427323a700 1 -- 172.21.15.76:0/624864916 --> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f426c067cc0 con 0x7f425c0a11a0 2024-06-02T04:48:30.280 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.280+0000 7f4269ffb700 1 -- 172.21.15.76:0/624864916 <== mgr.14152 v2:172.21.15.76:6800/2591353090 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+54 (secure 0 0 0) 0x7f426c067cc0 con 0x7f425c0a11a0 2024-06-02T04:48:30.280 INFO:teuthology.orchestra.run.smithi076.stdout:/volumes/qa/sv_1/7a7f1c83-a445-4057-89ce-5ad118779c28 2024-06-02T04:48:30.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.282+0000 7f427323a700 1 -- 172.21.15.76:0/624864916 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f425c0a11a0 msgr2=0x7f425c0a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:30.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.282+0000 7f427323a700 1 --2- 172.21.15.76:0/624864916 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f425c0a11a0 0x7f425c0a3660 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f426c0690d0 tx=0x7f425800a380 comp rx=0 tx=0).stop 2024-06-02T04:48:30.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.282+0000 7f427323a700 1 -- 172.21.15.76:0/624864916 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f426c0ffe60 msgr2=0x7f426c068b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:30.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.282+0000 7f427323a700 1 --2- 172.21.15.76:0/624864916 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f426c0ffe60 0x7f426c068b10 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f426000b5c0 tx=0x7f4260003a50 comp rx=0 tx=0).stop 2024-06-02T04:48:30.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.282+0000 7f427323a700 1 -- 172.21.15.76:0/624864916 shutdown_connections 2024-06-02T04:48:30.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.282+0000 7f427323a700 1 --2- 172.21.15.76:0/624864916 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f425c0a11a0 0x7f425c0a3660 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:30.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.282+0000 7f427323a700 1 --2- 172.21.15.76:0/624864916 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f426c101970 0x7f426c19e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:30.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.282+0000 7f427323a700 1 --2- 172.21.15.76:0/624864916 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f426c0ffe60 0x7f426c068b10 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:30.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.282+0000 7f427323a700 1 --2- 172.21.15.76:0/624864916 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f426c100fb0 0x7f426c19bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:30.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.282+0000 7f427323a700 1 -- 172.21.15.76:0/624864916 >> 172.21.15.76:0/624864916 conn(0x7f426c0fb3f0 msgr2=0x7f426c104410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:30.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.282+0000 7f427323a700 1 -- 172.21.15.76:0/624864916 shutdown_connections 2024-06-02T04:48:30.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.283+0000 7f427323a700 1 -- 172.21.15.76:0/624864916 wait complete. 2024-06-02T04:48:30.300 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T04:48:30.424 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.422+0000 7fb0e4e42700 1 -- 172.21.15.76:0/3261437702 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb0e0100f50 msgr2=0x7fb0e01013b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:30.424 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.422+0000 7fb0e4e42700 1 --2- 172.21.15.76:0/3261437702 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb0e0100f50 0x7fb0e01013b0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fb0c80099c0 tx=0x7fb0c8009cd0 comp rx=0 tx=0).stop 2024-06-02T04:48:30.424 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.422+0000 7fb0e4e42700 1 -- 172.21.15.76:0/3261437702 shutdown_connections 2024-06-02T04:48:30.424 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.422+0000 7fb0e4e42700 1 --2- 172.21.15.76:0/3261437702 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0e01018f0 0x7fb0e01081a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:30.425 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.422+0000 7fb0e4e42700 1 --2- 172.21.15.76:0/3261437702 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0e00ffd60 0x7fb0e0100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:30.425 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.422+0000 7fb0e4e42700 1 --2- 172.21.15.76:0/3261437702 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb0e0100f50 0x7fb0e01013b0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:30.425 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.422+0000 7fb0e4e42700 1 -- 172.21.15.76:0/3261437702 >> 172.21.15.76:0/3261437702 conn(0x7fb0e00fb2f0 msgr2=0x7fb0e00fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:30.425 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.422+0000 7fb0e4e42700 1 -- 172.21.15.76:0/3261437702 shutdown_connections 2024-06-02T04:48:30.425 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.422+0000 7fb0e4e42700 1 -- 172.21.15.76:0/3261437702 wait complete. 2024-06-02T04:48:30.425 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.423+0000 7fb0e4e42700 1 Processor -- start 2024-06-02T04:48:30.425 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.423+0000 7fb0e4e42700 1 -- start start 2024-06-02T04:48:30.425 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.423+0000 7fb0e4e42700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb0e00ffd60 0x7fb0e0196d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:30.425 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.423+0000 7fb0e4e42700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0e0100f50 0x7fb0e0197290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:30.425 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.423+0000 7fb0e4e42700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0e01018f0 0x7fb0e019e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:30.425 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.423+0000 7fb0e4e42700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e019e840 con 0x7fb0e00ffd60 2024-06-02T04:48:30.425 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.423+0000 7fb0e4e42700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e019e9b0 con 0x7fb0e0100f50 2024-06-02T04:48:30.426 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.423+0000 7fb0e4e42700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e019eb70 con 0x7fb0e01018f0 2024-06-02T04:48:30.426 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.423+0000 7fb0de59c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb0e00ffd60 0x7fb0e0196d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:30.426 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.423+0000 7fb0de59c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb0e00ffd60 0x7fb0e0196d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:40900/0 (socket says 172.21.15.76:40900) 2024-06-02T04:48:30.426 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.423+0000 7fb0de59c700 1 -- 172.21.15.76:0/2898032428 learned_addr learned my addr 172.21.15.76:0/2898032428 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:48:30.426 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.423+0000 7fb0ddd9b700 1 --2- 172.21.15.76:0/2898032428 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0e0100f50 0x7fb0e0197290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:30.426 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.423+0000 7fb0ded9d700 1 --2- 172.21.15.76:0/2898032428 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0e01018f0 0x7fb0e019e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:30.426 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.423+0000 7fb0de59c700 1 -- 172.21.15.76:0/2898032428 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0e01018f0 msgr2=0x7fb0e019e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:30.426 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.423+0000 7fb0de59c700 1 --2- 172.21.15.76:0/2898032428 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0e01018f0 0x7fb0e019e270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:30.426 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.423+0000 7fb0de59c700 1 -- 172.21.15.76:0/2898032428 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0e0100f50 msgr2=0x7fb0e0197290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:30.426 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.423+0000 7fb0de59c700 1 --2- 172.21.15.76:0/2898032428 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0e0100f50 0x7fb0e0197290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:30.426 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.423+0000 7fb0de59c700 1 -- 172.21.15.76:0/2898032428 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0c80095f0 con 0x7fb0e00ffd60 2024-06-02T04:48:30.426 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.423+0000 7fb0ddd9b700 1 --2- 172.21.15.76:0/2898032428 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0e0100f50 0x7fb0e0197290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:48:30.427 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.423+0000 7fb0de59c700 1 --2- 172.21.15.76:0/2898032428 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb0e00ffd60 0x7fb0e0196d50 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fb0d000d980 tx=0x7fb0d000dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:30.427 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.423+0000 7fb0d77fe700 1 -- 172.21.15.76:0/2898032428 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0d000de60 con 0x7fb0e00ffd60 2024-06-02T04:48:30.427 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.424+0000 7fb0e4e42700 1 -- 172.21.15.76:0/2898032428 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0e019ee50 con 0x7fb0e00ffd60 2024-06-02T04:48:30.427 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.424+0000 7fb0d77fe700 1 -- 172.21.15.76:0/2898032428 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb0d00044b0 con 0x7fb0e00ffd60 2024-06-02T04:48:30.427 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.424+0000 7fb0d77fe700 1 -- 172.21.15.76:0/2898032428 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0d0003b40 con 0x7fb0e00ffd60 2024-06-02T04:48:30.427 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.424+0000 7fb0e4e42700 1 -- 172.21.15.76:0/2898032428 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0e019f280 con 0x7fb0e00ffd60 2024-06-02T04:48:30.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.424+0000 7fb0e4e42700 1 -- 172.21.15.76:0/2898032428 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0e01071d0 con 0x7fb0e00ffd60 2024-06-02T04:48:30.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.425+0000 7fb0d77fe700 1 -- 172.21.15.76:0/2898032428 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fb0d0004870 con 0x7fb0e00ffd60 2024-06-02T04:48:30.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.426+0000 7fb0d77fe700 1 --2- 172.21.15.76:0/2898032428 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fb0cc0a11b0 0x7fb0cc0a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:30.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.426+0000 7fb0d77fe700 1 -- 172.21.15.76:0/2898032428 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fb0d00cccc0 con 0x7fb0e00ffd60 2024-06-02T04:48:30.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.426+0000 7fb0ddd9b700 1 --2- 172.21.15.76:0/2898032428 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fb0cc0a11b0 0x7fb0cc0a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:30.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.426+0000 7fb0ddd9b700 1 --2- 172.21.15.76:0/2898032428 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fb0cc0a11b0 0x7fb0cc0a3670 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb0c8003780 tx=0x7fb0c8000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:30.430 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.430+0000 7fb0d77fe700 1 -- 172.21.15.76:0/2898032428 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fb0d0096100 con 0x7fb0e00ffd60 2024-06-02T04:48:30.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:30 smithi119 ceph-mon[46633]: from='client.14868 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:48:30.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:30 smithi119 ceph-mon[46633]: from='client.14880 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:48:30.671 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.671+0000 7fb0e4e42700 1 -- 172.21.15.76:0/2898032428 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb0e0067c10 con 0x7fb0e00ffd60 2024-06-02T04:48:30.672 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.672+0000 7fb0d77fe700 1 -- 172.21.15.76:0/2898032428 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+10874 (secure 0 0 0) 0x7fb0d0009940 con 0x7fb0e00ffd60 2024-06-02T04:48:30.672 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:48:30.672 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6835/3029342152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3029342152},{"type":"v1","addr":"172.21.15.76:6835","nonce":3029342152}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6837/1207985317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":1207985317},{"type":"v1","addr":"172.21.15.76:6837","nonce":1207985317}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14607,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6839/928709755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":928709755},{"type":"v1","addr":"172.21.15.76:6839","nonce":928709755}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6841/4162178633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6840","nonce":4162178633},{"type":"v1","addr":"172.21.15.76:6841","nonce":4162178633}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/1543944863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":1543944863},{"type":"v1","addr":"172.21.15.119:6833","nonce":1543944863}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24418,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6833/1527921393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1527921393},{"type":"v1","addr":"172.21.15.192:6833","nonce":1527921393}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-02T04:48:02.662812+0000","modified":"2024-06-02T04:48:28.274836+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24491,"mds_1":24475,"mds_2":24463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24434":{"gid":24434,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6835/2746840347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":2746840347},{"type":"v1","addr":"172.21.15.119:6835","nonce":2746840347}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24451":{"gid":24451,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.192:6835/783181340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":783181340},{"type":"v1","addr":"172.21.15.192:6835","nonce":783181340}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24458":{"gid":24458,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6837/2171687478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":2171687478},{"type":"v1","addr":"172.21.15.119:6837","nonce":2171687478}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24463":{"gid":24463,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":11,"addr":"172.21.15.192:6837/960773710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":960773710},{"type":"v1","addr":"172.21.15.192:6837","nonce":960773710}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24475":{"gid":24475,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.192:6839/3978681402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":3978681402},{"type":"v1","addr":"172.21.15.192:6839","nonce":3978681402}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.119:6839/4098406903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":4098406903},{"type":"v1","addr":"172.21.15.119:6839","nonce":4098406903}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-06-02T04:48:30.675 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.674+0000 7fb0e4e42700 1 -- 172.21.15.76:0/2898032428 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fb0cc0a11b0 msgr2=0x7fb0cc0a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:30.675 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.674+0000 7fb0e4e42700 1 --2- 172.21.15.76:0/2898032428 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fb0cc0a11b0 0x7fb0cc0a3670 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb0c8003780 tx=0x7fb0c8000bc0 comp rx=0 tx=0).stop 2024-06-02T04:48:30.675 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.674+0000 7fb0e4e42700 1 -- 172.21.15.76:0/2898032428 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb0e00ffd60 msgr2=0x7fb0e0196d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:30.675 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.674+0000 7fb0e4e42700 1 --2- 172.21.15.76:0/2898032428 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb0e00ffd60 0x7fb0e0196d50 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fb0d000d980 tx=0x7fb0d000dd40 comp rx=0 tx=0).stop 2024-06-02T04:48:30.675 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.674+0000 7fb0e4e42700 1 -- 172.21.15.76:0/2898032428 shutdown_connections 2024-06-02T04:48:30.675 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.674+0000 7fb0e4e42700 1 --2- 172.21.15.76:0/2898032428 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0e01018f0 0x7fb0e019e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:30.675 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.674+0000 7fb0e4e42700 1 --2- 172.21.15.76:0/2898032428 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb0e00ffd60 0x7fb0e0196d50 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:30.675 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.674+0000 7fb0e4e42700 1 --2- 172.21.15.76:0/2898032428 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fb0cc0a11b0 0x7fb0cc0a3670 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:30.676 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.674+0000 7fb0e4e42700 1 --2- 172.21.15.76:0/2898032428 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0e0100f50 0x7fb0e0197290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:30.676 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.674+0000 7fb0e4e42700 1 -- 172.21.15.76:0/2898032428 >> 172.21.15.76:0/2898032428 conn(0x7fb0e00fb2f0 msgr2=0x7fb0e0104310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:30.676 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.674+0000 7fb0e4e42700 1 -- 172.21.15.76:0/2898032428 shutdown_connections 2024-06-02T04:48:30.676 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.674+0000 7fb0e4e42700 1 -- 172.21.15.76:0/2898032428 wait complete. 2024-06-02T04:48:30.676 INFO:teuthology.orchestra.run.smithi076.stderr:dumped fsmap epoch 24 2024-06-02T04:48:30.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:30 smithi192 ceph-mon[47933]: from='client.14868 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:48:30.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:30 smithi192 ceph-mon[47933]: from='client.14880 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:48:30.686 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:30 smithi076 ceph-mon[42935]: from='client.14868 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:48:30.686 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:30 smithi076 ceph-mon[42935]: from='client.14880 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:48:30.688 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-02T04:48:30.813 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.812+0000 7fbe1e645700 1 -- 172.21.15.76:0/859460616 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbe180ffd60 msgr2=0x7fbe18100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:30.813 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.812+0000 7fbe1e645700 1 --2- 172.21.15.76:0/859460616 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbe180ffd60 0x7fbe18100180 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fbe080099c0 tx=0x7fbe08009cd0 comp rx=0 tx=0).stop 2024-06-02T04:48:30.813 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.812+0000 7fbe1e645700 1 -- 172.21.15.76:0/859460616 shutdown_connections 2024-06-02T04:48:30.813 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.812+0000 7fbe1e645700 1 --2- 172.21.15.76:0/859460616 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbe181018f0 0x7fbe181081a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:30.813 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.812+0000 7fbe1e645700 1 --2- 172.21.15.76:0/859460616 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbe180ffd60 0x7fbe18100180 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:30.813 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.812+0000 7fbe1e645700 1 --2- 172.21.15.76:0/859460616 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbe18100f50 0x7fbe181013b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:30.813 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.812+0000 7fbe1e645700 1 -- 172.21.15.76:0/859460616 >> 172.21.15.76:0/859460616 conn(0x7fbe180fb2f0 msgr2=0x7fbe180fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:30.813 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.812+0000 7fbe1e645700 1 -- 172.21.15.76:0/859460616 shutdown_connections 2024-06-02T04:48:30.813 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.812+0000 7fbe1e645700 1 -- 172.21.15.76:0/859460616 wait complete. 2024-06-02T04:48:30.813 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.813+0000 7fbe1e645700 1 Processor -- start 2024-06-02T04:48:30.814 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.813+0000 7fbe1e645700 1 -- start start 2024-06-02T04:48:30.816 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.813+0000 7fbe1e645700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbe180ffd60 0x7fbe18195c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:30.816 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.813+0000 7fbe1e645700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbe18100f50 0x7fbe181961b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:30.816 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.813+0000 7fbe1e645700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbe181018f0 0x7fbe1819d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:30.816 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.813+0000 7fbe1e645700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe1819d760 con 0x7fbe180ffd60 2024-06-02T04:48:30.816 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.813+0000 7fbe1e645700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe1819d8d0 con 0x7fbe181018f0 2024-06-02T04:48:30.816 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.813+0000 7fbe1e645700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe1819da90 con 0x7fbe18100f50 2024-06-02T04:48:30.816 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.813+0000 7fbe17fff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbe180ffd60 0x7fbe18195c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:30.816 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.813+0000 7fbe17fff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbe180ffd60 0x7fbe18195c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:40920/0 (socket says 172.21.15.76:40920) 2024-06-02T04:48:30.817 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.813+0000 7fbe17fff700 1 -- 172.21.15.76:0/2909761295 learned_addr learned my addr 172.21.15.76:0/2909761295 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:48:30.817 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.813+0000 7fbe1cbe2700 1 --2- 172.21.15.76:0/2909761295 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbe181018f0 0x7fbe1819d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:30.817 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.813+0000 7fbe177fe700 1 --2- 172.21.15.76:0/2909761295 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbe18100f50 0x7fbe181961b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:30.817 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.813+0000 7fbe17fff700 1 -- 172.21.15.76:0/2909761295 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbe18100f50 msgr2=0x7fbe181961b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:30.817 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.813+0000 7fbe17fff700 1 --2- 172.21.15.76:0/2909761295 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbe18100f50 0x7fbe181961b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:30.817 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.813+0000 7fbe17fff700 1 -- 172.21.15.76:0/2909761295 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbe181018f0 msgr2=0x7fbe1819d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:30.817 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.813+0000 7fbe17fff700 1 --2- 172.21.15.76:0/2909761295 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbe181018f0 0x7fbe1819d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:30.817 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.813+0000 7fbe17fff700 1 -- 172.21.15.76:0/2909761295 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe080095f0 con 0x7fbe180ffd60 2024-06-02T04:48:30.817 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.814+0000 7fbe17fff700 1 --2- 172.21.15.76:0/2909761295 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbe180ffd60 0x7fbe18195c70 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fbe08009990 tx=0x7fbe0800fab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:30.817 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.814+0000 7fbe157fa700 1 -- 172.21.15.76:0/2909761295 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe0801d070 con 0x7fbe180ffd60 2024-06-02T04:48:30.817 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.814+0000 7fbe157fa700 1 -- 172.21.15.76:0/2909761295 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbe0800bd10 con 0x7fbe180ffd60 2024-06-02T04:48:30.817 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.814+0000 7fbe1e645700 1 -- 172.21.15.76:0/2909761295 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe1819dd10 con 0x7fbe180ffd60 2024-06-02T04:48:30.817 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.814+0000 7fbe157fa700 1 -- 172.21.15.76:0/2909761295 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe08017650 con 0x7fbe180ffd60 2024-06-02T04:48:30.818 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.814+0000 7fbe1e645700 1 -- 172.21.15.76:0/2909761295 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe1819e130 con 0x7fbe180ffd60 2024-06-02T04:48:30.818 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.815+0000 7fbe1e645700 1 -- 172.21.15.76:0/2909761295 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe181072a0 con 0x7fbe180ffd60 2024-06-02T04:48:30.818 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.816+0000 7fbe157fa700 1 -- 172.21.15.76:0/2909761295 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fbe08022470 con 0x7fbe180ffd60 2024-06-02T04:48:30.818 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.816+0000 7fbe157fa700 1 --2- 172.21.15.76:0/2909761295 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fbe040a11b0 0x7fbe040a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:30.819 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.816+0000 7fbe177fe700 1 --2- 172.21.15.76:0/2909761295 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fbe040a11b0 0x7fbe040a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:30.819 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.816+0000 7fbe157fa700 1 -- 172.21.15.76:0/2909761295 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fbe080cded0 con 0x7fbe180ffd60 2024-06-02T04:48:30.819 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.817+0000 7fbe177fe700 1 --2- 172.21.15.76:0/2909761295 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fbe040a11b0 0x7fbe040a3670 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fbe00009b30 tx=0x7fbe00009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:30.821 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:30.821+0000 7fbe157fa700 1 -- 172.21.15.76:0/2909761295 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fbe080973a0 con 0x7fbe180ffd60 2024-06-02T04:48:31.020 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.020+0000 7fbe1e645700 1 -- 172.21.15.76:0/2909761295 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbe18067c10 con 0x7fbe180ffd60 2024-06-02T04:48:31.022 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.022+0000 7fbe157fa700 1 -- 172.21.15.76:0/2909761295 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+23984 (secure 0 0 0) 0x7fbe0809a9c0 con 0x7fbe180ffd60 2024-06-02T04:48:31.022 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:48:31.022 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":80,"fsid":"60ab6d30-209a-11ef-bc9b-c7b262605968","created":"2024-06-02T04:42:21.007333+0000","modified":"2024-06-02T04:48:07.101373+0000","last_up_change":"2024-06-02T04:47:29.822242+0000","last_in_change":"2024-06-02T04:47:14.253449+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T04:44:56.408602+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-02T04:48:01.194954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-02T04:48:01.828863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-02T04:48:04.916565+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"33a51ba2-be5c-41d0-b5d1-8d6039f2ca4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6802","nonce":2869602045},{"type":"v1","addr":"172.21.15.76:6803","nonce":2869602045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6804","nonce":2869602045},{"type":"v1","addr":"172.21.15.76:6805","nonce":2869602045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6808","nonce":2869602045},{"type":"v1","addr":"172.21.15.76:6809","nonce":2869602045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6806","nonce":2869602045},{"type":"v1","addr":"172.21.15.76:6807","nonce":2869602045}]},"public_addr":"172.21.15.76:6803/2869602045","cluster_addr":"172.21.15.76:6805/2869602045","heartbeat_back_addr":"172.21.15.76:6809/2869602045","heartbeat_front_addr":"172.21.15.76:6807/2869602045","state":["exists","up"]},{"osd":1,"uuid":"ace46e13-3bb7-4103-973a-6860554df8b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":2353738098},{"type":"v1","addr":"172.21.15.119:6801","nonce":2353738098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":2353738098},{"type":"v1","addr":"172.21.15.119:6803","nonce":2353738098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":2353738098},{"type":"v1","addr":"172.21.15.119:6807","nonce":2353738098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":2353738098},{"type":"v1","addr":"172.21.15.119:6805","nonce":2353738098}]},"public_addr":"172.21.15.119:6801/2353738098","cluster_addr":"172.21.15.119:6803/2353738098","heartbeat_back_addr":"172.21.15.119:6807/2353738098","heartbeat_front_addr":"172.21.15.119:6805/2353738098","state":["exists","up"]},{"osd":2,"uuid":"4addc09e-77a9-428a-bcc4-38194f486cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":3206918546},{"type":"v1","addr":"172.21.15.192:6801","nonce":3206918546}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":3206918546},{"type":"v1","addr":"172.21.15.192:6803","nonce":3206918546}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":3206918546},{"type":"v1","addr":"172.21.15.192:6807","nonce":3206918546}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":3206918546},{"type":"v1","addr":"172.21.15.192:6805","nonce":3206918546}]},"public_addr":"172.21.15.192:6801/3206918546","cluster_addr":"172.21.15.192:6803/3206918546","heartbeat_back_addr":"172.21.15.192:6807/3206918546","heartbeat_front_addr":"172.21.15.192:6805/3206918546","state":["exists","up"]},{"osd":3,"uuid":"dc525518-82c6-49ed-8ca8-e3bd5bfc18d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6810","nonce":3747864233},{"type":"v1","addr":"172.21.15.76:6811","nonce":3747864233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6812","nonce":3747864233},{"type":"v1","addr":"172.21.15.76:6813","nonce":3747864233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6816","nonce":3747864233},{"type":"v1","addr":"172.21.15.76:6817","nonce":3747864233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6814","nonce":3747864233},{"type":"v1","addr":"172.21.15.76:6815","nonce":3747864233}]},"public_addr":"172.21.15.76:6811/3747864233","cluster_addr":"172.21.15.76:6813/3747864233","heartbeat_back_addr":"172.21.15.76:6817/3747864233","heartbeat_front_addr":"172.21.15.76:6815/3747864233","state":["exists","up"]},{"osd":4,"uuid":"eef293d0-cb87-47b3-9751-c6437a1cf079","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":2571629047},{"type":"v1","addr":"172.21.15.119:6809","nonce":2571629047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":2571629047},{"type":"v1","addr":"172.21.15.119:6811","nonce":2571629047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":2571629047},{"type":"v1","addr":"172.21.15.119:6815","nonce":2571629047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":2571629047},{"type":"v1","addr":"172.21.15.119:6813","nonce":2571629047}]},"public_addr":"172.21.15.119:6809/2571629047","cluster_addr":"172.21.15.119:6811/2571629047","heartbeat_back_addr":"172.21.15.119:6815/2571629047","heartbeat_front_addr":"172.21.15.119:6813/2571629047","state":["exists","up"]},{"osd":5,"uuid":"60eb8c6e-766c-49d0-9997-44f85776b3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3285065416},{"type":"v1","addr":"172.21.15.192:6809","nonce":3285065416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":3285065416},{"type":"v1","addr":"172.21.15.192:6811","nonce":3285065416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3285065416},{"type":"v1","addr":"172.21.15.192:6815","nonce":3285065416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":3285065416},{"type":"v1","addr":"172.21.15.192:6813","nonce":3285065416}]},"public_addr":"172.21.15.192:6809/3285065416","cluster_addr":"172.21.15.192:6811/3285065416","heartbeat_back_addr":"172.21.15.192:6815/3285065416","heartbeat_front_addr":"172.21.15.192:6813/3285065416","state":["exists","up"]},{"osd":6,"uuid":"e6dc8b9d-dd06-4870-a506-def8201b7e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6818","nonce":2951381580},{"type":"v1","addr":"172.21.15.76:6819","nonce":2951381580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6820","nonce":2951381580},{"type":"v1","addr":"172.21.15.76:6821","nonce":2951381580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6824","nonce":2951381580},{"type":"v1","addr":"172.21.15.76:6825","nonce":2951381580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6822","nonce":2951381580},{"type":"v1","addr":"172.21.15.76:6823","nonce":2951381580}]},"public_addr":"172.21.15.76:6819/2951381580","cluster_addr":"172.21.15.76:6821/2951381580","heartbeat_back_addr":"172.21.15.76:6825/2951381580","heartbeat_front_addr":"172.21.15.76:6823/2951381580","state":["exists","up"]},{"osd":7,"uuid":"2f5dccb3-39a1-4f25-8715-fa264d59db97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1802558756},{"type":"v1","addr":"172.21.15.119:6817","nonce":1802558756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1802558756},{"type":"v1","addr":"172.21.15.119:6819","nonce":1802558756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1802558756},{"type":"v1","addr":"172.21.15.119:6823","nonce":1802558756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1802558756},{"type":"v1","addr":"172.21.15.119:6821","nonce":1802558756}]},"public_addr":"172.21.15.119:6817/1802558756","cluster_addr":"172.21.15.119:6819/1802558756","heartbeat_back_addr":"172.21.15.119:6823/1802558756","heartbeat_front_addr":"172.21.15.119:6821/1802558756","state":["exists","up"]},{"osd":8,"uuid":"39b6ccd0-16e7-4cd5-87e0-d827e9172984","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":1214972276},{"type":"v1","addr":"172.21.15.192:6817","nonce":1214972276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":1214972276},{"type":"v1","addr":"172.21.15.192:6819","nonce":1214972276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":1214972276},{"type":"v1","addr":"172.21.15.192:6823","nonce":1214972276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":1214972276},{"type":"v1","addr":"172.21.15.192:6821","nonce":1214972276}]},"public_addr":"172.21.15.192:6817/1214972276","cluster_addr":"172.21.15.192:6819/1214972276","heartbeat_back_addr":"172.21.15.192:6823/1214972276","heartbeat_front_addr":"172.21.15.192:6821/1214972276","state":["exists","up"]},{"osd":9,"uuid":"851b2155-07bd-45de-bfe0-53021fda733f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6826","nonce":3095501821},{"type":"v1","addr":"172.21.15.76:6827","nonce":3095501821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6828","nonce":3095501821},{"type":"v1","addr":"172.21.15.76:6829","nonce":3095501821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":3095501821},{"type":"v1","addr":"172.21.15.76:6833","nonce":3095501821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6830","nonce":3095501821},{"type":"v1","addr":"172.21.15.76:6831","nonce":3095501821}]},"public_addr":"172.21.15.76:6827/3095501821","cluster_addr":"172.21.15.76:6829/3095501821","heartbeat_back_addr":"172.21.15.76:6833/3095501821","heartbeat_front_addr":"172.21.15.76:6831/3095501821","state":["exists","up"]},{"osd":10,"uuid":"e4b18e7e-bddf-4dd4-84f6-7902ea327cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":4082130894},{"type":"v1","addr":"172.21.15.119:6825","nonce":4082130894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":4082130894},{"type":"v1","addr":"172.21.15.119:6827","nonce":4082130894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":4082130894},{"type":"v1","addr":"172.21.15.119:6831","nonce":4082130894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":4082130894},{"type":"v1","addr":"172.21.15.119:6829","nonce":4082130894}]},"public_addr":"172.21.15.119:6825/4082130894","cluster_addr":"172.21.15.119:6827/4082130894","heartbeat_back_addr":"172.21.15.119:6831/4082130894","heartbeat_front_addr":"172.21.15.119:6829/4082130894","state":["exists","up"]},{"osd":11,"uuid":"54567e18-920c-4ae9-9557-0efba5a1a820","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":439693921},{"type":"v1","addr":"172.21.15.192:6825","nonce":439693921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":439693921},{"type":"v1","addr":"172.21.15.192:6827","nonce":439693921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":439693921},{"type":"v1","addr":"172.21.15.192:6831","nonce":439693921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":439693921},{"type":"v1","addr":"172.21.15.192:6829","nonce":439693921}]},"public_addr":"172.21.15.192:6825/439693921","cluster_addr":"172.21.15.192:6827/439693921","heartbeat_back_addr":"172.21.15.192:6831/439693921","heartbeat_front_addr":"172.21.15.192:6829/439693921","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:44:19.922390+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:44:36.895563+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:44:53.699019+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:45:11.167404+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:45:27.955899+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:45:44.850368+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:46:02.003588+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:46:19.019217+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:46:36.189670+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:46:53.919365+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:47:11.563053+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:47:28.822443+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.76:6801/4200406736":"2024-06-03T04:43:06.092916+0000","172.21.15.76:6800/4200406736":"2024-06-03T04:43:06.092916+0000","172.21.15.76:0/1524144593":"2024-06-03T04:43:06.092916+0000","172.21.15.76:0/3269372590":"2024-06-03T04:43:06.092916+0000","172.21.15.76:0/3570893846":"2024-06-03T04:42:44.872236+0000","172.21.15.76:0/902035790":"2024-06-03T04:43:06.092916+0000","172.21.15.76:6800/2550846765":"2024-06-03T04:42:44.872236+0000","172.21.15.76:6801/2550846765":"2024-06-03T04:42:44.872236+0000","172.21.15.76:0/2646712763":"2024-06-03T04:42:44.872236+0000","172.21.15.76:0/964578813":"2024-06-03T04:42:44.872236+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T04:48:31.024 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.024+0000 7fbe1e645700 1 -- 172.21.15.76:0/2909761295 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fbe040a11b0 msgr2=0x7fbe040a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:31.025 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.024+0000 7fbe1e645700 1 --2- 172.21.15.76:0/2909761295 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fbe040a11b0 0x7fbe040a3670 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fbe00009b30 tx=0x7fbe00009260 comp rx=0 tx=0).stop 2024-06-02T04:48:31.025 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.024+0000 7fbe1e645700 1 -- 172.21.15.76:0/2909761295 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbe180ffd60 msgr2=0x7fbe18195c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:31.025 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.024+0000 7fbe1e645700 1 --2- 172.21.15.76:0/2909761295 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbe180ffd60 0x7fbe18195c70 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fbe08009990 tx=0x7fbe0800fab0 comp rx=0 tx=0).stop 2024-06-02T04:48:31.025 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.024+0000 7fbe1e645700 1 -- 172.21.15.76:0/2909761295 shutdown_connections 2024-06-02T04:48:31.025 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.024+0000 7fbe1e645700 1 --2- 172.21.15.76:0/2909761295 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fbe040a11b0 0x7fbe040a3670 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:31.025 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.024+0000 7fbe1e645700 1 --2- 172.21.15.76:0/2909761295 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbe181018f0 0x7fbe1819d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:31.025 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.024+0000 7fbe1e645700 1 --2- 172.21.15.76:0/2909761295 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbe180ffd60 0x7fbe18195c70 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:31.025 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.024+0000 7fbe1e645700 1 --2- 172.21.15.76:0/2909761295 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbe18100f50 0x7fbe181961b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:31.025 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.024+0000 7fbe1e645700 1 -- 172.21.15.76:0/2909761295 >> 172.21.15.76:0/2909761295 conn(0x7fbe180fb2f0 msgr2=0x7fbe181043e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:31.025 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.024+0000 7fbe1e645700 1 -- 172.21.15.76:0/2909761295 shutdown_connections 2024-06-02T04:48:31.025 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.024+0000 7fbe1e645700 1 -- 172.21.15.76:0/2909761295 wait complete. 2024-06-02T04:48:31.037 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-06-02T04:48:31.037 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-02T04:48:31.162 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.159+0000 7f3100560700 1 -- 172.21.15.76:0/3517416129 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f30f8104240 msgr2=0x7f30f8106630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:31.162 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.159+0000 7f3100560700 1 --2- 172.21.15.76:0/3517416129 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f30f8104240 0x7f30f8106630 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f30f4009990 tx=0x7f30f4009ca0 comp rx=0 tx=0).stop 2024-06-02T04:48:31.162 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.159+0000 7f3100560700 1 -- 172.21.15.76:0/3517416129 shutdown_connections 2024-06-02T04:48:31.162 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.159+0000 7f3100560700 1 --2- 172.21.15.76:0/3517416129 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f30f8106b70 0x7f30f8108fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:31.162 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.159+0000 7f3100560700 1 --2- 172.21.15.76:0/3517416129 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f30f8101910 0x7f30f8103d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:31.162 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.159+0000 7f3100560700 1 --2- 172.21.15.76:0/3517416129 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f30f8104240 0x7f30f8106630 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:31.162 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.159+0000 7f3100560700 1 -- 172.21.15.76:0/3517416129 >> 172.21.15.76:0/3517416129 conn(0x7f30f80fb300 msgr2=0x7f30f80fd740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:31.162 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.159+0000 7f3100560700 1 -- 172.21.15.76:0/3517416129 shutdown_connections 2024-06-02T04:48:31.163 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.159+0000 7f3100560700 1 -- 172.21.15.76:0/3517416129 wait complete. 2024-06-02T04:48:31.163 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.160+0000 7f3100560700 1 Processor -- start 2024-06-02T04:48:31.163 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.160+0000 7f3100560700 1 -- start start 2024-06-02T04:48:31.163 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.160+0000 7f3100560700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f30f8101910 0x7f30f8196c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:31.163 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.160+0000 7f3100560700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f30f8104240 0x7f30f81971b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:31.163 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.160+0000 7f3100560700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f30f8106b70 0x7f30f819e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:31.163 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.160+0000 7f3100560700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30f819e760 con 0x7f30f8104240 2024-06-02T04:48:31.163 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.160+0000 7f3100560700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30f819e8d0 con 0x7f30f8106b70 2024-06-02T04:48:31.163 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.160+0000 7f3100560700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30f819ea90 con 0x7f30f8101910 2024-06-02T04:48:31.163 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.160+0000 7f30fdafb700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f30f8104240 0x7f30f81971b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:31.163 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.160+0000 7f30fdafb700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f30f8104240 0x7f30f81971b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:40942/0 (socket says 172.21.15.76:40942) 2024-06-02T04:48:31.163 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.160+0000 7f30fdafb700 1 -- 172.21.15.76:0/315606175 learned_addr learned my addr 172.21.15.76:0/315606175 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:48:31.163 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.160+0000 7f30feafd700 1 --2- 172.21.15.76:0/315606175 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f30f8106b70 0x7f30f819e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:31.164 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.160+0000 7f30fe2fc700 1 --2- 172.21.15.76:0/315606175 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f30f8101910 0x7f30f8196c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:31.164 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.161+0000 7f30fdafb700 1 -- 172.21.15.76:0/315606175 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f30f8101910 msgr2=0x7f30f8196c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:31.164 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.161+0000 7f30fdafb700 1 --2- 172.21.15.76:0/315606175 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f30f8101910 0x7f30f8196c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:31.164 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.161+0000 7f30fdafb700 1 -- 172.21.15.76:0/315606175 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f30f8106b70 msgr2=0x7f30f819e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:31.164 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.161+0000 7f30fdafb700 1 --2- 172.21.15.76:0/315606175 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f30f8106b70 0x7f30f819e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:31.164 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.161+0000 7f30fdafb700 1 -- 172.21.15.76:0/315606175 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30f40095f0 con 0x7f30f8104240 2024-06-02T04:48:31.164 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.161+0000 7f30fdafb700 1 --2- 172.21.15.76:0/315606175 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f30f8104240 0x7f30f81971b0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f30f4005740 tx=0x7f30f4009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:31.164 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.161+0000 7f30ef7fe700 1 -- 172.21.15.76:0/315606175 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30f401d070 con 0x7f30f8104240 2024-06-02T04:48:31.164 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.161+0000 7f30ef7fe700 1 -- 172.21.15.76:0/315606175 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f30f400f460 con 0x7f30f8104240 2024-06-02T04:48:31.164 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.161+0000 7f3100560700 1 -- 172.21.15.76:0/315606175 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30f819ed10 con 0x7f30f8104240 2024-06-02T04:48:31.164 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.161+0000 7f30ef7fe700 1 -- 172.21.15.76:0/315606175 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30f4021670 con 0x7f30f8104240 2024-06-02T04:48:31.164 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.161+0000 7f3100560700 1 -- 172.21.15.76:0/315606175 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30f819f190 con 0x7f30f8104240 2024-06-02T04:48:31.164 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.162+0000 7f3100560700 1 -- 172.21.15.76:0/315606175 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30f80fce80 con 0x7f30f8104240 2024-06-02T04:48:31.165 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.163+0000 7f30ef7fe700 1 -- 172.21.15.76:0/315606175 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f30f400f5d0 con 0x7f30f8104240 2024-06-02T04:48:31.165 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.163+0000 7f30ef7fe700 1 --2- 172.21.15.76:0/315606175 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f30e40a1230 0x7f30e40a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:31.165 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.164+0000 7f30fe2fc700 1 --2- 172.21.15.76:0/315606175 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f30e40a1230 0x7f30e40a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:31.166 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.164+0000 7f30ef7fe700 1 -- 172.21.15.76:0/315606175 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f30f40ce310 con 0x7f30f8104240 2024-06-02T04:48:31.166 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.164+0000 7f30fe2fc700 1 --2- 172.21.15.76:0/315606175 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f30e40a1230 0x7f30e40a36f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f30f81980f0 tx=0x7f30e8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:31.167 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.167+0000 7f30ef7fe700 1 -- 172.21.15.76:0/315606175 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f30f40977e0 con 0x7f30f8104240 2024-06-02T04:48:31.364 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.364+0000 7f3100560700 1 -- 172.21.15.76:0/315606175 --> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f30f802ce10 con 0x7f30e40a1230 2024-06-02T04:48:31.376 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.376+0000 7f30ef7fe700 1 -- 172.21.15.76:0/315606175 <== mgr.14152 v2:172.21.15.76:6800/2591353090 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+418061 (secure 0 0 0) 0x7f30f802ce10 con 0x7f30e40a1230 2024-06-02T04:48:31.383 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:48:31.386 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.380+0000 7f3100560700 1 -- 172.21.15.76:0/315606175 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f30e40a1230 msgr2=0x7f30e40a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:31.386 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.380+0000 7f3100560700 1 --2- 172.21.15.76:0/315606175 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f30e40a1230 0x7f30e40a36f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f30f81980f0 tx=0x7f30e8009260 comp rx=0 tx=0).stop 2024-06-02T04:48:31.386 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.380+0000 7f3100560700 1 -- 172.21.15.76:0/315606175 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f30f8104240 msgr2=0x7f30f81971b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:31.386 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.380+0000 7f3100560700 1 --2- 172.21.15.76:0/315606175 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f30f8104240 0x7f30f81971b0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f30f4005740 tx=0x7f30f4009580 comp rx=0 tx=0).stop 2024-06-02T04:48:31.387 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.380+0000 7f3100560700 1 -- 172.21.15.76:0/315606175 shutdown_connections 2024-06-02T04:48:31.387 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.380+0000 7f3100560700 1 --2- 172.21.15.76:0/315606175 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f30e40a1230 0x7f30e40a36f0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:31.387 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.380+0000 7f3100560700 1 --2- 172.21.15.76:0/315606175 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f30f8106b70 0x7f30f819e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:31.387 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.380+0000 7f3100560700 1 --2- 172.21.15.76:0/315606175 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f30f8101910 0x7f30f8196c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:31.387 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.380+0000 7f3100560700 1 --2- 172.21.15.76:0/315606175 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f30f8104240 0x7f30f81971b0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:31.387 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.380+0000 7f3100560700 1 -- 172.21.15.76:0/315606175 >> 172.21.15.76:0/315606175 conn(0x7f30f80fb300 msgr2=0x7f30f8102270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:31.387 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.380+0000 7f3100560700 1 -- 172.21.15.76:0/315606175 shutdown_connections 2024-06-02T04:48:31.387 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.380+0000 7f3100560700 1 -- 172.21.15.76:0/315606175 wait complete. 2024-06-02T04:48:31.387 INFO:teuthology.orchestra.run.smithi076.stderr:dumped all 2024-06-02T04:48:31.392 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:31 smithi076 ceph-mon[42935]: from='client.14886 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:48:31.392 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:31 smithi076 ceph-mon[42935]: from='client.14892 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:48:31.392 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:31 smithi076 ceph-mon[42935]: pgmap v232: 129 pgs: 129 active+clean; 601 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 682 B/s rd, 3.2 KiB/s wr, 5 op/s 2024-06-02T04:48:31.392 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:31 smithi076 ceph-mon[42935]: from='client.14898 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:48:31.392 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:31 smithi076 ceph-mon[42935]: mgrmap e17: x(active, since 5m), standbys: z, y 2024-06-02T04:48:31.392 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:31 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/2898032428' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:48:31.392 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:31 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/2909761295' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:48:31.393 INFO:teuthology.orchestra.run.smithi076.stdout:{"pg_ready":true,"pg_map":{"version":232,"stamp":"2024-06-02T04:48:30.155579+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":615823,"num_objects":46,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":132,"num_read_kb":117,"num_write":284,"num_write_kb":2994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":229,"ondisk_log_size":229,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":371652,"kb_used_data":10548,"kb_used_omap":18,"kb_used_meta":360941,"kb_avail":1124570172,"statfs":{"total":1151940427776,"available":1151559856128,"internally_reserved":0,"allocated":10801152,"data_stored":7056603,"data_compressed":247011,"data_compressed_allocated":331776,"data_compressed_original":2162688,"omap_allocated":19131,"internal_metadata":369603909},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":21002,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":6,"num_read_kb":8,"num_write":56,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003622"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.692267+0000","last_change":"2024-06-02T04:48:02.689765+0000","last_active":"2024-06-02T04:48:06.692267+0000","last_peered":"2024-06-02T04:48:06.692267+0000","last_clean":"2024-06-02T04:48:06.692267+0000","last_became_active":"2024-06-02T04:48:02.689464+0000","last_became_peered":"2024-06-02T04:48:02.689464+0000","last_unstale":"2024-06-02T04:48:06.692267+0000","last_undegraded":"2024-06-02T04:48:06.692267+0000","last_fullsized":"2024-06-02T04:48:06.692267+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:13:19.743519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.701845+0000","last_change":"2024-06-02T04:48:02.691499+0000","last_active":"2024-06-02T04:48:06.701845+0000","last_peered":"2024-06-02T04:48:06.701845+0000","last_clean":"2024-06-02T04:48:06.701845+0000","last_became_active":"2024-06-02T04:48:02.691179+0000","last_became_peered":"2024-06-02T04:48:02.691179+0000","last_unstale":"2024-06-02T04:48:06.701845+0000","last_undegraded":"2024-06-02T04:48:06.701845+0000","last_fullsized":"2024-06-02T04:48:06.701845+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T14:00:17.118877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.701714+0000","last_change":"2024-06-02T04:48:02.688527+0000","last_active":"2024-06-02T04:48:06.701714+0000","last_peered":"2024-06-02T04:48:06.701714+0000","last_clean":"2024-06-02T04:48:06.701714+0000","last_became_active":"2024-06-02T04:48:02.688184+0000","last_became_peered":"2024-06-02T04:48:02.688184+0000","last_unstale":"2024-06-02T04:48:06.701714+0000","last_undegraded":"2024-06-02T04:48:06.701714+0000","last_fullsized":"2024-06-02T04:48:06.701714+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T08:40:35.052887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.697066+0000","last_change":"2024-06-02T04:48:02.695277+0000","last_active":"2024-06-02T04:48:06.697066+0000","last_peered":"2024-06-02T04:48:06.697066+0000","last_clean":"2024-06-02T04:48:06.697066+0000","last_became_active":"2024-06-02T04:48:02.694951+0000","last_became_peered":"2024-06-02T04:48:02.694951+0000","last_unstale":"2024-06-02T04:48:06.697066+0000","last_undegraded":"2024-06-02T04:48:06.697066+0000","last_fullsized":"2024-06-02T04:48:06.697066+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T14:13:50.672421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.696221+0000","last_change":"2024-06-02T04:48:02.691454+0000","last_active":"2024-06-02T04:48:06.696221+0000","last_peered":"2024-06-02T04:48:06.696221+0000","last_clean":"2024-06-02T04:48:06.696221+0000","last_became_active":"2024-06-02T04:48:02.691083+0000","last_became_peered":"2024-06-02T04:48:02.691083+0000","last_unstale":"2024-06-02T04:48:06.696221+0000","last_undegraded":"2024-06-02T04:48:06.696221+0000","last_fullsized":"2024-06-02T04:48:06.696221+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T07:12:58.481115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.961870+0000","last_change":"2024-06-02T04:48:02.690371+0000","last_active":"2024-06-02T04:48:06.961870+0000","last_peered":"2024-06-02T04:48:06.961870+0000","last_clean":"2024-06-02T04:48:06.961870+0000","last_became_active":"2024-06-02T04:48:02.682047+0000","last_became_peered":"2024-06-02T04:48:02.682047+0000","last_unstale":"2024-06-02T04:48:06.961870+0000","last_undegraded":"2024-06-02T04:48:06.961870+0000","last_fullsized":"2024-06-02T04:48:06.961870+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:17:59.717575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.698244+0000","last_change":"2024-06-02T04:48:02.697823+0000","last_active":"2024-06-02T04:48:06.698244+0000","last_peered":"2024-06-02T04:48:06.698244+0000","last_clean":"2024-06-02T04:48:06.698244+0000","last_became_active":"2024-06-02T04:48:02.697491+0000","last_became_peered":"2024-06-02T04:48:02.697491+0000","last_unstale":"2024-06-02T04:48:06.698244+0000","last_undegraded":"2024-06-02T04:48:06.698244+0000","last_fullsized":"2024-06-02T04:48:06.698244+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T16:08:39.689192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.105002+0000","last_change":"2024-06-02T04:48:02.702564+0000","last_active":"2024-06-02T04:48:07.105002+0000","last_peered":"2024-06-02T04:48:07.105002+0000","last_clean":"2024-06-02T04:48:07.105002+0000","last_became_active":"2024-06-02T04:48:02.702259+0000","last_became_peered":"2024-06-02T04:48:02.702259+0000","last_unstale":"2024-06-02T04:48:07.105002+0000","last_undegraded":"2024-06-02T04:48:07.105002+0000","last_fullsized":"2024-06-02T04:48:07.105002+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T12:33:28.945414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.692781+0000","last_change":"2024-06-02T04:48:02.694090+0000","last_active":"2024-06-02T04:48:06.692781+0000","last_peered":"2024-06-02T04:48:06.692781+0000","last_clean":"2024-06-02T04:48:06.692781+0000","last_became_active":"2024-06-02T04:48:02.693723+0000","last_became_peered":"2024-06-02T04:48:02.693723+0000","last_unstale":"2024-06-02T04:48:06.692781+0000","last_undegraded":"2024-06-02T04:48:06.692781+0000","last_fullsized":"2024-06-02T04:48:06.692781+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:33:26.628450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.963109+0000","last_change":"2024-06-02T04:48:02.702201+0000","last_active":"2024-06-02T04:48:06.963109+0000","last_peered":"2024-06-02T04:48:06.963109+0000","last_clean":"2024-06-02T04:48:06.963109+0000","last_became_active":"2024-06-02T04:48:02.701834+0000","last_became_peered":"2024-06-02T04:48:02.701834+0000","last_unstale":"2024-06-02T04:48:06.963109+0000","last_undegraded":"2024-06-02T04:48:06.963109+0000","last_fullsized":"2024-06-02T04:48:06.963109+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T08:22:24.009015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.699587+0000","last_change":"2024-06-02T04:48:02.700280+0000","last_active":"2024-06-02T04:48:06.699587+0000","last_peered":"2024-06-02T04:48:06.699587+0000","last_clean":"2024-06-02T04:48:06.699587+0000","last_became_active":"2024-06-02T04:48:02.699852+0000","last_became_peered":"2024-06-02T04:48:02.699852+0000","last_unstale":"2024-06-02T04:48:06.699587+0000","last_undegraded":"2024-06-02T04:48:06.699587+0000","last_fullsized":"2024-06-02T04:48:06.699587+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T16:45:28.228692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.696970+0000","last_change":"2024-06-02T04:48:02.689951+0000","last_active":"2024-06-02T04:48:06.696970+0000","last_peered":"2024-06-02T04:48:06.696970+0000","last_clean":"2024-06-02T04:48:06.696970+0000","last_became_active":"2024-06-02T04:48:02.689249+0000","last_became_peered":"2024-06-02T04:48:02.689249+0000","last_unstale":"2024-06-02T04:48:06.696970+0000","last_undegraded":"2024-06-02T04:48:06.696970+0000","last_fullsized":"2024-06-02T04:48:06.696970+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:09:43.620165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.691345+0000","last_change":"2024-06-02T04:48:02.691126+0000","last_active":"2024-06-02T04:48:06.691345+0000","last_peered":"2024-06-02T04:48:06.691345+0000","last_clean":"2024-06-02T04:48:06.691345+0000","last_became_active":"2024-06-02T04:48:02.690825+0000","last_became_peered":"2024-06-02T04:48:02.690825+0000","last_unstale":"2024-06-02T04:48:06.691345+0000","last_undegraded":"2024-06-02T04:48:06.691345+0000","last_fullsized":"2024-06-02T04:48:06.691345+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:03:36.461555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.708124+0000","last_change":"2024-06-02T04:48:02.692802+0000","last_active":"2024-06-02T04:48:06.708124+0000","last_peered":"2024-06-02T04:48:06.708124+0000","last_clean":"2024-06-02T04:48:06.708124+0000","last_became_active":"2024-06-02T04:48:02.692495+0000","last_became_peered":"2024-06-02T04:48:02.692495+0000","last_unstale":"2024-06-02T04:48:06.708124+0000","last_undegraded":"2024-06-02T04:48:06.708124+0000","last_fullsized":"2024-06-02T04:48:06.708124+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T14:57:10.991752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.701916+0000","last_change":"2024-06-02T04:48:02.702968+0000","last_active":"2024-06-02T04:48:06.701916+0000","last_peered":"2024-06-02T04:48:06.701916+0000","last_clean":"2024-06-02T04:48:06.701916+0000","last_became_active":"2024-06-02T04:48:02.702672+0000","last_became_peered":"2024-06-02T04:48:02.702672+0000","last_unstale":"2024-06-02T04:48:06.701916+0000","last_undegraded":"2024-06-02T04:48:06.701916+0000","last_fullsized":"2024-06-02T04:48:06.701916+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:04:38.385228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.691702+0000","last_change":"2024-06-02T04:48:02.701329+0000","last_active":"2024-06-02T04:48:06.691702+0000","last_peered":"2024-06-02T04:48:06.691702+0000","last_clean":"2024-06-02T04:48:06.691702+0000","last_became_active":"2024-06-02T04:48:02.701064+0000","last_became_peered":"2024-06-02T04:48:02.701064+0000","last_unstale":"2024-06-02T04:48:06.691702+0000","last_undegraded":"2024-06-02T04:48:06.691702+0000","last_fullsized":"2024-06-02T04:48:06.691702+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:28:06.265050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.692151+0000","last_change":"2024-06-02T04:48:02.688538+0000","last_active":"2024-06-02T04:48:06.692151+0000","last_peered":"2024-06-02T04:48:06.692151+0000","last_clean":"2024-06-02T04:48:06.692151+0000","last_became_active":"2024-06-02T04:48:02.688175+0000","last_became_peered":"2024-06-02T04:48:02.688175+0000","last_unstale":"2024-06-02T04:48:06.692151+0000","last_undegraded":"2024-06-02T04:48:06.692151+0000","last_fullsized":"2024-06-02T04:48:06.692151+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T07:30:47.310924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.697897+0000","last_change":"2024-06-02T04:48:02.688515+0000","last_active":"2024-06-02T04:48:06.697897+0000","last_peered":"2024-06-02T04:48:06.697897+0000","last_clean":"2024-06-02T04:48:06.697897+0000","last_became_active":"2024-06-02T04:48:02.688205+0000","last_became_peered":"2024-06-02T04:48:02.688205+0000","last_unstale":"2024-06-02T04:48:06.697897+0000","last_undegraded":"2024-06-02T04:48:06.697897+0000","last_fullsized":"2024-06-02T04:48:06.697897+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:20:05.829628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.700166+0000","last_change":"2024-06-02T04:48:02.688376+0000","last_active":"2024-06-02T04:48:06.700166+0000","last_peered":"2024-06-02T04:48:06.700166+0000","last_clean":"2024-06-02T04:48:06.700166+0000","last_became_active":"2024-06-02T04:48:02.688055+0000","last_became_peered":"2024-06-02T04:48:02.688055+0000","last_unstale":"2024-06-02T04:48:06.700166+0000","last_undegraded":"2024-06-02T04:48:06.700166+0000","last_fullsized":"2024-06-02T04:48:06.700166+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:55:41.327635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.714875+0000","last_change":"2024-06-02T04:48:06.713517+0000","last_active":"2024-06-02T04:48:06.714875+0000","last_peered":"2024-06-02T04:48:06.714875+0000","last_clean":"2024-06-02T04:48:06.714875+0000","last_became_active":"2024-06-02T04:48:06.713187+0000","last_became_peered":"2024-06-02T04:48:06.713187+0000","last_unstale":"2024-06-02T04:48:06.714875+0000","last_undegraded":"2024-06-02T04:48:06.714875+0000","last_fullsized":"2024-06-02T04:48:06.714875+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:11:46.598023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"75'4","reported_seq":20,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.705518+0000","last_change":"2024-06-02T04:48:02.271595+0000","last_active":"2024-06-02T04:48:06.705518+0000","last_peered":"2024-06-02T04:48:06.705518+0000","last_clean":"2024-06-02T04:48:06.705518+0000","last_became_active":"2024-06-02T04:48:02.271326+0000","last_became_peered":"2024-06-02T04:48:02.271326+0000","last_unstale":"2024-06-02T04:48:06.705518+0000","last_undegraded":"2024-06-02T04:48:06.705518+0000","last_fullsized":"2024-06-02T04:48:06.705518+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:23:31.096224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.105442+0000","last_change":"2024-06-02T04:48:02.696542+0000","last_active":"2024-06-02T04:48:07.105442+0000","last_peered":"2024-06-02T04:48:07.105442+0000","last_clean":"2024-06-02T04:48:07.105442+0000","last_became_active":"2024-06-02T04:48:02.696260+0000","last_became_peered":"2024-06-02T04:48:02.696260+0000","last_unstale":"2024-06-02T04:48:07.105442+0000","last_undegraded":"2024-06-02T04:48:07.105442+0000","last_fullsized":"2024-06-02T04:48:07.105442+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T06:28:04.097035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.291625+0000","last_change":"2024-06-02T04:48:06.713685+0000","last_active":"2024-06-02T04:48:07.291625+0000","last_peered":"2024-06-02T04:48:07.291625+0000","last_clean":"2024-06-02T04:48:07.291625+0000","last_became_active":"2024-06-02T04:48:06.713254+0000","last_became_peered":"2024-06-02T04:48:06.713254+0000","last_unstale":"2024-06-02T04:48:07.291625+0000","last_undegraded":"2024-06-02T04:48:07.291625+0000","last_fullsized":"2024-06-02T04:48:07.291625+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:12:48.304229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"75'1","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.702453+0000","last_change":"2024-06-02T04:48:02.268361+0000","last_active":"2024-06-02T04:48:06.702453+0000","last_peered":"2024-06-02T04:48:06.702453+0000","last_clean":"2024-06-02T04:48:06.702453+0000","last_became_active":"2024-06-02T04:48:02.268053+0000","last_became_peered":"2024-06-02T04:48:02.268053+0000","last_unstale":"2024-06-02T04:48:06.702453+0000","last_undegraded":"2024-06-02T04:48:06.702453+0000","last_fullsized":"2024-06-02T04:48:06.702453+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T16:04:13.955351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.701807+0000","last_change":"2024-06-02T04:48:02.686322+0000","last_active":"2024-06-02T04:48:06.701807+0000","last_peered":"2024-06-02T04:48:06.701807+0000","last_clean":"2024-06-02T04:48:06.701807+0000","last_became_active":"2024-06-02T04:48:02.685978+0000","last_became_peered":"2024-06-02T04:48:02.685978+0000","last_unstale":"2024-06-02T04:48:06.701807+0000","last_undegraded":"2024-06-02T04:48:06.701807+0000","last_fullsized":"2024-06-02T04:48:06.701807+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T12:12:19.157330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.291715+0000","last_change":"2024-06-02T04:48:06.717046+0000","last_active":"2024-06-02T04:48:07.291715+0000","last_peered":"2024-06-02T04:48:07.291715+0000","last_clean":"2024-06-02T04:48:07.291715+0000","last_became_active":"2024-06-02T04:48:06.716603+0000","last_became_peered":"2024-06-02T04:48:06.716603+0000","last_unstale":"2024-06-02T04:48:07.291715+0000","last_undegraded":"2024-06-02T04:48:07.291715+0000","last_fullsized":"2024-06-02T04:48:07.291715+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:35:22.953004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"80'4","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:27.276618+0000","last_change":"2024-06-02T04:48:02.278143+0000","last_active":"2024-06-02T04:48:27.276618+0000","last_peered":"2024-06-02T04:48:27.276618+0000","last_clean":"2024-06-02T04:48:27.276618+0000","last_became_active":"2024-06-02T04:48:02.277656+0000","last_became_peered":"2024-06-02T04:48:02.277656+0000","last_unstale":"2024-06-02T04:48:27.276618+0000","last_undegraded":"2024-06-02T04:48:27.276618+0000","last_fullsized":"2024-06-02T04:48:27.276618+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T12:03:01.549353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.692452+0000","last_change":"2024-06-02T04:48:02.699659+0000","last_active":"2024-06-02T04:48:06.692452+0000","last_peered":"2024-06-02T04:48:06.692452+0000","last_clean":"2024-06-02T04:48:06.692452+0000","last_became_active":"2024-06-02T04:48:02.699321+0000","last_became_peered":"2024-06-02T04:48:02.699321+0000","last_unstale":"2024-06-02T04:48:06.692452+0000","last_undegraded":"2024-06-02T04:48:06.692452+0000","last_fullsized":"2024-06-02T04:48:06.692452+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:33:35.088215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.291668+0000","last_change":"2024-06-02T04:48:06.712031+0000","last_active":"2024-06-02T04:48:07.291668+0000","last_peered":"2024-06-02T04:48:07.291668+0000","last_clean":"2024-06-02T04:48:07.291668+0000","last_became_active":"2024-06-02T04:48:06.711637+0000","last_became_peered":"2024-06-02T04:48:06.711637+0000","last_unstale":"2024-06-02T04:48:07.291668+0000","last_undegraded":"2024-06-02T04:48:07.291668+0000","last_fullsized":"2024-06-02T04:48:07.291668+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T06:10:05.281793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"75'2","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.697836+0000","last_change":"2024-06-02T04:48:02.268698+0000","last_active":"2024-06-02T04:48:06.697836+0000","last_peered":"2024-06-02T04:48:06.697836+0000","last_clean":"2024-06-02T04:48:06.697836+0000","last_became_active":"2024-06-02T04:48:02.268286+0000","last_became_peered":"2024-06-02T04:48:02.268286+0000","last_unstale":"2024-06-02T04:48:06.697836+0000","last_undegraded":"2024-06-02T04:48:06.697836+0000","last_fullsized":"2024-06-02T04:48:06.697836+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T10:37:42.354104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.030205+0000","last_change":"2024-06-02T04:48:02.702280+0000","last_active":"2024-06-02T04:48:07.030205+0000","last_peered":"2024-06-02T04:48:07.030205+0000","last_clean":"2024-06-02T04:48:07.030205+0000","last_became_active":"2024-06-02T04:48:02.701830+0000","last_became_peered":"2024-06-02T04:48:02.701830+0000","last_unstale":"2024-06-02T04:48:07.030205+0000","last_undegraded":"2024-06-02T04:48:07.030205+0000","last_fullsized":"2024-06-02T04:48:07.030205+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T06:44:06.324024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.709193+0000","last_change":"2024-06-02T04:48:06.708484+0000","last_active":"2024-06-02T04:48:06.709193+0000","last_peered":"2024-06-02T04:48:06.709193+0000","last_clean":"2024-06-02T04:48:06.709193+0000","last_became_active":"2024-06-02T04:48:06.708048+0000","last_became_peered":"2024-06-02T04:48:06.708048+0000","last_unstale":"2024-06-02T04:48:06.709193+0000","last_undegraded":"2024-06-02T04:48:06.709193+0000","last_fullsized":"2024-06-02T04:48:06.709193+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:30:42.361362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"80'5","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:26.276987+0000","last_change":"2024-06-02T04:48:02.274961+0000","last_active":"2024-06-02T04:48:26.276987+0000","last_peered":"2024-06-02T04:48:26.276987+0000","last_clean":"2024-06-02T04:48:26.276987+0000","last_became_active":"2024-06-02T04:48:02.274617+0000","last_became_peered":"2024-06-02T04:48:02.274617+0000","last_unstale":"2024-06-02T04:48:26.276987+0000","last_undegraded":"2024-06-02T04:48:26.276987+0000","last_fullsized":"2024-06-02T04:48:26.276987+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T16:47:17.136996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.698487+0000","last_change":"2024-06-02T04:48:02.684722+0000","last_active":"2024-06-02T04:48:06.698487+0000","last_peered":"2024-06-02T04:48:06.698487+0000","last_clean":"2024-06-02T04:48:06.698487+0000","last_became_active":"2024-06-02T04:48:02.684354+0000","last_became_peered":"2024-06-02T04:48:02.684354+0000","last_unstale":"2024-06-02T04:48:06.698487+0000","last_undegraded":"2024-06-02T04:48:06.698487+0000","last_fullsized":"2024-06-02T04:48:06.698487+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T07:46:54.136882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.714856+0000","last_change":"2024-06-02T04:48:06.713498+0000","last_active":"2024-06-02T04:48:06.714856+0000","last_peered":"2024-06-02T04:48:06.714856+0000","last_clean":"2024-06-02T04:48:06.714856+0000","last_became_active":"2024-06-02T04:48:06.712949+0000","last_became_peered":"2024-06-02T04:48:06.712949+0000","last_unstale":"2024-06-02T04:48:06.714856+0000","last_undegraded":"2024-06-02T04:48:06.714856+0000","last_fullsized":"2024-06-02T04:48:06.714856+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:37:31.586703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"80'3","reported_seq":19,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:27.277254+0000","last_change":"2024-06-02T04:48:02.266358+0000","last_active":"2024-06-02T04:48:27.277254+0000","last_peered":"2024-06-02T04:48:27.277254+0000","last_clean":"2024-06-02T04:48:27.277254+0000","last_became_active":"2024-06-02T04:48:02.266008+0000","last_became_peered":"2024-06-02T04:48:02.266008+0000","last_unstale":"2024-06-02T04:48:27.277254+0000","last_undegraded":"2024-06-02T04:48:27.277254+0000","last_fullsized":"2024-06-02T04:48:27.277254+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:07:13.104170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.030185+0000","last_change":"2024-06-02T04:48:02.702234+0000","last_active":"2024-06-02T04:48:07.030185+0000","last_peered":"2024-06-02T04:48:07.030185+0000","last_clean":"2024-06-02T04:48:07.030185+0000","last_became_active":"2024-06-02T04:48:02.701927+0000","last_became_peered":"2024-06-02T04:48:02.701927+0000","last_unstale":"2024-06-02T04:48:07.030185+0000","last_undegraded":"2024-06-02T04:48:07.030185+0000","last_fullsized":"2024-06-02T04:48:07.030185+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:55:55.940957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.106401+0000","last_change":"2024-06-02T04:48:06.713257+0000","last_active":"2024-06-02T04:48:07.106401+0000","last_peered":"2024-06-02T04:48:07.106401+0000","last_clean":"2024-06-02T04:48:07.106401+0000","last_became_active":"2024-06-02T04:48:06.712862+0000","last_became_peered":"2024-06-02T04:48:06.712862+0000","last_unstale":"2024-06-02T04:48:07.106401+0000","last_undegraded":"2024-06-02T04:48:07.106401+0000","last_fullsized":"2024-06-02T04:48:07.106401+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T06:23:35.115824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"80'2","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:27.276292+0000","last_change":"2024-06-02T04:48:02.258838+0000","last_active":"2024-06-02T04:48:27.276292+0000","last_peered":"2024-06-02T04:48:27.276292+0000","last_clean":"2024-06-02T04:48:27.276292+0000","last_became_active":"2024-06-02T04:48:02.258516+0000","last_became_peered":"2024-06-02T04:48:02.258516+0000","last_unstale":"2024-06-02T04:48:27.276292+0000","last_undegraded":"2024-06-02T04:48:27.276292+0000","last_fullsized":"2024-06-02T04:48:27.276292+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:32:04.161724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.104908+0000","last_change":"2024-06-02T04:48:02.690043+0000","last_active":"2024-06-02T04:48:07.104908+0000","last_peered":"2024-06-02T04:48:07.104908+0000","last_clean":"2024-06-02T04:48:07.104908+0000","last_became_active":"2024-06-02T04:48:02.689748+0000","last_became_peered":"2024-06-02T04:48:02.689748+0000","last_unstale":"2024-06-02T04:48:07.104908+0000","last_undegraded":"2024-06-02T04:48:07.104908+0000","last_fullsized":"2024-06-02T04:48:07.104908+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:50:23.694653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.338557+0000","last_change":"2024-06-02T04:48:06.704093+0000","last_active":"2024-06-02T04:48:07.338557+0000","last_peered":"2024-06-02T04:48:07.338557+0000","last_clean":"2024-06-02T04:48:07.338557+0000","last_became_active":"2024-06-02T04:48:06.703732+0000","last_became_peered":"2024-06-02T04:48:06.703732+0000","last_unstale":"2024-06-02T04:48:07.338557+0000","last_undegraded":"2024-06-02T04:48:07.338557+0000","last_fullsized":"2024-06-02T04:48:07.338557+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:50:10.434364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"80'1","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.338898+0000","last_change":"2024-06-02T04:48:02.274753+0000","last_active":"2024-06-02T04:48:07.338898+0000","last_peered":"2024-06-02T04:48:07.338898+0000","last_clean":"2024-06-02T04:48:07.338898+0000","last_became_active":"2024-06-02T04:48:02.274390+0000","last_became_peered":"2024-06-02T04:48:02.274390+0000","last_unstale":"2024-06-02T04:48:07.338898+0000","last_undegraded":"2024-06-02T04:48:07.338898+0000","last_fullsized":"2024-06-02T04:48:07.338898+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:42:38.790750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.698110+0000","last_change":"2024-06-02T04:48:02.684832+0000","last_active":"2024-06-02T04:48:06.698110+0000","last_peered":"2024-06-02T04:48:06.698110+0000","last_clean":"2024-06-02T04:48:06.698110+0000","last_became_active":"2024-06-02T04:48:02.684520+0000","last_became_peered":"2024-06-02T04:48:02.684520+0000","last_unstale":"2024-06-02T04:48:06.698110+0000","last_undegraded":"2024-06-02T04:48:06.698110+0000","last_fullsized":"2024-06-02T04:48:06.698110+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:08:33.038975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.104977+0000","last_change":"2024-06-02T04:48:06.704725+0000","last_active":"2024-06-02T04:48:07.104977+0000","last_peered":"2024-06-02T04:48:07.104977+0000","last_clean":"2024-06-02T04:48:07.104977+0000","last_became_active":"2024-06-02T04:48:06.704284+0000","last_became_peered":"2024-06-02T04:48:06.704284+0000","last_unstale":"2024-06-02T04:48:07.104977+0000","last_undegraded":"2024-06-02T04:48:07.104977+0000","last_fullsized":"2024-06-02T04:48:07.104977+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:56:04.558505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"80'3","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:26.275573+0000","last_change":"2024-06-02T04:48:02.267048+0000","last_active":"2024-06-02T04:48:26.275573+0000","last_peered":"2024-06-02T04:48:26.275573+0000","last_clean":"2024-06-02T04:48:26.275573+0000","last_became_active":"2024-06-02T04:48:02.266707+0000","last_became_peered":"2024-06-02T04:48:02.266707+0000","last_unstale":"2024-06-02T04:48:26.275573+0000","last_undegraded":"2024-06-02T04:48:26.275573+0000","last_fullsized":"2024-06-02T04:48:26.275573+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:36:25.633728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.692726+0000","last_change":"2024-06-02T04:48:02.700485+0000","last_active":"2024-06-02T04:48:06.692726+0000","last_peered":"2024-06-02T04:48:06.692726+0000","last_clean":"2024-06-02T04:48:06.692726+0000","last_became_active":"2024-06-02T04:48:02.700228+0000","last_became_peered":"2024-06-02T04:48:02.700228+0000","last_unstale":"2024-06-02T04:48:06.692726+0000","last_undegraded":"2024-06-02T04:48:06.692726+0000","last_fullsized":"2024-06-02T04:48:06.692726+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T06:39:18.244476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.717696+0000","last_change":"2024-06-02T04:48:06.716821+0000","last_active":"2024-06-02T04:48:06.717696+0000","last_peered":"2024-06-02T04:48:06.717696+0000","last_clean":"2024-06-02T04:48:06.717696+0000","last_became_active":"2024-06-02T04:48:06.716432+0000","last_became_peered":"2024-06-02T04:48:06.716432+0000","last_unstale":"2024-06-02T04:48:06.717696+0000","last_undegraded":"2024-06-02T04:48:06.717696+0000","last_fullsized":"2024-06-02T04:48:06.717696+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T12:06:50.164797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"80'2","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:26.276005+0000","last_change":"2024-06-02T04:48:02.272377+0000","last_active":"2024-06-02T04:48:26.276005+0000","last_peered":"2024-06-02T04:48:26.276005+0000","last_clean":"2024-06-02T04:48:26.276005+0000","last_became_active":"2024-06-02T04:48:02.272017+0000","last_became_peered":"2024-06-02T04:48:02.272017+0000","last_unstale":"2024-06-02T04:48:26.276005+0000","last_undegraded":"2024-06-02T04:48:26.276005+0000","last_fullsized":"2024-06-02T04:48:26.276005+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T10:24:14.945609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.701744+0000","last_change":"2024-06-02T04:48:02.687056+0000","last_active":"2024-06-02T04:48:06.701744+0000","last_peered":"2024-06-02T04:48:06.701744+0000","last_clean":"2024-06-02T04:48:06.701744+0000","last_became_active":"2024-06-02T04:48:02.686729+0000","last_became_peered":"2024-06-02T04:48:02.686729+0000","last_unstale":"2024-06-02T04:48:06.701744+0000","last_undegraded":"2024-06-02T04:48:06.701744+0000","last_fullsized":"2024-06-02T04:48:06.701744+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:54:44.636489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.292066+0000","last_change":"2024-06-02T04:48:06.713816+0000","last_active":"2024-06-02T04:48:07.292066+0000","last_peered":"2024-06-02T04:48:07.292066+0000","last_clean":"2024-06-02T04:48:07.292066+0000","last_became_active":"2024-06-02T04:48:06.713372+0000","last_became_peered":"2024-06-02T04:48:06.713372+0000","last_unstale":"2024-06-02T04:48:07.292066+0000","last_undegraded":"2024-06-02T04:48:07.292066+0000","last_fullsized":"2024-06-02T04:48:07.292066+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T10:12:46.455263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"80'4","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.339772+0000","last_change":"2024-06-02T04:48:02.274971+0000","last_active":"2024-06-02T04:48:07.339772+0000","last_peered":"2024-06-02T04:48:07.339772+0000","last_clean":"2024-06-02T04:48:07.339772+0000","last_became_active":"2024-06-02T04:48:02.274137+0000","last_became_peered":"2024-06-02T04:48:02.274137+0000","last_unstale":"2024-06-02T04:48:07.339772+0000","last_undegraded":"2024-06-02T04:48:07.339772+0000","last_fullsized":"2024-06-02T04:48:07.339772+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:41:45.634923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.692551+0000","last_change":"2024-06-02T04:48:02.693919+0000","last_active":"2024-06-02T04:48:06.692551+0000","last_peered":"2024-06-02T04:48:06.692551+0000","last_clean":"2024-06-02T04:48:06.692551+0000","last_became_active":"2024-06-02T04:48:02.693577+0000","last_became_peered":"2024-06-02T04:48:02.693577+0000","last_unstale":"2024-06-02T04:48:06.692551+0000","last_undegraded":"2024-06-02T04:48:06.692551+0000","last_fullsized":"2024-06-02T04:48:06.692551+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:00:47.500411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.716072+0000","last_change":"2024-06-02T04:48:06.713061+0000","last_active":"2024-06-02T04:48:06.716072+0000","last_peered":"2024-06-02T04:48:06.716072+0000","last_clean":"2024-06-02T04:48:06.716072+0000","last_became_active":"2024-06-02T04:48:06.712687+0000","last_became_peered":"2024-06-02T04:48:06.712687+0000","last_unstale":"2024-06-02T04:48:06.716072+0000","last_undegraded":"2024-06-02T04:48:06.716072+0000","last_fullsized":"2024-06-02T04:48:06.716072+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T08:46:02.417626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"80'19","reported_seq":39,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:29.080379+0000","last_change":"2024-06-02T04:48:02.270101+0000","last_active":"2024-06-02T04:48:29.080379+0000","last_peered":"2024-06-02T04:48:29.080379+0000","last_clean":"2024-06-02T04:48:29.080379+0000","last_became_active":"2024-06-02T04:48:02.269637+0000","last_became_peered":"2024-06-02T04:48:02.269637+0000","last_unstale":"2024-06-02T04:48:29.080379+0000","last_undegraded":"2024-06-02T04:48:29.080379+0000","last_fullsized":"2024-06-02T04:48:29.080379+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:37:07.572299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23097,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":6,"num_write":20,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.698707+0000","last_change":"2024-06-02T04:48:02.698435+0000","last_active":"2024-06-02T04:48:06.698707+0000","last_peered":"2024-06-02T04:48:06.698707+0000","last_clean":"2024-06-02T04:48:06.698707+0000","last_became_active":"2024-06-02T04:48:02.698071+0000","last_became_peered":"2024-06-02T04:48:02.698071+0000","last_unstale":"2024-06-02T04:48:06.698707+0000","last_undegraded":"2024-06-02T04:48:06.698707+0000","last_fullsized":"2024-06-02T04:48:06.698707+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:45:38.673256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.030226+0000","last_change":"2024-06-02T04:48:06.705965+0000","last_active":"2024-06-02T04:48:07.030226+0000","last_peered":"2024-06-02T04:48:07.030226+0000","last_clean":"2024-06-02T04:48:07.030226+0000","last_became_active":"2024-06-02T04:48:06.705527+0000","last_became_peered":"2024-06-02T04:48:06.705527+0000","last_unstale":"2024-06-02T04:48:07.030226+0000","last_undegraded":"2024-06-02T04:48:07.030226+0000","last_fullsized":"2024-06-02T04:48:07.030226+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:41:54.100212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"75'2","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.696778+0000","last_change":"2024-06-02T04:48:02.273389+0000","last_active":"2024-06-02T04:48:06.696778+0000","last_peered":"2024-06-02T04:48:06.696778+0000","last_clean":"2024-06-02T04:48:06.696778+0000","last_became_active":"2024-06-02T04:48:02.271701+0000","last_became_peered":"2024-06-02T04:48:02.271701+0000","last_unstale":"2024-06-02T04:48:06.696778+0000","last_undegraded":"2024-06-02T04:48:06.696778+0000","last_fullsized":"2024-06-02T04:48:06.696778+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:46:48.304156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.691378+0000","last_change":"2024-06-02T04:48:02.689417+0000","last_active":"2024-06-02T04:48:06.691378+0000","last_peered":"2024-06-02T04:48:06.691378+0000","last_clean":"2024-06-02T04:48:06.691378+0000","last_became_active":"2024-06-02T04:48:02.689108+0000","last_became_peered":"2024-06-02T04:48:02.689108+0000","last_unstale":"2024-06-02T04:48:06.691378+0000","last_undegraded":"2024-06-02T04:48:06.691378+0000","last_fullsized":"2024-06-02T04:48:06.691378+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:23:14.231198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.106225+0000","last_change":"2024-06-02T04:48:06.713370+0000","last_active":"2024-06-02T04:48:07.106225+0000","last_peered":"2024-06-02T04:48:07.106225+0000","last_clean":"2024-06-02T04:48:07.106225+0000","last_became_active":"2024-06-02T04:48:06.712972+0000","last_became_peered":"2024-06-02T04:48:06.712972+0000","last_unstale":"2024-06-02T04:48:07.106225+0000","last_undegraded":"2024-06-02T04:48:07.106225+0000","last_fullsized":"2024-06-02T04:48:07.106225+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:37:23.908276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"80'3","reported_seq":19,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:26.275559+0000","last_change":"2024-06-02T04:48:02.274386+0000","last_active":"2024-06-02T04:48:26.275559+0000","last_peered":"2024-06-02T04:48:26.275559+0000","last_clean":"2024-06-02T04:48:26.275559+0000","last_became_active":"2024-06-02T04:48:02.274001+0000","last_became_peered":"2024-06-02T04:48:02.274001+0000","last_unstale":"2024-06-02T04:48:26.275559+0000","last_undegraded":"2024-06-02T04:48:26.275559+0000","last_fullsized":"2024-06-02T04:48:26.275559+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T14:02:10.256428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.699635+0000","last_change":"2024-06-02T04:48:02.706735+0000","last_active":"2024-06-02T04:48:06.699635+0000","last_peered":"2024-06-02T04:48:06.699635+0000","last_clean":"2024-06-02T04:48:06.699635+0000","last_became_active":"2024-06-02T04:48:02.706475+0000","last_became_peered":"2024-06-02T04:48:02.706475+0000","last_unstale":"2024-06-02T04:48:06.699635+0000","last_undegraded":"2024-06-02T04:48:06.699635+0000","last_fullsized":"2024-06-02T04:48:06.699635+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T10:59:57.946798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.715816+0000","last_change":"2024-06-02T04:48:06.713266+0000","last_active":"2024-06-02T04:48:06.715816+0000","last_peered":"2024-06-02T04:48:06.715816+0000","last_clean":"2024-06-02T04:48:06.715816+0000","last_became_active":"2024-06-02T04:48:06.712659+0000","last_became_peered":"2024-06-02T04:48:06.712659+0000","last_unstale":"2024-06-02T04:48:06.715816+0000","last_undegraded":"2024-06-02T04:48:06.715816+0000","last_fullsized":"2024-06-02T04:48:06.715816+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T16:30:21.140420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.696866+0000","last_change":"2024-06-02T04:48:02.265157+0000","last_active":"2024-06-02T04:48:06.696866+0000","last_peered":"2024-06-02T04:48:06.696866+0000","last_clean":"2024-06-02T04:48:06.696866+0000","last_became_active":"2024-06-02T04:48:02.264782+0000","last_became_peered":"2024-06-02T04:48:02.264782+0000","last_unstale":"2024-06-02T04:48:06.696866+0000","last_undegraded":"2024-06-02T04:48:06.696866+0000","last_fullsized":"2024-06-02T04:48:06.696866+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:55:35.177299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.698945+0000","last_change":"2024-06-02T04:48:02.698864+0000","last_active":"2024-06-02T04:48:06.698945+0000","last_peered":"2024-06-02T04:48:06.698945+0000","last_clean":"2024-06-02T04:48:06.698945+0000","last_became_active":"2024-06-02T04:48:02.698547+0000","last_became_peered":"2024-06-02T04:48:02.698547+0000","last_unstale":"2024-06-02T04:48:06.698945+0000","last_undegraded":"2024-06-02T04:48:06.698945+0000","last_fullsized":"2024-06-02T04:48:06.698945+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:03:39.835164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.339323+0000","last_change":"2024-06-02T04:48:06.713198+0000","last_active":"2024-06-02T04:48:07.339323+0000","last_peered":"2024-06-02T04:48:07.339323+0000","last_clean":"2024-06-02T04:48:07.339323+0000","last_became_active":"2024-06-02T04:48:06.712806+0000","last_became_peered":"2024-06-02T04:48:06.712806+0000","last_unstale":"2024-06-02T04:48:07.339323+0000","last_undegraded":"2024-06-02T04:48:07.339323+0000","last_fullsized":"2024-06-02T04:48:07.339323+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:48:09.492933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"80'15","reported_seq":31,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:27.278481+0000","last_change":"2024-06-02T04:48:02.277744+0000","last_active":"2024-06-02T04:48:27.278481+0000","last_peered":"2024-06-02T04:48:27.278481+0000","last_clean":"2024-06-02T04:48:27.278481+0000","last_became_active":"2024-06-02T04:48:02.277044+0000","last_became_peered":"2024-06-02T04:48:02.277044+0000","last_unstale":"2024-06-02T04:48:27.278481+0000","last_undegraded":"2024-06-02T04:48:27.278481+0000","last_fullsized":"2024-06-02T04:48:27.278481+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:47:38.606233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.030145+0000","last_change":"2024-06-02T04:48:02.702234+0000","last_active":"2024-06-02T04:48:07.030145+0000","last_peered":"2024-06-02T04:48:07.030145+0000","last_clean":"2024-06-02T04:48:07.030145+0000","last_became_active":"2024-06-02T04:48:02.701857+0000","last_became_peered":"2024-06-02T04:48:02.701857+0000","last_unstale":"2024-06-02T04:48:07.030145+0000","last_undegraded":"2024-06-02T04:48:07.030145+0000","last_fullsized":"2024-06-02T04:48:07.030145+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:01:52.901690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.030132+0000","last_change":"2024-06-02T04:48:06.704575+0000","last_active":"2024-06-02T04:48:07.030132+0000","last_peered":"2024-06-02T04:48:07.030132+0000","last_clean":"2024-06-02T04:48:07.030132+0000","last_became_active":"2024-06-02T04:48:06.704129+0000","last_became_peered":"2024-06-02T04:48:06.704129+0000","last_unstale":"2024-06-02T04:48:07.030132+0000","last_undegraded":"2024-06-02T04:48:07.030132+0000","last_fullsized":"2024-06-02T04:48:07.030132+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:43:53.481252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"75'1","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.696782+0000","last_change":"2024-06-02T04:48:02.268816+0000","last_active":"2024-06-02T04:48:06.696782+0000","last_peered":"2024-06-02T04:48:06.696782+0000","last_clean":"2024-06-02T04:48:06.696782+0000","last_became_active":"2024-06-02T04:48:02.268469+0000","last_became_peered":"2024-06-02T04:48:02.268469+0000","last_unstale":"2024-06-02T04:48:06.696782+0000","last_undegraded":"2024-06-02T04:48:06.696782+0000","last_fullsized":"2024-06-02T04:48:06.696782+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:42:32.434414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.691711+0000","last_change":"2024-06-02T04:48:02.704536+0000","last_active":"2024-06-02T04:48:06.691711+0000","last_peered":"2024-06-02T04:48:06.691711+0000","last_clean":"2024-06-02T04:48:06.691711+0000","last_became_active":"2024-06-02T04:48:02.704149+0000","last_became_peered":"2024-06-02T04:48:02.704149+0000","last_unstale":"2024-06-02T04:48:06.691711+0000","last_undegraded":"2024-06-02T04:48:06.691711+0000","last_fullsized":"2024-06-02T04:48:06.691711+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T07:59:40.379135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.114754+0000","last_change":"2024-06-02T04:48:06.963192+0000","last_active":"2024-06-02T04:48:07.114754+0000","last_peered":"2024-06-02T04:48:07.114754+0000","last_clean":"2024-06-02T04:48:07.114754+0000","last_became_active":"2024-06-02T04:48:06.962658+0000","last_became_peered":"2024-06-02T04:48:06.962658+0000","last_unstale":"2024-06-02T04:48:07.114754+0000","last_undegraded":"2024-06-02T04:48:07.114754+0000","last_fullsized":"2024-06-02T04:48:07.114754+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:28:33.093285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.702674+0000","last_change":"2024-06-02T04:48:02.270893+0000","last_active":"2024-06-02T04:48:06.702674+0000","last_peered":"2024-06-02T04:48:06.702674+0000","last_clean":"2024-06-02T04:48:06.702674+0000","last_became_active":"2024-06-02T04:48:02.270566+0000","last_became_peered":"2024-06-02T04:48:02.270566+0000","last_unstale":"2024-06-02T04:48:06.702674+0000","last_undegraded":"2024-06-02T04:48:06.702674+0000","last_fullsized":"2024-06-02T04:48:06.702674+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:57:36.202043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.962165+0000","last_change":"2024-06-02T04:48:02.693528+0000","last_active":"2024-06-02T04:48:06.962165+0000","last_peered":"2024-06-02T04:48:06.962165+0000","last_clean":"2024-06-02T04:48:06.962165+0000","last_became_active":"2024-06-02T04:48:02.693240+0000","last_became_peered":"2024-06-02T04:48:02.693240+0000","last_unstale":"2024-06-02T04:48:06.962165+0000","last_undegraded":"2024-06-02T04:48:06.962165+0000","last_fullsized":"2024-06-02T04:48:06.962165+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T14:48:59.338977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.339278+0000","last_change":"2024-06-02T04:48:06.710454+0000","last_active":"2024-06-02T04:48:07.339278+0000","last_peered":"2024-06-02T04:48:07.339278+0000","last_clean":"2024-06-02T04:48:07.339278+0000","last_became_active":"2024-06-02T04:48:06.710090+0000","last_became_peered":"2024-06-02T04:48:06.710090+0000","last_unstale":"2024-06-02T04:48:07.339278+0000","last_undegraded":"2024-06-02T04:48:07.339278+0000","last_fullsized":"2024-06-02T04:48:07.339278+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:27:52.401032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.698482+0000","last_change":"2024-06-02T04:48:02.271748+0000","last_active":"2024-06-02T04:48:06.698482+0000","last_peered":"2024-06-02T04:48:06.698482+0000","last_clean":"2024-06-02T04:48:06.698482+0000","last_became_active":"2024-06-02T04:48:02.270941+0000","last_became_peered":"2024-06-02T04:48:02.270941+0000","last_unstale":"2024-06-02T04:48:06.698482+0000","last_undegraded":"2024-06-02T04:48:06.698482+0000","last_fullsized":"2024-06-02T04:48:06.698482+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T14:22:37.698956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.962254+0000","last_change":"2024-06-02T04:48:02.690331+0000","last_active":"2024-06-02T04:48:06.962254+0000","last_peered":"2024-06-02T04:48:06.962254+0000","last_clean":"2024-06-02T04:48:06.962254+0000","last_became_active":"2024-06-02T04:48:02.681983+0000","last_became_peered":"2024-06-02T04:48:02.681983+0000","last_unstale":"2024-06-02T04:48:06.962254+0000","last_undegraded":"2024-06-02T04:48:06.962254+0000","last_fullsized":"2024-06-02T04:48:06.962254+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T14:09:12.117847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.339368+0000","last_change":"2024-06-02T04:48:06.962698+0000","last_active":"2024-06-02T04:48:07.339368+0000","last_peered":"2024-06-02T04:48:07.339368+0000","last_clean":"2024-06-02T04:48:07.339368+0000","last_became_active":"2024-06-02T04:48:06.962283+0000","last_became_peered":"2024-06-02T04:48:06.962283+0000","last_unstale":"2024-06-02T04:48:07.339368+0000","last_undegraded":"2024-06-02T04:48:07.339368+0000","last_fullsized":"2024-06-02T04:48:07.339368+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T14:33:49.504150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.030119+0000","last_change":"2024-06-02T04:48:02.702856+0000","last_active":"2024-06-02T04:48:07.030119+0000","last_peered":"2024-06-02T04:48:07.030119+0000","last_clean":"2024-06-02T04:48:07.030119+0000","last_became_active":"2024-06-02T04:48:02.702513+0000","last_became_peered":"2024-06-02T04:48:02.702513+0000","last_unstale":"2024-06-02T04:48:07.030119+0000","last_undegraded":"2024-06-02T04:48:07.030119+0000","last_fullsized":"2024-06-02T04:48:07.030119+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T07:10:35.957386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"80'4","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:27.277906+0000","last_change":"2024-06-02T04:48:02.265627+0000","last_active":"2024-06-02T04:48:27.277906+0000","last_peered":"2024-06-02T04:48:27.277906+0000","last_clean":"2024-06-02T04:48:27.277906+0000","last_became_active":"2024-06-02T04:48:02.265301+0000","last_became_peered":"2024-06-02T04:48:02.265301+0000","last_unstale":"2024-06-02T04:48:27.277906+0000","last_undegraded":"2024-06-02T04:48:27.277906+0000","last_fullsized":"2024-06-02T04:48:27.277906+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T10:46:10.211378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.710314+0000","last_change":"2024-06-02T04:48:06.709988+0000","last_active":"2024-06-02T04:48:06.710314+0000","last_peered":"2024-06-02T04:48:06.710314+0000","last_clean":"2024-06-02T04:48:06.710314+0000","last_became_active":"2024-06-02T04:48:06.709642+0000","last_became_peered":"2024-06-02T04:48:06.709642+0000","last_unstale":"2024-06-02T04:48:06.710314+0000","last_undegraded":"2024-06-02T04:48:06.710314+0000","last_fullsized":"2024-06-02T04:48:06.710314+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T10:09:46.250709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.105024+0000","last_change":"2024-06-02T04:48:02.696666+0000","last_active":"2024-06-02T04:48:07.105024+0000","last_peered":"2024-06-02T04:48:07.105024+0000","last_clean":"2024-06-02T04:48:07.105024+0000","last_became_active":"2024-06-02T04:48:02.696343+0000","last_became_peered":"2024-06-02T04:48:02.696343+0000","last_unstale":"2024-06-02T04:48:07.105024+0000","last_undegraded":"2024-06-02T04:48:07.105024+0000","last_fullsized":"2024-06-02T04:48:07.105024+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T12:31:13.426174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.698922+0000","last_change":"2024-06-02T04:48:02.268619+0000","last_active":"2024-06-02T04:48:06.698922+0000","last_peered":"2024-06-02T04:48:06.698922+0000","last_clean":"2024-06-02T04:48:06.698922+0000","last_became_active":"2024-06-02T04:48:02.268244+0000","last_became_peered":"2024-06-02T04:48:02.268244+0000","last_unstale":"2024-06-02T04:48:06.698922+0000","last_undegraded":"2024-06-02T04:48:06.698922+0000","last_fullsized":"2024-06-02T04:48:06.698922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:15:13.469046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"19'137","reported_seq":326,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.339208+0000","last_change":"2024-06-02T04:47:15.713382+0000","last_active":"2024-06-02T04:48:07.339208+0000","last_peered":"2024-06-02T04:48:07.339208+0000","last_clean":"2024-06-02T04:48:07.339208+0000","last_became_active":"2024-06-02T04:47:15.712972+0000","last_became_peered":"2024-06-02T04:47:15.712972+0000","last_unstale":"2024-06-02T04:48:07.339208+0000","last_undegraded":"2024-06-02T04:48:07.339208+0000","last_fullsized":"2024-06-02T04:48:07.339208+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:44:56.604079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:44:56.604079+0000","last_clean_scrub_stamp":"2024-06-02T04:44:56.604079+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T12:54:02.306899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.030237+0000","last_change":"2024-06-02T04:48:06.964717+0000","last_active":"2024-06-02T04:48:07.030237+0000","last_peered":"2024-06-02T04:48:07.030237+0000","last_clean":"2024-06-02T04:48:07.030237+0000","last_became_active":"2024-06-02T04:48:06.964244+0000","last_became_peered":"2024-06-02T04:48:06.964244+0000","last_unstale":"2024-06-02T04:48:07.030237+0000","last_undegraded":"2024-06-02T04:48:07.030237+0000","last_fullsized":"2024-06-02T04:48:07.030237+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:26:58.901182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.691167+0000","last_change":"2024-06-02T04:48:02.703427+0000","last_active":"2024-06-02T04:48:06.691167+0000","last_peered":"2024-06-02T04:48:06.691167+0000","last_clean":"2024-06-02T04:48:06.691167+0000","last_became_active":"2024-06-02T04:48:02.703140+0000","last_became_peered":"2024-06-02T04:48:02.703140+0000","last_unstale":"2024-06-02T04:48:06.691167+0000","last_undegraded":"2024-06-02T04:48:06.691167+0000","last_fullsized":"2024-06-02T04:48:06.691167+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T10:24:07.881130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"80'1","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.339329+0000","last_change":"2024-06-02T04:48:02.272953+0000","last_active":"2024-06-02T04:48:07.339329+0000","last_peered":"2024-06-02T04:48:07.339329+0000","last_clean":"2024-06-02T04:48:07.339329+0000","last_became_active":"2024-06-02T04:48:02.272603+0000","last_became_peered":"2024-06-02T04:48:02.272603+0000","last_unstale":"2024-06-02T04:48:07.339329+0000","last_undegraded":"2024-06-02T04:48:07.339329+0000","last_fullsized":"2024-06-02T04:48:07.339329+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:46:33.907707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.106136+0000","last_change":"2024-06-02T04:48:06.703427+0000","last_active":"2024-06-02T04:48:07.106136+0000","last_peered":"2024-06-02T04:48:07.106136+0000","last_clean":"2024-06-02T04:48:07.106136+0000","last_became_active":"2024-06-02T04:48:06.702442+0000","last_became_peered":"2024-06-02T04:48:06.702442+0000","last_unstale":"2024-06-02T04:48:07.106136+0000","last_undegraded":"2024-06-02T04:48:07.106136+0000","last_fullsized":"2024-06-02T04:48:07.106136+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T14:47:12.376520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"80'1","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.115045+0000","last_change":"2024-06-02T04:48:02.277241+0000","last_active":"2024-06-02T04:48:07.115045+0000","last_peered":"2024-06-02T04:48:07.115045+0000","last_clean":"2024-06-02T04:48:07.115045+0000","last_became_active":"2024-06-02T04:48:02.276903+0000","last_became_peered":"2024-06-02T04:48:02.276903+0000","last_unstale":"2024-06-02T04:48:07.115045+0000","last_undegraded":"2024-06-02T04:48:07.115045+0000","last_fullsized":"2024-06-02T04:48:07.115045+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:16:40.664225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.691848+0000","last_change":"2024-06-02T04:48:02.682260+0000","last_active":"2024-06-02T04:48:06.691848+0000","last_peered":"2024-06-02T04:48:06.691848+0000","last_clean":"2024-06-02T04:48:06.691848+0000","last_became_active":"2024-06-02T04:48:02.681962+0000","last_became_peered":"2024-06-02T04:48:02.681962+0000","last_unstale":"2024-06-02T04:48:06.691848+0000","last_undegraded":"2024-06-02T04:48:06.691848+0000","last_fullsized":"2024-06-02T04:48:06.691848+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:42:26.588628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.104914+0000","last_change":"2024-06-02T04:48:06.963380+0000","last_active":"2024-06-02T04:48:07.104914+0000","last_peered":"2024-06-02T04:48:07.104914+0000","last_clean":"2024-06-02T04:48:07.104914+0000","last_became_active":"2024-06-02T04:48:06.962717+0000","last_became_peered":"2024-06-02T04:48:06.962717+0000","last_unstale":"2024-06-02T04:48:07.104914+0000","last_undegraded":"2024-06-02T04:48:07.104914+0000","last_fullsized":"2024-06-02T04:48:07.104914+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T07:05:46.983987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"80'1","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.112569+0000","last_change":"2024-06-02T04:48:02.270183+0000","last_active":"2024-06-02T04:48:07.112569+0000","last_peered":"2024-06-02T04:48:07.112569+0000","last_clean":"2024-06-02T04:48:07.112569+0000","last_became_active":"2024-06-02T04:48:02.269880+0000","last_became_peered":"2024-06-02T04:48:02.269880+0000","last_unstale":"2024-06-02T04:48:07.112569+0000","last_undegraded":"2024-06-02T04:48:07.112569+0000","last_fullsized":"2024-06-02T04:48:07.112569+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T16:12:41.959174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.105672+0000","last_change":"2024-06-02T04:48:02.696692+0000","last_active":"2024-06-02T04:48:07.105672+0000","last_peered":"2024-06-02T04:48:07.105672+0000","last_clean":"2024-06-02T04:48:07.105672+0000","last_became_active":"2024-06-02T04:48:02.696398+0000","last_became_peered":"2024-06-02T04:48:02.696398+0000","last_unstale":"2024-06-02T04:48:07.105672+0000","last_undegraded":"2024-06-02T04:48:07.105672+0000","last_fullsized":"2024-06-02T04:48:07.105672+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T14:12:15.108989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.707203+0000","last_change":"2024-06-02T04:48:06.706766+0000","last_active":"2024-06-02T04:48:06.707203+0000","last_peered":"2024-06-02T04:48:06.707203+0000","last_clean":"2024-06-02T04:48:06.707203+0000","last_became_active":"2024-06-02T04:48:06.706440+0000","last_became_peered":"2024-06-02T04:48:06.706440+0000","last_unstale":"2024-06-02T04:48:06.707203+0000","last_undegraded":"2024-06-02T04:48:06.707203+0000","last_fullsized":"2024-06-02T04:48:06.707203+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:24:20.283467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"75'2","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.697476+0000","last_change":"2024-06-02T04:48:02.265259+0000","last_active":"2024-06-02T04:48:06.697476+0000","last_peered":"2024-06-02T04:48:06.697476+0000","last_clean":"2024-06-02T04:48:06.697476+0000","last_became_active":"2024-06-02T04:48:02.264931+0000","last_became_peered":"2024-06-02T04:48:02.264931+0000","last_unstale":"2024-06-02T04:48:06.697476+0000","last_undegraded":"2024-06-02T04:48:06.697476+0000","last_fullsized":"2024-06-02T04:48:06.697476+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:06:18.360519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.701931+0000","last_change":"2024-06-02T04:48:02.684808+0000","last_active":"2024-06-02T04:48:06.701931+0000","last_peered":"2024-06-02T04:48:06.701931+0000","last_clean":"2024-06-02T04:48:06.701931+0000","last_became_active":"2024-06-02T04:48:02.684492+0000","last_became_peered":"2024-06-02T04:48:02.684492+0000","last_unstale":"2024-06-02T04:48:06.701931+0000","last_undegraded":"2024-06-02T04:48:06.701931+0000","last_fullsized":"2024-06-02T04:48:06.701931+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T12:10:01.537377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.291954+0000","last_change":"2024-06-02T04:48:06.965041+0000","last_active":"2024-06-02T04:48:07.291954+0000","last_peered":"2024-06-02T04:48:07.291954+0000","last_clean":"2024-06-02T04:48:07.291954+0000","last_became_active":"2024-06-02T04:48:06.964487+0000","last_became_peered":"2024-06-02T04:48:06.964487+0000","last_unstale":"2024-06-02T04:48:07.291954+0000","last_undegraded":"2024-06-02T04:48:07.291954+0000","last_fullsized":"2024-06-02T04:48:07.291954+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:51:05.082026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:26.276806+0000","last_change":"2024-06-02T04:48:02.271485+0000","last_active":"2024-06-02T04:48:26.276806+0000","last_peered":"2024-06-02T04:48:26.276806+0000","last_clean":"2024-06-02T04:48:26.276806+0000","last_became_active":"2024-06-02T04:48:02.271156+0000","last_became_peered":"2024-06-02T04:48:02.271156+0000","last_unstale":"2024-06-02T04:48:26.276806+0000","last_undegraded":"2024-06-02T04:48:26.276806+0000","last_fullsized":"2024-06-02T04:48:26.276806+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:57:34.467559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.696113+0000","last_change":"2024-06-02T04:48:02.673700+0000","last_active":"2024-06-02T04:48:06.696113+0000","last_peered":"2024-06-02T04:48:06.696113+0000","last_clean":"2024-06-02T04:48:06.696113+0000","last_became_active":"2024-06-02T04:48:02.673262+0000","last_became_peered":"2024-06-02T04:48:02.673262+0000","last_unstale":"2024-06-02T04:48:06.696113+0000","last_undegraded":"2024-06-02T04:48:06.696113+0000","last_fullsized":"2024-06-02T04:48:06.696113+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:45:00.682562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.717730+0000","last_change":"2024-06-02T04:48:06.716848+0000","last_active":"2024-06-02T04:48:06.717730+0000","last_peered":"2024-06-02T04:48:06.717730+0000","last_clean":"2024-06-02T04:48:06.717730+0000","last_became_active":"2024-06-02T04:48:06.716411+0000","last_became_peered":"2024-06-02T04:48:06.716411+0000","last_unstale":"2024-06-02T04:48:06.717730+0000","last_undegraded":"2024-06-02T04:48:06.717730+0000","last_fullsized":"2024-06-02T04:48:06.717730+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T06:09:36.074569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"80'3","reported_seq":19,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:26.273955+0000","last_change":"2024-06-02T04:48:02.269426+0000","last_active":"2024-06-02T04:48:26.273955+0000","last_peered":"2024-06-02T04:48:26.273955+0000","last_clean":"2024-06-02T04:48:26.273955+0000","last_became_active":"2024-06-02T04:48:02.269115+0000","last_became_peered":"2024-06-02T04:48:02.269115+0000","last_unstale":"2024-06-02T04:48:26.273955+0000","last_undegraded":"2024-06-02T04:48:26.273955+0000","last_fullsized":"2024-06-02T04:48:26.273955+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:18:28.568367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.691586+0000","last_change":"2024-06-02T04:48:02.694234+0000","last_active":"2024-06-02T04:48:06.691586+0000","last_peered":"2024-06-02T04:48:06.691586+0000","last_clean":"2024-06-02T04:48:06.691586+0000","last_became_active":"2024-06-02T04:48:02.693916+0000","last_became_peered":"2024-06-02T04:48:02.693916+0000","last_unstale":"2024-06-02T04:48:06.691586+0000","last_undegraded":"2024-06-02T04:48:06.691586+0000","last_fullsized":"2024-06-02T04:48:06.691586+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T16:47:44.939277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.291788+0000","last_change":"2024-06-02T04:48:06.716026+0000","last_active":"2024-06-02T04:48:07.291788+0000","last_peered":"2024-06-02T04:48:07.291788+0000","last_clean":"2024-06-02T04:48:07.291788+0000","last_became_active":"2024-06-02T04:48:06.715730+0000","last_became_peered":"2024-06-02T04:48:06.715730+0000","last_unstale":"2024-06-02T04:48:07.291788+0000","last_undegraded":"2024-06-02T04:48:07.291788+0000","last_fullsized":"2024-06-02T04:48:07.291788+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:35:53.707307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.696497+0000","last_change":"2024-06-02T04:48:02.271576+0000","last_active":"2024-06-02T04:48:06.696497+0000","last_peered":"2024-06-02T04:48:06.696497+0000","last_clean":"2024-06-02T04:48:06.696497+0000","last_became_active":"2024-06-02T04:48:02.271101+0000","last_became_peered":"2024-06-02T04:48:02.271101+0000","last_unstale":"2024-06-02T04:48:06.696497+0000","last_undegraded":"2024-06-02T04:48:06.696497+0000","last_fullsized":"2024-06-02T04:48:06.696497+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T08:35:37.467479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.105325+0000","last_change":"2024-06-02T04:48:02.702773+0000","last_active":"2024-06-02T04:48:07.105325+0000","last_peered":"2024-06-02T04:48:07.105325+0000","last_clean":"2024-06-02T04:48:07.105325+0000","last_became_active":"2024-06-02T04:48:02.702415+0000","last_became_peered":"2024-06-02T04:48:02.702415+0000","last_unstale":"2024-06-02T04:48:07.105325+0000","last_undegraded":"2024-06-02T04:48:07.105325+0000","last_fullsized":"2024-06-02T04:48:07.105325+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:18:55.084384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.291891+0000","last_change":"2024-06-02T04:48:06.963120+0000","last_active":"2024-06-02T04:48:07.291891+0000","last_peered":"2024-06-02T04:48:07.291891+0000","last_clean":"2024-06-02T04:48:07.291891+0000","last_became_active":"2024-06-02T04:48:06.962509+0000","last_became_peered":"2024-06-02T04:48:06.962509+0000","last_unstale":"2024-06-02T04:48:07.291891+0000","last_undegraded":"2024-06-02T04:48:07.291891+0000","last_fullsized":"2024-06-02T04:48:07.291891+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T04:55:34.509179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:26.276892+0000","last_change":"2024-06-02T04:48:02.273511+0000","last_active":"2024-06-02T04:48:26.276892+0000","last_peered":"2024-06-02T04:48:26.276892+0000","last_clean":"2024-06-02T04:48:26.276892+0000","last_became_active":"2024-06-02T04:48:02.273100+0000","last_became_peered":"2024-06-02T04:48:02.273100+0000","last_unstale":"2024-06-02T04:48:26.276892+0000","last_undegraded":"2024-06-02T04:48:26.276892+0000","last_fullsized":"2024-06-02T04:48:26.276892+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:04:11.742406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.698614+0000","last_change":"2024-06-02T04:48:02.696594+0000","last_active":"2024-06-02T04:48:06.698614+0000","last_peered":"2024-06-02T04:48:06.698614+0000","last_clean":"2024-06-02T04:48:06.698614+0000","last_became_active":"2024-06-02T04:48:02.696278+0000","last_became_peered":"2024-06-02T04:48:02.696278+0000","last_unstale":"2024-06-02T04:48:06.698614+0000","last_undegraded":"2024-06-02T04:48:06.698614+0000","last_fullsized":"2024-06-02T04:48:06.698614+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T16:10:16.275451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.339646+0000","last_change":"2024-06-02T04:48:06.701837+0000","last_active":"2024-06-02T04:48:07.339646+0000","last_peered":"2024-06-02T04:48:07.339646+0000","last_clean":"2024-06-02T04:48:07.339646+0000","last_became_active":"2024-06-02T04:48:06.701454+0000","last_became_peered":"2024-06-02T04:48:06.701454+0000","last_unstale":"2024-06-02T04:48:07.339646+0000","last_undegraded":"2024-06-02T04:48:07.339646+0000","last_fullsized":"2024-06-02T04:48:07.339646+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T16:25:46.585200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.698230+0000","last_change":"2024-06-02T04:48:02.272941+0000","last_active":"2024-06-02T04:48:06.698230+0000","last_peered":"2024-06-02T04:48:06.698230+0000","last_clean":"2024-06-02T04:48:06.698230+0000","last_became_active":"2024-06-02T04:48:02.270149+0000","last_became_peered":"2024-06-02T04:48:02.270149+0000","last_unstale":"2024-06-02T04:48:06.698230+0000","last_undegraded":"2024-06-02T04:48:06.698230+0000","last_fullsized":"2024-06-02T04:48:06.698230+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T04:54:09.813917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.699678+0000","last_change":"2024-06-02T04:48:02.699722+0000","last_active":"2024-06-02T04:48:06.699678+0000","last_peered":"2024-06-02T04:48:06.699678+0000","last_clean":"2024-06-02T04:48:06.699678+0000","last_became_active":"2024-06-02T04:48:02.699376+0000","last_became_peered":"2024-06-02T04:48:02.699376+0000","last_unstale":"2024-06-02T04:48:06.699678+0000","last_undegraded":"2024-06-02T04:48:06.699678+0000","last_fullsized":"2024-06-02T04:48:06.699678+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T08:12:24.048499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.338868+0000","last_change":"2024-06-02T04:48:06.706493+0000","last_active":"2024-06-02T04:48:07.338868+0000","last_peered":"2024-06-02T04:48:07.338868+0000","last_clean":"2024-06-02T04:48:07.338868+0000","last_became_active":"2024-06-02T04:48:06.706135+0000","last_became_peered":"2024-06-02T04:48:06.706135+0000","last_unstale":"2024-06-02T04:48:07.338868+0000","last_undegraded":"2024-06-02T04:48:07.338868+0000","last_fullsized":"2024-06-02T04:48:07.338868+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:54:51.491641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"75'1","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.698221+0000","last_change":"2024-06-02T04:48:02.271534+0000","last_active":"2024-06-02T04:48:06.698221+0000","last_peered":"2024-06-02T04:48:06.698221+0000","last_clean":"2024-06-02T04:48:06.698221+0000","last_became_active":"2024-06-02T04:48:02.271144+0000","last_became_peered":"2024-06-02T04:48:02.271144+0000","last_unstale":"2024-06-02T04:48:06.698221+0000","last_undegraded":"2024-06-02T04:48:06.698221+0000","last_fullsized":"2024-06-02T04:48:06.698221+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:45:10.221432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.698395+0000","last_change":"2024-06-02T04:48:02.697089+0000","last_active":"2024-06-02T04:48:06.698395+0000","last_peered":"2024-06-02T04:48:06.698395+0000","last_clean":"2024-06-02T04:48:06.698395+0000","last_became_active":"2024-06-02T04:48:02.696755+0000","last_became_peered":"2024-06-02T04:48:02.696755+0000","last_unstale":"2024-06-02T04:48:06.698395+0000","last_undegraded":"2024-06-02T04:48:06.698395+0000","last_fullsized":"2024-06-02T04:48:06.698395+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T08:56:18.715019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.030079+0000","last_change":"2024-06-02T04:48:06.705906+0000","last_active":"2024-06-02T04:48:07.030079+0000","last_peered":"2024-06-02T04:48:07.030079+0000","last_clean":"2024-06-02T04:48:07.030079+0000","last_became_active":"2024-06-02T04:48:06.705502+0000","last_became_peered":"2024-06-02T04:48:06.705502+0000","last_unstale":"2024-06-02T04:48:07.030079+0000","last_undegraded":"2024-06-02T04:48:07.030079+0000","last_fullsized":"2024-06-02T04:48:07.030079+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T16:33:41.228392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"75'2","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.691448+0000","last_change":"2024-06-02T04:48:02.265912+0000","last_active":"2024-06-02T04:48:06.691448+0000","last_peered":"2024-06-02T04:48:06.691448+0000","last_clean":"2024-06-02T04:48:06.691448+0000","last_became_active":"2024-06-02T04:48:02.265494+0000","last_became_peered":"2024-06-02T04:48:02.265494+0000","last_unstale":"2024-06-02T04:48:06.691448+0000","last_undegraded":"2024-06-02T04:48:06.691448+0000","last_fullsized":"2024-06-02T04:48:06.691448+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T10:21:58.897765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.699265+0000","last_change":"2024-06-02T04:48:02.693091+0000","last_active":"2024-06-02T04:48:06.699265+0000","last_peered":"2024-06-02T04:48:06.699265+0000","last_clean":"2024-06-02T04:48:06.699265+0000","last_became_active":"2024-06-02T04:48:02.692025+0000","last_became_peered":"2024-06-02T04:48:02.692025+0000","last_unstale":"2024-06-02T04:48:06.699265+0000","last_undegraded":"2024-06-02T04:48:06.699265+0000","last_fullsized":"2024-06-02T04:48:06.699265+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T14:36:35.813881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.691657+0000","last_change":"2024-06-02T04:48:02.694381+0000","last_active":"2024-06-02T04:48:06.691657+0000","last_peered":"2024-06-02T04:48:06.691657+0000","last_clean":"2024-06-02T04:48:06.691657+0000","last_became_active":"2024-06-02T04:48:02.694049+0000","last_became_peered":"2024-06-02T04:48:02.694049+0000","last_unstale":"2024-06-02T04:48:06.691657+0000","last_undegraded":"2024-06-02T04:48:06.691657+0000","last_fullsized":"2024-06-02T04:48:06.691657+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:04:31.920810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.701162+0000","last_change":"2024-06-02T04:48:02.702174+0000","last_active":"2024-06-02T04:48:06.701162+0000","last_peered":"2024-06-02T04:48:06.701162+0000","last_clean":"2024-06-02T04:48:06.701162+0000","last_became_active":"2024-06-02T04:48:02.701893+0000","last_became_peered":"2024-06-02T04:48:02.701893+0000","last_unstale":"2024-06-02T04:48:06.701162+0000","last_undegraded":"2024-06-02T04:48:06.701162+0000","last_fullsized":"2024-06-02T04:48:06.701162+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:39:07.224256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.696402+0000","last_change":"2024-06-02T04:48:02.688547+0000","last_active":"2024-06-02T04:48:06.696402+0000","last_peered":"2024-06-02T04:48:06.696402+0000","last_clean":"2024-06-02T04:48:06.696402+0000","last_became_active":"2024-06-02T04:48:02.688183+0000","last_became_peered":"2024-06-02T04:48:02.688183+0000","last_unstale":"2024-06-02T04:48:06.696402+0000","last_undegraded":"2024-06-02T04:48:06.696402+0000","last_fullsized":"2024-06-02T04:48:06.696402+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:47:22.399630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.701544+0000","last_change":"2024-06-02T04:48:02.702958+0000","last_active":"2024-06-02T04:48:06.701544+0000","last_peered":"2024-06-02T04:48:06.701544+0000","last_clean":"2024-06-02T04:48:06.701544+0000","last_became_active":"2024-06-02T04:48:02.702640+0000","last_became_peered":"2024-06-02T04:48:02.702640+0000","last_unstale":"2024-06-02T04:48:06.701544+0000","last_undegraded":"2024-06-02T04:48:06.701544+0000","last_fullsized":"2024-06-02T04:48:06.701544+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T12:53:17.406762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.691930+0000","last_change":"2024-06-02T04:48:02.702817+0000","last_active":"2024-06-02T04:48:06.691930+0000","last_peered":"2024-06-02T04:48:06.691930+0000","last_clean":"2024-06-02T04:48:06.691930+0000","last_became_active":"2024-06-02T04:48:02.702526+0000","last_became_peered":"2024-06-02T04:48:02.702526+0000","last_unstale":"2024-06-02T04:48:06.691930+0000","last_undegraded":"2024-06-02T04:48:06.691930+0000","last_fullsized":"2024-06-02T04:48:06.691930+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:54:58.505585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.691852+0000","last_change":"2024-06-02T04:48:02.690645+0000","last_active":"2024-06-02T04:48:06.691852+0000","last_peered":"2024-06-02T04:48:06.691852+0000","last_clean":"2024-06-02T04:48:06.691852+0000","last_became_active":"2024-06-02T04:48:02.690282+0000","last_became_peered":"2024-06-02T04:48:02.690282+0000","last_unstale":"2024-06-02T04:48:06.691852+0000","last_undegraded":"2024-06-02T04:48:06.691852+0000","last_fullsized":"2024-06-02T04:48:06.691852+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:30:16.471475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.697098+0000","last_change":"2024-06-02T04:48:02.698865+0000","last_active":"2024-06-02T04:48:06.697098+0000","last_peered":"2024-06-02T04:48:06.697098+0000","last_clean":"2024-06-02T04:48:06.697098+0000","last_became_active":"2024-06-02T04:48:02.698554+0000","last_became_peered":"2024-06-02T04:48:02.698554+0000","last_unstale":"2024-06-02T04:48:06.697098+0000","last_undegraded":"2024-06-02T04:48:06.697098+0000","last_fullsized":"2024-06-02T04:48:06.697098+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:19:14.413170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.105716+0000","last_change":"2024-06-02T04:48:02.694345+0000","last_active":"2024-06-02T04:48:07.105716+0000","last_peered":"2024-06-02T04:48:07.105716+0000","last_clean":"2024-06-02T04:48:07.105716+0000","last_became_active":"2024-06-02T04:48:02.693866+0000","last_became_peered":"2024-06-02T04:48:02.693866+0000","last_unstale":"2024-06-02T04:48:07.105716+0000","last_undegraded":"2024-06-02T04:48:07.105716+0000","last_fullsized":"2024-06-02T04:48:07.105716+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:56:09.409774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.030106+0000","last_change":"2024-06-02T04:48:02.689609+0000","last_active":"2024-06-02T04:48:07.030106+0000","last_peered":"2024-06-02T04:48:07.030106+0000","last_clean":"2024-06-02T04:48:07.030106+0000","last_became_active":"2024-06-02T04:48:02.689279+0000","last_became_peered":"2024-06-02T04:48:02.689279+0000","last_unstale":"2024-06-02T04:48:07.030106+0000","last_undegraded":"2024-06-02T04:48:07.030106+0000","last_fullsized":"2024-06-02T04:48:07.030106+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T14:05:04.600923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.105060+0000","last_change":"2024-06-02T04:48:02.694124+0000","last_active":"2024-06-02T04:48:07.105060+0000","last_peered":"2024-06-02T04:48:07.105060+0000","last_clean":"2024-06-02T04:48:07.105060+0000","last_became_active":"2024-06-02T04:48:02.693787+0000","last_became_peered":"2024-06-02T04:48:02.693787+0000","last_unstale":"2024-06-02T04:48:07.105060+0000","last_undegraded":"2024-06-02T04:48:07.105060+0000","last_fullsized":"2024-06-02T04:48:07.105060+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T07:56:27.274107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.692381+0000","last_change":"2024-06-02T04:48:02.698736+0000","last_active":"2024-06-02T04:48:06.692381+0000","last_peered":"2024-06-02T04:48:06.692381+0000","last_clean":"2024-06-02T04:48:06.692381+0000","last_became_active":"2024-06-02T04:48:02.698285+0000","last_became_peered":"2024-06-02T04:48:02.698285+0000","last_unstale":"2024-06-02T04:48:06.692381+0000","last_undegraded":"2024-06-02T04:48:06.692381+0000","last_fullsized":"2024-06-02T04:48:06.692381+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T04:53:31.655139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.691329+0000","last_change":"2024-06-02T04:48:02.689942+0000","last_active":"2024-06-02T04:48:06.691329+0000","last_peered":"2024-06-02T04:48:06.691329+0000","last_clean":"2024-06-02T04:48:06.691329+0000","last_became_active":"2024-06-02T04:48:02.689096+0000","last_became_peered":"2024-06-02T04:48:02.689096+0000","last_unstale":"2024-06-02T04:48:06.691329+0000","last_undegraded":"2024-06-02T04:48:06.691329+0000","last_fullsized":"2024-06-02T04:48:06.691329+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:11:06.451048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.691855+0000","last_change":"2024-06-02T04:48:02.691514+0000","last_active":"2024-06-02T04:48:06.691855+0000","last_peered":"2024-06-02T04:48:06.691855+0000","last_clean":"2024-06-02T04:48:06.691855+0000","last_became_active":"2024-06-02T04:48:02.691169+0000","last_became_peered":"2024-06-02T04:48:02.691169+0000","last_unstale":"2024-06-02T04:48:06.691855+0000","last_undegraded":"2024-06-02T04:48:06.691855+0000","last_fullsized":"2024-06-02T04:48:06.691855+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T06:03:54.513910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":280790,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":25455,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":6,"num_read_kb":8,"num_write":103,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":245760,"data_stored":58419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":71,"seq":304942678029,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27876,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717276,"statfs":{"total":95995035648,"available":95966490624,"internally_reserved":0,"allocated":880640,"data_stored":442067,"data_compressed":11656,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]}]},{"osd":10,"up_from":64,"seq":274877906962,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32056,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713096,"statfs":{"total":95995035648,"available":95962210304,"internally_reserved":0,"allocated":966656,"data_stored":1033083,"data_compressed":47369,"data_compressed_allocated":61440,"data_compressed_original":622592,"omap_allocated":1599,"internal_metadata":31848897},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":1,"last update":"Sun Jun 2 04:48:17 2024","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.42499999999999999}]},{"osd":2,"last update":"Sun Jun 2 04:48:17 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.66800000000000004}]},{"osd":3,"last update":"Sun Jun 2 04:48:17 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.61099999999999999}]},{"osd":4,"last update":"Sun Jun 2 04:48:17 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.52400000000000002}]},{"osd":5,"last update":"Sun Jun 2 04:48:17 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.626}]},{"osd":6,"last update":"Sun Jun 2 04:48:17 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.65800000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":8,"last update":"Sun Jun 2 04:48:17 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.70699999999999996}]},{"osd":9,"last update":"Sun Jun 2 04:48:17 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.64400000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]}]},{"osd":9,"up_from":60,"seq":257698037781,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31988,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713164,"statfs":{"total":95995035648,"available":95962279936,"internally_reserved":0,"allocated":876544,"data_stored":437971,"data_compressed":11656,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1599,"internal_metadata":31848897},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 04:47:56 2024","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.41099999999999998}]},{"osd":1,"last update":"Sun Jun 2 04:47:56 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.58299999999999996}]},{"osd":2,"last update":"Sun Jun 2 04:47:56 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.64900000000000002}]},{"osd":3,"last update":"Sun Jun 2 04:47:56 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.434},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.35799999999999998}]},{"osd":4,"last update":"Sun Jun 2 04:47:56 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.59799999999999998}]},{"osd":5,"last update":"Sun Jun 2 04:47:56 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.498},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.67900000000000005}]},{"osd":6,"last update":"Sun Jun 2 04:47:56 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.505}]},{"osd":7,"last update":"Sun Jun 2 04:47:56 2024","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.53300000000000003}]},{"osd":8,"last update":"Sun Jun 2 04:47:56 2024","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.623},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.57299999999999995}]},{"osd":10,"last update":"Sun Jun 2 04:48:13 2024","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.61199999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]}]},{"osd":8,"up_from":53,"seq":227633266712,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27884,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717268,"statfs":{"total":95995035648,"available":95966482432,"internally_reserved":0,"allocated":888832,"data_stored":437796,"data_compressed":11656,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 04:47:37 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.57899999999999996}]},{"osd":1,"last update":"Sun Jun 2 04:47:37 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.499},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.56100000000000005}]},{"osd":2,"last update":"Sun Jun 2 04:47:37 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.432}]},{"osd":3,"last update":"Sun Jun 2 04:47:37 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.625},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.59699999999999998}]},{"osd":4,"last update":"Sun Jun 2 04:47:37 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.53600000000000003}]},{"osd":5,"last update":"Sun Jun 2 04:47:37 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.46999999999999997}]},{"osd":6,"last update":"Sun Jun 2 04:47:37 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.78200000000000003}]},{"osd":7,"last update":"Sun Jun 2 04:47:37 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.77300000000000002}]},{"osd":9,"last update":"Sun Jun 2 04:47:58 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.73999999999999999}]},{"osd":10,"last update":"Sun Jun 2 04:48:16 2024","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.68799999999999994}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]}]},{"osd":7,"up_from":46,"seq":197568495644,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32032,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713120,"statfs":{"total":95995035648,"available":95962234880,"internally_reserved":0,"allocated":925696,"data_stored":1028339,"data_compressed":47369,"data_compressed_allocated":61440,"data_compressed_original":622592,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 04:47:20 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.30199999999999999}]},{"osd":1,"last update":"Sun Jun 2 04:48:22 2024","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.42599999999999999,"15min":0.42299999999999999},"min":{"1min":0.31900000000000001,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.629,"5min":0.746,"15min":0.746},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.42999999999999999,"15min":0.42199999999999999},"min":{"1min":0.33600000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.66900000000000004,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.49399999999999999}]},{"osd":2,"last update":"Sun Jun 2 04:48:22 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.57999999999999996,"15min":0.57199999999999995},"min":{"1min":0.434,"5min":0.31,"15min":0.31},"max":{"1min":0.80700000000000005,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.58199999999999996,"15min":0.57399999999999995},"min":{"1min":0.42099999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.85899999999999999,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.71699999999999997}]},{"osd":3,"last update":"Sun Jun 2 04:48:22 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.59599999999999997,"15min":0.58999999999999997},"min":{"1min":0.435,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.93100000000000005,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.623,"5min":0.56899999999999995,"15min":0.56000000000000005},"min":{"1min":0.379,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.59599999999999997}]},{"osd":4,"last update":"Sun Jun 2 04:48:22 2024","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.442,"15min":0.437},"min":{"1min":0.34899999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.54300000000000004,"15min":0.53700000000000003},"min":{"1min":0.33200000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.746,"5min":0.879,"15min":0.879},"last":0.52300000000000002}]},{"osd":5,"last update":"Sun Jun 2 04:48:22 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.59999999999999998,"15min":0.59499999999999997},"min":{"1min":0.42099999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.66700000000000004,"15min":0.66100000000000003},"min":{"1min":0.48699999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.95299999999999996,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.73399999999999999}]},{"osd":6,"last update":"Sun Jun 2 04:48:22 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.63300000000000001,"15min":0.625},"min":{"1min":0.46899999999999997,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.629},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.624,"15min":0.61399999999999999},"min":{"1min":0.505,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.91800000000000004,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.53900000000000003}]},{"osd":8,"last update":"Sun Jun 2 04:47:40 2024","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.621}]},{"osd":9,"last update":"Sun Jun 2 04:47:56 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.66600000000000004}]},{"osd":10,"last update":"Sun Jun 2 04:48:16 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.78200000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80500000000000005}]}]},{"osd":6,"up_from":40,"seq":171798691871,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27872,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717280,"statfs":{"total":95995035648,"available":95966494720,"internally_reserved":0,"allocated":876544,"data_stored":437479,"data_compressed":11656,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 04:48:05 2024","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.38300000000000001,"15min":0.38600000000000001},"min":{"1min":0.27400000000000002,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.40200000000000002,"15min":0.41099999999999998},"min":{"1min":0.28699999999999998,"5min":0.251,"15min":0.251},"max":{"1min":0.49199999999999999,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.41699999999999998}]},{"osd":1,"last update":"Sun Jun 2 04:48:05 2024","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.56000000000000005,"15min":0.56399999999999995},"min":{"1min":0.378,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.73499999999999999,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.57899999999999996,"15min":0.58399999999999996},"min":{"1min":0.33600000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.749,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.56200000000000006}]},{"osd":2,"last update":"Sun Jun 2 04:48:05 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.56699999999999995,"15min":0.56899999999999995},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.746,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.57899999999999996,"15min":0.58199999999999996},"min":{"1min":0.40000000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.78300000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.68100000000000005}]},{"osd":3,"last update":"Sun Jun 2 04:48:05 2024","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.44700000000000001,"15min":0.45600000000000002},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.65700000000000003,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.441},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.46400000000000002,"15min":0.47099999999999997},"min":{"1min":0.32800000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.52900000000000003,"5min":0.745,"15min":0.745},"last":0.51700000000000002}]},{"osd":4,"last update":"Sun Jun 2 04:48:05 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.60199999999999998,"15min":0.60399999999999998},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.78900000000000003,"5min":1.032,"15min":1.032},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.626,"15min":0.63800000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.69799999999999995,"5min":1.071,"15min":1.071},"last":0.60099999999999998}]},{"osd":5,"last update":"Sun Jun 2 04:48:05 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.61499999999999999,"15min":0.62},"min":{"1min":0.39500000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.64500000000000002,"15min":0.65100000000000002},"min":{"1min":0.48099999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.77000000000000002,"5min":0.999,"15min":0.999},"last":0.871}]},{"osd":7,"last update":"Sun Jun 2 04:48:23 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.63600000000000001,"15min":0.63900000000000001},"min":{"1min":0.45300000000000001,"5min":0.439,"15min":0.439},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.747},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.64100000000000001,"15min":0.64800000000000002},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.79400000000000004,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.63900000000000001}]},{"osd":8,"last update":"Sun Jun 2 04:47:39 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.83699999999999997}]},{"osd":9,"last update":"Sun Jun 2 04:47:56 2024","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.66600000000000004}]},{"osd":10,"last update":"Sun Jun 2 04:48:15 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.75800000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85699999999999998}]}]},{"osd":1,"up_from":12,"seq":51539607601,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36088,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93709064,"statfs":{"total":95995035648,"available":95958081536,"internally_reserved":0,"allocated":901120,"data_stored":456387,"data_compressed":11656,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 04:47:44 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.49399999999999999,"15min":0.48599999999999999},"min":{"1min":0.30199999999999999,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.48999999999999999,"15min":0.48599999999999999},"min":{"1min":0.34399999999999997,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.66900000000000004,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.46300000000000002}]},{"osd":2,"last update":"Sun Jun 2 04:47:59 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.35599999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.51000000000000001,"15min":0.502},"min":{"1min":0.38600000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.57699999999999996}]},{"osd":3,"last update":"Sun Jun 2 04:48:16 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.5,"15min":0.48799999999999999},"min":{"1min":0.35499999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.50900000000000001,"15min":0.503},"min":{"1min":0.377,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.376}]},{"osd":4,"last update":"Sun Jun 2 04:47:39 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.39800000000000002,"15min":0.38600000000000001},"min":{"1min":0.26400000000000001,"5min":0.248,"15min":0.248},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.41899999999999998,"15min":0.40699999999999997},"min":{"1min":0.30499999999999999,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.47699999999999998}]},{"osd":5,"last update":"Sun Jun 2 04:47:50 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.54200000000000004,"15min":0.53500000000000003},"min":{"1min":0.36299999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.627},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.60499999999999998,"15min":0.59299999999999997},"min":{"1min":0.48399999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.61899999999999999}]},{"osd":6,"last update":"Sun Jun 2 04:48:07 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.60499999999999998,"15min":0.59299999999999997},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.60399999999999998,"15min":0.59399999999999997},"min":{"1min":0.51000000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.56499999999999995}]},{"osd":7,"last update":"Sun Jun 2 04:48:27 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.53900000000000003,"15min":0.53800000000000003},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.498},{"interface":"front","average":{"1min":0.627,"5min":0.58799999999999997,"15min":0.58199999999999996},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.63900000000000001}]},{"osd":8,"last update":"Sun Jun 2 04:47:39 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.65300000000000002}]},{"osd":9,"last update":"Sun Jun 2 04:47:57 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.67700000000000005}]},{"osd":10,"last update":"Sun Jun 2 04:48:16 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.68899999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]}]},{"osd":0,"up_from":8,"seq":34359738419,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31976,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713176,"statfs":{"total":95995035648,"available":95962292224,"internally_reserved":0,"allocated":884736,"data_stored":438083,"data_compressed":11656,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jun 2 04:47:42 2024","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.48899999999999999,"15min":0.46300000000000002},"min":{"1min":0.41199999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.48899999999999999,"15min":0.45800000000000002},"min":{"1min":0.39500000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.52800000000000002}]},{"osd":2,"last update":"Sun Jun 2 04:48:00 2024","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.495,"15min":0.46700000000000003},"min":{"1min":0.39300000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.51800000000000002,"15min":0.47999999999999998},"min":{"1min":0.46000000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.84799999999999998,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.621}]},{"osd":3,"last update":"Sun Jun 2 04:47:17 2024","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.41899999999999998,"15min":0.40699999999999997},"min":{"1min":0.317,"5min":0.253,"15min":0.253},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.438,"15min":0.436},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.33600000000000002}]},{"osd":4,"last update":"Sun Jun 2 04:47:32 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.53200000000000003,"15min":0.51600000000000001},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.81100000000000005,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.52700000000000002,"15min":0.52000000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.54200000000000004}]},{"osd":5,"last update":"Sun Jun 2 04:47:51 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.55200000000000005,"15min":0.53200000000000003},"min":{"1min":0.47599999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.56000000000000005,"15min":0.53700000000000003},"min":{"1min":0.55700000000000005,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.57299999999999995}]},{"osd":6,"last update":"Sun Jun 2 04:48:08 2024","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.49199999999999999,"15min":0.49299999999999999},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.76300000000000001,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.47099999999999997,"15min":0.46899999999999997},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.44700000000000001}]},{"osd":7,"last update":"Sun Jun 2 04:47:21 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.68500000000000005}]},{"osd":8,"last update":"Sun Jun 2 04:47:38 2024","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.65800000000000003}]},{"osd":9,"last update":"Sun Jun 2 04:47:56 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.503}]},{"osd":10,"last update":"Sun Jun 2 04:48:16 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.59299999999999997}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]}]},{"osd":2,"up_from":16,"seq":68719476781,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31980,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713172,"statfs":{"total":95995035648,"available":95962288128,"internally_reserved":0,"allocated":888832,"data_stored":441219,"data_compressed":11656,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 04:48:05 2024","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.496,"15min":0.48599999999999999},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.71499999999999997,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.50800000000000001,"15min":0.50900000000000001},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.66200000000000003,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.45300000000000001}]},{"osd":1,"last update":"Sun Jun 2 04:48:05 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.53500000000000003,"15min":0.52900000000000003},"min":{"1min":0.36899999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.74299999999999999,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.54200000000000004,"15min":0.54400000000000004},"min":{"1min":0.39700000000000002,"5min":0.254,"15min":0.254},"max":{"1min":0.79300000000000004,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.72999999999999998}]},{"osd":3,"last update":"Sun Jun 2 04:48:22 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.55500000000000005,"15min":0.55700000000000005},"min":{"1min":0.39000000000000001,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.71599999999999997,"5min":1.472,"15min":1.472},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.53200000000000003,"15min":0.52700000000000002},"min":{"1min":0.372,"5min":0.308,"15min":0.308},"max":{"1min":0.80400000000000005,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.52400000000000002}]},{"osd":4,"last update":"Sun Jun 2 04:47:33 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.51700000000000002,"15min":0.51300000000000001},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.68100000000000005,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.34699999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.66400000000000003,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.74199999999999999}]},{"osd":5,"last update":"Sun Jun 2 04:47:51 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.432,"15min":0.41599999999999998},"min":{"1min":0.29599999999999999,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.45900000000000002,"15min":0.44500000000000001},"min":{"1min":0.32000000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.58199999999999996}]},{"osd":6,"last update":"Sun Jun 2 04:48:05 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.39900000000000002,"5min":0.372,"15min":0.372},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.503},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.64000000000000001,"15min":0.63300000000000001},"min":{"1min":0.45400000000000001,"5min":0.438,"15min":0.438},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.69599999999999995}]},{"osd":7,"last update":"Sun Jun 2 04:47:24 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.68100000000000005}]},{"osd":8,"last update":"Sun Jun 2 04:47:38 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.64800000000000002}]},{"osd":9,"last update":"Sun Jun 2 04:48:01 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.85099999999999998}]},{"osd":10,"last update":"Sun Jun 2 04:48:16 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.71799999999999997}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]}]},{"osd":3,"up_from":22,"seq":94489280553,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31976,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713176,"statfs":{"total":95995035648,"available":95962292224,"internally_reserved":0,"allocated":884736,"data_stored":437583,"data_compressed":11656,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 04:48:20 2024","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.32400000000000001,"15min":0.312},"min":{"1min":0.24199999999999999,"5min":0.221,"15min":0.221},"max":{"1min":0.44400000000000001,"5min":0.48999999999999999,"15min":0.48999999999999999},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.34899999999999998,"15min":0.34100000000000003},"min":{"1min":0.255,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.55500000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.47399999999999998}]},{"osd":1,"last update":"Sun Jun 2 04:48:20 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.48299999999999998,"15min":0.46300000000000002},"min":{"1min":0.40999999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.65700000000000003,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.48999999999999999,"15min":0.46200000000000002},"min":{"1min":0.39100000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.68799999999999994,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.55100000000000005}]},{"osd":2,"last update":"Sun Jun 2 04:48:20 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.56000000000000005,"15min":0.56399999999999995},"min":{"1min":0.377,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.73999999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.57899999999999996,"15min":0.59099999999999997},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.63300000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":0.77000000000000002}]},{"osd":4,"last update":"Sun Jun 2 04:47:34 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.502,"15min":0.495},"min":{"1min":0.38400000000000001,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.50700000000000001,"15min":0.499},"min":{"1min":0.33800000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.67300000000000004}]},{"osd":5,"last update":"Sun Jun 2 04:47:51 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.55200000000000005,"15min":0.54900000000000004},"min":{"1min":0.42599999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.81999999999999995,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.65300000000000002}]},{"osd":6,"last update":"Sun Jun 2 04:48:06 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.46899999999999997,"15min":0.46700000000000003},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.628},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.47199999999999998,"15min":0.47099999999999997},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.63200000000000001,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.51900000000000002}]},{"osd":7,"last update":"Sun Jun 2 04:48:26 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.44900000000000001,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.80500000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.628,"5min":0.64800000000000002,"15min":0.65100000000000002},"min":{"1min":0.48899999999999999,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.751,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.751}]},{"osd":8,"last update":"Sun Jun 2 04:47:39 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.51100000000000001}]},{"osd":9,"last update":"Sun Jun 2 04:48:00 2024","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.66100000000000003}]},{"osd":10,"last update":"Sun Jun 2 04:48:14 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.82399999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]}]},{"osd":4,"up_from":29,"seq":124554051622,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31980,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713172,"statfs":{"total":95995035648,"available":95962288128,"internally_reserved":0,"allocated":876544,"data_stored":437411,"data_compressed":11656,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 04:47:31 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.49199999999999999,"15min":0.48099999999999998},"min":{"1min":0.32400000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.495,"15min":0.48699999999999999},"min":{"1min":0.35199999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.78900000000000003,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.34300000000000003}]},{"osd":1,"last update":"Sun Jun 2 04:47:31 2024","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.34399999999999997,"15min":0.33800000000000002},"min":{"1min":0.30199999999999999,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.495,"5min":0.495,"15min":0.495},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.36899999999999999,"15min":0.36099999999999999},"min":{"1min":0.26100000000000001,"5min":0.217,"15min":0.217},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.40999999999999998}]},{"osd":2,"last update":"Sun Jun 2 04:47:31 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.52500000000000002,"15min":0.52300000000000002},"min":{"1min":0.41699999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.73599999999999999,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.622,"5min":0.54400000000000004,"15min":0.53100000000000003},"min":{"1min":0.44,"5min":0.377,"15min":0.377},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.56999999999999995}]},{"osd":3,"last update":"Sun Jun 2 04:47:31 2024","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.52200000000000002,"15min":0.51200000000000001},"min":{"1min":0.38200000000000001,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.51200000000000001,"15min":0.50700000000000001},"min":{"1min":0.34000000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.68799999999999994,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.38100000000000001}]},{"osd":5,"last update":"Sun Jun 2 04:47:49 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.60299999999999998,"15min":0.59999999999999998},"min":{"1min":0.40699999999999997,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.59999999999999998,"15min":0.59299999999999997},"min":{"1min":0.45200000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.65300000000000002}]},{"osd":6,"last update":"Sun Jun 2 04:48:07 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.57199999999999995,"15min":0.55700000000000005},"min":{"1min":0.40100000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.59199999999999997,"15min":0.57599999999999996},"min":{"1min":0.41999999999999998,"5min":0.379,"15min":0.379},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.45000000000000001}]},{"osd":7,"last update":"Sun Jun 2 04:48:24 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.53100000000000003,"15min":0.52200000000000002},"min":{"1min":0.36399999999999999,"5min":0.312,"15min":0.312},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.56499999999999995,"15min":0.55100000000000005},"min":{"1min":0.38100000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.61699999999999999}]},{"osd":8,"last update":"Sun Jun 2 04:47:38 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.63900000000000001}]},{"osd":9,"last update":"Sun Jun 2 04:47:58 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.5}]},{"osd":10,"last update":"Sun Jun 2 04:48:15 2024","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.69999999999999996}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]}]},{"osd":5,"up_from":33,"seq":141733920803,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":950272,"data_stored":1029185,"data_compressed":47369,"data_compressed_allocated":61440,"data_compressed_original":622592,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 04:47:50 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.48899999999999999,"15min":0.47999999999999998},"min":{"1min":0.35299999999999998,"5min":0.249,"15min":0.249},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.46000000000000002,"15min":0.44600000000000001},"min":{"1min":0.38700000000000001,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.374}]},{"osd":1,"last update":"Sun Jun 2 04:47:50 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.52900000000000003,"15min":0.52100000000000002},"min":{"1min":0.36699999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.53800000000000003,"15min":0.53100000000000003},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.64900000000000002}]},{"osd":2,"last update":"Sun Jun 2 04:47:50 2024","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.39100000000000001,"15min":0.38900000000000001},"min":{"1min":0.26900000000000002,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.317},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.38100000000000001,"15min":0.377},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.34000000000000002}]},{"osd":3,"last update":"Sun Jun 2 04:47:50 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.51900000000000002,"15min":0.51700000000000002},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.70499999999999996,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.51500000000000001,"15min":0.504},"min":{"1min":0.41999999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.46100000000000002}]},{"osd":4,"last update":"Sun Jun 2 04:47:50 2024","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.55500000000000005,"15min":0.55000000000000004},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.54300000000000004}]},{"osd":6,"last update":"Sun Jun 2 04:48:07 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56999999999999995,"15min":0.57099999999999995},"min":{"1min":0.42099999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.439},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.58599999999999997,"15min":0.57799999999999996},"min":{"1min":0.46800000000000003,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.55500000000000005}]},{"osd":7,"last update":"Sun Jun 2 04:48:23 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.65600000000000003,"15min":0.65400000000000003},"min":{"1min":0.42499999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.92400000000000004,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.625},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.65500000000000003,"15min":0.64700000000000002},"min":{"1min":0.45400000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.71199999999999997}]},{"osd":8,"last update":"Sun Jun 2 04:47:41 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.48599999999999999}]},{"osd":9,"last update":"Sun Jun 2 04:48:01 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.498},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.60699999999999998}]},{"osd":10,"last update":"Sun Jun 2 04:48:13 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.66000000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34075,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34075,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34075,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35713,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35713,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35713,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35713,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35713,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":23097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":25020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-02T04:48:31.402 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-02T04:48:31.557 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.555+0000 7f1fb9b7a700 1 -- 172.21.15.76:0/2658677495 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1fb41018f0 msgr2=0x7f1fb41081a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:31.557 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.555+0000 7f1fb9b7a700 1 --2- 172.21.15.76:0/2658677495 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1fb41018f0 0x7f1fb41081a0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f1fac00b0d0 tx=0x7f1fac00b3e0 comp rx=0 tx=0).stop 2024-06-02T04:48:31.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.555+0000 7f1fb9b7a700 1 -- 172.21.15.76:0/2658677495 shutdown_connections 2024-06-02T04:48:31.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.555+0000 7f1fb9b7a700 1 --2- 172.21.15.76:0/2658677495 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1fb41018f0 0x7f1fb41081a0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:31.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.555+0000 7f1fb9b7a700 1 --2- 172.21.15.76:0/2658677495 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1fb40ffd60 0x7f1fb4100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:31.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.555+0000 7f1fb9b7a700 1 --2- 172.21.15.76:0/2658677495 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1fb4100f50 0x7f1fb41013b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:31.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.555+0000 7f1fb9b7a700 1 -- 172.21.15.76:0/2658677495 >> 172.21.15.76:0/2658677495 conn(0x7f1fb40fb2f0 msgr2=0x7f1fb40fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:31.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.555+0000 7f1fb9b7a700 1 -- 172.21.15.76:0/2658677495 shutdown_connections 2024-06-02T04:48:31.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.555+0000 7f1fb9b7a700 1 -- 172.21.15.76:0/2658677495 wait complete. 2024-06-02T04:48:31.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.556+0000 7f1fb9b7a700 1 Processor -- start 2024-06-02T04:48:31.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.556+0000 7f1fb9b7a700 1 -- start start 2024-06-02T04:48:31.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.556+0000 7f1fb9b7a700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1fb40ffd60 0x7f1fb4199020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:31.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.556+0000 7f1fb9b7a700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1fb4100f50 0x7f1fb4199560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:31.559 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.556+0000 7f1fb9b7a700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1fb41018f0 0x7f1fb41a0580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:31.559 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.556+0000 7f1fb9b7a700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb41a0b50 con 0x7f1fb41018f0 2024-06-02T04:48:31.559 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.556+0000 7f1fb9b7a700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb41a0c90 con 0x7f1fb4100f50 2024-06-02T04:48:31.559 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.556+0000 7f1fb9b7a700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb41a0e20 con 0x7f1fb40ffd60 2024-06-02T04:48:31.559 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.556+0000 7f1fb3fff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1fb41018f0 0x7f1fb41a0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:31.559 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.556+0000 7f1fb3fff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1fb41018f0 0x7f1fb41a0580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:40960/0 (socket says 172.21.15.76:40960) 2024-06-02T04:48:31.559 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.556+0000 7f1fb3fff700 1 -- 172.21.15.76:0/1526749634 learned_addr learned my addr 172.21.15.76:0/1526749634 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:48:31.559 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.556+0000 7f1fb2ffd700 1 --2- 172.21.15.76:0/1526749634 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1fb4100f50 0x7f1fb4199560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:31.560 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.556+0000 7f1fb37fe700 1 --2- 172.21.15.76:0/1526749634 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1fb40ffd60 0x7f1fb4199020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:31.560 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.556+0000 7f1fb3fff700 1 -- 172.21.15.76:0/1526749634 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1fb40ffd60 msgr2=0x7f1fb4199020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:31.560 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.556+0000 7f1fb3fff700 1 --2- 172.21.15.76:0/1526749634 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1fb40ffd60 0x7f1fb4199020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:31.560 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.556+0000 7f1fb3fff700 1 -- 172.21.15.76:0/1526749634 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1fb4100f50 msgr2=0x7f1fb4199560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:31.560 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.556+0000 7f1fb3fff700 1 --2- 172.21.15.76:0/1526749634 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1fb4100f50 0x7f1fb4199560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:31.560 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.556+0000 7f1fb3fff700 1 -- 172.21.15.76:0/1526749634 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fac009d00 con 0x7f1fb41018f0 2024-06-02T04:48:31.560 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.557+0000 7f1fb3fff700 1 --2- 172.21.15.76:0/1526749634 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1fb41018f0 0x7f1fb41a0580 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f1fac007af0 tx=0x7f1fac007850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:31.560 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.557+0000 7f1fb0ff9700 1 -- 172.21.15.76:0/1526749634 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fac00e040 con 0x7f1fb41018f0 2024-06-02T04:48:31.560 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.557+0000 7f1fb9b7a700 1 -- 172.21.15.76:0/1526749634 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fb41a10a0 con 0x7f1fb41018f0 2024-06-02T04:48:31.560 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.557+0000 7f1fb0ff9700 1 -- 172.21.15.76:0/1526749634 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1fac00be30 con 0x7f1fb41018f0 2024-06-02T04:48:31.560 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.557+0000 7f1fb0ff9700 1 -- 172.21.15.76:0/1526749634 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fac01b9f0 con 0x7f1fb41018f0 2024-06-02T04:48:31.560 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.557+0000 7f1fb9b7a700 1 -- 172.21.15.76:0/1526749634 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fb41a1520 con 0x7f1fb41018f0 2024-06-02T04:48:31.561 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.558+0000 7f1fb9b7a700 1 -- 172.21.15.76:0/1526749634 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fb4067c10 con 0x7f1fb41018f0 2024-06-02T04:48:31.561 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.559+0000 7f1fb0ff9700 1 -- 172.21.15.76:0/1526749634 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f1fac01d670 con 0x7f1fb41018f0 2024-06-02T04:48:31.561 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.560+0000 7f1fb0ff9700 1 --2- 172.21.15.76:0/1526749634 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f1f9c0a11b0 0x7f1f9c0a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:31.561 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.560+0000 7f1fb0ff9700 1 -- 172.21.15.76:0/1526749634 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f1fac0ce100 con 0x7f1fb41018f0 2024-06-02T04:48:31.562 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.560+0000 7f1fb37fe700 1 --2- 172.21.15.76:0/1526749634 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f1f9c0a11b0 0x7f1f9c0a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:31.562 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.560+0000 7f1fb37fe700 1 --2- 172.21.15.76:0/1526749634 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f1f9c0a11b0 0x7f1f9c0a3670 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f1fb4100db0 tx=0x7f1fa400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:31.564 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.564+0000 7f1fb0ff9700 1 -- 172.21.15.76:0/1526749634 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f1fac097570 con 0x7f1fb41018f0 2024-06-02T04:48:31.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:31 smithi119 ceph-mon[46633]: from='client.14886 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:48:31.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:31 smithi119 ceph-mon[46633]: from='client.14892 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:48:31.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:31 smithi119 ceph-mon[46633]: pgmap v232: 129 pgs: 129 active+clean; 601 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 682 B/s rd, 3.2 KiB/s wr, 5 op/s 2024-06-02T04:48:31.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:31 smithi119 ceph-mon[46633]: from='client.14898 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:48:31.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:31 smithi119 ceph-mon[46633]: mgrmap e17: x(active, since 5m), standbys: z, y 2024-06-02T04:48:31.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:31 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/2898032428' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:48:31.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:31 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/2909761295' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:48:31.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:31 smithi192 ceph-mon[47933]: from='client.14886 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:48:31.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:31 smithi192 ceph-mon[47933]: from='client.14892 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:48:31.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:31 smithi192 ceph-mon[47933]: pgmap v232: 129 pgs: 129 active+clean; 601 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 682 B/s rd, 3.2 KiB/s wr, 5 op/s 2024-06-02T04:48:31.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:31 smithi192 ceph-mon[47933]: from='client.14898 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:48:31.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:31 smithi192 ceph-mon[47933]: mgrmap e17: x(active, since 5m), standbys: z, y 2024-06-02T04:48:31.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:31 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/2898032428' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:48:31.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:31 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/2909761295' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:48:31.759 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.759+0000 7f1fb9b7a700 1 -- 172.21.15.76:0/1526749634 --> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1fb40687b0 con 0x7f1f9c0a11b0 2024-06-02T04:48:31.771 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.771+0000 7f1fb0ff9700 1 -- 172.21.15.76:0/1526749634 <== mgr.14152 v2:172.21.15.76:6800/2591353090 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+418061 (secure 0 0 0) 0x7f1fb40687b0 con 0x7f1f9c0a11b0 2024-06-02T04:48:31.776 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:48:31.779 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.775+0000 7f1fb9b7a700 1 -- 172.21.15.76:0/1526749634 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f1f9c0a11b0 msgr2=0x7f1f9c0a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:31.779 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.775+0000 7f1fb9b7a700 1 --2- 172.21.15.76:0/1526749634 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f1f9c0a11b0 0x7f1f9c0a3670 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f1fb4100db0 tx=0x7f1fa400b410 comp rx=0 tx=0).stop 2024-06-02T04:48:31.779 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.775+0000 7f1fb9b7a700 1 -- 172.21.15.76:0/1526749634 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1fb41018f0 msgr2=0x7f1fb41a0580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:31.779 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.775+0000 7f1fb9b7a700 1 --2- 172.21.15.76:0/1526749634 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1fb41018f0 0x7f1fb41a0580 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f1fac007af0 tx=0x7f1fac007850 comp rx=0 tx=0).stop 2024-06-02T04:48:31.780 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.775+0000 7f1fb9b7a700 1 -- 172.21.15.76:0/1526749634 shutdown_connections 2024-06-02T04:48:31.780 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.775+0000 7f1fb9b7a700 1 --2- 172.21.15.76:0/1526749634 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1fb41018f0 0x7f1fb41a0580 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:31.780 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.775+0000 7f1fb9b7a700 1 --2- 172.21.15.76:0/1526749634 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1fb40ffd60 0x7f1fb4199020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:31.780 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.775+0000 7f1fb9b7a700 1 --2- 172.21.15.76:0/1526749634 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f1f9c0a11b0 0x7f1f9c0a3670 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:31.780 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.775+0000 7f1fb9b7a700 1 --2- 172.21.15.76:0/1526749634 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1fb4100f50 0x7f1fb4199560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:31.780 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.775+0000 7f1fb9b7a700 1 -- 172.21.15.76:0/1526749634 >> 172.21.15.76:0/1526749634 conn(0x7f1fb40fb2f0 msgr2=0x7f1fb40680a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:31.780 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.775+0000 7f1fb9b7a700 1 -- 172.21.15.76:0/1526749634 shutdown_connections 2024-06-02T04:48:31.780 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:31.775+0000 7f1fb9b7a700 1 -- 172.21.15.76:0/1526749634 wait complete. 2024-06-02T04:48:31.780 INFO:teuthology.orchestra.run.smithi076.stderr:dumped all 2024-06-02T04:48:31.787 INFO:teuthology.orchestra.run.smithi076.stdout:{"pg_ready":true,"pg_map":{"version":232,"stamp":"2024-06-02T04:48:30.155579+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":615823,"num_objects":46,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":132,"num_read_kb":117,"num_write":284,"num_write_kb":2994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":229,"ondisk_log_size":229,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":371652,"kb_used_data":10548,"kb_used_omap":18,"kb_used_meta":360941,"kb_avail":1124570172,"statfs":{"total":1151940427776,"available":1151559856128,"internally_reserved":0,"allocated":10801152,"data_stored":7056603,"data_compressed":247011,"data_compressed_allocated":331776,"data_compressed_original":2162688,"omap_allocated":19131,"internal_metadata":369603909},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":21002,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":6,"num_read_kb":8,"num_write":56,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003622"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.692267+0000","last_change":"2024-06-02T04:48:02.689765+0000","last_active":"2024-06-02T04:48:06.692267+0000","last_peered":"2024-06-02T04:48:06.692267+0000","last_clean":"2024-06-02T04:48:06.692267+0000","last_became_active":"2024-06-02T04:48:02.689464+0000","last_became_peered":"2024-06-02T04:48:02.689464+0000","last_unstale":"2024-06-02T04:48:06.692267+0000","last_undegraded":"2024-06-02T04:48:06.692267+0000","last_fullsized":"2024-06-02T04:48:06.692267+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:13:19.743519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.701845+0000","last_change":"2024-06-02T04:48:02.691499+0000","last_active":"2024-06-02T04:48:06.701845+0000","last_peered":"2024-06-02T04:48:06.701845+0000","last_clean":"2024-06-02T04:48:06.701845+0000","last_became_active":"2024-06-02T04:48:02.691179+0000","last_became_peered":"2024-06-02T04:48:02.691179+0000","last_unstale":"2024-06-02T04:48:06.701845+0000","last_undegraded":"2024-06-02T04:48:06.701845+0000","last_fullsized":"2024-06-02T04:48:06.701845+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T14:00:17.118877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.701714+0000","last_change":"2024-06-02T04:48:02.688527+0000","last_active":"2024-06-02T04:48:06.701714+0000","last_peered":"2024-06-02T04:48:06.701714+0000","last_clean":"2024-06-02T04:48:06.701714+0000","last_became_active":"2024-06-02T04:48:02.688184+0000","last_became_peered":"2024-06-02T04:48:02.688184+0000","last_unstale":"2024-06-02T04:48:06.701714+0000","last_undegraded":"2024-06-02T04:48:06.701714+0000","last_fullsized":"2024-06-02T04:48:06.701714+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T08:40:35.052887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.697066+0000","last_change":"2024-06-02T04:48:02.695277+0000","last_active":"2024-06-02T04:48:06.697066+0000","last_peered":"2024-06-02T04:48:06.697066+0000","last_clean":"2024-06-02T04:48:06.697066+0000","last_became_active":"2024-06-02T04:48:02.694951+0000","last_became_peered":"2024-06-02T04:48:02.694951+0000","last_unstale":"2024-06-02T04:48:06.697066+0000","last_undegraded":"2024-06-02T04:48:06.697066+0000","last_fullsized":"2024-06-02T04:48:06.697066+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T14:13:50.672421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.696221+0000","last_change":"2024-06-02T04:48:02.691454+0000","last_active":"2024-06-02T04:48:06.696221+0000","last_peered":"2024-06-02T04:48:06.696221+0000","last_clean":"2024-06-02T04:48:06.696221+0000","last_became_active":"2024-06-02T04:48:02.691083+0000","last_became_peered":"2024-06-02T04:48:02.691083+0000","last_unstale":"2024-06-02T04:48:06.696221+0000","last_undegraded":"2024-06-02T04:48:06.696221+0000","last_fullsized":"2024-06-02T04:48:06.696221+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T07:12:58.481115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.961870+0000","last_change":"2024-06-02T04:48:02.690371+0000","last_active":"2024-06-02T04:48:06.961870+0000","last_peered":"2024-06-02T04:48:06.961870+0000","last_clean":"2024-06-02T04:48:06.961870+0000","last_became_active":"2024-06-02T04:48:02.682047+0000","last_became_peered":"2024-06-02T04:48:02.682047+0000","last_unstale":"2024-06-02T04:48:06.961870+0000","last_undegraded":"2024-06-02T04:48:06.961870+0000","last_fullsized":"2024-06-02T04:48:06.961870+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:17:59.717575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.698244+0000","last_change":"2024-06-02T04:48:02.697823+0000","last_active":"2024-06-02T04:48:06.698244+0000","last_peered":"2024-06-02T04:48:06.698244+0000","last_clean":"2024-06-02T04:48:06.698244+0000","last_became_active":"2024-06-02T04:48:02.697491+0000","last_became_peered":"2024-06-02T04:48:02.697491+0000","last_unstale":"2024-06-02T04:48:06.698244+0000","last_undegraded":"2024-06-02T04:48:06.698244+0000","last_fullsized":"2024-06-02T04:48:06.698244+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T16:08:39.689192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.105002+0000","last_change":"2024-06-02T04:48:02.702564+0000","last_active":"2024-06-02T04:48:07.105002+0000","last_peered":"2024-06-02T04:48:07.105002+0000","last_clean":"2024-06-02T04:48:07.105002+0000","last_became_active":"2024-06-02T04:48:02.702259+0000","last_became_peered":"2024-06-02T04:48:02.702259+0000","last_unstale":"2024-06-02T04:48:07.105002+0000","last_undegraded":"2024-06-02T04:48:07.105002+0000","last_fullsized":"2024-06-02T04:48:07.105002+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T12:33:28.945414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.692781+0000","last_change":"2024-06-02T04:48:02.694090+0000","last_active":"2024-06-02T04:48:06.692781+0000","last_peered":"2024-06-02T04:48:06.692781+0000","last_clean":"2024-06-02T04:48:06.692781+0000","last_became_active":"2024-06-02T04:48:02.693723+0000","last_became_peered":"2024-06-02T04:48:02.693723+0000","last_unstale":"2024-06-02T04:48:06.692781+0000","last_undegraded":"2024-06-02T04:48:06.692781+0000","last_fullsized":"2024-06-02T04:48:06.692781+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:33:26.628450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.963109+0000","last_change":"2024-06-02T04:48:02.702201+0000","last_active":"2024-06-02T04:48:06.963109+0000","last_peered":"2024-06-02T04:48:06.963109+0000","last_clean":"2024-06-02T04:48:06.963109+0000","last_became_active":"2024-06-02T04:48:02.701834+0000","last_became_peered":"2024-06-02T04:48:02.701834+0000","last_unstale":"2024-06-02T04:48:06.963109+0000","last_undegraded":"2024-06-02T04:48:06.963109+0000","last_fullsized":"2024-06-02T04:48:06.963109+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T08:22:24.009015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.699587+0000","last_change":"2024-06-02T04:48:02.700280+0000","last_active":"2024-06-02T04:48:06.699587+0000","last_peered":"2024-06-02T04:48:06.699587+0000","last_clean":"2024-06-02T04:48:06.699587+0000","last_became_active":"2024-06-02T04:48:02.699852+0000","last_became_peered":"2024-06-02T04:48:02.699852+0000","last_unstale":"2024-06-02T04:48:06.699587+0000","last_undegraded":"2024-06-02T04:48:06.699587+0000","last_fullsized":"2024-06-02T04:48:06.699587+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T16:45:28.228692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.696970+0000","last_change":"2024-06-02T04:48:02.689951+0000","last_active":"2024-06-02T04:48:06.696970+0000","last_peered":"2024-06-02T04:48:06.696970+0000","last_clean":"2024-06-02T04:48:06.696970+0000","last_became_active":"2024-06-02T04:48:02.689249+0000","last_became_peered":"2024-06-02T04:48:02.689249+0000","last_unstale":"2024-06-02T04:48:06.696970+0000","last_undegraded":"2024-06-02T04:48:06.696970+0000","last_fullsized":"2024-06-02T04:48:06.696970+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:09:43.620165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.691345+0000","last_change":"2024-06-02T04:48:02.691126+0000","last_active":"2024-06-02T04:48:06.691345+0000","last_peered":"2024-06-02T04:48:06.691345+0000","last_clean":"2024-06-02T04:48:06.691345+0000","last_became_active":"2024-06-02T04:48:02.690825+0000","last_became_peered":"2024-06-02T04:48:02.690825+0000","last_unstale":"2024-06-02T04:48:06.691345+0000","last_undegraded":"2024-06-02T04:48:06.691345+0000","last_fullsized":"2024-06-02T04:48:06.691345+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:03:36.461555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.708124+0000","last_change":"2024-06-02T04:48:02.692802+0000","last_active":"2024-06-02T04:48:06.708124+0000","last_peered":"2024-06-02T04:48:06.708124+0000","last_clean":"2024-06-02T04:48:06.708124+0000","last_became_active":"2024-06-02T04:48:02.692495+0000","last_became_peered":"2024-06-02T04:48:02.692495+0000","last_unstale":"2024-06-02T04:48:06.708124+0000","last_undegraded":"2024-06-02T04:48:06.708124+0000","last_fullsized":"2024-06-02T04:48:06.708124+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T14:57:10.991752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.701916+0000","last_change":"2024-06-02T04:48:02.702968+0000","last_active":"2024-06-02T04:48:06.701916+0000","last_peered":"2024-06-02T04:48:06.701916+0000","last_clean":"2024-06-02T04:48:06.701916+0000","last_became_active":"2024-06-02T04:48:02.702672+0000","last_became_peered":"2024-06-02T04:48:02.702672+0000","last_unstale":"2024-06-02T04:48:06.701916+0000","last_undegraded":"2024-06-02T04:48:06.701916+0000","last_fullsized":"2024-06-02T04:48:06.701916+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:04:38.385228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.691702+0000","last_change":"2024-06-02T04:48:02.701329+0000","last_active":"2024-06-02T04:48:06.691702+0000","last_peered":"2024-06-02T04:48:06.691702+0000","last_clean":"2024-06-02T04:48:06.691702+0000","last_became_active":"2024-06-02T04:48:02.701064+0000","last_became_peered":"2024-06-02T04:48:02.701064+0000","last_unstale":"2024-06-02T04:48:06.691702+0000","last_undegraded":"2024-06-02T04:48:06.691702+0000","last_fullsized":"2024-06-02T04:48:06.691702+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:28:06.265050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.692151+0000","last_change":"2024-06-02T04:48:02.688538+0000","last_active":"2024-06-02T04:48:06.692151+0000","last_peered":"2024-06-02T04:48:06.692151+0000","last_clean":"2024-06-02T04:48:06.692151+0000","last_became_active":"2024-06-02T04:48:02.688175+0000","last_became_peered":"2024-06-02T04:48:02.688175+0000","last_unstale":"2024-06-02T04:48:06.692151+0000","last_undegraded":"2024-06-02T04:48:06.692151+0000","last_fullsized":"2024-06-02T04:48:06.692151+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T07:30:47.310924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.697897+0000","last_change":"2024-06-02T04:48:02.688515+0000","last_active":"2024-06-02T04:48:06.697897+0000","last_peered":"2024-06-02T04:48:06.697897+0000","last_clean":"2024-06-02T04:48:06.697897+0000","last_became_active":"2024-06-02T04:48:02.688205+0000","last_became_peered":"2024-06-02T04:48:02.688205+0000","last_unstale":"2024-06-02T04:48:06.697897+0000","last_undegraded":"2024-06-02T04:48:06.697897+0000","last_fullsized":"2024-06-02T04:48:06.697897+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:20:05.829628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.700166+0000","last_change":"2024-06-02T04:48:02.688376+0000","last_active":"2024-06-02T04:48:06.700166+0000","last_peered":"2024-06-02T04:48:06.700166+0000","last_clean":"2024-06-02T04:48:06.700166+0000","last_became_active":"2024-06-02T04:48:02.688055+0000","last_became_peered":"2024-06-02T04:48:02.688055+0000","last_unstale":"2024-06-02T04:48:06.700166+0000","last_undegraded":"2024-06-02T04:48:06.700166+0000","last_fullsized":"2024-06-02T04:48:06.700166+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:55:41.327635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.714875+0000","last_change":"2024-06-02T04:48:06.713517+0000","last_active":"2024-06-02T04:48:06.714875+0000","last_peered":"2024-06-02T04:48:06.714875+0000","last_clean":"2024-06-02T04:48:06.714875+0000","last_became_active":"2024-06-02T04:48:06.713187+0000","last_became_peered":"2024-06-02T04:48:06.713187+0000","last_unstale":"2024-06-02T04:48:06.714875+0000","last_undegraded":"2024-06-02T04:48:06.714875+0000","last_fullsized":"2024-06-02T04:48:06.714875+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:11:46.598023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"75'4","reported_seq":20,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.705518+0000","last_change":"2024-06-02T04:48:02.271595+0000","last_active":"2024-06-02T04:48:06.705518+0000","last_peered":"2024-06-02T04:48:06.705518+0000","last_clean":"2024-06-02T04:48:06.705518+0000","last_became_active":"2024-06-02T04:48:02.271326+0000","last_became_peered":"2024-06-02T04:48:02.271326+0000","last_unstale":"2024-06-02T04:48:06.705518+0000","last_undegraded":"2024-06-02T04:48:06.705518+0000","last_fullsized":"2024-06-02T04:48:06.705518+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:23:31.096224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.105442+0000","last_change":"2024-06-02T04:48:02.696542+0000","last_active":"2024-06-02T04:48:07.105442+0000","last_peered":"2024-06-02T04:48:07.105442+0000","last_clean":"2024-06-02T04:48:07.105442+0000","last_became_active":"2024-06-02T04:48:02.696260+0000","last_became_peered":"2024-06-02T04:48:02.696260+0000","last_unstale":"2024-06-02T04:48:07.105442+0000","last_undegraded":"2024-06-02T04:48:07.105442+0000","last_fullsized":"2024-06-02T04:48:07.105442+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T06:28:04.097035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.291625+0000","last_change":"2024-06-02T04:48:06.713685+0000","last_active":"2024-06-02T04:48:07.291625+0000","last_peered":"2024-06-02T04:48:07.291625+0000","last_clean":"2024-06-02T04:48:07.291625+0000","last_became_active":"2024-06-02T04:48:06.713254+0000","last_became_peered":"2024-06-02T04:48:06.713254+0000","last_unstale":"2024-06-02T04:48:07.291625+0000","last_undegraded":"2024-06-02T04:48:07.291625+0000","last_fullsized":"2024-06-02T04:48:07.291625+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:12:48.304229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"75'1","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.702453+0000","last_change":"2024-06-02T04:48:02.268361+0000","last_active":"2024-06-02T04:48:06.702453+0000","last_peered":"2024-06-02T04:48:06.702453+0000","last_clean":"2024-06-02T04:48:06.702453+0000","last_became_active":"2024-06-02T04:48:02.268053+0000","last_became_peered":"2024-06-02T04:48:02.268053+0000","last_unstale":"2024-06-02T04:48:06.702453+0000","last_undegraded":"2024-06-02T04:48:06.702453+0000","last_fullsized":"2024-06-02T04:48:06.702453+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T16:04:13.955351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.701807+0000","last_change":"2024-06-02T04:48:02.686322+0000","last_active":"2024-06-02T04:48:06.701807+0000","last_peered":"2024-06-02T04:48:06.701807+0000","last_clean":"2024-06-02T04:48:06.701807+0000","last_became_active":"2024-06-02T04:48:02.685978+0000","last_became_peered":"2024-06-02T04:48:02.685978+0000","last_unstale":"2024-06-02T04:48:06.701807+0000","last_undegraded":"2024-06-02T04:48:06.701807+0000","last_fullsized":"2024-06-02T04:48:06.701807+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T12:12:19.157330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.291715+0000","last_change":"2024-06-02T04:48:06.717046+0000","last_active":"2024-06-02T04:48:07.291715+0000","last_peered":"2024-06-02T04:48:07.291715+0000","last_clean":"2024-06-02T04:48:07.291715+0000","last_became_active":"2024-06-02T04:48:06.716603+0000","last_became_peered":"2024-06-02T04:48:06.716603+0000","last_unstale":"2024-06-02T04:48:07.291715+0000","last_undegraded":"2024-06-02T04:48:07.291715+0000","last_fullsized":"2024-06-02T04:48:07.291715+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:35:22.953004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"80'4","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:27.276618+0000","last_change":"2024-06-02T04:48:02.278143+0000","last_active":"2024-06-02T04:48:27.276618+0000","last_peered":"2024-06-02T04:48:27.276618+0000","last_clean":"2024-06-02T04:48:27.276618+0000","last_became_active":"2024-06-02T04:48:02.277656+0000","last_became_peered":"2024-06-02T04:48:02.277656+0000","last_unstale":"2024-06-02T04:48:27.276618+0000","last_undegraded":"2024-06-02T04:48:27.276618+0000","last_fullsized":"2024-06-02T04:48:27.276618+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T12:03:01.549353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.692452+0000","last_change":"2024-06-02T04:48:02.699659+0000","last_active":"2024-06-02T04:48:06.692452+0000","last_peered":"2024-06-02T04:48:06.692452+0000","last_clean":"2024-06-02T04:48:06.692452+0000","last_became_active":"2024-06-02T04:48:02.699321+0000","last_became_peered":"2024-06-02T04:48:02.699321+0000","last_unstale":"2024-06-02T04:48:06.692452+0000","last_undegraded":"2024-06-02T04:48:06.692452+0000","last_fullsized":"2024-06-02T04:48:06.692452+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:33:35.088215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.291668+0000","last_change":"2024-06-02T04:48:06.712031+0000","last_active":"2024-06-02T04:48:07.291668+0000","last_peered":"2024-06-02T04:48:07.291668+0000","last_clean":"2024-06-02T04:48:07.291668+0000","last_became_active":"2024-06-02T04:48:06.711637+0000","last_became_peered":"2024-06-02T04:48:06.711637+0000","last_unstale":"2024-06-02T04:48:07.291668+0000","last_undegraded":"2024-06-02T04:48:07.291668+0000","last_fullsized":"2024-06-02T04:48:07.291668+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T06:10:05.281793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"75'2","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.697836+0000","last_change":"2024-06-02T04:48:02.268698+0000","last_active":"2024-06-02T04:48:06.697836+0000","last_peered":"2024-06-02T04:48:06.697836+0000","last_clean":"2024-06-02T04:48:06.697836+0000","last_became_active":"2024-06-02T04:48:02.268286+0000","last_became_peered":"2024-06-02T04:48:02.268286+0000","last_unstale":"2024-06-02T04:48:06.697836+0000","last_undegraded":"2024-06-02T04:48:06.697836+0000","last_fullsized":"2024-06-02T04:48:06.697836+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T10:37:42.354104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.030205+0000","last_change":"2024-06-02T04:48:02.702280+0000","last_active":"2024-06-02T04:48:07.030205+0000","last_peered":"2024-06-02T04:48:07.030205+0000","last_clean":"2024-06-02T04:48:07.030205+0000","last_became_active":"2024-06-02T04:48:02.701830+0000","last_became_peered":"2024-06-02T04:48:02.701830+0000","last_unstale":"2024-06-02T04:48:07.030205+0000","last_undegraded":"2024-06-02T04:48:07.030205+0000","last_fullsized":"2024-06-02T04:48:07.030205+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T06:44:06.324024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.709193+0000","last_change":"2024-06-02T04:48:06.708484+0000","last_active":"2024-06-02T04:48:06.709193+0000","last_peered":"2024-06-02T04:48:06.709193+0000","last_clean":"2024-06-02T04:48:06.709193+0000","last_became_active":"2024-06-02T04:48:06.708048+0000","last_became_peered":"2024-06-02T04:48:06.708048+0000","last_unstale":"2024-06-02T04:48:06.709193+0000","last_undegraded":"2024-06-02T04:48:06.709193+0000","last_fullsized":"2024-06-02T04:48:06.709193+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:30:42.361362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"80'5","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:26.276987+0000","last_change":"2024-06-02T04:48:02.274961+0000","last_active":"2024-06-02T04:48:26.276987+0000","last_peered":"2024-06-02T04:48:26.276987+0000","last_clean":"2024-06-02T04:48:26.276987+0000","last_became_active":"2024-06-02T04:48:02.274617+0000","last_became_peered":"2024-06-02T04:48:02.274617+0000","last_unstale":"2024-06-02T04:48:26.276987+0000","last_undegraded":"2024-06-02T04:48:26.276987+0000","last_fullsized":"2024-06-02T04:48:26.276987+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T16:47:17.136996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.698487+0000","last_change":"2024-06-02T04:48:02.684722+0000","last_active":"2024-06-02T04:48:06.698487+0000","last_peered":"2024-06-02T04:48:06.698487+0000","last_clean":"2024-06-02T04:48:06.698487+0000","last_became_active":"2024-06-02T04:48:02.684354+0000","last_became_peered":"2024-06-02T04:48:02.684354+0000","last_unstale":"2024-06-02T04:48:06.698487+0000","last_undegraded":"2024-06-02T04:48:06.698487+0000","last_fullsized":"2024-06-02T04:48:06.698487+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T07:46:54.136882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.714856+0000","last_change":"2024-06-02T04:48:06.713498+0000","last_active":"2024-06-02T04:48:06.714856+0000","last_peered":"2024-06-02T04:48:06.714856+0000","last_clean":"2024-06-02T04:48:06.714856+0000","last_became_active":"2024-06-02T04:48:06.712949+0000","last_became_peered":"2024-06-02T04:48:06.712949+0000","last_unstale":"2024-06-02T04:48:06.714856+0000","last_undegraded":"2024-06-02T04:48:06.714856+0000","last_fullsized":"2024-06-02T04:48:06.714856+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:37:31.586703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"80'3","reported_seq":19,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:27.277254+0000","last_change":"2024-06-02T04:48:02.266358+0000","last_active":"2024-06-02T04:48:27.277254+0000","last_peered":"2024-06-02T04:48:27.277254+0000","last_clean":"2024-06-02T04:48:27.277254+0000","last_became_active":"2024-06-02T04:48:02.266008+0000","last_became_peered":"2024-06-02T04:48:02.266008+0000","last_unstale":"2024-06-02T04:48:27.277254+0000","last_undegraded":"2024-06-02T04:48:27.277254+0000","last_fullsized":"2024-06-02T04:48:27.277254+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:07:13.104170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.030185+0000","last_change":"2024-06-02T04:48:02.702234+0000","last_active":"2024-06-02T04:48:07.030185+0000","last_peered":"2024-06-02T04:48:07.030185+0000","last_clean":"2024-06-02T04:48:07.030185+0000","last_became_active":"2024-06-02T04:48:02.701927+0000","last_became_peered":"2024-06-02T04:48:02.701927+0000","last_unstale":"2024-06-02T04:48:07.030185+0000","last_undegraded":"2024-06-02T04:48:07.030185+0000","last_fullsized":"2024-06-02T04:48:07.030185+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:55:55.940957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.106401+0000","last_change":"2024-06-02T04:48:06.713257+0000","last_active":"2024-06-02T04:48:07.106401+0000","last_peered":"2024-06-02T04:48:07.106401+0000","last_clean":"2024-06-02T04:48:07.106401+0000","last_became_active":"2024-06-02T04:48:06.712862+0000","last_became_peered":"2024-06-02T04:48:06.712862+0000","last_unstale":"2024-06-02T04:48:07.106401+0000","last_undegraded":"2024-06-02T04:48:07.106401+0000","last_fullsized":"2024-06-02T04:48:07.106401+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T06:23:35.115824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"80'2","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:27.276292+0000","last_change":"2024-06-02T04:48:02.258838+0000","last_active":"2024-06-02T04:48:27.276292+0000","last_peered":"2024-06-02T04:48:27.276292+0000","last_clean":"2024-06-02T04:48:27.276292+0000","last_became_active":"2024-06-02T04:48:02.258516+0000","last_became_peered":"2024-06-02T04:48:02.258516+0000","last_unstale":"2024-06-02T04:48:27.276292+0000","last_undegraded":"2024-06-02T04:48:27.276292+0000","last_fullsized":"2024-06-02T04:48:27.276292+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:32:04.161724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.104908+0000","last_change":"2024-06-02T04:48:02.690043+0000","last_active":"2024-06-02T04:48:07.104908+0000","last_peered":"2024-06-02T04:48:07.104908+0000","last_clean":"2024-06-02T04:48:07.104908+0000","last_became_active":"2024-06-02T04:48:02.689748+0000","last_became_peered":"2024-06-02T04:48:02.689748+0000","last_unstale":"2024-06-02T04:48:07.104908+0000","last_undegraded":"2024-06-02T04:48:07.104908+0000","last_fullsized":"2024-06-02T04:48:07.104908+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:50:23.694653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.338557+0000","last_change":"2024-06-02T04:48:06.704093+0000","last_active":"2024-06-02T04:48:07.338557+0000","last_peered":"2024-06-02T04:48:07.338557+0000","last_clean":"2024-06-02T04:48:07.338557+0000","last_became_active":"2024-06-02T04:48:06.703732+0000","last_became_peered":"2024-06-02T04:48:06.703732+0000","last_unstale":"2024-06-02T04:48:07.338557+0000","last_undegraded":"2024-06-02T04:48:07.338557+0000","last_fullsized":"2024-06-02T04:48:07.338557+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:50:10.434364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"80'1","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.338898+0000","last_change":"2024-06-02T04:48:02.274753+0000","last_active":"2024-06-02T04:48:07.338898+0000","last_peered":"2024-06-02T04:48:07.338898+0000","last_clean":"2024-06-02T04:48:07.338898+0000","last_became_active":"2024-06-02T04:48:02.274390+0000","last_became_peered":"2024-06-02T04:48:02.274390+0000","last_unstale":"2024-06-02T04:48:07.338898+0000","last_undegraded":"2024-06-02T04:48:07.338898+0000","last_fullsized":"2024-06-02T04:48:07.338898+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:42:38.790750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.698110+0000","last_change":"2024-06-02T04:48:02.684832+0000","last_active":"2024-06-02T04:48:06.698110+0000","last_peered":"2024-06-02T04:48:06.698110+0000","last_clean":"2024-06-02T04:48:06.698110+0000","last_became_active":"2024-06-02T04:48:02.684520+0000","last_became_peered":"2024-06-02T04:48:02.684520+0000","last_unstale":"2024-06-02T04:48:06.698110+0000","last_undegraded":"2024-06-02T04:48:06.698110+0000","last_fullsized":"2024-06-02T04:48:06.698110+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:08:33.038975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.104977+0000","last_change":"2024-06-02T04:48:06.704725+0000","last_active":"2024-06-02T04:48:07.104977+0000","last_peered":"2024-06-02T04:48:07.104977+0000","last_clean":"2024-06-02T04:48:07.104977+0000","last_became_active":"2024-06-02T04:48:06.704284+0000","last_became_peered":"2024-06-02T04:48:06.704284+0000","last_unstale":"2024-06-02T04:48:07.104977+0000","last_undegraded":"2024-06-02T04:48:07.104977+0000","last_fullsized":"2024-06-02T04:48:07.104977+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:56:04.558505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"80'3","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:26.275573+0000","last_change":"2024-06-02T04:48:02.267048+0000","last_active":"2024-06-02T04:48:26.275573+0000","last_peered":"2024-06-02T04:48:26.275573+0000","last_clean":"2024-06-02T04:48:26.275573+0000","last_became_active":"2024-06-02T04:48:02.266707+0000","last_became_peered":"2024-06-02T04:48:02.266707+0000","last_unstale":"2024-06-02T04:48:26.275573+0000","last_undegraded":"2024-06-02T04:48:26.275573+0000","last_fullsized":"2024-06-02T04:48:26.275573+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:36:25.633728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.692726+0000","last_change":"2024-06-02T04:48:02.700485+0000","last_active":"2024-06-02T04:48:06.692726+0000","last_peered":"2024-06-02T04:48:06.692726+0000","last_clean":"2024-06-02T04:48:06.692726+0000","last_became_active":"2024-06-02T04:48:02.700228+0000","last_became_peered":"2024-06-02T04:48:02.700228+0000","last_unstale":"2024-06-02T04:48:06.692726+0000","last_undegraded":"2024-06-02T04:48:06.692726+0000","last_fullsized":"2024-06-02T04:48:06.692726+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T06:39:18.244476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.717696+0000","last_change":"2024-06-02T04:48:06.716821+0000","last_active":"2024-06-02T04:48:06.717696+0000","last_peered":"2024-06-02T04:48:06.717696+0000","last_clean":"2024-06-02T04:48:06.717696+0000","last_became_active":"2024-06-02T04:48:06.716432+0000","last_became_peered":"2024-06-02T04:48:06.716432+0000","last_unstale":"2024-06-02T04:48:06.717696+0000","last_undegraded":"2024-06-02T04:48:06.717696+0000","last_fullsized":"2024-06-02T04:48:06.717696+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T12:06:50.164797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"80'2","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:26.276005+0000","last_change":"2024-06-02T04:48:02.272377+0000","last_active":"2024-06-02T04:48:26.276005+0000","last_peered":"2024-06-02T04:48:26.276005+0000","last_clean":"2024-06-02T04:48:26.276005+0000","last_became_active":"2024-06-02T04:48:02.272017+0000","last_became_peered":"2024-06-02T04:48:02.272017+0000","last_unstale":"2024-06-02T04:48:26.276005+0000","last_undegraded":"2024-06-02T04:48:26.276005+0000","last_fullsized":"2024-06-02T04:48:26.276005+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T10:24:14.945609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.701744+0000","last_change":"2024-06-02T04:48:02.687056+0000","last_active":"2024-06-02T04:48:06.701744+0000","last_peered":"2024-06-02T04:48:06.701744+0000","last_clean":"2024-06-02T04:48:06.701744+0000","last_became_active":"2024-06-02T04:48:02.686729+0000","last_became_peered":"2024-06-02T04:48:02.686729+0000","last_unstale":"2024-06-02T04:48:06.701744+0000","last_undegraded":"2024-06-02T04:48:06.701744+0000","last_fullsized":"2024-06-02T04:48:06.701744+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:54:44.636489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.292066+0000","last_change":"2024-06-02T04:48:06.713816+0000","last_active":"2024-06-02T04:48:07.292066+0000","last_peered":"2024-06-02T04:48:07.292066+0000","last_clean":"2024-06-02T04:48:07.292066+0000","last_became_active":"2024-06-02T04:48:06.713372+0000","last_became_peered":"2024-06-02T04:48:06.713372+0000","last_unstale":"2024-06-02T04:48:07.292066+0000","last_undegraded":"2024-06-02T04:48:07.292066+0000","last_fullsized":"2024-06-02T04:48:07.292066+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T10:12:46.455263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"80'4","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.339772+0000","last_change":"2024-06-02T04:48:02.274971+0000","last_active":"2024-06-02T04:48:07.339772+0000","last_peered":"2024-06-02T04:48:07.339772+0000","last_clean":"2024-06-02T04:48:07.339772+0000","last_became_active":"2024-06-02T04:48:02.274137+0000","last_became_peered":"2024-06-02T04:48:02.274137+0000","last_unstale":"2024-06-02T04:48:07.339772+0000","last_undegraded":"2024-06-02T04:48:07.339772+0000","last_fullsized":"2024-06-02T04:48:07.339772+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:41:45.634923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.692551+0000","last_change":"2024-06-02T04:48:02.693919+0000","last_active":"2024-06-02T04:48:06.692551+0000","last_peered":"2024-06-02T04:48:06.692551+0000","last_clean":"2024-06-02T04:48:06.692551+0000","last_became_active":"2024-06-02T04:48:02.693577+0000","last_became_peered":"2024-06-02T04:48:02.693577+0000","last_unstale":"2024-06-02T04:48:06.692551+0000","last_undegraded":"2024-06-02T04:48:06.692551+0000","last_fullsized":"2024-06-02T04:48:06.692551+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:00:47.500411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.716072+0000","last_change":"2024-06-02T04:48:06.713061+0000","last_active":"2024-06-02T04:48:06.716072+0000","last_peered":"2024-06-02T04:48:06.716072+0000","last_clean":"2024-06-02T04:48:06.716072+0000","last_became_active":"2024-06-02T04:48:06.712687+0000","last_became_peered":"2024-06-02T04:48:06.712687+0000","last_unstale":"2024-06-02T04:48:06.716072+0000","last_undegraded":"2024-06-02T04:48:06.716072+0000","last_fullsized":"2024-06-02T04:48:06.716072+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T08:46:02.417626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"80'19","reported_seq":39,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:29.080379+0000","last_change":"2024-06-02T04:48:02.270101+0000","last_active":"2024-06-02T04:48:29.080379+0000","last_peered":"2024-06-02T04:48:29.080379+0000","last_clean":"2024-06-02T04:48:29.080379+0000","last_became_active":"2024-06-02T04:48:02.269637+0000","last_became_peered":"2024-06-02T04:48:02.269637+0000","last_unstale":"2024-06-02T04:48:29.080379+0000","last_undegraded":"2024-06-02T04:48:29.080379+0000","last_fullsized":"2024-06-02T04:48:29.080379+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:37:07.572299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23097,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":6,"num_write":20,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.698707+0000","last_change":"2024-06-02T04:48:02.698435+0000","last_active":"2024-06-02T04:48:06.698707+0000","last_peered":"2024-06-02T04:48:06.698707+0000","last_clean":"2024-06-02T04:48:06.698707+0000","last_became_active":"2024-06-02T04:48:02.698071+0000","last_became_peered":"2024-06-02T04:48:02.698071+0000","last_unstale":"2024-06-02T04:48:06.698707+0000","last_undegraded":"2024-06-02T04:48:06.698707+0000","last_fullsized":"2024-06-02T04:48:06.698707+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:45:38.673256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.030226+0000","last_change":"2024-06-02T04:48:06.705965+0000","last_active":"2024-06-02T04:48:07.030226+0000","last_peered":"2024-06-02T04:48:07.030226+0000","last_clean":"2024-06-02T04:48:07.030226+0000","last_became_active":"2024-06-02T04:48:06.705527+0000","last_became_peered":"2024-06-02T04:48:06.705527+0000","last_unstale":"2024-06-02T04:48:07.030226+0000","last_undegraded":"2024-06-02T04:48:07.030226+0000","last_fullsized":"2024-06-02T04:48:07.030226+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:41:54.100212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"75'2","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.696778+0000","last_change":"2024-06-02T04:48:02.273389+0000","last_active":"2024-06-02T04:48:06.696778+0000","last_peered":"2024-06-02T04:48:06.696778+0000","last_clean":"2024-06-02T04:48:06.696778+0000","last_became_active":"2024-06-02T04:48:02.271701+0000","last_became_peered":"2024-06-02T04:48:02.271701+0000","last_unstale":"2024-06-02T04:48:06.696778+0000","last_undegraded":"2024-06-02T04:48:06.696778+0000","last_fullsized":"2024-06-02T04:48:06.696778+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:46:48.304156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.691378+0000","last_change":"2024-06-02T04:48:02.689417+0000","last_active":"2024-06-02T04:48:06.691378+0000","last_peered":"2024-06-02T04:48:06.691378+0000","last_clean":"2024-06-02T04:48:06.691378+0000","last_became_active":"2024-06-02T04:48:02.689108+0000","last_became_peered":"2024-06-02T04:48:02.689108+0000","last_unstale":"2024-06-02T04:48:06.691378+0000","last_undegraded":"2024-06-02T04:48:06.691378+0000","last_fullsized":"2024-06-02T04:48:06.691378+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:23:14.231198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.106225+0000","last_change":"2024-06-02T04:48:06.713370+0000","last_active":"2024-06-02T04:48:07.106225+0000","last_peered":"2024-06-02T04:48:07.106225+0000","last_clean":"2024-06-02T04:48:07.106225+0000","last_became_active":"2024-06-02T04:48:06.712972+0000","last_became_peered":"2024-06-02T04:48:06.712972+0000","last_unstale":"2024-06-02T04:48:07.106225+0000","last_undegraded":"2024-06-02T04:48:07.106225+0000","last_fullsized":"2024-06-02T04:48:07.106225+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:37:23.908276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"80'3","reported_seq":19,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:26.275559+0000","last_change":"2024-06-02T04:48:02.274386+0000","last_active":"2024-06-02T04:48:26.275559+0000","last_peered":"2024-06-02T04:48:26.275559+0000","last_clean":"2024-06-02T04:48:26.275559+0000","last_became_active":"2024-06-02T04:48:02.274001+0000","last_became_peered":"2024-06-02T04:48:02.274001+0000","last_unstale":"2024-06-02T04:48:26.275559+0000","last_undegraded":"2024-06-02T04:48:26.275559+0000","last_fullsized":"2024-06-02T04:48:26.275559+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T14:02:10.256428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.699635+0000","last_change":"2024-06-02T04:48:02.706735+0000","last_active":"2024-06-02T04:48:06.699635+0000","last_peered":"2024-06-02T04:48:06.699635+0000","last_clean":"2024-06-02T04:48:06.699635+0000","last_became_active":"2024-06-02T04:48:02.706475+0000","last_became_peered":"2024-06-02T04:48:02.706475+0000","last_unstale":"2024-06-02T04:48:06.699635+0000","last_undegraded":"2024-06-02T04:48:06.699635+0000","last_fullsized":"2024-06-02T04:48:06.699635+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T10:59:57.946798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.715816+0000","last_change":"2024-06-02T04:48:06.713266+0000","last_active":"2024-06-02T04:48:06.715816+0000","last_peered":"2024-06-02T04:48:06.715816+0000","last_clean":"2024-06-02T04:48:06.715816+0000","last_became_active":"2024-06-02T04:48:06.712659+0000","last_became_peered":"2024-06-02T04:48:06.712659+0000","last_unstale":"2024-06-02T04:48:06.715816+0000","last_undegraded":"2024-06-02T04:48:06.715816+0000","last_fullsized":"2024-06-02T04:48:06.715816+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T16:30:21.140420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.696866+0000","last_change":"2024-06-02T04:48:02.265157+0000","last_active":"2024-06-02T04:48:06.696866+0000","last_peered":"2024-06-02T04:48:06.696866+0000","last_clean":"2024-06-02T04:48:06.696866+0000","last_became_active":"2024-06-02T04:48:02.264782+0000","last_became_peered":"2024-06-02T04:48:02.264782+0000","last_unstale":"2024-06-02T04:48:06.696866+0000","last_undegraded":"2024-06-02T04:48:06.696866+0000","last_fullsized":"2024-06-02T04:48:06.696866+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:55:35.177299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.698945+0000","last_change":"2024-06-02T04:48:02.698864+0000","last_active":"2024-06-02T04:48:06.698945+0000","last_peered":"2024-06-02T04:48:06.698945+0000","last_clean":"2024-06-02T04:48:06.698945+0000","last_became_active":"2024-06-02T04:48:02.698547+0000","last_became_peered":"2024-06-02T04:48:02.698547+0000","last_unstale":"2024-06-02T04:48:06.698945+0000","last_undegraded":"2024-06-02T04:48:06.698945+0000","last_fullsized":"2024-06-02T04:48:06.698945+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:03:39.835164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.339323+0000","last_change":"2024-06-02T04:48:06.713198+0000","last_active":"2024-06-02T04:48:07.339323+0000","last_peered":"2024-06-02T04:48:07.339323+0000","last_clean":"2024-06-02T04:48:07.339323+0000","last_became_active":"2024-06-02T04:48:06.712806+0000","last_became_peered":"2024-06-02T04:48:06.712806+0000","last_unstale":"2024-06-02T04:48:07.339323+0000","last_undegraded":"2024-06-02T04:48:07.339323+0000","last_fullsized":"2024-06-02T04:48:07.339323+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:48:09.492933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"80'15","reported_seq":31,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:27.278481+0000","last_change":"2024-06-02T04:48:02.277744+0000","last_active":"2024-06-02T04:48:27.278481+0000","last_peered":"2024-06-02T04:48:27.278481+0000","last_clean":"2024-06-02T04:48:27.278481+0000","last_became_active":"2024-06-02T04:48:02.277044+0000","last_became_peered":"2024-06-02T04:48:02.277044+0000","last_unstale":"2024-06-02T04:48:27.278481+0000","last_undegraded":"2024-06-02T04:48:27.278481+0000","last_fullsized":"2024-06-02T04:48:27.278481+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:47:38.606233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.030145+0000","last_change":"2024-06-02T04:48:02.702234+0000","last_active":"2024-06-02T04:48:07.030145+0000","last_peered":"2024-06-02T04:48:07.030145+0000","last_clean":"2024-06-02T04:48:07.030145+0000","last_became_active":"2024-06-02T04:48:02.701857+0000","last_became_peered":"2024-06-02T04:48:02.701857+0000","last_unstale":"2024-06-02T04:48:07.030145+0000","last_undegraded":"2024-06-02T04:48:07.030145+0000","last_fullsized":"2024-06-02T04:48:07.030145+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:01:52.901690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.030132+0000","last_change":"2024-06-02T04:48:06.704575+0000","last_active":"2024-06-02T04:48:07.030132+0000","last_peered":"2024-06-02T04:48:07.030132+0000","last_clean":"2024-06-02T04:48:07.030132+0000","last_became_active":"2024-06-02T04:48:06.704129+0000","last_became_peered":"2024-06-02T04:48:06.704129+0000","last_unstale":"2024-06-02T04:48:07.030132+0000","last_undegraded":"2024-06-02T04:48:07.030132+0000","last_fullsized":"2024-06-02T04:48:07.030132+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:43:53.481252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"75'1","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.696782+0000","last_change":"2024-06-02T04:48:02.268816+0000","last_active":"2024-06-02T04:48:06.696782+0000","last_peered":"2024-06-02T04:48:06.696782+0000","last_clean":"2024-06-02T04:48:06.696782+0000","last_became_active":"2024-06-02T04:48:02.268469+0000","last_became_peered":"2024-06-02T04:48:02.268469+0000","last_unstale":"2024-06-02T04:48:06.696782+0000","last_undegraded":"2024-06-02T04:48:06.696782+0000","last_fullsized":"2024-06-02T04:48:06.696782+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:42:32.434414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.691711+0000","last_change":"2024-06-02T04:48:02.704536+0000","last_active":"2024-06-02T04:48:06.691711+0000","last_peered":"2024-06-02T04:48:06.691711+0000","last_clean":"2024-06-02T04:48:06.691711+0000","last_became_active":"2024-06-02T04:48:02.704149+0000","last_became_peered":"2024-06-02T04:48:02.704149+0000","last_unstale":"2024-06-02T04:48:06.691711+0000","last_undegraded":"2024-06-02T04:48:06.691711+0000","last_fullsized":"2024-06-02T04:48:06.691711+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T07:59:40.379135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.114754+0000","last_change":"2024-06-02T04:48:06.963192+0000","last_active":"2024-06-02T04:48:07.114754+0000","last_peered":"2024-06-02T04:48:07.114754+0000","last_clean":"2024-06-02T04:48:07.114754+0000","last_became_active":"2024-06-02T04:48:06.962658+0000","last_became_peered":"2024-06-02T04:48:06.962658+0000","last_unstale":"2024-06-02T04:48:07.114754+0000","last_undegraded":"2024-06-02T04:48:07.114754+0000","last_fullsized":"2024-06-02T04:48:07.114754+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:28:33.093285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.702674+0000","last_change":"2024-06-02T04:48:02.270893+0000","last_active":"2024-06-02T04:48:06.702674+0000","last_peered":"2024-06-02T04:48:06.702674+0000","last_clean":"2024-06-02T04:48:06.702674+0000","last_became_active":"2024-06-02T04:48:02.270566+0000","last_became_peered":"2024-06-02T04:48:02.270566+0000","last_unstale":"2024-06-02T04:48:06.702674+0000","last_undegraded":"2024-06-02T04:48:06.702674+0000","last_fullsized":"2024-06-02T04:48:06.702674+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:57:36.202043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.962165+0000","last_change":"2024-06-02T04:48:02.693528+0000","last_active":"2024-06-02T04:48:06.962165+0000","last_peered":"2024-06-02T04:48:06.962165+0000","last_clean":"2024-06-02T04:48:06.962165+0000","last_became_active":"2024-06-02T04:48:02.693240+0000","last_became_peered":"2024-06-02T04:48:02.693240+0000","last_unstale":"2024-06-02T04:48:06.962165+0000","last_undegraded":"2024-06-02T04:48:06.962165+0000","last_fullsized":"2024-06-02T04:48:06.962165+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T14:48:59.338977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.339278+0000","last_change":"2024-06-02T04:48:06.710454+0000","last_active":"2024-06-02T04:48:07.339278+0000","last_peered":"2024-06-02T04:48:07.339278+0000","last_clean":"2024-06-02T04:48:07.339278+0000","last_became_active":"2024-06-02T04:48:06.710090+0000","last_became_peered":"2024-06-02T04:48:06.710090+0000","last_unstale":"2024-06-02T04:48:07.339278+0000","last_undegraded":"2024-06-02T04:48:07.339278+0000","last_fullsized":"2024-06-02T04:48:07.339278+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:27:52.401032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.698482+0000","last_change":"2024-06-02T04:48:02.271748+0000","last_active":"2024-06-02T04:48:06.698482+0000","last_peered":"2024-06-02T04:48:06.698482+0000","last_clean":"2024-06-02T04:48:06.698482+0000","last_became_active":"2024-06-02T04:48:02.270941+0000","last_became_peered":"2024-06-02T04:48:02.270941+0000","last_unstale":"2024-06-02T04:48:06.698482+0000","last_undegraded":"2024-06-02T04:48:06.698482+0000","last_fullsized":"2024-06-02T04:48:06.698482+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T14:22:37.698956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.962254+0000","last_change":"2024-06-02T04:48:02.690331+0000","last_active":"2024-06-02T04:48:06.962254+0000","last_peered":"2024-06-02T04:48:06.962254+0000","last_clean":"2024-06-02T04:48:06.962254+0000","last_became_active":"2024-06-02T04:48:02.681983+0000","last_became_peered":"2024-06-02T04:48:02.681983+0000","last_unstale":"2024-06-02T04:48:06.962254+0000","last_undegraded":"2024-06-02T04:48:06.962254+0000","last_fullsized":"2024-06-02T04:48:06.962254+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T14:09:12.117847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.339368+0000","last_change":"2024-06-02T04:48:06.962698+0000","last_active":"2024-06-02T04:48:07.339368+0000","last_peered":"2024-06-02T04:48:07.339368+0000","last_clean":"2024-06-02T04:48:07.339368+0000","last_became_active":"2024-06-02T04:48:06.962283+0000","last_became_peered":"2024-06-02T04:48:06.962283+0000","last_unstale":"2024-06-02T04:48:07.339368+0000","last_undegraded":"2024-06-02T04:48:07.339368+0000","last_fullsized":"2024-06-02T04:48:07.339368+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T14:33:49.504150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.030119+0000","last_change":"2024-06-02T04:48:02.702856+0000","last_active":"2024-06-02T04:48:07.030119+0000","last_peered":"2024-06-02T04:48:07.030119+0000","last_clean":"2024-06-02T04:48:07.030119+0000","last_became_active":"2024-06-02T04:48:02.702513+0000","last_became_peered":"2024-06-02T04:48:02.702513+0000","last_unstale":"2024-06-02T04:48:07.030119+0000","last_undegraded":"2024-06-02T04:48:07.030119+0000","last_fullsized":"2024-06-02T04:48:07.030119+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T07:10:35.957386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"80'4","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:27.277906+0000","last_change":"2024-06-02T04:48:02.265627+0000","last_active":"2024-06-02T04:48:27.277906+0000","last_peered":"2024-06-02T04:48:27.277906+0000","last_clean":"2024-06-02T04:48:27.277906+0000","last_became_active":"2024-06-02T04:48:02.265301+0000","last_became_peered":"2024-06-02T04:48:02.265301+0000","last_unstale":"2024-06-02T04:48:27.277906+0000","last_undegraded":"2024-06-02T04:48:27.277906+0000","last_fullsized":"2024-06-02T04:48:27.277906+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T10:46:10.211378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.710314+0000","last_change":"2024-06-02T04:48:06.709988+0000","last_active":"2024-06-02T04:48:06.710314+0000","last_peered":"2024-06-02T04:48:06.710314+0000","last_clean":"2024-06-02T04:48:06.710314+0000","last_became_active":"2024-06-02T04:48:06.709642+0000","last_became_peered":"2024-06-02T04:48:06.709642+0000","last_unstale":"2024-06-02T04:48:06.710314+0000","last_undegraded":"2024-06-02T04:48:06.710314+0000","last_fullsized":"2024-06-02T04:48:06.710314+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T10:09:46.250709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.105024+0000","last_change":"2024-06-02T04:48:02.696666+0000","last_active":"2024-06-02T04:48:07.105024+0000","last_peered":"2024-06-02T04:48:07.105024+0000","last_clean":"2024-06-02T04:48:07.105024+0000","last_became_active":"2024-06-02T04:48:02.696343+0000","last_became_peered":"2024-06-02T04:48:02.696343+0000","last_unstale":"2024-06-02T04:48:07.105024+0000","last_undegraded":"2024-06-02T04:48:07.105024+0000","last_fullsized":"2024-06-02T04:48:07.105024+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T12:31:13.426174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.698922+0000","last_change":"2024-06-02T04:48:02.268619+0000","last_active":"2024-06-02T04:48:06.698922+0000","last_peered":"2024-06-02T04:48:06.698922+0000","last_clean":"2024-06-02T04:48:06.698922+0000","last_became_active":"2024-06-02T04:48:02.268244+0000","last_became_peered":"2024-06-02T04:48:02.268244+0000","last_unstale":"2024-06-02T04:48:06.698922+0000","last_undegraded":"2024-06-02T04:48:06.698922+0000","last_fullsized":"2024-06-02T04:48:06.698922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:15:13.469046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"19'137","reported_seq":326,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.339208+0000","last_change":"2024-06-02T04:47:15.713382+0000","last_active":"2024-06-02T04:48:07.339208+0000","last_peered":"2024-06-02T04:48:07.339208+0000","last_clean":"2024-06-02T04:48:07.339208+0000","last_became_active":"2024-06-02T04:47:15.712972+0000","last_became_peered":"2024-06-02T04:47:15.712972+0000","last_unstale":"2024-06-02T04:48:07.339208+0000","last_undegraded":"2024-06-02T04:48:07.339208+0000","last_fullsized":"2024-06-02T04:48:07.339208+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:44:56.604079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:44:56.604079+0000","last_clean_scrub_stamp":"2024-06-02T04:44:56.604079+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T12:54:02.306899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.030237+0000","last_change":"2024-06-02T04:48:06.964717+0000","last_active":"2024-06-02T04:48:07.030237+0000","last_peered":"2024-06-02T04:48:07.030237+0000","last_clean":"2024-06-02T04:48:07.030237+0000","last_became_active":"2024-06-02T04:48:06.964244+0000","last_became_peered":"2024-06-02T04:48:06.964244+0000","last_unstale":"2024-06-02T04:48:07.030237+0000","last_undegraded":"2024-06-02T04:48:07.030237+0000","last_fullsized":"2024-06-02T04:48:07.030237+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:26:58.901182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.691167+0000","last_change":"2024-06-02T04:48:02.703427+0000","last_active":"2024-06-02T04:48:06.691167+0000","last_peered":"2024-06-02T04:48:06.691167+0000","last_clean":"2024-06-02T04:48:06.691167+0000","last_became_active":"2024-06-02T04:48:02.703140+0000","last_became_peered":"2024-06-02T04:48:02.703140+0000","last_unstale":"2024-06-02T04:48:06.691167+0000","last_undegraded":"2024-06-02T04:48:06.691167+0000","last_fullsized":"2024-06-02T04:48:06.691167+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T10:24:07.881130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"80'1","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.339329+0000","last_change":"2024-06-02T04:48:02.272953+0000","last_active":"2024-06-02T04:48:07.339329+0000","last_peered":"2024-06-02T04:48:07.339329+0000","last_clean":"2024-06-02T04:48:07.339329+0000","last_became_active":"2024-06-02T04:48:02.272603+0000","last_became_peered":"2024-06-02T04:48:02.272603+0000","last_unstale":"2024-06-02T04:48:07.339329+0000","last_undegraded":"2024-06-02T04:48:07.339329+0000","last_fullsized":"2024-06-02T04:48:07.339329+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:46:33.907707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.106136+0000","last_change":"2024-06-02T04:48:06.703427+0000","last_active":"2024-06-02T04:48:07.106136+0000","last_peered":"2024-06-02T04:48:07.106136+0000","last_clean":"2024-06-02T04:48:07.106136+0000","last_became_active":"2024-06-02T04:48:06.702442+0000","last_became_peered":"2024-06-02T04:48:06.702442+0000","last_unstale":"2024-06-02T04:48:07.106136+0000","last_undegraded":"2024-06-02T04:48:07.106136+0000","last_fullsized":"2024-06-02T04:48:07.106136+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T14:47:12.376520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"80'1","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.115045+0000","last_change":"2024-06-02T04:48:02.277241+0000","last_active":"2024-06-02T04:48:07.115045+0000","last_peered":"2024-06-02T04:48:07.115045+0000","last_clean":"2024-06-02T04:48:07.115045+0000","last_became_active":"2024-06-02T04:48:02.276903+0000","last_became_peered":"2024-06-02T04:48:02.276903+0000","last_unstale":"2024-06-02T04:48:07.115045+0000","last_undegraded":"2024-06-02T04:48:07.115045+0000","last_fullsized":"2024-06-02T04:48:07.115045+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:16:40.664225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.691848+0000","last_change":"2024-06-02T04:48:02.682260+0000","last_active":"2024-06-02T04:48:06.691848+0000","last_peered":"2024-06-02T04:48:06.691848+0000","last_clean":"2024-06-02T04:48:06.691848+0000","last_became_active":"2024-06-02T04:48:02.681962+0000","last_became_peered":"2024-06-02T04:48:02.681962+0000","last_unstale":"2024-06-02T04:48:06.691848+0000","last_undegraded":"2024-06-02T04:48:06.691848+0000","last_fullsized":"2024-06-02T04:48:06.691848+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:42:26.588628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.104914+0000","last_change":"2024-06-02T04:48:06.963380+0000","last_active":"2024-06-02T04:48:07.104914+0000","last_peered":"2024-06-02T04:48:07.104914+0000","last_clean":"2024-06-02T04:48:07.104914+0000","last_became_active":"2024-06-02T04:48:06.962717+0000","last_became_peered":"2024-06-02T04:48:06.962717+0000","last_unstale":"2024-06-02T04:48:07.104914+0000","last_undegraded":"2024-06-02T04:48:07.104914+0000","last_fullsized":"2024-06-02T04:48:07.104914+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T07:05:46.983987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"80'1","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.112569+0000","last_change":"2024-06-02T04:48:02.270183+0000","last_active":"2024-06-02T04:48:07.112569+0000","last_peered":"2024-06-02T04:48:07.112569+0000","last_clean":"2024-06-02T04:48:07.112569+0000","last_became_active":"2024-06-02T04:48:02.269880+0000","last_became_peered":"2024-06-02T04:48:02.269880+0000","last_unstale":"2024-06-02T04:48:07.112569+0000","last_undegraded":"2024-06-02T04:48:07.112569+0000","last_fullsized":"2024-06-02T04:48:07.112569+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T16:12:41.959174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.105672+0000","last_change":"2024-06-02T04:48:02.696692+0000","last_active":"2024-06-02T04:48:07.105672+0000","last_peered":"2024-06-02T04:48:07.105672+0000","last_clean":"2024-06-02T04:48:07.105672+0000","last_became_active":"2024-06-02T04:48:02.696398+0000","last_became_peered":"2024-06-02T04:48:02.696398+0000","last_unstale":"2024-06-02T04:48:07.105672+0000","last_undegraded":"2024-06-02T04:48:07.105672+0000","last_fullsized":"2024-06-02T04:48:07.105672+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T14:12:15.108989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.707203+0000","last_change":"2024-06-02T04:48:06.706766+0000","last_active":"2024-06-02T04:48:06.707203+0000","last_peered":"2024-06-02T04:48:06.707203+0000","last_clean":"2024-06-02T04:48:06.707203+0000","last_became_active":"2024-06-02T04:48:06.706440+0000","last_became_peered":"2024-06-02T04:48:06.706440+0000","last_unstale":"2024-06-02T04:48:06.707203+0000","last_undegraded":"2024-06-02T04:48:06.707203+0000","last_fullsized":"2024-06-02T04:48:06.707203+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:24:20.283467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"75'2","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.697476+0000","last_change":"2024-06-02T04:48:02.265259+0000","last_active":"2024-06-02T04:48:06.697476+0000","last_peered":"2024-06-02T04:48:06.697476+0000","last_clean":"2024-06-02T04:48:06.697476+0000","last_became_active":"2024-06-02T04:48:02.264931+0000","last_became_peered":"2024-06-02T04:48:02.264931+0000","last_unstale":"2024-06-02T04:48:06.697476+0000","last_undegraded":"2024-06-02T04:48:06.697476+0000","last_fullsized":"2024-06-02T04:48:06.697476+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:06:18.360519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.701931+0000","last_change":"2024-06-02T04:48:02.684808+0000","last_active":"2024-06-02T04:48:06.701931+0000","last_peered":"2024-06-02T04:48:06.701931+0000","last_clean":"2024-06-02T04:48:06.701931+0000","last_became_active":"2024-06-02T04:48:02.684492+0000","last_became_peered":"2024-06-02T04:48:02.684492+0000","last_unstale":"2024-06-02T04:48:06.701931+0000","last_undegraded":"2024-06-02T04:48:06.701931+0000","last_fullsized":"2024-06-02T04:48:06.701931+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T12:10:01.537377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.291954+0000","last_change":"2024-06-02T04:48:06.965041+0000","last_active":"2024-06-02T04:48:07.291954+0000","last_peered":"2024-06-02T04:48:07.291954+0000","last_clean":"2024-06-02T04:48:07.291954+0000","last_became_active":"2024-06-02T04:48:06.964487+0000","last_became_peered":"2024-06-02T04:48:06.964487+0000","last_unstale":"2024-06-02T04:48:07.291954+0000","last_undegraded":"2024-06-02T04:48:07.291954+0000","last_fullsized":"2024-06-02T04:48:07.291954+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:51:05.082026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:26.276806+0000","last_change":"2024-06-02T04:48:02.271485+0000","last_active":"2024-06-02T04:48:26.276806+0000","last_peered":"2024-06-02T04:48:26.276806+0000","last_clean":"2024-06-02T04:48:26.276806+0000","last_became_active":"2024-06-02T04:48:02.271156+0000","last_became_peered":"2024-06-02T04:48:02.271156+0000","last_unstale":"2024-06-02T04:48:26.276806+0000","last_undegraded":"2024-06-02T04:48:26.276806+0000","last_fullsized":"2024-06-02T04:48:26.276806+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:57:34.467559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.696113+0000","last_change":"2024-06-02T04:48:02.673700+0000","last_active":"2024-06-02T04:48:06.696113+0000","last_peered":"2024-06-02T04:48:06.696113+0000","last_clean":"2024-06-02T04:48:06.696113+0000","last_became_active":"2024-06-02T04:48:02.673262+0000","last_became_peered":"2024-06-02T04:48:02.673262+0000","last_unstale":"2024-06-02T04:48:06.696113+0000","last_undegraded":"2024-06-02T04:48:06.696113+0000","last_fullsized":"2024-06-02T04:48:06.696113+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:45:00.682562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.717730+0000","last_change":"2024-06-02T04:48:06.716848+0000","last_active":"2024-06-02T04:48:06.717730+0000","last_peered":"2024-06-02T04:48:06.717730+0000","last_clean":"2024-06-02T04:48:06.717730+0000","last_became_active":"2024-06-02T04:48:06.716411+0000","last_became_peered":"2024-06-02T04:48:06.716411+0000","last_unstale":"2024-06-02T04:48:06.717730+0000","last_undegraded":"2024-06-02T04:48:06.717730+0000","last_fullsized":"2024-06-02T04:48:06.717730+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T06:09:36.074569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"80'3","reported_seq":19,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:26.273955+0000","last_change":"2024-06-02T04:48:02.269426+0000","last_active":"2024-06-02T04:48:26.273955+0000","last_peered":"2024-06-02T04:48:26.273955+0000","last_clean":"2024-06-02T04:48:26.273955+0000","last_became_active":"2024-06-02T04:48:02.269115+0000","last_became_peered":"2024-06-02T04:48:02.269115+0000","last_unstale":"2024-06-02T04:48:26.273955+0000","last_undegraded":"2024-06-02T04:48:26.273955+0000","last_fullsized":"2024-06-02T04:48:26.273955+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:18:28.568367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.691586+0000","last_change":"2024-06-02T04:48:02.694234+0000","last_active":"2024-06-02T04:48:06.691586+0000","last_peered":"2024-06-02T04:48:06.691586+0000","last_clean":"2024-06-02T04:48:06.691586+0000","last_became_active":"2024-06-02T04:48:02.693916+0000","last_became_peered":"2024-06-02T04:48:02.693916+0000","last_unstale":"2024-06-02T04:48:06.691586+0000","last_undegraded":"2024-06-02T04:48:06.691586+0000","last_fullsized":"2024-06-02T04:48:06.691586+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T16:47:44.939277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.291788+0000","last_change":"2024-06-02T04:48:06.716026+0000","last_active":"2024-06-02T04:48:07.291788+0000","last_peered":"2024-06-02T04:48:07.291788+0000","last_clean":"2024-06-02T04:48:07.291788+0000","last_became_active":"2024-06-02T04:48:06.715730+0000","last_became_peered":"2024-06-02T04:48:06.715730+0000","last_unstale":"2024-06-02T04:48:07.291788+0000","last_undegraded":"2024-06-02T04:48:07.291788+0000","last_fullsized":"2024-06-02T04:48:07.291788+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:35:53.707307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.696497+0000","last_change":"2024-06-02T04:48:02.271576+0000","last_active":"2024-06-02T04:48:06.696497+0000","last_peered":"2024-06-02T04:48:06.696497+0000","last_clean":"2024-06-02T04:48:06.696497+0000","last_became_active":"2024-06-02T04:48:02.271101+0000","last_became_peered":"2024-06-02T04:48:02.271101+0000","last_unstale":"2024-06-02T04:48:06.696497+0000","last_undegraded":"2024-06-02T04:48:06.696497+0000","last_fullsized":"2024-06-02T04:48:06.696497+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T08:35:37.467479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.105325+0000","last_change":"2024-06-02T04:48:02.702773+0000","last_active":"2024-06-02T04:48:07.105325+0000","last_peered":"2024-06-02T04:48:07.105325+0000","last_clean":"2024-06-02T04:48:07.105325+0000","last_became_active":"2024-06-02T04:48:02.702415+0000","last_became_peered":"2024-06-02T04:48:02.702415+0000","last_unstale":"2024-06-02T04:48:07.105325+0000","last_undegraded":"2024-06-02T04:48:07.105325+0000","last_fullsized":"2024-06-02T04:48:07.105325+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:18:55.084384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.291891+0000","last_change":"2024-06-02T04:48:06.963120+0000","last_active":"2024-06-02T04:48:07.291891+0000","last_peered":"2024-06-02T04:48:07.291891+0000","last_clean":"2024-06-02T04:48:07.291891+0000","last_became_active":"2024-06-02T04:48:06.962509+0000","last_became_peered":"2024-06-02T04:48:06.962509+0000","last_unstale":"2024-06-02T04:48:07.291891+0000","last_undegraded":"2024-06-02T04:48:07.291891+0000","last_fullsized":"2024-06-02T04:48:07.291891+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T04:55:34.509179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:26.276892+0000","last_change":"2024-06-02T04:48:02.273511+0000","last_active":"2024-06-02T04:48:26.276892+0000","last_peered":"2024-06-02T04:48:26.276892+0000","last_clean":"2024-06-02T04:48:26.276892+0000","last_became_active":"2024-06-02T04:48:02.273100+0000","last_became_peered":"2024-06-02T04:48:02.273100+0000","last_unstale":"2024-06-02T04:48:26.276892+0000","last_undegraded":"2024-06-02T04:48:26.276892+0000","last_fullsized":"2024-06-02T04:48:26.276892+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:04:11.742406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.698614+0000","last_change":"2024-06-02T04:48:02.696594+0000","last_active":"2024-06-02T04:48:06.698614+0000","last_peered":"2024-06-02T04:48:06.698614+0000","last_clean":"2024-06-02T04:48:06.698614+0000","last_became_active":"2024-06-02T04:48:02.696278+0000","last_became_peered":"2024-06-02T04:48:02.696278+0000","last_unstale":"2024-06-02T04:48:06.698614+0000","last_undegraded":"2024-06-02T04:48:06.698614+0000","last_fullsized":"2024-06-02T04:48:06.698614+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T16:10:16.275451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.339646+0000","last_change":"2024-06-02T04:48:06.701837+0000","last_active":"2024-06-02T04:48:07.339646+0000","last_peered":"2024-06-02T04:48:07.339646+0000","last_clean":"2024-06-02T04:48:07.339646+0000","last_became_active":"2024-06-02T04:48:06.701454+0000","last_became_peered":"2024-06-02T04:48:06.701454+0000","last_unstale":"2024-06-02T04:48:07.339646+0000","last_undegraded":"2024-06-02T04:48:07.339646+0000","last_fullsized":"2024-06-02T04:48:07.339646+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T16:25:46.585200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.698230+0000","last_change":"2024-06-02T04:48:02.272941+0000","last_active":"2024-06-02T04:48:06.698230+0000","last_peered":"2024-06-02T04:48:06.698230+0000","last_clean":"2024-06-02T04:48:06.698230+0000","last_became_active":"2024-06-02T04:48:02.270149+0000","last_became_peered":"2024-06-02T04:48:02.270149+0000","last_unstale":"2024-06-02T04:48:06.698230+0000","last_undegraded":"2024-06-02T04:48:06.698230+0000","last_fullsized":"2024-06-02T04:48:06.698230+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T04:54:09.813917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.699678+0000","last_change":"2024-06-02T04:48:02.699722+0000","last_active":"2024-06-02T04:48:06.699678+0000","last_peered":"2024-06-02T04:48:06.699678+0000","last_clean":"2024-06-02T04:48:06.699678+0000","last_became_active":"2024-06-02T04:48:02.699376+0000","last_became_peered":"2024-06-02T04:48:02.699376+0000","last_unstale":"2024-06-02T04:48:06.699678+0000","last_undegraded":"2024-06-02T04:48:06.699678+0000","last_fullsized":"2024-06-02T04:48:06.699678+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T08:12:24.048499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.338868+0000","last_change":"2024-06-02T04:48:06.706493+0000","last_active":"2024-06-02T04:48:07.338868+0000","last_peered":"2024-06-02T04:48:07.338868+0000","last_clean":"2024-06-02T04:48:07.338868+0000","last_became_active":"2024-06-02T04:48:06.706135+0000","last_became_peered":"2024-06-02T04:48:06.706135+0000","last_unstale":"2024-06-02T04:48:07.338868+0000","last_undegraded":"2024-06-02T04:48:07.338868+0000","last_fullsized":"2024-06-02T04:48:07.338868+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:54:51.491641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"75'1","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.698221+0000","last_change":"2024-06-02T04:48:02.271534+0000","last_active":"2024-06-02T04:48:06.698221+0000","last_peered":"2024-06-02T04:48:06.698221+0000","last_clean":"2024-06-02T04:48:06.698221+0000","last_became_active":"2024-06-02T04:48:02.271144+0000","last_became_peered":"2024-06-02T04:48:02.271144+0000","last_unstale":"2024-06-02T04:48:06.698221+0000","last_undegraded":"2024-06-02T04:48:06.698221+0000","last_fullsized":"2024-06-02T04:48:06.698221+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:45:10.221432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.698395+0000","last_change":"2024-06-02T04:48:02.697089+0000","last_active":"2024-06-02T04:48:06.698395+0000","last_peered":"2024-06-02T04:48:06.698395+0000","last_clean":"2024-06-02T04:48:06.698395+0000","last_became_active":"2024-06-02T04:48:02.696755+0000","last_became_peered":"2024-06-02T04:48:02.696755+0000","last_unstale":"2024-06-02T04:48:06.698395+0000","last_undegraded":"2024-06-02T04:48:06.698395+0000","last_fullsized":"2024-06-02T04:48:06.698395+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T08:56:18.715019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.030079+0000","last_change":"2024-06-02T04:48:06.705906+0000","last_active":"2024-06-02T04:48:07.030079+0000","last_peered":"2024-06-02T04:48:07.030079+0000","last_clean":"2024-06-02T04:48:07.030079+0000","last_became_active":"2024-06-02T04:48:06.705502+0000","last_became_peered":"2024-06-02T04:48:06.705502+0000","last_unstale":"2024-06-02T04:48:07.030079+0000","last_undegraded":"2024-06-02T04:48:07.030079+0000","last_fullsized":"2024-06-02T04:48:07.030079+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T16:33:41.228392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"75'2","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.691448+0000","last_change":"2024-06-02T04:48:02.265912+0000","last_active":"2024-06-02T04:48:06.691448+0000","last_peered":"2024-06-02T04:48:06.691448+0000","last_clean":"2024-06-02T04:48:06.691448+0000","last_became_active":"2024-06-02T04:48:02.265494+0000","last_became_peered":"2024-06-02T04:48:02.265494+0000","last_unstale":"2024-06-02T04:48:06.691448+0000","last_undegraded":"2024-06-02T04:48:06.691448+0000","last_fullsized":"2024-06-02T04:48:06.691448+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T10:21:58.897765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.699265+0000","last_change":"2024-06-02T04:48:02.693091+0000","last_active":"2024-06-02T04:48:06.699265+0000","last_peered":"2024-06-02T04:48:06.699265+0000","last_clean":"2024-06-02T04:48:06.699265+0000","last_became_active":"2024-06-02T04:48:02.692025+0000","last_became_peered":"2024-06-02T04:48:02.692025+0000","last_unstale":"2024-06-02T04:48:06.699265+0000","last_undegraded":"2024-06-02T04:48:06.699265+0000","last_fullsized":"2024-06-02T04:48:06.699265+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T14:36:35.813881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.691657+0000","last_change":"2024-06-02T04:48:02.694381+0000","last_active":"2024-06-02T04:48:06.691657+0000","last_peered":"2024-06-02T04:48:06.691657+0000","last_clean":"2024-06-02T04:48:06.691657+0000","last_became_active":"2024-06-02T04:48:02.694049+0000","last_became_peered":"2024-06-02T04:48:02.694049+0000","last_unstale":"2024-06-02T04:48:06.691657+0000","last_undegraded":"2024-06-02T04:48:06.691657+0000","last_fullsized":"2024-06-02T04:48:06.691657+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:04:31.920810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.701162+0000","last_change":"2024-06-02T04:48:02.702174+0000","last_active":"2024-06-02T04:48:06.701162+0000","last_peered":"2024-06-02T04:48:06.701162+0000","last_clean":"2024-06-02T04:48:06.701162+0000","last_became_active":"2024-06-02T04:48:02.701893+0000","last_became_peered":"2024-06-02T04:48:02.701893+0000","last_unstale":"2024-06-02T04:48:06.701162+0000","last_undegraded":"2024-06-02T04:48:06.701162+0000","last_fullsized":"2024-06-02T04:48:06.701162+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:39:07.224256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.696402+0000","last_change":"2024-06-02T04:48:02.688547+0000","last_active":"2024-06-02T04:48:06.696402+0000","last_peered":"2024-06-02T04:48:06.696402+0000","last_clean":"2024-06-02T04:48:06.696402+0000","last_became_active":"2024-06-02T04:48:02.688183+0000","last_became_peered":"2024-06-02T04:48:02.688183+0000","last_unstale":"2024-06-02T04:48:06.696402+0000","last_undegraded":"2024-06-02T04:48:06.696402+0000","last_fullsized":"2024-06-02T04:48:06.696402+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:47:22.399630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.701544+0000","last_change":"2024-06-02T04:48:02.702958+0000","last_active":"2024-06-02T04:48:06.701544+0000","last_peered":"2024-06-02T04:48:06.701544+0000","last_clean":"2024-06-02T04:48:06.701544+0000","last_became_active":"2024-06-02T04:48:02.702640+0000","last_became_peered":"2024-06-02T04:48:02.702640+0000","last_unstale":"2024-06-02T04:48:06.701544+0000","last_undegraded":"2024-06-02T04:48:06.701544+0000","last_fullsized":"2024-06-02T04:48:06.701544+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T12:53:17.406762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.691930+0000","last_change":"2024-06-02T04:48:02.702817+0000","last_active":"2024-06-02T04:48:06.691930+0000","last_peered":"2024-06-02T04:48:06.691930+0000","last_clean":"2024-06-02T04:48:06.691930+0000","last_became_active":"2024-06-02T04:48:02.702526+0000","last_became_peered":"2024-06-02T04:48:02.702526+0000","last_unstale":"2024-06-02T04:48:06.691930+0000","last_undegraded":"2024-06-02T04:48:06.691930+0000","last_fullsized":"2024-06-02T04:48:06.691930+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:54:58.505585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.691852+0000","last_change":"2024-06-02T04:48:02.690645+0000","last_active":"2024-06-02T04:48:06.691852+0000","last_peered":"2024-06-02T04:48:06.691852+0000","last_clean":"2024-06-02T04:48:06.691852+0000","last_became_active":"2024-06-02T04:48:02.690282+0000","last_became_peered":"2024-06-02T04:48:02.690282+0000","last_unstale":"2024-06-02T04:48:06.691852+0000","last_undegraded":"2024-06-02T04:48:06.691852+0000","last_fullsized":"2024-06-02T04:48:06.691852+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:30:16.471475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.697098+0000","last_change":"2024-06-02T04:48:02.698865+0000","last_active":"2024-06-02T04:48:06.697098+0000","last_peered":"2024-06-02T04:48:06.697098+0000","last_clean":"2024-06-02T04:48:06.697098+0000","last_became_active":"2024-06-02T04:48:02.698554+0000","last_became_peered":"2024-06-02T04:48:02.698554+0000","last_unstale":"2024-06-02T04:48:06.697098+0000","last_undegraded":"2024-06-02T04:48:06.697098+0000","last_fullsized":"2024-06-02T04:48:06.697098+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:19:14.413170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.105716+0000","last_change":"2024-06-02T04:48:02.694345+0000","last_active":"2024-06-02T04:48:07.105716+0000","last_peered":"2024-06-02T04:48:07.105716+0000","last_clean":"2024-06-02T04:48:07.105716+0000","last_became_active":"2024-06-02T04:48:02.693866+0000","last_became_peered":"2024-06-02T04:48:02.693866+0000","last_unstale":"2024-06-02T04:48:07.105716+0000","last_undegraded":"2024-06-02T04:48:07.105716+0000","last_fullsized":"2024-06-02T04:48:07.105716+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:56:09.409774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.030106+0000","last_change":"2024-06-02T04:48:02.689609+0000","last_active":"2024-06-02T04:48:07.030106+0000","last_peered":"2024-06-02T04:48:07.030106+0000","last_clean":"2024-06-02T04:48:07.030106+0000","last_became_active":"2024-06-02T04:48:02.689279+0000","last_became_peered":"2024-06-02T04:48:02.689279+0000","last_unstale":"2024-06-02T04:48:07.030106+0000","last_undegraded":"2024-06-02T04:48:07.030106+0000","last_fullsized":"2024-06-02T04:48:07.030106+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T14:05:04.600923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.105060+0000","last_change":"2024-06-02T04:48:02.694124+0000","last_active":"2024-06-02T04:48:07.105060+0000","last_peered":"2024-06-02T04:48:07.105060+0000","last_clean":"2024-06-02T04:48:07.105060+0000","last_became_active":"2024-06-02T04:48:02.693787+0000","last_became_peered":"2024-06-02T04:48:02.693787+0000","last_unstale":"2024-06-02T04:48:07.105060+0000","last_undegraded":"2024-06-02T04:48:07.105060+0000","last_fullsized":"2024-06-02T04:48:07.105060+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T07:56:27.274107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.692381+0000","last_change":"2024-06-02T04:48:02.698736+0000","last_active":"2024-06-02T04:48:06.692381+0000","last_peered":"2024-06-02T04:48:06.692381+0000","last_clean":"2024-06-02T04:48:06.692381+0000","last_became_active":"2024-06-02T04:48:02.698285+0000","last_became_peered":"2024-06-02T04:48:02.698285+0000","last_unstale":"2024-06-02T04:48:06.692381+0000","last_undegraded":"2024-06-02T04:48:06.692381+0000","last_fullsized":"2024-06-02T04:48:06.692381+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T04:53:31.655139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.691329+0000","last_change":"2024-06-02T04:48:02.689942+0000","last_active":"2024-06-02T04:48:06.691329+0000","last_peered":"2024-06-02T04:48:06.691329+0000","last_clean":"2024-06-02T04:48:06.691329+0000","last_became_active":"2024-06-02T04:48:02.689096+0000","last_became_peered":"2024-06-02T04:48:02.689096+0000","last_unstale":"2024-06-02T04:48:06.691329+0000","last_undegraded":"2024-06-02T04:48:06.691329+0000","last_fullsized":"2024-06-02T04:48:06.691329+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:11:06.451048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.691855+0000","last_change":"2024-06-02T04:48:02.691514+0000","last_active":"2024-06-02T04:48:06.691855+0000","last_peered":"2024-06-02T04:48:06.691855+0000","last_clean":"2024-06-02T04:48:06.691855+0000","last_became_active":"2024-06-02T04:48:02.691169+0000","last_became_peered":"2024-06-02T04:48:02.691169+0000","last_unstale":"2024-06-02T04:48:06.691855+0000","last_undegraded":"2024-06-02T04:48:06.691855+0000","last_fullsized":"2024-06-02T04:48:06.691855+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T06:03:54.513910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":280790,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":25455,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":6,"num_read_kb":8,"num_write":103,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":245760,"data_stored":58419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":71,"seq":304942678029,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27876,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717276,"statfs":{"total":95995035648,"available":95966490624,"internally_reserved":0,"allocated":880640,"data_stored":442067,"data_compressed":11656,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]}]},{"osd":10,"up_from":64,"seq":274877906962,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32056,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713096,"statfs":{"total":95995035648,"available":95962210304,"internally_reserved":0,"allocated":966656,"data_stored":1033083,"data_compressed":47369,"data_compressed_allocated":61440,"data_compressed_original":622592,"omap_allocated":1599,"internal_metadata":31848897},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":1,"last update":"Sun Jun 2 04:48:17 2024","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.42499999999999999}]},{"osd":2,"last update":"Sun Jun 2 04:48:17 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.66800000000000004}]},{"osd":3,"last update":"Sun Jun 2 04:48:17 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.61099999999999999}]},{"osd":4,"last update":"Sun Jun 2 04:48:17 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.52400000000000002}]},{"osd":5,"last update":"Sun Jun 2 04:48:17 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.626}]},{"osd":6,"last update":"Sun Jun 2 04:48:17 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.65800000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":8,"last update":"Sun Jun 2 04:48:17 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.70699999999999996}]},{"osd":9,"last update":"Sun Jun 2 04:48:17 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.64400000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]}]},{"osd":9,"up_from":60,"seq":257698037781,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31988,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713164,"statfs":{"total":95995035648,"available":95962279936,"internally_reserved":0,"allocated":876544,"data_stored":437971,"data_compressed":11656,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1599,"internal_metadata":31848897},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 04:47:56 2024","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.41099999999999998}]},{"osd":1,"last update":"Sun Jun 2 04:47:56 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.58299999999999996}]},{"osd":2,"last update":"Sun Jun 2 04:47:56 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.64900000000000002}]},{"osd":3,"last update":"Sun Jun 2 04:47:56 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.434},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.35799999999999998}]},{"osd":4,"last update":"Sun Jun 2 04:47:56 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.59799999999999998}]},{"osd":5,"last update":"Sun Jun 2 04:47:56 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.498},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.67900000000000005}]},{"osd":6,"last update":"Sun Jun 2 04:47:56 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.505}]},{"osd":7,"last update":"Sun Jun 2 04:47:56 2024","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.53300000000000003}]},{"osd":8,"last update":"Sun Jun 2 04:47:56 2024","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.623},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.57299999999999995}]},{"osd":10,"last update":"Sun Jun 2 04:48:13 2024","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.61199999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]}]},{"osd":8,"up_from":53,"seq":227633266712,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27884,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717268,"statfs":{"total":95995035648,"available":95966482432,"internally_reserved":0,"allocated":888832,"data_stored":437796,"data_compressed":11656,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 04:47:37 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.57899999999999996}]},{"osd":1,"last update":"Sun Jun 2 04:47:37 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.499},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.56100000000000005}]},{"osd":2,"last update":"Sun Jun 2 04:47:37 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.432}]},{"osd":3,"last update":"Sun Jun 2 04:47:37 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.625},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.59699999999999998}]},{"osd":4,"last update":"Sun Jun 2 04:47:37 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.53600000000000003}]},{"osd":5,"last update":"Sun Jun 2 04:47:37 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.46999999999999997}]},{"osd":6,"last update":"Sun Jun 2 04:47:37 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.78200000000000003}]},{"osd":7,"last update":"Sun Jun 2 04:47:37 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.77300000000000002}]},{"osd":9,"last update":"Sun Jun 2 04:47:58 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.73999999999999999}]},{"osd":10,"last update":"Sun Jun 2 04:48:16 2024","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.68799999999999994}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]}]},{"osd":7,"up_from":46,"seq":197568495644,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32032,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713120,"statfs":{"total":95995035648,"available":95962234880,"internally_reserved":0,"allocated":925696,"data_stored":1028339,"data_compressed":47369,"data_compressed_allocated":61440,"data_compressed_original":622592,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 04:47:20 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.30199999999999999}]},{"osd":1,"last update":"Sun Jun 2 04:48:22 2024","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.42599999999999999,"15min":0.42299999999999999},"min":{"1min":0.31900000000000001,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.629,"5min":0.746,"15min":0.746},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.42999999999999999,"15min":0.42199999999999999},"min":{"1min":0.33600000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.66900000000000004,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.49399999999999999}]},{"osd":2,"last update":"Sun Jun 2 04:48:22 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.57999999999999996,"15min":0.57199999999999995},"min":{"1min":0.434,"5min":0.31,"15min":0.31},"max":{"1min":0.80700000000000005,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.58199999999999996,"15min":0.57399999999999995},"min":{"1min":0.42099999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.85899999999999999,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.71699999999999997}]},{"osd":3,"last update":"Sun Jun 2 04:48:22 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.59599999999999997,"15min":0.58999999999999997},"min":{"1min":0.435,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.93100000000000005,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.623,"5min":0.56899999999999995,"15min":0.56000000000000005},"min":{"1min":0.379,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.59599999999999997}]},{"osd":4,"last update":"Sun Jun 2 04:48:22 2024","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.442,"15min":0.437},"min":{"1min":0.34899999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.54300000000000004,"15min":0.53700000000000003},"min":{"1min":0.33200000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.746,"5min":0.879,"15min":0.879},"last":0.52300000000000002}]},{"osd":5,"last update":"Sun Jun 2 04:48:22 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.59999999999999998,"15min":0.59499999999999997},"min":{"1min":0.42099999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.66700000000000004,"15min":0.66100000000000003},"min":{"1min":0.48699999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.95299999999999996,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.73399999999999999}]},{"osd":6,"last update":"Sun Jun 2 04:48:22 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.63300000000000001,"15min":0.625},"min":{"1min":0.46899999999999997,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.629},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.624,"15min":0.61399999999999999},"min":{"1min":0.505,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.91800000000000004,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.53900000000000003}]},{"osd":8,"last update":"Sun Jun 2 04:47:40 2024","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.621}]},{"osd":9,"last update":"Sun Jun 2 04:47:56 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.66600000000000004}]},{"osd":10,"last update":"Sun Jun 2 04:48:16 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.78200000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80500000000000005}]}]},{"osd":6,"up_from":40,"seq":171798691871,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27872,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717280,"statfs":{"total":95995035648,"available":95966494720,"internally_reserved":0,"allocated":876544,"data_stored":437479,"data_compressed":11656,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 04:48:05 2024","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.38300000000000001,"15min":0.38600000000000001},"min":{"1min":0.27400000000000002,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.40200000000000002,"15min":0.41099999999999998},"min":{"1min":0.28699999999999998,"5min":0.251,"15min":0.251},"max":{"1min":0.49199999999999999,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.41699999999999998}]},{"osd":1,"last update":"Sun Jun 2 04:48:05 2024","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.56000000000000005,"15min":0.56399999999999995},"min":{"1min":0.378,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.73499999999999999,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.57899999999999996,"15min":0.58399999999999996},"min":{"1min":0.33600000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.749,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.56200000000000006}]},{"osd":2,"last update":"Sun Jun 2 04:48:05 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.56699999999999995,"15min":0.56899999999999995},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.746,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.57899999999999996,"15min":0.58199999999999996},"min":{"1min":0.40000000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.78300000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.68100000000000005}]},{"osd":3,"last update":"Sun Jun 2 04:48:05 2024","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.44700000000000001,"15min":0.45600000000000002},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.65700000000000003,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.441},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.46400000000000002,"15min":0.47099999999999997},"min":{"1min":0.32800000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.52900000000000003,"5min":0.745,"15min":0.745},"last":0.51700000000000002}]},{"osd":4,"last update":"Sun Jun 2 04:48:05 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.60199999999999998,"15min":0.60399999999999998},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.78900000000000003,"5min":1.032,"15min":1.032},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.626,"15min":0.63800000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.69799999999999995,"5min":1.071,"15min":1.071},"last":0.60099999999999998}]},{"osd":5,"last update":"Sun Jun 2 04:48:05 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.61499999999999999,"15min":0.62},"min":{"1min":0.39500000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.64500000000000002,"15min":0.65100000000000002},"min":{"1min":0.48099999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.77000000000000002,"5min":0.999,"15min":0.999},"last":0.871}]},{"osd":7,"last update":"Sun Jun 2 04:48:23 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.63600000000000001,"15min":0.63900000000000001},"min":{"1min":0.45300000000000001,"5min":0.439,"15min":0.439},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.747},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.64100000000000001,"15min":0.64800000000000002},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.79400000000000004,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.63900000000000001}]},{"osd":8,"last update":"Sun Jun 2 04:47:39 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.83699999999999997}]},{"osd":9,"last update":"Sun Jun 2 04:47:56 2024","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.66600000000000004}]},{"osd":10,"last update":"Sun Jun 2 04:48:15 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.75800000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85699999999999998}]}]},{"osd":1,"up_from":12,"seq":51539607601,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36088,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93709064,"statfs":{"total":95995035648,"available":95958081536,"internally_reserved":0,"allocated":901120,"data_stored":456387,"data_compressed":11656,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 04:47:44 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.49399999999999999,"15min":0.48599999999999999},"min":{"1min":0.30199999999999999,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.48999999999999999,"15min":0.48599999999999999},"min":{"1min":0.34399999999999997,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.66900000000000004,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.46300000000000002}]},{"osd":2,"last update":"Sun Jun 2 04:47:59 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.35599999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.51000000000000001,"15min":0.502},"min":{"1min":0.38600000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.57699999999999996}]},{"osd":3,"last update":"Sun Jun 2 04:48:16 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.5,"15min":0.48799999999999999},"min":{"1min":0.35499999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.50900000000000001,"15min":0.503},"min":{"1min":0.377,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.376}]},{"osd":4,"last update":"Sun Jun 2 04:47:39 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.39800000000000002,"15min":0.38600000000000001},"min":{"1min":0.26400000000000001,"5min":0.248,"15min":0.248},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.41899999999999998,"15min":0.40699999999999997},"min":{"1min":0.30499999999999999,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.47699999999999998}]},{"osd":5,"last update":"Sun Jun 2 04:47:50 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.54200000000000004,"15min":0.53500000000000003},"min":{"1min":0.36299999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.627},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.60499999999999998,"15min":0.59299999999999997},"min":{"1min":0.48399999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.61899999999999999}]},{"osd":6,"last update":"Sun Jun 2 04:48:07 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.60499999999999998,"15min":0.59299999999999997},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.60399999999999998,"15min":0.59399999999999997},"min":{"1min":0.51000000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.56499999999999995}]},{"osd":7,"last update":"Sun Jun 2 04:48:27 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.53900000000000003,"15min":0.53800000000000003},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.498},{"interface":"front","average":{"1min":0.627,"5min":0.58799999999999997,"15min":0.58199999999999996},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.63900000000000001}]},{"osd":8,"last update":"Sun Jun 2 04:47:39 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.65300000000000002}]},{"osd":9,"last update":"Sun Jun 2 04:47:57 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.67700000000000005}]},{"osd":10,"last update":"Sun Jun 2 04:48:16 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.68899999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]}]},{"osd":0,"up_from":8,"seq":34359738419,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31976,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713176,"statfs":{"total":95995035648,"available":95962292224,"internally_reserved":0,"allocated":884736,"data_stored":438083,"data_compressed":11656,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jun 2 04:47:42 2024","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.48899999999999999,"15min":0.46300000000000002},"min":{"1min":0.41199999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.48899999999999999,"15min":0.45800000000000002},"min":{"1min":0.39500000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.52800000000000002}]},{"osd":2,"last update":"Sun Jun 2 04:48:00 2024","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.495,"15min":0.46700000000000003},"min":{"1min":0.39300000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.51800000000000002,"15min":0.47999999999999998},"min":{"1min":0.46000000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.84799999999999998,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.621}]},{"osd":3,"last update":"Sun Jun 2 04:47:17 2024","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.41899999999999998,"15min":0.40699999999999997},"min":{"1min":0.317,"5min":0.253,"15min":0.253},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.438,"15min":0.436},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.33600000000000002}]},{"osd":4,"last update":"Sun Jun 2 04:47:32 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.53200000000000003,"15min":0.51600000000000001},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.81100000000000005,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.52700000000000002,"15min":0.52000000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.54200000000000004}]},{"osd":5,"last update":"Sun Jun 2 04:47:51 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.55200000000000005,"15min":0.53200000000000003},"min":{"1min":0.47599999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.56000000000000005,"15min":0.53700000000000003},"min":{"1min":0.55700000000000005,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.57299999999999995}]},{"osd":6,"last update":"Sun Jun 2 04:48:08 2024","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.49199999999999999,"15min":0.49299999999999999},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.76300000000000001,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.47099999999999997,"15min":0.46899999999999997},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.44700000000000001}]},{"osd":7,"last update":"Sun Jun 2 04:47:21 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.68500000000000005}]},{"osd":8,"last update":"Sun Jun 2 04:47:38 2024","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.65800000000000003}]},{"osd":9,"last update":"Sun Jun 2 04:47:56 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.503}]},{"osd":10,"last update":"Sun Jun 2 04:48:16 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.59299999999999997}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]}]},{"osd":2,"up_from":16,"seq":68719476781,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31980,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713172,"statfs":{"total":95995035648,"available":95962288128,"internally_reserved":0,"allocated":888832,"data_stored":441219,"data_compressed":11656,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 04:48:05 2024","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.496,"15min":0.48599999999999999},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.71499999999999997,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.50800000000000001,"15min":0.50900000000000001},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.66200000000000003,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.45300000000000001}]},{"osd":1,"last update":"Sun Jun 2 04:48:05 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.53500000000000003,"15min":0.52900000000000003},"min":{"1min":0.36899999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.74299999999999999,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.54200000000000004,"15min":0.54400000000000004},"min":{"1min":0.39700000000000002,"5min":0.254,"15min":0.254},"max":{"1min":0.79300000000000004,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.72999999999999998}]},{"osd":3,"last update":"Sun Jun 2 04:48:22 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.55500000000000005,"15min":0.55700000000000005},"min":{"1min":0.39000000000000001,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.71599999999999997,"5min":1.472,"15min":1.472},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.53200000000000003,"15min":0.52700000000000002},"min":{"1min":0.372,"5min":0.308,"15min":0.308},"max":{"1min":0.80400000000000005,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.52400000000000002}]},{"osd":4,"last update":"Sun Jun 2 04:47:33 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.51700000000000002,"15min":0.51300000000000001},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.68100000000000005,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.34699999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.66400000000000003,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.74199999999999999}]},{"osd":5,"last update":"Sun Jun 2 04:47:51 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.432,"15min":0.41599999999999998},"min":{"1min":0.29599999999999999,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.45900000000000002,"15min":0.44500000000000001},"min":{"1min":0.32000000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.58199999999999996}]},{"osd":6,"last update":"Sun Jun 2 04:48:05 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.39900000000000002,"5min":0.372,"15min":0.372},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.503},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.64000000000000001,"15min":0.63300000000000001},"min":{"1min":0.45400000000000001,"5min":0.438,"15min":0.438},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.69599999999999995}]},{"osd":7,"last update":"Sun Jun 2 04:47:24 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.68100000000000005}]},{"osd":8,"last update":"Sun Jun 2 04:47:38 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.64800000000000002}]},{"osd":9,"last update":"Sun Jun 2 04:48:01 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.85099999999999998}]},{"osd":10,"last update":"Sun Jun 2 04:48:16 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.71799999999999997}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]}]},{"osd":3,"up_from":22,"seq":94489280553,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31976,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713176,"statfs":{"total":95995035648,"available":95962292224,"internally_reserved":0,"allocated":884736,"data_stored":437583,"data_compressed":11656,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 04:48:20 2024","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.32400000000000001,"15min":0.312},"min":{"1min":0.24199999999999999,"5min":0.221,"15min":0.221},"max":{"1min":0.44400000000000001,"5min":0.48999999999999999,"15min":0.48999999999999999},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.34899999999999998,"15min":0.34100000000000003},"min":{"1min":0.255,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.55500000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.47399999999999998}]},{"osd":1,"last update":"Sun Jun 2 04:48:20 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.48299999999999998,"15min":0.46300000000000002},"min":{"1min":0.40999999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.65700000000000003,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.48999999999999999,"15min":0.46200000000000002},"min":{"1min":0.39100000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.68799999999999994,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.55100000000000005}]},{"osd":2,"last update":"Sun Jun 2 04:48:20 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.56000000000000005,"15min":0.56399999999999995},"min":{"1min":0.377,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.73999999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.57899999999999996,"15min":0.59099999999999997},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.63300000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":0.77000000000000002}]},{"osd":4,"last update":"Sun Jun 2 04:47:34 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.502,"15min":0.495},"min":{"1min":0.38400000000000001,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.50700000000000001,"15min":0.499},"min":{"1min":0.33800000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.67300000000000004}]},{"osd":5,"last update":"Sun Jun 2 04:47:51 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.55200000000000005,"15min":0.54900000000000004},"min":{"1min":0.42599999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.81999999999999995,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.65300000000000002}]},{"osd":6,"last update":"Sun Jun 2 04:48:06 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.46899999999999997,"15min":0.46700000000000003},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.628},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.47199999999999998,"15min":0.47099999999999997},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.63200000000000001,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.51900000000000002}]},{"osd":7,"last update":"Sun Jun 2 04:48:26 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.44900000000000001,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.80500000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.628,"5min":0.64800000000000002,"15min":0.65100000000000002},"min":{"1min":0.48899999999999999,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.751,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.751}]},{"osd":8,"last update":"Sun Jun 2 04:47:39 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.51100000000000001}]},{"osd":9,"last update":"Sun Jun 2 04:48:00 2024","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.66100000000000003}]},{"osd":10,"last update":"Sun Jun 2 04:48:14 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.82399999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]}]},{"osd":4,"up_from":29,"seq":124554051622,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31980,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713172,"statfs":{"total":95995035648,"available":95962288128,"internally_reserved":0,"allocated":876544,"data_stored":437411,"data_compressed":11656,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 04:47:31 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.49199999999999999,"15min":0.48099999999999998},"min":{"1min":0.32400000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.495,"15min":0.48699999999999999},"min":{"1min":0.35199999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.78900000000000003,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.34300000000000003}]},{"osd":1,"last update":"Sun Jun 2 04:47:31 2024","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.34399999999999997,"15min":0.33800000000000002},"min":{"1min":0.30199999999999999,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.495,"5min":0.495,"15min":0.495},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.36899999999999999,"15min":0.36099999999999999},"min":{"1min":0.26100000000000001,"5min":0.217,"15min":0.217},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.40999999999999998}]},{"osd":2,"last update":"Sun Jun 2 04:47:31 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.52500000000000002,"15min":0.52300000000000002},"min":{"1min":0.41699999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.73599999999999999,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.622,"5min":0.54400000000000004,"15min":0.53100000000000003},"min":{"1min":0.44,"5min":0.377,"15min":0.377},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.56999999999999995}]},{"osd":3,"last update":"Sun Jun 2 04:47:31 2024","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.52200000000000002,"15min":0.51200000000000001},"min":{"1min":0.38200000000000001,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.51200000000000001,"15min":0.50700000000000001},"min":{"1min":0.34000000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.68799999999999994,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.38100000000000001}]},{"osd":5,"last update":"Sun Jun 2 04:47:49 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.60299999999999998,"15min":0.59999999999999998},"min":{"1min":0.40699999999999997,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.59999999999999998,"15min":0.59299999999999997},"min":{"1min":0.45200000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.65300000000000002}]},{"osd":6,"last update":"Sun Jun 2 04:48:07 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.57199999999999995,"15min":0.55700000000000005},"min":{"1min":0.40100000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.59199999999999997,"15min":0.57599999999999996},"min":{"1min":0.41999999999999998,"5min":0.379,"15min":0.379},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.45000000000000001}]},{"osd":7,"last update":"Sun Jun 2 04:48:24 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.53100000000000003,"15min":0.52200000000000002},"min":{"1min":0.36399999999999999,"5min":0.312,"15min":0.312},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.56499999999999995,"15min":0.55100000000000005},"min":{"1min":0.38100000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.61699999999999999}]},{"osd":8,"last update":"Sun Jun 2 04:47:38 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.63900000000000001}]},{"osd":9,"last update":"Sun Jun 2 04:47:58 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.5}]},{"osd":10,"last update":"Sun Jun 2 04:48:15 2024","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.69999999999999996}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]}]},{"osd":5,"up_from":33,"seq":141733920803,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":950272,"data_stored":1029185,"data_compressed":47369,"data_compressed_allocated":61440,"data_compressed_original":622592,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 04:47:50 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.48899999999999999,"15min":0.47999999999999998},"min":{"1min":0.35299999999999998,"5min":0.249,"15min":0.249},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.46000000000000002,"15min":0.44600000000000001},"min":{"1min":0.38700000000000001,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.374}]},{"osd":1,"last update":"Sun Jun 2 04:47:50 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.52900000000000003,"15min":0.52100000000000002},"min":{"1min":0.36699999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.53800000000000003,"15min":0.53100000000000003},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.64900000000000002}]},{"osd":2,"last update":"Sun Jun 2 04:47:50 2024","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.39100000000000001,"15min":0.38900000000000001},"min":{"1min":0.26900000000000002,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.317},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.38100000000000001,"15min":0.377},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.34000000000000002}]},{"osd":3,"last update":"Sun Jun 2 04:47:50 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.51900000000000002,"15min":0.51700000000000002},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.70499999999999996,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.51500000000000001,"15min":0.504},"min":{"1min":0.41999999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.46100000000000002}]},{"osd":4,"last update":"Sun Jun 2 04:47:50 2024","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.55500000000000005,"15min":0.55000000000000004},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.54300000000000004}]},{"osd":6,"last update":"Sun Jun 2 04:48:07 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56999999999999995,"15min":0.57099999999999995},"min":{"1min":0.42099999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.439},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.58599999999999997,"15min":0.57799999999999996},"min":{"1min":0.46800000000000003,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.55500000000000005}]},{"osd":7,"last update":"Sun Jun 2 04:48:23 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.65600000000000003,"15min":0.65400000000000003},"min":{"1min":0.42499999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.92400000000000004,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.625},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.65500000000000003,"15min":0.64700000000000002},"min":{"1min":0.45400000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.71199999999999997}]},{"osd":8,"last update":"Sun Jun 2 04:47:41 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.48599999999999999}]},{"osd":9,"last update":"Sun Jun 2 04:48:01 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.498},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.60699999999999998}]},{"osd":10,"last update":"Sun Jun 2 04:48:13 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.66000000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34075,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34075,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34075,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35713,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35713,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35713,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35713,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35713,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":23097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":25020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-02T04:48:31.794 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-06-02T04:48:31.795 INFO:tasks.cephadm:Setting up client nodes... 2024-06-02T04:48:31.795 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 60ab6d30-209a-11ef-bc9b-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-06-02T04:48:32.050 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T04:48:32.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:32 smithi076 ceph-mon[42935]: from='client.14916 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-02T04:48:32.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:32 smithi119 ceph-mon[46633]: from='client.14916 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-02T04:48:32.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:32 smithi192 ceph-mon[47933]: from='client.14916 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-02T04:48:33.079 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:33.078+0000 7f52c0dfb700 1 -- 172.21.15.76:0/3290283690 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f52bc0ffe80 msgr2=0x7f52bc1002a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:33.079 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:33.078+0000 7f52c0dfb700 1 --2- 172.21.15.76:0/3290283690 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f52bc0ffe80 0x7f52bc1002a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f52b0009990 tx=0x7f52b0009ca0 comp rx=0 tx=0).stop 2024-06-02T04:48:33.079 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:33.078+0000 7f52c0dfb700 1 -- 172.21.15.76:0/3290283690 shutdown_connections 2024-06-02T04:48:33.079 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:33.078+0000 7f52c0dfb700 1 --2- 172.21.15.76:0/3290283690 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f52bc1019a0 0x7f52bc1082c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:33.079 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:33.078+0000 7f52c0dfb700 1 --2- 172.21.15.76:0/3290283690 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f52bc0ffe80 0x7f52bc1002a0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:33.080 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:33.078+0000 7f52c0dfb700 1 --2- 172.21.15.76:0/3290283690 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f52bc100fe0 0x7f52bc101460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:33.080 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:33.078+0000 7f52c0dfb700 1 -- 172.21.15.76:0/3290283690 >> 172.21.15.76:0/3290283690 conn(0x7f52bc0fb420 msgr2=0x7f52bc0fd860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:33.080 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:33.078+0000 7f52c0dfb700 1 -- 172.21.15.76:0/3290283690 shutdown_connections 2024-06-02T04:48:33.080 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:33.078+0000 7f52c0dfb700 1 -- 172.21.15.76:0/3290283690 wait complete. 2024-06-02T04:48:33.081 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:33.079+0000 7f52c0dfb700 1 Processor -- start 2024-06-02T04:48:33.082 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:33.079+0000 7f52c0dfb700 1 -- start start 2024-06-02T04:48:33.082 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:33.079+0000 7f52c0dfb700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f52bc0ffe80 0x7f52bc196e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:33.082 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:33.080+0000 7f52c0dfb700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f52bc100fe0 0x7f52bc197340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:33.082 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:33.080+0000 7f52c0dfb700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f52bc1019a0 0x7f52bc19e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:33.082 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:33.080+0000 7f52c0dfb700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52bc19e8f0 con 0x7f52bc1019a0 2024-06-02T04:48:33.082 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:33.080+0000 7f52c0dfb700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52bc19ea30 con 0x7f52bc100fe0 2024-06-02T04:48:33.082 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:33.080+0000 7f52c0dfb700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52bc19ebc0 con 0x7f52bc0ffe80 2024-06-02T04:48:33.082 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:33.080+0000 7f52bad9d700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f52bc1019a0 0x7f52bc19e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:33.082 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:33.080+0000 7f52bad9d700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f52bc1019a0 0x7f52bc19e320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:33786/0 (socket says 172.21.15.76:33786) 2024-06-02T04:48:33.082 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:33.080+0000 7f52bad9d700 1 -- 172.21.15.76:0/776171449 learned_addr learned my addr 172.21.15.76:0/776171449 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:48:33.083 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:33.080+0000 7f52b9d9b700 1 --2- 172.21.15.76:0/776171449 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f52bc100fe0 0x7f52bc197340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:33.083 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:33.080+0000 7f52ba59c700 1 --2- 172.21.15.76:0/776171449 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f52bc0ffe80 0x7f52bc196e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:33.083 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:33.080+0000 7f52bad9d700 1 -- 172.21.15.76:0/776171449 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f52bc0ffe80 msgr2=0x7f52bc196e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:33.083 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:33.080+0000 7f52bad9d700 1 --2- 172.21.15.76:0/776171449 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f52bc0ffe80 0x7f52bc196e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:33.083 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:33.080+0000 7f52bad9d700 1 -- 172.21.15.76:0/776171449 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f52bc100fe0 msgr2=0x7f52bc197340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:33.083 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:33.080+0000 7f52bad9d700 1 --2- 172.21.15.76:0/776171449 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f52bc100fe0 0x7f52bc197340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:33.083 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:33.080+0000 7f52bad9d700 1 -- 172.21.15.76:0/776171449 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52b00095f0 con 0x7f52bc1019a0 2024-06-02T04:48:33.083 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:33.080+0000 7f52bad9d700 1 --2- 172.21.15.76:0/776171449 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f52bc1019a0 0x7f52bc19e320 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f52b400add0 tx=0x7f52b400c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:33.083 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:33.080+0000 7f52ab7fe700 1 -- 172.21.15.76:0/776171449 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b400f070 con 0x7f52bc1019a0 2024-06-02T04:48:33.083 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:33.080+0000 7f52ab7fe700 1 -- 172.21.15.76:0/776171449 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f52b4007b30 con 0x7f52bc1019a0 2024-06-02T04:48:33.083 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:33.080+0000 7f52c0dfb700 1 -- 172.21.15.76:0/776171449 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52bc19eea0 con 0x7f52bc1019a0 2024-06-02T04:48:33.083 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:33.080+0000 7f52ab7fe700 1 -- 172.21.15.76:0/776171449 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b4005280 con 0x7f52bc1019a0 2024-06-02T04:48:33.083 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:33.080+0000 7f52c0dfb700 1 -- 172.21.15.76:0/776171449 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52bc19f2c0 con 0x7f52bc1019a0 2024-06-02T04:48:33.083 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:33.081+0000 7f52c0dfb700 1 -- 172.21.15.76:0/776171449 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52bc04ec60 con 0x7f52bc1019a0 2024-06-02T04:48:33.084 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:33.082+0000 7f52ab7fe700 1 -- 172.21.15.76:0/776171449 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f52b400c940 con 0x7f52bc1019a0 2024-06-02T04:48:33.084 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:33.083+0000 7f52ab7fe700 1 --2- 172.21.15.76:0/776171449 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f52a40a11b0 0x7f52a40a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:33.085 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:33.083+0000 7f52ba59c700 1 --2- 172.21.15.76:0/776171449 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f52a40a11b0 0x7f52a40a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:33.085 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:33.083+0000 7f52ab7fe700 1 -- 172.21.15.76:0/776171449 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f52b40cc2c0 con 0x7f52bc1019a0 2024-06-02T04:48:33.085 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:33.083+0000 7f52ba59c700 1 --2- 172.21.15.76:0/776171449 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f52a40a11b0 0x7f52a40a3670 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f52b000b5c0 tx=0x7f52b0005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:33.087 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:33.087+0000 7f52ab7fe700 1 -- 172.21.15.76:0/776171449 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f52b4095730 con 0x7f52bc1019a0 2024-06-02T04:48:33.362 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:33.362+0000 7f52c0dfb700 1 -- 172.21.15.76:0/776171449 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f52bc10b540 con 0x7f52bc1019a0 2024-06-02T04:48:33.366 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:33.366+0000 7f52ab7fe700 1 -- 172.21.15.76:0/776171449 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v31) v1 ==== 170+0+59 (secure 0 0 0) 0x7f52b4098d50 con 0x7f52bc1019a0 2024-06-02T04:48:33.367 INFO:teuthology.orchestra.run.smithi076.stdout:[client.0] 2024-06-02T04:48:33.367 INFO:teuthology.orchestra.run.smithi076.stdout: key = AQCh+VtmHvqsFRAAVo4z4fkTF+54bhm4ZU8EJQ== 2024-06-02T04:48:33.369 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:33.368+0000 7f52c0dfb700 1 -- 172.21.15.76:0/776171449 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f52a40a11b0 msgr2=0x7f52a40a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:33.369 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:33.368+0000 7f52c0dfb700 1 --2- 172.21.15.76:0/776171449 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f52a40a11b0 0x7f52a40a3670 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f52b000b5c0 tx=0x7f52b0005fb0 comp rx=0 tx=0).stop 2024-06-02T04:48:33.369 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:33.368+0000 7f52c0dfb700 1 -- 172.21.15.76:0/776171449 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f52bc1019a0 msgr2=0x7f52bc19e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:33.369 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:33.368+0000 7f52c0dfb700 1 --2- 172.21.15.76:0/776171449 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f52bc1019a0 0x7f52bc19e320 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f52b400add0 tx=0x7f52b400c330 comp rx=0 tx=0).stop 2024-06-02T04:48:33.369 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:33.369+0000 7f52c0dfb700 1 -- 172.21.15.76:0/776171449 shutdown_connections 2024-06-02T04:48:33.369 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:33.369+0000 7f52c0dfb700 1 --2- 172.21.15.76:0/776171449 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f52bc1019a0 0x7f52bc19e320 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:33.369 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:33.369+0000 7f52c0dfb700 1 --2- 172.21.15.76:0/776171449 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f52bc0ffe80 0x7f52bc196e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:33.369 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:33.369+0000 7f52c0dfb700 1 --2- 172.21.15.76:0/776171449 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f52a40a11b0 0x7f52a40a3670 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:33.369 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:33.369+0000 7f52c0dfb700 1 --2- 172.21.15.76:0/776171449 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f52bc100fe0 0x7f52bc197340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:33.370 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:33.369+0000 7f52c0dfb700 1 -- 172.21.15.76:0/776171449 >> 172.21.15.76:0/776171449 conn(0x7f52bc0fb420 msgr2=0x7f52bc0695c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:33.370 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:33.369+0000 7f52c0dfb700 1 -- 172.21.15.76:0/776171449 shutdown_connections 2024-06-02T04:48:33.370 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:33.369+0000 7f52c0dfb700 1 -- 172.21.15.76:0/776171449 wait complete. 2024-06-02T04:48:33.567 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:33 smithi076 ceph-mon[42935]: from='client.14922 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-02T04:48:33.567 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:33 smithi076 ceph-mon[42935]: pgmap v233: 129 pgs: 129 active+clean; 604 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4.2 KiB/s wr, 9 op/s 2024-06-02T04:48:33.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:33 smithi119 ceph-mon[46633]: from='client.14922 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-02T04:48:33.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:33 smithi119 ceph-mon[46633]: pgmap v233: 129 pgs: 129 active+clean; 604 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4.2 KiB/s wr, 9 op/s 2024-06-02T04:48:33.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:33 smithi192 ceph-mon[47933]: from='client.14922 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-02T04:48:33.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:33 smithi192 ceph-mon[47933]: pgmap v233: 129 pgs: 129 active+clean; 604 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4.2 KiB/s wr, 9 op/s 2024-06-02T04:48:33.751 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2024-06-02T04:48:33.751 DEBUG:teuthology.orchestra.run.smithi076:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-06-02T04:48:33.751 DEBUG:teuthology.orchestra.run.smithi076:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-06-02T04:48:33.793 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-06-02T04:48:33.793 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-06-02T04:48:33.794 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell --fsid 60ab6d30-209a-11ef-bc9b-c7b262605968 -- ceph mgr dump --format=json 2024-06-02T04:48:34.052 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T04:48:34.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:34 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/776171449' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-06-02T04:48:34.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:34 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/776171449' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-06-02T04:48:34.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:34 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/776171449' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-06-02T04:48:34.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:34 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/776171449' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-06-02T04:48:34.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:34 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/776171449' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-06-02T04:48:34.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:34 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/776171449' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-06-02T04:48:35.045 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:35.043+0000 7f18483c7700 1 -- 172.21.15.76:0/2691035897 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f18401051c0 msgr2=0x7f184010cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:35.045 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:35.043+0000 7f18483c7700 1 --2- 172.21.15.76:0/2691035897 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f18401051c0 0x7f184010cd90 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f183800b0a0 tx=0x7f183800b3b0 comp rx=0 tx=0).stop 2024-06-02T04:48:35.045 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:35.043+0000 7f18483c7700 1 -- 172.21.15.76:0/2691035897 shutdown_connections 2024-06-02T04:48:35.045 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:35.043+0000 7f18483c7700 1 --2- 172.21.15.76:0/2691035897 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f18401051c0 0x7f184010cd90 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:35.046 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:35.043+0000 7f18483c7700 1 --2- 172.21.15.76:0/2691035897 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f18401000e0 0x7f18401004c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:35.046 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:35.043+0000 7f18483c7700 1 --2- 172.21.15.76:0/2691035897 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1840100a90 0x7f1840104ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:35.046 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:35.043+0000 7f18483c7700 1 -- 172.21.15.76:0/2691035897 >> 172.21.15.76:0/2691035897 conn(0x7f1840076ec0 msgr2=0x7f18400772d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:35.046 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:35.043+0000 7f18483c7700 1 -- 172.21.15.76:0/2691035897 shutdown_connections 2024-06-02T04:48:35.046 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:35.043+0000 7f18483c7700 1 -- 172.21.15.76:0/2691035897 wait complete. 2024-06-02T04:48:35.046 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:35.043+0000 7f18483c7700 1 Processor -- start 2024-06-02T04:48:35.046 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:35.043+0000 7f18483c7700 1 -- start start 2024-06-02T04:48:35.046 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:35.044+0000 7f18483c7700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f18401000e0 0x7f18401974a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:35.046 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:35.044+0000 7f18483c7700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1840100a90 0x7f18401979e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:35.046 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:35.044+0000 7f18483c7700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f18401051c0 0x7f184019bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:35.046 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:35.044+0000 7f18483c7700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f184019c350 con 0x7f18401051c0 2024-06-02T04:48:35.046 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:35.044+0000 7f18483c7700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f184019c4c0 con 0x7f1840100a90 2024-06-02T04:48:35.046 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:35.044+0000 7f18483c7700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f184019c680 con 0x7f18401000e0 2024-06-02T04:48:35.047 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:35.044+0000 7f1846964700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f18401051c0 0x7f184019bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:35.047 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:35.044+0000 7f1846964700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f18401051c0 0x7f184019bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:33808/0 (socket says 172.21.15.76:33808) 2024-06-02T04:48:35.047 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:35.044+0000 7f1846964700 1 -- 172.21.15.76:0/912820853 learned_addr learned my addr 172.21.15.76:0/912820853 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:48:35.047 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:35.044+0000 7f1845962700 1 --2- 172.21.15.76:0/912820853 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1840100a90 0x7f18401979e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:35.047 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:35.044+0000 7f1846163700 1 --2- 172.21.15.76:0/912820853 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f18401000e0 0x7f18401974a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:35.047 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:35.044+0000 7f1846964700 1 -- 172.21.15.76:0/912820853 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f18401000e0 msgr2=0x7f18401974a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:35.047 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:35.044+0000 7f1846964700 1 --2- 172.21.15.76:0/912820853 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f18401000e0 0x7f18401974a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:35.047 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:35.044+0000 7f1846964700 1 -- 172.21.15.76:0/912820853 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1840100a90 msgr2=0x7f18401979e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:35.047 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:35.044+0000 7f1846964700 1 --2- 172.21.15.76:0/912820853 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1840100a90 0x7f18401979e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:35.047 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:35.044+0000 7f1846964700 1 -- 172.21.15.76:0/912820853 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1838009d00 con 0x7f18401051c0 2024-06-02T04:48:35.047 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:35.044+0000 7f1846964700 1 --2- 172.21.15.76:0/912820853 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f18401051c0 0x7f184019bd40 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f183800b070 tx=0x7f1838009380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:35.048 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:35.044+0000 7f18377fe700 1 -- 172.21.15.76:0/912820853 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f183800e040 con 0x7f18401051c0 2024-06-02T04:48:35.048 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:35.044+0000 7f18483c7700 1 -- 172.21.15.76:0/912820853 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f184019c900 con 0x7f18401051c0 2024-06-02T04:48:35.048 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:35.044+0000 7f18377fe700 1 -- 172.21.15.76:0/912820853 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f183800ce50 con 0x7f18401051c0 2024-06-02T04:48:35.048 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:35.044+0000 7f18377fe700 1 -- 172.21.15.76:0/912820853 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f183801b450 con 0x7f18401051c0 2024-06-02T04:48:35.048 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:35.045+0000 7f18483c7700 1 -- 172.21.15.76:0/912820853 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18401a41c0 con 0x7f18401051c0 2024-06-02T04:48:35.049 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:35.045+0000 7f18483c7700 1 -- 172.21.15.76:0/912820853 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18401094f0 con 0x7f18401051c0 2024-06-02T04:48:35.049 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:35.047+0000 7f18377fe700 1 -- 172.21.15.76:0/912820853 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f183801d480 con 0x7f18401051c0 2024-06-02T04:48:35.049 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:35.047+0000 7f18377fe700 1 --2- 172.21.15.76:0/912820853 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f182c0a11b0 0x7f182c0a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:35.049 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:35.047+0000 7f1846163700 1 --2- 172.21.15.76:0/912820853 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f182c0a11b0 0x7f182c0a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:35.049 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:35.047+0000 7f18377fe700 1 -- 172.21.15.76:0/912820853 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f18380ce810 con 0x7f18401051c0 2024-06-02T04:48:35.049 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:35.048+0000 7f1846163700 1 --2- 172.21.15.76:0/912820853 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f182c0a11b0 0x7f182c0a3670 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f183c006fd0 tx=0x7f183c008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:35.051 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:35.051+0000 7f18377fe700 1 -- 172.21.15.76:0/912820853 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f1838097ce0 con 0x7f18401051c0 2024-06-02T04:48:35.299 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:35.299+0000 7f18483c7700 1 -- 172.21.15.76:0/912820853 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f184019caf0 con 0x7f18401051c0 2024-06-02T04:48:35.303 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:35.303+0000 7f18377fe700 1 -- 172.21.15.76:0/912820853 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) v1 ==== 74+0+260285 (secure 0 0 0) 0x7f183809b300 con 0x7f18401051c0 2024-06-02T04:48:35.306 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:48:35.308 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:35.306+0000 7f18483c7700 1 -- 172.21.15.76:0/912820853 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f182c0a11b0 msgr2=0x7f182c0a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:35.308 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:35.306+0000 7f18483c7700 1 --2- 172.21.15.76:0/912820853 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f182c0a11b0 0x7f182c0a3670 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f183c006fd0 tx=0x7f183c008040 comp rx=0 tx=0).stop 2024-06-02T04:48:35.308 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:35.306+0000 7f18483c7700 1 -- 172.21.15.76:0/912820853 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f18401051c0 msgr2=0x7f184019bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:35.308 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:35.306+0000 7f18483c7700 1 --2- 172.21.15.76:0/912820853 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f18401051c0 0x7f184019bd40 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f183800b070 tx=0x7f1838009380 comp rx=0 tx=0).stop 2024-06-02T04:48:35.308 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:35.306+0000 7f18483c7700 1 -- 172.21.15.76:0/912820853 shutdown_connections 2024-06-02T04:48:35.308 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:35.306+0000 7f18483c7700 1 --2- 172.21.15.76:0/912820853 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f18401051c0 0x7f184019bd40 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:35.308 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:35.306+0000 7f18483c7700 1 --2- 172.21.15.76:0/912820853 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f18401000e0 0x7f18401974a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:35.308 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:35.306+0000 7f18483c7700 1 --2- 172.21.15.76:0/912820853 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f182c0a11b0 0x7f182c0a3670 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:35.308 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:35.306+0000 7f18483c7700 1 --2- 172.21.15.76:0/912820853 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1840100a90 0x7f18401979e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:35.308 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:35.306+0000 7f18483c7700 1 -- 172.21.15.76:0/912820853 >> 172.21.15.76:0/912820853 conn(0x7f1840076ec0 msgr2=0x7f18400699e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:35.309 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:35.306+0000 7f18483c7700 1 -- 172.21.15.76:0/912820853 shutdown_connections 2024-06-02T04:48:35.309 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:35.306+0000 7f18483c7700 1 -- 172.21.15.76:0/912820853 wait complete. 2024-06-02T04:48:35.645 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:35 smithi076 ceph-mon[42935]: pgmap v234: 129 pgs: 129 active+clean; 604 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4.2 KiB/s wr, 10 op/s 2024-06-02T04:48:35.645 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:35 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/912820853' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-06-02T04:48:35.679 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":17,"flags":0,"active_gid":14152,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6800","nonce":2591353090},{"type":"v1","addr":"172.21.15.76:6801","nonce":2591353090}]},"active_addr":"172.21.15.76:6801/2591353090","active_change":"2024-06-02T04:43:06.093064+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":24109,"name":"z","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24122,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.76:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.76:0","nonce":2276422207}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.76:0","nonce":1431580528}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.76:0","nonce":2236182587}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.76:0","nonce":1161729051}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.76:0","nonce":622659145}]}]} 2024-06-02T04:48:35.684 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-06-02T04:48:35.684 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-06-02T04:48:35.684 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell --fsid 60ab6d30-209a-11ef-bc9b-c7b262605968 -- ceph osd dump --format=json 2024-06-02T04:48:35.685 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:35 smithi192 ceph-mon[47933]: pgmap v234: 129 pgs: 129 active+clean; 604 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4.2 KiB/s wr, 10 op/s 2024-06-02T04:48:35.685 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:35 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/912820853' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-06-02T04:48:35.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:35 smithi119 ceph-mon[46633]: pgmap v234: 129 pgs: 129 active+clean; 604 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4.2 KiB/s wr, 10 op/s 2024-06-02T04:48:35.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:35 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/912820853' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-06-02T04:48:35.908 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T04:48:36.908 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:36.908+0000 7fea9640e700 1 -- 172.21.15.76:0/1852656980 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fea90107030 msgr2=0x7fea90107410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:36.909 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:36.908+0000 7fea9640e700 1 --2- 172.21.15.76:0/1852656980 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fea90107030 0x7fea90107410 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fea84009990 tx=0x7fea84009ca0 comp rx=0 tx=0).stop 2024-06-02T04:48:36.909 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:36.908+0000 7fea9640e700 1 -- 172.21.15.76:0/1852656980 shutdown_connections 2024-06-02T04:48:36.909 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:36.908+0000 7fea9640e700 1 --2- 172.21.15.76:0/1852656980 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fea90101990 0x7fea9010de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:36.909 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:36.908+0000 7fea9640e700 1 --2- 172.21.15.76:0/1852656980 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fea90107030 0x7fea90107410 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:36.909 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:36.908+0000 7fea9640e700 1 --2- 172.21.15.76:0/1852656980 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fea90100ff0 0x7fea90101450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:36.909 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:36.908+0000 7fea9640e700 1 -- 172.21.15.76:0/1852656980 >> 172.21.15.76:0/1852656980 conn(0x7fea90078190 msgr2=0x7fea900785a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:36.909 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:36.908+0000 7fea9640e700 1 -- 172.21.15.76:0/1852656980 shutdown_connections 2024-06-02T04:48:36.909 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:36.908+0000 7fea9640e700 1 -- 172.21.15.76:0/1852656980 wait complete. 2024-06-02T04:48:36.909 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:36.908+0000 7fea9640e700 1 Processor -- start 2024-06-02T04:48:36.909 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:36.908+0000 7fea9640e700 1 -- start start 2024-06-02T04:48:36.911 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:36.909+0000 7fea9640e700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fea90100ff0 0x7fea90197270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:36.911 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:36.909+0000 7fea9640e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fea90101990 0x7fea901977b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:36.911 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:36.909+0000 7fea9640e700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fea90107030 0x7fea9019bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:36.911 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:36.909+0000 7fea9640e700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea9019c170 con 0x7fea90107030 2024-06-02T04:48:36.911 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:36.909+0000 7fea9640e700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea9019c2e0 con 0x7fea90100ff0 2024-06-02T04:48:36.911 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:36.909+0000 7fea9640e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea9019c4a0 con 0x7fea90101990 2024-06-02T04:48:36.911 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:36.909+0000 7fea949ab700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fea90107030 0x7fea9019bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:36.911 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:36.909+0000 7fea949ab700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fea90107030 0x7fea9019bb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:33826/0 (socket says 172.21.15.76:33826) 2024-06-02T04:48:36.911 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:36.909+0000 7fea949ab700 1 -- 172.21.15.76:0/2148643240 learned_addr learned my addr 172.21.15.76:0/2148643240 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:48:36.911 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:36.909+0000 7fea8ffff700 1 --2- 172.21.15.76:0/2148643240 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fea90100ff0 0x7fea90197270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:36.912 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:36.909+0000 7fea8f7fe700 1 --2- 172.21.15.76:0/2148643240 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fea90101990 0x7fea901977b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:36.912 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:36.909+0000 7fea949ab700 1 -- 172.21.15.76:0/2148643240 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fea90101990 msgr2=0x7fea901977b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:36.912 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:36.909+0000 7fea949ab700 1 --2- 172.21.15.76:0/2148643240 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fea90101990 0x7fea901977b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:36.912 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:36.909+0000 7fea949ab700 1 -- 172.21.15.76:0/2148643240 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fea90100ff0 msgr2=0x7fea90197270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:36.912 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:36.909+0000 7fea949ab700 1 --2- 172.21.15.76:0/2148643240 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fea90100ff0 0x7fea90197270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:36.912 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:36.909+0000 7fea949ab700 1 -- 172.21.15.76:0/2148643240 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea840095f0 con 0x7fea90107030 2024-06-02T04:48:36.912 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:36.909+0000 7fea8ffff700 1 --2- 172.21.15.76:0/2148643240 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fea90100ff0 0x7fea90197270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:48:36.912 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:36.909+0000 7fea949ab700 1 --2- 172.21.15.76:0/2148643240 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fea90107030 0x7fea9019bb60 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fea8800cca0 tx=0x7fea8800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:36.912 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:36.910+0000 7fea8d7fa700 1 -- 172.21.15.76:0/2148643240 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea8800aba0 con 0x7fea90107030 2024-06-02T04:48:36.912 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:36.910+0000 7fea8d7fa700 1 -- 172.21.15.76:0/2148643240 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fea8800ad00 con 0x7fea90107030 2024-06-02T04:48:36.912 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:36.910+0000 7fea8d7fa700 1 -- 172.21.15.76:0/2148643240 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea880115e0 con 0x7fea90107030 2024-06-02T04:48:36.912 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:36.910+0000 7fea9640e700 1 -- 172.21.15.76:0/2148643240 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea9019c780 con 0x7fea90107030 2024-06-02T04:48:36.912 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:36.910+0000 7fea9640e700 1 -- 172.21.15.76:0/2148643240 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea901a3fe0 con 0x7fea90107030 2024-06-02T04:48:36.912 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:36.911+0000 7fea9640e700 1 -- 172.21.15.76:0/2148643240 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea90109550 con 0x7fea90107030 2024-06-02T04:48:36.913 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:36.912+0000 7fea8d7fa700 1 -- 172.21.15.76:0/2148643240 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fea88012420 con 0x7fea90107030 2024-06-02T04:48:36.913 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:36.912+0000 7fea8d7fa700 1 --2- 172.21.15.76:0/2148643240 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fea780a11b0 0x7fea780a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:36.913 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:36.912+0000 7fea8ffff700 1 --2- 172.21.15.76:0/2148643240 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fea780a11b0 0x7fea780a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:36.913 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:36.912+0000 7fea8d7fa700 1 -- 172.21.15.76:0/2148643240 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fea880cccc0 con 0x7fea90107030 2024-06-02T04:48:36.913 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:36.913+0000 7fea8ffff700 1 --2- 172.21.15.76:0/2148643240 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fea780a11b0 0x7fea780a3670 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fea84006010 tx=0x7fea8400b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:36.917 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:36.917+0000 7fea8d7fa700 1 -- 172.21.15.76:0/2148643240 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fea88096210 con 0x7fea90107030 2024-06-02T04:48:37.110 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:37.110+0000 7fea9640e700 1 -- 172.21.15.76:0/2148643240 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fea901026e0 con 0x7fea90107030 2024-06-02T04:48:37.112 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:37.112+0000 7fea8d7fa700 1 -- 172.21.15.76:0/2148643240 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+23984 (secure 0 0 0) 0x7fea88099830 con 0x7fea90107030 2024-06-02T04:48:37.112 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:48:37.112 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":80,"fsid":"60ab6d30-209a-11ef-bc9b-c7b262605968","created":"2024-06-02T04:42:21.007333+0000","modified":"2024-06-02T04:48:07.101373+0000","last_up_change":"2024-06-02T04:47:29.822242+0000","last_in_change":"2024-06-02T04:47:14.253449+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T04:44:56.408602+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-02T04:48:01.194954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-02T04:48:01.828863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-02T04:48:04.916565+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"33a51ba2-be5c-41d0-b5d1-8d6039f2ca4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6802","nonce":2869602045},{"type":"v1","addr":"172.21.15.76:6803","nonce":2869602045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6804","nonce":2869602045},{"type":"v1","addr":"172.21.15.76:6805","nonce":2869602045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6808","nonce":2869602045},{"type":"v1","addr":"172.21.15.76:6809","nonce":2869602045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6806","nonce":2869602045},{"type":"v1","addr":"172.21.15.76:6807","nonce":2869602045}]},"public_addr":"172.21.15.76:6803/2869602045","cluster_addr":"172.21.15.76:6805/2869602045","heartbeat_back_addr":"172.21.15.76:6809/2869602045","heartbeat_front_addr":"172.21.15.76:6807/2869602045","state":["exists","up"]},{"osd":1,"uuid":"ace46e13-3bb7-4103-973a-6860554df8b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":2353738098},{"type":"v1","addr":"172.21.15.119:6801","nonce":2353738098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":2353738098},{"type":"v1","addr":"172.21.15.119:6803","nonce":2353738098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":2353738098},{"type":"v1","addr":"172.21.15.119:6807","nonce":2353738098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":2353738098},{"type":"v1","addr":"172.21.15.119:6805","nonce":2353738098}]},"public_addr":"172.21.15.119:6801/2353738098","cluster_addr":"172.21.15.119:6803/2353738098","heartbeat_back_addr":"172.21.15.119:6807/2353738098","heartbeat_front_addr":"172.21.15.119:6805/2353738098","state":["exists","up"]},{"osd":2,"uuid":"4addc09e-77a9-428a-bcc4-38194f486cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":3206918546},{"type":"v1","addr":"172.21.15.192:6801","nonce":3206918546}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":3206918546},{"type":"v1","addr":"172.21.15.192:6803","nonce":3206918546}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":3206918546},{"type":"v1","addr":"172.21.15.192:6807","nonce":3206918546}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":3206918546},{"type":"v1","addr":"172.21.15.192:6805","nonce":3206918546}]},"public_addr":"172.21.15.192:6801/3206918546","cluster_addr":"172.21.15.192:6803/3206918546","heartbeat_back_addr":"172.21.15.192:6807/3206918546","heartbeat_front_addr":"172.21.15.192:6805/3206918546","state":["exists","up"]},{"osd":3,"uuid":"dc525518-82c6-49ed-8ca8-e3bd5bfc18d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6810","nonce":3747864233},{"type":"v1","addr":"172.21.15.76:6811","nonce":3747864233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6812","nonce":3747864233},{"type":"v1","addr":"172.21.15.76:6813","nonce":3747864233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6816","nonce":3747864233},{"type":"v1","addr":"172.21.15.76:6817","nonce":3747864233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6814","nonce":3747864233},{"type":"v1","addr":"172.21.15.76:6815","nonce":3747864233}]},"public_addr":"172.21.15.76:6811/3747864233","cluster_addr":"172.21.15.76:6813/3747864233","heartbeat_back_addr":"172.21.15.76:6817/3747864233","heartbeat_front_addr":"172.21.15.76:6815/3747864233","state":["exists","up"]},{"osd":4,"uuid":"eef293d0-cb87-47b3-9751-c6437a1cf079","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":2571629047},{"type":"v1","addr":"172.21.15.119:6809","nonce":2571629047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":2571629047},{"type":"v1","addr":"172.21.15.119:6811","nonce":2571629047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":2571629047},{"type":"v1","addr":"172.21.15.119:6815","nonce":2571629047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":2571629047},{"type":"v1","addr":"172.21.15.119:6813","nonce":2571629047}]},"public_addr":"172.21.15.119:6809/2571629047","cluster_addr":"172.21.15.119:6811/2571629047","heartbeat_back_addr":"172.21.15.119:6815/2571629047","heartbeat_front_addr":"172.21.15.119:6813/2571629047","state":["exists","up"]},{"osd":5,"uuid":"60eb8c6e-766c-49d0-9997-44f85776b3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3285065416},{"type":"v1","addr":"172.21.15.192:6809","nonce":3285065416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":3285065416},{"type":"v1","addr":"172.21.15.192:6811","nonce":3285065416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3285065416},{"type":"v1","addr":"172.21.15.192:6815","nonce":3285065416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":3285065416},{"type":"v1","addr":"172.21.15.192:6813","nonce":3285065416}]},"public_addr":"172.21.15.192:6809/3285065416","cluster_addr":"172.21.15.192:6811/3285065416","heartbeat_back_addr":"172.21.15.192:6815/3285065416","heartbeat_front_addr":"172.21.15.192:6813/3285065416","state":["exists","up"]},{"osd":6,"uuid":"e6dc8b9d-dd06-4870-a506-def8201b7e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6818","nonce":2951381580},{"type":"v1","addr":"172.21.15.76:6819","nonce":2951381580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6820","nonce":2951381580},{"type":"v1","addr":"172.21.15.76:6821","nonce":2951381580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6824","nonce":2951381580},{"type":"v1","addr":"172.21.15.76:6825","nonce":2951381580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6822","nonce":2951381580},{"type":"v1","addr":"172.21.15.76:6823","nonce":2951381580}]},"public_addr":"172.21.15.76:6819/2951381580","cluster_addr":"172.21.15.76:6821/2951381580","heartbeat_back_addr":"172.21.15.76:6825/2951381580","heartbeat_front_addr":"172.21.15.76:6823/2951381580","state":["exists","up"]},{"osd":7,"uuid":"2f5dccb3-39a1-4f25-8715-fa264d59db97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1802558756},{"type":"v1","addr":"172.21.15.119:6817","nonce":1802558756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1802558756},{"type":"v1","addr":"172.21.15.119:6819","nonce":1802558756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1802558756},{"type":"v1","addr":"172.21.15.119:6823","nonce":1802558756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1802558756},{"type":"v1","addr":"172.21.15.119:6821","nonce":1802558756}]},"public_addr":"172.21.15.119:6817/1802558756","cluster_addr":"172.21.15.119:6819/1802558756","heartbeat_back_addr":"172.21.15.119:6823/1802558756","heartbeat_front_addr":"172.21.15.119:6821/1802558756","state":["exists","up"]},{"osd":8,"uuid":"39b6ccd0-16e7-4cd5-87e0-d827e9172984","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":1214972276},{"type":"v1","addr":"172.21.15.192:6817","nonce":1214972276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":1214972276},{"type":"v1","addr":"172.21.15.192:6819","nonce":1214972276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":1214972276},{"type":"v1","addr":"172.21.15.192:6823","nonce":1214972276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":1214972276},{"type":"v1","addr":"172.21.15.192:6821","nonce":1214972276}]},"public_addr":"172.21.15.192:6817/1214972276","cluster_addr":"172.21.15.192:6819/1214972276","heartbeat_back_addr":"172.21.15.192:6823/1214972276","heartbeat_front_addr":"172.21.15.192:6821/1214972276","state":["exists","up"]},{"osd":9,"uuid":"851b2155-07bd-45de-bfe0-53021fda733f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6826","nonce":3095501821},{"type":"v1","addr":"172.21.15.76:6827","nonce":3095501821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6828","nonce":3095501821},{"type":"v1","addr":"172.21.15.76:6829","nonce":3095501821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":3095501821},{"type":"v1","addr":"172.21.15.76:6833","nonce":3095501821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6830","nonce":3095501821},{"type":"v1","addr":"172.21.15.76:6831","nonce":3095501821}]},"public_addr":"172.21.15.76:6827/3095501821","cluster_addr":"172.21.15.76:6829/3095501821","heartbeat_back_addr":"172.21.15.76:6833/3095501821","heartbeat_front_addr":"172.21.15.76:6831/3095501821","state":["exists","up"]},{"osd":10,"uuid":"e4b18e7e-bddf-4dd4-84f6-7902ea327cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":4082130894},{"type":"v1","addr":"172.21.15.119:6825","nonce":4082130894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":4082130894},{"type":"v1","addr":"172.21.15.119:6827","nonce":4082130894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":4082130894},{"type":"v1","addr":"172.21.15.119:6831","nonce":4082130894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":4082130894},{"type":"v1","addr":"172.21.15.119:6829","nonce":4082130894}]},"public_addr":"172.21.15.119:6825/4082130894","cluster_addr":"172.21.15.119:6827/4082130894","heartbeat_back_addr":"172.21.15.119:6831/4082130894","heartbeat_front_addr":"172.21.15.119:6829/4082130894","state":["exists","up"]},{"osd":11,"uuid":"54567e18-920c-4ae9-9557-0efba5a1a820","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":439693921},{"type":"v1","addr":"172.21.15.192:6825","nonce":439693921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":439693921},{"type":"v1","addr":"172.21.15.192:6827","nonce":439693921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":439693921},{"type":"v1","addr":"172.21.15.192:6831","nonce":439693921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":439693921},{"type":"v1","addr":"172.21.15.192:6829","nonce":439693921}]},"public_addr":"172.21.15.192:6825/439693921","cluster_addr":"172.21.15.192:6827/439693921","heartbeat_back_addr":"172.21.15.192:6831/439693921","heartbeat_front_addr":"172.21.15.192:6829/439693921","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:44:19.922390+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:44:36.895563+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:44:53.699019+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:45:11.167404+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:45:27.955899+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:45:44.850368+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:46:02.003588+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:46:19.019217+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:46:36.189670+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:46:53.919365+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:47:11.563053+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:47:28.822443+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.76:6801/4200406736":"2024-06-03T04:43:06.092916+0000","172.21.15.76:6800/4200406736":"2024-06-03T04:43:06.092916+0000","172.21.15.76:0/1524144593":"2024-06-03T04:43:06.092916+0000","172.21.15.76:0/3269372590":"2024-06-03T04:43:06.092916+0000","172.21.15.76:0/3570893846":"2024-06-03T04:42:44.872236+0000","172.21.15.76:0/902035790":"2024-06-03T04:43:06.092916+0000","172.21.15.76:6800/2550846765":"2024-06-03T04:42:44.872236+0000","172.21.15.76:6801/2550846765":"2024-06-03T04:42:44.872236+0000","172.21.15.76:0/2646712763":"2024-06-03T04:42:44.872236+0000","172.21.15.76:0/964578813":"2024-06-03T04:42:44.872236+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T04:48:37.114 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:37.114+0000 7fea9640e700 1 -- 172.21.15.76:0/2148643240 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fea780a11b0 msgr2=0x7fea780a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:37.114 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:37.114+0000 7fea9640e700 1 --2- 172.21.15.76:0/2148643240 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fea780a11b0 0x7fea780a3670 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fea84006010 tx=0x7fea8400b540 comp rx=0 tx=0).stop 2024-06-02T04:48:37.114 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:37.114+0000 7fea9640e700 1 -- 172.21.15.76:0/2148643240 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fea90107030 msgr2=0x7fea9019bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:37.115 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:37.114+0000 7fea9640e700 1 --2- 172.21.15.76:0/2148643240 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fea90107030 0x7fea9019bb60 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fea8800cca0 tx=0x7fea8800a060 comp rx=0 tx=0).stop 2024-06-02T04:48:37.115 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:37.114+0000 7fea9640e700 1 -- 172.21.15.76:0/2148643240 shutdown_connections 2024-06-02T04:48:37.115 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:37.114+0000 7fea9640e700 1 --2- 172.21.15.76:0/2148643240 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fea90107030 0x7fea9019bb60 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:37.115 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:37.114+0000 7fea9640e700 1 --2- 172.21.15.76:0/2148643240 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fea780a11b0 0x7fea780a3670 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:37.115 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:37.114+0000 7fea9640e700 1 --2- 172.21.15.76:0/2148643240 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fea90100ff0 0x7fea90197270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:37.115 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:37.114+0000 7fea9640e700 1 --2- 172.21.15.76:0/2148643240 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fea90101990 0x7fea901977b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:37.115 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:37.114+0000 7fea9640e700 1 -- 172.21.15.76:0/2148643240 >> 172.21.15.76:0/2148643240 conn(0x7fea90078190 msgr2=0x7fea900fff40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:37.115 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:37.114+0000 7fea9640e700 1 -- 172.21.15.76:0/2148643240 shutdown_connections 2024-06-02T04:48:37.115 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:37.114+0000 7fea9640e700 1 -- 172.21.15.76:0/2148643240 wait complete. 2024-06-02T04:48:37.432 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:37 smithi076 ceph-mon[42935]: pgmap v235: 129 pgs: 129 active+clean; 626 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 6.2 KiB/s wr, 12 op/s 2024-06-02T04:48:37.432 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:37 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/2148643240' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:48:37.505 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-06-02T04:48:37.505 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell --fsid 60ab6d30-209a-11ef-bc9b-c7b262605968 -- ceph osd dump --format=json 2024-06-02T04:48:37.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:37 smithi192 ceph-mon[47933]: pgmap v235: 129 pgs: 129 active+clean; 626 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 6.2 KiB/s wr, 12 op/s 2024-06-02T04:48:37.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:37 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/2148643240' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:48:37.728 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T04:48:37.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:37 smithi119 ceph-mon[46633]: pgmap v235: 129 pgs: 129 active+clean; 626 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 6.2 KiB/s wr, 12 op/s 2024-06-02T04:48:37.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:37 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/2148643240' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:48:38.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:38 smithi192 ceph-mon[47933]: pgmap v236: 129 pgs: 129 active+clean; 626 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 6.3 KiB/s wr, 13 op/s 2024-06-02T04:48:38.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:38 smithi076 ceph-mon[42935]: pgmap v236: 129 pgs: 129 active+clean; 626 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 6.3 KiB/s wr, 13 op/s 2024-06-02T04:48:38.736 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:38.735+0000 7f22e86f8700 1 -- 172.21.15.76:0/2690093847 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f22e0106fe0 msgr2=0x7f22e01073c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:38.736 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:38.735+0000 7f22e86f8700 1 --2- 172.21.15.76:0/2690093847 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f22e0106fe0 0x7f22e01073c0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f22dc0099c0 tx=0x7f22dc009cd0 comp rx=0 tx=0).stop 2024-06-02T04:48:38.736 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:38.736+0000 7f22e86f8700 1 -- 172.21.15.76:0/2690093847 shutdown_connections 2024-06-02T04:48:38.736 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:38.736+0000 7f22e86f8700 1 --2- 172.21.15.76:0/2690093847 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f22e0069bd0 0x7f22e010de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:38.736 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:38.736+0000 7f22e86f8700 1 --2- 172.21.15.76:0/2690093847 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f22e0106fe0 0x7f22e01073c0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:38.736 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:38.736+0000 7f22e86f8700 1 --2- 172.21.15.76:0/2690093847 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f22e0069210 0x7f22e0069690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:38.736 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:38.736+0000 7f22e86f8700 1 -- 172.21.15.76:0/2690093847 >> 172.21.15.76:0/2690093847 conn(0x7f22e0076e70 msgr2=0x7f22e0077280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:38.737 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:38.736+0000 7f22e86f8700 1 -- 172.21.15.76:0/2690093847 shutdown_connections 2024-06-02T04:48:38.737 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:38.736+0000 7f22e86f8700 1 -- 172.21.15.76:0/2690093847 wait complete. 2024-06-02T04:48:38.739 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:38.736+0000 7f22e86f8700 1 Processor -- start 2024-06-02T04:48:38.739 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:38.736+0000 7f22e86f8700 1 -- start start 2024-06-02T04:48:38.739 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:38.736+0000 7f22e86f8700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f22e0069210 0x7f22e01972b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:38.739 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:38.736+0000 7f22e86f8700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f22e0069bd0 0x7f22e01977f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:38.739 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:38.736+0000 7f22e86f8700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f22e0106fe0 0x7f22e019bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:38.739 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:38.736+0000 7f22e86f8700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22e019c1b0 con 0x7f22e0069210 2024-06-02T04:48:38.739 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:38.736+0000 7f22e86f8700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22e019c320 con 0x7f22e0106fe0 2024-06-02T04:48:38.739 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:38.736+0000 7f22e86f8700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22e019c4e0 con 0x7f22e0069bd0 2024-06-02T04:48:38.739 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:38.737+0000 7f22e6494700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f22e0069210 0x7f22e01972b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:38.739 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:38.737+0000 7f22e6494700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f22e0069210 0x7f22e01972b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:33844/0 (socket says 172.21.15.76:33844) 2024-06-02T04:48:38.739 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:38.737+0000 7f22e6494700 1 -- 172.21.15.76:0/3143227763 learned_addr learned my addr 172.21.15.76:0/3143227763 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:48:38.739 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:38.737+0000 7f22e5c93700 1 --2- 172.21.15.76:0/3143227763 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f22e0069bd0 0x7f22e01977f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:38.740 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:38.737+0000 7f22e6c95700 1 --2- 172.21.15.76:0/3143227763 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f22e0106fe0 0x7f22e019bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:38.740 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:38.737+0000 7f22e6494700 1 -- 172.21.15.76:0/3143227763 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f22e0069bd0 msgr2=0x7f22e01977f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:38.740 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:38.737+0000 7f22e6494700 1 --2- 172.21.15.76:0/3143227763 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f22e0069bd0 0x7f22e01977f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:38.740 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:38.737+0000 7f22e6494700 1 -- 172.21.15.76:0/3143227763 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f22e0106fe0 msgr2=0x7f22e019bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:38.740 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:38.737+0000 7f22e6494700 1 --2- 172.21.15.76:0/3143227763 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f22e0106fe0 0x7f22e019bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:38.740 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:38.737+0000 7f22e6494700 1 -- 172.21.15.76:0/3143227763 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22dc0095f0 con 0x7f22e0069210 2024-06-02T04:48:38.740 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:38.737+0000 7f22e6c95700 1 --2- 172.21.15.76:0/3143227763 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f22e0106fe0 0x7f22e019bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:48:38.740 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:38.737+0000 7f22e6494700 1 --2- 172.21.15.76:0/3143227763 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f22e0069210 0x7f22e01972b0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f22dc009f50 tx=0x7f22dc00f460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:38.740 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:38.737+0000 7f22d77fe700 1 -- 172.21.15.76:0/3143227763 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22dc01d070 con 0x7f22e0069210 2024-06-02T04:48:38.740 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:38.737+0000 7f22d77fe700 1 -- 172.21.15.76:0/3143227763 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f22dc00fd60 con 0x7f22e0069210 2024-06-02T04:48:38.740 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:38.737+0000 7f22e86f8700 1 -- 172.21.15.76:0/3143227763 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22e019c760 con 0x7f22e0069210 2024-06-02T04:48:38.740 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:38.737+0000 7f22d77fe700 1 -- 172.21.15.76:0/3143227763 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22dc022e40 con 0x7f22e0069210 2024-06-02T04:48:38.741 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:38.737+0000 7f22e86f8700 1 -- 172.21.15.76:0/3143227763 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22e01a4020 con 0x7f22e0069210 2024-06-02T04:48:38.741 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:38.738+0000 7f22e86f8700 1 -- 172.21.15.76:0/3143227763 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22e01094e0 con 0x7f22e0069210 2024-06-02T04:48:38.742 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:38.739+0000 7f22d77fe700 1 -- 172.21.15.76:0/3143227763 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f22dc0225e0 con 0x7f22e0069210 2024-06-02T04:48:38.742 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:38.740+0000 7f22d77fe700 1 --2- 172.21.15.76:0/3143227763 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f22cc0a1230 0x7f22cc0a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:38.742 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:38.740+0000 7f22e5c93700 1 --2- 172.21.15.76:0/3143227763 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f22cc0a1230 0x7f22cc0a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:38.742 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:38.740+0000 7f22d77fe700 1 -- 172.21.15.76:0/3143227763 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f22dc0cdc30 con 0x7f22e0069210 2024-06-02T04:48:38.742 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:38.740+0000 7f22e5c93700 1 --2- 172.21.15.76:0/3143227763 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f22cc0a1230 0x7f22cc0a36f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f22e0198810 tx=0x7f22d000a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:38.745 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:38.745+0000 7f22d77fe700 1 -- 172.21.15.76:0/3143227763 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f22dc0970a0 con 0x7f22e0069210 2024-06-02T04:48:38.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:38 smithi119 ceph-mon[46633]: pgmap v236: 129 pgs: 129 active+clean; 626 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 6.3 KiB/s wr, 13 op/s 2024-06-02T04:48:38.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:38.937+0000 7f22e86f8700 1 -- 172.21.15.76:0/3143227763 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f22e01985c0 con 0x7f22e0069210 2024-06-02T04:48:38.939 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:38.939+0000 7f22d77fe700 1 -- 172.21.15.76:0/3143227763 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+23984 (secure 0 0 0) 0x7f22dc09a6c0 con 0x7f22e0069210 2024-06-02T04:48:38.940 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:48:38.940 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":80,"fsid":"60ab6d30-209a-11ef-bc9b-c7b262605968","created":"2024-06-02T04:42:21.007333+0000","modified":"2024-06-02T04:48:07.101373+0000","last_up_change":"2024-06-02T04:47:29.822242+0000","last_in_change":"2024-06-02T04:47:14.253449+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T04:44:56.408602+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-02T04:48:01.194954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-02T04:48:01.828863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-02T04:48:04.916565+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"33a51ba2-be5c-41d0-b5d1-8d6039f2ca4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6802","nonce":2869602045},{"type":"v1","addr":"172.21.15.76:6803","nonce":2869602045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6804","nonce":2869602045},{"type":"v1","addr":"172.21.15.76:6805","nonce":2869602045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6808","nonce":2869602045},{"type":"v1","addr":"172.21.15.76:6809","nonce":2869602045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6806","nonce":2869602045},{"type":"v1","addr":"172.21.15.76:6807","nonce":2869602045}]},"public_addr":"172.21.15.76:6803/2869602045","cluster_addr":"172.21.15.76:6805/2869602045","heartbeat_back_addr":"172.21.15.76:6809/2869602045","heartbeat_front_addr":"172.21.15.76:6807/2869602045","state":["exists","up"]},{"osd":1,"uuid":"ace46e13-3bb7-4103-973a-6860554df8b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":2353738098},{"type":"v1","addr":"172.21.15.119:6801","nonce":2353738098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":2353738098},{"type":"v1","addr":"172.21.15.119:6803","nonce":2353738098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":2353738098},{"type":"v1","addr":"172.21.15.119:6807","nonce":2353738098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":2353738098},{"type":"v1","addr":"172.21.15.119:6805","nonce":2353738098}]},"public_addr":"172.21.15.119:6801/2353738098","cluster_addr":"172.21.15.119:6803/2353738098","heartbeat_back_addr":"172.21.15.119:6807/2353738098","heartbeat_front_addr":"172.21.15.119:6805/2353738098","state":["exists","up"]},{"osd":2,"uuid":"4addc09e-77a9-428a-bcc4-38194f486cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":3206918546},{"type":"v1","addr":"172.21.15.192:6801","nonce":3206918546}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":3206918546},{"type":"v1","addr":"172.21.15.192:6803","nonce":3206918546}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":3206918546},{"type":"v1","addr":"172.21.15.192:6807","nonce":3206918546}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":3206918546},{"type":"v1","addr":"172.21.15.192:6805","nonce":3206918546}]},"public_addr":"172.21.15.192:6801/3206918546","cluster_addr":"172.21.15.192:6803/3206918546","heartbeat_back_addr":"172.21.15.192:6807/3206918546","heartbeat_front_addr":"172.21.15.192:6805/3206918546","state":["exists","up"]},{"osd":3,"uuid":"dc525518-82c6-49ed-8ca8-e3bd5bfc18d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6810","nonce":3747864233},{"type":"v1","addr":"172.21.15.76:6811","nonce":3747864233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6812","nonce":3747864233},{"type":"v1","addr":"172.21.15.76:6813","nonce":3747864233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6816","nonce":3747864233},{"type":"v1","addr":"172.21.15.76:6817","nonce":3747864233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6814","nonce":3747864233},{"type":"v1","addr":"172.21.15.76:6815","nonce":3747864233}]},"public_addr":"172.21.15.76:6811/3747864233","cluster_addr":"172.21.15.76:6813/3747864233","heartbeat_back_addr":"172.21.15.76:6817/3747864233","heartbeat_front_addr":"172.21.15.76:6815/3747864233","state":["exists","up"]},{"osd":4,"uuid":"eef293d0-cb87-47b3-9751-c6437a1cf079","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":2571629047},{"type":"v1","addr":"172.21.15.119:6809","nonce":2571629047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":2571629047},{"type":"v1","addr":"172.21.15.119:6811","nonce":2571629047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":2571629047},{"type":"v1","addr":"172.21.15.119:6815","nonce":2571629047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":2571629047},{"type":"v1","addr":"172.21.15.119:6813","nonce":2571629047}]},"public_addr":"172.21.15.119:6809/2571629047","cluster_addr":"172.21.15.119:6811/2571629047","heartbeat_back_addr":"172.21.15.119:6815/2571629047","heartbeat_front_addr":"172.21.15.119:6813/2571629047","state":["exists","up"]},{"osd":5,"uuid":"60eb8c6e-766c-49d0-9997-44f85776b3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3285065416},{"type":"v1","addr":"172.21.15.192:6809","nonce":3285065416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":3285065416},{"type":"v1","addr":"172.21.15.192:6811","nonce":3285065416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3285065416},{"type":"v1","addr":"172.21.15.192:6815","nonce":3285065416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":3285065416},{"type":"v1","addr":"172.21.15.192:6813","nonce":3285065416}]},"public_addr":"172.21.15.192:6809/3285065416","cluster_addr":"172.21.15.192:6811/3285065416","heartbeat_back_addr":"172.21.15.192:6815/3285065416","heartbeat_front_addr":"172.21.15.192:6813/3285065416","state":["exists","up"]},{"osd":6,"uuid":"e6dc8b9d-dd06-4870-a506-def8201b7e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6818","nonce":2951381580},{"type":"v1","addr":"172.21.15.76:6819","nonce":2951381580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6820","nonce":2951381580},{"type":"v1","addr":"172.21.15.76:6821","nonce":2951381580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6824","nonce":2951381580},{"type":"v1","addr":"172.21.15.76:6825","nonce":2951381580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6822","nonce":2951381580},{"type":"v1","addr":"172.21.15.76:6823","nonce":2951381580}]},"public_addr":"172.21.15.76:6819/2951381580","cluster_addr":"172.21.15.76:6821/2951381580","heartbeat_back_addr":"172.21.15.76:6825/2951381580","heartbeat_front_addr":"172.21.15.76:6823/2951381580","state":["exists","up"]},{"osd":7,"uuid":"2f5dccb3-39a1-4f25-8715-fa264d59db97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1802558756},{"type":"v1","addr":"172.21.15.119:6817","nonce":1802558756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1802558756},{"type":"v1","addr":"172.21.15.119:6819","nonce":1802558756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1802558756},{"type":"v1","addr":"172.21.15.119:6823","nonce":1802558756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1802558756},{"type":"v1","addr":"172.21.15.119:6821","nonce":1802558756}]},"public_addr":"172.21.15.119:6817/1802558756","cluster_addr":"172.21.15.119:6819/1802558756","heartbeat_back_addr":"172.21.15.119:6823/1802558756","heartbeat_front_addr":"172.21.15.119:6821/1802558756","state":["exists","up"]},{"osd":8,"uuid":"39b6ccd0-16e7-4cd5-87e0-d827e9172984","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":1214972276},{"type":"v1","addr":"172.21.15.192:6817","nonce":1214972276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":1214972276},{"type":"v1","addr":"172.21.15.192:6819","nonce":1214972276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":1214972276},{"type":"v1","addr":"172.21.15.192:6823","nonce":1214972276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":1214972276},{"type":"v1","addr":"172.21.15.192:6821","nonce":1214972276}]},"public_addr":"172.21.15.192:6817/1214972276","cluster_addr":"172.21.15.192:6819/1214972276","heartbeat_back_addr":"172.21.15.192:6823/1214972276","heartbeat_front_addr":"172.21.15.192:6821/1214972276","state":["exists","up"]},{"osd":9,"uuid":"851b2155-07bd-45de-bfe0-53021fda733f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6826","nonce":3095501821},{"type":"v1","addr":"172.21.15.76:6827","nonce":3095501821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6828","nonce":3095501821},{"type":"v1","addr":"172.21.15.76:6829","nonce":3095501821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":3095501821},{"type":"v1","addr":"172.21.15.76:6833","nonce":3095501821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6830","nonce":3095501821},{"type":"v1","addr":"172.21.15.76:6831","nonce":3095501821}]},"public_addr":"172.21.15.76:6827/3095501821","cluster_addr":"172.21.15.76:6829/3095501821","heartbeat_back_addr":"172.21.15.76:6833/3095501821","heartbeat_front_addr":"172.21.15.76:6831/3095501821","state":["exists","up"]},{"osd":10,"uuid":"e4b18e7e-bddf-4dd4-84f6-7902ea327cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":4082130894},{"type":"v1","addr":"172.21.15.119:6825","nonce":4082130894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":4082130894},{"type":"v1","addr":"172.21.15.119:6827","nonce":4082130894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":4082130894},{"type":"v1","addr":"172.21.15.119:6831","nonce":4082130894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":4082130894},{"type":"v1","addr":"172.21.15.119:6829","nonce":4082130894}]},"public_addr":"172.21.15.119:6825/4082130894","cluster_addr":"172.21.15.119:6827/4082130894","heartbeat_back_addr":"172.21.15.119:6831/4082130894","heartbeat_front_addr":"172.21.15.119:6829/4082130894","state":["exists","up"]},{"osd":11,"uuid":"54567e18-920c-4ae9-9557-0efba5a1a820","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":439693921},{"type":"v1","addr":"172.21.15.192:6825","nonce":439693921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":439693921},{"type":"v1","addr":"172.21.15.192:6827","nonce":439693921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":439693921},{"type":"v1","addr":"172.21.15.192:6831","nonce":439693921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":439693921},{"type":"v1","addr":"172.21.15.192:6829","nonce":439693921}]},"public_addr":"172.21.15.192:6825/439693921","cluster_addr":"172.21.15.192:6827/439693921","heartbeat_back_addr":"172.21.15.192:6831/439693921","heartbeat_front_addr":"172.21.15.192:6829/439693921","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:44:19.922390+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:44:36.895563+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:44:53.699019+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:45:11.167404+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:45:27.955899+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:45:44.850368+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:46:02.003588+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:46:19.019217+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:46:36.189670+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:46:53.919365+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:47:11.563053+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:47:28.822443+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.76:6801/4200406736":"2024-06-03T04:43:06.092916+0000","172.21.15.76:6800/4200406736":"2024-06-03T04:43:06.092916+0000","172.21.15.76:0/1524144593":"2024-06-03T04:43:06.092916+0000","172.21.15.76:0/3269372590":"2024-06-03T04:43:06.092916+0000","172.21.15.76:0/3570893846":"2024-06-03T04:42:44.872236+0000","172.21.15.76:0/902035790":"2024-06-03T04:43:06.092916+0000","172.21.15.76:6800/2550846765":"2024-06-03T04:42:44.872236+0000","172.21.15.76:6801/2550846765":"2024-06-03T04:42:44.872236+0000","172.21.15.76:0/2646712763":"2024-06-03T04:42:44.872236+0000","172.21.15.76:0/964578813":"2024-06-03T04:42:44.872236+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T04:48:38.941 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:38.941+0000 7f22e86f8700 1 -- 172.21.15.76:0/3143227763 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f22cc0a1230 msgr2=0x7f22cc0a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:38.942 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:38.941+0000 7f22e86f8700 1 --2- 172.21.15.76:0/3143227763 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f22cc0a1230 0x7f22cc0a36f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f22e0198810 tx=0x7f22d000a380 comp rx=0 tx=0).stop 2024-06-02T04:48:38.942 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:38.941+0000 7f22e86f8700 1 -- 172.21.15.76:0/3143227763 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f22e0069210 msgr2=0x7f22e01972b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:38.942 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:38.941+0000 7f22e86f8700 1 --2- 172.21.15.76:0/3143227763 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f22e0069210 0x7f22e01972b0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f22dc009f50 tx=0x7f22dc00f460 comp rx=0 tx=0).stop 2024-06-02T04:48:38.942 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:38.941+0000 7f22e86f8700 1 -- 172.21.15.76:0/3143227763 shutdown_connections 2024-06-02T04:48:38.942 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:38.941+0000 7f22e86f8700 1 --2- 172.21.15.76:0/3143227763 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f22cc0a1230 0x7f22cc0a36f0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:38.942 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:38.941+0000 7f22e86f8700 1 --2- 172.21.15.76:0/3143227763 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f22e0106fe0 0x7f22e019bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:38.942 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:38.941+0000 7f22e86f8700 1 --2- 172.21.15.76:0/3143227763 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f22e0069210 0x7f22e01972b0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:38.942 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:38.941+0000 7f22e86f8700 1 --2- 172.21.15.76:0/3143227763 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f22e0069bd0 0x7f22e01977f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:38.942 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:38.941+0000 7f22e86f8700 1 -- 172.21.15.76:0/3143227763 >> 172.21.15.76:0/3143227763 conn(0x7f22e0076e70 msgr2=0x7f22e00fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:38.942 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:38.941+0000 7f22e86f8700 1 -- 172.21.15.76:0/3143227763 shutdown_connections 2024-06-02T04:48:38.942 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:38.941+0000 7f22e86f8700 1 -- 172.21.15.76:0/3143227763 wait complete. 2024-06-02T04:48:39.362 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell --fsid 60ab6d30-209a-11ef-bc9b-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-06-02T04:48:39.362 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell --fsid 60ab6d30-209a-11ef-bc9b-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-06-02T04:48:39.363 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell --fsid 60ab6d30-209a-11ef-bc9b-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-06-02T04:48:39.363 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell --fsid 60ab6d30-209a-11ef-bc9b-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-06-02T04:48:39.364 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell --fsid 60ab6d30-209a-11ef-bc9b-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-06-02T04:48:39.364 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell --fsid 60ab6d30-209a-11ef-bc9b-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-06-02T04:48:39.364 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell --fsid 60ab6d30-209a-11ef-bc9b-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-06-02T04:48:39.365 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell --fsid 60ab6d30-209a-11ef-bc9b-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-06-02T04:48:39.365 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell --fsid 60ab6d30-209a-11ef-bc9b-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-06-02T04:48:39.366 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell --fsid 60ab6d30-209a-11ef-bc9b-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-06-02T04:48:39.366 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell --fsid 60ab6d30-209a-11ef-bc9b-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-06-02T04:48:39.366 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell --fsid 60ab6d30-209a-11ef-bc9b-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-06-02T04:48:39.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:39 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/3143227763' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:48:39.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:39 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/3143227763' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:48:39.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:39 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/3143227763' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:48:40.099 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T04:48:40.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:40 smithi076 ceph-mon[42935]: pgmap v237: 129 pgs: 129 active+clean; 638 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 6.6 KiB/s wr, 13 op/s 2024-06-02T04:48:40.503 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T04:48:40.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:40 smithi192 ceph-mon[47933]: pgmap v237: 129 pgs: 129 active+clean; 638 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 6.6 KiB/s wr, 13 op/s 2024-06-02T04:48:40.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:40 smithi119 ceph-mon[46633]: pgmap v237: 129 pgs: 129 active+clean; 638 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 6.6 KiB/s wr, 13 op/s 2024-06-02T04:48:41.148 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:41.146+0000 7f5a301a6700 1 -- 172.21.15.76:0/2888228066 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5a28100890 msgr2=0x7f5a2810cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:41.148 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:41.146+0000 7f5a301a6700 1 --2- 172.21.15.76:0/2888228066 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5a28100890 0x7f5a2810cd40 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f5a1800b0a0 tx=0x7f5a1800b3b0 comp rx=0 tx=0).stop 2024-06-02T04:48:41.148 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:41.146+0000 7f5a301a6700 1 -- 172.21.15.76:0/2888228066 shutdown_connections 2024-06-02T04:48:41.148 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:41.146+0000 7f5a301a6700 1 --2- 172.21.15.76:0/2888228066 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5a28100890 0x7f5a2810cd40 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:41.148 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:41.146+0000 7f5a301a6700 1 --2- 172.21.15.76:0/2888228066 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5a28105f00 0x7f5a281062e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:41.148 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:41.146+0000 7f5a301a6700 1 --2- 172.21.15.76:0/2888228066 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5a280ffed0 0x7f5a28100350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:41.148 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:41.146+0000 7f5a301a6700 1 -- 172.21.15.76:0/2888228066 >> 172.21.15.76:0/2888228066 conn(0x7f5a28075f80 msgr2=0x7f5a28076390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:41.149 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:41.146+0000 7f5a301a6700 1 -- 172.21.15.76:0/2888228066 shutdown_connections 2024-06-02T04:48:41.149 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:41.146+0000 7f5a301a6700 1 -- 172.21.15.76:0/2888228066 wait complete. 2024-06-02T04:48:41.149 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:41.146+0000 7f5a301a6700 1 Processor -- start 2024-06-02T04:48:41.149 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:41.147+0000 7f5a301a6700 1 -- start start 2024-06-02T04:48:41.149 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:41.147+0000 7f5a301a6700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5a280ffed0 0x7f5a28101b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:41.149 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:41.147+0000 7f5a301a6700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5a28100890 0x7f5a281020b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:41.149 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:41.147+0000 7f5a301a6700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5a28105f00 0x7f5a281025f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:41.149 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:41.147+0000 7f5a301a6700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a281a5860 con 0x7f5a28105f00 2024-06-02T04:48:41.149 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:41.147+0000 7f5a301a6700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a281a59d0 con 0x7f5a28100890 2024-06-02T04:48:41.149 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:41.147+0000 7f5a301a6700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a281a5b90 con 0x7f5a280ffed0 2024-06-02T04:48:41.149 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:41.147+0000 7f5a2e743700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5a28105f00 0x7f5a281025f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:41.149 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:41.147+0000 7f5a2e743700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5a28105f00 0x7f5a281025f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:33864/0 (socket says 172.21.15.76:33864) 2024-06-02T04:48:41.149 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:41.147+0000 7f5a2e743700 1 -- 172.21.15.76:0/3970774060 learned_addr learned my addr 172.21.15.76:0/3970774060 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:48:41.150 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:41.147+0000 7f5a2df42700 1 --2- 172.21.15.76:0/3970774060 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5a280ffed0 0x7f5a28101b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:41.150 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:41.147+0000 7f5a2d741700 1 --2- 172.21.15.76:0/3970774060 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5a28100890 0x7f5a281020b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:41.150 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:41.147+0000 7f5a2e743700 1 -- 172.21.15.76:0/3970774060 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5a280ffed0 msgr2=0x7f5a28101b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:41.150 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:41.147+0000 7f5a2e743700 1 --2- 172.21.15.76:0/3970774060 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5a280ffed0 0x7f5a28101b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:41.150 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:41.147+0000 7f5a2e743700 1 -- 172.21.15.76:0/3970774060 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5a28100890 msgr2=0x7f5a281020b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:41.150 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:41.147+0000 7f5a2e743700 1 --2- 172.21.15.76:0/3970774060 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5a28100890 0x7f5a281020b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:41.150 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:41.147+0000 7f5a2e743700 1 -- 172.21.15.76:0/3970774060 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a18009d00 con 0x7f5a28105f00 2024-06-02T04:48:41.150 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:41.147+0000 7f5a2d741700 1 --2- 172.21.15.76:0/3970774060 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5a28100890 0x7f5a281020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:48:41.150 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:41.147+0000 7f5a2e743700 1 --2- 172.21.15.76:0/3970774060 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5a28105f00 0x7f5a281025f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f5a1800b830 tx=0x7f5a18009430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:41.150 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:41.147+0000 7f5a26ffd700 1 -- 172.21.15.76:0/3970774060 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a1800e040 con 0x7f5a28105f00 2024-06-02T04:48:41.150 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:41.148+0000 7f5a26ffd700 1 -- 172.21.15.76:0/3970774060 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5a18004e60 con 0x7f5a28105f00 2024-06-02T04:48:41.150 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:41.148+0000 7f5a26ffd700 1 -- 172.21.15.76:0/3970774060 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a18005400 con 0x7f5a28105f00 2024-06-02T04:48:41.150 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:41.148+0000 7f5a301a6700 1 -- 172.21.15.76:0/3970774060 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a281a5e10 con 0x7f5a28105f00 2024-06-02T04:48:41.151 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:41.148+0000 7f5a301a6700 1 -- 172.21.15.76:0/3970774060 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a281a6230 con 0x7f5a28105f00 2024-06-02T04:48:41.152 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:41.148+0000 7f5a301a6700 1 -- 172.21.15.76:0/3970774060 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5a281015b0 con 0x7f5a28105f00 2024-06-02T04:48:41.152 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:41.150+0000 7f5a26ffd700 1 -- 172.21.15.76:0/3970774060 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f5a1801bb70 con 0x7f5a28105f00 2024-06-02T04:48:41.152 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:41.150+0000 7f5a26ffd700 1 --2- 172.21.15.76:0/3970774060 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f5a100a11b0 0x7f5a100a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:41.152 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:41.150+0000 7f5a26ffd700 1 -- 172.21.15.76:0/3970774060 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f5a180ce900 con 0x7f5a28105f00 2024-06-02T04:48:41.152 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:41.150+0000 7f5a2df42700 1 --2- 172.21.15.76:0/3970774060 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f5a100a11b0 0x7f5a100a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:41.152 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:41.150+0000 7f5a26ffd700 1 --2- 172.21.15.76:0/3970774060 >> [v2:172.21.15.119:6808/2571629047,v1:172.21.15.119:6809/2571629047] conn(0x7f5a100abc00 0x7f5a100ae040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:41.152 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:41.150+0000 7f5a26ffd700 1 -- 172.21.15.76:0/3970774060 --> [v2:172.21.15.119:6808/2571629047,v1:172.21.15.119:6809/2571629047] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5a100ae710 con 0x7f5a100abc00 2024-06-02T04:48:41.152 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:41.150+0000 7f5a26ffd700 1 -- 172.21.15.76:0/3970774060 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5a180ced10 con 0x7f5a28105f00 2024-06-02T04:48:41.152 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:41.151+0000 7f5a2df42700 1 --2- 172.21.15.76:0/3970774060 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f5a100a11b0 0x7f5a100a3670 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f5a20005950 tx=0x7f5a20005eb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:41.152 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:41.151+0000 7f5a2d741700 1 --2- 172.21.15.76:0/3970774060 >> [v2:172.21.15.119:6808/2571629047,v1:172.21.15.119:6809/2571629047] conn(0x7f5a100abc00 0x7f5a100ae040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:41.152 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:41.151+0000 7f5a2d741700 1 --2- 172.21.15.76:0/3970774060 >> [v2:172.21.15.119:6808/2571629047,v1:172.21.15.119:6809/2571629047] conn(0x7f5a100abc00 0x7f5a100ae040 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:41.153 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:41.152+0000 7f5a26ffd700 1 -- 172.21.15.76:0/3970774060 <== osd.4 v2:172.21.15.119:6808/2571629047 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f5a100ae710 con 0x7f5a100abc00 2024-06-02T04:48:41.167 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:41.167+0000 7f5a301a6700 1 -- 172.21.15.76:0/3970774060 --> [v2:172.21.15.119:6808/2571629047,v1:172.21.15.119:6809/2571629047] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5a2810ff40 con 0x7f5a100abc00 2024-06-02T04:48:41.168 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:41.168+0000 7f5a26ffd700 1 -- 172.21.15.76:0/3970774060 <== osd.4 v2:172.21.15.119:6808/2571629047 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f5a2810ff40 con 0x7f5a100abc00 2024-06-02T04:48:41.169 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:41.169+0000 7f5a301a6700 1 -- 172.21.15.76:0/3970774060 >> [v2:172.21.15.119:6808/2571629047,v1:172.21.15.119:6809/2571629047] conn(0x7f5a100abc00 msgr2=0x7f5a100ae040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:41.169 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:41.169+0000 7f5a301a6700 1 --2- 172.21.15.76:0/3970774060 >> [v2:172.21.15.119:6808/2571629047,v1:172.21.15.119:6809/2571629047] conn(0x7f5a100abc00 0x7f5a100ae040 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:41.169 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:41.169+0000 7f5a301a6700 1 -- 172.21.15.76:0/3970774060 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f5a100a11b0 msgr2=0x7f5a100a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:41.170 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:41.169+0000 7f5a301a6700 1 --2- 172.21.15.76:0/3970774060 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f5a100a11b0 0x7f5a100a3670 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f5a20005950 tx=0x7f5a20005eb0 comp rx=0 tx=0).stop 2024-06-02T04:48:41.170 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:41.169+0000 7f5a301a6700 1 -- 172.21.15.76:0/3970774060 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5a28105f00 msgr2=0x7f5a281025f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:41.170 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:41.169+0000 7f5a301a6700 1 --2- 172.21.15.76:0/3970774060 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5a28105f00 0x7f5a281025f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f5a1800b830 tx=0x7f5a18009430 comp rx=0 tx=0).stop 2024-06-02T04:48:41.170 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:41.169+0000 7f5a2e743700 1 -- 172.21.15.76:0/3970774060 reap_dead start 2024-06-02T04:48:41.170 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:41.169+0000 7f5a301a6700 1 -- 172.21.15.76:0/3970774060 shutdown_connections 2024-06-02T04:48:41.170 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:41.169+0000 7f5a301a6700 1 -- 172.21.15.76:0/3970774060 >> 172.21.15.76:0/3970774060 conn(0x7f5a28075f80 msgr2=0x7f5a28068bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:41.170 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:41.169+0000 7f5a301a6700 1 -- 172.21.15.76:0/3970774060 shutdown_connections 2024-06-02T04:48:41.170 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:41.169+0000 7f5a301a6700 1 -- 172.21.15.76:0/3970774060 wait complete. 2024-06-02T04:48:41.310 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T04:48:41.362 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T04:48:41.880 INFO:teuthology.orchestra.run.smithi076.stdout:124554051626 2024-06-02T04:48:41.880 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell --fsid 60ab6d30-209a-11ef-bc9b-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-06-02T04:48:41.923 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T04:48:42.117 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T04:48:42.226 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T04:48:42.529 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T04:48:42.724 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T04:48:42.873 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T04:48:43.026 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T04:48:43.360 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:43 smithi076 ceph-mon[42935]: pgmap v238: 129 pgs: 129 active+clean; 638 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 4.5 KiB/s wr, 11 op/s 2024-06-02T04:48:43.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:43 smithi119 ceph-mon[46633]: pgmap v238: 129 pgs: 129 active+clean; 638 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 4.5 KiB/s wr, 11 op/s 2024-06-02T04:48:43.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:43 smithi192 ceph-mon[47933]: pgmap v238: 129 pgs: 129 active+clean; 638 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 4.5 KiB/s wr, 11 op/s 2024-06-02T04:48:43.839 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:43.837+0000 7f8e27123700 1 -- 172.21.15.76:0/2293021604 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8e20100850 msgr2=0x7f8e2010ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:43.840 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:43.837+0000 7f8e27123700 1 --2- 172.21.15.76:0/2293021604 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8e20100850 0x7f8e2010ccf0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f8e1800b0a0 tx=0x7f8e1800b3b0 comp rx=0 tx=0).stop 2024-06-02T04:48:43.840 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:43.838+0000 7f8e27123700 1 -- 172.21.15.76:0/2293021604 shutdown_connections 2024-06-02T04:48:43.840 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:43.838+0000 7f8e27123700 1 --2- 172.21.15.76:0/2293021604 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8e20100850 0x7f8e2010ccf0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:43.840 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:43.838+0000 7f8e27123700 1 --2- 172.21.15.76:0/2293021604 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8e20105f40 0x7f8e20106320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:43.840 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:43.838+0000 7f8e27123700 1 --2- 172.21.15.76:0/2293021604 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8e200ffe90 0x7f8e20100310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:43.840 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:43.838+0000 7f8e27123700 1 -- 172.21.15.76:0/2293021604 >> 172.21.15.76:0/2293021604 conn(0x7f8e20076e70 msgr2=0x7f8e20077280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:43.840 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:43.838+0000 7f8e27123700 1 -- 172.21.15.76:0/2293021604 shutdown_connections 2024-06-02T04:48:43.840 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:43.838+0000 7f8e27123700 1 -- 172.21.15.76:0/2293021604 wait complete. 2024-06-02T04:48:43.840 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:43.838+0000 7f8e27123700 1 Processor -- start 2024-06-02T04:48:43.840 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:43.838+0000 7f8e27123700 1 -- start start 2024-06-02T04:48:43.840 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:43.839+0000 7f8e27123700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8e200ffe90 0x7f8e20197350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:43.840 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:43.839+0000 7f8e27123700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8e20100850 0x7f8e20197890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:43.841 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:43.839+0000 7f8e27123700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8e20105f40 0x7f8e2019bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:43.841 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:43.839+0000 7f8e27123700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e2019c250 con 0x7f8e20105f40 2024-06-02T04:48:43.841 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:43.839+0000 7f8e27123700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e2019c3c0 con 0x7f8e20100850 2024-06-02T04:48:43.841 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:43.839+0000 7f8e27123700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e2019c580 con 0x7f8e200ffe90 2024-06-02T04:48:43.841 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:43.839+0000 7f8e256c0700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8e20105f40 0x7f8e2019bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:43.841 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:43.839+0000 7f8e256c0700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8e20105f40 0x7f8e2019bc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:57470/0 (socket says 172.21.15.76:57470) 2024-06-02T04:48:43.841 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:43.839+0000 7f8e256c0700 1 -- 172.21.15.76:0/3491886039 learned_addr learned my addr 172.21.15.76:0/3491886039 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:48:43.841 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:43.839+0000 7f8e1ffff700 1 --2- 172.21.15.76:0/3491886039 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8e20100850 0x7f8e20197890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:43.841 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:43.839+0000 7f8e24ebf700 1 --2- 172.21.15.76:0/3491886039 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8e200ffe90 0x7f8e20197350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:43.841 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:43.839+0000 7f8e256c0700 1 -- 172.21.15.76:0/3491886039 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8e200ffe90 msgr2=0x7f8e20197350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:43.841 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:43.839+0000 7f8e256c0700 1 --2- 172.21.15.76:0/3491886039 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8e200ffe90 0x7f8e20197350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:43.841 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:43.839+0000 7f8e256c0700 1 -- 172.21.15.76:0/3491886039 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8e20100850 msgr2=0x7f8e20197890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:43.841 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:43.839+0000 7f8e256c0700 1 --2- 172.21.15.76:0/3491886039 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8e20100850 0x7f8e20197890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:43.841 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:43.839+0000 7f8e256c0700 1 -- 172.21.15.76:0/3491886039 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e18009d00 con 0x7f8e20105f40 2024-06-02T04:48:43.842 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:43.839+0000 7f8e256c0700 1 --2- 172.21.15.76:0/3491886039 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8e20105f40 0x7f8e2019bc40 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f8e1800b070 tx=0x7f8e18009380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:43.842 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:43.839+0000 7f8e1dffb700 1 -- 172.21.15.76:0/3491886039 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e1800e040 con 0x7f8e20105f40 2024-06-02T04:48:43.842 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:43.840+0000 7f8e27123700 1 -- 172.21.15.76:0/3491886039 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e2019c800 con 0x7f8e20105f40 2024-06-02T04:48:43.842 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:43.840+0000 7f8e1dffb700 1 -- 172.21.15.76:0/3491886039 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8e18007930 con 0x7f8e20105f40 2024-06-02T04:48:43.842 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:43.840+0000 7f8e1dffb700 1 -- 172.21.15.76:0/3491886039 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e1801b450 con 0x7f8e20105f40 2024-06-02T04:48:43.842 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:43.840+0000 7f8e27123700 1 -- 172.21.15.76:0/3491886039 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e20101c40 con 0x7f8e20105f40 2024-06-02T04:48:43.842 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:43.841+0000 7f8e27123700 1 -- 172.21.15.76:0/3491886039 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8e2010ff00 con 0x7f8e20105f40 2024-06-02T04:48:43.844 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:43.844+0000 7f8e1dffb700 1 -- 172.21.15.76:0/3491886039 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f8e18004cf0 con 0x7f8e20105f40 2024-06-02T04:48:43.844 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:43.844+0000 7f8e1dffb700 1 --2- 172.21.15.76:0/3491886039 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f8e100a11b0 0x7f8e100a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:43.844 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:43.844+0000 7f8e1dffb700 1 -- 172.21.15.76:0/3491886039 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f8e180ced80 con 0x7f8e20105f40 2024-06-02T04:48:43.844 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:43.844+0000 7f8e24ebf700 1 --2- 172.21.15.76:0/3491886039 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f8e100a11b0 0x7f8e100a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:43.845 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:43.844+0000 7f8e1dffb700 1 --2- 172.21.15.76:0/3491886039 >> [v2:172.21.15.76:6826/3095501821,v1:172.21.15.76:6827/3095501821] conn(0x7f8e100abd30 0x7f8e100ae170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:43.845 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:43.844+0000 7f8e1dffb700 1 -- 172.21.15.76:0/3491886039 --> [v2:172.21.15.76:6826/3095501821,v1:172.21.15.76:6827/3095501821] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8e100ae840 con 0x7f8e100abd30 2024-06-02T04:48:43.845 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:43.844+0000 7f8e1dffb700 1 -- 172.21.15.76:0/3491886039 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8e180cf190 con 0x7f8e20105f40 2024-06-02T04:48:43.845 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:43.845+0000 7f8e1ffff700 1 --2- 172.21.15.76:0/3491886039 >> [v2:172.21.15.76:6826/3095501821,v1:172.21.15.76:6827/3095501821] conn(0x7f8e100abd30 0x7f8e100ae170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:43.845 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:43.845+0000 7f8e24ebf700 1 --2- 172.21.15.76:0/3491886039 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f8e100a11b0 0x7f8e100a3670 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8e14005950 tx=0x7f8e1400a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:43.845 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:43.845+0000 7f8e1ffff700 1 --2- 172.21.15.76:0/3491886039 >> [v2:172.21.15.76:6826/3095501821,v1:172.21.15.76:6827/3095501821] conn(0x7f8e100abd30 0x7f8e100ae170 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:43.846 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:43.846+0000 7f8e1dffb700 1 -- 172.21.15.76:0/3491886039 <== osd.9 v2:172.21.15.76:6826/3095501821 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f8e100ae840 con 0x7f8e100abd30 2024-06-02T04:48:43.862 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:43.862+0000 7f8e27123700 1 -- 172.21.15.76:0/3491886039 --> [v2:172.21.15.76:6826/3095501821,v1:172.21.15.76:6827/3095501821] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8e20101580 con 0x7f8e100abd30 2024-06-02T04:48:43.863 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:43.863+0000 7f8e1dffb700 1 -- 172.21.15.76:0/3491886039 <== osd.9 v2:172.21.15.76:6826/3095501821 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f8e20101580 con 0x7f8e100abd30 2024-06-02T04:48:43.864 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:43.863+0000 7f8e27123700 1 -- 172.21.15.76:0/3491886039 >> [v2:172.21.15.76:6826/3095501821,v1:172.21.15.76:6827/3095501821] conn(0x7f8e100abd30 msgr2=0x7f8e100ae170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:43.864 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:43.863+0000 7f8e27123700 1 --2- 172.21.15.76:0/3491886039 >> [v2:172.21.15.76:6826/3095501821,v1:172.21.15.76:6827/3095501821] conn(0x7f8e100abd30 0x7f8e100ae170 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:43.864 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:43.863+0000 7f8e27123700 1 -- 172.21.15.76:0/3491886039 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f8e100a11b0 msgr2=0x7f8e100a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:43.864 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:43.863+0000 7f8e27123700 1 --2- 172.21.15.76:0/3491886039 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f8e100a11b0 0x7f8e100a3670 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8e14005950 tx=0x7f8e1400a300 comp rx=0 tx=0).stop 2024-06-02T04:48:43.864 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:43.863+0000 7f8e27123700 1 -- 172.21.15.76:0/3491886039 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8e20105f40 msgr2=0x7f8e2019bc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:43.864 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:43.863+0000 7f8e27123700 1 --2- 172.21.15.76:0/3491886039 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8e20105f40 0x7f8e2019bc40 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f8e1800b070 tx=0x7f8e18009380 comp rx=0 tx=0).stop 2024-06-02T04:48:43.864 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:43.863+0000 7f8e256c0700 1 -- 172.21.15.76:0/3491886039 reap_dead start 2024-06-02T04:48:43.864 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:43.863+0000 7f8e27123700 1 -- 172.21.15.76:0/3491886039 shutdown_connections 2024-06-02T04:48:43.864 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:43.863+0000 7f8e27123700 1 -- 172.21.15.76:0/3491886039 >> 172.21.15.76:0/3491886039 conn(0x7f8e20076e70 msgr2=0x7f8e200ff1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:43.864 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:43.864+0000 7f8e27123700 1 -- 172.21.15.76:0/3491886039 shutdown_connections 2024-06-02T04:48:43.865 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:43.864+0000 7f8e27123700 1 -- 172.21.15.76:0/3491886039 wait complete. 2024-06-02T04:48:44.823 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:44.822+0000 7fe5a48cd700 1 -- 172.21.15.76:0/4245124971 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe5a0100ff0 msgr2=0x7fe5a0101450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:44.823 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:44.822+0000 7fe5a48cd700 1 --2- 172.21.15.76:0/4245124971 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe5a0100ff0 0x7fe5a0101450 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fe594009990 tx=0x7fe594009ca0 comp rx=0 tx=0).stop 2024-06-02T04:48:44.823 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:44.822+0000 7fe5a48cd700 1 -- 172.21.15.76:0/4245124971 shutdown_connections 2024-06-02T04:48:44.823 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:44.822+0000 7fe5a48cd700 1 --2- 172.21.15.76:0/4245124971 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe5a0101990 0x7fe5a010de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:44.823 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:44.822+0000 7fe5a48cd700 1 --2- 172.21.15.76:0/4245124971 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe5a0107030 0x7fe5a0107410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:44.823 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:44.822+0000 7fe5a48cd700 1 --2- 172.21.15.76:0/4245124971 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe5a0100ff0 0x7fe5a0101450 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:44.823 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:44.822+0000 7fe5a48cd700 1 -- 172.21.15.76:0/4245124971 >> 172.21.15.76:0/4245124971 conn(0x7fe5a0078190 msgr2=0x7fe5a00785a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:44.823 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:44.822+0000 7fe5a48cd700 1 -- 172.21.15.76:0/4245124971 shutdown_connections 2024-06-02T04:48:44.823 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:44.822+0000 7fe5a48cd700 1 -- 172.21.15.76:0/4245124971 wait complete. 2024-06-02T04:48:44.825 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:44.823+0000 7fe5a48cd700 1 Processor -- start 2024-06-02T04:48:44.825 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:44.823+0000 7fe5a48cd700 1 -- start start 2024-06-02T04:48:44.825 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:44.823+0000 7fe5a48cd700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe5a0100ff0 0x7fe5a0197370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:44.825 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:44.823+0000 7fe5a48cd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe5a0101990 0x7fe5a01978b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:44.825 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:44.823+0000 7fe5a48cd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe5a0107030 0x7fe5a019bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:44.825 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:44.823+0000 7fe5a48cd700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a019c270 con 0x7fe5a0107030 2024-06-02T04:48:44.825 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:44.823+0000 7fe5a48cd700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a019c3e0 con 0x7fe5a0100ff0 2024-06-02T04:48:44.825 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:44.823+0000 7fe5a48cd700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a019c5a0 con 0x7fe5a0101990 2024-06-02T04:48:44.825 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:44.824+0000 7fe59e59c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe5a0100ff0 0x7fe5a0197370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:44.826 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:44.824+0000 7fe59ed9d700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe5a0107030 0x7fe5a019bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:44.826 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:44.824+0000 7fe59e59c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe5a0100ff0 0x7fe5a0197370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:60700/0 (socket says 172.21.15.76:60700) 2024-06-02T04:48:44.826 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:44.824+0000 7fe59e59c700 1 -- 172.21.15.76:0/2340034063 learned_addr learned my addr 172.21.15.76:0/2340034063 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:48:44.826 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:44.824+0000 7fe59dd9b700 1 --2- 172.21.15.76:0/2340034063 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe5a0101990 0x7fe5a01978b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:44.826 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:44.824+0000 7fe59e59c700 1 -- 172.21.15.76:0/2340034063 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe5a0101990 msgr2=0x7fe5a01978b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:44.826 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:44.824+0000 7fe59e59c700 1 --2- 172.21.15.76:0/2340034063 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe5a0101990 0x7fe5a01978b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:44.826 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:44.824+0000 7fe59e59c700 1 -- 172.21.15.76:0/2340034063 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe5a0107030 msgr2=0x7fe5a019bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:44.826 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:44.824+0000 7fe59e59c700 1 --2- 172.21.15.76:0/2340034063 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe5a0107030 0x7fe5a019bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:44.826 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:44.824+0000 7fe59e59c700 1 -- 172.21.15.76:0/2340034063 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5940095f0 con 0x7fe5a0100ff0 2024-06-02T04:48:44.826 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:44.824+0000 7fe59ed9d700 1 --2- 172.21.15.76:0/2340034063 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe5a0107030 0x7fe5a019bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T04:48:44.826 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:44.824+0000 7fe59e59c700 1 --2- 172.21.15.76:0/2340034063 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe5a0100ff0 0x7fe5a0197370 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe59000d950 tx=0x7fe59000dc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:44.826 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:44.824+0000 7fe58f7fe700 1 -- 172.21.15.76:0/2340034063 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe590009940 con 0x7fe5a0100ff0 2024-06-02T04:48:44.826 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:44.824+0000 7fe58f7fe700 1 -- 172.21.15.76:0/2340034063 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe590010460 con 0x7fe5a0100ff0 2024-06-02T04:48:44.827 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:44.824+0000 7fe58f7fe700 1 -- 172.21.15.76:0/2340034063 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe59000f620 con 0x7fe5a0100ff0 2024-06-02T04:48:44.827 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:44.824+0000 7fe5a48cd700 1 -- 172.21.15.76:0/2340034063 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5a019c880 con 0x7fe5a0100ff0 2024-06-02T04:48:44.827 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:44.825+0000 7fe5a48cd700 1 -- 172.21.15.76:0/2340034063 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5a01a40e0 con 0x7fe5a0100ff0 2024-06-02T04:48:44.827 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:44.825+0000 7fe5a48cd700 1 -- 172.21.15.76:0/2340034063 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe5a01026e0 con 0x7fe5a0100ff0 2024-06-02T04:48:44.829 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:44.827+0000 7fe58f7fe700 1 -- 172.21.15.76:0/2340034063 <== mon.2 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fe5900105d0 con 0x7fe5a0100ff0 2024-06-02T04:48:44.829 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:44.827+0000 7fe58f7fe700 1 --2- 172.21.15.76:0/2340034063 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fe5880a12b0 0x7fe5880a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:44.829 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:44.827+0000 7fe58f7fe700 1 -- 172.21.15.76:0/2340034063 <== mon.2 v2:172.21.15.119:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fe5900cd070 con 0x7fe5a0100ff0 2024-06-02T04:48:44.829 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:44.827+0000 7fe59dd9b700 1 --2- 172.21.15.76:0/2340034063 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fe5880a12b0 0x7fe5880a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:44.829 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:44.828+0000 7fe58f7fe700 1 --2- 172.21.15.76:0/2340034063 >> [v2:172.21.15.192:6816/1214972276,v1:172.21.15.192:6817/1214972276] conn(0x7fe5880abe30 0x7fe5880ae270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:44.829 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:44.828+0000 7fe58f7fe700 1 -- 172.21.15.76:0/2340034063 --> [v2:172.21.15.192:6816/1214972276,v1:172.21.15.192:6817/1214972276] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe5880b2d50 con 0x7fe5880abe30 2024-06-02T04:48:44.829 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:44.828+0000 7fe58f7fe700 1 -- 172.21.15.76:0/2340034063 <== mon.2 v2:172.21.15.119:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe5900cd420 con 0x7fe5a0100ff0 2024-06-02T04:48:44.829 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:44.828+0000 7fe59dd9b700 1 --2- 172.21.15.76:0/2340034063 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fe5880a12b0 0x7fe5880a3770 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe59400b5c0 tx=0x7fe594005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:44.829 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:44.828+0000 7fe59ed9d700 1 --2- 172.21.15.76:0/2340034063 >> [v2:172.21.15.192:6816/1214972276,v1:172.21.15.192:6817/1214972276] conn(0x7fe5880abe30 0x7fe5880ae270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:44.829 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:44.829+0000 7fe59ed9d700 1 --2- 172.21.15.76:0/2340034063 >> [v2:172.21.15.192:6816/1214972276,v1:172.21.15.192:6817/1214972276] conn(0x7fe5880abe30 0x7fe5880ae270 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:44.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:44.829+0000 7fe58f7fe700 1 -- 172.21.15.76:0/2340034063 <== osd.8 v2:172.21.15.192:6816/1214972276 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fe5880b2d50 con 0x7fe5880abe30 2024-06-02T04:48:44.841 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T04:48:44.855 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:44.855+0000 7fe5a48cd700 1 -- 172.21.15.76:0/2340034063 --> [v2:172.21.15.192:6816/1214972276,v1:172.21.15.192:6817/1214972276] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe5a0111080 con 0x7fe5880abe30 2024-06-02T04:48:44.855 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:44.855+0000 7fe58f7fe700 1 -- 172.21.15.76:0/2340034063 <== osd.8 v2:172.21.15.192:6816/1214972276 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fe5a0111080 con 0x7fe5880abe30 2024-06-02T04:48:44.856 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:44.856+0000 7fe5a48cd700 1 -- 172.21.15.76:0/2340034063 >> [v2:172.21.15.192:6816/1214972276,v1:172.21.15.192:6817/1214972276] conn(0x7fe5880abe30 msgr2=0x7fe5880ae270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:44.856 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:44.856+0000 7fe5a48cd700 1 --2- 172.21.15.76:0/2340034063 >> [v2:172.21.15.192:6816/1214972276,v1:172.21.15.192:6817/1214972276] conn(0x7fe5880abe30 0x7fe5880ae270 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:44.856 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:44.856+0000 7fe5a48cd700 1 -- 172.21.15.76:0/2340034063 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fe5880a12b0 msgr2=0x7fe5880a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:44.856 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:44.856+0000 7fe5a48cd700 1 --2- 172.21.15.76:0/2340034063 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fe5880a12b0 0x7fe5880a3770 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe59400b5c0 tx=0x7fe594005fd0 comp rx=0 tx=0).stop 2024-06-02T04:48:44.856 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:44.856+0000 7fe5a48cd700 1 -- 172.21.15.76:0/2340034063 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe5a0100ff0 msgr2=0x7fe5a0197370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:44.857 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:44.856+0000 7fe5a48cd700 1 --2- 172.21.15.76:0/2340034063 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe5a0100ff0 0x7fe5a0197370 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe59000d950 tx=0x7fe59000dc60 comp rx=0 tx=0).stop 2024-06-02T04:48:44.857 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:44.856+0000 7fe59ed9d700 1 -- 172.21.15.76:0/2340034063 reap_dead start 2024-06-02T04:48:44.857 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:44.856+0000 7fe5a48cd700 1 -- 172.21.15.76:0/2340034063 shutdown_connections 2024-06-02T04:48:44.857 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:44.856+0000 7fe5a48cd700 1 -- 172.21.15.76:0/2340034063 >> 172.21.15.76:0/2340034063 conn(0x7fe5a0078190 msgr2=0x7fe5a00ffec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:44.857 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:44.856+0000 7fe5a48cd700 1 -- 172.21.15.76:0/2340034063 shutdown_connections 2024-06-02T04:48:44.857 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:44.856+0000 7fe5a48cd700 1 -- 172.21.15.76:0/2340034063 wait complete. 2024-06-02T04:48:45.266 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:45 smithi076 ceph-mon[42935]: pgmap v239: 129 pgs: 129 active+clean; 638 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 3.4 KiB/s wr, 7 op/s 2024-06-02T04:48:45.572 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:45.016+0000 7f93cc76c700 1 -- 172.21.15.76:0/49600510 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f93c4101990 msgr2=0x7f93c410de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:45.572 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:45.016+0000 7f93cc76c700 1 --2- 172.21.15.76:0/49600510 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f93c4101990 0x7f93c410de70 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f93bc00b0a0 tx=0x7f93bc00b3b0 comp rx=0 tx=0).stop 2024-06-02T04:48:45.572 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:45.016+0000 7f93cc76c700 1 -- 172.21.15.76:0/49600510 shutdown_connections 2024-06-02T04:48:45.572 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:45.016+0000 7f93cc76c700 1 --2- 172.21.15.76:0/49600510 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f93c4101990 0x7f93c410de70 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:45.572 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:45.016+0000 7f93cc76c700 1 --2- 172.21.15.76:0/49600510 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f93c4107030 0x7f93c4107410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:45.572 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:45.016+0000 7f93cc76c700 1 --2- 172.21.15.76:0/49600510 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f93c4100ff0 0x7f93c4101450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:45.572 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:45.016+0000 7f93cc76c700 1 -- 172.21.15.76:0/49600510 >> 172.21.15.76:0/49600510 conn(0x7f93c4078190 msgr2=0x7f93c40785a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:45.572 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:45.016+0000 7f93cc76c700 1 -- 172.21.15.76:0/49600510 shutdown_connections 2024-06-02T04:48:45.573 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:45.016+0000 7f93cc76c700 1 -- 172.21.15.76:0/49600510 wait complete. 2024-06-02T04:48:45.573 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:45.016+0000 7f93cc76c700 1 Processor -- start 2024-06-02T04:48:45.573 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:45.016+0000 7f93cc76c700 1 -- start start 2024-06-02T04:48:45.573 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:45.017+0000 7f93cc76c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f93c4100ff0 0x7f93c4197390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:45.573 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:45.017+0000 7f93cc76c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f93c4101990 0x7f93c41978d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:45.573 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:45.017+0000 7f93cc76c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f93c4107030 0x7f93c419bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:45.573 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:45.017+0000 7f93cc76c700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93c419c290 con 0x7f93c4101990 2024-06-02T04:48:45.573 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:45.017+0000 7f93cc76c700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93c419c400 con 0x7f93c4100ff0 2024-06-02T04:48:45.573 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:45.017+0000 7f93cc76c700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93c419c5c0 con 0x7f93c4107030 2024-06-02T04:48:45.573 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:45.017+0000 7f93c9d07700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f93c4101990 0x7f93c41978d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:45.573 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:45.017+0000 7f93c9d07700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f93c4101990 0x7f93c41978d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:57514/0 (socket says 172.21.15.76:57514) 2024-06-02T04:48:45.573 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:45.017+0000 7f93c9d07700 1 -- 172.21.15.76:0/3781962361 learned_addr learned my addr 172.21.15.76:0/3781962361 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:48:45.573 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:45.017+0000 7f93ca508700 1 --2- 172.21.15.76:0/3781962361 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f93c4100ff0 0x7f93c4197390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:45.574 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:45.017+0000 7f93cad09700 1 --2- 172.21.15.76:0/3781962361 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f93c4107030 0x7f93c419bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:45.574 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:45.017+0000 7f93c9d07700 1 -- 172.21.15.76:0/3781962361 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f93c4107030 msgr2=0x7f93c419bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:45.574 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:45.017+0000 7f93c9d07700 1 --2- 172.21.15.76:0/3781962361 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f93c4107030 0x7f93c419bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:45.574 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:45.017+0000 7f93c9d07700 1 -- 172.21.15.76:0/3781962361 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f93c4100ff0 msgr2=0x7f93c4197390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:45.574 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:45.017+0000 7f93c9d07700 1 --2- 172.21.15.76:0/3781962361 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f93c4100ff0 0x7f93c4197390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:45.575 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:45.017+0000 7f93c9d07700 1 -- 172.21.15.76:0/3781962361 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93bc009d00 con 0x7f93c4101990 2024-06-02T04:48:45.575 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:45.017+0000 7f93c9d07700 1 --2- 172.21.15.76:0/3781962361 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f93c4101990 0x7f93c41978d0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f93b400c9b0 tx=0x7f93b400ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:45.575 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:45.017+0000 7f93bb7fe700 1 -- 172.21.15.76:0/3781962361 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b4007b00 con 0x7f93c4101990 2024-06-02T04:48:45.575 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:45.017+0000 7f93cc76c700 1 -- 172.21.15.76:0/3781962361 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93c419c8a0 con 0x7f93c4101990 2024-06-02T04:48:45.575 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:45.017+0000 7f93bb7fe700 1 -- 172.21.15.76:0/3781962361 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f93b4007c60 con 0x7f93c4101990 2024-06-02T04:48:45.575 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:45.017+0000 7f93bb7fe700 1 -- 172.21.15.76:0/3781962361 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b4018660 con 0x7f93c4101990 2024-06-02T04:48:45.575 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:45.017+0000 7f93cc76c700 1 -- 172.21.15.76:0/3781962361 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93c41a4100 con 0x7f93c4101990 2024-06-02T04:48:45.575 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:45.018+0000 7f93cc76c700 1 -- 172.21.15.76:0/3781962361 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f93c4110fc0 con 0x7f93c4101990 2024-06-02T04:48:45.575 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:45.019+0000 7f93bb7fe700 1 -- 172.21.15.76:0/3781962361 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f93b400f450 con 0x7f93c4101990 2024-06-02T04:48:45.575 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:45.020+0000 7f93bb7fe700 1 --2- 172.21.15.76:0/3781962361 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f93b00a1230 0x7f93b00a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:45.575 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:45.020+0000 7f93ca508700 1 --2- 172.21.15.76:0/3781962361 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f93b00a1230 0x7f93b00a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:45.575 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:45.020+0000 7f93bb7fe700 1 -- 172.21.15.76:0/3781962361 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f93b40cd140 con 0x7f93c4101990 2024-06-02T04:48:45.575 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:45.020+0000 7f93bb7fe700 1 --2- 172.21.15.76:0/3781962361 >> [v2:172.21.15.119:6816/1802558756,v1:172.21.15.119:6817/1802558756] conn(0x7f93b00abdb0 0x7f93b00ae1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:45.576 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:45.020+0000 7f93bb7fe700 1 -- 172.21.15.76:0/3781962361 --> [v2:172.21.15.119:6816/1802558756,v1:172.21.15.119:6817/1802558756] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f93b00ae8c0 con 0x7f93b00abdb0 2024-06-02T04:48:45.576 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:45.020+0000 7f93bb7fe700 1 -- 172.21.15.76:0/3781962361 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) v2 ==== 24+0+0 (secure 0 0 0) 0x7f93b40cd4f0 con 0x7f93c4101990 2024-06-02T04:48:45.576 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:45.020+0000 7f93ca508700 1 --2- 172.21.15.76:0/3781962361 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f93b00a1230 0x7f93b00a36f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f93c0009be0 tx=0x7f93c0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:45.576 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:45.020+0000 7f93cad09700 1 --2- 172.21.15.76:0/3781962361 >> [v2:172.21.15.119:6816/1802558756,v1:172.21.15.119:6817/1802558756] conn(0x7f93b00abdb0 0x7f93b00ae1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:45.576 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:45.021+0000 7f93cad09700 1 --2- 172.21.15.76:0/3781962361 >> [v2:172.21.15.119:6816/1802558756,v1:172.21.15.119:6817/1802558756] conn(0x7f93b00abdb0 0x7f93b00ae1f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:45.576 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:45.022+0000 7f93bb7fe700 1 -- 172.21.15.76:0/3781962361 <== osd.7 v2:172.21.15.119:6816/1802558756 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f93b00ae8c0 con 0x7f93b00abdb0 2024-06-02T04:48:45.576 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:45.038+0000 7f93cc76c700 1 -- 172.21.15.76:0/3781962361 --> [v2:172.21.15.119:6816/1802558756,v1:172.21.15.119:6817/1802558756] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f93c4061620 con 0x7f93b00abdb0 2024-06-02T04:48:45.576 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:45.038+0000 7f93bb7fe700 1 -- 172.21.15.76:0/3781962361 <== osd.7 v2:172.21.15.119:6816/1802558756 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f93c4061620 con 0x7f93b00abdb0 2024-06-02T04:48:45.576 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:45.038+0000 7f93cc76c700 1 -- 172.21.15.76:0/3781962361 >> [v2:172.21.15.119:6816/1802558756,v1:172.21.15.119:6817/1802558756] conn(0x7f93b00abdb0 msgr2=0x7f93b00ae1f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:45.576 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:45.038+0000 7f93cc76c700 1 --2- 172.21.15.76:0/3781962361 >> [v2:172.21.15.119:6816/1802558756,v1:172.21.15.119:6817/1802558756] conn(0x7f93b00abdb0 0x7f93b00ae1f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:45.576 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:45.039+0000 7f93cc76c700 1 -- 172.21.15.76:0/3781962361 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f93b00a1230 msgr2=0x7f93b00a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:45.576 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:45.039+0000 7f93cc76c700 1 --2- 172.21.15.76:0/3781962361 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f93b00a1230 0x7f93b00a36f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f93c0009be0 tx=0x7f93c0009260 comp rx=0 tx=0).stop 2024-06-02T04:48:45.576 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:45.039+0000 7f93cc76c700 1 -- 172.21.15.76:0/3781962361 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f93c4101990 msgr2=0x7f93c41978d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:45.577 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:45.039+0000 7f93cc76c700 1 --2- 172.21.15.76:0/3781962361 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f93c4101990 0x7f93c41978d0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f93b400c9b0 tx=0x7f93b400ccc0 comp rx=0 tx=0).stop 2024-06-02T04:48:45.577 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:45.039+0000 7f93cad09700 1 -- 172.21.15.76:0/3781962361 reap_dead start 2024-06-02T04:48:45.577 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:45.039+0000 7f93cc76c700 1 -- 172.21.15.76:0/3781962361 shutdown_connections 2024-06-02T04:48:45.577 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:45.039+0000 7f93cc76c700 1 -- 172.21.15.76:0/3781962361 >> 172.21.15.76:0/3781962361 conn(0x7f93c4078190 msgr2=0x7f93c40fff40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:45.577 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:45.039+0000 7f93cc76c700 1 -- 172.21.15.76:0/3781962361 shutdown_connections 2024-06-02T04:48:45.577 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:45.039+0000 7f93cc76c700 1 -- 172.21.15.76:0/3781962361 wait complete. 2024-06-02T04:48:45.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:45 smithi119 ceph-mon[46633]: pgmap v239: 129 pgs: 129 active+clean; 638 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 3.4 KiB/s wr, 7 op/s 2024-06-02T04:48:45.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:45 smithi192 ceph-mon[47933]: pgmap v239: 129 pgs: 129 active+clean; 638 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 3.4 KiB/s wr, 7 op/s 2024-06-02T04:48:46.438 INFO:teuthology.orchestra.run.smithi076.stdout:257698037785 2024-06-02T04:48:46.439 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell --fsid 60ab6d30-209a-11ef-bc9b-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-06-02T04:48:47.242 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.099+0000 7f0fad5c1700 1 -- 172.21.15.76:0/822903190 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0fa8107060 msgr2=0x7f0fa8107440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:47.242 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.099+0000 7f0fad5c1700 1 --2- 172.21.15.76:0/822903190 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0fa8107060 0x7f0fa8107440 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f0f90009990 tx=0x7f0f90009ca0 comp rx=0 tx=0).stop 2024-06-02T04:48:47.242 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.099+0000 7f0fad5c1700 1 -- 172.21.15.76:0/822903190 shutdown_connections 2024-06-02T04:48:47.243 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.099+0000 7f0fad5c1700 1 --2- 172.21.15.76:0/822903190 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0fa81019e0 0x7f0fa810de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:47.243 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.099+0000 7f0fad5c1700 1 --2- 172.21.15.76:0/822903190 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0fa8107060 0x7f0fa8107440 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:47.243 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.099+0000 7f0fad5c1700 1 --2- 172.21.15.76:0/822903190 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0fa8101020 0x7f0fa81014a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:47.243 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.099+0000 7f0fad5c1700 1 -- 172.21.15.76:0/822903190 >> 172.21.15.76:0/822903190 conn(0x7f0fa8078100 msgr2=0x7f0fa8078510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:47.243 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.099+0000 7f0fad5c1700 1 -- 172.21.15.76:0/822903190 shutdown_connections 2024-06-02T04:48:47.243 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.099+0000 7f0fad5c1700 1 -- 172.21.15.76:0/822903190 wait complete. 2024-06-02T04:48:47.243 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.100+0000 7f0fad5c1700 1 Processor -- start 2024-06-02T04:48:47.243 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.100+0000 7f0fad5c1700 1 -- start start 2024-06-02T04:48:47.243 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.100+0000 7f0fad5c1700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0fa8101020 0x7f0fa8197330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:47.243 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.100+0000 7f0fad5c1700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0fa81019e0 0x7f0fa8197870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:47.243 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.100+0000 7f0fad5c1700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0fa8107060 0x7f0fa819bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:47.244 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.100+0000 7f0fad5c1700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa819c230 con 0x7f0fa81019e0 2024-06-02T04:48:47.244 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.100+0000 7f0fad5c1700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa819c3a0 con 0x7f0fa8107060 2024-06-02T04:48:47.244 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.100+0000 7f0fad5c1700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa819c560 con 0x7f0fa8101020 2024-06-02T04:48:47.244 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.100+0000 7f0fa67fc700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0fa81019e0 0x7f0fa8197870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:47.244 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.100+0000 7f0fa67fc700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0fa81019e0 0x7f0fa8197870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:57520/0 (socket says 172.21.15.76:57520) 2024-06-02T04:48:47.244 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.100+0000 7f0fa67fc700 1 -- 172.21.15.76:0/3133645555 learned_addr learned my addr 172.21.15.76:0/3133645555 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:48:47.244 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.101+0000 7f0fa6ffd700 1 --2- 172.21.15.76:0/3133645555 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0fa8101020 0x7f0fa8197330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:47.244 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.101+0000 7f0fa77fe700 1 --2- 172.21.15.76:0/3133645555 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0fa8107060 0x7f0fa819bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:47.244 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.101+0000 7f0fa67fc700 1 -- 172.21.15.76:0/3133645555 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0fa8101020 msgr2=0x7f0fa8197330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:47.244 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.101+0000 7f0fa67fc700 1 --2- 172.21.15.76:0/3133645555 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0fa8101020 0x7f0fa8197330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:47.244 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.101+0000 7f0fa67fc700 1 -- 172.21.15.76:0/3133645555 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0fa8107060 msgr2=0x7f0fa819bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:47.244 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.101+0000 7f0fa67fc700 1 --2- 172.21.15.76:0/3133645555 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0fa8107060 0x7f0fa819bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:47.245 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.101+0000 7f0fa67fc700 1 -- 172.21.15.76:0/3133645555 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f900095f0 con 0x7f0fa81019e0 2024-06-02T04:48:47.245 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.101+0000 7f0fa6ffd700 1 --2- 172.21.15.76:0/3133645555 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0fa8101020 0x7f0fa8197330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:48:47.245 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.101+0000 7f0fa77fe700 1 --2- 172.21.15.76:0/3133645555 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0fa8107060 0x7f0fa819bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:48:47.245 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.101+0000 7f0fa67fc700 1 --2- 172.21.15.76:0/3133645555 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0fa81019e0 0x7f0fa8197870 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f0f9800b530 tx=0x7f0f9800b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:47.245 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.101+0000 7f0f9ffff700 1 -- 172.21.15.76:0/3133645555 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f98011830 con 0x7f0fa81019e0 2024-06-02T04:48:47.245 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.101+0000 7f0fad5c1700 1 -- 172.21.15.76:0/3133645555 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fa819c840 con 0x7f0fa81019e0 2024-06-02T04:48:47.245 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.101+0000 7f0f9ffff700 1 -- 172.21.15.76:0/3133645555 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0f98011e20 con 0x7f0fa81019e0 2024-06-02T04:48:47.245 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.101+0000 7f0f9ffff700 1 -- 172.21.15.76:0/3133645555 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f98010dd0 con 0x7f0fa81019e0 2024-06-02T04:48:47.246 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.101+0000 7f0fad5c1700 1 -- 172.21.15.76:0/3133645555 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fa81a40a0 con 0x7f0fa81019e0 2024-06-02T04:48:47.246 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.102+0000 7f0fad5c1700 1 -- 172.21.15.76:0/3133645555 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0fa8111060 con 0x7f0fa81019e0 2024-06-02T04:48:47.246 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.103+0000 7f0f9ffff700 1 -- 172.21.15.76:0/3133645555 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f0f98011990 con 0x7f0fa81019e0 2024-06-02T04:48:47.246 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.104+0000 7f0f9ffff700 1 --2- 172.21.15.76:0/3133645555 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f0f940a11b0 0x7f0f940a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:47.246 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.104+0000 7f0fa6ffd700 1 --2- 172.21.15.76:0/3133645555 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f0f940a11b0 0x7f0f940a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:47.246 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.104+0000 7f0f9ffff700 1 -- 172.21.15.76:0/3133645555 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f0f980ccbf0 con 0x7f0fa81019e0 2024-06-02T04:48:47.246 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.104+0000 7f0f9ffff700 1 --2- 172.21.15.76:0/3133645555 >> [v2:172.21.15.76:6802/2869602045,v1:172.21.15.76:6803/2869602045] conn(0x7f0f940abd30 0x7f0f940ae170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:47.246 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.104+0000 7f0f9ffff700 1 -- 172.21.15.76:0/3133645555 --> [v2:172.21.15.76:6802/2869602045,v1:172.21.15.76:6803/2869602045] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0f940ae840 con 0x7f0f940abd30 2024-06-02T04:48:47.246 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.104+0000 7f0f9ffff700 1 -- 172.21.15.76:0/3133645555 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0f980cd000 con 0x7f0fa81019e0 2024-06-02T04:48:47.246 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.104+0000 7f0fa77fe700 1 --2- 172.21.15.76:0/3133645555 >> [v2:172.21.15.76:6802/2869602045,v1:172.21.15.76:6803/2869602045] conn(0x7f0f940abd30 0x7f0f940ae170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:47.246 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.104+0000 7f0fa6ffd700 1 --2- 172.21.15.76:0/3133645555 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f0f940a11b0 0x7f0f940a3670 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0f90006010 tx=0x7f0f9000b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:47.247 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.104+0000 7f0fa77fe700 1 --2- 172.21.15.76:0/3133645555 >> [v2:172.21.15.76:6802/2869602045,v1:172.21.15.76:6803/2869602045] conn(0x7f0f940abd30 0x7f0f940ae170 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:47.247 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.105+0000 7f0f9ffff700 1 -- 172.21.15.76:0/3133645555 <== osd.0 v2:172.21.15.76:6802/2869602045 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f0f940ae840 con 0x7f0f940abd30 2024-06-02T04:48:47.247 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.121+0000 7f0fad5c1700 1 -- 172.21.15.76:0/3133645555 --> [v2:172.21.15.76:6802/2869602045,v1:172.21.15.76:6803/2869602045] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0fa8061620 con 0x7f0f940abd30 2024-06-02T04:48:47.247 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.121+0000 7f0f9ffff700 1 -- 172.21.15.76:0/3133645555 <== osd.0 v2:172.21.15.76:6802/2869602045 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0fa8061620 con 0x7f0f940abd30 2024-06-02T04:48:47.247 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.121+0000 7f0fad5c1700 1 -- 172.21.15.76:0/3133645555 >> [v2:172.21.15.76:6802/2869602045,v1:172.21.15.76:6803/2869602045] conn(0x7f0f940abd30 msgr2=0x7f0f940ae170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:47.247 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.121+0000 7f0fad5c1700 1 --2- 172.21.15.76:0/3133645555 >> [v2:172.21.15.76:6802/2869602045,v1:172.21.15.76:6803/2869602045] conn(0x7f0f940abd30 0x7f0f940ae170 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:47.247 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.122+0000 7f0fad5c1700 1 -- 172.21.15.76:0/3133645555 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f0f940a11b0 msgr2=0x7f0f940a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:47.247 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.122+0000 7f0fad5c1700 1 --2- 172.21.15.76:0/3133645555 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f0f940a11b0 0x7f0f940a3670 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0f90006010 tx=0x7f0f9000b540 comp rx=0 tx=0).stop 2024-06-02T04:48:47.247 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.122+0000 7f0fad5c1700 1 -- 172.21.15.76:0/3133645555 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0fa81019e0 msgr2=0x7f0fa8197870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:47.247 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.122+0000 7f0fad5c1700 1 --2- 172.21.15.76:0/3133645555 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0fa81019e0 0x7f0fa8197870 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f0f9800b530 tx=0x7f0f9800b8f0 comp rx=0 tx=0).stop 2024-06-02T04:48:47.247 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.122+0000 7f0fa77fe700 1 -- 172.21.15.76:0/3133645555 reap_dead start 2024-06-02T04:48:47.248 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.122+0000 7f0fad5c1700 1 -- 172.21.15.76:0/3133645555 shutdown_connections 2024-06-02T04:48:47.248 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.122+0000 7f0fad5c1700 1 -- 172.21.15.76:0/3133645555 >> 172.21.15.76:0/3133645555 conn(0x7f0fa8078100 msgr2=0x7f0fa80ffe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:47.248 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.122+0000 7f0fad5c1700 1 -- 172.21.15.76:0/3133645555 shutdown_connections 2024-06-02T04:48:47.248 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.122+0000 7f0fad5c1700 1 -- 172.21.15.76:0/3133645555 wait complete. 2024-06-02T04:48:47.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:47 smithi076 ceph-mon[42935]: pgmap v240: 129 pgs: 129 active+clean; 638 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 3.4 KiB/s wr, 8 op/s 2024-06-02T04:48:47.526 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.518+0000 7fc6d0534700 1 -- 172.21.15.76:0/481192477 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc6c8100850 msgr2=0x7fc6c810ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:47.526 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.518+0000 7fc6d0534700 1 --2- 172.21.15.76:0/481192477 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc6c8100850 0x7fc6c810ccf0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fc6c000b0a0 tx=0x7fc6c000b3b0 comp rx=0 tx=0).stop 2024-06-02T04:48:47.526 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.518+0000 7fc6d0534700 1 -- 172.21.15.76:0/481192477 shutdown_connections 2024-06-02T04:48:47.526 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.518+0000 7fc6d0534700 1 --2- 172.21.15.76:0/481192477 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc6c8100850 0x7fc6c810ccf0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:47.526 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.518+0000 7fc6d0534700 1 --2- 172.21.15.76:0/481192477 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc6c8105f40 0x7fc6c8106320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:47.526 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.518+0000 7fc6d0534700 1 --2- 172.21.15.76:0/481192477 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc6c80ffe90 0x7fc6c8100310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:47.526 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.518+0000 7fc6d0534700 1 -- 172.21.15.76:0/481192477 >> 172.21.15.76:0/481192477 conn(0x7fc6c8076e70 msgr2=0x7fc6c8077280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:47.527 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.518+0000 7fc6d0534700 1 -- 172.21.15.76:0/481192477 shutdown_connections 2024-06-02T04:48:47.527 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.518+0000 7fc6d0534700 1 -- 172.21.15.76:0/481192477 wait complete. 2024-06-02T04:48:47.527 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.518+0000 7fc6d0534700 1 Processor -- start 2024-06-02T04:48:47.527 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.519+0000 7fc6d0534700 1 -- start start 2024-06-02T04:48:47.527 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.519+0000 7fc6d0534700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc6c80ffe90 0x7fc6c81981e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:47.527 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.519+0000 7fc6d0534700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc6c8100850 0x7fc6c8198720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:47.527 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.519+0000 7fc6d0534700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc6c8105f40 0x7fc6c81a3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:47.527 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.519+0000 7fc6d0534700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c8198f70 con 0x7fc6c80ffe90 2024-06-02T04:48:47.527 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.519+0000 7fc6d0534700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c81a37a0 con 0x7fc6c8105f40 2024-06-02T04:48:47.527 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.519+0000 7fc6d0534700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c81a38e0 con 0x7fc6c8100850 2024-06-02T04:48:47.527 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.519+0000 7fc6ce2d0700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc6c80ffe90 0x7fc6c81981e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:47.527 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.519+0000 7fc6ce2d0700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc6c80ffe90 0x7fc6c81981e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:57528/0 (socket says 172.21.15.76:57528) 2024-06-02T04:48:47.527 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.519+0000 7fc6ce2d0700 1 -- 172.21.15.76:0/188504364 learned_addr learned my addr 172.21.15.76:0/188504364 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:48:47.528 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.519+0000 7fc6cead1700 1 --2- 172.21.15.76:0/188504364 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc6c8105f40 0x7fc6c81a3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:47.528 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.519+0000 7fc6cdacf700 1 --2- 172.21.15.76:0/188504364 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc6c8100850 0x7fc6c8198720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:47.528 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.519+0000 7fc6ce2d0700 1 -- 172.21.15.76:0/188504364 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc6c8100850 msgr2=0x7fc6c8198720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:47.528 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.519+0000 7fc6ce2d0700 1 --2- 172.21.15.76:0/188504364 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc6c8100850 0x7fc6c8198720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:47.528 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.519+0000 7fc6ce2d0700 1 -- 172.21.15.76:0/188504364 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc6c8105f40 msgr2=0x7fc6c81a3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:47.528 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.519+0000 7fc6ce2d0700 1 --2- 172.21.15.76:0/188504364 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc6c8105f40 0x7fc6c81a3260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:47.528 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.519+0000 7fc6ce2d0700 1 -- 172.21.15.76:0/188504364 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6c0009d00 con 0x7fc6c80ffe90 2024-06-02T04:48:47.528 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.519+0000 7fc6ce2d0700 1 --2- 172.21.15.76:0/188504364 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc6c80ffe90 0x7fc6c81981e0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fc6b800c950 tx=0x7fc6b800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:47.528 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.520+0000 7fc6bf7fe700 1 -- 172.21.15.76:0/188504364 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b800cea0 con 0x7fc6c80ffe90 2024-06-02T04:48:47.528 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.520+0000 7fc6bf7fe700 1 -- 172.21.15.76:0/188504364 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc6b8004830 con 0x7fc6c80ffe90 2024-06-02T04:48:47.528 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.520+0000 7fc6d0534700 1 -- 172.21.15.76:0/188504364 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6c81a3b40 con 0x7fc6c80ffe90 2024-06-02T04:48:47.528 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.520+0000 7fc6bf7fe700 1 -- 172.21.15.76:0/188504364 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b8005440 con 0x7fc6c80ffe90 2024-06-02T04:48:47.528 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.520+0000 7fc6d0534700 1 -- 172.21.15.76:0/188504364 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6c81a4040 con 0x7fc6c80ffe90 2024-06-02T04:48:47.529 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.520+0000 7fc6d0534700 1 -- 172.21.15.76:0/188504364 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc6c8101580 con 0x7fc6c80ffe90 2024-06-02T04:48:47.529 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.522+0000 7fc6bf7fe700 1 -- 172.21.15.76:0/188504364 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fc6b80055a0 con 0x7fc6c80ffe90 2024-06-02T04:48:47.529 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.522+0000 7fc6bf7fe700 1 --2- 172.21.15.76:0/188504364 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fc6b40a11b0 0x7fc6b40a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:47.529 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.522+0000 7fc6cdacf700 1 --2- 172.21.15.76:0/188504364 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fc6b40a11b0 0x7fc6b40a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:47.529 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.522+0000 7fc6bf7fe700 1 -- 172.21.15.76:0/188504364 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fc6b80ccc00 con 0x7fc6c80ffe90 2024-06-02T04:48:47.529 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.523+0000 7fc6bf7fe700 1 --2- 172.21.15.76:0/188504364 >> [v2:172.21.15.76:6810/3747864233,v1:172.21.15.76:6811/3747864233] conn(0x7fc6b40abd30 0x7fc6b40ae170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:47.529 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.523+0000 7fc6bf7fe700 1 -- 172.21.15.76:0/188504364 --> [v2:172.21.15.76:6810/3747864233,v1:172.21.15.76:6811/3747864233] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc6b40ae840 con 0x7fc6b40abd30 2024-06-02T04:48:47.529 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.523+0000 7fc6bf7fe700 1 -- 172.21.15.76:0/188504364 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc6b80cd010 con 0x7fc6c80ffe90 2024-06-02T04:48:47.529 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.523+0000 7fc6cead1700 1 --2- 172.21.15.76:0/188504364 >> [v2:172.21.15.76:6810/3747864233,v1:172.21.15.76:6811/3747864233] conn(0x7fc6b40abd30 0x7fc6b40ae170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:47.529 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.523+0000 7fc6cdacf700 1 --2- 172.21.15.76:0/188504364 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fc6b40a11b0 0x7fc6b40a3670 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc6c4005fd0 tx=0x7fc6c400a560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:47.529 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.523+0000 7fc6cead1700 1 --2- 172.21.15.76:0/188504364 >> [v2:172.21.15.76:6810/3747864233,v1:172.21.15.76:6811/3747864233] conn(0x7fc6b40abd30 0x7fc6b40ae170 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:47.529 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.524+0000 7fc6bf7fe700 1 -- 172.21.15.76:0/188504364 <== osd.3 v2:172.21.15.76:6810/3747864233 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fc6b40ae840 con 0x7fc6b40abd30 2024-06-02T04:48:47.540 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.540+0000 7fc6d0534700 1 -- 172.21.15.76:0/188504364 --> [v2:172.21.15.76:6810/3747864233,v1:172.21.15.76:6811/3747864233] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc6c810fe80 con 0x7fc6b40abd30 2024-06-02T04:48:47.540 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.540+0000 7fc6bf7fe700 1 -- 172.21.15.76:0/188504364 <== osd.3 v2:172.21.15.76:6810/3747864233 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc6c810fe80 con 0x7fc6b40abd30 2024-06-02T04:48:47.541 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.540+0000 7fc6d0534700 1 -- 172.21.15.76:0/188504364 >> [v2:172.21.15.76:6810/3747864233,v1:172.21.15.76:6811/3747864233] conn(0x7fc6b40abd30 msgr2=0x7fc6b40ae170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:47.541 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.540+0000 7fc6d0534700 1 --2- 172.21.15.76:0/188504364 >> [v2:172.21.15.76:6810/3747864233,v1:172.21.15.76:6811/3747864233] conn(0x7fc6b40abd30 0x7fc6b40ae170 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:47.541 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.540+0000 7fc6d0534700 1 -- 172.21.15.76:0/188504364 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fc6b40a11b0 msgr2=0x7fc6b40a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:47.541 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.541+0000 7fc6d0534700 1 --2- 172.21.15.76:0/188504364 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fc6b40a11b0 0x7fc6b40a3670 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc6c4005fd0 tx=0x7fc6c400a560 comp rx=0 tx=0).stop 2024-06-02T04:48:47.541 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.541+0000 7fc6d0534700 1 -- 172.21.15.76:0/188504364 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc6c80ffe90 msgr2=0x7fc6c81981e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:47.541 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.541+0000 7fc6d0534700 1 --2- 172.21.15.76:0/188504364 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc6c80ffe90 0x7fc6c81981e0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fc6b800c950 tx=0x7fc6b800cc60 comp rx=0 tx=0).stop 2024-06-02T04:48:47.542 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.541+0000 7fc6cead1700 1 -- 172.21.15.76:0/188504364 reap_dead start 2024-06-02T04:48:47.542 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.541+0000 7fc6d0534700 1 -- 172.21.15.76:0/188504364 shutdown_connections 2024-06-02T04:48:47.542 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.541+0000 7fc6d0534700 1 -- 172.21.15.76:0/188504364 >> 172.21.15.76:0/188504364 conn(0x7fc6c8076e70 msgr2=0x7fc6c80fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:47.542 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.541+0000 7fc6d0534700 1 -- 172.21.15.76:0/188504364 shutdown_connections 2024-06-02T04:48:47.542 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:47.541+0000 7fc6d0534700 1 -- 172.21.15.76:0/188504364 wait complete. 2024-06-02T04:48:47.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:47 smithi119 ceph-mon[46633]: pgmap v240: 129 pgs: 129 active+clean; 638 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 3.4 KiB/s wr, 8 op/s 2024-06-02T04:48:47.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:47 smithi192 ceph-mon[47933]: pgmap v240: 129 pgs: 129 active+clean; 638 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 3.4 KiB/s wr, 8 op/s 2024-06-02T04:48:47.928 INFO:teuthology.orchestra.run.smithi076.stdout:227633266716 2024-06-02T04:48:47.929 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell --fsid 60ab6d30-209a-11ef-bc9b-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-06-02T04:48:48.228 INFO:teuthology.orchestra.run.smithi076.stdout:197568495648 2024-06-02T04:48:48.228 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell --fsid 60ab6d30-209a-11ef-bc9b-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-06-02T04:48:48.788 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:48.687+0000 7f153539f700 1 -- 172.21.15.76:0/721469340 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f15300ffef0 msgr2=0x7f15301002d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:48.789 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:48.687+0000 7f153539f700 1 --2- 172.21.15.76:0/721469340 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f15300ffef0 0x7f15301002d0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f1518009990 tx=0x7f1518009ca0 comp rx=0 tx=0).stop 2024-06-02T04:48:48.789 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:48.687+0000 7f153539f700 1 -- 172.21.15.76:0/721469340 shutdown_connections 2024-06-02T04:48:48.789 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:48.687+0000 7f153539f700 1 --2- 172.21.15.76:0/721469340 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1530104fd0 0x7f153010cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:48.789 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:48.687+0000 7f153539f700 1 --2- 172.21.15.76:0/721469340 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f15300ffef0 0x7f15301002d0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:48.789 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:48.687+0000 7f153539f700 1 --2- 172.21.15.76:0/721469340 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f15301008a0 0x7f15301048f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:48.789 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:48.687+0000 7f153539f700 1 -- 172.21.15.76:0/721469340 >> 172.21.15.76:0/721469340 conn(0x7f15300fb7e0 msgr2=0x7f15300fdc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:48.789 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:48.687+0000 7f153539f700 1 -- 172.21.15.76:0/721469340 shutdown_connections 2024-06-02T04:48:48.789 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:48.687+0000 7f153539f700 1 -- 172.21.15.76:0/721469340 wait complete. 2024-06-02T04:48:48.789 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:48.688+0000 7f153539f700 1 Processor -- start 2024-06-02T04:48:48.789 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:48.688+0000 7f153539f700 1 -- start start 2024-06-02T04:48:48.789 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:48.689+0000 7f153539f700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15300ffef0 0x7f1530196090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:48.789 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:48.689+0000 7f153539f700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f15301008a0 0x7f15301965d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:48.789 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:48.689+0000 7f153539f700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1530104fd0 0x7f153019a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:48.790 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:48.689+0000 7f153539f700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f153019af90 con 0x7f15301008a0 2024-06-02T04:48:48.790 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:48.689+0000 7f153539f700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f153019b100 con 0x7f15300ffef0 2024-06-02T04:48:48.790 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:48.689+0000 7f153539f700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f153019b2c0 con 0x7f1530104fd0 2024-06-02T04:48:48.790 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:48.689+0000 7f152f7fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f15301008a0 0x7f15301965d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:48.790 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:48.689+0000 7f152f7fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f15301008a0 0x7f15301965d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:57548/0 (socket says 172.21.15.76:57548) 2024-06-02T04:48:48.790 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:48.689+0000 7f152f7fe700 1 -- 172.21.15.76:0/3373495048 learned_addr learned my addr 172.21.15.76:0/3373495048 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:48:48.790 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:48.689+0000 7f152ffff700 1 --2- 172.21.15.76:0/3373495048 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15300ffef0 0x7f1530196090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:48.790 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:48.689+0000 7f1534b9e700 1 --2- 172.21.15.76:0/3373495048 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1530104fd0 0x7f153019a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:48.791 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:48.689+0000 7f152f7fe700 1 -- 172.21.15.76:0/3373495048 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1530104fd0 msgr2=0x7f153019a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:48.791 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:48.689+0000 7f152f7fe700 1 --2- 172.21.15.76:0/3373495048 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1530104fd0 0x7f153019a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:48.791 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:48.689+0000 7f152f7fe700 1 -- 172.21.15.76:0/3373495048 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15300ffef0 msgr2=0x7f1530196090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:48.791 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:48.689+0000 7f152f7fe700 1 --2- 172.21.15.76:0/3373495048 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15300ffef0 0x7f1530196090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:48.791 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:48.689+0000 7f152f7fe700 1 -- 172.21.15.76:0/3373495048 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15180095f0 con 0x7f15301008a0 2024-06-02T04:48:48.791 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:48.689+0000 7f152f7fe700 1 --2- 172.21.15.76:0/3373495048 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f15301008a0 0x7f15301965d0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f152000d980 tx=0x7f152000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:48.791 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:48.689+0000 7f152d7fa700 1 -- 172.21.15.76:0/3373495048 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f152000f890 con 0x7f15301008a0 2024-06-02T04:48:48.791 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:48.689+0000 7f152d7fa700 1 -- 172.21.15.76:0/3373495048 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f152000fe80 con 0x7f15301008a0 2024-06-02T04:48:48.791 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:48.689+0000 7f153539f700 1 -- 172.21.15.76:0/3373495048 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f153019b5a0 con 0x7f15301008a0 2024-06-02T04:48:48.792 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:48.689+0000 7f152d7fa700 1 -- 172.21.15.76:0/3373495048 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f152000e3b0 con 0x7f15301008a0 2024-06-02T04:48:48.792 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:48.689+0000 7f153539f700 1 -- 172.21.15.76:0/3373495048 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15301a2e00 con 0x7f15301008a0 2024-06-02T04:48:48.792 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:48.690+0000 7f153539f700 1 -- 172.21.15.76:0/3373495048 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f153010fd60 con 0x7f15301008a0 2024-06-02T04:48:48.792 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:48.691+0000 7f152d7fa700 1 -- 172.21.15.76:0/3373495048 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f152000f9f0 con 0x7f15301008a0 2024-06-02T04:48:48.792 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:48.692+0000 7f152d7fa700 1 --2- 172.21.15.76:0/3373495048 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f151c0a1230 0x7f151c0a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:48.792 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:48.692+0000 7f152ffff700 1 --2- 172.21.15.76:0/3373495048 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f151c0a1230 0x7f151c0a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:48.792 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:48.692+0000 7f152d7fa700 1 -- 172.21.15.76:0/3373495048 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f15200ccb50 con 0x7f15301008a0 2024-06-02T04:48:48.792 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:48.692+0000 7f152d7fa700 1 --2- 172.21.15.76:0/3373495048 >> [v2:172.21.15.119:6800/2353738098,v1:172.21.15.119:6801/2353738098] conn(0x7f151c0abdb0 0x7f151c0ae1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:48.792 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:48.692+0000 7f152d7fa700 1 -- 172.21.15.76:0/3373495048 --> [v2:172.21.15.119:6800/2353738098,v1:172.21.15.119:6801/2353738098] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f151c0ae8c0 con 0x7f151c0abdb0 2024-06-02T04:48:48.792 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:48.692+0000 7f152d7fa700 1 -- 172.21.15.76:0/3373495048 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) v2 ==== 24+0+0 (secure 0 0 0) 0x7f15200ccf00 con 0x7f15301008a0 2024-06-02T04:48:48.792 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:48.692+0000 7f152ffff700 1 --2- 172.21.15.76:0/3373495048 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f151c0a1230 0x7f151c0a36f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f151800b5c0 tx=0x7f1518005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:48.792 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:48.693+0000 7f1534b9e700 1 --2- 172.21.15.76:0/3373495048 >> [v2:172.21.15.119:6800/2353738098,v1:172.21.15.119:6801/2353738098] conn(0x7f151c0abdb0 0x7f151c0ae1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:48.793 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:48.693+0000 7f1534b9e700 1 --2- 172.21.15.76:0/3373495048 >> [v2:172.21.15.119:6800/2353738098,v1:172.21.15.119:6801/2353738098] conn(0x7f151c0abdb0 0x7f151c0ae1f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:48.793 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:48.694+0000 7f152d7fa700 1 -- 172.21.15.76:0/3373495048 <== osd.1 v2:172.21.15.119:6800/2353738098 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f151c0ae8c0 con 0x7f151c0abdb0 2024-06-02T04:48:48.793 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:48.710+0000 7f153539f700 1 -- 172.21.15.76:0/3373495048 --> [v2:172.21.15.119:6800/2353738098,v1:172.21.15.119:6801/2353738098] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1530061620 con 0x7f151c0abdb0 2024-06-02T04:48:48.793 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:48.710+0000 7f152d7fa700 1 -- 172.21.15.76:0/3373495048 <== osd.1 v2:172.21.15.119:6800/2353738098 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1530061620 con 0x7f151c0abdb0 2024-06-02T04:48:48.793 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:48.711+0000 7f153539f700 1 -- 172.21.15.76:0/3373495048 >> [v2:172.21.15.119:6800/2353738098,v1:172.21.15.119:6801/2353738098] conn(0x7f151c0abdb0 msgr2=0x7f151c0ae1f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:48.793 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:48.711+0000 7f153539f700 1 --2- 172.21.15.76:0/3373495048 >> [v2:172.21.15.119:6800/2353738098,v1:172.21.15.119:6801/2353738098] conn(0x7f151c0abdb0 0x7f151c0ae1f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:48.793 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:48.711+0000 7f153539f700 1 -- 172.21.15.76:0/3373495048 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f151c0a1230 msgr2=0x7f151c0a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:48.793 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:48.711+0000 7f153539f700 1 --2- 172.21.15.76:0/3373495048 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f151c0a1230 0x7f151c0a36f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f151800b5c0 tx=0x7f1518005fb0 comp rx=0 tx=0).stop 2024-06-02T04:48:48.793 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:48.711+0000 7f153539f700 1 -- 172.21.15.76:0/3373495048 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f15301008a0 msgr2=0x7f15301965d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:48.793 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:48.711+0000 7f153539f700 1 --2- 172.21.15.76:0/3373495048 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f15301008a0 0x7f15301965d0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f152000d980 tx=0x7f152000dc90 comp rx=0 tx=0).stop 2024-06-02T04:48:48.793 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:48.711+0000 7f1534b9e700 1 -- 172.21.15.76:0/3373495048 reap_dead start 2024-06-02T04:48:48.793 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:48.711+0000 7f153539f700 1 -- 172.21.15.76:0/3373495048 shutdown_connections 2024-06-02T04:48:48.793 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:48.711+0000 7f153539f700 1 -- 172.21.15.76:0/3373495048 >> 172.21.15.76:0/3373495048 conn(0x7f15300fb7e0 msgr2=0x7f15300fccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:48.793 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:48.711+0000 7f153539f700 1 -- 172.21.15.76:0/3373495048 shutdown_connections 2024-06-02T04:48:48.794 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:48.711+0000 7f153539f700 1 -- 172.21.15.76:0/3373495048 wait complete. 2024-06-02T04:48:49.101 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.101+0000 7f15c9865700 1 -- 172.21.15.76:0/2803027466 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f15c4106fe0 msgr2=0x7f15c41073c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:49.101 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.101+0000 7f15c9865700 1 --2- 172.21.15.76:0/2803027466 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f15c4106fe0 0x7f15c41073c0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f15b80099c0 tx=0x7f15b8009cd0 comp rx=0 tx=0).stop 2024-06-02T04:48:49.101 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.101+0000 7f15c9865700 1 -- 172.21.15.76:0/2803027466 shutdown_connections 2024-06-02T04:48:49.101 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.101+0000 7f15c9865700 1 --2- 172.21.15.76:0/2803027466 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15c4069c10 0x7f15c410de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:49.101 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.101+0000 7f15c9865700 1 --2- 172.21.15.76:0/2803027466 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f15c4106fe0 0x7f15c41073c0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:49.101 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.101+0000 7f15c9865700 1 --2- 172.21.15.76:0/2803027466 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f15c4069250 0x7f15c40696d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:49.102 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.101+0000 7f15c9865700 1 -- 172.21.15.76:0/2803027466 >> 172.21.15.76:0/2803027466 conn(0x7f15c4076e70 msgr2=0x7f15c4077280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:49.102 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.101+0000 7f15c9865700 1 -- 172.21.15.76:0/2803027466 shutdown_connections 2024-06-02T04:48:49.102 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.101+0000 7f15c9865700 1 -- 172.21.15.76:0/2803027466 wait complete. 2024-06-02T04:48:49.103 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.101+0000 7f15c9865700 1 Processor -- start 2024-06-02T04:48:49.103 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.102+0000 7f15c9865700 1 -- start start 2024-06-02T04:48:49.103 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.102+0000 7f15c9865700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f15c4069250 0x7f15c4197260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:49.103 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.102+0000 7f15c9865700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15c4069c10 0x7f15c41977a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:49.104 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.102+0000 7f15c9865700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f15c4106fe0 0x7f15c419bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:49.104 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.102+0000 7f15c9865700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15c419c160 con 0x7f15c4106fe0 2024-06-02T04:48:49.104 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.102+0000 7f15c9865700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15c419c2d0 con 0x7f15c4069c10 2024-06-02T04:48:49.104 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.102+0000 7f15c9865700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15c419c490 con 0x7f15c4069250 2024-06-02T04:48:49.104 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.102+0000 7f15c37fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f15c4106fe0 0x7f15c419bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:49.104 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.102+0000 7f15c37fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f15c4106fe0 0x7f15c419bb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:57564/0 (socket says 172.21.15.76:57564) 2024-06-02T04:48:49.104 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.102+0000 7f15c37fe700 1 -- 172.21.15.76:0/4273456026 learned_addr learned my addr 172.21.15.76:0/4273456026 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:48:49.104 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.102+0000 7f15c27fc700 1 --2- 172.21.15.76:0/4273456026 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15c4069c10 0x7f15c41977a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:49.104 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.102+0000 7f15c2ffd700 1 --2- 172.21.15.76:0/4273456026 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f15c4069250 0x7f15c4197260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:49.104 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.102+0000 7f15c37fe700 1 -- 172.21.15.76:0/4273456026 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f15c4069250 msgr2=0x7f15c4197260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:49.104 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.102+0000 7f15c37fe700 1 --2- 172.21.15.76:0/4273456026 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f15c4069250 0x7f15c4197260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:49.104 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.102+0000 7f15c37fe700 1 -- 172.21.15.76:0/4273456026 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15c4069c10 msgr2=0x7f15c41977a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:49.105 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.102+0000 7f15c37fe700 1 --2- 172.21.15.76:0/4273456026 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15c4069c10 0x7f15c41977a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:49.105 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.102+0000 7f15c37fe700 1 -- 172.21.15.76:0/4273456026 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15b80095f0 con 0x7f15c4106fe0 2024-06-02T04:48:49.105 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.102+0000 7f15c27fc700 1 --2- 172.21.15.76:0/4273456026 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15c4069c10 0x7f15c41977a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:48:49.105 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.102+0000 7f15c37fe700 1 --2- 172.21.15.76:0/4273456026 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f15c4106fe0 0x7f15c419bb50 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f15bc007ee0 tx=0x7f15bc00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:49.105 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.102+0000 7f15c8863700 1 -- 172.21.15.76:0/4273456026 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15bc017070 con 0x7f15c4106fe0 2024-06-02T04:48:49.105 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.103+0000 7f15c9865700 1 -- 172.21.15.76:0/4273456026 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15c419c770 con 0x7f15c4106fe0 2024-06-02T04:48:49.105 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.103+0000 7f15c8863700 1 -- 172.21.15.76:0/4273456026 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f15bc00f040 con 0x7f15c4106fe0 2024-06-02T04:48:49.105 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.103+0000 7f15c8863700 1 -- 172.21.15.76:0/4273456026 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15bc005710 con 0x7f15c4106fe0 2024-06-02T04:48:49.105 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.103+0000 7f15c9865700 1 -- 172.21.15.76:0/4273456026 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15c41a3fd0 con 0x7f15c4106fe0 2024-06-02T04:48:49.105 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.103+0000 7f15c9865700 1 -- 172.21.15.76:0/4273456026 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f15c4102690 con 0x7f15c4106fe0 2024-06-02T04:48:49.106 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.105+0000 7f15c8863700 1 -- 172.21.15.76:0/4273456026 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f15bc005870 con 0x7f15c4106fe0 2024-06-02T04:48:49.106 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.105+0000 7f15c8863700 1 --2- 172.21.15.76:0/4273456026 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f15ac0a11b0 0x7f15ac0a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:49.106 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.105+0000 7f15c2ffd700 1 --2- 172.21.15.76:0/4273456026 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f15ac0a11b0 0x7f15ac0a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:49.106 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.105+0000 7f15c8863700 1 -- 172.21.15.76:0/4273456026 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f15bc0ccbd0 con 0x7f15c4106fe0 2024-06-02T04:48:49.107 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.106+0000 7f15c8863700 1 --2- 172.21.15.76:0/4273456026 >> [v2:172.21.15.192:6800/3206918546,v1:172.21.15.192:6801/3206918546] conn(0x7f15ac0abd30 0x7f15ac0ae170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:49.107 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.106+0000 7f15c8863700 1 -- 172.21.15.76:0/4273456026 --> [v2:172.21.15.192:6800/3206918546,v1:172.21.15.192:6801/3206918546] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f15ac0ae840 con 0x7f15ac0abd30 2024-06-02T04:48:49.107 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.106+0000 7f15c8863700 1 -- 172.21.15.76:0/4273456026 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) v2 ==== 24+0+0 (secure 0 0 0) 0x7f15bc0ccfe0 con 0x7f15c4106fe0 2024-06-02T04:48:49.107 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.106+0000 7f15c2ffd700 1 --2- 172.21.15.76:0/4273456026 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f15ac0a11b0 0x7f15ac0a3670 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f15b8006010 tx=0x7f15b8000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:49.107 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.106+0000 7f15c27fc700 1 --2- 172.21.15.76:0/4273456026 >> [v2:172.21.15.192:6800/3206918546,v1:172.21.15.192:6801/3206918546] conn(0x7f15ac0abd30 0x7f15ac0ae170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:49.108 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.107+0000 7f15c27fc700 1 --2- 172.21.15.76:0/4273456026 >> [v2:172.21.15.192:6800/3206918546,v1:172.21.15.192:6801/3206918546] conn(0x7f15ac0abd30 0x7f15ac0ae170 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:49.108 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.108+0000 7f15c8863700 1 -- 172.21.15.76:0/4273456026 <== osd.2 v2:172.21.15.192:6800/3206918546 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f15ac0ae840 con 0x7f15ac0abd30 2024-06-02T04:48:49.124 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.124+0000 7f15c9865700 1 -- 172.21.15.76:0/4273456026 --> [v2:172.21.15.192:6800/3206918546,v1:172.21.15.192:6801/3206918546] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f15c4111090 con 0x7f15ac0abd30 2024-06-02T04:48:49.125 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.124+0000 7f15c8863700 1 -- 172.21.15.76:0/4273456026 <== osd.2 v2:172.21.15.192:6800/3206918546 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f15c4111090 con 0x7f15ac0abd30 2024-06-02T04:48:49.126 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.125+0000 7f15c9865700 1 -- 172.21.15.76:0/4273456026 >> [v2:172.21.15.192:6800/3206918546,v1:172.21.15.192:6801/3206918546] conn(0x7f15ac0abd30 msgr2=0x7f15ac0ae170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:49.126 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.125+0000 7f15c9865700 1 --2- 172.21.15.76:0/4273456026 >> [v2:172.21.15.192:6800/3206918546,v1:172.21.15.192:6801/3206918546] conn(0x7f15ac0abd30 0x7f15ac0ae170 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:49.126 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.125+0000 7f15c9865700 1 -- 172.21.15.76:0/4273456026 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f15ac0a11b0 msgr2=0x7f15ac0a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:49.126 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.125+0000 7f15c9865700 1 --2- 172.21.15.76:0/4273456026 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f15ac0a11b0 0x7f15ac0a3670 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f15b8006010 tx=0x7f15b8000bc0 comp rx=0 tx=0).stop 2024-06-02T04:48:49.126 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.125+0000 7f15c9865700 1 -- 172.21.15.76:0/4273456026 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f15c4106fe0 msgr2=0x7f15c419bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:49.126 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.125+0000 7f15c9865700 1 --2- 172.21.15.76:0/4273456026 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f15c4106fe0 0x7f15c419bb50 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f15bc007ee0 tx=0x7f15bc00d3b0 comp rx=0 tx=0).stop 2024-06-02T04:48:49.126 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.125+0000 7f15c37fe700 1 -- 172.21.15.76:0/4273456026 reap_dead start 2024-06-02T04:48:49.126 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.125+0000 7f15c9865700 1 -- 172.21.15.76:0/4273456026 shutdown_connections 2024-06-02T04:48:49.126 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.125+0000 7f15c9865700 1 -- 172.21.15.76:0/4273456026 >> 172.21.15.76:0/4273456026 conn(0x7f15c4076e70 msgr2=0x7f15c40fec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:49.126 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.125+0000 7f15c9865700 1 -- 172.21.15.76:0/4273456026 shutdown_connections 2024-06-02T04:48:49.126 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.125+0000 7f15c9865700 1 -- 172.21.15.76:0/4273456026 wait complete. 2024-06-02T04:48:49.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:49 smithi076 ceph-mon[42935]: pgmap v241: 129 pgs: 129 active+clean; 638 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-06-02T04:48:49.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:49 smithi119 ceph-mon[46633]: pgmap v241: 129 pgs: 129 active+clean; 638 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-06-02T04:48:49.614 INFO:teuthology.orchestra.run.smithi076.stdout:51539607605 2024-06-02T04:48:49.615 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell --fsid 60ab6d30-209a-11ef-bc9b-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-06-02T04:48:49.645 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.644+0000 7fa493771700 1 -- 172.21.15.76:0/301646410 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa48c0ff940 msgr2=0x7fa48c0ffd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:49.645 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.644+0000 7fa493771700 1 --2- 172.21.15.76:0/301646410 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa48c0ff940 0x7fa48c0ffd20 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fa488009990 tx=0x7fa488009ca0 comp rx=0 tx=0).stop 2024-06-02T04:48:49.645 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.644+0000 7fa493771700 1 -- 172.21.15.76:0/301646410 shutdown_connections 2024-06-02T04:48:49.645 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.644+0000 7fa493771700 1 --2- 172.21.15.76:0/301646410 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa48c111dd0 0x7fa48c1141c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:49.646 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.644+0000 7fa493771700 1 --2- 172.21.15.76:0/301646410 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa48c0ff940 0x7fa48c0ffd20 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:49.646 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.644+0000 7fa493771700 1 --2- 172.21.15.76:0/301646410 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa48c100260 0x7fa48c111890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:49.646 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.644+0000 7fa493771700 1 -- 172.21.15.76:0/301646410 >> 172.21.15.76:0/301646410 conn(0x7fa48c075260 msgr2=0x7fa48c075670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:49.646 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.644+0000 7fa493771700 1 -- 172.21.15.76:0/301646410 shutdown_connections 2024-06-02T04:48:49.646 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.644+0000 7fa493771700 1 -- 172.21.15.76:0/301646410 wait complete. 2024-06-02T04:48:49.647 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.645+0000 7fa493771700 1 Processor -- start 2024-06-02T04:48:49.647 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.645+0000 7fa493771700 1 -- start start 2024-06-02T04:48:49.647 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.645+0000 7fa493771700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa48c0ff940 0x7fa48c1a35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:49.648 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.645+0000 7fa493771700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa48c100260 0x7fa48c1a3b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:49.648 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.645+0000 7fa493771700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa48c111dd0 0x7fa48c19d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:49.648 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.645+0000 7fa493771700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa48c19dd60 con 0x7fa48c100260 2024-06-02T04:48:49.648 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.645+0000 7fa493771700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa48c19ded0 con 0x7fa48c0ff940 2024-06-02T04:48:49.648 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.645+0000 7fa493771700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa48c19e090 con 0x7fa48c111dd0 2024-06-02T04:48:49.648 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.646+0000 7fa490d0c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa48c100260 0x7fa48c1a3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:49.648 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.646+0000 7fa490d0c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa48c100260 0x7fa48c1a3b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:57582/0 (socket says 172.21.15.76:57582) 2024-06-02T04:48:49.648 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.646+0000 7fa490d0c700 1 -- 172.21.15.76:0/2659767123 learned_addr learned my addr 172.21.15.76:0/2659767123 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:48:49.648 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.646+0000 7fa49150d700 1 --2- 172.21.15.76:0/2659767123 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa48c0ff940 0x7fa48c1a35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:49.648 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.646+0000 7fa491d0e700 1 --2- 172.21.15.76:0/2659767123 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa48c111dd0 0x7fa48c19d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:49.648 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.646+0000 7fa490d0c700 1 -- 172.21.15.76:0/2659767123 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa48c111dd0 msgr2=0x7fa48c19d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:49.648 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.646+0000 7fa490d0c700 1 --2- 172.21.15.76:0/2659767123 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa48c111dd0 0x7fa48c19d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:49.648 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.646+0000 7fa490d0c700 1 -- 172.21.15.76:0/2659767123 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa48c0ff940 msgr2=0x7fa48c1a35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:49.649 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.646+0000 7fa490d0c700 1 --2- 172.21.15.76:0/2659767123 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa48c0ff940 0x7fa48c1a35c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:49.649 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.646+0000 7fa490d0c700 1 -- 172.21.15.76:0/2659767123 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4880095f0 con 0x7fa48c100260 2024-06-02T04:48:49.649 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.646+0000 7fa490d0c700 1 --2- 172.21.15.76:0/2659767123 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa48c100260 0x7fa48c1a3b00 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fa47c00d950 tx=0x7fa47c00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:49.650 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.647+0000 7fa4827fc700 1 -- 172.21.15.76:0/2659767123 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa47c009940 con 0x7fa48c100260 2024-06-02T04:48:49.650 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.647+0000 7fa4827fc700 1 -- 172.21.15.76:0/2659767123 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa47c010460 con 0x7fa48c100260 2024-06-02T04:48:49.650 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.647+0000 7fa493771700 1 -- 172.21.15.76:0/2659767123 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa48c19e370 con 0x7fa48c100260 2024-06-02T04:48:49.650 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.647+0000 7fa4827fc700 1 -- 172.21.15.76:0/2659767123 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa47c00f620 con 0x7fa48c100260 2024-06-02T04:48:49.650 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.647+0000 7fa493771700 1 -- 172.21.15.76:0/2659767123 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa48c1aa5b0 con 0x7fa48c100260 2024-06-02T04:48:49.650 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.648+0000 7fa493771700 1 -- 172.21.15.76:0/2659767123 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa48c1176c0 con 0x7fa48c100260 2024-06-02T04:48:49.651 INFO:teuthology.orchestra.run.smithi076.stdout:34359738423 2024-06-02T04:48:49.651 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell --fsid 60ab6d30-209a-11ef-bc9b-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-06-02T04:48:49.652 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.649+0000 7fa4827fc700 1 -- 172.21.15.76:0/2659767123 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fa47c0105d0 con 0x7fa48c100260 2024-06-02T04:48:49.653 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.650+0000 7fa4827fc700 1 --2- 172.21.15.76:0/2659767123 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fa4780a1330 0x7fa4780a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:49.653 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.650+0000 7fa49150d700 1 --2- 172.21.15.76:0/2659767123 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fa4780a1330 0x7fa4780a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:49.653 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.650+0000 7fa4827fc700 1 -- 172.21.15.76:0/2659767123 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fa47c0cc930 con 0x7fa48c100260 2024-06-02T04:48:49.653 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.650+0000 7fa4827fc700 1 --2- 172.21.15.76:0/2659767123 >> [v2:172.21.15.119:6824/4082130894,v1:172.21.15.119:6825/4082130894] conn(0x7fa4780abeb0 0x7fa4780ae2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:49.653 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.650+0000 7fa4827fc700 1 -- 172.21.15.76:0/2659767123 --> [v2:172.21.15.119:6824/4082130894,v1:172.21.15.119:6825/4082130894] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa4780ae9c0 con 0x7fa4780abeb0 2024-06-02T04:48:49.653 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.650+0000 7fa4827fc700 1 -- 172.21.15.76:0/2659767123 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa47c0d12c0 con 0x7fa48c100260 2024-06-02T04:48:49.653 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.650+0000 7fa49150d700 1 --2- 172.21.15.76:0/2659767123 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fa4780a1330 0x7fa4780a37f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa488006010 tx=0x7fa4880058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:49.653 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.651+0000 7fa491d0e700 1 --2- 172.21.15.76:0/2659767123 >> [v2:172.21.15.119:6824/4082130894,v1:172.21.15.119:6825/4082130894] conn(0x7fa4780abeb0 0x7fa4780ae2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:49.653 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.651+0000 7fa491d0e700 1 --2- 172.21.15.76:0/2659767123 >> [v2:172.21.15.119:6824/4082130894,v1:172.21.15.119:6825/4082130894] conn(0x7fa4780abeb0 0x7fa4780ae2f0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:49.654 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.652+0000 7fa4827fc700 1 -- 172.21.15.76:0/2659767123 <== osd.10 v2:172.21.15.119:6824/4082130894 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fa4780ae9c0 con 0x7fa4780abeb0 2024-06-02T04:48:49.669 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.668+0000 7fa493771700 1 -- 172.21.15.76:0/2659767123 --> [v2:172.21.15.119:6824/4082130894,v1:172.21.15.119:6825/4082130894] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa48c0ff300 con 0x7fa4780abeb0 2024-06-02T04:48:49.670 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.669+0000 7fa4827fc700 1 -- 172.21.15.76:0/2659767123 <== osd.10 v2:172.21.15.119:6824/4082130894 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fa48c0ff300 con 0x7fa4780abeb0 2024-06-02T04:48:49.671 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.669+0000 7fa493771700 1 -- 172.21.15.76:0/2659767123 >> [v2:172.21.15.119:6824/4082130894,v1:172.21.15.119:6825/4082130894] conn(0x7fa4780abeb0 msgr2=0x7fa4780ae2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:49.671 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.669+0000 7fa493771700 1 --2- 172.21.15.76:0/2659767123 >> [v2:172.21.15.119:6824/4082130894,v1:172.21.15.119:6825/4082130894] conn(0x7fa4780abeb0 0x7fa4780ae2f0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:49.671 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.669+0000 7fa493771700 1 -- 172.21.15.76:0/2659767123 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fa4780a1330 msgr2=0x7fa4780a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:49.671 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.669+0000 7fa493771700 1 --2- 172.21.15.76:0/2659767123 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fa4780a1330 0x7fa4780a37f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa488006010 tx=0x7fa4880058e0 comp rx=0 tx=0).stop 2024-06-02T04:48:49.671 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.669+0000 7fa493771700 1 -- 172.21.15.76:0/2659767123 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa48c100260 msgr2=0x7fa48c1a3b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:49.671 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.669+0000 7fa493771700 1 --2- 172.21.15.76:0/2659767123 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa48c100260 0x7fa48c1a3b00 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fa47c00d950 tx=0x7fa47c00dc60 comp rx=0 tx=0).stop 2024-06-02T04:48:49.671 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.669+0000 7fa491d0e700 1 -- 172.21.15.76:0/2659767123 reap_dead start 2024-06-02T04:48:49.671 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.670+0000 7fa493771700 1 -- 172.21.15.76:0/2659767123 shutdown_connections 2024-06-02T04:48:49.672 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.670+0000 7fa493771700 1 -- 172.21.15.76:0/2659767123 >> 172.21.15.76:0/2659767123 conn(0x7fa48c075260 msgr2=0x7fa48c0fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:49.672 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.670+0000 7fa493771700 1 -- 172.21.15.76:0/2659767123 shutdown_connections 2024-06-02T04:48:49.672 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.670+0000 7fa493771700 1 -- 172.21.15.76:0/2659767123 wait complete. 2024-06-02T04:48:49.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:49 smithi192 ceph-mon[47933]: pgmap v241: 129 pgs: 129 active+clean; 638 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-06-02T04:48:49.713 INFO:teuthology.orchestra.run.smithi076.stdout:94489280558 2024-06-02T04:48:49.714 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell --fsid 60ab6d30-209a-11ef-bc9b-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-06-02T04:48:49.823 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.822+0000 7f15089b9700 1 -- 172.21.15.76:0/2238070957 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1504105ec0 msgr2=0x7f1504068950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:49.823 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.822+0000 7f15089b9700 1 --2- 172.21.15.76:0/2238070957 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1504105ec0 0x7f1504068950 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f14f4009990 tx=0x7f14f4009ca0 comp rx=0 tx=0).stop 2024-06-02T04:48:49.824 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.822+0000 7f15089b9700 1 -- 172.21.15.76:0/2238070957 shutdown_connections 2024-06-02T04:48:49.824 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.822+0000 7f15089b9700 1 --2- 172.21.15.76:0/2238070957 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f15041039d0 0x7f1504103e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:49.824 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.822+0000 7f15089b9700 1 --2- 172.21.15.76:0/2238070957 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1504105ec0 0x7f1504068950 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:49.824 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.822+0000 7f15089b9700 1 --2- 172.21.15.76:0/2238070957 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1504068e90 0x7f1504069310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:49.824 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.822+0000 7f15089b9700 1 -- 172.21.15.76:0/2238070957 >> 172.21.15.76:0/2238070957 conn(0x7f1504075f80 msgr2=0x7f1504076390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:49.824 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.822+0000 7f15089b9700 1 -- 172.21.15.76:0/2238070957 shutdown_connections 2024-06-02T04:48:49.824 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.822+0000 7f15089b9700 1 -- 172.21.15.76:0/2238070957 wait complete. 2024-06-02T04:48:49.826 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.823+0000 7f15089b9700 1 Processor -- start 2024-06-02T04:48:49.826 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.823+0000 7f15089b9700 1 -- start start 2024-06-02T04:48:49.826 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.823+0000 7f15089b9700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1504068e90 0x7f15041a35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:49.826 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.823+0000 7f15089b9700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f15041039d0 0x7f15041a3b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:49.826 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.823+0000 7f15089b9700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1504105ec0 0x7f150419d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:49.826 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.823+0000 7f15089b9700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f150419dd60 con 0x7f15041039d0 2024-06-02T04:48:49.826 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.823+0000 7f15089b9700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f150419ded0 con 0x7f1504068e90 2024-06-02T04:48:49.826 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.823+0000 7f15089b9700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f150419e090 con 0x7f1504105ec0 2024-06-02T04:48:49.826 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.823+0000 7f1502d9d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1504105ec0 0x7f150419d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:49.826 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.823+0000 7f1502d9d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1504105ec0 0x7f150419d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:54564/0 (socket says 172.21.15.76:54564) 2024-06-02T04:48:49.826 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.823+0000 7f1502d9d700 1 -- 172.21.15.76:0/2202672742 learned_addr learned my addr 172.21.15.76:0/2202672742 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:48:49.827 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.824+0000 7f150259c700 1 --2- 172.21.15.76:0/2202672742 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1504068e90 0x7f15041a35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:49.827 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.824+0000 7f1501d9b700 1 --2- 172.21.15.76:0/2202672742 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f15041039d0 0x7f15041a3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:49.827 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.824+0000 7f1502d9d700 1 -- 172.21.15.76:0/2202672742 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1504068e90 msgr2=0x7f15041a35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:49.827 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.824+0000 7f1502d9d700 1 --2- 172.21.15.76:0/2202672742 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1504068e90 0x7f15041a35c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:49.827 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.824+0000 7f1502d9d700 1 -- 172.21.15.76:0/2202672742 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f15041039d0 msgr2=0x7f15041a3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:49.827 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.824+0000 7f1502d9d700 1 --2- 172.21.15.76:0/2202672742 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f15041039d0 0x7f15041a3b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:49.827 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.824+0000 7f1502d9d700 1 -- 172.21.15.76:0/2202672742 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14f40095f0 con 0x7f1504105ec0 2024-06-02T04:48:49.827 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.824+0000 7f1501d9b700 1 --2- 172.21.15.76:0/2202672742 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f15041039d0 0x7f15041a3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:48:49.827 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.824+0000 7f1502d9d700 1 --2- 172.21.15.76:0/2202672742 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1504105ec0 0x7f150419d700 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f14fc007d70 tx=0x7f14fc00a340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:49.827 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.824+0000 7f14f37fe700 1 -- 172.21.15.76:0/2202672742 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14fc00ad40 con 0x7f1504105ec0 2024-06-02T04:48:49.827 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.824+0000 7f14f37fe700 1 -- 172.21.15.76:0/2202672742 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f14fc0128b0 con 0x7f1504105ec0 2024-06-02T04:48:49.827 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.824+0000 7f14f37fe700 1 -- 172.21.15.76:0/2202672742 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14fc0115a0 con 0x7f1504105ec0 2024-06-02T04:48:49.828 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.825+0000 7f15089b9700 1 -- 172.21.15.76:0/2202672742 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f150419e370 con 0x7f1504105ec0 2024-06-02T04:48:49.828 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.825+0000 7f15089b9700 1 -- 172.21.15.76:0/2202672742 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15041aa5b0 con 0x7f1504105ec0 2024-06-02T04:48:49.828 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.826+0000 7f15089b9700 1 -- 172.21.15.76:0/2202672742 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1504117620 con 0x7f1504105ec0 2024-06-02T04:48:49.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.828+0000 7f14f37fe700 1 -- 172.21.15.76:0/2202672742 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f14fc012a20 con 0x7f1504105ec0 2024-06-02T04:48:49.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.828+0000 7f14f37fe700 1 --2- 172.21.15.76:0/2202672742 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f14ec0a11b0 0x7f14ec0a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:49.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.828+0000 7f14f37fe700 1 -- 172.21.15.76:0/2202672742 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f14fc0cd400 con 0x7f1504105ec0 2024-06-02T04:48:49.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.828+0000 7f14f37fe700 1 --2- 172.21.15.76:0/2202672742 >> [v2:172.21.15.192:6808/3285065416,v1:172.21.15.192:6809/3285065416] conn(0x7f14ec0abd30 0x7f14ec0ae170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:49.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.828+0000 7f14f37fe700 1 -- 172.21.15.76:0/2202672742 --> [v2:172.21.15.192:6808/3285065416,v1:172.21.15.192:6809/3285065416] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f14ec0ae840 con 0x7f14ec0abd30 2024-06-02T04:48:49.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.828+0000 7f14f37fe700 1 -- 172.21.15.76:0/2202672742 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) v2 ==== 24+0+0 (secure 0 0 0) 0x7f14fc0cd7b0 con 0x7f1504105ec0 2024-06-02T04:48:49.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.829+0000 7f1501d9b700 1 --2- 172.21.15.76:0/2202672742 >> [v2:172.21.15.192:6808/3285065416,v1:172.21.15.192:6809/3285065416] conn(0x7f14ec0abd30 0x7f14ec0ae170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:49.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.829+0000 7f150259c700 1 --2- 172.21.15.76:0/2202672742 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f14ec0a11b0 0x7f14ec0a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:49.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.829+0000 7f1501d9b700 1 --2- 172.21.15.76:0/2202672742 >> [v2:172.21.15.192:6808/3285065416,v1:172.21.15.192:6809/3285065416] conn(0x7f14ec0abd30 0x7f14ec0ae170 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:49.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.830+0000 7f150259c700 1 --2- 172.21.15.76:0/2202672742 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f14ec0a11b0 0x7f14ec0a3670 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f14f400b5c0 tx=0x7f14f4005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:49.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.830+0000 7f14f37fe700 1 -- 172.21.15.76:0/2202672742 <== osd.5 v2:172.21.15.192:6808/3285065416 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f14ec0ae840 con 0x7f14ec0abd30 2024-06-02T04:48:49.847 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.846+0000 7f15089b9700 1 -- 172.21.15.76:0/2202672742 --> [v2:172.21.15.192:6808/3285065416,v1:172.21.15.192:6809/3285065416] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f15041004b0 con 0x7f14ec0abd30 2024-06-02T04:48:49.848 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.847+0000 7f14f37fe700 1 -- 172.21.15.76:0/2202672742 <== osd.5 v2:172.21.15.192:6808/3285065416 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f15041004b0 con 0x7f14ec0abd30 2024-06-02T04:48:49.849 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.847+0000 7f15089b9700 1 -- 172.21.15.76:0/2202672742 >> [v2:172.21.15.192:6808/3285065416,v1:172.21.15.192:6809/3285065416] conn(0x7f14ec0abd30 msgr2=0x7f14ec0ae170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:49.849 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.847+0000 7f15089b9700 1 --2- 172.21.15.76:0/2202672742 >> [v2:172.21.15.192:6808/3285065416,v1:172.21.15.192:6809/3285065416] conn(0x7f14ec0abd30 0x7f14ec0ae170 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:49.849 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.847+0000 7f15089b9700 1 -- 172.21.15.76:0/2202672742 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f14ec0a11b0 msgr2=0x7f14ec0a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:49.849 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.847+0000 7f15089b9700 1 --2- 172.21.15.76:0/2202672742 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f14ec0a11b0 0x7f14ec0a3670 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f14f400b5c0 tx=0x7f14f4005fb0 comp rx=0 tx=0).stop 2024-06-02T04:48:49.849 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.848+0000 7f15089b9700 1 -- 172.21.15.76:0/2202672742 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1504105ec0 msgr2=0x7f150419d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:49.849 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.848+0000 7f15089b9700 1 --2- 172.21.15.76:0/2202672742 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1504105ec0 0x7f150419d700 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f14fc007d70 tx=0x7f14fc00a340 comp rx=0 tx=0).stop 2024-06-02T04:48:49.849 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.848+0000 7f1502d9d700 1 -- 172.21.15.76:0/2202672742 reap_dead start 2024-06-02T04:48:49.849 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.848+0000 7f15089b9700 1 -- 172.21.15.76:0/2202672742 shutdown_connections 2024-06-02T04:48:49.849 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.848+0000 7f15089b9700 1 -- 172.21.15.76:0/2202672742 >> 172.21.15.76:0/2202672742 conn(0x7f1504075f80 msgr2=0x7f15040feec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:49.850 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.848+0000 7f15089b9700 1 -- 172.21.15.76:0/2202672742 shutdown_connections 2024-06-02T04:48:49.850 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.848+0000 7f15089b9700 1 -- 172.21.15.76:0/2202672742 wait complete. 2024-06-02T04:48:49.960 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.958+0000 7fda6b9cd700 1 -- 172.21.15.76:0/1550208887 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fda640ffba0 msgr2=0x7fda640fff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:49.960 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.958+0000 7fda6b9cd700 1 --2- 172.21.15.76:0/1550208887 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fda640ffba0 0x7fda640fff80 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fda600099c0 tx=0x7fda60009cd0 comp rx=0 tx=0).stop 2024-06-02T04:48:49.960 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.958+0000 7fda6b9cd700 1 -- 172.21.15.76:0/1550208887 shutdown_connections 2024-06-02T04:48:49.960 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.958+0000 7fda6b9cd700 1 --2- 172.21.15.76:0/1550208887 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fda641063c0 0x7fda6410dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:49.960 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.958+0000 7fda6b9cd700 1 --2- 172.21.15.76:0/1550208887 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fda640ffba0 0x7fda640fff80 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:49.960 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.958+0000 7fda6b9cd700 1 --2- 172.21.15.76:0/1550208887 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fda64100550 0x7fda64105c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:49.960 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.958+0000 7fda6b9cd700 1 -- 172.21.15.76:0/1550208887 >> 172.21.15.76:0/1550208887 conn(0x7fda64075260 msgr2=0x7fda64075670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:49.960 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.958+0000 7fda6b9cd700 1 -- 172.21.15.76:0/1550208887 shutdown_connections 2024-06-02T04:48:49.960 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.958+0000 7fda6b9cd700 1 -- 172.21.15.76:0/1550208887 wait complete. 2024-06-02T04:48:49.962 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.959+0000 7fda6b9cd700 1 Processor -- start 2024-06-02T04:48:49.962 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.959+0000 7fda6b9cd700 1 -- start start 2024-06-02T04:48:49.962 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.959+0000 7fda6b9cd700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fda640ffba0 0x7fda64197280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:49.962 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.959+0000 7fda6b9cd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fda64100550 0x7fda641977c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:49.962 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.959+0000 7fda6b9cd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fda641063c0 0x7fda6419bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:49.963 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.959+0000 7fda6b9cd700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda6419c180 con 0x7fda641063c0 2024-06-02T04:48:49.963 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.959+0000 7fda6b9cd700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda6419c2f0 con 0x7fda640ffba0 2024-06-02T04:48:49.963 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.959+0000 7fda6b9cd700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda6419c4b0 con 0x7fda64100550 2024-06-02T04:48:49.963 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.960+0000 7fda69f6a700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fda641063c0 0x7fda6419bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:49.963 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.960+0000 7fda69f6a700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fda641063c0 0x7fda6419bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:57624/0 (socket says 172.21.15.76:57624) 2024-06-02T04:48:49.963 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.960+0000 7fda69f6a700 1 -- 172.21.15.76:0/2046045861 learned_addr learned my addr 172.21.15.76:0/2046045861 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:48:49.963 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.960+0000 7fda69769700 1 --2- 172.21.15.76:0/2046045861 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fda640ffba0 0x7fda64197280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:49.963 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.960+0000 7fda68f68700 1 --2- 172.21.15.76:0/2046045861 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fda64100550 0x7fda641977c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:49.963 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.960+0000 7fda69f6a700 1 -- 172.21.15.76:0/2046045861 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fda64100550 msgr2=0x7fda641977c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:49.963 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.960+0000 7fda69f6a700 1 --2- 172.21.15.76:0/2046045861 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fda64100550 0x7fda641977c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:49.963 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.960+0000 7fda69f6a700 1 -- 172.21.15.76:0/2046045861 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fda640ffba0 msgr2=0x7fda64197280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:49.963 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.960+0000 7fda69f6a700 1 --2- 172.21.15.76:0/2046045861 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fda640ffba0 0x7fda64197280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:49.963 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.960+0000 7fda69f6a700 1 -- 172.21.15.76:0/2046045861 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda600095f0 con 0x7fda641063c0 2024-06-02T04:48:49.964 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.960+0000 7fda68f68700 1 --2- 172.21.15.76:0/2046045861 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fda64100550 0x7fda641977c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:48:49.964 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.960+0000 7fda69f6a700 1 --2- 172.21.15.76:0/2046045861 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fda641063c0 0x7fda6419bb70 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fda5c007ee0 tx=0x7fda5c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:49.964 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.960+0000 7fda5a7fc700 1 -- 172.21.15.76:0/2046045861 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda5c017070 con 0x7fda641063c0 2024-06-02T04:48:49.964 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.960+0000 7fda5a7fc700 1 -- 172.21.15.76:0/2046045861 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fda5c00f040 con 0x7fda641063c0 2024-06-02T04:48:49.964 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.960+0000 7fda6b9cd700 1 -- 172.21.15.76:0/2046045861 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda6419c790 con 0x7fda641063c0 2024-06-02T04:48:49.964 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.960+0000 7fda5a7fc700 1 -- 172.21.15.76:0/2046045861 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda5c005710 con 0x7fda641063c0 2024-06-02T04:48:49.964 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.960+0000 7fda6b9cd700 1 -- 172.21.15.76:0/2046045861 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda641a3ff0 con 0x7fda641063c0 2024-06-02T04:48:49.964 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.961+0000 7fda6b9cd700 1 -- 172.21.15.76:0/2046045861 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fda640683c0 con 0x7fda641063c0 2024-06-02T04:48:49.965 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.962+0000 7fda5a7fc700 1 -- 172.21.15.76:0/2046045861 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fda5c005870 con 0x7fda641063c0 2024-06-02T04:48:49.965 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.963+0000 7fda5a7fc700 1 --2- 172.21.15.76:0/2046045861 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fda500a12b0 0x7fda500a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:49.965 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.963+0000 7fda69769700 1 --2- 172.21.15.76:0/2046045861 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fda500a12b0 0x7fda500a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:49.965 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.963+0000 7fda5a7fc700 1 -- 172.21.15.76:0/2046045861 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fda5c0ccae0 con 0x7fda641063c0 2024-06-02T04:48:49.966 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.963+0000 7fda5a7fc700 1 --2- 172.21.15.76:0/2046045861 >> [v2:172.21.15.76:6818/2951381580,v1:172.21.15.76:6819/2951381580] conn(0x7fda500abe30 0x7fda500ae270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:49.966 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.963+0000 7fda5a7fc700 1 -- 172.21.15.76:0/2046045861 --> [v2:172.21.15.76:6818/2951381580,v1:172.21.15.76:6819/2951381580] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fda500ae940 con 0x7fda500abe30 2024-06-02T04:48:49.966 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.963+0000 7fda5a7fc700 1 -- 172.21.15.76:0/2046045861 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) v2 ==== 24+0+0 (secure 0 0 0) 0x7fda5c0cce90 con 0x7fda641063c0 2024-06-02T04:48:49.966 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.963+0000 7fda68f68700 1 --2- 172.21.15.76:0/2046045861 >> [v2:172.21.15.76:6818/2951381580,v1:172.21.15.76:6819/2951381580] conn(0x7fda500abe30 0x7fda500ae270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:49.966 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.963+0000 7fda69769700 1 --2- 172.21.15.76:0/2046045861 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fda500a12b0 0x7fda500a3770 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fda60009f50 tx=0x7fda60005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:49.966 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.964+0000 7fda68f68700 1 --2- 172.21.15.76:0/2046045861 >> [v2:172.21.15.76:6818/2951381580,v1:172.21.15.76:6819/2951381580] conn(0x7fda500abe30 0x7fda500ae270 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:49.966 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.964+0000 7fda5a7fc700 1 -- 172.21.15.76:0/2046045861 <== osd.6 v2:172.21.15.76:6818/2951381580 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fda500ae940 con 0x7fda500abe30 2024-06-02T04:48:49.981 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.980+0000 7fda6b9cd700 1 -- 172.21.15.76:0/2046045861 --> [v2:172.21.15.76:6818/2951381580,v1:172.21.15.76:6819/2951381580] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fda64111050 con 0x7fda500abe30 2024-06-02T04:48:49.982 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.981+0000 7fda5a7fc700 1 -- 172.21.15.76:0/2046045861 <== osd.6 v2:172.21.15.76:6818/2951381580 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fda64111050 con 0x7fda500abe30 2024-06-02T04:48:49.983 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.981+0000 7fda6b9cd700 1 -- 172.21.15.76:0/2046045861 >> [v2:172.21.15.76:6818/2951381580,v1:172.21.15.76:6819/2951381580] conn(0x7fda500abe30 msgr2=0x7fda500ae270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:49.983 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.981+0000 7fda6b9cd700 1 --2- 172.21.15.76:0/2046045861 >> [v2:172.21.15.76:6818/2951381580,v1:172.21.15.76:6819/2951381580] conn(0x7fda500abe30 0x7fda500ae270 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:49.983 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.981+0000 7fda6b9cd700 1 -- 172.21.15.76:0/2046045861 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fda500a12b0 msgr2=0x7fda500a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:49.983 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.981+0000 7fda6b9cd700 1 --2- 172.21.15.76:0/2046045861 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fda500a12b0 0x7fda500a3770 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fda60009f50 tx=0x7fda60005fb0 comp rx=0 tx=0).stop 2024-06-02T04:48:49.983 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.981+0000 7fda6b9cd700 1 -- 172.21.15.76:0/2046045861 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fda641063c0 msgr2=0x7fda6419bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:49.983 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.981+0000 7fda6b9cd700 1 --2- 172.21.15.76:0/2046045861 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fda641063c0 0x7fda6419bb70 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fda5c007ee0 tx=0x7fda5c00d3b0 comp rx=0 tx=0).stop 2024-06-02T04:48:49.983 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.981+0000 7fda69f6a700 1 -- 172.21.15.76:0/2046045861 reap_dead start 2024-06-02T04:48:49.983 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.981+0000 7fda6b9cd700 1 -- 172.21.15.76:0/2046045861 shutdown_connections 2024-06-02T04:48:49.983 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.981+0000 7fda6b9cd700 1 -- 172.21.15.76:0/2046045861 >> 172.21.15.76:0/2046045861 conn(0x7fda64075260 msgr2=0x7fda64105500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:49.983 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.981+0000 7fda6b9cd700 1 -- 172.21.15.76:0/2046045861 shutdown_connections 2024-06-02T04:48:49.983 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:49.981+0000 7fda6b9cd700 1 -- 172.21.15.76:0/2046045861 wait complete. 2024-06-02T04:48:50.313 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:50.312+0000 7f832d15c700 1 -- 172.21.15.76:0/426834532 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f83281062d0 msgr2=0x7f832810dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:50.313 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:50.312+0000 7f832d15c700 1 --2- 172.21.15.76:0/426834532 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f83281062d0 0x7f832810dea0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f8320009990 tx=0x7f8320009ca0 comp rx=0 tx=0).stop 2024-06-02T04:48:50.313 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:50.312+0000 7f832d15c700 1 -- 172.21.15.76:0/426834532 shutdown_connections 2024-06-02T04:48:50.314 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:50.312+0000 7f832d15c700 1 --2- 172.21.15.76:0/426834532 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f83281062d0 0x7f832810dea0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:50.314 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:50.312+0000 7f832d15c700 1 --2- 172.21.15.76:0/426834532 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f83280698c0 0x7f8328069ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:50.314 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:50.312+0000 7f832d15c700 1 --2- 172.21.15.76:0/426834532 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f832806a270 0x7f8328105bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:50.314 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:50.312+0000 7f832d15c700 1 -- 172.21.15.76:0/426834532 >> 172.21.15.76:0/426834532 conn(0x7f8328076c40 msgr2=0x7f8328077050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:50.314 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:50.312+0000 7f832d15c700 1 -- 172.21.15.76:0/426834532 shutdown_connections 2024-06-02T04:48:50.314 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:50.312+0000 7f832d15c700 1 -- 172.21.15.76:0/426834532 wait complete. 2024-06-02T04:48:50.315 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:50.313+0000 7f832d15c700 1 Processor -- start 2024-06-02T04:48:50.315 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:50.313+0000 7f832d15c700 1 -- start start 2024-06-02T04:48:50.315 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:50.313+0000 7f832d15c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f83280698c0 0x7f8328100290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:50.316 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:50.313+0000 7f832d15c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f832806a270 0x7f83281007d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:50.316 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:50.313+0000 7f832d15c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f83281062d0 0x7f8328100d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:50.316 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:50.313+0000 7f832d15c700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83281a55f0 con 0x7f832806a270 2024-06-02T04:48:50.316 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:50.313+0000 7f832d15c700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83281a5760 con 0x7f83281062d0 2024-06-02T04:48:50.316 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:50.313+0000 7f832d15c700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83281a5920 con 0x7f83280698c0 2024-06-02T04:48:50.316 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:50.313+0000 7f831ffff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f832806a270 0x7f83281007d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:50.316 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:50.313+0000 7f831ffff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f832806a270 0x7f83281007d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:57644/0 (socket says 172.21.15.76:57644) 2024-06-02T04:48:50.316 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:50.313+0000 7f831ffff700 1 -- 172.21.15.76:0/639519796 learned_addr learned my addr 172.21.15.76:0/639519796 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:48:50.316 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:50.313+0000 7f8326d9d700 1 --2- 172.21.15.76:0/639519796 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f83280698c0 0x7f8328100290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:50.316 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:50.313+0000 7f831ffff700 1 -- 172.21.15.76:0/639519796 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f83280698c0 msgr2=0x7f8328100290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:50.316 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:50.313+0000 7f831ffff700 1 --2- 172.21.15.76:0/639519796 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f83280698c0 0x7f8328100290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:50.316 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:50.313+0000 7f831ffff700 1 -- 172.21.15.76:0/639519796 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f83281062d0 msgr2=0x7f8328100d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:50.316 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:50.313+0000 7f831ffff700 1 --2- 172.21.15.76:0/639519796 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f83281062d0 0x7f8328100d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:50.316 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:50.313+0000 7f831ffff700 1 -- 172.21.15.76:0/639519796 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83200095f0 con 0x7f832806a270 2024-06-02T04:48:50.317 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:50.314+0000 7f831ffff700 1 --2- 172.21.15.76:0/639519796 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f832806a270 0x7f83281007d0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f831000e970 tx=0x7f831000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:50.317 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:50.314+0000 7f8324d99700 1 -- 172.21.15.76:0/639519796 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8310009790 con 0x7f832806a270 2024-06-02T04:48:50.317 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:50.314+0000 7f832d15c700 1 -- 172.21.15.76:0/639519796 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83281a5c00 con 0x7f832806a270 2024-06-02T04:48:50.317 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:50.314+0000 7f8324d99700 1 -- 172.21.15.76:0/639519796 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f831000eec0 con 0x7f832806a270 2024-06-02T04:48:50.317 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:50.314+0000 7f8324d99700 1 -- 172.21.15.76:0/639519796 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83100054b0 con 0x7f832806a270 2024-06-02T04:48:50.317 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:50.314+0000 7f832d15c700 1 -- 172.21.15.76:0/639519796 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83281a6100 con 0x7f832806a270 2024-06-02T04:48:50.318 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:50.315+0000 7f832d15c700 1 -- 172.21.15.76:0/639519796 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8328111080 con 0x7f832806a270 2024-06-02T04:48:50.318 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:50.316+0000 7f8324d99700 1 -- 172.21.15.76:0/639519796 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f8310005610 con 0x7f832806a270 2024-06-02T04:48:50.318 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:50.316+0000 7f8324d99700 1 --2- 172.21.15.76:0/639519796 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f83140a11b0 0x7f83140a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:50.318 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:50.317+0000 7f8326d9d700 1 --2- 172.21.15.76:0/639519796 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f83140a11b0 0x7f83140a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:50.318 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:50.317+0000 7f8324d99700 1 -- 172.21.15.76:0/639519796 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f8310014070 con 0x7f832806a270 2024-06-02T04:48:50.319 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:50.317+0000 7f8324d99700 1 --2- 172.21.15.76:0/639519796 >> [v2:172.21.15.192:6824/439693921,v1:172.21.15.192:6825/439693921] conn(0x7f83140abd30 0x7f83140ae170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:50.319 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:50.317+0000 7f8324d99700 1 -- 172.21.15.76:0/639519796 --> [v2:172.21.15.192:6824/439693921,v1:172.21.15.192:6825/439693921] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f83140ae840 con 0x7f83140abd30 2024-06-02T04:48:50.319 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:50.317+0000 7f8324d99700 1 -- 172.21.15.76:0/639519796 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) v2 ==== 24+0+0 (secure 0 0 0) 0x7f83100cd440 con 0x7f832806a270 2024-06-02T04:48:50.319 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:50.317+0000 7f8326d9d700 1 --2- 172.21.15.76:0/639519796 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f83140a11b0 0x7f83140a3670 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f8318009550 tx=0x7f83180091b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:50.319 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:50.317+0000 7f832759e700 1 --2- 172.21.15.76:0/639519796 >> [v2:172.21.15.192:6824/439693921,v1:172.21.15.192:6825/439693921] conn(0x7f83140abd30 0x7f83140ae170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:50.319 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:50.317+0000 7f832759e700 1 --2- 172.21.15.76:0/639519796 >> [v2:172.21.15.192:6824/439693921,v1:172.21.15.192:6825/439693921] conn(0x7f83140abd30 0x7f83140ae170 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:50.319 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:50.318+0000 7f8324d99700 1 -- 172.21.15.76:0/639519796 <== osd.11 v2:172.21.15.192:6824/439693921 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f83140ae840 con 0x7f83140abd30 2024-06-02T04:48:50.335 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:50.334+0000 7f832d15c700 1 -- 172.21.15.76:0/639519796 --> [v2:172.21.15.192:6824/439693921,v1:172.21.15.192:6825/439693921] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f83280616a0 con 0x7f83140abd30 2024-06-02T04:48:50.336 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:50.334+0000 7f8324d99700 1 -- 172.21.15.76:0/639519796 <== osd.11 v2:172.21.15.192:6824/439693921 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f83280616a0 con 0x7f83140abd30 2024-06-02T04:48:50.337 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:50.335+0000 7f832d15c700 1 -- 172.21.15.76:0/639519796 >> [v2:172.21.15.192:6824/439693921,v1:172.21.15.192:6825/439693921] conn(0x7f83140abd30 msgr2=0x7f83140ae170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:50.337 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:50.335+0000 7f832d15c700 1 --2- 172.21.15.76:0/639519796 >> [v2:172.21.15.192:6824/439693921,v1:172.21.15.192:6825/439693921] conn(0x7f83140abd30 0x7f83140ae170 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:50.337 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:50.335+0000 7f832d15c700 1 -- 172.21.15.76:0/639519796 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f83140a11b0 msgr2=0x7f83140a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:50.337 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:50.335+0000 7f832d15c700 1 --2- 172.21.15.76:0/639519796 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f83140a11b0 0x7f83140a3670 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f8318009550 tx=0x7f83180091b0 comp rx=0 tx=0).stop 2024-06-02T04:48:50.337 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:50.335+0000 7f832d15c700 1 -- 172.21.15.76:0/639519796 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f832806a270 msgr2=0x7f83281007d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:50.337 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:50.335+0000 7f832d15c700 1 --2- 172.21.15.76:0/639519796 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f832806a270 0x7f83281007d0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f831000e970 tx=0x7f831000ec80 comp rx=0 tx=0).stop 2024-06-02T04:48:50.337 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:50.335+0000 7f832759e700 1 -- 172.21.15.76:0/639519796 reap_dead start 2024-06-02T04:48:50.337 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:50.335+0000 7f832d15c700 1 -- 172.21.15.76:0/639519796 shutdown_connections 2024-06-02T04:48:50.337 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:50.335+0000 7f832d15c700 1 -- 172.21.15.76:0/639519796 >> 172.21.15.76:0/639519796 conn(0x7f8328076c40 msgr2=0x7f83281074a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:50.337 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:50.335+0000 7f832d15c700 1 -- 172.21.15.76:0/639519796 shutdown_connections 2024-06-02T04:48:50.337 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:50.335+0000 7f832d15c700 1 -- 172.21.15.76:0/639519796 wait complete. 2024-06-02T04:48:50.413 INFO:teuthology.orchestra.run.smithi076.stdout:274877906967 2024-06-02T04:48:50.413 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell --fsid 60ab6d30-209a-11ef-bc9b-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-06-02T04:48:50.774 INFO:teuthology.orchestra.run.smithi076.stdout:171798691876 2024-06-02T04:48:50.775 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell --fsid 60ab6d30-209a-11ef-bc9b-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-06-02T04:48:51.079 INFO:teuthology.orchestra.run.smithi076.stdout:141733920808 2024-06-02T04:48:51.080 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell --fsid 60ab6d30-209a-11ef-bc9b-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-06-02T04:48:51.235 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T04:48:51.264 INFO:teuthology.orchestra.run.smithi076.stdout:68719476786 2024-06-02T04:48:51.264 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell --fsid 60ab6d30-209a-11ef-bc9b-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-06-02T04:48:51.372 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:51 smithi076 ceph-mon[42935]: pgmap v242: 129 pgs: 129 active+clean; 639 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.6 KiB/s wr, 8 op/s 2024-06-02T04:48:51.575 INFO:teuthology.orchestra.run.smithi076.stdout:304942678034 2024-06-02T04:48:51.576 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell --fsid 60ab6d30-209a-11ef-bc9b-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-06-02T04:48:51.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:51 smithi119 ceph-mon[46633]: pgmap v242: 129 pgs: 129 active+clean; 639 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.6 KiB/s wr, 8 op/s 2024-06-02T04:48:51.647 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T04:48:51.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:51 smithi192 ceph-mon[47933]: pgmap v242: 129 pgs: 129 active+clean; 639 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.6 KiB/s wr, 8 op/s 2024-06-02T04:48:51.739 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T04:48:51.849 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T04:48:53.199 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T04:48:53.320 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T04:48:53.375 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:53 smithi076 ceph-mon[42935]: pgmap v243: 129 pgs: 129 active+clean; 639 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 255 B/s wr, 6 op/s 2024-06-02T04:48:53.551 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T04:48:53.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:53 smithi119 ceph-mon[46633]: pgmap v243: 129 pgs: 129 active+clean; 639 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 255 B/s wr, 6 op/s 2024-06-02T04:48:53.616 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:53.615+0000 7fa7557c3700 1 -- 172.21.15.76:0/2637035462 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa750105f40 msgr2=0x7fa750106320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:53.616 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:53.615+0000 7fa7557c3700 1 --2- 172.21.15.76:0/2637035462 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa750105f40 0x7fa750106320 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fa740009990 tx=0x7fa740009ca0 comp rx=0 tx=0).stop 2024-06-02T04:48:53.616 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:53.615+0000 7fa7557c3700 1 -- 172.21.15.76:0/2637035462 shutdown_connections 2024-06-02T04:48:53.616 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:53.615+0000 7fa7557c3700 1 --2- 172.21.15.76:0/2637035462 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa750100850 0x7fa75010ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:53.616 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:53.615+0000 7fa7557c3700 1 --2- 172.21.15.76:0/2637035462 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa750105f40 0x7fa750106320 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:53.616 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:53.615+0000 7fa7557c3700 1 --2- 172.21.15.76:0/2637035462 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa7500ffe90 0x7fa750100310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:53.616 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:53.615+0000 7fa7557c3700 1 -- 172.21.15.76:0/2637035462 >> 172.21.15.76:0/2637035462 conn(0x7fa750076e70 msgr2=0x7fa750077280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:53.616 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:53.615+0000 7fa7557c3700 1 -- 172.21.15.76:0/2637035462 shutdown_connections 2024-06-02T04:48:53.616 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:53.615+0000 7fa7557c3700 1 -- 172.21.15.76:0/2637035462 wait complete. 2024-06-02T04:48:53.617 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:53.616+0000 7fa7557c3700 1 Processor -- start 2024-06-02T04:48:53.617 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:53.616+0000 7fa7557c3700 1 -- start start 2024-06-02T04:48:53.618 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:53.616+0000 7fa7557c3700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7500ffe90 0x7fa750198070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:53.618 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:53.616+0000 7fa7557c3700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa750100850 0x7fa7501985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:53.618 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:53.616+0000 7fa7557c3700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa750105f40 0x7fa7501a30f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:53.618 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:53.616+0000 7fa7557c3700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa750198e70 con 0x7fa750100850 2024-06-02T04:48:53.619 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:53.616+0000 7fa7557c3700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7501a3630 con 0x7fa7500ffe90 2024-06-02T04:48:53.619 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:53.616+0000 7fa7557c3700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7501a3770 con 0x7fa750105f40 2024-06-02T04:48:53.619 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:53.616+0000 7fa74e7fc700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa750100850 0x7fa7501985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:53.619 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:53.616+0000 7fa74e7fc700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa750100850 0x7fa7501985b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:33870/0 (socket says 172.21.15.76:33870) 2024-06-02T04:48:53.619 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:53.616+0000 7fa74e7fc700 1 -- 172.21.15.76:0/2895205420 learned_addr learned my addr 172.21.15.76:0/2895205420 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:48:53.619 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:53.616+0000 7fa74effd700 1 --2- 172.21.15.76:0/2895205420 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7500ffe90 0x7fa750198070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:53.619 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:53.616+0000 7fa74f7fe700 1 --2- 172.21.15.76:0/2895205420 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa750105f40 0x7fa7501a30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:53.619 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:53.616+0000 7fa74e7fc700 1 -- 172.21.15.76:0/2895205420 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa750105f40 msgr2=0x7fa7501a30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:53.619 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:53.616+0000 7fa74e7fc700 1 --2- 172.21.15.76:0/2895205420 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa750105f40 0x7fa7501a30f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:53.619 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:53.616+0000 7fa74e7fc700 1 -- 172.21.15.76:0/2895205420 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7500ffe90 msgr2=0x7fa750198070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:53.619 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:53.616+0000 7fa74e7fc700 1 --2- 172.21.15.76:0/2895205420 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7500ffe90 0x7fa750198070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:53.619 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:53.616+0000 7fa74e7fc700 1 -- 172.21.15.76:0/2895205420 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7400095f0 con 0x7fa750100850 2024-06-02T04:48:53.620 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:53.616+0000 7fa74effd700 1 --2- 172.21.15.76:0/2895205420 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7500ffe90 0x7fa750198070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:48:53.620 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:53.617+0000 7fa74e7fc700 1 --2- 172.21.15.76:0/2895205420 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa750100850 0x7fa7501985b0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fa74400c9b0 tx=0x7fa74400cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:53.620 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:53.617+0000 7fa737fff700 1 -- 172.21.15.76:0/2895205420 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa744007b00 con 0x7fa750100850 2024-06-02T04:48:53.620 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:53.617+0000 7fa7557c3700 1 -- 172.21.15.76:0/2895205420 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7501a39f0 con 0x7fa750100850 2024-06-02T04:48:53.620 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:53.617+0000 7fa737fff700 1 -- 172.21.15.76:0/2895205420 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa744007c60 con 0x7fa750100850 2024-06-02T04:48:53.620 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:53.617+0000 7fa737fff700 1 -- 172.21.15.76:0/2895205420 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa744018660 con 0x7fa750100850 2024-06-02T04:48:53.620 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:53.617+0000 7fa7557c3700 1 -- 172.21.15.76:0/2895205420 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7501a3ef0 con 0x7fa750100850 2024-06-02T04:48:53.620 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:53.618+0000 7fa7557c3700 1 -- 172.21.15.76:0/2895205420 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7501083d0 con 0x7fa750100850 2024-06-02T04:48:53.621 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:53.619+0000 7fa737fff700 1 -- 172.21.15.76:0/2895205420 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fa74400f450 con 0x7fa750100850 2024-06-02T04:48:53.621 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:53.620+0000 7fa737fff700 1 --2- 172.21.15.76:0/2895205420 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fa7380a11b0 0x7fa7380a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:53.621 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:53.620+0000 7fa74effd700 1 --2- 172.21.15.76:0/2895205420 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fa7380a11b0 0x7fa7380a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:53.621 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:53.620+0000 7fa737fff700 1 -- 172.21.15.76:0/2895205420 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fa7440cccc0 con 0x7fa750100850 2024-06-02T04:48:53.621 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:53.620+0000 7fa74effd700 1 --2- 172.21.15.76:0/2895205420 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fa7380a11b0 0x7fa7380a3670 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa740005f50 tx=0x7fa740005e80 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:53.626 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:53.626+0000 7fa737fff700 1 -- 172.21.15.76:0/2895205420 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fa744096100 con 0x7fa750100850 2024-06-02T04:48:53.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:53 smithi192 ceph-mon[47933]: pgmap v243: 129 pgs: 129 active+clean; 639 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 255 B/s wr, 6 op/s 2024-06-02T04:48:53.844 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:53.843+0000 7fa7557c3700 1 -- 172.21.15.76:0/2895205420 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) v1 -- 0x7fa750101580 con 0x7fa750100850 2024-06-02T04:48:53.844 INFO:teuthology.orchestra.run.smithi076.stdout:257698037787 2024-06-02T04:48:53.845 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:53.844+0000 7fa737fff700 1 -- 172.21.15.76:0/2895205420 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa744099720 con 0x7fa750100850 2024-06-02T04:48:53.847 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:53.846+0000 7fa7557c3700 1 -- 172.21.15.76:0/2895205420 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fa7380a11b0 msgr2=0x7fa7380a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:53.848 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:53.846+0000 7fa7557c3700 1 --2- 172.21.15.76:0/2895205420 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fa7380a11b0 0x7fa7380a3670 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa740005f50 tx=0x7fa740005e80 comp rx=0 tx=0).stop 2024-06-02T04:48:53.848 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:53.846+0000 7fa7557c3700 1 -- 172.21.15.76:0/2895205420 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa750100850 msgr2=0x7fa7501985b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:53.848 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:53.846+0000 7fa7557c3700 1 --2- 172.21.15.76:0/2895205420 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa750100850 0x7fa7501985b0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fa74400c9b0 tx=0x7fa74400cd70 comp rx=0 tx=0).stop 2024-06-02T04:48:53.848 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:53.846+0000 7fa7557c3700 1 -- 172.21.15.76:0/2895205420 shutdown_connections 2024-06-02T04:48:53.848 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:53.846+0000 7fa7557c3700 1 --2- 172.21.15.76:0/2895205420 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa750105f40 0x7fa7501a30f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:53.848 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:53.846+0000 7fa7557c3700 1 --2- 172.21.15.76:0/2895205420 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fa7380a11b0 0x7fa7380a3670 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:53.848 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:53.846+0000 7fa7557c3700 1 --2- 172.21.15.76:0/2895205420 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7500ffe90 0x7fa750198070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:53.848 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:53.846+0000 7fa7557c3700 1 --2- 172.21.15.76:0/2895205420 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa750100850 0x7fa7501985b0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:53.848 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:53.846+0000 7fa7557c3700 1 -- 172.21.15.76:0/2895205420 >> 172.21.15.76:0/2895205420 conn(0x7fa750076e70 msgr2=0x7fa7500febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:53.848 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:53.848+0000 7fa7557c3700 1 -- 172.21.15.76:0/2895205420 shutdown_connections 2024-06-02T04:48:53.849 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:53.848+0000 7fa7557c3700 1 -- 172.21.15.76:0/2895205420 wait complete. 2024-06-02T04:48:54.387 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:54.385+0000 7f674b4c4700 1 -- 172.21.15.76:0/713459200 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6744069720 msgr2=0x7f6744069ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:54.387 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:54.385+0000 7f674b4c4700 1 --2- 172.21.15.76:0/713459200 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6744069720 0x7f6744069ba0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f6738009990 tx=0x7f6738009ca0 comp rx=0 tx=0).stop 2024-06-02T04:48:54.387 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:54.385+0000 7f674b4c4700 1 -- 172.21.15.76:0/713459200 shutdown_connections 2024-06-02T04:48:54.388 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:54.385+0000 7f674b4c4700 1 --2- 172.21.15.76:0/713459200 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6744103990 0x7f6744103e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:54.388 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:54.385+0000 7f674b4c4700 1 --2- 172.21.15.76:0/713459200 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6744105fa0 0x7f67440691e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:54.388 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:54.385+0000 7f674b4c4700 1 --2- 172.21.15.76:0/713459200 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6744069720 0x7f6744069ba0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:54.388 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:54.385+0000 7f674b4c4700 1 -- 172.21.15.76:0/713459200 >> 172.21.15.76:0/713459200 conn(0x7f6744076e70 msgr2=0x7f6744077280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:54.388 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:54.385+0000 7f674b4c4700 1 -- 172.21.15.76:0/713459200 shutdown_connections 2024-06-02T04:48:54.388 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:54.385+0000 7f674b4c4700 1 -- 172.21.15.76:0/713459200 wait complete. 2024-06-02T04:48:54.388 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:54.386+0000 7f674b4c4700 1 Processor -- start 2024-06-02T04:48:54.388 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:54.386+0000 7f674b4c4700 1 -- start start 2024-06-02T04:48:54.388 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:54.386+0000 7f674b4c4700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6744069720 0x7f67441a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:54.388 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:54.386+0000 7f674b4c4700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6744103990 0x7f67441a3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:54.388 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:54.386+0000 7f674b4c4700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6744105fa0 0x7f674419d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:54.388 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:54.386+0000 7f674b4c4700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f674419dcf0 con 0x7f6744069720 2024-06-02T04:48:54.388 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:54.386+0000 7f674b4c4700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f674419de60 con 0x7f6744103990 2024-06-02T04:48:54.389 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:54.386+0000 7f674b4c4700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f674419e020 con 0x7f6744105fa0 2024-06-02T04:48:54.389 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:54.386+0000 7f6749260700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6744069720 0x7f67441a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:54.389 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:54.387+0000 7f6749260700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6744069720 0x7f67441a3550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:33896/0 (socket says 172.21.15.76:33896) 2024-06-02T04:48:54.389 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:54.387+0000 7f6749260700 1 -- 172.21.15.76:0/381822610 learned_addr learned my addr 172.21.15.76:0/381822610 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:48:54.389 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:54.387+0000 7f6748a5f700 1 --2- 172.21.15.76:0/381822610 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6744103990 0x7f67441a3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:54.389 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:54.387+0000 7f6749a61700 1 --2- 172.21.15.76:0/381822610 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6744105fa0 0x7f674419d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:54.389 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:54.387+0000 7f6749260700 1 -- 172.21.15.76:0/381822610 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6744105fa0 msgr2=0x7f674419d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:54.389 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:54.387+0000 7f6749260700 1 --2- 172.21.15.76:0/381822610 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6744105fa0 0x7f674419d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:54.389 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:54.387+0000 7f6749260700 1 -- 172.21.15.76:0/381822610 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6744103990 msgr2=0x7f67441a3a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:54.389 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:54.387+0000 7f6749260700 1 --2- 172.21.15.76:0/381822610 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6744103990 0x7f67441a3a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:54.389 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:54.387+0000 7f6749260700 1 -- 172.21.15.76:0/381822610 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67380095f0 con 0x7f6744069720 2024-06-02T04:48:54.389 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:54.387+0000 7f6749260700 1 --2- 172.21.15.76:0/381822610 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6744069720 0x7f67441a3550 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f673400d950 tx=0x7f673400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:54.389 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:54.387+0000 7f67427fc700 1 -- 172.21.15.76:0/381822610 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f673400f890 con 0x7f6744069720 2024-06-02T04:48:54.390 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:54.387+0000 7f674b4c4700 1 -- 172.21.15.76:0/381822610 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f674419e300 con 0x7f6744069720 2024-06-02T04:48:54.391 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:54.387+0000 7f67427fc700 1 -- 172.21.15.76:0/381822610 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f673400fe80 con 0x7f6744069720 2024-06-02T04:48:54.391 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:54.387+0000 7f67427fc700 1 -- 172.21.15.76:0/381822610 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f673400e3b0 con 0x7f6744069720 2024-06-02T04:48:54.391 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:54.387+0000 7f674b4c4700 1 -- 172.21.15.76:0/381822610 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67441aa540 con 0x7f6744069720 2024-06-02T04:48:54.391 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:54.388+0000 7f674b4c4700 1 -- 172.21.15.76:0/381822610 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67440ffd30 con 0x7f6744069720 2024-06-02T04:48:54.391 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:54.389+0000 7f67427fc700 1 -- 172.21.15.76:0/381822610 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f6734010460 con 0x7f6744069720 2024-06-02T04:48:54.391 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:54.390+0000 7f67427fc700 1 --2- 172.21.15.76:0/381822610 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f672c0a11b0 0x7f672c0a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:54.391 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:54.390+0000 7f6748a5f700 1 --2- 172.21.15.76:0/381822610 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f672c0a11b0 0x7f672c0a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:54.391 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:54.390+0000 7f67427fc700 1 -- 172.21.15.76:0/381822610 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f67340ccd80 con 0x7f6744069720 2024-06-02T04:48:54.391 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:54.390+0000 7f6748a5f700 1 --2- 172.21.15.76:0/381822610 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f672c0a11b0 0x7f672c0a3670 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f674419eda0 tx=0x7f6738005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:54.393 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:54.393+0000 7f67427fc700 1 -- 172.21.15.76:0/381822610 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f6734096160 con 0x7f6744069720 2024-06-02T04:48:54.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:54 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/2895205420' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-06-02T04:48:54.513 INFO:tasks.cephadm.ceph_manager.ceph:need seq 257698037785 got 257698037787 for osd.9 2024-06-02T04:48:54.513 DEBUG:teuthology.parallel:result is None 2024-06-02T04:48:54.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:54 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/2895205420' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-06-02T04:48:54.597 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:54.597+0000 7f674b4c4700 1 -- 172.21.15.76:0/381822610 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6744100470 con 0x7f6744069720 2024-06-02T04:48:54.597 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:54.597+0000 7f67427fc700 1 -- 172.21.15.76:0/381822610 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6734016020 con 0x7f6744069720 2024-06-02T04:48:54.597 INFO:teuthology.orchestra.run.smithi076.stdout:51539607606 2024-06-02T04:48:54.599 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:54.599+0000 7f674b4c4700 1 -- 172.21.15.76:0/381822610 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f672c0a11b0 msgr2=0x7f672c0a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:54.600 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:54.599+0000 7f674b4c4700 1 --2- 172.21.15.76:0/381822610 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f672c0a11b0 0x7f672c0a3670 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f674419eda0 tx=0x7f6738005fb0 comp rx=0 tx=0).stop 2024-06-02T04:48:54.600 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:54.599+0000 7f674b4c4700 1 -- 172.21.15.76:0/381822610 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6744069720 msgr2=0x7f67441a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:54.600 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:54.599+0000 7f674b4c4700 1 --2- 172.21.15.76:0/381822610 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6744069720 0x7f67441a3550 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f673400d950 tx=0x7f673400dc60 comp rx=0 tx=0).stop 2024-06-02T04:48:54.600 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:54.599+0000 7f674b4c4700 1 -- 172.21.15.76:0/381822610 shutdown_connections 2024-06-02T04:48:54.600 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:54.599+0000 7f674b4c4700 1 --2- 172.21.15.76:0/381822610 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6744105fa0 0x7f674419d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:54.600 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:54.599+0000 7f674b4c4700 1 --2- 172.21.15.76:0/381822610 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6744069720 0x7f67441a3550 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:54.600 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:54.599+0000 7f674b4c4700 1 --2- 172.21.15.76:0/381822610 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f672c0a11b0 0x7f672c0a3670 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:54.600 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:54.599+0000 7f674b4c4700 1 --2- 172.21.15.76:0/381822610 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6744103990 0x7f67441a3a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:54.600 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:54.599+0000 7f674b4c4700 1 -- 172.21.15.76:0/381822610 >> 172.21.15.76:0/381822610 conn(0x7f6744076e70 msgr2=0x7f67440fce70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:54.600 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:54.599+0000 7f674b4c4700 1 -- 172.21.15.76:0/381822610 shutdown_connections 2024-06-02T04:48:54.600 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:54.599+0000 7f674b4c4700 1 -- 172.21.15.76:0/381822610 wait complete. 2024-06-02T04:48:54.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:54 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/2895205420' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-06-02T04:48:55.042 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:55.041+0000 7f135c4e7700 1 -- 172.21.15.76:0/2743925566 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f13541063c0 msgr2=0x7f135410dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:55.042 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:55.041+0000 7f135c4e7700 1 --2- 172.21.15.76:0/2743925566 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f13541063c0 0x7f135410dee0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f134c00b0d0 tx=0x7f134c00b3e0 comp rx=0 tx=0).stop 2024-06-02T04:48:55.042 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:55.041+0000 7f135c4e7700 1 -- 172.21.15.76:0/2743925566 shutdown_connections 2024-06-02T04:48:55.042 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:55.041+0000 7f135c4e7700 1 --2- 172.21.15.76:0/2743925566 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f13541063c0 0x7f135410dee0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:55.042 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:55.041+0000 7f135c4e7700 1 --2- 172.21.15.76:0/2743925566 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13540ffba0 0x7f13540fff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:55.042 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:55.041+0000 7f135c4e7700 1 --2- 172.21.15.76:0/2743925566 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1354100550 0x7f1354105c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:55.042 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:55.041+0000 7f135c4e7700 1 -- 172.21.15.76:0/2743925566 >> 172.21.15.76:0/2743925566 conn(0x7f1354075260 msgr2=0x7f1354075670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:55.042 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:55.041+0000 7f135c4e7700 1 -- 172.21.15.76:0/2743925566 shutdown_connections 2024-06-02T04:48:55.042 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:55.041+0000 7f135c4e7700 1 -- 172.21.15.76:0/2743925566 wait complete. 2024-06-02T04:48:55.044 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:55.042+0000 7f135c4e7700 1 Processor -- start 2024-06-02T04:48:55.044 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:55.042+0000 7f135c4e7700 1 -- start start 2024-06-02T04:48:55.044 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:55.042+0000 7f135c4e7700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f13540ffba0 0x7f1354100b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:55.045 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:55.042+0000 7f135c4e7700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1354100550 0x7f1354101060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:55.045 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:55.042+0000 7f135c4e7700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f13541063c0 0x7f13541015a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:55.045 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:55.042+0000 7f135c4e7700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13541a5740 con 0x7f13540ffba0 2024-06-02T04:48:55.045 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:55.042+0000 7f135c4e7700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13541a58b0 con 0x7f1354100550 2024-06-02T04:48:55.045 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:55.042+0000 7f135c4e7700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13541a5a70 con 0x7f13541063c0 2024-06-02T04:48:55.045 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:55.042+0000 7f135a283700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f13540ffba0 0x7f1354100b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:55.045 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:55.042+0000 7f135a283700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f13540ffba0 0x7f1354100b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:33902/0 (socket says 172.21.15.76:33902) 2024-06-02T04:48:55.045 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:55.042+0000 7f135a283700 1 -- 172.21.15.76:0/2238835634 learned_addr learned my addr 172.21.15.76:0/2238835634 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:48:55.045 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:55.042+0000 7f1359a82700 1 --2- 172.21.15.76:0/2238835634 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1354100550 0x7f1354101060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:55.045 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:55.042+0000 7f135aa84700 1 --2- 172.21.15.76:0/2238835634 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f13541063c0 0x7f13541015a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:55.045 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:55.043+0000 7f135a283700 1 -- 172.21.15.76:0/2238835634 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f13541063c0 msgr2=0x7f13541015a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:55.046 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:55.043+0000 7f135a283700 1 --2- 172.21.15.76:0/2238835634 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f13541063c0 0x7f13541015a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:55.046 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:55.043+0000 7f135a283700 1 -- 172.21.15.76:0/2238835634 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1354100550 msgr2=0x7f1354101060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:55.046 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:55.043+0000 7f135a283700 1 --2- 172.21.15.76:0/2238835634 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1354100550 0x7f1354101060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:55.046 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:55.043+0000 7f135a283700 1 -- 172.21.15.76:0/2238835634 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f134c009d00 con 0x7f13540ffba0 2024-06-02T04:48:55.046 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:55.043+0000 7f1359a82700 1 --2- 172.21.15.76:0/2238835634 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1354100550 0x7f1354101060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:48:55.046 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:55.043+0000 7f135aa84700 1 --2- 172.21.15.76:0/2238835634 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f13541063c0 0x7f13541015a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:48:55.046 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:55.043+0000 7f135a283700 1 --2- 172.21.15.76:0/2238835634 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f13540ffba0 0x7f1354100b20 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f135000c920 tx=0x7f135000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:55.046 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:55.043+0000 7f13477fe700 1 -- 172.21.15.76:0/2238835634 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1350007b00 con 0x7f13540ffba0 2024-06-02T04:48:55.046 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:55.043+0000 7f135c4e7700 1 -- 172.21.15.76:0/2238835634 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13541a5d50 con 0x7f13540ffba0 2024-06-02T04:48:55.046 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:55.043+0000 7f13477fe700 1 -- 172.21.15.76:0/2238835634 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1350004cc0 con 0x7f13540ffba0 2024-06-02T04:48:55.047 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:55.043+0000 7f13477fe700 1 -- 172.21.15.76:0/2238835634 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1350005490 con 0x7f13540ffba0 2024-06-02T04:48:55.047 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:55.043+0000 7f135c4e7700 1 -- 172.21.15.76:0/2238835634 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13541a6240 con 0x7f13540ffba0 2024-06-02T04:48:55.047 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:55.044+0000 7f135c4e7700 1 -- 172.21.15.76:0/2238835634 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13541095a0 con 0x7f13540ffba0 2024-06-02T04:48:55.048 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:55.045+0000 7f13477fe700 1 -- 172.21.15.76:0/2238835634 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f1350004750 con 0x7f13540ffba0 2024-06-02T04:48:55.048 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:55.045+0000 7f13477fe700 1 --2- 172.21.15.76:0/2238835634 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f13400a11b0 0x7f13400a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:55.048 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:55.046+0000 7f1359a82700 1 --2- 172.21.15.76:0/2238835634 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f13400a11b0 0x7f13400a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:55.048 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:55.046+0000 7f13477fe700 1 -- 172.21.15.76:0/2238835634 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f13500ccc70 con 0x7f13540ffba0 2024-06-02T04:48:55.048 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:55.046+0000 7f1359a82700 1 --2- 172.21.15.76:0/2238835634 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f13400a11b0 0x7f13400a3670 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f1354102250 tx=0x7f1348008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:55.049 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:55.049+0000 7f13477fe700 1 -- 172.21.15.76:0/2238835634 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f13500960b0 con 0x7f13540ffba0 2024-06-02T04:48:55.262 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:55.261+0000 7f135c4e7700 1 -- 172.21.15.76:0/2238835634 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f1354102000 con 0x7f13540ffba0 2024-06-02T04:48:55.263 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:55.262+0000 7f13477fe700 1 -- 172.21.15.76:0/2238835634 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f135001d020 con 0x7f13540ffba0 2024-06-02T04:48:55.263 INFO:teuthology.orchestra.run.smithi076.stdout:124554051628 2024-06-02T04:48:55.265 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:55.264+0000 7f135c4e7700 1 -- 172.21.15.76:0/2238835634 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f13400a11b0 msgr2=0x7f13400a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:55.265 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:55.264+0000 7f135c4e7700 1 --2- 172.21.15.76:0/2238835634 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f13400a11b0 0x7f13400a3670 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f1354102250 tx=0x7f1348008040 comp rx=0 tx=0).stop 2024-06-02T04:48:55.265 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:55.264+0000 7f135c4e7700 1 -- 172.21.15.76:0/2238835634 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f13540ffba0 msgr2=0x7f1354100b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:55.265 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:55.264+0000 7f135c4e7700 1 --2- 172.21.15.76:0/2238835634 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f13540ffba0 0x7f1354100b20 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f135000c920 tx=0x7f135000cce0 comp rx=0 tx=0).stop 2024-06-02T04:48:55.265 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:55.264+0000 7f135c4e7700 1 -- 172.21.15.76:0/2238835634 shutdown_connections 2024-06-02T04:48:55.265 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:55.264+0000 7f135c4e7700 1 --2- 172.21.15.76:0/2238835634 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f13541063c0 0x7f13541015a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:55.265 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:55.264+0000 7f135c4e7700 1 --2- 172.21.15.76:0/2238835634 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f13540ffba0 0x7f1354100b20 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:55.265 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:55.264+0000 7f135c4e7700 1 --2- 172.21.15.76:0/2238835634 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f13400a11b0 0x7f13400a3670 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:55.265 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:55.264+0000 7f135c4e7700 1 --2- 172.21.15.76:0/2238835634 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1354100550 0x7f1354101060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:55.265 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:55.264+0000 7f135c4e7700 1 -- 172.21.15.76:0/2238835634 >> 172.21.15.76:0/2238835634 conn(0x7f1354075260 msgr2=0x7f13540feb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:55.265 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:55.264+0000 7f135c4e7700 1 -- 172.21.15.76:0/2238835634 shutdown_connections 2024-06-02T04:48:55.266 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:55.264+0000 7f135c4e7700 1 -- 172.21.15.76:0/2238835634 wait complete. 2024-06-02T04:48:55.342 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T04:48:55.457 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:55 smithi076 ceph-mon[42935]: pgmap v244: 129 pgs: 129 active+clean; 639 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 255 B/s wr, 5 op/s 2024-06-02T04:48:55.458 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:55 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/381822610' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-06-02T04:48:55.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:55 smithi119 ceph-mon[46633]: pgmap v244: 129 pgs: 129 active+clean; 639 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 255 B/s wr, 5 op/s 2024-06-02T04:48:55.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:55 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/381822610' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-06-02T04:48:55.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:55 smithi192 ceph-mon[47933]: pgmap v244: 129 pgs: 129 active+clean; 639 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 255 B/s wr, 5 op/s 2024-06-02T04:48:55.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:55 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/381822610' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-06-02T04:48:56.240 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T04:48:56.373 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:56 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/2238835634' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-06-02T04:48:56.427 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T04:48:56.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:56 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/2238835634' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-06-02T04:48:56.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:56 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/2238835634' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-06-02T04:48:56.804 INFO:tasks.cephadm.ceph_manager.ceph:need seq 124554051626 got 124554051628 for osd.4 2024-06-02T04:48:56.805 DEBUG:teuthology.parallel:result is None 2024-06-02T04:48:57.129 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T04:48:57.150 INFO:tasks.cephadm.ceph_manager.ceph:need seq 51539607605 got 51539607606 for osd.1 2024-06-02T04:48:57.150 DEBUG:teuthology.parallel:result is None 2024-06-02T04:48:57.249 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:57 smithi076 ceph-mon[42935]: pgmap v245: 129 pgs: 129 active+clean; 639 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 255 B/s wr, 7 op/s 2024-06-02T04:48:57.520 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.504+0000 7f15b2b5b700 1 -- 172.21.15.76:0/3352828405 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f15ac100890 msgr2=0x7f15ac10cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:57.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.504+0000 7f15b2b5b700 1 --2- 172.21.15.76:0/3352828405 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f15ac100890 0x7f15ac10cd40 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f15a400b0a0 tx=0x7f15a400b3b0 comp rx=0 tx=0).stop 2024-06-02T04:48:57.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.504+0000 7f15b2b5b700 1 -- 172.21.15.76:0/3352828405 shutdown_connections 2024-06-02T04:48:57.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.504+0000 7f15b2b5b700 1 --2- 172.21.15.76:0/3352828405 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f15ac100890 0x7f15ac10cd40 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:57.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.504+0000 7f15b2b5b700 1 --2- 172.21.15.76:0/3352828405 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f15ac105f00 0x7f15ac1062e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:57.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.504+0000 7f15b2b5b700 1 --2- 172.21.15.76:0/3352828405 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15ac0ffed0 0x7f15ac100350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:57.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.504+0000 7f15b2b5b700 1 -- 172.21.15.76:0/3352828405 >> 172.21.15.76:0/3352828405 conn(0x7f15ac075f80 msgr2=0x7f15ac076390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:57.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.504+0000 7f15b2b5b700 1 -- 172.21.15.76:0/3352828405 shutdown_connections 2024-06-02T04:48:57.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.504+0000 7f15b2b5b700 1 -- 172.21.15.76:0/3352828405 wait complete. 2024-06-02T04:48:57.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.505+0000 7f15b2b5b700 1 Processor -- start 2024-06-02T04:48:57.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.505+0000 7f15b2b5b700 1 -- start start 2024-06-02T04:48:57.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.505+0000 7f15b2b5b700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15ac0ffed0 0x7f15ac1973d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:57.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.505+0000 7f15b2b5b700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f15ac100890 0x7f15ac197910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:57.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.505+0000 7f15b2b5b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f15ac105f00 0x7f15ac19bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:57.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.505+0000 7f15b2b5b700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ac19c2d0 con 0x7f15ac100890 2024-06-02T04:48:57.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.505+0000 7f15b2b5b700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ac19c440 con 0x7f15ac0ffed0 2024-06-02T04:48:57.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.505+0000 7f15b2b5b700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ac19c600 con 0x7f15ac105f00 2024-06-02T04:48:57.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.505+0000 7f15b08f7700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15ac0ffed0 0x7f15ac1973d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:57.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.505+0000 7f15b08f7700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15ac0ffed0 0x7f15ac1973d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:55524/0 (socket says 172.21.15.76:55524) 2024-06-02T04:48:57.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.505+0000 7f15b08f7700 1 -- 172.21.15.76:0/2008857357 learned_addr learned my addr 172.21.15.76:0/2008857357 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:48:57.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.505+0000 7f15b10f8700 1 --2- 172.21.15.76:0/2008857357 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f15ac105f00 0x7f15ac19bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:57.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.505+0000 7f15b08f7700 1 -- 172.21.15.76:0/2008857357 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f15ac105f00 msgr2=0x7f15ac19bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:57.523 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.505+0000 7f15b08f7700 1 --2- 172.21.15.76:0/2008857357 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f15ac105f00 0x7f15ac19bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:57.523 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.505+0000 7f15b08f7700 1 -- 172.21.15.76:0/2008857357 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f15ac100890 msgr2=0x7f15ac197910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:57.523 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.505+0000 7f15b08f7700 1 --2- 172.21.15.76:0/2008857357 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f15ac100890 0x7f15ac197910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:57.523 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.505+0000 7f15b08f7700 1 -- 172.21.15.76:0/2008857357 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15a4009d00 con 0x7f15ac0ffed0 2024-06-02T04:48:57.523 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.505+0000 7f15b10f8700 1 --2- 172.21.15.76:0/2008857357 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f15ac105f00 0x7f15ac19bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:48:57.523 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.506+0000 7f15b08f7700 1 --2- 172.21.15.76:0/2008857357 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15ac0ffed0 0x7f15ac1973d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f15a000e9a0 tx=0x7f15a000ed60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:57.523 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.506+0000 7f15a9ffb700 1 -- 172.21.15.76:0/2008857357 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a0009790 con 0x7f15ac0ffed0 2024-06-02T04:48:57.523 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.506+0000 7f15b2b5b700 1 -- 172.21.15.76:0/2008857357 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15ac19c8e0 con 0x7f15ac0ffed0 2024-06-02T04:48:57.523 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.506+0000 7f15a9ffb700 1 -- 172.21.15.76:0/2008857357 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f15a000cbd0 con 0x7f15ac0ffed0 2024-06-02T04:48:57.523 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.506+0000 7f15a9ffb700 1 -- 172.21.15.76:0/2008857357 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a0018680 con 0x7f15ac0ffed0 2024-06-02T04:48:57.523 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.506+0000 7f15b2b5b700 1 -- 172.21.15.76:0/2008857357 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15ac1a4140 con 0x7f15ac0ffed0 2024-06-02T04:48:57.523 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.507+0000 7f15b2b5b700 1 -- 172.21.15.76:0/2008857357 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15ac1015b0 con 0x7f15ac0ffed0 2024-06-02T04:48:57.524 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.508+0000 7f15a9ffb700 1 -- 172.21.15.76:0/2008857357 <== mon.2 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f15a000cd40 con 0x7f15ac0ffed0 2024-06-02T04:48:57.524 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.509+0000 7f15a9ffb700 1 --2- 172.21.15.76:0/2008857357 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f159c0a11b0 0x7f159c0a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:57.524 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.509+0000 7f15abfff700 1 --2- 172.21.15.76:0/2008857357 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f159c0a11b0 0x7f159c0a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:57.524 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.509+0000 7f15a9ffb700 1 -- 172.21.15.76:0/2008857357 <== mon.2 v2:172.21.15.119:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f15a0014070 con 0x7f15ac0ffed0 2024-06-02T04:48:57.524 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.509+0000 7f15abfff700 1 --2- 172.21.15.76:0/2008857357 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f159c0a11b0 0x7f159c0a3670 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f1598005fd0 tx=0x7f1598005f60 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:57.524 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.513+0000 7f15a9ffb700 1 -- 172.21.15.76:0/2008857357 <== mon.2 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f15a0096570 con 0x7f15ac0ffed0 2024-06-02T04:48:57.554 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.472+0000 7f7b1915d700 1 -- 172.21.15.76:0/1885847185 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7b14100890 msgr2=0x7f7b1410cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:57.554 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.472+0000 7f7b1915d700 1 --2- 172.21.15.76:0/1885847185 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7b14100890 0x7f7b1410cd40 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c00b0a0 tx=0x7f7b0c00b3b0 comp rx=0 tx=0).stop 2024-06-02T04:48:57.554 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.472+0000 7f7b1915d700 1 -- 172.21.15.76:0/1885847185 shutdown_connections 2024-06-02T04:48:57.554 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.472+0000 7f7b1915d700 1 --2- 172.21.15.76:0/1885847185 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7b14100890 0x7f7b1410cd40 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:57.554 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.472+0000 7f7b1915d700 1 --2- 172.21.15.76:0/1885847185 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7b14105f00 0x7f7b141062e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:57.554 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.472+0000 7f7b1915d700 1 --2- 172.21.15.76:0/1885847185 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7b140ffed0 0x7f7b14100350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:57.554 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.472+0000 7f7b1915d700 1 -- 172.21.15.76:0/1885847185 >> 172.21.15.76:0/1885847185 conn(0x7f7b14075f80 msgr2=0x7f7b14076390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:57.555 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.472+0000 7f7b1915d700 1 -- 172.21.15.76:0/1885847185 shutdown_connections 2024-06-02T04:48:57.555 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.472+0000 7f7b1915d700 1 -- 172.21.15.76:0/1885847185 wait complete. 2024-06-02T04:48:57.555 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.473+0000 7f7b1915d700 1 Processor -- start 2024-06-02T04:48:57.555 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.473+0000 7f7b1915d700 1 -- start start 2024-06-02T04:48:57.555 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.473+0000 7f7b1915d700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7b140ffed0 0x7f7b14196300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:57.555 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.473+0000 7f7b1915d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7b14100890 0x7f7b14196840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:57.555 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.473+0000 7f7b1915d700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7b14105f00 0x7f7b1419abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:57.555 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.473+0000 7f7b1915d700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b1419b200 con 0x7f7b14105f00 2024-06-02T04:48:57.555 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.473+0000 7f7b1915d700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b1419b370 con 0x7f7b140ffed0 2024-06-02T04:48:57.555 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.473+0000 7f7b1915d700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b1419b530 con 0x7f7b14100890 2024-06-02T04:48:57.555 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.474+0000 7f7b1359e700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7b14105f00 0x7f7b1419abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:57.555 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.474+0000 7f7b1359e700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7b14105f00 0x7f7b1419abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:33920/0 (socket says 172.21.15.76:33920) 2024-06-02T04:48:57.555 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.474+0000 7f7b1359e700 1 -- 172.21.15.76:0/1118544544 learned_addr learned my addr 172.21.15.76:0/1118544544 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:48:57.556 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.474+0000 7f7b12d9d700 1 --2- 172.21.15.76:0/1118544544 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7b140ffed0 0x7f7b14196300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:57.556 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.474+0000 7f7b1259c700 1 --2- 172.21.15.76:0/1118544544 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7b14100890 0x7f7b14196840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:57.556 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.474+0000 7f7b1359e700 1 -- 172.21.15.76:0/1118544544 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7b14100890 msgr2=0x7f7b14196840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:57.556 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.474+0000 7f7b1359e700 1 --2- 172.21.15.76:0/1118544544 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7b14100890 0x7f7b14196840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:57.556 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.474+0000 7f7b1359e700 1 -- 172.21.15.76:0/1118544544 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7b140ffed0 msgr2=0x7f7b14196300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:57.556 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.474+0000 7f7b1359e700 1 --2- 172.21.15.76:0/1118544544 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7b140ffed0 0x7f7b14196300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:57.556 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.474+0000 7f7b1359e700 1 -- 172.21.15.76:0/1118544544 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b0c009d00 con 0x7f7b14105f00 2024-06-02T04:48:57.556 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.474+0000 7f7b1359e700 1 --2- 172.21.15.76:0/1118544544 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7b14105f00 0x7f7b1419abf0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c00b070 tx=0x7f7b0c009380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:57.556 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.474+0000 7f7afbfff700 1 -- 172.21.15.76:0/1118544544 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b0c00e040 con 0x7f7b14105f00 2024-06-02T04:48:57.556 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.474+0000 7f7afbfff700 1 -- 172.21.15.76:0/1118544544 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7b0c007930 con 0x7f7b14105f00 2024-06-02T04:48:57.556 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.474+0000 7f7b1915d700 1 -- 172.21.15.76:0/1118544544 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b1419b7b0 con 0x7f7b14105f00 2024-06-02T04:48:57.556 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.474+0000 7f7afbfff700 1 -- 172.21.15.76:0/1118544544 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b0c01b450 con 0x7f7b14105f00 2024-06-02T04:48:57.556 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.474+0000 7f7b1915d700 1 -- 172.21.15.76:0/1118544544 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b14068b20 con 0x7f7b14105f00 2024-06-02T04:48:57.557 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.476+0000 7f7b1915d700 1 -- 172.21.15.76:0/1118544544 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b141015b0 con 0x7f7b14105f00 2024-06-02T04:48:57.557 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.478+0000 7f7afbfff700 1 -- 172.21.15.76:0/1118544544 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f7b0c004cf0 con 0x7f7b14105f00 2024-06-02T04:48:57.557 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.479+0000 7f7afbfff700 1 --2- 172.21.15.76:0/1118544544 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f7afc0a1230 0x7f7afc0a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:57.557 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.479+0000 7f7b12d9d700 1 --2- 172.21.15.76:0/1118544544 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f7afc0a1230 0x7f7afc0a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:57.557 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.479+0000 7f7afbfff700 1 -- 172.21.15.76:0/1118544544 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f7b0c0ce880 con 0x7f7b14105f00 2024-06-02T04:48:57.557 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.479+0000 7f7b12d9d700 1 --2- 172.21.15.76:0/1118544544 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f7afc0a1230 0x7f7afc0a36f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7b04005950 tx=0x7f7b0400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:57.557 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.482+0000 7f7afbfff700 1 -- 172.21.15.76:0/1118544544 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f7b0c097d50 con 0x7f7b14105f00 2024-06-02T04:48:57.564 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.564+0000 7f46f0e17700 1 -- 172.21.15.76:0/727603866 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f46ec1012f0 msgr2=0x7f46ec10d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:57.564 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.564+0000 7f46f0e17700 1 --2- 172.21.15.76:0/727603866 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f46ec1012f0 0x7f46ec10d540 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f46e00099c0 tx=0x7f46e0009cd0 comp rx=0 tx=0).stop 2024-06-02T04:48:57.565 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.564+0000 7f46f0e17700 1 -- 172.21.15.76:0/727603866 shutdown_connections 2024-06-02T04:48:57.565 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.564+0000 7f46f0e17700 1 --2- 172.21.15.76:0/727603866 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f46ec10da80 0x7f46ec10fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:57.565 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.564+0000 7f46f0e17700 1 --2- 172.21.15.76:0/727603866 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f46ec1009d0 0x7f46ec100db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:57.565 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.564+0000 7f46f0e17700 1 --2- 172.21.15.76:0/727603866 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f46ec1012f0 0x7f46ec10d540 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:57.565 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.564+0000 7f46f0e17700 1 -- 172.21.15.76:0/727603866 >> 172.21.15.76:0/727603866 conn(0x7f46ec075f80 msgr2=0x7f46ec076390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:57.565 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.564+0000 7f46f0e17700 1 -- 172.21.15.76:0/727603866 shutdown_connections 2024-06-02T04:48:57.565 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.564+0000 7f46f0e17700 1 -- 172.21.15.76:0/727603866 wait complete. 2024-06-02T04:48:57.567 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.565+0000 7f46f0e17700 1 Processor -- start 2024-06-02T04:48:57.567 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.565+0000 7f46f0e17700 1 -- start start 2024-06-02T04:48:57.567 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.565+0000 7f46f0e17700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f46ec1009d0 0x7f46ec1994b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:57.567 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.565+0000 7f46f0e17700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f46ec1012f0 0x7f46ec1999f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:57.567 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.565+0000 7f46f0e17700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f46ec10da80 0x7f46ec19dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:57.567 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.565+0000 7f46f0e17700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46ec19e3b0 con 0x7f46ec1012f0 2024-06-02T04:48:57.567 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.565+0000 7f46f0e17700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46ec19e520 con 0x7f46ec1009d0 2024-06-02T04:48:57.567 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.565+0000 7f46f0e17700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46ec19e6e0 con 0x7f46ec10da80 2024-06-02T04:48:57.567 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.565+0000 7f46e9d9b700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f46ec1012f0 0x7f46ec1999f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:57.567 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.565+0000 7f46e9d9b700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f46ec1012f0 0x7f46ec1999f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:33956/0 (socket says 172.21.15.76:33956) 2024-06-02T04:48:57.567 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.565+0000 7f46e9d9b700 1 -- 172.21.15.76:0/44683289 learned_addr learned my addr 172.21.15.76:0/44683289 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:48:57.567 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.565+0000 7f46ea59c700 1 --2- 172.21.15.76:0/44683289 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f46ec1009d0 0x7f46ec1994b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:57.568 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.565+0000 7f46ead9d700 1 --2- 172.21.15.76:0/44683289 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f46ec10da80 0x7f46ec19dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:57.568 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.565+0000 7f46e9d9b700 1 -- 172.21.15.76:0/44683289 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f46ec10da80 msgr2=0x7f46ec19dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:57.568 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.565+0000 7f46e9d9b700 1 --2- 172.21.15.76:0/44683289 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f46ec10da80 0x7f46ec19dda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:57.568 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.566+0000 7f46e9d9b700 1 -- 172.21.15.76:0/44683289 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f46ec1009d0 msgr2=0x7f46ec1994b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:57.568 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.566+0000 7f46e9d9b700 1 --2- 172.21.15.76:0/44683289 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f46ec1009d0 0x7f46ec1994b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:57.568 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.566+0000 7f46e9d9b700 1 -- 172.21.15.76:0/44683289 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46e00095f0 con 0x7f46ec1012f0 2024-06-02T04:48:57.568 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.566+0000 7f46e9d9b700 1 --2- 172.21.15.76:0/44683289 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f46ec1012f0 0x7f46ec1999f0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f46e0009f50 tx=0x7f46e0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:57.568 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.566+0000 7f46db7fe700 1 -- 172.21.15.76:0/44683289 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e001d070 con 0x7f46ec1012f0 2024-06-02T04:48:57.568 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.566+0000 7f46f0e17700 1 -- 172.21.15.76:0/44683289 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46ec19e960 con 0x7f46ec1012f0 2024-06-02T04:48:57.568 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.566+0000 7f46db7fe700 1 -- 172.21.15.76:0/44683289 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f46e000fcf0 con 0x7f46ec1012f0 2024-06-02T04:48:57.568 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.566+0000 7f46db7fe700 1 -- 172.21.15.76:0/44683289 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e0022d40 con 0x7f46ec1012f0 2024-06-02T04:48:57.568 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.566+0000 7f46f0e17700 1 -- 172.21.15.76:0/44683289 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46ec1a6220 con 0x7f46ec1012f0 2024-06-02T04:48:57.569 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.567+0000 7f46f0e17700 1 -- 172.21.15.76:0/44683289 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46ec108ca0 con 0x7f46ec1012f0 2024-06-02T04:48:57.569 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.568+0000 7f46db7fe700 1 -- 172.21.15.76:0/44683289 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f46e0022470 con 0x7f46ec1012f0 2024-06-02T04:48:57.569 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.569+0000 7f46db7fe700 1 --2- 172.21.15.76:0/44683289 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f46d40a11b0 0x7f46d40a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:57.569 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.569+0000 7f46ea59c700 1 --2- 172.21.15.76:0/44683289 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f46d40a11b0 0x7f46d40a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:57.569 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.569+0000 7f46db7fe700 1 -- 172.21.15.76:0/44683289 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f46e00cdca0 con 0x7f46ec1012f0 2024-06-02T04:48:57.570 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.569+0000 7f46ea59c700 1 --2- 172.21.15.76:0/44683289 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f46d40a11b0 0x7f46d40a3670 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f46dc00ac50 tx=0x7f46dc00a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:57.577 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.577+0000 7f46db7fe700 1 -- 172.21.15.76:0/44683289 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f46e0097170 con 0x7f46ec1012f0 2024-06-02T04:48:57.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:57 smithi119 ceph-mon[46633]: pgmap v245: 129 pgs: 129 active+clean; 639 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 255 B/s wr, 7 op/s 2024-06-02T04:48:57.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:57 smithi192 ceph-mon[47933]: pgmap v245: 129 pgs: 129 active+clean; 639 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 255 B/s wr, 7 op/s 2024-06-02T04:48:57.700 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.699+0000 7f7b1915d700 1 -- 172.21.15.76:0/1118544544 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7b14197610 con 0x7f7b14105f00 2024-06-02T04:48:57.700 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.700+0000 7f7afbfff700 1 -- 172.21.15.76:0/1118544544 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7b0c09b370 con 0x7f7b14105f00 2024-06-02T04:48:57.700 INFO:teuthology.orchestra.run.smithi076.stdout:34359738425 2024-06-02T04:48:57.702 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.702+0000 7f7b1915d700 1 -- 172.21.15.76:0/1118544544 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f7afc0a1230 msgr2=0x7f7afc0a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:57.702 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.702+0000 7f7b1915d700 1 --2- 172.21.15.76:0/1118544544 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f7afc0a1230 0x7f7afc0a36f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7b04005950 tx=0x7f7b0400b410 comp rx=0 tx=0).stop 2024-06-02T04:48:57.702 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.702+0000 7f7b1915d700 1 -- 172.21.15.76:0/1118544544 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7b14105f00 msgr2=0x7f7b1419abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:57.703 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.702+0000 7f7b1915d700 1 --2- 172.21.15.76:0/1118544544 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7b14105f00 0x7f7b1419abf0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c00b070 tx=0x7f7b0c009380 comp rx=0 tx=0).stop 2024-06-02T04:48:57.703 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.702+0000 7f7b1915d700 1 -- 172.21.15.76:0/1118544544 shutdown_connections 2024-06-02T04:48:57.703 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.702+0000 7f7b1915d700 1 --2- 172.21.15.76:0/1118544544 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7b14105f00 0x7f7b1419abf0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:57.703 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.702+0000 7f7b1915d700 1 --2- 172.21.15.76:0/1118544544 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f7afc0a1230 0x7f7afc0a36f0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:57.703 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.702+0000 7f7b1915d700 1 --2- 172.21.15.76:0/1118544544 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7b140ffed0 0x7f7b14196300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:57.703 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.702+0000 7f7b1915d700 1 --2- 172.21.15.76:0/1118544544 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7b14100890 0x7f7b14196840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:57.703 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.702+0000 7f7b1915d700 1 -- 172.21.15.76:0/1118544544 >> 172.21.15.76:0/1118544544 conn(0x7f7b14075f80 msgr2=0x7f7b140fedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:57.703 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.702+0000 7f7b1915d700 1 -- 172.21.15.76:0/1118544544 shutdown_connections 2024-06-02T04:48:57.703 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.702+0000 7f7b1915d700 1 -- 172.21.15.76:0/1118544544 wait complete. 2024-06-02T04:48:57.748 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.748+0000 7f15b2b5b700 1 -- 172.21.15.76:0/2008857357 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) v1 -- 0x7f15ac04ec60 con 0x7f15ac0ffed0 2024-06-02T04:48:57.748 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.748+0000 7f15a9ffb700 1 -- 172.21.15.76:0/2008857357 <== mon.2 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f15a0026020 con 0x7f15ac0ffed0 2024-06-02T04:48:57.749 INFO:teuthology.orchestra.run.smithi076.stdout:227633266718 2024-06-02T04:48:57.752 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.752+0000 7f15b2b5b700 1 -- 172.21.15.76:0/2008857357 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f159c0a11b0 msgr2=0x7f159c0a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:57.752 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.752+0000 7f15b2b5b700 1 --2- 172.21.15.76:0/2008857357 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f159c0a11b0 0x7f159c0a3670 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f1598005fd0 tx=0x7f1598005f60 comp rx=0 tx=0).stop 2024-06-02T04:48:57.752 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.752+0000 7f15b2b5b700 1 -- 172.21.15.76:0/2008857357 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15ac0ffed0 msgr2=0x7f15ac1973d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:57.752 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.752+0000 7f15b2b5b700 1 --2- 172.21.15.76:0/2008857357 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15ac0ffed0 0x7f15ac1973d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f15a000e9a0 tx=0x7f15a000ed60 comp rx=0 tx=0).stop 2024-06-02T04:48:57.754 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.754+0000 7f15b2b5b700 1 -- 172.21.15.76:0/2008857357 shutdown_connections 2024-06-02T04:48:57.754 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.754+0000 7f15b2b5b700 1 --2- 172.21.15.76:0/2008857357 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f15ac105f00 0x7f15ac19bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:57.754 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.754+0000 7f15b2b5b700 1 --2- 172.21.15.76:0/2008857357 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f159c0a11b0 0x7f159c0a3670 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:57.754 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.754+0000 7f15b2b5b700 1 --2- 172.21.15.76:0/2008857357 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15ac0ffed0 0x7f15ac1973d0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:57.754 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.754+0000 7f15b2b5b700 1 --2- 172.21.15.76:0/2008857357 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f15ac100890 0x7f15ac197910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:57.754 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.754+0000 7f15b2b5b700 1 -- 172.21.15.76:0/2008857357 >> 172.21.15.76:0/2008857357 conn(0x7f15ac075f80 msgr2=0x7f15ac068bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:57.754 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.754+0000 7f15b2b5b700 1 -- 172.21.15.76:0/2008857357 shutdown_connections 2024-06-02T04:48:57.755 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.754+0000 7f15b2b5b700 1 -- 172.21.15.76:0/2008857357 wait complete. 2024-06-02T04:48:57.799 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.799+0000 7f46f0e17700 1 -- 172.21.15.76:0/44683289 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f46ec1004e0 con 0x7f46ec1012f0 2024-06-02T04:48:57.799 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.799+0000 7f46db7fe700 1 -- 172.21.15.76:0/44683289 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f46e000fe60 con 0x7f46ec1012f0 2024-06-02T04:48:57.800 INFO:teuthology.orchestra.run.smithi076.stdout:197568495650 2024-06-02T04:48:57.802 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.801+0000 7f46f0e17700 1 -- 172.21.15.76:0/44683289 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f46d40a11b0 msgr2=0x7f46d40a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:57.802 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.801+0000 7f46f0e17700 1 --2- 172.21.15.76:0/44683289 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f46d40a11b0 0x7f46d40a3670 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f46dc00ac50 tx=0x7f46dc00a380 comp rx=0 tx=0).stop 2024-06-02T04:48:57.802 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.801+0000 7f46f0e17700 1 -- 172.21.15.76:0/44683289 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f46ec1012f0 msgr2=0x7f46ec1999f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:57.802 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.801+0000 7f46f0e17700 1 --2- 172.21.15.76:0/44683289 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f46ec1012f0 0x7f46ec1999f0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f46e0009f50 tx=0x7f46e0004730 comp rx=0 tx=0).stop 2024-06-02T04:48:57.802 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.801+0000 7f46f0e17700 1 -- 172.21.15.76:0/44683289 shutdown_connections 2024-06-02T04:48:57.802 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.801+0000 7f46f0e17700 1 --2- 172.21.15.76:0/44683289 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f46ec10da80 0x7f46ec19dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:57.802 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.801+0000 7f46f0e17700 1 --2- 172.21.15.76:0/44683289 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f46d40a11b0 0x7f46d40a3670 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:57.802 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.801+0000 7f46f0e17700 1 --2- 172.21.15.76:0/44683289 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f46ec1009d0 0x7f46ec1994b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:57.802 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.801+0000 7f46f0e17700 1 --2- 172.21.15.76:0/44683289 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f46ec1012f0 0x7f46ec1999f0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:57.802 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.801+0000 7f46f0e17700 1 -- 172.21.15.76:0/44683289 >> 172.21.15.76:0/44683289 conn(0x7f46ec075f80 msgr2=0x7f46ec10f230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:57.802 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.801+0000 7f46f0e17700 1 -- 172.21.15.76:0/44683289 shutdown_connections 2024-06-02T04:48:57.803 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.801+0000 7f46f0e17700 1 -- 172.21.15.76:0/44683289 wait complete. 2024-06-02T04:48:58.046 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.979+0000 7f52a0f8c700 1 -- 172.21.15.76:0/2141256330 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f529c0ffe90 msgr2=0x7f529c100310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:58.046 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.979+0000 7f52a0f8c700 1 --2- 172.21.15.76:0/2141256330 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f529c0ffe90 0x7f529c100310 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f528c009990 tx=0x7f528c009ca0 comp rx=0 tx=0).stop 2024-06-02T04:48:58.046 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.980+0000 7f52a0f8c700 1 -- 172.21.15.76:0/2141256330 shutdown_connections 2024-06-02T04:48:58.046 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.980+0000 7f52a0f8c700 1 --2- 172.21.15.76:0/2141256330 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f529c100850 0x7f529c10ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:58.046 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.980+0000 7f52a0f8c700 1 --2- 172.21.15.76:0/2141256330 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f529c105f40 0x7f529c106320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:58.046 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.980+0000 7f52a0f8c700 1 --2- 172.21.15.76:0/2141256330 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f529c0ffe90 0x7f529c100310 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:58.046 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.980+0000 7f52a0f8c700 1 -- 172.21.15.76:0/2141256330 >> 172.21.15.76:0/2141256330 conn(0x7f529c076e70 msgr2=0x7f529c077280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:58.046 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.980+0000 7f52a0f8c700 1 -- 172.21.15.76:0/2141256330 shutdown_connections 2024-06-02T04:48:58.046 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.980+0000 7f52a0f8c700 1 -- 172.21.15.76:0/2141256330 wait complete. 2024-06-02T04:48:58.046 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.981+0000 7f52a0f8c700 1 Processor -- start 2024-06-02T04:48:58.047 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.981+0000 7f52a0f8c700 1 -- start start 2024-06-02T04:48:58.047 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.981+0000 7f52a0f8c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f529c0ffe90 0x7f529c197240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:58.047 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.981+0000 7f52a0f8c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f529c100850 0x7f529c197780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:58.047 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.981+0000 7f52a0f8c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f529c105f40 0x7f529c19bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:58.047 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.981+0000 7f52a0f8c700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f529c19c140 con 0x7f529c0ffe90 2024-06-02T04:48:58.047 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.981+0000 7f52a0f8c700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f529c19c2b0 con 0x7f529c105f40 2024-06-02T04:48:58.047 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.981+0000 7f52a0f8c700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f529c19c470 con 0x7f529c100850 2024-06-02T04:48:58.047 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.981+0000 7f529a59c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f529c0ffe90 0x7f529c197240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:58.047 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.981+0000 7f529a59c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f529c0ffe90 0x7f529c197240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:33976/0 (socket says 172.21.15.76:33976) 2024-06-02T04:48:58.047 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.981+0000 7f529a59c700 1 -- 172.21.15.76:0/3480198575 learned_addr learned my addr 172.21.15.76:0/3480198575 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:48:58.047 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.981+0000 7f5299d9b700 1 --2- 172.21.15.76:0/3480198575 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f529c100850 0x7f529c197780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:58.047 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.981+0000 7f529ad9d700 1 --2- 172.21.15.76:0/3480198575 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f529c105f40 0x7f529c19bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:58.048 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.981+0000 7f529a59c700 1 -- 172.21.15.76:0/3480198575 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f529c100850 msgr2=0x7f529c197780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:58.048 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.981+0000 7f529a59c700 1 --2- 172.21.15.76:0/3480198575 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f529c100850 0x7f529c197780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:58.048 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.981+0000 7f529a59c700 1 -- 172.21.15.76:0/3480198575 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f529c105f40 msgr2=0x7f529c19bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:58.048 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.981+0000 7f529a59c700 1 --2- 172.21.15.76:0/3480198575 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f529c105f40 0x7f529c19bb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:58.048 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.981+0000 7f529a59c700 1 -- 172.21.15.76:0/3480198575 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f528c0095f0 con 0x7f529c0ffe90 2024-06-02T04:48:58.048 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.981+0000 7f529a59c700 1 --2- 172.21.15.76:0/3480198575 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f529c0ffe90 0x7f529c197240 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f529000c920 tx=0x7f529000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:58.048 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.982+0000 7f528b7fe700 1 -- 172.21.15.76:0/3480198575 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5290007b00 con 0x7f529c0ffe90 2024-06-02T04:48:58.048 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.982+0000 7f528b7fe700 1 -- 172.21.15.76:0/3480198575 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f529000ce70 con 0x7f529c0ffe90 2024-06-02T04:48:58.048 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.982+0000 7f52a0f8c700 1 -- 172.21.15.76:0/3480198575 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f529c19c750 con 0x7f529c0ffe90 2024-06-02T04:48:58.048 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.982+0000 7f528b7fe700 1 -- 172.21.15.76:0/3480198575 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5290005440 con 0x7f529c0ffe90 2024-06-02T04:48:58.048 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.982+0000 7f52a0f8c700 1 -- 172.21.15.76:0/3480198575 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f529c1a3fb0 con 0x7f529c0ffe90 2024-06-02T04:48:58.048 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.983+0000 7f52a0f8c700 1 -- 172.21.15.76:0/3480198575 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f529c108290 con 0x7f529c0ffe90 2024-06-02T04:48:58.048 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.984+0000 7f528b7fe700 1 -- 172.21.15.76:0/3480198575 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f52900055a0 con 0x7f529c0ffe90 2024-06-02T04:48:58.049 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.985+0000 7f528b7fe700 1 --2- 172.21.15.76:0/3480198575 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f52840a11b0 0x7f52840a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:58.049 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.985+0000 7f5299d9b700 1 --2- 172.21.15.76:0/3480198575 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f52840a11b0 0x7f52840a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:58.049 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.985+0000 7f528b7fe700 1 -- 172.21.15.76:0/3480198575 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f52900cc890 con 0x7f529c0ffe90 2024-06-02T04:48:58.049 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.985+0000 7f5299d9b700 1 --2- 172.21.15.76:0/3480198575 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f52840a11b0 0x7f52840a3670 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f529c1987a0 tx=0x7f528c005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:58.049 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:57.989+0000 7f528b7fe700 1 -- 172.21.15.76:0/3480198575 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f5290095c70 con 0x7f529c0ffe90 2024-06-02T04:48:58.198 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:58.197+0000 7f52a0f8c700 1 -- 172.21.15.76:0/3480198575 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f529c198550 con 0x7f529c0ffe90 2024-06-02T04:48:58.198 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:58.197+0000 7f528b7fe700 1 -- 172.21.15.76:0/3480198575 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f529001d090 con 0x7f529c0ffe90 2024-06-02T04:48:58.198 INFO:teuthology.orchestra.run.smithi076.stdout:141733920809 2024-06-02T04:48:58.200 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:58.200+0000 7f52a0f8c700 1 -- 172.21.15.76:0/3480198575 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f52840a11b0 msgr2=0x7f52840a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:58.200 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:58.200+0000 7f52a0f8c700 1 --2- 172.21.15.76:0/3480198575 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f52840a11b0 0x7f52840a3670 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f529c1987a0 tx=0x7f528c005fb0 comp rx=0 tx=0).stop 2024-06-02T04:48:58.200 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:58.200+0000 7f52a0f8c700 1 -- 172.21.15.76:0/3480198575 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f529c0ffe90 msgr2=0x7f529c197240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:58.200 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:58.200+0000 7f52a0f8c700 1 --2- 172.21.15.76:0/3480198575 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f529c0ffe90 0x7f529c197240 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f529000c920 tx=0x7f529000cc30 comp rx=0 tx=0).stop 2024-06-02T04:48:58.200 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:58.200+0000 7f52a0f8c700 1 -- 172.21.15.76:0/3480198575 shutdown_connections 2024-06-02T04:48:58.200 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:58.200+0000 7f52a0f8c700 1 --2- 172.21.15.76:0/3480198575 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f52840a11b0 0x7f52840a3670 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:58.200 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:58.200+0000 7f52a0f8c700 1 --2- 172.21.15.76:0/3480198575 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f529c105f40 0x7f529c19bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:58.200 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:58.200+0000 7f52a0f8c700 1 --2- 172.21.15.76:0/3480198575 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f529c0ffe90 0x7f529c197240 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:58.200 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:58.200+0000 7f52a0f8c700 1 --2- 172.21.15.76:0/3480198575 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f529c100850 0x7f529c197780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:58.201 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:58.200+0000 7f52a0f8c700 1 -- 172.21.15.76:0/3480198575 >> 172.21.15.76:0/3480198575 conn(0x7f529c076e70 msgr2=0x7f529c0feea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:58.201 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:58.200+0000 7f52a0f8c700 1 -- 172.21.15.76:0/3480198575 shutdown_connections 2024-06-02T04:48:58.201 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:58.200+0000 7f52a0f8c700 1 -- 172.21.15.76:0/3480198575 wait complete. 2024-06-02T04:48:58.456 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:58 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/1118544544' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-06-02T04:48:58.456 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:58 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/2008857357' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-06-02T04:48:58.456 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:58 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/44683289' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-06-02T04:48:58.456 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:58 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/3480198575' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-06-02T04:48:58.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:58 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/1118544544' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-06-02T04:48:58.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:58 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/2008857357' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-06-02T04:48:58.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:58 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/44683289' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-06-02T04:48:58.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:58 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/3480198575' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-06-02T04:48:58.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:58 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/1118544544' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-06-02T04:48:58.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:58 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/2008857357' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-06-02T04:48:58.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:58 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/44683289' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-06-02T04:48:58.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:58 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/3480198575' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-06-02T04:48:58.743 INFO:tasks.cephadm.ceph_manager.ceph:need seq 227633266716 got 227633266718 for osd.8 2024-06-02T04:48:58.743 DEBUG:teuthology.parallel:result is None 2024-06-02T04:48:58.893 INFO:tasks.cephadm.ceph_manager.ceph:need seq 197568495648 got 197568495650 for osd.7 2024-06-02T04:48:58.893 DEBUG:teuthology.parallel:result is None 2024-06-02T04:48:59.176 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738423 got 34359738425 for osd.0 2024-06-02T04:48:59.176 DEBUG:teuthology.parallel:result is None 2024-06-02T04:48:59.410 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:59.409+0000 7f6442d67700 1 -- 172.21.15.76:0/20750947 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f643c101410 msgr2=0x7f643c10cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:59.410 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:59.409+0000 7f6442d67700 1 --2- 172.21.15.76:0/20750947 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f643c101410 0x7f643c10cd70 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f643400b0d0 tx=0x7f643400b3e0 comp rx=0 tx=0).stop 2024-06-02T04:48:59.410 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:59.409+0000 7f6442d67700 1 -- 172.21.15.76:0/20750947 shutdown_connections 2024-06-02T04:48:59.410 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:59.409+0000 7f6442d67700 1 --2- 172.21.15.76:0/20750947 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f643c101410 0x7f643c10cd70 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:59.410 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:59.409+0000 7f6442d67700 1 --2- 172.21.15.76:0/20750947 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f643c104ed0 0x7f643c1052b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:59.410 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:59.409+0000 7f6442d67700 1 --2- 172.21.15.76:0/20750947 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f643c100a50 0x7f643c100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:59.410 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:59.409+0000 7f6442d67700 1 -- 172.21.15.76:0/20750947 >> 172.21.15.76:0/20750947 conn(0x7f643c075260 msgr2=0x7f643c075670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:59.410 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:59.409+0000 7f6442d67700 1 -- 172.21.15.76:0/20750947 shutdown_connections 2024-06-02T04:48:59.410 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:59.409+0000 7f6442d67700 1 -- 172.21.15.76:0/20750947 wait complete. 2024-06-02T04:48:59.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:59.410+0000 7f6442d67700 1 Processor -- start 2024-06-02T04:48:59.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:59.410+0000 7f6442d67700 1 -- start start 2024-06-02T04:48:59.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:59.411+0000 7f6442d67700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f643c100a50 0x7f643c1961f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:59.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:59.411+0000 7f6442d67700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f643c101410 0x7f643c196730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:59.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:59.411+0000 7f6442d67700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f643c104ed0 0x7f643c19aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:59.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:59.411+0000 7f6442d67700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f643c19b0a0 con 0x7f643c101410 2024-06-02T04:48:59.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:59.411+0000 7f6442d67700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f643c19b210 con 0x7f643c104ed0 2024-06-02T04:48:59.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:59.411+0000 7f6442d67700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f643c19b3d0 con 0x7f643c100a50 2024-06-02T04:48:59.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:59.411+0000 7f643bfff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f643c101410 0x7f643c196730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:59.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:59.411+0000 7f643bfff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f643c101410 0x7f643c196730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:33990/0 (socket says 172.21.15.76:33990) 2024-06-02T04:48:59.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:59.411+0000 7f643bfff700 1 -- 172.21.15.76:0/463342033 learned_addr learned my addr 172.21.15.76:0/463342033 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:48:59.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:59.411+0000 7f6440b03700 1 --2- 172.21.15.76:0/463342033 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f643c100a50 0x7f643c1961f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:59.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:59.411+0000 7f6441304700 1 --2- 172.21.15.76:0/463342033 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f643c104ed0 0x7f643c19aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:59.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:59.411+0000 7f643bfff700 1 -- 172.21.15.76:0/463342033 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f643c100a50 msgr2=0x7f643c1961f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:59.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:59.411+0000 7f643bfff700 1 --2- 172.21.15.76:0/463342033 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f643c100a50 0x7f643c1961f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:59.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:59.411+0000 7f643bfff700 1 -- 172.21.15.76:0/463342033 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f643c104ed0 msgr2=0x7f643c19aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:59.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:59.411+0000 7f643bfff700 1 --2- 172.21.15.76:0/463342033 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f643c104ed0 0x7f643c19aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:59.414 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:59.411+0000 7f643bfff700 1 -- 172.21.15.76:0/463342033 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6434009d00 con 0x7f643c101410 2024-06-02T04:48:59.414 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:59.411+0000 7f6440b03700 1 --2- 172.21.15.76:0/463342033 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f643c100a50 0x7f643c1961f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:48:59.414 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:59.411+0000 7f6441304700 1 --2- 172.21.15.76:0/463342033 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f643c104ed0 0x7f643c19aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:48:59.414 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:59.411+0000 7f643bfff700 1 --2- 172.21.15.76:0/463342033 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f643c101410 0x7f643c196730 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f6428007b50 tx=0x7f6428007f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:59.414 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:59.411+0000 7f6439ffb700 1 -- 172.21.15.76:0/463342033 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6428011070 con 0x7f643c101410 2024-06-02T04:48:59.414 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:59.411+0000 7f6442d67700 1 -- 172.21.15.76:0/463342033 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f643c19b6b0 con 0x7f643c101410 2024-06-02T04:48:59.414 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:59.411+0000 7f6439ffb700 1 -- 172.21.15.76:0/463342033 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f642800c2e0 con 0x7f643c101410 2024-06-02T04:48:59.414 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:59.411+0000 7f6439ffb700 1 -- 172.21.15.76:0/463342033 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f642800e5c0 con 0x7f643c101410 2024-06-02T04:48:59.414 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:59.412+0000 7f6442d67700 1 -- 172.21.15.76:0/463342033 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f643c0ffb10 con 0x7f643c101410 2024-06-02T04:48:59.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:59.413+0000 7f6442d67700 1 -- 172.21.15.76:0/463342033 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f643c0684d0 con 0x7f643c101410 2024-06-02T04:48:59.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:59.413+0000 7f6439ffb700 1 -- 172.21.15.76:0/463342033 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f6428004e50 con 0x7f643c101410 2024-06-02T04:48:59.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:59.414+0000 7f6439ffb700 1 --2- 172.21.15.76:0/463342033 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f642c0a11b0 0x7f642c0a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:48:59.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:59.414+0000 7f6440b03700 1 --2- 172.21.15.76:0/463342033 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f642c0a11b0 0x7f642c0a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:48:59.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:59.414+0000 7f6439ffb700 1 -- 172.21.15.76:0/463342033 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f64280ce020 con 0x7f643c101410 2024-06-02T04:48:59.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:59.414+0000 7f6440b03700 1 --2- 172.21.15.76:0/463342033 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f642c0a11b0 0x7f642c0a3670 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f6430005fd0 tx=0x7f6430005e30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:48:59.418 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:59.418+0000 7f6439ffb700 1 -- 172.21.15.76:0/463342033 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f64280974f0 con 0x7f643c101410 2024-06-02T04:48:59.480 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:48:59 smithi076 ceph-mon[42935]: pgmap v246: 129 pgs: 129 active+clean; 639 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2024-06-02T04:48:59.497 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T04:48:59.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:48:59 smithi119 ceph-mon[46633]: pgmap v246: 129 pgs: 129 active+clean; 639 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2024-06-02T04:48:59.624 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:59.624+0000 7f6442d67700 1 -- 172.21.15.76:0/463342033 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f643c1974b0 con 0x7f643c101410 2024-06-02T04:48:59.624 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:59.624+0000 7f6439ffb700 1 -- 172.21.15.76:0/463342033 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f642809ab10 con 0x7f643c101410 2024-06-02T04:48:59.625 INFO:teuthology.orchestra.run.smithi076.stdout:94489280560 2024-06-02T04:48:59.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:59.626+0000 7f6442d67700 1 -- 172.21.15.76:0/463342033 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f642c0a11b0 msgr2=0x7f642c0a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:59.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:59.626+0000 7f6442d67700 1 --2- 172.21.15.76:0/463342033 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f642c0a11b0 0x7f642c0a3670 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f6430005fd0 tx=0x7f6430005e30 comp rx=0 tx=0).stop 2024-06-02T04:48:59.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:59.626+0000 7f6442d67700 1 -- 172.21.15.76:0/463342033 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f643c101410 msgr2=0x7f643c196730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:48:59.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:59.626+0000 7f6442d67700 1 --2- 172.21.15.76:0/463342033 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f643c101410 0x7f643c196730 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f6428007b50 tx=0x7f6428007f10 comp rx=0 tx=0).stop 2024-06-02T04:48:59.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:59.626+0000 7f6442d67700 1 -- 172.21.15.76:0/463342033 shutdown_connections 2024-06-02T04:48:59.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:59.626+0000 7f6442d67700 1 --2- 172.21.15.76:0/463342033 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f642c0a11b0 0x7f642c0a3670 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:59.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:59.626+0000 7f6442d67700 1 --2- 172.21.15.76:0/463342033 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f643c104ed0 0x7f643c19aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:59.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:59.626+0000 7f6442d67700 1 --2- 172.21.15.76:0/463342033 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f643c100a50 0x7f643c1961f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:59.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:59.626+0000 7f6442d67700 1 --2- 172.21.15.76:0/463342033 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f643c101410 0x7f643c196730 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:48:59.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:59.626+0000 7f6442d67700 1 -- 172.21.15.76:0/463342033 >> 172.21.15.76:0/463342033 conn(0x7f643c075260 msgr2=0x7f643c0fd8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:48:59.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:59.626+0000 7f6442d67700 1 -- 172.21.15.76:0/463342033 shutdown_connections 2024-06-02T04:48:59.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:48:59.626+0000 7f6442d67700 1 -- 172.21.15.76:0/463342033 wait complete. 2024-06-02T04:48:59.668 INFO:tasks.cephadm.ceph_manager.ceph:need seq 141733920808 got 141733920809 for osd.5 2024-06-02T04:48:59.668 DEBUG:teuthology.parallel:result is None 2024-06-02T04:48:59.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:48:59 smithi192 ceph-mon[47933]: pgmap v246: 129 pgs: 129 active+clean; 639 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2024-06-02T04:49:00.289 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:00 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/463342033' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-06-02T04:49:00.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:00 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/463342033' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-06-02T04:49:00.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:00 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/463342033' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-06-02T04:49:00.776 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:00.775+0000 7f38adf28700 1 -- 172.21.15.76:0/2581279032 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f38a8100850 msgr2=0x7f38a810ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:00.776 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:00.775+0000 7f38adf28700 1 --2- 172.21.15.76:0/2581279032 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f38a8100850 0x7f38a810ccf0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f38a000b0a0 tx=0x7f38a000b3b0 comp rx=0 tx=0).stop 2024-06-02T04:49:00.777 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:00.775+0000 7f38adf28700 1 -- 172.21.15.76:0/2581279032 shutdown_connections 2024-06-02T04:49:00.777 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:00.775+0000 7f38adf28700 1 --2- 172.21.15.76:0/2581279032 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f38a8100850 0x7f38a810ccf0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:00.777 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:00.775+0000 7f38adf28700 1 --2- 172.21.15.76:0/2581279032 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f38a8105f40 0x7f38a8106320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:00.777 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:00.775+0000 7f38adf28700 1 --2- 172.21.15.76:0/2581279032 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f38a80ffe90 0x7f38a8100310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:00.777 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:00.775+0000 7f38adf28700 1 -- 172.21.15.76:0/2581279032 >> 172.21.15.76:0/2581279032 conn(0x7f38a8076e70 msgr2=0x7f38a8077280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:00.777 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:00.775+0000 7f38adf28700 1 -- 172.21.15.76:0/2581279032 shutdown_connections 2024-06-02T04:49:00.777 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:00.775+0000 7f38adf28700 1 -- 172.21.15.76:0/2581279032 wait complete. 2024-06-02T04:49:00.777 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:00.776+0000 7f38adf28700 1 Processor -- start 2024-06-02T04:49:00.777 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:00.776+0000 7f38adf28700 1 -- start start 2024-06-02T04:49:00.779 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:00.776+0000 7f38adf28700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f38a80ffe90 0x7f38a8198170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:00.779 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:00.776+0000 7f38adf28700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f38a8100850 0x7f38a81986b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:00.779 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:00.776+0000 7f38adf28700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f38a8105f40 0x7f38a81a31f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:00.779 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:00.776+0000 7f38adf28700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38a8198f70 con 0x7f38a8105f40 2024-06-02T04:49:00.779 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:00.776+0000 7f38adf28700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38a81a3730 con 0x7f38a80ffe90 2024-06-02T04:49:00.779 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:00.776+0000 7f38adf28700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38a81a3870 con 0x7f38a8100850 2024-06-02T04:49:00.779 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:00.777+0000 7f38a77fe700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f38a80ffe90 0x7f38a8198170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:00.779 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:00.777+0000 7f38a7fff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f38a8105f40 0x7f38a81a31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:00.779 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:00.777+0000 7f38a77fe700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f38a80ffe90 0x7f38a8198170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:55588/0 (socket says 172.21.15.76:55588) 2024-06-02T04:49:00.780 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:00.777+0000 7f38a77fe700 1 -- 172.21.15.76:0/2348467211 learned_addr learned my addr 172.21.15.76:0/2348467211 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:49:00.780 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:00.777+0000 7f38a6ffd700 1 --2- 172.21.15.76:0/2348467211 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f38a8100850 0x7f38a81986b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:00.780 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:00.777+0000 7f38a77fe700 1 -- 172.21.15.76:0/2348467211 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f38a8100850 msgr2=0x7f38a81986b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:00.780 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:00.777+0000 7f38a77fe700 1 --2- 172.21.15.76:0/2348467211 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f38a8100850 0x7f38a81986b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:00.780 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:00.777+0000 7f38a77fe700 1 -- 172.21.15.76:0/2348467211 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f38a8105f40 msgr2=0x7f38a81a31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:00.780 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:00.777+0000 7f38a77fe700 1 --2- 172.21.15.76:0/2348467211 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f38a8105f40 0x7f38a81a31f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:00.780 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:00.777+0000 7f38a77fe700 1 -- 172.21.15.76:0/2348467211 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38a0009d00 con 0x7f38a80ffe90 2024-06-02T04:49:00.780 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:00.777+0000 7f38a7fff700 1 --2- 172.21.15.76:0/2348467211 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f38a8105f40 0x7f38a81a31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T04:49:00.780 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:00.777+0000 7f38a77fe700 1 --2- 172.21.15.76:0/2348467211 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f38a80ffe90 0x7f38a8198170 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f389000e9a0 tx=0x7f389000ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:00.781 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:00.777+0000 7f38a4ff9700 1 -- 172.21.15.76:0/2348467211 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3890009790 con 0x7f38a80ffe90 2024-06-02T04:49:00.781 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:00.777+0000 7f38adf28700 1 -- 172.21.15.76:0/2348467211 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38a81a3af0 con 0x7f38a80ffe90 2024-06-02T04:49:00.781 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:00.777+0000 7f38a4ff9700 1 -- 172.21.15.76:0/2348467211 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3890010430 con 0x7f38a80ffe90 2024-06-02T04:49:00.781 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:00.777+0000 7f38a4ff9700 1 -- 172.21.15.76:0/2348467211 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f389000cea0 con 0x7f38a80ffe90 2024-06-02T04:49:00.782 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:00.777+0000 7f38adf28700 1 -- 172.21.15.76:0/2348467211 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38a81a3ff0 con 0x7f38a80ffe90 2024-06-02T04:49:00.782 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:00.778+0000 7f38adf28700 1 -- 172.21.15.76:0/2348467211 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38a81083d0 con 0x7f38a80ffe90 2024-06-02T04:49:00.783 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:00.779+0000 7f38a4ff9700 1 -- 172.21.15.76:0/2348467211 <== mon.2 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f38900105a0 con 0x7f38a80ffe90 2024-06-02T04:49:00.783 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:00.780+0000 7f38a4ff9700 1 --2- 172.21.15.76:0/2348467211 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f38940a11b0 0x7f38940a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:00.783 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:00.780+0000 7f38a6ffd700 1 --2- 172.21.15.76:0/2348467211 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f38940a11b0 0x7f38940a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:00.783 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:00.780+0000 7f38a4ff9700 1 -- 172.21.15.76:0/2348467211 <== mon.2 v2:172.21.15.119:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f3890014070 con 0x7f38a80ffe90 2024-06-02T04:49:00.783 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:00.780+0000 7f38a6ffd700 1 --2- 172.21.15.76:0/2348467211 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f38940a11b0 0x7f38940a3670 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f38a80699f0 tx=0x7f3898009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:00.784 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:00.783+0000 7f38a4ff9700 1 -- 172.21.15.76:0/2348467211 <== mon.2 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f38900cce60 con 0x7f38a80ffe90 2024-06-02T04:49:00.992 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:00.992+0000 7f38adf28700 1 -- 172.21.15.76:0/2348467211 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) v1 -- 0x7f38a8101580 con 0x7f38a80ffe90 2024-06-02T04:49:00.993 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:00.992+0000 7f38a4ff9700 1 -- 172.21.15.76:0/2348467211 <== mon.2 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) v1 ==== 75+0+13 (secure 0 0 0) 0x7f3890099c50 con 0x7f38a80ffe90 2024-06-02T04:49:00.993 INFO:teuthology.orchestra.run.smithi076.stdout:274877906969 2024-06-02T04:49:00.995 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:00.995+0000 7f38adf28700 1 -- 172.21.15.76:0/2348467211 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f38940a11b0 msgr2=0x7f38940a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:00.995 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:00.995+0000 7f38adf28700 1 --2- 172.21.15.76:0/2348467211 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f38940a11b0 0x7f38940a3670 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f38a80699f0 tx=0x7f3898009260 comp rx=0 tx=0).stop 2024-06-02T04:49:00.995 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:00.995+0000 7f38adf28700 1 -- 172.21.15.76:0/2348467211 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f38a80ffe90 msgr2=0x7f38a8198170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:00.995 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:00.995+0000 7f38adf28700 1 --2- 172.21.15.76:0/2348467211 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f38a80ffe90 0x7f38a8198170 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f389000e9a0 tx=0x7f389000ecb0 comp rx=0 tx=0).stop 2024-06-02T04:49:00.995 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:00.995+0000 7f38adf28700 1 -- 172.21.15.76:0/2348467211 shutdown_connections 2024-06-02T04:49:00.995 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:00.995+0000 7f38adf28700 1 --2- 172.21.15.76:0/2348467211 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f38a8105f40 0x7f38a81a31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:00.995 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:00.995+0000 7f38adf28700 1 --2- 172.21.15.76:0/2348467211 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f38940a11b0 0x7f38940a3670 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:00.996 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:00.995+0000 7f38adf28700 1 --2- 172.21.15.76:0/2348467211 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f38a80ffe90 0x7f38a8198170 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:00.996 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:00.995+0000 7f38adf28700 1 --2- 172.21.15.76:0/2348467211 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f38a8100850 0x7f38a81986b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:00.996 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:00.995+0000 7f38adf28700 1 -- 172.21.15.76:0/2348467211 >> 172.21.15.76:0/2348467211 conn(0x7f38a8076e70 msgr2=0x7f38a80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:00.996 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:00.995+0000 7f38adf28700 1 -- 172.21.15.76:0/2348467211 shutdown_connections 2024-06-02T04:49:00.996 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:00.995+0000 7f38adf28700 1 -- 172.21.15.76:0/2348467211 wait complete. 2024-06-02T04:49:01.181 INFO:tasks.cephadm.ceph_manager.ceph:need seq 94489280558 got 94489280560 for osd.3 2024-06-02T04:49:01.181 DEBUG:teuthology.parallel:result is None 2024-06-02T04:49:01.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:01.432+0000 7f2c95aa8700 1 -- 172.21.15.76:0/86245268 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2c900ffbc0 msgr2=0x7f2c900fffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:01.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:01.432+0000 7f2c95aa8700 1 --2- 172.21.15.76:0/86245268 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2c900ffbc0 0x7f2c900fffa0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f2c80009990 tx=0x7f2c80009ca0 comp rx=0 tx=0).stop 2024-06-02T04:49:01.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:01.432+0000 7f2c95aa8700 1 -- 172.21.15.76:0/86245268 shutdown_connections 2024-06-02T04:49:01.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:01.432+0000 7f2c95aa8700 1 --2- 172.21.15.76:0/86245268 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2c901063e0 0x7f2c9010dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:01.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:01.432+0000 7f2c95aa8700 1 --2- 172.21.15.76:0/86245268 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2c900ffbc0 0x7f2c900fffa0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:01.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:01.432+0000 7f2c95aa8700 1 --2- 172.21.15.76:0/86245268 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2c90100570 0x7f2c90105cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:01.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:01.432+0000 7f2c95aa8700 1 -- 172.21.15.76:0/86245268 >> 172.21.15.76:0/86245268 conn(0x7f2c90075190 msgr2=0x7f2c900755a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:01.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:01.432+0000 7f2c95aa8700 1 -- 172.21.15.76:0/86245268 shutdown_connections 2024-06-02T04:49:01.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:01.432+0000 7f2c95aa8700 1 -- 172.21.15.76:0/86245268 wait complete. 2024-06-02T04:49:01.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:01.433+0000 7f2c95aa8700 1 Processor -- start 2024-06-02T04:49:01.436 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:01.433+0000 7f2c95aa8700 1 -- start start 2024-06-02T04:49:01.436 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:01.433+0000 7f2c95aa8700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2c900ffbc0 0x7f2c90197320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:01.436 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:01.433+0000 7f2c95aa8700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2c90100570 0x7f2c90197860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:01.436 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:01.433+0000 7f2c95aa8700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2c901063e0 0x7f2c9019bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:01.436 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:01.433+0000 7f2c95aa8700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c9019c220 con 0x7f2c90100570 2024-06-02T04:49:01.436 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:01.433+0000 7f2c95aa8700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c9019c390 con 0x7f2c900ffbc0 2024-06-02T04:49:01.436 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:01.433+0000 7f2c95aa8700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c9019c550 con 0x7f2c901063e0 2024-06-02T04:49:01.436 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:01.433+0000 7f2c8effd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2c90100570 0x7f2c90197860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:01.436 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:01.433+0000 7f2c8effd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2c90100570 0x7f2c90197860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:34036/0 (socket says 172.21.15.76:34036) 2024-06-02T04:49:01.436 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:01.433+0000 7f2c8effd700 1 -- 172.21.15.76:0/4158521513 learned_addr learned my addr 172.21.15.76:0/4158521513 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:49:01.436 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:01.433+0000 7f2c8f7fe700 1 --2- 172.21.15.76:0/4158521513 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2c900ffbc0 0x7f2c90197320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:01.437 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:01.433+0000 7f2c8ffff700 1 --2- 172.21.15.76:0/4158521513 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2c901063e0 0x7f2c9019bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:01.437 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:01.434+0000 7f2c8effd700 1 -- 172.21.15.76:0/4158521513 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2c901063e0 msgr2=0x7f2c9019bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:01.437 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:01.434+0000 7f2c8effd700 1 --2- 172.21.15.76:0/4158521513 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2c901063e0 0x7f2c9019bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:01.437 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:01.434+0000 7f2c8effd700 1 -- 172.21.15.76:0/4158521513 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2c900ffbc0 msgr2=0x7f2c90197320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:01.437 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:01.434+0000 7f2c8effd700 1 --2- 172.21.15.76:0/4158521513 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2c900ffbc0 0x7f2c90197320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:01.437 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:01.434+0000 7f2c8effd700 1 -- 172.21.15.76:0/4158521513 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c800095f0 con 0x7f2c90100570 2024-06-02T04:49:01.437 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:01.434+0000 7f2c8effd700 1 --2- 172.21.15.76:0/4158521513 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2c90100570 0x7f2c90197860 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f2c8400d950 tx=0x7f2c8400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:01.437 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:01.434+0000 7f2c8cff9700 1 -- 172.21.15.76:0/4158521513 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c84009940 con 0x7f2c90100570 2024-06-02T04:49:01.437 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:01.434+0000 7f2c8cff9700 1 -- 172.21.15.76:0/4158521513 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2c84010460 con 0x7f2c90100570 2024-06-02T04:49:01.437 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:01.434+0000 7f2c95aa8700 1 -- 172.21.15.76:0/4158521513 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c9019c830 con 0x7f2c90100570 2024-06-02T04:49:01.437 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:01.434+0000 7f2c8cff9700 1 -- 172.21.15.76:0/4158521513 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c8400f620 con 0x7f2c90100570 2024-06-02T04:49:01.437 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:01.434+0000 7f2c95aa8700 1 -- 172.21.15.76:0/4158521513 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c901a4090 con 0x7f2c90100570 2024-06-02T04:49:01.437 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:01.435+0000 7f2c95aa8700 1 -- 172.21.15.76:0/4158521513 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c901095c0 con 0x7f2c90100570 2024-06-02T04:49:01.438 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:01.436+0000 7f2c8cff9700 1 -- 172.21.15.76:0/4158521513 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f2c840105d0 con 0x7f2c90100570 2024-06-02T04:49:01.438 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:01.437+0000 7f2c8cff9700 1 --2- 172.21.15.76:0/4158521513 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f2c780a11b0 0x7f2c780a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:01.438 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:01.437+0000 7f2c8f7fe700 1 --2- 172.21.15.76:0/4158521513 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f2c780a11b0 0x7f2c780a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:01.439 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:01.437+0000 7f2c8cff9700 1 -- 172.21.15.76:0/4158521513 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f2c840cca90 con 0x7f2c90100570 2024-06-02T04:49:01.439 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:01.437+0000 7f2c8f7fe700 1 --2- 172.21.15.76:0/4158521513 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f2c780a11b0 0x7f2c780a3670 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2c8000b5c0 tx=0x7f2c80005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:01.439 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:01 smithi076 ceph-mon[42935]: pgmap v247: 129 pgs: 129 active+clean; 639 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 255 B/s wr, 6 op/s 2024-06-02T04:49:01.439 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:01 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:49:01.439 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:01 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/2348467211' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-06-02T04:49:01.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:01.441+0000 7f2c8cff9700 1 -- 172.21.15.76:0/4158521513 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f2c84095ed0 con 0x7f2c90100570 2024-06-02T04:49:01.593 INFO:tasks.cephadm.ceph_manager.ceph:need seq 274877906967 got 274877906969 for osd.10 2024-06-02T04:49:01.593 DEBUG:teuthology.parallel:result is None 2024-06-02T04:49:01.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:01 smithi119 ceph-mon[46633]: pgmap v247: 129 pgs: 129 active+clean; 639 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 255 B/s wr, 6 op/s 2024-06-02T04:49:01.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:01 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:49:01.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:01 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/2348467211' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-06-02T04:49:01.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:01 smithi192 ceph-mon[47933]: pgmap v247: 129 pgs: 129 active+clean; 639 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 255 B/s wr, 6 op/s 2024-06-02T04:49:01.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:01 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:49:01.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:01 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/2348467211' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-06-02T04:49:01.684 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:01.683+0000 7f2c95aa8700 1 -- 172.21.15.76:0/4158521513 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) v1 -- 0x7f2c900690b0 con 0x7f2c90100570 2024-06-02T04:49:01.684 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:01.684+0000 7f2c8cff9700 1 -- 172.21.15.76:0/4158521513 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) v1 ==== 75+0+13 (secure 0 0 0) 0x7f2c84016090 con 0x7f2c90100570 2024-06-02T04:49:01.684 INFO:teuthology.orchestra.run.smithi076.stdout:304942678036 2024-06-02T04:49:01.686 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:01.686+0000 7f2c95aa8700 1 -- 172.21.15.76:0/4158521513 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f2c780a11b0 msgr2=0x7f2c780a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:01.686 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:01.686+0000 7f2c95aa8700 1 --2- 172.21.15.76:0/4158521513 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f2c780a11b0 0x7f2c780a3670 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2c8000b5c0 tx=0x7f2c80005fb0 comp rx=0 tx=0).stop 2024-06-02T04:49:01.687 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:01.686+0000 7f2c95aa8700 1 -- 172.21.15.76:0/4158521513 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2c90100570 msgr2=0x7f2c90197860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:01.687 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:01.686+0000 7f2c95aa8700 1 --2- 172.21.15.76:0/4158521513 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2c90100570 0x7f2c90197860 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f2c8400d950 tx=0x7f2c8400dc60 comp rx=0 tx=0).stop 2024-06-02T04:49:01.687 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:01.686+0000 7f2c95aa8700 1 -- 172.21.15.76:0/4158521513 shutdown_connections 2024-06-02T04:49:01.687 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:01.686+0000 7f2c95aa8700 1 --2- 172.21.15.76:0/4158521513 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2c901063e0 0x7f2c9019bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:01.687 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:01.686+0000 7f2c95aa8700 1 --2- 172.21.15.76:0/4158521513 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f2c780a11b0 0x7f2c780a3670 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:01.687 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:01.686+0000 7f2c95aa8700 1 --2- 172.21.15.76:0/4158521513 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2c900ffbc0 0x7f2c90197320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:01.687 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:01.686+0000 7f2c95aa8700 1 --2- 172.21.15.76:0/4158521513 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2c90100570 0x7f2c90197860 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:01.687 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:01.686+0000 7f2c95aa8700 1 -- 172.21.15.76:0/4158521513 >> 172.21.15.76:0/4158521513 conn(0x7f2c90075190 msgr2=0x7f2c900fdda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:01.687 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:01.686+0000 7f2c95aa8700 1 -- 172.21.15.76:0/4158521513 shutdown_connections 2024-06-02T04:49:01.687 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:01.686+0000 7f2c95aa8700 1 -- 172.21.15.76:0/4158521513 wait complete. 2024-06-02T04:49:01.731 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:01.730+0000 7f281a756700 1 -- 172.21.15.76:0/4255935697 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2814107020 msgr2=0x7f2814107400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:01.731 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:01.730+0000 7f281a756700 1 --2- 172.21.15.76:0/4255935697 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2814107020 0x7f2814107400 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f28080099c0 tx=0x7f2808009cd0 comp rx=0 tx=0).stop 2024-06-02T04:49:01.731 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:01.730+0000 7f281a756700 1 -- 172.21.15.76:0/4255935697 shutdown_connections 2024-06-02T04:49:01.731 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:01.730+0000 7f281a756700 1 --2- 172.21.15.76:0/4255935697 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f28140692f0 0x7f281410de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:01.731 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:01.730+0000 7f281a756700 1 --2- 172.21.15.76:0/4255935697 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2814107020 0x7f2814107400 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:01.731 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:01.730+0000 7f281a756700 1 --2- 172.21.15.76:0/4255935697 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2814068950 0x7f2814068db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:01.731 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:01.730+0000 7f281a756700 1 -- 172.21.15.76:0/4255935697 >> 172.21.15.76:0/4255935697 conn(0x7f2814075f80 msgr2=0x7f2814076390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:01.731 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:01.730+0000 7f281a756700 1 -- 172.21.15.76:0/4255935697 shutdown_connections 2024-06-02T04:49:01.732 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:01.730+0000 7f281a756700 1 -- 172.21.15.76:0/4255935697 wait complete. 2024-06-02T04:49:01.732 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:01.731+0000 7f281a756700 1 Processor -- start 2024-06-02T04:49:01.732 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:01.731+0000 7f281a756700 1 -- start start 2024-06-02T04:49:01.733 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:01.731+0000 7f281a756700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2814068950 0x7f2814197300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:01.734 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:01.731+0000 7f281a756700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f28140692f0 0x7f2814197840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:01.734 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:01.731+0000 7f281a756700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2814107020 0x7f281419bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:01.734 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:01.731+0000 7f281a756700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f281419c200 con 0x7f28140692f0 2024-06-02T04:49:01.734 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:01.731+0000 7f281a756700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f281419c370 con 0x7f2814068950 2024-06-02T04:49:01.734 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:01.731+0000 7f281a756700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f281419c530 con 0x7f2814107020 2024-06-02T04:49:01.734 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:01.731+0000 7f28137fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f28140692f0 0x7f2814197840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:01.734 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:01.731+0000 7f28137fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f28140692f0 0x7f2814197840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:34066/0 (socket says 172.21.15.76:34066) 2024-06-02T04:49:01.734 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:01.731+0000 7f28137fe700 1 -- 172.21.15.76:0/1134270231 learned_addr learned my addr 172.21.15.76:0/1134270231 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:49:01.734 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:01.731+0000 7f2818cf3700 1 --2- 172.21.15.76:0/1134270231 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2814107020 0x7f281419bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:01.734 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:01.731+0000 7f2813fff700 1 --2- 172.21.15.76:0/1134270231 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2814068950 0x7f2814197300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:01.734 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:01.732+0000 7f28137fe700 1 -- 172.21.15.76:0/1134270231 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2814107020 msgr2=0x7f281419bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:01.734 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:01.732+0000 7f28137fe700 1 --2- 172.21.15.76:0/1134270231 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2814107020 0x7f281419bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:01.735 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:01.732+0000 7f28137fe700 1 -- 172.21.15.76:0/1134270231 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2814068950 msgr2=0x7f2814197300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:01.735 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:01.732+0000 7f28137fe700 1 --2- 172.21.15.76:0/1134270231 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2814068950 0x7f2814197300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:01.735 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:01.732+0000 7f28137fe700 1 -- 172.21.15.76:0/1134270231 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28080095f0 con 0x7f28140692f0 2024-06-02T04:49:01.735 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:01.732+0000 7f28137fe700 1 --2- 172.21.15.76:0/1134270231 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f28140692f0 0x7f2814197840 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f280400b530 tx=0x7f280400b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:01.735 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:01.732+0000 7f28117fa700 1 -- 172.21.15.76:0/1134270231 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2804011830 con 0x7f28140692f0 2024-06-02T04:49:01.735 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:01.732+0000 7f28117fa700 1 -- 172.21.15.76:0/1134270231 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2804011e20 con 0x7f28140692f0 2024-06-02T04:49:01.735 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:01.732+0000 7f281a756700 1 -- 172.21.15.76:0/1134270231 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f281419c810 con 0x7f28140692f0 2024-06-02T04:49:01.735 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:01.732+0000 7f28117fa700 1 -- 172.21.15.76:0/1134270231 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f280400f2e0 con 0x7f28140692f0 2024-06-02T04:49:01.735 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:01.732+0000 7f281a756700 1 -- 172.21.15.76:0/1134270231 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28141000a0 con 0x7f28140692f0 2024-06-02T04:49:01.735 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:01.733+0000 7f281a756700 1 -- 172.21.15.76:0/1134270231 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2814109540 con 0x7f28140692f0 2024-06-02T04:49:01.736 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:01.734+0000 7f28117fa700 1 -- 172.21.15.76:0/1134270231 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f2804011990 con 0x7f28140692f0 2024-06-02T04:49:01.736 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:01.735+0000 7f28117fa700 1 --2- 172.21.15.76:0/1134270231 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f27fc0a1230 0x7f27fc0a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:01.736 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:01.735+0000 7f2813fff700 1 --2- 172.21.15.76:0/1134270231 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f27fc0a1230 0x7f27fc0a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:01.736 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:01.735+0000 7f28117fa700 1 -- 172.21.15.76:0/1134270231 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f28040cca80 con 0x7f28140692f0 2024-06-02T04:49:01.736 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:01.735+0000 7f2813fff700 1 --2- 172.21.15.76:0/1134270231 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f27fc0a1230 0x7f27fc0a36f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2808009fd0 tx=0x7f2808005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:01.738 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:01.738+0000 7f28117fa700 1 -- 172.21.15.76:0/1134270231 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f2804095f70 con 0x7f28140692f0 2024-06-02T04:49:01.942 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:01.942+0000 7f281a756700 1 -- 172.21.15.76:0/1134270231 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f28141026d0 con 0x7f28140692f0 2024-06-02T04:49:01.943 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:01.943+0000 7f28117fa700 1 -- 172.21.15.76:0/1134270231 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2804015090 con 0x7f28140692f0 2024-06-02T04:49:01.943 INFO:teuthology.orchestra.run.smithi076.stdout:171798691878 2024-06-02T04:49:01.945 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:01.945+0000 7f281a756700 1 -- 172.21.15.76:0/1134270231 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f27fc0a1230 msgr2=0x7f27fc0a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:01.945 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:01.945+0000 7f281a756700 1 --2- 172.21.15.76:0/1134270231 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f27fc0a1230 0x7f27fc0a36f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2808009fd0 tx=0x7f2808005fb0 comp rx=0 tx=0).stop 2024-06-02T04:49:01.945 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:01.945+0000 7f281a756700 1 -- 172.21.15.76:0/1134270231 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f28140692f0 msgr2=0x7f2814197840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:01.945 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:01.945+0000 7f281a756700 1 --2- 172.21.15.76:0/1134270231 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f28140692f0 0x7f2814197840 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f280400b530 tx=0x7f280400b840 comp rx=0 tx=0).stop 2024-06-02T04:49:01.945 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:01.945+0000 7f281a756700 1 -- 172.21.15.76:0/1134270231 shutdown_connections 2024-06-02T04:49:01.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:01.945+0000 7f281a756700 1 --2- 172.21.15.76:0/1134270231 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2814107020 0x7f281419bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:01.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:01.945+0000 7f281a756700 1 --2- 172.21.15.76:0/1134270231 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f27fc0a1230 0x7f27fc0a36f0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:01.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:01.945+0000 7f281a756700 1 --2- 172.21.15.76:0/1134270231 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2814068950 0x7f2814197300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:01.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:01.945+0000 7f281a756700 1 --2- 172.21.15.76:0/1134270231 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f28140692f0 0x7f2814197840 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:01.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:01.945+0000 7f281a756700 1 -- 172.21.15.76:0/1134270231 >> 172.21.15.76:0/1134270231 conn(0x7f2814075f80 msgr2=0x7f28140fee40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:01.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:01.945+0000 7f281a756700 1 -- 172.21.15.76:0/1134270231 shutdown_connections 2024-06-02T04:49:01.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:01.945+0000 7f281a756700 1 -- 172.21.15.76:0/1134270231 wait complete. 2024-06-02T04:49:02.464 INFO:tasks.cephadm.ceph_manager.ceph:need seq 171798691876 got 171798691878 for osd.6 2024-06-02T04:49:02.464 DEBUG:teuthology.parallel:result is None 2024-06-02T04:49:02.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:02 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:49:02.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:02 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:49:02.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:02 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:49:02.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:02 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:49:02.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:02 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/4158521513' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-06-02T04:49:02.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:02 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/1134270231' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-06-02T04:49:02.625 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:02.624+0000 7f8eb2e22700 1 -- 172.21.15.76:0/1412911053 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8eac107020 msgr2=0x7f8eac107400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:02.626 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:02.624+0000 7f8eb2e22700 1 --2- 172.21.15.76:0/1412911053 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8eac107020 0x7f8eac107400 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f8ea00099c0 tx=0x7f8ea0009cd0 comp rx=0 tx=0).stop 2024-06-02T04:49:02.626 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:02.624+0000 7f8eb2e22700 1 -- 172.21.15.76:0/1412911053 shutdown_connections 2024-06-02T04:49:02.626 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:02.624+0000 7f8eb2e22700 1 --2- 172.21.15.76:0/1412911053 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8eac0692f0 0x7f8eac10de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:02.626 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:02.624+0000 7f8eb2e22700 1 --2- 172.21.15.76:0/1412911053 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8eac107020 0x7f8eac107400 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:02.626 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:02.624+0000 7f8eb2e22700 1 --2- 172.21.15.76:0/1412911053 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8eac068950 0x7f8eac068db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:02.626 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:02.624+0000 7f8eb2e22700 1 -- 172.21.15.76:0/1412911053 >> 172.21.15.76:0/1412911053 conn(0x7f8eac075f80 msgr2=0x7f8eac076390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:02.626 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:02.624+0000 7f8eb2e22700 1 -- 172.21.15.76:0/1412911053 shutdown_connections 2024-06-02T04:49:02.626 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:02.624+0000 7f8eb2e22700 1 -- 172.21.15.76:0/1412911053 wait complete. 2024-06-02T04:49:02.626 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:02.625+0000 7f8eb2e22700 1 Processor -- start 2024-06-02T04:49:02.626 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:02.625+0000 7f8eb2e22700 1 -- start start 2024-06-02T04:49:02.626 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:02.625+0000 7f8eb2e22700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8eac068950 0x7f8eac1972c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:02.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:02.625+0000 7f8eb2e22700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8eac0692f0 0x7f8eac197800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:02.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:02.625+0000 7f8eb2e22700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8eac107020 0x7f8eac19bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:02.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:02.625+0000 7f8eb2e22700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eac19c1c0 con 0x7f8eac107020 2024-06-02T04:49:02.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:02.625+0000 7f8eb2e22700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eac19c330 con 0x7f8eac0692f0 2024-06-02T04:49:02.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:02.625+0000 7f8eb2e22700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eac19c4f0 con 0x7f8eac068950 2024-06-02T04:49:02.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:02.625+0000 7f8eb13bf700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8eac107020 0x7f8eac19bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:02.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:02.625+0000 7f8eb13bf700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8eac107020 0x7f8eac19bbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:54142/0 (socket says 172.21.15.76:54142) 2024-06-02T04:49:02.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:02.625+0000 7f8eb13bf700 1 -- 172.21.15.76:0/4203028555 learned_addr learned my addr 172.21.15.76:0/4203028555 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:49:02.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:02.625+0000 7f8eabfff700 1 --2- 172.21.15.76:0/4203028555 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8eac0692f0 0x7f8eac197800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:02.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:02.625+0000 7f8eb0bbe700 1 --2- 172.21.15.76:0/4203028555 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8eac068950 0x7f8eac1972c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:02.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:02.625+0000 7f8eb13bf700 1 -- 172.21.15.76:0/4203028555 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8eac068950 msgr2=0x7f8eac1972c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:02.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:02.625+0000 7f8eb13bf700 1 --2- 172.21.15.76:0/4203028555 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8eac068950 0x7f8eac1972c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:02.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:02.625+0000 7f8eb13bf700 1 -- 172.21.15.76:0/4203028555 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8eac0692f0 msgr2=0x7f8eac197800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:02.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:02.625+0000 7f8eb13bf700 1 --2- 172.21.15.76:0/4203028555 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8eac0692f0 0x7f8eac197800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:02.628 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:02.625+0000 7f8eb13bf700 1 -- 172.21.15.76:0/4203028555 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ea00095f0 con 0x7f8eac107020 2024-06-02T04:49:02.628 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:02.626+0000 7f8eb13bf700 1 --2- 172.21.15.76:0/4203028555 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8eac107020 0x7f8eac19bbb0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f8ea400ada0 tx=0x7f8ea400c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:02.629 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:02.626+0000 7f8ea9ffb700 1 -- 172.21.15.76:0/4203028555 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea400f070 con 0x7f8eac107020 2024-06-02T04:49:02.629 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:02.626+0000 7f8ea9ffb700 1 -- 172.21.15.76:0/4203028555 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8ea4007b30 con 0x7f8eac107020 2024-06-02T04:49:02.629 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:02.626+0000 7f8eb2e22700 1 -- 172.21.15.76:0/4203028555 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8eac19c7d0 con 0x7f8eac107020 2024-06-02T04:49:02.629 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:02.626+0000 7f8ea9ffb700 1 -- 172.21.15.76:0/4203028555 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea4005280 con 0x7f8eac107020 2024-06-02T04:49:02.629 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:02.626+0000 7f8eb2e22700 1 -- 172.21.15.76:0/4203028555 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8eac1a4030 con 0x7f8eac107020 2024-06-02T04:49:02.629 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:02.627+0000 7f8eb2e22700 1 -- 172.21.15.76:0/4203028555 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8eac109540 con 0x7f8eac107020 2024-06-02T04:49:02.629 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:02.628+0000 7f8ea9ffb700 1 -- 172.21.15.76:0/4203028555 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f8ea400c8d0 con 0x7f8eac107020 2024-06-02T04:49:02.629 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:02.628+0000 7f8ea9ffb700 1 --2- 172.21.15.76:0/4203028555 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f8e9c0a11b0 0x7f8e9c0a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:02.629 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:02.628+0000 7f8eb0bbe700 1 --2- 172.21.15.76:0/4203028555 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f8e9c0a11b0 0x7f8e9c0a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:02.629 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:02.628+0000 7f8ea9ffb700 1 -- 172.21.15.76:0/4203028555 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f8ea40cc150 con 0x7f8eac107020 2024-06-02T04:49:02.630 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:02.629+0000 7f8eb0bbe700 1 --2- 172.21.15.76:0/4203028555 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f8e9c0a11b0 0x7f8e9c0a3670 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f8ea0000c00 tx=0x7f8ea0009f10 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:02.633 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:02.633+0000 7f8ea9ffb700 1 -- 172.21.15.76:0/4203028555 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f8ea4095620 con 0x7f8eac107020 2024-06-02T04:49:02.658 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:02 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:49:02.658 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:02 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:49:02.658 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:02 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:49:02.658 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:02 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:49:02.658 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:02 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/4158521513' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-06-02T04:49:02.658 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:02 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/1134270231' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-06-02T04:49:02.676 INFO:tasks.cephadm.ceph_manager.ceph:need seq 304942678034 got 304942678036 for osd.11 2024-06-02T04:49:02.676 DEBUG:teuthology.parallel:result is None 2024-06-02T04:49:02.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:02 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:49:02.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:02 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:49:02.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:02 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:49:02.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:02 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:49:02.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:02 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/4158521513' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-06-02T04:49:02.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:02 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/1134270231' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-06-02T04:49:02.853 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:02.853+0000 7f8eb2e22700 1 -- 172.21.15.76:0/4203028555 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8eac1985d0 con 0x7f8eac107020 2024-06-02T04:49:02.853 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:02.853+0000 7f8ea9ffb700 1 -- 172.21.15.76:0/4203028555 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8ea4098c40 con 0x7f8eac107020 2024-06-02T04:49:02.853 INFO:teuthology.orchestra.run.smithi076.stdout:68719476789 2024-06-02T04:49:02.856 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:02.856+0000 7f8eb2e22700 1 -- 172.21.15.76:0/4203028555 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f8e9c0a11b0 msgr2=0x7f8e9c0a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:02.856 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:02.856+0000 7f8eb2e22700 1 --2- 172.21.15.76:0/4203028555 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f8e9c0a11b0 0x7f8e9c0a3670 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f8ea0000c00 tx=0x7f8ea0009f10 comp rx=0 tx=0).stop 2024-06-02T04:49:02.856 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:02.856+0000 7f8eb2e22700 1 -- 172.21.15.76:0/4203028555 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8eac107020 msgr2=0x7f8eac19bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:02.856 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:02.856+0000 7f8eb2e22700 1 --2- 172.21.15.76:0/4203028555 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8eac107020 0x7f8eac19bbb0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f8ea400ada0 tx=0x7f8ea400c330 comp rx=0 tx=0).stop 2024-06-02T04:49:02.856 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:02.856+0000 7f8eb2e22700 1 -- 172.21.15.76:0/4203028555 shutdown_connections 2024-06-02T04:49:02.856 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:02.856+0000 7f8eb2e22700 1 --2- 172.21.15.76:0/4203028555 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8eac107020 0x7f8eac19bbb0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:02.856 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:02.856+0000 7f8eb2e22700 1 --2- 172.21.15.76:0/4203028555 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8eac068950 0x7f8eac1972c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:02.857 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:02.856+0000 7f8eb2e22700 1 --2- 172.21.15.76:0/4203028555 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f8e9c0a11b0 0x7f8e9c0a3670 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:02.857 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:02.856+0000 7f8eb2e22700 1 --2- 172.21.15.76:0/4203028555 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8eac0692f0 0x7f8eac197800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:02.857 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:02.856+0000 7f8eb2e22700 1 -- 172.21.15.76:0/4203028555 >> 172.21.15.76:0/4203028555 conn(0x7f8eac075f80 msgr2=0x7f8eac0fee30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:02.857 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:02.856+0000 7f8eb2e22700 1 -- 172.21.15.76:0/4203028555 shutdown_connections 2024-06-02T04:49:02.857 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:02.856+0000 7f8eb2e22700 1 -- 172.21.15.76:0/4203028555 wait complete. 2024-06-02T04:49:03.241 INFO:tasks.cephadm.ceph_manager.ceph:need seq 68719476786 got 68719476789 for osd.2 2024-06-02T04:49:03.242 DEBUG:teuthology.parallel:result is None 2024-06-02T04:49:03.242 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-06-02T04:49:03.242 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell --fsid 60ab6d30-209a-11ef-bc9b-c7b262605968 -- ceph pg dump --format=json 2024-06-02T04:49:03.524 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T04:49:03.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:03 smithi119 ceph-mon[46633]: pgmap v248: 129 pgs: 129 active+clean; 639 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 5 op/s 2024-06-02T04:49:03.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:03 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/4203028555' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-06-02T04:49:03.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:03 smithi192 ceph-mon[47933]: pgmap v248: 129 pgs: 129 active+clean; 639 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 5 op/s 2024-06-02T04:49:03.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:03 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/4203028555' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-06-02T04:49:03.721 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:03 smithi076 ceph-mon[42935]: pgmap v248: 129 pgs: 129 active+clean; 639 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 5 op/s 2024-06-02T04:49:03.721 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:03 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/4203028555' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-06-02T04:49:04.591 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:04.591+0000 7f15ba271700 1 -- 172.21.15.76:0/3169122384 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f15b40692f0 msgr2=0x7f15b410de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:04.591 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:04.591+0000 7f15ba271700 1 --2- 172.21.15.76:0/3169122384 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f15b40692f0 0x7f15b410de60 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f15ac00b0a0 tx=0x7f15ac00b3b0 comp rx=0 tx=0).stop 2024-06-02T04:49:04.591 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:04.591+0000 7f15ba271700 1 -- 172.21.15.76:0/3169122384 shutdown_connections 2024-06-02T04:49:04.592 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:04.591+0000 7f15ba271700 1 --2- 172.21.15.76:0/3169122384 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f15b40692f0 0x7f15b410de60 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:04.592 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:04.591+0000 7f15ba271700 1 --2- 172.21.15.76:0/3169122384 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f15b4107020 0x7f15b4107400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:04.592 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:04.591+0000 7f15ba271700 1 --2- 172.21.15.76:0/3169122384 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15b4068950 0x7f15b4068db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:04.592 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:04.591+0000 7f15ba271700 1 -- 172.21.15.76:0/3169122384 >> 172.21.15.76:0/3169122384 conn(0x7f15b4075f80 msgr2=0x7f15b4076390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:04.592 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:04.591+0000 7f15ba271700 1 -- 172.21.15.76:0/3169122384 shutdown_connections 2024-06-02T04:49:04.592 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:04.591+0000 7f15ba271700 1 -- 172.21.15.76:0/3169122384 wait complete. 2024-06-02T04:49:04.594 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:04.591+0000 7f15ba271700 1 Processor -- start 2024-06-02T04:49:04.594 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:04.592+0000 7f15ba271700 1 -- start start 2024-06-02T04:49:04.594 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:04.592+0000 7f15ba271700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15b4068950 0x7f15b41995a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:04.594 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:04.592+0000 7f15ba271700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f15b40692f0 0x7f15b4199ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:04.594 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:04.592+0000 7f15ba271700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f15b4107020 0x7f15b419de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:04.594 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:04.592+0000 7f15ba271700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15b419e4a0 con 0x7f15b40692f0 2024-06-02T04:49:04.594 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:04.592+0000 7f15ba271700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15b419e610 con 0x7f15b4068950 2024-06-02T04:49:04.594 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:04.592+0000 7f15ba271700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15b419e7d0 con 0x7f15b4107020 2024-06-02T04:49:04.595 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:04.592+0000 7f15b37fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f15b40692f0 0x7f15b4199ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:04.595 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:04.592+0000 7f15b37fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f15b40692f0 0x7f15b4199ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:54158/0 (socket says 172.21.15.76:54158) 2024-06-02T04:49:04.595 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:04.592+0000 7f15b37fe700 1 -- 172.21.15.76:0/2032477307 learned_addr learned my addr 172.21.15.76:0/2032477307 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:49:04.595 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:04.592+0000 7f15b880e700 1 --2- 172.21.15.76:0/2032477307 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f15b4107020 0x7f15b419de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:04.595 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:04.592+0000 7f15b3fff700 1 --2- 172.21.15.76:0/2032477307 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15b4068950 0x7f15b41995a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:04.595 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:04.592+0000 7f15b37fe700 1 -- 172.21.15.76:0/2032477307 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f15b4107020 msgr2=0x7f15b419de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:04.595 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:04.592+0000 7f15b37fe700 1 --2- 172.21.15.76:0/2032477307 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f15b4107020 0x7f15b419de90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:04.595 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:04.592+0000 7f15b37fe700 1 -- 172.21.15.76:0/2032477307 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15b4068950 msgr2=0x7f15b41995a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:04.595 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:04.592+0000 7f15b37fe700 1 --2- 172.21.15.76:0/2032477307 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15b4068950 0x7f15b41995a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:04.595 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:04.592+0000 7f15b37fe700 1 -- 172.21.15.76:0/2032477307 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15ac009d00 con 0x7f15b40692f0 2024-06-02T04:49:04.595 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:04.592+0000 7f15b880e700 1 --2- 172.21.15.76:0/2032477307 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f15b4107020 0x7f15b419de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:49:04.595 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:04.592+0000 7f15b37fe700 1 --2- 172.21.15.76:0/2032477307 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f15b40692f0 0x7f15b4199ae0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f15a400e9a0 tx=0x7f15a400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:04.596 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:04.593+0000 7f15b17fa700 1 -- 172.21.15.76:0/2032477307 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a4009790 con 0x7f15b40692f0 2024-06-02T04:49:04.596 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:04.593+0000 7f15b17fa700 1 -- 172.21.15.76:0/2032477307 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f15a400cbd0 con 0x7f15b40692f0 2024-06-02T04:49:04.596 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:04.593+0000 7f15ba271700 1 -- 172.21.15.76:0/2032477307 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15b419eab0 con 0x7f15b40692f0 2024-06-02T04:49:04.596 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:04.593+0000 7f15b17fa700 1 -- 172.21.15.76:0/2032477307 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a4018680 con 0x7f15b40692f0 2024-06-02T04:49:04.596 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:04.593+0000 7f15ba271700 1 -- 172.21.15.76:0/2032477307 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15b41a6310 con 0x7f15b40692f0 2024-06-02T04:49:04.596 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:04.594+0000 7f15ba271700 1 -- 172.21.15.76:0/2032477307 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15b41026d0 con 0x7f15b40692f0 2024-06-02T04:49:04.597 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:04.595+0000 7f15b17fa700 1 -- 172.21.15.76:0/2032477307 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f15a400cd40 con 0x7f15b40692f0 2024-06-02T04:49:04.597 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:04.595+0000 7f15b17fa700 1 --2- 172.21.15.76:0/2032477307 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f159c0a1230 0x7f159c0a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:04.597 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:04.596+0000 7f15b3fff700 1 --2- 172.21.15.76:0/2032477307 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f159c0a1230 0x7f159c0a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:04.597 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:04.596+0000 7f15b17fa700 1 -- 172.21.15.76:0/2032477307 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f15a4014070 con 0x7f15b40692f0 2024-06-02T04:49:04.597 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:04.596+0000 7f15b3fff700 1 --2- 172.21.15.76:0/2032477307 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f159c0a1230 0x7f159c0a36f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f15a8005fd0 tx=0x7f15a8005ce0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:04.599 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:04.599+0000 7f15b17fa700 1 -- 172.21.15.76:0/2032477307 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f15a4096530 con 0x7f15b40692f0 2024-06-02T04:49:04.790 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:04.790+0000 7f15ba271700 1 -- 172.21.15.76:0/2032477307 --> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f15b4110d30 con 0x7f159c0a1230 2024-06-02T04:49:04.802 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:04.802+0000 7f15b17fa700 1 -- 172.21.15.76:0/2032477307 <== mgr.14152 v2:172.21.15.76:6800/2591353090 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+422946 (secure 0 0 0) 0x7f15b4110d30 con 0x7f159c0a1230 2024-06-02T04:49:04.808 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:49:04.811 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:04.806+0000 7f15ba271700 1 -- 172.21.15.76:0/2032477307 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f159c0a1230 msgr2=0x7f159c0a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:04.811 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:04.806+0000 7f15ba271700 1 --2- 172.21.15.76:0/2032477307 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f159c0a1230 0x7f159c0a36f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f15a8005fd0 tx=0x7f15a8005ce0 comp rx=0 tx=0).stop 2024-06-02T04:49:04.811 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:04.806+0000 7f15ba271700 1 -- 172.21.15.76:0/2032477307 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f15b40692f0 msgr2=0x7f15b4199ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:04.811 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:04.806+0000 7f15ba271700 1 --2- 172.21.15.76:0/2032477307 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f15b40692f0 0x7f15b4199ae0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f15a400e9a0 tx=0x7f15a400ed60 comp rx=0 tx=0).stop 2024-06-02T04:49:04.812 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:04.806+0000 7f15ba271700 1 -- 172.21.15.76:0/2032477307 shutdown_connections 2024-06-02T04:49:04.812 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:04.806+0000 7f15ba271700 1 --2- 172.21.15.76:0/2032477307 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f15b4107020 0x7f15b419de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:04.812 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:04.806+0000 7f15ba271700 1 --2- 172.21.15.76:0/2032477307 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f159c0a1230 0x7f159c0a36f0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:04.812 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:04.806+0000 7f15ba271700 1 --2- 172.21.15.76:0/2032477307 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15b4068950 0x7f15b41995a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:04.812 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:04.806+0000 7f15ba271700 1 --2- 172.21.15.76:0/2032477307 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f15b40692f0 0x7f15b4199ae0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:04.812 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:04.806+0000 7f15ba271700 1 -- 172.21.15.76:0/2032477307 >> 172.21.15.76:0/2032477307 conn(0x7f15b4075f80 msgr2=0x7f15b410c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:04.812 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:04.806+0000 7f15ba271700 1 -- 172.21.15.76:0/2032477307 shutdown_connections 2024-06-02T04:49:04.812 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:04.806+0000 7f15ba271700 1 -- 172.21.15.76:0/2032477307 wait complete. 2024-06-02T04:49:04.812 INFO:teuthology.orchestra.run.smithi076.stderr:dumped all 2024-06-02T04:49:05.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:04 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:49:05.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:04 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:49:05.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:04 smithi119 ceph-mon[46633]: pgmap v249: 129 pgs: 129 active+clean; 639 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-06-02T04:49:05.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:04 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:49:05.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:04 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:49:05.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:04 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:49:05.141 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:04 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:49:05.141 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:04 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:49:05.141 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:04 smithi076 ceph-mon[42935]: pgmap v249: 129 pgs: 129 active+clean; 639 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-06-02T04:49:05.141 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:04 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:49:05.141 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:04 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:49:05.141 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:04 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:49:05.177 INFO:teuthology.orchestra.run.smithi076.stdout:{"pg_ready":true,"pg_map":{"version":249,"stamp":"2024-06-02T04:49:04.165919+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":654353,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":343,"num_read_kb":284,"num_write":337,"num_write_kb":3051,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":275,"ondisk_log_size":275,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":371860,"kb_used_data":10804,"kb_used_omap":18,"kb_used_meta":360941,"kb_avail":1124569964,"statfs":{"total":1151940427776,"available":1151559643136,"internally_reserved":0,"allocated":11063296,"data_stored":7243462,"data_compressed":247011,"data_compressed_allocated":331776,"data_compressed_original":2162688,"omap_allocated":19131,"internal_metadata":369603909},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":27,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003397"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.692267+0000","last_change":"2024-06-02T04:48:02.689765+0000","last_active":"2024-06-02T04:48:06.692267+0000","last_peered":"2024-06-02T04:48:06.692267+0000","last_clean":"2024-06-02T04:48:06.692267+0000","last_became_active":"2024-06-02T04:48:02.689464+0000","last_became_peered":"2024-06-02T04:48:02.689464+0000","last_unstale":"2024-06-02T04:48:06.692267+0000","last_undegraded":"2024-06-02T04:48:06.692267+0000","last_fullsized":"2024-06-02T04:48:06.692267+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:13:19.743519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.701845+0000","last_change":"2024-06-02T04:48:02.691499+0000","last_active":"2024-06-02T04:48:06.701845+0000","last_peered":"2024-06-02T04:48:06.701845+0000","last_clean":"2024-06-02T04:48:06.701845+0000","last_became_active":"2024-06-02T04:48:02.691179+0000","last_became_peered":"2024-06-02T04:48:02.691179+0000","last_unstale":"2024-06-02T04:48:06.701845+0000","last_undegraded":"2024-06-02T04:48:06.701845+0000","last_fullsized":"2024-06-02T04:48:06.701845+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T14:00:17.118877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.701714+0000","last_change":"2024-06-02T04:48:02.688527+0000","last_active":"2024-06-02T04:48:06.701714+0000","last_peered":"2024-06-02T04:48:06.701714+0000","last_clean":"2024-06-02T04:48:06.701714+0000","last_became_active":"2024-06-02T04:48:02.688184+0000","last_became_peered":"2024-06-02T04:48:02.688184+0000","last_unstale":"2024-06-02T04:48:06.701714+0000","last_undegraded":"2024-06-02T04:48:06.701714+0000","last_fullsized":"2024-06-02T04:48:06.701714+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T08:40:35.052887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.697066+0000","last_change":"2024-06-02T04:48:02.695277+0000","last_active":"2024-06-02T04:48:06.697066+0000","last_peered":"2024-06-02T04:48:06.697066+0000","last_clean":"2024-06-02T04:48:06.697066+0000","last_became_active":"2024-06-02T04:48:02.694951+0000","last_became_peered":"2024-06-02T04:48:02.694951+0000","last_unstale":"2024-06-02T04:48:06.697066+0000","last_undegraded":"2024-06-02T04:48:06.697066+0000","last_fullsized":"2024-06-02T04:48:06.697066+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T14:13:50.672421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.696221+0000","last_change":"2024-06-02T04:48:02.691454+0000","last_active":"2024-06-02T04:48:06.696221+0000","last_peered":"2024-06-02T04:48:06.696221+0000","last_clean":"2024-06-02T04:48:06.696221+0000","last_became_active":"2024-06-02T04:48:02.691083+0000","last_became_peered":"2024-06-02T04:48:02.691083+0000","last_unstale":"2024-06-02T04:48:06.696221+0000","last_undegraded":"2024-06-02T04:48:06.696221+0000","last_fullsized":"2024-06-02T04:48:06.696221+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T07:12:58.481115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.961870+0000","last_change":"2024-06-02T04:48:02.690371+0000","last_active":"2024-06-02T04:48:06.961870+0000","last_peered":"2024-06-02T04:48:06.961870+0000","last_clean":"2024-06-02T04:48:06.961870+0000","last_became_active":"2024-06-02T04:48:02.682047+0000","last_became_peered":"2024-06-02T04:48:02.682047+0000","last_unstale":"2024-06-02T04:48:06.961870+0000","last_undegraded":"2024-06-02T04:48:06.961870+0000","last_fullsized":"2024-06-02T04:48:06.961870+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:17:59.717575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.698244+0000","last_change":"2024-06-02T04:48:02.697823+0000","last_active":"2024-06-02T04:48:06.698244+0000","last_peered":"2024-06-02T04:48:06.698244+0000","last_clean":"2024-06-02T04:48:06.698244+0000","last_became_active":"2024-06-02T04:48:02.697491+0000","last_became_peered":"2024-06-02T04:48:02.697491+0000","last_unstale":"2024-06-02T04:48:06.698244+0000","last_undegraded":"2024-06-02T04:48:06.698244+0000","last_fullsized":"2024-06-02T04:48:06.698244+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T16:08:39.689192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.105002+0000","last_change":"2024-06-02T04:48:02.702564+0000","last_active":"2024-06-02T04:48:07.105002+0000","last_peered":"2024-06-02T04:48:07.105002+0000","last_clean":"2024-06-02T04:48:07.105002+0000","last_became_active":"2024-06-02T04:48:02.702259+0000","last_became_peered":"2024-06-02T04:48:02.702259+0000","last_unstale":"2024-06-02T04:48:07.105002+0000","last_undegraded":"2024-06-02T04:48:07.105002+0000","last_fullsized":"2024-06-02T04:48:07.105002+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T12:33:28.945414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.692781+0000","last_change":"2024-06-02T04:48:02.694090+0000","last_active":"2024-06-02T04:48:06.692781+0000","last_peered":"2024-06-02T04:48:06.692781+0000","last_clean":"2024-06-02T04:48:06.692781+0000","last_became_active":"2024-06-02T04:48:02.693723+0000","last_became_peered":"2024-06-02T04:48:02.693723+0000","last_unstale":"2024-06-02T04:48:06.692781+0000","last_undegraded":"2024-06-02T04:48:06.692781+0000","last_fullsized":"2024-06-02T04:48:06.692781+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:33:26.628450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.963109+0000","last_change":"2024-06-02T04:48:02.702201+0000","last_active":"2024-06-02T04:48:06.963109+0000","last_peered":"2024-06-02T04:48:06.963109+0000","last_clean":"2024-06-02T04:48:06.963109+0000","last_became_active":"2024-06-02T04:48:02.701834+0000","last_became_peered":"2024-06-02T04:48:02.701834+0000","last_unstale":"2024-06-02T04:48:06.963109+0000","last_undegraded":"2024-06-02T04:48:06.963109+0000","last_fullsized":"2024-06-02T04:48:06.963109+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T08:22:24.009015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.699587+0000","last_change":"2024-06-02T04:48:02.700280+0000","last_active":"2024-06-02T04:48:06.699587+0000","last_peered":"2024-06-02T04:48:06.699587+0000","last_clean":"2024-06-02T04:48:06.699587+0000","last_became_active":"2024-06-02T04:48:02.699852+0000","last_became_peered":"2024-06-02T04:48:02.699852+0000","last_unstale":"2024-06-02T04:48:06.699587+0000","last_undegraded":"2024-06-02T04:48:06.699587+0000","last_fullsized":"2024-06-02T04:48:06.699587+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T16:45:28.228692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.696970+0000","last_change":"2024-06-02T04:48:02.689951+0000","last_active":"2024-06-02T04:48:06.696970+0000","last_peered":"2024-06-02T04:48:06.696970+0000","last_clean":"2024-06-02T04:48:06.696970+0000","last_became_active":"2024-06-02T04:48:02.689249+0000","last_became_peered":"2024-06-02T04:48:02.689249+0000","last_unstale":"2024-06-02T04:48:06.696970+0000","last_undegraded":"2024-06-02T04:48:06.696970+0000","last_fullsized":"2024-06-02T04:48:06.696970+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:09:43.620165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.691345+0000","last_change":"2024-06-02T04:48:02.691126+0000","last_active":"2024-06-02T04:48:06.691345+0000","last_peered":"2024-06-02T04:48:06.691345+0000","last_clean":"2024-06-02T04:48:06.691345+0000","last_became_active":"2024-06-02T04:48:02.690825+0000","last_became_peered":"2024-06-02T04:48:02.690825+0000","last_unstale":"2024-06-02T04:48:06.691345+0000","last_undegraded":"2024-06-02T04:48:06.691345+0000","last_fullsized":"2024-06-02T04:48:06.691345+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:03:36.461555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.708124+0000","last_change":"2024-06-02T04:48:02.692802+0000","last_active":"2024-06-02T04:48:06.708124+0000","last_peered":"2024-06-02T04:48:06.708124+0000","last_clean":"2024-06-02T04:48:06.708124+0000","last_became_active":"2024-06-02T04:48:02.692495+0000","last_became_peered":"2024-06-02T04:48:02.692495+0000","last_unstale":"2024-06-02T04:48:06.708124+0000","last_undegraded":"2024-06-02T04:48:06.708124+0000","last_fullsized":"2024-06-02T04:48:06.708124+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T14:57:10.991752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.701916+0000","last_change":"2024-06-02T04:48:02.702968+0000","last_active":"2024-06-02T04:48:06.701916+0000","last_peered":"2024-06-02T04:48:06.701916+0000","last_clean":"2024-06-02T04:48:06.701916+0000","last_became_active":"2024-06-02T04:48:02.702672+0000","last_became_peered":"2024-06-02T04:48:02.702672+0000","last_unstale":"2024-06-02T04:48:06.701916+0000","last_undegraded":"2024-06-02T04:48:06.701916+0000","last_fullsized":"2024-06-02T04:48:06.701916+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:04:38.385228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.691702+0000","last_change":"2024-06-02T04:48:02.701329+0000","last_active":"2024-06-02T04:48:06.691702+0000","last_peered":"2024-06-02T04:48:06.691702+0000","last_clean":"2024-06-02T04:48:06.691702+0000","last_became_active":"2024-06-02T04:48:02.701064+0000","last_became_peered":"2024-06-02T04:48:02.701064+0000","last_unstale":"2024-06-02T04:48:06.691702+0000","last_undegraded":"2024-06-02T04:48:06.691702+0000","last_fullsized":"2024-06-02T04:48:06.691702+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:28:06.265050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.692151+0000","last_change":"2024-06-02T04:48:02.688538+0000","last_active":"2024-06-02T04:48:06.692151+0000","last_peered":"2024-06-02T04:48:06.692151+0000","last_clean":"2024-06-02T04:48:06.692151+0000","last_became_active":"2024-06-02T04:48:02.688175+0000","last_became_peered":"2024-06-02T04:48:02.688175+0000","last_unstale":"2024-06-02T04:48:06.692151+0000","last_undegraded":"2024-06-02T04:48:06.692151+0000","last_fullsized":"2024-06-02T04:48:06.692151+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T07:30:47.310924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.697897+0000","last_change":"2024-06-02T04:48:02.688515+0000","last_active":"2024-06-02T04:48:06.697897+0000","last_peered":"2024-06-02T04:48:06.697897+0000","last_clean":"2024-06-02T04:48:06.697897+0000","last_became_active":"2024-06-02T04:48:02.688205+0000","last_became_peered":"2024-06-02T04:48:02.688205+0000","last_unstale":"2024-06-02T04:48:06.697897+0000","last_undegraded":"2024-06-02T04:48:06.697897+0000","last_fullsized":"2024-06-02T04:48:06.697897+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:20:05.829628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.700166+0000","last_change":"2024-06-02T04:48:02.688376+0000","last_active":"2024-06-02T04:48:06.700166+0000","last_peered":"2024-06-02T04:48:06.700166+0000","last_clean":"2024-06-02T04:48:06.700166+0000","last_became_active":"2024-06-02T04:48:02.688055+0000","last_became_peered":"2024-06-02T04:48:02.688055+0000","last_unstale":"2024-06-02T04:48:06.700166+0000","last_undegraded":"2024-06-02T04:48:06.700166+0000","last_fullsized":"2024-06-02T04:48:06.700166+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:55:41.327635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.714875+0000","last_change":"2024-06-02T04:48:06.713517+0000","last_active":"2024-06-02T04:48:06.714875+0000","last_peered":"2024-06-02T04:48:06.714875+0000","last_clean":"2024-06-02T04:48:06.714875+0000","last_became_active":"2024-06-02T04:48:06.713187+0000","last_became_peered":"2024-06-02T04:48:06.713187+0000","last_unstale":"2024-06-02T04:48:06.714875+0000","last_undegraded":"2024-06-02T04:48:06.714875+0000","last_fullsized":"2024-06-02T04:48:06.714875+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:11:46.598023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"80'9","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:27.278058+0000","last_change":"2024-06-02T04:48:02.271595+0000","last_active":"2024-06-02T04:48:27.278058+0000","last_peered":"2024-06-02T04:48:27.278058+0000","last_clean":"2024-06-02T04:48:27.278058+0000","last_became_active":"2024-06-02T04:48:02.271326+0000","last_became_peered":"2024-06-02T04:48:02.271326+0000","last_unstale":"2024-06-02T04:48:27.278058+0000","last_undegraded":"2024-06-02T04:48:27.278058+0000","last_fullsized":"2024-06-02T04:48:27.278058+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:23:31.096224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.105442+0000","last_change":"2024-06-02T04:48:02.696542+0000","last_active":"2024-06-02T04:48:07.105442+0000","last_peered":"2024-06-02T04:48:07.105442+0000","last_clean":"2024-06-02T04:48:07.105442+0000","last_became_active":"2024-06-02T04:48:02.696260+0000","last_became_peered":"2024-06-02T04:48:02.696260+0000","last_unstale":"2024-06-02T04:48:07.105442+0000","last_undegraded":"2024-06-02T04:48:07.105442+0000","last_fullsized":"2024-06-02T04:48:07.105442+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T06:28:04.097035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.291625+0000","last_change":"2024-06-02T04:48:06.713685+0000","last_active":"2024-06-02T04:48:07.291625+0000","last_peered":"2024-06-02T04:48:07.291625+0000","last_clean":"2024-06-02T04:48:07.291625+0000","last_became_active":"2024-06-02T04:48:06.713254+0000","last_became_peered":"2024-06-02T04:48:06.713254+0000","last_unstale":"2024-06-02T04:48:07.291625+0000","last_undegraded":"2024-06-02T04:48:07.291625+0000","last_fullsized":"2024-06-02T04:48:07.291625+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:12:48.304229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.105489+0000","last_change":"2024-06-02T04:48:02.268361+0000","last_active":"2024-06-02T04:48:07.105489+0000","last_peered":"2024-06-02T04:48:07.105489+0000","last_clean":"2024-06-02T04:48:07.105489+0000","last_became_active":"2024-06-02T04:48:02.268053+0000","last_became_peered":"2024-06-02T04:48:02.268053+0000","last_unstale":"2024-06-02T04:48:07.105489+0000","last_undegraded":"2024-06-02T04:48:07.105489+0000","last_fullsized":"2024-06-02T04:48:07.105489+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T16:04:13.955351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.701807+0000","last_change":"2024-06-02T04:48:02.686322+0000","last_active":"2024-06-02T04:48:06.701807+0000","last_peered":"2024-06-02T04:48:06.701807+0000","last_clean":"2024-06-02T04:48:06.701807+0000","last_became_active":"2024-06-02T04:48:02.685978+0000","last_became_peered":"2024-06-02T04:48:02.685978+0000","last_unstale":"2024-06-02T04:48:06.701807+0000","last_undegraded":"2024-06-02T04:48:06.701807+0000","last_fullsized":"2024-06-02T04:48:06.701807+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T12:12:19.157330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.291715+0000","last_change":"2024-06-02T04:48:06.717046+0000","last_active":"2024-06-02T04:48:07.291715+0000","last_peered":"2024-06-02T04:48:07.291715+0000","last_clean":"2024-06-02T04:48:07.291715+0000","last_became_active":"2024-06-02T04:48:06.716603+0000","last_became_peered":"2024-06-02T04:48:06.716603+0000","last_unstale":"2024-06-02T04:48:07.291715+0000","last_undegraded":"2024-06-02T04:48:07.291715+0000","last_fullsized":"2024-06-02T04:48:07.291715+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:35:22.953004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"80'4","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:27.276618+0000","last_change":"2024-06-02T04:48:02.278143+0000","last_active":"2024-06-02T04:48:27.276618+0000","last_peered":"2024-06-02T04:48:27.276618+0000","last_clean":"2024-06-02T04:48:27.276618+0000","last_became_active":"2024-06-02T04:48:02.277656+0000","last_became_peered":"2024-06-02T04:48:02.277656+0000","last_unstale":"2024-06-02T04:48:27.276618+0000","last_undegraded":"2024-06-02T04:48:27.276618+0000","last_fullsized":"2024-06-02T04:48:27.276618+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T12:03:01.549353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.692452+0000","last_change":"2024-06-02T04:48:02.699659+0000","last_active":"2024-06-02T04:48:06.692452+0000","last_peered":"2024-06-02T04:48:06.692452+0000","last_clean":"2024-06-02T04:48:06.692452+0000","last_became_active":"2024-06-02T04:48:02.699321+0000","last_became_peered":"2024-06-02T04:48:02.699321+0000","last_unstale":"2024-06-02T04:48:06.692452+0000","last_undegraded":"2024-06-02T04:48:06.692452+0000","last_fullsized":"2024-06-02T04:48:06.692452+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:33:35.088215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.291668+0000","last_change":"2024-06-02T04:48:06.712031+0000","last_active":"2024-06-02T04:48:07.291668+0000","last_peered":"2024-06-02T04:48:07.291668+0000","last_clean":"2024-06-02T04:48:07.291668+0000","last_became_active":"2024-06-02T04:48:06.711637+0000","last_became_peered":"2024-06-02T04:48:06.711637+0000","last_unstale":"2024-06-02T04:48:07.291668+0000","last_undegraded":"2024-06-02T04:48:07.291668+0000","last_fullsized":"2024-06-02T04:48:07.291668+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T06:10:05.281793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"75'2","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.697836+0000","last_change":"2024-06-02T04:48:02.268698+0000","last_active":"2024-06-02T04:48:06.697836+0000","last_peered":"2024-06-02T04:48:06.697836+0000","last_clean":"2024-06-02T04:48:06.697836+0000","last_became_active":"2024-06-02T04:48:02.268286+0000","last_became_peered":"2024-06-02T04:48:02.268286+0000","last_unstale":"2024-06-02T04:48:06.697836+0000","last_undegraded":"2024-06-02T04:48:06.697836+0000","last_fullsized":"2024-06-02T04:48:06.697836+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T10:37:42.354104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.030205+0000","last_change":"2024-06-02T04:48:02.702280+0000","last_active":"2024-06-02T04:48:07.030205+0000","last_peered":"2024-06-02T04:48:07.030205+0000","last_clean":"2024-06-02T04:48:07.030205+0000","last_became_active":"2024-06-02T04:48:02.701830+0000","last_became_peered":"2024-06-02T04:48:02.701830+0000","last_unstale":"2024-06-02T04:48:07.030205+0000","last_undegraded":"2024-06-02T04:48:07.030205+0000","last_fullsized":"2024-06-02T04:48:07.030205+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T06:44:06.324024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.709193+0000","last_change":"2024-06-02T04:48:06.708484+0000","last_active":"2024-06-02T04:48:06.709193+0000","last_peered":"2024-06-02T04:48:06.709193+0000","last_clean":"2024-06-02T04:48:06.709193+0000","last_became_active":"2024-06-02T04:48:06.708048+0000","last_became_peered":"2024-06-02T04:48:06.708048+0000","last_unstale":"2024-06-02T04:48:06.709193+0000","last_undegraded":"2024-06-02T04:48:06.709193+0000","last_fullsized":"2024-06-02T04:48:06.709193+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:30:42.361362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"80'6","reported_seq":59,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:49:00.331247+0000","last_change":"2024-06-02T04:48:02.274961+0000","last_active":"2024-06-02T04:49:00.331247+0000","last_peered":"2024-06-02T04:49:00.331247+0000","last_clean":"2024-06-02T04:49:00.331247+0000","last_became_active":"2024-06-02T04:48:02.274617+0000","last_became_peered":"2024-06-02T04:48:02.274617+0000","last_unstale":"2024-06-02T04:49:00.331247+0000","last_undegraded":"2024-06-02T04:49:00.331247+0000","last_fullsized":"2024-06-02T04:49:00.331247+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T16:47:17.136996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":967,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":37,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.698487+0000","last_change":"2024-06-02T04:48:02.684722+0000","last_active":"2024-06-02T04:48:06.698487+0000","last_peered":"2024-06-02T04:48:06.698487+0000","last_clean":"2024-06-02T04:48:06.698487+0000","last_became_active":"2024-06-02T04:48:02.684354+0000","last_became_peered":"2024-06-02T04:48:02.684354+0000","last_unstale":"2024-06-02T04:48:06.698487+0000","last_undegraded":"2024-06-02T04:48:06.698487+0000","last_fullsized":"2024-06-02T04:48:06.698487+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T07:46:54.136882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.714856+0000","last_change":"2024-06-02T04:48:06.713498+0000","last_active":"2024-06-02T04:48:06.714856+0000","last_peered":"2024-06-02T04:48:06.714856+0000","last_clean":"2024-06-02T04:48:06.714856+0000","last_became_active":"2024-06-02T04:48:06.712949+0000","last_became_peered":"2024-06-02T04:48:06.712949+0000","last_unstale":"2024-06-02T04:48:06.714856+0000","last_undegraded":"2024-06-02T04:48:06.714856+0000","last_fullsized":"2024-06-02T04:48:06.714856+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:37:31.586703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"80'3","reported_seq":19,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:27.277254+0000","last_change":"2024-06-02T04:48:02.266358+0000","last_active":"2024-06-02T04:48:27.277254+0000","last_peered":"2024-06-02T04:48:27.277254+0000","last_clean":"2024-06-02T04:48:27.277254+0000","last_became_active":"2024-06-02T04:48:02.266008+0000","last_became_peered":"2024-06-02T04:48:02.266008+0000","last_unstale":"2024-06-02T04:48:27.277254+0000","last_undegraded":"2024-06-02T04:48:27.277254+0000","last_fullsized":"2024-06-02T04:48:27.277254+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:07:13.104170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.030185+0000","last_change":"2024-06-02T04:48:02.702234+0000","last_active":"2024-06-02T04:48:07.030185+0000","last_peered":"2024-06-02T04:48:07.030185+0000","last_clean":"2024-06-02T04:48:07.030185+0000","last_became_active":"2024-06-02T04:48:02.701927+0000","last_became_peered":"2024-06-02T04:48:02.701927+0000","last_unstale":"2024-06-02T04:48:07.030185+0000","last_undegraded":"2024-06-02T04:48:07.030185+0000","last_fullsized":"2024-06-02T04:48:07.030185+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:55:55.940957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.106401+0000","last_change":"2024-06-02T04:48:06.713257+0000","last_active":"2024-06-02T04:48:07.106401+0000","last_peered":"2024-06-02T04:48:07.106401+0000","last_clean":"2024-06-02T04:48:07.106401+0000","last_became_active":"2024-06-02T04:48:06.712862+0000","last_became_peered":"2024-06-02T04:48:06.712862+0000","last_unstale":"2024-06-02T04:48:07.106401+0000","last_undegraded":"2024-06-02T04:48:07.106401+0000","last_fullsized":"2024-06-02T04:48:07.106401+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T06:23:35.115824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"80'2","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:27.276292+0000","last_change":"2024-06-02T04:48:02.258838+0000","last_active":"2024-06-02T04:48:27.276292+0000","last_peered":"2024-06-02T04:48:27.276292+0000","last_clean":"2024-06-02T04:48:27.276292+0000","last_became_active":"2024-06-02T04:48:02.258516+0000","last_became_peered":"2024-06-02T04:48:02.258516+0000","last_unstale":"2024-06-02T04:48:27.276292+0000","last_undegraded":"2024-06-02T04:48:27.276292+0000","last_fullsized":"2024-06-02T04:48:27.276292+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:32:04.161724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.104908+0000","last_change":"2024-06-02T04:48:02.690043+0000","last_active":"2024-06-02T04:48:07.104908+0000","last_peered":"2024-06-02T04:48:07.104908+0000","last_clean":"2024-06-02T04:48:07.104908+0000","last_became_active":"2024-06-02T04:48:02.689748+0000","last_became_peered":"2024-06-02T04:48:02.689748+0000","last_unstale":"2024-06-02T04:48:07.104908+0000","last_undegraded":"2024-06-02T04:48:07.104908+0000","last_fullsized":"2024-06-02T04:48:07.104908+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:50:23.694653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.338557+0000","last_change":"2024-06-02T04:48:06.704093+0000","last_active":"2024-06-02T04:48:07.338557+0000","last_peered":"2024-06-02T04:48:07.338557+0000","last_clean":"2024-06-02T04:48:07.338557+0000","last_became_active":"2024-06-02T04:48:06.703732+0000","last_became_peered":"2024-06-02T04:48:06.703732+0000","last_unstale":"2024-06-02T04:48:07.338557+0000","last_undegraded":"2024-06-02T04:48:07.338557+0000","last_fullsized":"2024-06-02T04:48:07.338557+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:50:10.434364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"80'1","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.338898+0000","last_change":"2024-06-02T04:48:02.274753+0000","last_active":"2024-06-02T04:48:07.338898+0000","last_peered":"2024-06-02T04:48:07.338898+0000","last_clean":"2024-06-02T04:48:07.338898+0000","last_became_active":"2024-06-02T04:48:02.274390+0000","last_became_peered":"2024-06-02T04:48:02.274390+0000","last_unstale":"2024-06-02T04:48:07.338898+0000","last_undegraded":"2024-06-02T04:48:07.338898+0000","last_fullsized":"2024-06-02T04:48:07.338898+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:42:38.790750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.698110+0000","last_change":"2024-06-02T04:48:02.684832+0000","last_active":"2024-06-02T04:48:06.698110+0000","last_peered":"2024-06-02T04:48:06.698110+0000","last_clean":"2024-06-02T04:48:06.698110+0000","last_became_active":"2024-06-02T04:48:02.684520+0000","last_became_peered":"2024-06-02T04:48:02.684520+0000","last_unstale":"2024-06-02T04:48:06.698110+0000","last_undegraded":"2024-06-02T04:48:06.698110+0000","last_fullsized":"2024-06-02T04:48:06.698110+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:08:33.038975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.104977+0000","last_change":"2024-06-02T04:48:06.704725+0000","last_active":"2024-06-02T04:48:07.104977+0000","last_peered":"2024-06-02T04:48:07.104977+0000","last_clean":"2024-06-02T04:48:07.104977+0000","last_became_active":"2024-06-02T04:48:06.704284+0000","last_became_peered":"2024-06-02T04:48:06.704284+0000","last_unstale":"2024-06-02T04:48:07.104977+0000","last_undegraded":"2024-06-02T04:48:07.104977+0000","last_fullsized":"2024-06-02T04:48:07.104977+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:56:04.558505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"80'3","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:57.326785+0000","last_change":"2024-06-02T04:48:02.267048+0000","last_active":"2024-06-02T04:48:57.326785+0000","last_peered":"2024-06-02T04:48:57.326785+0000","last_clean":"2024-06-02T04:48:57.326785+0000","last_became_active":"2024-06-02T04:48:02.266707+0000","last_became_peered":"2024-06-02T04:48:02.266707+0000","last_unstale":"2024-06-02T04:48:57.326785+0000","last_undegraded":"2024-06-02T04:48:57.326785+0000","last_fullsized":"2024-06-02T04:48:57.326785+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:36:25.633728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.692726+0000","last_change":"2024-06-02T04:48:02.700485+0000","last_active":"2024-06-02T04:48:06.692726+0000","last_peered":"2024-06-02T04:48:06.692726+0000","last_clean":"2024-06-02T04:48:06.692726+0000","last_became_active":"2024-06-02T04:48:02.700228+0000","last_became_peered":"2024-06-02T04:48:02.700228+0000","last_unstale":"2024-06-02T04:48:06.692726+0000","last_undegraded":"2024-06-02T04:48:06.692726+0000","last_fullsized":"2024-06-02T04:48:06.692726+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T06:39:18.244476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.717696+0000","last_change":"2024-06-02T04:48:06.716821+0000","last_active":"2024-06-02T04:48:06.717696+0000","last_peered":"2024-06-02T04:48:06.717696+0000","last_clean":"2024-06-02T04:48:06.717696+0000","last_became_active":"2024-06-02T04:48:06.716432+0000","last_became_peered":"2024-06-02T04:48:06.716432+0000","last_unstale":"2024-06-02T04:48:06.717696+0000","last_undegraded":"2024-06-02T04:48:06.717696+0000","last_fullsized":"2024-06-02T04:48:06.717696+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T12:06:50.164797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"80'2","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:26.276005+0000","last_change":"2024-06-02T04:48:02.272377+0000","last_active":"2024-06-02T04:48:26.276005+0000","last_peered":"2024-06-02T04:48:26.276005+0000","last_clean":"2024-06-02T04:48:26.276005+0000","last_became_active":"2024-06-02T04:48:02.272017+0000","last_became_peered":"2024-06-02T04:48:02.272017+0000","last_unstale":"2024-06-02T04:48:26.276005+0000","last_undegraded":"2024-06-02T04:48:26.276005+0000","last_fullsized":"2024-06-02T04:48:26.276005+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T10:24:14.945609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.701744+0000","last_change":"2024-06-02T04:48:02.687056+0000","last_active":"2024-06-02T04:48:06.701744+0000","last_peered":"2024-06-02T04:48:06.701744+0000","last_clean":"2024-06-02T04:48:06.701744+0000","last_became_active":"2024-06-02T04:48:02.686729+0000","last_became_peered":"2024-06-02T04:48:02.686729+0000","last_unstale":"2024-06-02T04:48:06.701744+0000","last_undegraded":"2024-06-02T04:48:06.701744+0000","last_fullsized":"2024-06-02T04:48:06.701744+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:54:44.636489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.292066+0000","last_change":"2024-06-02T04:48:06.713816+0000","last_active":"2024-06-02T04:48:07.292066+0000","last_peered":"2024-06-02T04:48:07.292066+0000","last_clean":"2024-06-02T04:48:07.292066+0000","last_became_active":"2024-06-02T04:48:06.713372+0000","last_became_peered":"2024-06-02T04:48:06.713372+0000","last_unstale":"2024-06-02T04:48:07.292066+0000","last_undegraded":"2024-06-02T04:48:07.292066+0000","last_fullsized":"2024-06-02T04:48:07.292066+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T10:12:46.455263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"80'4","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:26.274666+0000","last_change":"2024-06-02T04:48:02.274971+0000","last_active":"2024-06-02T04:48:26.274666+0000","last_peered":"2024-06-02T04:48:26.274666+0000","last_clean":"2024-06-02T04:48:26.274666+0000","last_became_active":"2024-06-02T04:48:02.274137+0000","last_became_peered":"2024-06-02T04:48:02.274137+0000","last_unstale":"2024-06-02T04:48:26.274666+0000","last_undegraded":"2024-06-02T04:48:26.274666+0000","last_fullsized":"2024-06-02T04:48:26.274666+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:41:45.634923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.692551+0000","last_change":"2024-06-02T04:48:02.693919+0000","last_active":"2024-06-02T04:48:06.692551+0000","last_peered":"2024-06-02T04:48:06.692551+0000","last_clean":"2024-06-02T04:48:06.692551+0000","last_became_active":"2024-06-02T04:48:02.693577+0000","last_became_peered":"2024-06-02T04:48:02.693577+0000","last_unstale":"2024-06-02T04:48:06.692551+0000","last_undegraded":"2024-06-02T04:48:06.692551+0000","last_fullsized":"2024-06-02T04:48:06.692551+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:00:47.500411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.716072+0000","last_change":"2024-06-02T04:48:06.713061+0000","last_active":"2024-06-02T04:48:06.716072+0000","last_peered":"2024-06-02T04:48:06.716072+0000","last_clean":"2024-06-02T04:48:06.716072+0000","last_became_active":"2024-06-02T04:48:06.712687+0000","last_became_peered":"2024-06-02T04:48:06.712687+0000","last_unstale":"2024-06-02T04:48:06.716072+0000","last_undegraded":"2024-06-02T04:48:06.716072+0000","last_fullsized":"2024-06-02T04:48:06.716072+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T08:46:02.417626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"80'31","reported_seq":116,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:58.327885+0000","last_change":"2024-06-02T04:48:02.270101+0000","last_active":"2024-06-02T04:48:58.327885+0000","last_peered":"2024-06-02T04:48:58.327885+0000","last_clean":"2024-06-02T04:48:58.327885+0000","last_became_active":"2024-06-02T04:48:02.269637+0000","last_became_peered":"2024-06-02T04:48:02.269637+0000","last_unstale":"2024-06-02T04:48:58.327885+0000","last_undegraded":"2024-06-02T04:48:58.327885+0000","last_fullsized":"2024-06-02T04:48:58.327885+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:37:07.572299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59451,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":69,"num_read_kb":93,"num_write":32,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.698707+0000","last_change":"2024-06-02T04:48:02.698435+0000","last_active":"2024-06-02T04:48:06.698707+0000","last_peered":"2024-06-02T04:48:06.698707+0000","last_clean":"2024-06-02T04:48:06.698707+0000","last_became_active":"2024-06-02T04:48:02.698071+0000","last_became_peered":"2024-06-02T04:48:02.698071+0000","last_unstale":"2024-06-02T04:48:06.698707+0000","last_undegraded":"2024-06-02T04:48:06.698707+0000","last_fullsized":"2024-06-02T04:48:06.698707+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:45:38.673256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.030226+0000","last_change":"2024-06-02T04:48:06.705965+0000","last_active":"2024-06-02T04:48:07.030226+0000","last_peered":"2024-06-02T04:48:07.030226+0000","last_clean":"2024-06-02T04:48:07.030226+0000","last_became_active":"2024-06-02T04:48:06.705527+0000","last_became_peered":"2024-06-02T04:48:06.705527+0000","last_unstale":"2024-06-02T04:48:07.030226+0000","last_undegraded":"2024-06-02T04:48:07.030226+0000","last_fullsized":"2024-06-02T04:48:07.030226+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:41:54.100212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"80'6","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:27.277539+0000","last_change":"2024-06-02T04:48:02.273389+0000","last_active":"2024-06-02T04:48:27.277539+0000","last_peered":"2024-06-02T04:48:27.277539+0000","last_clean":"2024-06-02T04:48:27.277539+0000","last_became_active":"2024-06-02T04:48:02.271701+0000","last_became_peered":"2024-06-02T04:48:02.271701+0000","last_unstale":"2024-06-02T04:48:27.277539+0000","last_undegraded":"2024-06-02T04:48:27.277539+0000","last_fullsized":"2024-06-02T04:48:27.277539+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:46:48.304156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.691378+0000","last_change":"2024-06-02T04:48:02.689417+0000","last_active":"2024-06-02T04:48:06.691378+0000","last_peered":"2024-06-02T04:48:06.691378+0000","last_clean":"2024-06-02T04:48:06.691378+0000","last_became_active":"2024-06-02T04:48:02.689108+0000","last_became_peered":"2024-06-02T04:48:02.689108+0000","last_unstale":"2024-06-02T04:48:06.691378+0000","last_undegraded":"2024-06-02T04:48:06.691378+0000","last_fullsized":"2024-06-02T04:48:06.691378+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:23:14.231198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.106225+0000","last_change":"2024-06-02T04:48:06.713370+0000","last_active":"2024-06-02T04:48:07.106225+0000","last_peered":"2024-06-02T04:48:07.106225+0000","last_clean":"2024-06-02T04:48:07.106225+0000","last_became_active":"2024-06-02T04:48:06.712972+0000","last_became_peered":"2024-06-02T04:48:06.712972+0000","last_unstale":"2024-06-02T04:48:07.106225+0000","last_undegraded":"2024-06-02T04:48:07.106225+0000","last_fullsized":"2024-06-02T04:48:07.106225+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:37:23.908276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"80'3","reported_seq":19,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:26.275559+0000","last_change":"2024-06-02T04:48:02.274386+0000","last_active":"2024-06-02T04:48:26.275559+0000","last_peered":"2024-06-02T04:48:26.275559+0000","last_clean":"2024-06-02T04:48:26.275559+0000","last_became_active":"2024-06-02T04:48:02.274001+0000","last_became_peered":"2024-06-02T04:48:02.274001+0000","last_unstale":"2024-06-02T04:48:26.275559+0000","last_undegraded":"2024-06-02T04:48:26.275559+0000","last_fullsized":"2024-06-02T04:48:26.275559+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T14:02:10.256428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.699635+0000","last_change":"2024-06-02T04:48:02.706735+0000","last_active":"2024-06-02T04:48:06.699635+0000","last_peered":"2024-06-02T04:48:06.699635+0000","last_clean":"2024-06-02T04:48:06.699635+0000","last_became_active":"2024-06-02T04:48:02.706475+0000","last_became_peered":"2024-06-02T04:48:02.706475+0000","last_unstale":"2024-06-02T04:48:06.699635+0000","last_undegraded":"2024-06-02T04:48:06.699635+0000","last_fullsized":"2024-06-02T04:48:06.699635+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T10:59:57.946798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.715816+0000","last_change":"2024-06-02T04:48:06.713266+0000","last_active":"2024-06-02T04:48:06.715816+0000","last_peered":"2024-06-02T04:48:06.715816+0000","last_clean":"2024-06-02T04:48:06.715816+0000","last_became_active":"2024-06-02T04:48:06.712659+0000","last_became_peered":"2024-06-02T04:48:06.712659+0000","last_unstale":"2024-06-02T04:48:06.715816+0000","last_undegraded":"2024-06-02T04:48:06.715816+0000","last_fullsized":"2024-06-02T04:48:06.715816+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T16:30:21.140420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"80'4","reported_seq":55,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:58.328068+0000","last_change":"2024-06-02T04:48:02.265157+0000","last_active":"2024-06-02T04:48:58.328068+0000","last_peered":"2024-06-02T04:48:58.328068+0000","last_clean":"2024-06-02T04:48:58.328068+0000","last_became_active":"2024-06-02T04:48:02.264782+0000","last_became_peered":"2024-06-02T04:48:02.264782+0000","last_unstale":"2024-06-02T04:48:58.328068+0000","last_undegraded":"2024-06-02T04:48:58.328068+0000","last_fullsized":"2024-06-02T04:48:58.328068+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:55:35.177299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":933,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":36,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.698945+0000","last_change":"2024-06-02T04:48:02.698864+0000","last_active":"2024-06-02T04:48:06.698945+0000","last_peered":"2024-06-02T04:48:06.698945+0000","last_clean":"2024-06-02T04:48:06.698945+0000","last_became_active":"2024-06-02T04:48:02.698547+0000","last_became_peered":"2024-06-02T04:48:02.698547+0000","last_unstale":"2024-06-02T04:48:06.698945+0000","last_undegraded":"2024-06-02T04:48:06.698945+0000","last_fullsized":"2024-06-02T04:48:06.698945+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:03:39.835164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.339323+0000","last_change":"2024-06-02T04:48:06.713198+0000","last_active":"2024-06-02T04:48:07.339323+0000","last_peered":"2024-06-02T04:48:07.339323+0000","last_clean":"2024-06-02T04:48:07.339323+0000","last_became_active":"2024-06-02T04:48:06.712806+0000","last_became_peered":"2024-06-02T04:48:06.712806+0000","last_unstale":"2024-06-02T04:48:07.339323+0000","last_undegraded":"2024-06-02T04:48:07.339323+0000","last_fullsized":"2024-06-02T04:48:07.339323+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:48:09.492933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"80'15","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:27.278673+0000","last_change":"2024-06-02T04:48:02.277744+0000","last_active":"2024-06-02T04:48:27.278673+0000","last_peered":"2024-06-02T04:48:27.278673+0000","last_clean":"2024-06-02T04:48:27.278673+0000","last_became_active":"2024-06-02T04:48:02.277044+0000","last_became_peered":"2024-06-02T04:48:02.277044+0000","last_unstale":"2024-06-02T04:48:27.278673+0000","last_undegraded":"2024-06-02T04:48:27.278673+0000","last_fullsized":"2024-06-02T04:48:27.278673+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:47:38.606233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.030145+0000","last_change":"2024-06-02T04:48:02.702234+0000","last_active":"2024-06-02T04:48:07.030145+0000","last_peered":"2024-06-02T04:48:07.030145+0000","last_clean":"2024-06-02T04:48:07.030145+0000","last_became_active":"2024-06-02T04:48:02.701857+0000","last_became_peered":"2024-06-02T04:48:02.701857+0000","last_unstale":"2024-06-02T04:48:07.030145+0000","last_undegraded":"2024-06-02T04:48:07.030145+0000","last_fullsized":"2024-06-02T04:48:07.030145+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:01:52.901690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.030132+0000","last_change":"2024-06-02T04:48:06.704575+0000","last_active":"2024-06-02T04:48:07.030132+0000","last_peered":"2024-06-02T04:48:07.030132+0000","last_clean":"2024-06-02T04:48:07.030132+0000","last_became_active":"2024-06-02T04:48:06.704129+0000","last_became_peered":"2024-06-02T04:48:06.704129+0000","last_unstale":"2024-06-02T04:48:07.030132+0000","last_undegraded":"2024-06-02T04:48:07.030132+0000","last_fullsized":"2024-06-02T04:48:07.030132+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:43:53.481252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":19,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:28.281548+0000","last_change":"2024-06-02T04:48:02.268816+0000","last_active":"2024-06-02T04:48:28.281548+0000","last_peered":"2024-06-02T04:48:28.281548+0000","last_clean":"2024-06-02T04:48:28.281548+0000","last_became_active":"2024-06-02T04:48:02.268469+0000","last_became_peered":"2024-06-02T04:48:02.268469+0000","last_unstale":"2024-06-02T04:48:28.281548+0000","last_undegraded":"2024-06-02T04:48:28.281548+0000","last_fullsized":"2024-06-02T04:48:28.281548+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:42:32.434414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.691711+0000","last_change":"2024-06-02T04:48:02.704536+0000","last_active":"2024-06-02T04:48:06.691711+0000","last_peered":"2024-06-02T04:48:06.691711+0000","last_clean":"2024-06-02T04:48:06.691711+0000","last_became_active":"2024-06-02T04:48:02.704149+0000","last_became_peered":"2024-06-02T04:48:02.704149+0000","last_unstale":"2024-06-02T04:48:06.691711+0000","last_undegraded":"2024-06-02T04:48:06.691711+0000","last_fullsized":"2024-06-02T04:48:06.691711+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T07:59:40.379135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.114754+0000","last_change":"2024-06-02T04:48:06.963192+0000","last_active":"2024-06-02T04:48:07.114754+0000","last_peered":"2024-06-02T04:48:07.114754+0000","last_clean":"2024-06-02T04:48:07.114754+0000","last_became_active":"2024-06-02T04:48:06.962658+0000","last_became_peered":"2024-06-02T04:48:06.962658+0000","last_unstale":"2024-06-02T04:48:07.114754+0000","last_undegraded":"2024-06-02T04:48:07.114754+0000","last_fullsized":"2024-06-02T04:48:07.114754+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:28:33.093285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.702674+0000","last_change":"2024-06-02T04:48:02.270893+0000","last_active":"2024-06-02T04:48:06.702674+0000","last_peered":"2024-06-02T04:48:06.702674+0000","last_clean":"2024-06-02T04:48:06.702674+0000","last_became_active":"2024-06-02T04:48:02.270566+0000","last_became_peered":"2024-06-02T04:48:02.270566+0000","last_unstale":"2024-06-02T04:48:06.702674+0000","last_undegraded":"2024-06-02T04:48:06.702674+0000","last_fullsized":"2024-06-02T04:48:06.702674+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:57:36.202043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.962165+0000","last_change":"2024-06-02T04:48:02.693528+0000","last_active":"2024-06-02T04:48:06.962165+0000","last_peered":"2024-06-02T04:48:06.962165+0000","last_clean":"2024-06-02T04:48:06.962165+0000","last_became_active":"2024-06-02T04:48:02.693240+0000","last_became_peered":"2024-06-02T04:48:02.693240+0000","last_unstale":"2024-06-02T04:48:06.962165+0000","last_undegraded":"2024-06-02T04:48:06.962165+0000","last_fullsized":"2024-06-02T04:48:06.962165+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T14:48:59.338977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.339278+0000","last_change":"2024-06-02T04:48:06.710454+0000","last_active":"2024-06-02T04:48:07.339278+0000","last_peered":"2024-06-02T04:48:07.339278+0000","last_clean":"2024-06-02T04:48:07.339278+0000","last_became_active":"2024-06-02T04:48:06.710090+0000","last_became_peered":"2024-06-02T04:48:06.710090+0000","last_unstale":"2024-06-02T04:48:07.339278+0000","last_undegraded":"2024-06-02T04:48:07.339278+0000","last_fullsized":"2024-06-02T04:48:07.339278+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:27:52.401032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"80'1","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.339601+0000","last_change":"2024-06-02T04:48:02.271748+0000","last_active":"2024-06-02T04:48:07.339601+0000","last_peered":"2024-06-02T04:48:07.339601+0000","last_clean":"2024-06-02T04:48:07.339601+0000","last_became_active":"2024-06-02T04:48:02.270941+0000","last_became_peered":"2024-06-02T04:48:02.270941+0000","last_unstale":"2024-06-02T04:48:07.339601+0000","last_undegraded":"2024-06-02T04:48:07.339601+0000","last_fullsized":"2024-06-02T04:48:07.339601+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T14:22:37.698956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.962254+0000","last_change":"2024-06-02T04:48:02.690331+0000","last_active":"2024-06-02T04:48:06.962254+0000","last_peered":"2024-06-02T04:48:06.962254+0000","last_clean":"2024-06-02T04:48:06.962254+0000","last_became_active":"2024-06-02T04:48:02.681983+0000","last_became_peered":"2024-06-02T04:48:02.681983+0000","last_unstale":"2024-06-02T04:48:06.962254+0000","last_undegraded":"2024-06-02T04:48:06.962254+0000","last_fullsized":"2024-06-02T04:48:06.962254+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T14:09:12.117847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.339368+0000","last_change":"2024-06-02T04:48:06.962698+0000","last_active":"2024-06-02T04:48:07.339368+0000","last_peered":"2024-06-02T04:48:07.339368+0000","last_clean":"2024-06-02T04:48:07.339368+0000","last_became_active":"2024-06-02T04:48:06.962283+0000","last_became_peered":"2024-06-02T04:48:06.962283+0000","last_unstale":"2024-06-02T04:48:07.339368+0000","last_undegraded":"2024-06-02T04:48:07.339368+0000","last_fullsized":"2024-06-02T04:48:07.339368+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T14:33:49.504150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.030119+0000","last_change":"2024-06-02T04:48:02.702856+0000","last_active":"2024-06-02T04:48:07.030119+0000","last_peered":"2024-06-02T04:48:07.030119+0000","last_clean":"2024-06-02T04:48:07.030119+0000","last_became_active":"2024-06-02T04:48:02.702513+0000","last_became_peered":"2024-06-02T04:48:02.702513+0000","last_unstale":"2024-06-02T04:48:07.030119+0000","last_undegraded":"2024-06-02T04:48:07.030119+0000","last_fullsized":"2024-06-02T04:48:07.030119+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T07:10:35.957386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"80'4","reported_seq":51,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:57.326346+0000","last_change":"2024-06-02T04:48:02.265627+0000","last_active":"2024-06-02T04:48:57.326346+0000","last_peered":"2024-06-02T04:48:57.326346+0000","last_clean":"2024-06-02T04:48:57.326346+0000","last_became_active":"2024-06-02T04:48:02.265301+0000","last_became_peered":"2024-06-02T04:48:02.265301+0000","last_unstale":"2024-06-02T04:48:57.326346+0000","last_undegraded":"2024-06-02T04:48:57.326346+0000","last_fullsized":"2024-06-02T04:48:57.326346+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T10:46:10.211378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"80'1","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.339971+0000","last_change":"2024-06-02T04:48:06.709988+0000","last_active":"2024-06-02T04:48:07.339971+0000","last_peered":"2024-06-02T04:48:07.339971+0000","last_clean":"2024-06-02T04:48:07.339971+0000","last_became_active":"2024-06-02T04:48:06.709642+0000","last_became_peered":"2024-06-02T04:48:06.709642+0000","last_unstale":"2024-06-02T04:48:07.339971+0000","last_undegraded":"2024-06-02T04:48:07.339971+0000","last_fullsized":"2024-06-02T04:48:07.339971+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T10:09:46.250709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.105024+0000","last_change":"2024-06-02T04:48:02.696666+0000","last_active":"2024-06-02T04:48:07.105024+0000","last_peered":"2024-06-02T04:48:07.105024+0000","last_clean":"2024-06-02T04:48:07.105024+0000","last_became_active":"2024-06-02T04:48:02.696343+0000","last_became_peered":"2024-06-02T04:48:02.696343+0000","last_unstale":"2024-06-02T04:48:07.105024+0000","last_undegraded":"2024-06-02T04:48:07.105024+0000","last_fullsized":"2024-06-02T04:48:07.105024+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T12:31:13.426174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"80'3","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:28.281140+0000","last_change":"2024-06-02T04:48:02.268619+0000","last_active":"2024-06-02T04:48:28.281140+0000","last_peered":"2024-06-02T04:48:28.281140+0000","last_clean":"2024-06-02T04:48:28.281140+0000","last_became_active":"2024-06-02T04:48:02.268244+0000","last_became_peered":"2024-06-02T04:48:02.268244+0000","last_unstale":"2024-06-02T04:48:28.281140+0000","last_undegraded":"2024-06-02T04:48:28.281140+0000","last_fullsized":"2024-06-02T04:48:28.281140+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:15:13.469046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"19'137","reported_seq":326,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.339208+0000","last_change":"2024-06-02T04:47:15.713382+0000","last_active":"2024-06-02T04:48:07.339208+0000","last_peered":"2024-06-02T04:48:07.339208+0000","last_clean":"2024-06-02T04:48:07.339208+0000","last_became_active":"2024-06-02T04:47:15.712972+0000","last_became_peered":"2024-06-02T04:47:15.712972+0000","last_unstale":"2024-06-02T04:48:07.339208+0000","last_undegraded":"2024-06-02T04:48:07.339208+0000","last_fullsized":"2024-06-02T04:48:07.339208+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:44:56.604079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:44:56.604079+0000","last_clean_scrub_stamp":"2024-06-02T04:44:56.604079+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T12:54:02.306899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.030237+0000","last_change":"2024-06-02T04:48:06.964717+0000","last_active":"2024-06-02T04:48:07.030237+0000","last_peered":"2024-06-02T04:48:07.030237+0000","last_clean":"2024-06-02T04:48:07.030237+0000","last_became_active":"2024-06-02T04:48:06.964244+0000","last_became_peered":"2024-06-02T04:48:06.964244+0000","last_unstale":"2024-06-02T04:48:07.030237+0000","last_undegraded":"2024-06-02T04:48:07.030237+0000","last_fullsized":"2024-06-02T04:48:07.030237+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:26:58.901182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.691167+0000","last_change":"2024-06-02T04:48:02.703427+0000","last_active":"2024-06-02T04:48:06.691167+0000","last_peered":"2024-06-02T04:48:06.691167+0000","last_clean":"2024-06-02T04:48:06.691167+0000","last_became_active":"2024-06-02T04:48:02.703140+0000","last_became_peered":"2024-06-02T04:48:02.703140+0000","last_unstale":"2024-06-02T04:48:06.691167+0000","last_undegraded":"2024-06-02T04:48:06.691167+0000","last_fullsized":"2024-06-02T04:48:06.691167+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T10:24:07.881130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"80'3","reported_seq":19,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:27.277328+0000","last_change":"2024-06-02T04:48:02.272953+0000","last_active":"2024-06-02T04:48:27.277328+0000","last_peered":"2024-06-02T04:48:27.277328+0000","last_clean":"2024-06-02T04:48:27.277328+0000","last_became_active":"2024-06-02T04:48:02.272603+0000","last_became_peered":"2024-06-02T04:48:02.272603+0000","last_unstale":"2024-06-02T04:48:27.277328+0000","last_undegraded":"2024-06-02T04:48:27.277328+0000","last_fullsized":"2024-06-02T04:48:27.277328+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:46:33.907707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.106136+0000","last_change":"2024-06-02T04:48:06.703427+0000","last_active":"2024-06-02T04:48:07.106136+0000","last_peered":"2024-06-02T04:48:07.106136+0000","last_clean":"2024-06-02T04:48:07.106136+0000","last_became_active":"2024-06-02T04:48:06.702442+0000","last_became_peered":"2024-06-02T04:48:06.702442+0000","last_unstale":"2024-06-02T04:48:07.106136+0000","last_undegraded":"2024-06-02T04:48:07.106136+0000","last_fullsized":"2024-06-02T04:48:07.106136+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T14:47:12.376520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"80'1","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:26.275366+0000","last_change":"2024-06-02T04:48:02.277241+0000","last_active":"2024-06-02T04:48:26.275366+0000","last_peered":"2024-06-02T04:48:26.275366+0000","last_clean":"2024-06-02T04:48:26.275366+0000","last_became_active":"2024-06-02T04:48:02.276903+0000","last_became_peered":"2024-06-02T04:48:02.276903+0000","last_unstale":"2024-06-02T04:48:26.275366+0000","last_undegraded":"2024-06-02T04:48:26.275366+0000","last_fullsized":"2024-06-02T04:48:26.275366+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:16:40.664225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.691848+0000","last_change":"2024-06-02T04:48:02.682260+0000","last_active":"2024-06-02T04:48:06.691848+0000","last_peered":"2024-06-02T04:48:06.691848+0000","last_clean":"2024-06-02T04:48:06.691848+0000","last_became_active":"2024-06-02T04:48:02.681962+0000","last_became_peered":"2024-06-02T04:48:02.681962+0000","last_unstale":"2024-06-02T04:48:06.691848+0000","last_undegraded":"2024-06-02T04:48:06.691848+0000","last_fullsized":"2024-06-02T04:48:06.691848+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:42:26.588628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.104914+0000","last_change":"2024-06-02T04:48:06.963380+0000","last_active":"2024-06-02T04:48:07.104914+0000","last_peered":"2024-06-02T04:48:07.104914+0000","last_clean":"2024-06-02T04:48:07.104914+0000","last_became_active":"2024-06-02T04:48:06.962717+0000","last_became_peered":"2024-06-02T04:48:06.962717+0000","last_unstale":"2024-06-02T04:48:07.104914+0000","last_undegraded":"2024-06-02T04:48:07.104914+0000","last_fullsized":"2024-06-02T04:48:07.104914+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T07:05:46.983987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"80'5","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:32.112975+0000","last_change":"2024-06-02T04:48:02.270183+0000","last_active":"2024-06-02T04:48:32.112975+0000","last_peered":"2024-06-02T04:48:32.112975+0000","last_clean":"2024-06-02T04:48:32.112975+0000","last_became_active":"2024-06-02T04:48:02.269880+0000","last_became_peered":"2024-06-02T04:48:02.269880+0000","last_unstale":"2024-06-02T04:48:32.112975+0000","last_undegraded":"2024-06-02T04:48:32.112975+0000","last_fullsized":"2024-06-02T04:48:32.112975+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T16:12:41.959174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.105672+0000","last_change":"2024-06-02T04:48:02.696692+0000","last_active":"2024-06-02T04:48:07.105672+0000","last_peered":"2024-06-02T04:48:07.105672+0000","last_clean":"2024-06-02T04:48:07.105672+0000","last_became_active":"2024-06-02T04:48:02.696398+0000","last_became_peered":"2024-06-02T04:48:02.696398+0000","last_unstale":"2024-06-02T04:48:07.105672+0000","last_undegraded":"2024-06-02T04:48:07.105672+0000","last_fullsized":"2024-06-02T04:48:07.105672+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T14:12:15.108989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.707203+0000","last_change":"2024-06-02T04:48:06.706766+0000","last_active":"2024-06-02T04:48:06.707203+0000","last_peered":"2024-06-02T04:48:06.707203+0000","last_clean":"2024-06-02T04:48:06.707203+0000","last_became_active":"2024-06-02T04:48:06.706440+0000","last_became_peered":"2024-06-02T04:48:06.706440+0000","last_unstale":"2024-06-02T04:48:06.707203+0000","last_undegraded":"2024-06-02T04:48:06.707203+0000","last_fullsized":"2024-06-02T04:48:06.707203+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:24:20.283467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"80'4","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:26.275167+0000","last_change":"2024-06-02T04:48:02.265259+0000","last_active":"2024-06-02T04:48:26.275167+0000","last_peered":"2024-06-02T04:48:26.275167+0000","last_clean":"2024-06-02T04:48:26.275167+0000","last_became_active":"2024-06-02T04:48:02.264931+0000","last_became_peered":"2024-06-02T04:48:02.264931+0000","last_unstale":"2024-06-02T04:48:26.275167+0000","last_undegraded":"2024-06-02T04:48:26.275167+0000","last_fullsized":"2024-06-02T04:48:26.275167+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:06:18.360519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.701931+0000","last_change":"2024-06-02T04:48:02.684808+0000","last_active":"2024-06-02T04:48:06.701931+0000","last_peered":"2024-06-02T04:48:06.701931+0000","last_clean":"2024-06-02T04:48:06.701931+0000","last_became_active":"2024-06-02T04:48:02.684492+0000","last_became_peered":"2024-06-02T04:48:02.684492+0000","last_unstale":"2024-06-02T04:48:06.701931+0000","last_undegraded":"2024-06-02T04:48:06.701931+0000","last_fullsized":"2024-06-02T04:48:06.701931+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T12:10:01.537377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.291954+0000","last_change":"2024-06-02T04:48:06.965041+0000","last_active":"2024-06-02T04:48:07.291954+0000","last_peered":"2024-06-02T04:48:07.291954+0000","last_clean":"2024-06-02T04:48:07.291954+0000","last_became_active":"2024-06-02T04:48:06.964487+0000","last_became_peered":"2024-06-02T04:48:06.964487+0000","last_unstale":"2024-06-02T04:48:07.291954+0000","last_undegraded":"2024-06-02T04:48:07.291954+0000","last_fullsized":"2024-06-02T04:48:07.291954+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:51:05.082026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:26.276806+0000","last_change":"2024-06-02T04:48:02.271485+0000","last_active":"2024-06-02T04:48:26.276806+0000","last_peered":"2024-06-02T04:48:26.276806+0000","last_clean":"2024-06-02T04:48:26.276806+0000","last_became_active":"2024-06-02T04:48:02.271156+0000","last_became_peered":"2024-06-02T04:48:02.271156+0000","last_unstale":"2024-06-02T04:48:26.276806+0000","last_undegraded":"2024-06-02T04:48:26.276806+0000","last_fullsized":"2024-06-02T04:48:26.276806+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:57:34.467559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.696113+0000","last_change":"2024-06-02T04:48:02.673700+0000","last_active":"2024-06-02T04:48:06.696113+0000","last_peered":"2024-06-02T04:48:06.696113+0000","last_clean":"2024-06-02T04:48:06.696113+0000","last_became_active":"2024-06-02T04:48:02.673262+0000","last_became_peered":"2024-06-02T04:48:02.673262+0000","last_unstale":"2024-06-02T04:48:06.696113+0000","last_undegraded":"2024-06-02T04:48:06.696113+0000","last_fullsized":"2024-06-02T04:48:06.696113+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:45:00.682562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.717730+0000","last_change":"2024-06-02T04:48:06.716848+0000","last_active":"2024-06-02T04:48:06.717730+0000","last_peered":"2024-06-02T04:48:06.717730+0000","last_clean":"2024-06-02T04:48:06.717730+0000","last_became_active":"2024-06-02T04:48:06.716411+0000","last_became_peered":"2024-06-02T04:48:06.716411+0000","last_unstale":"2024-06-02T04:48:06.717730+0000","last_undegraded":"2024-06-02T04:48:06.717730+0000","last_fullsized":"2024-06-02T04:48:06.717730+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T06:09:36.074569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"80'3","reported_seq":19,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:26.273955+0000","last_change":"2024-06-02T04:48:02.269426+0000","last_active":"2024-06-02T04:48:26.273955+0000","last_peered":"2024-06-02T04:48:26.273955+0000","last_clean":"2024-06-02T04:48:26.273955+0000","last_became_active":"2024-06-02T04:48:02.269115+0000","last_became_peered":"2024-06-02T04:48:02.269115+0000","last_unstale":"2024-06-02T04:48:26.273955+0000","last_undegraded":"2024-06-02T04:48:26.273955+0000","last_fullsized":"2024-06-02T04:48:26.273955+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:18:28.568367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.691586+0000","last_change":"2024-06-02T04:48:02.694234+0000","last_active":"2024-06-02T04:48:06.691586+0000","last_peered":"2024-06-02T04:48:06.691586+0000","last_clean":"2024-06-02T04:48:06.691586+0000","last_became_active":"2024-06-02T04:48:02.693916+0000","last_became_peered":"2024-06-02T04:48:02.693916+0000","last_unstale":"2024-06-02T04:48:06.691586+0000","last_undegraded":"2024-06-02T04:48:06.691586+0000","last_fullsized":"2024-06-02T04:48:06.691586+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T16:47:44.939277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"80'1","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:10.229530+0000","last_change":"2024-06-02T04:48:06.716026+0000","last_active":"2024-06-02T04:48:10.229530+0000","last_peered":"2024-06-02T04:48:10.229530+0000","last_clean":"2024-06-02T04:48:10.229530+0000","last_became_active":"2024-06-02T04:48:06.715730+0000","last_became_peered":"2024-06-02T04:48:06.715730+0000","last_unstale":"2024-06-02T04:48:10.229530+0000","last_undegraded":"2024-06-02T04:48:10.229530+0000","last_fullsized":"2024-06-02T04:48:10.229530+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:35:53.707307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"80'1","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.338726+0000","last_change":"2024-06-02T04:48:02.271576+0000","last_active":"2024-06-02T04:48:07.338726+0000","last_peered":"2024-06-02T04:48:07.338726+0000","last_clean":"2024-06-02T04:48:07.338726+0000","last_became_active":"2024-06-02T04:48:02.271101+0000","last_became_peered":"2024-06-02T04:48:02.271101+0000","last_unstale":"2024-06-02T04:48:07.338726+0000","last_undegraded":"2024-06-02T04:48:07.338726+0000","last_fullsized":"2024-06-02T04:48:07.338726+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T08:35:37.467479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.105325+0000","last_change":"2024-06-02T04:48:02.702773+0000","last_active":"2024-06-02T04:48:07.105325+0000","last_peered":"2024-06-02T04:48:07.105325+0000","last_clean":"2024-06-02T04:48:07.105325+0000","last_became_active":"2024-06-02T04:48:02.702415+0000","last_became_peered":"2024-06-02T04:48:02.702415+0000","last_unstale":"2024-06-02T04:48:07.105325+0000","last_undegraded":"2024-06-02T04:48:07.105325+0000","last_fullsized":"2024-06-02T04:48:07.105325+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:18:55.084384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.291891+0000","last_change":"2024-06-02T04:48:06.963120+0000","last_active":"2024-06-02T04:48:07.291891+0000","last_peered":"2024-06-02T04:48:07.291891+0000","last_clean":"2024-06-02T04:48:07.291891+0000","last_became_active":"2024-06-02T04:48:06.962509+0000","last_became_peered":"2024-06-02T04:48:06.962509+0000","last_unstale":"2024-06-02T04:48:07.291891+0000","last_undegraded":"2024-06-02T04:48:07.291891+0000","last_fullsized":"2024-06-02T04:48:07.291891+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T04:55:34.509179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:26.277127+0000","last_change":"2024-06-02T04:48:02.273511+0000","last_active":"2024-06-02T04:48:26.277127+0000","last_peered":"2024-06-02T04:48:26.277127+0000","last_clean":"2024-06-02T04:48:26.277127+0000","last_became_active":"2024-06-02T04:48:02.273100+0000","last_became_peered":"2024-06-02T04:48:02.273100+0000","last_unstale":"2024-06-02T04:48:26.277127+0000","last_undegraded":"2024-06-02T04:48:26.277127+0000","last_fullsized":"2024-06-02T04:48:26.277127+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:04:11.742406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.698614+0000","last_change":"2024-06-02T04:48:02.696594+0000","last_active":"2024-06-02T04:48:06.698614+0000","last_peered":"2024-06-02T04:48:06.698614+0000","last_clean":"2024-06-02T04:48:06.698614+0000","last_became_active":"2024-06-02T04:48:02.696278+0000","last_became_peered":"2024-06-02T04:48:02.696278+0000","last_unstale":"2024-06-02T04:48:06.698614+0000","last_undegraded":"2024-06-02T04:48:06.698614+0000","last_fullsized":"2024-06-02T04:48:06.698614+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T16:10:16.275451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.339646+0000","last_change":"2024-06-02T04:48:06.701837+0000","last_active":"2024-06-02T04:48:07.339646+0000","last_peered":"2024-06-02T04:48:07.339646+0000","last_clean":"2024-06-02T04:48:07.339646+0000","last_became_active":"2024-06-02T04:48:06.701454+0000","last_became_peered":"2024-06-02T04:48:06.701454+0000","last_unstale":"2024-06-02T04:48:07.339646+0000","last_undegraded":"2024-06-02T04:48:07.339646+0000","last_fullsized":"2024-06-02T04:48:07.339646+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T16:25:46.585200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"80'3","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:27.277685+0000","last_change":"2024-06-02T04:48:02.272941+0000","last_active":"2024-06-02T04:48:27.277685+0000","last_peered":"2024-06-02T04:48:27.277685+0000","last_clean":"2024-06-02T04:48:27.277685+0000","last_became_active":"2024-06-02T04:48:02.270149+0000","last_became_peered":"2024-06-02T04:48:02.270149+0000","last_unstale":"2024-06-02T04:48:27.277685+0000","last_undegraded":"2024-06-02T04:48:27.277685+0000","last_fullsized":"2024-06-02T04:48:27.277685+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T04:54:09.813917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.699678+0000","last_change":"2024-06-02T04:48:02.699722+0000","last_active":"2024-06-02T04:48:06.699678+0000","last_peered":"2024-06-02T04:48:06.699678+0000","last_clean":"2024-06-02T04:48:06.699678+0000","last_became_active":"2024-06-02T04:48:02.699376+0000","last_became_peered":"2024-06-02T04:48:02.699376+0000","last_unstale":"2024-06-02T04:48:06.699678+0000","last_undegraded":"2024-06-02T04:48:06.699678+0000","last_fullsized":"2024-06-02T04:48:06.699678+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T08:12:24.048499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.338868+0000","last_change":"2024-06-02T04:48:06.706493+0000","last_active":"2024-06-02T04:48:07.338868+0000","last_peered":"2024-06-02T04:48:07.338868+0000","last_clean":"2024-06-02T04:48:07.338868+0000","last_became_active":"2024-06-02T04:48:06.706135+0000","last_became_peered":"2024-06-02T04:48:06.706135+0000","last_unstale":"2024-06-02T04:48:07.338868+0000","last_undegraded":"2024-06-02T04:48:07.338868+0000","last_fullsized":"2024-06-02T04:48:07.338868+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:54:51.491641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"75'1","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.339950+0000","last_change":"2024-06-02T04:48:02.271534+0000","last_active":"2024-06-02T04:48:07.339950+0000","last_peered":"2024-06-02T04:48:07.339950+0000","last_clean":"2024-06-02T04:48:07.339950+0000","last_became_active":"2024-06-02T04:48:02.271144+0000","last_became_peered":"2024-06-02T04:48:02.271144+0000","last_unstale":"2024-06-02T04:48:07.339950+0000","last_undegraded":"2024-06-02T04:48:07.339950+0000","last_fullsized":"2024-06-02T04:48:07.339950+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:45:10.221432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.698395+0000","last_change":"2024-06-02T04:48:02.697089+0000","last_active":"2024-06-02T04:48:06.698395+0000","last_peered":"2024-06-02T04:48:06.698395+0000","last_clean":"2024-06-02T04:48:06.698395+0000","last_became_active":"2024-06-02T04:48:02.696755+0000","last_became_peered":"2024-06-02T04:48:02.696755+0000","last_unstale":"2024-06-02T04:48:06.698395+0000","last_undegraded":"2024-06-02T04:48:06.698395+0000","last_fullsized":"2024-06-02T04:48:06.698395+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T08:56:18.715019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.030079+0000","last_change":"2024-06-02T04:48:06.705906+0000","last_active":"2024-06-02T04:48:07.030079+0000","last_peered":"2024-06-02T04:48:07.030079+0000","last_clean":"2024-06-02T04:48:07.030079+0000","last_became_active":"2024-06-02T04:48:06.705502+0000","last_became_peered":"2024-06-02T04:48:06.705502+0000","last_unstale":"2024-06-02T04:48:07.030079+0000","last_undegraded":"2024-06-02T04:48:07.030079+0000","last_fullsized":"2024-06-02T04:48:07.030079+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T16:33:41.228392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"75'2","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.691448+0000","last_change":"2024-06-02T04:48:02.265912+0000","last_active":"2024-06-02T04:48:06.691448+0000","last_peered":"2024-06-02T04:48:06.691448+0000","last_clean":"2024-06-02T04:48:06.691448+0000","last_became_active":"2024-06-02T04:48:02.265494+0000","last_became_peered":"2024-06-02T04:48:02.265494+0000","last_unstale":"2024-06-02T04:48:06.691448+0000","last_undegraded":"2024-06-02T04:48:06.691448+0000","last_fullsized":"2024-06-02T04:48:06.691448+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T10:21:58.897765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.699265+0000","last_change":"2024-06-02T04:48:02.693091+0000","last_active":"2024-06-02T04:48:06.699265+0000","last_peered":"2024-06-02T04:48:06.699265+0000","last_clean":"2024-06-02T04:48:06.699265+0000","last_became_active":"2024-06-02T04:48:02.692025+0000","last_became_peered":"2024-06-02T04:48:02.692025+0000","last_unstale":"2024-06-02T04:48:06.699265+0000","last_undegraded":"2024-06-02T04:48:06.699265+0000","last_fullsized":"2024-06-02T04:48:06.699265+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T14:36:35.813881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.691657+0000","last_change":"2024-06-02T04:48:02.694381+0000","last_active":"2024-06-02T04:48:06.691657+0000","last_peered":"2024-06-02T04:48:06.691657+0000","last_clean":"2024-06-02T04:48:06.691657+0000","last_became_active":"2024-06-02T04:48:02.694049+0000","last_became_peered":"2024-06-02T04:48:02.694049+0000","last_unstale":"2024-06-02T04:48:06.691657+0000","last_undegraded":"2024-06-02T04:48:06.691657+0000","last_fullsized":"2024-06-02T04:48:06.691657+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:04:31.920810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.701162+0000","last_change":"2024-06-02T04:48:02.702174+0000","last_active":"2024-06-02T04:48:06.701162+0000","last_peered":"2024-06-02T04:48:06.701162+0000","last_clean":"2024-06-02T04:48:06.701162+0000","last_became_active":"2024-06-02T04:48:02.701893+0000","last_became_peered":"2024-06-02T04:48:02.701893+0000","last_unstale":"2024-06-02T04:48:06.701162+0000","last_undegraded":"2024-06-02T04:48:06.701162+0000","last_fullsized":"2024-06-02T04:48:06.701162+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:39:07.224256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.696402+0000","last_change":"2024-06-02T04:48:02.688547+0000","last_active":"2024-06-02T04:48:06.696402+0000","last_peered":"2024-06-02T04:48:06.696402+0000","last_clean":"2024-06-02T04:48:06.696402+0000","last_became_active":"2024-06-02T04:48:02.688183+0000","last_became_peered":"2024-06-02T04:48:02.688183+0000","last_unstale":"2024-06-02T04:48:06.696402+0000","last_undegraded":"2024-06-02T04:48:06.696402+0000","last_fullsized":"2024-06-02T04:48:06.696402+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:47:22.399630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.701544+0000","last_change":"2024-06-02T04:48:02.702958+0000","last_active":"2024-06-02T04:48:06.701544+0000","last_peered":"2024-06-02T04:48:06.701544+0000","last_clean":"2024-06-02T04:48:06.701544+0000","last_became_active":"2024-06-02T04:48:02.702640+0000","last_became_peered":"2024-06-02T04:48:02.702640+0000","last_unstale":"2024-06-02T04:48:06.701544+0000","last_undegraded":"2024-06-02T04:48:06.701544+0000","last_fullsized":"2024-06-02T04:48:06.701544+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T12:53:17.406762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.691930+0000","last_change":"2024-06-02T04:48:02.702817+0000","last_active":"2024-06-02T04:48:06.691930+0000","last_peered":"2024-06-02T04:48:06.691930+0000","last_clean":"2024-06-02T04:48:06.691930+0000","last_became_active":"2024-06-02T04:48:02.702526+0000","last_became_peered":"2024-06-02T04:48:02.702526+0000","last_unstale":"2024-06-02T04:48:06.691930+0000","last_undegraded":"2024-06-02T04:48:06.691930+0000","last_fullsized":"2024-06-02T04:48:06.691930+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:54:58.505585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.691852+0000","last_change":"2024-06-02T04:48:02.690645+0000","last_active":"2024-06-02T04:48:06.691852+0000","last_peered":"2024-06-02T04:48:06.691852+0000","last_clean":"2024-06-02T04:48:06.691852+0000","last_became_active":"2024-06-02T04:48:02.690282+0000","last_became_peered":"2024-06-02T04:48:02.690282+0000","last_unstale":"2024-06-02T04:48:06.691852+0000","last_undegraded":"2024-06-02T04:48:06.691852+0000","last_fullsized":"2024-06-02T04:48:06.691852+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:30:16.471475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.697098+0000","last_change":"2024-06-02T04:48:02.698865+0000","last_active":"2024-06-02T04:48:06.697098+0000","last_peered":"2024-06-02T04:48:06.697098+0000","last_clean":"2024-06-02T04:48:06.697098+0000","last_became_active":"2024-06-02T04:48:02.698554+0000","last_became_peered":"2024-06-02T04:48:02.698554+0000","last_unstale":"2024-06-02T04:48:06.697098+0000","last_undegraded":"2024-06-02T04:48:06.697098+0000","last_fullsized":"2024-06-02T04:48:06.697098+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:19:14.413170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.105716+0000","last_change":"2024-06-02T04:48:02.694345+0000","last_active":"2024-06-02T04:48:07.105716+0000","last_peered":"2024-06-02T04:48:07.105716+0000","last_clean":"2024-06-02T04:48:07.105716+0000","last_became_active":"2024-06-02T04:48:02.693866+0000","last_became_peered":"2024-06-02T04:48:02.693866+0000","last_unstale":"2024-06-02T04:48:07.105716+0000","last_undegraded":"2024-06-02T04:48:07.105716+0000","last_fullsized":"2024-06-02T04:48:07.105716+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:56:09.409774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.030106+0000","last_change":"2024-06-02T04:48:02.689609+0000","last_active":"2024-06-02T04:48:07.030106+0000","last_peered":"2024-06-02T04:48:07.030106+0000","last_clean":"2024-06-02T04:48:07.030106+0000","last_became_active":"2024-06-02T04:48:02.689279+0000","last_became_peered":"2024-06-02T04:48:02.689279+0000","last_unstale":"2024-06-02T04:48:07.030106+0000","last_undegraded":"2024-06-02T04:48:07.030106+0000","last_fullsized":"2024-06-02T04:48:07.030106+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T14:05:04.600923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.105060+0000","last_change":"2024-06-02T04:48:02.694124+0000","last_active":"2024-06-02T04:48:07.105060+0000","last_peered":"2024-06-02T04:48:07.105060+0000","last_clean":"2024-06-02T04:48:07.105060+0000","last_became_active":"2024-06-02T04:48:02.693787+0000","last_became_peered":"2024-06-02T04:48:02.693787+0000","last_unstale":"2024-06-02T04:48:07.105060+0000","last_undegraded":"2024-06-02T04:48:07.105060+0000","last_fullsized":"2024-06-02T04:48:07.105060+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T07:56:27.274107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.692381+0000","last_change":"2024-06-02T04:48:02.698736+0000","last_active":"2024-06-02T04:48:06.692381+0000","last_peered":"2024-06-02T04:48:06.692381+0000","last_clean":"2024-06-02T04:48:06.692381+0000","last_became_active":"2024-06-02T04:48:02.698285+0000","last_became_peered":"2024-06-02T04:48:02.698285+0000","last_unstale":"2024-06-02T04:48:06.692381+0000","last_undegraded":"2024-06-02T04:48:06.692381+0000","last_fullsized":"2024-06-02T04:48:06.692381+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T04:53:31.655139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.691329+0000","last_change":"2024-06-02T04:48:02.689942+0000","last_active":"2024-06-02T04:48:06.691329+0000","last_peered":"2024-06-02T04:48:06.691329+0000","last_clean":"2024-06-02T04:48:06.691329+0000","last_became_active":"2024-06-02T04:48:02.689096+0000","last_became_peered":"2024-06-02T04:48:02.689096+0000","last_unstale":"2024-06-02T04:48:06.691329+0000","last_undegraded":"2024-06-02T04:48:06.691329+0000","last_fullsized":"2024-06-02T04:48:06.691329+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:11:06.451048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.691855+0000","last_change":"2024-06-02T04:48:02.691514+0000","last_active":"2024-06-02T04:48:06.691855+0000","last_peered":"2024-06-02T04:48:06.691855+0000","last_clean":"2024-06-02T04:48:06.691855+0000","last_became_active":"2024-06-02T04:48:02.691169+0000","last_became_peered":"2024-06-02T04:48:02.691169+0000","last_unstale":"2024-06-02T04:48:06.691855+0000","last_undegraded":"2024-06-02T04:48:06.691855+0000","last_fullsized":"2024-06-02T04:48:06.691855+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T06:03:54.513910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":280790,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":63751,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":217,"num_read_kb":175,"num_write":154,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":191253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":136,"ondisk_log_size":136,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":71,"seq":304942678036,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27876,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717276,"statfs":{"total":95995035648,"available":95966490624,"internally_reserved":0,"allocated":880640,"data_stored":442067,"data_compressed":11656,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 04:48:31 2024","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.55900000000000005}]},{"osd":1,"last update":"Sun Jun 2 04:48:31 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.68999999999999995}]},{"osd":2,"last update":"Sun Jun 2 04:48:31 2024","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.434,"15min":0.434},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.441,"5min":0.441,"15min":0.441},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.58799999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":4,"last update":"Sun Jun 2 04:48:31 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.85499999999999998}]},{"osd":5,"last update":"Sun Jun 2 04:48:31 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.63700000000000001}]},{"osd":6,"last update":"Sun Jun 2 04:48:31 2024","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.86899999999999999}]},{"osd":7,"last update":"Sun Jun 2 04:48:31 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.88300000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81599999999999995}]},{"osd":9,"last update":"Sun Jun 2 04:48:31 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.429,"5min":1.429,"15min":1.429},"last":0.89400000000000002}]},{"osd":10,"last update":"Sun Jun 2 04:48:31 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.92400000000000004}]}]},{"osd":10,"up_from":64,"seq":274877906969,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32112,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713040,"statfs":{"total":95995035648,"available":95962152960,"internally_reserved":0,"allocated":1024000,"data_stored":1089131,"data_compressed":47369,"data_compressed_allocated":61440,"data_compressed_original":622592,"omap_allocated":1599,"internal_metadata":31848897},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":1,"last update":"Sun Jun 2 04:48:17 2024","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.68000000000000005}]},{"osd":2,"last update":"Sun Jun 2 04:48:17 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.71299999999999997}]},{"osd":3,"last update":"Sun Jun 2 04:48:17 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.73499999999999999}]},{"osd":4,"last update":"Sun Jun 2 04:48:17 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.83999999999999997}]},{"osd":5,"last update":"Sun Jun 2 04:48:17 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.76300000000000001}]},{"osd":6,"last update":"Sun Jun 2 04:48:17 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.82699999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":8,"last update":"Sun Jun 2 04:48:17 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.97999999999999998}]},{"osd":9,"last update":"Sun Jun 2 04:48:17 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.87},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.95899999999999996}]},{"osd":11,"last update":"Sun Jun 2 04:48:33 2024","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.92500000000000004}]}]},{"osd":9,"up_from":60,"seq":257698037789,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31992,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713160,"statfs":{"total":95995035648,"available":95962275840,"internally_reserved":0,"allocated":901120,"data_stored":446399,"data_compressed":11656,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1599,"internal_metadata":31848897},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 04:49:00 2024","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.439,"15min":0.45200000000000001},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.51600000000000001,"5min":0.621,"15min":0.621},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.443,"15min":0.46000000000000002},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.45400000000000001,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.29199999999999998}]},{"osd":1,"last update":"Sun Jun 2 04:49:00 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.59899999999999998,"15min":0.60699999999999998},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.74199999999999999,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.61299999999999999,"15min":0.625},"min":{"1min":0.41599999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.72599999999999998,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.46400000000000002}]},{"osd":2,"last update":"Sun Jun 2 04:49:00 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.60699999999999998,"15min":0.62},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.68999999999999995,"5min":0.748,"15min":0.748},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.57699999999999996,"15min":0.58499999999999996},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.72799999999999998,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.38200000000000001}]},{"osd":3,"last update":"Sun Jun 2 04:49:00 2024","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.51800000000000002,"15min":0.53900000000000003},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.52000000000000002,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.55900000000000005,"15min":0.58099999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.39100000000000001}]},{"osd":4,"last update":"Sun Jun 2 04:49:00 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.60799999999999998,"15min":0.621},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.71099999999999997,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.64900000000000002,"15min":0.65900000000000003},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.79500000000000004,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.45200000000000001}]},{"osd":5,"last update":"Sun Jun 2 04:49:00 2024","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.60399999999999998,"15min":0.61699999999999999},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.71299999999999997,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.438},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.67100000000000004,"15min":0.68300000000000005},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.74099999999999999,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.54400000000000004}]},{"osd":6,"last update":"Sun Jun 2 04:47:56 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.505}]},{"osd":7,"last update":"Sun Jun 2 04:49:00 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.75900000000000001,"15min":0.78500000000000003},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.82299999999999995,"5min":1.081,"15min":1.081},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.73999999999999999,"15min":0.76100000000000001},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.83599999999999997,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.495}]},{"osd":8,"last update":"Sun Jun 2 04:49:00 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.76000000000000001,"15min":0.78400000000000003},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.79900000000000004,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.73599999999999999,"15min":0.75800000000000001},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.80700000000000005,"5min":1.01,"15min":1.01},"last":0.47599999999999998}]},{"osd":10,"last update":"Sun Jun 2 04:48:13 2024","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.50600000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]}]},{"osd":8,"up_from":53,"seq":227633266720,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":892928,"data_stored":441892,"data_compressed":11656,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 04:48:38 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.54600000000000004,"15min":0.54300000000000004},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.77300000000000002,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.52800000000000002,"15min":0.52400000000000002},"min":{"1min":0.45900000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.34699999999999998}]},{"osd":1,"last update":"Sun Jun 2 04:48:38 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.53900000000000003,"15min":0.53300000000000003},"min":{"1min":0.36899999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.629}]},{"osd":2,"last update":"Sun Jun 2 04:48:38 2024","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.42699999999999999,"15min":0.42299999999999999},"min":{"1min":0.311,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.379},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.437,"15min":0.433},"min":{"1min":0.26900000000000002,"5min":0.245,"15min":0.245},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.36299999999999999}]},{"osd":3,"last update":"Sun Jun 2 04:48:38 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.53500000000000003,"15min":0.52900000000000003},"min":{"1min":0.35099999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.56100000000000005,"15min":0.55700000000000005},"min":{"1min":0.41199999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.72999999999999998,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.41199999999999998}]},{"osd":4,"last update":"Sun Jun 2 04:48:38 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.56999999999999995,"15min":0.56799999999999995},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.496},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.40999999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.76100000000000001,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.47099999999999997}]},{"osd":5,"last update":"Sun Jun 2 04:48:38 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.52500000000000002,"15min":0.52100000000000002},"min":{"1min":0.33100000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.80800000000000005,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.53500000000000003,"15min":0.53100000000000003},"min":{"1min":0.379,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.82199999999999995,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.52200000000000002}]},{"osd":6,"last update":"Sun Jun 2 04:48:38 2024","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.628,"15min":0.625},"min":{"1min":0.5,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.79100000000000004,"5min":0.876,"15min":0.876},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.63200000000000001,"15min":0.628},"min":{"1min":0.40600000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.84099999999999997,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.54700000000000004}]},{"osd":7,"last update":"Sun Jun 2 04:48:38 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.66400000000000003,"15min":0.65900000000000003},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.91000000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.67300000000000004,"15min":0.66700000000000004},"min":{"1min":0.50900000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.57199999999999995}]},{"osd":9,"last update":"Sun Jun 2 04:48:59 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.67100000000000004,"15min":0.66100000000000003},"min":{"1min":0.51600000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.68999999999999995,"15min":0.68500000000000005},"min":{"1min":0.47099999999999997,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.91800000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.60799999999999998}]},{"osd":10,"last update":"Sun Jun 2 04:48:16 2024","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.64000000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]}]},{"osd":7,"up_from":46,"seq":197568495652,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32036,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713116,"statfs":{"total":95995035648,"available":95962230784,"internally_reserved":0,"allocated":946176,"data_stored":1038431,"data_compressed":47369,"data_compressed_allocated":61440,"data_compressed_original":622592,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 04:47:20 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.30199999999999999}]},{"osd":1,"last update":"Sun Jun 2 04:48:22 2024","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.42599999999999999,"15min":0.42299999999999999},"min":{"1min":0.31900000000000001,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.629,"5min":0.746,"15min":0.746},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.42999999999999999,"15min":0.42199999999999999},"min":{"1min":0.33600000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.66900000000000004,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.29399999999999998}]},{"osd":2,"last update":"Sun Jun 2 04:48:22 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.57999999999999996,"15min":0.57199999999999995},"min":{"1min":0.434,"5min":0.31,"15min":0.31},"max":{"1min":0.80700000000000005,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.58199999999999996,"15min":0.57399999999999995},"min":{"1min":0.42099999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.85899999999999999,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.39300000000000002}]},{"osd":3,"last update":"Sun Jun 2 04:48:22 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.59599999999999997,"15min":0.58999999999999997},"min":{"1min":0.435,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.93100000000000005,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.623,"5min":0.56899999999999995,"15min":0.56000000000000005},"min":{"1min":0.379,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.435}]},{"osd":4,"last update":"Sun Jun 2 04:48:22 2024","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.442,"15min":0.437},"min":{"1min":0.34899999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.312},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.54300000000000004,"15min":0.53700000000000003},"min":{"1min":0.33200000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.746,"5min":0.879,"15min":0.879},"last":0.40699999999999997}]},{"osd":5,"last update":"Sun Jun 2 04:48:22 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.59999999999999998,"15min":0.59499999999999997},"min":{"1min":0.42099999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.66700000000000004,"15min":0.66100000000000003},"min":{"1min":0.48699999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.95299999999999996,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.36699999999999999}]},{"osd":6,"last update":"Sun Jun 2 04:48:22 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.63300000000000001,"15min":0.625},"min":{"1min":0.46899999999999997,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.624,"15min":0.61399999999999999},"min":{"1min":0.505,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.91800000000000004,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.45200000000000001}]},{"osd":8,"last update":"Sun Jun 2 04:48:42 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.70799999999999996,"15min":0.69799999999999995},"min":{"1min":0.54500000000000004,"5min":0.441,"15min":0.441},"max":{"1min":1.0069999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.66900000000000004,"15min":0.66000000000000003},"min":{"1min":0.55400000000000005,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.49099999999999999}]},{"osd":9,"last update":"Sun Jun 2 04:48:57 2024","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.72599999999999998,"15min":0.72799999999999998},"min":{"1min":0.51600000000000001,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.97399999999999998,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.70699999999999996,"15min":0.70899999999999996},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.879,"5min":1.042,"15min":1.042},"last":0.50700000000000001}]},{"osd":10,"last update":"Sun Jun 2 04:48:16 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.5}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]}]},{"osd":6,"up_from":40,"seq":171798691878,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27872,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717280,"statfs":{"total":95995035648,"available":95966494720,"internally_reserved":0,"allocated":876544,"data_stored":437479,"data_compressed":11656,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 04:48:05 2024","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.38300000000000001,"15min":0.38600000000000001},"min":{"1min":0.27400000000000002,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.40200000000000002,"15min":0.41099999999999998},"min":{"1min":0.28699999999999998,"5min":0.251,"15min":0.251},"max":{"1min":0.49199999999999999,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.29899999999999999}]},{"osd":1,"last update":"Sun Jun 2 04:48:05 2024","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.56000000000000005,"15min":0.56399999999999995},"min":{"1min":0.378,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.73499999999999999,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.57899999999999996,"15min":0.58399999999999996},"min":{"1min":0.33600000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.749,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.45000000000000001}]},{"osd":2,"last update":"Sun Jun 2 04:48:05 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.56699999999999995,"15min":0.56899999999999995},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.746,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.57899999999999996,"15min":0.58199999999999996},"min":{"1min":0.40000000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.78300000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.373}]},{"osd":3,"last update":"Sun Jun 2 04:48:05 2024","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.44700000000000001,"15min":0.45600000000000002},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.65700000000000003,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.46400000000000002,"15min":0.47099999999999997},"min":{"1min":0.32800000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.52900000000000003,"5min":0.745,"15min":0.745},"last":0.57199999999999995}]},{"osd":4,"last update":"Sun Jun 2 04:48:05 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.60199999999999998,"15min":0.60399999999999998},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.78900000000000003,"5min":1.032,"15min":1.032},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.626,"15min":0.63800000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.69799999999999995,"5min":1.071,"15min":1.071},"last":0.58399999999999996}]},{"osd":5,"last update":"Sun Jun 2 04:48:05 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.61499999999999999,"15min":0.62},"min":{"1min":0.39500000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.436},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.64500000000000002,"15min":0.65100000000000002},"min":{"1min":0.48099999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.77000000000000002,"5min":0.999,"15min":0.999},"last":0.55900000000000005}]},{"osd":7,"last update":"Sun Jun 2 04:48:23 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.63600000000000001,"15min":0.63900000000000001},"min":{"1min":0.45300000000000001,"5min":0.439,"15min":0.439},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.64100000000000001,"15min":0.64800000000000002},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.79400000000000004,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.62}]},{"osd":8,"last update":"Sun Jun 2 04:48:39 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.68500000000000005,"15min":0.68000000000000005},"min":{"1min":0.501,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.897,"5min":1.897,"15min":1.897},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.69699999999999995,"15min":0.69899999999999995},"min":{"1min":0.47299999999999998,"5min":0.443,"15min":0.443},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.63100000000000001}]},{"osd":9,"last update":"Sun Jun 2 04:47:56 2024","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.60699999999999998}]},{"osd":10,"last update":"Sun Jun 2 04:48:15 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.64700000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]}]},{"osd":1,"up_from":12,"seq":51539607608,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36128,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93709024,"statfs":{"total":95995035648,"available":95958040576,"internally_reserved":0,"allocated":942080,"data_stored":496840,"data_compressed":11656,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 04:48:46 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.51100000000000001,"15min":0.49099999999999999},"min":{"1min":0.32100000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.85599999999999998,"5min":1.131,"15min":1.131},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.50600000000000001,"15min":0.49099999999999999},"min":{"1min":0.32700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.64400000000000002}]},{"osd":2,"last update":"Sun Jun 2 04:47:59 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.35599999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.504},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.51000000000000001,"15min":0.502},"min":{"1min":0.38600000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.627}]},{"osd":3,"last update":"Sun Jun 2 04:48:16 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.5,"15min":0.48799999999999999},"min":{"1min":0.35499999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.50900000000000001,"15min":0.503},"min":{"1min":0.377,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.53600000000000003}]},{"osd":4,"last update":"Sun Jun 2 04:47:39 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.39800000000000002,"15min":0.38600000000000001},"min":{"1min":0.26400000000000001,"5min":0.248,"15min":0.248},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.41899999999999998,"15min":0.40699999999999997},"min":{"1min":0.30499999999999999,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.42699999999999999}]},{"osd":5,"last update":"Sun Jun 2 04:48:54 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.56000000000000005,"15min":0.54100000000000004},"min":{"1min":0.41999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.78000000000000003,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.624,"15min":0.59999999999999998},"min":{"1min":0.441,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.88300000000000001,"5min":1.212,"15min":1.212},"last":0.70199999999999996}]},{"osd":6,"last update":"Sun Jun 2 04:48:07 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.60499999999999998,"15min":0.59299999999999997},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.60399999999999998,"15min":0.59399999999999997},"min":{"1min":0.51000000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.67900000000000005}]},{"osd":7,"last update":"Sun Jun 2 04:48:27 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.53900000000000003,"15min":0.53800000000000003},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.627,"5min":0.58799999999999997,"15min":0.58199999999999996},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.56799999999999995}]},{"osd":8,"last update":"Sun Jun 2 04:48:41 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.67300000000000004,"15min":0.67400000000000004},"min":{"1min":0.45700000000000002,"5min":0.435,"15min":0.435},"max":{"1min":0.85399999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72899999999999998,"15min":0.72999999999999998},"min":{"1min":0.46600000000000003,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.97499999999999998,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.66500000000000004}]},{"osd":9,"last update":"Sun Jun 2 04:47:57 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.77400000000000002}]},{"osd":10,"last update":"Sun Jun 2 04:48:16 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.76100000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738427,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31992,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713160,"statfs":{"total":95995035648,"available":95962275840,"internally_reserved":0,"allocated":901120,"data_stored":438867,"data_compressed":11656,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jun 2 04:48:43 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.51000000000000001,"15min":0.46999999999999997},"min":{"1min":0.35199999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.51000000000000001,"15min":0.46500000000000002},"min":{"1min":0.32000000000000001,"5min":0.315,"15min":0.315},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.36799999999999999}]},{"osd":2,"last update":"Sun Jun 2 04:48:00 2024","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.495,"15min":0.46700000000000003},"min":{"1min":0.39300000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.5},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.51800000000000002,"15min":0.47999999999999998},"min":{"1min":0.46000000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.84799999999999998,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.78100000000000003}]},{"osd":3,"last update":"Sun Jun 2 04:47:17 2024","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.41899999999999998,"15min":0.40699999999999997},"min":{"1min":0.317,"5min":0.253,"15min":0.253},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.438,"15min":0.436},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.47899999999999998}]},{"osd":4,"last update":"Sun Jun 2 04:48:37 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.54800000000000004,"15min":0.52100000000000002},"min":{"1min":0.38200000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.53800000000000003,"15min":0.52400000000000002},"min":{"1min":0.42599999999999999,"5min":0.372,"15min":0.372},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.51800000000000002}]},{"osd":5,"last update":"Sun Jun 2 04:48:52 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.57199999999999995,"15min":0.53900000000000003},"min":{"1min":0.377,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.57299999999999995,"15min":0.54100000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.46600000000000003}]},{"osd":6,"last update":"Sun Jun 2 04:48:08 2024","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.49199999999999999,"15min":0.49299999999999999},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.76300000000000001,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.47099999999999997,"15min":0.46899999999999997},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.66900000000000004}]},{"osd":7,"last update":"Sun Jun 2 04:47:21 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":1.139},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":1.099}]},{"osd":8,"last update":"Sun Jun 2 04:48:41 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.64200000000000002,"15min":0.64500000000000002},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.70299999999999996,"15min":0.70699999999999996},"min":{"1min":0.54500000000000004,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.98599999999999999}]},{"osd":9,"last update":"Sun Jun 2 04:48:57 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.627,"15min":0.63700000000000001},"min":{"1min":0.36699999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.60799999999999998,"15min":0.60999999999999999},"min":{"1min":0.39600000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.76000000000000001}]},{"osd":10,"last update":"Sun Jun 2 04:48:16 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":1.1220000000000001},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.56000000000000005}]},{"osd":11,"last update":"Sun Jun 2 04:48:32 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":1.008}]}]},{"osd":2,"up_from":16,"seq":68719476789,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32056,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713096,"statfs":{"total":95995035648,"available":95962210304,"internally_reserved":0,"allocated":966656,"data_stored":498535,"data_compressed":11656,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 04:48:05 2024","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.496,"15min":0.48599999999999999},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.71499999999999997,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.50800000000000001,"15min":0.50900000000000001},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.66200000000000003,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.39500000000000002}]},{"osd":1,"last update":"Sun Jun 2 04:48:05 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.53500000000000003,"15min":0.52900000000000003},"min":{"1min":0.36899999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.74299999999999999,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.54200000000000004,"15min":0.54400000000000004},"min":{"1min":0.39700000000000002,"5min":0.254,"15min":0.254},"max":{"1min":0.79300000000000004,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.81100000000000005}]},{"osd":3,"last update":"Sun Jun 2 04:48:22 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.55500000000000005,"15min":0.55700000000000005},"min":{"1min":0.39000000000000001,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.71599999999999997,"5min":1.472,"15min":1.472},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.53200000000000003,"15min":0.52700000000000002},"min":{"1min":0.372,"5min":0.308,"15min":0.308},"max":{"1min":0.80400000000000005,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.55700000000000005}]},{"osd":4,"last update":"Sun Jun 2 04:47:33 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.51700000000000002,"15min":0.51300000000000001},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.68100000000000005,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.34699999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.66400000000000003,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.61899999999999999}]},{"osd":5,"last update":"Sun Jun 2 04:48:53 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.46400000000000002,"15min":0.42599999999999999},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.48499999999999999,"15min":0.45300000000000001},"min":{"1min":0.34100000000000003,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.47099999999999997}]},{"osd":6,"last update":"Sun Jun 2 04:48:05 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.39900000000000002,"5min":0.372,"15min":0.372},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.441},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.64000000000000001,"15min":0.63300000000000001},"min":{"1min":0.45400000000000001,"5min":0.438,"15min":0.438},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.66900000000000004}]},{"osd":7,"last update":"Sun Jun 2 04:47:24 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.76200000000000001}]},{"osd":8,"last update":"Sun Jun 2 04:48:42 2024","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.56699999999999995,"15min":0.56100000000000005},"min":{"1min":0.42399999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.497},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.63100000000000001,"15min":0.621},"min":{"1min":0.41499999999999998,"5min":0.37,"15min":0.37},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.70999999999999996}]},{"osd":9,"last update":"Sun Jun 2 04:48:01 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.73799999999999999}]},{"osd":10,"last update":"Sun Jun 2 04:48:16 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.72199999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]}]},{"osd":3,"up_from":22,"seq":94489280561,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31980,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713172,"statfs":{"total":95995035648,"available":95962288128,"internally_reserved":0,"allocated":888832,"data_stored":437673,"data_compressed":11656,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 04:48:20 2024","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.32400000000000001,"15min":0.312},"min":{"1min":0.24199999999999999,"5min":0.221,"15min":0.221},"max":{"1min":0.44400000000000001,"5min":0.48999999999999999,"15min":0.48999999999999999},"last":0.376},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.34899999999999998,"15min":0.34100000000000003},"min":{"1min":0.255,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.55500000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.30299999999999999}]},{"osd":1,"last update":"Sun Jun 2 04:48:20 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.48299999999999998,"15min":0.46300000000000002},"min":{"1min":0.40999999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.65700000000000003,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.48999999999999999,"15min":0.46200000000000002},"min":{"1min":0.39100000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.68799999999999994,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.60599999999999998}]},{"osd":2,"last update":"Sun Jun 2 04:48:20 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.56000000000000005,"15min":0.56399999999999995},"min":{"1min":0.377,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.73999999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.44},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.57899999999999996,"15min":0.59099999999999997},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.63300000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":0.51000000000000001}]},{"osd":4,"last update":"Sun Jun 2 04:48:38 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.51400000000000001,"15min":0.499},"min":{"1min":0.41599999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.67300000000000004,"5min":0.877,"15min":0.877},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.52600000000000002,"15min":0.505},"min":{"1min":0.40999999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.72299999999999998,"5min":0.751,"15min":0.751},"last":0.52400000000000002}]},{"osd":5,"last update":"Sun Jun 2 04:48:54 2024","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.63400000000000001,"15min":0.57999999999999996},"min":{"1min":0.38900000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":7.3220000000000001,"5min":7.3220000000000001,"15min":7.3220000000000001},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55300000000000005,"15min":0.54900000000000004},"min":{"1min":0.39800000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.90000000000000002,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.44800000000000001}]},{"osd":6,"last update":"Sun Jun 2 04:48:06 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.46899999999999997,"15min":0.46700000000000003},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.47199999999999998,"15min":0.47099999999999997},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.63200000000000001,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.40300000000000002}]},{"osd":7,"last update":"Sun Jun 2 04:48:26 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.44900000000000001,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.80500000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.628,"5min":0.64800000000000002,"15min":0.65100000000000002},"min":{"1min":0.48899999999999999,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.751,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.63500000000000001}]},{"osd":8,"last update":"Sun Jun 2 04:47:39 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.51100000000000001}]},{"osd":9,"last update":"Sun Jun 2 04:48:00 2024","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.496},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.45800000000000002}]},{"osd":10,"last update":"Sun Jun 2 04:48:14 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.70699999999999996}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]}]},{"osd":4,"up_from":29,"seq":124554051630,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31980,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713172,"statfs":{"total":95995035648,"available":95962288128,"internally_reserved":0,"allocated":888832,"data_stored":442474,"data_compressed":11656,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 04:47:31 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.49199999999999999,"15min":0.48099999999999998},"min":{"1min":0.32400000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.495,"15min":0.48699999999999999},"min":{"1min":0.35199999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.78900000000000003,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.34300000000000003}]},{"osd":1,"last update":"Sun Jun 2 04:48:33 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.36099999999999999,"15min":0.34300000000000003},"min":{"1min":0.27500000000000002,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.38900000000000001,"15min":0.36699999999999999},"min":{"1min":0.30199999999999999,"5min":0.217,"15min":0.217},"max":{"1min":0.72799999999999998,"5min":0.877,"15min":0.877},"last":0.45200000000000001}]},{"osd":2,"last update":"Sun Jun 2 04:48:33 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.53900000000000003,"15min":0.52800000000000002},"min":{"1min":0.41899999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.624,"5min":0.56399999999999995,"15min":0.53800000000000003},"min":{"1min":0.47099999999999997,"5min":0.377,"15min":0.377},"max":{"1min":0.80800000000000005,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.63900000000000001}]},{"osd":3,"last update":"Sun Jun 2 04:48:33 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.54000000000000004,"15min":0.51800000000000002},"min":{"1min":0.373,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.52000000000000002,"15min":0.51000000000000001},"min":{"1min":0.38100000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.72899999999999998,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.68400000000000005}]},{"osd":5,"last update":"Sun Jun 2 04:48:53 2024","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.60999999999999999,"15min":0.60199999999999998},"min":{"1min":0.46100000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.85499999999999998,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.621,"15min":0.59999999999999998},"min":{"1min":0.46500000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.96599999999999997,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.623}]},{"osd":6,"last update":"Sun Jun 2 04:48:07 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.57199999999999995,"15min":0.55700000000000005},"min":{"1min":0.40100000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.59199999999999997,"15min":0.57599999999999996},"min":{"1min":0.41999999999999998,"5min":0.379,"15min":0.379},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.72799999999999998}]},{"osd":7,"last update":"Sun Jun 2 04:48:24 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.53100000000000003,"15min":0.52200000000000002},"min":{"1min":0.36399999999999999,"5min":0.312,"15min":0.312},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.56499999999999995,"15min":0.55100000000000005},"min":{"1min":0.38100000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.53400000000000003}]},{"osd":8,"last update":"Sun Jun 2 04:48:40 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.60599999999999998,"15min":0.60399999999999998},"min":{"1min":0.45100000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.78200000000000003,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71499999999999997,"15min":0.71399999999999997},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.94399999999999995,"5min":1.071,"15min":1.071},"last":0.91300000000000003}]},{"osd":9,"last update":"Sun Jun 2 04:48:58 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.74099999999999999,"15min":0.745},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.62,"5min":0.64200000000000002,"15min":0.64600000000000002},"min":{"1min":0.47699999999999998,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.83999999999999997,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.75}]},{"osd":10,"last update":"Sun Jun 2 04:48:15 2024","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.877},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.77600000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86399999999999999}]}]},{"osd":5,"up_from":33,"seq":141733920811,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":954368,"data_stored":1033674,"data_compressed":47369,"data_compressed_allocated":61440,"data_compressed_original":622592,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 04:48:50 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.504,"15min":0.48499999999999999},"min":{"1min":0.40200000000000002,"5min":0.249,"15min":0.249},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.47499999999999998,"15min":0.45100000000000001},"min":{"1min":0.374,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.56000000000000005}]},{"osd":1,"last update":"Sun Jun 2 04:48:50 2024","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.55300000000000005,"15min":0.52900000000000003},"min":{"1min":0.5,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.79500000000000004,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.55100000000000005,"15min":0.53500000000000003},"min":{"1min":0.47099999999999997,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.77900000000000003,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.622}]},{"osd":2,"last update":"Sun Jun 2 04:48:50 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.40999999999999998,"15min":0.39500000000000002},"min":{"1min":0.317,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.40899999999999997,"15min":0.38700000000000001},"min":{"1min":0.316,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.67900000000000005}]},{"osd":3,"last update":"Sun Jun 2 04:48:50 2024","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.53000000000000003,"15min":0.52000000000000002},"min":{"1min":0.38800000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.621,"5min":0.53900000000000003,"15min":0.51200000000000001},"min":{"1min":0.46100000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.80200000000000005,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.71499999999999997}]},{"osd":4,"last update":"Sun Jun 2 04:48:50 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.58199999999999996,"15min":0.55900000000000005},"min":{"1min":0.54200000000000004,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.58999999999999997,"15min":0.57599999999999996},"min":{"1min":0.54300000000000004,"5min":0.313,"15min":0.313},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.76500000000000001}]},{"osd":6,"last update":"Sun Jun 2 04:48:07 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56999999999999995,"15min":0.57099999999999995},"min":{"1min":0.42099999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.58599999999999997,"15min":0.57799999999999996},"min":{"1min":0.46800000000000003,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.875}]},{"osd":7,"last update":"Sun Jun 2 04:48:23 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.65600000000000003,"15min":0.65400000000000003},"min":{"1min":0.42499999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.92400000000000004,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.65500000000000003,"15min":0.64700000000000002},"min":{"1min":0.45400000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.79600000000000004}]},{"osd":8,"last update":"Sun Jun 2 04:48:43 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.60699999999999998,"15min":0.59099999999999997},"min":{"1min":0.42099999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.623,"15min":0.61599999999999999},"min":{"1min":0.39000000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.90000000000000002,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.81499999999999995}]},{"osd":9,"last update":"Sun Jun 2 04:48:01 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.93600000000000005}]},{"osd":10,"last update":"Sun Jun 2 04:48:13 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.90500000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34075,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34075,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34075,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35713,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35713,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35713,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35713,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35713,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":59451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":61146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":989,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":61374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-02T04:49:05.184 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell --fsid 60ab6d30-209a-11ef-bc9b-c7b262605968 -- ceph pg dump --format=json 2024-06-02T04:49:05.185 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:04 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:49:05.185 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:04 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:49:05.185 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:04 smithi192 ceph-mon[47933]: pgmap v249: 129 pgs: 129 active+clean; 639 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-06-02T04:49:05.185 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:04 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:49:05.185 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:04 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:49:05.185 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:04 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:49:05.407 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T04:49:06.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:05 smithi192 ceph-mon[47933]: from='client.15093 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-02T04:49:06.221 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:05 smithi076 ceph-mon[42935]: from='client.15093 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-02T04:49:06.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:05 smithi119 ceph-mon[46633]: from='client.15093 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-02T04:49:06.414 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:06.413+0000 7feb7cbd9700 1 -- 172.21.15.76:0/3158662469 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7feb780ffed0 msgr2=0x7feb78100350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:06.414 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:06.413+0000 7feb7cbd9700 1 --2- 172.21.15.76:0/3158662469 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7feb780ffed0 0x7feb78100350 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7feb68009990 tx=0x7feb68009ca0 comp rx=0 tx=0).stop 2024-06-02T04:49:06.414 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:06.414+0000 7feb7cbd9700 1 -- 172.21.15.76:0/3158662469 shutdown_connections 2024-06-02T04:49:06.414 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:06.414+0000 7feb7cbd9700 1 --2- 172.21.15.76:0/3158662469 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb78100890 0x7feb7810cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:06.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:06.414+0000 7feb7cbd9700 1 --2- 172.21.15.76:0/3158662469 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feb78105f00 0x7feb781062e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:06.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:06.414+0000 7feb7cbd9700 1 --2- 172.21.15.76:0/3158662469 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7feb780ffed0 0x7feb78100350 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:06.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:06.414+0000 7feb7cbd9700 1 -- 172.21.15.76:0/3158662469 >> 172.21.15.76:0/3158662469 conn(0x7feb78075f80 msgr2=0x7feb78076390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:06.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:06.414+0000 7feb7cbd9700 1 -- 172.21.15.76:0/3158662469 shutdown_connections 2024-06-02T04:49:06.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:06.414+0000 7feb7cbd9700 1 -- 172.21.15.76:0/3158662469 wait complete. 2024-06-02T04:49:06.416 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:06.414+0000 7feb7cbd9700 1 Processor -- start 2024-06-02T04:49:06.416 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:06.414+0000 7feb7cbd9700 1 -- start start 2024-06-02T04:49:06.417 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:06.415+0000 7feb7cbd9700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb780ffed0 0x7feb78197310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:06.417 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:06.415+0000 7feb7cbd9700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7feb78100890 0x7feb78197850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:06.417 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:06.415+0000 7feb7cbd9700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feb78105f00 0x7feb7819bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:06.417 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:06.415+0000 7feb7cbd9700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb7819c210 con 0x7feb78100890 2024-06-02T04:49:06.417 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:06.415+0000 7feb7cbd9700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb7819c380 con 0x7feb78105f00 2024-06-02T04:49:06.417 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:06.415+0000 7feb7cbd9700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb7819c540 con 0x7feb780ffed0 2024-06-02T04:49:06.417 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:06.415+0000 7feb75d9b700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7feb78100890 0x7feb78197850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:06.417 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:06.415+0000 7feb75d9b700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7feb78100890 0x7feb78197850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:54174/0 (socket says 172.21.15.76:54174) 2024-06-02T04:49:06.417 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:06.415+0000 7feb75d9b700 1 -- 172.21.15.76:0/286527478 learned_addr learned my addr 172.21.15.76:0/286527478 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:49:06.417 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:06.415+0000 7feb7659c700 1 --2- 172.21.15.76:0/286527478 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb780ffed0 0x7feb78197310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:06.417 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:06.415+0000 7feb75d9b700 1 -- 172.21.15.76:0/286527478 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb780ffed0 msgr2=0x7feb78197310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:06.417 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:06.415+0000 7feb75d9b700 1 --2- 172.21.15.76:0/286527478 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb780ffed0 0x7feb78197310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:06.417 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:06.415+0000 7feb75d9b700 1 -- 172.21.15.76:0/286527478 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feb78105f00 msgr2=0x7feb7819bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:06.418 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:06.415+0000 7feb75d9b700 1 --2- 172.21.15.76:0/286527478 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feb78105f00 0x7feb7819bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:06.418 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:06.415+0000 7feb75d9b700 1 -- 172.21.15.76:0/286527478 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb680095f0 con 0x7feb78100890 2024-06-02T04:49:06.418 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:06.415+0000 7feb75d9b700 1 --2- 172.21.15.76:0/286527478 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7feb78100890 0x7feb78197850 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7feb68006010 tx=0x7feb68004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:06.418 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:06.415+0000 7feb6f7fe700 1 -- 172.21.15.76:0/286527478 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb6801d070 con 0x7feb78100890 2024-06-02T04:49:06.418 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:06.415+0000 7feb6f7fe700 1 -- 172.21.15.76:0/286527478 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7feb6800fd70 con 0x7feb78100890 2024-06-02T04:49:06.418 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:06.415+0000 7feb7cbd9700 1 -- 172.21.15.76:0/286527478 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb7819c7c0 con 0x7feb78100890 2024-06-02T04:49:06.418 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:06.415+0000 7feb6f7fe700 1 -- 172.21.15.76:0/286527478 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb68022dd0 con 0x7feb78100890 2024-06-02T04:49:06.418 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:06.415+0000 7feb7cbd9700 1 -- 172.21.15.76:0/286527478 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb781a4080 con 0x7feb78100890 2024-06-02T04:49:06.418 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:06.416+0000 7feb7cbd9700 1 -- 172.21.15.76:0/286527478 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb781015b0 con 0x7feb78100890 2024-06-02T04:49:06.419 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:06.417+0000 7feb6f7fe700 1 -- 172.21.15.76:0/286527478 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7feb68022570 con 0x7feb78100890 2024-06-02T04:49:06.419 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:06.418+0000 7feb6f7fe700 1 --2- 172.21.15.76:0/286527478 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7feb640a11b0 0x7feb640a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:06.419 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:06.418+0000 7feb7659c700 1 --2- 172.21.15.76:0/286527478 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7feb640a11b0 0x7feb640a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:06.419 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:06.418+0000 7feb6f7fe700 1 -- 172.21.15.76:0/286527478 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 8730+0+0 (secure 0 0 0) 0x7feb680ce0e0 con 0x7feb78100890 2024-06-02T04:49:06.419 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:06.418+0000 7feb7659c700 1 --2- 172.21.15.76:0/286527478 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7feb640a11b0 0x7feb640a3670 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7feb60005950 tx=0x7feb6000a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:06.422 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:06.422+0000 7feb6f7fe700 1 -- 172.21.15.76:0/286527478 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7feb680975b0 con 0x7feb78100890 2024-06-02T04:49:06.611 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:06.611+0000 7feb7cbd9700 1 -- 172.21.15.76:0/286527478 --> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7feb78198620 con 0x7feb640a11b0 2024-06-02T04:49:06.623 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:06.623+0000 7feb6f7fe700 1 -- 172.21.15.76:0/286527478 <== mgr.14152 v2:172.21.15.76:6800/2591353090 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+424092 (secure 0 0 0) 0x7feb78198620 con 0x7feb640a11b0 2024-06-02T04:49:06.628 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:49:06.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:06.626+0000 7feb7cbd9700 1 -- 172.21.15.76:0/286527478 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7feb640a11b0 msgr2=0x7feb640a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:06.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:06.626+0000 7feb7cbd9700 1 --2- 172.21.15.76:0/286527478 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7feb640a11b0 0x7feb640a3670 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7feb60005950 tx=0x7feb6000a300 comp rx=0 tx=0).stop 2024-06-02T04:49:06.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:06.626+0000 7feb7cbd9700 1 -- 172.21.15.76:0/286527478 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7feb78100890 msgr2=0x7feb78197850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:06.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:06.626+0000 7feb7cbd9700 1 --2- 172.21.15.76:0/286527478 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7feb78100890 0x7feb78197850 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7feb68006010 tx=0x7feb68004730 comp rx=0 tx=0).stop 2024-06-02T04:49:06.632 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:06.626+0000 7feb7cbd9700 1 -- 172.21.15.76:0/286527478 shutdown_connections 2024-06-02T04:49:06.632 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:06.626+0000 7feb7cbd9700 1 --2- 172.21.15.76:0/286527478 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7feb640a11b0 0x7feb640a3670 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:06.632 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:06.626+0000 7feb7cbd9700 1 --2- 172.21.15.76:0/286527478 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feb78105f00 0x7feb7819bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:06.632 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:06.626+0000 7feb7cbd9700 1 --2- 172.21.15.76:0/286527478 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb780ffed0 0x7feb78197310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:06.632 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:06.626+0000 7feb7cbd9700 1 --2- 172.21.15.76:0/286527478 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7feb78100890 0x7feb78197850 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:06.632 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:06.626+0000 7feb7cbd9700 1 -- 172.21.15.76:0/286527478 >> 172.21.15.76:0/286527478 conn(0x7feb78075f80 msgr2=0x7feb78068c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:06.632 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:06.626+0000 7feb7cbd9700 1 -- 172.21.15.76:0/286527478 shutdown_connections 2024-06-02T04:49:06.632 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:06.626+0000 7feb7cbd9700 1 -- 172.21.15.76:0/286527478 wait complete. 2024-06-02T04:49:06.632 INFO:teuthology.orchestra.run.smithi076.stderr:dumped all 2024-06-02T04:49:06.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:06 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [8, 4]}]: dispatch 2024-06-02T04:49:06.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:06 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4]}]: dispatch 2024-06-02T04:49:06.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:06 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]: dispatch 2024-06-02T04:49:06.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:06 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]: dispatch 2024-06-02T04:49:06.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:06 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]: dispatch 2024-06-02T04:49:06.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:06 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]: dispatch 2024-06-02T04:49:06.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:06 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]: dispatch 2024-06-02T04:49:06.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:06 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.8", "id": [5, 10]}]: dispatch 2024-06-02T04:49:06.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:06 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [9, 8]}]: dispatch 2024-06-02T04:49:06.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:06 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [9, 8]}]: dispatch 2024-06-02T04:49:06.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:06 smithi076 ceph-mon[42935]: pgmap v250: 129 pgs: 129 active+clean; 639 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-06-02T04:49:07.032 INFO:teuthology.orchestra.run.smithi076.stdout:{"pg_ready":true,"pg_map":{"version":250,"stamp":"2024-06-02T04:49:06.166350+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":654353,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":368,"num_read_kb":299,"num_write":337,"num_write_kb":3051,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":275,"ondisk_log_size":275,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":371860,"kb_used_data":10804,"kb_used_omap":18,"kb_used_meta":360941,"kb_avail":1124569964,"statfs":{"total":1151940427776,"available":1151559643136,"internally_reserved":0,"allocated":11063296,"data_stored":7243462,"data_compressed":247011,"data_compressed_allocated":331776,"data_compressed_original":2162688,"omap_allocated":19131,"internal_metadata":369603909},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":42,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003251"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.692267+0000","last_change":"2024-06-02T04:48:02.689765+0000","last_active":"2024-06-02T04:48:06.692267+0000","last_peered":"2024-06-02T04:48:06.692267+0000","last_clean":"2024-06-02T04:48:06.692267+0000","last_became_active":"2024-06-02T04:48:02.689464+0000","last_became_peered":"2024-06-02T04:48:02.689464+0000","last_unstale":"2024-06-02T04:48:06.692267+0000","last_undegraded":"2024-06-02T04:48:06.692267+0000","last_fullsized":"2024-06-02T04:48:06.692267+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:13:19.743519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.701845+0000","last_change":"2024-06-02T04:48:02.691499+0000","last_active":"2024-06-02T04:48:06.701845+0000","last_peered":"2024-06-02T04:48:06.701845+0000","last_clean":"2024-06-02T04:48:06.701845+0000","last_became_active":"2024-06-02T04:48:02.691179+0000","last_became_peered":"2024-06-02T04:48:02.691179+0000","last_unstale":"2024-06-02T04:48:06.701845+0000","last_undegraded":"2024-06-02T04:48:06.701845+0000","last_fullsized":"2024-06-02T04:48:06.701845+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T14:00:17.118877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.701714+0000","last_change":"2024-06-02T04:48:02.688527+0000","last_active":"2024-06-02T04:48:06.701714+0000","last_peered":"2024-06-02T04:48:06.701714+0000","last_clean":"2024-06-02T04:48:06.701714+0000","last_became_active":"2024-06-02T04:48:02.688184+0000","last_became_peered":"2024-06-02T04:48:02.688184+0000","last_unstale":"2024-06-02T04:48:06.701714+0000","last_undegraded":"2024-06-02T04:48:06.701714+0000","last_fullsized":"2024-06-02T04:48:06.701714+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T08:40:35.052887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.697066+0000","last_change":"2024-06-02T04:48:02.695277+0000","last_active":"2024-06-02T04:48:06.697066+0000","last_peered":"2024-06-02T04:48:06.697066+0000","last_clean":"2024-06-02T04:48:06.697066+0000","last_became_active":"2024-06-02T04:48:02.694951+0000","last_became_peered":"2024-06-02T04:48:02.694951+0000","last_unstale":"2024-06-02T04:48:06.697066+0000","last_undegraded":"2024-06-02T04:48:06.697066+0000","last_fullsized":"2024-06-02T04:48:06.697066+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T14:13:50.672421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.696221+0000","last_change":"2024-06-02T04:48:02.691454+0000","last_active":"2024-06-02T04:48:06.696221+0000","last_peered":"2024-06-02T04:48:06.696221+0000","last_clean":"2024-06-02T04:48:06.696221+0000","last_became_active":"2024-06-02T04:48:02.691083+0000","last_became_peered":"2024-06-02T04:48:02.691083+0000","last_unstale":"2024-06-02T04:48:06.696221+0000","last_undegraded":"2024-06-02T04:48:06.696221+0000","last_fullsized":"2024-06-02T04:48:06.696221+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T07:12:58.481115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.961870+0000","last_change":"2024-06-02T04:48:02.690371+0000","last_active":"2024-06-02T04:48:06.961870+0000","last_peered":"2024-06-02T04:48:06.961870+0000","last_clean":"2024-06-02T04:48:06.961870+0000","last_became_active":"2024-06-02T04:48:02.682047+0000","last_became_peered":"2024-06-02T04:48:02.682047+0000","last_unstale":"2024-06-02T04:48:06.961870+0000","last_undegraded":"2024-06-02T04:48:06.961870+0000","last_fullsized":"2024-06-02T04:48:06.961870+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:17:59.717575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.698244+0000","last_change":"2024-06-02T04:48:02.697823+0000","last_active":"2024-06-02T04:48:06.698244+0000","last_peered":"2024-06-02T04:48:06.698244+0000","last_clean":"2024-06-02T04:48:06.698244+0000","last_became_active":"2024-06-02T04:48:02.697491+0000","last_became_peered":"2024-06-02T04:48:02.697491+0000","last_unstale":"2024-06-02T04:48:06.698244+0000","last_undegraded":"2024-06-02T04:48:06.698244+0000","last_fullsized":"2024-06-02T04:48:06.698244+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T16:08:39.689192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.105002+0000","last_change":"2024-06-02T04:48:02.702564+0000","last_active":"2024-06-02T04:48:07.105002+0000","last_peered":"2024-06-02T04:48:07.105002+0000","last_clean":"2024-06-02T04:48:07.105002+0000","last_became_active":"2024-06-02T04:48:02.702259+0000","last_became_peered":"2024-06-02T04:48:02.702259+0000","last_unstale":"2024-06-02T04:48:07.105002+0000","last_undegraded":"2024-06-02T04:48:07.105002+0000","last_fullsized":"2024-06-02T04:48:07.105002+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T12:33:28.945414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.692781+0000","last_change":"2024-06-02T04:48:02.694090+0000","last_active":"2024-06-02T04:48:06.692781+0000","last_peered":"2024-06-02T04:48:06.692781+0000","last_clean":"2024-06-02T04:48:06.692781+0000","last_became_active":"2024-06-02T04:48:02.693723+0000","last_became_peered":"2024-06-02T04:48:02.693723+0000","last_unstale":"2024-06-02T04:48:06.692781+0000","last_undegraded":"2024-06-02T04:48:06.692781+0000","last_fullsized":"2024-06-02T04:48:06.692781+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:33:26.628450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.963109+0000","last_change":"2024-06-02T04:48:02.702201+0000","last_active":"2024-06-02T04:48:06.963109+0000","last_peered":"2024-06-02T04:48:06.963109+0000","last_clean":"2024-06-02T04:48:06.963109+0000","last_became_active":"2024-06-02T04:48:02.701834+0000","last_became_peered":"2024-06-02T04:48:02.701834+0000","last_unstale":"2024-06-02T04:48:06.963109+0000","last_undegraded":"2024-06-02T04:48:06.963109+0000","last_fullsized":"2024-06-02T04:48:06.963109+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T08:22:24.009015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.699587+0000","last_change":"2024-06-02T04:48:02.700280+0000","last_active":"2024-06-02T04:48:06.699587+0000","last_peered":"2024-06-02T04:48:06.699587+0000","last_clean":"2024-06-02T04:48:06.699587+0000","last_became_active":"2024-06-02T04:48:02.699852+0000","last_became_peered":"2024-06-02T04:48:02.699852+0000","last_unstale":"2024-06-02T04:48:06.699587+0000","last_undegraded":"2024-06-02T04:48:06.699587+0000","last_fullsized":"2024-06-02T04:48:06.699587+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T16:45:28.228692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.696970+0000","last_change":"2024-06-02T04:48:02.689951+0000","last_active":"2024-06-02T04:48:06.696970+0000","last_peered":"2024-06-02T04:48:06.696970+0000","last_clean":"2024-06-02T04:48:06.696970+0000","last_became_active":"2024-06-02T04:48:02.689249+0000","last_became_peered":"2024-06-02T04:48:02.689249+0000","last_unstale":"2024-06-02T04:48:06.696970+0000","last_undegraded":"2024-06-02T04:48:06.696970+0000","last_fullsized":"2024-06-02T04:48:06.696970+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:09:43.620165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.691345+0000","last_change":"2024-06-02T04:48:02.691126+0000","last_active":"2024-06-02T04:48:06.691345+0000","last_peered":"2024-06-02T04:48:06.691345+0000","last_clean":"2024-06-02T04:48:06.691345+0000","last_became_active":"2024-06-02T04:48:02.690825+0000","last_became_peered":"2024-06-02T04:48:02.690825+0000","last_unstale":"2024-06-02T04:48:06.691345+0000","last_undegraded":"2024-06-02T04:48:06.691345+0000","last_fullsized":"2024-06-02T04:48:06.691345+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:03:36.461555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.708124+0000","last_change":"2024-06-02T04:48:02.692802+0000","last_active":"2024-06-02T04:48:06.708124+0000","last_peered":"2024-06-02T04:48:06.708124+0000","last_clean":"2024-06-02T04:48:06.708124+0000","last_became_active":"2024-06-02T04:48:02.692495+0000","last_became_peered":"2024-06-02T04:48:02.692495+0000","last_unstale":"2024-06-02T04:48:06.708124+0000","last_undegraded":"2024-06-02T04:48:06.708124+0000","last_fullsized":"2024-06-02T04:48:06.708124+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T14:57:10.991752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.701916+0000","last_change":"2024-06-02T04:48:02.702968+0000","last_active":"2024-06-02T04:48:06.701916+0000","last_peered":"2024-06-02T04:48:06.701916+0000","last_clean":"2024-06-02T04:48:06.701916+0000","last_became_active":"2024-06-02T04:48:02.702672+0000","last_became_peered":"2024-06-02T04:48:02.702672+0000","last_unstale":"2024-06-02T04:48:06.701916+0000","last_undegraded":"2024-06-02T04:48:06.701916+0000","last_fullsized":"2024-06-02T04:48:06.701916+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:04:38.385228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.691702+0000","last_change":"2024-06-02T04:48:02.701329+0000","last_active":"2024-06-02T04:48:06.691702+0000","last_peered":"2024-06-02T04:48:06.691702+0000","last_clean":"2024-06-02T04:48:06.691702+0000","last_became_active":"2024-06-02T04:48:02.701064+0000","last_became_peered":"2024-06-02T04:48:02.701064+0000","last_unstale":"2024-06-02T04:48:06.691702+0000","last_undegraded":"2024-06-02T04:48:06.691702+0000","last_fullsized":"2024-06-02T04:48:06.691702+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:28:06.265050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.692151+0000","last_change":"2024-06-02T04:48:02.688538+0000","last_active":"2024-06-02T04:48:06.692151+0000","last_peered":"2024-06-02T04:48:06.692151+0000","last_clean":"2024-06-02T04:48:06.692151+0000","last_became_active":"2024-06-02T04:48:02.688175+0000","last_became_peered":"2024-06-02T04:48:02.688175+0000","last_unstale":"2024-06-02T04:48:06.692151+0000","last_undegraded":"2024-06-02T04:48:06.692151+0000","last_fullsized":"2024-06-02T04:48:06.692151+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T07:30:47.310924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.697897+0000","last_change":"2024-06-02T04:48:02.688515+0000","last_active":"2024-06-02T04:48:06.697897+0000","last_peered":"2024-06-02T04:48:06.697897+0000","last_clean":"2024-06-02T04:48:06.697897+0000","last_became_active":"2024-06-02T04:48:02.688205+0000","last_became_peered":"2024-06-02T04:48:02.688205+0000","last_unstale":"2024-06-02T04:48:06.697897+0000","last_undegraded":"2024-06-02T04:48:06.697897+0000","last_fullsized":"2024-06-02T04:48:06.697897+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:20:05.829628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.700166+0000","last_change":"2024-06-02T04:48:02.688376+0000","last_active":"2024-06-02T04:48:06.700166+0000","last_peered":"2024-06-02T04:48:06.700166+0000","last_clean":"2024-06-02T04:48:06.700166+0000","last_became_active":"2024-06-02T04:48:02.688055+0000","last_became_peered":"2024-06-02T04:48:02.688055+0000","last_unstale":"2024-06-02T04:48:06.700166+0000","last_undegraded":"2024-06-02T04:48:06.700166+0000","last_fullsized":"2024-06-02T04:48:06.700166+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:55:41.327635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.714875+0000","last_change":"2024-06-02T04:48:06.713517+0000","last_active":"2024-06-02T04:48:06.714875+0000","last_peered":"2024-06-02T04:48:06.714875+0000","last_clean":"2024-06-02T04:48:06.714875+0000","last_became_active":"2024-06-02T04:48:06.713187+0000","last_became_peered":"2024-06-02T04:48:06.713187+0000","last_unstale":"2024-06-02T04:48:06.714875+0000","last_undegraded":"2024-06-02T04:48:06.714875+0000","last_fullsized":"2024-06-02T04:48:06.714875+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:11:46.598023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"80'9","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:27.278058+0000","last_change":"2024-06-02T04:48:02.271595+0000","last_active":"2024-06-02T04:48:27.278058+0000","last_peered":"2024-06-02T04:48:27.278058+0000","last_clean":"2024-06-02T04:48:27.278058+0000","last_became_active":"2024-06-02T04:48:02.271326+0000","last_became_peered":"2024-06-02T04:48:02.271326+0000","last_unstale":"2024-06-02T04:48:27.278058+0000","last_undegraded":"2024-06-02T04:48:27.278058+0000","last_fullsized":"2024-06-02T04:48:27.278058+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:23:31.096224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.105442+0000","last_change":"2024-06-02T04:48:02.696542+0000","last_active":"2024-06-02T04:48:07.105442+0000","last_peered":"2024-06-02T04:48:07.105442+0000","last_clean":"2024-06-02T04:48:07.105442+0000","last_became_active":"2024-06-02T04:48:02.696260+0000","last_became_peered":"2024-06-02T04:48:02.696260+0000","last_unstale":"2024-06-02T04:48:07.105442+0000","last_undegraded":"2024-06-02T04:48:07.105442+0000","last_fullsized":"2024-06-02T04:48:07.105442+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T06:28:04.097035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.291625+0000","last_change":"2024-06-02T04:48:06.713685+0000","last_active":"2024-06-02T04:48:07.291625+0000","last_peered":"2024-06-02T04:48:07.291625+0000","last_clean":"2024-06-02T04:48:07.291625+0000","last_became_active":"2024-06-02T04:48:06.713254+0000","last_became_peered":"2024-06-02T04:48:06.713254+0000","last_unstale":"2024-06-02T04:48:07.291625+0000","last_undegraded":"2024-06-02T04:48:07.291625+0000","last_fullsized":"2024-06-02T04:48:07.291625+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:12:48.304229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.105489+0000","last_change":"2024-06-02T04:48:02.268361+0000","last_active":"2024-06-02T04:48:07.105489+0000","last_peered":"2024-06-02T04:48:07.105489+0000","last_clean":"2024-06-02T04:48:07.105489+0000","last_became_active":"2024-06-02T04:48:02.268053+0000","last_became_peered":"2024-06-02T04:48:02.268053+0000","last_unstale":"2024-06-02T04:48:07.105489+0000","last_undegraded":"2024-06-02T04:48:07.105489+0000","last_fullsized":"2024-06-02T04:48:07.105489+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T16:04:13.955351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.701807+0000","last_change":"2024-06-02T04:48:02.686322+0000","last_active":"2024-06-02T04:48:06.701807+0000","last_peered":"2024-06-02T04:48:06.701807+0000","last_clean":"2024-06-02T04:48:06.701807+0000","last_became_active":"2024-06-02T04:48:02.685978+0000","last_became_peered":"2024-06-02T04:48:02.685978+0000","last_unstale":"2024-06-02T04:48:06.701807+0000","last_undegraded":"2024-06-02T04:48:06.701807+0000","last_fullsized":"2024-06-02T04:48:06.701807+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T12:12:19.157330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.291715+0000","last_change":"2024-06-02T04:48:06.717046+0000","last_active":"2024-06-02T04:48:07.291715+0000","last_peered":"2024-06-02T04:48:07.291715+0000","last_clean":"2024-06-02T04:48:07.291715+0000","last_became_active":"2024-06-02T04:48:06.716603+0000","last_became_peered":"2024-06-02T04:48:06.716603+0000","last_unstale":"2024-06-02T04:48:07.291715+0000","last_undegraded":"2024-06-02T04:48:07.291715+0000","last_fullsized":"2024-06-02T04:48:07.291715+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:35:22.953004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"80'4","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:27.276618+0000","last_change":"2024-06-02T04:48:02.278143+0000","last_active":"2024-06-02T04:48:27.276618+0000","last_peered":"2024-06-02T04:48:27.276618+0000","last_clean":"2024-06-02T04:48:27.276618+0000","last_became_active":"2024-06-02T04:48:02.277656+0000","last_became_peered":"2024-06-02T04:48:02.277656+0000","last_unstale":"2024-06-02T04:48:27.276618+0000","last_undegraded":"2024-06-02T04:48:27.276618+0000","last_fullsized":"2024-06-02T04:48:27.276618+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T12:03:01.549353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.692452+0000","last_change":"2024-06-02T04:48:02.699659+0000","last_active":"2024-06-02T04:48:06.692452+0000","last_peered":"2024-06-02T04:48:06.692452+0000","last_clean":"2024-06-02T04:48:06.692452+0000","last_became_active":"2024-06-02T04:48:02.699321+0000","last_became_peered":"2024-06-02T04:48:02.699321+0000","last_unstale":"2024-06-02T04:48:06.692452+0000","last_undegraded":"2024-06-02T04:48:06.692452+0000","last_fullsized":"2024-06-02T04:48:06.692452+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:33:35.088215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.291668+0000","last_change":"2024-06-02T04:48:06.712031+0000","last_active":"2024-06-02T04:48:07.291668+0000","last_peered":"2024-06-02T04:48:07.291668+0000","last_clean":"2024-06-02T04:48:07.291668+0000","last_became_active":"2024-06-02T04:48:06.711637+0000","last_became_peered":"2024-06-02T04:48:06.711637+0000","last_unstale":"2024-06-02T04:48:07.291668+0000","last_undegraded":"2024-06-02T04:48:07.291668+0000","last_fullsized":"2024-06-02T04:48:07.291668+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T06:10:05.281793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"75'2","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.697836+0000","last_change":"2024-06-02T04:48:02.268698+0000","last_active":"2024-06-02T04:48:06.697836+0000","last_peered":"2024-06-02T04:48:06.697836+0000","last_clean":"2024-06-02T04:48:06.697836+0000","last_became_active":"2024-06-02T04:48:02.268286+0000","last_became_peered":"2024-06-02T04:48:02.268286+0000","last_unstale":"2024-06-02T04:48:06.697836+0000","last_undegraded":"2024-06-02T04:48:06.697836+0000","last_fullsized":"2024-06-02T04:48:06.697836+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T10:37:42.354104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.030205+0000","last_change":"2024-06-02T04:48:02.702280+0000","last_active":"2024-06-02T04:48:07.030205+0000","last_peered":"2024-06-02T04:48:07.030205+0000","last_clean":"2024-06-02T04:48:07.030205+0000","last_became_active":"2024-06-02T04:48:02.701830+0000","last_became_peered":"2024-06-02T04:48:02.701830+0000","last_unstale":"2024-06-02T04:48:07.030205+0000","last_undegraded":"2024-06-02T04:48:07.030205+0000","last_fullsized":"2024-06-02T04:48:07.030205+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T06:44:06.324024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.709193+0000","last_change":"2024-06-02T04:48:06.708484+0000","last_active":"2024-06-02T04:48:06.709193+0000","last_peered":"2024-06-02T04:48:06.709193+0000","last_clean":"2024-06-02T04:48:06.709193+0000","last_became_active":"2024-06-02T04:48:06.708048+0000","last_became_peered":"2024-06-02T04:48:06.708048+0000","last_unstale":"2024-06-02T04:48:06.709193+0000","last_undegraded":"2024-06-02T04:48:06.709193+0000","last_fullsized":"2024-06-02T04:48:06.709193+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:30:42.361362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"80'6","reported_seq":59,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:49:00.331247+0000","last_change":"2024-06-02T04:48:02.274961+0000","last_active":"2024-06-02T04:49:00.331247+0000","last_peered":"2024-06-02T04:49:00.331247+0000","last_clean":"2024-06-02T04:49:00.331247+0000","last_became_active":"2024-06-02T04:48:02.274617+0000","last_became_peered":"2024-06-02T04:48:02.274617+0000","last_unstale":"2024-06-02T04:49:00.331247+0000","last_undegraded":"2024-06-02T04:49:00.331247+0000","last_fullsized":"2024-06-02T04:49:00.331247+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T16:47:17.136996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":967,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":37,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.698487+0000","last_change":"2024-06-02T04:48:02.684722+0000","last_active":"2024-06-02T04:48:06.698487+0000","last_peered":"2024-06-02T04:48:06.698487+0000","last_clean":"2024-06-02T04:48:06.698487+0000","last_became_active":"2024-06-02T04:48:02.684354+0000","last_became_peered":"2024-06-02T04:48:02.684354+0000","last_unstale":"2024-06-02T04:48:06.698487+0000","last_undegraded":"2024-06-02T04:48:06.698487+0000","last_fullsized":"2024-06-02T04:48:06.698487+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T07:46:54.136882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.714856+0000","last_change":"2024-06-02T04:48:06.713498+0000","last_active":"2024-06-02T04:48:06.714856+0000","last_peered":"2024-06-02T04:48:06.714856+0000","last_clean":"2024-06-02T04:48:06.714856+0000","last_became_active":"2024-06-02T04:48:06.712949+0000","last_became_peered":"2024-06-02T04:48:06.712949+0000","last_unstale":"2024-06-02T04:48:06.714856+0000","last_undegraded":"2024-06-02T04:48:06.714856+0000","last_fullsized":"2024-06-02T04:48:06.714856+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:37:31.586703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"80'3","reported_seq":19,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:27.277254+0000","last_change":"2024-06-02T04:48:02.266358+0000","last_active":"2024-06-02T04:48:27.277254+0000","last_peered":"2024-06-02T04:48:27.277254+0000","last_clean":"2024-06-02T04:48:27.277254+0000","last_became_active":"2024-06-02T04:48:02.266008+0000","last_became_peered":"2024-06-02T04:48:02.266008+0000","last_unstale":"2024-06-02T04:48:27.277254+0000","last_undegraded":"2024-06-02T04:48:27.277254+0000","last_fullsized":"2024-06-02T04:48:27.277254+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:07:13.104170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.030185+0000","last_change":"2024-06-02T04:48:02.702234+0000","last_active":"2024-06-02T04:48:07.030185+0000","last_peered":"2024-06-02T04:48:07.030185+0000","last_clean":"2024-06-02T04:48:07.030185+0000","last_became_active":"2024-06-02T04:48:02.701927+0000","last_became_peered":"2024-06-02T04:48:02.701927+0000","last_unstale":"2024-06-02T04:48:07.030185+0000","last_undegraded":"2024-06-02T04:48:07.030185+0000","last_fullsized":"2024-06-02T04:48:07.030185+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:55:55.940957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.106401+0000","last_change":"2024-06-02T04:48:06.713257+0000","last_active":"2024-06-02T04:48:07.106401+0000","last_peered":"2024-06-02T04:48:07.106401+0000","last_clean":"2024-06-02T04:48:07.106401+0000","last_became_active":"2024-06-02T04:48:06.712862+0000","last_became_peered":"2024-06-02T04:48:06.712862+0000","last_unstale":"2024-06-02T04:48:07.106401+0000","last_undegraded":"2024-06-02T04:48:07.106401+0000","last_fullsized":"2024-06-02T04:48:07.106401+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T06:23:35.115824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"80'2","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:27.276292+0000","last_change":"2024-06-02T04:48:02.258838+0000","last_active":"2024-06-02T04:48:27.276292+0000","last_peered":"2024-06-02T04:48:27.276292+0000","last_clean":"2024-06-02T04:48:27.276292+0000","last_became_active":"2024-06-02T04:48:02.258516+0000","last_became_peered":"2024-06-02T04:48:02.258516+0000","last_unstale":"2024-06-02T04:48:27.276292+0000","last_undegraded":"2024-06-02T04:48:27.276292+0000","last_fullsized":"2024-06-02T04:48:27.276292+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:32:04.161724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.104908+0000","last_change":"2024-06-02T04:48:02.690043+0000","last_active":"2024-06-02T04:48:07.104908+0000","last_peered":"2024-06-02T04:48:07.104908+0000","last_clean":"2024-06-02T04:48:07.104908+0000","last_became_active":"2024-06-02T04:48:02.689748+0000","last_became_peered":"2024-06-02T04:48:02.689748+0000","last_unstale":"2024-06-02T04:48:07.104908+0000","last_undegraded":"2024-06-02T04:48:07.104908+0000","last_fullsized":"2024-06-02T04:48:07.104908+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:50:23.694653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.338557+0000","last_change":"2024-06-02T04:48:06.704093+0000","last_active":"2024-06-02T04:48:07.338557+0000","last_peered":"2024-06-02T04:48:07.338557+0000","last_clean":"2024-06-02T04:48:07.338557+0000","last_became_active":"2024-06-02T04:48:06.703732+0000","last_became_peered":"2024-06-02T04:48:06.703732+0000","last_unstale":"2024-06-02T04:48:07.338557+0000","last_undegraded":"2024-06-02T04:48:07.338557+0000","last_fullsized":"2024-06-02T04:48:07.338557+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:50:10.434364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"80'1","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.338898+0000","last_change":"2024-06-02T04:48:02.274753+0000","last_active":"2024-06-02T04:48:07.338898+0000","last_peered":"2024-06-02T04:48:07.338898+0000","last_clean":"2024-06-02T04:48:07.338898+0000","last_became_active":"2024-06-02T04:48:02.274390+0000","last_became_peered":"2024-06-02T04:48:02.274390+0000","last_unstale":"2024-06-02T04:48:07.338898+0000","last_undegraded":"2024-06-02T04:48:07.338898+0000","last_fullsized":"2024-06-02T04:48:07.338898+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:42:38.790750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.698110+0000","last_change":"2024-06-02T04:48:02.684832+0000","last_active":"2024-06-02T04:48:06.698110+0000","last_peered":"2024-06-02T04:48:06.698110+0000","last_clean":"2024-06-02T04:48:06.698110+0000","last_became_active":"2024-06-02T04:48:02.684520+0000","last_became_peered":"2024-06-02T04:48:02.684520+0000","last_unstale":"2024-06-02T04:48:06.698110+0000","last_undegraded":"2024-06-02T04:48:06.698110+0000","last_fullsized":"2024-06-02T04:48:06.698110+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:08:33.038975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.104977+0000","last_change":"2024-06-02T04:48:06.704725+0000","last_active":"2024-06-02T04:48:07.104977+0000","last_peered":"2024-06-02T04:48:07.104977+0000","last_clean":"2024-06-02T04:48:07.104977+0000","last_became_active":"2024-06-02T04:48:06.704284+0000","last_became_peered":"2024-06-02T04:48:06.704284+0000","last_unstale":"2024-06-02T04:48:07.104977+0000","last_undegraded":"2024-06-02T04:48:07.104977+0000","last_fullsized":"2024-06-02T04:48:07.104977+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:56:04.558505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"80'3","reported_seq":55,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:49:02.333193+0000","last_change":"2024-06-02T04:48:02.267048+0000","last_active":"2024-06-02T04:49:02.333193+0000","last_peered":"2024-06-02T04:49:02.333193+0000","last_clean":"2024-06-02T04:49:02.333193+0000","last_became_active":"2024-06-02T04:48:02.266707+0000","last_became_peered":"2024-06-02T04:48:02.266707+0000","last_unstale":"2024-06-02T04:49:02.333193+0000","last_undegraded":"2024-06-02T04:49:02.333193+0000","last_fullsized":"2024-06-02T04:49:02.333193+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:36:25.633728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.692726+0000","last_change":"2024-06-02T04:48:02.700485+0000","last_active":"2024-06-02T04:48:06.692726+0000","last_peered":"2024-06-02T04:48:06.692726+0000","last_clean":"2024-06-02T04:48:06.692726+0000","last_became_active":"2024-06-02T04:48:02.700228+0000","last_became_peered":"2024-06-02T04:48:02.700228+0000","last_unstale":"2024-06-02T04:48:06.692726+0000","last_undegraded":"2024-06-02T04:48:06.692726+0000","last_fullsized":"2024-06-02T04:48:06.692726+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T06:39:18.244476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.717696+0000","last_change":"2024-06-02T04:48:06.716821+0000","last_active":"2024-06-02T04:48:06.717696+0000","last_peered":"2024-06-02T04:48:06.717696+0000","last_clean":"2024-06-02T04:48:06.717696+0000","last_became_active":"2024-06-02T04:48:06.716432+0000","last_became_peered":"2024-06-02T04:48:06.716432+0000","last_unstale":"2024-06-02T04:48:06.717696+0000","last_undegraded":"2024-06-02T04:48:06.717696+0000","last_fullsized":"2024-06-02T04:48:06.717696+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T12:06:50.164797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"80'2","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:26.276005+0000","last_change":"2024-06-02T04:48:02.272377+0000","last_active":"2024-06-02T04:48:26.276005+0000","last_peered":"2024-06-02T04:48:26.276005+0000","last_clean":"2024-06-02T04:48:26.276005+0000","last_became_active":"2024-06-02T04:48:02.272017+0000","last_became_peered":"2024-06-02T04:48:02.272017+0000","last_unstale":"2024-06-02T04:48:26.276005+0000","last_undegraded":"2024-06-02T04:48:26.276005+0000","last_fullsized":"2024-06-02T04:48:26.276005+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T10:24:14.945609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.701744+0000","last_change":"2024-06-02T04:48:02.687056+0000","last_active":"2024-06-02T04:48:06.701744+0000","last_peered":"2024-06-02T04:48:06.701744+0000","last_clean":"2024-06-02T04:48:06.701744+0000","last_became_active":"2024-06-02T04:48:02.686729+0000","last_became_peered":"2024-06-02T04:48:02.686729+0000","last_unstale":"2024-06-02T04:48:06.701744+0000","last_undegraded":"2024-06-02T04:48:06.701744+0000","last_fullsized":"2024-06-02T04:48:06.701744+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:54:44.636489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.292066+0000","last_change":"2024-06-02T04:48:06.713816+0000","last_active":"2024-06-02T04:48:07.292066+0000","last_peered":"2024-06-02T04:48:07.292066+0000","last_clean":"2024-06-02T04:48:07.292066+0000","last_became_active":"2024-06-02T04:48:06.713372+0000","last_became_peered":"2024-06-02T04:48:06.713372+0000","last_unstale":"2024-06-02T04:48:07.292066+0000","last_undegraded":"2024-06-02T04:48:07.292066+0000","last_fullsized":"2024-06-02T04:48:07.292066+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T10:12:46.455263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"80'4","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:26.274666+0000","last_change":"2024-06-02T04:48:02.274971+0000","last_active":"2024-06-02T04:48:26.274666+0000","last_peered":"2024-06-02T04:48:26.274666+0000","last_clean":"2024-06-02T04:48:26.274666+0000","last_became_active":"2024-06-02T04:48:02.274137+0000","last_became_peered":"2024-06-02T04:48:02.274137+0000","last_unstale":"2024-06-02T04:48:26.274666+0000","last_undegraded":"2024-06-02T04:48:26.274666+0000","last_fullsized":"2024-06-02T04:48:26.274666+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:41:45.634923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.692551+0000","last_change":"2024-06-02T04:48:02.693919+0000","last_active":"2024-06-02T04:48:06.692551+0000","last_peered":"2024-06-02T04:48:06.692551+0000","last_clean":"2024-06-02T04:48:06.692551+0000","last_became_active":"2024-06-02T04:48:02.693577+0000","last_became_peered":"2024-06-02T04:48:02.693577+0000","last_unstale":"2024-06-02T04:48:06.692551+0000","last_undegraded":"2024-06-02T04:48:06.692551+0000","last_fullsized":"2024-06-02T04:48:06.692551+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:00:47.500411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.716072+0000","last_change":"2024-06-02T04:48:06.713061+0000","last_active":"2024-06-02T04:48:06.716072+0000","last_peered":"2024-06-02T04:48:06.716072+0000","last_clean":"2024-06-02T04:48:06.716072+0000","last_became_active":"2024-06-02T04:48:06.712687+0000","last_became_peered":"2024-06-02T04:48:06.712687+0000","last_unstale":"2024-06-02T04:48:06.716072+0000","last_undegraded":"2024-06-02T04:48:06.716072+0000","last_fullsized":"2024-06-02T04:48:06.716072+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T08:46:02.417626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"80'31","reported_seq":126,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:49:03.334153+0000","last_change":"2024-06-02T04:48:02.270101+0000","last_active":"2024-06-02T04:49:03.334153+0000","last_peered":"2024-06-02T04:49:03.334153+0000","last_clean":"2024-06-02T04:49:03.334153+0000","last_became_active":"2024-06-02T04:48:02.269637+0000","last_became_peered":"2024-06-02T04:48:02.269637+0000","last_unstale":"2024-06-02T04:49:03.334153+0000","last_undegraded":"2024-06-02T04:49:03.334153+0000","last_fullsized":"2024-06-02T04:49:03.334153+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:37:07.572299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59451,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":79,"num_read_kb":98,"num_write":32,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.698707+0000","last_change":"2024-06-02T04:48:02.698435+0000","last_active":"2024-06-02T04:48:06.698707+0000","last_peered":"2024-06-02T04:48:06.698707+0000","last_clean":"2024-06-02T04:48:06.698707+0000","last_became_active":"2024-06-02T04:48:02.698071+0000","last_became_peered":"2024-06-02T04:48:02.698071+0000","last_unstale":"2024-06-02T04:48:06.698707+0000","last_undegraded":"2024-06-02T04:48:06.698707+0000","last_fullsized":"2024-06-02T04:48:06.698707+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:45:38.673256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.030226+0000","last_change":"2024-06-02T04:48:06.705965+0000","last_active":"2024-06-02T04:48:07.030226+0000","last_peered":"2024-06-02T04:48:07.030226+0000","last_clean":"2024-06-02T04:48:07.030226+0000","last_became_active":"2024-06-02T04:48:06.705527+0000","last_became_peered":"2024-06-02T04:48:06.705527+0000","last_unstale":"2024-06-02T04:48:07.030226+0000","last_undegraded":"2024-06-02T04:48:07.030226+0000","last_fullsized":"2024-06-02T04:48:07.030226+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:41:54.100212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"80'6","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:27.277539+0000","last_change":"2024-06-02T04:48:02.273389+0000","last_active":"2024-06-02T04:48:27.277539+0000","last_peered":"2024-06-02T04:48:27.277539+0000","last_clean":"2024-06-02T04:48:27.277539+0000","last_became_active":"2024-06-02T04:48:02.271701+0000","last_became_peered":"2024-06-02T04:48:02.271701+0000","last_unstale":"2024-06-02T04:48:27.277539+0000","last_undegraded":"2024-06-02T04:48:27.277539+0000","last_fullsized":"2024-06-02T04:48:27.277539+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:46:48.304156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.691378+0000","last_change":"2024-06-02T04:48:02.689417+0000","last_active":"2024-06-02T04:48:06.691378+0000","last_peered":"2024-06-02T04:48:06.691378+0000","last_clean":"2024-06-02T04:48:06.691378+0000","last_became_active":"2024-06-02T04:48:02.689108+0000","last_became_peered":"2024-06-02T04:48:02.689108+0000","last_unstale":"2024-06-02T04:48:06.691378+0000","last_undegraded":"2024-06-02T04:48:06.691378+0000","last_fullsized":"2024-06-02T04:48:06.691378+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:23:14.231198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.106225+0000","last_change":"2024-06-02T04:48:06.713370+0000","last_active":"2024-06-02T04:48:07.106225+0000","last_peered":"2024-06-02T04:48:07.106225+0000","last_clean":"2024-06-02T04:48:07.106225+0000","last_became_active":"2024-06-02T04:48:06.712972+0000","last_became_peered":"2024-06-02T04:48:06.712972+0000","last_unstale":"2024-06-02T04:48:07.106225+0000","last_undegraded":"2024-06-02T04:48:07.106225+0000","last_fullsized":"2024-06-02T04:48:07.106225+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:37:23.908276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"80'3","reported_seq":19,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:26.275559+0000","last_change":"2024-06-02T04:48:02.274386+0000","last_active":"2024-06-02T04:48:26.275559+0000","last_peered":"2024-06-02T04:48:26.275559+0000","last_clean":"2024-06-02T04:48:26.275559+0000","last_became_active":"2024-06-02T04:48:02.274001+0000","last_became_peered":"2024-06-02T04:48:02.274001+0000","last_unstale":"2024-06-02T04:48:26.275559+0000","last_undegraded":"2024-06-02T04:48:26.275559+0000","last_fullsized":"2024-06-02T04:48:26.275559+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T14:02:10.256428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.699635+0000","last_change":"2024-06-02T04:48:02.706735+0000","last_active":"2024-06-02T04:48:06.699635+0000","last_peered":"2024-06-02T04:48:06.699635+0000","last_clean":"2024-06-02T04:48:06.699635+0000","last_became_active":"2024-06-02T04:48:02.706475+0000","last_became_peered":"2024-06-02T04:48:02.706475+0000","last_unstale":"2024-06-02T04:48:06.699635+0000","last_undegraded":"2024-06-02T04:48:06.699635+0000","last_fullsized":"2024-06-02T04:48:06.699635+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T10:59:57.946798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.715816+0000","last_change":"2024-06-02T04:48:06.713266+0000","last_active":"2024-06-02T04:48:06.715816+0000","last_peered":"2024-06-02T04:48:06.715816+0000","last_clean":"2024-06-02T04:48:06.715816+0000","last_became_active":"2024-06-02T04:48:06.712659+0000","last_became_peered":"2024-06-02T04:48:06.712659+0000","last_unstale":"2024-06-02T04:48:06.715816+0000","last_undegraded":"2024-06-02T04:48:06.715816+0000","last_fullsized":"2024-06-02T04:48:06.715816+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T16:30:21.140420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"80'4","reported_seq":60,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:49:03.334403+0000","last_change":"2024-06-02T04:48:02.265157+0000","last_active":"2024-06-02T04:49:03.334403+0000","last_peered":"2024-06-02T04:49:03.334403+0000","last_clean":"2024-06-02T04:49:03.334403+0000","last_became_active":"2024-06-02T04:48:02.264782+0000","last_became_peered":"2024-06-02T04:48:02.264782+0000","last_unstale":"2024-06-02T04:49:03.334403+0000","last_undegraded":"2024-06-02T04:49:03.334403+0000","last_fullsized":"2024-06-02T04:49:03.334403+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:55:35.177299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":933,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":41,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.698945+0000","last_change":"2024-06-02T04:48:02.698864+0000","last_active":"2024-06-02T04:48:06.698945+0000","last_peered":"2024-06-02T04:48:06.698945+0000","last_clean":"2024-06-02T04:48:06.698945+0000","last_became_active":"2024-06-02T04:48:02.698547+0000","last_became_peered":"2024-06-02T04:48:02.698547+0000","last_unstale":"2024-06-02T04:48:06.698945+0000","last_undegraded":"2024-06-02T04:48:06.698945+0000","last_fullsized":"2024-06-02T04:48:06.698945+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:03:39.835164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.339323+0000","last_change":"2024-06-02T04:48:06.713198+0000","last_active":"2024-06-02T04:48:07.339323+0000","last_peered":"2024-06-02T04:48:07.339323+0000","last_clean":"2024-06-02T04:48:07.339323+0000","last_became_active":"2024-06-02T04:48:06.712806+0000","last_became_peered":"2024-06-02T04:48:06.712806+0000","last_unstale":"2024-06-02T04:48:07.339323+0000","last_undegraded":"2024-06-02T04:48:07.339323+0000","last_fullsized":"2024-06-02T04:48:07.339323+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:48:09.492933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"80'15","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:27.278673+0000","last_change":"2024-06-02T04:48:02.277744+0000","last_active":"2024-06-02T04:48:27.278673+0000","last_peered":"2024-06-02T04:48:27.278673+0000","last_clean":"2024-06-02T04:48:27.278673+0000","last_became_active":"2024-06-02T04:48:02.277044+0000","last_became_peered":"2024-06-02T04:48:02.277044+0000","last_unstale":"2024-06-02T04:48:27.278673+0000","last_undegraded":"2024-06-02T04:48:27.278673+0000","last_fullsized":"2024-06-02T04:48:27.278673+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:47:38.606233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.030145+0000","last_change":"2024-06-02T04:48:02.702234+0000","last_active":"2024-06-02T04:48:07.030145+0000","last_peered":"2024-06-02T04:48:07.030145+0000","last_clean":"2024-06-02T04:48:07.030145+0000","last_became_active":"2024-06-02T04:48:02.701857+0000","last_became_peered":"2024-06-02T04:48:02.701857+0000","last_unstale":"2024-06-02T04:48:07.030145+0000","last_undegraded":"2024-06-02T04:48:07.030145+0000","last_fullsized":"2024-06-02T04:48:07.030145+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:01:52.901690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.030132+0000","last_change":"2024-06-02T04:48:06.704575+0000","last_active":"2024-06-02T04:48:07.030132+0000","last_peered":"2024-06-02T04:48:07.030132+0000","last_clean":"2024-06-02T04:48:07.030132+0000","last_became_active":"2024-06-02T04:48:06.704129+0000","last_became_peered":"2024-06-02T04:48:06.704129+0000","last_unstale":"2024-06-02T04:48:07.030132+0000","last_undegraded":"2024-06-02T04:48:07.030132+0000","last_fullsized":"2024-06-02T04:48:07.030132+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:43:53.481252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":19,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:28.281548+0000","last_change":"2024-06-02T04:48:02.268816+0000","last_active":"2024-06-02T04:48:28.281548+0000","last_peered":"2024-06-02T04:48:28.281548+0000","last_clean":"2024-06-02T04:48:28.281548+0000","last_became_active":"2024-06-02T04:48:02.268469+0000","last_became_peered":"2024-06-02T04:48:02.268469+0000","last_unstale":"2024-06-02T04:48:28.281548+0000","last_undegraded":"2024-06-02T04:48:28.281548+0000","last_fullsized":"2024-06-02T04:48:28.281548+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:42:32.434414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.691711+0000","last_change":"2024-06-02T04:48:02.704536+0000","last_active":"2024-06-02T04:48:06.691711+0000","last_peered":"2024-06-02T04:48:06.691711+0000","last_clean":"2024-06-02T04:48:06.691711+0000","last_became_active":"2024-06-02T04:48:02.704149+0000","last_became_peered":"2024-06-02T04:48:02.704149+0000","last_unstale":"2024-06-02T04:48:06.691711+0000","last_undegraded":"2024-06-02T04:48:06.691711+0000","last_fullsized":"2024-06-02T04:48:06.691711+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T07:59:40.379135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.114754+0000","last_change":"2024-06-02T04:48:06.963192+0000","last_active":"2024-06-02T04:48:07.114754+0000","last_peered":"2024-06-02T04:48:07.114754+0000","last_clean":"2024-06-02T04:48:07.114754+0000","last_became_active":"2024-06-02T04:48:06.962658+0000","last_became_peered":"2024-06-02T04:48:06.962658+0000","last_unstale":"2024-06-02T04:48:07.114754+0000","last_undegraded":"2024-06-02T04:48:07.114754+0000","last_fullsized":"2024-06-02T04:48:07.114754+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:28:33.093285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.702674+0000","last_change":"2024-06-02T04:48:02.270893+0000","last_active":"2024-06-02T04:48:06.702674+0000","last_peered":"2024-06-02T04:48:06.702674+0000","last_clean":"2024-06-02T04:48:06.702674+0000","last_became_active":"2024-06-02T04:48:02.270566+0000","last_became_peered":"2024-06-02T04:48:02.270566+0000","last_unstale":"2024-06-02T04:48:06.702674+0000","last_undegraded":"2024-06-02T04:48:06.702674+0000","last_fullsized":"2024-06-02T04:48:06.702674+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:57:36.202043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.962165+0000","last_change":"2024-06-02T04:48:02.693528+0000","last_active":"2024-06-02T04:48:06.962165+0000","last_peered":"2024-06-02T04:48:06.962165+0000","last_clean":"2024-06-02T04:48:06.962165+0000","last_became_active":"2024-06-02T04:48:02.693240+0000","last_became_peered":"2024-06-02T04:48:02.693240+0000","last_unstale":"2024-06-02T04:48:06.962165+0000","last_undegraded":"2024-06-02T04:48:06.962165+0000","last_fullsized":"2024-06-02T04:48:06.962165+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T14:48:59.338977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.339278+0000","last_change":"2024-06-02T04:48:06.710454+0000","last_active":"2024-06-02T04:48:07.339278+0000","last_peered":"2024-06-02T04:48:07.339278+0000","last_clean":"2024-06-02T04:48:07.339278+0000","last_became_active":"2024-06-02T04:48:06.710090+0000","last_became_peered":"2024-06-02T04:48:06.710090+0000","last_unstale":"2024-06-02T04:48:07.339278+0000","last_undegraded":"2024-06-02T04:48:07.339278+0000","last_fullsized":"2024-06-02T04:48:07.339278+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:27:52.401032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"80'1","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.339601+0000","last_change":"2024-06-02T04:48:02.271748+0000","last_active":"2024-06-02T04:48:07.339601+0000","last_peered":"2024-06-02T04:48:07.339601+0000","last_clean":"2024-06-02T04:48:07.339601+0000","last_became_active":"2024-06-02T04:48:02.270941+0000","last_became_peered":"2024-06-02T04:48:02.270941+0000","last_unstale":"2024-06-02T04:48:07.339601+0000","last_undegraded":"2024-06-02T04:48:07.339601+0000","last_fullsized":"2024-06-02T04:48:07.339601+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T14:22:37.698956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.962254+0000","last_change":"2024-06-02T04:48:02.690331+0000","last_active":"2024-06-02T04:48:06.962254+0000","last_peered":"2024-06-02T04:48:06.962254+0000","last_clean":"2024-06-02T04:48:06.962254+0000","last_became_active":"2024-06-02T04:48:02.681983+0000","last_became_peered":"2024-06-02T04:48:02.681983+0000","last_unstale":"2024-06-02T04:48:06.962254+0000","last_undegraded":"2024-06-02T04:48:06.962254+0000","last_fullsized":"2024-06-02T04:48:06.962254+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T14:09:12.117847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.339368+0000","last_change":"2024-06-02T04:48:06.962698+0000","last_active":"2024-06-02T04:48:07.339368+0000","last_peered":"2024-06-02T04:48:07.339368+0000","last_clean":"2024-06-02T04:48:07.339368+0000","last_became_active":"2024-06-02T04:48:06.962283+0000","last_became_peered":"2024-06-02T04:48:06.962283+0000","last_unstale":"2024-06-02T04:48:07.339368+0000","last_undegraded":"2024-06-02T04:48:07.339368+0000","last_fullsized":"2024-06-02T04:48:07.339368+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T14:33:49.504150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.030119+0000","last_change":"2024-06-02T04:48:02.702856+0000","last_active":"2024-06-02T04:48:07.030119+0000","last_peered":"2024-06-02T04:48:07.030119+0000","last_clean":"2024-06-02T04:48:07.030119+0000","last_became_active":"2024-06-02T04:48:02.702513+0000","last_became_peered":"2024-06-02T04:48:02.702513+0000","last_unstale":"2024-06-02T04:48:07.030119+0000","last_undegraded":"2024-06-02T04:48:07.030119+0000","last_fullsized":"2024-06-02T04:48:07.030119+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T07:10:35.957386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"80'4","reported_seq":56,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:49:02.332632+0000","last_change":"2024-06-02T04:48:02.265627+0000","last_active":"2024-06-02T04:49:02.332632+0000","last_peered":"2024-06-02T04:49:02.332632+0000","last_clean":"2024-06-02T04:49:02.332632+0000","last_became_active":"2024-06-02T04:48:02.265301+0000","last_became_peered":"2024-06-02T04:48:02.265301+0000","last_unstale":"2024-06-02T04:49:02.332632+0000","last_undegraded":"2024-06-02T04:49:02.332632+0000","last_fullsized":"2024-06-02T04:49:02.332632+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T10:46:10.211378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"80'1","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.339971+0000","last_change":"2024-06-02T04:48:06.709988+0000","last_active":"2024-06-02T04:48:07.339971+0000","last_peered":"2024-06-02T04:48:07.339971+0000","last_clean":"2024-06-02T04:48:07.339971+0000","last_became_active":"2024-06-02T04:48:06.709642+0000","last_became_peered":"2024-06-02T04:48:06.709642+0000","last_unstale":"2024-06-02T04:48:07.339971+0000","last_undegraded":"2024-06-02T04:48:07.339971+0000","last_fullsized":"2024-06-02T04:48:07.339971+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T10:09:46.250709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.105024+0000","last_change":"2024-06-02T04:48:02.696666+0000","last_active":"2024-06-02T04:48:07.105024+0000","last_peered":"2024-06-02T04:48:07.105024+0000","last_clean":"2024-06-02T04:48:07.105024+0000","last_became_active":"2024-06-02T04:48:02.696343+0000","last_became_peered":"2024-06-02T04:48:02.696343+0000","last_unstale":"2024-06-02T04:48:07.105024+0000","last_undegraded":"2024-06-02T04:48:07.105024+0000","last_fullsized":"2024-06-02T04:48:07.105024+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T12:31:13.426174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"80'3","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:28.281140+0000","last_change":"2024-06-02T04:48:02.268619+0000","last_active":"2024-06-02T04:48:28.281140+0000","last_peered":"2024-06-02T04:48:28.281140+0000","last_clean":"2024-06-02T04:48:28.281140+0000","last_became_active":"2024-06-02T04:48:02.268244+0000","last_became_peered":"2024-06-02T04:48:02.268244+0000","last_unstale":"2024-06-02T04:48:28.281140+0000","last_undegraded":"2024-06-02T04:48:28.281140+0000","last_fullsized":"2024-06-02T04:48:28.281140+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:15:13.469046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"19'137","reported_seq":326,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.339208+0000","last_change":"2024-06-02T04:47:15.713382+0000","last_active":"2024-06-02T04:48:07.339208+0000","last_peered":"2024-06-02T04:48:07.339208+0000","last_clean":"2024-06-02T04:48:07.339208+0000","last_became_active":"2024-06-02T04:47:15.712972+0000","last_became_peered":"2024-06-02T04:47:15.712972+0000","last_unstale":"2024-06-02T04:48:07.339208+0000","last_undegraded":"2024-06-02T04:48:07.339208+0000","last_fullsized":"2024-06-02T04:48:07.339208+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:44:56.604079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:44:56.604079+0000","last_clean_scrub_stamp":"2024-06-02T04:44:56.604079+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T12:54:02.306899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.030237+0000","last_change":"2024-06-02T04:48:06.964717+0000","last_active":"2024-06-02T04:48:07.030237+0000","last_peered":"2024-06-02T04:48:07.030237+0000","last_clean":"2024-06-02T04:48:07.030237+0000","last_became_active":"2024-06-02T04:48:06.964244+0000","last_became_peered":"2024-06-02T04:48:06.964244+0000","last_unstale":"2024-06-02T04:48:07.030237+0000","last_undegraded":"2024-06-02T04:48:07.030237+0000","last_fullsized":"2024-06-02T04:48:07.030237+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:26:58.901182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.691167+0000","last_change":"2024-06-02T04:48:02.703427+0000","last_active":"2024-06-02T04:48:06.691167+0000","last_peered":"2024-06-02T04:48:06.691167+0000","last_clean":"2024-06-02T04:48:06.691167+0000","last_became_active":"2024-06-02T04:48:02.703140+0000","last_became_peered":"2024-06-02T04:48:02.703140+0000","last_unstale":"2024-06-02T04:48:06.691167+0000","last_undegraded":"2024-06-02T04:48:06.691167+0000","last_fullsized":"2024-06-02T04:48:06.691167+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T10:24:07.881130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"80'3","reported_seq":19,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:27.277328+0000","last_change":"2024-06-02T04:48:02.272953+0000","last_active":"2024-06-02T04:48:27.277328+0000","last_peered":"2024-06-02T04:48:27.277328+0000","last_clean":"2024-06-02T04:48:27.277328+0000","last_became_active":"2024-06-02T04:48:02.272603+0000","last_became_peered":"2024-06-02T04:48:02.272603+0000","last_unstale":"2024-06-02T04:48:27.277328+0000","last_undegraded":"2024-06-02T04:48:27.277328+0000","last_fullsized":"2024-06-02T04:48:27.277328+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:46:33.907707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.106136+0000","last_change":"2024-06-02T04:48:06.703427+0000","last_active":"2024-06-02T04:48:07.106136+0000","last_peered":"2024-06-02T04:48:07.106136+0000","last_clean":"2024-06-02T04:48:07.106136+0000","last_became_active":"2024-06-02T04:48:06.702442+0000","last_became_peered":"2024-06-02T04:48:06.702442+0000","last_unstale":"2024-06-02T04:48:07.106136+0000","last_undegraded":"2024-06-02T04:48:07.106136+0000","last_fullsized":"2024-06-02T04:48:07.106136+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T14:47:12.376520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"80'1","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:26.275366+0000","last_change":"2024-06-02T04:48:02.277241+0000","last_active":"2024-06-02T04:48:26.275366+0000","last_peered":"2024-06-02T04:48:26.275366+0000","last_clean":"2024-06-02T04:48:26.275366+0000","last_became_active":"2024-06-02T04:48:02.276903+0000","last_became_peered":"2024-06-02T04:48:02.276903+0000","last_unstale":"2024-06-02T04:48:26.275366+0000","last_undegraded":"2024-06-02T04:48:26.275366+0000","last_fullsized":"2024-06-02T04:48:26.275366+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:16:40.664225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.691848+0000","last_change":"2024-06-02T04:48:02.682260+0000","last_active":"2024-06-02T04:48:06.691848+0000","last_peered":"2024-06-02T04:48:06.691848+0000","last_clean":"2024-06-02T04:48:06.691848+0000","last_became_active":"2024-06-02T04:48:02.681962+0000","last_became_peered":"2024-06-02T04:48:02.681962+0000","last_unstale":"2024-06-02T04:48:06.691848+0000","last_undegraded":"2024-06-02T04:48:06.691848+0000","last_fullsized":"2024-06-02T04:48:06.691848+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:42:26.588628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.104914+0000","last_change":"2024-06-02T04:48:06.963380+0000","last_active":"2024-06-02T04:48:07.104914+0000","last_peered":"2024-06-02T04:48:07.104914+0000","last_clean":"2024-06-02T04:48:07.104914+0000","last_became_active":"2024-06-02T04:48:06.962717+0000","last_became_peered":"2024-06-02T04:48:06.962717+0000","last_unstale":"2024-06-02T04:48:07.104914+0000","last_undegraded":"2024-06-02T04:48:07.104914+0000","last_fullsized":"2024-06-02T04:48:07.104914+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T07:05:46.983987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"80'5","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:32.112975+0000","last_change":"2024-06-02T04:48:02.270183+0000","last_active":"2024-06-02T04:48:32.112975+0000","last_peered":"2024-06-02T04:48:32.112975+0000","last_clean":"2024-06-02T04:48:32.112975+0000","last_became_active":"2024-06-02T04:48:02.269880+0000","last_became_peered":"2024-06-02T04:48:02.269880+0000","last_unstale":"2024-06-02T04:48:32.112975+0000","last_undegraded":"2024-06-02T04:48:32.112975+0000","last_fullsized":"2024-06-02T04:48:32.112975+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T16:12:41.959174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.105672+0000","last_change":"2024-06-02T04:48:02.696692+0000","last_active":"2024-06-02T04:48:07.105672+0000","last_peered":"2024-06-02T04:48:07.105672+0000","last_clean":"2024-06-02T04:48:07.105672+0000","last_became_active":"2024-06-02T04:48:02.696398+0000","last_became_peered":"2024-06-02T04:48:02.696398+0000","last_unstale":"2024-06-02T04:48:07.105672+0000","last_undegraded":"2024-06-02T04:48:07.105672+0000","last_fullsized":"2024-06-02T04:48:07.105672+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T14:12:15.108989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.707203+0000","last_change":"2024-06-02T04:48:06.706766+0000","last_active":"2024-06-02T04:48:06.707203+0000","last_peered":"2024-06-02T04:48:06.707203+0000","last_clean":"2024-06-02T04:48:06.707203+0000","last_became_active":"2024-06-02T04:48:06.706440+0000","last_became_peered":"2024-06-02T04:48:06.706440+0000","last_unstale":"2024-06-02T04:48:06.707203+0000","last_undegraded":"2024-06-02T04:48:06.707203+0000","last_fullsized":"2024-06-02T04:48:06.707203+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:24:20.283467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"80'4","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:26.275167+0000","last_change":"2024-06-02T04:48:02.265259+0000","last_active":"2024-06-02T04:48:26.275167+0000","last_peered":"2024-06-02T04:48:26.275167+0000","last_clean":"2024-06-02T04:48:26.275167+0000","last_became_active":"2024-06-02T04:48:02.264931+0000","last_became_peered":"2024-06-02T04:48:02.264931+0000","last_unstale":"2024-06-02T04:48:26.275167+0000","last_undegraded":"2024-06-02T04:48:26.275167+0000","last_fullsized":"2024-06-02T04:48:26.275167+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:06:18.360519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.701931+0000","last_change":"2024-06-02T04:48:02.684808+0000","last_active":"2024-06-02T04:48:06.701931+0000","last_peered":"2024-06-02T04:48:06.701931+0000","last_clean":"2024-06-02T04:48:06.701931+0000","last_became_active":"2024-06-02T04:48:02.684492+0000","last_became_peered":"2024-06-02T04:48:02.684492+0000","last_unstale":"2024-06-02T04:48:06.701931+0000","last_undegraded":"2024-06-02T04:48:06.701931+0000","last_fullsized":"2024-06-02T04:48:06.701931+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T12:10:01.537377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.291954+0000","last_change":"2024-06-02T04:48:06.965041+0000","last_active":"2024-06-02T04:48:07.291954+0000","last_peered":"2024-06-02T04:48:07.291954+0000","last_clean":"2024-06-02T04:48:07.291954+0000","last_became_active":"2024-06-02T04:48:06.964487+0000","last_became_peered":"2024-06-02T04:48:06.964487+0000","last_unstale":"2024-06-02T04:48:07.291954+0000","last_undegraded":"2024-06-02T04:48:07.291954+0000","last_fullsized":"2024-06-02T04:48:07.291954+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:51:05.082026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:26.276806+0000","last_change":"2024-06-02T04:48:02.271485+0000","last_active":"2024-06-02T04:48:26.276806+0000","last_peered":"2024-06-02T04:48:26.276806+0000","last_clean":"2024-06-02T04:48:26.276806+0000","last_became_active":"2024-06-02T04:48:02.271156+0000","last_became_peered":"2024-06-02T04:48:02.271156+0000","last_unstale":"2024-06-02T04:48:26.276806+0000","last_undegraded":"2024-06-02T04:48:26.276806+0000","last_fullsized":"2024-06-02T04:48:26.276806+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:57:34.467559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.696113+0000","last_change":"2024-06-02T04:48:02.673700+0000","last_active":"2024-06-02T04:48:06.696113+0000","last_peered":"2024-06-02T04:48:06.696113+0000","last_clean":"2024-06-02T04:48:06.696113+0000","last_became_active":"2024-06-02T04:48:02.673262+0000","last_became_peered":"2024-06-02T04:48:02.673262+0000","last_unstale":"2024-06-02T04:48:06.696113+0000","last_undegraded":"2024-06-02T04:48:06.696113+0000","last_fullsized":"2024-06-02T04:48:06.696113+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:45:00.682562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.717730+0000","last_change":"2024-06-02T04:48:06.716848+0000","last_active":"2024-06-02T04:48:06.717730+0000","last_peered":"2024-06-02T04:48:06.717730+0000","last_clean":"2024-06-02T04:48:06.717730+0000","last_became_active":"2024-06-02T04:48:06.716411+0000","last_became_peered":"2024-06-02T04:48:06.716411+0000","last_unstale":"2024-06-02T04:48:06.717730+0000","last_undegraded":"2024-06-02T04:48:06.717730+0000","last_fullsized":"2024-06-02T04:48:06.717730+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T06:09:36.074569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"80'3","reported_seq":19,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:26.273955+0000","last_change":"2024-06-02T04:48:02.269426+0000","last_active":"2024-06-02T04:48:26.273955+0000","last_peered":"2024-06-02T04:48:26.273955+0000","last_clean":"2024-06-02T04:48:26.273955+0000","last_became_active":"2024-06-02T04:48:02.269115+0000","last_became_peered":"2024-06-02T04:48:02.269115+0000","last_unstale":"2024-06-02T04:48:26.273955+0000","last_undegraded":"2024-06-02T04:48:26.273955+0000","last_fullsized":"2024-06-02T04:48:26.273955+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:18:28.568367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.691586+0000","last_change":"2024-06-02T04:48:02.694234+0000","last_active":"2024-06-02T04:48:06.691586+0000","last_peered":"2024-06-02T04:48:06.691586+0000","last_clean":"2024-06-02T04:48:06.691586+0000","last_became_active":"2024-06-02T04:48:02.693916+0000","last_became_peered":"2024-06-02T04:48:02.693916+0000","last_unstale":"2024-06-02T04:48:06.691586+0000","last_undegraded":"2024-06-02T04:48:06.691586+0000","last_fullsized":"2024-06-02T04:48:06.691586+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T16:47:44.939277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"80'1","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:10.229530+0000","last_change":"2024-06-02T04:48:06.716026+0000","last_active":"2024-06-02T04:48:10.229530+0000","last_peered":"2024-06-02T04:48:10.229530+0000","last_clean":"2024-06-02T04:48:10.229530+0000","last_became_active":"2024-06-02T04:48:06.715730+0000","last_became_peered":"2024-06-02T04:48:06.715730+0000","last_unstale":"2024-06-02T04:48:10.229530+0000","last_undegraded":"2024-06-02T04:48:10.229530+0000","last_fullsized":"2024-06-02T04:48:10.229530+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:35:53.707307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"80'1","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.338726+0000","last_change":"2024-06-02T04:48:02.271576+0000","last_active":"2024-06-02T04:48:07.338726+0000","last_peered":"2024-06-02T04:48:07.338726+0000","last_clean":"2024-06-02T04:48:07.338726+0000","last_became_active":"2024-06-02T04:48:02.271101+0000","last_became_peered":"2024-06-02T04:48:02.271101+0000","last_unstale":"2024-06-02T04:48:07.338726+0000","last_undegraded":"2024-06-02T04:48:07.338726+0000","last_fullsized":"2024-06-02T04:48:07.338726+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T08:35:37.467479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.105325+0000","last_change":"2024-06-02T04:48:02.702773+0000","last_active":"2024-06-02T04:48:07.105325+0000","last_peered":"2024-06-02T04:48:07.105325+0000","last_clean":"2024-06-02T04:48:07.105325+0000","last_became_active":"2024-06-02T04:48:02.702415+0000","last_became_peered":"2024-06-02T04:48:02.702415+0000","last_unstale":"2024-06-02T04:48:07.105325+0000","last_undegraded":"2024-06-02T04:48:07.105325+0000","last_fullsized":"2024-06-02T04:48:07.105325+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:18:55.084384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.291891+0000","last_change":"2024-06-02T04:48:06.963120+0000","last_active":"2024-06-02T04:48:07.291891+0000","last_peered":"2024-06-02T04:48:07.291891+0000","last_clean":"2024-06-02T04:48:07.291891+0000","last_became_active":"2024-06-02T04:48:06.962509+0000","last_became_peered":"2024-06-02T04:48:06.962509+0000","last_unstale":"2024-06-02T04:48:07.291891+0000","last_undegraded":"2024-06-02T04:48:07.291891+0000","last_fullsized":"2024-06-02T04:48:07.291891+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T04:55:34.509179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:26.277127+0000","last_change":"2024-06-02T04:48:02.273511+0000","last_active":"2024-06-02T04:48:26.277127+0000","last_peered":"2024-06-02T04:48:26.277127+0000","last_clean":"2024-06-02T04:48:26.277127+0000","last_became_active":"2024-06-02T04:48:02.273100+0000","last_became_peered":"2024-06-02T04:48:02.273100+0000","last_unstale":"2024-06-02T04:48:26.277127+0000","last_undegraded":"2024-06-02T04:48:26.277127+0000","last_fullsized":"2024-06-02T04:48:26.277127+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:04:11.742406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.698614+0000","last_change":"2024-06-02T04:48:02.696594+0000","last_active":"2024-06-02T04:48:06.698614+0000","last_peered":"2024-06-02T04:48:06.698614+0000","last_clean":"2024-06-02T04:48:06.698614+0000","last_became_active":"2024-06-02T04:48:02.696278+0000","last_became_peered":"2024-06-02T04:48:02.696278+0000","last_unstale":"2024-06-02T04:48:06.698614+0000","last_undegraded":"2024-06-02T04:48:06.698614+0000","last_fullsized":"2024-06-02T04:48:06.698614+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T16:10:16.275451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.339646+0000","last_change":"2024-06-02T04:48:06.701837+0000","last_active":"2024-06-02T04:48:07.339646+0000","last_peered":"2024-06-02T04:48:07.339646+0000","last_clean":"2024-06-02T04:48:07.339646+0000","last_became_active":"2024-06-02T04:48:06.701454+0000","last_became_peered":"2024-06-02T04:48:06.701454+0000","last_unstale":"2024-06-02T04:48:07.339646+0000","last_undegraded":"2024-06-02T04:48:07.339646+0000","last_fullsized":"2024-06-02T04:48:07.339646+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T16:25:46.585200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"80'3","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:27.277685+0000","last_change":"2024-06-02T04:48:02.272941+0000","last_active":"2024-06-02T04:48:27.277685+0000","last_peered":"2024-06-02T04:48:27.277685+0000","last_clean":"2024-06-02T04:48:27.277685+0000","last_became_active":"2024-06-02T04:48:02.270149+0000","last_became_peered":"2024-06-02T04:48:02.270149+0000","last_unstale":"2024-06-02T04:48:27.277685+0000","last_undegraded":"2024-06-02T04:48:27.277685+0000","last_fullsized":"2024-06-02T04:48:27.277685+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T04:54:09.813917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.699678+0000","last_change":"2024-06-02T04:48:02.699722+0000","last_active":"2024-06-02T04:48:06.699678+0000","last_peered":"2024-06-02T04:48:06.699678+0000","last_clean":"2024-06-02T04:48:06.699678+0000","last_became_active":"2024-06-02T04:48:02.699376+0000","last_became_peered":"2024-06-02T04:48:02.699376+0000","last_unstale":"2024-06-02T04:48:06.699678+0000","last_undegraded":"2024-06-02T04:48:06.699678+0000","last_fullsized":"2024-06-02T04:48:06.699678+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T08:12:24.048499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.338868+0000","last_change":"2024-06-02T04:48:06.706493+0000","last_active":"2024-06-02T04:48:07.338868+0000","last_peered":"2024-06-02T04:48:07.338868+0000","last_clean":"2024-06-02T04:48:07.338868+0000","last_became_active":"2024-06-02T04:48:06.706135+0000","last_became_peered":"2024-06-02T04:48:06.706135+0000","last_unstale":"2024-06-02T04:48:07.338868+0000","last_undegraded":"2024-06-02T04:48:07.338868+0000","last_fullsized":"2024-06-02T04:48:07.338868+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:54:51.491641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"75'1","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.339950+0000","last_change":"2024-06-02T04:48:02.271534+0000","last_active":"2024-06-02T04:48:07.339950+0000","last_peered":"2024-06-02T04:48:07.339950+0000","last_clean":"2024-06-02T04:48:07.339950+0000","last_became_active":"2024-06-02T04:48:02.271144+0000","last_became_peered":"2024-06-02T04:48:02.271144+0000","last_unstale":"2024-06-02T04:48:07.339950+0000","last_undegraded":"2024-06-02T04:48:07.339950+0000","last_fullsized":"2024-06-02T04:48:07.339950+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:45:10.221432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.698395+0000","last_change":"2024-06-02T04:48:02.697089+0000","last_active":"2024-06-02T04:48:06.698395+0000","last_peered":"2024-06-02T04:48:06.698395+0000","last_clean":"2024-06-02T04:48:06.698395+0000","last_became_active":"2024-06-02T04:48:02.696755+0000","last_became_peered":"2024-06-02T04:48:02.696755+0000","last_unstale":"2024-06-02T04:48:06.698395+0000","last_undegraded":"2024-06-02T04:48:06.698395+0000","last_fullsized":"2024-06-02T04:48:06.698395+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T08:56:18.715019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.030079+0000","last_change":"2024-06-02T04:48:06.705906+0000","last_active":"2024-06-02T04:48:07.030079+0000","last_peered":"2024-06-02T04:48:07.030079+0000","last_clean":"2024-06-02T04:48:07.030079+0000","last_became_active":"2024-06-02T04:48:06.705502+0000","last_became_peered":"2024-06-02T04:48:06.705502+0000","last_unstale":"2024-06-02T04:48:07.030079+0000","last_undegraded":"2024-06-02T04:48:07.030079+0000","last_fullsized":"2024-06-02T04:48:07.030079+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T16:33:41.228392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"75'2","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.691448+0000","last_change":"2024-06-02T04:48:02.265912+0000","last_active":"2024-06-02T04:48:06.691448+0000","last_peered":"2024-06-02T04:48:06.691448+0000","last_clean":"2024-06-02T04:48:06.691448+0000","last_became_active":"2024-06-02T04:48:02.265494+0000","last_became_peered":"2024-06-02T04:48:02.265494+0000","last_unstale":"2024-06-02T04:48:06.691448+0000","last_undegraded":"2024-06-02T04:48:06.691448+0000","last_fullsized":"2024-06-02T04:48:06.691448+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T10:21:58.897765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.699265+0000","last_change":"2024-06-02T04:48:02.693091+0000","last_active":"2024-06-02T04:48:06.699265+0000","last_peered":"2024-06-02T04:48:06.699265+0000","last_clean":"2024-06-02T04:48:06.699265+0000","last_became_active":"2024-06-02T04:48:02.692025+0000","last_became_peered":"2024-06-02T04:48:02.692025+0000","last_unstale":"2024-06-02T04:48:06.699265+0000","last_undegraded":"2024-06-02T04:48:06.699265+0000","last_fullsized":"2024-06-02T04:48:06.699265+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T14:36:35.813881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.691657+0000","last_change":"2024-06-02T04:48:02.694381+0000","last_active":"2024-06-02T04:48:06.691657+0000","last_peered":"2024-06-02T04:48:06.691657+0000","last_clean":"2024-06-02T04:48:06.691657+0000","last_became_active":"2024-06-02T04:48:02.694049+0000","last_became_peered":"2024-06-02T04:48:02.694049+0000","last_unstale":"2024-06-02T04:48:06.691657+0000","last_undegraded":"2024-06-02T04:48:06.691657+0000","last_fullsized":"2024-06-02T04:48:06.691657+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:04:31.920810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.701162+0000","last_change":"2024-06-02T04:48:02.702174+0000","last_active":"2024-06-02T04:48:06.701162+0000","last_peered":"2024-06-02T04:48:06.701162+0000","last_clean":"2024-06-02T04:48:06.701162+0000","last_became_active":"2024-06-02T04:48:02.701893+0000","last_became_peered":"2024-06-02T04:48:02.701893+0000","last_unstale":"2024-06-02T04:48:06.701162+0000","last_undegraded":"2024-06-02T04:48:06.701162+0000","last_fullsized":"2024-06-02T04:48:06.701162+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:39:07.224256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.696402+0000","last_change":"2024-06-02T04:48:02.688547+0000","last_active":"2024-06-02T04:48:06.696402+0000","last_peered":"2024-06-02T04:48:06.696402+0000","last_clean":"2024-06-02T04:48:06.696402+0000","last_became_active":"2024-06-02T04:48:02.688183+0000","last_became_peered":"2024-06-02T04:48:02.688183+0000","last_unstale":"2024-06-02T04:48:06.696402+0000","last_undegraded":"2024-06-02T04:48:06.696402+0000","last_fullsized":"2024-06-02T04:48:06.696402+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:47:22.399630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.701544+0000","last_change":"2024-06-02T04:48:02.702958+0000","last_active":"2024-06-02T04:48:06.701544+0000","last_peered":"2024-06-02T04:48:06.701544+0000","last_clean":"2024-06-02T04:48:06.701544+0000","last_became_active":"2024-06-02T04:48:02.702640+0000","last_became_peered":"2024-06-02T04:48:02.702640+0000","last_unstale":"2024-06-02T04:48:06.701544+0000","last_undegraded":"2024-06-02T04:48:06.701544+0000","last_fullsized":"2024-06-02T04:48:06.701544+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T12:53:17.406762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.691930+0000","last_change":"2024-06-02T04:48:02.702817+0000","last_active":"2024-06-02T04:48:06.691930+0000","last_peered":"2024-06-02T04:48:06.691930+0000","last_clean":"2024-06-02T04:48:06.691930+0000","last_became_active":"2024-06-02T04:48:02.702526+0000","last_became_peered":"2024-06-02T04:48:02.702526+0000","last_unstale":"2024-06-02T04:48:06.691930+0000","last_undegraded":"2024-06-02T04:48:06.691930+0000","last_fullsized":"2024-06-02T04:48:06.691930+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:54:58.505585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.691852+0000","last_change":"2024-06-02T04:48:02.690645+0000","last_active":"2024-06-02T04:48:06.691852+0000","last_peered":"2024-06-02T04:48:06.691852+0000","last_clean":"2024-06-02T04:48:06.691852+0000","last_became_active":"2024-06-02T04:48:02.690282+0000","last_became_peered":"2024-06-02T04:48:02.690282+0000","last_unstale":"2024-06-02T04:48:06.691852+0000","last_undegraded":"2024-06-02T04:48:06.691852+0000","last_fullsized":"2024-06-02T04:48:06.691852+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:30:16.471475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.697098+0000","last_change":"2024-06-02T04:48:02.698865+0000","last_active":"2024-06-02T04:48:06.697098+0000","last_peered":"2024-06-02T04:48:06.697098+0000","last_clean":"2024-06-02T04:48:06.697098+0000","last_became_active":"2024-06-02T04:48:02.698554+0000","last_became_peered":"2024-06-02T04:48:02.698554+0000","last_unstale":"2024-06-02T04:48:06.697098+0000","last_undegraded":"2024-06-02T04:48:06.697098+0000","last_fullsized":"2024-06-02T04:48:06.697098+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:19:14.413170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.105716+0000","last_change":"2024-06-02T04:48:02.694345+0000","last_active":"2024-06-02T04:48:07.105716+0000","last_peered":"2024-06-02T04:48:07.105716+0000","last_clean":"2024-06-02T04:48:07.105716+0000","last_became_active":"2024-06-02T04:48:02.693866+0000","last_became_peered":"2024-06-02T04:48:02.693866+0000","last_unstale":"2024-06-02T04:48:07.105716+0000","last_undegraded":"2024-06-02T04:48:07.105716+0000","last_fullsized":"2024-06-02T04:48:07.105716+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:56:09.409774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.030106+0000","last_change":"2024-06-02T04:48:02.689609+0000","last_active":"2024-06-02T04:48:07.030106+0000","last_peered":"2024-06-02T04:48:07.030106+0000","last_clean":"2024-06-02T04:48:07.030106+0000","last_became_active":"2024-06-02T04:48:02.689279+0000","last_became_peered":"2024-06-02T04:48:02.689279+0000","last_unstale":"2024-06-02T04:48:07.030106+0000","last_undegraded":"2024-06-02T04:48:07.030106+0000","last_fullsized":"2024-06-02T04:48:07.030106+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T14:05:04.600923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-02T04:48:07.105060+0000","last_change":"2024-06-02T04:48:02.694124+0000","last_active":"2024-06-02T04:48:07.105060+0000","last_peered":"2024-06-02T04:48:07.105060+0000","last_clean":"2024-06-02T04:48:07.105060+0000","last_became_active":"2024-06-02T04:48:02.693787+0000","last_became_peered":"2024-06-02T04:48:02.693787+0000","last_unstale":"2024-06-02T04:48:07.105060+0000","last_undegraded":"2024-06-02T04:48:07.105060+0000","last_fullsized":"2024-06-02T04:48:07.105060+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T07:56:27.274107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.692381+0000","last_change":"2024-06-02T04:48:02.698736+0000","last_active":"2024-06-02T04:48:06.692381+0000","last_peered":"2024-06-02T04:48:06.692381+0000","last_clean":"2024-06-02T04:48:06.692381+0000","last_became_active":"2024-06-02T04:48:02.698285+0000","last_became_peered":"2024-06-02T04:48:02.698285+0000","last_unstale":"2024-06-02T04:48:06.692381+0000","last_undegraded":"2024-06-02T04:48:06.692381+0000","last_fullsized":"2024-06-02T04:48:06.692381+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T04:53:31.655139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.691329+0000","last_change":"2024-06-02T04:48:02.689942+0000","last_active":"2024-06-02T04:48:06.691329+0000","last_peered":"2024-06-02T04:48:06.691329+0000","last_clean":"2024-06-02T04:48:06.691329+0000","last_became_active":"2024-06-02T04:48:02.689096+0000","last_became_peered":"2024-06-02T04:48:02.689096+0000","last_unstale":"2024-06-02T04:48:06.691329+0000","last_undegraded":"2024-06-02T04:48:06.691329+0000","last_fullsized":"2024-06-02T04:48:06.691329+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:11:06.451048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-06-02T04:48:06.691855+0000","last_change":"2024-06-02T04:48:02.691514+0000","last_active":"2024-06-02T04:48:06.691855+0000","last_peered":"2024-06-02T04:48:06.691855+0000","last_clean":"2024-06-02T04:48:06.691855+0000","last_became_active":"2024-06-02T04:48:02.691169+0000","last_became_peered":"2024-06-02T04:48:02.691169+0000","last_unstale":"2024-06-02T04:48:06.691855+0000","last_undegraded":"2024-06-02T04:48:06.691855+0000","last_fullsized":"2024-06-02T04:48:06.691855+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T06:03:54.513910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":280790,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":63751,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":242,"num_read_kb":190,"num_write":154,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":191253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":136,"ondisk_log_size":136,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":71,"seq":304942678037,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27876,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717276,"statfs":{"total":95995035648,"available":95966490624,"internally_reserved":0,"allocated":880640,"data_stored":442067,"data_compressed":11656,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 04:48:31 2024","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.59899999999999998}]},{"osd":1,"last update":"Sun Jun 2 04:48:31 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.497},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.68600000000000005}]},{"osd":2,"last update":"Sun Jun 2 04:48:31 2024","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.434,"15min":0.434},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.441,"5min":0.441,"15min":0.441},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.38400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":4,"last update":"Sun Jun 2 04:48:31 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.52600000000000002}]},{"osd":5,"last update":"Sun Jun 2 04:48:31 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.501},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.47199999999999998}]},{"osd":6,"last update":"Sun Jun 2 04:48:31 2024","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.64200000000000002}]},{"osd":7,"last update":"Sun Jun 2 04:48:31 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.627}]},{"osd":8,"last update":"Sun Jun 2 04:49:02 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.59299999999999997}]},{"osd":9,"last update":"Sun Jun 2 04:48:31 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.747},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.429,"5min":1.429,"15min":1.429},"last":0.67000000000000004}]},{"osd":10,"last update":"Sun Jun 2 04:48:31 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.78100000000000003}]}]},{"osd":10,"up_from":64,"seq":274877906970,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32112,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713040,"statfs":{"total":95995035648,"available":95962152960,"internally_reserved":0,"allocated":1024000,"data_stored":1089131,"data_compressed":47369,"data_compressed_allocated":61440,"data_compressed_original":622592,"omap_allocated":1599,"internal_metadata":31848897},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":1,"last update":"Sun Jun 2 04:48:17 2024","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.39100000000000001}]},{"osd":2,"last update":"Sun Jun 2 04:48:17 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.53200000000000003}]},{"osd":3,"last update":"Sun Jun 2 04:48:17 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.38},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.48299999999999998}]},{"osd":4,"last update":"Sun Jun 2 04:48:17 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.36099999999999999}]},{"osd":5,"last update":"Sun Jun 2 04:48:17 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.45400000000000001}]},{"osd":6,"last update":"Sun Jun 2 04:48:17 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.52400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":8,"last update":"Sun Jun 2 04:48:17 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.54200000000000004}]},{"osd":9,"last update":"Sun Jun 2 04:48:17 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.60699999999999998}]},{"osd":11,"last update":"Sun Jun 2 04:48:33 2024","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.495}]}]},{"osd":9,"up_from":60,"seq":257698037789,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31992,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713160,"statfs":{"total":95995035648,"available":95962275840,"internally_reserved":0,"allocated":901120,"data_stored":446399,"data_compressed":11656,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1599,"internal_metadata":31848897},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 04:49:00 2024","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.439,"15min":0.45200000000000001},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.51600000000000001,"5min":0.621,"15min":0.621},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.443,"15min":0.46000000000000002},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.45400000000000001,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.29199999999999998}]},{"osd":1,"last update":"Sun Jun 2 04:49:00 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.59899999999999998,"15min":0.60699999999999998},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.74199999999999999,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.61299999999999999,"15min":0.625},"min":{"1min":0.41599999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.72599999999999998,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.46400000000000002}]},{"osd":2,"last update":"Sun Jun 2 04:49:00 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.60699999999999998,"15min":0.62},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.68999999999999995,"5min":0.748,"15min":0.748},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.57699999999999996,"15min":0.58499999999999996},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.72799999999999998,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.38200000000000001}]},{"osd":3,"last update":"Sun Jun 2 04:49:00 2024","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.51800000000000002,"15min":0.53900000000000003},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.52000000000000002,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.55900000000000005,"15min":0.58099999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.39100000000000001}]},{"osd":4,"last update":"Sun Jun 2 04:49:00 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.60799999999999998,"15min":0.621},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.71099999999999997,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.64900000000000002,"15min":0.65900000000000003},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.79500000000000004,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.45200000000000001}]},{"osd":5,"last update":"Sun Jun 2 04:49:00 2024","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.60399999999999998,"15min":0.61699999999999999},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.71299999999999997,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.438},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.67100000000000004,"15min":0.68300000000000005},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.74099999999999999,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.54400000000000004}]},{"osd":6,"last update":"Sun Jun 2 04:47:56 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.505}]},{"osd":7,"last update":"Sun Jun 2 04:49:00 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.75900000000000001,"15min":0.78500000000000003},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.82299999999999995,"5min":1.081,"15min":1.081},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.73999999999999999,"15min":0.76100000000000001},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.83599999999999997,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.495}]},{"osd":8,"last update":"Sun Jun 2 04:49:00 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.76000000000000001,"15min":0.78400000000000003},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.79900000000000004,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.73599999999999999,"15min":0.75800000000000001},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.80700000000000005,"5min":1.01,"15min":1.01},"last":0.47599999999999998}]},{"osd":10,"last update":"Sun Jun 2 04:48:13 2024","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.50600000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]}]},{"osd":8,"up_from":53,"seq":227633266720,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":892928,"data_stored":441892,"data_compressed":11656,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 04:48:38 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.54600000000000004,"15min":0.54300000000000004},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.77300000000000002,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.52800000000000002,"15min":0.52400000000000002},"min":{"1min":0.45900000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.34699999999999998}]},{"osd":1,"last update":"Sun Jun 2 04:48:38 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.53900000000000003,"15min":0.53300000000000003},"min":{"1min":0.36899999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.629}]},{"osd":2,"last update":"Sun Jun 2 04:48:38 2024","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.42699999999999999,"15min":0.42299999999999999},"min":{"1min":0.311,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.379},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.437,"15min":0.433},"min":{"1min":0.26900000000000002,"5min":0.245,"15min":0.245},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.36299999999999999}]},{"osd":3,"last update":"Sun Jun 2 04:48:38 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.53500000000000003,"15min":0.52900000000000003},"min":{"1min":0.35099999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.56100000000000005,"15min":0.55700000000000005},"min":{"1min":0.41199999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.72999999999999998,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.41199999999999998}]},{"osd":4,"last update":"Sun Jun 2 04:48:38 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.56999999999999995,"15min":0.56799999999999995},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.496},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.40999999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.76100000000000001,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.47099999999999997}]},{"osd":5,"last update":"Sun Jun 2 04:48:38 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.52500000000000002,"15min":0.52100000000000002},"min":{"1min":0.33100000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.80800000000000005,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.53500000000000003,"15min":0.53100000000000003},"min":{"1min":0.379,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.82199999999999995,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.52200000000000002}]},{"osd":6,"last update":"Sun Jun 2 04:48:38 2024","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.628,"15min":0.625},"min":{"1min":0.5,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.79100000000000004,"5min":0.876,"15min":0.876},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.63200000000000001,"15min":0.628},"min":{"1min":0.40600000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.84099999999999997,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.54700000000000004}]},{"osd":7,"last update":"Sun Jun 2 04:48:38 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.66400000000000003,"15min":0.65900000000000003},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.91000000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.67300000000000004,"15min":0.66700000000000004},"min":{"1min":0.50900000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.57199999999999995}]},{"osd":9,"last update":"Sun Jun 2 04:48:59 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.67100000000000004,"15min":0.66100000000000003},"min":{"1min":0.51600000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.68999999999999995,"15min":0.68500000000000005},"min":{"1min":0.47099999999999997,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.91800000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.60799999999999998}]},{"osd":10,"last update":"Sun Jun 2 04:48:16 2024","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.64000000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]}]},{"osd":7,"up_from":46,"seq":197568495652,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32036,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713116,"statfs":{"total":95995035648,"available":95962230784,"internally_reserved":0,"allocated":946176,"data_stored":1038431,"data_compressed":47369,"data_compressed_allocated":61440,"data_compressed_original":622592,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 04:47:20 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.30199999999999999}]},{"osd":1,"last update":"Sun Jun 2 04:48:22 2024","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.42599999999999999,"15min":0.42299999999999999},"min":{"1min":0.31900000000000001,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.629,"5min":0.746,"15min":0.746},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.42999999999999999,"15min":0.42199999999999999},"min":{"1min":0.33600000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.66900000000000004,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.29399999999999998}]},{"osd":2,"last update":"Sun Jun 2 04:48:22 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.57999999999999996,"15min":0.57199999999999995},"min":{"1min":0.434,"5min":0.31,"15min":0.31},"max":{"1min":0.80700000000000005,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.58199999999999996,"15min":0.57399999999999995},"min":{"1min":0.42099999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.85899999999999999,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.39300000000000002}]},{"osd":3,"last update":"Sun Jun 2 04:48:22 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.59599999999999997,"15min":0.58999999999999997},"min":{"1min":0.435,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.93100000000000005,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.623,"5min":0.56899999999999995,"15min":0.56000000000000005},"min":{"1min":0.379,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.435}]},{"osd":4,"last update":"Sun Jun 2 04:48:22 2024","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.442,"15min":0.437},"min":{"1min":0.34899999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.312},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.54300000000000004,"15min":0.53700000000000003},"min":{"1min":0.33200000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.746,"5min":0.879,"15min":0.879},"last":0.40699999999999997}]},{"osd":5,"last update":"Sun Jun 2 04:48:22 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.59999999999999998,"15min":0.59499999999999997},"min":{"1min":0.42099999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.66700000000000004,"15min":0.66100000000000003},"min":{"1min":0.48699999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.95299999999999996,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.36699999999999999}]},{"osd":6,"last update":"Sun Jun 2 04:48:22 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.63300000000000001,"15min":0.625},"min":{"1min":0.46899999999999997,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.624,"15min":0.61399999999999999},"min":{"1min":0.505,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.91800000000000004,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.45200000000000001}]},{"osd":8,"last update":"Sun Jun 2 04:48:42 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.70799999999999996,"15min":0.69799999999999995},"min":{"1min":0.54500000000000004,"5min":0.441,"15min":0.441},"max":{"1min":1.0069999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.66900000000000004,"15min":0.66000000000000003},"min":{"1min":0.55400000000000005,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.49099999999999999}]},{"osd":9,"last update":"Sun Jun 2 04:48:57 2024","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.72599999999999998,"15min":0.72799999999999998},"min":{"1min":0.51600000000000001,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.97399999999999998,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.70699999999999996,"15min":0.70899999999999996},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.879,"5min":1.042,"15min":1.042},"last":0.50700000000000001}]},{"osd":10,"last update":"Sun Jun 2 04:48:16 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.5}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]}]},{"osd":6,"up_from":40,"seq":171798691879,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27872,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717280,"statfs":{"total":95995035648,"available":95966494720,"internally_reserved":0,"allocated":876544,"data_stored":437479,"data_compressed":11656,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 04:48:05 2024","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.38300000000000001,"15min":0.38600000000000001},"min":{"1min":0.27400000000000002,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.40200000000000002,"15min":0.41099999999999998},"min":{"1min":0.28699999999999998,"5min":0.251,"15min":0.251},"max":{"1min":0.49199999999999999,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.31}]},{"osd":1,"last update":"Sun Jun 2 04:48:05 2024","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.56000000000000005,"15min":0.56399999999999995},"min":{"1min":0.378,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.73499999999999999,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.57899999999999996,"15min":0.58399999999999996},"min":{"1min":0.33600000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.749,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.44700000000000001}]},{"osd":2,"last update":"Sun Jun 2 04:48:05 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.56699999999999995,"15min":0.56899999999999995},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.746,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.57899999999999996,"15min":0.58199999999999996},"min":{"1min":0.40000000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.78300000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.371}]},{"osd":3,"last update":"Sun Jun 2 04:48:05 2024","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.44700000000000001,"15min":0.45600000000000002},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.65700000000000003,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.46400000000000002,"15min":0.47099999999999997},"min":{"1min":0.32800000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.52900000000000003,"5min":0.745,"15min":0.745},"last":0.498}]},{"osd":4,"last update":"Sun Jun 2 04:48:05 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.60199999999999998,"15min":0.60399999999999998},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.78900000000000003,"5min":1.032,"15min":1.032},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.626,"15min":0.63800000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.69799999999999995,"5min":1.071,"15min":1.071},"last":0.50800000000000001}]},{"osd":5,"last update":"Sun Jun 2 04:48:05 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.61499999999999999,"15min":0.62},"min":{"1min":0.39500000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.64500000000000002,"15min":0.65100000000000002},"min":{"1min":0.48099999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.77000000000000002,"5min":0.999,"15min":0.999},"last":0.48199999999999998}]},{"osd":7,"last update":"Sun Jun 2 04:48:23 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.63600000000000001,"15min":0.63900000000000001},"min":{"1min":0.45300000000000001,"5min":0.439,"15min":0.439},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.64100000000000001,"15min":0.64800000000000002},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.79400000000000004,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.57999999999999996}]},{"osd":8,"last update":"Sun Jun 2 04:48:39 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.68500000000000005,"15min":0.68000000000000005},"min":{"1min":0.501,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.897,"5min":1.897,"15min":1.897},"last":0.624},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.69699999999999995,"15min":0.69899999999999995},"min":{"1min":0.47299999999999998,"5min":0.443,"15min":0.443},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.58899999999999997}]},{"osd":9,"last update":"Sun Jun 2 04:49:00 2024","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.65500000000000003,"15min":0.62},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":6.2530000000000001,"5min":6.2530000000000001,"15min":6.2530000000000001},"last":0.60899999999999999},{"interface":"front","average":{"1min":1.2110000000000001,"5min":0.71999999999999997,"15min":0.63800000000000001},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":12.939,"5min":12.939,"15min":12.939},"last":0.59799999999999998}]},{"osd":10,"last update":"Sun Jun 2 04:48:15 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.65500000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]}]},{"osd":1,"up_from":12,"seq":51539607609,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36128,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93709024,"statfs":{"total":95995035648,"available":95958040576,"internally_reserved":0,"allocated":942080,"data_stored":496840,"data_compressed":11656,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 04:48:46 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.51100000000000001,"15min":0.49099999999999999},"min":{"1min":0.32100000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.85599999999999998,"5min":1.131,"15min":1.131},"last":0.624},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.50600000000000001,"15min":0.49099999999999999},"min":{"1min":0.32700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.40699999999999997}]},{"osd":2,"last update":"Sun Jun 2 04:49:00 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.52300000000000002,"15min":0.51400000000000001},"min":{"1min":0.40799999999999997,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.72999999999999998,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.53700000000000003,"15min":0.51100000000000001},"min":{"1min":0.38800000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.79700000000000004,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.47799999999999998}]},{"osd":3,"last update":"Sun Jun 2 04:48:16 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.5,"15min":0.48799999999999999},"min":{"1min":0.35499999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.50900000000000001,"15min":0.503},"min":{"1min":0.377,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.45500000000000002}]},{"osd":4,"last update":"Sun Jun 2 04:49:03 2024","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.433}]},{"osd":5,"last update":"Sun Jun 2 04:48:54 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.56000000000000005,"15min":0.54100000000000004},"min":{"1min":0.41999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.78000000000000003,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.624,"15min":0.59999999999999998},"min":{"1min":0.441,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.88300000000000001,"5min":1.212,"15min":1.212},"last":0.66700000000000004}]},{"osd":6,"last update":"Sun Jun 2 04:48:07 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.60499999999999998,"15min":0.59299999999999997},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.60399999999999998,"15min":0.59399999999999997},"min":{"1min":0.51000000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.65100000000000002}]},{"osd":7,"last update":"Sun Jun 2 04:48:27 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.53900000000000003,"15min":0.53800000000000003},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.627,"5min":0.58799999999999997,"15min":0.58199999999999996},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.72899999999999998}]},{"osd":8,"last update":"Sun Jun 2 04:48:41 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.67300000000000004,"15min":0.67400000000000004},"min":{"1min":0.45700000000000002,"5min":0.435,"15min":0.435},"max":{"1min":0.85399999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72899999999999998,"15min":0.72999999999999998},"min":{"1min":0.46600000000000003,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.97499999999999998,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.71199999999999997}]},{"osd":9,"last update":"Sun Jun 2 04:49:00 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.52700000000000002,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.95399999999999996,"5min":1.288,"15min":1.288},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.71399999999999997,"15min":0.70999999999999996},"min":{"1min":0.56999999999999995,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.77000000000000002}]},{"osd":10,"last update":"Sun Jun 2 04:48:16 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.745},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.78400000000000003}]},{"osd":11,"last update":"Sun Jun 2 04:49:03 2024","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.81499999999999995}]}]},{"osd":0,"up_from":8,"seq":34359738427,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31992,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713160,"statfs":{"total":95995035648,"available":95962275840,"internally_reserved":0,"allocated":901120,"data_stored":438867,"data_compressed":11656,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jun 2 04:48:43 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.51000000000000001,"15min":0.46999999999999997},"min":{"1min":0.35199999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.51000000000000001,"15min":0.46500000000000002},"min":{"1min":0.32000000000000001,"5min":0.315,"15min":0.315},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.36799999999999999}]},{"osd":2,"last update":"Sun Jun 2 04:48:00 2024","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.495,"15min":0.46700000000000003},"min":{"1min":0.39300000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.5},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.51800000000000002,"15min":0.47999999999999998},"min":{"1min":0.46000000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.84799999999999998,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.78100000000000003}]},{"osd":3,"last update":"Sun Jun 2 04:47:17 2024","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.41899999999999998,"15min":0.40699999999999997},"min":{"1min":0.317,"5min":0.253,"15min":0.253},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.438,"15min":0.436},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.47899999999999998}]},{"osd":4,"last update":"Sun Jun 2 04:48:37 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.54800000000000004,"15min":0.52100000000000002},"min":{"1min":0.38200000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.53800000000000003,"15min":0.52400000000000002},"min":{"1min":0.42599999999999999,"5min":0.372,"15min":0.372},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.51800000000000002}]},{"osd":5,"last update":"Sun Jun 2 04:48:52 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.57199999999999995,"15min":0.53900000000000003},"min":{"1min":0.377,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.57299999999999995,"15min":0.54100000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.46600000000000003}]},{"osd":6,"last update":"Sun Jun 2 04:48:08 2024","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.49199999999999999,"15min":0.49299999999999999},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.76300000000000001,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.47099999999999997,"15min":0.46899999999999997},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.66900000000000004}]},{"osd":7,"last update":"Sun Jun 2 04:47:21 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":1.139},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":1.099}]},{"osd":8,"last update":"Sun Jun 2 04:48:41 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.64200000000000002,"15min":0.64500000000000002},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.70299999999999996,"15min":0.70699999999999996},"min":{"1min":0.54500000000000004,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.98599999999999999}]},{"osd":9,"last update":"Sun Jun 2 04:48:57 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.627,"15min":0.63700000000000001},"min":{"1min":0.36699999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.60799999999999998,"15min":0.60999999999999999},"min":{"1min":0.39600000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.76000000000000001}]},{"osd":10,"last update":"Sun Jun 2 04:48:16 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":1.1220000000000001},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.56000000000000005}]},{"osd":11,"last update":"Sun Jun 2 04:48:32 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":1.008}]}]},{"osd":2,"up_from":16,"seq":68719476789,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32056,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713096,"statfs":{"total":95995035648,"available":95962210304,"internally_reserved":0,"allocated":966656,"data_stored":498535,"data_compressed":11656,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 04:48:05 2024","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.496,"15min":0.48599999999999999},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.71499999999999997,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.50800000000000001,"15min":0.50900000000000001},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.66200000000000003,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.39500000000000002}]},{"osd":1,"last update":"Sun Jun 2 04:48:05 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.53500000000000003,"15min":0.52900000000000003},"min":{"1min":0.36899999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.74299999999999999,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.54200000000000004,"15min":0.54400000000000004},"min":{"1min":0.39700000000000002,"5min":0.254,"15min":0.254},"max":{"1min":0.79300000000000004,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.81100000000000005}]},{"osd":3,"last update":"Sun Jun 2 04:48:22 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.55500000000000005,"15min":0.55700000000000005},"min":{"1min":0.39000000000000001,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.71599999999999997,"5min":1.472,"15min":1.472},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.53200000000000003,"15min":0.52700000000000002},"min":{"1min":0.372,"5min":0.308,"15min":0.308},"max":{"1min":0.80400000000000005,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.55700000000000005}]},{"osd":4,"last update":"Sun Jun 2 04:47:33 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.51700000000000002,"15min":0.51300000000000001},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.68100000000000005,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.34699999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.66400000000000003,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.61899999999999999}]},{"osd":5,"last update":"Sun Jun 2 04:48:53 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.46400000000000002,"15min":0.42599999999999999},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.48499999999999999,"15min":0.45300000000000001},"min":{"1min":0.34100000000000003,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.47099999999999997}]},{"osd":6,"last update":"Sun Jun 2 04:48:05 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.39900000000000002,"5min":0.372,"15min":0.372},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.441},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.64000000000000001,"15min":0.63300000000000001},"min":{"1min":0.45400000000000001,"5min":0.438,"15min":0.438},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.66900000000000004}]},{"osd":7,"last update":"Sun Jun 2 04:47:24 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.76200000000000001}]},{"osd":8,"last update":"Sun Jun 2 04:48:42 2024","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.56699999999999995,"15min":0.56100000000000005},"min":{"1min":0.42399999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.497},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.63100000000000001,"15min":0.621},"min":{"1min":0.41499999999999998,"5min":0.37,"15min":0.37},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.70999999999999996}]},{"osd":9,"last update":"Sun Jun 2 04:48:01 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.73799999999999999}]},{"osd":10,"last update":"Sun Jun 2 04:48:16 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.72199999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]}]},{"osd":3,"up_from":22,"seq":94489280561,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31980,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713172,"statfs":{"total":95995035648,"available":95962288128,"internally_reserved":0,"allocated":888832,"data_stored":437673,"data_compressed":11656,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 04:48:20 2024","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.32400000000000001,"15min":0.312},"min":{"1min":0.24199999999999999,"5min":0.221,"15min":0.221},"max":{"1min":0.44400000000000001,"5min":0.48999999999999999,"15min":0.48999999999999999},"last":0.376},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.34899999999999998,"15min":0.34100000000000003},"min":{"1min":0.255,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.55500000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.30299999999999999}]},{"osd":1,"last update":"Sun Jun 2 04:48:20 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.48299999999999998,"15min":0.46300000000000002},"min":{"1min":0.40999999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.65700000000000003,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.48999999999999999,"15min":0.46200000000000002},"min":{"1min":0.39100000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.68799999999999994,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.60599999999999998}]},{"osd":2,"last update":"Sun Jun 2 04:48:20 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.56000000000000005,"15min":0.56399999999999995},"min":{"1min":0.377,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.73999999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.44},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.57899999999999996,"15min":0.59099999999999997},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.63300000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":0.51000000000000001}]},{"osd":4,"last update":"Sun Jun 2 04:48:38 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.51400000000000001,"15min":0.499},"min":{"1min":0.41599999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.67300000000000004,"5min":0.877,"15min":0.877},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.52600000000000002,"15min":0.505},"min":{"1min":0.40999999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.72299999999999998,"5min":0.751,"15min":0.751},"last":0.52400000000000002}]},{"osd":5,"last update":"Sun Jun 2 04:48:54 2024","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.63400000000000001,"15min":0.57999999999999996},"min":{"1min":0.38900000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":7.3220000000000001,"5min":7.3220000000000001,"15min":7.3220000000000001},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55300000000000005,"15min":0.54900000000000004},"min":{"1min":0.39800000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.90000000000000002,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.44800000000000001}]},{"osd":6,"last update":"Sun Jun 2 04:48:06 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.46899999999999997,"15min":0.46700000000000003},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.47199999999999998,"15min":0.47099999999999997},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.63200000000000001,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.40300000000000002}]},{"osd":7,"last update":"Sun Jun 2 04:48:26 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.44900000000000001,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.80500000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.628,"5min":0.64800000000000002,"15min":0.65100000000000002},"min":{"1min":0.48899999999999999,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.751,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.63500000000000001}]},{"osd":8,"last update":"Sun Jun 2 04:47:39 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.51100000000000001}]},{"osd":9,"last update":"Sun Jun 2 04:48:00 2024","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.496},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.45800000000000002}]},{"osd":10,"last update":"Sun Jun 2 04:48:14 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.70699999999999996}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]}]},{"osd":4,"up_from":29,"seq":124554051631,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31980,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713172,"statfs":{"total":95995035648,"available":95962288128,"internally_reserved":0,"allocated":888832,"data_stored":442474,"data_compressed":11656,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 04:47:31 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.49199999999999999,"15min":0.48099999999999998},"min":{"1min":0.32400000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.495,"15min":0.48699999999999999},"min":{"1min":0.35199999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.78900000000000003,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.34300000000000003}]},{"osd":1,"last update":"Sun Jun 2 04:48:33 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.36099999999999999,"15min":0.34300000000000003},"min":{"1min":0.27500000000000002,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.38900000000000001,"15min":0.36699999999999999},"min":{"1min":0.30199999999999999,"5min":0.217,"15min":0.217},"max":{"1min":0.72799999999999998,"5min":0.877,"15min":0.877},"last":0.46700000000000003}]},{"osd":2,"last update":"Sun Jun 2 04:48:33 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.53900000000000003,"15min":0.52800000000000002},"min":{"1min":0.41899999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.624,"5min":0.56399999999999995,"15min":0.53800000000000003},"min":{"1min":0.47099999999999997,"5min":0.377,"15min":0.377},"max":{"1min":0.80800000000000005,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.66400000000000003}]},{"osd":3,"last update":"Sun Jun 2 04:48:33 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.54000000000000004,"15min":0.51800000000000002},"min":{"1min":0.373,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.52000000000000002,"15min":0.51000000000000001},"min":{"1min":0.38100000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.72899999999999998,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.51300000000000001}]},{"osd":5,"last update":"Sun Jun 2 04:48:53 2024","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.60999999999999999,"15min":0.60199999999999998},"min":{"1min":0.46100000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.85499999999999998,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.621,"15min":0.59999999999999998},"min":{"1min":0.46500000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.96599999999999997,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.78100000000000003}]},{"osd":6,"last update":"Sun Jun 2 04:48:07 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.57199999999999995,"15min":0.55700000000000005},"min":{"1min":0.40100000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.59199999999999997,"15min":0.57599999999999996},"min":{"1min":0.41999999999999998,"5min":0.379,"15min":0.379},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.53600000000000003}]},{"osd":7,"last update":"Sun Jun 2 04:48:24 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.53100000000000003,"15min":0.52200000000000002},"min":{"1min":0.36399999999999999,"5min":0.312,"15min":0.312},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.56499999999999995,"15min":0.55100000000000005},"min":{"1min":0.38100000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.63400000000000001}]},{"osd":8,"last update":"Sun Jun 2 04:48:40 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.60599999999999998,"15min":0.60399999999999998},"min":{"1min":0.45100000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.78200000000000003,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71499999999999997,"15min":0.71399999999999997},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.94399999999999995,"5min":1.071,"15min":1.071},"last":0.74199999999999999}]},{"osd":9,"last update":"Sun Jun 2 04:48:58 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.74099999999999999,"15min":0.745},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.62,"5min":0.64200000000000002,"15min":0.64600000000000002},"min":{"1min":0.47699999999999998,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.83999999999999997,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.55100000000000005}]},{"osd":10,"last update":"Sun Jun 2 04:48:15 2024","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.621},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.75800000000000001}]},{"osd":11,"last update":"Sun Jun 2 04:49:02 2024","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.80000000000000004}]}]},{"osd":5,"up_from":33,"seq":141733920811,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":954368,"data_stored":1033674,"data_compressed":47369,"data_compressed_allocated":61440,"data_compressed_original":622592,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 04:48:50 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.504,"15min":0.48499999999999999},"min":{"1min":0.40200000000000002,"5min":0.249,"15min":0.249},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.47499999999999998,"15min":0.45100000000000001},"min":{"1min":0.374,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.56000000000000005}]},{"osd":1,"last update":"Sun Jun 2 04:48:50 2024","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.55300000000000005,"15min":0.52900000000000003},"min":{"1min":0.5,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.79500000000000004,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.55100000000000005,"15min":0.53500000000000003},"min":{"1min":0.47099999999999997,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.77900000000000003,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.622}]},{"osd":2,"last update":"Sun Jun 2 04:48:50 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.40999999999999998,"15min":0.39500000000000002},"min":{"1min":0.317,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.40899999999999997,"15min":0.38700000000000001},"min":{"1min":0.316,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.67900000000000005}]},{"osd":3,"last update":"Sun Jun 2 04:48:50 2024","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.53000000000000003,"15min":0.52000000000000002},"min":{"1min":0.38800000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.621,"5min":0.53900000000000003,"15min":0.51200000000000001},"min":{"1min":0.46100000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.80200000000000005,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.71499999999999997}]},{"osd":4,"last update":"Sun Jun 2 04:48:50 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.58199999999999996,"15min":0.55900000000000005},"min":{"1min":0.54200000000000004,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.58999999999999997,"15min":0.57599999999999996},"min":{"1min":0.54300000000000004,"5min":0.313,"15min":0.313},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.76500000000000001}]},{"osd":6,"last update":"Sun Jun 2 04:48:07 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56999999999999995,"15min":0.57099999999999995},"min":{"1min":0.42099999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.58599999999999997,"15min":0.57799999999999996},"min":{"1min":0.46800000000000003,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.875}]},{"osd":7,"last update":"Sun Jun 2 04:48:23 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.65600000000000003,"15min":0.65400000000000003},"min":{"1min":0.42499999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.92400000000000004,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.65500000000000003,"15min":0.64700000000000002},"min":{"1min":0.45400000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.79600000000000004}]},{"osd":8,"last update":"Sun Jun 2 04:48:43 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.60699999999999998,"15min":0.59099999999999997},"min":{"1min":0.42099999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.623,"15min":0.61599999999999999},"min":{"1min":0.39000000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.90000000000000002,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.81499999999999995}]},{"osd":9,"last update":"Sun Jun 2 04:48:01 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.93600000000000005}]},{"osd":10,"last update":"Sun Jun 2 04:48:13 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.90500000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34075,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34075,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34075,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35713,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35713,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35713,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35713,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35713,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":59451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":61146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":989,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":61374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-02T04:49:07.039 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-06-02T04:49:07.040 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-06-02T04:49:07.040 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-06-02T04:49:07.040 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell --fsid 60ab6d30-209a-11ef-bc9b-c7b262605968 -- ceph health --format=json 2024-06-02T04:49:07.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:06 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [8, 4]}]: dispatch 2024-06-02T04:49:07.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:06 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4]}]: dispatch 2024-06-02T04:49:07.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:06 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]: dispatch 2024-06-02T04:49:07.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:06 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]: dispatch 2024-06-02T04:49:07.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:06 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]: dispatch 2024-06-02T04:49:07.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:06 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]: dispatch 2024-06-02T04:49:07.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:06 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]: dispatch 2024-06-02T04:49:07.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:06 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.8", "id": [5, 10]}]: dispatch 2024-06-02T04:49:07.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:06 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [9, 8]}]: dispatch 2024-06-02T04:49:07.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:06 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [9, 8]}]: dispatch 2024-06-02T04:49:07.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:06 smithi192 ceph-mon[47933]: pgmap v250: 129 pgs: 129 active+clean; 639 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-06-02T04:49:07.264 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T04:49:07.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:06 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [8, 4]}]: dispatch 2024-06-02T04:49:07.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:06 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4]}]: dispatch 2024-06-02T04:49:07.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:06 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]: dispatch 2024-06-02T04:49:07.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:06 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]: dispatch 2024-06-02T04:49:07.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:06 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]: dispatch 2024-06-02T04:49:07.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:06 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]: dispatch 2024-06-02T04:49:07.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:06 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]: dispatch 2024-06-02T04:49:07.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:06 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.8", "id": [5, 10]}]: dispatch 2024-06-02T04:49:07.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:06 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [9, 8]}]: dispatch 2024-06-02T04:49:07.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:06 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [9, 8]}]: dispatch 2024-06-02T04:49:07.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:06 smithi119 ceph-mon[46633]: pgmap v250: 129 pgs: 129 active+clean; 639 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-06-02T04:49:07.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:07 smithi076 ceph-mon[42935]: from='client.15099 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-02T04:49:07.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:07 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [8, 4]}]': finished 2024-06-02T04:49:07.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:07 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4]}]': finished 2024-06-02T04:49:07.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:07 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]': finished 2024-06-02T04:49:07.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:07 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]': finished 2024-06-02T04:49:07.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:07 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]': finished 2024-06-02T04:49:07.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:07 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]': finished 2024-06-02T04:49:07.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:07 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]': finished 2024-06-02T04:49:07.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:07 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.8", "id": [5, 10]}]': finished 2024-06-02T04:49:07.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:07 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [9, 8]}]': finished 2024-06-02T04:49:07.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:07 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [9, 8]}]': finished 2024-06-02T04:49:07.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:07 smithi076 ceph-mon[42935]: osdmap e81: 12 total, 12 up, 12 in 2024-06-02T04:49:08.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:07 smithi192 ceph-mon[47933]: from='client.15099 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-02T04:49:08.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:07 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [8, 4]}]': finished 2024-06-02T04:49:08.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:07 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4]}]': finished 2024-06-02T04:49:08.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:07 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]': finished 2024-06-02T04:49:08.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:07 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]': finished 2024-06-02T04:49:08.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:07 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]': finished 2024-06-02T04:49:08.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:07 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]': finished 2024-06-02T04:49:08.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:07 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]': finished 2024-06-02T04:49:08.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:07 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.8", "id": [5, 10]}]': finished 2024-06-02T04:49:08.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:07 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [9, 8]}]': finished 2024-06-02T04:49:08.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:07 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [9, 8]}]': finished 2024-06-02T04:49:08.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:07 smithi192 ceph-mon[47933]: osdmap e81: 12 total, 12 up, 12 in 2024-06-02T04:49:08.287 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:08.287+0000 7f4465fa9700 1 -- 172.21.15.76:0/2227795092 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4460107020 msgr2=0x7f4460107400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:08.287 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:08.287+0000 7f4465fa9700 1 --2- 172.21.15.76:0/2227795092 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4460107020 0x7f4460107400 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f4450009990 tx=0x7f4450009ca0 comp rx=0 tx=0).stop 2024-06-02T04:49:08.287 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:08.287+0000 7f4465fa9700 1 -- 172.21.15.76:0/2227795092 shutdown_connections 2024-06-02T04:49:08.287 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:08.287+0000 7f4465fa9700 1 --2- 172.21.15.76:0/2227795092 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f44600692f0 0x7f446010de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:08.287 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:08.287+0000 7f4465fa9700 1 --2- 172.21.15.76:0/2227795092 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4460107020 0x7f4460107400 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:08.288 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:08.287+0000 7f4465fa9700 1 --2- 172.21.15.76:0/2227795092 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4460068950 0x7f4460068db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:08.288 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:08.287+0000 7f4465fa9700 1 -- 172.21.15.76:0/2227795092 >> 172.21.15.76:0/2227795092 conn(0x7f4460075f80 msgr2=0x7f4460076390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:08.288 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:08.287+0000 7f4465fa9700 1 -- 172.21.15.76:0/2227795092 shutdown_connections 2024-06-02T04:49:08.288 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:08.287+0000 7f4465fa9700 1 -- 172.21.15.76:0/2227795092 wait complete. 2024-06-02T04:49:08.290 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:08.287+0000 7f4465fa9700 1 Processor -- start 2024-06-02T04:49:08.290 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:08.288+0000 7f4465fa9700 1 -- start start 2024-06-02T04:49:08.290 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:08.288+0000 7f4465fa9700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4460068950 0x7f4460197360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:08.290 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:08.288+0000 7f4465fa9700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f44600692f0 0x7f44601978a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:08.290 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:08.288+0000 7f4465fa9700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4460107020 0x7f446019bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:08.290 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:08.288+0000 7f4465fa9700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f446019c260 con 0x7f4460107020 2024-06-02T04:49:08.290 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:08.288+0000 7f4465fa9700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f446019c3d0 con 0x7f44600692f0 2024-06-02T04:49:08.290 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:08.288+0000 7f4465fa9700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f446019c590 con 0x7f4460068950 2024-06-02T04:49:08.290 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:08.288+0000 7f445ffff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4460107020 0x7f446019bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:08.290 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:08.288+0000 7f445ffff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4460107020 0x7f446019bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:54194/0 (socket says 172.21.15.76:54194) 2024-06-02T04:49:08.290 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:08.288+0000 7f445ffff700 1 -- 172.21.15.76:0/3788081806 learned_addr learned my addr 172.21.15.76:0/3788081806 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:49:08.291 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:08.288+0000 7f445effd700 1 --2- 172.21.15.76:0/3788081806 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f44600692f0 0x7f44601978a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:08.291 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:08.288+0000 7f445f7fe700 1 --2- 172.21.15.76:0/3788081806 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4460068950 0x7f4460197360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:08.291 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:08.288+0000 7f445ffff700 1 -- 172.21.15.76:0/3788081806 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4460068950 msgr2=0x7f4460197360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:08.291 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:08.288+0000 7f445ffff700 1 --2- 172.21.15.76:0/3788081806 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4460068950 0x7f4460197360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:08.291 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:08.288+0000 7f445ffff700 1 -- 172.21.15.76:0/3788081806 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f44600692f0 msgr2=0x7f44601978a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:08.291 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:08.288+0000 7f445ffff700 1 --2- 172.21.15.76:0/3788081806 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f44600692f0 0x7f44601978a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:08.291 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:08.288+0000 7f445ffff700 1 -- 172.21.15.76:0/3788081806 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44500095f0 con 0x7f4460107020 2024-06-02T04:49:08.291 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:08.288+0000 7f445ffff700 1 --2- 172.21.15.76:0/3788081806 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4460107020 0x7f446019bc50 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f4458007ee0 tx=0x7f445800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:08.291 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:08.288+0000 7f445cff9700 1 -- 172.21.15.76:0/3788081806 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4458017070 con 0x7f4460107020 2024-06-02T04:49:08.292 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:08.289+0000 7f4465fa9700 1 -- 172.21.15.76:0/3788081806 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f446019c870 con 0x7f4460107020 2024-06-02T04:49:08.292 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:08.289+0000 7f445cff9700 1 -- 172.21.15.76:0/3788081806 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f445800f040 con 0x7f4460107020 2024-06-02T04:49:08.292 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:08.289+0000 7f445cff9700 1 -- 172.21.15.76:0/3788081806 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4458005710 con 0x7f4460107020 2024-06-02T04:49:08.292 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:08.289+0000 7f4465fa9700 1 -- 172.21.15.76:0/3788081806 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44601a40d0 con 0x7f4460107020 2024-06-02T04:49:08.292 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:08.289+0000 7f4465fa9700 1 -- 172.21.15.76:0/3788081806 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4460109540 con 0x7f4460107020 2024-06-02T04:49:08.293 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:08.291+0000 7f445cff9700 1 -- 172.21.15.76:0/3788081806 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f4458005870 con 0x7f4460107020 2024-06-02T04:49:08.293 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:08.291+0000 7f445cff9700 1 --2- 172.21.15.76:0/3788081806 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f444c0a11b0 0x7f444c0a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:08.293 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:08.291+0000 7f445f7fe700 1 --2- 172.21.15.76:0/3788081806 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f444c0a11b0 0x7f444c0a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:08.293 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:08.291+0000 7f445cff9700 1 -- 172.21.15.76:0/3788081806 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f44580ccb50 con 0x7f4460107020 2024-06-02T04:49:08.293 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:08.292+0000 7f445f7fe700 1 --2- 172.21.15.76:0/3788081806 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f444c0a11b0 0x7f444c0a3670 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f445000b5c0 tx=0x7f4450005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:08.295 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:08.295+0000 7f445cff9700 1 -- 172.21.15.76:0/3788081806 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f4458095e70 con 0x7f4460107020 2024-06-02T04:49:08.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:07 smithi119 ceph-mon[46633]: from='client.15099 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-02T04:49:08.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:07 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [8, 4]}]': finished 2024-06-02T04:49:08.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:07 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4]}]': finished 2024-06-02T04:49:08.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:07 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]': finished 2024-06-02T04:49:08.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:07 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]': finished 2024-06-02T04:49:08.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:07 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]': finished 2024-06-02T04:49:08.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:07 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]': finished 2024-06-02T04:49:08.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:07 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]': finished 2024-06-02T04:49:08.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:07 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.8", "id": [5, 10]}]': finished 2024-06-02T04:49:08.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:07 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [9, 8]}]': finished 2024-06-02T04:49:08.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:07 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [9, 8]}]': finished 2024-06-02T04:49:08.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:07 smithi119 ceph-mon[46633]: osdmap e81: 12 total, 12 up, 12 in 2024-06-02T04:49:08.533 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:08.532+0000 7f4465fa9700 1 -- 172.21.15.76:0/3788081806 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f44601026d0 con 0x7f4460107020 2024-06-02T04:49:08.533 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:08.533+0000 7f445cff9700 1 -- 172.21.15.76:0/3788081806 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f4458099490 con 0x7f4460107020 2024-06-02T04:49:08.533 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:49:08.533 INFO:teuthology.orchestra.run.smithi076.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-06-02T04:49:08.535 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:08.535+0000 7f4465fa9700 1 -- 172.21.15.76:0/3788081806 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f444c0a11b0 msgr2=0x7f444c0a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:08.536 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:08.535+0000 7f4465fa9700 1 --2- 172.21.15.76:0/3788081806 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f444c0a11b0 0x7f444c0a3670 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f445000b5c0 tx=0x7f4450005fd0 comp rx=0 tx=0).stop 2024-06-02T04:49:08.536 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:08.535+0000 7f4465fa9700 1 -- 172.21.15.76:0/3788081806 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4460107020 msgr2=0x7f446019bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:08.536 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:08.535+0000 7f4465fa9700 1 --2- 172.21.15.76:0/3788081806 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4460107020 0x7f446019bc50 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f4458007ee0 tx=0x7f445800d3b0 comp rx=0 tx=0).stop 2024-06-02T04:49:08.536 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:08.535+0000 7f4465fa9700 1 -- 172.21.15.76:0/3788081806 shutdown_connections 2024-06-02T04:49:08.536 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:08.535+0000 7f4465fa9700 1 --2- 172.21.15.76:0/3788081806 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4460107020 0x7f446019bc50 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:08.536 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:08.535+0000 7f4465fa9700 1 --2- 172.21.15.76:0/3788081806 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4460068950 0x7f4460197360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:08.536 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:08.535+0000 7f4465fa9700 1 --2- 172.21.15.76:0/3788081806 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f444c0a11b0 0x7f444c0a3670 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:08.536 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:08.535+0000 7f4465fa9700 1 --2- 172.21.15.76:0/3788081806 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f44600692f0 0x7f44601978a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:08.536 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:08.535+0000 7f4465fa9700 1 -- 172.21.15.76:0/3788081806 >> 172.21.15.76:0/3788081806 conn(0x7f4460075f80 msgr2=0x7f44600fee70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:08.536 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:08.535+0000 7f4465fa9700 1 -- 172.21.15.76:0/3788081806 shutdown_connections 2024-06-02T04:49:08.536 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:08.535+0000 7f4465fa9700 1 -- 172.21.15.76:0/3788081806 wait complete. 2024-06-02T04:49:08.916 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-06-02T04:49:08.916 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-02T04:49:09.043 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.043+0000 7fae03ec7700 1 -- 172.21.15.76:0/535139112 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fadfc101900 msgr2=0x7fadfc1081b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:09.043 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.043+0000 7fae03ec7700 1 --2- 172.21.15.76:0/535139112 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fadfc101900 0x7fadfc1081b0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fadf400b1d0 tx=0x7fadf400b4e0 comp rx=0 tx=0).stop 2024-06-02T04:49:09.043 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.043+0000 7fae03ec7700 1 -- 172.21.15.76:0/535139112 shutdown_connections 2024-06-02T04:49:09.044 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.043+0000 7fae03ec7700 1 --2- 172.21.15.76:0/535139112 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fadfc101900 0x7fadfc1081b0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:09.044 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.043+0000 7fae03ec7700 1 --2- 172.21.15.76:0/535139112 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fadfc0ffd70 0x7fadfc100190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:09.044 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.043+0000 7fae03ec7700 1 --2- 172.21.15.76:0/535139112 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fadfc100f60 0x7fadfc1013c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:09.044 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.043+0000 7fae03ec7700 1 -- 172.21.15.76:0/535139112 >> 172.21.15.76:0/535139112 conn(0x7fadfc0fb2e0 msgr2=0x7fadfc0fd720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:09.044 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.043+0000 7fae03ec7700 1 -- 172.21.15.76:0/535139112 shutdown_connections 2024-06-02T04:49:09.044 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.043+0000 7fae03ec7700 1 -- 172.21.15.76:0/535139112 wait complete. 2024-06-02T04:49:09.046 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.044+0000 7fae03ec7700 1 Processor -- start 2024-06-02T04:49:09.046 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.044+0000 7fae03ec7700 1 -- start start 2024-06-02T04:49:09.046 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.044+0000 7fae03ec7700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fadfc0ffd70 0x7fadfc194a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:09.046 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.044+0000 7fae03ec7700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fadfc100f60 0x7fadfc194f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:09.046 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.044+0000 7fae03ec7700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fadfc101900 0x7fadfc19bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:09.046 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.044+0000 7fae03ec7700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadfc19c580 con 0x7fadfc101900 2024-06-02T04:49:09.046 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.044+0000 7fae03ec7700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadfc19c6c0 con 0x7fadfc0ffd70 2024-06-02T04:49:09.047 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.044+0000 7fae03ec7700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadfc19c850 con 0x7fadfc100f60 2024-06-02T04:49:09.047 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.044+0000 7fae02464700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fadfc101900 0x7fadfc19bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:09.047 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.044+0000 7fae02464700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fadfc101900 0x7fadfc19bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:54220/0 (socket says 172.21.15.76:54220) 2024-06-02T04:49:09.047 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.044+0000 7fae02464700 1 -- 172.21.15.76:0/1258147858 learned_addr learned my addr 172.21.15.76:0/1258147858 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:49:09.047 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.044+0000 7fae01c63700 1 --2- 172.21.15.76:0/1258147858 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fadfc0ffd70 0x7fadfc194a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:09.047 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.044+0000 7fae01462700 1 --2- 172.21.15.76:0/1258147858 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fadfc100f60 0x7fadfc194f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:09.047 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.044+0000 7fae02464700 1 -- 172.21.15.76:0/1258147858 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fadfc100f60 msgr2=0x7fadfc194f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:09.047 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.044+0000 7fae02464700 1 --2- 172.21.15.76:0/1258147858 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fadfc100f60 0x7fadfc194f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:09.047 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.044+0000 7fae02464700 1 -- 172.21.15.76:0/1258147858 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fadfc0ffd70 msgr2=0x7fadfc194a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:09.047 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.044+0000 7fae02464700 1 --2- 172.21.15.76:0/1258147858 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fadfc0ffd70 0x7fadfc194a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:09.047 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.044+0000 7fae02464700 1 -- 172.21.15.76:0/1258147858 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadf4009d00 con 0x7fadfc101900 2024-06-02T04:49:09.047 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.045+0000 7fae02464700 1 --2- 172.21.15.76:0/1258147858 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fadfc101900 0x7fadfc19bfb0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fadf4009300 tx=0x7fadf4009330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:09.048 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.045+0000 7fadf2ffd700 1 -- 172.21.15.76:0/1258147858 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf401e070 con 0x7fadfc101900 2024-06-02T04:49:09.048 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.045+0000 7fae03ec7700 1 -- 172.21.15.76:0/1258147858 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadfc19cad0 con 0x7fadfc101900 2024-06-02T04:49:09.048 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.045+0000 7fadf2ffd700 1 -- 172.21.15.76:0/1258147858 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fadf4007c90 con 0x7fadfc101900 2024-06-02T04:49:09.048 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.045+0000 7fadf2ffd700 1 -- 172.21.15.76:0/1258147858 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf4023470 con 0x7fadfc101900 2024-06-02T04:49:09.048 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.045+0000 7fae03ec7700 1 -- 172.21.15.76:0/1258147858 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadfc19cfa0 con 0x7fadfc101900 2024-06-02T04:49:09.048 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.046+0000 7fae03ec7700 1 -- 172.21.15.76:0/1258147858 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadfc107120 con 0x7fadfc101900 2024-06-02T04:49:09.049 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.047+0000 7fadf2ffd700 1 -- 172.21.15.76:0/1258147858 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fadf40235d0 con 0x7fadfc101900 2024-06-02T04:49:09.049 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.047+0000 7fadf2ffd700 1 --2- 172.21.15.76:0/1258147858 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fade80a11b0 0x7fade80a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:09.049 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.047+0000 7fadf2ffd700 1 -- 172.21.15.76:0/1258147858 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fadf40d0070 con 0x7fadfc101900 2024-06-02T04:49:09.049 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.047+0000 7fae01c63700 1 --2- 172.21.15.76:0/1258147858 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fade80a11b0 0x7fade80a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:09.049 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.048+0000 7fae01c63700 1 --2- 172.21.15.76:0/1258147858 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fade80a11b0 0x7fade80a3670 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fadfc100dc0 tx=0x7fadf800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:09.052 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.052+0000 7fadf2ffd700 1 -- 172.21.15.76:0/1258147858 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fadf4099420 con 0x7fadfc101900 2024-06-02T04:49:09.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:08 smithi192 ceph-mon[47933]: osdmap e82: 12 total, 12 up, 12 in 2024-06-02T04:49:09.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:08 smithi192 ceph-mon[47933]: pgmap v253: 129 pgs: 2 peering, 127 active+clean; 639 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-06-02T04:49:09.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:08 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/3788081806' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-06-02T04:49:09.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:08 smithi076 ceph-mon[42935]: osdmap e82: 12 total, 12 up, 12 in 2024-06-02T04:49:09.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:08 smithi076 ceph-mon[42935]: pgmap v253: 129 pgs: 2 peering, 127 active+clean; 639 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-06-02T04:49:09.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:08 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/3788081806' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-06-02T04:49:09.253 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.253+0000 7fae03ec7700 1 -- 172.21.15.76:0/1258147858 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fadfc10a3a0 con 0x7fadfc101900 2024-06-02T04:49:09.255 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.254+0000 7fadf2ffd700 1 -- 172.21.15.76:0/1258147858 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+24453 (secure 0 0 0) 0x7fadf409ca40 con 0x7fadfc101900 2024-06-02T04:49:09.255 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:49:09.255 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":82,"fsid":"60ab6d30-209a-11ef-bc9b-c7b262605968","created":"2024-06-02T04:42:21.007333+0000","modified":"2024-06-02T04:49:07.862801+0000","last_up_change":"2024-06-02T04:47:29.822242+0000","last_in_change":"2024-06-02T04:47:14.253449+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T04:44:56.408602+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-02T04:48:01.194954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-02T04:48:01.828863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-02T04:48:04.916565+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"33a51ba2-be5c-41d0-b5d1-8d6039f2ca4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6802","nonce":2869602045},{"type":"v1","addr":"172.21.15.76:6803","nonce":2869602045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6804","nonce":2869602045},{"type":"v1","addr":"172.21.15.76:6805","nonce":2869602045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6808","nonce":2869602045},{"type":"v1","addr":"172.21.15.76:6809","nonce":2869602045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6806","nonce":2869602045},{"type":"v1","addr":"172.21.15.76:6807","nonce":2869602045}]},"public_addr":"172.21.15.76:6803/2869602045","cluster_addr":"172.21.15.76:6805/2869602045","heartbeat_back_addr":"172.21.15.76:6809/2869602045","heartbeat_front_addr":"172.21.15.76:6807/2869602045","state":["exists","up"]},{"osd":1,"uuid":"ace46e13-3bb7-4103-973a-6860554df8b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":2353738098},{"type":"v1","addr":"172.21.15.119:6801","nonce":2353738098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":2353738098},{"type":"v1","addr":"172.21.15.119:6803","nonce":2353738098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":2353738098},{"type":"v1","addr":"172.21.15.119:6807","nonce":2353738098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":2353738098},{"type":"v1","addr":"172.21.15.119:6805","nonce":2353738098}]},"public_addr":"172.21.15.119:6801/2353738098","cluster_addr":"172.21.15.119:6803/2353738098","heartbeat_back_addr":"172.21.15.119:6807/2353738098","heartbeat_front_addr":"172.21.15.119:6805/2353738098","state":["exists","up"]},{"osd":2,"uuid":"4addc09e-77a9-428a-bcc4-38194f486cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":3206918546},{"type":"v1","addr":"172.21.15.192:6801","nonce":3206918546}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":3206918546},{"type":"v1","addr":"172.21.15.192:6803","nonce":3206918546}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":3206918546},{"type":"v1","addr":"172.21.15.192:6807","nonce":3206918546}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":3206918546},{"type":"v1","addr":"172.21.15.192:6805","nonce":3206918546}]},"public_addr":"172.21.15.192:6801/3206918546","cluster_addr":"172.21.15.192:6803/3206918546","heartbeat_back_addr":"172.21.15.192:6807/3206918546","heartbeat_front_addr":"172.21.15.192:6805/3206918546","state":["exists","up"]},{"osd":3,"uuid":"dc525518-82c6-49ed-8ca8-e3bd5bfc18d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6810","nonce":3747864233},{"type":"v1","addr":"172.21.15.76:6811","nonce":3747864233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6812","nonce":3747864233},{"type":"v1","addr":"172.21.15.76:6813","nonce":3747864233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6816","nonce":3747864233},{"type":"v1","addr":"172.21.15.76:6817","nonce":3747864233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6814","nonce":3747864233},{"type":"v1","addr":"172.21.15.76:6815","nonce":3747864233}]},"public_addr":"172.21.15.76:6811/3747864233","cluster_addr":"172.21.15.76:6813/3747864233","heartbeat_back_addr":"172.21.15.76:6817/3747864233","heartbeat_front_addr":"172.21.15.76:6815/3747864233","state":["exists","up"]},{"osd":4,"uuid":"eef293d0-cb87-47b3-9751-c6437a1cf079","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":2571629047},{"type":"v1","addr":"172.21.15.119:6809","nonce":2571629047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":2571629047},{"type":"v1","addr":"172.21.15.119:6811","nonce":2571629047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":2571629047},{"type":"v1","addr":"172.21.15.119:6815","nonce":2571629047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":2571629047},{"type":"v1","addr":"172.21.15.119:6813","nonce":2571629047}]},"public_addr":"172.21.15.119:6809/2571629047","cluster_addr":"172.21.15.119:6811/2571629047","heartbeat_back_addr":"172.21.15.119:6815/2571629047","heartbeat_front_addr":"172.21.15.119:6813/2571629047","state":["exists","up"]},{"osd":5,"uuid":"60eb8c6e-766c-49d0-9997-44f85776b3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3285065416},{"type":"v1","addr":"172.21.15.192:6809","nonce":3285065416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":3285065416},{"type":"v1","addr":"172.21.15.192:6811","nonce":3285065416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3285065416},{"type":"v1","addr":"172.21.15.192:6815","nonce":3285065416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":3285065416},{"type":"v1","addr":"172.21.15.192:6813","nonce":3285065416}]},"public_addr":"172.21.15.192:6809/3285065416","cluster_addr":"172.21.15.192:6811/3285065416","heartbeat_back_addr":"172.21.15.192:6815/3285065416","heartbeat_front_addr":"172.21.15.192:6813/3285065416","state":["exists","up"]},{"osd":6,"uuid":"e6dc8b9d-dd06-4870-a506-def8201b7e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6818","nonce":2951381580},{"type":"v1","addr":"172.21.15.76:6819","nonce":2951381580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6820","nonce":2951381580},{"type":"v1","addr":"172.21.15.76:6821","nonce":2951381580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6824","nonce":2951381580},{"type":"v1","addr":"172.21.15.76:6825","nonce":2951381580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6822","nonce":2951381580},{"type":"v1","addr":"172.21.15.76:6823","nonce":2951381580}]},"public_addr":"172.21.15.76:6819/2951381580","cluster_addr":"172.21.15.76:6821/2951381580","heartbeat_back_addr":"172.21.15.76:6825/2951381580","heartbeat_front_addr":"172.21.15.76:6823/2951381580","state":["exists","up"]},{"osd":7,"uuid":"2f5dccb3-39a1-4f25-8715-fa264d59db97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1802558756},{"type":"v1","addr":"172.21.15.119:6817","nonce":1802558756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1802558756},{"type":"v1","addr":"172.21.15.119:6819","nonce":1802558756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1802558756},{"type":"v1","addr":"172.21.15.119:6823","nonce":1802558756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1802558756},{"type":"v1","addr":"172.21.15.119:6821","nonce":1802558756}]},"public_addr":"172.21.15.119:6817/1802558756","cluster_addr":"172.21.15.119:6819/1802558756","heartbeat_back_addr":"172.21.15.119:6823/1802558756","heartbeat_front_addr":"172.21.15.119:6821/1802558756","state":["exists","up"]},{"osd":8,"uuid":"39b6ccd0-16e7-4cd5-87e0-d827e9172984","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":1214972276},{"type":"v1","addr":"172.21.15.192:6817","nonce":1214972276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":1214972276},{"type":"v1","addr":"172.21.15.192:6819","nonce":1214972276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":1214972276},{"type":"v1","addr":"172.21.15.192:6823","nonce":1214972276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":1214972276},{"type":"v1","addr":"172.21.15.192:6821","nonce":1214972276}]},"public_addr":"172.21.15.192:6817/1214972276","cluster_addr":"172.21.15.192:6819/1214972276","heartbeat_back_addr":"172.21.15.192:6823/1214972276","heartbeat_front_addr":"172.21.15.192:6821/1214972276","state":["exists","up"]},{"osd":9,"uuid":"851b2155-07bd-45de-bfe0-53021fda733f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6826","nonce":3095501821},{"type":"v1","addr":"172.21.15.76:6827","nonce":3095501821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6828","nonce":3095501821},{"type":"v1","addr":"172.21.15.76:6829","nonce":3095501821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":3095501821},{"type":"v1","addr":"172.21.15.76:6833","nonce":3095501821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6830","nonce":3095501821},{"type":"v1","addr":"172.21.15.76:6831","nonce":3095501821}]},"public_addr":"172.21.15.76:6827/3095501821","cluster_addr":"172.21.15.76:6829/3095501821","heartbeat_back_addr":"172.21.15.76:6833/3095501821","heartbeat_front_addr":"172.21.15.76:6831/3095501821","state":["exists","up"]},{"osd":10,"uuid":"e4b18e7e-bddf-4dd4-84f6-7902ea327cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":4082130894},{"type":"v1","addr":"172.21.15.119:6825","nonce":4082130894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":4082130894},{"type":"v1","addr":"172.21.15.119:6827","nonce":4082130894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":4082130894},{"type":"v1","addr":"172.21.15.119:6831","nonce":4082130894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":4082130894},{"type":"v1","addr":"172.21.15.119:6829","nonce":4082130894}]},"public_addr":"172.21.15.119:6825/4082130894","cluster_addr":"172.21.15.119:6827/4082130894","heartbeat_back_addr":"172.21.15.119:6831/4082130894","heartbeat_front_addr":"172.21.15.119:6829/4082130894","state":["exists","up"]},{"osd":11,"uuid":"54567e18-920c-4ae9-9557-0efba5a1a820","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":439693921},{"type":"v1","addr":"172.21.15.192:6825","nonce":439693921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":439693921},{"type":"v1","addr":"172.21.15.192:6827","nonce":439693921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":439693921},{"type":"v1","addr":"172.21.15.192:6831","nonce":439693921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":439693921},{"type":"v1","addr":"172.21.15.192:6829","nonce":439693921}]},"public_addr":"172.21.15.192:6825/439693921","cluster_addr":"172.21.15.192:6827/439693921","heartbeat_back_addr":"172.21.15.192:6831/439693921","heartbeat_front_addr":"172.21.15.192:6829/439693921","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:44:19.922390+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:44:36.895563+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:44:53.699019+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:45:11.167404+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:45:27.955899+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:45:44.850368+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:46:02.003588+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:46:19.019217+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:46:36.189670+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:46:53.919365+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:47:11.563053+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:47:28.822443+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":4}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.8","mappings":[{"from":5,"to":10}]},{"pgid":"4.14","mappings":[{"from":9,"to":8}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.76:6801/4200406736":"2024-06-03T04:43:06.092916+0000","172.21.15.76:6800/4200406736":"2024-06-03T04:43:06.092916+0000","172.21.15.76:0/1524144593":"2024-06-03T04:43:06.092916+0000","172.21.15.76:0/3269372590":"2024-06-03T04:43:06.092916+0000","172.21.15.76:0/3570893846":"2024-06-03T04:42:44.872236+0000","172.21.15.76:0/902035790":"2024-06-03T04:43:06.092916+0000","172.21.15.76:6800/2550846765":"2024-06-03T04:42:44.872236+0000","172.21.15.76:6801/2550846765":"2024-06-03T04:42:44.872236+0000","172.21.15.76:0/2646712763":"2024-06-03T04:42:44.872236+0000","172.21.15.76:0/964578813":"2024-06-03T04:42:44.872236+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T04:49:09.257 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.256+0000 7fae03ec7700 1 -- 172.21.15.76:0/1258147858 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fade80a11b0 msgr2=0x7fade80a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:09.257 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.256+0000 7fae03ec7700 1 --2- 172.21.15.76:0/1258147858 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fade80a11b0 0x7fade80a3670 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fadfc100dc0 tx=0x7fadf800b410 comp rx=0 tx=0).stop 2024-06-02T04:49:09.257 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.256+0000 7fae03ec7700 1 -- 172.21.15.76:0/1258147858 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fadfc101900 msgr2=0x7fadfc19bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:09.257 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.256+0000 7fae03ec7700 1 --2- 172.21.15.76:0/1258147858 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fadfc101900 0x7fadfc19bfb0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fadf4009300 tx=0x7fadf4009330 comp rx=0 tx=0).stop 2024-06-02T04:49:09.257 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.256+0000 7fae03ec7700 1 -- 172.21.15.76:0/1258147858 shutdown_connections 2024-06-02T04:49:09.257 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.256+0000 7fae03ec7700 1 --2- 172.21.15.76:0/1258147858 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fadfc101900 0x7fadfc19bfb0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:09.257 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.256+0000 7fae03ec7700 1 --2- 172.21.15.76:0/1258147858 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fade80a11b0 0x7fade80a3670 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:09.258 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.256+0000 7fae03ec7700 1 --2- 172.21.15.76:0/1258147858 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fadfc0ffd70 0x7fadfc194a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:09.258 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.256+0000 7fae03ec7700 1 --2- 172.21.15.76:0/1258147858 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fadfc100f60 0x7fadfc194f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:09.258 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.256+0000 7fae03ec7700 1 -- 172.21.15.76:0/1258147858 >> 172.21.15.76:0/1258147858 conn(0x7fadfc0fb2e0 msgr2=0x7fadfc104260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:09.258 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.256+0000 7fae03ec7700 1 -- 172.21.15.76:0/1258147858 shutdown_connections 2024-06-02T04:49:09.258 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.257+0000 7fae03ec7700 1 -- 172.21.15.76:0/1258147858 wait complete. 2024-06-02T04:49:09.269 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-06-02T04:44:56.408602+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-06-02T04:48:01.194954+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-06-02T04:48:01.828863+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '76', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-06-02T04:48:04.916565+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-06-02T04:49:09.270 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-06-02T04:49:09.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:08 smithi119 ceph-mon[46633]: osdmap e82: 12 total, 12 up, 12 in 2024-06-02T04:49:09.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:08 smithi119 ceph-mon[46633]: pgmap v253: 129 pgs: 2 peering, 127 active+clean; 639 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-06-02T04:49:09.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:08 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/3788081806' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-06-02T04:49:09.396 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.395+0000 7f3b108e7700 1 -- 172.21.15.76:0/1613744582 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3b0c1007d0 msgr2=0x7f3b0c100c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:09.396 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.395+0000 7f3b108e7700 1 --2- 172.21.15.76:0/1613744582 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3b0c1007d0 0x7f3b0c100c30 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f3b000099c0 tx=0x7f3b00009cd0 comp rx=0 tx=0).stop 2024-06-02T04:49:09.396 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.396+0000 7f3b108e7700 1 -- 172.21.15.76:0/1613744582 shutdown_connections 2024-06-02T04:49:09.396 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.396+0000 7f3b108e7700 1 --2- 172.21.15.76:0/1613744582 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3b0c101170 0x7f3b0c107a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:09.396 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.396+0000 7f3b108e7700 1 --2- 172.21.15.76:0/1613744582 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3b0c0ff5e0 0x7f3b0c0ffa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:09.396 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.396+0000 7f3b108e7700 1 --2- 172.21.15.76:0/1613744582 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3b0c1007d0 0x7f3b0c100c30 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:09.396 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.396+0000 7f3b108e7700 1 -- 172.21.15.76:0/1613744582 >> 172.21.15.76:0/1613744582 conn(0x7f3b0c0fab50 msgr2=0x7f3b0c0fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:09.397 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.396+0000 7f3b108e7700 1 -- 172.21.15.76:0/1613744582 shutdown_connections 2024-06-02T04:49:09.397 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.396+0000 7f3b108e7700 1 -- 172.21.15.76:0/1613744582 wait complete. 2024-06-02T04:49:09.399 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.396+0000 7f3b108e7700 1 Processor -- start 2024-06-02T04:49:09.401 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.396+0000 7f3b108e7700 1 -- start start 2024-06-02T04:49:09.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.396+0000 7f3b108e7700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3b0c0ff5e0 0x7f3b0c195e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:09.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.396+0000 7f3b108e7700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3b0c1007d0 0x7f3b0c196360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:09.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.397+0000 7f3b108e7700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3b0c101170 0x7f3b0c19d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:09.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.397+0000 7f3b108e7700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0c19d950 con 0x7f3b0c0ff5e0 2024-06-02T04:49:09.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.397+0000 7f3b108e7700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0c19da90 con 0x7f3b0c101170 2024-06-02T04:49:09.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.397+0000 7f3b108e7700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0c19dc20 con 0x7f3b0c1007d0 2024-06-02T04:49:09.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.397+0000 7f3b0a59c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3b0c0ff5e0 0x7f3b0c195e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:09.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.397+0000 7f3b0a59c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3b0c0ff5e0 0x7f3b0c195e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:54240/0 (socket says 172.21.15.76:54240) 2024-06-02T04:49:09.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.397+0000 7f3b0a59c700 1 -- 172.21.15.76:0/3249837275 learned_addr learned my addr 172.21.15.76:0/3249837275 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:49:09.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.397+0000 7f3b0ad9d700 1 --2- 172.21.15.76:0/3249837275 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3b0c101170 0x7f3b0c19d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:09.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.397+0000 7f3b09d9b700 1 --2- 172.21.15.76:0/3249837275 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3b0c1007d0 0x7f3b0c196360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:09.403 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.397+0000 7f3b0a59c700 1 -- 172.21.15.76:0/3249837275 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3b0c1007d0 msgr2=0x7f3b0c196360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:09.403 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.397+0000 7f3b0a59c700 1 --2- 172.21.15.76:0/3249837275 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3b0c1007d0 0x7f3b0c196360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:09.403 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.397+0000 7f3b0a59c700 1 -- 172.21.15.76:0/3249837275 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3b0c101170 msgr2=0x7f3b0c19d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:09.403 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.397+0000 7f3b0a59c700 1 --2- 172.21.15.76:0/3249837275 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3b0c101170 0x7f3b0c19d380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:09.403 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.397+0000 7f3b0a59c700 1 -- 172.21.15.76:0/3249837275 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b000095f0 con 0x7f3b0c0ff5e0 2024-06-02T04:49:09.403 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.397+0000 7f3b0ad9d700 1 --2- 172.21.15.76:0/3249837275 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3b0c101170 0x7f3b0c19d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:49:09.403 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.397+0000 7f3b0a59c700 1 --2- 172.21.15.76:0/3249837275 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3b0c0ff5e0 0x7f3b0c195e20 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f3afc00b500 tx=0x7f3afc00b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:09.403 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.397+0000 7f3afb7fe700 1 -- 172.21.15.76:0/3249837275 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3afc011830 con 0x7f3b0c0ff5e0 2024-06-02T04:49:09.403 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.397+0000 7f3afb7fe700 1 -- 172.21.15.76:0/3249837275 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3afc011e20 con 0x7f3b0c0ff5e0 2024-06-02T04:49:09.403 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.397+0000 7f3b108e7700 1 -- 172.21.15.76:0/3249837275 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b0c19df00 con 0x7f3b0c0ff5e0 2024-06-02T04:49:09.403 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.397+0000 7f3afb7fe700 1 -- 172.21.15.76:0/3249837275 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3afc010dd0 con 0x7f3b0c0ff5e0 2024-06-02T04:49:09.403 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.397+0000 7f3b108e7700 1 -- 172.21.15.76:0/3249837275 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b0c19e330 con 0x7f3b0c0ff5e0 2024-06-02T04:49:09.403 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.398+0000 7f3b108e7700 1 -- 172.21.15.76:0/3249837275 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b0c106b00 con 0x7f3b0c0ff5e0 2024-06-02T04:49:09.404 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.400+0000 7f3afb7fe700 1 -- 172.21.15.76:0/3249837275 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f3afc011990 con 0x7f3b0c0ff5e0 2024-06-02T04:49:09.404 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.400+0000 7f3afb7fe700 1 --2- 172.21.15.76:0/3249837275 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f3af40a1230 0x7f3af40a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:09.404 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.400+0000 7f3b09d9b700 1 --2- 172.21.15.76:0/3249837275 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f3af40a1230 0x7f3af40a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:09.404 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.401+0000 7f3afb7fe700 1 -- 172.21.15.76:0/3249837275 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f3afc0ccb10 con 0x7f3b0c0ff5e0 2024-06-02T04:49:09.404 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.401+0000 7f3b09d9b700 1 --2- 172.21.15.76:0/3249837275 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f3af40a1230 0x7f3af40a36f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f3b00003780 tx=0x7f3b00005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:09.405 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.404+0000 7f3afb7fe700 1 -- 172.21.15.76:0/3249837275 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f3afc095f40 con 0x7f3b0c0ff5e0 2024-06-02T04:49:09.601 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.601+0000 7f3b108e7700 1 -- 172.21.15.76:0/3249837275 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3b0c10b640 con 0x7f3b0c0ff5e0 2024-06-02T04:49:09.602 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.601+0000 7f3afb7fe700 1 -- 172.21.15.76:0/3249837275 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3afc0150a0 con 0x7f3b0c0ff5e0 2024-06-02T04:49:09.602 INFO:teuthology.orchestra.run.smithi076.stdout:pg_num: 1 2024-06-02T04:49:09.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.604+0000 7f3b108e7700 1 -- 172.21.15.76:0/3249837275 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f3af40a1230 msgr2=0x7f3af40a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:09.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.604+0000 7f3b108e7700 1 --2- 172.21.15.76:0/3249837275 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f3af40a1230 0x7f3af40a36f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f3b00003780 tx=0x7f3b00005fb0 comp rx=0 tx=0).stop 2024-06-02T04:49:09.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.604+0000 7f3b108e7700 1 -- 172.21.15.76:0/3249837275 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3b0c0ff5e0 msgr2=0x7f3b0c195e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:09.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.604+0000 7f3b108e7700 1 --2- 172.21.15.76:0/3249837275 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3b0c0ff5e0 0x7f3b0c195e20 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f3afc00b500 tx=0x7f3afc00b8c0 comp rx=0 tx=0).stop 2024-06-02T04:49:09.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.604+0000 7f3b108e7700 1 -- 172.21.15.76:0/3249837275 shutdown_connections 2024-06-02T04:49:09.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.604+0000 7f3b108e7700 1 --2- 172.21.15.76:0/3249837275 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f3af40a1230 0x7f3af40a36f0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:09.607 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.604+0000 7f3b108e7700 1 --2- 172.21.15.76:0/3249837275 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3b0c101170 0x7f3b0c19d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:09.607 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.604+0000 7f3b108e7700 1 --2- 172.21.15.76:0/3249837275 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3b0c0ff5e0 0x7f3b0c195e20 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:09.607 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.604+0000 7f3b108e7700 1 --2- 172.21.15.76:0/3249837275 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3b0c1007d0 0x7f3b0c196360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:09.607 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.604+0000 7f3b108e7700 1 -- 172.21.15.76:0/3249837275 >> 172.21.15.76:0/3249837275 conn(0x7f3b0c0fab50 msgr2=0x7f3b0c103c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:09.607 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.604+0000 7f3b108e7700 1 -- 172.21.15.76:0/3249837275 shutdown_connections 2024-06-02T04:49:09.607 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.604+0000 7f3b108e7700 1 -- 172.21.15.76:0/3249837275 wait complete. 2024-06-02T04:49:09.617 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-06-02T04:49:09.744 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.742+0000 7fdb330e9700 1 -- 172.21.15.76:0/1676483190 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdb2c104370 msgr2=0x7fdb2c106760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:09.745 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.742+0000 7fdb330e9700 1 --2- 172.21.15.76:0/1676483190 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdb2c104370 0x7fdb2c106760 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fdb18009990 tx=0x7fdb18009ca0 comp rx=0 tx=0).stop 2024-06-02T04:49:09.745 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.742+0000 7fdb330e9700 1 -- 172.21.15.76:0/1676483190 shutdown_connections 2024-06-02T04:49:09.745 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.742+0000 7fdb330e9700 1 --2- 172.21.15.76:0/1676483190 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdb2c106ca0 0x7fdb2c1090b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:09.745 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.742+0000 7fdb330e9700 1 --2- 172.21.15.76:0/1676483190 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb2c101a40 0x7fdb2c103e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:09.745 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.742+0000 7fdb330e9700 1 --2- 172.21.15.76:0/1676483190 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdb2c104370 0x7fdb2c106760 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:09.745 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.742+0000 7fdb330e9700 1 -- 172.21.15.76:0/1676483190 >> 172.21.15.76:0/1676483190 conn(0x7fdb2c0fb3f0 msgr2=0x7fdb2c0fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:09.745 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.742+0000 7fdb330e9700 1 -- 172.21.15.76:0/1676483190 shutdown_connections 2024-06-02T04:49:09.745 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.742+0000 7fdb330e9700 1 -- 172.21.15.76:0/1676483190 wait complete. 2024-06-02T04:49:09.745 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.743+0000 7fdb330e9700 1 Processor -- start 2024-06-02T04:49:09.745 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.743+0000 7fdb330e9700 1 -- start start 2024-06-02T04:49:09.745 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.743+0000 7fdb330e9700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdb2c101a40 0x7fdb2c196e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:09.745 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.743+0000 7fdb330e9700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdb2c104370 0x7fdb2c197350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:09.745 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.743+0000 7fdb330e9700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb2c106ca0 0x7fdb2c19e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:09.746 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.743+0000 7fdb330e9700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb2c19e940 con 0x7fdb2c104370 2024-06-02T04:49:09.746 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.743+0000 7fdb330e9700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb2c19ea80 con 0x7fdb2c106ca0 2024-06-02T04:49:09.746 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.743+0000 7fdb330e9700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb2c19ec10 con 0x7fdb2c101a40 2024-06-02T04:49:09.746 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.743+0000 7fdb2bfff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdb2c104370 0x7fdb2c197350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:09.746 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.743+0000 7fdb2bfff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdb2c104370 0x7fdb2c197350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:54258/0 (socket says 172.21.15.76:54258) 2024-06-02T04:49:09.746 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.743+0000 7fdb2bfff700 1 -- 172.21.15.76:0/2912057839 learned_addr learned my addr 172.21.15.76:0/2912057839 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:49:09.746 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.743+0000 7fdb30e85700 1 --2- 172.21.15.76:0/2912057839 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdb2c101a40 0x7fdb2c196e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:09.746 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.743+0000 7fdb31686700 1 --2- 172.21.15.76:0/2912057839 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb2c106ca0 0x7fdb2c19e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:09.746 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.743+0000 7fdb2bfff700 1 -- 172.21.15.76:0/2912057839 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdb2c101a40 msgr2=0x7fdb2c196e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:09.746 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.743+0000 7fdb2bfff700 1 --2- 172.21.15.76:0/2912057839 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdb2c101a40 0x7fdb2c196e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:09.746 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.743+0000 7fdb2bfff700 1 -- 172.21.15.76:0/2912057839 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb2c106ca0 msgr2=0x7fdb2c19e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:09.746 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.743+0000 7fdb2bfff700 1 --2- 172.21.15.76:0/2912057839 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb2c106ca0 0x7fdb2c19e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:09.747 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.743+0000 7fdb2bfff700 1 -- 172.21.15.76:0/2912057839 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb180095f0 con 0x7fdb2c104370 2024-06-02T04:49:09.747 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.743+0000 7fdb31686700 1 --2- 172.21.15.76:0/2912057839 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb2c106ca0 0x7fdb2c19e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:49:09.747 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.743+0000 7fdb2bfff700 1 --2- 172.21.15.76:0/2912057839 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdb2c104370 0x7fdb2c197350 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fdb18000c00 tx=0x7fdb18004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:09.747 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.744+0000 7fdb29ffb700 1 -- 172.21.15.76:0/2912057839 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb1801d070 con 0x7fdb2c104370 2024-06-02T04:49:09.747 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.744+0000 7fdb29ffb700 1 -- 172.21.15.76:0/2912057839 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdb18003f40 con 0x7fdb2c104370 2024-06-02T04:49:09.747 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.744+0000 7fdb330e9700 1 -- 172.21.15.76:0/2912057839 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb2c19ee90 con 0x7fdb2c104370 2024-06-02T04:49:09.747 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.744+0000 7fdb29ffb700 1 -- 172.21.15.76:0/2912057839 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb18022b70 con 0x7fdb2c104370 2024-06-02T04:49:09.747 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.744+0000 7fdb330e9700 1 -- 172.21.15.76:0/2912057839 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb2c19f250 con 0x7fdb2c104370 2024-06-02T04:49:09.748 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.745+0000 7fdb330e9700 1 -- 172.21.15.76:0/2912057839 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb2c0fcf70 con 0x7fdb2c104370 2024-06-02T04:49:09.748 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.746+0000 7fdb29ffb700 1 -- 172.21.15.76:0/2912057839 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fdb18003ab0 con 0x7fdb2c104370 2024-06-02T04:49:09.748 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.747+0000 7fdb29ffb700 1 --2- 172.21.15.76:0/2912057839 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fdb1c0a11b0 0x7fdb1c0a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:09.748 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.747+0000 7fdb30e85700 1 --2- 172.21.15.76:0/2912057839 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fdb1c0a11b0 0x7fdb1c0a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:09.748 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.747+0000 7fdb29ffb700 1 -- 172.21.15.76:0/2912057839 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fdb180ce7f0 con 0x7fdb2c104370 2024-06-02T04:49:09.748 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.747+0000 7fdb30e85700 1 --2- 172.21.15.76:0/2912057839 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fdb1c0a11b0 0x7fdb1c0a3670 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fdb20005950 tx=0x7fdb2000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:09.750 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.750+0000 7fdb29ffb700 1 -- 172.21.15.76:0/2912057839 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fdb18097ba0 con 0x7fdb2c104370 2024-06-02T04:49:09.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.947+0000 7fdb330e9700 1 -- 172.21.15.76:0/2912057839 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdb2c10c880 con 0x7fdb2c104370 2024-06-02T04:49:09.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.947+0000 7fdb29ffb700 1 -- 172.21.15.76:0/2912057839 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v82) v1 ==== 104+0+11 (secure 0 0 0) 0x7fdb1809b1c0 con 0x7fdb2c104370 2024-06-02T04:49:09.948 INFO:teuthology.orchestra.run.smithi076.stdout:pg_num: 32 2024-06-02T04:49:09.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.949+0000 7fdb330e9700 1 -- 172.21.15.76:0/2912057839 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fdb1c0a11b0 msgr2=0x7fdb1c0a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:09.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.949+0000 7fdb330e9700 1 --2- 172.21.15.76:0/2912057839 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fdb1c0a11b0 0x7fdb1c0a3670 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fdb20005950 tx=0x7fdb2000b410 comp rx=0 tx=0).stop 2024-06-02T04:49:09.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.949+0000 7fdb330e9700 1 -- 172.21.15.76:0/2912057839 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdb2c104370 msgr2=0x7fdb2c197350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:09.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.949+0000 7fdb330e9700 1 --2- 172.21.15.76:0/2912057839 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdb2c104370 0x7fdb2c197350 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fdb18000c00 tx=0x7fdb18004730 comp rx=0 tx=0).stop 2024-06-02T04:49:09.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.949+0000 7fdb330e9700 1 -- 172.21.15.76:0/2912057839 shutdown_connections 2024-06-02T04:49:09.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.949+0000 7fdb330e9700 1 --2- 172.21.15.76:0/2912057839 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fdb1c0a11b0 0x7fdb1c0a3670 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:09.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.949+0000 7fdb330e9700 1 --2- 172.21.15.76:0/2912057839 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb2c106ca0 0x7fdb2c19e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:09.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.949+0000 7fdb330e9700 1 --2- 172.21.15.76:0/2912057839 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdb2c101a40 0x7fdb2c196e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:09.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.949+0000 7fdb330e9700 1 --2- 172.21.15.76:0/2912057839 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdb2c104370 0x7fdb2c197350 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:09.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.949+0000 7fdb330e9700 1 -- 172.21.15.76:0/2912057839 >> 172.21.15.76:0/2912057839 conn(0x7fdb2c0fb3f0 msgr2=0x7fdb2c103930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:09.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.949+0000 7fdb330e9700 1 -- 172.21.15.76:0/2912057839 shutdown_connections 2024-06-02T04:49:09.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:09.949+0000 7fdb330e9700 1 -- 172.21.15.76:0/2912057839 wait complete. 2024-06-02T04:49:09.962 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-06-02T04:49:10.089 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.087+0000 7f28ce79e700 1 -- 172.21.15.76:0/1316285643 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f28c80fee30 msgr2=0x7f28c80ff290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:10.089 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.087+0000 7f28ce79e700 1 --2- 172.21.15.76:0/1316285643 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f28c80fee30 0x7f28c80ff290 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f28c4009990 tx=0x7f28c4009ca0 comp rx=0 tx=0).stop 2024-06-02T04:49:10.089 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.087+0000 7f28ce79e700 1 -- 172.21.15.76:0/1316285643 shutdown_connections 2024-06-02T04:49:10.089 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.087+0000 7f28ce79e700 1 --2- 172.21.15.76:0/1316285643 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28c80ff7d0 0x7f28c81093a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:10.089 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.087+0000 7f28ce79e700 1 --2- 172.21.15.76:0/1316285643 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f28c81023c0 0x7f28c81027e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:10.090 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.087+0000 7f28ce79e700 1 --2- 172.21.15.76:0/1316285643 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f28c80fee30 0x7f28c80ff290 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:10.090 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.087+0000 7f28ce79e700 1 -- 172.21.15.76:0/1316285643 >> 172.21.15.76:0/1316285643 conn(0x7f28c80fa9d0 msgr2=0x7f28c80fcdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:10.090 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.087+0000 7f28ce79e700 1 -- 172.21.15.76:0/1316285643 shutdown_connections 2024-06-02T04:49:10.090 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.087+0000 7f28ce79e700 1 -- 172.21.15.76:0/1316285643 wait complete. 2024-06-02T04:49:10.090 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.087+0000 7f28ce79e700 1 Processor -- start 2024-06-02T04:49:10.090 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.087+0000 7f28ce79e700 1 -- start start 2024-06-02T04:49:10.090 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.088+0000 7f28ce79e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f28c80fee30 0x7f28c8196ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:10.090 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.088+0000 7f28ce79e700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f28c80ff7d0 0x7f28c81971e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:10.090 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.088+0000 7f28ce79e700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28c81023c0 0x7f28c819e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:10.090 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.088+0000 7f28ce79e700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28c819e790 con 0x7f28c80ff7d0 2024-06-02T04:49:10.090 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.088+0000 7f28ce79e700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28c819e900 con 0x7f28c81023c0 2024-06-02T04:49:10.090 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.088+0000 7f28ce79e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28c819eac0 con 0x7f28c80fee30 2024-06-02T04:49:10.091 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.088+0000 7f28ccf9b700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f28c80ff7d0 0x7f28c81971e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:10.091 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.088+0000 7f28ccf9b700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f28c80ff7d0 0x7f28c81971e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:54272/0 (socket says 172.21.15.76:54272) 2024-06-02T04:49:10.091 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.088+0000 7f28ccf9b700 1 -- 172.21.15.76:0/1768792649 learned_addr learned my addr 172.21.15.76:0/1768792649 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:49:10.091 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.088+0000 7f28cd79c700 1 --2- 172.21.15.76:0/1768792649 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f28c80fee30 0x7f28c8196ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:10.091 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.088+0000 7f28cdf9d700 1 --2- 172.21.15.76:0/1768792649 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28c81023c0 0x7f28c819e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:10.091 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.088+0000 7f28ccf9b700 1 -- 172.21.15.76:0/1768792649 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f28c80fee30 msgr2=0x7f28c8196ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:10.091 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.088+0000 7f28ccf9b700 1 --2- 172.21.15.76:0/1768792649 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f28c80fee30 0x7f28c8196ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:10.091 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.088+0000 7f28ccf9b700 1 -- 172.21.15.76:0/1768792649 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28c81023c0 msgr2=0x7f28c819e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:10.091 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.088+0000 7f28ccf9b700 1 --2- 172.21.15.76:0/1768792649 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28c81023c0 0x7f28c819e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:10.091 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.088+0000 7f28ccf9b700 1 -- 172.21.15.76:0/1768792649 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28c40095f0 con 0x7f28c80ff7d0 2024-06-02T04:49:10.091 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.088+0000 7f28ccf9b700 1 --2- 172.21.15.76:0/1768792649 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f28c80ff7d0 0x7f28c81971e0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f28c40098e0 tx=0x7f28c4003a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:10.091 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.088+0000 7f28be7fc700 1 -- 172.21.15.76:0/1768792649 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c401d070 con 0x7f28c80ff7d0 2024-06-02T04:49:10.091 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.088+0000 7f28ce79e700 1 -- 172.21.15.76:0/1768792649 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28c819ed40 con 0x7f28c80ff7d0 2024-06-02T04:49:10.092 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.088+0000 7f28be7fc700 1 -- 172.21.15.76:0/1768792649 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f28c400bd90 con 0x7f28c80ff7d0 2024-06-02T04:49:10.092 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.088+0000 7f28be7fc700 1 -- 172.21.15.76:0/1768792649 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c4022c10 con 0x7f28c80ff7d0 2024-06-02T04:49:10.092 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.089+0000 7f28ce79e700 1 -- 172.21.15.76:0/1768792649 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28c819f1c0 con 0x7f28c80ff7d0 2024-06-02T04:49:10.093 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.089+0000 7f28ce79e700 1 -- 172.21.15.76:0/1768792649 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28c8108400 con 0x7f28c80ff7d0 2024-06-02T04:49:10.093 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.091+0000 7f28be7fc700 1 -- 172.21.15.76:0/1768792649 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f28c4022470 con 0x7f28c80ff7d0 2024-06-02T04:49:10.093 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.091+0000 7f28be7fc700 1 --2- 172.21.15.76:0/1768792649 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f28b40a11b0 0x7f28b40a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:10.093 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.091+0000 7f28cd79c700 1 --2- 172.21.15.76:0/1768792649 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f28b40a11b0 0x7f28b40a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:10.093 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.091+0000 7f28be7fc700 1 -- 172.21.15.76:0/1768792649 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f28c40ce9c0 con 0x7f28c80ff7d0 2024-06-02T04:49:10.093 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.092+0000 7f28cd79c700 1 --2- 172.21.15.76:0/1768792649 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f28b40a11b0 0x7f28b40a3670 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f28c8198120 tx=0x7f28b800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:10.095 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.095+0000 7f28be7fc700 1 -- 172.21.15.76:0/1768792649 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f28c4097d70 con 0x7f28c80ff7d0 2024-06-02T04:49:10.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:09 smithi192 ceph-mon[47933]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-06-02T04:49:10.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:09 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/1258147858' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:49:10.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:09 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/3249837275' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-02T04:49:10.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:09 smithi076 ceph-mon[42935]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-06-02T04:49:10.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:09 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/1258147858' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:49:10.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:09 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/3249837275' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-02T04:49:10.294 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.294+0000 7f28ce79e700 1 -- 172.21.15.76:0/1768792649 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f28c810c720 con 0x7f28c80ff7d0 2024-06-02T04:49:10.294 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.294+0000 7f28be7fc700 1 -- 172.21.15.76:0/1768792649 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v82) v1 ==== 100+0+11 (secure 0 0 0) 0x7f28c409b390 con 0x7f28c80ff7d0 2024-06-02T04:49:10.294 INFO:teuthology.orchestra.run.smithi076.stdout:pg_num: 64 2024-06-02T04:49:10.297 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.296+0000 7f28ce79e700 1 -- 172.21.15.76:0/1768792649 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f28b40a11b0 msgr2=0x7f28b40a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:10.297 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.296+0000 7f28ce79e700 1 --2- 172.21.15.76:0/1768792649 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f28b40a11b0 0x7f28b40a3670 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f28c8198120 tx=0x7f28b800b410 comp rx=0 tx=0).stop 2024-06-02T04:49:10.297 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.296+0000 7f28ce79e700 1 -- 172.21.15.76:0/1768792649 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f28c80ff7d0 msgr2=0x7f28c81971e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:10.297 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.296+0000 7f28ce79e700 1 --2- 172.21.15.76:0/1768792649 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f28c80ff7d0 0x7f28c81971e0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f28c40098e0 tx=0x7f28c4003a50 comp rx=0 tx=0).stop 2024-06-02T04:49:10.297 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.296+0000 7f28ce79e700 1 -- 172.21.15.76:0/1768792649 shutdown_connections 2024-06-02T04:49:10.297 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.296+0000 7f28ce79e700 1 --2- 172.21.15.76:0/1768792649 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f28b40a11b0 0x7f28b40a3670 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:10.297 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.296+0000 7f28ce79e700 1 --2- 172.21.15.76:0/1768792649 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28c81023c0 0x7f28c819e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:10.297 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.296+0000 7f28ce79e700 1 --2- 172.21.15.76:0/1768792649 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f28c80fee30 0x7f28c8196ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:10.297 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.296+0000 7f28ce79e700 1 --2- 172.21.15.76:0/1768792649 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f28c80ff7d0 0x7f28c81971e0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:10.297 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.296+0000 7f28ce79e700 1 -- 172.21.15.76:0/1768792649 >> 172.21.15.76:0/1768792649 conn(0x7f28c80fa9d0 msgr2=0x7f28c8105540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:10.297 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.296+0000 7f28ce79e700 1 -- 172.21.15.76:0/1768792649 shutdown_connections 2024-06-02T04:49:10.297 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.296+0000 7f28ce79e700 1 -- 172.21.15.76:0/1768792649 wait complete. 2024-06-02T04:49:10.309 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-06-02T04:49:10.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:09 smithi119 ceph-mon[46633]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-06-02T04:49:10.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:09 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/1258147858' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:49:10.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:09 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/3249837275' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-02T04:49:10.438 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.435+0000 7fdc876e8700 1 -- 172.21.15.76:0/70028687 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdc80101970 msgr2=0x7fdc80108290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:10.439 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.435+0000 7fdc876e8700 1 --2- 172.21.15.76:0/70028687 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdc80101970 0x7fdc80108290 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fdc7800b0a0 tx=0x7fdc7800b3b0 comp rx=0 tx=0).stop 2024-06-02T04:49:10.439 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.435+0000 7fdc876e8700 1 -- 172.21.15.76:0/70028687 shutdown_connections 2024-06-02T04:49:10.439 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.435+0000 7fdc876e8700 1 --2- 172.21.15.76:0/70028687 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdc80101970 0x7fdc80108290 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:10.439 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.435+0000 7fdc876e8700 1 --2- 172.21.15.76:0/70028687 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdc800ffe60 0x7fdc80100280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:10.439 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.435+0000 7fdc876e8700 1 --2- 172.21.15.76:0/70028687 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdc80100fb0 0x7fdc80101430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:10.439 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.435+0000 7fdc876e8700 1 -- 172.21.15.76:0/70028687 >> 172.21.15.76:0/70028687 conn(0x7fdc800fb3f0 msgr2=0x7fdc800fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:10.439 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.436+0000 7fdc876e8700 1 -- 172.21.15.76:0/70028687 shutdown_connections 2024-06-02T04:49:10.439 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.436+0000 7fdc876e8700 1 -- 172.21.15.76:0/70028687 wait complete. 2024-06-02T04:49:10.439 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.436+0000 7fdc876e8700 1 Processor -- start 2024-06-02T04:49:10.439 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.436+0000 7fdc876e8700 1 -- start start 2024-06-02T04:49:10.439 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.436+0000 7fdc876e8700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdc800ffe60 0x7fdc80068b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:10.439 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.436+0000 7fdc876e8700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdc80100fb0 0x7fdc8019bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:10.440 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.436+0000 7fdc876e8700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdc80101970 0x7fdc8019e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:10.440 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.436+0000 7fdc876e8700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc8019e9e0 con 0x7fdc80100fb0 2024-06-02T04:49:10.440 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.436+0000 7fdc876e8700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc8019eb50 con 0x7fdc80101970 2024-06-02T04:49:10.440 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.436+0000 7fdc876e8700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc8019ed10 con 0x7fdc800ffe60 2024-06-02T04:49:10.440 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.436+0000 7fdc84c83700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdc80100fb0 0x7fdc8019bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:10.440 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.436+0000 7fdc84c83700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdc80100fb0 0x7fdc8019bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:54286/0 (socket says 172.21.15.76:54286) 2024-06-02T04:49:10.440 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.436+0000 7fdc84c83700 1 -- 172.21.15.76:0/3833084611 learned_addr learned my addr 172.21.15.76:0/3833084611 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:49:10.440 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.436+0000 7fdc85484700 1 --2- 172.21.15.76:0/3833084611 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdc800ffe60 0x7fdc80068b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:10.440 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.437+0000 7fdc85c85700 1 --2- 172.21.15.76:0/3833084611 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdc80101970 0x7fdc8019e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:10.440 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.437+0000 7fdc84c83700 1 -- 172.21.15.76:0/3833084611 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdc800ffe60 msgr2=0x7fdc80068b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:10.440 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.437+0000 7fdc84c83700 1 --2- 172.21.15.76:0/3833084611 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdc800ffe60 0x7fdc80068b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:10.440 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.437+0000 7fdc84c83700 1 -- 172.21.15.76:0/3833084611 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdc80101970 msgr2=0x7fdc8019e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:10.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.437+0000 7fdc84c83700 1 --2- 172.21.15.76:0/3833084611 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdc80101970 0x7fdc8019e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:10.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.437+0000 7fdc84c83700 1 -- 172.21.15.76:0/3833084611 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc78009d00 con 0x7fdc80100fb0 2024-06-02T04:49:10.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.437+0000 7fdc85c85700 1 --2- 172.21.15.76:0/3833084611 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdc80101970 0x7fdc8019e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:49:10.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.437+0000 7fdc84c83700 1 --2- 172.21.15.76:0/3833084611 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdc80100fb0 0x7fdc8019bc50 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fdc7000d950 tx=0x7fdc7000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:10.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.437+0000 7fdc767fc700 1 -- 172.21.15.76:0/3833084611 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc70009940 con 0x7fdc80100fb0 2024-06-02T04:49:10.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.437+0000 7fdc876e8700 1 -- 172.21.15.76:0/3833084611 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc8019eff0 con 0x7fdc80100fb0 2024-06-02T04:49:10.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.437+0000 7fdc767fc700 1 -- 172.21.15.76:0/3833084611 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdc70010460 con 0x7fdc80100fb0 2024-06-02T04:49:10.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.437+0000 7fdc767fc700 1 -- 172.21.15.76:0/3833084611 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc7000f620 con 0x7fdc80100fb0 2024-06-02T04:49:10.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.437+0000 7fdc876e8700 1 -- 172.21.15.76:0/3833084611 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc8019f4c0 con 0x7fdc80100fb0 2024-06-02T04:49:10.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.438+0000 7fdc876e8700 1 -- 172.21.15.76:0/3833084611 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc801072d0 con 0x7fdc80100fb0 2024-06-02T04:49:10.442 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.439+0000 7fdc767fc700 1 -- 172.21.15.76:0/3833084611 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fdc700105d0 con 0x7fdc80100fb0 2024-06-02T04:49:10.442 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.440+0000 7fdc767fc700 1 --2- 172.21.15.76:0/3833084611 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fdc6c0a1230 0x7fdc6c0a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:10.442 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.440+0000 7fdc767fc700 1 -- 172.21.15.76:0/3833084611 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fdc700ccc40 con 0x7fdc80100fb0 2024-06-02T04:49:10.442 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.440+0000 7fdc85484700 1 --2- 172.21.15.76:0/3833084611 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fdc6c0a1230 0x7fdc6c0a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:10.442 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.440+0000 7fdc85484700 1 --2- 172.21.15.76:0/3833084611 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fdc6c0a1230 0x7fdc6c0a36f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fdc7c005950 tx=0x7fdc7c00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:10.443 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.443+0000 7fdc767fc700 1 -- 172.21.15.76:0/3833084611 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fdc70095f00 con 0x7fdc80100fb0 2024-06-02T04:49:10.640 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.639+0000 7fdc876e8700 1 -- 172.21.15.76:0/3833084611 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fdc8010b620 con 0x7fdc80100fb0 2024-06-02T04:49:10.640 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.639+0000 7fdc767fc700 1 -- 172.21.15.76:0/3833084611 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v82) v1 ==== 103+0+11 (secure 0 0 0) 0x7fdc700160a0 con 0x7fdc80100fb0 2024-06-02T04:49:10.640 INFO:teuthology.orchestra.run.smithi076.stdout:pg_num: 32 2024-06-02T04:49:10.642 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.642+0000 7fdc876e8700 1 -- 172.21.15.76:0/3833084611 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fdc6c0a1230 msgr2=0x7fdc6c0a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:10.642 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.642+0000 7fdc876e8700 1 --2- 172.21.15.76:0/3833084611 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fdc6c0a1230 0x7fdc6c0a36f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fdc7c005950 tx=0x7fdc7c00b410 comp rx=0 tx=0).stop 2024-06-02T04:49:10.642 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.642+0000 7fdc876e8700 1 -- 172.21.15.76:0/3833084611 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdc80100fb0 msgr2=0x7fdc8019bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:10.642 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.642+0000 7fdc876e8700 1 --2- 172.21.15.76:0/3833084611 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdc80100fb0 0x7fdc8019bc50 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fdc7000d950 tx=0x7fdc7000dc60 comp rx=0 tx=0).stop 2024-06-02T04:49:10.642 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.642+0000 7fdc876e8700 1 -- 172.21.15.76:0/3833084611 shutdown_connections 2024-06-02T04:49:10.643 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.642+0000 7fdc876e8700 1 --2- 172.21.15.76:0/3833084611 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fdc6c0a1230 0x7fdc6c0a36f0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:10.643 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.642+0000 7fdc876e8700 1 --2- 172.21.15.76:0/3833084611 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdc80101970 0x7fdc8019e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:10.643 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.642+0000 7fdc876e8700 1 --2- 172.21.15.76:0/3833084611 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdc800ffe60 0x7fdc80068b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:10.643 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.642+0000 7fdc876e8700 1 --2- 172.21.15.76:0/3833084611 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdc80100fb0 0x7fdc8019bc50 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:10.643 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.642+0000 7fdc876e8700 1 -- 172.21.15.76:0/3833084611 >> 172.21.15.76:0/3833084611 conn(0x7fdc800fb3f0 msgr2=0x7fdc80104410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:10.643 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.642+0000 7fdc876e8700 1 -- 172.21.15.76:0/3833084611 shutdown_connections 2024-06-02T04:49:10.643 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.642+0000 7fdc876e8700 1 -- 172.21.15.76:0/3833084611 wait complete. 2024-06-02T04:49:10.655 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T04:49:10.779 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.779+0000 7fb7385b2700 1 -- 172.21.15.76:0/1191118153 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb7300ffd60 msgr2=0x7fb730100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:10.779 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.779+0000 7fb7385b2700 1 --2- 172.21.15.76:0/1191118153 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb7300ffd60 0x7fb730100180 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fb72c0099c0 tx=0x7fb72c009cd0 comp rx=0 tx=0).stop 2024-06-02T04:49:10.779 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.779+0000 7fb7385b2700 1 -- 172.21.15.76:0/1191118153 shutdown_connections 2024-06-02T04:49:10.780 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.779+0000 7fb7385b2700 1 --2- 172.21.15.76:0/1191118153 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb7301018f0 0x7fb7301081a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:10.780 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.779+0000 7fb7385b2700 1 --2- 172.21.15.76:0/1191118153 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb7300ffd60 0x7fb730100180 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:10.780 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.779+0000 7fb7385b2700 1 --2- 172.21.15.76:0/1191118153 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb730100f50 0x7fb7301013b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:10.780 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.779+0000 7fb7385b2700 1 -- 172.21.15.76:0/1191118153 >> 172.21.15.76:0/1191118153 conn(0x7fb7300fb2f0 msgr2=0x7fb7300fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:10.780 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.779+0000 7fb7385b2700 1 -- 172.21.15.76:0/1191118153 shutdown_connections 2024-06-02T04:49:10.780 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.779+0000 7fb7385b2700 1 -- 172.21.15.76:0/1191118153 wait complete. 2024-06-02T04:49:10.782 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.780+0000 7fb7385b2700 1 Processor -- start 2024-06-02T04:49:10.782 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.780+0000 7fb7385b2700 1 -- start start 2024-06-02T04:49:10.782 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.780+0000 7fb7385b2700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb7300ffd60 0x7fb730068b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:10.782 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.780+0000 7fb7385b2700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb730100f50 0x7fb73019dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:10.782 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.780+0000 7fb7385b2700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb7301018f0 0x7fb7301a03f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:10.783 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.780+0000 7fb7385b2700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7301a0a50 con 0x7fb7300ffd60 2024-06-02T04:49:10.783 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.780+0000 7fb7385b2700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7301a0bc0 con 0x7fb7301018f0 2024-06-02T04:49:10.783 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.780+0000 7fb7385b2700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7301a0d80 con 0x7fb730100f50 2024-06-02T04:49:10.783 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.780+0000 7fb73634e700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb7300ffd60 0x7fb730068b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:10.783 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.780+0000 7fb73634e700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb7300ffd60 0x7fb730068b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:54308/0 (socket says 172.21.15.76:54308) 2024-06-02T04:49:10.783 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.780+0000 7fb73634e700 1 -- 172.21.15.76:0/2606754521 learned_addr learned my addr 172.21.15.76:0/2606754521 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:49:10.783 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.780+0000 7fb736b4f700 1 --2- 172.21.15.76:0/2606754521 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb7301018f0 0x7fb7301a03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:10.783 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.780+0000 7fb735b4d700 1 --2- 172.21.15.76:0/2606754521 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb730100f50 0x7fb73019dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:10.783 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.780+0000 7fb73634e700 1 -- 172.21.15.76:0/2606754521 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb730100f50 msgr2=0x7fb73019dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:10.783 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.780+0000 7fb73634e700 1 --2- 172.21.15.76:0/2606754521 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb730100f50 0x7fb73019dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:10.783 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.780+0000 7fb73634e700 1 -- 172.21.15.76:0/2606754521 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb7301018f0 msgr2=0x7fb7301a03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:10.783 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.780+0000 7fb73634e700 1 --2- 172.21.15.76:0/2606754521 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb7301018f0 0x7fb7301a03f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:10.783 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.780+0000 7fb73634e700 1 -- 172.21.15.76:0/2606754521 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb72c0095f0 con 0x7fb7300ffd60 2024-06-02T04:49:10.783 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.780+0000 7fb73634e700 1 --2- 172.21.15.76:0/2606754521 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb7300ffd60 0x7fb730068b10 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fb72c009990 tx=0x7fb72c00fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:10.784 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.781+0000 7fb7277fe700 1 -- 172.21.15.76:0/2606754521 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb72c01d070 con 0x7fb7300ffd60 2024-06-02T04:49:10.784 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.781+0000 7fb7277fe700 1 -- 172.21.15.76:0/2606754521 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb72c00bd10 con 0x7fb7300ffd60 2024-06-02T04:49:10.784 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.781+0000 7fb7385b2700 1 -- 172.21.15.76:0/2606754521 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7301a1000 con 0x7fb7300ffd60 2024-06-02T04:49:10.784 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.781+0000 7fb7277fe700 1 -- 172.21.15.76:0/2606754521 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb72c017650 con 0x7fb7300ffd60 2024-06-02T04:49:10.784 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.781+0000 7fb7385b2700 1 -- 172.21.15.76:0/2606754521 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7301a1420 con 0x7fb7300ffd60 2024-06-02T04:49:10.784 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.782+0000 7fb7385b2700 1 -- 172.21.15.76:0/2606754521 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7301072a0 con 0x7fb7300ffd60 2024-06-02T04:49:10.785 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.783+0000 7fb7277fe700 1 -- 172.21.15.76:0/2606754521 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fb72c022470 con 0x7fb7300ffd60 2024-06-02T04:49:10.785 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.783+0000 7fb7277fe700 1 --2- 172.21.15.76:0/2606754521 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fb71c0a11b0 0x7fb71c0a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:10.785 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.783+0000 7fb7277fe700 1 -- 172.21.15.76:0/2606754521 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fb72c0ce4c0 con 0x7fb7300ffd60 2024-06-02T04:49:10.785 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.783+0000 7fb735b4d700 1 --2- 172.21.15.76:0/2606754521 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fb71c0a11b0 0x7fb71c0a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:10.785 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.784+0000 7fb735b4d700 1 --2- 172.21.15.76:0/2606754521 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fb71c0a11b0 0x7fb71c0a3670 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb720005950 tx=0x7fb7200058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:10.787 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:10.787+0000 7fb7277fe700 1 -- 172.21.15.76:0/2606754521 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fb72c097870 con 0x7fb7300ffd60 2024-06-02T04:49:10.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:10 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/2912057839' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-06-02T04:49:10.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:10 smithi076 ceph-mon[42935]: pgmap v254: 129 pgs: 2 peering, 127 active+clean; 639 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-06-02T04:49:10.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:10 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/1768792649' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-06-02T04:49:10.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:10 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/3833084611' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-06-02T04:49:11.032 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.032+0000 7fb7385b2700 1 -- 172.21.15.76:0/2606754521 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb730067c10 con 0x7fb7300ffd60 2024-06-02T04:49:11.033 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.032+0000 7fb7277fe700 1 -- 172.21.15.76:0/2606754521 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+10874 (secure 0 0 0) 0x7fb72c09ae90 con 0x7fb7300ffd60 2024-06-02T04:49:11.033 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:49:11.033 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6835/3029342152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3029342152},{"type":"v1","addr":"172.21.15.76:6835","nonce":3029342152}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6837/1207985317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":1207985317},{"type":"v1","addr":"172.21.15.76:6837","nonce":1207985317}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14607,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6839/928709755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":928709755},{"type":"v1","addr":"172.21.15.76:6839","nonce":928709755}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6841/4162178633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6840","nonce":4162178633},{"type":"v1","addr":"172.21.15.76:6841","nonce":4162178633}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/1543944863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":1543944863},{"type":"v1","addr":"172.21.15.119:6833","nonce":1543944863}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24418,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6833/1527921393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1527921393},{"type":"v1","addr":"172.21.15.192:6833","nonce":1527921393}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-02T04:48:02.662812+0000","modified":"2024-06-02T04:48:28.274836+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24491,"mds_1":24475,"mds_2":24463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24434":{"gid":24434,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6835/2746840347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":2746840347},{"type":"v1","addr":"172.21.15.119:6835","nonce":2746840347}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24451":{"gid":24451,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.192:6835/783181340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":783181340},{"type":"v1","addr":"172.21.15.192:6835","nonce":783181340}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24458":{"gid":24458,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6837/2171687478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":2171687478},{"type":"v1","addr":"172.21.15.119:6837","nonce":2171687478}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24463":{"gid":24463,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":11,"addr":"172.21.15.192:6837/960773710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":960773710},{"type":"v1","addr":"172.21.15.192:6837","nonce":960773710}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24475":{"gid":24475,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.192:6839/3978681402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":3978681402},{"type":"v1","addr":"172.21.15.192:6839","nonce":3978681402}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.119:6839/4098406903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":4098406903},{"type":"v1","addr":"172.21.15.119:6839","nonce":4098406903}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-06-02T04:49:11.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.035+0000 7fb7385b2700 1 -- 172.21.15.76:0/2606754521 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fb71c0a11b0 msgr2=0x7fb71c0a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:11.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.035+0000 7fb7385b2700 1 --2- 172.21.15.76:0/2606754521 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fb71c0a11b0 0x7fb71c0a3670 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb720005950 tx=0x7fb7200058e0 comp rx=0 tx=0).stop 2024-06-02T04:49:11.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.035+0000 7fb7385b2700 1 -- 172.21.15.76:0/2606754521 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb7300ffd60 msgr2=0x7fb730068b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:11.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.035+0000 7fb7385b2700 1 --2- 172.21.15.76:0/2606754521 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb7300ffd60 0x7fb730068b10 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fb72c009990 tx=0x7fb72c00fa00 comp rx=0 tx=0).stop 2024-06-02T04:49:11.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.035+0000 7fb7385b2700 1 -- 172.21.15.76:0/2606754521 shutdown_connections 2024-06-02T04:49:11.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.035+0000 7fb7385b2700 1 --2- 172.21.15.76:0/2606754521 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fb71c0a11b0 0x7fb71c0a3670 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:11.036 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.035+0000 7fb7385b2700 1 --2- 172.21.15.76:0/2606754521 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb7301018f0 0x7fb7301a03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:11.036 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.035+0000 7fb7385b2700 1 --2- 172.21.15.76:0/2606754521 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb7300ffd60 0x7fb730068b10 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:11.036 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.035+0000 7fb7385b2700 1 --2- 172.21.15.76:0/2606754521 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb730100f50 0x7fb73019dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:11.036 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.035+0000 7fb7385b2700 1 -- 172.21.15.76:0/2606754521 >> 172.21.15.76:0/2606754521 conn(0x7fb7300fb2f0 msgr2=0x7fb7301043e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:11.036 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.035+0000 7fb7385b2700 1 -- 172.21.15.76:0/2606754521 shutdown_connections 2024-06-02T04:49:11.036 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.035+0000 7fb7385b2700 1 -- 172.21.15.76:0/2606754521 wait complete. 2024-06-02T04:49:11.036 INFO:teuthology.orchestra.run.smithi076.stderr:dumped fsmap epoch 24 2024-06-02T04:49:11.048 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-02T04:49:11.172 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.169+0000 7f2cf141f700 1 -- 172.21.15.76:0/3822719744 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2cec0ffd60 msgr2=0x7f2cec100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:11.172 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.169+0000 7f2cf141f700 1 --2- 172.21.15.76:0/3822719744 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2cec0ffd60 0x7f2cec100180 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f2ce00099c0 tx=0x7f2ce0009cd0 comp rx=0 tx=0).stop 2024-06-02T04:49:11.172 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.169+0000 7f2cf141f700 1 -- 172.21.15.76:0/3822719744 shutdown_connections 2024-06-02T04:49:11.172 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.169+0000 7f2cf141f700 1 --2- 172.21.15.76:0/3822719744 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2cec1018f0 0x7f2cec1081a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:11.172 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.170+0000 7f2cf141f700 1 --2- 172.21.15.76:0/3822719744 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2cec0ffd60 0x7f2cec100180 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:11.172 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.170+0000 7f2cf141f700 1 --2- 172.21.15.76:0/3822719744 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2cec100f50 0x7f2cec1013b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:11.172 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.170+0000 7f2cf141f700 1 -- 172.21.15.76:0/3822719744 >> 172.21.15.76:0/3822719744 conn(0x7f2cec0fb2f0 msgr2=0x7f2cec0fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:11.172 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.170+0000 7f2cf141f700 1 -- 172.21.15.76:0/3822719744 shutdown_connections 2024-06-02T04:49:11.173 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.170+0000 7f2cf141f700 1 -- 172.21.15.76:0/3822719744 wait complete. 2024-06-02T04:49:11.173 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.170+0000 7f2cf141f700 1 Processor -- start 2024-06-02T04:49:11.173 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.170+0000 7f2cf141f700 1 -- start start 2024-06-02T04:49:11.173 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.170+0000 7f2cf141f700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2cec0ffd60 0x7f2cec196da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:11.173 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.170+0000 7f2cf141f700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2cec100f50 0x7f2cec1972e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:11.173 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.170+0000 7f2cf141f700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2cec1018f0 0x7f2cec19e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:11.173 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.170+0000 7f2cf141f700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cec19e8d0 con 0x7f2cec0ffd60 2024-06-02T04:49:11.173 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.170+0000 7f2cf141f700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cec19ea10 con 0x7f2cec1018f0 2024-06-02T04:49:11.173 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.170+0000 7f2cf141f700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cec19eba0 con 0x7f2cec100f50 2024-06-02T04:49:11.173 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.171+0000 7f2ceaffd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2cec0ffd60 0x7f2cec196da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:11.173 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.171+0000 7f2ceaffd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2cec0ffd60 0x7f2cec196da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:54320/0 (socket says 172.21.15.76:54320) 2024-06-02T04:49:11.173 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.171+0000 7f2ceaffd700 1 -- 172.21.15.76:0/1582158113 learned_addr learned my addr 172.21.15.76:0/1582158113 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:49:11.173 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.171+0000 7f2ceb7fe700 1 --2- 172.21.15.76:0/1582158113 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2cec1018f0 0x7f2cec19e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:11.174 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.171+0000 7f2cea7fc700 1 --2- 172.21.15.76:0/1582158113 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2cec100f50 0x7f2cec1972e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:11.174 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.171+0000 7f2ceaffd700 1 -- 172.21.15.76:0/1582158113 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2cec100f50 msgr2=0x7f2cec1972e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:11.174 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.171+0000 7f2ceaffd700 1 --2- 172.21.15.76:0/1582158113 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2cec100f50 0x7f2cec1972e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:11.174 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.171+0000 7f2ceaffd700 1 -- 172.21.15.76:0/1582158113 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2cec1018f0 msgr2=0x7f2cec19e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:11.174 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.171+0000 7f2ceaffd700 1 --2- 172.21.15.76:0/1582158113 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2cec1018f0 0x7f2cec19e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:11.174 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.171+0000 7f2ceaffd700 1 -- 172.21.15.76:0/1582158113 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ce00095f0 con 0x7f2cec0ffd60 2024-06-02T04:49:11.174 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.171+0000 7f2ceb7fe700 1 --2- 172.21.15.76:0/1582158113 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2cec1018f0 0x7f2cec19e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:49:11.174 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.171+0000 7f2cea7fc700 1 --2- 172.21.15.76:0/1582158113 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2cec100f50 0x7f2cec1972e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:49:11.174 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.171+0000 7f2ceaffd700 1 --2- 172.21.15.76:0/1582158113 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2cec0ffd60 0x7f2cec196da0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f2ce0009f50 tx=0x7f2ce0003b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:11.174 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.171+0000 7f2cd3fff700 1 -- 172.21.15.76:0/1582158113 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ce001d070 con 0x7f2cec0ffd60 2024-06-02T04:49:11.174 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.171+0000 7f2cf141f700 1 -- 172.21.15.76:0/1582158113 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cec19ee20 con 0x7f2cec0ffd60 2024-06-02T04:49:11.174 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.171+0000 7f2cd3fff700 1 -- 172.21.15.76:0/1582158113 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2ce000bda0 con 0x7f2cec0ffd60 2024-06-02T04:49:11.174 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.171+0000 7f2cd3fff700 1 -- 172.21.15.76:0/1582158113 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ce000f460 con 0x7f2cec0ffd60 2024-06-02T04:49:11.175 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.171+0000 7f2cf141f700 1 -- 172.21.15.76:0/1582158113 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cec19f190 con 0x7f2cec0ffd60 2024-06-02T04:49:11.175 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.172+0000 7f2cf141f700 1 -- 172.21.15.76:0/1582158113 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cec0680d0 con 0x7f2cec0ffd60 2024-06-02T04:49:11.175 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.173+0000 7f2cd3fff700 1 -- 172.21.15.76:0/1582158113 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f2ce0022470 con 0x7f2cec0ffd60 2024-06-02T04:49:11.176 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.174+0000 7f2cd3fff700 1 --2- 172.21.15.76:0/1582158113 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f2cd40a11b0 0x7f2cd40a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:11.176 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.174+0000 7f2cd3fff700 1 -- 172.21.15.76:0/1582158113 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f2ce00ce4b0 con 0x7f2cec0ffd60 2024-06-02T04:49:11.176 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.174+0000 7f2cea7fc700 1 --2- 172.21.15.76:0/1582158113 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f2cd40a11b0 0x7f2cd40a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:11.176 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.174+0000 7f2cea7fc700 1 --2- 172.21.15.76:0/1582158113 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f2cd40a11b0 0x7f2cd40a3670 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc007900 tx=0x7f2cdc008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:11.177 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.177+0000 7f2cd3fff700 1 -- 172.21.15.76:0/1582158113 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f2ce0097860 con 0x7f2cec0ffd60 2024-06-02T04:49:11.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:10 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/2912057839' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-06-02T04:49:11.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:10 smithi192 ceph-mon[47933]: pgmap v254: 129 pgs: 2 peering, 127 active+clean; 639 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-06-02T04:49:11.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:10 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/1768792649' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-06-02T04:49:11.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:10 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/3833084611' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-06-02T04:49:11.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:10 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/2912057839' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-06-02T04:49:11.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:10 smithi119 ceph-mon[46633]: pgmap v254: 129 pgs: 2 peering, 127 active+clean; 639 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-06-02T04:49:11.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:10 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/1768792649' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-06-02T04:49:11.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:10 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/3833084611' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-06-02T04:49:11.374 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.374+0000 7f2cf141f700 1 -- 172.21.15.76:0/1582158113 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2cec10b4f0 con 0x7f2cec0ffd60 2024-06-02T04:49:11.376 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.376+0000 7f2cd3fff700 1 -- 172.21.15.76:0/1582158113 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+24453 (secure 0 0 0) 0x7f2ce009ae80 con 0x7f2cec0ffd60 2024-06-02T04:49:11.376 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:49:11.376 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":82,"fsid":"60ab6d30-209a-11ef-bc9b-c7b262605968","created":"2024-06-02T04:42:21.007333+0000","modified":"2024-06-02T04:49:07.862801+0000","last_up_change":"2024-06-02T04:47:29.822242+0000","last_in_change":"2024-06-02T04:47:14.253449+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T04:44:56.408602+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-02T04:48:01.194954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-02T04:48:01.828863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-02T04:48:04.916565+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"33a51ba2-be5c-41d0-b5d1-8d6039f2ca4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6802","nonce":2869602045},{"type":"v1","addr":"172.21.15.76:6803","nonce":2869602045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6804","nonce":2869602045},{"type":"v1","addr":"172.21.15.76:6805","nonce":2869602045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6808","nonce":2869602045},{"type":"v1","addr":"172.21.15.76:6809","nonce":2869602045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6806","nonce":2869602045},{"type":"v1","addr":"172.21.15.76:6807","nonce":2869602045}]},"public_addr":"172.21.15.76:6803/2869602045","cluster_addr":"172.21.15.76:6805/2869602045","heartbeat_back_addr":"172.21.15.76:6809/2869602045","heartbeat_front_addr":"172.21.15.76:6807/2869602045","state":["exists","up"]},{"osd":1,"uuid":"ace46e13-3bb7-4103-973a-6860554df8b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":2353738098},{"type":"v1","addr":"172.21.15.119:6801","nonce":2353738098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":2353738098},{"type":"v1","addr":"172.21.15.119:6803","nonce":2353738098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":2353738098},{"type":"v1","addr":"172.21.15.119:6807","nonce":2353738098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":2353738098},{"type":"v1","addr":"172.21.15.119:6805","nonce":2353738098}]},"public_addr":"172.21.15.119:6801/2353738098","cluster_addr":"172.21.15.119:6803/2353738098","heartbeat_back_addr":"172.21.15.119:6807/2353738098","heartbeat_front_addr":"172.21.15.119:6805/2353738098","state":["exists","up"]},{"osd":2,"uuid":"4addc09e-77a9-428a-bcc4-38194f486cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":3206918546},{"type":"v1","addr":"172.21.15.192:6801","nonce":3206918546}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":3206918546},{"type":"v1","addr":"172.21.15.192:6803","nonce":3206918546}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":3206918546},{"type":"v1","addr":"172.21.15.192:6807","nonce":3206918546}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":3206918546},{"type":"v1","addr":"172.21.15.192:6805","nonce":3206918546}]},"public_addr":"172.21.15.192:6801/3206918546","cluster_addr":"172.21.15.192:6803/3206918546","heartbeat_back_addr":"172.21.15.192:6807/3206918546","heartbeat_front_addr":"172.21.15.192:6805/3206918546","state":["exists","up"]},{"osd":3,"uuid":"dc525518-82c6-49ed-8ca8-e3bd5bfc18d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6810","nonce":3747864233},{"type":"v1","addr":"172.21.15.76:6811","nonce":3747864233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6812","nonce":3747864233},{"type":"v1","addr":"172.21.15.76:6813","nonce":3747864233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6816","nonce":3747864233},{"type":"v1","addr":"172.21.15.76:6817","nonce":3747864233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6814","nonce":3747864233},{"type":"v1","addr":"172.21.15.76:6815","nonce":3747864233}]},"public_addr":"172.21.15.76:6811/3747864233","cluster_addr":"172.21.15.76:6813/3747864233","heartbeat_back_addr":"172.21.15.76:6817/3747864233","heartbeat_front_addr":"172.21.15.76:6815/3747864233","state":["exists","up"]},{"osd":4,"uuid":"eef293d0-cb87-47b3-9751-c6437a1cf079","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":2571629047},{"type":"v1","addr":"172.21.15.119:6809","nonce":2571629047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":2571629047},{"type":"v1","addr":"172.21.15.119:6811","nonce":2571629047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":2571629047},{"type":"v1","addr":"172.21.15.119:6815","nonce":2571629047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":2571629047},{"type":"v1","addr":"172.21.15.119:6813","nonce":2571629047}]},"public_addr":"172.21.15.119:6809/2571629047","cluster_addr":"172.21.15.119:6811/2571629047","heartbeat_back_addr":"172.21.15.119:6815/2571629047","heartbeat_front_addr":"172.21.15.119:6813/2571629047","state":["exists","up"]},{"osd":5,"uuid":"60eb8c6e-766c-49d0-9997-44f85776b3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3285065416},{"type":"v1","addr":"172.21.15.192:6809","nonce":3285065416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":3285065416},{"type":"v1","addr":"172.21.15.192:6811","nonce":3285065416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3285065416},{"type":"v1","addr":"172.21.15.192:6815","nonce":3285065416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":3285065416},{"type":"v1","addr":"172.21.15.192:6813","nonce":3285065416}]},"public_addr":"172.21.15.192:6809/3285065416","cluster_addr":"172.21.15.192:6811/3285065416","heartbeat_back_addr":"172.21.15.192:6815/3285065416","heartbeat_front_addr":"172.21.15.192:6813/3285065416","state":["exists","up"]},{"osd":6,"uuid":"e6dc8b9d-dd06-4870-a506-def8201b7e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6818","nonce":2951381580},{"type":"v1","addr":"172.21.15.76:6819","nonce":2951381580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6820","nonce":2951381580},{"type":"v1","addr":"172.21.15.76:6821","nonce":2951381580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6824","nonce":2951381580},{"type":"v1","addr":"172.21.15.76:6825","nonce":2951381580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6822","nonce":2951381580},{"type":"v1","addr":"172.21.15.76:6823","nonce":2951381580}]},"public_addr":"172.21.15.76:6819/2951381580","cluster_addr":"172.21.15.76:6821/2951381580","heartbeat_back_addr":"172.21.15.76:6825/2951381580","heartbeat_front_addr":"172.21.15.76:6823/2951381580","state":["exists","up"]},{"osd":7,"uuid":"2f5dccb3-39a1-4f25-8715-fa264d59db97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1802558756},{"type":"v1","addr":"172.21.15.119:6817","nonce":1802558756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1802558756},{"type":"v1","addr":"172.21.15.119:6819","nonce":1802558756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1802558756},{"type":"v1","addr":"172.21.15.119:6823","nonce":1802558756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1802558756},{"type":"v1","addr":"172.21.15.119:6821","nonce":1802558756}]},"public_addr":"172.21.15.119:6817/1802558756","cluster_addr":"172.21.15.119:6819/1802558756","heartbeat_back_addr":"172.21.15.119:6823/1802558756","heartbeat_front_addr":"172.21.15.119:6821/1802558756","state":["exists","up"]},{"osd":8,"uuid":"39b6ccd0-16e7-4cd5-87e0-d827e9172984","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":1214972276},{"type":"v1","addr":"172.21.15.192:6817","nonce":1214972276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":1214972276},{"type":"v1","addr":"172.21.15.192:6819","nonce":1214972276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":1214972276},{"type":"v1","addr":"172.21.15.192:6823","nonce":1214972276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":1214972276},{"type":"v1","addr":"172.21.15.192:6821","nonce":1214972276}]},"public_addr":"172.21.15.192:6817/1214972276","cluster_addr":"172.21.15.192:6819/1214972276","heartbeat_back_addr":"172.21.15.192:6823/1214972276","heartbeat_front_addr":"172.21.15.192:6821/1214972276","state":["exists","up"]},{"osd":9,"uuid":"851b2155-07bd-45de-bfe0-53021fda733f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6826","nonce":3095501821},{"type":"v1","addr":"172.21.15.76:6827","nonce":3095501821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6828","nonce":3095501821},{"type":"v1","addr":"172.21.15.76:6829","nonce":3095501821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":3095501821},{"type":"v1","addr":"172.21.15.76:6833","nonce":3095501821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6830","nonce":3095501821},{"type":"v1","addr":"172.21.15.76:6831","nonce":3095501821}]},"public_addr":"172.21.15.76:6827/3095501821","cluster_addr":"172.21.15.76:6829/3095501821","heartbeat_back_addr":"172.21.15.76:6833/3095501821","heartbeat_front_addr":"172.21.15.76:6831/3095501821","state":["exists","up"]},{"osd":10,"uuid":"e4b18e7e-bddf-4dd4-84f6-7902ea327cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":4082130894},{"type":"v1","addr":"172.21.15.119:6825","nonce":4082130894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":4082130894},{"type":"v1","addr":"172.21.15.119:6827","nonce":4082130894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":4082130894},{"type":"v1","addr":"172.21.15.119:6831","nonce":4082130894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":4082130894},{"type":"v1","addr":"172.21.15.119:6829","nonce":4082130894}]},"public_addr":"172.21.15.119:6825/4082130894","cluster_addr":"172.21.15.119:6827/4082130894","heartbeat_back_addr":"172.21.15.119:6831/4082130894","heartbeat_front_addr":"172.21.15.119:6829/4082130894","state":["exists","up"]},{"osd":11,"uuid":"54567e18-920c-4ae9-9557-0efba5a1a820","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":439693921},{"type":"v1","addr":"172.21.15.192:6825","nonce":439693921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":439693921},{"type":"v1","addr":"172.21.15.192:6827","nonce":439693921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":439693921},{"type":"v1","addr":"172.21.15.192:6831","nonce":439693921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":439693921},{"type":"v1","addr":"172.21.15.192:6829","nonce":439693921}]},"public_addr":"172.21.15.192:6825/439693921","cluster_addr":"172.21.15.192:6827/439693921","heartbeat_back_addr":"172.21.15.192:6831/439693921","heartbeat_front_addr":"172.21.15.192:6829/439693921","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:44:19.922390+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:44:36.895563+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:44:53.699019+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:45:11.167404+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:45:27.955899+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:45:44.850368+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:46:02.003588+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:46:19.019217+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:46:36.189670+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:46:53.919365+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:47:11.563053+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:47:28.822443+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":4}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.8","mappings":[{"from":5,"to":10}]},{"pgid":"4.14","mappings":[{"from":9,"to":8}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.76:6801/4200406736":"2024-06-03T04:43:06.092916+0000","172.21.15.76:6800/4200406736":"2024-06-03T04:43:06.092916+0000","172.21.15.76:0/1524144593":"2024-06-03T04:43:06.092916+0000","172.21.15.76:0/3269372590":"2024-06-03T04:43:06.092916+0000","172.21.15.76:0/3570893846":"2024-06-03T04:42:44.872236+0000","172.21.15.76:0/902035790":"2024-06-03T04:43:06.092916+0000","172.21.15.76:6800/2550846765":"2024-06-03T04:42:44.872236+0000","172.21.15.76:6801/2550846765":"2024-06-03T04:42:44.872236+0000","172.21.15.76:0/2646712763":"2024-06-03T04:42:44.872236+0000","172.21.15.76:0/964578813":"2024-06-03T04:42:44.872236+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T04:49:11.379 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.378+0000 7f2cf141f700 1 -- 172.21.15.76:0/1582158113 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f2cd40a11b0 msgr2=0x7f2cd40a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:11.379 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.378+0000 7f2cf141f700 1 --2- 172.21.15.76:0/1582158113 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f2cd40a11b0 0x7f2cd40a3670 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc007900 tx=0x7f2cdc008040 comp rx=0 tx=0).stop 2024-06-02T04:49:11.379 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.378+0000 7f2cf141f700 1 -- 172.21.15.76:0/1582158113 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2cec0ffd60 msgr2=0x7f2cec196da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:11.379 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.378+0000 7f2cf141f700 1 --2- 172.21.15.76:0/1582158113 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2cec0ffd60 0x7f2cec196da0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f2ce0009f50 tx=0x7f2ce0003b00 comp rx=0 tx=0).stop 2024-06-02T04:49:11.379 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.378+0000 7f2cf141f700 1 -- 172.21.15.76:0/1582158113 shutdown_connections 2024-06-02T04:49:11.379 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.378+0000 7f2cf141f700 1 --2- 172.21.15.76:0/1582158113 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f2cd40a11b0 0x7f2cd40a3670 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:11.379 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.378+0000 7f2cf141f700 1 --2- 172.21.15.76:0/1582158113 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2cec1018f0 0x7f2cec19e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:11.379 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.378+0000 7f2cf141f700 1 --2- 172.21.15.76:0/1582158113 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2cec0ffd60 0x7f2cec196da0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:11.379 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.378+0000 7f2cf141f700 1 --2- 172.21.15.76:0/1582158113 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2cec100f50 0x7f2cec1972e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:11.379 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.378+0000 7f2cf141f700 1 -- 172.21.15.76:0/1582158113 >> 172.21.15.76:0/1582158113 conn(0x7f2cec0fb2f0 msgr2=0x7f2cec0694a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:11.380 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.378+0000 7f2cf141f700 1 -- 172.21.15.76:0/1582158113 shutdown_connections 2024-06-02T04:49:11.380 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.378+0000 7f2cf141f700 1 -- 172.21.15.76:0/1582158113 wait complete. 2024-06-02T04:49:11.391 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-06-02T04:44:56.408602+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-06-02T04:48:01.194954+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-06-02T04:48:01.828863+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '76', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-06-02T04:48:04.916565+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-06-02T04:49:11.392 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-06-02T04:49:11.520 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.517+0000 7f24555aa700 1 -- 172.21.15.76:0/729081475 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2450102ab0 msgr2=0x7f24501093d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:11.520 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.517+0000 7f24555aa700 1 --2- 172.21.15.76:0/729081475 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2450102ab0 0x7f24501093d0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f244800b0a0 tx=0x7f244800b3b0 comp rx=0 tx=0).stop 2024-06-02T04:49:11.520 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.517+0000 7f24555aa700 1 -- 172.21.15.76:0/729081475 shutdown_connections 2024-06-02T04:49:11.520 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.517+0000 7f24555aa700 1 --2- 172.21.15.76:0/729081475 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2450102ab0 0x7f24501093d0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:11.520 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.517+0000 7f24555aa700 1 --2- 172.21.15.76:0/729081475 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2450100f20 0x7f2450101360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:11.520 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.517+0000 7f24555aa700 1 --2- 172.21.15.76:0/729081475 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f24501020f0 0x7f2450102570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:11.520 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.517+0000 7f24555aa700 1 -- 172.21.15.76:0/729081475 >> 172.21.15.76:0/729081475 conn(0x7f24500fc4e0 msgr2=0x7f24500fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:11.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.517+0000 7f24555aa700 1 -- 172.21.15.76:0/729081475 shutdown_connections 2024-06-02T04:49:11.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.517+0000 7f24555aa700 1 -- 172.21.15.76:0/729081475 wait complete. 2024-06-02T04:49:11.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.518+0000 7f24555aa700 1 Processor -- start 2024-06-02T04:49:11.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.518+0000 7f24555aa700 1 -- start start 2024-06-02T04:49:11.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.518+0000 7f24555aa700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2450100f20 0x7f2450196f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:11.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.518+0000 7f24555aa700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f24501020f0 0x7f2450197490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:11.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.518+0000 7f24555aa700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2450102ab0 0x7f245019e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:11.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.518+0000 7f24555aa700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f245019ea30 con 0x7f2450102ab0 2024-06-02T04:49:11.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.518+0000 7f24555aa700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f245019eb70 con 0x7f2450100f20 2024-06-02T04:49:11.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.518+0000 7f24555aa700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f245019ed00 con 0x7f24501020f0 2024-06-02T04:49:11.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.518+0000 7f244f7fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2450102ab0 0x7f245019e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:11.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.518+0000 7f244f7fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2450102ab0 0x7f245019e460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:54336/0 (socket says 172.21.15.76:54336) 2024-06-02T04:49:11.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.518+0000 7f244f7fe700 1 -- 172.21.15.76:0/146457830 learned_addr learned my addr 172.21.15.76:0/146457830 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:49:11.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.518+0000 7f244e7fc700 1 --2- 172.21.15.76:0/146457830 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f24501020f0 0x7f2450197490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:11.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.518+0000 7f244effd700 1 --2- 172.21.15.76:0/146457830 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2450100f20 0x7f2450196f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:11.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.518+0000 7f244f7fe700 1 -- 172.21.15.76:0/146457830 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f24501020f0 msgr2=0x7f2450197490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:11.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.518+0000 7f244f7fe700 1 --2- 172.21.15.76:0/146457830 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f24501020f0 0x7f2450197490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:11.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.518+0000 7f244f7fe700 1 -- 172.21.15.76:0/146457830 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2450100f20 msgr2=0x7f2450196f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:11.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.518+0000 7f244f7fe700 1 --2- 172.21.15.76:0/146457830 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2450100f20 0x7f2450196f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:11.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.518+0000 7f244f7fe700 1 -- 172.21.15.76:0/146457830 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2448009d00 con 0x7f2450102ab0 2024-06-02T04:49:11.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.519+0000 7f244f7fe700 1 --2- 172.21.15.76:0/146457830 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2450102ab0 0x7f245019e460 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f2448004ce0 tx=0x7f2448004dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:11.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.519+0000 7f2437fff700 1 -- 172.21.15.76:0/146457830 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f244800e040 con 0x7f2450102ab0 2024-06-02T04:49:11.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.519+0000 7f2437fff700 1 -- 172.21.15.76:0/146457830 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f244800ce60 con 0x7f2450102ab0 2024-06-02T04:49:11.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.519+0000 7f24555aa700 1 -- 172.21.15.76:0/146457830 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f245019ef80 con 0x7f2450102ab0 2024-06-02T04:49:11.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.519+0000 7f2437fff700 1 -- 172.21.15.76:0/146457830 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f244801bb20 con 0x7f2450102ab0 2024-06-02T04:49:11.523 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.519+0000 7f24555aa700 1 -- 172.21.15.76:0/146457830 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f245019f3a0 con 0x7f2450102ab0 2024-06-02T04:49:11.523 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.520+0000 7f24555aa700 1 -- 172.21.15.76:0/146457830 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2450108430 con 0x7f2450102ab0 2024-06-02T04:49:11.523 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.521+0000 7f2437fff700 1 -- 172.21.15.76:0/146457830 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f244801bc80 con 0x7f2450102ab0 2024-06-02T04:49:11.523 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.521+0000 7f2437fff700 1 --2- 172.21.15.76:0/146457830 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f24380a11b0 0x7f24380a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:11.523 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.522+0000 7f244effd700 1 --2- 172.21.15.76:0/146457830 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f24380a11b0 0x7f24380a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:11.524 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.522+0000 7f2437fff700 1 -- 172.21.15.76:0/146457830 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f24480cf220 con 0x7f2450102ab0 2024-06-02T04:49:11.524 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.522+0000 7f244effd700 1 --2- 172.21.15.76:0/146457830 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f24380a11b0 0x7f24380a3670 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2444005950 tx=0x7f24440058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:11.525 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.525+0000 7f2437fff700 1 -- 172.21.15.76:0/146457830 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f2448098570 con 0x7f2450102ab0 2024-06-02T04:49:11.722 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.722+0000 7f24555aa700 1 -- 172.21.15.76:0/146457830 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2450107e10 con 0x7f2450102ab0 2024-06-02T04:49:11.723 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.722+0000 7f2437fff700 1 -- 172.21.15.76:0/146457830 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) v1 ==== 93+0+10 (secure 0 0 0) 0x7f244809bb90 con 0x7f2450102ab0 2024-06-02T04:49:11.723 INFO:teuthology.orchestra.run.smithi076.stdout:pg_num: 1 2024-06-02T04:49:11.725 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.725+0000 7f24555aa700 1 -- 172.21.15.76:0/146457830 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f24380a11b0 msgr2=0x7f24380a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:11.725 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.725+0000 7f24555aa700 1 --2- 172.21.15.76:0/146457830 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f24380a11b0 0x7f24380a3670 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2444005950 tx=0x7f24440058e0 comp rx=0 tx=0).stop 2024-06-02T04:49:11.725 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.725+0000 7f24555aa700 1 -- 172.21.15.76:0/146457830 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2450102ab0 msgr2=0x7f245019e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:11.725 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.725+0000 7f24555aa700 1 --2- 172.21.15.76:0/146457830 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2450102ab0 0x7f245019e460 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f2448004ce0 tx=0x7f2448004dc0 comp rx=0 tx=0).stop 2024-06-02T04:49:11.725 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.725+0000 7f24555aa700 1 -- 172.21.15.76:0/146457830 shutdown_connections 2024-06-02T04:49:11.726 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.725+0000 7f24555aa700 1 --2- 172.21.15.76:0/146457830 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2450102ab0 0x7f245019e460 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:11.726 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.725+0000 7f24555aa700 1 --2- 172.21.15.76:0/146457830 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f24380a11b0 0x7f24380a3670 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:11.726 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.725+0000 7f24555aa700 1 --2- 172.21.15.76:0/146457830 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2450100f20 0x7f2450196f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:11.726 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.725+0000 7f24555aa700 1 --2- 172.21.15.76:0/146457830 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f24501020f0 0x7f2450197490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:11.726 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.725+0000 7f24555aa700 1 -- 172.21.15.76:0/146457830 >> 172.21.15.76:0/146457830 conn(0x7f24500fc4e0 msgr2=0x7f2450105570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:11.726 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.725+0000 7f24555aa700 1 -- 172.21.15.76:0/146457830 shutdown_connections 2024-06-02T04:49:11.726 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.725+0000 7f24555aa700 1 -- 172.21.15.76:0/146457830 wait complete. 2024-06-02T04:49:11.738 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-06-02T04:49:11.867 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.864+0000 7f12b74e7700 1 -- 172.21.15.76:0/401333555 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f12b0101970 msgr2=0x7f12b0108290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:11.867 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.864+0000 7f12b74e7700 1 --2- 172.21.15.76:0/401333555 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f12b0101970 0x7f12b0108290 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f12a800b0a0 tx=0x7f12a800b3b0 comp rx=0 tx=0).stop 2024-06-02T04:49:11.867 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.864+0000 7f12b74e7700 1 -- 172.21.15.76:0/401333555 shutdown_connections 2024-06-02T04:49:11.867 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.864+0000 7f12b74e7700 1 --2- 172.21.15.76:0/401333555 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f12b0101970 0x7f12b0108290 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:11.868 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.864+0000 7f12b74e7700 1 --2- 172.21.15.76:0/401333555 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f12b00ffe60 0x7f12b0100280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:11.868 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.864+0000 7f12b74e7700 1 --2- 172.21.15.76:0/401333555 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f12b0100fb0 0x7f12b0101430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:11.868 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.864+0000 7f12b74e7700 1 -- 172.21.15.76:0/401333555 >> 172.21.15.76:0/401333555 conn(0x7f12b00fb3f0 msgr2=0x7f12b00fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:11.868 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.864+0000 7f12b74e7700 1 -- 172.21.15.76:0/401333555 shutdown_connections 2024-06-02T04:49:11.868 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.864+0000 7f12b74e7700 1 -- 172.21.15.76:0/401333555 wait complete. 2024-06-02T04:49:11.868 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.864+0000 7f12b74e7700 1 Processor -- start 2024-06-02T04:49:11.868 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.864+0000 7f12b74e7700 1 -- start start 2024-06-02T04:49:11.868 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.864+0000 7f12b74e7700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f12b00ffe60 0x7f12b006a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:11.868 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.864+0000 7f12b74e7700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f12b0100fb0 0x7f12b019dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:11.868 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.864+0000 7f12b74e7700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f12b0101970 0x7f12b01a0510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:11.868 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.864+0000 7f12b74e7700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12b01a0b70 con 0x7f12b0100fb0 2024-06-02T04:49:11.868 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.864+0000 7f12b74e7700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12b01a0ce0 con 0x7f12b00ffe60 2024-06-02T04:49:11.868 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.864+0000 7f12b74e7700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12b01a0ea0 con 0x7f12b0101970 2024-06-02T04:49:11.869 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.865+0000 7f12b4a82700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f12b0100fb0 0x7f12b019dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:11.869 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.865+0000 7f12b4a82700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f12b0100fb0 0x7f12b019dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:54356/0 (socket says 172.21.15.76:54356) 2024-06-02T04:49:11.869 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.865+0000 7f12b4a82700 1 -- 172.21.15.76:0/763272562 learned_addr learned my addr 172.21.15.76:0/763272562 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:49:11.869 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.865+0000 7f12b5283700 1 --2- 172.21.15.76:0/763272562 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f12b00ffe60 0x7f12b006a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:11.869 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.865+0000 7f12b5a84700 1 --2- 172.21.15.76:0/763272562 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f12b0101970 0x7f12b01a0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:11.869 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.865+0000 7f12b4a82700 1 -- 172.21.15.76:0/763272562 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f12b0101970 msgr2=0x7f12b01a0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:11.869 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.865+0000 7f12b4a82700 1 --2- 172.21.15.76:0/763272562 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f12b0101970 0x7f12b01a0510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:11.869 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.865+0000 7f12b4a82700 1 -- 172.21.15.76:0/763272562 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f12b00ffe60 msgr2=0x7f12b006a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:11.869 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.865+0000 7f12b4a82700 1 --2- 172.21.15.76:0/763272562 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f12b00ffe60 0x7f12b006a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:11.869 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.865+0000 7f12b4a82700 1 -- 172.21.15.76:0/763272562 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12a8009d00 con 0x7f12b0100fb0 2024-06-02T04:49:11.869 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.865+0000 7f12b5a84700 1 --2- 172.21.15.76:0/763272562 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f12b0101970 0x7f12b01a0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:49:11.869 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.865+0000 7f12b4a82700 1 --2- 172.21.15.76:0/763272562 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f12b0100fb0 0x7f12b019dfc0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f12a000e9a0 tx=0x7f12a000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:11.869 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.865+0000 7f12a67fc700 1 -- 172.21.15.76:0/763272562 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a0009790 con 0x7f12b0100fb0 2024-06-02T04:49:11.870 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.865+0000 7f12a67fc700 1 -- 172.21.15.76:0/763272562 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f12a000cbd0 con 0x7f12b0100fb0 2024-06-02T04:49:11.870 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.865+0000 7f12b74e7700 1 -- 172.21.15.76:0/763272562 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12b01a1180 con 0x7f12b0100fb0 2024-06-02T04:49:11.870 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.865+0000 7f12a67fc700 1 -- 172.21.15.76:0/763272562 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a0018680 con 0x7f12b0100fb0 2024-06-02T04:49:11.870 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.865+0000 7f12b74e7700 1 -- 172.21.15.76:0/763272562 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12b01a16e0 con 0x7f12b0100fb0 2024-06-02T04:49:11.870 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.866+0000 7f12b74e7700 1 -- 172.21.15.76:0/763272562 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12b01072d0 con 0x7f12b0100fb0 2024-06-02T04:49:11.870 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.867+0000 7f12a67fc700 1 -- 172.21.15.76:0/763272562 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f12a000cd40 con 0x7f12b0100fb0 2024-06-02T04:49:11.871 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.868+0000 7f12a67fc700 1 --2- 172.21.15.76:0/763272562 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f129c0a1230 0x7f129c0a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:11.871 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.868+0000 7f12a67fc700 1 -- 172.21.15.76:0/763272562 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f12a0014070 con 0x7f12b0100fb0 2024-06-02T04:49:11.871 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.868+0000 7f12b5283700 1 --2- 172.21.15.76:0/763272562 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f129c0a1230 0x7f129c0a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:11.871 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.868+0000 7f12b5283700 1 --2- 172.21.15.76:0/763272562 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f129c0a1230 0x7f129c0a36f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f12ac005950 tx=0x7f12ac00a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:11.872 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:11.872+0000 7f12a67fc700 1 -- 172.21.15.76:0/763272562 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f12a0096670 con 0x7f12b0100fb0 2024-06-02T04:49:12.071 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.071+0000 7f12b74e7700 1 -- 172.21.15.76:0/763272562 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f12b010b620 con 0x7f12b0100fb0 2024-06-02T04:49:12.072 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.071+0000 7f12a67fc700 1 -- 172.21.15.76:0/763272562 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v82) v1 ==== 104+0+11 (secure 0 0 0) 0x7f12a0099c90 con 0x7f12b0100fb0 2024-06-02T04:49:12.072 INFO:teuthology.orchestra.run.smithi076.stdout:pg_num: 32 2024-06-02T04:49:12.074 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.074+0000 7f12b74e7700 1 -- 172.21.15.76:0/763272562 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f129c0a1230 msgr2=0x7f129c0a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:12.074 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.074+0000 7f12b74e7700 1 --2- 172.21.15.76:0/763272562 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f129c0a1230 0x7f129c0a36f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f12ac005950 tx=0x7f12ac00a300 comp rx=0 tx=0).stop 2024-06-02T04:49:12.074 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.074+0000 7f12b74e7700 1 -- 172.21.15.76:0/763272562 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f12b0100fb0 msgr2=0x7f12b019dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:12.074 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.074+0000 7f12b74e7700 1 --2- 172.21.15.76:0/763272562 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f12b0100fb0 0x7f12b019dfc0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f12a000e9a0 tx=0x7f12a000ecb0 comp rx=0 tx=0).stop 2024-06-02T04:49:12.074 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.074+0000 7f12b74e7700 1 -- 172.21.15.76:0/763272562 shutdown_connections 2024-06-02T04:49:12.075 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.074+0000 7f12b74e7700 1 --2- 172.21.15.76:0/763272562 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f12b0101970 0x7f12b01a0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:12.075 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.074+0000 7f12b74e7700 1 --2- 172.21.15.76:0/763272562 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f129c0a1230 0x7f129c0a36f0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:12.075 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.074+0000 7f12b74e7700 1 --2- 172.21.15.76:0/763272562 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f12b00ffe60 0x7f12b006a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:12.075 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.074+0000 7f12b74e7700 1 --2- 172.21.15.76:0/763272562 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f12b0100fb0 0x7f12b019dfc0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:12.075 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.074+0000 7f12b74e7700 1 -- 172.21.15.76:0/763272562 >> 172.21.15.76:0/763272562 conn(0x7f12b00fb3f0 msgr2=0x7f12b0104410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:12.075 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.074+0000 7f12b74e7700 1 -- 172.21.15.76:0/763272562 shutdown_connections 2024-06-02T04:49:12.075 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.074+0000 7f12b74e7700 1 -- 172.21.15.76:0/763272562 wait complete. 2024-06-02T04:49:12.085 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:11 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/2606754521' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:49:12.085 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:11 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/1582158113' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:49:12.085 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:11 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/146457830' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-02T04:49:12.086 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-06-02T04:49:12.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:11 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/2606754521' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:49:12.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:11 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/1582158113' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:49:12.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:11 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/146457830' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-02T04:49:12.211 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.211+0000 7f310fb5f700 1 -- 172.21.15.76:0/4256039954 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3108100fd0 msgr2=0x7f3108101450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:12.212 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.211+0000 7f310fb5f700 1 --2- 172.21.15.76:0/4256039954 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3108100fd0 0x7f3108101450 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f3104009990 tx=0x7f3104009ca0 comp rx=0 tx=0).stop 2024-06-02T04:49:12.212 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.211+0000 7f310fb5f700 1 -- 172.21.15.76:0/4256039954 shutdown_connections 2024-06-02T04:49:12.212 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.211+0000 7f310fb5f700 1 --2- 172.21.15.76:0/4256039954 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3108101990 0x7f31081082b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:12.212 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.211+0000 7f310fb5f700 1 --2- 172.21.15.76:0/4256039954 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f31080ffe80 0x7f31081002a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:12.212 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.211+0000 7f310fb5f700 1 --2- 172.21.15.76:0/4256039954 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3108100fd0 0x7f3108101450 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:12.212 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.211+0000 7f310fb5f700 1 -- 172.21.15.76:0/4256039954 >> 172.21.15.76:0/4256039954 conn(0x7f31080fb3f0 msgr2=0x7f31080fd830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:12.212 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.211+0000 7f310fb5f700 1 -- 172.21.15.76:0/4256039954 shutdown_connections 2024-06-02T04:49:12.212 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.211+0000 7f310fb5f700 1 -- 172.21.15.76:0/4256039954 wait complete. 2024-06-02T04:49:12.214 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.212+0000 7f310fb5f700 1 Processor -- start 2024-06-02T04:49:12.214 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.212+0000 7f310fb5f700 1 -- start start 2024-06-02T04:49:12.214 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.212+0000 7f310fb5f700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f31080ffe80 0x7f3108196d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:12.214 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.212+0000 7f310fb5f700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3108100fd0 0x7f31081972d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:12.214 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.212+0000 7f310fb5f700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3108101990 0x7f310819e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:12.215 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.212+0000 7f310fb5f700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f310819e880 con 0x7f31080ffe80 2024-06-02T04:49:12.215 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.212+0000 7f310fb5f700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f310819e9f0 con 0x7f3108100fd0 2024-06-02T04:49:12.215 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.212+0000 7f310fb5f700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f310819ebb0 con 0x7f3108101990 2024-06-02T04:49:12.215 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.212+0000 7f310d8fb700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f31080ffe80 0x7f3108196d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:12.215 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.212+0000 7f310d8fb700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f31080ffe80 0x7f3108196d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:54384/0 (socket says 172.21.15.76:54384) 2024-06-02T04:49:12.215 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.212+0000 7f310d8fb700 1 -- 172.21.15.76:0/1395521911 learned_addr learned my addr 172.21.15.76:0/1395521911 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:49:12.215 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.212+0000 7f310d0fa700 1 --2- 172.21.15.76:0/1395521911 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3108100fd0 0x7f31081972d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:12.215 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.212+0000 7f310e0fc700 1 --2- 172.21.15.76:0/1395521911 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3108101990 0x7f310819e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:12.215 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.213+0000 7f310d8fb700 1 -- 172.21.15.76:0/1395521911 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3108101990 msgr2=0x7f310819e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:12.215 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.213+0000 7f310d8fb700 1 --2- 172.21.15.76:0/1395521911 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3108101990 0x7f310819e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:12.215 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.213+0000 7f310d8fb700 1 -- 172.21.15.76:0/1395521911 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3108100fd0 msgr2=0x7f31081972d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:12.215 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.213+0000 7f310d8fb700 1 --2- 172.21.15.76:0/1395521911 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3108100fd0 0x7f31081972d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:12.215 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.213+0000 7f310d8fb700 1 -- 172.21.15.76:0/1395521911 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31040095f0 con 0x7f31080ffe80 2024-06-02T04:49:12.216 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.213+0000 7f310d8fb700 1 --2- 172.21.15.76:0/1395521911 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f31080ffe80 0x7f3108196d90 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f30f800c9b0 tx=0x7f30f800cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:12.216 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.213+0000 7f30feffd700 1 -- 172.21.15.76:0/1395521911 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30f8007b00 con 0x7f31080ffe80 2024-06-02T04:49:12.216 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.213+0000 7f30feffd700 1 -- 172.21.15.76:0/1395521911 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f30f8007c60 con 0x7f31080ffe80 2024-06-02T04:49:12.216 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.213+0000 7f310fb5f700 1 -- 172.21.15.76:0/1395521911 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f310819ee90 con 0x7f31080ffe80 2024-06-02T04:49:12.216 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.213+0000 7f30feffd700 1 -- 172.21.15.76:0/1395521911 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30f8018660 con 0x7f31080ffe80 2024-06-02T04:49:12.216 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.213+0000 7f310fb5f700 1 -- 172.21.15.76:0/1395521911 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f310819f2b0 con 0x7f31080ffe80 2024-06-02T04:49:12.216 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.214+0000 7f310fb5f700 1 -- 172.21.15.76:0/1395521911 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3108107240 con 0x7f31080ffe80 2024-06-02T04:49:12.217 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.215+0000 7f30feffd700 1 -- 172.21.15.76:0/1395521911 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f30f800f450 con 0x7f31080ffe80 2024-06-02T04:49:12.217 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.216+0000 7f30feffd700 1 --2- 172.21.15.76:0/1395521911 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f30f40a11b0 0x7f30f40a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:12.217 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.216+0000 7f310d0fa700 1 --2- 172.21.15.76:0/1395521911 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f30f40a11b0 0x7f30f40a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:12.217 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.216+0000 7f30feffd700 1 -- 172.21.15.76:0/1395521911 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f30f80cd0e0 con 0x7f31080ffe80 2024-06-02T04:49:12.217 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.216+0000 7f310d0fa700 1 --2- 172.21.15.76:0/1395521911 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f30f40a11b0 0x7f30f40a3670 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f310400b5c0 tx=0x7f3104005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:12.219 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.219+0000 7f30feffd700 1 -- 172.21.15.76:0/1395521911 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f30f8096430 con 0x7f31080ffe80 2024-06-02T04:49:12.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:11 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/2606754521' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:49:12.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:11 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/1582158113' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:49:12.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:11 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/146457830' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-02T04:49:12.419 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.419+0000 7f310fb5f700 1 -- 172.21.15.76:0/1395521911 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f310810c8a0 con 0x7f31080ffe80 2024-06-02T04:49:12.419 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.419+0000 7f30feffd700 1 -- 172.21.15.76:0/1395521911 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v82) v1 ==== 100+0+11 (secure 0 0 0) 0x7f30f8099a50 con 0x7f31080ffe80 2024-06-02T04:49:12.419 INFO:teuthology.orchestra.run.smithi076.stdout:pg_num: 64 2024-06-02T04:49:12.421 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.421+0000 7f310fb5f700 1 -- 172.21.15.76:0/1395521911 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f30f40a11b0 msgr2=0x7f30f40a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:12.421 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.421+0000 7f310fb5f700 1 --2- 172.21.15.76:0/1395521911 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f30f40a11b0 0x7f30f40a3670 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f310400b5c0 tx=0x7f3104005fb0 comp rx=0 tx=0).stop 2024-06-02T04:49:12.421 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.421+0000 7f310fb5f700 1 -- 172.21.15.76:0/1395521911 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f31080ffe80 msgr2=0x7f3108196d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:12.421 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.421+0000 7f310fb5f700 1 --2- 172.21.15.76:0/1395521911 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f31080ffe80 0x7f3108196d90 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f30f800c9b0 tx=0x7f30f800cd70 comp rx=0 tx=0).stop 2024-06-02T04:49:12.422 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.421+0000 7f310fb5f700 1 -- 172.21.15.76:0/1395521911 shutdown_connections 2024-06-02T04:49:12.422 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.421+0000 7f310fb5f700 1 --2- 172.21.15.76:0/1395521911 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3108101990 0x7f310819e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:12.422 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.421+0000 7f310fb5f700 1 --2- 172.21.15.76:0/1395521911 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f31080ffe80 0x7f3108196d90 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:12.422 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.421+0000 7f310fb5f700 1 --2- 172.21.15.76:0/1395521911 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f30f40a11b0 0x7f30f40a3670 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:12.422 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.421+0000 7f310fb5f700 1 --2- 172.21.15.76:0/1395521911 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3108100fd0 0x7f31081972d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:12.422 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.421+0000 7f310fb5f700 1 -- 172.21.15.76:0/1395521911 >> 172.21.15.76:0/1395521911 conn(0x7f31080fb3f0 msgr2=0x7f3108104380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:12.422 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.421+0000 7f310fb5f700 1 -- 172.21.15.76:0/1395521911 shutdown_connections 2024-06-02T04:49:12.422 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.421+0000 7f310fb5f700 1 -- 172.21.15.76:0/1395521911 wait complete. 2024-06-02T04:49:12.434 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-06-02T04:49:12.560 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.559+0000 7fbaca5ed700 1 -- 172.21.15.76:0/3005524944 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbac41021f0 msgr2=0x7fbac4102650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:12.560 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.559+0000 7fbaca5ed700 1 --2- 172.21.15.76:0/3005524944 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbac41021f0 0x7fbac4102650 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fbab8009990 tx=0x7fbab8009ca0 comp rx=0 tx=0).stop 2024-06-02T04:49:12.560 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.559+0000 7fbaca5ed700 1 -- 172.21.15.76:0/3005524944 shutdown_connections 2024-06-02T04:49:12.560 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.559+0000 7fbaca5ed700 1 --2- 172.21.15.76:0/3005524944 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbac4102b90 0x7fbac4109440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:12.560 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.559+0000 7fbaca5ed700 1 --2- 172.21.15.76:0/3005524944 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbac40ff220 0x7fbac40ff640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:12.560 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.559+0000 7fbaca5ed700 1 --2- 172.21.15.76:0/3005524944 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbac41021f0 0x7fbac4102650 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:12.561 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.559+0000 7fbaca5ed700 1 -- 172.21.15.76:0/3005524944 >> 172.21.15.76:0/3005524944 conn(0x7fbac40fab50 msgr2=0x7fbac40fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:12.561 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.560+0000 7fbaca5ed700 1 -- 172.21.15.76:0/3005524944 shutdown_connections 2024-06-02T04:49:12.561 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.560+0000 7fbaca5ed700 1 -- 172.21.15.76:0/3005524944 wait complete. 2024-06-02T04:49:12.561 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.560+0000 7fbaca5ed700 1 Processor -- start 2024-06-02T04:49:12.561 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.560+0000 7fbaca5ed700 1 -- start start 2024-06-02T04:49:12.563 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.560+0000 7fbaca5ed700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbac40ff220 0x7fbac4101b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:12.563 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.560+0000 7fbaca5ed700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbac41021f0 0x7fbac41001a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:12.563 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.560+0000 7fbaca5ed700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbac4102b90 0x7fbac41006e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:12.563 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.560+0000 7fbaca5ed700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbac4100e80 con 0x7fbac4102b90 2024-06-02T04:49:12.563 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.560+0000 7fbaca5ed700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbac4100ff0 con 0x7fbac40ff220 2024-06-02T04:49:12.563 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.560+0000 7fbaca5ed700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbac41a0eb0 con 0x7fbac41021f0 2024-06-02T04:49:12.563 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.561+0000 7fbac8b8a700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbac4102b90 0x7fbac41006e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:12.563 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.561+0000 7fbac8b8a700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbac4102b90 0x7fbac41006e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:38268/0 (socket says 172.21.15.76:38268) 2024-06-02T04:49:12.563 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.561+0000 7fbac8b8a700 1 -- 172.21.15.76:0/1696389451 learned_addr learned my addr 172.21.15.76:0/1696389451 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:49:12.563 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.561+0000 7fbac37fe700 1 --2- 172.21.15.76:0/1696389451 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbac41021f0 0x7fbac41001a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:12.564 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.561+0000 7fbac3fff700 1 --2- 172.21.15.76:0/1696389451 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbac40ff220 0x7fbac4101b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:12.564 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.561+0000 7fbac8b8a700 1 -- 172.21.15.76:0/1696389451 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbac41021f0 msgr2=0x7fbac41001a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:12.564 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.561+0000 7fbac8b8a700 1 --2- 172.21.15.76:0/1696389451 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbac41021f0 0x7fbac41001a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:12.564 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.561+0000 7fbac8b8a700 1 -- 172.21.15.76:0/1696389451 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbac40ff220 msgr2=0x7fbac4101b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:12.564 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.561+0000 7fbac8b8a700 1 --2- 172.21.15.76:0/1696389451 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbac40ff220 0x7fbac4101b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:12.564 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.561+0000 7fbac8b8a700 1 -- 172.21.15.76:0/1696389451 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbab80095f0 con 0x7fbac4102b90 2024-06-02T04:49:12.564 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.561+0000 7fbac8b8a700 1 --2- 172.21.15.76:0/1696389451 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbac4102b90 0x7fbac41006e0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fbabc00ef30 tx=0x7fbabc00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:12.564 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.561+0000 7fbac17fa700 1 -- 172.21.15.76:0/1696389451 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbabc018070 con 0x7fbac4102b90 2024-06-02T04:49:12.564 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.561+0000 7fbac17fa700 1 -- 172.21.15.76:0/1696389451 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbabc00f040 con 0x7fbac4102b90 2024-06-02T04:49:12.564 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.561+0000 7fbaca5ed700 1 -- 172.21.15.76:0/1696389451 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbac41a10e0 con 0x7fbac4102b90 2024-06-02T04:49:12.564 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.561+0000 7fbac17fa700 1 -- 172.21.15.76:0/1696389451 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbabc00cc10 con 0x7fbac4102b90 2024-06-02T04:49:12.564 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.561+0000 7fbaca5ed700 1 -- 172.21.15.76:0/1696389451 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbac41a15a0 con 0x7fbac4102b90 2024-06-02T04:49:12.564 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.562+0000 7fbaca5ed700 1 -- 172.21.15.76:0/1696389451 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbac41084d0 con 0x7fbac4102b90 2024-06-02T04:49:12.565 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.563+0000 7fbac17fa700 1 -- 172.21.15.76:0/1696389451 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fbabc007500 con 0x7fbac4102b90 2024-06-02T04:49:12.565 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.564+0000 7fbac17fa700 1 --2- 172.21.15.76:0/1696389451 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fbaac0a11b0 0x7fbaac0a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:12.565 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.564+0000 7fbac3fff700 1 --2- 172.21.15.76:0/1696389451 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fbaac0a11b0 0x7fbaac0a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:12.565 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.564+0000 7fbac17fa700 1 -- 172.21.15.76:0/1696389451 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fbabc0cc8e0 con 0x7fbac4102b90 2024-06-02T04:49:12.565 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.564+0000 7fbac3fff700 1 --2- 172.21.15.76:0/1696389451 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fbaac0a11b0 0x7fbaac0a3670 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fbac4067df0 tx=0x7fbab400b5b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:12.568 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.568+0000 7fbac17fa700 1 -- 172.21.15.76:0/1696389451 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fbabc095c30 con 0x7fbac4102b90 2024-06-02T04:49:12.764 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.764+0000 7fbaca5ed700 1 -- 172.21.15.76:0/1696389451 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fbac410c660 con 0x7fbac4102b90 2024-06-02T04:49:12.765 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.764+0000 7fbac17fa700 1 -- 172.21.15.76:0/1696389451 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v82) v1 ==== 103+0+11 (secure 0 0 0) 0x7fbabc099250 con 0x7fbac4102b90 2024-06-02T04:49:12.765 INFO:teuthology.orchestra.run.smithi076.stdout:pg_num: 32 2024-06-02T04:49:12.767 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.767+0000 7fbaca5ed700 1 -- 172.21.15.76:0/1696389451 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fbaac0a11b0 msgr2=0x7fbaac0a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:12.767 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.767+0000 7fbaca5ed700 1 --2- 172.21.15.76:0/1696389451 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fbaac0a11b0 0x7fbaac0a3670 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fbac4067df0 tx=0x7fbab400b5b0 comp rx=0 tx=0).stop 2024-06-02T04:49:12.767 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.767+0000 7fbaca5ed700 1 -- 172.21.15.76:0/1696389451 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbac4102b90 msgr2=0x7fbac41006e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:12.767 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.767+0000 7fbaca5ed700 1 --2- 172.21.15.76:0/1696389451 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbac4102b90 0x7fbac41006e0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fbabc00ef30 tx=0x7fbabc00c3a0 comp rx=0 tx=0).stop 2024-06-02T04:49:12.768 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.767+0000 7fbaca5ed700 1 -- 172.21.15.76:0/1696389451 shutdown_connections 2024-06-02T04:49:12.768 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.767+0000 7fbaca5ed700 1 --2- 172.21.15.76:0/1696389451 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbac4102b90 0x7fbac41006e0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:12.768 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.767+0000 7fbaca5ed700 1 --2- 172.21.15.76:0/1696389451 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fbaac0a11b0 0x7fbaac0a3670 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:12.768 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.767+0000 7fbaca5ed700 1 --2- 172.21.15.76:0/1696389451 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbac40ff220 0x7fbac4101b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:12.768 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.767+0000 7fbaca5ed700 1 --2- 172.21.15.76:0/1696389451 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbac41021f0 0x7fbac41001a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:12.768 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.767+0000 7fbaca5ed700 1 -- 172.21.15.76:0/1696389451 >> 172.21.15.76:0/1696389451 conn(0x7fbac40fab50 msgr2=0x7fbac4105610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:12.768 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.767+0000 7fbaca5ed700 1 -- 172.21.15.76:0/1696389451 shutdown_connections 2024-06-02T04:49:12.768 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.767+0000 7fbaca5ed700 1 -- 172.21.15.76:0/1696389451 wait complete. 2024-06-02T04:49:12.780 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T04:49:12.905 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.905+0000 7f31c0a94700 1 -- 172.21.15.76:0/95848102 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f31bc1018f0 msgr2=0x7f31bc1081a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:12.906 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.905+0000 7f31c0a94700 1 --2- 172.21.15.76:0/95848102 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f31bc1018f0 0x7f31bc1081a0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f31b400b0d0 tx=0x7f31b400b3e0 comp rx=0 tx=0).stop 2024-06-02T04:49:12.906 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.905+0000 7f31c0a94700 1 -- 172.21.15.76:0/95848102 shutdown_connections 2024-06-02T04:49:12.906 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.905+0000 7f31c0a94700 1 --2- 172.21.15.76:0/95848102 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f31bc1018f0 0x7f31bc1081a0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:12.906 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.905+0000 7f31c0a94700 1 --2- 172.21.15.76:0/95848102 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f31bc0ffd60 0x7f31bc100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:12.906 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.905+0000 7f31c0a94700 1 --2- 172.21.15.76:0/95848102 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f31bc100f50 0x7f31bc1013b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:12.906 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.905+0000 7f31c0a94700 1 -- 172.21.15.76:0/95848102 >> 172.21.15.76:0/95848102 conn(0x7f31bc0fb2f0 msgr2=0x7f31bc0fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:12.906 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.905+0000 7f31c0a94700 1 -- 172.21.15.76:0/95848102 shutdown_connections 2024-06-02T04:49:12.906 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.905+0000 7f31c0a94700 1 -- 172.21.15.76:0/95848102 wait complete. 2024-06-02T04:49:12.908 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.906+0000 7f31c0a94700 1 Processor -- start 2024-06-02T04:49:12.908 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.906+0000 7f31c0a94700 1 -- start start 2024-06-02T04:49:12.909 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.906+0000 7f31c0a94700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f31bc0ffd60 0x7f31bc195d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:12.909 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.906+0000 7f31c0a94700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f31bc100f50 0x7f31bc1962b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:12.909 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.906+0000 7f31c0a94700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f31bc1018f0 0x7f31bc19d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:12.909 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.906+0000 7f31c0a94700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31bc19d860 con 0x7f31bc0ffd60 2024-06-02T04:49:12.909 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.906+0000 7f31c0a94700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31bc19d9d0 con 0x7f31bc1018f0 2024-06-02T04:49:12.909 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.906+0000 7f31c0a94700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31bc19db90 con 0x7f31bc100f50 2024-06-02T04:49:12.909 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.906+0000 7f31ba59c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f31bc0ffd60 0x7f31bc195d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:12.909 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.906+0000 7f31ba59c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f31bc0ffd60 0x7f31bc195d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:38282/0 (socket says 172.21.15.76:38282) 2024-06-02T04:49:12.909 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.906+0000 7f31ba59c700 1 -- 172.21.15.76:0/3086877149 learned_addr learned my addr 172.21.15.76:0/3086877149 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:49:12.909 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.906+0000 7f31bad9d700 1 --2- 172.21.15.76:0/3086877149 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f31bc1018f0 0x7f31bc19d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:12.909 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.907+0000 7f31b1d9b700 1 --2- 172.21.15.76:0/3086877149 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f31bc100f50 0x7f31bc1962b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:12.909 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.907+0000 7f31ba59c700 1 -- 172.21.15.76:0/3086877149 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f31bc100f50 msgr2=0x7f31bc1962b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:12.909 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.907+0000 7f31ba59c700 1 --2- 172.21.15.76:0/3086877149 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f31bc100f50 0x7f31bc1962b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:12.910 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.907+0000 7f31ba59c700 1 -- 172.21.15.76:0/3086877149 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f31bc1018f0 msgr2=0x7f31bc19d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:12.910 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.907+0000 7f31ba59c700 1 --2- 172.21.15.76:0/3086877149 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f31bc1018f0 0x7f31bc19d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:12.910 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.907+0000 7f31ba59c700 1 -- 172.21.15.76:0/3086877149 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31b4009d00 con 0x7f31bc0ffd60 2024-06-02T04:49:12.910 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.907+0000 7f31b1d9b700 1 --2- 172.21.15.76:0/3086877149 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f31bc100f50 0x7f31bc1962b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:49:12.910 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.907+0000 7f31ba59c700 1 --2- 172.21.15.76:0/3086877149 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f31bc0ffd60 0x7f31bc195d70 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f31ac00d980 tx=0x7f31ac00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:12.910 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.907+0000 7f31b3fff700 1 -- 172.21.15.76:0/3086877149 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31ac004020 con 0x7f31bc0ffd60 2024-06-02T04:49:12.910 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.907+0000 7f31c0a94700 1 -- 172.21.15.76:0/3086877149 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31bc19de70 con 0x7f31bc0ffd60 2024-06-02T04:49:12.910 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.907+0000 7f31b3fff700 1 -- 172.21.15.76:0/3086877149 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f31ac009730 con 0x7f31bc0ffd60 2024-06-02T04:49:12.910 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.907+0000 7f31b3fff700 1 -- 172.21.15.76:0/3086877149 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31ac0039c0 con 0x7f31bc0ffd60 2024-06-02T04:49:12.910 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.907+0000 7f31c0a94700 1 -- 172.21.15.76:0/3086877149 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31bc19e310 con 0x7f31bc0ffd60 2024-06-02T04:49:12.910 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.908+0000 7f31c0a94700 1 -- 172.21.15.76:0/3086877149 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31bc1071e0 con 0x7f31bc0ffd60 2024-06-02T04:49:12.911 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.909+0000 7f31b3fff700 1 -- 172.21.15.76:0/3086877149 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f31ac0098a0 con 0x7f31bc0ffd60 2024-06-02T04:49:12.911 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.909+0000 7f31b3fff700 1 --2- 172.21.15.76:0/3086877149 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f31a80a1230 0x7f31a80a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:12.911 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.910+0000 7f31b1d9b700 1 --2- 172.21.15.76:0/3086877149 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f31a80a1230 0x7f31a80a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:12.911 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.910+0000 7f31b3fff700 1 -- 172.21.15.76:0/3086877149 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f31ac0ccab0 con 0x7f31bc0ffd60 2024-06-02T04:49:12.911 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.910+0000 7f31b1d9b700 1 --2- 172.21.15.76:0/3086877149 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f31a80a1230 0x7f31a80a36f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f31a4007900 tx=0x7f31a4008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:12.914 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:12.914+0000 7f31b3fff700 1 -- 172.21.15.76:0/3086877149 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f31ac095d70 con 0x7f31bc0ffd60 2024-06-02T04:49:13.155 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.155+0000 7f31c0a94700 1 -- 172.21.15.76:0/3086877149 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f31bc067c10 con 0x7f31bc0ffd60 2024-06-02T04:49:13.156 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.156+0000 7f31b3fff700 1 -- 172.21.15.76:0/3086877149 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+10874 (secure 0 0 0) 0x7f31ac099390 con 0x7f31bc0ffd60 2024-06-02T04:49:13.156 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:49:13.156 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6835/3029342152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3029342152},{"type":"v1","addr":"172.21.15.76:6835","nonce":3029342152}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6837/1207985317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":1207985317},{"type":"v1","addr":"172.21.15.76:6837","nonce":1207985317}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14607,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6839/928709755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":928709755},{"type":"v1","addr":"172.21.15.76:6839","nonce":928709755}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6841/4162178633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6840","nonce":4162178633},{"type":"v1","addr":"172.21.15.76:6841","nonce":4162178633}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/1543944863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":1543944863},{"type":"v1","addr":"172.21.15.119:6833","nonce":1543944863}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24418,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6833/1527921393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1527921393},{"type":"v1","addr":"172.21.15.192:6833","nonce":1527921393}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-02T04:48:02.662812+0000","modified":"2024-06-02T04:48:28.274836+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24491,"mds_1":24475,"mds_2":24463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24434":{"gid":24434,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6835/2746840347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":2746840347},{"type":"v1","addr":"172.21.15.119:6835","nonce":2746840347}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24451":{"gid":24451,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.192:6835/783181340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":783181340},{"type":"v1","addr":"172.21.15.192:6835","nonce":783181340}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24458":{"gid":24458,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6837/2171687478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":2171687478},{"type":"v1","addr":"172.21.15.119:6837","nonce":2171687478}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24463":{"gid":24463,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":11,"addr":"172.21.15.192:6837/960773710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":960773710},{"type":"v1","addr":"172.21.15.192:6837","nonce":960773710}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24475":{"gid":24475,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.192:6839/3978681402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":3978681402},{"type":"v1","addr":"172.21.15.192:6839","nonce":3978681402}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.119:6839/4098406903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":4098406903},{"type":"v1","addr":"172.21.15.119:6839","nonce":4098406903}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-06-02T04:49:13.159 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.158+0000 7f31c0a94700 1 -- 172.21.15.76:0/3086877149 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f31a80a1230 msgr2=0x7f31a80a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:13.159 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.158+0000 7f31c0a94700 1 --2- 172.21.15.76:0/3086877149 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f31a80a1230 0x7f31a80a36f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f31a4007900 tx=0x7f31a4008040 comp rx=0 tx=0).stop 2024-06-02T04:49:13.159 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.158+0000 7f31c0a94700 1 -- 172.21.15.76:0/3086877149 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f31bc0ffd60 msgr2=0x7f31bc195d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:13.159 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.158+0000 7f31c0a94700 1 --2- 172.21.15.76:0/3086877149 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f31bc0ffd60 0x7f31bc195d70 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f31ac00d980 tx=0x7f31ac00dc90 comp rx=0 tx=0).stop 2024-06-02T04:49:13.159 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.158+0000 7f31c0a94700 1 -- 172.21.15.76:0/3086877149 shutdown_connections 2024-06-02T04:49:13.159 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.158+0000 7f31c0a94700 1 --2- 172.21.15.76:0/3086877149 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f31a80a1230 0x7f31a80a36f0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:13.159 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.158+0000 7f31c0a94700 1 --2- 172.21.15.76:0/3086877149 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f31bc1018f0 0x7f31bc19d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:13.159 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.158+0000 7f31c0a94700 1 --2- 172.21.15.76:0/3086877149 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f31bc0ffd60 0x7f31bc195d70 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:13.159 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.158+0000 7f31c0a94700 1 --2- 172.21.15.76:0/3086877149 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f31bc100f50 0x7f31bc1962b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:13.159 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.158+0000 7f31c0a94700 1 -- 172.21.15.76:0/3086877149 >> 172.21.15.76:0/3086877149 conn(0x7f31bc0fb2f0 msgr2=0x7f31bc104320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:13.159 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.158+0000 7f31c0a94700 1 -- 172.21.15.76:0/3086877149 shutdown_connections 2024-06-02T04:49:13.159 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.158+0000 7f31c0a94700 1 -- 172.21.15.76:0/3086877149 wait complete. 2024-06-02T04:49:13.160 INFO:teuthology.orchestra.run.smithi076.stderr:dumped fsmap epoch 24 2024-06-02T04:49:13.170 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:12 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/763272562' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-06-02T04:49:13.170 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:12 smithi076 ceph-mon[42935]: pgmap v255: 129 pgs: 2 peering, 127 active+clean; 639 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s; 0 B/s, 0 objects/s recovering 2024-06-02T04:49:13.170 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:12 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/1395521911' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-06-02T04:49:13.170 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:12 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/1696389451' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-06-02T04:49:13.171 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-02T04:49:13.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:12 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/763272562' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-06-02T04:49:13.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:12 smithi192 ceph-mon[47933]: pgmap v255: 129 pgs: 2 peering, 127 active+clean; 639 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s; 0 B/s, 0 objects/s recovering 2024-06-02T04:49:13.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:12 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/1395521911' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-06-02T04:49:13.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:12 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/1696389451' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-06-02T04:49:13.293 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.293+0000 7fed29b09700 1 -- 172.21.15.76:0/1503026443 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fed24100f50 msgr2=0x7fed241013b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:13.294 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.293+0000 7fed29b09700 1 --2- 172.21.15.76:0/1503026443 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fed24100f50 0x7fed241013b0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fed140099c0 tx=0x7fed14009cd0 comp rx=0 tx=0).stop 2024-06-02T04:49:13.294 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.293+0000 7fed29b09700 1 -- 172.21.15.76:0/1503026443 shutdown_connections 2024-06-02T04:49:13.294 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.293+0000 7fed29b09700 1 --2- 172.21.15.76:0/1503026443 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fed241018f0 0x7fed241081a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:13.294 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.293+0000 7fed29b09700 1 --2- 172.21.15.76:0/1503026443 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed240ffd60 0x7fed24100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:13.294 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.293+0000 7fed29b09700 1 --2- 172.21.15.76:0/1503026443 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fed24100f50 0x7fed241013b0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:13.294 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.293+0000 7fed29b09700 1 -- 172.21.15.76:0/1503026443 >> 172.21.15.76:0/1503026443 conn(0x7fed240fb2f0 msgr2=0x7fed240fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:13.294 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.293+0000 7fed29b09700 1 -- 172.21.15.76:0/1503026443 shutdown_connections 2024-06-02T04:49:13.294 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.293+0000 7fed29b09700 1 -- 172.21.15.76:0/1503026443 wait complete. 2024-06-02T04:49:13.294 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.294+0000 7fed29b09700 1 Processor -- start 2024-06-02T04:49:13.296 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.294+0000 7fed29b09700 1 -- start start 2024-06-02T04:49:13.296 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.294+0000 7fed29b09700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fed240ffd60 0x7fed24196d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:13.297 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.294+0000 7fed29b09700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed24100f50 0x7fed24197280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:13.297 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.294+0000 7fed29b09700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fed241018f0 0x7fed2419e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:13.297 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.294+0000 7fed29b09700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed2419e830 con 0x7fed240ffd60 2024-06-02T04:49:13.297 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.294+0000 7fed29b09700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed2419e9a0 con 0x7fed24100f50 2024-06-02T04:49:13.297 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.294+0000 7fed29b09700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed2419eb60 con 0x7fed241018f0 2024-06-02T04:49:13.297 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.294+0000 7fed237fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fed240ffd60 0x7fed24196d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:13.297 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.294+0000 7fed237fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fed240ffd60 0x7fed24196d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:38312/0 (socket says 172.21.15.76:38312) 2024-06-02T04:49:13.297 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.294+0000 7fed237fe700 1 -- 172.21.15.76:0/947969051 learned_addr learned my addr 172.21.15.76:0/947969051 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:49:13.297 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.294+0000 7fed23fff700 1 --2- 172.21.15.76:0/947969051 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fed241018f0 0x7fed2419e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:13.297 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.294+0000 7fed22ffd700 1 --2- 172.21.15.76:0/947969051 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed24100f50 0x7fed24197280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:13.297 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.294+0000 7fed237fe700 1 -- 172.21.15.76:0/947969051 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fed241018f0 msgr2=0x7fed2419e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:13.297 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.294+0000 7fed237fe700 1 --2- 172.21.15.76:0/947969051 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fed241018f0 0x7fed2419e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:13.297 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.294+0000 7fed237fe700 1 -- 172.21.15.76:0/947969051 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed24100f50 msgr2=0x7fed24197280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:13.298 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.294+0000 7fed237fe700 1 --2- 172.21.15.76:0/947969051 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed24100f50 0x7fed24197280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:13.298 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.294+0000 7fed237fe700 1 -- 172.21.15.76:0/947969051 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed140095f0 con 0x7fed240ffd60 2024-06-02T04:49:13.298 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.294+0000 7fed22ffd700 1 --2- 172.21.15.76:0/947969051 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed24100f50 0x7fed24197280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:49:13.298 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.295+0000 7fed237fe700 1 --2- 172.21.15.76:0/947969051 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fed240ffd60 0x7fed24196d40 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fed1800e970 tx=0x7fed1800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:13.298 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.295+0000 7fed20ff9700 1 -- 172.21.15.76:0/947969051 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed18009790 con 0x7fed240ffd60 2024-06-02T04:49:13.298 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.295+0000 7fed20ff9700 1 -- 172.21.15.76:0/947969051 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fed1800eec0 con 0x7fed240ffd60 2024-06-02T04:49:13.298 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.295+0000 7fed29b09700 1 -- 172.21.15.76:0/947969051 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed2419ee40 con 0x7fed240ffd60 2024-06-02T04:49:13.298 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.295+0000 7fed20ff9700 1 -- 172.21.15.76:0/947969051 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed18003c10 con 0x7fed240ffd60 2024-06-02T04:49:13.298 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.295+0000 7fed29b09700 1 -- 172.21.15.76:0/947969051 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed2419f260 con 0x7fed240ffd60 2024-06-02T04:49:13.298 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.296+0000 7fed29b09700 1 -- 172.21.15.76:0/947969051 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed24067c10 con 0x7fed240ffd60 2024-06-02T04:49:13.299 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.297+0000 7fed20ff9700 1 -- 172.21.15.76:0/947969051 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fed18004870 con 0x7fed240ffd60 2024-06-02T04:49:13.299 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.297+0000 7fed20ff9700 1 --2- 172.21.15.76:0/947969051 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fed0c0a11b0 0x7fed0c0a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:13.299 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.297+0000 7fed20ff9700 1 -- 172.21.15.76:0/947969051 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fed18014070 con 0x7fed240ffd60 2024-06-02T04:49:13.299 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.297+0000 7fed22ffd700 1 --2- 172.21.15.76:0/947969051 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fed0c0a11b0 0x7fed0c0a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:13.299 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.298+0000 7fed22ffd700 1 --2- 172.21.15.76:0/947969051 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fed0c0a11b0 0x7fed0c0a3670 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fed1400b580 tx=0x7fed1401a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:13.301 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.301+0000 7fed20ff9700 1 -- 172.21.15.76:0/947969051 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fed18096450 con 0x7fed240ffd60 2024-06-02T04:49:13.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:12 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/763272562' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-06-02T04:49:13.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:12 smithi119 ceph-mon[46633]: pgmap v255: 129 pgs: 2 peering, 127 active+clean; 639 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s; 0 B/s, 0 objects/s recovering 2024-06-02T04:49:13.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:12 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/1395521911' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-06-02T04:49:13.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:12 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/1696389451' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-06-02T04:49:13.503 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.503+0000 7fed29b09700 1 -- 172.21.15.76:0/947969051 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fed2410b420 con 0x7fed240ffd60 2024-06-02T04:49:13.505 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.505+0000 7fed20ff9700 1 -- 172.21.15.76:0/947969051 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+24453 (secure 0 0 0) 0x7fed1809ee60 con 0x7fed240ffd60 2024-06-02T04:49:13.505 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:49:13.505 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":82,"fsid":"60ab6d30-209a-11ef-bc9b-c7b262605968","created":"2024-06-02T04:42:21.007333+0000","modified":"2024-06-02T04:49:07.862801+0000","last_up_change":"2024-06-02T04:47:29.822242+0000","last_in_change":"2024-06-02T04:47:14.253449+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T04:44:56.408602+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-02T04:48:01.194954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-02T04:48:01.828863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-02T04:48:04.916565+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"33a51ba2-be5c-41d0-b5d1-8d6039f2ca4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6802","nonce":2869602045},{"type":"v1","addr":"172.21.15.76:6803","nonce":2869602045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6804","nonce":2869602045},{"type":"v1","addr":"172.21.15.76:6805","nonce":2869602045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6808","nonce":2869602045},{"type":"v1","addr":"172.21.15.76:6809","nonce":2869602045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6806","nonce":2869602045},{"type":"v1","addr":"172.21.15.76:6807","nonce":2869602045}]},"public_addr":"172.21.15.76:6803/2869602045","cluster_addr":"172.21.15.76:6805/2869602045","heartbeat_back_addr":"172.21.15.76:6809/2869602045","heartbeat_front_addr":"172.21.15.76:6807/2869602045","state":["exists","up"]},{"osd":1,"uuid":"ace46e13-3bb7-4103-973a-6860554df8b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":2353738098},{"type":"v1","addr":"172.21.15.119:6801","nonce":2353738098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":2353738098},{"type":"v1","addr":"172.21.15.119:6803","nonce":2353738098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":2353738098},{"type":"v1","addr":"172.21.15.119:6807","nonce":2353738098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":2353738098},{"type":"v1","addr":"172.21.15.119:6805","nonce":2353738098}]},"public_addr":"172.21.15.119:6801/2353738098","cluster_addr":"172.21.15.119:6803/2353738098","heartbeat_back_addr":"172.21.15.119:6807/2353738098","heartbeat_front_addr":"172.21.15.119:6805/2353738098","state":["exists","up"]},{"osd":2,"uuid":"4addc09e-77a9-428a-bcc4-38194f486cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":3206918546},{"type":"v1","addr":"172.21.15.192:6801","nonce":3206918546}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":3206918546},{"type":"v1","addr":"172.21.15.192:6803","nonce":3206918546}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":3206918546},{"type":"v1","addr":"172.21.15.192:6807","nonce":3206918546}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":3206918546},{"type":"v1","addr":"172.21.15.192:6805","nonce":3206918546}]},"public_addr":"172.21.15.192:6801/3206918546","cluster_addr":"172.21.15.192:6803/3206918546","heartbeat_back_addr":"172.21.15.192:6807/3206918546","heartbeat_front_addr":"172.21.15.192:6805/3206918546","state":["exists","up"]},{"osd":3,"uuid":"dc525518-82c6-49ed-8ca8-e3bd5bfc18d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6810","nonce":3747864233},{"type":"v1","addr":"172.21.15.76:6811","nonce":3747864233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6812","nonce":3747864233},{"type":"v1","addr":"172.21.15.76:6813","nonce":3747864233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6816","nonce":3747864233},{"type":"v1","addr":"172.21.15.76:6817","nonce":3747864233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6814","nonce":3747864233},{"type":"v1","addr":"172.21.15.76:6815","nonce":3747864233}]},"public_addr":"172.21.15.76:6811/3747864233","cluster_addr":"172.21.15.76:6813/3747864233","heartbeat_back_addr":"172.21.15.76:6817/3747864233","heartbeat_front_addr":"172.21.15.76:6815/3747864233","state":["exists","up"]},{"osd":4,"uuid":"eef293d0-cb87-47b3-9751-c6437a1cf079","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":2571629047},{"type":"v1","addr":"172.21.15.119:6809","nonce":2571629047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":2571629047},{"type":"v1","addr":"172.21.15.119:6811","nonce":2571629047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":2571629047},{"type":"v1","addr":"172.21.15.119:6815","nonce":2571629047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":2571629047},{"type":"v1","addr":"172.21.15.119:6813","nonce":2571629047}]},"public_addr":"172.21.15.119:6809/2571629047","cluster_addr":"172.21.15.119:6811/2571629047","heartbeat_back_addr":"172.21.15.119:6815/2571629047","heartbeat_front_addr":"172.21.15.119:6813/2571629047","state":["exists","up"]},{"osd":5,"uuid":"60eb8c6e-766c-49d0-9997-44f85776b3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3285065416},{"type":"v1","addr":"172.21.15.192:6809","nonce":3285065416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":3285065416},{"type":"v1","addr":"172.21.15.192:6811","nonce":3285065416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3285065416},{"type":"v1","addr":"172.21.15.192:6815","nonce":3285065416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":3285065416},{"type":"v1","addr":"172.21.15.192:6813","nonce":3285065416}]},"public_addr":"172.21.15.192:6809/3285065416","cluster_addr":"172.21.15.192:6811/3285065416","heartbeat_back_addr":"172.21.15.192:6815/3285065416","heartbeat_front_addr":"172.21.15.192:6813/3285065416","state":["exists","up"]},{"osd":6,"uuid":"e6dc8b9d-dd06-4870-a506-def8201b7e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6818","nonce":2951381580},{"type":"v1","addr":"172.21.15.76:6819","nonce":2951381580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6820","nonce":2951381580},{"type":"v1","addr":"172.21.15.76:6821","nonce":2951381580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6824","nonce":2951381580},{"type":"v1","addr":"172.21.15.76:6825","nonce":2951381580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6822","nonce":2951381580},{"type":"v1","addr":"172.21.15.76:6823","nonce":2951381580}]},"public_addr":"172.21.15.76:6819/2951381580","cluster_addr":"172.21.15.76:6821/2951381580","heartbeat_back_addr":"172.21.15.76:6825/2951381580","heartbeat_front_addr":"172.21.15.76:6823/2951381580","state":["exists","up"]},{"osd":7,"uuid":"2f5dccb3-39a1-4f25-8715-fa264d59db97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1802558756},{"type":"v1","addr":"172.21.15.119:6817","nonce":1802558756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1802558756},{"type":"v1","addr":"172.21.15.119:6819","nonce":1802558756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1802558756},{"type":"v1","addr":"172.21.15.119:6823","nonce":1802558756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1802558756},{"type":"v1","addr":"172.21.15.119:6821","nonce":1802558756}]},"public_addr":"172.21.15.119:6817/1802558756","cluster_addr":"172.21.15.119:6819/1802558756","heartbeat_back_addr":"172.21.15.119:6823/1802558756","heartbeat_front_addr":"172.21.15.119:6821/1802558756","state":["exists","up"]},{"osd":8,"uuid":"39b6ccd0-16e7-4cd5-87e0-d827e9172984","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":1214972276},{"type":"v1","addr":"172.21.15.192:6817","nonce":1214972276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":1214972276},{"type":"v1","addr":"172.21.15.192:6819","nonce":1214972276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":1214972276},{"type":"v1","addr":"172.21.15.192:6823","nonce":1214972276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":1214972276},{"type":"v1","addr":"172.21.15.192:6821","nonce":1214972276}]},"public_addr":"172.21.15.192:6817/1214972276","cluster_addr":"172.21.15.192:6819/1214972276","heartbeat_back_addr":"172.21.15.192:6823/1214972276","heartbeat_front_addr":"172.21.15.192:6821/1214972276","state":["exists","up"]},{"osd":9,"uuid":"851b2155-07bd-45de-bfe0-53021fda733f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6826","nonce":3095501821},{"type":"v1","addr":"172.21.15.76:6827","nonce":3095501821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6828","nonce":3095501821},{"type":"v1","addr":"172.21.15.76:6829","nonce":3095501821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":3095501821},{"type":"v1","addr":"172.21.15.76:6833","nonce":3095501821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6830","nonce":3095501821},{"type":"v1","addr":"172.21.15.76:6831","nonce":3095501821}]},"public_addr":"172.21.15.76:6827/3095501821","cluster_addr":"172.21.15.76:6829/3095501821","heartbeat_back_addr":"172.21.15.76:6833/3095501821","heartbeat_front_addr":"172.21.15.76:6831/3095501821","state":["exists","up"]},{"osd":10,"uuid":"e4b18e7e-bddf-4dd4-84f6-7902ea327cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":4082130894},{"type":"v1","addr":"172.21.15.119:6825","nonce":4082130894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":4082130894},{"type":"v1","addr":"172.21.15.119:6827","nonce":4082130894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":4082130894},{"type":"v1","addr":"172.21.15.119:6831","nonce":4082130894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":4082130894},{"type":"v1","addr":"172.21.15.119:6829","nonce":4082130894}]},"public_addr":"172.21.15.119:6825/4082130894","cluster_addr":"172.21.15.119:6827/4082130894","heartbeat_back_addr":"172.21.15.119:6831/4082130894","heartbeat_front_addr":"172.21.15.119:6829/4082130894","state":["exists","up"]},{"osd":11,"uuid":"54567e18-920c-4ae9-9557-0efba5a1a820","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":439693921},{"type":"v1","addr":"172.21.15.192:6825","nonce":439693921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":439693921},{"type":"v1","addr":"172.21.15.192:6827","nonce":439693921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":439693921},{"type":"v1","addr":"172.21.15.192:6831","nonce":439693921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":439693921},{"type":"v1","addr":"172.21.15.192:6829","nonce":439693921}]},"public_addr":"172.21.15.192:6825/439693921","cluster_addr":"172.21.15.192:6827/439693921","heartbeat_back_addr":"172.21.15.192:6831/439693921","heartbeat_front_addr":"172.21.15.192:6829/439693921","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:44:19.922390+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:44:36.895563+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:44:53.699019+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:45:11.167404+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:45:27.955899+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:45:44.850368+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:46:02.003588+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:46:19.019217+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:46:36.189670+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:46:53.919365+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:47:11.563053+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:47:28.822443+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":4}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.8","mappings":[{"from":5,"to":10}]},{"pgid":"4.14","mappings":[{"from":9,"to":8}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.76:6801/4200406736":"2024-06-03T04:43:06.092916+0000","172.21.15.76:6800/4200406736":"2024-06-03T04:43:06.092916+0000","172.21.15.76:0/1524144593":"2024-06-03T04:43:06.092916+0000","172.21.15.76:0/3269372590":"2024-06-03T04:43:06.092916+0000","172.21.15.76:0/3570893846":"2024-06-03T04:42:44.872236+0000","172.21.15.76:0/902035790":"2024-06-03T04:43:06.092916+0000","172.21.15.76:6800/2550846765":"2024-06-03T04:42:44.872236+0000","172.21.15.76:6801/2550846765":"2024-06-03T04:42:44.872236+0000","172.21.15.76:0/2646712763":"2024-06-03T04:42:44.872236+0000","172.21.15.76:0/964578813":"2024-06-03T04:42:44.872236+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T04:49:13.507 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.507+0000 7fed29b09700 1 -- 172.21.15.76:0/947969051 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fed0c0a11b0 msgr2=0x7fed0c0a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:13.507 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.507+0000 7fed29b09700 1 --2- 172.21.15.76:0/947969051 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fed0c0a11b0 0x7fed0c0a3670 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fed1400b580 tx=0x7fed1401a040 comp rx=0 tx=0).stop 2024-06-02T04:49:13.507 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.507+0000 7fed29b09700 1 -- 172.21.15.76:0/947969051 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fed240ffd60 msgr2=0x7fed24196d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:13.507 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.507+0000 7fed29b09700 1 --2- 172.21.15.76:0/947969051 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fed240ffd60 0x7fed24196d40 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fed1800e970 tx=0x7fed1800ec80 comp rx=0 tx=0).stop 2024-06-02T04:49:13.508 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.507+0000 7fed29b09700 1 -- 172.21.15.76:0/947969051 shutdown_connections 2024-06-02T04:49:13.508 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.507+0000 7fed29b09700 1 --2- 172.21.15.76:0/947969051 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fed241018f0 0x7fed2419e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:13.508 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.507+0000 7fed29b09700 1 --2- 172.21.15.76:0/947969051 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fed240ffd60 0x7fed24196d40 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:13.508 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.507+0000 7fed29b09700 1 --2- 172.21.15.76:0/947969051 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fed0c0a11b0 0x7fed0c0a3670 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:13.508 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.507+0000 7fed29b09700 1 --2- 172.21.15.76:0/947969051 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed24100f50 0x7fed24197280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:13.508 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.507+0000 7fed29b09700 1 -- 172.21.15.76:0/947969051 >> 172.21.15.76:0/947969051 conn(0x7fed240fb2f0 msgr2=0x7fed24067ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:13.508 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.507+0000 7fed29b09700 1 -- 172.21.15.76:0/947969051 shutdown_connections 2024-06-02T04:49:13.508 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.507+0000 7fed29b09700 1 -- 172.21.15.76:0/947969051 wait complete. 2024-06-02T04:49:13.520 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T04:49:13.645 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.642+0000 7f8227dee700 1 -- 172.21.15.76:0/2580399905 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f82201013e0 msgr2=0x7f8220101800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:13.645 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.642+0000 7f8227dee700 1 --2- 172.21.15.76:0/2580399905 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f82201013e0 0x7f8220101800 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f821c009990 tx=0x7f821c009ca0 comp rx=0 tx=0).stop 2024-06-02T04:49:13.645 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.642+0000 7f8227dee700 1 -- 172.21.15.76:0/2580399905 shutdown_connections 2024-06-02T04:49:13.645 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.642+0000 7f8227dee700 1 --2- 172.21.15.76:0/2580399905 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8220100960 0x7f8220108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:13.645 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.642+0000 7f8227dee700 1 --2- 172.21.15.76:0/2580399905 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f82201013e0 0x7f8220101800 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:13.645 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.643+0000 7f8227dee700 1 --2- 172.21.15.76:0/2580399905 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f82200fffa0 0x7f8220100420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:13.646 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.643+0000 7f8227dee700 1 -- 172.21.15.76:0/2580399905 >> 172.21.15.76:0/2580399905 conn(0x7f82200faa70 msgr2=0x7f82200fce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:13.646 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.643+0000 7f8227dee700 1 -- 172.21.15.76:0/2580399905 shutdown_connections 2024-06-02T04:49:13.646 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.643+0000 7f8227dee700 1 -- 172.21.15.76:0/2580399905 wait complete. 2024-06-02T04:49:13.646 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.643+0000 7f8227dee700 1 Processor -- start 2024-06-02T04:49:13.646 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.643+0000 7f8227dee700 1 -- start start 2024-06-02T04:49:13.646 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.643+0000 7f8227dee700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f82200fffa0 0x7f8220195bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:13.646 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.643+0000 7f8227dee700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8220100960 0x7f8220196130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:13.646 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.643+0000 7f8227dee700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f82201013e0 0x7f822019d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:13.646 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.643+0000 7f8227dee700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f822019d720 con 0x7f82200fffa0 2024-06-02T04:49:13.646 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.643+0000 7f8227dee700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f822019d860 con 0x7f8220100960 2024-06-02T04:49:13.646 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.643+0000 7f8227dee700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f822019d9f0 con 0x7f82201013e0 2024-06-02T04:49:13.646 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.643+0000 7f8225b8a700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f82200fffa0 0x7f8220195bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:13.647 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.644+0000 7f8225b8a700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f82200fffa0 0x7f8220195bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:38318/0 (socket says 172.21.15.76:38318) 2024-06-02T04:49:13.647 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.644+0000 7f8225b8a700 1 -- 172.21.15.76:0/736033206 learned_addr learned my addr 172.21.15.76:0/736033206 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:49:13.647 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.644+0000 7f8225389700 1 --2- 172.21.15.76:0/736033206 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8220100960 0x7f8220196130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:13.647 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.644+0000 7f822638b700 1 --2- 172.21.15.76:0/736033206 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f82201013e0 0x7f822019d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:13.647 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.644+0000 7f8225b8a700 1 -- 172.21.15.76:0/736033206 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f82201013e0 msgr2=0x7f822019d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:13.647 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.644+0000 7f8225b8a700 1 --2- 172.21.15.76:0/736033206 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f82201013e0 0x7f822019d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:13.647 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.644+0000 7f8225b8a700 1 -- 172.21.15.76:0/736033206 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8220100960 msgr2=0x7f8220196130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:13.647 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.644+0000 7f8225b8a700 1 --2- 172.21.15.76:0/736033206 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8220100960 0x7f8220196130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:13.647 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.644+0000 7f8225b8a700 1 -- 172.21.15.76:0/736033206 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f821c0095f0 con 0x7f82200fffa0 2024-06-02T04:49:13.647 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.644+0000 7f822638b700 1 --2- 172.21.15.76:0/736033206 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f82201013e0 0x7f822019d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:49:13.647 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.644+0000 7f8225b8a700 1 --2- 172.21.15.76:0/736033206 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f82200fffa0 0x7f8220195bf0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f821c003b00 tx=0x7f821c003b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:13.647 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.644+0000 7f8216ffd700 1 -- 172.21.15.76:0/736033206 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f821c01d070 con 0x7f82200fffa0 2024-06-02T04:49:13.647 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.644+0000 7f8216ffd700 1 -- 172.21.15.76:0/736033206 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f821c00bd50 con 0x7f82200fffa0 2024-06-02T04:49:13.648 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.644+0000 7f8227dee700 1 -- 172.21.15.76:0/736033206 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f822019dc70 con 0x7f82200fffa0 2024-06-02T04:49:13.648 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.644+0000 7f8216ffd700 1 -- 172.21.15.76:0/736033206 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f821c005280 con 0x7f82200fffa0 2024-06-02T04:49:13.648 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.644+0000 7f8227dee700 1 -- 172.21.15.76:0/736033206 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f822019e110 con 0x7f82200fffa0 2024-06-02T04:49:13.648 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.645+0000 7f8227dee700 1 -- 172.21.15.76:0/736033206 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82200673f0 con 0x7f82200fffa0 2024-06-02T04:49:13.649 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.646+0000 7f8216ffd700 1 -- 172.21.15.76:0/736033206 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f821c004800 con 0x7f82200fffa0 2024-06-02T04:49:13.649 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.647+0000 7f8216ffd700 1 --2- 172.21.15.76:0/736033206 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f820c0a1230 0x7f820c0a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:13.649 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.647+0000 7f8225389700 1 --2- 172.21.15.76:0/736033206 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f820c0a1230 0x7f820c0a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:13.649 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.647+0000 7f8216ffd700 1 -- 172.21.15.76:0/736033206 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f821c0ce080 con 0x7f82200fffa0 2024-06-02T04:49:13.649 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.648+0000 7f8225389700 1 --2- 172.21.15.76:0/736033206 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f820c0a1230 0x7f820c0a36f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f8210005950 tx=0x7f821000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:13.651 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.651+0000 7f8216ffd700 1 -- 172.21.15.76:0/736033206 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f821c097430 con 0x7f82200fffa0 2024-06-02T04:49:13.893 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.893+0000 7f8227dee700 1 -- 172.21.15.76:0/736033206 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f82200673f0 con 0x7f82200fffa0 2024-06-02T04:49:13.894 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.894+0000 7f8216ffd700 1 -- 172.21.15.76:0/736033206 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+10874 (secure 0 0 0) 0x7f82200673f0 con 0x7f82200fffa0 2024-06-02T04:49:13.894 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:49:13.894 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6835/3029342152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3029342152},{"type":"v1","addr":"172.21.15.76:6835","nonce":3029342152}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6837/1207985317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":1207985317},{"type":"v1","addr":"172.21.15.76:6837","nonce":1207985317}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14607,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6839/928709755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":928709755},{"type":"v1","addr":"172.21.15.76:6839","nonce":928709755}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6841/4162178633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6840","nonce":4162178633},{"type":"v1","addr":"172.21.15.76:6841","nonce":4162178633}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/1543944863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":1543944863},{"type":"v1","addr":"172.21.15.119:6833","nonce":1543944863}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24418,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6833/1527921393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1527921393},{"type":"v1","addr":"172.21.15.192:6833","nonce":1527921393}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-02T04:48:02.662812+0000","modified":"2024-06-02T04:48:28.274836+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24491,"mds_1":24475,"mds_2":24463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24434":{"gid":24434,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6835/2746840347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":2746840347},{"type":"v1","addr":"172.21.15.119:6835","nonce":2746840347}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24451":{"gid":24451,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.192:6835/783181340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":783181340},{"type":"v1","addr":"172.21.15.192:6835","nonce":783181340}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24458":{"gid":24458,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6837/2171687478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":2171687478},{"type":"v1","addr":"172.21.15.119:6837","nonce":2171687478}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24463":{"gid":24463,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":11,"addr":"172.21.15.192:6837/960773710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":960773710},{"type":"v1","addr":"172.21.15.192:6837","nonce":960773710}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24475":{"gid":24475,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.192:6839/3978681402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":3978681402},{"type":"v1","addr":"172.21.15.192:6839","nonce":3978681402}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.119:6839/4098406903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":4098406903},{"type":"v1","addr":"172.21.15.119:6839","nonce":4098406903}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-06-02T04:49:13.896 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.896+0000 7f8227dee700 1 -- 172.21.15.76:0/736033206 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f820c0a1230 msgr2=0x7f820c0a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:13.896 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.896+0000 7f8227dee700 1 --2- 172.21.15.76:0/736033206 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f820c0a1230 0x7f820c0a36f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f8210005950 tx=0x7f821000b410 comp rx=0 tx=0).stop 2024-06-02T04:49:13.896 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.896+0000 7f8227dee700 1 -- 172.21.15.76:0/736033206 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f82200fffa0 msgr2=0x7f8220195bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:13.897 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.896+0000 7f8227dee700 1 --2- 172.21.15.76:0/736033206 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f82200fffa0 0x7f8220195bf0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f821c003b00 tx=0x7f821c003b30 comp rx=0 tx=0).stop 2024-06-02T04:49:13.897 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.896+0000 7f8227dee700 1 -- 172.21.15.76:0/736033206 shutdown_connections 2024-06-02T04:49:13.897 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.896+0000 7f8227dee700 1 --2- 172.21.15.76:0/736033206 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f82201013e0 0x7f822019d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:13.897 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.896+0000 7f8227dee700 1 --2- 172.21.15.76:0/736033206 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f82200fffa0 0x7f8220195bf0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:13.897 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.896+0000 7f8227dee700 1 --2- 172.21.15.76:0/736033206 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f820c0a1230 0x7f820c0a36f0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:13.897 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.896+0000 7f8227dee700 1 --2- 172.21.15.76:0/736033206 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8220100960 0x7f8220196130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:13.897 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.896+0000 7f8227dee700 1 -- 172.21.15.76:0/736033206 >> 172.21.15.76:0/736033206 conn(0x7f82200faa70 msgr2=0x7f82201044c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:13.897 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.896+0000 7f8227dee700 1 -- 172.21.15.76:0/736033206 shutdown_connections 2024-06-02T04:49:13.897 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:13.896+0000 7f8227dee700 1 -- 172.21.15.76:0/736033206 wait complete. 2024-06-02T04:49:13.897 INFO:teuthology.orchestra.run.smithi076.stderr:dumped fsmap epoch 24 2024-06-02T04:49:13.908 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-06-02T04:48:02.662812+0000', 'modified': '2024-06-02T04:48:28.274836+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24491, 'mds_1': 24475, 'mds_2': 24463}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24434': {'gid': 24434, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.119:6835/2746840347', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.119:6834', 'nonce': 2746840347}, {'type': 'v1', 'addr': '172.21.15.119:6835', 'nonce': 2746840347}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24451': {'gid': 24451, 'name': 'f', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.192:6835/783181340', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.192:6834', 'nonce': 783181340}, {'type': 'v1', 'addr': '172.21.15.192:6835', 'nonce': 783181340}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24458': {'gid': 24458, 'name': 'h', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.119:6837/2171687478', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.119:6836', 'nonce': 2171687478}, {'type': 'v1', 'addr': '172.21.15.119:6837', 'nonce': 2171687478}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24463': {'gid': 24463, 'name': 'c', 'rank': 2, 'incarnation': 22, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.192:6837/960773710', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.192:6836', 'nonce': 960773710}, {'type': 'v1', 'addr': '172.21.15.192:6837', 'nonce': 960773710}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24475': {'gid': 24475, 'name': 'i', 'rank': 1, 'incarnation': 20, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.192:6839/3978681402', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.192:6838', 'nonce': 3978681402}, {'type': 'v1', 'addr': '172.21.15.192:6839', 'nonce': 3978681402}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24491': {'gid': 24491, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.119:6839/4098406903', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.119:6838', 'nonce': 4098406903}, {'type': 'v1', 'addr': '172.21.15.119:6839', 'nonce': 4098406903}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-06-02T04:49:13.909 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-06-02T04:49:13.909 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-06-02T04:49:14.034 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.032+0000 7f2cdbd88700 1 -- 172.21.15.76:0/2688694075 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2cd4100f20 msgr2=0x7f2cd4101360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:14.034 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.032+0000 7f2cdbd88700 1 --2- 172.21.15.76:0/2688694075 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2cd4100f20 0x7f2cd4101360 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f2cc4009990 tx=0x7f2cc4009ca0 comp rx=0 tx=0).stop 2024-06-02T04:49:14.034 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.032+0000 7f2cdbd88700 1 -- 172.21.15.76:0/2688694075 shutdown_connections 2024-06-02T04:49:14.034 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.032+0000 7f2cdbd88700 1 --2- 172.21.15.76:0/2688694075 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2cd4102ab0 0x7f2cd41093d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:14.034 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.032+0000 7f2cdbd88700 1 --2- 172.21.15.76:0/2688694075 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2cd4100f20 0x7f2cd4101360 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:14.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.032+0000 7f2cdbd88700 1 --2- 172.21.15.76:0/2688694075 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2cd41020f0 0x7f2cd4102570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:14.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.032+0000 7f2cdbd88700 1 -- 172.21.15.76:0/2688694075 >> 172.21.15.76:0/2688694075 conn(0x7f2cd40fc4e0 msgr2=0x7f2cd40fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:14.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.032+0000 7f2cdbd88700 1 -- 172.21.15.76:0/2688694075 shutdown_connections 2024-06-02T04:49:14.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.032+0000 7f2cdbd88700 1 -- 172.21.15.76:0/2688694075 wait complete. 2024-06-02T04:49:14.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.032+0000 7f2cdbd88700 1 Processor -- start 2024-06-02T04:49:14.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.032+0000 7f2cdbd88700 1 -- start start 2024-06-02T04:49:14.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.032+0000 7f2cdbd88700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2cd4100f20 0x7f2cd4196da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:14.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.032+0000 7f2cdbd88700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2cd41020f0 0x7f2cd41972e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:14.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.032+0000 7f2cdbd88700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2cd4102ab0 0x7f2cd419e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:14.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.032+0000 7f2cdbd88700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd419e8d0 con 0x7f2cd41020f0 2024-06-02T04:49:14.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.032+0000 7f2cdbd88700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd419ea10 con 0x7f2cd4100f20 2024-06-02T04:49:14.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.032+0000 7f2cdbd88700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd419eba0 con 0x7f2cd4102ab0 2024-06-02T04:49:14.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.033+0000 7f2cd9323700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2cd41020f0 0x7f2cd41972e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:14.036 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.033+0000 7f2cd9323700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2cd41020f0 0x7f2cd41972e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:38338/0 (socket says 172.21.15.76:38338) 2024-06-02T04:49:14.036 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.033+0000 7f2cd9323700 1 -- 172.21.15.76:0/1052636356 learned_addr learned my addr 172.21.15.76:0/1052636356 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:49:14.036 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.033+0000 7f2cd9b24700 1 --2- 172.21.15.76:0/1052636356 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2cd4100f20 0x7f2cd4196da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:14.036 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.033+0000 7f2cd9323700 1 -- 172.21.15.76:0/1052636356 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2cd4102ab0 msgr2=0x7f2cd419e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:14.036 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.033+0000 7f2cda325700 1 --2- 172.21.15.76:0/1052636356 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2cd4102ab0 0x7f2cd419e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:14.036 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.033+0000 7f2cd9323700 1 --2- 172.21.15.76:0/1052636356 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2cd4102ab0 0x7f2cd419e300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:14.036 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.033+0000 7f2cd9323700 1 -- 172.21.15.76:0/1052636356 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2cd4100f20 msgr2=0x7f2cd4196da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:14.036 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.033+0000 7f2cd9323700 1 --2- 172.21.15.76:0/1052636356 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2cd4100f20 0x7f2cd4196da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:14.036 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.033+0000 7f2cd9323700 1 -- 172.21.15.76:0/1052636356 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cc40095f0 con 0x7f2cd41020f0 2024-06-02T04:49:14.036 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.033+0000 7f2cd9323700 1 --2- 172.21.15.76:0/1052636356 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2cd41020f0 0x7f2cd41972e0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f2cd000c920 tx=0x7f2cd000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:14.036 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.033+0000 7f2ccaffd700 1 -- 172.21.15.76:0/1052636356 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd0007b00 con 0x7f2cd41020f0 2024-06-02T04:49:14.036 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.033+0000 7f2cdbd88700 1 -- 172.21.15.76:0/1052636356 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cd419ee80 con 0x7f2cd41020f0 2024-06-02T04:49:14.037 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.033+0000 7f2ccaffd700 1 -- 172.21.15.76:0/1052636356 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2cd000ce70 con 0x7f2cd41020f0 2024-06-02T04:49:14.037 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.033+0000 7f2ccaffd700 1 -- 172.21.15.76:0/1052636356 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd00053e0 con 0x7f2cd41020f0 2024-06-02T04:49:14.037 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.033+0000 7f2cdbd88700 1 -- 172.21.15.76:0/1052636356 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cd419f350 con 0x7f2cd41020f0 2024-06-02T04:49:14.043 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.035+0000 7f2ccaffd700 1 -- 172.21.15.76:0/1052636356 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f2cd0005580 con 0x7f2cd41020f0 2024-06-02T04:49:14.043 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.036+0000 7f2ccaffd700 1 --2- 172.21.15.76:0/1052636356 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f2cc00a11b0 0x7f2cc00a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:14.043 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.036+0000 7f2ccaffd700 1 -- 172.21.15.76:0/1052636356 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f2cd00cc970 con 0x7f2cd41020f0 2024-06-02T04:49:14.043 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.036+0000 7f2cd9b24700 1 --2- 172.21.15.76:0/1052636356 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f2cc00a11b0 0x7f2cc00a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:14.043 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.036+0000 7f2cd9b24700 1 --2- 172.21.15.76:0/1052636356 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f2cc00a11b0 0x7f2cc00a3670 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f2cc400c010 tx=0x7f2cc4003720 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:14.044 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.037+0000 7f2ce7f43b80 1 Processor -- start 2024-06-02T04:49:14.044 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.037+0000 7f2ce7f43b80 1 -- start start 2024-06-02T04:49:14.044 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.037+0000 7f2ce7f43b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e6104614f0 0x55e610461910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:14.044 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.037+0000 7f2ce7f43b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e610461e50 0x55e6104622d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:14.044 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.037+0000 7f2ce7f43b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e610462810 0x55e610462c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:14.044 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.037+0000 7f2ce7f43b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6103b8100 con 0x55e610462810 2024-06-02T04:49:14.044 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.037+0000 7f2ce7f43b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6103b5ac0 con 0x55e6104614f0 2024-06-02T04:49:14.044 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.037+0000 7f2ce7f43b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6103b13b0 con 0x55e610461e50 2024-06-02T04:49:14.044 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.037+0000 7f2cda325700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e610462810 0x55e610462c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:14.044 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.037+0000 7f2cda325700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e610462810 0x55e610462c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:38344/0 (socket says 172.21.15.76:38344) 2024-06-02T04:49:14.044 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.037+0000 7f2cda325700 1 -- 172.21.15.76:0/2430092413 learned_addr learned my addr 172.21.15.76:0/2430092413 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:49:14.045 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.038+0000 7f2cd9b24700 1 --2- 172.21.15.76:0/2430092413 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e6104614f0 0x55e610461910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:14.045 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.038+0000 7f2cd9323700 1 --2- 172.21.15.76:0/2430092413 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e610461e50 0x55e6104622d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:14.045 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.038+0000 7f2cda325700 1 -- 172.21.15.76:0/2430092413 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e610461e50 msgr2=0x55e6104622d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:49:14.045 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.038+0000 7f2cda325700 1 --2- 172.21.15.76:0/2430092413 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e610461e50 0x55e6104622d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:14.045 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.038+0000 7f2cda325700 1 -- 172.21.15.76:0/2430092413 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e6104614f0 msgr2=0x55e610461910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:49:14.045 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.038+0000 7f2cda325700 1 --2- 172.21.15.76:0/2430092413 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e6104614f0 0x55e610461910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:14.045 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.038+0000 7f2cda325700 1 -- 172.21.15.76:0/2430092413 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e610232360 con 0x55e610462810 2024-06-02T04:49:14.045 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.038+0000 7f2cd9323700 1 --2- 172.21.15.76:0/2430092413 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e610461e50 0x55e6104622d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:49:14.045 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.038+0000 7f2cda325700 1 --2- 172.21.15.76:0/2430092413 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e610462810 0x55e610462c90 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f2ccc0060b0 tx=0x7f2ccc007500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ad2d8e225f10354 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:14.045 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.038+0000 7f2cbffff700 1 -- 172.21.15.76:0/2430092413 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ccc003a00 con 0x55e610462810 2024-06-02T04:49:14.045 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.038+0000 7f2cbffff700 1 -- 172.21.15.76:0/2430092413 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2ccc004020 con 0x55e610462810 2024-06-02T04:49:14.045 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.038+0000 7f2cbffff700 1 -- 172.21.15.76:0/2430092413 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ccc014660 con 0x55e610462810 2024-06-02T04:49:14.045 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.039+0000 7f2ce7f43b80 1 -- 172.21.15.76:0/2430092413 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e610462810 msgr2=0x55e610462c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:14.046 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.039+0000 7f2ce7f43b80 1 --2- 172.21.15.76:0/2430092413 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e610462810 0x55e610462c90 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f2ccc0060b0 tx=0x7f2ccc007500 comp rx=0 tx=0).stop 2024-06-02T04:49:14.046 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.039+0000 7f2ce7f43b80 1 -- 172.21.15.76:0/2430092413 shutdown_connections 2024-06-02T04:49:14.046 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.039+0000 7f2ce7f43b80 1 --2- 172.21.15.76:0/2430092413 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e610462810 0x55e610462c90 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:14.046 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.039+0000 7f2ce7f43b80 1 --2- 172.21.15.76:0/2430092413 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e6104614f0 0x55e610461910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:14.046 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.039+0000 7f2ce7f43b80 1 --2- 172.21.15.76:0/2430092413 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e610461e50 0x55e6104622d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:14.046 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.039+0000 7f2ce7f43b80 1 -- 172.21.15.76:0/2430092413 >> 172.21.15.76:0/2430092413 conn(0x55e6103bf1c0 msgr2=0x55e61045bd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:14.046 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.039+0000 7f2ce7f43b80 1 -- 172.21.15.76:0/2430092413 shutdown_connections 2024-06-02T04:49:14.046 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.039+0000 7f2ce7f43b80 1 -- 172.21.15.76:0/2430092413 wait complete. 2024-06-02T04:49:14.046 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.039+0000 7f2ce7f43b80 1 -- start start 2024-06-02T04:49:14.046 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.039+0000 7f2ce7f43b80 1 Processor -- start 2024-06-02T04:49:14.046 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.040+0000 7f2ce7f43b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e6104614f0 0x55e61046ad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:14.046 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.040+0000 7f2ce7f43b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e610461e50 0x55e61046b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:14.047 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.040+0000 7f2ce7f43b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e610462810 0x55e6104722f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:14.047 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.040+0000 7f2ce7f43b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e61034d510 con 0x55e6104614f0 2024-06-02T04:49:14.047 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.040+0000 7f2ce7f43b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e61034d1b0 con 0x55e610462810 2024-06-02T04:49:14.047 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.040+0000 7f2ce7f43b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e610234650 con 0x55e610461e50 2024-06-02T04:49:14.047 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.040+0000 7f2ce7f43b80 10 client.0 _ll_register_callbacks cb 0x55e610356ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:49:14.047 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.040+0000 7f2cd9b24700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e6104614f0 0x55e61046ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:14.047 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.040+0000 7f2cd9b24700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e6104614f0 0x55e61046ad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:38348/0 (socket says 172.21.15.76:38348) 2024-06-02T04:49:14.047 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.040+0000 7f2cd9b24700 1 -- 172.21.15.76:0/2480212236 learned_addr learned my addr 172.21.15.76:0/2480212236 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:49:14.047 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.040+0000 7f2cd9323700 1 --2- 172.21.15.76:0/2480212236 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e610461e50 0x55e61046b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:14.047 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.040+0000 7f2cda325700 1 --2- 172.21.15.76:0/2480212236 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e610462810 0x55e6104722f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:14.047 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.040+0000 7f2cd9b24700 1 -- 172.21.15.76:0/2480212236 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e610461e50 msgr2=0x55e61046b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:49:14.047 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.040+0000 7f2cd9b24700 1 --2- 172.21.15.76:0/2480212236 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e610461e50 0x55e61046b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:14.048 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.040+0000 7f2cd9b24700 1 -- 172.21.15.76:0/2480212236 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e610462810 msgr2=0x55e6104722f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:49:14.048 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.040+0000 7f2cd9b24700 1 --2- 172.21.15.76:0/2480212236 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e610462810 0x55e6104722f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:14.048 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.040+0000 7f2cd9b24700 1 -- 172.21.15.76:0/2480212236 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ccc009920 con 0x55e6104614f0 2024-06-02T04:49:14.048 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.040+0000 7f2cd9323700 1 --2- 172.21.15.76:0/2480212236 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e610461e50 0x55e61046b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:49:14.048 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.040+0000 7f2cda325700 1 --2- 172.21.15.76:0/2480212236 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e610462810 0x55e6104722f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:49:14.048 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.040+0000 7f2cd9b24700 1 --2- 172.21.15.76:0/2480212236 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e6104614f0 0x55e61046ad70 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f2cc4015000 tx=0x7f2cc401a050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdcb46bb81f7c848 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:14.048 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.040+0000 7f2cbd7fa700 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-06-02T04:49:14.048 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.040+0000 7f2cbd7fa700 1 -- 172.21.15.76:0/2480212236 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc402b050 con 0x55e6104614f0 2024-06-02T04:49:14.048 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.040+0000 7f2ce7f43b80 1 -- 172.21.15.76:0/2480212236 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e61030a220 con 0x55e6104614f0 2024-06-02T04:49:14.048 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.040+0000 7f2cbd7fa700 1 -- 172.21.15.76:0/2480212236 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f2cc4003820 con 0x55e6104614f0 2024-06-02T04:49:14.048 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.041+0000 7f2cbd7fa700 1 -- 172.21.15.76:0/2480212236 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2cc4004e60 con 0x55e6104614f0 2024-06-02T04:49:14.048 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.041+0000 7f2ce7f43b80 10 client.15201 fetch_fsmap learned FSMap version 24 2024-06-02T04:49:14.049 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.041+0000 7f2ce7f43b80 1 -- 172.21.15.76:0/2480212236 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55e6101deb10 con 0x55e6104614f0 2024-06-02T04:49:14.049 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.041+0000 7f2cbd7fa700 1 -- 172.21.15.76:0/2480212236 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55e61030a220 con 0x55e6104614f0 2024-06-02T04:49:14.049 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.041+0000 7f2cbd7fa700 1 -- 172.21.15.76:0/2480212236 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f2cc400f5f0 con 0x55e6104614f0 2024-06-02T04:49:14.049 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.041+0000 7f2ce7f43b80 10 client.15201 fetch_fsmap finished waiting for FSMap version 24 2024-06-02T04:49:14.049 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.041+0000 7f2ce7f43b80 10 client.15201 resolve_mds: resolved name 'c' to daemon mds.c 2024-06-02T04:49:14.049 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.041+0000 7f2ce7f43b80 20 client.15201 populate_metadata read hostname 'smithi076' 2024-06-02T04:49:14.049 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.041+0000 7f2ce7f43b80 1 --2- 172.21.15.76:0/2480212236 >> [v2:172.21.15.192:6836/960773710,v1:172.21.15.192:6837/960773710] conn(0x55e610475490 0x55e61047b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:14.049 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.041+0000 7f2ce7f43b80 4 client.15201 mds_command: new command op to 24463 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T04:49:14.049 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.041+0000 7f2ce7f43b80 1 -- 172.21.15.76:0/2480212236 --> [v2:172.21.15.192:6836/960773710,v1:172.21.15.192:6837/960773710] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e6104307c0 con 0x55e610475490 2024-06-02T04:49:14.049 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.041+0000 7f2cd9323700 1 --2- 172.21.15.76:0/2480212236 >> [v2:172.21.15.192:6836/960773710,v1:172.21.15.192:6837/960773710] conn(0x55e610475490 0x55e61047b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:14.049 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.042+0000 7f2cbd7fa700 10 client.15201 ms_handle_connect on v2:172.21.15.192:6836/960773710 2024-06-02T04:49:14.049 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.042+0000 7f2cd9323700 1 --2- 172.21.15.76:0/2480212236 >> [v2:172.21.15.192:6836/960773710,v1:172.21.15.192:6837/960773710] conn(0x55e610475490 0x55e61047b2d0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=554ae9b1fd3f018a server_cookie=ef732f8ba8a3e893 in_seq=0 out_seq=0 2024-06-02T04:49:14.049 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.042+0000 7f2cbd7fa700 1 -- 172.21.15.76:0/2480212236 <== mds.2 v2:172.21.15.192:6836/960773710 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55e6104307c0 con 0x55e610475490 2024-06-02T04:49:14.050 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.042+0000 7f2cbd7fa700 10 client.15201 handle_command_reply: tid=0 2024-06-02T04:49:14.050 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.042+0000 7f2ce7f43b80 1 client.15201 shutdown 2024-06-02T04:49:14.050 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.043+0000 7f2ce7f43b80 1 -- 172.21.15.76:0/2480212236 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e6104614f0 msgr2=0x55e61046ad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:14.050 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.043+0000 7f2ce7f43b80 1 --2- 172.21.15.76:0/2480212236 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e6104614f0 0x55e61046ad70 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f2cc4015000 tx=0x7f2cc401a050 comp rx=0 tx=0).stop 2024-06-02T04:49:14.050 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.043+0000 7f2ce7f43b80 1 -- 172.21.15.76:0/2480212236 shutdown_connections 2024-06-02T04:49:14.050 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.043+0000 7f2ce7f43b80 1 --2- 172.21.15.76:0/2480212236 >> [v2:172.21.15.192:6836/960773710,v1:172.21.15.192:6837/960773710] conn(0x55e610475490 0x55e61047b2d0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:14.050 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.043+0000 7f2ce7f43b80 1 --2- 172.21.15.76:0/2480212236 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e610462810 0x55e6104722f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:14.050 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.043+0000 7f2ce7f43b80 1 --2- 172.21.15.76:0/2480212236 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e6104614f0 0x55e61046ad70 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:14.050 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.043+0000 7f2cbd7fa700 0 client.15201 ms_handle_reset on v2:172.21.15.192:6836/960773710 2024-06-02T04:49:14.050 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.043+0000 7f2ce7f43b80 1 --2- 172.21.15.76:0/2480212236 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e610461e50 0x55e61046b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:14.050 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.043+0000 7f2ce7f43b80 1 -- 172.21.15.76:0/2480212236 >> 172.21.15.76:0/2480212236 conn(0x55e6103bf1c0 msgr2=0x55e6104602f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:14.050 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.043+0000 7f2ce7f43b80 1 -- 172.21.15.76:0/2480212236 shutdown_connections 2024-06-02T04:49:14.050 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.043+0000 7f2ce7f43b80 1 -- 172.21.15.76:0/2480212236 wait complete. 2024-06-02T04:49:14.051 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.043+0000 7f2ce7f43b80 20 client.15201 trim_cache size 0 max 16384 2024-06-02T04:49:14.062 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.060+0000 7f2ce7f43b80 1 Processor -- start 2024-06-02T04:49:14.062 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.060+0000 7f2ce7f43b80 1 -- start start 2024-06-02T04:49:14.063 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.061+0000 7f2ce7f43b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e6104614f0 0x55e6104618d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:14.063 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.061+0000 7f2ce7f43b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e610461e50 0x55e61045c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:14.063 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.061+0000 7f2ce7f43b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e610462810 0x55e6104722b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:14.063 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.061+0000 7f2ce7f43b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6103505a0 con 0x55e610462810 2024-06-02T04:49:14.063 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.061+0000 7f2ce7f43b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e61045d520 con 0x55e6104614f0 2024-06-02T04:49:14.063 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.061+0000 7f2ce7f43b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6103aa150 con 0x55e610461e50 2024-06-02T04:49:14.063 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.061+0000 7f2cda325700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e610462810 0x55e6104722b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:14.063 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.061+0000 7f2cda325700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e610462810 0x55e6104722b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:38352/0 (socket says 172.21.15.76:38352) 2024-06-02T04:49:14.063 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.061+0000 7f2cda325700 1 -- 172.21.15.76:0/298050474 learned_addr learned my addr 172.21.15.76:0/298050474 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:49:14.063 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.061+0000 7f2cd9b24700 1 --2- 172.21.15.76:0/298050474 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e6104614f0 0x55e6104618d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:14.063 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.061+0000 7f2cd9323700 1 --2- 172.21.15.76:0/298050474 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e610461e50 0x55e61045c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:14.063 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.061+0000 7f2cda325700 1 -- 172.21.15.76:0/298050474 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e610461e50 msgr2=0x55e61045c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:49:14.063 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.061+0000 7f2cda325700 1 --2- 172.21.15.76:0/298050474 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e610461e50 0x55e61045c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:14.064 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.061+0000 7f2cda325700 1 -- 172.21.15.76:0/298050474 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e6104614f0 msgr2=0x55e6104618d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:49:14.064 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.061+0000 7f2cda325700 1 --2- 172.21.15.76:0/298050474 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e6104614f0 0x55e6104618d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:14.064 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.061+0000 7f2cda325700 1 -- 172.21.15.76:0/298050474 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e610377510 con 0x55e610462810 2024-06-02T04:49:14.064 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.061+0000 7f2cda325700 1 --2- 172.21.15.76:0/298050474 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e610462810 0x55e6104722b0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f2ccc0090b0 tx=0x7f2ccc0090e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20b7b9a4f91b7be8 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:14.064 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.061+0000 7f2cc8ff9700 1 -- 172.21.15.76:0/298050474 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ccc003a00 con 0x55e610462810 2024-06-02T04:49:14.064 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.061+0000 7f2cc8ff9700 1 -- 172.21.15.76:0/298050474 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2ccc004190 con 0x55e610462810 2024-06-02T04:49:14.064 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.061+0000 7f2cc8ff9700 1 -- 172.21.15.76:0/298050474 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ccc004d50 con 0x55e610462810 2024-06-02T04:49:14.064 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.062+0000 7f2ce7f43b80 1 -- 172.21.15.76:0/298050474 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e610462810 msgr2=0x55e6104722b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:14.064 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.062+0000 7f2ce7f43b80 1 --2- 172.21.15.76:0/298050474 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e610462810 0x55e6104722b0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f2ccc0090b0 tx=0x7f2ccc0090e0 comp rx=0 tx=0).stop 2024-06-02T04:49:14.064 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.062+0000 7f2ce7f43b80 1 -- 172.21.15.76:0/298050474 shutdown_connections 2024-06-02T04:49:14.064 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.062+0000 7f2ce7f43b80 1 --2- 172.21.15.76:0/298050474 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e610462810 0x55e6104722b0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:14.064 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.062+0000 7f2ce7f43b80 1 --2- 172.21.15.76:0/298050474 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e6104614f0 0x55e6104618d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:14.064 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.062+0000 7f2ce7f43b80 1 --2- 172.21.15.76:0/298050474 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e610461e50 0x55e61045c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:14.065 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.062+0000 7f2ce7f43b80 1 -- 172.21.15.76:0/298050474 >> 172.21.15.76:0/298050474 conn(0x55e6103bf1c0 msgr2=0x55e6104581c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:14.065 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.062+0000 7f2ce7f43b80 1 -- 172.21.15.76:0/298050474 shutdown_connections 2024-06-02T04:49:14.065 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.062+0000 7f2ce7f43b80 1 -- 172.21.15.76:0/298050474 wait complete. 2024-06-02T04:49:14.065 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.062+0000 7f2ce7f43b80 1 -- start start 2024-06-02T04:49:14.065 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.062+0000 7f2ce7f43b80 1 Processor -- start 2024-06-02T04:49:14.068 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.063+0000 7f2ce7f43b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e6104614f0 0x55e61046f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:14.068 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.063+0000 7f2ce7f43b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e610461e50 0x55e610471830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:14.068 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.063+0000 7f2ce7f43b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e610462810 0x55e610471d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:14.068 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.063+0000 7f2ce7f43b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e61045bb30 con 0x55e610462810 2024-06-02T04:49:14.068 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.063+0000 7f2ce7f43b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6104722b0 con 0x55e610461e50 2024-06-02T04:49:14.068 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.063+0000 7f2ce7f43b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e610472440 con 0x55e6104614f0 2024-06-02T04:49:14.068 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.063+0000 7f2ce7f43b80 10 client.0 _ll_register_callbacks cb 0x55e610356ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:49:14.068 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.063+0000 7f2cda325700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e610462810 0x55e610471d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:14.068 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.063+0000 7f2cda325700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e610462810 0x55e610471d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:38362/0 (socket says 172.21.15.76:38362) 2024-06-02T04:49:14.069 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.063+0000 7f2cda325700 1 -- 172.21.15.76:0/4135928381 learned_addr learned my addr 172.21.15.76:0/4135928381 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:49:14.069 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.063+0000 7f2cd9b24700 1 --2- 172.21.15.76:0/4135928381 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e6104614f0 0x55e61046f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:14.069 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.063+0000 7f2cd9323700 1 --2- 172.21.15.76:0/4135928381 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e610461e50 0x55e610471830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:14.069 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.063+0000 7f2cda325700 1 -- 172.21.15.76:0/4135928381 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e6104614f0 msgr2=0x55e61046f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:49:14.069 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.063+0000 7f2cda325700 1 --2- 172.21.15.76:0/4135928381 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e6104614f0 0x55e61046f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:14.069 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.063+0000 7f2cda325700 1 -- 172.21.15.76:0/4135928381 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e610461e50 msgr2=0x55e610471830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:49:14.069 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.063+0000 7f2cda325700 1 --2- 172.21.15.76:0/4135928381 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e610461e50 0x55e610471830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:14.069 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.063+0000 7f2cda325700 1 -- 172.21.15.76:0/4135928381 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e610232360 con 0x55e610462810 2024-06-02T04:49:14.069 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.063+0000 7f2cda325700 1 --2- 172.21.15.76:0/4135928381 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e610462810 0x55e610471d70 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f2ccc0074a0 tx=0x7f2ccc009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c127faf34b02617 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:14.069 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.063+0000 7f2cbd7fa700 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-06-02T04:49:14.069 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.063+0000 7f2cbd7fa700 1 -- 172.21.15.76:0/4135928381 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ccc003a00 con 0x55e610462810 2024-06-02T04:49:14.069 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.063+0000 7f2cbd7fa700 1 -- 172.21.15.76:0/4135928381 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f2ccc003b60 con 0x55e610462810 2024-06-02T04:49:14.070 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.063+0000 7f2ce7f43b80 1 -- 172.21.15.76:0/4135928381 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2ccc004020 con 0x55e610462810 2024-06-02T04:49:14.070 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.064+0000 7f2cbd7fa700 1 -- 172.21.15.76:0/4135928381 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2ccc003d40 con 0x55e610462810 2024-06-02T04:49:14.070 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.064+0000 7f2ce7f43b80 10 client.15207 fetch_fsmap learned FSMap version 24 2024-06-02T04:49:14.070 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.064+0000 7f2ce7f43b80 1 -- 172.21.15.76:0/4135928381 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55e610236c80 con 0x55e610462810 2024-06-02T04:49:14.070 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.064+0000 7f2cbd7fa700 1 -- 172.21.15.76:0/4135928381 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2ccc004020 con 0x55e610462810 2024-06-02T04:49:14.070 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.064+0000 7f2cbd7fa700 1 -- 172.21.15.76:0/4135928381 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f2ccc027070 con 0x55e610462810 2024-06-02T04:49:14.070 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.064+0000 7f2ce7f43b80 10 client.15207 fetch_fsmap finished waiting for FSMap version 24 2024-06-02T04:49:14.070 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.064+0000 7f2ce7f43b80 10 client.15207 resolve_mds: resolved name 'c' to daemon mds.c 2024-06-02T04:49:14.070 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.064+0000 7f2ce7f43b80 20 client.15207 populate_metadata read hostname 'smithi076' 2024-06-02T04:49:14.070 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.064+0000 7f2ce7f43b80 1 --2- 172.21.15.76:0/4135928381 >> [v2:172.21.15.192:6836/960773710,v1:172.21.15.192:6837/960773710] conn(0x55e6104d1520 0x55e6104cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:14.070 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.064+0000 7f2ce7f43b80 4 client.15207 mds_command: new command op to 24463 tid=0 multi_id=0 [{"prefix": "status"}] 2024-06-02T04:49:14.070 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.064+0000 7f2ce7f43b80 1 -- 172.21.15.76:0/4135928381 --> [v2:172.21.15.192:6836/960773710,v1:172.21.15.192:6837/960773710] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55e6103a9e70 con 0x55e6104d1520 2024-06-02T04:49:14.071 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.064+0000 7f2cd9b24700 1 --2- 172.21.15.76:0/4135928381 >> [v2:172.21.15.192:6836/960773710,v1:172.21.15.192:6837/960773710] conn(0x55e6104d1520 0x55e6104cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:14.071 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.064+0000 7f2cbd7fa700 10 client.15207 ms_handle_connect on v2:172.21.15.192:6836/960773710 2024-06-02T04:49:14.071 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.064+0000 7f2cd9b24700 1 --2- 172.21.15.76:0/4135928381 >> [v2:172.21.15.192:6836/960773710,v1:172.21.15.192:6837/960773710] conn(0x55e6104d1520 0x55e6104cdeb0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c4a1b01f13e02025 server_cookie=4dd20147755d4b97 in_seq=0 out_seq=0 2024-06-02T04:49:14.071 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.065+0000 7f2cbd7fa700 1 -- 172.21.15.76:0/4135928381 <== mds.2 v2:172.21.15.192:6836/960773710 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x55e6103a9e70 con 0x55e6104d1520 2024-06-02T04:49:14.071 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.065+0000 7f2cbd7fa700 10 client.15207 handle_command_reply: tid=0 2024-06-02T04:49:14.071 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.065+0000 7f2ce7f43b80 1 client.15207 shutdown 2024-06-02T04:49:14.071 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.065+0000 7f2ce7f43b80 1 -- 172.21.15.76:0/4135928381 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e610462810 msgr2=0x55e610471d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:14.071 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.065+0000 7f2ce7f43b80 1 --2- 172.21.15.76:0/4135928381 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e610462810 0x55e610471d70 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f2ccc0074a0 tx=0x7f2ccc009040 comp rx=0 tx=0).stop 2024-06-02T04:49:14.071 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.065+0000 7f2ce7f43b80 1 -- 172.21.15.76:0/4135928381 shutdown_connections 2024-06-02T04:49:14.071 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.065+0000 7f2ce7f43b80 1 --2- 172.21.15.76:0/4135928381 >> [v2:172.21.15.192:6836/960773710,v1:172.21.15.192:6837/960773710] conn(0x55e6104d1520 0x55e6104cdeb0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:14.071 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.065+0000 7f2ce7f43b80 1 --2- 172.21.15.76:0/4135928381 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e610462810 0x55e610471d70 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:14.071 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.065+0000 7f2cbd7fa700 0 client.15207 ms_handle_reset on v2:172.21.15.192:6836/960773710 2024-06-02T04:49:14.072 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.065+0000 7f2ce7f43b80 1 --2- 172.21.15.76:0/4135928381 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e6104614f0 0x55e61046f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:14.072 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.065+0000 7f2ce7f43b80 1 --2- 172.21.15.76:0/4135928381 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e610461e50 0x55e610471830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:14.072 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.065+0000 7f2ce7f43b80 1 -- 172.21.15.76:0/4135928381 >> 172.21.15.76:0/4135928381 conn(0x55e6103bf1c0 msgr2=0x55e610465740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:14.072 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.065+0000 7f2ce7f43b80 1 -- 172.21.15.76:0/4135928381 shutdown_connections 2024-06-02T04:49:14.072 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.065+0000 7f2ce7f43b80 1 -- 172.21.15.76:0/4135928381 wait complete. 2024-06-02T04:49:14.072 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.065+0000 7f2ce7f43b80 20 client.15207 trim_cache size 0 max 16384 2024-06-02T04:49:14.072 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-06-02T04:49:14.072 INFO:teuthology.orchestra.run.smithi076.stdout: "cluster_fsid": "60ab6d30-209a-11ef-bc9b-c7b262605968", 2024-06-02T04:49:14.072 INFO:teuthology.orchestra.run.smithi076.stdout: "whoami": 2, 2024-06-02T04:49:14.073 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 24463, 2024-06-02T04:49:14.073 INFO:teuthology.orchestra.run.smithi076.stdout: "want_state": "up:active", 2024-06-02T04:49:14.073 INFO:teuthology.orchestra.run.smithi076.stdout: "state": "up:active", 2024-06-02T04:49:14.073 INFO:teuthology.orchestra.run.smithi076.stdout: "fs_name": "cephfs", 2024-06-02T04:49:14.073 INFO:teuthology.orchestra.run.smithi076.stdout: "rank_uptime": 46.797867732999997, 2024-06-02T04:49:14.073 INFO:teuthology.orchestra.run.smithi076.stdout: "mdsmap_epoch": 24, 2024-06-02T04:49:14.073 INFO:teuthology.orchestra.run.smithi076.stdout: "osdmap_epoch": 82, 2024-06-02T04:49:14.073 INFO:teuthology.orchestra.run.smithi076.stdout: "osdmap_epoch_barrier": 80, 2024-06-02T04:49:14.073 INFO:teuthology.orchestra.run.smithi076.stdout: "uptime": 85.714091244000002 2024-06-02T04:49:14.073 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-06-02T04:49:14.074 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.065+0000 7f2cdbd88700 1 -- 172.21.15.76:0/1052636356 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f2cc00a11b0 msgr2=0x7f2cc00a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:14.074 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.065+0000 7f2cdbd88700 1 --2- 172.21.15.76:0/1052636356 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f2cc00a11b0 0x7f2cc00a3670 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f2cc400c010 tx=0x7f2cc4003720 comp rx=0 tx=0).stop 2024-06-02T04:49:14.074 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.065+0000 7f2cdbd88700 1 -- 172.21.15.76:0/1052636356 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2cd41020f0 msgr2=0x7f2cd41972e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:14.074 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.065+0000 7f2cdbd88700 1 --2- 172.21.15.76:0/1052636356 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2cd41020f0 0x7f2cd41972e0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f2cd000c920 tx=0x7f2cd000cc30 comp rx=0 tx=0).stop 2024-06-02T04:49:14.074 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.066+0000 7f2cdbd88700 1 -- 172.21.15.76:0/1052636356 shutdown_connections 2024-06-02T04:49:14.074 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.066+0000 7f2cdbd88700 1 --2- 172.21.15.76:0/1052636356 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2cd4102ab0 0x7f2cd419e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:14.074 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.066+0000 7f2cdbd88700 1 --2- 172.21.15.76:0/1052636356 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f2cc00a11b0 0x7f2cc00a3670 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:14.074 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.066+0000 7f2cdbd88700 1 --2- 172.21.15.76:0/1052636356 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2cd4100f20 0x7f2cd4196da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:14.075 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.066+0000 7f2cdbd88700 1 --2- 172.21.15.76:0/1052636356 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2cd41020f0 0x7f2cd41972e0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:14.075 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.066+0000 7f2cdbd88700 1 -- 172.21.15.76:0/1052636356 >> 172.21.15.76:0/1052636356 conn(0x7f2cd40fc4e0 msgr2=0x7f2cd4105590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:14.075 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.066+0000 7f2cdbd88700 1 -- 172.21.15.76:0/1052636356 shutdown_connections 2024-06-02T04:49:14.075 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.066+0000 7f2cdbd88700 1 -- 172.21.15.76:0/1052636356 wait complete. 2024-06-02T04:49:14.078 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2024-06-02T04:49:14.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:13 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/3086877149' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:49:14.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:13 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/947969051' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:49:14.204 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.201+0000 7ff6a8248700 1 -- 172.21.15.76:0/2931012556 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff6a01019e0 msgr2=0x7ff6a0103dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:14.204 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.201+0000 7ff6a8248700 1 --2- 172.21.15.76:0/2931012556 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff6a01019e0 0x7ff6a0103dd0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7ff690009990 tx=0x7ff690009ca0 comp rx=0 tx=0).stop 2024-06-02T04:49:14.204 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.201+0000 7ff6a8248700 1 -- 172.21.15.76:0/2931012556 shutdown_connections 2024-06-02T04:49:14.204 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.201+0000 7ff6a8248700 1 --2- 172.21.15.76:0/2931012556 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff6a0106c40 0x7ff6a01090b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:14.204 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.201+0000 7ff6a8248700 1 --2- 172.21.15.76:0/2931012556 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff6a01019e0 0x7ff6a0103dd0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:14.204 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.201+0000 7ff6a8248700 1 --2- 172.21.15.76:0/2931012556 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff6a0104310 0x7ff6a0106700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:14.204 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.201+0000 7ff6a8248700 1 -- 172.21.15.76:0/2931012556 >> 172.21.15.76:0/2931012556 conn(0x7ff6a00fb3f0 msgr2=0x7ff6a00fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:14.204 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.201+0000 7ff6a8248700 1 -- 172.21.15.76:0/2931012556 shutdown_connections 2024-06-02T04:49:14.204 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.201+0000 7ff6a8248700 1 -- 172.21.15.76:0/2931012556 wait complete. 2024-06-02T04:49:14.204 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.201+0000 7ff6a8248700 1 Processor -- start 2024-06-02T04:49:14.204 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.201+0000 7ff6a8248700 1 -- start start 2024-06-02T04:49:14.205 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.202+0000 7ff6a8248700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff6a01019e0 0x7ff6a0196e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:14.205 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.202+0000 7ff6a8248700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff6a0104310 0x7ff6a0197380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:14.205 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.202+0000 7ff6a8248700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff6a0106c40 0x7ff6a019e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:14.205 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.202+0000 7ff6a8248700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a019e970 con 0x7ff6a0106c40 2024-06-02T04:49:14.205 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.202+0000 7ff6a8248700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a019eab0 con 0x7ff6a01019e0 2024-06-02T04:49:14.205 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.202+0000 7ff6a8248700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a019ec40 con 0x7ff6a0104310 2024-06-02T04:49:14.205 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.202+0000 7ff6a67e5700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff6a0106c40 0x7ff6a019e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:14.205 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.202+0000 7ff6a67e5700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff6a0106c40 0x7ff6a019e3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:38386/0 (socket says 172.21.15.76:38386) 2024-06-02T04:49:14.205 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.202+0000 7ff6a67e5700 1 -- 172.21.15.76:0/907117121 learned_addr learned my addr 172.21.15.76:0/907117121 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:49:14.205 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.202+0000 7ff6a57e3700 1 --2- 172.21.15.76:0/907117121 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff6a0104310 0x7ff6a0197380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:14.205 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.202+0000 7ff6a5fe4700 1 --2- 172.21.15.76:0/907117121 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff6a01019e0 0x7ff6a0196e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:14.205 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.202+0000 7ff6a67e5700 1 -- 172.21.15.76:0/907117121 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff6a0104310 msgr2=0x7ff6a0197380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:14.205 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.202+0000 7ff6a67e5700 1 --2- 172.21.15.76:0/907117121 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff6a0104310 0x7ff6a0197380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:14.206 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.202+0000 7ff6a67e5700 1 -- 172.21.15.76:0/907117121 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff6a01019e0 msgr2=0x7ff6a0196e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:14.206 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.202+0000 7ff6a67e5700 1 --2- 172.21.15.76:0/907117121 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff6a01019e0 0x7ff6a0196e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:14.206 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.202+0000 7ff6a67e5700 1 -- 172.21.15.76:0/907117121 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6900095f0 con 0x7ff6a0106c40 2024-06-02T04:49:14.206 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.202+0000 7ff6a67e5700 1 --2- 172.21.15.76:0/907117121 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff6a0106c40 0x7ff6a019e3a0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7ff698007ee0 tx=0x7ff69800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:14.206 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.202+0000 7ff696ffd700 1 -- 172.21.15.76:0/907117121 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff69800dd20 con 0x7ff6a0106c40 2024-06-02T04:49:14.206 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.202+0000 7ff6a8248700 1 -- 172.21.15.76:0/907117121 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6a019ef20 con 0x7ff6a0106c40 2024-06-02T04:49:14.206 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.202+0000 7ff696ffd700 1 -- 172.21.15.76:0/907117121 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff69800f040 con 0x7ff6a0106c40 2024-06-02T04:49:14.206 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.202+0000 7ff696ffd700 1 -- 172.21.15.76:0/907117121 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff698004750 con 0x7ff6a0106c40 2024-06-02T04:49:14.206 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.203+0000 7ff6a8248700 1 -- 172.21.15.76:0/907117121 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6a019f3f0 con 0x7ff6a0106c40 2024-06-02T04:49:14.209 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.205+0000 7ff696ffd700 1 -- 172.21.15.76:0/907117121 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7ff698003a00 con 0x7ff6a0106c40 2024-06-02T04:49:14.209 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.206+0000 7ff696ffd700 1 --2- 172.21.15.76:0/907117121 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7ff68c0a11b0 0x7ff68c0a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:14.209 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.206+0000 7ff6a5fe4700 1 --2- 172.21.15.76:0/907117121 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7ff68c0a11b0 0x7ff68c0a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:14.209 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.206+0000 7ff696ffd700 1 -- 172.21.15.76:0/907117121 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 9020+0+0 (secure 0 0 0) 0x7ff6980cc650 con 0x7ff6a0106c40 2024-06-02T04:49:14.209 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.206+0000 7ff6a5fe4700 1 --2- 172.21.15.76:0/907117121 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7ff68c0a11b0 0x7ff68c0a3670 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7ff690006010 tx=0x7ff69000b610 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:14.209 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.207+0000 7ff6b4403b80 1 Processor -- start 2024-06-02T04:49:14.209 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.207+0000 7ff6b4403b80 1 -- start start 2024-06-02T04:49:14.209 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.207+0000 7ff6b4403b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55788674f4f0 0x55788674f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:14.210 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.207+0000 7ff6b4403b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55788674fe50 0x5578867502d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:14.210 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.207+0000 7ff6b4403b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557886750810 0x557886750c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:14.210 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.207+0000 7ff6b4403b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578866a6100 con 0x55788674f4f0 2024-06-02T04:49:14.210 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.207+0000 7ff6b4403b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578866a3ac0 con 0x55788674fe50 2024-06-02T04:49:14.210 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.207+0000 7ff6b4403b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55788669f3b0 con 0x557886750810 2024-06-02T04:49:14.210 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.207+0000 7ff6a5fe4700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55788674f4f0 0x55788674f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:14.210 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.207+0000 7ff6a5fe4700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55788674f4f0 0x55788674f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:38396/0 (socket says 172.21.15.76:38396) 2024-06-02T04:49:14.210 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.207+0000 7ff6a5fe4700 1 -- 172.21.15.76:0/2129921849 learned_addr learned my addr 172.21.15.76:0/2129921849 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:49:14.210 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.207+0000 7ff6a67e5700 1 --2- 172.21.15.76:0/2129921849 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557886750810 0x557886750c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:14.210 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.207+0000 7ff6a5fe4700 1 -- 172.21.15.76:0/2129921849 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557886750810 msgr2=0x557886750c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:49:14.210 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.207+0000 7ff6a5fe4700 1 --2- 172.21.15.76:0/2129921849 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557886750810 0x557886750c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:14.210 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.207+0000 7ff6a5fe4700 1 -- 172.21.15.76:0/2129921849 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55788674fe50 msgr2=0x5578867502d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:49:14.211 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.207+0000 7ff6a5fe4700 1 --2- 172.21.15.76:0/2129921849 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55788674fe50 0x5578867502d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:14.211 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.208+0000 7ff6a5fe4700 1 -- 172.21.15.76:0/2129921849 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557886520360 con 0x55788674f4f0 2024-06-02T04:49:14.211 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.208+0000 7ff6a5fe4700 1 --2- 172.21.15.76:0/2129921849 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55788674f4f0 0x55788674f910 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7ff690015000 tx=0x7ff690020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c62b4f49722c120 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:14.211 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.208+0000 7ff68bfff700 1 -- 172.21.15.76:0/2129921849 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff690003d10 con 0x55788674f4f0 2024-06-02T04:49:14.211 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.208+0000 7ff68bfff700 1 -- 172.21.15.76:0/2129921849 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff69001e040 con 0x55788674f4f0 2024-06-02T04:49:14.211 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.208+0000 7ff68bfff700 1 -- 172.21.15.76:0/2129921849 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff690004ac0 con 0x55788674f4f0 2024-06-02T04:49:14.211 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.208+0000 7ff6b4403b80 1 -- 172.21.15.76:0/2129921849 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55788674f4f0 msgr2=0x55788674f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:14.211 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.208+0000 7ff6b4403b80 1 --2- 172.21.15.76:0/2129921849 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55788674f4f0 0x55788674f910 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7ff690015000 tx=0x7ff690020000 comp rx=0 tx=0).stop 2024-06-02T04:49:14.211 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.209+0000 7ff6b4403b80 1 -- 172.21.15.76:0/2129921849 shutdown_connections 2024-06-02T04:49:14.211 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.209+0000 7ff6b4403b80 1 --2- 172.21.15.76:0/2129921849 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557886750810 0x557886750c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:14.211 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.209+0000 7ff6b4403b80 1 --2- 172.21.15.76:0/2129921849 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55788674f4f0 0x55788674f910 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:14.211 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.209+0000 7ff6b4403b80 1 --2- 172.21.15.76:0/2129921849 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55788674fe50 0x5578867502d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:14.211 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.209+0000 7ff6b4403b80 1 -- 172.21.15.76:0/2129921849 >> 172.21.15.76:0/2129921849 conn(0x5578866ad1c0 msgr2=0x557886749d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:14.211 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.209+0000 7ff6b4403b80 1 -- 172.21.15.76:0/2129921849 shutdown_connections 2024-06-02T04:49:14.212 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.209+0000 7ff6b4403b80 1 -- 172.21.15.76:0/2129921849 wait complete. 2024-06-02T04:49:14.212 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.209+0000 7ff6b4403b80 1 -- start start 2024-06-02T04:49:14.212 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.209+0000 7ff6b4403b80 1 Processor -- start 2024-06-02T04:49:14.215 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.209+0000 7ff6b4403b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55788674f4f0 0x557886758db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:14.215 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.209+0000 7ff6b4403b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55788674fe50 0x5578867592f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:14.215 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.209+0000 7ff6b4403b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557886750810 0x557886760330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:14.216 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.209+0000 7ff6b4403b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55788663b510 con 0x55788674fe50 2024-06-02T04:49:14.216 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.209+0000 7ff6b4403b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55788663b1b0 con 0x557886750810 2024-06-02T04:49:14.216 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.209+0000 7ff6b4403b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x557886522650 con 0x55788674f4f0 2024-06-02T04:49:14.216 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.210+0000 7ff6b4403b80 10 client.0 _ll_register_callbacks cb 0x557886644ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:49:14.216 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.210+0000 7ff6a57e3700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55788674fe50 0x5578867592f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:14.216 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.210+0000 7ff6a57e3700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55788674fe50 0x5578867592f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:38400/0 (socket says 172.21.15.76:38400) 2024-06-02T04:49:14.216 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.210+0000 7ff6a57e3700 1 -- 172.21.15.76:0/972112736 learned_addr learned my addr 172.21.15.76:0/972112736 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:49:14.216 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.210+0000 7ff6a67e5700 1 --2- 172.21.15.76:0/972112736 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557886750810 0x557886760330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:14.216 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.210+0000 7ff6a57e3700 1 -- 172.21.15.76:0/972112736 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55788674f4f0 msgr2=0x557886758db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:49:14.216 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.210+0000 7ff6a57e3700 1 --2- 172.21.15.76:0/972112736 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55788674f4f0 0x557886758db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:14.216 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.210+0000 7ff6a57e3700 1 -- 172.21.15.76:0/972112736 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557886750810 msgr2=0x557886760330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:49:14.216 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.210+0000 7ff6a57e3700 1 --2- 172.21.15.76:0/972112736 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557886750810 0x557886760330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:14.216 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.210+0000 7ff6a57e3700 1 -- 172.21.15.76:0/972112736 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6a0109ca0 con 0x55788674fe50 2024-06-02T04:49:14.217 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.210+0000 7ff6a57e3700 1 --2- 172.21.15.76:0/972112736 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55788674fe50 0x5578867592f0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7ff69c0116c0 tx=0x7ff69c0119d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dda537a41d3eb6e5 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:14.217 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.210+0000 7ff6897fa700 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-06-02T04:49:14.217 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.210+0000 7ff6897fa700 1 -- 172.21.15.76:0/972112736 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff69c004030 con 0x55788674fe50 2024-06-02T04:49:14.217 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.210+0000 7ff6897fa700 1 -- 172.21.15.76:0/972112736 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 9020+0+0 (secure 0 0 0) 0x7ff69c004190 con 0x55788674fe50 2024-06-02T04:49:14.217 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.210+0000 7ff6b4403b80 1 -- 172.21.15.76:0/972112736 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5578865f8220 con 0x55788674fe50 2024-06-02T04:49:14.217 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.210+0000 7ff6897fa700 1 -- 172.21.15.76:0/972112736 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff69c004390 con 0x55788674fe50 2024-06-02T04:49:14.217 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.210+0000 7ff6b4403b80 10 client.15219 fetch_fsmap learned FSMap version 24 2024-06-02T04:49:14.217 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.210+0000 7ff6b4403b80 1 -- 172.21.15.76:0/972112736 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x5578864ccb10 con 0x55788674fe50 2024-06-02T04:49:14.217 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.210+0000 7ff6897fa700 1 -- 172.21.15.76:0/972112736 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5578865f8220 con 0x55788674fe50 2024-06-02T04:49:14.217 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.211+0000 7ff6897fa700 1 -- 172.21.15.76:0/972112736 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7ff69c00e7f0 con 0x55788674fe50 2024-06-02T04:49:14.217 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.211+0000 7ff6b4403b80 10 client.15219 fetch_fsmap finished waiting for FSMap version 24 2024-06-02T04:49:14.217 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.211+0000 7ff6b4403b80 10 client.15219 resolve_mds: resolved name 'i' to daemon mds.i 2024-06-02T04:49:14.218 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.211+0000 7ff6b4403b80 20 client.15219 populate_metadata read hostname 'smithi076' 2024-06-02T04:49:14.218 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.211+0000 7ff6b4403b80 1 --2- 172.21.15.76:0/972112736 >> [v2:172.21.15.192:6838/3978681402,v1:172.21.15.192:6839/3978681402] conn(0x557886763ac0 0x5578867693b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:14.218 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.211+0000 7ff6b4403b80 4 client.15219 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T04:49:14.218 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.211+0000 7ff6b4403b80 1 -- 172.21.15.76:0/972112736 --> [v2:172.21.15.192:6838/3978681402,v1:172.21.15.192:6839/3978681402] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55788671e7c0 con 0x557886763ac0 2024-06-02T04:49:14.218 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.211+0000 7ff6a5fe4700 1 --2- 172.21.15.76:0/972112736 >> [v2:172.21.15.192:6838/3978681402,v1:172.21.15.192:6839/3978681402] conn(0x557886763ac0 0x5578867693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:14.218 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.211+0000 7ff6897fa700 10 client.15219 ms_handle_connect on v2:172.21.15.192:6838/3978681402 2024-06-02T04:49:14.218 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.211+0000 7ff6a5fe4700 1 --2- 172.21.15.76:0/972112736 >> [v2:172.21.15.192:6838/3978681402,v1:172.21.15.192:6839/3978681402] conn(0x557886763ac0 0x5578867693b0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5f5cb61981fd1849 server_cookie=4b81cfb640d180a8 in_seq=0 out_seq=0 2024-06-02T04:49:14.218 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.212+0000 7ff6897fa700 1 -- 172.21.15.76:0/972112736 <== mds.1 v2:172.21.15.192:6838/3978681402 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55788671e7c0 con 0x557886763ac0 2024-06-02T04:49:14.218 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.212+0000 7ff6897fa700 10 client.15219 handle_command_reply: tid=0 2024-06-02T04:49:14.218 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.212+0000 7ff6b4403b80 1 client.15219 shutdown 2024-06-02T04:49:14.218 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.212+0000 7ff6b4403b80 1 -- 172.21.15.76:0/972112736 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55788674fe50 msgr2=0x5578867592f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:14.218 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.212+0000 7ff6b4403b80 1 --2- 172.21.15.76:0/972112736 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55788674fe50 0x5578867592f0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7ff69c0116c0 tx=0x7ff69c0119d0 comp rx=0 tx=0).stop 2024-06-02T04:49:14.219 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.212+0000 7ff6b4403b80 1 -- 172.21.15.76:0/972112736 shutdown_connections 2024-06-02T04:49:14.219 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.212+0000 7ff6b4403b80 1 --2- 172.21.15.76:0/972112736 >> [v2:172.21.15.192:6838/3978681402,v1:172.21.15.192:6839/3978681402] conn(0x557886763ac0 0x5578867693b0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:14.219 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.212+0000 7ff6b4403b80 1 --2- 172.21.15.76:0/972112736 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557886750810 0x557886760330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:14.219 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.212+0000 7ff6b4403b80 1 --2- 172.21.15.76:0/972112736 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55788674f4f0 0x557886758db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:14.219 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.212+0000 7ff6897fa700 0 client.15219 ms_handle_reset on v2:172.21.15.192:6838/3978681402 2024-06-02T04:49:14.219 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.212+0000 7ff6b4403b80 1 --2- 172.21.15.76:0/972112736 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55788674fe50 0x5578867592f0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:14.219 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.212+0000 7ff6b4403b80 1 -- 172.21.15.76:0/972112736 >> 172.21.15.76:0/972112736 conn(0x5578866ad1c0 msgr2=0x557886749550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:14.219 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.212+0000 7ff6b4403b80 1 -- 172.21.15.76:0/972112736 shutdown_connections 2024-06-02T04:49:14.219 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.212+0000 7ff6b4403b80 1 -- 172.21.15.76:0/972112736 wait complete. 2024-06-02T04:49:14.219 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.213+0000 7ff6b4403b80 20 client.15219 trim_cache size 0 max 16384 2024-06-02T04:49:14.232 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.230+0000 7ff6b4403b80 1 Processor -- start 2024-06-02T04:49:14.233 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.230+0000 7ff6b4403b80 1 -- start start 2024-06-02T04:49:14.233 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.231+0000 7ff6b4403b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55788674f4f0 0x55788674f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:14.233 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.231+0000 7ff6b4403b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55788674fe50 0x5578867602f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:14.233 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.231+0000 7ff6b4403b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557886750810 0x557886759a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:14.233 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.231+0000 7ff6b4403b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x557886698150 con 0x557886750810 2024-06-02T04:49:14.233 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.231+0000 7ff6b4403b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55788669c010 con 0x55788674fe50 2024-06-02T04:49:14.233 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.231+0000 7ff6b4403b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578867614b0 con 0x55788674f4f0 2024-06-02T04:49:14.233 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.231+0000 7ff6a67e5700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557886750810 0x557886759a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:14.233 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.231+0000 7ff6a67e5700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557886750810 0x557886759a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:38404/0 (socket says 172.21.15.76:38404) 2024-06-02T04:49:14.233 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.231+0000 7ff6a67e5700 1 -- 172.21.15.76:0/3353388801 learned_addr learned my addr 172.21.15.76:0/3353388801 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:49:14.233 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.231+0000 7ff6a57e3700 1 --2- 172.21.15.76:0/3353388801 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55788674fe50 0x5578867602f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:14.234 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.231+0000 7ff6a5fe4700 1 --2- 172.21.15.76:0/3353388801 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55788674f4f0 0x55788674f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:14.234 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.231+0000 7ff6a67e5700 1 -- 172.21.15.76:0/3353388801 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55788674f4f0 msgr2=0x55788674f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:49:14.234 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.231+0000 7ff6a67e5700 1 --2- 172.21.15.76:0/3353388801 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55788674f4f0 0x55788674f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:14.234 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.231+0000 7ff6a67e5700 1 -- 172.21.15.76:0/3353388801 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55788674fe50 msgr2=0x5578867602f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:49:14.234 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.231+0000 7ff6a67e5700 1 --2- 172.21.15.76:0/3353388801 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55788674fe50 0x5578867602f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:14.234 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.231+0000 7ff6a67e5700 1 -- 172.21.15.76:0/3353388801 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557886665510 con 0x557886750810 2024-06-02T04:49:14.234 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.231+0000 7ff6a67e5700 1 --2- 172.21.15.76:0/3353388801 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557886750810 0x557886759a30 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7ff698099560 tx=0x7ff698099000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3acad922cbe9748 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:14.234 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.231+0000 7ff694ff9700 1 -- 172.21.15.76:0/3353388801 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff698099cd0 con 0x557886750810 2024-06-02T04:49:14.234 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.231+0000 7ff694ff9700 1 -- 172.21.15.76:0/3353388801 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff6980995d0 con 0x557886750810 2024-06-02T04:49:14.234 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.231+0000 7ff694ff9700 1 -- 172.21.15.76:0/3353388801 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff698009450 con 0x557886750810 2024-06-02T04:49:14.234 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.232+0000 7ff6b4403b80 1 -- 172.21.15.76:0/3353388801 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557886750810 msgr2=0x557886759a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:14.234 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.232+0000 7ff6b4403b80 1 --2- 172.21.15.76:0/3353388801 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557886750810 0x557886759a30 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7ff698099560 tx=0x7ff698099000 comp rx=0 tx=0).stop 2024-06-02T04:49:14.235 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.232+0000 7ff6b4403b80 1 -- 172.21.15.76:0/3353388801 shutdown_connections 2024-06-02T04:49:14.235 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.232+0000 7ff6b4403b80 1 --2- 172.21.15.76:0/3353388801 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557886750810 0x557886759a30 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:14.235 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.232+0000 7ff6b4403b80 1 --2- 172.21.15.76:0/3353388801 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55788674f4f0 0x55788674f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:14.235 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.232+0000 7ff6b4403b80 1 --2- 172.21.15.76:0/3353388801 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55788674fe50 0x5578867602f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:14.235 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.232+0000 7ff6b4403b80 1 -- 172.21.15.76:0/3353388801 >> 172.21.15.76:0/3353388801 conn(0x5578866ad1c0 msgr2=0x557886750bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:14.235 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.232+0000 7ff6b4403b80 1 -- 172.21.15.76:0/3353388801 shutdown_connections 2024-06-02T04:49:14.235 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.232+0000 7ff6b4403b80 1 -- 172.21.15.76:0/3353388801 wait complete. 2024-06-02T04:49:14.235 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.232+0000 7ff6b4403b80 1 -- start start 2024-06-02T04:49:14.235 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.232+0000 7ff6b4403b80 1 Processor -- start 2024-06-02T04:49:14.237 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.233+0000 7ff6b4403b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55788674f4f0 0x55788675d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:14.237 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.233+0000 7ff6b4403b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55788674fe50 0x55788675f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:14.237 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.233+0000 7ff6b4403b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557886750810 0x55788675fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:14.237 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.233+0000 7ff6b4403b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x557886749ad0 con 0x557886750810 2024-06-02T04:49:14.237 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.233+0000 7ff6b4403b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578867602f0 con 0x55788674f4f0 2024-06-02T04:49:14.237 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.233+0000 7ff6b4403b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578867604b0 con 0x55788674fe50 2024-06-02T04:49:14.237 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.233+0000 7ff6b4403b80 10 client.0 _ll_register_callbacks cb 0x557886644ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:49:14.237 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.233+0000 7ff6a67e5700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557886750810 0x55788675fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:14.237 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.233+0000 7ff6a67e5700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557886750810 0x55788675fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:38410/0 (socket says 172.21.15.76:38410) 2024-06-02T04:49:14.237 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.233+0000 7ff6a67e5700 1 -- 172.21.15.76:0/815997806 learned_addr learned my addr 172.21.15.76:0/815997806 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:49:14.238 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.233+0000 7ff6a57e3700 1 --2- 172.21.15.76:0/815997806 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55788674fe50 0x55788675f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:14.238 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.233+0000 7ff6a5fe4700 1 --2- 172.21.15.76:0/815997806 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55788674f4f0 0x55788675d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:14.238 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.233+0000 7ff6a67e5700 1 -- 172.21.15.76:0/815997806 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55788674fe50 msgr2=0x55788675f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:49:14.238 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.233+0000 7ff6a67e5700 1 --2- 172.21.15.76:0/815997806 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55788674fe50 0x55788675f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:14.238 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.233+0000 7ff6a67e5700 1 -- 172.21.15.76:0/815997806 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55788674f4f0 msgr2=0x55788675d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:49:14.238 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.233+0000 7ff6a67e5700 1 --2- 172.21.15.76:0/815997806 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55788674f4f0 0x55788675d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:14.238 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.233+0000 7ff6a67e5700 1 -- 172.21.15.76:0/815997806 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6a019f3f0 con 0x557886750810 2024-06-02T04:49:14.238 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.233+0000 7ff6a57e3700 1 --2- 172.21.15.76:0/815997806 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55788674fe50 0x55788675f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T04:49:14.238 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.233+0000 7ff6a67e5700 1 --2- 172.21.15.76:0/815997806 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557886750810 0x55788675fdb0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7ff6980a1520 tx=0x7ff69800d8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51b965287e5c51a2 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:14.238 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.233+0000 7ff6897fa700 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-06-02T04:49:14.239 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:13 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/3086877149' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:49:14.239 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:13 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/947969051' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:49:14.241 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.234+0000 7ff6897fa700 1 -- 172.21.15.76:0/815997806 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff698099cd0 con 0x557886750810 2024-06-02T04:49:14.241 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.234+0000 7ff6897fa700 1 -- 172.21.15.76:0/815997806 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 9020+0+0 (secure 0 0 0) 0x7ff698009410 con 0x557886750810 2024-06-02T04:49:14.241 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.234+0000 7ff6b4403b80 1 -- 172.21.15.76:0/815997806 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff69001e040 con 0x557886750810 2024-06-02T04:49:14.241 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.234+0000 7ff6897fa700 1 -- 172.21.15.76:0/815997806 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff69809d120 con 0x557886750810 2024-06-02T04:49:14.241 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.234+0000 7ff6b4403b80 10 client.15225 fetch_fsmap learned FSMap version 24 2024-06-02T04:49:14.241 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.234+0000 7ff6b4403b80 1 -- 172.21.15.76:0/815997806 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x557886524c80 con 0x557886750810 2024-06-02T04:49:14.241 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.234+0000 7ff6897fa700 1 -- 172.21.15.76:0/815997806 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff69001e040 con 0x557886750810 2024-06-02T04:49:14.242 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.234+0000 7ff6897fa700 1 -- 172.21.15.76:0/815997806 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7ff698099830 con 0x557886750810 2024-06-02T04:49:14.242 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.234+0000 7ff6b4403b80 10 client.15225 fetch_fsmap finished waiting for FSMap version 24 2024-06-02T04:49:14.242 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.234+0000 7ff6b4403b80 10 client.15225 resolve_mds: resolved name 'i' to daemon mds.i 2024-06-02T04:49:14.242 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.234+0000 7ff6b4403b80 20 client.15225 populate_metadata read hostname 'smithi076' 2024-06-02T04:49:14.242 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.234+0000 7ff6b4403b80 1 --2- 172.21.15.76:0/815997806 >> [v2:172.21.15.192:6838/3978681402,v1:172.21.15.192:6839/3978681402] conn(0x5578867bf6d0 0x5578867bc060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:14.242 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.234+0000 7ff6b4403b80 4 client.15225 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "status"}] 2024-06-02T04:49:14.242 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.234+0000 7ff6b4403b80 1 -- 172.21.15.76:0/815997806 --> [v2:172.21.15.192:6838/3978681402,v1:172.21.15.192:6839/3978681402] -- command(tid 0: {"prefix": "status"}) v1 -- 0x557886697e70 con 0x5578867bf6d0 2024-06-02T04:49:14.242 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.234+0000 7ff6a5fe4700 1 --2- 172.21.15.76:0/815997806 >> [v2:172.21.15.192:6838/3978681402,v1:172.21.15.192:6839/3978681402] conn(0x5578867bf6d0 0x5578867bc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:14.242 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.235+0000 7ff6897fa700 10 client.15225 ms_handle_connect on v2:172.21.15.192:6838/3978681402 2024-06-02T04:49:14.242 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.235+0000 7ff6a5fe4700 1 --2- 172.21.15.76:0/815997806 >> [v2:172.21.15.192:6838/3978681402,v1:172.21.15.192:6839/3978681402] conn(0x5578867bf6d0 0x5578867bc060 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4f0813a6fa657af0 server_cookie=ee2e684898cb04e8 in_seq=0 out_seq=0 2024-06-02T04:49:14.242 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.235+0000 7ff6897fa700 1 -- 172.21.15.76:0/815997806 <== mds.1 v2:172.21.15.192:6838/3978681402 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+326 (crc 0 0 0) 0x557886697e70 con 0x5578867bf6d0 2024-06-02T04:49:14.243 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.235+0000 7ff6897fa700 10 client.15225 handle_command_reply: tid=0 2024-06-02T04:49:14.243 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.235+0000 7ff6b4403b80 1 client.15225 shutdown 2024-06-02T04:49:14.243 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.235+0000 7ff6b4403b80 1 -- 172.21.15.76:0/815997806 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557886750810 msgr2=0x55788675fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:14.243 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.235+0000 7ff6b4403b80 1 --2- 172.21.15.76:0/815997806 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557886750810 0x55788675fdb0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7ff6980a1520 tx=0x7ff69800d8a0 comp rx=0 tx=0).stop 2024-06-02T04:49:14.243 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.235+0000 7ff6b4403b80 1 -- 172.21.15.76:0/815997806 shutdown_connections 2024-06-02T04:49:14.243 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.235+0000 7ff6b4403b80 1 --2- 172.21.15.76:0/815997806 >> [v2:172.21.15.192:6838/3978681402,v1:172.21.15.192:6839/3978681402] conn(0x5578867bf6d0 0x5578867bc060 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:14.243 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.235+0000 7ff6b4403b80 1 --2- 172.21.15.76:0/815997806 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557886750810 0x55788675fdb0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:14.243 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.235+0000 7ff6b4403b80 1 --2- 172.21.15.76:0/815997806 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55788674f4f0 0x55788675d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:14.243 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.235+0000 7ff6b4403b80 1 --2- 172.21.15.76:0/815997806 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55788674fe50 0x55788675f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:14.243 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.235+0000 7ff6897fa700 0 client.15225 ms_handle_reset on v2:172.21.15.192:6838/3978681402 2024-06-02T04:49:14.243 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.235+0000 7ff6b4403b80 1 -- 172.21.15.76:0/815997806 >> 172.21.15.76:0/815997806 conn(0x5578866ad1c0 msgr2=0x557886759a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:14.243 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.235+0000 7ff6b4403b80 1 -- 172.21.15.76:0/815997806 shutdown_connections 2024-06-02T04:49:14.243 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.236+0000 7ff6b4403b80 1 -- 172.21.15.76:0/815997806 wait complete. 2024-06-02T04:49:14.244 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.236+0000 7ff6b4403b80 20 client.15225 trim_cache size 0 max 16384 2024-06-02T04:49:14.244 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-06-02T04:49:14.244 INFO:teuthology.orchestra.run.smithi076.stdout: "cluster_fsid": "60ab6d30-209a-11ef-bc9b-c7b262605968", 2024-06-02T04:49:14.244 INFO:teuthology.orchestra.run.smithi076.stdout: "whoami": 1, 2024-06-02T04:49:14.244 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 24475, 2024-06-02T04:49:14.244 INFO:teuthology.orchestra.run.smithi076.stdout: "want_state": "up:active", 2024-06-02T04:49:14.244 INFO:teuthology.orchestra.run.smithi076.stdout: "state": "up:active", 2024-06-02T04:49:14.244 INFO:teuthology.orchestra.run.smithi076.stdout: "fs_name": "cephfs", 2024-06-02T04:49:14.244 INFO:teuthology.orchestra.run.smithi076.stdout: "rank_uptime": 47.971063594, 2024-06-02T04:49:14.244 INFO:teuthology.orchestra.run.smithi076.stdout: "mdsmap_epoch": 24, 2024-06-02T04:49:14.245 INFO:teuthology.orchestra.run.smithi076.stdout: "osdmap_epoch": 82, 2024-06-02T04:49:14.245 INFO:teuthology.orchestra.run.smithi076.stdout: "osdmap_epoch_barrier": 80, 2024-06-02T04:49:14.245 INFO:teuthology.orchestra.run.smithi076.stdout: "uptime": 82.426095356999994 2024-06-02T04:49:14.245 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-06-02T04:49:14.245 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.236+0000 7ff6a8248700 1 -- 172.21.15.76:0/907117121 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7ff68c0a11b0 msgr2=0x7ff68c0a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:14.245 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.236+0000 7ff6a8248700 1 --2- 172.21.15.76:0/907117121 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7ff68c0a11b0 0x7ff68c0a3670 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7ff690006010 tx=0x7ff69000b610 comp rx=0 tx=0).stop 2024-06-02T04:49:14.246 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.236+0000 7ff6a8248700 1 -- 172.21.15.76:0/907117121 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff6a0106c40 msgr2=0x7ff6a019e3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:14.246 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.236+0000 7ff6a8248700 1 --2- 172.21.15.76:0/907117121 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff6a0106c40 0x7ff6a019e3a0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7ff698007ee0 tx=0x7ff69800d3b0 comp rx=0 tx=0).stop 2024-06-02T04:49:14.246 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.236+0000 7ff6a8248700 1 -- 172.21.15.76:0/907117121 shutdown_connections 2024-06-02T04:49:14.246 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.236+0000 7ff6a8248700 1 --2- 172.21.15.76:0/907117121 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff6a0106c40 0x7ff6a019e3a0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:14.246 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.236+0000 7ff6a8248700 1 --2- 172.21.15.76:0/907117121 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7ff68c0a11b0 0x7ff68c0a3670 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:14.246 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.236+0000 7ff6a8248700 1 --2- 172.21.15.76:0/907117121 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff6a01019e0 0x7ff6a0196e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:14.246 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.236+0000 7ff6a8248700 1 --2- 172.21.15.76:0/907117121 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff6a0104310 0x7ff6a0197380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:14.246 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.236+0000 7ff6a8248700 1 -- 172.21.15.76:0/907117121 >> 172.21.15.76:0/907117121 conn(0x7ff6a00fb3f0 msgr2=0x7ff6a0102580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:14.246 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.236+0000 7ff6a8248700 1 -- 172.21.15.76:0/907117121 shutdown_connections 2024-06-02T04:49:14.246 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.236+0000 7ff6a8248700 1 -- 172.21.15.76:0/907117121 wait complete. 2024-06-02T04:49:14.249 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-06-02T04:49:14.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:13 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/3086877149' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:49:14.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:13 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/947969051' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:49:14.376 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.374+0000 7fc294272700 1 -- 172.21.15.76:0/1819695321 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc28c101970 msgr2=0x7fc28c108290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:14.377 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.374+0000 7fc294272700 1 --2- 172.21.15.76:0/1819695321 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc28c101970 0x7fc28c108290 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fc28400b0a0 tx=0x7fc28400b3b0 comp rx=0 tx=0).stop 2024-06-02T04:49:14.377 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.374+0000 7fc294272700 1 -- 172.21.15.76:0/1819695321 shutdown_connections 2024-06-02T04:49:14.377 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.374+0000 7fc294272700 1 --2- 172.21.15.76:0/1819695321 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc28c101970 0x7fc28c108290 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:14.377 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.374+0000 7fc294272700 1 --2- 172.21.15.76:0/1819695321 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc28c0ffe60 0x7fc28c100280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:14.377 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.374+0000 7fc294272700 1 --2- 172.21.15.76:0/1819695321 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc28c100fb0 0x7fc28c101430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:14.377 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.374+0000 7fc294272700 1 -- 172.21.15.76:0/1819695321 >> 172.21.15.76:0/1819695321 conn(0x7fc28c0fb3f0 msgr2=0x7fc28c0fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:14.377 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.374+0000 7fc294272700 1 -- 172.21.15.76:0/1819695321 shutdown_connections 2024-06-02T04:49:14.377 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.374+0000 7fc294272700 1 -- 172.21.15.76:0/1819695321 wait complete. 2024-06-02T04:49:14.377 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.375+0000 7fc294272700 1 Processor -- start 2024-06-02T04:49:14.377 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.375+0000 7fc294272700 1 -- start start 2024-06-02T04:49:14.378 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.375+0000 7fc294272700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc28c0ffe60 0x7fc28c068b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:14.378 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.375+0000 7fc294272700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc28c100fb0 0x7fc28c19bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:14.378 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.375+0000 7fc294272700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc28c101970 0x7fc28c19e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:14.378 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.375+0000 7fc294272700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc28c19eab0 con 0x7fc28c0ffe60 2024-06-02T04:49:14.378 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.375+0000 7fc294272700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc28c19ec20 con 0x7fc28c101970 2024-06-02T04:49:14.378 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.375+0000 7fc294272700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc28c19ede0 con 0x7fc28c100fb0 2024-06-02T04:49:14.378 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.375+0000 7fc29200e700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc28c0ffe60 0x7fc28c068b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:14.378 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.375+0000 7fc29200e700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc28c0ffe60 0x7fc28c068b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:38428/0 (socket says 172.21.15.76:38428) 2024-06-02T04:49:14.378 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.375+0000 7fc29200e700 1 -- 172.21.15.76:0/3790193089 learned_addr learned my addr 172.21.15.76:0/3790193089 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:49:14.378 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.375+0000 7fc29180d700 1 --2- 172.21.15.76:0/3790193089 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc28c100fb0 0x7fc28c19bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:14.378 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.375+0000 7fc29280f700 1 --2- 172.21.15.76:0/3790193089 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc28c101970 0x7fc28c19e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:14.379 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.375+0000 7fc29200e700 1 -- 172.21.15.76:0/3790193089 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc28c100fb0 msgr2=0x7fc28c19bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:14.379 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.375+0000 7fc29200e700 1 --2- 172.21.15.76:0/3790193089 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc28c100fb0 0x7fc28c19bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:14.379 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.375+0000 7fc29200e700 1 -- 172.21.15.76:0/3790193089 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc28c101970 msgr2=0x7fc28c19e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:14.379 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.375+0000 7fc29200e700 1 --2- 172.21.15.76:0/3790193089 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc28c101970 0x7fc28c19e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:14.379 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.375+0000 7fc29200e700 1 -- 172.21.15.76:0/3790193089 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc284009d00 con 0x7fc28c0ffe60 2024-06-02T04:49:14.379 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.375+0000 7fc29180d700 1 --2- 172.21.15.76:0/3790193089 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc28c100fb0 0x7fc28c19bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:49:14.379 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.375+0000 7fc29280f700 1 --2- 172.21.15.76:0/3790193089 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc28c101970 0x7fc28c19e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:49:14.379 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.375+0000 7fc29200e700 1 --2- 172.21.15.76:0/3790193089 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc28c0ffe60 0x7fc28c068b10 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fc28000b530 tx=0x7fc28000b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:14.379 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.376+0000 7fc27f7fe700 1 -- 172.21.15.76:0/3790193089 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc280011830 con 0x7fc28c0ffe60 2024-06-02T04:49:14.379 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.376+0000 7fc27f7fe700 1 -- 172.21.15.76:0/3790193089 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc280011e20 con 0x7fc28c0ffe60 2024-06-02T04:49:14.379 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.376+0000 7fc294272700 1 -- 172.21.15.76:0/3790193089 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc28c19f0c0 con 0x7fc28c0ffe60 2024-06-02T04:49:14.379 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.376+0000 7fc27f7fe700 1 -- 172.21.15.76:0/3790193089 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc280010dd0 con 0x7fc28c0ffe60 2024-06-02T04:49:14.379 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.376+0000 7fc294272700 1 -- 172.21.15.76:0/3790193089 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc28c19f620 con 0x7fc28c0ffe60 2024-06-02T04:49:14.386 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.378+0000 7fc27f7fe700 1 -- 172.21.15.76:0/3790193089 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fc280011990 con 0x7fc28c0ffe60 2024-06-02T04:49:14.386 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.378+0000 7fc27f7fe700 1 --2- 172.21.15.76:0/3790193089 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fc2780a1230 0x7fc2780a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:14.386 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.379+0000 7fc29180d700 1 --2- 172.21.15.76:0/3790193089 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fc2780a1230 0x7fc2780a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:14.386 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.379+0000 7fc27f7fe700 1 -- 172.21.15.76:0/3790193089 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fc2800cc7c0 con 0x7fc28c0ffe60 2024-06-02T04:49:14.386 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.379+0000 7fc29180d700 1 --2- 172.21.15.76:0/3790193089 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fc2780a1230 0x7fc2780a36f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fc28c0690d0 tx=0x7fc288008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:14.386 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.379+0000 7fc2a042db80 1 Processor -- start 2024-06-02T04:49:14.386 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.379+0000 7fc2a042db80 1 -- start start 2024-06-02T04:49:14.386 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.380+0000 7fc2a042db80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5589a01674f0 0x5589a0167910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:14.386 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.380+0000 7fc2a042db80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5589a0167e50 0x5589a01682d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:14.387 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.380+0000 7fc2a042db80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5589a0168810 0x5589a0168c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:14.387 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.380+0000 7fc2a042db80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589a00be100 con 0x5589a0167e50 2024-06-02T04:49:14.387 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.380+0000 7fc2a042db80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589a00bbac0 con 0x5589a0168810 2024-06-02T04:49:14.387 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.380+0000 7fc2a042db80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589a00b73b0 con 0x5589a01674f0 2024-06-02T04:49:14.387 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.380+0000 7fc29180d700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5589a0167e50 0x5589a01682d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:14.387 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.380+0000 7fc29180d700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5589a0167e50 0x5589a01682d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:38442/0 (socket says 172.21.15.76:38442) 2024-06-02T04:49:14.387 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.380+0000 7fc29180d700 1 -- 172.21.15.76:0/2235783295 learned_addr learned my addr 172.21.15.76:0/2235783295 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:49:14.387 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.380+0000 7fc29200e700 1 --2- 172.21.15.76:0/2235783295 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5589a01674f0 0x5589a0167910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:14.387 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.380+0000 7fc29280f700 1 --2- 172.21.15.76:0/2235783295 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5589a0168810 0x5589a0168c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:14.387 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.380+0000 7fc29180d700 1 -- 172.21.15.76:0/2235783295 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5589a01674f0 msgr2=0x5589a0167910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:49:14.387 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.380+0000 7fc29180d700 1 --2- 172.21.15.76:0/2235783295 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5589a01674f0 0x5589a0167910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:14.387 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.380+0000 7fc29180d700 1 -- 172.21.15.76:0/2235783295 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5589a0168810 msgr2=0x5589a0168c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:49:14.387 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.380+0000 7fc29180d700 1 --2- 172.21.15.76:0/2235783295 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5589a0168810 0x5589a0168c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:14.388 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.380+0000 7fc29180d700 1 -- 172.21.15.76:0/2235783295 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55899ff38360 con 0x5589a0167e50 2024-06-02T04:49:14.388 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.380+0000 7fc29180d700 1 --2- 172.21.15.76:0/2235783295 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5589a0167e50 0x5589a01682d0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fc28800d780 tx=0x7fc288010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df776336304b06f7 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:14.388 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.380+0000 7fc27cda5700 1 -- 172.21.15.76:0/2235783295 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc288014640 con 0x5589a0167e50 2024-06-02T04:49:14.388 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.380+0000 7fc27cda5700 1 -- 172.21.15.76:0/2235783295 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc288014c30 con 0x5589a0167e50 2024-06-02T04:49:14.388 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.380+0000 7fc27cda5700 1 -- 172.21.15.76:0/2235783295 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc28801fb80 con 0x5589a0167e50 2024-06-02T04:49:14.388 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.381+0000 7fc2a042db80 1 -- 172.21.15.76:0/2235783295 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5589a0167e50 msgr2=0x5589a01682d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:14.388 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.381+0000 7fc2a042db80 1 --2- 172.21.15.76:0/2235783295 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5589a0167e50 0x5589a01682d0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fc28800d780 tx=0x7fc288010000 comp rx=0 tx=0).stop 2024-06-02T04:49:14.388 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.381+0000 7fc2a042db80 1 -- 172.21.15.76:0/2235783295 shutdown_connections 2024-06-02T04:49:14.388 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.381+0000 7fc2a042db80 1 --2- 172.21.15.76:0/2235783295 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5589a0168810 0x5589a0168c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:14.388 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.381+0000 7fc2a042db80 1 --2- 172.21.15.76:0/2235783295 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5589a01674f0 0x5589a0167910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:14.388 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.381+0000 7fc2a042db80 1 --2- 172.21.15.76:0/2235783295 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5589a0167e50 0x5589a01682d0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:14.388 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.381+0000 7fc2a042db80 1 -- 172.21.15.76:0/2235783295 >> 172.21.15.76:0/2235783295 conn(0x5589a00c51c0 msgr2=0x5589a0161d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:14.388 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.381+0000 7fc2a042db80 1 -- 172.21.15.76:0/2235783295 shutdown_connections 2024-06-02T04:49:14.389 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.381+0000 7fc2a042db80 1 -- 172.21.15.76:0/2235783295 wait complete. 2024-06-02T04:49:14.389 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.381+0000 7fc2a042db80 1 -- start start 2024-06-02T04:49:14.389 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.382+0000 7fc2a042db80 1 Processor -- start 2024-06-02T04:49:14.389 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.382+0000 7fc2a042db80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5589a01674f0 0x5589a0170e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:14.389 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.382+0000 7fc2a042db80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5589a0167e50 0x5589a0171340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:14.389 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.382+0000 7fc2a042db80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5589a0168810 0x5589a0178380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:14.389 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.382+0000 7fc2a042db80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589a0053510 con 0x5589a0168810 2024-06-02T04:49:14.389 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.382+0000 7fc2a042db80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589a00531b0 con 0x5589a01674f0 2024-06-02T04:49:14.389 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.382+0000 7fc2a042db80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55899ff3a650 con 0x5589a0167e50 2024-06-02T04:49:14.389 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.382+0000 7fc2a042db80 10 client.0 _ll_register_callbacks cb 0x5589a005cae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:49:14.389 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.382+0000 7fc29280f700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5589a0168810 0x5589a0178380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:14.389 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.382+0000 7fc29280f700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5589a0168810 0x5589a0178380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:38444/0 (socket says 172.21.15.76:38444) 2024-06-02T04:49:14.389 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.382+0000 7fc29280f700 1 -- 172.21.15.76:0/3099068206 learned_addr learned my addr 172.21.15.76:0/3099068206 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:49:14.390 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.382+0000 7fc29180d700 1 --2- 172.21.15.76:0/3099068206 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5589a0167e50 0x5589a0171340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:14.390 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.382+0000 7fc29200e700 1 --2- 172.21.15.76:0/3099068206 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5589a01674f0 0x5589a0170e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:14.390 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.382+0000 7fc29280f700 1 -- 172.21.15.76:0/3099068206 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5589a0167e50 msgr2=0x5589a0171340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:49:14.390 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.382+0000 7fc29280f700 1 --2- 172.21.15.76:0/3099068206 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5589a0167e50 0x5589a0171340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:14.390 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.382+0000 7fc29280f700 1 -- 172.21.15.76:0/3099068206 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5589a01674f0 msgr2=0x5589a0170e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:49:14.390 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.382+0000 7fc29280f700 1 --2- 172.21.15.76:0/3099068206 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5589a01674f0 0x5589a0170e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:14.390 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.382+0000 7fc29280f700 1 -- 172.21.15.76:0/3099068206 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc28800e040 con 0x5589a0168810 2024-06-02T04:49:14.390 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.382+0000 7fc29200e700 1 --2- 172.21.15.76:0/3099068206 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5589a01674f0 0x5589a0170e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:49:14.390 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.382+0000 7fc29280f700 1 --2- 172.21.15.76:0/3099068206 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5589a0168810 0x5589a0178380 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fc28400b830 tx=0x7fc284009420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8b54b3a09e92702 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:14.390 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.382+0000 7fc275ffb700 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-06-02T04:49:14.390 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.382+0000 7fc275ffb700 1 -- 172.21.15.76:0/3099068206 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc28400e040 con 0x5589a0168810 2024-06-02T04:49:14.390 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.383+0000 7fc275ffb700 1 -- 172.21.15.76:0/3099068206 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fc28401c440 con 0x5589a0168810 2024-06-02T04:49:14.390 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.383+0000 7fc2a042db80 1 -- 172.21.15.76:0/3099068206 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5589a0010220 con 0x5589a0168810 2024-06-02T04:49:14.391 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.383+0000 7fc275ffb700 1 -- 172.21.15.76:0/3099068206 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc28401c600 con 0x5589a0168810 2024-06-02T04:49:14.391 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.383+0000 7fc2a042db80 10 client.15237 fetch_fsmap learned FSMap version 24 2024-06-02T04:49:14.391 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.383+0000 7fc2a042db80 1 -- 172.21.15.76:0/3099068206 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55899fee4b10 con 0x5589a0168810 2024-06-02T04:49:14.391 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.383+0000 7fc275ffb700 1 -- 172.21.15.76:0/3099068206 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5589a0010220 con 0x5589a0168810 2024-06-02T04:49:14.391 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.383+0000 7fc275ffb700 1 -- 172.21.15.76:0/3099068206 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fc284019050 con 0x5589a0168810 2024-06-02T04:49:14.391 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.383+0000 7fc2a042db80 10 client.15237 fetch_fsmap finished waiting for FSMap version 24 2024-06-02T04:49:14.391 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.383+0000 7fc2a042db80 10 client.15237 resolve_mds: resolved name 'b' to daemon mds.b 2024-06-02T04:49:14.391 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.383+0000 7fc2a042db80 20 client.15237 populate_metadata read hostname 'smithi076' 2024-06-02T04:49:14.391 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.383+0000 7fc2a042db80 1 --2- 172.21.15.76:0/3099068206 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5589a017bfc0 0x5589a01812a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:14.391 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.383+0000 7fc2a042db80 4 client.15237 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T04:49:14.391 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.383+0000 7fc2a042db80 1 -- 172.21.15.76:0/3099068206 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5589a01367c0 con 0x5589a017bfc0 2024-06-02T04:49:14.391 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.383+0000 7fc29200e700 1 --2- 172.21.15.76:0/3099068206 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5589a017bfc0 0x5589a01812a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:14.391 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.384+0000 7fc275ffb700 10 client.15237 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:49:14.391 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.384+0000 7fc29200e700 1 --2- 172.21.15.76:0/3099068206 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5589a017bfc0 0x5589a01812a0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5d3be8e99b8277e0 server_cookie=345316972494859e in_seq=0 out_seq=0 2024-06-02T04:49:14.392 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.384+0000 7fc275ffb700 1 -- 172.21.15.76:0/3099068206 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5589a01367c0 con 0x5589a017bfc0 2024-06-02T04:49:14.392 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.384+0000 7fc275ffb700 10 client.15237 handle_command_reply: tid=0 2024-06-02T04:49:14.392 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.384+0000 7fc2a042db80 1 client.15237 shutdown 2024-06-02T04:49:14.392 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.385+0000 7fc2a042db80 1 -- 172.21.15.76:0/3099068206 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5589a0168810 msgr2=0x5589a0178380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:14.392 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.385+0000 7fc2a042db80 1 --2- 172.21.15.76:0/3099068206 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5589a0168810 0x5589a0178380 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fc28400b830 tx=0x7fc284009420 comp rx=0 tx=0).stop 2024-06-02T04:49:14.392 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.385+0000 7fc2a042db80 1 -- 172.21.15.76:0/3099068206 shutdown_connections 2024-06-02T04:49:14.392 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.385+0000 7fc2a042db80 1 --2- 172.21.15.76:0/3099068206 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5589a017bfc0 0x5589a01812a0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:14.392 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.385+0000 7fc2a042db80 1 --2- 172.21.15.76:0/3099068206 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5589a0168810 0x5589a0178380 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:14.392 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.385+0000 7fc275ffb700 0 client.15237 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:49:14.392 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.385+0000 7fc2a042db80 1 --2- 172.21.15.76:0/3099068206 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5589a01674f0 0x5589a0170e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:14.392 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.385+0000 7fc2a042db80 1 --2- 172.21.15.76:0/3099068206 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5589a0167e50 0x5589a0171340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:14.392 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.385+0000 7fc2a042db80 1 -- 172.21.15.76:0/3099068206 >> 172.21.15.76:0/3099068206 conn(0x5589a00c51c0 msgr2=0x5589a0161550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:14.393 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.385+0000 7fc2a042db80 1 -- 172.21.15.76:0/3099068206 shutdown_connections 2024-06-02T04:49:14.393 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.385+0000 7fc2a042db80 1 -- 172.21.15.76:0/3099068206 wait complete. 2024-06-02T04:49:14.393 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.385+0000 7fc2a042db80 20 client.15237 trim_cache size 0 max 16384 2024-06-02T04:49:14.409 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.402+0000 7fc2a042db80 1 Processor -- start 2024-06-02T04:49:14.409 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.402+0000 7fc2a042db80 1 -- start start 2024-06-02T04:49:14.409 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.403+0000 7fc2a042db80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5589a01674f0 0x5589a01678d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:14.409 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.403+0000 7fc2a042db80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5589a0167e50 0x5589a0178a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:14.409 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.403+0000 7fc2a042db80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5589a0168810 0x5589a0178340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:14.409 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.403+0000 7fc2a042db80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589a00b0150 con 0x5589a0167e50 2024-06-02T04:49:14.409 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.403+0000 7fc2a042db80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589a00b4010 con 0x5589a0168810 2024-06-02T04:49:14.410 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.403+0000 7fc2a042db80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589a00565a0 con 0x5589a01674f0 2024-06-02T04:49:14.410 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.403+0000 7fc29180d700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5589a0167e50 0x5589a0178a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:14.410 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.403+0000 7fc29180d700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5589a0167e50 0x5589a0178a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:38452/0 (socket says 172.21.15.76:38452) 2024-06-02T04:49:14.410 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.403+0000 7fc29180d700 1 -- 172.21.15.76:0/3791128283 learned_addr learned my addr 172.21.15.76:0/3791128283 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:49:14.410 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.403+0000 7fc29280f700 1 --2- 172.21.15.76:0/3791128283 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5589a0168810 0x5589a0178340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:14.410 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.403+0000 7fc29200e700 1 --2- 172.21.15.76:0/3791128283 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5589a01674f0 0x5589a01678d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:14.410 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.403+0000 7fc29180d700 1 -- 172.21.15.76:0/3791128283 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5589a01674f0 msgr2=0x5589a01678d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:49:14.410 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.403+0000 7fc29180d700 1 --2- 172.21.15.76:0/3791128283 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5589a01674f0 0x5589a01678d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:14.410 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.403+0000 7fc29180d700 1 -- 172.21.15.76:0/3791128283 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5589a0168810 msgr2=0x5589a0178340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:49:14.410 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.403+0000 7fc29180d700 1 --2- 172.21.15.76:0/3791128283 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5589a0168810 0x5589a0178340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:14.411 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.403+0000 7fc29180d700 1 -- 172.21.15.76:0/3791128283 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5589a007d510 con 0x5589a0167e50 2024-06-02T04:49:14.411 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.403+0000 7fc29280f700 1 --2- 172.21.15.76:0/3791128283 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5589a0168810 0x5589a0178340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:49:14.411 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.403+0000 7fc29200e700 1 --2- 172.21.15.76:0/3791128283 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5589a01674f0 0x5589a01678d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:49:14.411 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.403+0000 7fc29180d700 1 --2- 172.21.15.76:0/3791128283 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5589a0167e50 0x5589a0178a30 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fc288006fd0 tx=0x7fc288009e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=921e6638cb1b18e7 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:14.411 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.403+0000 7fc27d5a6700 1 -- 172.21.15.76:0/3791128283 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc28801f500 con 0x5589a0167e50 2024-06-02T04:49:14.411 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.403+0000 7fc27d5a6700 1 -- 172.21.15.76:0/3791128283 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc28801f770 con 0x5589a0167e50 2024-06-02T04:49:14.411 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.403+0000 7fc27d5a6700 1 -- 172.21.15.76:0/3791128283 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc288014ad0 con 0x5589a0167e50 2024-06-02T04:49:14.411 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.404+0000 7fc2a042db80 1 -- 172.21.15.76:0/3791128283 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5589a0167e50 msgr2=0x5589a0178a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:14.411 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.404+0000 7fc2a042db80 1 --2- 172.21.15.76:0/3791128283 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5589a0167e50 0x5589a0178a30 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fc288006fd0 tx=0x7fc288009e90 comp rx=0 tx=0).stop 2024-06-02T04:49:14.411 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.404+0000 7fc2a042db80 1 -- 172.21.15.76:0/3791128283 shutdown_connections 2024-06-02T04:49:14.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.404+0000 7fc2a042db80 1 --2- 172.21.15.76:0/3791128283 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5589a0168810 0x5589a0178340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:14.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.404+0000 7fc2a042db80 1 --2- 172.21.15.76:0/3791128283 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5589a01674f0 0x5589a01678d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:14.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.404+0000 7fc2a042db80 1 --2- 172.21.15.76:0/3791128283 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5589a0167e50 0x5589a0178a30 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:14.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.404+0000 7fc2a042db80 1 -- 172.21.15.76:0/3791128283 >> 172.21.15.76:0/3791128283 conn(0x5589a00c51c0 msgr2=0x5589a0168bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:14.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.404+0000 7fc2a042db80 1 -- 172.21.15.76:0/3791128283 shutdown_connections 2024-06-02T04:49:14.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.404+0000 7fc2a042db80 1 -- 172.21.15.76:0/3791128283 wait complete. 2024-06-02T04:49:14.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.404+0000 7fc2a042db80 1 -- start start 2024-06-02T04:49:14.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.404+0000 7fc2a042db80 1 Processor -- start 2024-06-02T04:49:14.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.404+0000 7fc2a042db80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5589a01674f0 0x5589a01752d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:14.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.404+0000 7fc2a042db80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5589a0168810 0x5589a0177820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:14.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.404+0000 7fc2a042db80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5589a0177d60 0x5589a01781e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:14.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.404+0000 7fc2a042db80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589a01d2fb0 con 0x5589a0168810 2024-06-02T04:49:14.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.404+0000 7fc2a042db80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589a01d3120 con 0x5589a0177d60 2024-06-02T04:49:14.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.404+0000 7fc2a042db80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589a01d32e0 con 0x5589a01674f0 2024-06-02T04:49:14.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.404+0000 7fc2a042db80 10 client.0 _ll_register_callbacks cb 0x5589a005cae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:49:14.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.405+0000 7fc29180d700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5589a0168810 0x5589a0177820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:14.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.405+0000 7fc29180d700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5589a0168810 0x5589a0177820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:38456/0 (socket says 172.21.15.76:38456) 2024-06-02T04:49:14.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.405+0000 7fc29180d700 1 -- 172.21.15.76:0/3107966253 learned_addr learned my addr 172.21.15.76:0/3107966253 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:49:14.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.405+0000 7fc29280f700 1 --2- 172.21.15.76:0/3107966253 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5589a0177d60 0x5589a01781e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:14.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.405+0000 7fc29200e700 1 --2- 172.21.15.76:0/3107966253 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5589a01674f0 0x5589a01752d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:14.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.405+0000 7fc29180d700 1 -- 172.21.15.76:0/3107966253 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5589a01674f0 msgr2=0x5589a01752d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:49:14.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.405+0000 7fc29180d700 1 --2- 172.21.15.76:0/3107966253 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5589a01674f0 0x5589a01752d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:14.414 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.405+0000 7fc29180d700 1 -- 172.21.15.76:0/3107966253 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5589a0177d60 msgr2=0x5589a01781e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:49:14.414 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.405+0000 7fc29180d700 1 --2- 172.21.15.76:0/3107966253 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5589a0177d60 0x5589a01781e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:14.414 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.405+0000 7fc29180d700 1 -- 172.21.15.76:0/3107966253 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55899ff38360 con 0x5589a0168810 2024-06-02T04:49:14.414 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.405+0000 7fc29180d700 1 --2- 172.21.15.76:0/3107966253 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5589a0168810 0x5589a0177820 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fc288009370 tx=0x7fc2880148f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae38ddc8f5f0b700 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:14.414 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.405+0000 7fc275ffb700 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-06-02T04:49:14.414 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.405+0000 7fc275ffb700 1 -- 172.21.15.76:0/3107966253 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc28801faf0 con 0x5589a0168810 2024-06-02T04:49:14.414 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.405+0000 7fc275ffb700 1 -- 172.21.15.76:0/3107966253 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fc28801fc50 con 0x5589a0168810 2024-06-02T04:49:14.414 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.405+0000 7fc2a042db80 1 -- 172.21.15.76:0/3107966253 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc288014c30 con 0x5589a0168810 2024-06-02T04:49:14.414 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.405+0000 7fc275ffb700 1 -- 172.21.15.76:0/3107966253 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc288028400 con 0x5589a0168810 2024-06-02T04:49:14.414 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.405+0000 7fc2a042db80 10 client.15243 fetch_fsmap learned FSMap version 24 2024-06-02T04:49:14.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.405+0000 7fc2a042db80 1 -- 172.21.15.76:0/3107966253 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55899ff3cc80 con 0x5589a0168810 2024-06-02T04:49:14.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.405+0000 7fc275ffb700 1 -- 172.21.15.76:0/3107966253 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc288046020 con 0x5589a0168810 2024-06-02T04:49:14.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.406+0000 7fc275ffb700 1 -- 172.21.15.76:0/3107966253 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fc2880333f0 con 0x5589a0168810 2024-06-02T04:49:14.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.406+0000 7fc2a042db80 10 client.15243 fetch_fsmap finished waiting for FSMap version 24 2024-06-02T04:49:14.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.406+0000 7fc2a042db80 10 client.15243 resolve_mds: resolved name 'b' to daemon mds.b 2024-06-02T04:49:14.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.406+0000 7fc2a042db80 20 client.15243 populate_metadata read hostname 'smithi076' 2024-06-02T04:49:14.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.406+0000 7fc2a042db80 1 --2- 172.21.15.76:0/3107966253 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5589a01d7b80 0x5589a01d4530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:14.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.406+0000 7fc2a042db80 4 client.15243 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "status"}] 2024-06-02T04:49:14.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.406+0000 7fc2a042db80 1 -- 172.21.15.76:0/3107966253 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5589a00afe70 con 0x5589a01d7b80 2024-06-02T04:49:14.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.406+0000 7fc29200e700 1 --2- 172.21.15.76:0/3107966253 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5589a01d7b80 0x5589a01d4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:14.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.406+0000 7fc29200e700 1 --2- 172.21.15.76:0/3107966253 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5589a01d7b80 0x5589a01d4530 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b519097929186eed server_cookie=40118af07f2c41b0 in_seq=0 out_seq=0 2024-06-02T04:49:14.416 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.406+0000 7fc275ffb700 10 client.15243 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:49:14.416 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.407+0000 7fc275ffb700 1 -- 172.21.15.76:0/3107966253 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x5589a00afe70 con 0x5589a01d7b80 2024-06-02T04:49:14.416 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.407+0000 7fc275ffb700 10 client.15243 handle_command_reply: tid=0 2024-06-02T04:49:14.416 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.407+0000 7fc2a042db80 1 client.15243 shutdown 2024-06-02T04:49:14.416 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.407+0000 7fc2a042db80 1 -- 172.21.15.76:0/3107966253 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5589a0168810 msgr2=0x5589a0177820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:14.416 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.407+0000 7fc2a042db80 1 --2- 172.21.15.76:0/3107966253 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5589a0168810 0x5589a0177820 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fc288009370 tx=0x7fc2880148f0 comp rx=0 tx=0).stop 2024-06-02T04:49:14.416 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.407+0000 7fc2a042db80 1 -- 172.21.15.76:0/3107966253 shutdown_connections 2024-06-02T04:49:14.416 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.407+0000 7fc2a042db80 1 --2- 172.21.15.76:0/3107966253 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5589a01d7b80 0x5589a01d4530 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:14.416 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.407+0000 7fc2a042db80 1 --2- 172.21.15.76:0/3107966253 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5589a0177d60 0x5589a01781e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:14.416 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.407+0000 7fc2a042db80 1 --2- 172.21.15.76:0/3107966253 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5589a01674f0 0x5589a01752d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:14.416 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.407+0000 7fc275ffb700 0 client.15243 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:49:14.417 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.407+0000 7fc2a042db80 1 --2- 172.21.15.76:0/3107966253 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5589a0168810 0x5589a0177820 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:14.417 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.407+0000 7fc2a042db80 1 -- 172.21.15.76:0/3107966253 >> 172.21.15.76:0/3107966253 conn(0x5589a00c51c0 msgr2=0x5589a0178a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:14.417 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.407+0000 7fc2a042db80 1 -- 172.21.15.76:0/3107966253 shutdown_connections 2024-06-02T04:49:14.417 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.407+0000 7fc2a042db80 1 -- 172.21.15.76:0/3107966253 wait complete. 2024-06-02T04:49:14.417 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.407+0000 7fc2a042db80 20 client.15243 trim_cache size 0 max 16384 2024-06-02T04:49:14.417 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-06-02T04:49:14.417 INFO:teuthology.orchestra.run.smithi076.stdout: "cluster_fsid": "60ab6d30-209a-11ef-bc9b-c7b262605968", 2024-06-02T04:49:14.417 INFO:teuthology.orchestra.run.smithi076.stdout: "whoami": 0, 2024-06-02T04:49:14.418 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 24491, 2024-06-02T04:49:14.418 INFO:teuthology.orchestra.run.smithi076.stdout: "want_state": "up:active", 2024-06-02T04:49:14.418 INFO:teuthology.orchestra.run.smithi076.stdout: "state": "up:active", 2024-06-02T04:49:14.418 INFO:teuthology.orchestra.run.smithi076.stdout: "fs_name": "cephfs", 2024-06-02T04:49:14.418 INFO:teuthology.orchestra.run.smithi076.stdout: "rank_uptime": 71.741579982999994, 2024-06-02T04:49:14.418 INFO:teuthology.orchestra.run.smithi076.stdout: "mdsmap_epoch": 24, 2024-06-02T04:49:14.418 INFO:teuthology.orchestra.run.smithi076.stdout: "osdmap_epoch": 82, 2024-06-02T04:49:14.418 INFO:teuthology.orchestra.run.smithi076.stdout: "osdmap_epoch_barrier": 80, 2024-06-02T04:49:14.418 INFO:teuthology.orchestra.run.smithi076.stdout: "uptime": 77.298959832999998 2024-06-02T04:49:14.418 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-06-02T04:49:14.420 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.407+0000 7fc294272700 1 -- 172.21.15.76:0/3790193089 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fc2780a1230 msgr2=0x7fc2780a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:14.420 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.407+0000 7fc294272700 1 --2- 172.21.15.76:0/3790193089 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fc2780a1230 0x7fc2780a36f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fc28c0690d0 tx=0x7fc288008040 comp rx=0 tx=0).stop 2024-06-02T04:49:14.420 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.407+0000 7fc294272700 1 -- 172.21.15.76:0/3790193089 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc28c0ffe60 msgr2=0x7fc28c068b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:14.420 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.407+0000 7fc294272700 1 --2- 172.21.15.76:0/3790193089 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc28c0ffe60 0x7fc28c068b10 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fc28000b530 tx=0x7fc28000b8f0 comp rx=0 tx=0).stop 2024-06-02T04:49:14.420 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.407+0000 7fc294272700 1 -- 172.21.15.76:0/3790193089 shutdown_connections 2024-06-02T04:49:14.421 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.407+0000 7fc294272700 1 --2- 172.21.15.76:0/3790193089 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fc2780a1230 0x7fc2780a36f0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:14.421 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.407+0000 7fc294272700 1 --2- 172.21.15.76:0/3790193089 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc28c101970 0x7fc28c19e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:14.421 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.407+0000 7fc294272700 1 --2- 172.21.15.76:0/3790193089 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc28c0ffe60 0x7fc28c068b10 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:14.421 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.407+0000 7fc294272700 1 --2- 172.21.15.76:0/3790193089 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc28c100fb0 0x7fc28c19bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:14.421 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.407+0000 7fc294272700 1 -- 172.21.15.76:0/3790193089 >> 172.21.15.76:0/3790193089 conn(0x7fc28c0fb3f0 msgr2=0x7fc28c104410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:14.421 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.407+0000 7fc294272700 1 -- 172.21.15.76:0/3790193089 shutdown_connections 2024-06-02T04:49:14.421 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:14.407+0000 7fc294272700 1 -- 172.21.15.76:0/3790193089 wait complete. 2024-06-02T04:49:14.422 INFO:tasks.cephadm:Setup complete, yielding 2024-06-02T04:49:14.422 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-06-02T04:49:14.432 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi076.front.sepia.ceph.com 2024-06-02T04:49:14.433 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 60ab6d30-209a-11ef-bc9b-c7b262605968 -- bash -c 'ceph orch status' 2024-06-02T04:49:14.651 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T04:49:15.103 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:14 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/736033206' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:49:15.103 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:14 smithi076 ceph-mon[42935]: pgmap v256: 129 pgs: 129 active+clean; 639 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2024-06-02T04:49:15.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:14 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/736033206' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:49:15.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:14 smithi192 ceph-mon[47933]: pgmap v256: 129 pgs: 129 active+clean; 639 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2024-06-02T04:49:15.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:14 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/736033206' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:49:15.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:14 smithi119 ceph-mon[46633]: pgmap v256: 129 pgs: 129 active+clean; 639 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2024-06-02T04:49:15.756 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:15.755+0000 7f19e57a0700 1 -- 172.21.15.76:0/4075459449 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f19e00fff00 msgr2=0x7f19e0100320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:15.756 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:15.755+0000 7f19e57a0700 1 --2- 172.21.15.76:0/4075459449 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f19e00fff00 0x7f19e0100320 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f19d4009990 tx=0x7f19d4009ca0 comp rx=0 tx=0).stop 2024-06-02T04:49:15.756 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:15.755+0000 7f19e57a0700 1 -- 172.21.15.76:0/4075459449 shutdown_connections 2024-06-02T04:49:15.756 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:15.755+0000 7f19e57a0700 1 --2- 172.21.15.76:0/4075459449 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f19e0101a20 0x7f19e0108340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:15.756 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:15.755+0000 7f19e57a0700 1 --2- 172.21.15.76:0/4075459449 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f19e00fff00 0x7f19e0100320 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:15.756 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:15.755+0000 7f19e57a0700 1 --2- 172.21.15.76:0/4075459449 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f19e0101060 0x7f19e01014e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:15.756 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:15.755+0000 7f19e57a0700 1 -- 172.21.15.76:0/4075459449 >> 172.21.15.76:0/4075459449 conn(0x7f19e00fb4a0 msgr2=0x7f19e00fd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:15.756 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:15.755+0000 7f19e57a0700 1 -- 172.21.15.76:0/4075459449 shutdown_connections 2024-06-02T04:49:15.757 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:15.755+0000 7f19e57a0700 1 -- 172.21.15.76:0/4075459449 wait complete. 2024-06-02T04:49:15.757 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:15.755+0000 7f19e57a0700 1 Processor -- start 2024-06-02T04:49:15.757 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:15.756+0000 7f19e57a0700 1 -- start start 2024-06-02T04:49:15.759 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:15.756+0000 7f19e57a0700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f19e00fff00 0x7f19e010a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:15.759 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:15.756+0000 7f19e57a0700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f19e0101060 0x7f19e0108e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:15.759 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:15.756+0000 7f19e57a0700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f19e0101a20 0x7f19e0109370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:15.759 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:15.756+0000 7f19e57a0700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19e0109b10 con 0x7f19e00fff00 2024-06-02T04:49:15.759 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:15.756+0000 7f19e57a0700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19e0109c80 con 0x7f19e0101060 2024-06-02T04:49:15.759 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:15.756+0000 7f19e57a0700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19e01a0f60 con 0x7f19e0101a20 2024-06-02T04:49:15.759 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:15.756+0000 7f19deffd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f19e00fff00 0x7f19e010a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:15.759 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:15.756+0000 7f19deffd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f19e00fff00 0x7f19e010a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:38472/0 (socket says 172.21.15.76:38472) 2024-06-02T04:49:15.759 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:15.756+0000 7f19deffd700 1 -- 172.21.15.76:0/1595105849 learned_addr learned my addr 172.21.15.76:0/1595105849 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:49:15.759 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:15.756+0000 7f19de7fc700 1 --2- 172.21.15.76:0/1595105849 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f19e0101060 0x7f19e0108e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:15.759 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:15.756+0000 7f19df7fe700 1 --2- 172.21.15.76:0/1595105849 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f19e0101a20 0x7f19e0109370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:15.760 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:15.756+0000 7f19deffd700 1 -- 172.21.15.76:0/1595105849 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f19e0101a20 msgr2=0x7f19e0109370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:15.760 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:15.756+0000 7f19deffd700 1 --2- 172.21.15.76:0/1595105849 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f19e0101a20 0x7f19e0109370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:15.760 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:15.756+0000 7f19deffd700 1 -- 172.21.15.76:0/1595105849 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f19e0101060 msgr2=0x7f19e0108e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:15.760 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:15.756+0000 7f19deffd700 1 --2- 172.21.15.76:0/1595105849 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f19e0101060 0x7f19e0108e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:15.760 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:15.756+0000 7f19deffd700 1 -- 172.21.15.76:0/1595105849 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19d40095f0 con 0x7f19e00fff00 2024-06-02T04:49:15.760 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:15.756+0000 7f19df7fe700 1 --2- 172.21.15.76:0/1595105849 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f19e0101a20 0x7f19e0109370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:49:15.760 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:15.756+0000 7f19deffd700 1 --2- 172.21.15.76:0/1595105849 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f19e00fff00 0x7f19e010a790 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f19d4006010 tx=0x7f19d4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:15.760 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:15.757+0000 7f19c7fff700 1 -- 172.21.15.76:0/1595105849 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d401d070 con 0x7f19e00fff00 2024-06-02T04:49:15.760 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:15.757+0000 7f19c7fff700 1 -- 172.21.15.76:0/1595105849 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f19d4003f80 con 0x7f19e00fff00 2024-06-02T04:49:15.760 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:15.757+0000 7f19e57a0700 1 -- 172.21.15.76:0/1595105849 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19e01a1190 con 0x7f19e00fff00 2024-06-02T04:49:15.760 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:15.757+0000 7f19c7fff700 1 -- 172.21.15.76:0/1595105849 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d4022bc0 con 0x7f19e00fff00 2024-06-02T04:49:15.760 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:15.757+0000 7f19e57a0700 1 -- 172.21.15.76:0/1595105849 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19e01a15a0 con 0x7f19e00fff00 2024-06-02T04:49:15.760 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:15.758+0000 7f19e57a0700 1 -- 172.21.15.76:0/1595105849 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19e01073f0 con 0x7f19e00fff00 2024-06-02T04:49:15.760 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:15.759+0000 7f19c7fff700 1 -- 172.21.15.76:0/1595105849 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f19d4003af0 con 0x7f19e00fff00 2024-06-02T04:49:15.761 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:15.759+0000 7f19c7fff700 1 --2- 172.21.15.76:0/1595105849 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f19c80a11b0 0x7f19c80a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:15.761 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:15.759+0000 7f19de7fc700 1 --2- 172.21.15.76:0/1595105849 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f19c80a11b0 0x7f19c80a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:15.761 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:15.759+0000 7f19c7fff700 1 -- 172.21.15.76:0/1595105849 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f19d40ce3c0 con 0x7f19e00fff00 2024-06-02T04:49:15.761 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:15.760+0000 7f19de7fc700 1 --2- 172.21.15.76:0/1595105849 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f19c80a11b0 0x7f19c80a3670 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f19d0009a10 tx=0x7f19d0009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:15.764 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:15.764+0000 7f19c7fff700 1 -- 172.21.15.76:0/1595105849 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f19d4097770 con 0x7f19e00fff00 2024-06-02T04:49:15.974 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:15.974+0000 7f19e57a0700 1 -- 172.21.15.76:0/1595105849 --> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7f19e00613e0 con 0x7f19c80a11b0 2024-06-02T04:49:15.975 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:15.975+0000 7f19c7fff700 1 -- 172.21.15.76:0/1595105849 <== mgr.14152 v2:172.21.15.76:6800/2591353090 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f19e00613e0 con 0x7f19c80a11b0 2024-06-02T04:49:15.975 INFO:teuthology.orchestra.run.smithi076.stdout:Backend: cephadm 2024-06-02T04:49:15.975 INFO:teuthology.orchestra.run.smithi076.stdout:Available: Yes 2024-06-02T04:49:15.975 INFO:teuthology.orchestra.run.smithi076.stdout:Paused: No 2024-06-02T04:49:15.977 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:15.977+0000 7f19e57a0700 1 -- 172.21.15.76:0/1595105849 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f19c80a11b0 msgr2=0x7f19c80a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:15.977 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:15.977+0000 7f19e57a0700 1 --2- 172.21.15.76:0/1595105849 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f19c80a11b0 0x7f19c80a3670 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f19d0009a10 tx=0x7f19d0009190 comp rx=0 tx=0).stop 2024-06-02T04:49:15.977 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:15.977+0000 7f19e57a0700 1 -- 172.21.15.76:0/1595105849 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f19e00fff00 msgr2=0x7f19e010a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:15.977 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:15.977+0000 7f19e57a0700 1 --2- 172.21.15.76:0/1595105849 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f19e00fff00 0x7f19e010a790 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f19d4006010 tx=0x7f19d4004730 comp rx=0 tx=0).stop 2024-06-02T04:49:15.977 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:15.977+0000 7f19e57a0700 1 -- 172.21.15.76:0/1595105849 shutdown_connections 2024-06-02T04:49:15.978 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:15.977+0000 7f19e57a0700 1 --2- 172.21.15.76:0/1595105849 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f19e0101a20 0x7f19e0109370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:15.978 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:15.977+0000 7f19e57a0700 1 --2- 172.21.15.76:0/1595105849 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f19e00fff00 0x7f19e010a790 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:15.978 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:15.977+0000 7f19e57a0700 1 --2- 172.21.15.76:0/1595105849 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f19c80a11b0 0x7f19c80a3670 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:15.978 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:15.977+0000 7f19e57a0700 1 --2- 172.21.15.76:0/1595105849 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f19e0101060 0x7f19e0108e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:15.978 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:15.977+0000 7f19e57a0700 1 -- 172.21.15.76:0/1595105849 >> 172.21.15.76:0/1595105849 conn(0x7f19e00fb4a0 msgr2=0x7f19e0104530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:15.978 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:15.977+0000 7f19e57a0700 1 -- 172.21.15.76:0/1595105849 shutdown_connections 2024-06-02T04:49:15.978 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:15.977+0000 7f19e57a0700 1 -- 172.21.15.76:0/1595105849 wait complete. 2024-06-02T04:49:16.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:15 smithi192 ceph-mon[47933]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-06-02T04:49:16.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:15 smithi192 ceph-mon[47933]: Cluster is now healthy 2024-06-02T04:49:16.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:15 smithi076 ceph-mon[42935]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-06-02T04:49:16.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:15 smithi076 ceph-mon[42935]: Cluster is now healthy 2024-06-02T04:49:16.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:15 smithi119 ceph-mon[46633]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-06-02T04:49:16.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:15 smithi119 ceph-mon[46633]: Cluster is now healthy 2024-06-02T04:49:16.375 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 60ab6d30-209a-11ef-bc9b-c7b262605968 -- bash -c 'ceph orch ps' 2024-06-02T04:49:16.601 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T04:49:16.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:16 smithi076 ceph-mon[42935]: from='client.15249 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:49:16.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:16 smithi076 ceph-mon[42935]: pgmap v257: 129 pgs: 129 active+clean; 639 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2024-06-02T04:49:17.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:16 smithi192 ceph-mon[47933]: from='client.15249 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:49:17.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:16 smithi192 ceph-mon[47933]: pgmap v257: 129 pgs: 129 active+clean; 639 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2024-06-02T04:49:17.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:16 smithi119 ceph-mon[46633]: from='client.15249 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:49:17.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:16 smithi119 ceph-mon[46633]: pgmap v257: 129 pgs: 129 active+clean; 639 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2024-06-02T04:49:17.555 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:17.554+0000 7f6dc5929700 1 -- 172.21.15.76:0/2409651123 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6dc0101b10 msgr2=0x7f6dc0103f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:17.555 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:17.554+0000 7f6dc5929700 1 --2- 172.21.15.76:0/2409651123 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6dc0101b10 0x7f6dc0103f00 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f6db0009990 tx=0x7f6db0009ca0 comp rx=0 tx=0).stop 2024-06-02T04:49:17.555 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:17.555+0000 7f6dc5929700 1 -- 172.21.15.76:0/2409651123 shutdown_connections 2024-06-02T04:49:17.555 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:17.555+0000 7f6dc5929700 1 --2- 172.21.15.76:0/2409651123 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6dc0106d70 0x7f6dc0109160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:17.556 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:17.555+0000 7f6dc5929700 1 --2- 172.21.15.76:0/2409651123 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6dc0101b10 0x7f6dc0103f00 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:17.556 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:17.555+0000 7f6dc5929700 1 --2- 172.21.15.76:0/2409651123 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6dc0104440 0x7f6dc0106830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:17.556 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:17.555+0000 7f6dc5929700 1 -- 172.21.15.76:0/2409651123 >> 172.21.15.76:0/2409651123 conn(0x7f6dc00fb4a0 msgr2=0x7f6dc00fd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:17.556 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:17.555+0000 7f6dc5929700 1 -- 172.21.15.76:0/2409651123 shutdown_connections 2024-06-02T04:49:17.556 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:17.555+0000 7f6dc5929700 1 -- 172.21.15.76:0/2409651123 wait complete. 2024-06-02T04:49:17.557 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:17.555+0000 7f6dc5929700 1 Processor -- start 2024-06-02T04:49:17.557 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:17.555+0000 7f6dc5929700 1 -- start start 2024-06-02T04:49:17.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:17.556+0000 7f6dc5929700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6dc0101b10 0x7f6dc0196e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:17.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:17.556+0000 7f6dc5929700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6dc0104440 0x7f6dc0197360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:17.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:17.556+0000 7f6dc5929700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6dc0106d70 0x7f6dc019e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:17.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:17.556+0000 7f6dc5929700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dc019e960 con 0x7f6dc0101b10 2024-06-02T04:49:17.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:17.556+0000 7f6dc5929700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dc019eaa0 con 0x7f6dc0106d70 2024-06-02T04:49:17.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:17.556+0000 7f6dc5929700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dc019ec30 con 0x7f6dc0104440 2024-06-02T04:49:17.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:17.556+0000 7f6dbeffd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6dc0101b10 0x7f6dc0196e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:17.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:17.556+0000 7f6dbeffd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6dc0101b10 0x7f6dc0196e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:38476/0 (socket says 172.21.15.76:38476) 2024-06-02T04:49:17.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:17.556+0000 7f6dbeffd700 1 -- 172.21.15.76:0/1847652191 learned_addr learned my addr 172.21.15.76:0/1847652191 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:49:17.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:17.556+0000 7f6dbf7fe700 1 --2- 172.21.15.76:0/1847652191 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6dc0106d70 0x7f6dc019e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:17.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:17.556+0000 7f6dbe7fc700 1 --2- 172.21.15.76:0/1847652191 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6dc0104440 0x7f6dc0197360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:17.559 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:17.556+0000 7f6dbeffd700 1 -- 172.21.15.76:0/1847652191 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6dc0104440 msgr2=0x7f6dc0197360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:17.559 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:17.556+0000 7f6dbeffd700 1 --2- 172.21.15.76:0/1847652191 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6dc0104440 0x7f6dc0197360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:17.559 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:17.556+0000 7f6dbeffd700 1 -- 172.21.15.76:0/1847652191 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6dc0106d70 msgr2=0x7f6dc019e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:17.559 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:17.556+0000 7f6dbeffd700 1 --2- 172.21.15.76:0/1847652191 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6dc0106d70 0x7f6dc019e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:17.559 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:17.556+0000 7f6dbeffd700 1 -- 172.21.15.76:0/1847652191 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6db00095f0 con 0x7f6dc0101b10 2024-06-02T04:49:17.559 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:17.556+0000 7f6dbf7fe700 1 --2- 172.21.15.76:0/1847652191 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6dc0106d70 0x7f6dc019e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:49:17.559 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:17.556+0000 7f6dbeffd700 1 --2- 172.21.15.76:0/1847652191 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6dc0101b10 0x7f6dc0196e20 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f6db0003a50 tx=0x7f6db0003b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:17.559 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:17.556+0000 7f6dc4927700 1 -- 172.21.15.76:0/1847652191 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6db001d070 con 0x7f6dc0101b10 2024-06-02T04:49:17.559 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:17.556+0000 7f6dc4927700 1 -- 172.21.15.76:0/1847652191 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6db000bd70 con 0x7f6dc0101b10 2024-06-02T04:49:17.559 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:17.556+0000 7f6dc5929700 1 -- 172.21.15.76:0/1847652191 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dc019eeb0 con 0x7f6dc0101b10 2024-06-02T04:49:17.559 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:17.556+0000 7f6dc4927700 1 -- 172.21.15.76:0/1847652191 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6db0022d00 con 0x7f6dc0101b10 2024-06-02T04:49:17.560 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:17.556+0000 7f6dc5929700 1 -- 172.21.15.76:0/1847652191 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dc019f210 con 0x7f6dc0101b10 2024-06-02T04:49:17.560 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:17.558+0000 7f6dc5929700 1 -- 172.21.15.76:0/1847652191 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dc00fd020 con 0x7f6dc0101b10 2024-06-02T04:49:17.560 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:17.558+0000 7f6dc4927700 1 -- 172.21.15.76:0/1847652191 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f6db0022470 con 0x7f6dc0101b10 2024-06-02T04:49:17.561 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:17.559+0000 7f6dc4927700 1 --2- 172.21.15.76:0/1847652191 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f6da80a11b0 0x7f6da80a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:17.561 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:17.559+0000 7f6dbe7fc700 1 --2- 172.21.15.76:0/1847652191 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f6da80a11b0 0x7f6da80a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:17.561 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:17.559+0000 7f6dc4927700 1 -- 172.21.15.76:0/1847652191 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f6db00ce200 con 0x7f6dc0101b10 2024-06-02T04:49:17.561 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:17.560+0000 7f6dbe7fc700 1 --2- 172.21.15.76:0/1847652191 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f6da80a11b0 0x7f6da80a3670 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f6db400bbd0 tx=0x7f6db400b5b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:17.563 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:17.563+0000 7f6dc4927700 1 -- 172.21.15.76:0/1847652191 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f6db00976d0 con 0x7f6dc0101b10 2024-06-02T04:49:17.767 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:17.766+0000 7f6dc5929700 1 -- 172.21.15.76:0/1847652191 --> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f6dc002ceb0 con 0x7f6da80a11b0 2024-06-02T04:49:17.779 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:17.779+0000 7f6dc4927700 1 -- 172.21.15.76:0/1847652191 <== mgr.14152 v2:172.21.15.76:6800/2591353090 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+4185 (secure 0 0 0) 0x7f6dc002ceb0 con 0x7f6da80a11b0 2024-06-02T04:49:17.780 INFO:teuthology.orchestra.run.smithi076.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-06-02T04:49:17.780 INFO:teuthology.orchestra.run.smithi076.stdout:mds.a smithi076 running (82s) 13s ago 82s 13.9M - 18.2.2-1381-g3bb45379 a7978103fbbe d733ffc5d229 2024-06-02T04:49:17.780 INFO:teuthology.orchestra.run.smithi076.stdout:mds.b smithi119 running (80s) 16s ago 80s 32.8M - 18.2.2-1381-g3bb45379 a7978103fbbe 975190c26554 2024-06-02T04:49:17.780 INFO:teuthology.orchestra.run.smithi076.stdout:mds.c smithi192 running (89s) 16s ago 89s 18.3M - 18.2.2-1381-g3bb45379 a7978103fbbe 3d552265f694 2024-06-02T04:49:17.780 INFO:teuthology.orchestra.run.smithi076.stdout:mds.d smithi076 running (94s) 13s ago 94s 16.5M - 18.2.2-1381-g3bb45379 a7978103fbbe 799e51b9e312 2024-06-02T04:49:17.780 INFO:teuthology.orchestra.run.smithi076.stdout:mds.e smithi119 running (93s) 16s ago 92s 17.1M - 18.2.2-1381-g3bb45379 a7978103fbbe 82eb49f8f5d3 2024-06-02T04:49:17.780 INFO:teuthology.orchestra.run.smithi076.stdout:mds.f smithi192 running (91s) 16s ago 91s 17.5M - 18.2.2-1381-g3bb45379 a7978103fbbe 253f4e41a734 2024-06-02T04:49:17.780 INFO:teuthology.orchestra.run.smithi076.stdout:mds.g smithi076 running (84s) 13s ago 84s 17.2M - 18.2.2-1381-g3bb45379 a7978103fbbe 1d13153c1882 2024-06-02T04:49:17.780 INFO:teuthology.orchestra.run.smithi076.stdout:mds.h smithi119 running (87s) 16s ago 87s 18.4M - 18.2.2-1381-g3bb45379 a7978103fbbe 5ae75b6c981b 2024-06-02T04:49:17.780 INFO:teuthology.orchestra.run.smithi076.stdout:mds.i smithi192 running (86s) 16s ago 85s 20.8M - 18.2.2-1381-g3bb45379 a7978103fbbe 74426b90584f 2024-06-02T04:49:17.781 INFO:teuthology.orchestra.run.smithi076.stdout:mds.j smithi076 running (96s) 13s ago 96s 14.1M - 18.2.2-1381-g3bb45379 a7978103fbbe 856156f3b5fd 2024-06-02T04:49:17.781 INFO:teuthology.orchestra.run.smithi076.stdout:mds.k smithi119 running (98s) 16s ago 98s 14.7M - 18.2.2-1381-g3bb45379 a7978103fbbe 63f53794290e 2024-06-02T04:49:17.781 INFO:teuthology.orchestra.run.smithi076.stdout:mds.l smithi192 running (100s) 16s ago 99s 15.1M - 18.2.2-1381-g3bb45379 a7978103fbbe 7cf3fdb29368 2024-06-02T04:49:17.781 INFO:teuthology.orchestra.run.smithi076.stdout:mgr.x smithi076 *:9283,8765 running (6m) 13s ago 6m 531M - 18.2.2-1381-g3bb45379 a7978103fbbe eea40d32d809 2024-06-02T04:49:17.781 INFO:teuthology.orchestra.run.smithi076.stdout:mgr.y smithi119 *:8443,8765 running (5m) 16s ago 5m 458M - 18.2.2-1381-g3bb45379 a7978103fbbe 1e908e3a1b89 2024-06-02T04:49:17.781 INFO:teuthology.orchestra.run.smithi076.stdout:mgr.z smithi192 *:8443,8765 running (5m) 16s ago 5m 461M - 18.2.2-1381-g3bb45379 a7978103fbbe 52f48ba77660 2024-06-02T04:49:17.781 INFO:teuthology.orchestra.run.smithi076.stdout:mon.a smithi076 running (6m) 13s ago 6m 91.6M 2048M 18.2.2-1381-g3bb45379 a7978103fbbe 6fcc8af18c95 2024-06-02T04:49:17.781 INFO:teuthology.orchestra.run.smithi076.stdout:mon.b smithi119 running (5m) 16s ago 5m 60.5M 2048M 18.2.2-1381-g3bb45379 a7978103fbbe 40f4ecd96951 2024-06-02T04:49:17.781 INFO:teuthology.orchestra.run.smithi076.stdout:mon.c smithi192 running (5m) 16s ago 5m 60.2M 2048M 18.2.2-1381-g3bb45379 a7978103fbbe fb6264c68810 2024-06-02T04:49:17.781 INFO:teuthology.orchestra.run.smithi076.stdout:osd.0 smithi076 running (5m) 13s ago 5m 138M 4278M 18.2.2-1381-g3bb45379 a7978103fbbe ed8ba818afa1 2024-06-02T04:49:17.781 INFO:teuthology.orchestra.run.smithi076.stdout:osd.1 smithi119 running (4m) 16s ago 4m 147M 4278M 18.2.2-1381-g3bb45379 a7978103fbbe 00e342e6d65b 2024-06-02T04:49:17.781 INFO:teuthology.orchestra.run.smithi076.stdout:osd.2 smithi192 running (4m) 16s ago 4m 142M 4278M 18.2.2-1381-g3bb45379 a7978103fbbe f2d071408e32 2024-06-02T04:49:17.781 INFO:teuthology.orchestra.run.smithi076.stdout:osd.3 smithi076 running (4m) 13s ago 4m 131M 4278M 18.2.2-1381-g3bb45379 a7978103fbbe 3da0e9a5ad19 2024-06-02T04:49:17.782 INFO:teuthology.orchestra.run.smithi076.stdout:osd.4 smithi119 running (3m) 16s ago 3m 135M 4278M 18.2.2-1381-g3bb45379 a7978103fbbe 9414a26dd42c 2024-06-02T04:49:17.782 INFO:teuthology.orchestra.run.smithi076.stdout:osd.5 smithi192 running (3m) 16s ago 3m 68.3M 4278M 18.2.2-1381-g3bb45379 a7978103fbbe f93b29f5a655 2024-06-02T04:49:17.782 INFO:teuthology.orchestra.run.smithi076.stdout:osd.6 smithi076 running (3m) 13s ago 3m 59.2M 4278M 18.2.2-1381-g3bb45379 a7978103fbbe bb77ccc5d953 2024-06-02T04:49:17.782 INFO:teuthology.orchestra.run.smithi076.stdout:osd.7 smithi119 running (3m) 16s ago 3m 132M 4278M 18.2.2-1381-g3bb45379 a7978103fbbe 82fe6a8058fc 2024-06-02T04:49:17.782 INFO:teuthology.orchestra.run.smithi076.stdout:osd.8 smithi192 running (2m) 16s ago 2m 60.2M 4278M 18.2.2-1381-g3bb45379 a7978103fbbe 392c1411ee9c 2024-06-02T04:49:17.782 INFO:teuthology.orchestra.run.smithi076.stdout:osd.9 smithi076 running (2m) 13s ago 2m 126M 4278M 18.2.2-1381-g3bb45379 a7978103fbbe 448f84d6d3f0 2024-06-02T04:49:17.782 INFO:teuthology.orchestra.run.smithi076.stdout:osd.10 smithi119 running (2m) 16s ago 2m 130M 4278M 18.2.2-1381-g3bb45379 a7978103fbbe 02ebdcf3fd4f 2024-06-02T04:49:17.782 INFO:teuthology.orchestra.run.smithi076.stdout:osd.11 smithi192 running (114s) 16s ago 114s 55.4M 4278M 18.2.2-1381-g3bb45379 a7978103fbbe 7840a58dca55 2024-06-02T04:49:17.783 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:17.781+0000 7f6dc5929700 1 -- 172.21.15.76:0/1847652191 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f6da80a11b0 msgr2=0x7f6da80a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:17.783 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:17.781+0000 7f6dc5929700 1 --2- 172.21.15.76:0/1847652191 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f6da80a11b0 0x7f6da80a3670 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f6db400bbd0 tx=0x7f6db400b5b0 comp rx=0 tx=0).stop 2024-06-02T04:49:17.783 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:17.781+0000 7f6dc5929700 1 -- 172.21.15.76:0/1847652191 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6dc0101b10 msgr2=0x7f6dc0196e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:17.783 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:17.781+0000 7f6dc5929700 1 --2- 172.21.15.76:0/1847652191 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6dc0101b10 0x7f6dc0196e20 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f6db0003a50 tx=0x7f6db0003b30 comp rx=0 tx=0).stop 2024-06-02T04:49:17.783 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:17.782+0000 7f6dc5929700 1 -- 172.21.15.76:0/1847652191 shutdown_connections 2024-06-02T04:49:17.783 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:17.782+0000 7f6dc5929700 1 --2- 172.21.15.76:0/1847652191 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f6da80a11b0 0x7f6da80a3670 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:17.783 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:17.782+0000 7f6dc5929700 1 --2- 172.21.15.76:0/1847652191 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6dc0106d70 0x7f6dc019e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:17.783 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:17.782+0000 7f6dc5929700 1 --2- 172.21.15.76:0/1847652191 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6dc0101b10 0x7f6dc0196e20 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:17.783 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:17.782+0000 7f6dc5929700 1 --2- 172.21.15.76:0/1847652191 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6dc0104440 0x7f6dc0197360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:17.784 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:17.782+0000 7f6dc5929700 1 -- 172.21.15.76:0/1847652191 >> 172.21.15.76:0/1847652191 conn(0x7f6dc00fb4a0 msgr2=0x7f6dc0103a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:17.784 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:17.782+0000 7f6dc5929700 1 -- 172.21.15.76:0/1847652191 shutdown_connections 2024-06-02T04:49:17.784 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:17.782+0000 7f6dc5929700 1 -- 172.21.15.76:0/1847652191 wait complete. 2024-06-02T04:49:18.157 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 60ab6d30-209a-11ef-bc9b-c7b262605968 -- bash -c 'ceph orch ls' 2024-06-02T04:49:18.383 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T04:49:19.381 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:19.379+0000 7f6086e9d700 1 -- 172.21.15.76:0/2870867588 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6080101a40 msgr2=0x7f6080108360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:19.382 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:19.379+0000 7f6086e9d700 1 --2- 172.21.15.76:0/2870867588 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6080101a40 0x7f6080108360 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f607800b0a0 tx=0x7f607800b3b0 comp rx=0 tx=0).stop 2024-06-02T04:49:19.382 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:19.379+0000 7f6086e9d700 1 -- 172.21.15.76:0/2870867588 shutdown_connections 2024-06-02T04:49:19.382 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:19.379+0000 7f6086e9d700 1 --2- 172.21.15.76:0/2870867588 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6080101a40 0x7f6080108360 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:19.382 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:19.379+0000 7f6086e9d700 1 --2- 172.21.15.76:0/2870867588 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f60800fff20 0x7f6080100340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:19.382 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:19.379+0000 7f6086e9d700 1 --2- 172.21.15.76:0/2870867588 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6080101080 0x7f6080101500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:19.382 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:19.379+0000 7f6086e9d700 1 -- 172.21.15.76:0/2870867588 >> 172.21.15.76:0/2870867588 conn(0x7f60800fb4c0 msgr2=0x7f60800fd900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:19.382 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:19.380+0000 7f6086e9d700 1 -- 172.21.15.76:0/2870867588 shutdown_connections 2024-06-02T04:49:19.382 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:19.380+0000 7f6086e9d700 1 -- 172.21.15.76:0/2870867588 wait complete. 2024-06-02T04:49:19.382 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:19.380+0000 7f6086e9d700 1 Processor -- start 2024-06-02T04:49:19.382 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:19.380+0000 7f6086e9d700 1 -- start start 2024-06-02T04:49:19.383 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:19.381+0000 7f6086e9d700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f60800fff20 0x7f608006a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:19.383 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:19.381+0000 7f6086e9d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6080101080 0x7f608019bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:19.383 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:19.381+0000 7f6086e9d700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6080101a40 0x7f608019e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:19.383 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:19.381+0000 7f6086e9d700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f608019e950 con 0x7f6080101a40 2024-06-02T04:49:19.383 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:19.381+0000 7f6086e9d700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f608019eac0 con 0x7f60800fff20 2024-06-02T04:49:19.383 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:19.381+0000 7f6086e9d700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f608019ec80 con 0x7f6080101080 2024-06-02T04:49:19.383 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:19.381+0000 7f608543a700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6080101a40 0x7f608019e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:19.383 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:19.381+0000 7f608543a700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6080101a40 0x7f608019e1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:38486/0 (socket says 172.21.15.76:38486) 2024-06-02T04:49:19.383 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:19.381+0000 7f608543a700 1 -- 172.21.15.76:0/1022069236 learned_addr learned my addr 172.21.15.76:0/1022069236 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:49:19.383 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:19.381+0000 7f6084c39700 1 --2- 172.21.15.76:0/1022069236 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f60800fff20 0x7f608006a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:19.383 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:19.381+0000 7f608543a700 1 -- 172.21.15.76:0/1022069236 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6080101080 msgr2=0x7f608019bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:19.383 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:19.381+0000 7f608543a700 1 --2- 172.21.15.76:0/1022069236 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6080101080 0x7f608019bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:19.384 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:19.381+0000 7f608543a700 1 -- 172.21.15.76:0/1022069236 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f60800fff20 msgr2=0x7f608006a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:19.384 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:19.381+0000 7f608543a700 1 --2- 172.21.15.76:0/1022069236 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f60800fff20 0x7f608006a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:19.384 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:19.381+0000 7f608543a700 1 -- 172.21.15.76:0/1022069236 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6078009d00 con 0x7f6080101a40 2024-06-02T04:49:19.384 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:19.381+0000 7f608543a700 1 --2- 172.21.15.76:0/1022069236 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6080101a40 0x7f608019e1b0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f6078004d10 tx=0x7f6078004d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:19.384 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:19.381+0000 7f607dffb700 1 -- 172.21.15.76:0/1022069236 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f607800e040 con 0x7f6080101a40 2024-06-02T04:49:19.384 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:19.381+0000 7f6086e9d700 1 -- 172.21.15.76:0/1022069236 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f608019ef00 con 0x7f6080101a40 2024-06-02T04:49:19.384 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:19.381+0000 7f607dffb700 1 -- 172.21.15.76:0/1022069236 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6078009440 con 0x7f6080101a40 2024-06-02T04:49:19.384 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:19.381+0000 7f607dffb700 1 -- 172.21.15.76:0/1022069236 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f607801dbb0 con 0x7f6080101a40 2024-06-02T04:49:19.385 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:19.382+0000 7f6086e9d700 1 -- 172.21.15.76:0/1022069236 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f608019f2b0 con 0x7f6080101a40 2024-06-02T04:49:19.385 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:19.383+0000 7f6086e9d700 1 -- 172.21.15.76:0/1022069236 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60801072d0 con 0x7f6080101a40 2024-06-02T04:49:19.385 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:19.384+0000 7f607dffb700 1 -- 172.21.15.76:0/1022069236 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f6078005450 con 0x7f6080101a40 2024-06-02T04:49:19.385 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:19.384+0000 7f607dffb700 1 --2- 172.21.15.76:0/1022069236 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f60700a11b0 0x7f60700a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:19.385 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:19.384+0000 7f6084c39700 1 --2- 172.21.15.76:0/1022069236 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f60700a11b0 0x7f60700a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:19.385 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:19.384+0000 7f607dffb700 1 -- 172.21.15.76:0/1022069236 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f60780ce730 con 0x7f6080101a40 2024-06-02T04:49:19.386 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:19.385+0000 7f6084c39700 1 --2- 172.21.15.76:0/1022069236 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f60700a11b0 0x7f60700a3670 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f6074005950 tx=0x7f607400a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:19.389 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:19.389+0000 7f607dffb700 1 -- 172.21.15.76:0/1022069236 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f6078097a80 con 0x7f6080101a40 2024-06-02T04:49:19.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:19 smithi076 ceph-mon[42935]: from='client.15255 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:49:19.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:19 smithi076 ceph-mon[42935]: pgmap v258: 129 pgs: 129 active+clean; 639 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-06-02T04:49:19.591 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:19.590+0000 7f6086e9d700 1 -- 172.21.15.76:0/1022069236 --> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f608002ceb0 con 0x7f60700a11b0 2024-06-02T04:49:19.596 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:19.596+0000 7f607dffb700 1 -- 172.21.15.76:0/1022069236 <== mgr.14152 v2:172.21.15.76:6800/2591353090 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+985 (secure 0 0 0) 0x7f608002ceb0 con 0x7f60700a11b0 2024-06-02T04:49:19.596 INFO:teuthology.orchestra.run.smithi076.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-06-02T04:49:19.596 INFO:teuthology.orchestra.run.smithi076.stdout:mds.all 12/12 18s ago 103s smithi076=a;smithi076=d;smithi076=g;smithi076=j;smithi119=b;smithi119=e;smithi119=h;smithi119=k;smithi192=c;smithi192=f;smithi192=i;smithi192=l;count:12 2024-06-02T04:49:19.596 INFO:teuthology.orchestra.run.smithi076.stdout:mgr 3/3 18s ago 5m smithi076=x;smithi119=y;smithi192=z;count:3 2024-06-02T04:49:19.596 INFO:teuthology.orchestra.run.smithi076.stdout:mon 3/3 18s ago 5m smithi076:172.21.15.76=a;smithi119:172.21.15.119=b;smithi192:172.21.15.192=c;count:3 2024-06-02T04:49:19.596 INFO:teuthology.orchestra.run.smithi076.stdout:osd 12 18s ago - 2024-06-02T04:49:19.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:19 smithi119 ceph-mon[46633]: from='client.15255 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:49:19.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:19 smithi119 ceph-mon[46633]: pgmap v258: 129 pgs: 129 active+clean; 639 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-06-02T04:49:19.598 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:19.598+0000 7f6086e9d700 1 -- 172.21.15.76:0/1022069236 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f60700a11b0 msgr2=0x7f60700a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:19.598 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:19.598+0000 7f6086e9d700 1 --2- 172.21.15.76:0/1022069236 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f60700a11b0 0x7f60700a3670 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f6074005950 tx=0x7f607400a300 comp rx=0 tx=0).stop 2024-06-02T04:49:19.598 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:19.598+0000 7f6086e9d700 1 -- 172.21.15.76:0/1022069236 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6080101a40 msgr2=0x7f608019e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:19.598 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:19.598+0000 7f6086e9d700 1 --2- 172.21.15.76:0/1022069236 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6080101a40 0x7f608019e1b0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f6078004d10 tx=0x7f6078004d40 comp rx=0 tx=0).stop 2024-06-02T04:49:19.599 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:19.598+0000 7f6086e9d700 1 -- 172.21.15.76:0/1022069236 shutdown_connections 2024-06-02T04:49:19.599 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:19.598+0000 7f6086e9d700 1 --2- 172.21.15.76:0/1022069236 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6080101a40 0x7f608019e1b0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:19.599 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:19.598+0000 7f6086e9d700 1 --2- 172.21.15.76:0/1022069236 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f60700a11b0 0x7f60700a3670 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:19.599 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:19.598+0000 7f6086e9d700 1 --2- 172.21.15.76:0/1022069236 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f60800fff20 0x7f608006a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:19.599 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:19.598+0000 7f6086e9d700 1 --2- 172.21.15.76:0/1022069236 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6080101080 0x7f608019bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:19.599 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:19.598+0000 7f6086e9d700 1 -- 172.21.15.76:0/1022069236 >> 172.21.15.76:0/1022069236 conn(0x7f60800fb4c0 msgr2=0x7f6080104410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:19.599 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:19.598+0000 7f6086e9d700 1 -- 172.21.15.76:0/1022069236 shutdown_connections 2024-06-02T04:49:19.599 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:19.598+0000 7f6086e9d700 1 -- 172.21.15.76:0/1022069236 wait complete. 2024-06-02T04:49:19.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:19 smithi192 ceph-mon[47933]: from='client.15255 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:49:19.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:19 smithi192 ceph-mon[47933]: pgmap v258: 129 pgs: 129 active+clean; 639 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-06-02T04:49:19.998 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 60ab6d30-209a-11ef-bc9b-c7b262605968 -- bash -c 'ceph orch host ls' 2024-06-02T04:49:20.222 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T04:49:21.301 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:21.298+0000 7fe903b2c700 1 -- 172.21.15.76:0/2697198628 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe8fc0fff00 msgr2=0x7fe8fc100320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:21.301 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:21.298+0000 7fe903b2c700 1 --2- 172.21.15.76:0/2697198628 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe8fc0fff00 0x7fe8fc100320 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fe8f0009990 tx=0x7fe8f0009ca0 comp rx=0 tx=0).stop 2024-06-02T04:49:21.301 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:21.298+0000 7fe903b2c700 1 -- 172.21.15.76:0/2697198628 shutdown_connections 2024-06-02T04:49:21.301 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:21.298+0000 7fe903b2c700 1 --2- 172.21.15.76:0/2697198628 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe8fc101a20 0x7fe8fc108340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:21.301 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:21.298+0000 7fe903b2c700 1 --2- 172.21.15.76:0/2697198628 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe8fc0fff00 0x7fe8fc100320 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:21.301 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:21.298+0000 7fe903b2c700 1 --2- 172.21.15.76:0/2697198628 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe8fc101060 0x7fe8fc1014e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:21.301 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:21.298+0000 7fe903b2c700 1 -- 172.21.15.76:0/2697198628 >> 172.21.15.76:0/2697198628 conn(0x7fe8fc0fb4a0 msgr2=0x7fe8fc0fd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:21.301 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:21.299+0000 7fe903b2c700 1 -- 172.21.15.76:0/2697198628 shutdown_connections 2024-06-02T04:49:21.302 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:21.299+0000 7fe903b2c700 1 -- 172.21.15.76:0/2697198628 wait complete. 2024-06-02T04:49:21.302 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:21.299+0000 7fe903b2c700 1 Processor -- start 2024-06-02T04:49:21.302 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:21.299+0000 7fe903b2c700 1 -- start start 2024-06-02T04:49:21.302 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:21.299+0000 7fe903b2c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe8fc0fff00 0x7fe8fc195e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:21.302 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:21.299+0000 7fe903b2c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe8fc101060 0x7fe8fc196350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:21.302 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:21.299+0000 7fe903b2c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe8fc101a20 0x7fe8fc19d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:21.302 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:21.299+0000 7fe903b2c700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8fc19d8b0 con 0x7fe8fc101060 2024-06-02T04:49:21.302 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:21.299+0000 7fe903b2c700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8fc19d9f0 con 0x7fe8fc0fff00 2024-06-02T04:49:21.302 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:21.299+0000 7fe903b2c700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8fc19dbb0 con 0x7fe8fc101a20 2024-06-02T04:49:21.302 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:21.299+0000 7fe9010c7700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe8fc101060 0x7fe8fc196350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:21.302 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:21.299+0000 7fe9010c7700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe8fc101060 0x7fe8fc196350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:38502/0 (socket says 172.21.15.76:38502) 2024-06-02T04:49:21.302 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:21.299+0000 7fe9010c7700 1 -- 172.21.15.76:0/1999336228 learned_addr learned my addr 172.21.15.76:0/1999336228 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:49:21.302 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:21.300+0000 7fe9020c9700 1 --2- 172.21.15.76:0/1999336228 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe8fc101a20 0x7fe8fc19d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:21.303 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:21.300+0000 7fe9018c8700 1 --2- 172.21.15.76:0/1999336228 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe8fc0fff00 0x7fe8fc195e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:21.303 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:21.300+0000 7fe9010c7700 1 -- 172.21.15.76:0/1999336228 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe8fc101a20 msgr2=0x7fe8fc19d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:21.303 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:21.300+0000 7fe9010c7700 1 --2- 172.21.15.76:0/1999336228 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe8fc101a20 0x7fe8fc19d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:21.303 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:21.300+0000 7fe9010c7700 1 -- 172.21.15.76:0/1999336228 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe8fc0fff00 msgr2=0x7fe8fc195e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:21.303 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:21.300+0000 7fe9010c7700 1 --2- 172.21.15.76:0/1999336228 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe8fc0fff00 0x7fe8fc195e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:21.303 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:21.300+0000 7fe9010c7700 1 -- 172.21.15.76:0/1999336228 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8f00095f0 con 0x7fe8fc101060 2024-06-02T04:49:21.303 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:21.300+0000 7fe9010c7700 1 --2- 172.21.15.76:0/1999336228 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe8fc101060 0x7fe8fc196350 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fe8f800c920 tx=0x7fe8f800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:21.303 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:21.300+0000 7fe8eeffd700 1 -- 172.21.15.76:0/1999336228 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8f8004a30 con 0x7fe8fc101060 2024-06-02T04:49:21.303 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:21.300+0000 7fe8eeffd700 1 -- 172.21.15.76:0/1999336228 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe8f80054b0 con 0x7fe8fc101060 2024-06-02T04:49:21.303 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:21.300+0000 7fe8eeffd700 1 -- 172.21.15.76:0/1999336228 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8f8007b50 con 0x7fe8fc101060 2024-06-02T04:49:21.303 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:21.300+0000 7fe903b2c700 1 -- 172.21.15.76:0/1999336228 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8fc19de90 con 0x7fe8fc101060 2024-06-02T04:49:21.303 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:21.300+0000 7fe903b2c700 1 -- 172.21.15.76:0/1999336228 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8fc0695e0 con 0x7fe8fc101060 2024-06-02T04:49:21.304 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:21.301+0000 7fe903b2c700 1 -- 172.21.15.76:0/1999336228 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8fc04ec60 con 0x7fe8fc101060 2024-06-02T04:49:21.304 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:21.302+0000 7fe8eeffd700 1 -- 172.21.15.76:0/1999336228 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fe8f8007cb0 con 0x7fe8fc101060 2024-06-02T04:49:21.304 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:21.303+0000 7fe8eeffd700 1 --2- 172.21.15.76:0/1999336228 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fe8e80a33c0 0x7fe8e80a5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:21.304 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:21.303+0000 7fe9018c8700 1 --2- 172.21.15.76:0/1999336228 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fe8e80a33c0 0x7fe8e80a5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:21.305 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:21.303+0000 7fe8eeffd700 1 -- 172.21.15.76:0/1999336228 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fe8f80ccc80 con 0x7fe8fc101060 2024-06-02T04:49:21.305 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:21.303+0000 7fe9018c8700 1 --2- 172.21.15.76:0/1999336228 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fe8e80a33c0 0x7fe8e80a5880 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fe8f000c010 tx=0x7fe8f0003720 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:21.307 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:21.306+0000 7fe8eeffd700 1 -- 172.21.15.76:0/1999336228 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fe8f8095fa0 con 0x7fe8fc101060 2024-06-02T04:49:21.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:21 smithi076 ceph-mon[42935]: from='client.15261 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:49:21.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:21 smithi076 ceph-mon[42935]: pgmap v259: 129 pgs: 129 active+clean; 639 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-06-02T04:49:21.504 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:21.504+0000 7fe903b2c700 1 -- 172.21.15.76:0/1999336228 --> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fe8fc06a2f0 con 0x7fe8e80a33c0 2024-06-02T04:49:21.506 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:21.505+0000 7fe8eeffd700 1 -- 172.21.15.76:0/1999336228 <== mgr.14152 v2:172.21.15.76:6800/2591353090 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+191 (secure 0 0 0) 0x7fe8fc06a2f0 con 0x7fe8e80a33c0 2024-06-02T04:49:21.506 INFO:teuthology.orchestra.run.smithi076.stdout:HOST ADDR LABELS STATUS 2024-06-02T04:49:21.506 INFO:teuthology.orchestra.run.smithi076.stdout:smithi076 172.21.15.76 2024-06-02T04:49:21.506 INFO:teuthology.orchestra.run.smithi076.stdout:smithi119 172.21.15.119 2024-06-02T04:49:21.506 INFO:teuthology.orchestra.run.smithi076.stdout:smithi192 172.21.15.192 2024-06-02T04:49:21.506 INFO:teuthology.orchestra.run.smithi076.stdout:3 hosts in cluster 2024-06-02T04:49:21.508 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:21.508+0000 7fe903b2c700 1 -- 172.21.15.76:0/1999336228 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fe8e80a33c0 msgr2=0x7fe8e80a5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:21.508 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:21.508+0000 7fe903b2c700 1 --2- 172.21.15.76:0/1999336228 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fe8e80a33c0 0x7fe8e80a5880 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fe8f000c010 tx=0x7fe8f0003720 comp rx=0 tx=0).stop 2024-06-02T04:49:21.508 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:21.508+0000 7fe903b2c700 1 -- 172.21.15.76:0/1999336228 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe8fc101060 msgr2=0x7fe8fc196350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:21.508 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:21.508+0000 7fe903b2c700 1 --2- 172.21.15.76:0/1999336228 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe8fc101060 0x7fe8fc196350 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fe8f800c920 tx=0x7fe8f800cc30 comp rx=0 tx=0).stop 2024-06-02T04:49:21.508 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:21.508+0000 7fe903b2c700 1 -- 172.21.15.76:0/1999336228 shutdown_connections 2024-06-02T04:49:21.508 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:21.508+0000 7fe903b2c700 1 --2- 172.21.15.76:0/1999336228 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe8fc101a20 0x7fe8fc19d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:21.508 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:21.508+0000 7fe903b2c700 1 --2- 172.21.15.76:0/1999336228 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fe8e80a33c0 0x7fe8e80a5880 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:21.508 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:21.508+0000 7fe903b2c700 1 --2- 172.21.15.76:0/1999336228 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe8fc0fff00 0x7fe8fc195e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:21.509 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:21.508+0000 7fe903b2c700 1 --2- 172.21.15.76:0/1999336228 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe8fc101060 0x7fe8fc196350 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:21.509 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:21.508+0000 7fe903b2c700 1 -- 172.21.15.76:0/1999336228 >> 172.21.15.76:0/1999336228 conn(0x7fe8fc0fb4a0 msgr2=0x7fe8fc104560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:21.509 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:21.508+0000 7fe903b2c700 1 -- 172.21.15.76:0/1999336228 shutdown_connections 2024-06-02T04:49:21.509 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:21.508+0000 7fe903b2c700 1 -- 172.21.15.76:0/1999336228 wait complete. 2024-06-02T04:49:21.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:21 smithi119 ceph-mon[46633]: from='client.15261 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:49:21.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:21 smithi119 ceph-mon[46633]: pgmap v259: 129 pgs: 129 active+clean; 639 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-06-02T04:49:21.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:21 smithi192 ceph-mon[47933]: from='client.15261 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:49:21.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:21 smithi192 ceph-mon[47933]: pgmap v259: 129 pgs: 129 active+clean; 639 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-06-02T04:49:21.899 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 60ab6d30-209a-11ef-bc9b-c7b262605968 -- bash -c 'ceph orch device ls' 2024-06-02T04:49:22.123 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T04:49:23.174 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:23.170+0000 7fbf8b293700 1 -- 172.21.15.76:0/3651413613 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbf84101060 msgr2=0x7fbf841014e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:23.174 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:23.170+0000 7fbf8b293700 1 --2- 172.21.15.76:0/3651413613 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbf84101060 0x7fbf841014e0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fbf80009990 tx=0x7fbf80009ca0 comp rx=0 tx=0).stop 2024-06-02T04:49:23.174 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:23.170+0000 7fbf8b293700 1 -- 172.21.15.76:0/3651413613 shutdown_connections 2024-06-02T04:49:23.175 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:23.170+0000 7fbf8b293700 1 --2- 172.21.15.76:0/3651413613 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbf84101a20 0x7fbf84108340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:23.175 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:23.170+0000 7fbf8b293700 1 --2- 172.21.15.76:0/3651413613 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf840fff00 0x7fbf84100320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:23.175 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:23.170+0000 7fbf8b293700 1 --2- 172.21.15.76:0/3651413613 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbf84101060 0x7fbf841014e0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:23.175 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:23.170+0000 7fbf8b293700 1 -- 172.21.15.76:0/3651413613 >> 172.21.15.76:0/3651413613 conn(0x7fbf840fb4c0 msgr2=0x7fbf840fd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:23.175 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:23.170+0000 7fbf8b293700 1 -- 172.21.15.76:0/3651413613 shutdown_connections 2024-06-02T04:49:23.175 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:23.170+0000 7fbf8b293700 1 -- 172.21.15.76:0/3651413613 wait complete. 2024-06-02T04:49:23.175 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:23.171+0000 7fbf8b293700 1 Processor -- start 2024-06-02T04:49:23.175 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:23.171+0000 7fbf8b293700 1 -- start start 2024-06-02T04:49:23.175 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:23.171+0000 7fbf8b293700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbf840fff00 0x7fbf84069cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:23.175 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:23.171+0000 7fbf8b293700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbf84101060 0x7fbf8419bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:23.176 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:23.171+0000 7fbf8b293700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf84101a20 0x7fbf8419e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:23.176 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:23.171+0000 7fbf8b293700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8419e970 con 0x7fbf840fff00 2024-06-02T04:49:23.176 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:23.171+0000 7fbf8b293700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8419eae0 con 0x7fbf84101a20 2024-06-02T04:49:23.176 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:23.171+0000 7fbf8b293700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8419eca0 con 0x7fbf84101060 2024-06-02T04:49:23.176 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:23.171+0000 7fbf8902f700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbf840fff00 0x7fbf84069cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:23.176 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:23.171+0000 7fbf8902f700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbf840fff00 0x7fbf84069cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:43026/0 (socket says 172.21.15.76:43026) 2024-06-02T04:49:23.176 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:23.171+0000 7fbf8902f700 1 -- 172.21.15.76:0/3067702329 learned_addr learned my addr 172.21.15.76:0/3067702329 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:49:23.176 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:23.171+0000 7fbf89830700 1 --2- 172.21.15.76:0/3067702329 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf84101a20 0x7fbf8419e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:23.176 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:23.172+0000 7fbf8882e700 1 --2- 172.21.15.76:0/3067702329 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbf84101060 0x7fbf8419bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:23.176 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:23.172+0000 7fbf8902f700 1 -- 172.21.15.76:0/3067702329 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbf84101060 msgr2=0x7fbf8419bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:23.176 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:23.172+0000 7fbf8902f700 1 --2- 172.21.15.76:0/3067702329 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbf84101060 0x7fbf8419bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:23.176 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:23.172+0000 7fbf8902f700 1 -- 172.21.15.76:0/3067702329 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf84101a20 msgr2=0x7fbf8419e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:23.177 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:23.172+0000 7fbf8902f700 1 --2- 172.21.15.76:0/3067702329 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf84101a20 0x7fbf8419e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:23.177 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:23.172+0000 7fbf8902f700 1 -- 172.21.15.76:0/3067702329 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf800095f0 con 0x7fbf840fff00 2024-06-02T04:49:23.177 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:23.172+0000 7fbf8882e700 1 --2- 172.21.15.76:0/3067702329 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbf84101060 0x7fbf8419bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:49:23.177 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:23.172+0000 7fbf8902f700 1 --2- 172.21.15.76:0/3067702329 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbf840fff00 0x7fbf84069cf0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fbf7800d950 tx=0x7fbf7800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:23.177 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:23.172+0000 7fbf767fc700 1 -- 172.21.15.76:0/3067702329 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf78009940 con 0x7fbf840fff00 2024-06-02T04:49:23.177 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:23.172+0000 7fbf767fc700 1 -- 172.21.15.76:0/3067702329 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbf78010460 con 0x7fbf840fff00 2024-06-02T04:49:23.177 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:23.172+0000 7fbf8b293700 1 -- 172.21.15.76:0/3067702329 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf8419ef80 con 0x7fbf840fff00 2024-06-02T04:49:23.177 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:23.172+0000 7fbf767fc700 1 -- 172.21.15.76:0/3067702329 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf7800f620 con 0x7fbf840fff00 2024-06-02T04:49:23.177 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:23.172+0000 7fbf8b293700 1 -- 172.21.15.76:0/3067702329 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf8419f390 con 0x7fbf840fff00 2024-06-02T04:49:23.177 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:23.173+0000 7fbf8b293700 1 -- 172.21.15.76:0/3067702329 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf84107370 con 0x7fbf840fff00 2024-06-02T04:49:23.178 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:23.174+0000 7fbf767fc700 1 -- 172.21.15.76:0/3067702329 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fbf780105d0 con 0x7fbf840fff00 2024-06-02T04:49:23.178 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:23.174+0000 7fbf767fc700 1 --2- 172.21.15.76:0/3067702329 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fbf700a1230 0x7fbf700a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:23.178 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:23.175+0000 7fbf8882e700 1 --2- 172.21.15.76:0/3067702329 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fbf700a1230 0x7fbf700a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:23.178 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:23.175+0000 7fbf767fc700 1 -- 172.21.15.76:0/3067702329 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fbf780ccc50 con 0x7fbf840fff00 2024-06-02T04:49:23.178 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:23.175+0000 7fbf8882e700 1 --2- 172.21.15.76:0/3067702329 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fbf700a1230 0x7fbf700a36f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fbf80000c00 tx=0x7fbf80005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:23.180 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:23.179+0000 7fbf767fc700 1 -- 172.21.15.76:0/3067702329 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fbf78095f10 con 0x7fbf840fff00 2024-06-02T04:49:23.383 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:23.381+0000 7fbf8b293700 1 -- 172.21.15.76:0/3067702329 --> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fbf8402ceb0 con 0x7fbf700a1230 2024-06-02T04:49:23.384 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:23.383+0000 7fbf767fc700 1 -- 172.21.15.76:0/3067702329 <== mgr.14152 v2:172.21.15.76:6800/2591353090 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+532 (secure 0 0 0) 0x7fbf8402ceb0 con 0x7fbf700a1230 2024-06-02T04:49:23.385 INFO:teuthology.orchestra.run.smithi076.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-06-02T04:49:23.385 INFO:teuthology.orchestra.run.smithi076.stdout:smithi076 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400U4400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-06-02T04:49:23.385 INFO:teuthology.orchestra.run.smithi076.stdout:smithi119 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400Y1400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-06-02T04:49:23.385 INFO:teuthology.orchestra.run.smithi076.stdout:smithi192 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620500NN400BGN 372G No 115s ago Has a FileSystem, LVM detected 2024-06-02T04:49:23.387 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:23.385+0000 7fbf8b293700 1 -- 172.21.15.76:0/3067702329 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fbf700a1230 msgr2=0x7fbf700a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:23.387 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:23.385+0000 7fbf8b293700 1 --2- 172.21.15.76:0/3067702329 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fbf700a1230 0x7fbf700a36f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fbf80000c00 tx=0x7fbf80005fd0 comp rx=0 tx=0).stop 2024-06-02T04:49:23.387 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:23.385+0000 7fbf8b293700 1 -- 172.21.15.76:0/3067702329 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbf840fff00 msgr2=0x7fbf84069cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:23.387 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:23.385+0000 7fbf8b293700 1 --2- 172.21.15.76:0/3067702329 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbf840fff00 0x7fbf84069cf0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fbf7800d950 tx=0x7fbf7800dc60 comp rx=0 tx=0).stop 2024-06-02T04:49:23.388 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:23.385+0000 7fbf8b293700 1 -- 172.21.15.76:0/3067702329 shutdown_connections 2024-06-02T04:49:23.388 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:23.385+0000 7fbf8b293700 1 --2- 172.21.15.76:0/3067702329 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fbf700a1230 0x7fbf700a36f0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:23.388 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:23.385+0000 7fbf8b293700 1 --2- 172.21.15.76:0/3067702329 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf84101a20 0x7fbf8419e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:23.388 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:23.385+0000 7fbf8b293700 1 --2- 172.21.15.76:0/3067702329 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbf840fff00 0x7fbf84069cf0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:23.388 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:23.385+0000 7fbf8b293700 1 --2- 172.21.15.76:0/3067702329 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbf84101060 0x7fbf8419bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:23.388 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:23.385+0000 7fbf8b293700 1 -- 172.21.15.76:0/3067702329 >> 172.21.15.76:0/3067702329 conn(0x7fbf840fb4c0 msgr2=0x7fbf841044b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:23.388 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:23.385+0000 7fbf8b293700 1 -- 172.21.15.76:0/3067702329 shutdown_connections 2024-06-02T04:49:23.388 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:23.385+0000 7fbf8b293700 1 -- 172.21.15.76:0/3067702329 wait complete. 2024-06-02T04:49:23.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:23 smithi076 ceph-mon[42935]: from='client.15267 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:49:23.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:23 smithi076 ceph-mon[42935]: pgmap v260: 129 pgs: 129 active+clean; 639 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-06-02T04:49:23.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:23 smithi119 ceph-mon[46633]: from='client.15267 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:49:23.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:23 smithi119 ceph-mon[46633]: pgmap v260: 129 pgs: 129 active+clean; 639 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-06-02T04:49:23.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:23 smithi192 ceph-mon[47933]: from='client.15267 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:49:23.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:23 smithi192 ceph-mon[47933]: pgmap v260: 129 pgs: 129 active+clean; 639 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-06-02T04:49:23.782 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-06-02T04:49:23.793 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi076.front.sepia.ceph.com 2024-06-02T04:49:23.793 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 60ab6d30-209a-11ef-bc9b-c7b262605968 -- bash -c 'ceph fs dump' 2024-06-02T04:49:24.018 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T04:49:24.996 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:24.994+0000 7fe1c0f94700 1 -- 172.21.15.76:0/2495851857 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe1bc102ba0 msgr2=0x7fe1bc109450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:24.997 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:24.994+0000 7fe1c0f94700 1 --2- 172.21.15.76:0/2495851857 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe1bc102ba0 0x7fe1bc109450 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fe1b400b0d0 tx=0x7fe1b400b3e0 comp rx=0 tx=0).stop 2024-06-02T04:49:24.997 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:24.995+0000 7fe1c0f94700 1 -- 172.21.15.76:0/2495851857 shutdown_connections 2024-06-02T04:49:24.997 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:24.995+0000 7fe1c0f94700 1 --2- 172.21.15.76:0/2495851857 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe1bc102ba0 0x7fe1bc109450 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:24.997 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:24.995+0000 7fe1c0f94700 1 --2- 172.21.15.76:0/2495851857 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe1bc101000 0x7fe1bc101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:24.997 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:24.995+0000 7fe1c0f94700 1 --2- 172.21.15.76:0/2495851857 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe1bc102200 0x7fe1bc102660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:24.997 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:24.995+0000 7fe1c0f94700 1 -- 172.21.15.76:0/2495851857 >> 172.21.15.76:0/2495851857 conn(0x7fe1bc0fc5c0 msgr2=0x7fe1bc0fe9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:24.997 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:24.995+0000 7fe1c0f94700 1 -- 172.21.15.76:0/2495851857 shutdown_connections 2024-06-02T04:49:24.997 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:24.995+0000 7fe1c0f94700 1 -- 172.21.15.76:0/2495851857 wait complete. 2024-06-02T04:49:24.997 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:24.995+0000 7fe1c0f94700 1 Processor -- start 2024-06-02T04:49:24.997 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:24.995+0000 7fe1c0f94700 1 -- start start 2024-06-02T04:49:24.999 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:24.996+0000 7fe1c0f94700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe1bc101000 0x7fe1bc1990f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:24.999 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:24.996+0000 7fe1c0f94700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe1bc102200 0x7fe1bc199630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:24.999 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:24.996+0000 7fe1c0f94700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe1bc102ba0 0x7fe1bc1a0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:24.999 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:24.996+0000 7fe1c0f94700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1bc1a0c30 con 0x7fe1bc102200 2024-06-02T04:49:24.999 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:24.996+0000 7fe1c0f94700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1bc1a0d70 con 0x7fe1bc102ba0 2024-06-02T04:49:24.999 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:24.996+0000 7fe1c0f94700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1bc1a0f00 con 0x7fe1bc101000 2024-06-02T04:49:25.000 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:24.996+0000 7fe1b9d9b700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe1bc102200 0x7fe1bc199630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:25.000 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:24.996+0000 7fe1b9d9b700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe1bc102200 0x7fe1bc199630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:43040/0 (socket says 172.21.15.76:43040) 2024-06-02T04:49:25.000 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:24.996+0000 7fe1b9d9b700 1 -- 172.21.15.76:0/2631692182 learned_addr learned my addr 172.21.15.76:0/2631692182 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:49:25.000 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:24.996+0000 7fe1ba59c700 1 --2- 172.21.15.76:0/2631692182 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe1bc101000 0x7fe1bc1990f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:25.000 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:24.996+0000 7fe1bad9d700 1 --2- 172.21.15.76:0/2631692182 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe1bc102ba0 0x7fe1bc1a0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:25.000 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:24.996+0000 7fe1b9d9b700 1 -- 172.21.15.76:0/2631692182 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe1bc101000 msgr2=0x7fe1bc1990f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:25.000 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:24.996+0000 7fe1b9d9b700 1 --2- 172.21.15.76:0/2631692182 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe1bc101000 0x7fe1bc1990f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:25.000 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:24.996+0000 7fe1b9d9b700 1 -- 172.21.15.76:0/2631692182 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe1bc102ba0 msgr2=0x7fe1bc1a0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:25.000 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:24.996+0000 7fe1b9d9b700 1 --2- 172.21.15.76:0/2631692182 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe1bc102ba0 0x7fe1bc1a0660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:25.000 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:24.996+0000 7fe1b9d9b700 1 -- 172.21.15.76:0/2631692182 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1b4009d00 con 0x7fe1bc102200 2024-06-02T04:49:25.000 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:24.996+0000 7fe1b9d9b700 1 --2- 172.21.15.76:0/2631692182 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe1bc102200 0x7fe1bc199630 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fe1b000d980 tx=0x7fe1b000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:25.000 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:24.996+0000 7fe1ab7fe700 1 -- 172.21.15.76:0/2631692182 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1b00098d0 con 0x7fe1bc102200 2024-06-02T04:49:25.000 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:24.996+0000 7fe1ab7fe700 1 -- 172.21.15.76:0/2631692182 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe1b0010460 con 0x7fe1bc102200 2024-06-02T04:49:25.001 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:24.996+0000 7fe1c0f94700 1 -- 172.21.15.76:0/2631692182 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1bc1a11e0 con 0x7fe1bc102200 2024-06-02T04:49:25.001 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:24.996+0000 7fe1ab7fe700 1 -- 172.21.15.76:0/2631692182 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1b000f620 con 0x7fe1bc102200 2024-06-02T04:49:25.001 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:24.997+0000 7fe1c0f94700 1 -- 172.21.15.76:0/2631692182 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1bc1a1730 con 0x7fe1bc102200 2024-06-02T04:49:25.001 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:24.998+0000 7fe1c0f94700 1 -- 172.21.15.76:0/2631692182 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1bc04ec60 con 0x7fe1bc102200 2024-06-02T04:49:25.001 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:25.000+0000 7fe1ab7fe700 1 -- 172.21.15.76:0/2631692182 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fe1b0009a30 con 0x7fe1bc102200 2024-06-02T04:49:25.001 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:25.000+0000 7fe1ab7fe700 1 --2- 172.21.15.76:0/2631692182 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fe1a40a1230 0x7fe1a40a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:25.002 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:25.000+0000 7fe1ba59c700 1 --2- 172.21.15.76:0/2631692182 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fe1a40a1230 0x7fe1a40a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:25.002 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:25.000+0000 7fe1ab7fe700 1 -- 172.21.15.76:0/2631692182 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fe1b00ccab0 con 0x7fe1bc102200 2024-06-02T04:49:25.002 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:25.000+0000 7fe1ba59c700 1 --2- 172.21.15.76:0/2631692182 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fe1a40a1230 0x7fe1a40a36f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc102060 tx=0x7fe1ac00a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:25.005 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:25.004+0000 7fe1ab7fe700 1 -- 172.21.15.76:0/2631692182 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fe1b0095dd0 con 0x7fe1bc102200 2024-06-02T04:49:25.243 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:25.243+0000 7fe1c0f94700 1 -- 172.21.15.76:0/2631692182 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fe1bc10c6d0 con 0x7fe1bc102200 2024-06-02T04:49:25.243 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:25.243+0000 7fe1ab7fe700 1 -- 172.21.15.76:0/2631692182 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) v1 ==== 76+0+2903 (secure 0 0 0) 0x7fe1b0020b70 con 0x7fe1bc102200 2024-06-02T04:49:25.244 INFO:teuthology.orchestra.run.smithi076.stdout:e24 2024-06-02T04:49:25.244 INFO:teuthology.orchestra.run.smithi076.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-06-02T04:49:25.244 INFO:teuthology.orchestra.run.smithi076.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-06-02T04:49:25.244 INFO:teuthology.orchestra.run.smithi076.stdout:legacy client fscid: 1 2024-06-02T04:49:25.244 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:49:25.244 INFO:teuthology.orchestra.run.smithi076.stdout:Filesystem 'cephfs' (1) 2024-06-02T04:49:25.244 INFO:teuthology.orchestra.run.smithi076.stdout:fs_name cephfs 2024-06-02T04:49:25.244 INFO:teuthology.orchestra.run.smithi076.stdout:epoch 24 2024-06-02T04:49:25.244 INFO:teuthology.orchestra.run.smithi076.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-06-02T04:49:25.244 INFO:teuthology.orchestra.run.smithi076.stdout:created 2024-06-02T04:48:02.662812+0000 2024-06-02T04:49:25.244 INFO:teuthology.orchestra.run.smithi076.stdout:modified 2024-06-02T04:48:28.274836+0000 2024-06-02T04:49:25.244 INFO:teuthology.orchestra.run.smithi076.stdout:tableserver 0 2024-06-02T04:49:25.245 INFO:teuthology.orchestra.run.smithi076.stdout:root 0 2024-06-02T04:49:25.245 INFO:teuthology.orchestra.run.smithi076.stdout:session_timeout 300 2024-06-02T04:49:25.245 INFO:teuthology.orchestra.run.smithi076.stdout:session_autoclose 300 2024-06-02T04:49:25.245 INFO:teuthology.orchestra.run.smithi076.stdout:max_file_size 1099511627776 2024-06-02T04:49:25.245 INFO:teuthology.orchestra.run.smithi076.stdout:max_xattr_size 65536 2024-06-02T04:49:25.245 INFO:teuthology.orchestra.run.smithi076.stdout:required_client_features {} 2024-06-02T04:49:25.245 INFO:teuthology.orchestra.run.smithi076.stdout:last_failure 0 2024-06-02T04:49:25.245 INFO:teuthology.orchestra.run.smithi076.stdout:last_failure_osd_epoch 0 2024-06-02T04:49:25.245 INFO:teuthology.orchestra.run.smithi076.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-06-02T04:49:25.245 INFO:teuthology.orchestra.run.smithi076.stdout:max_mds 3 2024-06-02T04:49:25.245 INFO:teuthology.orchestra.run.smithi076.stdout:in 0,1,2 2024-06-02T04:49:25.245 INFO:teuthology.orchestra.run.smithi076.stdout:up {0=24491,1=24475,2=24463} 2024-06-02T04:49:25.246 INFO:teuthology.orchestra.run.smithi076.stdout:failed 2024-06-02T04:49:25.246 INFO:teuthology.orchestra.run.smithi076.stdout:damaged 2024-06-02T04:49:25.246 INFO:teuthology.orchestra.run.smithi076.stdout:stopped 2024-06-02T04:49:25.246 INFO:teuthology.orchestra.run.smithi076.stdout:data_pools [3,4] 2024-06-02T04:49:25.246 INFO:teuthology.orchestra.run.smithi076.stdout:metadata_pool 2 2024-06-02T04:49:25.246 INFO:teuthology.orchestra.run.smithi076.stdout:inline_data disabled 2024-06-02T04:49:25.246 INFO:teuthology.orchestra.run.smithi076.stdout:balancer 2024-06-02T04:49:25.246 INFO:teuthology.orchestra.run.smithi076.stdout:bal_rank_mask -1 2024-06-02T04:49:25.246 INFO:teuthology.orchestra.run.smithi076.stdout:standby_count_wanted 0 2024-06-02T04:49:25.246 INFO:teuthology.orchestra.run.smithi076.stdout:[mds.b{0:24491} state up:active seq 3 addr [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] compat {c=[1],r=[1],i=[7ff]}] 2024-06-02T04:49:25.246 INFO:teuthology.orchestra.run.smithi076.stdout:[mds.h{0:24458} state up:standby-replay seq 1 addr [v2:172.21.15.119:6836/2171687478,v1:172.21.15.119:6837/2171687478] compat {c=[1],r=[1],i=[7ff]}] 2024-06-02T04:49:25.246 INFO:teuthology.orchestra.run.smithi076.stdout:[mds.i{1:24475} state up:active seq 10 addr [v2:172.21.15.192:6838/3978681402,v1:172.21.15.192:6839/3978681402] compat {c=[1],r=[1],i=[7ff]}] 2024-06-02T04:49:25.246 INFO:teuthology.orchestra.run.smithi076.stdout:[mds.f{1:24451} state up:standby-replay seq 1 addr [v2:172.21.15.192:6834/783181340,v1:172.21.15.192:6835/783181340] compat {c=[1],r=[1],i=[7ff]}] 2024-06-02T04:49:25.247 INFO:teuthology.orchestra.run.smithi076.stdout:[mds.c{2:24463} state up:active seq 11 addr [v2:172.21.15.192:6836/960773710,v1:172.21.15.192:6837/960773710] compat {c=[1],r=[1],i=[7ff]}] 2024-06-02T04:49:25.247 INFO:teuthology.orchestra.run.smithi076.stdout:[mds.e{2:24434} state up:standby-replay seq 1 addr [v2:172.21.15.119:6834/2746840347,v1:172.21.15.119:6835/2746840347] compat {c=[1],r=[1],i=[7ff]}] 2024-06-02T04:49:25.247 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:49:25.247 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:49:25.247 INFO:teuthology.orchestra.run.smithi076.stdout:Standby daemons: 2024-06-02T04:49:25.247 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:49:25.247 INFO:teuthology.orchestra.run.smithi076.stdout:[mds.j{-1:14541} state up:standby seq 1 addr [v2:172.21.15.76:6834/3029342152,v1:172.21.15.76:6835/3029342152] compat {c=[1],r=[1],i=[7ff]}] 2024-06-02T04:49:25.247 INFO:teuthology.orchestra.run.smithi076.stdout:[mds.d{-1:14553} state up:standby seq 1 addr [v2:172.21.15.76:6836/1207985317,v1:172.21.15.76:6837/1207985317] compat {c=[1],r=[1],i=[7ff]}] 2024-06-02T04:49:25.247 INFO:teuthology.orchestra.run.smithi076.stdout:[mds.g{-1:14607} state up:standby seq 1 addr [v2:172.21.15.76:6838/928709755,v1:172.21.15.76:6839/928709755] compat {c=[1],r=[1],i=[7ff]}] 2024-06-02T04:49:25.247 INFO:teuthology.orchestra.run.smithi076.stdout:[mds.a{-1:14619} state up:standby seq 1 addr [v2:172.21.15.76:6840/4162178633,v1:172.21.15.76:6841/4162178633] compat {c=[1],r=[1],i=[7ff]}] 2024-06-02T04:49:25.247 INFO:teuthology.orchestra.run.smithi076.stdout:[mds.k{-1:24410} state up:standby seq 1 addr [v2:172.21.15.119:6832/1543944863,v1:172.21.15.119:6833/1543944863] compat {c=[1],r=[1],i=[7ff]}] 2024-06-02T04:49:25.247 INFO:teuthology.orchestra.run.smithi076.stdout:[mds.l{-1:24418} state up:standby seq 1 addr [v2:172.21.15.192:6832/1527921393,v1:172.21.15.192:6833/1527921393] compat {c=[1],r=[1],i=[7ff]}] 2024-06-02T04:49:25.248 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:25.245+0000 7fe1c0f94700 1 -- 172.21.15.76:0/2631692182 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fe1a40a1230 msgr2=0x7fe1a40a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:25.248 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:25.245+0000 7fe1c0f94700 1 --2- 172.21.15.76:0/2631692182 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fe1a40a1230 0x7fe1a40a36f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc102060 tx=0x7fe1ac00a380 comp rx=0 tx=0).stop 2024-06-02T04:49:25.248 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:25.245+0000 7fe1c0f94700 1 -- 172.21.15.76:0/2631692182 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe1bc102200 msgr2=0x7fe1bc199630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:25.248 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:25.245+0000 7fe1c0f94700 1 --2- 172.21.15.76:0/2631692182 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe1bc102200 0x7fe1bc199630 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fe1b000d980 tx=0x7fe1b000dc90 comp rx=0 tx=0).stop 2024-06-02T04:49:25.248 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:25.245+0000 7fe1c0f94700 1 -- 172.21.15.76:0/2631692182 shutdown_connections 2024-06-02T04:49:25.248 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:25.245+0000 7fe1c0f94700 1 --2- 172.21.15.76:0/2631692182 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fe1a40a1230 0x7fe1a40a36f0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:25.248 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:25.245+0000 7fe1c0f94700 1 --2- 172.21.15.76:0/2631692182 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe1bc102ba0 0x7fe1bc1a0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:25.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:25.245+0000 7fe1c0f94700 1 --2- 172.21.15.76:0/2631692182 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe1bc101000 0x7fe1bc1990f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:25.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:25.245+0000 7fe1c0f94700 1 --2- 172.21.15.76:0/2631692182 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe1bc102200 0x7fe1bc199630 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:25.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:25.245+0000 7fe1c0f94700 1 -- 172.21.15.76:0/2631692182 >> 172.21.15.76:0/2631692182 conn(0x7fe1bc0fc5c0 msgr2=0x7fe1bc0731d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:25.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:25.245+0000 7fe1c0f94700 1 -- 172.21.15.76:0/2631692182 shutdown_connections 2024-06-02T04:49:25.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:25.245+0000 7fe1c0f94700 1 -- 172.21.15.76:0/2631692182 wait complete. 2024-06-02T04:49:25.249 INFO:teuthology.orchestra.run.smithi076.stderr:dumped fsmap epoch 24 2024-06-02T04:49:25.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:25 smithi076 ceph-mon[42935]: from='client.15273 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:49:25.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:25 smithi076 ceph-mon[42935]: pgmap v261: 129 pgs: 129 active+clean; 639 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-06-02T04:49:25.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:25 smithi119 ceph-mon[46633]: from='client.15273 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:49:25.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:25 smithi119 ceph-mon[46633]: pgmap v261: 129 pgs: 129 active+clean; 639 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-06-02T04:49:25.631 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 60ab6d30-209a-11ef-bc9b-c7b262605968 -- bash -c 'ceph osd dump' 2024-06-02T04:49:25.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:25 smithi192 ceph-mon[47933]: from='client.15273 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:49:25.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:25 smithi192 ceph-mon[47933]: pgmap v261: 129 pgs: 129 active+clean; 639 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-06-02T04:49:25.855 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T04:49:26.358 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:26 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/2631692182' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-06-02T04:49:26.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:26 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/2631692182' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-06-02T04:49:26.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:26 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/2631692182' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-06-02T04:49:26.871 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:26.870+0000 7f01e052d700 1 -- 172.21.15.76:0/2185913956 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f01d8101070 msgr2=0x7f01d81014f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:26.871 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:26.870+0000 7f01e052d700 1 --2- 172.21.15.76:0/2185913956 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f01d8101070 0x7f01d81014f0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f01c8009990 tx=0x7f01c8009ca0 comp rx=0 tx=0).stop 2024-06-02T04:49:26.871 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:26.870+0000 7f01e052d700 1 -- 172.21.15.76:0/2185913956 shutdown_connections 2024-06-02T04:49:26.871 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:26.870+0000 7f01e052d700 1 --2- 172.21.15.76:0/2185913956 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f01d8101a30 0x7f01d8108350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:26.871 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:26.870+0000 7f01e052d700 1 --2- 172.21.15.76:0/2185913956 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f01d80ffe80 0x7f01d81002a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:26.872 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:26.870+0000 7f01e052d700 1 --2- 172.21.15.76:0/2185913956 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f01d8101070 0x7f01d81014f0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:26.872 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:26.870+0000 7f01e052d700 1 -- 172.21.15.76:0/2185913956 >> 172.21.15.76:0/2185913956 conn(0x7f01d80fb470 msgr2=0x7f01d80fd8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:26.872 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:26.871+0000 7f01e052d700 1 -- 172.21.15.76:0/2185913956 shutdown_connections 2024-06-02T04:49:26.872 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:26.871+0000 7f01e052d700 1 -- 172.21.15.76:0/2185913956 wait complete. 2024-06-02T04:49:26.874 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:26.871+0000 7f01e052d700 1 Processor -- start 2024-06-02T04:49:26.874 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:26.871+0000 7f01e052d700 1 -- start start 2024-06-02T04:49:26.874 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:26.871+0000 7f01e052d700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f01d80ffe80 0x7f01d8199020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:26.874 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:26.871+0000 7f01e052d700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f01d8101070 0x7f01d8199560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:26.874 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:26.871+0000 7f01e052d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f01d8101a30 0x7f01d81a0540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:26.874 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:26.871+0000 7f01e052d700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01d81a0b10 con 0x7f01d80ffe80 2024-06-02T04:49:26.874 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:26.871+0000 7f01e052d700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01d81a0c50 con 0x7f01d8101070 2024-06-02T04:49:26.874 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:26.871+0000 7f01e052d700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01d81a0de0 con 0x7f01d8101a30 2024-06-02T04:49:26.874 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:26.871+0000 7f01de2c9700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f01d80ffe80 0x7f01d8199020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:26.875 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:26.871+0000 7f01de2c9700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f01d80ffe80 0x7f01d8199020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:43044/0 (socket says 172.21.15.76:43044) 2024-06-02T04:49:26.875 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:26.871+0000 7f01de2c9700 1 -- 172.21.15.76:0/1031581901 learned_addr learned my addr 172.21.15.76:0/1031581901 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:49:26.875 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:26.872+0000 7f01deaca700 1 --2- 172.21.15.76:0/1031581901 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f01d8101a30 0x7f01d81a0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:26.875 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:26.872+0000 7f01ddac8700 1 --2- 172.21.15.76:0/1031581901 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f01d8101070 0x7f01d8199560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:26.875 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:26.872+0000 7f01de2c9700 1 -- 172.21.15.76:0/1031581901 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f01d8101a30 msgr2=0x7f01d81a0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:26.875 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:26.872+0000 7f01de2c9700 1 --2- 172.21.15.76:0/1031581901 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f01d8101a30 0x7f01d81a0540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:26.875 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:26.872+0000 7f01de2c9700 1 -- 172.21.15.76:0/1031581901 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f01d8101070 msgr2=0x7f01d8199560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:26.875 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:26.872+0000 7f01de2c9700 1 --2- 172.21.15.76:0/1031581901 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f01d8101070 0x7f01d8199560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:26.875 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:26.872+0000 7f01de2c9700 1 -- 172.21.15.76:0/1031581901 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01c80095f0 con 0x7f01d80ffe80 2024-06-02T04:49:26.875 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:26.872+0000 7f01deaca700 1 --2- 172.21.15.76:0/1031581901 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f01d8101a30 0x7f01d81a0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:49:26.875 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:26.872+0000 7f01de2c9700 1 --2- 172.21.15.76:0/1031581901 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f01d80ffe80 0x7f01d8199020 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f01d400c9c0 tx=0x7f01d400cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:26.875 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:26.872+0000 7f01cf7fe700 1 -- 172.21.15.76:0/1031581901 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01d4007ac0 con 0x7f01d80ffe80 2024-06-02T04:49:26.876 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:26.872+0000 7f01cf7fe700 1 -- 172.21.15.76:0/1031581901 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f01d4007c20 con 0x7f01d80ffe80 2024-06-02T04:49:26.876 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:26.872+0000 7f01e052d700 1 -- 172.21.15.76:0/1031581901 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01d81a10c0 con 0x7f01d80ffe80 2024-06-02T04:49:26.876 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:26.872+0000 7f01cf7fe700 1 -- 172.21.15.76:0/1031581901 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01d4018660 con 0x7f01d80ffe80 2024-06-02T04:49:26.876 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:26.872+0000 7f01e052d700 1 -- 172.21.15.76:0/1031581901 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01d81a1610 con 0x7f01d80ffe80 2024-06-02T04:49:26.876 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:26.873+0000 7f01e052d700 1 -- 172.21.15.76:0/1031581901 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01d804ec60 con 0x7f01d80ffe80 2024-06-02T04:49:26.877 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:26.875+0000 7f01cf7fe700 1 -- 172.21.15.76:0/1031581901 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f01d400f450 con 0x7f01d80ffe80 2024-06-02T04:49:26.877 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:26.875+0000 7f01cf7fe700 1 --2- 172.21.15.76:0/1031581901 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f01c40a1230 0x7f01c40a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:26.877 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:26.875+0000 7f01ddac8700 1 --2- 172.21.15.76:0/1031581901 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f01c40a1230 0x7f01c40a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:26.877 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:26.875+0000 7f01cf7fe700 1 -- 172.21.15.76:0/1031581901 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f01d40ccdf0 con 0x7f01d80ffe80 2024-06-02T04:49:26.877 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:26.876+0000 7f01ddac8700 1 --2- 172.21.15.76:0/1031581901 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f01c40a1230 0x7f01c40a36f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f01c800c010 tx=0x7f01c800b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:26.879 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:26.879+0000 7f01cf7fe700 1 -- 172.21.15.76:0/1031581901 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f01d4096220 con 0x7f01d80ffe80 2024-06-02T04:49:27.073 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:27.073+0000 7f01e052d700 1 -- 172.21.15.76:0/1031581901 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd dump"} v 0) v1 -- 0x7f01d810b5b0 con 0x7f01d80ffe80 2024-06-02T04:49:27.074 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:27.074+0000 7f01cf7fe700 1 -- 172.21.15.76:0/1031581901 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v82) v1 ==== 56+0+5607 (secure 0 0 0) 0x7f01d4099840 con 0x7f01d80ffe80 2024-06-02T04:49:27.074 INFO:teuthology.orchestra.run.smithi076.stdout:epoch 82 2024-06-02T04:49:27.074 INFO:teuthology.orchestra.run.smithi076.stdout:fsid 60ab6d30-209a-11ef-bc9b-c7b262605968 2024-06-02T04:49:27.074 INFO:teuthology.orchestra.run.smithi076.stdout:created 2024-06-02T04:42:21.007333+0000 2024-06-02T04:49:27.074 INFO:teuthology.orchestra.run.smithi076.stdout:modified 2024-06-02T04:49:07.862801+0000 2024-06-02T04:49:27.074 INFO:teuthology.orchestra.run.smithi076.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-06-02T04:49:27.075 INFO:teuthology.orchestra.run.smithi076.stdout:crush_version 27 2024-06-02T04:49:27.075 INFO:teuthology.orchestra.run.smithi076.stdout:full_ratio 0.95 2024-06-02T04:49:27.075 INFO:teuthology.orchestra.run.smithi076.stdout:backfillfull_ratio 0.9 2024-06-02T04:49:27.075 INFO:teuthology.orchestra.run.smithi076.stdout:nearfull_ratio 0.85 2024-06-02T04:49:27.075 INFO:teuthology.orchestra.run.smithi076.stdout:require_min_compat_client luminous 2024-06-02T04:49:27.075 INFO:teuthology.orchestra.run.smithi076.stdout:min_compat_client luminous 2024-06-02T04:49:27.075 INFO:teuthology.orchestra.run.smithi076.stdout:require_osd_release reef 2024-06-02T04:49:27.075 INFO:teuthology.orchestra.run.smithi076.stdout:stretch_mode_enabled false 2024-06-02T04:49:27.075 INFO:teuthology.orchestra.run.smithi076.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 19 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-06-02T04:49:27.075 INFO:teuthology.orchestra.run.smithi076.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 75 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 2.25 2024-06-02T04:49:27.075 INFO:teuthology.orchestra.run.smithi076.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 76 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.05 application cephfs read_balance_score 1.50 2024-06-02T04:49:27.075 INFO:teuthology.orchestra.run.smithi076.stdout:pool 4 'cephfs_data_ec' erasure profile cephfs_data_ec size 4 min_size 3 crush_rule 1 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 80 flags hashpspool,ec_overwrites stripe_width 8192 pg_num_min 64 target_size_ratio 0.9 application cephfs 2024-06-02T04:49:27.075 INFO:teuthology.orchestra.run.smithi076.stdout:max_osd 12 2024-06-02T04:49:27.076 INFO:teuthology.orchestra.run.smithi076.stdout:osd.0 up in weight 1 up_from 8 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.76:6802/2869602045,v1:172.21.15.76:6803/2869602045] [v2:172.21.15.76:6804/2869602045,v1:172.21.15.76:6805/2869602045] exists,up 33a51ba2-be5c-41d0-b5d1-8d6039f2ca4c 2024-06-02T04:49:27.076 INFO:teuthology.orchestra.run.smithi076.stdout:osd.1 up in weight 1 up_from 12 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.119:6800/2353738098,v1:172.21.15.119:6801/2353738098] [v2:172.21.15.119:6802/2353738098,v1:172.21.15.119:6803/2353738098] exists,up ace46e13-3bb7-4103-973a-6860554df8b0 2024-06-02T04:49:27.076 INFO:teuthology.orchestra.run.smithi076.stdout:osd.2 up in weight 1 up_from 16 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.192:6800/3206918546,v1:172.21.15.192:6801/3206918546] [v2:172.21.15.192:6802/3206918546,v1:172.21.15.192:6803/3206918546] exists,up 4addc09e-77a9-428a-bcc4-38194f486cf6 2024-06-02T04:49:27.076 INFO:teuthology.orchestra.run.smithi076.stdout:osd.3 up in weight 1 up_from 22 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.76:6810/3747864233,v1:172.21.15.76:6811/3747864233] [v2:172.21.15.76:6812/3747864233,v1:172.21.15.76:6813/3747864233] exists,up dc525518-82c6-49ed-8ca8-e3bd5bfc18d1 2024-06-02T04:49:27.076 INFO:teuthology.orchestra.run.smithi076.stdout:osd.4 up in weight 1 up_from 29 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.119:6808/2571629047,v1:172.21.15.119:6809/2571629047] [v2:172.21.15.119:6810/2571629047,v1:172.21.15.119:6811/2571629047] exists,up eef293d0-cb87-47b3-9751-c6437a1cf079 2024-06-02T04:49:27.076 INFO:teuthology.orchestra.run.smithi076.stdout:osd.5 up in weight 1 up_from 33 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.192:6808/3285065416,v1:172.21.15.192:6809/3285065416] [v2:172.21.15.192:6810/3285065416,v1:172.21.15.192:6811/3285065416] exists,up 60eb8c6e-766c-49d0-9997-44f85776b3fb 2024-06-02T04:49:27.076 INFO:teuthology.orchestra.run.smithi076.stdout:osd.6 up in weight 1 up_from 40 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.76:6818/2951381580,v1:172.21.15.76:6819/2951381580] [v2:172.21.15.76:6820/2951381580,v1:172.21.15.76:6821/2951381580] exists,up e6dc8b9d-dd06-4870-a506-def8201b7e6d 2024-06-02T04:49:27.076 INFO:teuthology.orchestra.run.smithi076.stdout:osd.7 up in weight 1 up_from 46 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.119:6816/1802558756,v1:172.21.15.119:6817/1802558756] [v2:172.21.15.119:6818/1802558756,v1:172.21.15.119:6819/1802558756] exists,up 2f5dccb3-39a1-4f25-8715-fa264d59db97 2024-06-02T04:49:27.076 INFO:teuthology.orchestra.run.smithi076.stdout:osd.8 up in weight 1 up_from 53 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.192:6816/1214972276,v1:172.21.15.192:6817/1214972276] [v2:172.21.15.192:6818/1214972276,v1:172.21.15.192:6819/1214972276] exists,up 39b6ccd0-16e7-4cd5-87e0-d827e9172984 2024-06-02T04:49:27.076 INFO:teuthology.orchestra.run.smithi076.stdout:osd.9 up in weight 1 up_from 60 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.76:6826/3095501821,v1:172.21.15.76:6827/3095501821] [v2:172.21.15.76:6828/3095501821,v1:172.21.15.76:6829/3095501821] exists,up 851b2155-07bd-45de-bfe0-53021fda733f 2024-06-02T04:49:27.076 INFO:teuthology.orchestra.run.smithi076.stdout:osd.10 up in weight 1 up_from 64 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.119:6824/4082130894,v1:172.21.15.119:6825/4082130894] [v2:172.21.15.119:6826/4082130894,v1:172.21.15.119:6827/4082130894] exists,up e4b18e7e-bddf-4dd4-84f6-7902ea327cbe 2024-06-02T04:49:27.077 INFO:teuthology.orchestra.run.smithi076.stdout:osd.11 up in weight 1 up_from 71 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.192:6824/439693921,v1:172.21.15.192:6825/439693921] [v2:172.21.15.192:6826/439693921,v1:172.21.15.192:6827/439693921] exists,up 54567e18-920c-4ae9-9557-0efba5a1a820 2024-06-02T04:49:27.077 INFO:teuthology.orchestra.run.smithi076.stdout:pg_upmap_items 2.0 [8,4] 2024-06-02T04:49:27.077 INFO:teuthology.orchestra.run.smithi076.stdout:pg_upmap_items 2.1d [2,4] 2024-06-02T04:49:27.077 INFO:teuthology.orchestra.run.smithi076.stdout:pg_upmap_items 3.1 [4,9] 2024-06-02T04:49:27.077 INFO:teuthology.orchestra.run.smithi076.stdout:pg_upmap_items 3.14 [4,6] 2024-06-02T04:49:27.077 INFO:teuthology.orchestra.run.smithi076.stdout:pg_upmap_items 3.24 [4,9] 2024-06-02T04:49:27.077 INFO:teuthology.orchestra.run.smithi076.stdout:pg_upmap_items 3.25 [5,9] 2024-06-02T04:49:27.077 INFO:teuthology.orchestra.run.smithi076.stdout:pg_upmap_items 4.2 [9,1] 2024-06-02T04:49:27.077 INFO:teuthology.orchestra.run.smithi076.stdout:pg_upmap_items 4.8 [5,10] 2024-06-02T04:49:27.077 INFO:teuthology.orchestra.run.smithi076.stdout:pg_upmap_items 4.14 [9,8] 2024-06-02T04:49:27.077 INFO:teuthology.orchestra.run.smithi076.stdout:pg_upmap_items 4.1b [9,8] 2024-06-02T04:49:27.077 INFO:teuthology.orchestra.run.smithi076.stdout:blocklist 172.21.15.76:6801/4200406736 expires 2024-06-03T04:43:06.092916+0000 2024-06-02T04:49:27.077 INFO:teuthology.orchestra.run.smithi076.stdout:blocklist 172.21.15.76:6800/4200406736 expires 2024-06-03T04:43:06.092916+0000 2024-06-02T04:49:27.078 INFO:teuthology.orchestra.run.smithi076.stdout:blocklist 172.21.15.76:0/1524144593 expires 2024-06-03T04:43:06.092916+0000 2024-06-02T04:49:27.078 INFO:teuthology.orchestra.run.smithi076.stdout:blocklist 172.21.15.76:0/3269372590 expires 2024-06-03T04:43:06.092916+0000 2024-06-02T04:49:27.078 INFO:teuthology.orchestra.run.smithi076.stdout:blocklist 172.21.15.76:0/3570893846 expires 2024-06-03T04:42:44.872236+0000 2024-06-02T04:49:27.078 INFO:teuthology.orchestra.run.smithi076.stdout:blocklist 172.21.15.76:0/902035790 expires 2024-06-03T04:43:06.092916+0000 2024-06-02T04:49:27.078 INFO:teuthology.orchestra.run.smithi076.stdout:blocklist 172.21.15.76:6800/2550846765 expires 2024-06-03T04:42:44.872236+0000 2024-06-02T04:49:27.078 INFO:teuthology.orchestra.run.smithi076.stdout:blocklist 172.21.15.76:6801/2550846765 expires 2024-06-03T04:42:44.872236+0000 2024-06-02T04:49:27.078 INFO:teuthology.orchestra.run.smithi076.stdout:blocklist 172.21.15.76:0/2646712763 expires 2024-06-03T04:42:44.872236+0000 2024-06-02T04:49:27.078 INFO:teuthology.orchestra.run.smithi076.stdout:blocklist 172.21.15.76:0/964578813 expires 2024-06-03T04:42:44.872236+0000 2024-06-02T04:49:27.079 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:27.076+0000 7f01e052d700 1 -- 172.21.15.76:0/1031581901 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f01c40a1230 msgr2=0x7f01c40a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:27.079 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:27.076+0000 7f01e052d700 1 --2- 172.21.15.76:0/1031581901 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f01c40a1230 0x7f01c40a36f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f01c800c010 tx=0x7f01c800b540 comp rx=0 tx=0).stop 2024-06-02T04:49:27.079 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:27.076+0000 7f01e052d700 1 -- 172.21.15.76:0/1031581901 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f01d80ffe80 msgr2=0x7f01d8199020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:27.079 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:27.076+0000 7f01e052d700 1 --2- 172.21.15.76:0/1031581901 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f01d80ffe80 0x7f01d8199020 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f01d400c9c0 tx=0x7f01d400cd80 comp rx=0 tx=0).stop 2024-06-02T04:49:27.079 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:27.076+0000 7f01e052d700 1 -- 172.21.15.76:0/1031581901 shutdown_connections 2024-06-02T04:49:27.079 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:27.076+0000 7f01e052d700 1 --2- 172.21.15.76:0/1031581901 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f01d8101a30 0x7f01d81a0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:27.079 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:27.076+0000 7f01e052d700 1 --2- 172.21.15.76:0/1031581901 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f01d80ffe80 0x7f01d8199020 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:27.079 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:27.076+0000 7f01e052d700 1 --2- 172.21.15.76:0/1031581901 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f01c40a1230 0x7f01c40a36f0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:27.079 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:27.076+0000 7f01e052d700 1 --2- 172.21.15.76:0/1031581901 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f01d8101070 0x7f01d8199560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:27.079 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:27.076+0000 7f01e052d700 1 -- 172.21.15.76:0/1031581901 >> 172.21.15.76:0/1031581901 conn(0x7f01d80fb470 msgr2=0x7f01d8069680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:27.080 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:27.076+0000 7f01e052d700 1 -- 172.21.15.76:0/1031581901 shutdown_connections 2024-06-02T04:49:27.080 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:27.076+0000 7f01e052d700 1 -- 172.21.15.76:0/1031581901 wait complete. 2024-06-02T04:49:27.432 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:27 smithi076 ceph-mon[42935]: pgmap v262: 129 pgs: 129 active+clean; 639 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-02T04:49:27.432 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:27 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/1031581901' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-06-02T04:49:27.497 INFO:teuthology.run_tasks:Running task fs.ready... 2024-06-02T04:49:27.509 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-02T04:49:27.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:27 smithi119 ceph-mon[46633]: pgmap v262: 129 pgs: 129 active+clean; 639 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-02T04:49:27.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:27 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/1031581901' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-06-02T04:49:27.638 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:27.636+0000 7fd6c4769700 1 -- 172.21.15.76:0/2106281333 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd6bc102990 msgr2=0x7fd6bc1092b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:27.638 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:27.636+0000 7fd6c4769700 1 --2- 172.21.15.76:0/2106281333 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd6bc102990 0x7fd6bc1092b0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fd6b400b0a0 tx=0x7fd6b400b3b0 comp rx=0 tx=0).stop 2024-06-02T04:49:27.638 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:27.636+0000 7fd6c4769700 1 -- 172.21.15.76:0/2106281333 shutdown_connections 2024-06-02T04:49:27.639 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:27.636+0000 7fd6c4769700 1 --2- 172.21.15.76:0/2106281333 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd6bc102990 0x7fd6bc1092b0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:27.639 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:27.636+0000 7fd6c4769700 1 --2- 172.21.15.76:0/2106281333 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd6bc100e80 0x7fd6bc1012a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:27.639 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:27.636+0000 7fd6c4769700 1 --2- 172.21.15.76:0/2106281333 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd6bc101fd0 0x7fd6bc102450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:27.639 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:27.636+0000 7fd6c4769700 1 -- 172.21.15.76:0/2106281333 >> 172.21.15.76:0/2106281333 conn(0x7fd6bc0fc410 msgr2=0x7fd6bc0fe830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:27.639 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:27.636+0000 7fd6c4769700 1 -- 172.21.15.76:0/2106281333 shutdown_connections 2024-06-02T04:49:27.639 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:27.636+0000 7fd6c4769700 1 -- 172.21.15.76:0/2106281333 wait complete. 2024-06-02T04:49:27.639 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:27.636+0000 7fd6c4769700 1 Processor -- start 2024-06-02T04:49:27.639 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:27.637+0000 7fd6c4769700 1 -- start start 2024-06-02T04:49:27.639 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:27.637+0000 7fd6c4769700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd6bc100e80 0x7fd6bc074d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:27.640 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:27.637+0000 7fd6c4769700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd6bc101fd0 0x7fd6bc073390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:27.640 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:27.637+0000 7fd6c4769700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd6bc102990 0x7fd6bc0738d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:27.640 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:27.637+0000 7fd6c4769700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6bc074070 con 0x7fd6bc102990 2024-06-02T04:49:27.640 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:27.637+0000 7fd6c4769700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6bc0741e0 con 0x7fd6bc100e80 2024-06-02T04:49:27.640 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:27.637+0000 7fd6c4769700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6bc1a0d00 con 0x7fd6bc101fd0 2024-06-02T04:49:27.640 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:27.637+0000 7fd6c2d06700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd6bc102990 0x7fd6bc0738d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:27.640 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:27.637+0000 7fd6c2d06700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd6bc102990 0x7fd6bc0738d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:43074/0 (socket says 172.21.15.76:43074) 2024-06-02T04:49:27.640 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:27.637+0000 7fd6c2d06700 1 -- 172.21.15.76:0/1596951377 learned_addr learned my addr 172.21.15.76:0/1596951377 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:49:27.640 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:27.637+0000 7fd6c1d04700 1 --2- 172.21.15.76:0/1596951377 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd6bc101fd0 0x7fd6bc073390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:27.641 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:27.637+0000 7fd6c2505700 1 --2- 172.21.15.76:0/1596951377 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd6bc100e80 0x7fd6bc074d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:27.641 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:27.637+0000 7fd6c2d06700 1 -- 172.21.15.76:0/1596951377 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd6bc101fd0 msgr2=0x7fd6bc073390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:27.641 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:27.637+0000 7fd6c2d06700 1 --2- 172.21.15.76:0/1596951377 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd6bc101fd0 0x7fd6bc073390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:27.641 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:27.637+0000 7fd6c2d06700 1 -- 172.21.15.76:0/1596951377 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd6bc100e80 msgr2=0x7fd6bc074d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:27.641 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:27.637+0000 7fd6c2d06700 1 --2- 172.21.15.76:0/1596951377 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd6bc100e80 0x7fd6bc074d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:27.641 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:27.637+0000 7fd6c2d06700 1 -- 172.21.15.76:0/1596951377 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6b4009d00 con 0x7fd6bc102990 2024-06-02T04:49:27.641 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:27.637+0000 7fd6c2505700 1 --2- 172.21.15.76:0/1596951377 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd6bc100e80 0x7fd6bc074d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:49:27.641 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:27.637+0000 7fd6c1d04700 1 --2- 172.21.15.76:0/1596951377 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd6bc101fd0 0x7fd6bc073390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:49:27.641 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:27.637+0000 7fd6c2d06700 1 --2- 172.21.15.76:0/1596951377 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd6bc102990 0x7fd6bc0738d0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fd6b4004d10 tx=0x7fd6b4004df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:27.641 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:27.637+0000 7fd6b37fe700 1 -- 172.21.15.76:0/1596951377 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b400e040 con 0x7fd6bc102990 2024-06-02T04:49:27.641 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:27.637+0000 7fd6b37fe700 1 -- 172.21.15.76:0/1596951377 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd6b40058e0 con 0x7fd6bc102990 2024-06-02T04:49:27.641 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:27.637+0000 7fd6c4769700 1 -- 172.21.15.76:0/1596951377 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6bc1a0f30 con 0x7fd6bc102990 2024-06-02T04:49:27.641 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:27.637+0000 7fd6b37fe700 1 -- 172.21.15.76:0/1596951377 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b401dc70 con 0x7fd6bc102990 2024-06-02T04:49:27.641 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:27.637+0000 7fd6c4769700 1 -- 172.21.15.76:0/1596951377 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6bc1a1350 con 0x7fd6bc102990 2024-06-02T04:49:27.642 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:27.638+0000 7fd6c4769700 1 -- 172.21.15.76:0/1596951377 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6bc1081c0 con 0x7fd6bc102990 2024-06-02T04:49:27.642 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:27.639+0000 7fd6b37fe700 1 -- 172.21.15.76:0/1596951377 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fd6b401d480 con 0x7fd6bc102990 2024-06-02T04:49:27.642 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:27.640+0000 7fd6b37fe700 1 --2- 172.21.15.76:0/1596951377 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fd6a80a1230 0x7fd6a80a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:27.643 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:27.640+0000 7fd6c2505700 1 --2- 172.21.15.76:0/1596951377 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fd6a80a1230 0x7fd6a80a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:27.643 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:27.640+0000 7fd6b37fe700 1 -- 172.21.15.76:0/1596951377 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fd6b40ce540 con 0x7fd6bc102990 2024-06-02T04:49:27.643 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:27.640+0000 7fd6c2505700 1 --2- 172.21.15.76:0/1596951377 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fd6a80a1230 0x7fd6a80a36f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fd6b8005fd0 tx=0x7fd6b8005e20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:27.645 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:27.645+0000 7fd6b37fe700 1 -- 172.21.15.76:0/1596951377 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fd6b40978f0 con 0x7fd6bc102990 2024-06-02T04:49:27.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:27 smithi192 ceph-mon[47933]: pgmap v262: 129 pgs: 129 active+clean; 639 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-02T04:49:27.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:27 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/1031581901' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-06-02T04:49:27.845 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:27.845+0000 7fd6c4769700 1 -- 172.21.15.76:0/1596951377 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd6bc10c530 con 0x7fd6bc102990 2024-06-02T04:49:27.847 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:27.847+0000 7fd6b37fe700 1 -- 172.21.15.76:0/1596951377 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+24453 (secure 0 0 0) 0x7fd6b409af10 con 0x7fd6bc102990 2024-06-02T04:49:27.847 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:49:27.848 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":82,"fsid":"60ab6d30-209a-11ef-bc9b-c7b262605968","created":"2024-06-02T04:42:21.007333+0000","modified":"2024-06-02T04:49:07.862801+0000","last_up_change":"2024-06-02T04:47:29.822242+0000","last_in_change":"2024-06-02T04:47:14.253449+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T04:44:56.408602+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-02T04:48:01.194954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-02T04:48:01.828863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-02T04:48:04.916565+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"33a51ba2-be5c-41d0-b5d1-8d6039f2ca4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6802","nonce":2869602045},{"type":"v1","addr":"172.21.15.76:6803","nonce":2869602045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6804","nonce":2869602045},{"type":"v1","addr":"172.21.15.76:6805","nonce":2869602045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6808","nonce":2869602045},{"type":"v1","addr":"172.21.15.76:6809","nonce":2869602045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6806","nonce":2869602045},{"type":"v1","addr":"172.21.15.76:6807","nonce":2869602045}]},"public_addr":"172.21.15.76:6803/2869602045","cluster_addr":"172.21.15.76:6805/2869602045","heartbeat_back_addr":"172.21.15.76:6809/2869602045","heartbeat_front_addr":"172.21.15.76:6807/2869602045","state":["exists","up"]},{"osd":1,"uuid":"ace46e13-3bb7-4103-973a-6860554df8b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":2353738098},{"type":"v1","addr":"172.21.15.119:6801","nonce":2353738098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":2353738098},{"type":"v1","addr":"172.21.15.119:6803","nonce":2353738098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":2353738098},{"type":"v1","addr":"172.21.15.119:6807","nonce":2353738098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":2353738098},{"type":"v1","addr":"172.21.15.119:6805","nonce":2353738098}]},"public_addr":"172.21.15.119:6801/2353738098","cluster_addr":"172.21.15.119:6803/2353738098","heartbeat_back_addr":"172.21.15.119:6807/2353738098","heartbeat_front_addr":"172.21.15.119:6805/2353738098","state":["exists","up"]},{"osd":2,"uuid":"4addc09e-77a9-428a-bcc4-38194f486cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":3206918546},{"type":"v1","addr":"172.21.15.192:6801","nonce":3206918546}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":3206918546},{"type":"v1","addr":"172.21.15.192:6803","nonce":3206918546}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":3206918546},{"type":"v1","addr":"172.21.15.192:6807","nonce":3206918546}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":3206918546},{"type":"v1","addr":"172.21.15.192:6805","nonce":3206918546}]},"public_addr":"172.21.15.192:6801/3206918546","cluster_addr":"172.21.15.192:6803/3206918546","heartbeat_back_addr":"172.21.15.192:6807/3206918546","heartbeat_front_addr":"172.21.15.192:6805/3206918546","state":["exists","up"]},{"osd":3,"uuid":"dc525518-82c6-49ed-8ca8-e3bd5bfc18d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6810","nonce":3747864233},{"type":"v1","addr":"172.21.15.76:6811","nonce":3747864233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6812","nonce":3747864233},{"type":"v1","addr":"172.21.15.76:6813","nonce":3747864233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6816","nonce":3747864233},{"type":"v1","addr":"172.21.15.76:6817","nonce":3747864233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6814","nonce":3747864233},{"type":"v1","addr":"172.21.15.76:6815","nonce":3747864233}]},"public_addr":"172.21.15.76:6811/3747864233","cluster_addr":"172.21.15.76:6813/3747864233","heartbeat_back_addr":"172.21.15.76:6817/3747864233","heartbeat_front_addr":"172.21.15.76:6815/3747864233","state":["exists","up"]},{"osd":4,"uuid":"eef293d0-cb87-47b3-9751-c6437a1cf079","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":2571629047},{"type":"v1","addr":"172.21.15.119:6809","nonce":2571629047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":2571629047},{"type":"v1","addr":"172.21.15.119:6811","nonce":2571629047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":2571629047},{"type":"v1","addr":"172.21.15.119:6815","nonce":2571629047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":2571629047},{"type":"v1","addr":"172.21.15.119:6813","nonce":2571629047}]},"public_addr":"172.21.15.119:6809/2571629047","cluster_addr":"172.21.15.119:6811/2571629047","heartbeat_back_addr":"172.21.15.119:6815/2571629047","heartbeat_front_addr":"172.21.15.119:6813/2571629047","state":["exists","up"]},{"osd":5,"uuid":"60eb8c6e-766c-49d0-9997-44f85776b3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3285065416},{"type":"v1","addr":"172.21.15.192:6809","nonce":3285065416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":3285065416},{"type":"v1","addr":"172.21.15.192:6811","nonce":3285065416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3285065416},{"type":"v1","addr":"172.21.15.192:6815","nonce":3285065416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":3285065416},{"type":"v1","addr":"172.21.15.192:6813","nonce":3285065416}]},"public_addr":"172.21.15.192:6809/3285065416","cluster_addr":"172.21.15.192:6811/3285065416","heartbeat_back_addr":"172.21.15.192:6815/3285065416","heartbeat_front_addr":"172.21.15.192:6813/3285065416","state":["exists","up"]},{"osd":6,"uuid":"e6dc8b9d-dd06-4870-a506-def8201b7e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6818","nonce":2951381580},{"type":"v1","addr":"172.21.15.76:6819","nonce":2951381580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6820","nonce":2951381580},{"type":"v1","addr":"172.21.15.76:6821","nonce":2951381580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6824","nonce":2951381580},{"type":"v1","addr":"172.21.15.76:6825","nonce":2951381580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6822","nonce":2951381580},{"type":"v1","addr":"172.21.15.76:6823","nonce":2951381580}]},"public_addr":"172.21.15.76:6819/2951381580","cluster_addr":"172.21.15.76:6821/2951381580","heartbeat_back_addr":"172.21.15.76:6825/2951381580","heartbeat_front_addr":"172.21.15.76:6823/2951381580","state":["exists","up"]},{"osd":7,"uuid":"2f5dccb3-39a1-4f25-8715-fa264d59db97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1802558756},{"type":"v1","addr":"172.21.15.119:6817","nonce":1802558756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1802558756},{"type":"v1","addr":"172.21.15.119:6819","nonce":1802558756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1802558756},{"type":"v1","addr":"172.21.15.119:6823","nonce":1802558756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1802558756},{"type":"v1","addr":"172.21.15.119:6821","nonce":1802558756}]},"public_addr":"172.21.15.119:6817/1802558756","cluster_addr":"172.21.15.119:6819/1802558756","heartbeat_back_addr":"172.21.15.119:6823/1802558756","heartbeat_front_addr":"172.21.15.119:6821/1802558756","state":["exists","up"]},{"osd":8,"uuid":"39b6ccd0-16e7-4cd5-87e0-d827e9172984","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":1214972276},{"type":"v1","addr":"172.21.15.192:6817","nonce":1214972276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":1214972276},{"type":"v1","addr":"172.21.15.192:6819","nonce":1214972276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":1214972276},{"type":"v1","addr":"172.21.15.192:6823","nonce":1214972276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":1214972276},{"type":"v1","addr":"172.21.15.192:6821","nonce":1214972276}]},"public_addr":"172.21.15.192:6817/1214972276","cluster_addr":"172.21.15.192:6819/1214972276","heartbeat_back_addr":"172.21.15.192:6823/1214972276","heartbeat_front_addr":"172.21.15.192:6821/1214972276","state":["exists","up"]},{"osd":9,"uuid":"851b2155-07bd-45de-bfe0-53021fda733f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6826","nonce":3095501821},{"type":"v1","addr":"172.21.15.76:6827","nonce":3095501821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6828","nonce":3095501821},{"type":"v1","addr":"172.21.15.76:6829","nonce":3095501821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":3095501821},{"type":"v1","addr":"172.21.15.76:6833","nonce":3095501821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6830","nonce":3095501821},{"type":"v1","addr":"172.21.15.76:6831","nonce":3095501821}]},"public_addr":"172.21.15.76:6827/3095501821","cluster_addr":"172.21.15.76:6829/3095501821","heartbeat_back_addr":"172.21.15.76:6833/3095501821","heartbeat_front_addr":"172.21.15.76:6831/3095501821","state":["exists","up"]},{"osd":10,"uuid":"e4b18e7e-bddf-4dd4-84f6-7902ea327cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":4082130894},{"type":"v1","addr":"172.21.15.119:6825","nonce":4082130894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":4082130894},{"type":"v1","addr":"172.21.15.119:6827","nonce":4082130894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":4082130894},{"type":"v1","addr":"172.21.15.119:6831","nonce":4082130894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":4082130894},{"type":"v1","addr":"172.21.15.119:6829","nonce":4082130894}]},"public_addr":"172.21.15.119:6825/4082130894","cluster_addr":"172.21.15.119:6827/4082130894","heartbeat_back_addr":"172.21.15.119:6831/4082130894","heartbeat_front_addr":"172.21.15.119:6829/4082130894","state":["exists","up"]},{"osd":11,"uuid":"54567e18-920c-4ae9-9557-0efba5a1a820","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":439693921},{"type":"v1","addr":"172.21.15.192:6825","nonce":439693921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":439693921},{"type":"v1","addr":"172.21.15.192:6827","nonce":439693921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":439693921},{"type":"v1","addr":"172.21.15.192:6831","nonce":439693921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":439693921},{"type":"v1","addr":"172.21.15.192:6829","nonce":439693921}]},"public_addr":"172.21.15.192:6825/439693921","cluster_addr":"172.21.15.192:6827/439693921","heartbeat_back_addr":"172.21.15.192:6831/439693921","heartbeat_front_addr":"172.21.15.192:6829/439693921","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:44:19.922390+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:44:36.895563+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:44:53.699019+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:45:11.167404+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:45:27.955899+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:45:44.850368+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:46:02.003588+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:46:19.019217+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:46:36.189670+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:46:53.919365+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:47:11.563053+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:47:28.822443+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":4}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.8","mappings":[{"from":5,"to":10}]},{"pgid":"4.14","mappings":[{"from":9,"to":8}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.76:6801/4200406736":"2024-06-03T04:43:06.092916+0000","172.21.15.76:6800/4200406736":"2024-06-03T04:43:06.092916+0000","172.21.15.76:0/1524144593":"2024-06-03T04:43:06.092916+0000","172.21.15.76:0/3269372590":"2024-06-03T04:43:06.092916+0000","172.21.15.76:0/3570893846":"2024-06-03T04:42:44.872236+0000","172.21.15.76:0/902035790":"2024-06-03T04:43:06.092916+0000","172.21.15.76:6800/2550846765":"2024-06-03T04:42:44.872236+0000","172.21.15.76:6801/2550846765":"2024-06-03T04:42:44.872236+0000","172.21.15.76:0/2646712763":"2024-06-03T04:42:44.872236+0000","172.21.15.76:0/964578813":"2024-06-03T04:42:44.872236+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T04:49:27.850 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:27.849+0000 7fd6c4769700 1 -- 172.21.15.76:0/1596951377 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fd6a80a1230 msgr2=0x7fd6a80a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:27.850 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:27.849+0000 7fd6c4769700 1 --2- 172.21.15.76:0/1596951377 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fd6a80a1230 0x7fd6a80a36f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fd6b8005fd0 tx=0x7fd6b8005e20 comp rx=0 tx=0).stop 2024-06-02T04:49:27.850 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:27.849+0000 7fd6c4769700 1 -- 172.21.15.76:0/1596951377 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd6bc102990 msgr2=0x7fd6bc0738d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:27.850 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:27.849+0000 7fd6c4769700 1 --2- 172.21.15.76:0/1596951377 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd6bc102990 0x7fd6bc0738d0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fd6b4004d10 tx=0x7fd6b4004df0 comp rx=0 tx=0).stop 2024-06-02T04:49:27.850 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:27.849+0000 7fd6c4769700 1 -- 172.21.15.76:0/1596951377 shutdown_connections 2024-06-02T04:49:27.850 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:27.849+0000 7fd6c4769700 1 --2- 172.21.15.76:0/1596951377 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd6bc102990 0x7fd6bc0738d0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:27.850 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:27.849+0000 7fd6c4769700 1 --2- 172.21.15.76:0/1596951377 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fd6a80a1230 0x7fd6a80a36f0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:27.850 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:27.849+0000 7fd6c4769700 1 --2- 172.21.15.76:0/1596951377 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd6bc100e80 0x7fd6bc074d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:27.850 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:27.849+0000 7fd6c4769700 1 --2- 172.21.15.76:0/1596951377 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd6bc101fd0 0x7fd6bc073390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:27.851 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:27.849+0000 7fd6c4769700 1 -- 172.21.15.76:0/1596951377 >> 172.21.15.76:0/1596951377 conn(0x7fd6bc0fc410 msgr2=0x7fd6bc105300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:27.851 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:27.849+0000 7fd6c4769700 1 -- 172.21.15.76:0/1596951377 shutdown_connections 2024-06-02T04:49:27.851 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:27.849+0000 7fd6c4769700 1 -- 172.21.15.76:0/1596951377 wait complete. 2024-06-02T04:49:27.862 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-06-02T04:44:56.408602+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-06-02T04:48:01.194954+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-06-02T04:48:01.828863+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '76', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-06-02T04:48:04.916565+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-06-02T04:49:27.863 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-06-02T04:49:27.992 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:27.990+0000 7f9e8fa2f700 1 -- 172.21.15.76:0/3474013865 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9e88100060 msgr2=0x7f9e881004e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:27.992 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:27.990+0000 7f9e8fa2f700 1 --2- 172.21.15.76:0/3474013865 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9e88100060 0x7f9e881004e0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f9e84009990 tx=0x7f9e84009ca0 comp rx=0 tx=0).stop 2024-06-02T04:49:27.992 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:27.990+0000 7f9e8fa2f700 1 -- 172.21.15.76:0/3474013865 shutdown_connections 2024-06-02T04:49:27.992 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:27.990+0000 7f9e8fa2f700 1 --2- 172.21.15.76:0/3474013865 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9e88100a20 0x7f9e881082c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:27.993 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:27.990+0000 7f9e8fa2f700 1 --2- 172.21.15.76:0/3474013865 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e88101410 0x7f9e88101830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:27.993 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:27.990+0000 7f9e8fa2f700 1 --2- 172.21.15.76:0/3474013865 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9e88100060 0x7f9e881004e0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:27.993 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:27.990+0000 7f9e8fa2f700 1 -- 172.21.15.76:0/3474013865 >> 172.21.15.76:0/3474013865 conn(0x7f9e880fab50 msgr2=0x7f9e880fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:27.993 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:27.990+0000 7f9e8fa2f700 1 -- 172.21.15.76:0/3474013865 shutdown_connections 2024-06-02T04:49:27.993 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:27.990+0000 7f9e8fa2f700 1 -- 172.21.15.76:0/3474013865 wait complete. 2024-06-02T04:49:27.993 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:27.990+0000 7f9e8fa2f700 1 Processor -- start 2024-06-02T04:49:27.993 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:27.990+0000 7f9e8fa2f700 1 -- start start 2024-06-02T04:49:27.993 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:27.991+0000 7f9e8fa2f700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9e88100060 0x7f9e880ffa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:27.993 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:27.991+0000 7f9e8fa2f700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e88100a20 0x7f9e8819bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:27.993 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:27.991+0000 7f9e8fa2f700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9e88101410 0x7f9e8819e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:27.993 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:27.991+0000 7f9e8fa2f700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e8819e890 con 0x7f9e88100060 2024-06-02T04:49:27.993 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:27.991+0000 7f9e8fa2f700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e8819ea00 con 0x7f9e88101410 2024-06-02T04:49:27.994 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:27.991+0000 7f9e8fa2f700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e8819ebc0 con 0x7f9e88100a20 2024-06-02T04:49:27.994 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:27.991+0000 7f9e8d7cb700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9e88100060 0x7f9e880ffa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:27.994 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:27.991+0000 7f9e8d7cb700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9e88100060 0x7f9e880ffa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:43088/0 (socket says 172.21.15.76:43088) 2024-06-02T04:49:27.994 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:27.991+0000 7f9e8d7cb700 1 -- 172.21.15.76:0/3709097210 learned_addr learned my addr 172.21.15.76:0/3709097210 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:49:27.994 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:27.991+0000 7f9e8cfca700 1 --2- 172.21.15.76:0/3709097210 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e88100a20 0x7f9e8819bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:27.994 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:27.991+0000 7f9e8dfcc700 1 --2- 172.21.15.76:0/3709097210 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9e88101410 0x7f9e8819e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:27.994 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:27.991+0000 7f9e8d7cb700 1 -- 172.21.15.76:0/3709097210 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e88100a20 msgr2=0x7f9e8819bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:27.994 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:27.991+0000 7f9e8d7cb700 1 --2- 172.21.15.76:0/3709097210 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e88100a20 0x7f9e8819bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:27.994 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:27.991+0000 7f9e8d7cb700 1 -- 172.21.15.76:0/3709097210 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9e88101410 msgr2=0x7f9e8819e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:27.994 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:27.991+0000 7f9e8d7cb700 1 --2- 172.21.15.76:0/3709097210 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9e88101410 0x7f9e8819e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:27.994 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:27.991+0000 7f9e8d7cb700 1 -- 172.21.15.76:0/3709097210 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e840095f0 con 0x7f9e88100060 2024-06-02T04:49:27.994 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:27.991+0000 7f9e8cfca700 1 --2- 172.21.15.76:0/3709097210 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e88100a20 0x7f9e8819bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:49:27.995 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:27.991+0000 7f9e8d7cb700 1 --2- 172.21.15.76:0/3709097210 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9e88100060 0x7f9e880ffa70 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f9e7800c920 tx=0x7f9e7800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:27.995 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:27.991+0000 7f9e7e7fc700 1 -- 172.21.15.76:0/3709097210 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e78007b00 con 0x7f9e88100060 2024-06-02T04:49:27.995 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:27.991+0000 7f9e7e7fc700 1 -- 172.21.15.76:0/3709097210 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9e7800ce70 con 0x7f9e88100060 2024-06-02T04:49:27.995 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:27.991+0000 7f9e8fa2f700 1 -- 172.21.15.76:0/3709097210 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e8819eea0 con 0x7f9e88100060 2024-06-02T04:49:27.995 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:27.991+0000 7f9e7e7fc700 1 -- 172.21.15.76:0/3709097210 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e78005440 con 0x7f9e88100060 2024-06-02T04:49:27.995 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:27.991+0000 7f9e8fa2f700 1 -- 172.21.15.76:0/3709097210 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e8819f2d0 con 0x7f9e88100060 2024-06-02T04:49:27.996 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:27.992+0000 7f9e8fa2f700 1 -- 172.21.15.76:0/3709097210 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e88107350 con 0x7f9e88100060 2024-06-02T04:49:27.996 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:27.994+0000 7f9e7e7fc700 1 -- 172.21.15.76:0/3709097210 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f9e780055a0 con 0x7f9e88100060 2024-06-02T04:49:27.996 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:27.995+0000 7f9e7e7fc700 1 --2- 172.21.15.76:0/3709097210 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f9e740a1230 0x7f9e740a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:27.996 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:27.995+0000 7f9e8cfca700 1 --2- 172.21.15.76:0/3709097210 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f9e740a1230 0x7f9e740a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:27.996 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:27.995+0000 7f9e7e7fc700 1 -- 172.21.15.76:0/3709097210 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f9e780ccca0 con 0x7f9e88100060 2024-06-02T04:49:27.996 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:27.995+0000 7f9e8cfca700 1 --2- 172.21.15.76:0/3709097210 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f9e740a1230 0x7f9e740a36f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f9e8400b5c0 tx=0x7f9e84005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:27.998 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:27.998+0000 7f9e7e7fc700 1 -- 172.21.15.76:0/3709097210 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f9e78096040 con 0x7f9e88100060 2024-06-02T04:49:28.193 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.192+0000 7f9e8fa2f700 1 -- 172.21.15.76:0/3709097210 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9e8810b7b0 con 0x7f9e88100060 2024-06-02T04:49:28.193 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.193+0000 7f9e7e7fc700 1 -- 172.21.15.76:0/3709097210 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9e7801d070 con 0x7f9e88100060 2024-06-02T04:49:28.193 INFO:teuthology.orchestra.run.smithi076.stdout:pg_num: 1 2024-06-02T04:49:28.195 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.195+0000 7f9e8fa2f700 1 -- 172.21.15.76:0/3709097210 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f9e740a1230 msgr2=0x7f9e740a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:28.195 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.195+0000 7f9e8fa2f700 1 --2- 172.21.15.76:0/3709097210 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f9e740a1230 0x7f9e740a36f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f9e8400b5c0 tx=0x7f9e84005fb0 comp rx=0 tx=0).stop 2024-06-02T04:49:28.195 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.195+0000 7f9e8fa2f700 1 -- 172.21.15.76:0/3709097210 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9e88100060 msgr2=0x7f9e880ffa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:28.195 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.195+0000 7f9e8fa2f700 1 --2- 172.21.15.76:0/3709097210 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9e88100060 0x7f9e880ffa70 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f9e7800c920 tx=0x7f9e7800cc30 comp rx=0 tx=0).stop 2024-06-02T04:49:28.196 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.195+0000 7f9e8fa2f700 1 -- 172.21.15.76:0/3709097210 shutdown_connections 2024-06-02T04:49:28.196 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.195+0000 7f9e8fa2f700 1 --2- 172.21.15.76:0/3709097210 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f9e740a1230 0x7f9e740a36f0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:28.196 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.195+0000 7f9e8fa2f700 1 --2- 172.21.15.76:0/3709097210 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9e88101410 0x7f9e8819e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:28.196 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.195+0000 7f9e8fa2f700 1 --2- 172.21.15.76:0/3709097210 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9e88100060 0x7f9e880ffa70 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:28.196 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.195+0000 7f9e8fa2f700 1 --2- 172.21.15.76:0/3709097210 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e88100a20 0x7f9e8819bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:28.196 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.195+0000 7f9e8fa2f700 1 -- 172.21.15.76:0/3709097210 >> 172.21.15.76:0/3709097210 conn(0x7f9e880fab50 msgr2=0x7f9e88104490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:28.196 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.195+0000 7f9e8fa2f700 1 -- 172.21.15.76:0/3709097210 shutdown_connections 2024-06-02T04:49:28.196 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.195+0000 7f9e8fa2f700 1 -- 172.21.15.76:0/3709097210 wait complete. 2024-06-02T04:49:28.208 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-06-02T04:49:28.338 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.335+0000 7fbf83357700 1 -- 172.21.15.76:0/36245271 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbf7c106c40 msgr2=0x7fbf7c1090b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:28.338 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.335+0000 7fbf83357700 1 --2- 172.21.15.76:0/36245271 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbf7c106c40 0x7fbf7c1090b0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fbf7400b0a0 tx=0x7fbf7400b3b0 comp rx=0 tx=0).stop 2024-06-02T04:49:28.338 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.335+0000 7fbf83357700 1 -- 172.21.15.76:0/36245271 shutdown_connections 2024-06-02T04:49:28.338 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.335+0000 7fbf83357700 1 --2- 172.21.15.76:0/36245271 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbf7c106c40 0x7fbf7c1090b0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:28.338 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.335+0000 7fbf83357700 1 --2- 172.21.15.76:0/36245271 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf7c1019e0 0x7fbf7c103dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:28.338 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.335+0000 7fbf83357700 1 --2- 172.21.15.76:0/36245271 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbf7c104310 0x7fbf7c106700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:28.338 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.335+0000 7fbf83357700 1 -- 172.21.15.76:0/36245271 >> 172.21.15.76:0/36245271 conn(0x7fbf7c0fb3f0 msgr2=0x7fbf7c0fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:28.338 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.335+0000 7fbf83357700 1 -- 172.21.15.76:0/36245271 shutdown_connections 2024-06-02T04:49:28.339 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.335+0000 7fbf83357700 1 -- 172.21.15.76:0/36245271 wait complete. 2024-06-02T04:49:28.339 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.336+0000 7fbf83357700 1 Processor -- start 2024-06-02T04:49:28.339 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.336+0000 7fbf83357700 1 -- start start 2024-06-02T04:49:28.339 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.336+0000 7fbf83357700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbf7c1019e0 0x7fbf7c196e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:28.339 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.336+0000 7fbf83357700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf7c104310 0x7fbf7c1973c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:28.339 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.336+0000 7fbf83357700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbf7c106c40 0x7fbf7c19e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:28.339 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.336+0000 7fbf83357700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf7c19e9b0 con 0x7fbf7c1019e0 2024-06-02T04:49:28.339 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.336+0000 7fbf83357700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf7c19eaf0 con 0x7fbf7c104310 2024-06-02T04:49:28.339 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.336+0000 7fbf83357700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf7c19ec80 con 0x7fbf7c106c40 2024-06-02T04:49:28.339 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.336+0000 7fbf810f3700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbf7c1019e0 0x7fbf7c196e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:28.339 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.336+0000 7fbf810f3700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbf7c1019e0 0x7fbf7c196e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:43102/0 (socket says 172.21.15.76:43102) 2024-06-02T04:49:28.339 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.336+0000 7fbf810f3700 1 -- 172.21.15.76:0/1919796015 learned_addr learned my addr 172.21.15.76:0/1919796015 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:49:28.340 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.336+0000 7fbf818f4700 1 --2- 172.21.15.76:0/1919796015 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbf7c106c40 0x7fbf7c19e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:28.340 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.337+0000 7fbf810f3700 1 -- 172.21.15.76:0/1919796015 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbf7c106c40 msgr2=0x7fbf7c19e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:28.340 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.337+0000 7fbf810f3700 1 --2- 172.21.15.76:0/1919796015 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbf7c106c40 0x7fbf7c19e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:28.340 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.337+0000 7fbf810f3700 1 -- 172.21.15.76:0/1919796015 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf7c104310 msgr2=0x7fbf7c1973c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:28.340 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.337+0000 7fbf808f2700 1 --2- 172.21.15.76:0/1919796015 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf7c104310 0x7fbf7c1973c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:28.340 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.337+0000 7fbf810f3700 1 --2- 172.21.15.76:0/1919796015 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf7c104310 0x7fbf7c1973c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:28.340 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.337+0000 7fbf810f3700 1 -- 172.21.15.76:0/1919796015 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf74009d00 con 0x7fbf7c1019e0 2024-06-02T04:49:28.340 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.337+0000 7fbf808f2700 1 --2- 172.21.15.76:0/1919796015 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf7c104310 0x7fbf7c1973c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:49:28.340 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.337+0000 7fbf810f3700 1 --2- 172.21.15.76:0/1919796015 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbf7c1019e0 0x7fbf7c196e80 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fbf7800c9b0 tx=0x7fbf7800ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:28.340 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.337+0000 7fbf727fc700 1 -- 172.21.15.76:0/1919796015 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf78007b00 con 0x7fbf7c1019e0 2024-06-02T04:49:28.340 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.337+0000 7fbf727fc700 1 -- 172.21.15.76:0/1919796015 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbf78007c60 con 0x7fbf7c1019e0 2024-06-02T04:49:28.340 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.337+0000 7fbf83357700 1 -- 172.21.15.76:0/1919796015 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf7c19ef60 con 0x7fbf7c1019e0 2024-06-02T04:49:28.340 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.337+0000 7fbf727fc700 1 -- 172.21.15.76:0/1919796015 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf78018660 con 0x7fbf7c1019e0 2024-06-02T04:49:28.341 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.337+0000 7fbf83357700 1 -- 172.21.15.76:0/1919796015 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf7c19f390 con 0x7fbf7c1019e0 2024-06-02T04:49:28.341 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.338+0000 7fbf83357700 1 -- 172.21.15.76:0/1919796015 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf7c0fcf70 con 0x7fbf7c1019e0 2024-06-02T04:49:28.342 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.339+0000 7fbf727fc700 1 -- 172.21.15.76:0/1919796015 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fbf7800f450 con 0x7fbf7c1019e0 2024-06-02T04:49:28.342 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.339+0000 7fbf727fc700 1 --2- 172.21.15.76:0/1919796015 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fbf680a1230 0x7fbf680a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:28.342 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.340+0000 7fbf808f2700 1 --2- 172.21.15.76:0/1919796015 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fbf680a1230 0x7fbf680a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:28.342 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.340+0000 7fbf727fc700 1 -- 172.21.15.76:0/1919796015 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fbf780cccd0 con 0x7fbf7c1019e0 2024-06-02T04:49:28.342 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.340+0000 7fbf808f2700 1 --2- 172.21.15.76:0/1919796015 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fbf680a1230 0x7fbf680a36f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fbf6c005fd0 tx=0x7fbf6c005ee0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:28.344 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.344+0000 7fbf727fc700 1 -- 172.21.15.76:0/1919796015 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fbf78095ff0 con 0x7fbf7c1019e0 2024-06-02T04:49:28.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:28 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/1596951377' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:49:28.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:28 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/3709097210' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-02T04:49:28.543 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.543+0000 7fbf83357700 1 -- 172.21.15.76:0/1919796015 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbf7c10c640 con 0x7fbf7c1019e0 2024-06-02T04:49:28.543 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.543+0000 7fbf727fc700 1 -- 172.21.15.76:0/1919796015 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v82) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbf7800fe60 con 0x7fbf7c1019e0 2024-06-02T04:49:28.544 INFO:teuthology.orchestra.run.smithi076.stdout:pg_num: 32 2024-06-02T04:49:28.546 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.545+0000 7fbf83357700 1 -- 172.21.15.76:0/1919796015 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fbf680a1230 msgr2=0x7fbf680a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:28.546 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.545+0000 7fbf83357700 1 --2- 172.21.15.76:0/1919796015 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fbf680a1230 0x7fbf680a36f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fbf6c005fd0 tx=0x7fbf6c005ee0 comp rx=0 tx=0).stop 2024-06-02T04:49:28.546 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.545+0000 7fbf83357700 1 -- 172.21.15.76:0/1919796015 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbf7c1019e0 msgr2=0x7fbf7c196e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:28.546 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.545+0000 7fbf83357700 1 --2- 172.21.15.76:0/1919796015 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbf7c1019e0 0x7fbf7c196e80 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fbf7800c9b0 tx=0x7fbf7800ccc0 comp rx=0 tx=0).stop 2024-06-02T04:49:28.546 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.545+0000 7fbf83357700 1 -- 172.21.15.76:0/1919796015 shutdown_connections 2024-06-02T04:49:28.546 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.545+0000 7fbf83357700 1 --2- 172.21.15.76:0/1919796015 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbf7c106c40 0x7fbf7c19e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:28.546 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.545+0000 7fbf83357700 1 --2- 172.21.15.76:0/1919796015 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbf7c1019e0 0x7fbf7c196e80 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:28.546 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.545+0000 7fbf83357700 1 --2- 172.21.15.76:0/1919796015 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fbf680a1230 0x7fbf680a36f0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:28.546 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.545+0000 7fbf83357700 1 --2- 172.21.15.76:0/1919796015 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf7c104310 0x7fbf7c1973c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:28.546 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.545+0000 7fbf83357700 1 -- 172.21.15.76:0/1919796015 >> 172.21.15.76:0/1919796015 conn(0x7fbf7c0fb3f0 msgr2=0x7fbf7c102320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:28.547 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.545+0000 7fbf83357700 1 -- 172.21.15.76:0/1919796015 shutdown_connections 2024-06-02T04:49:28.547 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.545+0000 7fbf83357700 1 -- 172.21.15.76:0/1919796015 wait complete. 2024-06-02T04:49:28.558 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-06-02T04:49:28.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:28 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/1596951377' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:49:28.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:28 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/3709097210' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-02T04:49:28.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:28 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/1596951377' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:49:28.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:28 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/3709097210' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-02T04:49:28.683 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.682+0000 7f28611fc700 1 -- 172.21.15.76:0/1926139671 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f285c101a00 msgr2=0x7f285c103df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:28.683 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.682+0000 7f28611fc700 1 --2- 172.21.15.76:0/1926139671 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f285c101a00 0x7f285c103df0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f2844009990 tx=0x7f2844009ca0 comp rx=0 tx=0).stop 2024-06-02T04:49:28.683 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.682+0000 7f28611fc700 1 -- 172.21.15.76:0/1926139671 shutdown_connections 2024-06-02T04:49:28.684 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.682+0000 7f28611fc700 1 --2- 172.21.15.76:0/1926139671 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f285c106c60 0x7f285c1090d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:28.684 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.682+0000 7f28611fc700 1 --2- 172.21.15.76:0/1926139671 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f285c101a00 0x7f285c103df0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:28.684 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.682+0000 7f28611fc700 1 --2- 172.21.15.76:0/1926139671 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f285c104330 0x7f285c106720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:28.684 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.682+0000 7f28611fc700 1 -- 172.21.15.76:0/1926139671 >> 172.21.15.76:0/1926139671 conn(0x7f285c0fb3f0 msgr2=0x7f285c0fd830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:28.684 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.682+0000 7f28611fc700 1 -- 172.21.15.76:0/1926139671 shutdown_connections 2024-06-02T04:49:28.684 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.683+0000 7f28611fc700 1 -- 172.21.15.76:0/1926139671 wait complete. 2024-06-02T04:49:28.686 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.683+0000 7f28611fc700 1 Processor -- start 2024-06-02T04:49:28.686 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.684+0000 7f28611fc700 1 -- start start 2024-06-02T04:49:28.686 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.684+0000 7f28611fc700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f285c101a00 0x7f285c196e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:28.686 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.684+0000 7f28611fc700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f285c104330 0x7f285c197340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:28.686 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.684+0000 7f28611fc700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f285c106c60 0x7f285c19e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:28.686 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.684+0000 7f28611fc700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f285c19e8f0 con 0x7f285c106c60 2024-06-02T04:49:28.686 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.684+0000 7f28611fc700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f285c19ea60 con 0x7f285c104330 2024-06-02T04:49:28.687 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.684+0000 7f28611fc700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f285c19ec20 con 0x7f285c101a00 2024-06-02T04:49:28.687 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.684+0000 7f285b59e700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f285c106c60 0x7f285c19e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:28.687 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.684+0000 7f285b59e700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f285c106c60 0x7f285c19e320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:43122/0 (socket says 172.21.15.76:43122) 2024-06-02T04:49:28.687 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.684+0000 7f285ad9d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f285c101a00 0x7f285c196e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:28.687 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.684+0000 7f285b59e700 1 -- 172.21.15.76:0/782780269 learned_addr learned my addr 172.21.15.76:0/782780269 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:49:28.687 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.684+0000 7f285a59c700 1 --2- 172.21.15.76:0/782780269 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f285c104330 0x7f285c197340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:28.687 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.684+0000 7f285b59e700 1 -- 172.21.15.76:0/782780269 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f285c101a00 msgr2=0x7f285c196e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:28.687 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.684+0000 7f285b59e700 1 --2- 172.21.15.76:0/782780269 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f285c101a00 0x7f285c196e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:28.687 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.684+0000 7f285b59e700 1 -- 172.21.15.76:0/782780269 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f285c104330 msgr2=0x7f285c197340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:28.687 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.684+0000 7f285b59e700 1 --2- 172.21.15.76:0/782780269 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f285c104330 0x7f285c197340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:28.687 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.684+0000 7f285b59e700 1 -- 172.21.15.76:0/782780269 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28440095f0 con 0x7f285c106c60 2024-06-02T04:49:28.687 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.684+0000 7f285b59e700 1 --2- 172.21.15.76:0/782780269 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f285c106c60 0x7f285c19e320 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f2854007ee0 tx=0x7f285400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:28.687 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.685+0000 7f2853fff700 1 -- 172.21.15.76:0/782780269 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f285400dd20 con 0x7f285c106c60 2024-06-02T04:49:28.688 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.685+0000 7f28611fc700 1 -- 172.21.15.76:0/782780269 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f285c19ef00 con 0x7f285c106c60 2024-06-02T04:49:28.688 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.685+0000 7f2853fff700 1 -- 172.21.15.76:0/782780269 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f285400f040 con 0x7f285c106c60 2024-06-02T04:49:28.688 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.685+0000 7f2853fff700 1 -- 172.21.15.76:0/782780269 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2854004750 con 0x7f285c106c60 2024-06-02T04:49:28.688 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.685+0000 7f28611fc700 1 -- 172.21.15.76:0/782780269 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f285c19f380 con 0x7f285c106c60 2024-06-02T04:49:28.688 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.686+0000 7f28611fc700 1 -- 172.21.15.76:0/782780269 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f285c0fcf70 con 0x7f285c106c60 2024-06-02T04:49:28.688 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.687+0000 7f2853fff700 1 -- 172.21.15.76:0/782780269 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f2854003a00 con 0x7f285c106c60 2024-06-02T04:49:28.689 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.687+0000 7f2853fff700 1 --2- 172.21.15.76:0/782780269 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f28480a11b0 0x7f28480a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:28.689 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.687+0000 7f2853fff700 1 -- 172.21.15.76:0/782780269 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f28540cce00 con 0x7f285c106c60 2024-06-02T04:49:28.689 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.687+0000 7f285ad9d700 1 --2- 172.21.15.76:0/782780269 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f28480a11b0 0x7f28480a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:28.689 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.688+0000 7f285ad9d700 1 --2- 172.21.15.76:0/782780269 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f28480a11b0 0x7f28480a3670 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f2844000c00 tx=0x7f2844005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:28.691 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.691+0000 7f2853fff700 1 -- 172.21.15.76:0/782780269 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f2854096120 con 0x7f285c106c60 2024-06-02T04:49:28.886 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.886+0000 7f28611fc700 1 -- 172.21.15.76:0/782780269 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f285c10c660 con 0x7f285c106c60 2024-06-02T04:49:28.887 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.886+0000 7f2853fff700 1 -- 172.21.15.76:0/782780269 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v82) v1 ==== 100+0+11 (secure 0 0 0) 0x7f28540230a0 con 0x7f285c106c60 2024-06-02T04:49:28.887 INFO:teuthology.orchestra.run.smithi076.stdout:pg_num: 64 2024-06-02T04:49:28.889 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.889+0000 7f28611fc700 1 -- 172.21.15.76:0/782780269 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f28480a11b0 msgr2=0x7f28480a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:28.889 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.889+0000 7f28611fc700 1 --2- 172.21.15.76:0/782780269 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f28480a11b0 0x7f28480a3670 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f2844000c00 tx=0x7f2844005fb0 comp rx=0 tx=0).stop 2024-06-02T04:49:28.889 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.889+0000 7f28611fc700 1 -- 172.21.15.76:0/782780269 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f285c106c60 msgr2=0x7f285c19e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:28.889 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.889+0000 7f28611fc700 1 --2- 172.21.15.76:0/782780269 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f285c106c60 0x7f285c19e320 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f2854007ee0 tx=0x7f285400d3b0 comp rx=0 tx=0).stop 2024-06-02T04:49:28.889 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.889+0000 7f28611fc700 1 -- 172.21.15.76:0/782780269 shutdown_connections 2024-06-02T04:49:28.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.889+0000 7f28611fc700 1 --2- 172.21.15.76:0/782780269 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f285c106c60 0x7f285c19e320 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:28.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.889+0000 7f28611fc700 1 --2- 172.21.15.76:0/782780269 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f285c101a00 0x7f285c196e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:28.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.889+0000 7f28611fc700 1 --2- 172.21.15.76:0/782780269 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f28480a11b0 0x7f28480a3670 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:28.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.889+0000 7f28611fc700 1 --2- 172.21.15.76:0/782780269 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f285c104330 0x7f285c197340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:28.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.889+0000 7f28611fc700 1 -- 172.21.15.76:0/782780269 >> 172.21.15.76:0/782780269 conn(0x7f285c0fb3f0 msgr2=0x7f285c102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:28.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.889+0000 7f28611fc700 1 -- 172.21.15.76:0/782780269 shutdown_connections 2024-06-02T04:49:28.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:28.889+0000 7f28611fc700 1 -- 172.21.15.76:0/782780269 wait complete. 2024-06-02T04:49:28.902 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-06-02T04:49:29.028 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.028+0000 7f701dc86700 1 -- 172.21.15.76:0/1820097532 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7018100fb0 msgr2=0x7f7018101430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:29.029 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.028+0000 7f701dc86700 1 --2- 172.21.15.76:0/1820097532 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7018100fb0 0x7f7018101430 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f7008009990 tx=0x7f7008009ca0 comp rx=0 tx=0).stop 2024-06-02T04:49:29.029 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.028+0000 7f701dc86700 1 -- 172.21.15.76:0/1820097532 shutdown_connections 2024-06-02T04:49:29.029 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.028+0000 7f701dc86700 1 --2- 172.21.15.76:0/1820097532 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7018101970 0x7f7018108290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:29.029 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.028+0000 7f701dc86700 1 --2- 172.21.15.76:0/1820097532 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f70180ffe60 0x7f7018100280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:29.029 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.028+0000 7f701dc86700 1 --2- 172.21.15.76:0/1820097532 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7018100fb0 0x7f7018101430 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:29.029 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.028+0000 7f701dc86700 1 -- 172.21.15.76:0/1820097532 >> 172.21.15.76:0/1820097532 conn(0x7f70180fb3f0 msgr2=0x7f70180fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:29.029 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.028+0000 7f701dc86700 1 -- 172.21.15.76:0/1820097532 shutdown_connections 2024-06-02T04:49:29.029 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.028+0000 7f701dc86700 1 -- 172.21.15.76:0/1820097532 wait complete. 2024-06-02T04:49:29.029 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.028+0000 7f701dc86700 1 Processor -- start 2024-06-02T04:49:29.029 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.028+0000 7f701dc86700 1 -- start start 2024-06-02T04:49:29.031 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.029+0000 7f701dc86700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f70180ffe60 0x7f7018068b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:29.031 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.029+0000 7f701dc86700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7018100fb0 0x7f701819bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:29.031 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.029+0000 7f701dc86700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7018101970 0x7f701819e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:29.031 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.029+0000 7f701dc86700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f701819e8a0 con 0x7f7018101970 2024-06-02T04:49:29.032 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.029+0000 7f701dc86700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f701819ea10 con 0x7f7018100fb0 2024-06-02T04:49:29.032 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.029+0000 7f701dc86700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f701819ebd0 con 0x7f70180ffe60 2024-06-02T04:49:29.032 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.029+0000 7f7017fff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7018101970 0x7f701819e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:29.032 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.029+0000 7f7017fff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7018101970 0x7f701819e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:43142/0 (socket says 172.21.15.76:43142) 2024-06-02T04:49:29.032 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.029+0000 7f7017fff700 1 -- 172.21.15.76:0/1153610130 learned_addr learned my addr 172.21.15.76:0/1153610130 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:49:29.032 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.029+0000 7f7016ffd700 1 --2- 172.21.15.76:0/1153610130 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7018100fb0 0x7f701819bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:29.032 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.029+0000 7f70177fe700 1 --2- 172.21.15.76:0/1153610130 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f70180ffe60 0x7f7018068b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:29.032 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.029+0000 7f7017fff700 1 -- 172.21.15.76:0/1153610130 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f70180ffe60 msgr2=0x7f7018068b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:29.032 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.029+0000 7f7017fff700 1 --2- 172.21.15.76:0/1153610130 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f70180ffe60 0x7f7018068b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:29.032 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.029+0000 7f7017fff700 1 -- 172.21.15.76:0/1153610130 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7018100fb0 msgr2=0x7f701819bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:29.032 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.029+0000 7f7017fff700 1 --2- 172.21.15.76:0/1153610130 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7018100fb0 0x7f701819bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:29.032 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.029+0000 7f7017fff700 1 -- 172.21.15.76:0/1153610130 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70080095f0 con 0x7f7018101970 2024-06-02T04:49:29.033 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.029+0000 7f7017fff700 1 --2- 172.21.15.76:0/1153610130 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7018101970 0x7f701819e100 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f701000ada0 tx=0x7f701000c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:29.033 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.029+0000 7f7014ff9700 1 -- 172.21.15.76:0/1153610130 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f701000f070 con 0x7f7018101970 2024-06-02T04:49:29.033 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.029+0000 7f7014ff9700 1 -- 172.21.15.76:0/1153610130 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7010007b30 con 0x7f7018101970 2024-06-02T04:49:29.033 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.029+0000 7f701dc86700 1 -- 172.21.15.76:0/1153610130 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f701819eeb0 con 0x7f7018101970 2024-06-02T04:49:29.033 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.029+0000 7f7014ff9700 1 -- 172.21.15.76:0/1153610130 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70100053e0 con 0x7f7018101970 2024-06-02T04:49:29.033 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.029+0000 7f701dc86700 1 -- 172.21.15.76:0/1153610130 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f701819f2e0 con 0x7f7018101970 2024-06-02T04:49:29.033 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.030+0000 7f701dc86700 1 -- 172.21.15.76:0/1153610130 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7018107320 con 0x7f7018101970 2024-06-02T04:49:29.034 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.031+0000 7f7014ff9700 1 -- 172.21.15.76:0/1153610130 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f701000c980 con 0x7f7018101970 2024-06-02T04:49:29.034 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.032+0000 7f7014ff9700 1 --2- 172.21.15.76:0/1153610130 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f70000a11b0 0x7f70000a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:29.034 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.032+0000 7f7014ff9700 1 -- 172.21.15.76:0/1153610130 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f70100cca90 con 0x7f7018101970 2024-06-02T04:49:29.034 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.032+0000 7f70177fe700 1 --2- 172.21.15.76:0/1153610130 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f70000a11b0 0x7f70000a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:29.034 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.033+0000 7f70177fe700 1 --2- 172.21.15.76:0/1153610130 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f70000a11b0 0x7f70000a3670 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f700c005fd0 tx=0x7f700c00a560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:29.036 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.036+0000 7f7014ff9700 1 -- 172.21.15.76:0/1153610130 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f7010095e40 con 0x7f7018101970 2024-06-02T04:49:29.235 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.235+0000 7f701dc86700 1 -- 172.21.15.76:0/1153610130 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f701810b510 con 0x7f7018101970 2024-06-02T04:49:29.236 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.236+0000 7f7014ff9700 1 -- 172.21.15.76:0/1153610130 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v82) v1 ==== 103+0+11 (secure 0 0 0) 0x7f701000cc30 con 0x7f7018101970 2024-06-02T04:49:29.236 INFO:teuthology.orchestra.run.smithi076.stdout:pg_num: 32 2024-06-02T04:49:29.238 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.238+0000 7f701dc86700 1 -- 172.21.15.76:0/1153610130 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f70000a11b0 msgr2=0x7f70000a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:29.238 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.238+0000 7f701dc86700 1 --2- 172.21.15.76:0/1153610130 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f70000a11b0 0x7f70000a3670 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f700c005fd0 tx=0x7f700c00a560 comp rx=0 tx=0).stop 2024-06-02T04:49:29.238 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.238+0000 7f701dc86700 1 -- 172.21.15.76:0/1153610130 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7018101970 msgr2=0x7f701819e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:29.238 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.238+0000 7f701dc86700 1 --2- 172.21.15.76:0/1153610130 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7018101970 0x7f701819e100 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f701000ada0 tx=0x7f701000c330 comp rx=0 tx=0).stop 2024-06-02T04:49:29.242 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.238+0000 7f701dc86700 1 -- 172.21.15.76:0/1153610130 shutdown_connections 2024-06-02T04:49:29.242 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.238+0000 7f701dc86700 1 --2- 172.21.15.76:0/1153610130 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7018101970 0x7f701819e100 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:29.242 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.238+0000 7f701dc86700 1 --2- 172.21.15.76:0/1153610130 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f70180ffe60 0x7f7018068b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:29.242 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.238+0000 7f701dc86700 1 --2- 172.21.15.76:0/1153610130 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f70000a11b0 0x7f70000a3670 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:29.242 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.238+0000 7f701dc86700 1 --2- 172.21.15.76:0/1153610130 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7018100fb0 0x7f701819bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:29.242 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.238+0000 7f701dc86700 1 -- 172.21.15.76:0/1153610130 >> 172.21.15.76:0/1153610130 conn(0x7f70180fb3f0 msgr2=0x7f7018104460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:29.242 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.238+0000 7f701dc86700 1 -- 172.21.15.76:0/1153610130 shutdown_connections 2024-06-02T04:49:29.242 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.238+0000 7f701dc86700 1 -- 172.21.15.76:0/1153610130 wait complete. 2024-06-02T04:49:29.251 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T04:49:29.376 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.373+0000 7f885a507700 1 -- 172.21.15.76:0/3320290473 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8854102ad0 msgr2=0x7f8854109380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:29.376 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.373+0000 7f885a507700 1 --2- 172.21.15.76:0/3320290473 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8854102ad0 0x7f8854109380 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f884c00b0a0 tx=0x7f884c00b3b0 comp rx=0 tx=0).stop 2024-06-02T04:49:29.376 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.373+0000 7f885a507700 1 -- 172.21.15.76:0/3320290473 shutdown_connections 2024-06-02T04:49:29.376 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.373+0000 7f885a507700 1 --2- 172.21.15.76:0/3320290473 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8854102ad0 0x7f8854109380 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:29.376 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.373+0000 7f885a507700 1 --2- 172.21.15.76:0/3320290473 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f88540ff160 0x7f88540ff580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:29.376 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.373+0000 7f885a507700 1 --2- 172.21.15.76:0/3320290473 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8854102130 0x7f8854102590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:29.376 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.373+0000 7f885a507700 1 -- 172.21.15.76:0/3320290473 >> 172.21.15.76:0/3320290473 conn(0x7f88540faab0 msgr2=0x7f88540fced0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:29.377 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.373+0000 7f885a507700 1 -- 172.21.15.76:0/3320290473 shutdown_connections 2024-06-02T04:49:29.377 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.373+0000 7f885a507700 1 -- 172.21.15.76:0/3320290473 wait complete. 2024-06-02T04:49:29.377 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.373+0000 7f885a507700 1 Processor -- start 2024-06-02T04:49:29.377 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.374+0000 7f885a507700 1 -- start start 2024-06-02T04:49:29.377 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.374+0000 7f885a507700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f88540ff160 0x7f8854101a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:29.377 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.374+0000 7f885a507700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8854102130 0x7f88541000e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:29.377 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.374+0000 7f885a507700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8854102ad0 0x7f8854100620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:29.377 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.374+0000 7f885a507700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8854100dc0 con 0x7f8854102130 2024-06-02T04:49:29.377 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.374+0000 7f885a507700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8854100f30 con 0x7f88540ff160 2024-06-02T04:49:29.377 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.374+0000 7f885a507700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88541a0ff0 con 0x7f8854102ad0 2024-06-02T04:49:29.377 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.374+0000 7f88537fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8854102130 0x7f88541000e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:29.377 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.374+0000 7f88537fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8854102130 0x7f88541000e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:43160/0 (socket says 172.21.15.76:43160) 2024-06-02T04:49:29.377 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.374+0000 7f88537fe700 1 -- 172.21.15.76:0/2379096042 learned_addr learned my addr 172.21.15.76:0/2379096042 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:49:29.378 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.374+0000 7f8858aa4700 1 --2- 172.21.15.76:0/2379096042 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8854102ad0 0x7f8854100620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:29.378 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.374+0000 7f8853fff700 1 --2- 172.21.15.76:0/2379096042 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f88540ff160 0x7f8854101a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:29.378 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.374+0000 7f88537fe700 1 -- 172.21.15.76:0/2379096042 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8854102ad0 msgr2=0x7f8854100620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:29.378 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.374+0000 7f88537fe700 1 --2- 172.21.15.76:0/2379096042 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8854102ad0 0x7f8854100620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:29.378 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.374+0000 7f88537fe700 1 -- 172.21.15.76:0/2379096042 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f88540ff160 msgr2=0x7f8854101a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:29.378 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.374+0000 7f88537fe700 1 --2- 172.21.15.76:0/2379096042 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f88540ff160 0x7f8854101a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:29.378 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.374+0000 7f88537fe700 1 -- 172.21.15.76:0/2379096042 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f884c009d00 con 0x7f8854102130 2024-06-02T04:49:29.378 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.374+0000 7f88537fe700 1 --2- 172.21.15.76:0/2379096042 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8854102130 0x7f88541000e0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f884800b530 tx=0x7f884800b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:29.378 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.375+0000 7f88517fa700 1 -- 172.21.15.76:0/2379096042 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8848011830 con 0x7f8854102130 2024-06-02T04:49:29.378 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.375+0000 7f88517fa700 1 -- 172.21.15.76:0/2379096042 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8848011e20 con 0x7f8854102130 2024-06-02T04:49:29.378 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.375+0000 7f885a507700 1 -- 172.21.15.76:0/2379096042 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88541a1280 con 0x7f8854102130 2024-06-02T04:49:29.378 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.375+0000 7f88517fa700 1 -- 172.21.15.76:0/2379096042 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8848010dd0 con 0x7f8854102130 2024-06-02T04:49:29.378 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.375+0000 7f885a507700 1 -- 172.21.15.76:0/2379096042 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88541a1860 con 0x7f8854102130 2024-06-02T04:49:29.379 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.376+0000 7f885a507700 1 -- 172.21.15.76:0/2379096042 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8854108410 con 0x7f8854102130 2024-06-02T04:49:29.380 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.377+0000 7f88517fa700 1 -- 172.21.15.76:0/2379096042 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f8848011990 con 0x7f8854102130 2024-06-02T04:49:29.380 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.377+0000 7f88517fa700 1 --2- 172.21.15.76:0/2379096042 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f883c0a1230 0x7f883c0a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:29.380 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.377+0000 7f8853fff700 1 --2- 172.21.15.76:0/2379096042 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f883c0a1230 0x7f883c0a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:29.380 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.377+0000 7f88517fa700 1 -- 172.21.15.76:0/2379096042 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f88480cc6b0 con 0x7f8854102130 2024-06-02T04:49:29.380 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.378+0000 7f8853fff700 1 --2- 172.21.15.76:0/2379096042 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f883c0a1230 0x7f883c0a36f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f8844006fd0 tx=0x7f8844008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:29.382 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.382+0000 7f88517fa700 1 -- 172.21.15.76:0/2379096042 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f8848095ae0 con 0x7f8854102130 2024-06-02T04:49:29.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:29 smithi119 ceph-mon[46633]: pgmap v263: 129 pgs: 129 active+clean; 639 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-02T04:49:29.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:29 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/1919796015' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-06-02T04:49:29.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:29 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/782780269' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-06-02T04:49:29.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:29 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/1153610130' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-06-02T04:49:29.624 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.623+0000 7f885a507700 1 -- 172.21.15.76:0/2379096042 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8854068060 con 0x7f8854102130 2024-06-02T04:49:29.624 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.624+0000 7f88517fa700 1 -- 172.21.15.76:0/2379096042 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+10874 (secure 0 0 0) 0x7f8848099100 con 0x7f8854102130 2024-06-02T04:49:29.624 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:49:29.625 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6835/3029342152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3029342152},{"type":"v1","addr":"172.21.15.76:6835","nonce":3029342152}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6837/1207985317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":1207985317},{"type":"v1","addr":"172.21.15.76:6837","nonce":1207985317}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14607,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6839/928709755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":928709755},{"type":"v1","addr":"172.21.15.76:6839","nonce":928709755}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6841/4162178633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6840","nonce":4162178633},{"type":"v1","addr":"172.21.15.76:6841","nonce":4162178633}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/1543944863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":1543944863},{"type":"v1","addr":"172.21.15.119:6833","nonce":1543944863}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24418,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6833/1527921393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1527921393},{"type":"v1","addr":"172.21.15.192:6833","nonce":1527921393}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-02T04:48:02.662812+0000","modified":"2024-06-02T04:48:28.274836+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24491,"mds_1":24475,"mds_2":24463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24434":{"gid":24434,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6835/2746840347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":2746840347},{"type":"v1","addr":"172.21.15.119:6835","nonce":2746840347}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24451":{"gid":24451,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.192:6835/783181340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":783181340},{"type":"v1","addr":"172.21.15.192:6835","nonce":783181340}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24458":{"gid":24458,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6837/2171687478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":2171687478},{"type":"v1","addr":"172.21.15.119:6837","nonce":2171687478}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24463":{"gid":24463,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":11,"addr":"172.21.15.192:6837/960773710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":960773710},{"type":"v1","addr":"172.21.15.192:6837","nonce":960773710}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24475":{"gid":24475,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.192:6839/3978681402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":3978681402},{"type":"v1","addr":"172.21.15.192:6839","nonce":3978681402}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.119:6839/4098406903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":4098406903},{"type":"v1","addr":"172.21.15.119:6839","nonce":4098406903}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-06-02T04:49:29.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.626+0000 7f885a507700 1 -- 172.21.15.76:0/2379096042 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f883c0a1230 msgr2=0x7f883c0a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:29.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.626+0000 7f885a507700 1 --2- 172.21.15.76:0/2379096042 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f883c0a1230 0x7f883c0a36f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f8844006fd0 tx=0x7f8844008040 comp rx=0 tx=0).stop 2024-06-02T04:49:29.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.627+0000 7f885a507700 1 -- 172.21.15.76:0/2379096042 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8854102130 msgr2=0x7f88541000e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:29.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.627+0000 7f885a507700 1 --2- 172.21.15.76:0/2379096042 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8854102130 0x7f88541000e0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f884800b530 tx=0x7f884800b840 comp rx=0 tx=0).stop 2024-06-02T04:49:29.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.627+0000 7f885a507700 1 -- 172.21.15.76:0/2379096042 shutdown_connections 2024-06-02T04:49:29.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.627+0000 7f885a507700 1 --2- 172.21.15.76:0/2379096042 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8854102ad0 0x7f8854100620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:29.628 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.627+0000 7f885a507700 1 --2- 172.21.15.76:0/2379096042 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f883c0a1230 0x7f883c0a36f0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:29.628 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.627+0000 7f885a507700 1 --2- 172.21.15.76:0/2379096042 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f88540ff160 0x7f8854101a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:29.628 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.627+0000 7f885a507700 1 --2- 172.21.15.76:0/2379096042 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8854102130 0x7f88541000e0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:29.628 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.627+0000 7f885a507700 1 -- 172.21.15.76:0/2379096042 >> 172.21.15.76:0/2379096042 conn(0x7f88540faab0 msgr2=0x7f8854105550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:29.628 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.627+0000 7f885a507700 1 -- 172.21.15.76:0/2379096042 shutdown_connections 2024-06-02T04:49:29.628 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.627+0000 7f885a507700 1 -- 172.21.15.76:0/2379096042 wait complete. 2024-06-02T04:49:29.628 INFO:teuthology.orchestra.run.smithi076.stderr:dumped fsmap epoch 24 2024-06-02T04:49:29.638 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:29 smithi076 ceph-mon[42935]: pgmap v263: 129 pgs: 129 active+clean; 639 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-02T04:49:29.638 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:29 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/1919796015' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-06-02T04:49:29.639 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:29 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/782780269' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-06-02T04:49:29.639 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:29 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/1153610130' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-06-02T04:49:29.640 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-02T04:49:29.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:29 smithi192 ceph-mon[47933]: pgmap v263: 129 pgs: 129 active+clean; 639 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-02T04:49:29.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:29 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/1919796015' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-06-02T04:49:29.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:29 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/782780269' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-06-02T04:49:29.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:29 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/1153610130' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-06-02T04:49:29.766 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.764+0000 7f01d5753700 1 -- 172.21.15.76:0/2168452521 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f01d0101920 msgr2=0x7f01d01081d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:29.766 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.764+0000 7f01d5753700 1 --2- 172.21.15.76:0/2168452521 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f01d0101920 0x7f01d01081d0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f01c800b0d0 tx=0x7f01c800b3e0 comp rx=0 tx=0).stop 2024-06-02T04:49:29.766 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.764+0000 7f01d5753700 1 -- 172.21.15.76:0/2168452521 shutdown_connections 2024-06-02T04:49:29.766 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.764+0000 7f01d5753700 1 --2- 172.21.15.76:0/2168452521 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f01d0101920 0x7f01d01081d0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:29.767 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.764+0000 7f01d5753700 1 --2- 172.21.15.76:0/2168452521 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f01d00ffd90 0x7f01d01001b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:29.767 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.764+0000 7f01d5753700 1 --2- 172.21.15.76:0/2168452521 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f01d0100f80 0x7f01d01013e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:29.767 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.764+0000 7f01d5753700 1 -- 172.21.15.76:0/2168452521 >> 172.21.15.76:0/2168452521 conn(0x7f01d00fb300 msgr2=0x7f01d00fd740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:29.767 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.764+0000 7f01d5753700 1 -- 172.21.15.76:0/2168452521 shutdown_connections 2024-06-02T04:49:29.767 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.764+0000 7f01d5753700 1 -- 172.21.15.76:0/2168452521 wait complete. 2024-06-02T04:49:29.767 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.764+0000 7f01d5753700 1 Processor -- start 2024-06-02T04:49:29.767 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.765+0000 7f01d5753700 1 -- start start 2024-06-02T04:49:29.767 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.765+0000 7f01d5753700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f01d00ffd90 0x7f01d0103c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:29.767 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.765+0000 7f01d5753700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f01d0100f80 0x7f01d0102360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:29.767 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.765+0000 7f01d5753700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f01d0101920 0x7f01d01028a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:29.767 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.765+0000 7f01d5753700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01d0102fa0 con 0x7f01d0101920 2024-06-02T04:49:29.767 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.765+0000 7f01d5753700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01d0103110 con 0x7f01d0100f80 2024-06-02T04:49:29.768 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.765+0000 7f01d5753700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01d01a10e0 con 0x7f01d00ffd90 2024-06-02T04:49:29.768 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.765+0000 7f01cf7fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f01d0101920 0x7f01d01028a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:29.768 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.765+0000 7f01cf7fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f01d0101920 0x7f01d01028a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:43184/0 (socket says 172.21.15.76:43184) 2024-06-02T04:49:29.768 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.765+0000 7f01cf7fe700 1 -- 172.21.15.76:0/2756566733 learned_addr learned my addr 172.21.15.76:0/2756566733 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:49:29.768 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.765+0000 7f01ceffd700 1 --2- 172.21.15.76:0/2756566733 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f01d00ffd90 0x7f01d0103c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:29.768 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.765+0000 7f01ce7fc700 1 --2- 172.21.15.76:0/2756566733 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f01d0100f80 0x7f01d0102360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:29.768 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.765+0000 7f01cf7fe700 1 -- 172.21.15.76:0/2756566733 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f01d00ffd90 msgr2=0x7f01d0103c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:29.768 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.765+0000 7f01cf7fe700 1 --2- 172.21.15.76:0/2756566733 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f01d00ffd90 0x7f01d0103c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:29.768 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.765+0000 7f01cf7fe700 1 -- 172.21.15.76:0/2756566733 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f01d0100f80 msgr2=0x7f01d0102360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:29.769 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.765+0000 7f01cf7fe700 1 --2- 172.21.15.76:0/2756566733 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f01d0100f80 0x7f01d0102360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:29.769 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.765+0000 7f01cf7fe700 1 -- 172.21.15.76:0/2756566733 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01c8009d00 con 0x7f01d0101920 2024-06-02T04:49:29.769 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.765+0000 7f01ce7fc700 1 --2- 172.21.15.76:0/2756566733 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f01d0100f80 0x7f01d0102360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:49:29.769 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.765+0000 7f01cf7fe700 1 --2- 172.21.15.76:0/2756566733 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f01d0101920 0x7f01d01028a0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f01c8007b60 tx=0x7f01c8009440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:29.769 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.765+0000 7f01b7fff700 1 -- 172.21.15.76:0/2756566733 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c800e040 con 0x7f01d0101920 2024-06-02T04:49:29.769 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.766+0000 7f01d5753700 1 -- 172.21.15.76:0/2756566733 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01d01a12e0 con 0x7f01d0101920 2024-06-02T04:49:29.769 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.766+0000 7f01b7fff700 1 -- 172.21.15.76:0/2756566733 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f01c8004e60 con 0x7f01d0101920 2024-06-02T04:49:29.769 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.766+0000 7f01b7fff700 1 -- 172.21.15.76:0/2756566733 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c8012980 con 0x7f01d0101920 2024-06-02T04:49:29.769 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.766+0000 7f01d5753700 1 -- 172.21.15.76:0/2756566733 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01d01a1790 con 0x7f01d0101920 2024-06-02T04:49:29.770 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.766+0000 7f01d5753700 1 -- 172.21.15.76:0/2756566733 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01d0068060 con 0x7f01d0101920 2024-06-02T04:49:29.770 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.768+0000 7f01b7fff700 1 -- 172.21.15.76:0/2756566733 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f01c8005730 con 0x7f01d0101920 2024-06-02T04:49:29.771 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.768+0000 7f01b7fff700 1 --2- 172.21.15.76:0/2756566733 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f01b80a11b0 0x7f01b80a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:29.771 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.768+0000 7f01ceffd700 1 --2- 172.21.15.76:0/2756566733 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f01b80a11b0 0x7f01b80a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:29.771 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.768+0000 7f01b7fff700 1 -- 172.21.15.76:0/2756566733 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f01c80ce620 con 0x7f01d0101920 2024-06-02T04:49:29.771 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.769+0000 7f01ceffd700 1 --2- 172.21.15.76:0/2756566733 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f01b80a11b0 0x7f01b80a3670 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f01d0100de0 tx=0x7f01c4009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:29.772 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.772+0000 7f01b7fff700 1 -- 172.21.15.76:0/2756566733 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f01c80979d0 con 0x7f01d0101920 2024-06-02T04:49:29.970 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.969+0000 7f01d5753700 1 -- 172.21.15.76:0/2756566733 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f01d010b810 con 0x7f01d0101920 2024-06-02T04:49:29.971 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.971+0000 7f01b7fff700 1 -- 172.21.15.76:0/2756566733 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+24453 (secure 0 0 0) 0x7f01c809aff0 con 0x7f01d0101920 2024-06-02T04:49:29.971 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:49:29.972 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":82,"fsid":"60ab6d30-209a-11ef-bc9b-c7b262605968","created":"2024-06-02T04:42:21.007333+0000","modified":"2024-06-02T04:49:07.862801+0000","last_up_change":"2024-06-02T04:47:29.822242+0000","last_in_change":"2024-06-02T04:47:14.253449+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T04:44:56.408602+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-02T04:48:01.194954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-02T04:48:01.828863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-02T04:48:04.916565+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"33a51ba2-be5c-41d0-b5d1-8d6039f2ca4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6802","nonce":2869602045},{"type":"v1","addr":"172.21.15.76:6803","nonce":2869602045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6804","nonce":2869602045},{"type":"v1","addr":"172.21.15.76:6805","nonce":2869602045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6808","nonce":2869602045},{"type":"v1","addr":"172.21.15.76:6809","nonce":2869602045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6806","nonce":2869602045},{"type":"v1","addr":"172.21.15.76:6807","nonce":2869602045}]},"public_addr":"172.21.15.76:6803/2869602045","cluster_addr":"172.21.15.76:6805/2869602045","heartbeat_back_addr":"172.21.15.76:6809/2869602045","heartbeat_front_addr":"172.21.15.76:6807/2869602045","state":["exists","up"]},{"osd":1,"uuid":"ace46e13-3bb7-4103-973a-6860554df8b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":2353738098},{"type":"v1","addr":"172.21.15.119:6801","nonce":2353738098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":2353738098},{"type":"v1","addr":"172.21.15.119:6803","nonce":2353738098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":2353738098},{"type":"v1","addr":"172.21.15.119:6807","nonce":2353738098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":2353738098},{"type":"v1","addr":"172.21.15.119:6805","nonce":2353738098}]},"public_addr":"172.21.15.119:6801/2353738098","cluster_addr":"172.21.15.119:6803/2353738098","heartbeat_back_addr":"172.21.15.119:6807/2353738098","heartbeat_front_addr":"172.21.15.119:6805/2353738098","state":["exists","up"]},{"osd":2,"uuid":"4addc09e-77a9-428a-bcc4-38194f486cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":3206918546},{"type":"v1","addr":"172.21.15.192:6801","nonce":3206918546}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":3206918546},{"type":"v1","addr":"172.21.15.192:6803","nonce":3206918546}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":3206918546},{"type":"v1","addr":"172.21.15.192:6807","nonce":3206918546}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":3206918546},{"type":"v1","addr":"172.21.15.192:6805","nonce":3206918546}]},"public_addr":"172.21.15.192:6801/3206918546","cluster_addr":"172.21.15.192:6803/3206918546","heartbeat_back_addr":"172.21.15.192:6807/3206918546","heartbeat_front_addr":"172.21.15.192:6805/3206918546","state":["exists","up"]},{"osd":3,"uuid":"dc525518-82c6-49ed-8ca8-e3bd5bfc18d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6810","nonce":3747864233},{"type":"v1","addr":"172.21.15.76:6811","nonce":3747864233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6812","nonce":3747864233},{"type":"v1","addr":"172.21.15.76:6813","nonce":3747864233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6816","nonce":3747864233},{"type":"v1","addr":"172.21.15.76:6817","nonce":3747864233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6814","nonce":3747864233},{"type":"v1","addr":"172.21.15.76:6815","nonce":3747864233}]},"public_addr":"172.21.15.76:6811/3747864233","cluster_addr":"172.21.15.76:6813/3747864233","heartbeat_back_addr":"172.21.15.76:6817/3747864233","heartbeat_front_addr":"172.21.15.76:6815/3747864233","state":["exists","up"]},{"osd":4,"uuid":"eef293d0-cb87-47b3-9751-c6437a1cf079","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":2571629047},{"type":"v1","addr":"172.21.15.119:6809","nonce":2571629047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":2571629047},{"type":"v1","addr":"172.21.15.119:6811","nonce":2571629047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":2571629047},{"type":"v1","addr":"172.21.15.119:6815","nonce":2571629047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":2571629047},{"type":"v1","addr":"172.21.15.119:6813","nonce":2571629047}]},"public_addr":"172.21.15.119:6809/2571629047","cluster_addr":"172.21.15.119:6811/2571629047","heartbeat_back_addr":"172.21.15.119:6815/2571629047","heartbeat_front_addr":"172.21.15.119:6813/2571629047","state":["exists","up"]},{"osd":5,"uuid":"60eb8c6e-766c-49d0-9997-44f85776b3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3285065416},{"type":"v1","addr":"172.21.15.192:6809","nonce":3285065416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":3285065416},{"type":"v1","addr":"172.21.15.192:6811","nonce":3285065416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3285065416},{"type":"v1","addr":"172.21.15.192:6815","nonce":3285065416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":3285065416},{"type":"v1","addr":"172.21.15.192:6813","nonce":3285065416}]},"public_addr":"172.21.15.192:6809/3285065416","cluster_addr":"172.21.15.192:6811/3285065416","heartbeat_back_addr":"172.21.15.192:6815/3285065416","heartbeat_front_addr":"172.21.15.192:6813/3285065416","state":["exists","up"]},{"osd":6,"uuid":"e6dc8b9d-dd06-4870-a506-def8201b7e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6818","nonce":2951381580},{"type":"v1","addr":"172.21.15.76:6819","nonce":2951381580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6820","nonce":2951381580},{"type":"v1","addr":"172.21.15.76:6821","nonce":2951381580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6824","nonce":2951381580},{"type":"v1","addr":"172.21.15.76:6825","nonce":2951381580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6822","nonce":2951381580},{"type":"v1","addr":"172.21.15.76:6823","nonce":2951381580}]},"public_addr":"172.21.15.76:6819/2951381580","cluster_addr":"172.21.15.76:6821/2951381580","heartbeat_back_addr":"172.21.15.76:6825/2951381580","heartbeat_front_addr":"172.21.15.76:6823/2951381580","state":["exists","up"]},{"osd":7,"uuid":"2f5dccb3-39a1-4f25-8715-fa264d59db97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1802558756},{"type":"v1","addr":"172.21.15.119:6817","nonce":1802558756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1802558756},{"type":"v1","addr":"172.21.15.119:6819","nonce":1802558756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1802558756},{"type":"v1","addr":"172.21.15.119:6823","nonce":1802558756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1802558756},{"type":"v1","addr":"172.21.15.119:6821","nonce":1802558756}]},"public_addr":"172.21.15.119:6817/1802558756","cluster_addr":"172.21.15.119:6819/1802558756","heartbeat_back_addr":"172.21.15.119:6823/1802558756","heartbeat_front_addr":"172.21.15.119:6821/1802558756","state":["exists","up"]},{"osd":8,"uuid":"39b6ccd0-16e7-4cd5-87e0-d827e9172984","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":1214972276},{"type":"v1","addr":"172.21.15.192:6817","nonce":1214972276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":1214972276},{"type":"v1","addr":"172.21.15.192:6819","nonce":1214972276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":1214972276},{"type":"v1","addr":"172.21.15.192:6823","nonce":1214972276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":1214972276},{"type":"v1","addr":"172.21.15.192:6821","nonce":1214972276}]},"public_addr":"172.21.15.192:6817/1214972276","cluster_addr":"172.21.15.192:6819/1214972276","heartbeat_back_addr":"172.21.15.192:6823/1214972276","heartbeat_front_addr":"172.21.15.192:6821/1214972276","state":["exists","up"]},{"osd":9,"uuid":"851b2155-07bd-45de-bfe0-53021fda733f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6826","nonce":3095501821},{"type":"v1","addr":"172.21.15.76:6827","nonce":3095501821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6828","nonce":3095501821},{"type":"v1","addr":"172.21.15.76:6829","nonce":3095501821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":3095501821},{"type":"v1","addr":"172.21.15.76:6833","nonce":3095501821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6830","nonce":3095501821},{"type":"v1","addr":"172.21.15.76:6831","nonce":3095501821}]},"public_addr":"172.21.15.76:6827/3095501821","cluster_addr":"172.21.15.76:6829/3095501821","heartbeat_back_addr":"172.21.15.76:6833/3095501821","heartbeat_front_addr":"172.21.15.76:6831/3095501821","state":["exists","up"]},{"osd":10,"uuid":"e4b18e7e-bddf-4dd4-84f6-7902ea327cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":4082130894},{"type":"v1","addr":"172.21.15.119:6825","nonce":4082130894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":4082130894},{"type":"v1","addr":"172.21.15.119:6827","nonce":4082130894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":4082130894},{"type":"v1","addr":"172.21.15.119:6831","nonce":4082130894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":4082130894},{"type":"v1","addr":"172.21.15.119:6829","nonce":4082130894}]},"public_addr":"172.21.15.119:6825/4082130894","cluster_addr":"172.21.15.119:6827/4082130894","heartbeat_back_addr":"172.21.15.119:6831/4082130894","heartbeat_front_addr":"172.21.15.119:6829/4082130894","state":["exists","up"]},{"osd":11,"uuid":"54567e18-920c-4ae9-9557-0efba5a1a820","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":439693921},{"type":"v1","addr":"172.21.15.192:6825","nonce":439693921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":439693921},{"type":"v1","addr":"172.21.15.192:6827","nonce":439693921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":439693921},{"type":"v1","addr":"172.21.15.192:6831","nonce":439693921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":439693921},{"type":"v1","addr":"172.21.15.192:6829","nonce":439693921}]},"public_addr":"172.21.15.192:6825/439693921","cluster_addr":"172.21.15.192:6827/439693921","heartbeat_back_addr":"172.21.15.192:6831/439693921","heartbeat_front_addr":"172.21.15.192:6829/439693921","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:44:19.922390+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:44:36.895563+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:44:53.699019+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:45:11.167404+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:45:27.955899+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:45:44.850368+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:46:02.003588+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:46:19.019217+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:46:36.189670+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:46:53.919365+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:47:11.563053+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:47:28.822443+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":4}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.8","mappings":[{"from":5,"to":10}]},{"pgid":"4.14","mappings":[{"from":9,"to":8}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.76:6801/4200406736":"2024-06-03T04:43:06.092916+0000","172.21.15.76:6800/4200406736":"2024-06-03T04:43:06.092916+0000","172.21.15.76:0/1524144593":"2024-06-03T04:43:06.092916+0000","172.21.15.76:0/3269372590":"2024-06-03T04:43:06.092916+0000","172.21.15.76:0/3570893846":"2024-06-03T04:42:44.872236+0000","172.21.15.76:0/902035790":"2024-06-03T04:43:06.092916+0000","172.21.15.76:6800/2550846765":"2024-06-03T04:42:44.872236+0000","172.21.15.76:6801/2550846765":"2024-06-03T04:42:44.872236+0000","172.21.15.76:0/2646712763":"2024-06-03T04:42:44.872236+0000","172.21.15.76:0/964578813":"2024-06-03T04:42:44.872236+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T04:49:29.973 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.973+0000 7f01d5753700 1 -- 172.21.15.76:0/2756566733 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f01b80a11b0 msgr2=0x7f01b80a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:29.974 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.973+0000 7f01d5753700 1 --2- 172.21.15.76:0/2756566733 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f01b80a11b0 0x7f01b80a3670 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f01d0100de0 tx=0x7f01c4009190 comp rx=0 tx=0).stop 2024-06-02T04:49:29.974 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.973+0000 7f01d5753700 1 -- 172.21.15.76:0/2756566733 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f01d0101920 msgr2=0x7f01d01028a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:29.974 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.973+0000 7f01d5753700 1 --2- 172.21.15.76:0/2756566733 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f01d0101920 0x7f01d01028a0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f01c8007b60 tx=0x7f01c8009440 comp rx=0 tx=0).stop 2024-06-02T04:49:29.974 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.973+0000 7f01d5753700 1 -- 172.21.15.76:0/2756566733 shutdown_connections 2024-06-02T04:49:29.974 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.973+0000 7f01d5753700 1 --2- 172.21.15.76:0/2756566733 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f01d0101920 0x7f01d01028a0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:29.974 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.973+0000 7f01d5753700 1 --2- 172.21.15.76:0/2756566733 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f01d00ffd90 0x7f01d0103c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:29.974 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.973+0000 7f01d5753700 1 --2- 172.21.15.76:0/2756566733 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f01b80a11b0 0x7f01b80a3670 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:29.974 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.973+0000 7f01d5753700 1 --2- 172.21.15.76:0/2756566733 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f01d0100f80 0x7f01d0102360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:29.974 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.973+0000 7f01d5753700 1 -- 172.21.15.76:0/2756566733 >> 172.21.15.76:0/2756566733 conn(0x7f01d00fb300 msgr2=0x7f01d0069460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:29.974 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.973+0000 7f01d5753700 1 -- 172.21.15.76:0/2756566733 shutdown_connections 2024-06-02T04:49:29.974 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:29.973+0000 7f01d5753700 1 -- 172.21.15.76:0/2756566733 wait complete. 2024-06-02T04:49:29.986 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-06-02T04:44:56.408602+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-06-02T04:48:01.194954+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-06-02T04:48:01.828863+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '76', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-06-02T04:48:04.916565+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-06-02T04:49:29.987 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-06-02T04:49:30.114 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.112+0000 7fe459af9700 1 -- 172.21.15.76:0/3537427410 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe454100fb0 msgr2=0x7fe454101430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:30.115 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.112+0000 7fe459af9700 1 --2- 172.21.15.76:0/3537427410 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe454100fb0 0x7fe454101430 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fe444009990 tx=0x7fe444009ca0 comp rx=0 tx=0).stop 2024-06-02T04:49:30.115 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.112+0000 7fe459af9700 1 -- 172.21.15.76:0/3537427410 shutdown_connections 2024-06-02T04:49:30.115 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.112+0000 7fe459af9700 1 --2- 172.21.15.76:0/3537427410 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe454101970 0x7fe454108290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:30.115 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.112+0000 7fe459af9700 1 --2- 172.21.15.76:0/3537427410 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe4540ffe60 0x7fe454100280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:30.115 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.112+0000 7fe459af9700 1 --2- 172.21.15.76:0/3537427410 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe454100fb0 0x7fe454101430 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:30.115 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.112+0000 7fe459af9700 1 -- 172.21.15.76:0/3537427410 >> 172.21.15.76:0/3537427410 conn(0x7fe4540fb3f0 msgr2=0x7fe4540fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:30.115 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.112+0000 7fe459af9700 1 -- 172.21.15.76:0/3537427410 shutdown_connections 2024-06-02T04:49:30.115 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.112+0000 7fe459af9700 1 -- 172.21.15.76:0/3537427410 wait complete. 2024-06-02T04:49:30.115 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.113+0000 7fe459af9700 1 Processor -- start 2024-06-02T04:49:30.115 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.113+0000 7fe459af9700 1 -- start start 2024-06-02T04:49:30.115 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.113+0000 7fe459af9700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe4540ffe60 0x7fe454068b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:30.116 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.113+0000 7fe459af9700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe454100fb0 0x7fe45419bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:30.116 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.113+0000 7fe459af9700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe454101970 0x7fe45419e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:30.116 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.113+0000 7fe459af9700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe45419e870 con 0x7fe454100fb0 2024-06-02T04:49:30.116 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.113+0000 7fe459af9700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe45419e9e0 con 0x7fe4540ffe60 2024-06-02T04:49:30.116 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.113+0000 7fe459af9700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe45419eba0 con 0x7fe454101970 2024-06-02T04:49:30.116 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.113+0000 7fe452ffd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe454100fb0 0x7fe45419bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:30.116 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.113+0000 7fe452ffd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe454100fb0 0x7fe45419bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:43204/0 (socket says 172.21.15.76:43204) 2024-06-02T04:49:30.116 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.113+0000 7fe452ffd700 1 -- 172.21.15.76:0/1733723764 learned_addr learned my addr 172.21.15.76:0/1733723764 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:49:30.116 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.113+0000 7fe452ffd700 1 -- 172.21.15.76:0/1733723764 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe454101970 msgr2=0x7fe45419e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:30.116 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.113+0000 7fe453fff700 1 --2- 172.21.15.76:0/1733723764 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe454101970 0x7fe45419e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:30.116 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.113+0000 7fe452ffd700 1 --2- 172.21.15.76:0/1733723764 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe454101970 0x7fe45419e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:30.116 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.113+0000 7fe4537fe700 1 --2- 172.21.15.76:0/1733723764 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe4540ffe60 0x7fe454068b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:30.117 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.113+0000 7fe452ffd700 1 -- 172.21.15.76:0/1733723764 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe4540ffe60 msgr2=0x7fe454068b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:30.117 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.113+0000 7fe452ffd700 1 --2- 172.21.15.76:0/1733723764 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe4540ffe60 0x7fe454068b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:30.117 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.113+0000 7fe452ffd700 1 -- 172.21.15.76:0/1733723764 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4440095f0 con 0x7fe454100fb0 2024-06-02T04:49:30.117 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.113+0000 7fe453fff700 1 --2- 172.21.15.76:0/1733723764 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe454101970 0x7fe45419e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:49:30.117 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.113+0000 7fe452ffd700 1 --2- 172.21.15.76:0/1733723764 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe454100fb0 0x7fe45419bae0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fe4440059d0 tx=0x7fe4440047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:30.117 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.114+0000 7fe450ff9700 1 -- 172.21.15.76:0/1733723764 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe44401d070 con 0x7fe454100fb0 2024-06-02T04:49:30.117 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.114+0000 7fe450ff9700 1 -- 172.21.15.76:0/1733723764 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe444022470 con 0x7fe454100fb0 2024-06-02T04:49:30.117 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.114+0000 7fe459af9700 1 -- 172.21.15.76:0/1733723764 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe45419ee20 con 0x7fe454100fb0 2024-06-02T04:49:30.117 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.114+0000 7fe450ff9700 1 -- 172.21.15.76:0/1733723764 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe44400f6c0 con 0x7fe454100fb0 2024-06-02T04:49:30.117 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.114+0000 7fe459af9700 1 -- 172.21.15.76:0/1733723764 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe45419f1e0 con 0x7fe454100fb0 2024-06-02T04:49:30.118 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.115+0000 7fe459af9700 1 -- 172.21.15.76:0/1733723764 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe454107320 con 0x7fe454100fb0 2024-06-02T04:49:30.118 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.116+0000 7fe450ff9700 1 -- 172.21.15.76:0/1733723764 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fe4440225e0 con 0x7fe454100fb0 2024-06-02T04:49:30.118 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.116+0000 7fe450ff9700 1 --2- 172.21.15.76:0/1733723764 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fe43c0a11b0 0x7fe43c0a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:30.118 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.116+0000 7fe450ff9700 1 -- 172.21.15.76:0/1733723764 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fe4440ce3d0 con 0x7fe454100fb0 2024-06-02T04:49:30.118 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.116+0000 7fe4537fe700 1 --2- 172.21.15.76:0/1733723764 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fe43c0a11b0 0x7fe43c0a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:30.118 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.117+0000 7fe4537fe700 1 --2- 172.21.15.76:0/1733723764 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fe43c0a11b0 0x7fe43c0a3670 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fe448009b30 tx=0x7fe448009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:30.121 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.121+0000 7fe450ff9700 1 -- 172.21.15.76:0/1733723764 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fe444097780 con 0x7fe454100fb0 2024-06-02T04:49:30.323 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.323+0000 7fe459af9700 1 -- 172.21.15.76:0/1733723764 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe45410b710 con 0x7fe454100fb0 2024-06-02T04:49:30.324 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.323+0000 7fe450ff9700 1 -- 172.21.15.76:0/1733723764 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe44409ada0 con 0x7fe454100fb0 2024-06-02T04:49:30.324 INFO:teuthology.orchestra.run.smithi076.stdout:pg_num: 1 2024-06-02T04:49:30.326 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.325+0000 7fe459af9700 1 -- 172.21.15.76:0/1733723764 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fe43c0a11b0 msgr2=0x7fe43c0a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:30.326 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.325+0000 7fe459af9700 1 --2- 172.21.15.76:0/1733723764 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fe43c0a11b0 0x7fe43c0a3670 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fe448009b30 tx=0x7fe448009260 comp rx=0 tx=0).stop 2024-06-02T04:49:30.326 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.326+0000 7fe459af9700 1 -- 172.21.15.76:0/1733723764 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe454100fb0 msgr2=0x7fe45419bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:30.326 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.326+0000 7fe459af9700 1 --2- 172.21.15.76:0/1733723764 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe454100fb0 0x7fe45419bae0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fe4440059d0 tx=0x7fe4440047c0 comp rx=0 tx=0).stop 2024-06-02T04:49:30.326 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.326+0000 7fe459af9700 1 -- 172.21.15.76:0/1733723764 shutdown_connections 2024-06-02T04:49:30.327 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.326+0000 7fe459af9700 1 --2- 172.21.15.76:0/1733723764 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe454101970 0x7fe45419e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:30.327 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.326+0000 7fe459af9700 1 --2- 172.21.15.76:0/1733723764 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fe43c0a11b0 0x7fe43c0a3670 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:30.327 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.326+0000 7fe459af9700 1 --2- 172.21.15.76:0/1733723764 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe4540ffe60 0x7fe454068b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:30.327 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.326+0000 7fe459af9700 1 --2- 172.21.15.76:0/1733723764 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe454100fb0 0x7fe45419bae0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:30.327 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.326+0000 7fe459af9700 1 -- 172.21.15.76:0/1733723764 >> 172.21.15.76:0/1733723764 conn(0x7fe4540fb3f0 msgr2=0x7fe454104460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:30.327 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.326+0000 7fe459af9700 1 -- 172.21.15.76:0/1733723764 shutdown_connections 2024-06-02T04:49:30.327 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.326+0000 7fe459af9700 1 -- 172.21.15.76:0/1733723764 wait complete. 2024-06-02T04:49:30.338 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-06-02T04:49:30.466 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.463+0000 7fb64c74d700 1 -- 172.21.15.76:0/2889015675 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb6441020f0 msgr2=0x7fb644102570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:30.466 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.463+0000 7fb64c74d700 1 --2- 172.21.15.76:0/2889015675 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb6441020f0 0x7fb644102570 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fb638009990 tx=0x7fb638009ca0 comp rx=0 tx=0).stop 2024-06-02T04:49:30.469 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.463+0000 7fb64c74d700 1 -- 172.21.15.76:0/2889015675 shutdown_connections 2024-06-02T04:49:30.470 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.463+0000 7fb64c74d700 1 --2- 172.21.15.76:0/2889015675 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb644102ab0 0x7fb6441093d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:30.470 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.463+0000 7fb64c74d700 1 --2- 172.21.15.76:0/2889015675 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb644100f20 0x7fb644101360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:30.470 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.463+0000 7fb64c74d700 1 --2- 172.21.15.76:0/2889015675 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb6441020f0 0x7fb644102570 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:30.470 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.463+0000 7fb64c74d700 1 -- 172.21.15.76:0/2889015675 >> 172.21.15.76:0/2889015675 conn(0x7fb6440fc4e0 msgr2=0x7fb6440fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:30.470 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.463+0000 7fb64c74d700 1 -- 172.21.15.76:0/2889015675 shutdown_connections 2024-06-02T04:49:30.470 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.463+0000 7fb64c74d700 1 -- 172.21.15.76:0/2889015675 wait complete. 2024-06-02T04:49:30.470 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.464+0000 7fb64c74d700 1 Processor -- start 2024-06-02T04:49:30.470 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.464+0000 7fb64c74d700 1 -- start start 2024-06-02T04:49:30.470 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.464+0000 7fb64c74d700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb644100f20 0x7fb644074d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:30.470 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.464+0000 7fb64c74d700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb6441020f0 0x7fb644073390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:30.470 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.464+0000 7fb64c74d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb644102ab0 0x7fb6440738d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:30.471 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.464+0000 7fb64c74d700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb644074070 con 0x7fb644100f20 2024-06-02T04:49:30.471 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.464+0000 7fb64c74d700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6440741e0 con 0x7fb6441020f0 2024-06-02T04:49:30.471 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.464+0000 7fb64c74d700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6441a0fa0 con 0x7fb644102ab0 2024-06-02T04:49:30.471 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.464+0000 7fb64a4e9700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb644100f20 0x7fb644074d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:30.471 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.464+0000 7fb64a4e9700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb644100f20 0x7fb644074d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:43226/0 (socket says 172.21.15.76:43226) 2024-06-02T04:49:30.471 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.464+0000 7fb64a4e9700 1 -- 172.21.15.76:0/3533983156 learned_addr learned my addr 172.21.15.76:0/3533983156 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:49:30.471 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.465+0000 7fb64acea700 1 --2- 172.21.15.76:0/3533983156 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb644102ab0 0x7fb6440738d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:30.471 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.465+0000 7fb649ce8700 1 --2- 172.21.15.76:0/3533983156 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb6441020f0 0x7fb644073390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:30.471 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.465+0000 7fb64a4e9700 1 -- 172.21.15.76:0/3533983156 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb644102ab0 msgr2=0x7fb6440738d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:30.471 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.465+0000 7fb64a4e9700 1 --2- 172.21.15.76:0/3533983156 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb644102ab0 0x7fb6440738d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:30.471 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.465+0000 7fb64a4e9700 1 -- 172.21.15.76:0/3533983156 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb6441020f0 msgr2=0x7fb644073390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:30.471 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.465+0000 7fb64a4e9700 1 --2- 172.21.15.76:0/3533983156 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb6441020f0 0x7fb644073390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:30.471 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.465+0000 7fb64a4e9700 1 -- 172.21.15.76:0/3533983156 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6380095f0 con 0x7fb644100f20 2024-06-02T04:49:30.471 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.465+0000 7fb649ce8700 1 --2- 172.21.15.76:0/3533983156 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb6441020f0 0x7fb644073390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:49:30.472 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.465+0000 7fb64a4e9700 1 --2- 172.21.15.76:0/3533983156 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb644100f20 0x7fb644074d00 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fb64000b500 tx=0x7fb64000b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:30.472 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.465+0000 7fb6377fe700 1 -- 172.21.15.76:0/3533983156 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb640011830 con 0x7fb644100f20 2024-06-02T04:49:30.472 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.465+0000 7fb64c74d700 1 -- 172.21.15.76:0/3533983156 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6441a1230 con 0x7fb644100f20 2024-06-02T04:49:30.472 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.465+0000 7fb6377fe700 1 -- 172.21.15.76:0/3533983156 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb640011e20 con 0x7fb644100f20 2024-06-02T04:49:30.472 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.465+0000 7fb6377fe700 1 -- 172.21.15.76:0/3533983156 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb640010d20 con 0x7fb644100f20 2024-06-02T04:49:30.472 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.465+0000 7fb64c74d700 1 -- 172.21.15.76:0/3533983156 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6441a1740 con 0x7fb644100f20 2024-06-02T04:49:30.472 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.466+0000 7fb64c74d700 1 -- 172.21.15.76:0/3533983156 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6441084b0 con 0x7fb644100f20 2024-06-02T04:49:30.473 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.467+0000 7fb6377fe700 1 -- 172.21.15.76:0/3533983156 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fb640011990 con 0x7fb644100f20 2024-06-02T04:49:30.473 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.468+0000 7fb6377fe700 1 --2- 172.21.15.76:0/3533983156 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fb6300a11b0 0x7fb6300a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:30.473 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.468+0000 7fb649ce8700 1 --2- 172.21.15.76:0/3533983156 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fb6300a11b0 0x7fb6300a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:30.473 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.468+0000 7fb6377fe700 1 -- 172.21.15.76:0/3533983156 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fb6400ccbd0 con 0x7fb644100f20 2024-06-02T04:49:30.473 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.468+0000 7fb649ce8700 1 --2- 172.21.15.76:0/3533983156 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fb6300a11b0 0x7fb6300a3670 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fb638003780 tx=0x7fb638005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:30.473 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.472+0000 7fb6377fe700 1 -- 172.21.15.76:0/3533983156 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fb6400cce60 con 0x7fb644100f20 2024-06-02T04:49:30.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:30 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/2379096042' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:49:30.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:30 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/2756566733' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:49:30.667 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.667+0000 7fb64c74d700 1 -- 172.21.15.76:0/3533983156 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb64410c930 con 0x7fb644100f20 2024-06-02T04:49:30.668 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.667+0000 7fb6377fe700 1 -- 172.21.15.76:0/3533983156 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v82) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb640096000 con 0x7fb644100f20 2024-06-02T04:49:30.668 INFO:teuthology.orchestra.run.smithi076.stdout:pg_num: 32 2024-06-02T04:49:30.670 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.669+0000 7fb64c74d700 1 -- 172.21.15.76:0/3533983156 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fb6300a11b0 msgr2=0x7fb6300a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:30.670 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.670+0000 7fb64c74d700 1 --2- 172.21.15.76:0/3533983156 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fb6300a11b0 0x7fb6300a3670 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fb638003780 tx=0x7fb638005fb0 comp rx=0 tx=0).stop 2024-06-02T04:49:30.670 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.670+0000 7fb64c74d700 1 -- 172.21.15.76:0/3533983156 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb644100f20 msgr2=0x7fb644074d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:30.670 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.670+0000 7fb64c74d700 1 --2- 172.21.15.76:0/3533983156 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb644100f20 0x7fb644074d00 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fb64000b500 tx=0x7fb64000b8c0 comp rx=0 tx=0).stop 2024-06-02T04:49:30.670 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.670+0000 7fb64c74d700 1 -- 172.21.15.76:0/3533983156 shutdown_connections 2024-06-02T04:49:30.671 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.670+0000 7fb64c74d700 1 --2- 172.21.15.76:0/3533983156 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb644102ab0 0x7fb6440738d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:30.671 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.670+0000 7fb64c74d700 1 --2- 172.21.15.76:0/3533983156 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb644100f20 0x7fb644074d00 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:30.671 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.670+0000 7fb64c74d700 1 --2- 172.21.15.76:0/3533983156 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fb6300a11b0 0x7fb6300a3670 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:30.671 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.670+0000 7fb64c74d700 1 --2- 172.21.15.76:0/3533983156 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb6441020f0 0x7fb644073390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:30.671 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.670+0000 7fb64c74d700 1 -- 172.21.15.76:0/3533983156 >> 172.21.15.76:0/3533983156 conn(0x7fb6440fc4e0 msgr2=0x7fb6441055f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:30.671 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.670+0000 7fb64c74d700 1 -- 172.21.15.76:0/3533983156 shutdown_connections 2024-06-02T04:49:30.671 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.670+0000 7fb64c74d700 1 -- 172.21.15.76:0/3533983156 wait complete. 2024-06-02T04:49:30.681 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:30 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/2379096042' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:49:30.681 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:30 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/2756566733' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:49:30.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:30 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/2379096042' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:49:30.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:30 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/2756566733' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:49:30.682 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-06-02T04:49:30.809 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.809+0000 7fa3f212a700 1 -- 172.21.15.76:0/2389531800 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa3ec101970 msgr2=0x7fa3ec108290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:30.809 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.809+0000 7fa3f212a700 1 --2- 172.21.15.76:0/2389531800 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa3ec101970 0x7fa3ec108290 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fa3e400b0a0 tx=0x7fa3e400b3b0 comp rx=0 tx=0).stop 2024-06-02T04:49:30.810 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.809+0000 7fa3f212a700 1 -- 172.21.15.76:0/2389531800 shutdown_connections 2024-06-02T04:49:30.810 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.809+0000 7fa3f212a700 1 --2- 172.21.15.76:0/2389531800 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa3ec101970 0x7fa3ec108290 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:30.810 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.809+0000 7fa3f212a700 1 --2- 172.21.15.76:0/2389531800 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa3ec0ffe60 0x7fa3ec100280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:30.810 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.809+0000 7fa3f212a700 1 --2- 172.21.15.76:0/2389531800 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa3ec100fb0 0x7fa3ec101430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:30.810 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.809+0000 7fa3f212a700 1 -- 172.21.15.76:0/2389531800 >> 172.21.15.76:0/2389531800 conn(0x7fa3ec0fb3f0 msgr2=0x7fa3ec0fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:30.810 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.809+0000 7fa3f212a700 1 -- 172.21.15.76:0/2389531800 shutdown_connections 2024-06-02T04:49:30.810 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.809+0000 7fa3f212a700 1 -- 172.21.15.76:0/2389531800 wait complete. 2024-06-02T04:49:30.812 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.810+0000 7fa3f212a700 1 Processor -- start 2024-06-02T04:49:30.812 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.810+0000 7fa3f212a700 1 -- start start 2024-06-02T04:49:30.812 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.810+0000 7fa3f212a700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa3ec0ffe60 0x7fa3ec068b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:30.812 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.810+0000 7fa3f212a700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa3ec100fb0 0x7fa3ec19bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:30.812 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.810+0000 7fa3f212a700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa3ec101970 0x7fa3ec19e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:30.813 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.810+0000 7fa3f212a700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ec19ea90 con 0x7fa3ec0ffe60 2024-06-02T04:49:30.813 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.810+0000 7fa3f212a700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ec19ec00 con 0x7fa3ec101970 2024-06-02T04:49:30.813 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.810+0000 7fa3f212a700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ec19edc0 con 0x7fa3ec100fb0 2024-06-02T04:49:30.813 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.810+0000 7fa3eb7fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa3ec0ffe60 0x7fa3ec068b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:30.813 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.810+0000 7fa3eb7fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa3ec0ffe60 0x7fa3ec068b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:43232/0 (socket says 172.21.15.76:43232) 2024-06-02T04:49:30.813 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.810+0000 7fa3eb7fe700 1 -- 172.21.15.76:0/740968712 learned_addr learned my addr 172.21.15.76:0/740968712 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:49:30.813 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.810+0000 7fa3ebfff700 1 --2- 172.21.15.76:0/740968712 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa3ec101970 0x7fa3ec19e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:30.813 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.811+0000 7fa3eaffd700 1 --2- 172.21.15.76:0/740968712 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa3ec100fb0 0x7fa3ec19bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:30.813 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.811+0000 7fa3eb7fe700 1 -- 172.21.15.76:0/740968712 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa3ec100fb0 msgr2=0x7fa3ec19bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:30.813 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.811+0000 7fa3eb7fe700 1 --2- 172.21.15.76:0/740968712 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa3ec100fb0 0x7fa3ec19bc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:30.813 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.811+0000 7fa3eb7fe700 1 -- 172.21.15.76:0/740968712 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa3ec101970 msgr2=0x7fa3ec19e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:30.813 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.811+0000 7fa3eb7fe700 1 --2- 172.21.15.76:0/740968712 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa3ec101970 0x7fa3ec19e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:30.813 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.811+0000 7fa3eb7fe700 1 -- 172.21.15.76:0/740968712 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3e4009d00 con 0x7fa3ec0ffe60 2024-06-02T04:49:30.814 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.811+0000 7fa3ebfff700 1 --2- 172.21.15.76:0/740968712 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa3ec101970 0x7fa3ec19e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:49:30.814 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.811+0000 7fa3eb7fe700 1 --2- 172.21.15.76:0/740968712 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa3ec0ffe60 0x7fa3ec068b30 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc00d980 tx=0x7fa3dc00dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:30.814 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.811+0000 7fa3e8ff9700 1 -- 172.21.15.76:0/740968712 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3dc00bb60 con 0x7fa3ec0ffe60 2024-06-02T04:49:30.814 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.811+0000 7fa3e8ff9700 1 -- 172.21.15.76:0/740968712 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa3dc007640 con 0x7fa3ec0ffe60 2024-06-02T04:49:30.814 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.811+0000 7fa3f212a700 1 -- 172.21.15.76:0/740968712 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3ec19efe0 con 0x7fa3ec0ffe60 2024-06-02T04:49:30.814 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.811+0000 7fa3e8ff9700 1 -- 172.21.15.76:0/740968712 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3dc004d60 con 0x7fa3ec0ffe60 2024-06-02T04:49:30.814 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.811+0000 7fa3f212a700 1 -- 172.21.15.76:0/740968712 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3ec19f460 con 0x7fa3ec0ffe60 2024-06-02T04:49:30.814 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.812+0000 7fa3f212a700 1 -- 172.21.15.76:0/740968712 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3ec107280 con 0x7fa3ec0ffe60 2024-06-02T04:49:30.815 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.813+0000 7fa3e8ff9700 1 -- 172.21.15.76:0/740968712 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fa3dc004020 con 0x7fa3ec0ffe60 2024-06-02T04:49:30.815 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.813+0000 7fa3e8ff9700 1 --2- 172.21.15.76:0/740968712 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fa3d40a1230 0x7fa3d40a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:30.815 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.814+0000 7fa3eaffd700 1 --2- 172.21.15.76:0/740968712 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fa3d40a1230 0x7fa3d40a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:30.815 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.814+0000 7fa3e8ff9700 1 -- 172.21.15.76:0/740968712 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fa3dc0ccd00 con 0x7fa3ec0ffe60 2024-06-02T04:49:30.815 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.814+0000 7fa3eaffd700 1 --2- 172.21.15.76:0/740968712 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fa3d40a1230 0x7fa3d40a36f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fa3e0006fd0 tx=0x7fa3e0008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:30.818 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:30.818+0000 7fa3e8ff9700 1 -- 172.21.15.76:0/740968712 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fa3dc095fc0 con 0x7fa3ec0ffe60 2024-06-02T04:49:31.016 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.016+0000 7fa3f212a700 1 -- 172.21.15.76:0/740968712 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa3ec10b590 con 0x7fa3ec0ffe60 2024-06-02T04:49:31.016 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.016+0000 7fa3e8ff9700 1 -- 172.21.15.76:0/740968712 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v82) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa3dc016020 con 0x7fa3ec0ffe60 2024-06-02T04:49:31.016 INFO:teuthology.orchestra.run.smithi076.stdout:pg_num: 64 2024-06-02T04:49:31.018 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.018+0000 7fa3f212a700 1 -- 172.21.15.76:0/740968712 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fa3d40a1230 msgr2=0x7fa3d40a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:31.019 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.018+0000 7fa3f212a700 1 --2- 172.21.15.76:0/740968712 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fa3d40a1230 0x7fa3d40a36f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fa3e0006fd0 tx=0x7fa3e0008040 comp rx=0 tx=0).stop 2024-06-02T04:49:31.019 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.018+0000 7fa3f212a700 1 -- 172.21.15.76:0/740968712 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa3ec0ffe60 msgr2=0x7fa3ec068b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:31.019 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.018+0000 7fa3f212a700 1 --2- 172.21.15.76:0/740968712 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa3ec0ffe60 0x7fa3ec068b30 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc00d980 tx=0x7fa3dc00dd40 comp rx=0 tx=0).stop 2024-06-02T04:49:31.019 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.018+0000 7fa3f212a700 1 -- 172.21.15.76:0/740968712 shutdown_connections 2024-06-02T04:49:31.019 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.018+0000 7fa3f212a700 1 --2- 172.21.15.76:0/740968712 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fa3d40a1230 0x7fa3d40a36f0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:31.019 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.018+0000 7fa3f212a700 1 --2- 172.21.15.76:0/740968712 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa3ec101970 0x7fa3ec19e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:31.019 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.018+0000 7fa3f212a700 1 --2- 172.21.15.76:0/740968712 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa3ec0ffe60 0x7fa3ec068b30 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:31.019 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.018+0000 7fa3f212a700 1 --2- 172.21.15.76:0/740968712 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa3ec100fb0 0x7fa3ec19bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:31.019 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.018+0000 7fa3f212a700 1 -- 172.21.15.76:0/740968712 >> 172.21.15.76:0/740968712 conn(0x7fa3ec0fb3f0 msgr2=0x7fa3ec1043c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:31.019 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.018+0000 7fa3f212a700 1 -- 172.21.15.76:0/740968712 shutdown_connections 2024-06-02T04:49:31.019 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.018+0000 7fa3f212a700 1 -- 172.21.15.76:0/740968712 wait complete. 2024-06-02T04:49:31.031 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-06-02T04:49:31.157 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.156+0000 7f20fd5c5700 1 -- 172.21.15.76:0/1907827879 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f20f8101970 msgr2=0x7f20f8108290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:31.157 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.156+0000 7f20fd5c5700 1 --2- 172.21.15.76:0/1907827879 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f20f8101970 0x7f20f8108290 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f20f000b0a0 tx=0x7f20f000b3b0 comp rx=0 tx=0).stop 2024-06-02T04:49:31.157 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.156+0000 7f20fd5c5700 1 -- 172.21.15.76:0/1907827879 shutdown_connections 2024-06-02T04:49:31.157 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.156+0000 7f20fd5c5700 1 --2- 172.21.15.76:0/1907827879 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f20f8101970 0x7f20f8108290 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:31.157 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.156+0000 7f20fd5c5700 1 --2- 172.21.15.76:0/1907827879 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f20f80ffe60 0x7f20f8100280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:31.157 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.156+0000 7f20fd5c5700 1 --2- 172.21.15.76:0/1907827879 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f20f8100fb0 0x7f20f8101430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:31.157 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.156+0000 7f20fd5c5700 1 -- 172.21.15.76:0/1907827879 >> 172.21.15.76:0/1907827879 conn(0x7f20f80fb3f0 msgr2=0x7f20f80fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:31.157 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.156+0000 7f20fd5c5700 1 -- 172.21.15.76:0/1907827879 shutdown_connections 2024-06-02T04:49:31.157 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.156+0000 7f20fd5c5700 1 -- 172.21.15.76:0/1907827879 wait complete. 2024-06-02T04:49:31.157 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.157+0000 7f20fd5c5700 1 Processor -- start 2024-06-02T04:49:31.159 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.157+0000 7f20fd5c5700 1 -- start start 2024-06-02T04:49:31.160 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.157+0000 7f20fd5c5700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f20f80ffe60 0x7f20f806a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:31.160 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.157+0000 7f20fd5c5700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f20f8100fb0 0x7f20f819bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:31.160 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.157+0000 7f20fd5c5700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f20f8101970 0x7f20f819e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:31.160 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.157+0000 7f20fd5c5700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20f819ea00 con 0x7f20f8101970 2024-06-02T04:49:31.160 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.157+0000 7f20fd5c5700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20f819eb70 con 0x7f20f80ffe60 2024-06-02T04:49:31.160 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.157+0000 7f20fd5c5700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20f819ed30 con 0x7f20f8100fb0 2024-06-02T04:49:31.160 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.157+0000 7f20f77fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f20f8101970 0x7f20f819e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:31.160 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.157+0000 7f20f77fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f20f8101970 0x7f20f819e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:43252/0 (socket says 172.21.15.76:43252) 2024-06-02T04:49:31.160 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.157+0000 7f20f77fe700 1 -- 172.21.15.76:0/4016614846 learned_addr learned my addr 172.21.15.76:0/4016614846 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:49:31.160 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.157+0000 7f20f6ffd700 1 --2- 172.21.15.76:0/4016614846 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f20f80ffe60 0x7f20f806a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:31.160 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.157+0000 7f20f67fc700 1 --2- 172.21.15.76:0/4016614846 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f20f8100fb0 0x7f20f819bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:31.160 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.158+0000 7f20f77fe700 1 -- 172.21.15.76:0/4016614846 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f20f8100fb0 msgr2=0x7f20f819bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:31.160 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.158+0000 7f20f77fe700 1 --2- 172.21.15.76:0/4016614846 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f20f8100fb0 0x7f20f819bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:31.161 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.158+0000 7f20f77fe700 1 -- 172.21.15.76:0/4016614846 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f20f80ffe60 msgr2=0x7f20f806a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:31.161 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.158+0000 7f20f77fe700 1 --2- 172.21.15.76:0/4016614846 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f20f80ffe60 0x7f20f806a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:31.161 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.158+0000 7f20f77fe700 1 -- 172.21.15.76:0/4016614846 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20f0009d00 con 0x7f20f8101970 2024-06-02T04:49:31.161 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.158+0000 7f20f77fe700 1 --2- 172.21.15.76:0/4016614846 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f20f8101970 0x7f20f819e210 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f20f0009840 tx=0x7f20f000ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:31.161 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.158+0000 7f20effff700 1 -- 172.21.15.76:0/4016614846 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f000e040 con 0x7f20f8101970 2024-06-02T04:49:31.161 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.158+0000 7f20effff700 1 -- 172.21.15.76:0/4016614846 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f20f0004c50 con 0x7f20f8101970 2024-06-02T04:49:31.161 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.158+0000 7f20fd5c5700 1 -- 172.21.15.76:0/4016614846 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20f819ef50 con 0x7f20f8101970 2024-06-02T04:49:31.161 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.158+0000 7f20effff700 1 -- 172.21.15.76:0/4016614846 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f00052a0 con 0x7f20f8101970 2024-06-02T04:49:31.161 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.158+0000 7f20fd5c5700 1 -- 172.21.15.76:0/4016614846 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20f819f370 con 0x7f20f8101970 2024-06-02T04:49:31.161 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.159+0000 7f20fd5c5700 1 -- 172.21.15.76:0/4016614846 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20f81072d0 con 0x7f20f8101970 2024-06-02T04:49:31.162 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.160+0000 7f20effff700 1 -- 172.21.15.76:0/4016614846 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f20f001d470 con 0x7f20f8101970 2024-06-02T04:49:31.162 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.160+0000 7f20effff700 1 --2- 172.21.15.76:0/4016614846 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f20e40a11b0 0x7f20e40a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:31.162 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.161+0000 7f20effff700 1 -- 172.21.15.76:0/4016614846 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f20f00ce1f0 con 0x7f20f8101970 2024-06-02T04:49:31.162 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.161+0000 7f20f6ffd700 1 --2- 172.21.15.76:0/4016614846 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f20e40a11b0 0x7f20e40a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:31.162 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.161+0000 7f20f6ffd700 1 --2- 172.21.15.76:0/4016614846 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f20e40a11b0 0x7f20e40a3670 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f20e0005950 tx=0x7f20e000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:31.165 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.165+0000 7f20effff700 1 -- 172.21.15.76:0/4016614846 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f20f00975a0 con 0x7f20f8101970 2024-06-02T04:49:31.364 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.363+0000 7f20fd5c5700 1 -- 172.21.15.76:0/4016614846 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f20f810b620 con 0x7f20f8101970 2024-06-02T04:49:31.364 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.364+0000 7f20effff700 1 -- 172.21.15.76:0/4016614846 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v82) v1 ==== 103+0+11 (secure 0 0 0) 0x7f20f009abc0 con 0x7f20f8101970 2024-06-02T04:49:31.364 INFO:teuthology.orchestra.run.smithi076.stdout:pg_num: 32 2024-06-02T04:49:31.366 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.366+0000 7f20fd5c5700 1 -- 172.21.15.76:0/4016614846 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f20e40a11b0 msgr2=0x7f20e40a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:31.367 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.366+0000 7f20fd5c5700 1 --2- 172.21.15.76:0/4016614846 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f20e40a11b0 0x7f20e40a3670 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f20e0005950 tx=0x7f20e000b410 comp rx=0 tx=0).stop 2024-06-02T04:49:31.367 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.366+0000 7f20fd5c5700 1 -- 172.21.15.76:0/4016614846 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f20f8101970 msgr2=0x7f20f819e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:31.367 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.366+0000 7f20fd5c5700 1 --2- 172.21.15.76:0/4016614846 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f20f8101970 0x7f20f819e210 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f20f0009840 tx=0x7f20f000ba50 comp rx=0 tx=0).stop 2024-06-02T04:49:31.367 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.366+0000 7f20fd5c5700 1 -- 172.21.15.76:0/4016614846 shutdown_connections 2024-06-02T04:49:31.367 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.366+0000 7f20fd5c5700 1 --2- 172.21.15.76:0/4016614846 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f20f8101970 0x7f20f819e210 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:31.367 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.366+0000 7f20fd5c5700 1 --2- 172.21.15.76:0/4016614846 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f20e40a11b0 0x7f20e40a3670 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:31.367 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.366+0000 7f20fd5c5700 1 --2- 172.21.15.76:0/4016614846 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f20f80ffe60 0x7f20f806a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:31.367 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.366+0000 7f20fd5c5700 1 --2- 172.21.15.76:0/4016614846 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f20f8100fb0 0x7f20f819bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:31.367 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.366+0000 7f20fd5c5700 1 -- 172.21.15.76:0/4016614846 >> 172.21.15.76:0/4016614846 conn(0x7f20f80fb3f0 msgr2=0x7f20f8104410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:31.367 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.366+0000 7f20fd5c5700 1 -- 172.21.15.76:0/4016614846 shutdown_connections 2024-06-02T04:49:31.367 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.366+0000 7f20fd5c5700 1 -- 172.21.15.76:0/4016614846 wait complete. 2024-06-02T04:49:31.378 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:31 smithi076 ceph-mon[42935]: pgmap v264: 129 pgs: 129 active+clean; 639 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-06-02T04:49:31.378 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:31 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/1733723764' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-02T04:49:31.378 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:31 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/3533983156' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-06-02T04:49:31.378 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:31 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/740968712' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-06-02T04:49:31.379 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T04:49:31.505 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.503+0000 7f92ea02d700 1 -- 172.21.15.76:0/3824440813 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f92e4104220 msgr2=0x7f92e4106610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:31.505 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.503+0000 7f92ea02d700 1 --2- 172.21.15.76:0/3824440813 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f92e4104220 0x7f92e4106610 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f92d4009990 tx=0x7f92d4009ca0 comp rx=0 tx=0).stop 2024-06-02T04:49:31.505 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.503+0000 7f92ea02d700 1 -- 172.21.15.76:0/3824440813 shutdown_connections 2024-06-02T04:49:31.505 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.503+0000 7f92ea02d700 1 --2- 172.21.15.76:0/3824440813 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92e4106b50 0x7f92e4108fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:31.505 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.503+0000 7f92ea02d700 1 --2- 172.21.15.76:0/3824440813 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f92e41018f0 0x7f92e4103ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:31.506 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.503+0000 7f92ea02d700 1 --2- 172.21.15.76:0/3824440813 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f92e4104220 0x7f92e4106610 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:31.506 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.503+0000 7f92ea02d700 1 -- 172.21.15.76:0/3824440813 >> 172.21.15.76:0/3824440813 conn(0x7f92e40fb2e0 msgr2=0x7f92e40fd720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:31.506 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.503+0000 7f92ea02d700 1 -- 172.21.15.76:0/3824440813 shutdown_connections 2024-06-02T04:49:31.506 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.503+0000 7f92ea02d700 1 -- 172.21.15.76:0/3824440813 wait complete. 2024-06-02T04:49:31.506 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.503+0000 7f92ea02d700 1 Processor -- start 2024-06-02T04:49:31.506 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.503+0000 7f92ea02d700 1 -- start start 2024-06-02T04:49:31.506 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.504+0000 7f92ea02d700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92e41018f0 0x7f92e4196c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:31.506 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.504+0000 7f92ea02d700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f92e4104220 0x7f92e41971c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:31.506 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.504+0000 7f92ea02d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f92e4106b50 0x7f92e419e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:31.506 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.504+0000 7f92ea02d700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92e419e770 con 0x7f92e4104220 2024-06-02T04:49:31.506 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.504+0000 7f92ea02d700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92e419e8e0 con 0x7f92e41018f0 2024-06-02T04:49:31.507 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.504+0000 7f92ea02d700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92e419eaa0 con 0x7f92e4106b50 2024-06-02T04:49:31.507 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.504+0000 7f92e2ffd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f92e4104220 0x7f92e41971c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:31.507 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.504+0000 7f92e2ffd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f92e4104220 0x7f92e41971c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:43272/0 (socket says 172.21.15.76:43272) 2024-06-02T04:49:31.507 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.504+0000 7f92e2ffd700 1 -- 172.21.15.76:0/419089219 learned_addr learned my addr 172.21.15.76:0/419089219 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:49:31.507 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.504+0000 7f92e37fe700 1 --2- 172.21.15.76:0/419089219 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92e41018f0 0x7f92e4196c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:31.507 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.504+0000 7f92e3fff700 1 --2- 172.21.15.76:0/419089219 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f92e4106b50 0x7f92e419e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:31.507 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.504+0000 7f92e2ffd700 1 -- 172.21.15.76:0/419089219 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f92e4106b50 msgr2=0x7f92e419e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:31.507 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.504+0000 7f92e2ffd700 1 --2- 172.21.15.76:0/419089219 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f92e4106b50 0x7f92e419e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:31.507 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.504+0000 7f92e2ffd700 1 -- 172.21.15.76:0/419089219 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92e41018f0 msgr2=0x7f92e4196c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:31.507 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.504+0000 7f92e2ffd700 1 --2- 172.21.15.76:0/419089219 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92e41018f0 0x7f92e4196c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:31.507 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.504+0000 7f92e2ffd700 1 -- 172.21.15.76:0/419089219 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92d40095f0 con 0x7f92e4104220 2024-06-02T04:49:31.507 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.504+0000 7f92e2ffd700 1 --2- 172.21.15.76:0/419089219 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f92e4104220 0x7f92e41971c0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f92d4000c00 tx=0x7f92d4003b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:31.508 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.504+0000 7f92e0ff9700 1 -- 172.21.15.76:0/419089219 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92d401d070 con 0x7f92e4104220 2024-06-02T04:49:31.508 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.504+0000 7f92ea02d700 1 -- 172.21.15.76:0/419089219 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92e419ed20 con 0x7f92e4104220 2024-06-02T04:49:31.508 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.504+0000 7f92e0ff9700 1 -- 172.21.15.76:0/419089219 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f92d400bd70 con 0x7f92e4104220 2024-06-02T04:49:31.508 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.504+0000 7f92e0ff9700 1 -- 172.21.15.76:0/419089219 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92d4022d20 con 0x7f92e4104220 2024-06-02T04:49:31.508 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.504+0000 7f92ea02d700 1 -- 172.21.15.76:0/419089219 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92e419f140 con 0x7f92e4104220 2024-06-02T04:49:31.509 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.505+0000 7f92ea02d700 1 -- 172.21.15.76:0/419089219 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92e40fce60 con 0x7f92e4104220 2024-06-02T04:49:31.509 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.507+0000 7f92e0ff9700 1 -- 172.21.15.76:0/419089219 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f92d4022470 con 0x7f92e4104220 2024-06-02T04:49:31.509 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.507+0000 7f92e0ff9700 1 --2- 172.21.15.76:0/419089219 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f92d00a11b0 0x7f92d00a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:31.509 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.507+0000 7f92e37fe700 1 --2- 172.21.15.76:0/419089219 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f92d00a11b0 0x7f92d00a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:31.509 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.507+0000 7f92e0ff9700 1 -- 172.21.15.76:0/419089219 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f92d40ceb20 con 0x7f92e4104220 2024-06-02T04:49:31.509 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.508+0000 7f92e37fe700 1 --2- 172.21.15.76:0/419089219 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f92d00a11b0 0x7f92d00a3670 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f92cc005ea0 tx=0x7f92cc005e30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:31.511 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.511+0000 7f92e0ff9700 1 -- 172.21.15.76:0/419089219 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f92d4097ed0 con 0x7f92e4104220 2024-06-02T04:49:31.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:31 smithi119 ceph-mon[46633]: pgmap v264: 129 pgs: 129 active+clean; 639 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-06-02T04:49:31.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:31 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/1733723764' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-02T04:49:31.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:31 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/3533983156' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-06-02T04:49:31.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:31 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/740968712' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-06-02T04:49:31.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:31 smithi192 ceph-mon[47933]: pgmap v264: 129 pgs: 129 active+clean; 639 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-06-02T04:49:31.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:31 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/1733723764' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-02T04:49:31.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:31 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/3533983156' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-06-02T04:49:31.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:31 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/740968712' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-06-02T04:49:31.753 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.753+0000 7f92ea02d700 1 -- 172.21.15.76:0/419089219 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f92e4067380 con 0x7f92e4104220 2024-06-02T04:49:31.754 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.754+0000 7f92e0ff9700 1 -- 172.21.15.76:0/419089219 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+10874 (secure 0 0 0) 0x7f92d409b4f0 con 0x7f92e4104220 2024-06-02T04:49:31.754 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:49:31.754 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6835/3029342152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3029342152},{"type":"v1","addr":"172.21.15.76:6835","nonce":3029342152}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6837/1207985317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":1207985317},{"type":"v1","addr":"172.21.15.76:6837","nonce":1207985317}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14607,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6839/928709755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":928709755},{"type":"v1","addr":"172.21.15.76:6839","nonce":928709755}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6841/4162178633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6840","nonce":4162178633},{"type":"v1","addr":"172.21.15.76:6841","nonce":4162178633}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/1543944863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":1543944863},{"type":"v1","addr":"172.21.15.119:6833","nonce":1543944863}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24418,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6833/1527921393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1527921393},{"type":"v1","addr":"172.21.15.192:6833","nonce":1527921393}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-02T04:48:02.662812+0000","modified":"2024-06-02T04:48:28.274836+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24491,"mds_1":24475,"mds_2":24463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24434":{"gid":24434,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6835/2746840347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":2746840347},{"type":"v1","addr":"172.21.15.119:6835","nonce":2746840347}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24451":{"gid":24451,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.192:6835/783181340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":783181340},{"type":"v1","addr":"172.21.15.192:6835","nonce":783181340}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24458":{"gid":24458,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6837/2171687478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":2171687478},{"type":"v1","addr":"172.21.15.119:6837","nonce":2171687478}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24463":{"gid":24463,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":11,"addr":"172.21.15.192:6837/960773710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":960773710},{"type":"v1","addr":"172.21.15.192:6837","nonce":960773710}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24475":{"gid":24475,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.192:6839/3978681402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":3978681402},{"type":"v1","addr":"172.21.15.192:6839","nonce":3978681402}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.119:6839/4098406903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":4098406903},{"type":"v1","addr":"172.21.15.119:6839","nonce":4098406903}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-06-02T04:49:31.756 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.756+0000 7f92ea02d700 1 -- 172.21.15.76:0/419089219 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f92d00a11b0 msgr2=0x7f92d00a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:31.756 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.756+0000 7f92ea02d700 1 --2- 172.21.15.76:0/419089219 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f92d00a11b0 0x7f92d00a3670 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f92cc005ea0 tx=0x7f92cc005e30 comp rx=0 tx=0).stop 2024-06-02T04:49:31.756 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.756+0000 7f92ea02d700 1 -- 172.21.15.76:0/419089219 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f92e4104220 msgr2=0x7f92e41971c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:31.756 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.756+0000 7f92ea02d700 1 --2- 172.21.15.76:0/419089219 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f92e4104220 0x7f92e41971c0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f92d4000c00 tx=0x7f92d4003b00 comp rx=0 tx=0).stop 2024-06-02T04:49:31.756 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.756+0000 7f92ea02d700 1 -- 172.21.15.76:0/419089219 shutdown_connections 2024-06-02T04:49:31.757 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.756+0000 7f92ea02d700 1 --2- 172.21.15.76:0/419089219 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f92e4106b50 0x7f92e419e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:31.757 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.756+0000 7f92ea02d700 1 --2- 172.21.15.76:0/419089219 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f92d00a11b0 0x7f92d00a3670 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:31.757 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.756+0000 7f92ea02d700 1 --2- 172.21.15.76:0/419089219 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92e41018f0 0x7f92e4196c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:31.757 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.756+0000 7f92ea02d700 1 --2- 172.21.15.76:0/419089219 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f92e4104220 0x7f92e41971c0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:31.757 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.756+0000 7f92ea02d700 1 -- 172.21.15.76:0/419089219 >> 172.21.15.76:0/419089219 conn(0x7f92e40fb2e0 msgr2=0x7f92e41037c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:31.757 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.756+0000 7f92ea02d700 1 -- 172.21.15.76:0/419089219 shutdown_connections 2024-06-02T04:49:31.757 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.756+0000 7f92ea02d700 1 -- 172.21.15.76:0/419089219 wait complete. 2024-06-02T04:49:31.757 INFO:teuthology.orchestra.run.smithi076.stderr:dumped fsmap epoch 24 2024-06-02T04:49:31.769 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-02T04:49:31.891 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.891+0000 7fcfe4923700 1 -- 172.21.15.76:0/1299060056 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcfe0100f80 msgr2=0x7fcfe01013e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:31.891 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.891+0000 7fcfe4923700 1 --2- 172.21.15.76:0/1299060056 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcfe0100f80 0x7fcfe01013e0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fcfd40099c0 tx=0x7fcfd4009cd0 comp rx=0 tx=0).stop 2024-06-02T04:49:31.892 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.891+0000 7fcfe4923700 1 -- 172.21.15.76:0/1299060056 shutdown_connections 2024-06-02T04:49:31.892 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.891+0000 7fcfe4923700 1 --2- 172.21.15.76:0/1299060056 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcfe0101920 0x7fcfe01081d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:31.892 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.891+0000 7fcfe4923700 1 --2- 172.21.15.76:0/1299060056 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcfe00ffd90 0x7fcfe01001b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:31.892 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.891+0000 7fcfe4923700 1 --2- 172.21.15.76:0/1299060056 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcfe0100f80 0x7fcfe01013e0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:31.892 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.891+0000 7fcfe4923700 1 -- 172.21.15.76:0/1299060056 >> 172.21.15.76:0/1299060056 conn(0x7fcfe00fb300 msgr2=0x7fcfe00fd740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:31.892 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.891+0000 7fcfe4923700 1 -- 172.21.15.76:0/1299060056 shutdown_connections 2024-06-02T04:49:31.892 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.891+0000 7fcfe4923700 1 -- 172.21.15.76:0/1299060056 wait complete. 2024-06-02T04:49:31.894 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.892+0000 7fcfe4923700 1 Processor -- start 2024-06-02T04:49:31.894 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.892+0000 7fcfe4923700 1 -- start start 2024-06-02T04:49:31.894 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.892+0000 7fcfe4923700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcfe00ffd90 0x7fcfe0195be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:31.895 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.892+0000 7fcfe4923700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcfe0100f80 0x7fcfe0196120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:31.895 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.892+0000 7fcfe4923700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcfe0101920 0x7fcfe019d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:31.895 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.892+0000 7fcfe4923700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe019d710 con 0x7fcfe0101920 2024-06-02T04:49:31.895 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.892+0000 7fcfe4923700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe019d850 con 0x7fcfe00ffd90 2024-06-02T04:49:31.895 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.892+0000 7fcfe4923700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe019d9e0 con 0x7fcfe0100f80 2024-06-02T04:49:31.895 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.892+0000 7fcfded9d700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcfe0101920 0x7fcfe019d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:31.895 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.892+0000 7fcfded9d700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcfe0101920 0x7fcfe019d140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:43296/0 (socket says 172.21.15.76:43296) 2024-06-02T04:49:31.895 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.892+0000 7fcfded9d700 1 -- 172.21.15.76:0/878261952 learned_addr learned my addr 172.21.15.76:0/878261952 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:49:31.895 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.892+0000 7fcfddd9b700 1 --2- 172.21.15.76:0/878261952 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcfe0100f80 0x7fcfe0196120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:31.895 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.892+0000 7fcfde59c700 1 --2- 172.21.15.76:0/878261952 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcfe00ffd90 0x7fcfe0195be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:31.895 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.892+0000 7fcfded9d700 1 -- 172.21.15.76:0/878261952 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcfe0100f80 msgr2=0x7fcfe0196120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:31.895 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.892+0000 7fcfded9d700 1 --2- 172.21.15.76:0/878261952 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcfe0100f80 0x7fcfe0196120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:31.895 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.892+0000 7fcfded9d700 1 -- 172.21.15.76:0/878261952 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcfe00ffd90 msgr2=0x7fcfe0195be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:31.896 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.892+0000 7fcfded9d700 1 --2- 172.21.15.76:0/878261952 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcfe00ffd90 0x7fcfe0195be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:31.896 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.892+0000 7fcfded9d700 1 -- 172.21.15.76:0/878261952 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfd40095f0 con 0x7fcfe0101920 2024-06-02T04:49:31.896 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.893+0000 7fcfded9d700 1 --2- 172.21.15.76:0/878261952 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcfe0101920 0x7fcfe019d140 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fcfd8007d70 tx=0x7fcfd800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:31.896 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.893+0000 7fcfcf7fe700 1 -- 172.21.15.76:0/878261952 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd800ac90 con 0x7fcfe0101920 2024-06-02T04:49:31.896 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.893+0000 7fcfcf7fe700 1 -- 172.21.15.76:0/878261952 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcfd800adf0 con 0x7fcfe0101920 2024-06-02T04:49:31.896 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.893+0000 7fcfcf7fe700 1 -- 172.21.15.76:0/878261952 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd80115e0 con 0x7fcfe0101920 2024-06-02T04:49:31.896 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.893+0000 7fcfe4923700 1 -- 172.21.15.76:0/878261952 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfe019dcc0 con 0x7fcfe0101920 2024-06-02T04:49:31.896 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.893+0000 7fcfe4923700 1 -- 172.21.15.76:0/878261952 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfe019e180 con 0x7fcfe0101920 2024-06-02T04:49:31.896 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.894+0000 7fcfe4923700 1 -- 172.21.15.76:0/878261952 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfe0107210 con 0x7fcfe0101920 2024-06-02T04:49:31.897 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.895+0000 7fcfcf7fe700 1 -- 172.21.15.76:0/878261952 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fcfd8012420 con 0x7fcfe0101920 2024-06-02T04:49:31.897 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.896+0000 7fcfcf7fe700 1 --2- 172.21.15.76:0/878261952 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fcfc80a11b0 0x7fcfc80a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:31.897 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.896+0000 7fcfde59c700 1 --2- 172.21.15.76:0/878261952 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fcfc80a11b0 0x7fcfc80a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:31.897 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.896+0000 7fcfcf7fe700 1 -- 172.21.15.76:0/878261952 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fcfd80cce90 con 0x7fcfe0101920 2024-06-02T04:49:31.897 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.896+0000 7fcfde59c700 1 --2- 172.21.15.76:0/878261952 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fcfc80a11b0 0x7fcfc80a3670 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fcfe0100de0 tx=0x7fcfd000a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:31.902 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:31.900+0000 7fcfcf7fe700 1 -- 172.21.15.76:0/878261952 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fcfd8096260 con 0x7fcfe0101920 2024-06-02T04:49:32.100 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.100+0000 7fcfe4923700 1 -- 172.21.15.76:0/878261952 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcfe010b630 con 0x7fcfe0101920 2024-06-02T04:49:32.101 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.101+0000 7fcfcf7fe700 1 -- 172.21.15.76:0/878261952 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+24453 (secure 0 0 0) 0x7fcfd8099880 con 0x7fcfe0101920 2024-06-02T04:49:32.102 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:49:32.102 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":82,"fsid":"60ab6d30-209a-11ef-bc9b-c7b262605968","created":"2024-06-02T04:42:21.007333+0000","modified":"2024-06-02T04:49:07.862801+0000","last_up_change":"2024-06-02T04:47:29.822242+0000","last_in_change":"2024-06-02T04:47:14.253449+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T04:44:56.408602+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-02T04:48:01.194954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-02T04:48:01.828863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-02T04:48:04.916565+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"33a51ba2-be5c-41d0-b5d1-8d6039f2ca4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6802","nonce":2869602045},{"type":"v1","addr":"172.21.15.76:6803","nonce":2869602045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6804","nonce":2869602045},{"type":"v1","addr":"172.21.15.76:6805","nonce":2869602045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6808","nonce":2869602045},{"type":"v1","addr":"172.21.15.76:6809","nonce":2869602045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6806","nonce":2869602045},{"type":"v1","addr":"172.21.15.76:6807","nonce":2869602045}]},"public_addr":"172.21.15.76:6803/2869602045","cluster_addr":"172.21.15.76:6805/2869602045","heartbeat_back_addr":"172.21.15.76:6809/2869602045","heartbeat_front_addr":"172.21.15.76:6807/2869602045","state":["exists","up"]},{"osd":1,"uuid":"ace46e13-3bb7-4103-973a-6860554df8b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":2353738098},{"type":"v1","addr":"172.21.15.119:6801","nonce":2353738098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":2353738098},{"type":"v1","addr":"172.21.15.119:6803","nonce":2353738098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":2353738098},{"type":"v1","addr":"172.21.15.119:6807","nonce":2353738098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":2353738098},{"type":"v1","addr":"172.21.15.119:6805","nonce":2353738098}]},"public_addr":"172.21.15.119:6801/2353738098","cluster_addr":"172.21.15.119:6803/2353738098","heartbeat_back_addr":"172.21.15.119:6807/2353738098","heartbeat_front_addr":"172.21.15.119:6805/2353738098","state":["exists","up"]},{"osd":2,"uuid":"4addc09e-77a9-428a-bcc4-38194f486cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":3206918546},{"type":"v1","addr":"172.21.15.192:6801","nonce":3206918546}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":3206918546},{"type":"v1","addr":"172.21.15.192:6803","nonce":3206918546}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":3206918546},{"type":"v1","addr":"172.21.15.192:6807","nonce":3206918546}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":3206918546},{"type":"v1","addr":"172.21.15.192:6805","nonce":3206918546}]},"public_addr":"172.21.15.192:6801/3206918546","cluster_addr":"172.21.15.192:6803/3206918546","heartbeat_back_addr":"172.21.15.192:6807/3206918546","heartbeat_front_addr":"172.21.15.192:6805/3206918546","state":["exists","up"]},{"osd":3,"uuid":"dc525518-82c6-49ed-8ca8-e3bd5bfc18d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6810","nonce":3747864233},{"type":"v1","addr":"172.21.15.76:6811","nonce":3747864233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6812","nonce":3747864233},{"type":"v1","addr":"172.21.15.76:6813","nonce":3747864233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6816","nonce":3747864233},{"type":"v1","addr":"172.21.15.76:6817","nonce":3747864233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6814","nonce":3747864233},{"type":"v1","addr":"172.21.15.76:6815","nonce":3747864233}]},"public_addr":"172.21.15.76:6811/3747864233","cluster_addr":"172.21.15.76:6813/3747864233","heartbeat_back_addr":"172.21.15.76:6817/3747864233","heartbeat_front_addr":"172.21.15.76:6815/3747864233","state":["exists","up"]},{"osd":4,"uuid":"eef293d0-cb87-47b3-9751-c6437a1cf079","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":2571629047},{"type":"v1","addr":"172.21.15.119:6809","nonce":2571629047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":2571629047},{"type":"v1","addr":"172.21.15.119:6811","nonce":2571629047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":2571629047},{"type":"v1","addr":"172.21.15.119:6815","nonce":2571629047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":2571629047},{"type":"v1","addr":"172.21.15.119:6813","nonce":2571629047}]},"public_addr":"172.21.15.119:6809/2571629047","cluster_addr":"172.21.15.119:6811/2571629047","heartbeat_back_addr":"172.21.15.119:6815/2571629047","heartbeat_front_addr":"172.21.15.119:6813/2571629047","state":["exists","up"]},{"osd":5,"uuid":"60eb8c6e-766c-49d0-9997-44f85776b3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3285065416},{"type":"v1","addr":"172.21.15.192:6809","nonce":3285065416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":3285065416},{"type":"v1","addr":"172.21.15.192:6811","nonce":3285065416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3285065416},{"type":"v1","addr":"172.21.15.192:6815","nonce":3285065416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":3285065416},{"type":"v1","addr":"172.21.15.192:6813","nonce":3285065416}]},"public_addr":"172.21.15.192:6809/3285065416","cluster_addr":"172.21.15.192:6811/3285065416","heartbeat_back_addr":"172.21.15.192:6815/3285065416","heartbeat_front_addr":"172.21.15.192:6813/3285065416","state":["exists","up"]},{"osd":6,"uuid":"e6dc8b9d-dd06-4870-a506-def8201b7e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6818","nonce":2951381580},{"type":"v1","addr":"172.21.15.76:6819","nonce":2951381580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6820","nonce":2951381580},{"type":"v1","addr":"172.21.15.76:6821","nonce":2951381580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6824","nonce":2951381580},{"type":"v1","addr":"172.21.15.76:6825","nonce":2951381580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6822","nonce":2951381580},{"type":"v1","addr":"172.21.15.76:6823","nonce":2951381580}]},"public_addr":"172.21.15.76:6819/2951381580","cluster_addr":"172.21.15.76:6821/2951381580","heartbeat_back_addr":"172.21.15.76:6825/2951381580","heartbeat_front_addr":"172.21.15.76:6823/2951381580","state":["exists","up"]},{"osd":7,"uuid":"2f5dccb3-39a1-4f25-8715-fa264d59db97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1802558756},{"type":"v1","addr":"172.21.15.119:6817","nonce":1802558756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1802558756},{"type":"v1","addr":"172.21.15.119:6819","nonce":1802558756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1802558756},{"type":"v1","addr":"172.21.15.119:6823","nonce":1802558756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1802558756},{"type":"v1","addr":"172.21.15.119:6821","nonce":1802558756}]},"public_addr":"172.21.15.119:6817/1802558756","cluster_addr":"172.21.15.119:6819/1802558756","heartbeat_back_addr":"172.21.15.119:6823/1802558756","heartbeat_front_addr":"172.21.15.119:6821/1802558756","state":["exists","up"]},{"osd":8,"uuid":"39b6ccd0-16e7-4cd5-87e0-d827e9172984","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":1214972276},{"type":"v1","addr":"172.21.15.192:6817","nonce":1214972276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":1214972276},{"type":"v1","addr":"172.21.15.192:6819","nonce":1214972276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":1214972276},{"type":"v1","addr":"172.21.15.192:6823","nonce":1214972276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":1214972276},{"type":"v1","addr":"172.21.15.192:6821","nonce":1214972276}]},"public_addr":"172.21.15.192:6817/1214972276","cluster_addr":"172.21.15.192:6819/1214972276","heartbeat_back_addr":"172.21.15.192:6823/1214972276","heartbeat_front_addr":"172.21.15.192:6821/1214972276","state":["exists","up"]},{"osd":9,"uuid":"851b2155-07bd-45de-bfe0-53021fda733f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6826","nonce":3095501821},{"type":"v1","addr":"172.21.15.76:6827","nonce":3095501821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6828","nonce":3095501821},{"type":"v1","addr":"172.21.15.76:6829","nonce":3095501821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":3095501821},{"type":"v1","addr":"172.21.15.76:6833","nonce":3095501821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6830","nonce":3095501821},{"type":"v1","addr":"172.21.15.76:6831","nonce":3095501821}]},"public_addr":"172.21.15.76:6827/3095501821","cluster_addr":"172.21.15.76:6829/3095501821","heartbeat_back_addr":"172.21.15.76:6833/3095501821","heartbeat_front_addr":"172.21.15.76:6831/3095501821","state":["exists","up"]},{"osd":10,"uuid":"e4b18e7e-bddf-4dd4-84f6-7902ea327cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":4082130894},{"type":"v1","addr":"172.21.15.119:6825","nonce":4082130894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":4082130894},{"type":"v1","addr":"172.21.15.119:6827","nonce":4082130894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":4082130894},{"type":"v1","addr":"172.21.15.119:6831","nonce":4082130894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":4082130894},{"type":"v1","addr":"172.21.15.119:6829","nonce":4082130894}]},"public_addr":"172.21.15.119:6825/4082130894","cluster_addr":"172.21.15.119:6827/4082130894","heartbeat_back_addr":"172.21.15.119:6831/4082130894","heartbeat_front_addr":"172.21.15.119:6829/4082130894","state":["exists","up"]},{"osd":11,"uuid":"54567e18-920c-4ae9-9557-0efba5a1a820","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":439693921},{"type":"v1","addr":"172.21.15.192:6825","nonce":439693921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":439693921},{"type":"v1","addr":"172.21.15.192:6827","nonce":439693921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":439693921},{"type":"v1","addr":"172.21.15.192:6831","nonce":439693921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":439693921},{"type":"v1","addr":"172.21.15.192:6829","nonce":439693921}]},"public_addr":"172.21.15.192:6825/439693921","cluster_addr":"172.21.15.192:6827/439693921","heartbeat_back_addr":"172.21.15.192:6831/439693921","heartbeat_front_addr":"172.21.15.192:6829/439693921","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:44:19.922390+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:44:36.895563+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:44:53.699019+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:45:11.167404+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:45:27.955899+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:45:44.850368+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:46:02.003588+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:46:19.019217+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:46:36.189670+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:46:53.919365+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:47:11.563053+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:47:28.822443+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":4}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.8","mappings":[{"from":5,"to":10}]},{"pgid":"4.14","mappings":[{"from":9,"to":8}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.76:6801/4200406736":"2024-06-03T04:43:06.092916+0000","172.21.15.76:6800/4200406736":"2024-06-03T04:43:06.092916+0000","172.21.15.76:0/1524144593":"2024-06-03T04:43:06.092916+0000","172.21.15.76:0/3269372590":"2024-06-03T04:43:06.092916+0000","172.21.15.76:0/3570893846":"2024-06-03T04:42:44.872236+0000","172.21.15.76:0/902035790":"2024-06-03T04:43:06.092916+0000","172.21.15.76:6800/2550846765":"2024-06-03T04:42:44.872236+0000","172.21.15.76:6801/2550846765":"2024-06-03T04:42:44.872236+0000","172.21.15.76:0/2646712763":"2024-06-03T04:42:44.872236+0000","172.21.15.76:0/964578813":"2024-06-03T04:42:44.872236+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T04:49:32.107 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.103+0000 7fcfe4923700 1 -- 172.21.15.76:0/878261952 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fcfc80a11b0 msgr2=0x7fcfc80a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:32.107 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.103+0000 7fcfe4923700 1 --2- 172.21.15.76:0/878261952 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fcfc80a11b0 0x7fcfc80a3670 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fcfe0100de0 tx=0x7fcfd000a380 comp rx=0 tx=0).stop 2024-06-02T04:49:32.107 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.103+0000 7fcfe4923700 1 -- 172.21.15.76:0/878261952 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcfe0101920 msgr2=0x7fcfe019d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:32.107 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.103+0000 7fcfe4923700 1 --2- 172.21.15.76:0/878261952 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcfe0101920 0x7fcfe019d140 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fcfd8007d70 tx=0x7fcfd800a340 comp rx=0 tx=0).stop 2024-06-02T04:49:32.107 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.103+0000 7fcfe4923700 1 -- 172.21.15.76:0/878261952 shutdown_connections 2024-06-02T04:49:32.107 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.103+0000 7fcfe4923700 1 --2- 172.21.15.76:0/878261952 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcfe0101920 0x7fcfe019d140 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:32.107 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.103+0000 7fcfe4923700 1 --2- 172.21.15.76:0/878261952 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fcfc80a11b0 0x7fcfc80a3670 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:32.108 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.103+0000 7fcfe4923700 1 --2- 172.21.15.76:0/878261952 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcfe00ffd90 0x7fcfe0195be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:32.108 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.103+0000 7fcfe4923700 1 --2- 172.21.15.76:0/878261952 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcfe0100f80 0x7fcfe0196120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:32.108 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.103+0000 7fcfe4923700 1 -- 172.21.15.76:0/878261952 >> 172.21.15.76:0/878261952 conn(0x7fcfe00fb300 msgr2=0x7fcfe0104350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:32.108 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.103+0000 7fcfe4923700 1 -- 172.21.15.76:0/878261952 shutdown_connections 2024-06-02T04:49:32.108 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.104+0000 7fcfe4923700 1 -- 172.21.15.76:0/878261952 wait complete. 2024-06-02T04:49:32.117 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-06-02T04:48:02.662812+0000', 'modified': '2024-06-02T04:48:28.274836+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24491, 'mds_1': 24475, 'mds_2': 24463}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24434': {'gid': 24434, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.119:6835/2746840347', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.119:6834', 'nonce': 2746840347}, {'type': 'v1', 'addr': '172.21.15.119:6835', 'nonce': 2746840347}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24451': {'gid': 24451, 'name': 'f', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.192:6835/783181340', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.192:6834', 'nonce': 783181340}, {'type': 'v1', 'addr': '172.21.15.192:6835', 'nonce': 783181340}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24458': {'gid': 24458, 'name': 'h', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.119:6837/2171687478', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.119:6836', 'nonce': 2171687478}, {'type': 'v1', 'addr': '172.21.15.119:6837', 'nonce': 2171687478}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24463': {'gid': 24463, 'name': 'c', 'rank': 2, 'incarnation': 22, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.192:6837/960773710', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.192:6836', 'nonce': 960773710}, {'type': 'v1', 'addr': '172.21.15.192:6837', 'nonce': 960773710}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24475': {'gid': 24475, 'name': 'i', 'rank': 1, 'incarnation': 20, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.192:6839/3978681402', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.192:6838', 'nonce': 3978681402}, {'type': 'v1', 'addr': '172.21.15.192:6839', 'nonce': 3978681402}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24491': {'gid': 24491, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.119:6839/4098406903', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.119:6838', 'nonce': 4098406903}, {'type': 'v1', 'addr': '172.21.15.119:6839', 'nonce': 4098406903}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-06-02T04:49:32.117 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-06-02T04:49:32.117 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-06-02T04:49:32.243 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.240+0000 7fb9f5dec700 1 -- 172.21.15.76:0/4176601964 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb9f0101a00 msgr2=0x7fb9f0103df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:32.243 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.240+0000 7fb9f5dec700 1 --2- 172.21.15.76:0/4176601964 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb9f0101a00 0x7fb9f0103df0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fb9e0009990 tx=0x7fb9e0009ca0 comp rx=0 tx=0).stop 2024-06-02T04:49:32.243 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.240+0000 7fb9f5dec700 1 -- 172.21.15.76:0/4176601964 shutdown_connections 2024-06-02T04:49:32.243 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.240+0000 7fb9f5dec700 1 --2- 172.21.15.76:0/4176601964 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb9f0106c60 0x7fb9f01090d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:32.243 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.240+0000 7fb9f5dec700 1 --2- 172.21.15.76:0/4176601964 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb9f0101a00 0x7fb9f0103df0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:32.243 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.240+0000 7fb9f5dec700 1 --2- 172.21.15.76:0/4176601964 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb9f0104330 0x7fb9f0106720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:32.243 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.240+0000 7fb9f5dec700 1 -- 172.21.15.76:0/4176601964 >> 172.21.15.76:0/4176601964 conn(0x7fb9f00fb3f0 msgr2=0x7fb9f00fd830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:32.243 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.240+0000 7fb9f5dec700 1 -- 172.21.15.76:0/4176601964 shutdown_connections 2024-06-02T04:49:32.243 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.240+0000 7fb9f5dec700 1 -- 172.21.15.76:0/4176601964 wait complete. 2024-06-02T04:49:32.243 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.241+0000 7fb9f5dec700 1 Processor -- start 2024-06-02T04:49:32.244 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.241+0000 7fb9f5dec700 1 -- start start 2024-06-02T04:49:32.244 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.241+0000 7fb9f5dec700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb9f0101a00 0x7fb9f0196e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:32.244 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.241+0000 7fb9f5dec700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb9f0104330 0x7fb9f0197370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:32.244 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.241+0000 7fb9f5dec700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb9f0106c60 0x7fb9f019e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:32.244 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.241+0000 7fb9f5dec700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f019e960 con 0x7fb9f0106c60 2024-06-02T04:49:32.244 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.241+0000 7fb9f5dec700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f019eaa0 con 0x7fb9f0104330 2024-06-02T04:49:32.244 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.241+0000 7fb9f5dec700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f019ec30 con 0x7fb9f0101a00 2024-06-02T04:49:32.244 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.241+0000 7fb9effff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb9f0106c60 0x7fb9f019e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:32.244 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.241+0000 7fb9effff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb9f0106c60 0x7fb9f019e390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:54800/0 (socket says 172.21.15.76:54800) 2024-06-02T04:49:32.244 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.241+0000 7fb9effff700 1 -- 172.21.15.76:0/3005169970 learned_addr learned my addr 172.21.15.76:0/3005169970 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:49:32.244 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.242+0000 7fb9ef7fe700 1 --2- 172.21.15.76:0/3005169970 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb9f0101a00 0x7fb9f0196e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:32.244 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.242+0000 7fb9eeffd700 1 --2- 172.21.15.76:0/3005169970 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb9f0104330 0x7fb9f0197370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:32.244 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.242+0000 7fb9effff700 1 -- 172.21.15.76:0/3005169970 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb9f0101a00 msgr2=0x7fb9f0196e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:32.244 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.242+0000 7fb9effff700 1 --2- 172.21.15.76:0/3005169970 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb9f0101a00 0x7fb9f0196e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:32.245 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.242+0000 7fb9effff700 1 -- 172.21.15.76:0/3005169970 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb9f0104330 msgr2=0x7fb9f0197370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:32.245 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.242+0000 7fb9effff700 1 --2- 172.21.15.76:0/3005169970 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb9f0104330 0x7fb9f0197370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:32.245 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.242+0000 7fb9effff700 1 -- 172.21.15.76:0/3005169970 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9e00095f0 con 0x7fb9f0106c60 2024-06-02T04:49:32.245 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.242+0000 7fb9eeffd700 1 --2- 172.21.15.76:0/3005169970 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb9f0104330 0x7fb9f0197370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:49:32.245 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.242+0000 7fb9effff700 1 --2- 172.21.15.76:0/3005169970 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb9f0106c60 0x7fb9f019e390 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fb9e8007ee0 tx=0x7fb9e800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:32.245 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.242+0000 7fb9ecff9700 1 -- 172.21.15.76:0/3005169970 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e8017070 con 0x7fb9f0106c60 2024-06-02T04:49:32.245 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.242+0000 7fb9ecff9700 1 -- 172.21.15.76:0/3005169970 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb9e800f040 con 0x7fb9f0106c60 2024-06-02T04:49:32.245 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.242+0000 7fb9f5dec700 1 -- 172.21.15.76:0/3005169970 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9f019ef10 con 0x7fb9f0106c60 2024-06-02T04:49:32.245 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.242+0000 7fb9ecff9700 1 -- 172.21.15.76:0/3005169970 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e8005710 con 0x7fb9f0106c60 2024-06-02T04:49:32.245 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.242+0000 7fb9f5dec700 1 -- 172.21.15.76:0/3005169970 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9f019f3e0 con 0x7fb9f0106c60 2024-06-02T04:49:32.248 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.245+0000 7fb9ecff9700 1 -- 172.21.15.76:0/3005169970 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fb9e8005870 con 0x7fb9f0106c60 2024-06-02T04:49:32.248 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.245+0000 7fb9ecff9700 1 --2- 172.21.15.76:0/3005169970 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fb9d80a1230 0x7fb9d80a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:32.248 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.245+0000 7fb9ecff9700 1 -- 172.21.15.76:0/3005169970 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fb9e80cc4c0 con 0x7fb9f0106c60 2024-06-02T04:49:32.248 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.245+0000 7fb9ef7fe700 1 --2- 172.21.15.76:0/3005169970 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fb9d80a1230 0x7fb9d80a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:32.248 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.246+0000 7fba01fa7b80 1 Processor -- start 2024-06-02T04:49:32.248 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.246+0000 7fba01fa7b80 1 -- start start 2024-06-02T04:49:32.248 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.246+0000 7fba01fa7b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558d56fdc4f0 0x558d56fdc910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:32.248 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.246+0000 7fba01fa7b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558d56fdce50 0x558d56fdd2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:32.248 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.246+0000 7fba01fa7b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558d56fdd810 0x558d56fddc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:32.248 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.246+0000 7fba01fa7b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d56f33100 con 0x558d56fdc4f0 2024-06-02T04:49:32.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.246+0000 7fba01fa7b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d56f30ac0 con 0x558d56fdce50 2024-06-02T04:49:32.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.246+0000 7fba01fa7b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d56f2c3b0 con 0x558d56fdd810 2024-06-02T04:49:32.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.246+0000 7fb9ef7fe700 1 --2- 172.21.15.76:0/3005169970 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fb9d80a1230 0x7fb9d80a36f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb9e0003780 tx=0x7fb9e0005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:32.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.246+0000 7fb9ef7fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558d56fdc4f0 0x558d56fdc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:32.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.246+0000 7fb9ef7fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558d56fdc4f0 0x558d56fdc910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:54802/0 (socket says 172.21.15.76:54802) 2024-06-02T04:49:32.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.246+0000 7fb9ef7fe700 1 -- 172.21.15.76:0/57301753 learned_addr learned my addr 172.21.15.76:0/57301753 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:49:32.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.246+0000 7fb9effff700 1 --2- 172.21.15.76:0/57301753 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558d56fdd810 0x558d56fddc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:32.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.246+0000 7fb9eeffd700 1 --2- 172.21.15.76:0/57301753 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558d56fdce50 0x558d56fdd2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:32.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.246+0000 7fb9ef7fe700 1 -- 172.21.15.76:0/57301753 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558d56fdd810 msgr2=0x558d56fddc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:49:32.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.246+0000 7fb9ef7fe700 1 --2- 172.21.15.76:0/57301753 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558d56fdd810 0x558d56fddc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:32.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.246+0000 7fb9ef7fe700 1 -- 172.21.15.76:0/57301753 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558d56fdce50 msgr2=0x558d56fdd2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:49:32.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.246+0000 7fb9ef7fe700 1 --2- 172.21.15.76:0/57301753 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558d56fdce50 0x558d56fdd2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:32.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.246+0000 7fb9ef7fe700 1 -- 172.21.15.76:0/57301753 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558d56dad360 con 0x558d56fdc4f0 2024-06-02T04:49:32.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.246+0000 7fb9ef7fe700 1 --2- 172.21.15.76:0/57301753 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558d56fdc4f0 0x558d56fdc910 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fb9e0015000 tx=0x7fb9e0020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e90319adf10d3772 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:32.250 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.246+0000 7fb9d5ffb700 1 -- 172.21.15.76:0/57301753 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e00056a0 con 0x558d56fdc4f0 2024-06-02T04:49:32.250 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.247+0000 7fb9d5ffb700 1 -- 172.21.15.76:0/57301753 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb9e001e040 con 0x558d56fdc4f0 2024-06-02T04:49:32.250 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.247+0000 7fb9d5ffb700 1 -- 172.21.15.76:0/57301753 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e0003c40 con 0x558d56fdc4f0 2024-06-02T04:49:32.250 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.247+0000 7fba01fa7b80 1 -- 172.21.15.76:0/57301753 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558d56fdc4f0 msgr2=0x558d56fdc910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:32.250 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.247+0000 7fba01fa7b80 1 --2- 172.21.15.76:0/57301753 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558d56fdc4f0 0x558d56fdc910 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fb9e0015000 tx=0x7fb9e0020000 comp rx=0 tx=0).stop 2024-06-02T04:49:32.250 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.247+0000 7fba01fa7b80 1 -- 172.21.15.76:0/57301753 shutdown_connections 2024-06-02T04:49:32.250 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.247+0000 7fba01fa7b80 1 --2- 172.21.15.76:0/57301753 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558d56fdd810 0x558d56fddc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:32.250 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.247+0000 7fba01fa7b80 1 --2- 172.21.15.76:0/57301753 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558d56fdc4f0 0x558d56fdc910 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:32.250 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.247+0000 7fba01fa7b80 1 --2- 172.21.15.76:0/57301753 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558d56fdce50 0x558d56fdd2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:32.250 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.247+0000 7fba01fa7b80 1 -- 172.21.15.76:0/57301753 >> 172.21.15.76:0/57301753 conn(0x558d56f3a1c0 msgr2=0x558d56fd6d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:32.250 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.247+0000 7fba01fa7b80 1 -- 172.21.15.76:0/57301753 shutdown_connections 2024-06-02T04:49:32.250 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.247+0000 7fba01fa7b80 1 -- 172.21.15.76:0/57301753 wait complete. 2024-06-02T04:49:32.250 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.248+0000 7fba01fa7b80 1 -- start start 2024-06-02T04:49:32.251 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.248+0000 7fba01fa7b80 1 Processor -- start 2024-06-02T04:49:32.254 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.248+0000 7fba01fa7b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558d56fdc4f0 0x558d56fe5d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:32.254 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.248+0000 7fba01fa7b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558d56fdce50 0x558d56fe62c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:32.254 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.248+0000 7fba01fa7b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558d56fdd810 0x558d56fed300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:32.254 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.248+0000 7fba01fa7b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d56ec8510 con 0x558d56fdd810 2024-06-02T04:49:32.254 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.248+0000 7fba01fa7b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d56ec81b0 con 0x558d56fdc4f0 2024-06-02T04:49:32.254 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.248+0000 7fba01fa7b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d56daf650 con 0x558d56fdce50 2024-06-02T04:49:32.254 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.248+0000 7fba01fa7b80 10 client.0 _ll_register_callbacks cb 0x558d56ed1ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:49:32.255 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.248+0000 7fb9effff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558d56fdd810 0x558d56fed300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:32.255 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.248+0000 7fb9effff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558d56fdd810 0x558d56fed300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:54812/0 (socket says 172.21.15.76:54812) 2024-06-02T04:49:32.255 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.248+0000 7fb9effff700 1 -- 172.21.15.76:0/3683011822 learned_addr learned my addr 172.21.15.76:0/3683011822 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:49:32.255 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.248+0000 7fb9ef7fe700 1 --2- 172.21.15.76:0/3683011822 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558d56fdc4f0 0x558d56fe5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:32.255 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.249+0000 7fb9effff700 1 -- 172.21.15.76:0/3683011822 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558d56fdce50 msgr2=0x558d56fe62c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-02T04:49:32.255 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.249+0000 7fb9effff700 1 --2- 172.21.15.76:0/3683011822 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558d56fdce50 0x558d56fe62c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:32.255 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.249+0000 7fb9effff700 1 -- 172.21.15.76:0/3683011822 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558d56fdc4f0 msgr2=0x558d56fe5d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:49:32.255 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.249+0000 7fb9effff700 1 --2- 172.21.15.76:0/3683011822 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558d56fdc4f0 0x558d56fe5d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:32.255 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.249+0000 7fb9effff700 1 -- 172.21.15.76:0/3683011822 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9f0109cc0 con 0x558d56fdd810 2024-06-02T04:49:32.255 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.249+0000 7fb9effff700 1 --2- 172.21.15.76:0/3683011822 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558d56fdd810 0x558d56fed300 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fb9e80959a0 tx=0x7fb9e8099060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6e9afe8d4938b1b server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:32.255 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.249+0000 7fb9ceffd700 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-06-02T04:49:32.255 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.249+0000 7fb9ceffd700 1 -- 172.21.15.76:0/3683011822 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e80994a0 con 0x558d56fdd810 2024-06-02T04:49:32.255 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.249+0000 7fb9ceffd700 1 -- 172.21.15.76:0/3683011822 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fb9e809d2d0 con 0x558d56fdd810 2024-06-02T04:49:32.255 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.249+0000 7fba01fa7b80 1 -- 172.21.15.76:0/3683011822 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558d56e85220 con 0x558d56fdd810 2024-06-02T04:49:32.256 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.249+0000 7fb9ceffd700 1 -- 172.21.15.76:0/3683011822 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb9e80a1920 con 0x558d56fdd810 2024-06-02T04:49:32.256 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.249+0000 7fba01fa7b80 10 client.15375 fetch_fsmap learned FSMap version 24 2024-06-02T04:49:32.256 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.249+0000 7fba01fa7b80 1 -- 172.21.15.76:0/3683011822 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x558d56d59b10 con 0x558d56fdd810 2024-06-02T04:49:32.256 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.249+0000 7fb9ceffd700 1 -- 172.21.15.76:0/3683011822 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x558d56e85220 con 0x558d56fdd810 2024-06-02T04:49:32.256 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.249+0000 7fb9ceffd700 1 -- 172.21.15.76:0/3683011822 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fb9e8099700 con 0x558d56fdd810 2024-06-02T04:49:32.256 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.249+0000 7fba01fa7b80 10 client.15375 fetch_fsmap finished waiting for FSMap version 24 2024-06-02T04:49:32.256 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.249+0000 7fba01fa7b80 10 client.15375 resolve_mds: resolved name 'c' to daemon mds.c 2024-06-02T04:49:32.256 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.249+0000 7fba01fa7b80 20 client.15375 populate_metadata read hostname 'smithi076' 2024-06-02T04:49:32.256 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.249+0000 7fba01fa7b80 1 --2- 172.21.15.76:0/3683011822 >> [v2:172.21.15.192:6836/960773710,v1:172.21.15.192:6837/960773710] conn(0x558d56ff0990 0x558d56ff6280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:32.256 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.249+0000 7fba01fa7b80 4 client.15375 mds_command: new command op to 24463 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T04:49:32.256 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.249+0000 7fba01fa7b80 1 -- 172.21.15.76:0/3683011822 --> [v2:172.21.15.192:6836/960773710,v1:172.21.15.192:6837/960773710] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558d56fab7c0 con 0x558d56ff0990 2024-06-02T04:49:32.256 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.250+0000 7fb9ef7fe700 1 --2- 172.21.15.76:0/3683011822 >> [v2:172.21.15.192:6836/960773710,v1:172.21.15.192:6837/960773710] conn(0x558d56ff0990 0x558d56ff6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:32.256 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.250+0000 7fb9ceffd700 10 client.15375 ms_handle_connect on v2:172.21.15.192:6836/960773710 2024-06-02T04:49:32.257 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.250+0000 7fb9ef7fe700 1 --2- 172.21.15.76:0/3683011822 >> [v2:172.21.15.192:6836/960773710,v1:172.21.15.192:6837/960773710] conn(0x558d56ff0990 0x558d56ff6280 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9d8917413089aa92 server_cookie=638259887782f9d in_seq=0 out_seq=0 2024-06-02T04:49:32.257 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.251+0000 7fb9ceffd700 1 -- 172.21.15.76:0/3683011822 <== mds.2 v2:172.21.15.192:6836/960773710 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x558d56fab7c0 con 0x558d56ff0990 2024-06-02T04:49:32.257 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.251+0000 7fb9ceffd700 10 client.15375 handle_command_reply: tid=0 2024-06-02T04:49:32.257 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.251+0000 7fba01fa7b80 1 client.15375 shutdown 2024-06-02T04:49:32.257 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.251+0000 7fba01fa7b80 1 -- 172.21.15.76:0/3683011822 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558d56fdd810 msgr2=0x558d56fed300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:32.257 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.251+0000 7fba01fa7b80 1 --2- 172.21.15.76:0/3683011822 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558d56fdd810 0x558d56fed300 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fb9e80959a0 tx=0x7fb9e8099060 comp rx=0 tx=0).stop 2024-06-02T04:49:32.257 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.251+0000 7fba01fa7b80 1 -- 172.21.15.76:0/3683011822 shutdown_connections 2024-06-02T04:49:32.257 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.251+0000 7fba01fa7b80 1 --2- 172.21.15.76:0/3683011822 >> [v2:172.21.15.192:6836/960773710,v1:172.21.15.192:6837/960773710] conn(0x558d56ff0990 0x558d56ff6280 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:32.257 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.251+0000 7fba01fa7b80 1 --2- 172.21.15.76:0/3683011822 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558d56fdd810 0x558d56fed300 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:32.257 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.251+0000 7fb9ceffd700 0 client.15375 ms_handle_reset on v2:172.21.15.192:6836/960773710 2024-06-02T04:49:32.257 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.251+0000 7fba01fa7b80 1 --2- 172.21.15.76:0/3683011822 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558d56fdc4f0 0x558d56fe5d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:32.257 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.251+0000 7fba01fa7b80 1 --2- 172.21.15.76:0/3683011822 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558d56fdce50 0x558d56fe62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:32.257 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.251+0000 7fba01fa7b80 1 -- 172.21.15.76:0/3683011822 >> 172.21.15.76:0/3683011822 conn(0x558d56f3a1c0 msgr2=0x558d56fd6550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:32.257 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.251+0000 7fba01fa7b80 1 -- 172.21.15.76:0/3683011822 shutdown_connections 2024-06-02T04:49:32.258 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.251+0000 7fba01fa7b80 1 -- 172.21.15.76:0/3683011822 wait complete. 2024-06-02T04:49:32.258 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.251+0000 7fba01fa7b80 20 client.15375 trim_cache size 0 max 16384 2024-06-02T04:49:32.278 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.273+0000 7fba01fa7b80 1 Processor -- start 2024-06-02T04:49:32.278 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.273+0000 7fba01fa7b80 1 -- start start 2024-06-02T04:49:32.278 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.273+0000 7fba01fa7b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558d56fdc4f0 0x558d56fdc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:32.278 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.273+0000 7fba01fa7b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558d56fdce50 0x558d56fed2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:32.279 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.273+0000 7fba01fa7b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558d56fdd810 0x558d56fe3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:32.279 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.273+0000 7fba01fa7b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d56e85250 con 0x558d56fdce50 2024-06-02T04:49:32.279 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.273+0000 7fba01fa7b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d56eea2e0 con 0x558d56fdd810 2024-06-02T04:49:32.279 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.273+0000 7fba01fa7b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d56f29010 con 0x558d56fdc4f0 2024-06-02T04:49:32.279 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.273+0000 7fb9eeffd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558d56fdce50 0x558d56fed2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:32.279 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.273+0000 7fb9eeffd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558d56fdce50 0x558d56fed2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:54822/0 (socket says 172.21.15.76:54822) 2024-06-02T04:49:32.279 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.273+0000 7fb9eeffd700 1 -- 172.21.15.76:0/785085216 learned_addr learned my addr 172.21.15.76:0/785085216 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:49:32.279 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.273+0000 7fb9ef7fe700 1 --2- 172.21.15.76:0/785085216 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558d56fdc4f0 0x558d56fdc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:32.279 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.273+0000 7fb9effff700 1 --2- 172.21.15.76:0/785085216 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558d56fdd810 0x558d56fe3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:32.279 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.273+0000 7fb9eeffd700 1 -- 172.21.15.76:0/785085216 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558d56fdc4f0 msgr2=0x558d56fdc8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:49:32.279 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.273+0000 7fb9eeffd700 1 --2- 172.21.15.76:0/785085216 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558d56fdc4f0 0x558d56fdc8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:32.279 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.273+0000 7fb9eeffd700 1 -- 172.21.15.76:0/785085216 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558d56fdd810 msgr2=0x558d56fe3dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:49:32.279 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.273+0000 7fb9eeffd700 1 --2- 172.21.15.76:0/785085216 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558d56fdd810 0x558d56fe3dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:32.280 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.273+0000 7fb9eeffd700 1 -- 172.21.15.76:0/785085216 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558d56ef2510 con 0x558d56fdce50 2024-06-02T04:49:32.280 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.273+0000 7fb9effff700 1 --2- 172.21.15.76:0/785085216 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558d56fdd810 0x558d56fe3dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:49:32.280 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.274+0000 7fb9eeffd700 1 --2- 172.21.15.76:0/785085216 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558d56fdce50 0x558d56fed2c0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fb9e400ca80 tx=0x7fb9e400cd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11849f8d6dfbdb06 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:32.280 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.274+0000 7fb9d67fc700 1 -- 172.21.15.76:0/785085216 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e400ecb0 con 0x558d56fdce50 2024-06-02T04:49:32.280 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.274+0000 7fb9d67fc700 1 -- 172.21.15.76:0/785085216 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb9e400ee10 con 0x558d56fdce50 2024-06-02T04:49:32.280 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.274+0000 7fb9d67fc700 1 -- 172.21.15.76:0/785085216 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e400f750 con 0x558d56fdce50 2024-06-02T04:49:32.280 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.274+0000 7fba01fa7b80 1 -- 172.21.15.76:0/785085216 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558d56fdce50 msgr2=0x558d56fed2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:32.280 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.274+0000 7fba01fa7b80 1 --2- 172.21.15.76:0/785085216 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558d56fdce50 0x558d56fed2c0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fb9e400ca80 tx=0x7fb9e400cd90 comp rx=0 tx=0).stop 2024-06-02T04:49:32.280 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.274+0000 7fba01fa7b80 1 -- 172.21.15.76:0/785085216 shutdown_connections 2024-06-02T04:49:32.280 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.274+0000 7fba01fa7b80 1 --2- 172.21.15.76:0/785085216 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558d56fdd810 0x558d56fe3dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:32.280 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.274+0000 7fba01fa7b80 1 --2- 172.21.15.76:0/785085216 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558d56fdc4f0 0x558d56fdc8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:32.280 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.274+0000 7fba01fa7b80 1 --2- 172.21.15.76:0/785085216 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558d56fdce50 0x558d56fed2c0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:32.280 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.274+0000 7fba01fa7b80 1 -- 172.21.15.76:0/785085216 >> 172.21.15.76:0/785085216 conn(0x558d56f3a1c0 msgr2=0x558d56fddbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:32.280 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.274+0000 7fba01fa7b80 1 -- 172.21.15.76:0/785085216 shutdown_connections 2024-06-02T04:49:32.281 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.274+0000 7fba01fa7b80 1 -- 172.21.15.76:0/785085216 wait complete. 2024-06-02T04:49:32.281 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.275+0000 7fba01fa7b80 1 -- start start 2024-06-02T04:49:32.281 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.275+0000 7fba01fa7b80 1 Processor -- start 2024-06-02T04:49:32.281 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.275+0000 7fba01fa7b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558d56fdc4f0 0x558d56fe7540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:32.281 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.275+0000 7fba01fa7b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558d56fdce50 0x558d56fe7a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:32.281 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.275+0000 7fba01fa7b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558d56fdd810 0x558d56feca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:32.281 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.275+0000 7fba01fa7b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d56fecfc0 con 0x558d56fdc4f0 2024-06-02T04:49:32.281 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.275+0000 7fba01fa7b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d56fed130 con 0x558d56fdd810 2024-06-02T04:49:32.281 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.275+0000 7fba01fa7b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d56fed2f0 con 0x558d56fdce50 2024-06-02T04:49:32.281 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.275+0000 7fba01fa7b80 10 client.0 _ll_register_callbacks cb 0x558d56ed1ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:49:32.281 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.275+0000 7fb9ef7fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558d56fdc4f0 0x558d56fe7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:32.281 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.275+0000 7fb9ef7fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558d56fdc4f0 0x558d56fe7540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:54838/0 (socket says 172.21.15.76:54838) 2024-06-02T04:49:32.282 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.275+0000 7fb9ef7fe700 1 -- 172.21.15.76:0/2212303371 learned_addr learned my addr 172.21.15.76:0/2212303371 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:49:32.282 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.275+0000 7fb9eeffd700 1 --2- 172.21.15.76:0/2212303371 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558d56fdce50 0x558d56fe7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:32.282 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.275+0000 7fb9effff700 1 --2- 172.21.15.76:0/2212303371 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558d56fdd810 0x558d56feca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:32.282 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.276+0000 7fb9ef7fe700 1 -- 172.21.15.76:0/2212303371 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558d56fdce50 msgr2=0x558d56fe7a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:49:32.282 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.276+0000 7fb9ef7fe700 1 --2- 172.21.15.76:0/2212303371 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558d56fdce50 0x558d56fe7a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:32.282 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.276+0000 7fb9ef7fe700 1 -- 172.21.15.76:0/2212303371 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558d56fdd810 msgr2=0x558d56feca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:49:32.282 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.276+0000 7fb9ef7fe700 1 --2- 172.21.15.76:0/2212303371 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558d56fdd810 0x558d56feca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:32.282 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.276+0000 7fb9ef7fe700 1 -- 172.21.15.76:0/2212303371 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9e400c6e0 con 0x558d56fdc4f0 2024-06-02T04:49:32.282 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.276+0000 7fb9effff700 1 --2- 172.21.15.76:0/2212303371 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558d56fdd810 0x558d56feca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:49:32.282 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.276+0000 7fb9ef7fe700 1 --2- 172.21.15.76:0/2212303371 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558d56fdc4f0 0x558d56fe7540 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fb9e000bf30 tx=0x7fb9e000b5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=608f133ba034acfd server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:32.282 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.276+0000 7fb9ceffd700 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-06-02T04:49:32.282 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.276+0000 7fb9ceffd700 1 -- 172.21.15.76:0/2212303371 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e0035040 con 0x558d56fdc4f0 2024-06-02T04:49:32.282 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.276+0000 7fb9ceffd700 1 -- 172.21.15.76:0/2212303371 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fb9e003b850 con 0x558d56fdc4f0 2024-06-02T04:49:32.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.276+0000 7fba01fa7b80 1 -- 172.21.15.76:0/2212303371 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb9e001e040 con 0x558d56fdc4f0 2024-06-02T04:49:32.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.276+0000 7fb9ceffd700 1 -- 172.21.15.76:0/2212303371 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb9e0004500 con 0x558d56fdc4f0 2024-06-02T04:49:32.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.276+0000 7fba01fa7b80 10 client.15381 fetch_fsmap learned FSMap version 24 2024-06-02T04:49:32.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.276+0000 7fba01fa7b80 1 -- 172.21.15.76:0/2212303371 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x558d56db1c80 con 0x558d56fdc4f0 2024-06-02T04:49:32.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.276+0000 7fb9ceffd700 1 -- 172.21.15.76:0/2212303371 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb9e001e040 con 0x558d56fdc4f0 2024-06-02T04:49:32.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.276+0000 7fb9ceffd700 1 -- 172.21.15.76:0/2212303371 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fb9e0003b50 con 0x558d56fdc4f0 2024-06-02T04:49:32.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.276+0000 7fba01fa7b80 10 client.15381 fetch_fsmap finished waiting for FSMap version 24 2024-06-02T04:49:32.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.276+0000 7fba01fa7b80 10 client.15381 resolve_mds: resolved name 'c' to daemon mds.c 2024-06-02T04:49:32.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.276+0000 7fba01fa7b80 20 client.15381 populate_metadata read hostname 'smithi076' 2024-06-02T04:49:32.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.276+0000 7fba01fa7b80 1 --2- 172.21.15.76:0/2212303371 >> [v2:172.21.15.192:6836/960773710,v1:172.21.15.192:6837/960773710] conn(0x558d5704c360 0x558d57048cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:32.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.276+0000 7fba01fa7b80 4 client.15381 mds_command: new command op to 24463 tid=0 multi_id=0 [{"prefix": "status"}] 2024-06-02T04:49:32.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.277+0000 7fba01fa7b80 1 -- 172.21.15.76:0/2212303371 --> [v2:172.21.15.192:6836/960773710,v1:172.21.15.192:6837/960773710] -- command(tid 0: {"prefix": "status"}) v1 -- 0x558d56f24e70 con 0x558d5704c360 2024-06-02T04:49:32.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.277+0000 7fb9eeffd700 1 --2- 172.21.15.76:0/2212303371 >> [v2:172.21.15.192:6836/960773710,v1:172.21.15.192:6837/960773710] conn(0x558d5704c360 0x558d57048cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:32.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.277+0000 7fb9eeffd700 1 --2- 172.21.15.76:0/2212303371 >> [v2:172.21.15.192:6836/960773710,v1:172.21.15.192:6837/960773710] conn(0x558d5704c360 0x558d57048cd0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=51cc0bab0ef6c4e server_cookie=43ecb38d424e5a07 in_seq=0 out_seq=0 2024-06-02T04:49:32.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.277+0000 7fb9ceffd700 10 client.15381 ms_handle_connect on v2:172.21.15.192:6836/960773710 2024-06-02T04:49:32.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.277+0000 7fb9ceffd700 1 -- 172.21.15.76:0/2212303371 <== mds.2 v2:172.21.15.192:6836/960773710 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x558d56f24e70 con 0x558d5704c360 2024-06-02T04:49:32.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.277+0000 7fb9ceffd700 10 client.15381 handle_command_reply: tid=0 2024-06-02T04:49:32.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.277+0000 7fba01fa7b80 1 client.15381 shutdown 2024-06-02T04:49:32.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.278+0000 7fba01fa7b80 1 -- 172.21.15.76:0/2212303371 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558d56fdc4f0 msgr2=0x558d56fe7540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:32.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.278+0000 7fba01fa7b80 1 --2- 172.21.15.76:0/2212303371 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558d56fdc4f0 0x558d56fe7540 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fb9e000bf30 tx=0x7fb9e000b5c0 comp rx=0 tx=0).stop 2024-06-02T04:49:32.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.278+0000 7fba01fa7b80 1 -- 172.21.15.76:0/2212303371 shutdown_connections 2024-06-02T04:49:32.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.278+0000 7fba01fa7b80 1 --2- 172.21.15.76:0/2212303371 >> [v2:172.21.15.192:6836/960773710,v1:172.21.15.192:6837/960773710] conn(0x558d5704c360 0x558d57048cd0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:32.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.278+0000 7fba01fa7b80 1 --2- 172.21.15.76:0/2212303371 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558d56fdd810 0x558d56feca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:32.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.278+0000 7fba01fa7b80 1 --2- 172.21.15.76:0/2212303371 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558d56fdc4f0 0x558d56fe7540 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:32.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.278+0000 7fba01fa7b80 1 --2- 172.21.15.76:0/2212303371 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558d56fdce50 0x558d56fe7a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:32.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.278+0000 7fb9ceffd700 0 client.15381 ms_handle_reset on v2:172.21.15.192:6836/960773710 2024-06-02T04:49:32.285 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.278+0000 7fba01fa7b80 1 -- 172.21.15.76:0/2212303371 >> 172.21.15.76:0/2212303371 conn(0x558d56f3a1c0 msgr2=0x558d56fe39b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:32.285 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.278+0000 7fba01fa7b80 1 -- 172.21.15.76:0/2212303371 shutdown_connections 2024-06-02T04:49:32.285 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.278+0000 7fba01fa7b80 1 -- 172.21.15.76:0/2212303371 wait complete. 2024-06-02T04:49:32.285 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.278+0000 7fba01fa7b80 20 client.15381 trim_cache size 0 max 16384 2024-06-02T04:49:32.285 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-06-02T04:49:32.285 INFO:teuthology.orchestra.run.smithi076.stdout: "cluster_fsid": "60ab6d30-209a-11ef-bc9b-c7b262605968", 2024-06-02T04:49:32.285 INFO:teuthology.orchestra.run.smithi076.stdout: "whoami": 2, 2024-06-02T04:49:32.285 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 24463, 2024-06-02T04:49:32.285 INFO:teuthology.orchestra.run.smithi076.stdout: "want_state": "up:active", 2024-06-02T04:49:32.286 INFO:teuthology.orchestra.run.smithi076.stdout: "state": "up:active", 2024-06-02T04:49:32.286 INFO:teuthology.orchestra.run.smithi076.stdout: "fs_name": "cephfs", 2024-06-02T04:49:32.286 INFO:teuthology.orchestra.run.smithi076.stdout: "rank_uptime": 65.010560742999999, 2024-06-02T04:49:32.286 INFO:teuthology.orchestra.run.smithi076.stdout: "mdsmap_epoch": 24, 2024-06-02T04:49:32.286 INFO:teuthology.orchestra.run.smithi076.stdout: "osdmap_epoch": 82, 2024-06-02T04:49:32.286 INFO:teuthology.orchestra.run.smithi076.stdout: "osdmap_epoch_barrier": 80, 2024-06-02T04:49:32.286 INFO:teuthology.orchestra.run.smithi076.stdout: "uptime": 103.92678460400001 2024-06-02T04:49:32.286 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-06-02T04:49:32.287 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.278+0000 7fb9f5dec700 1 -- 172.21.15.76:0/3005169970 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fb9d80a1230 msgr2=0x7fb9d80a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:32.287 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.278+0000 7fb9f5dec700 1 --2- 172.21.15.76:0/3005169970 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fb9d80a1230 0x7fb9d80a36f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb9e0003780 tx=0x7fb9e0005fb0 comp rx=0 tx=0).stop 2024-06-02T04:49:32.287 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.278+0000 7fb9f5dec700 1 -- 172.21.15.76:0/3005169970 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb9f0106c60 msgr2=0x7fb9f019e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:32.287 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.278+0000 7fb9f5dec700 1 --2- 172.21.15.76:0/3005169970 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb9f0106c60 0x7fb9f019e390 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fb9e8007ee0 tx=0x7fb9e800d3b0 comp rx=0 tx=0).stop 2024-06-02T04:49:32.287 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.278+0000 7fb9f5dec700 1 -- 172.21.15.76:0/3005169970 shutdown_connections 2024-06-02T04:49:32.287 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.278+0000 7fb9f5dec700 1 --2- 172.21.15.76:0/3005169970 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb9f0106c60 0x7fb9f019e390 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:32.287 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.278+0000 7fb9f5dec700 1 --2- 172.21.15.76:0/3005169970 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb9f0101a00 0x7fb9f0196e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:32.287 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.278+0000 7fb9f5dec700 1 --2- 172.21.15.76:0/3005169970 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fb9d80a1230 0x7fb9d80a36f0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:32.287 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.278+0000 7fb9f5dec700 1 --2- 172.21.15.76:0/3005169970 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb9f0104330 0x7fb9f0197370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:32.288 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.278+0000 7fb9f5dec700 1 -- 172.21.15.76:0/3005169970 >> 172.21.15.76:0/3005169970 conn(0x7fb9f00fb3f0 msgr2=0x7fb9f0103950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:32.288 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.278+0000 7fb9f5dec700 1 -- 172.21.15.76:0/3005169970 shutdown_connections 2024-06-02T04:49:32.288 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.278+0000 7fb9f5dec700 1 -- 172.21.15.76:0/3005169970 wait complete. 2024-06-02T04:49:32.291 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2024-06-02T04:49:32.417 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.414+0000 7f72c96e3700 1 -- 172.21.15.76:0/1637493501 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f72c4100fb0 msgr2=0x7f72c4101430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:32.418 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.414+0000 7f72c96e3700 1 --2- 172.21.15.76:0/1637493501 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f72c4100fb0 0x7f72c4101430 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f72ac009990 tx=0x7f72ac009ca0 comp rx=0 tx=0).stop 2024-06-02T04:49:32.418 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.414+0000 7f72c96e3700 1 -- 172.21.15.76:0/1637493501 shutdown_connections 2024-06-02T04:49:32.418 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.414+0000 7f72c96e3700 1 --2- 172.21.15.76:0/1637493501 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f72c4101970 0x7f72c4108290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:32.418 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.414+0000 7f72c96e3700 1 --2- 172.21.15.76:0/1637493501 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f72c40ffe60 0x7f72c4100280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:32.418 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.414+0000 7f72c96e3700 1 --2- 172.21.15.76:0/1637493501 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f72c4100fb0 0x7f72c4101430 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:32.418 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.414+0000 7f72c96e3700 1 -- 172.21.15.76:0/1637493501 >> 172.21.15.76:0/1637493501 conn(0x7f72c40fb3f0 msgr2=0x7f72c40fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:32.418 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.414+0000 7f72c96e3700 1 -- 172.21.15.76:0/1637493501 shutdown_connections 2024-06-02T04:49:32.418 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.414+0000 7f72c96e3700 1 -- 172.21.15.76:0/1637493501 wait complete. 2024-06-02T04:49:32.418 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.415+0000 7f72c96e3700 1 Processor -- start 2024-06-02T04:49:32.418 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.415+0000 7f72c96e3700 1 -- start start 2024-06-02T04:49:32.418 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.415+0000 7f72c96e3700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f72c40ffe60 0x7f72c4196e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:32.419 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.415+0000 7f72c96e3700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f72c4100fb0 0x7f72c4197350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:32.419 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.415+0000 7f72c96e3700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f72c4101970 0x7f72c419e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:32.419 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.415+0000 7f72c96e3700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c419e940 con 0x7f72c4100fb0 2024-06-02T04:49:32.419 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.415+0000 7f72c96e3700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c419ea80 con 0x7f72c4101970 2024-06-02T04:49:32.419 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.415+0000 7f72c96e3700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c419ec10 con 0x7f72c40ffe60 2024-06-02T04:49:32.419 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.415+0000 7f72c27fc700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f72c4100fb0 0x7f72c4197350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:32.419 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.415+0000 7f72c27fc700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f72c4100fb0 0x7f72c4197350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:54850/0 (socket says 172.21.15.76:54850) 2024-06-02T04:49:32.419 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.415+0000 7f72c27fc700 1 -- 172.21.15.76:0/3901210270 learned_addr learned my addr 172.21.15.76:0/3901210270 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:49:32.419 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.415+0000 7f72c2ffd700 1 --2- 172.21.15.76:0/3901210270 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f72c40ffe60 0x7f72c4196e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:32.419 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.415+0000 7f72c27fc700 1 -- 172.21.15.76:0/3901210270 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f72c40ffe60 msgr2=0x7f72c4196e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:32.420 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.415+0000 7f72c27fc700 1 --2- 172.21.15.76:0/3901210270 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f72c40ffe60 0x7f72c4196e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:32.420 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.415+0000 7f72c27fc700 1 -- 172.21.15.76:0/3901210270 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f72c4101970 msgr2=0x7f72c419e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:32.420 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.415+0000 7f72c27fc700 1 --2- 172.21.15.76:0/3901210270 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f72c4101970 0x7f72c419e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:32.420 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.415+0000 7f72c27fc700 1 -- 172.21.15.76:0/3901210270 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72ac0095f0 con 0x7f72c4100fb0 2024-06-02T04:49:32.420 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.416+0000 7f72c27fc700 1 --2- 172.21.15.76:0/3901210270 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f72c4100fb0 0x7f72c4197350 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f72ac00b5c0 tx=0x7f72ac0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:32.420 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.416+0000 7f72bbfff700 1 -- 172.21.15.76:0/3901210270 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72ac01d070 con 0x7f72c4100fb0 2024-06-02T04:49:32.420 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.416+0000 7f72bbfff700 1 -- 172.21.15.76:0/3901210270 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f72ac003f40 con 0x7f72c4100fb0 2024-06-02T04:49:32.420 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.416+0000 7f72c96e3700 1 -- 172.21.15.76:0/3901210270 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72c419ee90 con 0x7f72c4100fb0 2024-06-02T04:49:32.420 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.416+0000 7f72bbfff700 1 -- 172.21.15.76:0/3901210270 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72ac022c60 con 0x7f72c4100fb0 2024-06-02T04:49:32.420 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.416+0000 7f72c96e3700 1 -- 172.21.15.76:0/3901210270 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72c419f250 con 0x7f72c4100fb0 2024-06-02T04:49:32.427 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.418+0000 7f72bbfff700 1 -- 172.21.15.76:0/3901210270 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f72ac0040b0 con 0x7f72c4100fb0 2024-06-02T04:49:32.427 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.419+0000 7f72bbfff700 1 --2- 172.21.15.76:0/3901210270 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f72b00a11b0 0x7f72b00a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:32.427 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.419+0000 7f72bbfff700 1 -- 172.21.15.76:0/3901210270 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f72ac0ce3b0 con 0x7f72c4100fb0 2024-06-02T04:49:32.427 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.419+0000 7f72c2ffd700 1 --2- 172.21.15.76:0/3901210270 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f72b00a11b0 0x7f72b00a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:32.427 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.420+0000 7f72c2ffd700 1 --2- 172.21.15.76:0/3901210270 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f72b00a11b0 0x7f72b00a3670 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f72b4009d90 tx=0x7f72b4009040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:32.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.420+0000 7f72d589eb80 1 Processor -- start 2024-06-02T04:49:32.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.420+0000 7f72d589eb80 1 -- start start 2024-06-02T04:49:32.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.420+0000 7f72d589eb80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56075fc164f0 0x56075fc16910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:32.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.420+0000 7f72d589eb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56075fc16e50 0x56075fc172d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:32.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.420+0000 7f72d589eb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56075fc17810 0x56075fc17c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:32.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.420+0000 7f72d589eb80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x56075fb6d100 con 0x56075fc164f0 2024-06-02T04:49:32.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.420+0000 7f72d589eb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x56075fb6aac0 con 0x56075fc16e50 2024-06-02T04:49:32.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.420+0000 7f72d589eb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x56075fb663b0 con 0x56075fc17810 2024-06-02T04:49:32.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.420+0000 7f72c2ffd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56075fc164f0 0x56075fc16910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:32.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.420+0000 7f72c2ffd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56075fc164f0 0x56075fc16910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:54860/0 (socket says 172.21.15.76:54860) 2024-06-02T04:49:32.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.420+0000 7f72c2ffd700 1 -- 172.21.15.76:0/4161045297 learned_addr learned my addr 172.21.15.76:0/4161045297 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:49:32.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.420+0000 7f72c2ffd700 1 -- 172.21.15.76:0/4161045297 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56075fc17810 msgr2=0x56075fc17c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:49:32.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.420+0000 7f72c2ffd700 1 --2- 172.21.15.76:0/4161045297 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56075fc17810 0x56075fc17c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:32.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.420+0000 7f72c2ffd700 1 -- 172.21.15.76:0/4161045297 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56075fc16e50 msgr2=0x56075fc172d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:49:32.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.420+0000 7f72c2ffd700 1 --2- 172.21.15.76:0/4161045297 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56075fc16e50 0x56075fc172d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:32.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.420+0000 7f72c2ffd700 1 -- 172.21.15.76:0/4161045297 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56075f9e7360 con 0x56075fc164f0 2024-06-02T04:49:32.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.421+0000 7f72c2ffd700 1 --2- 172.21.15.76:0/4161045297 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56075fc164f0 0x56075fc16910 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f72b4016470 tx=0x7f72b4012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=238a9d5bb497f6b4 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:32.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.421+0000 7f72b97fa700 1 -- 172.21.15.76:0/4161045297 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b4021600 con 0x56075fc164f0 2024-06-02T04:49:32.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.421+0000 7f72b97fa700 1 -- 172.21.15.76:0/4161045297 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f72b4021bf0 con 0x56075fc164f0 2024-06-02T04:49:32.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.421+0000 7f72b97fa700 1 -- 172.21.15.76:0/4161045297 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b4014ab0 con 0x56075fc164f0 2024-06-02T04:49:32.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.421+0000 7f72d589eb80 1 -- 172.21.15.76:0/4161045297 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56075fc164f0 msgr2=0x56075fc16910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:32.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.421+0000 7f72d589eb80 1 --2- 172.21.15.76:0/4161045297 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56075fc164f0 0x56075fc16910 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f72b4016470 tx=0x7f72b4012000 comp rx=0 tx=0).stop 2024-06-02T04:49:32.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.422+0000 7f72d589eb80 1 -- 172.21.15.76:0/4161045297 shutdown_connections 2024-06-02T04:49:32.430 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.422+0000 7f72d589eb80 1 --2- 172.21.15.76:0/4161045297 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56075fc17810 0x56075fc17c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:32.430 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.422+0000 7f72d589eb80 1 --2- 172.21.15.76:0/4161045297 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56075fc164f0 0x56075fc16910 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:32.430 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.422+0000 7f72d589eb80 1 --2- 172.21.15.76:0/4161045297 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56075fc16e50 0x56075fc172d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:32.430 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.422+0000 7f72d589eb80 1 -- 172.21.15.76:0/4161045297 >> 172.21.15.76:0/4161045297 conn(0x56075fb741c0 msgr2=0x56075fc10d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:32.430 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.422+0000 7f72d589eb80 1 -- 172.21.15.76:0/4161045297 shutdown_connections 2024-06-02T04:49:32.430 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.422+0000 7f72d589eb80 1 -- 172.21.15.76:0/4161045297 wait complete. 2024-06-02T04:49:32.430 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.422+0000 7f72d589eb80 1 -- start start 2024-06-02T04:49:32.430 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.422+0000 7f72d589eb80 1 Processor -- start 2024-06-02T04:49:32.430 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.422+0000 7f72d589eb80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56075fc164f0 0x56075fc1fe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:32.430 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.422+0000 7f72d589eb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56075fc16e50 0x56075fc203b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:32.431 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.422+0000 7f72d589eb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56075fc17810 0x56075fc273f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:32.431 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.422+0000 7f72d589eb80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x56075fb02510 con 0x56075fc164f0 2024-06-02T04:49:32.431 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.422+0000 7f72d589eb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x56075fb021b0 con 0x56075fc16e50 2024-06-02T04:49:32.431 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.422+0000 7f72d589eb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x56075f9e9650 con 0x56075fc17810 2024-06-02T04:49:32.431 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.423+0000 7f72d589eb80 10 client.0 _ll_register_callbacks cb 0x56075fb0bae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:49:32.431 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.423+0000 7f72c2ffd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56075fc164f0 0x56075fc1fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:32.431 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.423+0000 7f72c2ffd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56075fc164f0 0x56075fc1fe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:54868/0 (socket says 172.21.15.76:54868) 2024-06-02T04:49:32.431 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.423+0000 7f72c2ffd700 1 -- 172.21.15.76:0/2936579283 learned_addr learned my addr 172.21.15.76:0/2936579283 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:49:32.431 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.423+0000 7f72c27fc700 1 --2- 172.21.15.76:0/2936579283 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56075fc16e50 0x56075fc203b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:32.431 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.423+0000 7f72c37fe700 1 --2- 172.21.15.76:0/2936579283 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56075fc17810 0x56075fc273f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:32.431 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.423+0000 7f72c2ffd700 1 -- 172.21.15.76:0/2936579283 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56075fc17810 msgr2=0x56075fc273f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:49:32.431 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.423+0000 7f72c2ffd700 1 --2- 172.21.15.76:0/2936579283 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56075fc17810 0x56075fc273f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:32.431 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.423+0000 7f72c2ffd700 1 -- 172.21.15.76:0/2936579283 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56075fc16e50 msgr2=0x56075fc203b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:49:32.432 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.423+0000 7f72c2ffd700 1 --2- 172.21.15.76:0/2936579283 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56075fc16e50 0x56075fc203b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:32.432 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.423+0000 7f72c2ffd700 1 -- 172.21.15.76:0/2936579283 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72b4007dc0 con 0x56075fc164f0 2024-06-02T04:49:32.432 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.423+0000 7f72c37fe700 1 --2- 172.21.15.76:0/2936579283 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56075fc17810 0x56075fc273f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:49:32.432 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.423+0000 7f72c27fc700 1 --2- 172.21.15.76:0/2936579283 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56075fc16e50 0x56075fc203b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:49:32.432 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.423+0000 7f72c2ffd700 1 --2- 172.21.15.76:0/2936579283 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56075fc164f0 0x56075fc1fe70 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f72b40092e0 tx=0x7f72b4004d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91ef9cc04c7c3262 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:32.432 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.423+0000 7f72aa7fc700 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-06-02T04:49:32.432 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.423+0000 7f72aa7fc700 1 -- 172.21.15.76:0/2936579283 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b4014c60 con 0x56075fc164f0 2024-06-02T04:49:32.432 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.423+0000 7f72d589eb80 1 -- 172.21.15.76:0/2936579283 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56075fabf220 con 0x56075fc164f0 2024-06-02T04:49:32.432 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.423+0000 7f72aa7fc700 1 -- 172.21.15.76:0/2936579283 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f72b4022e20 con 0x56075fc164f0 2024-06-02T04:49:32.432 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.423+0000 7f72aa7fc700 1 -- 172.21.15.76:0/2936579283 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f72b4014dc0 con 0x56075fc164f0 2024-06-02T04:49:32.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.423+0000 7f72d589eb80 10 client.15393 fetch_fsmap learned FSMap version 24 2024-06-02T04:49:32.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.423+0000 7f72d589eb80 1 -- 172.21.15.76:0/2936579283 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x56075f993b10 con 0x56075fc164f0 2024-06-02T04:49:32.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.423+0000 7f72aa7fc700 1 -- 172.21.15.76:0/2936579283 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56075fabf220 con 0x56075fc164f0 2024-06-02T04:49:32.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.424+0000 7f72aa7fc700 1 -- 172.21.15.76:0/2936579283 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f72b4005480 con 0x56075fc164f0 2024-06-02T04:49:32.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.424+0000 7f72d589eb80 10 client.15393 fetch_fsmap finished waiting for FSMap version 24 2024-06-02T04:49:32.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.424+0000 7f72d589eb80 10 client.15393 resolve_mds: resolved name 'i' to daemon mds.i 2024-06-02T04:49:32.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.424+0000 7f72d589eb80 20 client.15393 populate_metadata read hostname 'smithi076' 2024-06-02T04:49:32.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.424+0000 7f72d589eb80 1 --2- 172.21.15.76:0/2936579283 >> [v2:172.21.15.192:6838/3978681402,v1:172.21.15.192:6839/3978681402] conn(0x56075fc2afa0 0x56075fc30280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:32.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.424+0000 7f72d589eb80 4 client.15393 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T04:49:32.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.424+0000 7f72d589eb80 1 -- 172.21.15.76:0/2936579283 --> [v2:172.21.15.192:6838/3978681402,v1:172.21.15.192:6839/3978681402] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56075fbe57c0 con 0x56075fc2afa0 2024-06-02T04:49:32.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.424+0000 7f72c27fc700 1 --2- 172.21.15.76:0/2936579283 >> [v2:172.21.15.192:6838/3978681402,v1:172.21.15.192:6839/3978681402] conn(0x56075fc2afa0 0x56075fc30280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:32.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.424+0000 7f72aa7fc700 10 client.15393 ms_handle_connect on v2:172.21.15.192:6838/3978681402 2024-06-02T04:49:32.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.424+0000 7f72c27fc700 1 --2- 172.21.15.76:0/2936579283 >> [v2:172.21.15.192:6838/3978681402,v1:172.21.15.192:6839/3978681402] conn(0x56075fc2afa0 0x56075fc30280 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d059696afacda022 server_cookie=d725684e5533bf5e in_seq=0 out_seq=0 2024-06-02T04:49:32.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.425+0000 7f72aa7fc700 1 -- 172.21.15.76:0/2936579283 <== mds.1 v2:172.21.15.192:6838/3978681402 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56075fbe57c0 con 0x56075fc2afa0 2024-06-02T04:49:32.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.425+0000 7f72aa7fc700 10 client.15393 handle_command_reply: tid=0 2024-06-02T04:49:32.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.425+0000 7f72d589eb80 1 client.15393 shutdown 2024-06-02T04:49:32.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.425+0000 7f72d589eb80 1 -- 172.21.15.76:0/2936579283 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56075fc164f0 msgr2=0x56075fc1fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:32.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.425+0000 7f72d589eb80 1 --2- 172.21.15.76:0/2936579283 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56075fc164f0 0x56075fc1fe70 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f72b40092e0 tx=0x7f72b4004d70 comp rx=0 tx=0).stop 2024-06-02T04:49:32.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.425+0000 7f72d589eb80 1 -- 172.21.15.76:0/2936579283 shutdown_connections 2024-06-02T04:49:32.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.425+0000 7f72d589eb80 1 --2- 172.21.15.76:0/2936579283 >> [v2:172.21.15.192:6838/3978681402,v1:172.21.15.192:6839/3978681402] conn(0x56075fc2afa0 0x56075fc30280 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:32.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.425+0000 7f72d589eb80 1 --2- 172.21.15.76:0/2936579283 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56075fc17810 0x56075fc273f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:32.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.425+0000 7f72d589eb80 1 --2- 172.21.15.76:0/2936579283 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56075fc164f0 0x56075fc1fe70 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:32.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.425+0000 7f72aa7fc700 0 client.15393 ms_handle_reset on v2:172.21.15.192:6838/3978681402 2024-06-02T04:49:32.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.425+0000 7f72d589eb80 1 --2- 172.21.15.76:0/2936579283 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56075fc16e50 0x56075fc203b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:32.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.425+0000 7f72d589eb80 1 -- 172.21.15.76:0/2936579283 >> 172.21.15.76:0/2936579283 conn(0x56075fb741c0 msgr2=0x56075fc10550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:32.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.425+0000 7f72d589eb80 1 -- 172.21.15.76:0/2936579283 shutdown_connections 2024-06-02T04:49:32.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.425+0000 7f72d589eb80 1 -- 172.21.15.76:0/2936579283 wait complete. 2024-06-02T04:49:32.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.426+0000 7f72d589eb80 20 client.15393 trim_cache size 0 max 16384 2024-06-02T04:49:32.451 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.443+0000 7f72d589eb80 1 Processor -- start 2024-06-02T04:49:32.451 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.443+0000 7f72d589eb80 1 -- start start 2024-06-02T04:49:32.451 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.443+0000 7f72d589eb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56075fc164f0 0x56075fc168d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:32.451 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.443+0000 7f72d589eb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56075fc16e50 0x56075fc1ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:32.451 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.443+0000 7f72d589eb80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56075fc17810 0x56075fc273b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:32.451 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.444+0000 7f72d589eb80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x56075fbe57c0 con 0x56075fc17810 2024-06-02T04:49:32.451 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.444+0000 7f72d589eb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x56075fabf220 con 0x56075fc16e50 2024-06-02T04:49:32.451 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.444+0000 7f72d589eb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x56075fb242b0 con 0x56075fc164f0 2024-06-02T04:49:32.451 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.444+0000 7f72c37fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56075fc17810 0x56075fc273b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:32.451 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.444+0000 7f72c37fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56075fc17810 0x56075fc273b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:54874/0 (socket says 172.21.15.76:54874) 2024-06-02T04:49:32.452 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.444+0000 7f72c37fe700 1 -- 172.21.15.76:0/2132961096 learned_addr learned my addr 172.21.15.76:0/2132961096 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:49:32.452 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.444+0000 7f72c27fc700 1 --2- 172.21.15.76:0/2132961096 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56075fc16e50 0x56075fc1ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:32.452 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.444+0000 7f72c2ffd700 1 --2- 172.21.15.76:0/2132961096 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56075fc164f0 0x56075fc168d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:32.452 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.444+0000 7f72c37fe700 1 -- 172.21.15.76:0/2132961096 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56075fc164f0 msgr2=0x56075fc168d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:49:32.452 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.444+0000 7f72c37fe700 1 --2- 172.21.15.76:0/2132961096 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56075fc164f0 0x56075fc168d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:32.452 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.444+0000 7f72c37fe700 1 -- 172.21.15.76:0/2132961096 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56075fc16e50 msgr2=0x56075fc1ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:49:32.452 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.444+0000 7f72c37fe700 1 --2- 172.21.15.76:0/2132961096 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56075fc16e50 0x56075fc1ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:32.452 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.444+0000 7f72c37fe700 1 -- 172.21.15.76:0/2132961096 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56075fb2c510 con 0x56075fc17810 2024-06-02T04:49:32.452 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.444+0000 7f72c37fe700 1 --2- 172.21.15.76:0/2132961096 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56075fc17810 0x56075fc273b0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f72bc00b930 tx=0x7f72bc00bc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a0767e3304e8326 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:32.453 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.444+0000 7f72b9ffb700 1 -- 172.21.15.76:0/2132961096 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72bc00dc40 con 0x56075fc17810 2024-06-02T04:49:32.453 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.444+0000 7f72b9ffb700 1 -- 172.21.15.76:0/2132961096 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f72bc00be80 con 0x56075fc17810 2024-06-02T04:49:32.453 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.444+0000 7f72b9ffb700 1 -- 172.21.15.76:0/2132961096 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72bc00f680 con 0x56075fc17810 2024-06-02T04:49:32.453 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.445+0000 7f72d589eb80 1 -- 172.21.15.76:0/2132961096 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56075fc17810 msgr2=0x56075fc273b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:32.453 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.445+0000 7f72d589eb80 1 --2- 172.21.15.76:0/2132961096 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56075fc17810 0x56075fc273b0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f72bc00b930 tx=0x7f72bc00bc40 comp rx=0 tx=0).stop 2024-06-02T04:49:32.454 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.445+0000 7f72d589eb80 1 -- 172.21.15.76:0/2132961096 shutdown_connections 2024-06-02T04:49:32.454 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.445+0000 7f72d589eb80 1 --2- 172.21.15.76:0/2132961096 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56075fc17810 0x56075fc273b0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:32.454 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.445+0000 7f72d589eb80 1 --2- 172.21.15.76:0/2132961096 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56075fc164f0 0x56075fc168d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:32.454 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.445+0000 7f72d589eb80 1 --2- 172.21.15.76:0/2132961096 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56075fc16e50 0x56075fc1ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:32.454 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.445+0000 7f72d589eb80 1 -- 172.21.15.76:0/2132961096 >> 172.21.15.76:0/2132961096 conn(0x56075fb741c0 msgr2=0x56075fc17c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:32.454 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.445+0000 7f72d589eb80 1 -- 172.21.15.76:0/2132961096 shutdown_connections 2024-06-02T04:49:32.454 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.445+0000 7f72d589eb80 1 -- 172.21.15.76:0/2132961096 wait complete. 2024-06-02T04:49:32.454 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.445+0000 7f72d589eb80 1 -- start start 2024-06-02T04:49:32.454 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.445+0000 7f72d589eb80 1 Processor -- start 2024-06-02T04:49:32.454 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.446+0000 7f72d589eb80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56075fc164f0 0x56075fc22fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:32.454 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.446+0000 7f72d589eb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56075fc16e50 0x56075fc23520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:32.454 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.446+0000 7f72d589eb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56075fc17810 0x56075fc264f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:32.454 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.446+0000 7f72d589eb80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x56075fc26a30 con 0x56075fc164f0 2024-06-02T04:49:32.455 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.446+0000 7f72d589eb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x56075fc26ba0 con 0x56075fc17810 2024-06-02T04:49:32.455 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.446+0000 7f72d589eb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x56075fc26d60 con 0x56075fc16e50 2024-06-02T04:49:32.455 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.446+0000 7f72d589eb80 10 client.0 _ll_register_callbacks cb 0x56075fb0bae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:49:32.455 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.446+0000 7f72c2ffd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56075fc164f0 0x56075fc22fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:32.455 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.446+0000 7f72c2ffd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56075fc164f0 0x56075fc22fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:54878/0 (socket says 172.21.15.76:54878) 2024-06-02T04:49:32.455 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.446+0000 7f72c2ffd700 1 -- 172.21.15.76:0/3996236554 learned_addr learned my addr 172.21.15.76:0/3996236554 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:49:32.455 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.446+0000 7f72c37fe700 1 --2- 172.21.15.76:0/3996236554 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56075fc17810 0x56075fc264f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:32.455 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.446+0000 7f72c2ffd700 1 -- 172.21.15.76:0/3996236554 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56075fc16e50 msgr2=0x56075fc23520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:49:32.455 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.446+0000 7f72c27fc700 1 --2- 172.21.15.76:0/3996236554 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56075fc16e50 0x56075fc23520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:32.455 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.446+0000 7f72c2ffd700 1 --2- 172.21.15.76:0/3996236554 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56075fc16e50 0x56075fc23520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:32.455 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.446+0000 7f72c2ffd700 1 -- 172.21.15.76:0/3996236554 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56075fc17810 msgr2=0x56075fc264f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:49:32.455 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.446+0000 7f72c2ffd700 1 --2- 172.21.15.76:0/3996236554 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56075fc17810 0x56075fc264f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:32.455 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.446+0000 7f72c2ffd700 1 -- 172.21.15.76:0/3996236554 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72bc00b610 con 0x56075fc164f0 2024-06-02T04:49:32.456 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.446+0000 7f72c27fc700 1 --2- 172.21.15.76:0/3996236554 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56075fc16e50 0x56075fc23520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:49:32.456 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.446+0000 7f72c37fe700 1 --2- 172.21.15.76:0/3996236554 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56075fc17810 0x56075fc264f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:49:32.456 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.446+0000 7f72c2ffd700 1 --2- 172.21.15.76:0/3996236554 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56075fc164f0 0x56075fc22fe0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f72b4009630 tx=0x7f72b4014e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3d9c1646aead8a server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:32.456 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.446+0000 7f72aa7fc700 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-06-02T04:49:32.456 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.446+0000 7f72aa7fc700 1 -- 172.21.15.76:0/3996236554 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b4021810 con 0x56075fc164f0 2024-06-02T04:49:32.456 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.446+0000 7f72aa7fc700 1 -- 172.21.15.76:0/3996236554 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f72b4021970 con 0x56075fc164f0 2024-06-02T04:49:32.456 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.446+0000 7f72d589eb80 1 -- 172.21.15.76:0/3996236554 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56075fb5ee70 con 0x56075fc164f0 2024-06-02T04:49:32.456 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.446+0000 7f72aa7fc700 1 -- 172.21.15.76:0/3996236554 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f72b4009ed0 con 0x56075fc164f0 2024-06-02T04:49:32.456 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.446+0000 7f72d589eb80 10 client.15399 fetch_fsmap learned FSMap version 24 2024-06-02T04:49:32.456 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.446+0000 7f72d589eb80 1 -- 172.21.15.76:0/3996236554 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x56075f9ebc80 con 0x56075fc164f0 2024-06-02T04:49:32.456 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.447+0000 7f72aa7fc700 1 -- 172.21.15.76:0/3996236554 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56075fb5ee70 con 0x56075fc164f0 2024-06-02T04:49:32.456 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.447+0000 7f72aa7fc700 1 -- 172.21.15.76:0/3996236554 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f72b402a5d0 con 0x56075fc164f0 2024-06-02T04:49:32.457 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.447+0000 7f72d589eb80 10 client.15399 fetch_fsmap finished waiting for FSMap version 24 2024-06-02T04:49:32.457 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.447+0000 7f72d589eb80 10 client.15399 resolve_mds: resolved name 'i' to daemon mds.i 2024-06-02T04:49:32.457 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.447+0000 7f72d589eb80 20 client.15399 populate_metadata read hostname 'smithi076' 2024-06-02T04:49:32.457 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.447+0000 7f72d589eb80 1 --2- 172.21.15.76:0/3996236554 >> [v2:172.21.15.192:6838/3978681402,v1:172.21.15.192:6839/3978681402] conn(0x56075fc85dc0 0x56075fc826d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:32.457 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.447+0000 7f72d589eb80 4 client.15399 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "status"}] 2024-06-02T04:49:32.457 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.447+0000 7f72d589eb80 1 -- 172.21.15.76:0/3996236554 --> [v2:172.21.15.192:6838/3978681402,v1:172.21.15.192:6839/3978681402] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56075f9b4ca0 con 0x56075fc85dc0 2024-06-02T04:49:32.457 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.447+0000 7f72c27fc700 1 --2- 172.21.15.76:0/3996236554 >> [v2:172.21.15.192:6838/3978681402,v1:172.21.15.192:6839/3978681402] conn(0x56075fc85dc0 0x56075fc826d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:32.457 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.448+0000 7f72c27fc700 1 --2- 172.21.15.76:0/3996236554 >> [v2:172.21.15.192:6838/3978681402,v1:172.21.15.192:6839/3978681402] conn(0x56075fc85dc0 0x56075fc826d0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ab1fa82e2a38e404 server_cookie=470ed1071f405082 in_seq=0 out_seq=0 2024-06-02T04:49:32.457 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.448+0000 7f72aa7fc700 10 client.15399 ms_handle_connect on v2:172.21.15.192:6838/3978681402 2024-06-02T04:49:32.457 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.448+0000 7f72aa7fc700 1 -- 172.21.15.76:0/3996236554 <== mds.1 v2:172.21.15.192:6838/3978681402 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+326 (crc 0 0 0) 0x56075f9b4ca0 con 0x56075fc85dc0 2024-06-02T04:49:32.457 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.448+0000 7f72aa7fc700 10 client.15399 handle_command_reply: tid=0 2024-06-02T04:49:32.457 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.448+0000 7f72d589eb80 1 client.15399 shutdown 2024-06-02T04:49:32.457 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.448+0000 7f72d589eb80 1 -- 172.21.15.76:0/3996236554 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56075fc164f0 msgr2=0x56075fc22fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:32.458 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.448+0000 7f72d589eb80 1 --2- 172.21.15.76:0/3996236554 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56075fc164f0 0x56075fc22fe0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f72b4009630 tx=0x7f72b4014e20 comp rx=0 tx=0).stop 2024-06-02T04:49:32.458 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.448+0000 7f72d589eb80 1 -- 172.21.15.76:0/3996236554 shutdown_connections 2024-06-02T04:49:32.458 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.448+0000 7f72d589eb80 1 --2- 172.21.15.76:0/3996236554 >> [v2:172.21.15.192:6838/3978681402,v1:172.21.15.192:6839/3978681402] conn(0x56075fc85dc0 0x56075fc826d0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:32.458 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.448+0000 7f72d589eb80 1 --2- 172.21.15.76:0/3996236554 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56075fc17810 0x56075fc264f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:32.458 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.448+0000 7f72d589eb80 1 --2- 172.21.15.76:0/3996236554 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56075fc164f0 0x56075fc22fe0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:32.458 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.448+0000 7f72aa7fc700 0 client.15399 ms_handle_reset on v2:172.21.15.192:6838/3978681402 2024-06-02T04:49:32.458 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.448+0000 7f72d589eb80 1 --2- 172.21.15.76:0/3996236554 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56075fc16e50 0x56075fc23520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:32.458 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.448+0000 7f72d589eb80 1 -- 172.21.15.76:0/3996236554 >> 172.21.15.76:0/3996236554 conn(0x56075fb741c0 msgr2=0x56075fc17bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:32.458 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.448+0000 7f72d589eb80 1 -- 172.21.15.76:0/3996236554 shutdown_connections 2024-06-02T04:49:32.458 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.448+0000 7f72d589eb80 1 -- 172.21.15.76:0/3996236554 wait complete. 2024-06-02T04:49:32.459 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.448+0000 7f72d589eb80 20 client.15399 trim_cache size 0 max 16384 2024-06-02T04:49:32.459 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-06-02T04:49:32.459 INFO:teuthology.orchestra.run.smithi076.stdout: "cluster_fsid": "60ab6d30-209a-11ef-bc9b-c7b262605968", 2024-06-02T04:49:32.459 INFO:teuthology.orchestra.run.smithi076.stdout: "whoami": 1, 2024-06-02T04:49:32.459 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 24475, 2024-06-02T04:49:32.459 INFO:teuthology.orchestra.run.smithi076.stdout: "want_state": "up:active", 2024-06-02T04:49:32.459 INFO:teuthology.orchestra.run.smithi076.stdout: "state": "up:active", 2024-06-02T04:49:32.459 INFO:teuthology.orchestra.run.smithi076.stdout: "fs_name": "cephfs", 2024-06-02T04:49:32.459 INFO:teuthology.orchestra.run.smithi076.stdout: "rank_uptime": 66.183610485000003, 2024-06-02T04:49:32.459 INFO:teuthology.orchestra.run.smithi076.stdout: "mdsmap_epoch": 24, 2024-06-02T04:49:32.460 INFO:teuthology.orchestra.run.smithi076.stdout: "osdmap_epoch": 82, 2024-06-02T04:49:32.460 INFO:teuthology.orchestra.run.smithi076.stdout: "osdmap_epoch_barrier": 80, 2024-06-02T04:49:32.460 INFO:teuthology.orchestra.run.smithi076.stdout: "uptime": 100.63864271 2024-06-02T04:49:32.460 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-06-02T04:49:32.461 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.448+0000 7f72c96e3700 1 -- 172.21.15.76:0/3901210270 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f72b00a11b0 msgr2=0x7f72b00a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:32.461 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.448+0000 7f72c96e3700 1 --2- 172.21.15.76:0/3901210270 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f72b00a11b0 0x7f72b00a3670 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f72b4009d90 tx=0x7f72b4009040 comp rx=0 tx=0).stop 2024-06-02T04:49:32.461 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.448+0000 7f72c96e3700 1 -- 172.21.15.76:0/3901210270 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f72c4100fb0 msgr2=0x7f72c4197350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:32.461 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.449+0000 7f72c96e3700 1 --2- 172.21.15.76:0/3901210270 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f72c4100fb0 0x7f72c4197350 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f72ac00b5c0 tx=0x7f72ac0057f0 comp rx=0 tx=0).stop 2024-06-02T04:49:32.461 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.449+0000 7f72c96e3700 1 -- 172.21.15.76:0/3901210270 shutdown_connections 2024-06-02T04:49:32.461 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.449+0000 7f72c96e3700 1 --2- 172.21.15.76:0/3901210270 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f72b00a11b0 0x7f72b00a3670 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:32.461 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.449+0000 7f72c96e3700 1 --2- 172.21.15.76:0/3901210270 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f72c4101970 0x7f72c419e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:32.461 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.449+0000 7f72c96e3700 1 --2- 172.21.15.76:0/3901210270 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f72c40ffe60 0x7f72c4196e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:32.461 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.449+0000 7f72c96e3700 1 --2- 172.21.15.76:0/3901210270 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f72c4100fb0 0x7f72c4197350 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:32.461 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.449+0000 7f72c96e3700 1 -- 172.21.15.76:0/3901210270 >> 172.21.15.76:0/3901210270 conn(0x7f72c40fb3f0 msgr2=0x7f72c4068060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:32.461 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.449+0000 7f72c96e3700 1 -- 172.21.15.76:0/3901210270 shutdown_connections 2024-06-02T04:49:32.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.449+0000 7f72c96e3700 1 -- 172.21.15.76:0/3901210270 wait complete. 2024-06-02T04:49:32.462 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:32 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/4016614846' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-06-02T04:49:32.462 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:32 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/419089219' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:49:32.462 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:32 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/878261952' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:49:32.463 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-06-02T04:49:32.588 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.585+0000 7f69c72cb700 1 -- 172.21.15.76:0/3405259182 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f69c0102c60 msgr2=0x7f69c0109510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:32.588 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.585+0000 7f69c72cb700 1 --2- 172.21.15.76:0/3405259182 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f69c0102c60 0x7f69c0109510 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f69b800b0a0 tx=0x7f69b800b3b0 comp rx=0 tx=0).stop 2024-06-02T04:49:32.588 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.585+0000 7f69c72cb700 1 -- 172.21.15.76:0/3405259182 shutdown_connections 2024-06-02T04:49:32.588 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.585+0000 7f69c72cb700 1 --2- 172.21.15.76:0/3405259182 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f69c0102c60 0x7f69c0109510 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:32.588 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.585+0000 7f69c72cb700 1 --2- 172.21.15.76:0/3405259182 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f69c00ff250 0x7f69c00ff670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:32.588 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.585+0000 7f69c72cb700 1 --2- 172.21.15.76:0/3405259182 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f69c01022c0 0x7f69c0102720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:32.588 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.586+0000 7f69c72cb700 1 -- 172.21.15.76:0/3405259182 >> 172.21.15.76:0/3405259182 conn(0x7f69c00fab80 msgr2=0x7f69c00fcfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:32.589 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.586+0000 7f69c72cb700 1 -- 172.21.15.76:0/3405259182 shutdown_connections 2024-06-02T04:49:32.589 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.586+0000 7f69c72cb700 1 -- 172.21.15.76:0/3405259182 wait complete. 2024-06-02T04:49:32.589 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.586+0000 7f69c72cb700 1 Processor -- start 2024-06-02T04:49:32.589 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.586+0000 7f69c72cb700 1 -- start start 2024-06-02T04:49:32.589 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.586+0000 7f69c72cb700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f69c00ff250 0x7f69c0101be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:32.589 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.586+0000 7f69c72cb700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f69c01022c0 0x7f69c0100270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:32.589 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.586+0000 7f69c72cb700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f69c0102c60 0x7f69c01007b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:32.589 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.586+0000 7f69c72cb700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69c0100f50 con 0x7f69c01022c0 2024-06-02T04:49:32.589 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.586+0000 7f69c72cb700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69c01010c0 con 0x7f69c0102c60 2024-06-02T04:49:32.589 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.586+0000 7f69c72cb700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69c01a0f40 con 0x7f69c00ff250 2024-06-02T04:49:32.589 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.586+0000 7f69c4866700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f69c01022c0 0x7f69c0100270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:32.589 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.587+0000 7f69c4866700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f69c01022c0 0x7f69c0100270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:54892/0 (socket says 172.21.15.76:54892) 2024-06-02T04:49:32.589 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.587+0000 7f69c4866700 1 -- 172.21.15.76:0/1753746975 learned_addr learned my addr 172.21.15.76:0/1753746975 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:49:32.589 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.587+0000 7f69c5868700 1 --2- 172.21.15.76:0/1753746975 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f69c0102c60 0x7f69c01007b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:32.590 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.587+0000 7f69c5067700 1 --2- 172.21.15.76:0/1753746975 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f69c00ff250 0x7f69c0101be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:32.590 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.587+0000 7f69c4866700 1 -- 172.21.15.76:0/1753746975 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f69c00ff250 msgr2=0x7f69c0101be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:32.590 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.587+0000 7f69c4866700 1 --2- 172.21.15.76:0/1753746975 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f69c00ff250 0x7f69c0101be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:32.590 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.587+0000 7f69c4866700 1 -- 172.21.15.76:0/1753746975 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f69c0102c60 msgr2=0x7f69c01007b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:32.590 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.587+0000 7f69c4866700 1 --2- 172.21.15.76:0/1753746975 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f69c0102c60 0x7f69c01007b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:32.590 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.587+0000 7f69c4866700 1 -- 172.21.15.76:0/1753746975 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69b8009d00 con 0x7f69c01022c0 2024-06-02T04:49:32.590 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.587+0000 7f69c4866700 1 --2- 172.21.15.76:0/1753746975 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f69c01022c0 0x7f69c0100270 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f69b000d980 tx=0x7f69b000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:32.590 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.587+0000 7f69b67fc700 1 -- 172.21.15.76:0/1753746975 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69b0004220 con 0x7f69c01022c0 2024-06-02T04:49:32.590 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.587+0000 7f69b67fc700 1 -- 172.21.15.76:0/1753746975 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f69b0007640 con 0x7f69c01022c0 2024-06-02T04:49:32.590 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.587+0000 7f69c72cb700 1 -- 172.21.15.76:0/1753746975 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69c01a11d0 con 0x7f69c01022c0 2024-06-02T04:49:32.591 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.587+0000 7f69b67fc700 1 -- 172.21.15.76:0/1753746975 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69b00055e0 con 0x7f69c01022c0 2024-06-02T04:49:32.591 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.587+0000 7f69c72cb700 1 -- 172.21.15.76:0/1753746975 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69c01a1730 con 0x7f69c01022c0 2024-06-02T04:49:32.596 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.589+0000 7f69b67fc700 1 -- 172.21.15.76:0/1753746975 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f69b0004750 con 0x7f69c01022c0 2024-06-02T04:49:32.596 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.590+0000 7f69b67fc700 1 --2- 172.21.15.76:0/1753746975 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f69ac0a1230 0x7f69ac0a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:32.596 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.590+0000 7f69c5067700 1 --2- 172.21.15.76:0/1753746975 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f69ac0a1230 0x7f69ac0a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:32.596 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.590+0000 7f69b67fc700 1 -- 172.21.15.76:0/1753746975 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f69b00ccb10 con 0x7f69c01022c0 2024-06-02T04:49:32.596 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.590+0000 7f69c5067700 1 --2- 172.21.15.76:0/1753746975 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f69ac0a1230 0x7f69ac0a36f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f69c0069190 tx=0x7f69bc009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:32.596 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.591+0000 7f69d3486b80 1 Processor -- start 2024-06-02T04:49:32.596 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.591+0000 7f69d3486b80 1 -- start start 2024-06-02T04:49:32.597 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.591+0000 7f69d3486b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5611c3d594f0 0x5611c3d59910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:32.597 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.591+0000 7f69d3486b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5611c3d59e50 0x5611c3d5a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:32.597 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.591+0000 7f69d3486b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5611c3d5a810 0x5611c3d5ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:32.597 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.591+0000 7f69d3486b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611c3cb0100 con 0x5611c3d594f0 2024-06-02T04:49:32.597 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.591+0000 7f69d3486b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611c3cadac0 con 0x5611c3d59e50 2024-06-02T04:49:32.597 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.591+0000 7f69d3486b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611c3ca93b0 con 0x5611c3d5a810 2024-06-02T04:49:32.597 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.591+0000 7f69c5067700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5611c3d594f0 0x5611c3d59910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:32.597 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.591+0000 7f69c5067700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5611c3d594f0 0x5611c3d59910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:54902/0 (socket says 172.21.15.76:54902) 2024-06-02T04:49:32.597 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.591+0000 7f69c5067700 1 -- 172.21.15.76:0/1989182835 learned_addr learned my addr 172.21.15.76:0/1989182835 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:49:32.597 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.591+0000 7f69c5868700 1 --2- 172.21.15.76:0/1989182835 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5611c3d5a810 0x5611c3d5ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:32.598 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.592+0000 7f69c5067700 1 -- 172.21.15.76:0/1989182835 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5611c3d5a810 msgr2=0x5611c3d5ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:49:32.598 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.592+0000 7f69c5067700 1 --2- 172.21.15.76:0/1989182835 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5611c3d5a810 0x5611c3d5ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:32.598 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.592+0000 7f69c5067700 1 -- 172.21.15.76:0/1989182835 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5611c3d59e50 msgr2=0x5611c3d5a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:49:32.598 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.592+0000 7f69c5067700 1 --2- 172.21.15.76:0/1989182835 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5611c3d59e50 0x5611c3d5a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:32.598 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.592+0000 7f69c5067700 1 -- 172.21.15.76:0/1989182835 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5611c3b2a360 con 0x5611c3d594f0 2024-06-02T04:49:32.598 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.592+0000 7f69c5067700 1 --2- 172.21.15.76:0/1989182835 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5611c3d594f0 0x5611c3d59910 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f69bc011e20 tx=0x7f69bc014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0e5df6023c46a93 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:32.598 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.592+0000 7f69ab7fe700 1 -- 172.21.15.76:0/1989182835 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69bc01f620 con 0x5611c3d594f0 2024-06-02T04:49:32.598 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.592+0000 7f69ab7fe700 1 -- 172.21.15.76:0/1989182835 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f69bc016070 con 0x5611c3d594f0 2024-06-02T04:49:32.598 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.592+0000 7f69ab7fe700 1 -- 172.21.15.76:0/1989182835 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69bc01d8d0 con 0x5611c3d594f0 2024-06-02T04:49:32.598 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.593+0000 7f69d3486b80 1 -- 172.21.15.76:0/1989182835 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5611c3d594f0 msgr2=0x5611c3d59910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:32.598 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.593+0000 7f69d3486b80 1 --2- 172.21.15.76:0/1989182835 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5611c3d594f0 0x5611c3d59910 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f69bc011e20 tx=0x7f69bc014000 comp rx=0 tx=0).stop 2024-06-02T04:49:32.598 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.593+0000 7f69d3486b80 1 -- 172.21.15.76:0/1989182835 shutdown_connections 2024-06-02T04:49:32.598 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.593+0000 7f69d3486b80 1 --2- 172.21.15.76:0/1989182835 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5611c3d5a810 0x5611c3d5ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:32.599 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.593+0000 7f69d3486b80 1 --2- 172.21.15.76:0/1989182835 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5611c3d594f0 0x5611c3d59910 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:32.599 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.593+0000 7f69d3486b80 1 --2- 172.21.15.76:0/1989182835 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5611c3d59e50 0x5611c3d5a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:32.599 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.593+0000 7f69d3486b80 1 -- 172.21.15.76:0/1989182835 >> 172.21.15.76:0/1989182835 conn(0x5611c3cb71c0 msgr2=0x5611c3d53d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:32.599 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.593+0000 7f69d3486b80 1 -- 172.21.15.76:0/1989182835 shutdown_connections 2024-06-02T04:49:32.599 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.593+0000 7f69d3486b80 1 -- 172.21.15.76:0/1989182835 wait complete. 2024-06-02T04:49:32.599 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.593+0000 7f69d3486b80 1 -- start start 2024-06-02T04:49:32.599 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.593+0000 7f69d3486b80 1 Processor -- start 2024-06-02T04:49:32.599 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.594+0000 7f69d3486b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5611c3d594f0 0x5611c3d62e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:32.599 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.594+0000 7f69d3486b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5611c3d59e50 0x5611c3d63350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:32.599 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.594+0000 7f69d3486b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5611c3d5a810 0x5611c3d6a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:32.599 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.594+0000 7f69d3486b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611c3c45510 con 0x5611c3d594f0 2024-06-02T04:49:32.599 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.594+0000 7f69d3486b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611c3c451b0 con 0x5611c3d5a810 2024-06-02T04:49:32.599 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.594+0000 7f69d3486b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611c3b2c650 con 0x5611c3d59e50 2024-06-02T04:49:32.600 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.594+0000 7f69c5067700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5611c3d594f0 0x5611c3d62e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:32.600 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.594+0000 7f69c5067700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5611c3d594f0 0x5611c3d62e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:54918/0 (socket says 172.21.15.76:54918) 2024-06-02T04:49:32.600 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.594+0000 7f69c5067700 1 -- 172.21.15.76:0/1408249690 learned_addr learned my addr 172.21.15.76:0/1408249690 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:49:32.600 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.594+0000 7f69d3486b80 10 client.0 _ll_register_callbacks cb 0x5611c3c4eae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:49:32.600 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.594+0000 7f69c4866700 1 --2- 172.21.15.76:0/1408249690 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5611c3d59e50 0x5611c3d63350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:32.600 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.594+0000 7f69c5868700 1 --2- 172.21.15.76:0/1408249690 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5611c3d5a810 0x5611c3d6a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:32.600 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.594+0000 7f69c5067700 1 -- 172.21.15.76:0/1408249690 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5611c3d59e50 msgr2=0x5611c3d63350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:49:32.600 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.594+0000 7f69c5067700 1 --2- 172.21.15.76:0/1408249690 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5611c3d59e50 0x5611c3d63350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:32.600 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.594+0000 7f69c5067700 1 -- 172.21.15.76:0/1408249690 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5611c3d5a810 msgr2=0x5611c3d6a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:49:32.600 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.594+0000 7f69c5067700 1 --2- 172.21.15.76:0/1408249690 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5611c3d5a810 0x5611c3d6a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:32.600 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.594+0000 7f69c5067700 1 -- 172.21.15.76:0/1408249690 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69bc011ad0 con 0x5611c3d594f0 2024-06-02T04:49:32.600 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.594+0000 7f69c5067700 1 --2- 172.21.15.76:0/1408249690 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5611c3d594f0 0x5611c3d62e10 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f69bc01ff50 tx=0x7f69bc0099a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66971e1cfc4abc server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:32.600 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.594+0000 7f69a8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-06-02T04:49:32.601 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.594+0000 7f69a8ff9700 1 -- 172.21.15.76:0/1408249690 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69bc02e070 con 0x5611c3d594f0 2024-06-02T04:49:32.601 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.594+0000 7f69a8ff9700 1 -- 172.21.15.76:0/1408249690 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f69bc018070 con 0x5611c3d594f0 2024-06-02T04:49:32.601 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.594+0000 7f69d3486b80 1 -- 172.21.15.76:0/1408249690 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5611c3c02220 con 0x5611c3d594f0 2024-06-02T04:49:32.601 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.595+0000 7f69a8ff9700 1 -- 172.21.15.76:0/1408249690 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f69bc011ed0 con 0x5611c3d594f0 2024-06-02T04:49:32.601 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.595+0000 7f69d3486b80 10 client.15411 fetch_fsmap learned FSMap version 24 2024-06-02T04:49:32.601 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.595+0000 7f69d3486b80 1 -- 172.21.15.76:0/1408249690 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x5611c3ad6b10 con 0x5611c3d594f0 2024-06-02T04:49:32.601 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.595+0000 7f69a8ff9700 1 -- 172.21.15.76:0/1408249690 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5611c3c02220 con 0x5611c3d594f0 2024-06-02T04:49:32.601 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.595+0000 7f69a8ff9700 1 -- 172.21.15.76:0/1408249690 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f69bc003680 con 0x5611c3d594f0 2024-06-02T04:49:32.601 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.595+0000 7f69d3486b80 10 client.15411 fetch_fsmap finished waiting for FSMap version 24 2024-06-02T04:49:32.601 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.595+0000 7f69d3486b80 10 client.15411 resolve_mds: resolved name 'b' to daemon mds.b 2024-06-02T04:49:32.601 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.595+0000 7f69d3486b80 20 client.15411 populate_metadata read hostname 'smithi076' 2024-06-02T04:49:32.601 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.595+0000 7f69d3486b80 1 --2- 172.21.15.76:0/1408249690 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5611c3d6df10 0x5611c3d731b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:32.601 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.595+0000 7f69d3486b80 4 client.15411 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T04:49:32.602 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.595+0000 7f69d3486b80 1 -- 172.21.15.76:0/1408249690 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5611c3d287c0 con 0x5611c3d6df10 2024-06-02T04:49:32.602 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.595+0000 7f69c4866700 1 --2- 172.21.15.76:0/1408249690 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5611c3d6df10 0x5611c3d731b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:32.602 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.596+0000 7f69c4866700 1 --2- 172.21.15.76:0/1408249690 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5611c3d6df10 0x5611c3d731b0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=487b9cce34fa0e7e server_cookie=5ba076ed993f8f62 in_seq=0 out_seq=0 2024-06-02T04:49:32.602 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.596+0000 7f69a8ff9700 10 client.15411 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:49:32.602 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:32 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/4016614846' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-06-02T04:49:32.602 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:32 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/419089219' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:49:32.603 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:32 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/878261952' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:49:32.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.596+0000 7f69a8ff9700 1 -- 172.21.15.76:0/1408249690 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5611c3d287c0 con 0x5611c3d6df10 2024-06-02T04:49:32.604 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.596+0000 7f69a8ff9700 10 client.15411 handle_command_reply: tid=0 2024-06-02T04:49:32.604 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.596+0000 7f69d3486b80 1 client.15411 shutdown 2024-06-02T04:49:32.604 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.596+0000 7f69d3486b80 1 -- 172.21.15.76:0/1408249690 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5611c3d594f0 msgr2=0x5611c3d62e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:32.604 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.596+0000 7f69d3486b80 1 --2- 172.21.15.76:0/1408249690 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5611c3d594f0 0x5611c3d62e10 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f69bc01ff50 tx=0x7f69bc0099a0 comp rx=0 tx=0).stop 2024-06-02T04:49:32.604 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.597+0000 7f69d3486b80 1 -- 172.21.15.76:0/1408249690 shutdown_connections 2024-06-02T04:49:32.604 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.597+0000 7f69d3486b80 1 --2- 172.21.15.76:0/1408249690 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5611c3d6df10 0x5611c3d731b0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:32.604 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.597+0000 7f69d3486b80 1 --2- 172.21.15.76:0/1408249690 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5611c3d5a810 0x5611c3d6a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:32.604 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.597+0000 7f69d3486b80 1 --2- 172.21.15.76:0/1408249690 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5611c3d594f0 0x5611c3d62e10 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:32.604 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.597+0000 7f69a8ff9700 0 client.15411 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:49:32.604 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.597+0000 7f69d3486b80 1 --2- 172.21.15.76:0/1408249690 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5611c3d59e50 0x5611c3d63350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:32.604 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.597+0000 7f69d3486b80 1 -- 172.21.15.76:0/1408249690 >> 172.21.15.76:0/1408249690 conn(0x5611c3cb71c0 msgr2=0x5611c3d53550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:32.604 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.597+0000 7f69d3486b80 1 -- 172.21.15.76:0/1408249690 shutdown_connections 2024-06-02T04:49:32.605 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.597+0000 7f69d3486b80 1 -- 172.21.15.76:0/1408249690 wait complete. 2024-06-02T04:49:32.605 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.597+0000 7f69d3486b80 20 client.15411 trim_cache size 0 max 16384 2024-06-02T04:49:32.621 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.615+0000 7f69d3486b80 1 Processor -- start 2024-06-02T04:49:32.621 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.615+0000 7f69d3486b80 1 -- start start 2024-06-02T04:49:32.621 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.615+0000 7f69d3486b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5611c3d594f0 0x5611c3d61a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:32.621 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.615+0000 7f69d3486b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5611c3d59e50 0x5611c3d6aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:32.621 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.615+0000 7f69d3486b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5611c3d5a810 0x5611c3d6a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:32.621 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.615+0000 7f69d3486b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611c3ca6010 con 0x5611c3d59e50 2024-06-02T04:49:32.621 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.615+0000 7f69d3486b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611c3c485a0 con 0x5611c3d594f0 2024-06-02T04:49:32.621 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.615+0000 7f69d3486b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611c3d616c0 con 0x5611c3d5a810 2024-06-02T04:49:32.621 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.615+0000 7f69c4866700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5611c3d59e50 0x5611c3d6aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:32.621 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.615+0000 7f69c4866700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5611c3d59e50 0x5611c3d6aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:54930/0 (socket says 172.21.15.76:54930) 2024-06-02T04:49:32.621 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.615+0000 7f69c4866700 1 -- 172.21.15.76:0/3171166987 learned_addr learned my addr 172.21.15.76:0/3171166987 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:49:32.621 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.615+0000 7f69c5868700 1 --2- 172.21.15.76:0/3171166987 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5611c3d5a810 0x5611c3d6a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:32.622 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.615+0000 7f69c5067700 1 --2- 172.21.15.76:0/3171166987 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5611c3d594f0 0x5611c3d61a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:32.622 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.615+0000 7f69c4866700 1 -- 172.21.15.76:0/3171166987 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5611c3d5a810 msgr2=0x5611c3d6a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:49:32.622 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.615+0000 7f69c4866700 1 --2- 172.21.15.76:0/3171166987 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5611c3d5a810 0x5611c3d6a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:32.622 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.615+0000 7f69c4866700 1 -- 172.21.15.76:0/3171166987 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5611c3d594f0 msgr2=0x5611c3d61a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:49:32.622 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.615+0000 7f69c4866700 1 --2- 172.21.15.76:0/3171166987 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5611c3d594f0 0x5611c3d61a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:32.622 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.615+0000 7f69c4866700 1 -- 172.21.15.76:0/3171166987 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5611c3c6f510 con 0x5611c3d59e50 2024-06-02T04:49:32.622 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.615+0000 7f69c5868700 1 --2- 172.21.15.76:0/3171166987 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5611c3d5a810 0x5611c3d6a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:49:32.622 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.616+0000 7f69c4866700 1 --2- 172.21.15.76:0/3171166987 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5611c3d59e50 0x5611c3d6aa40 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f69b0099790 tx=0x7f69b00045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60da8e79d6170736 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:32.622 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.616+0000 7f69abfff700 1 -- 172.21.15.76:0/3171166987 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69b0099a90 con 0x5611c3d59e50 2024-06-02T04:49:32.622 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.616+0000 7f69abfff700 1 -- 172.21.15.76:0/3171166987 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f69b0014030 con 0x5611c3d59e50 2024-06-02T04:49:32.622 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.616+0000 7f69abfff700 1 -- 172.21.15.76:0/3171166987 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69b00b2220 con 0x5611c3d59e50 2024-06-02T04:49:32.622 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.616+0000 7f69d3486b80 1 -- 172.21.15.76:0/3171166987 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5611c3d59e50 msgr2=0x5611c3d6aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:32.622 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.616+0000 7f69d3486b80 1 --2- 172.21.15.76:0/3171166987 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5611c3d59e50 0x5611c3d6aa40 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f69b0099790 tx=0x7f69b00045e0 comp rx=0 tx=0).stop 2024-06-02T04:49:32.623 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.616+0000 7f69d3486b80 1 -- 172.21.15.76:0/3171166987 shutdown_connections 2024-06-02T04:49:32.623 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.616+0000 7f69d3486b80 1 --2- 172.21.15.76:0/3171166987 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5611c3d5a810 0x5611c3d6a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:32.623 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.616+0000 7f69d3486b80 1 --2- 172.21.15.76:0/3171166987 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5611c3d594f0 0x5611c3d61a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:32.623 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.616+0000 7f69d3486b80 1 --2- 172.21.15.76:0/3171166987 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5611c3d59e50 0x5611c3d6aa40 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:32.623 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.616+0000 7f69d3486b80 1 -- 172.21.15.76:0/3171166987 >> 172.21.15.76:0/3171166987 conn(0x5611c3cb71c0 msgr2=0x5611c3d5abf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:32.623 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.616+0000 7f69d3486b80 1 -- 172.21.15.76:0/3171166987 shutdown_connections 2024-06-02T04:49:32.623 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.616+0000 7f69d3486b80 1 -- 172.21.15.76:0/3171166987 wait complete. 2024-06-02T04:49:32.623 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.616+0000 7f69d3486b80 1 -- start start 2024-06-02T04:49:32.623 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.617+0000 7f69d3486b80 1 Processor -- start 2024-06-02T04:49:32.623 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.617+0000 7f69d3486b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5611c3d594f0 0x5611c3d67380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:32.623 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.617+0000 7f69d3486b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5611c3d59e50 0x5611c3d698d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:32.623 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.617+0000 7f69d3486b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5611c3d5a810 0x5611c3d69e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:32.623 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.617+0000 7f69d3486b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611c3d53b50 con 0x5611c3d59e50 2024-06-02T04:49:32.624 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.617+0000 7f69d3486b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611c3d6a350 con 0x5611c3d594f0 2024-06-02T04:49:32.624 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.617+0000 7f69d3486b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611c3d6a510 con 0x5611c3d5a810 2024-06-02T04:49:32.624 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.617+0000 7f69d3486b80 10 client.0 _ll_register_callbacks cb 0x5611c3c4eae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:49:32.624 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.617+0000 7f69c4866700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5611c3d59e50 0x5611c3d698d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:32.624 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.617+0000 7f69c4866700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5611c3d59e50 0x5611c3d698d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:54932/0 (socket says 172.21.15.76:54932) 2024-06-02T04:49:32.624 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.617+0000 7f69c4866700 1 -- 172.21.15.76:0/3462404892 learned_addr learned my addr 172.21.15.76:0/3462404892 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:49:32.624 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.617+0000 7f69c5067700 1 --2- 172.21.15.76:0/3462404892 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5611c3d594f0 0x5611c3d67380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:32.624 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.617+0000 7f69c5868700 1 --2- 172.21.15.76:0/3462404892 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5611c3d5a810 0x5611c3d69e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:32.624 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.617+0000 7f69c4866700 1 -- 172.21.15.76:0/3462404892 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5611c3d5a810 msgr2=0x5611c3d69e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:49:32.624 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.617+0000 7f69c4866700 1 --2- 172.21.15.76:0/3462404892 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5611c3d5a810 0x5611c3d69e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:32.624 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.617+0000 7f69c4866700 1 -- 172.21.15.76:0/3462404892 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5611c3d594f0 msgr2=0x5611c3d67380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:49:32.624 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.617+0000 7f69c4866700 1 --2- 172.21.15.76:0/3462404892 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5611c3d594f0 0x5611c3d67380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:32.624 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.617+0000 7f69c4866700 1 -- 172.21.15.76:0/3462404892 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69c01a1730 con 0x5611c3d59e50 2024-06-02T04:49:32.625 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.617+0000 7f69c5067700 1 --2- 172.21.15.76:0/3462404892 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5611c3d594f0 0x5611c3d67380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:49:32.625 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.618+0000 7f69c4866700 1 --2- 172.21.15.76:0/3462404892 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5611c3d59e50 0x5611c3d698d0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f69b0096500 tx=0x7f69b009d9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4431e7d3400f488a server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:32.625 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.618+0000 7f69a8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-06-02T04:49:32.625 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.618+0000 7f69a8ff9700 1 -- 172.21.15.76:0/3462404892 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69b00b2430 con 0x5611c3d59e50 2024-06-02T04:49:32.625 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.618+0000 7f69a8ff9700 1 -- 172.21.15.76:0/3462404892 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f69b0099cf0 con 0x5611c3d59e50 2024-06-02T04:49:32.625 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.618+0000 7f69d3486b80 1 -- 172.21.15.76:0/3462404892 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f69bc016070 con 0x5611c3d59e50 2024-06-02T04:49:32.625 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.618+0000 7f69a8ff9700 1 -- 172.21.15.76:0/3462404892 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f69b0099eb0 con 0x5611c3d59e50 2024-06-02T04:49:32.625 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.618+0000 7f69d3486b80 10 client.15417 fetch_fsmap learned FSMap version 24 2024-06-02T04:49:32.625 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.618+0000 7f69d3486b80 1 -- 172.21.15.76:0/3462404892 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x5611c3b2ec80 con 0x5611c3d59e50 2024-06-02T04:49:32.625 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.618+0000 7f69a8ff9700 1 -- 172.21.15.76:0/3462404892 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f69b0082080 con 0x5611c3d59e50 2024-06-02T04:49:32.625 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.618+0000 7f69a8ff9700 1 -- 172.21.15.76:0/3462404892 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f69b00a1ba0 con 0x5611c3d59e50 2024-06-02T04:49:32.625 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.618+0000 7f69d3486b80 10 client.15417 fetch_fsmap finished waiting for FSMap version 24 2024-06-02T04:49:32.625 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.618+0000 7f69d3486b80 10 client.15417 resolve_mds: resolved name 'b' to daemon mds.b 2024-06-02T04:49:32.626 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.618+0000 7f69d3486b80 20 client.15417 populate_metadata read hostname 'smithi076' 2024-06-02T04:49:32.626 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.618+0000 7f69d3486b80 1 --2- 172.21.15.76:0/3462404892 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5611c3dc94d0 0x5611c3dc5e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:32.626 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.618+0000 7f69d3486b80 4 client.15417 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "status"}] 2024-06-02T04:49:32.626 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.618+0000 7f69d3486b80 1 -- 172.21.15.76:0/3462404892 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5611c3ca1e70 con 0x5611c3dc94d0 2024-06-02T04:49:32.626 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.619+0000 7f69c5067700 1 --2- 172.21.15.76:0/3462404892 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5611c3dc94d0 0x5611c3dc5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:32.626 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.619+0000 7f69c5067700 1 --2- 172.21.15.76:0/3462404892 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5611c3dc94d0 0x5611c3dc5e60 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bb999b6254ed1f98 server_cookie=45b9e5c748528ea4 in_seq=0 out_seq=0 2024-06-02T04:49:32.626 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.619+0000 7f69a8ff9700 10 client.15417 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:49:32.626 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.619+0000 7f69a8ff9700 1 -- 172.21.15.76:0/3462404892 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x5611c3ca1e70 con 0x5611c3dc94d0 2024-06-02T04:49:32.626 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.619+0000 7f69a8ff9700 10 client.15417 handle_command_reply: tid=0 2024-06-02T04:49:32.626 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.619+0000 7f69d3486b80 1 client.15417 shutdown 2024-06-02T04:49:32.626 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.619+0000 7f69d3486b80 1 -- 172.21.15.76:0/3462404892 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5611c3d59e50 msgr2=0x5611c3d698d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:32.626 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.619+0000 7f69d3486b80 1 --2- 172.21.15.76:0/3462404892 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5611c3d59e50 0x5611c3d698d0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f69b0096500 tx=0x7f69b009d9e0 comp rx=0 tx=0).stop 2024-06-02T04:49:32.626 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.619+0000 7f69d3486b80 1 -- 172.21.15.76:0/3462404892 shutdown_connections 2024-06-02T04:49:32.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.619+0000 7f69d3486b80 1 --2- 172.21.15.76:0/3462404892 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5611c3dc94d0 0x5611c3dc5e60 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:32.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.619+0000 7f69d3486b80 1 --2- 172.21.15.76:0/3462404892 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5611c3d5a810 0x5611c3d69e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:32.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.619+0000 7f69d3486b80 1 --2- 172.21.15.76:0/3462404892 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5611c3d594f0 0x5611c3d67380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:32.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.619+0000 7f69a8ff9700 0 client.15417 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:49:32.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.619+0000 7f69d3486b80 1 --2- 172.21.15.76:0/3462404892 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5611c3d59e50 0x5611c3d698d0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:32.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.619+0000 7f69d3486b80 1 -- 172.21.15.76:0/3462404892 >> 172.21.15.76:0/3462404892 conn(0x5611c3cb71c0 msgr2=0x5611c3d53d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:32.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.619+0000 7f69d3486b80 1 -- 172.21.15.76:0/3462404892 shutdown_connections 2024-06-02T04:49:32.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.619+0000 7f69d3486b80 1 -- 172.21.15.76:0/3462404892 wait complete. 2024-06-02T04:49:32.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.620+0000 7f69d3486b80 20 client.15417 trim_cache size 0 max 16384 2024-06-02T04:49:32.627 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-06-02T04:49:32.628 INFO:teuthology.orchestra.run.smithi076.stdout: "cluster_fsid": "60ab6d30-209a-11ef-bc9b-c7b262605968", 2024-06-02T04:49:32.628 INFO:teuthology.orchestra.run.smithi076.stdout: "whoami": 0, 2024-06-02T04:49:32.628 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 24491, 2024-06-02T04:49:32.628 INFO:teuthology.orchestra.run.smithi076.stdout: "want_state": "up:active", 2024-06-02T04:49:32.628 INFO:teuthology.orchestra.run.smithi076.stdout: "state": "up:active", 2024-06-02T04:49:32.628 INFO:teuthology.orchestra.run.smithi076.stdout: "fs_name": "cephfs", 2024-06-02T04:49:32.628 INFO:teuthology.orchestra.run.smithi076.stdout: "rank_uptime": 89.954125864999995, 2024-06-02T04:49:32.628 INFO:teuthology.orchestra.run.smithi076.stdout: "mdsmap_epoch": 24, 2024-06-02T04:49:32.628 INFO:teuthology.orchestra.run.smithi076.stdout: "osdmap_epoch": 82, 2024-06-02T04:49:32.628 INFO:teuthology.orchestra.run.smithi076.stdout: "osdmap_epoch_barrier": 80, 2024-06-02T04:49:32.628 INFO:teuthology.orchestra.run.smithi076.stdout: "uptime": 95.511490049000003 2024-06-02T04:49:32.628 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-06-02T04:49:32.629 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.620+0000 7f69c72cb700 1 -- 172.21.15.76:0/1753746975 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f69ac0a1230 msgr2=0x7f69ac0a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:32.629 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.620+0000 7f69c72cb700 1 --2- 172.21.15.76:0/1753746975 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f69ac0a1230 0x7f69ac0a36f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f69c0069190 tx=0x7f69bc009260 comp rx=0 tx=0).stop 2024-06-02T04:49:32.629 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.620+0000 7f69c72cb700 1 -- 172.21.15.76:0/1753746975 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f69c01022c0 msgr2=0x7f69c0100270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:32.629 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.620+0000 7f69c72cb700 1 --2- 172.21.15.76:0/1753746975 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f69c01022c0 0x7f69c0100270 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f69b000d980 tx=0x7f69b000dc90 comp rx=0 tx=0).stop 2024-06-02T04:49:32.629 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.620+0000 7f69c72cb700 1 -- 172.21.15.76:0/1753746975 shutdown_connections 2024-06-02T04:49:32.630 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.620+0000 7f69c72cb700 1 --2- 172.21.15.76:0/1753746975 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f69ac0a1230 0x7f69ac0a36f0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:32.630 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.620+0000 7f69c72cb700 1 --2- 172.21.15.76:0/1753746975 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f69c0102c60 0x7f69c01007b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:32.630 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.620+0000 7f69c72cb700 1 --2- 172.21.15.76:0/1753746975 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f69c00ff250 0x7f69c0101be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:32.630 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.620+0000 7f69c72cb700 1 --2- 172.21.15.76:0/1753746975 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f69c01022c0 0x7f69c0100270 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:32.630 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.620+0000 7f69c72cb700 1 -- 172.21.15.76:0/1753746975 >> 172.21.15.76:0/1753746975 conn(0x7f69c00fab80 msgr2=0x7f69c01056e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:32.630 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.620+0000 7f69c72cb700 1 -- 172.21.15.76:0/1753746975 shutdown_connections 2024-06-02T04:49:32.630 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:32.620+0000 7f69c72cb700 1 -- 172.21.15.76:0/1753746975 wait complete. 2024-06-02T04:49:32.632 INFO:teuthology.run_tasks:Running task sequential... 2024-06-02T04:49:32.642 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-06-02T04:49:32.642 INFO:teuthology.task.sequential:In sequential, running task print... 2024-06-02T04:49:32.643 INFO:teuthology.task.print:Enabling mgr modules 2024-06-02T04:49:32.643 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-06-02T04:49:32.666 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-06-02T04:49:32.666 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-06-02T04:49:32.666 INFO:tasks.ceph_fuse:client.0 config is {'mntopts': ['context=system_u:object_r:postgresql_db_t:s0'], 'mount_subvol_num': 0, 'mountpoint': '/tmp/cephfs'} 2024-06-02T04:49:32.667 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-06-02T04:49:32.667 INFO:tasks.cephfs.mount:using client_config["hostfs_mntpt"] = /tmp/cephfs 2024-06-02T04:49:32.667 INFO:tasks.cephfs.mount:hostfs_mntpt = /tmp/cephfs 2024-06-02T04:49:32.667 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T04:49:32.667 DEBUG:teuthology.orchestra.run.smithi076:> ip netns list 2024-06-02T04:49:32.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:32 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/4016614846' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-06-02T04:49:32.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:32 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/419089219' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:49:32.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:32 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/878261952' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:49:32.684 INFO:teuthology.orchestra.run.smithi076.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-06-02T04:49:32.685 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T04:49:32.685 DEBUG:teuthology.orchestra.run.smithi076:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-06-02T04:49:32.764 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T04:49:32.765 DEBUG:teuthology.orchestra.run.smithi076:> sudo ip link delete ceph-brx 2024-06-02T04:49:32.864 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-06-02T04:49:32.865 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell --fsid 60ab6d30-209a-11ef-bc9b-c7b262605968 -- ceph fs ls 2024-06-02T04:49:33.091 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T04:49:33.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:33 smithi076 ceph-mon[42935]: pgmap v265: 129 pgs: 129 active+clean; 639 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-02T04:49:33.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:33 smithi119 ceph-mon[46633]: pgmap v265: 129 pgs: 129 active+clean; 639 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-02T04:49:33.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:33 smithi192 ceph-mon[47933]: pgmap v265: 129 pgs: 129 active+clean; 639 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-02T04:49:34.088 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:34.085+0000 7f8b3f1c1700 1 -- 172.21.15.76:0/3108701883 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8b38107030 msgr2=0x7f8b38107410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:34.088 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:34.085+0000 7f8b3f1c1700 1 --2- 172.21.15.76:0/3108701883 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8b38107030 0x7f8b38107410 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f8b2c009990 tx=0x7f8b2c009ca0 comp rx=0 tx=0).stop 2024-06-02T04:49:34.088 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:34.086+0000 7f8b3f1c1700 1 -- 172.21.15.76:0/3108701883 shutdown_connections 2024-06-02T04:49:34.088 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:34.086+0000 7f8b3f1c1700 1 --2- 172.21.15.76:0/3108701883 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8b38101990 0x7f8b3810de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:34.088 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:34.086+0000 7f8b3f1c1700 1 --2- 172.21.15.76:0/3108701883 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8b38107030 0x7f8b38107410 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:34.088 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:34.086+0000 7f8b3f1c1700 1 --2- 172.21.15.76:0/3108701883 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8b38100ff0 0x7f8b38101450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:34.088 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:34.086+0000 7f8b3f1c1700 1 -- 172.21.15.76:0/3108701883 >> 172.21.15.76:0/3108701883 conn(0x7f8b38078190 msgr2=0x7f8b380785a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:34.088 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:34.086+0000 7f8b3f1c1700 1 -- 172.21.15.76:0/3108701883 shutdown_connections 2024-06-02T04:49:34.088 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:34.086+0000 7f8b3f1c1700 1 -- 172.21.15.76:0/3108701883 wait complete. 2024-06-02T04:49:34.089 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:34.086+0000 7f8b3f1c1700 1 Processor -- start 2024-06-02T04:49:34.089 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:34.086+0000 7f8b3f1c1700 1 -- start start 2024-06-02T04:49:34.089 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:34.086+0000 7f8b3f1c1700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8b38100ff0 0x7f8b380732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:34.089 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:34.086+0000 7f8b3f1c1700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8b38101990 0x7f8b380737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:34.089 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:34.086+0000 7f8b3f1c1700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8b38107030 0x7f8b38073d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:34.089 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:34.086+0000 7f8b3f1c1700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b381a56d0 con 0x7f8b38101990 2024-06-02T04:49:34.089 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:34.086+0000 7f8b3f1c1700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b381a5840 con 0x7f8b38107030 2024-06-02T04:49:34.089 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:34.086+0000 7f8b3f1c1700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b381a5a00 con 0x7f8b38100ff0 2024-06-02T04:49:34.089 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:34.087+0000 7f8b37fff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8b38101990 0x7f8b380737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:34.089 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:34.087+0000 7f8b37fff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8b38101990 0x7f8b380737e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:54956/0 (socket says 172.21.15.76:54956) 2024-06-02T04:49:34.089 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:34.087+0000 7f8b37fff700 1 -- 172.21.15.76:0/4181827302 learned_addr learned my addr 172.21.15.76:0/4181827302 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:49:34.089 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:34.087+0000 7f8b3d75e700 1 --2- 172.21.15.76:0/4181827302 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8b38107030 0x7f8b38073d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:34.089 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:34.087+0000 7f8b3cf5d700 1 --2- 172.21.15.76:0/4181827302 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8b38100ff0 0x7f8b380732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:34.089 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:34.087+0000 7f8b37fff700 1 -- 172.21.15.76:0/4181827302 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8b38100ff0 msgr2=0x7f8b380732a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:34.090 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:34.087+0000 7f8b37fff700 1 --2- 172.21.15.76:0/4181827302 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8b38100ff0 0x7f8b380732a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:34.090 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:34.087+0000 7f8b37fff700 1 -- 172.21.15.76:0/4181827302 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8b38107030 msgr2=0x7f8b38073d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:34.090 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:34.087+0000 7f8b37fff700 1 --2- 172.21.15.76:0/4181827302 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8b38107030 0x7f8b38073d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:34.090 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:34.087+0000 7f8b37fff700 1 -- 172.21.15.76:0/4181827302 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b2c0095f0 con 0x7f8b38101990 2024-06-02T04:49:34.090 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:34.087+0000 7f8b37fff700 1 --2- 172.21.15.76:0/4181827302 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8b38101990 0x7f8b380737e0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f8b2400d950 tx=0x7f8b2400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:34.090 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:34.087+0000 7f8b35ffb700 1 -- 172.21.15.76:0/4181827302 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b24009940 con 0x7f8b38101990 2024-06-02T04:49:34.090 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:34.087+0000 7f8b3f1c1700 1 -- 172.21.15.76:0/4181827302 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b381a5ce0 con 0x7f8b38101990 2024-06-02T04:49:34.090 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:34.087+0000 7f8b35ffb700 1 -- 172.21.15.76:0/4181827302 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8b24010460 con 0x7f8b38101990 2024-06-02T04:49:34.090 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:34.087+0000 7f8b35ffb700 1 -- 172.21.15.76:0/4181827302 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b2400f620 con 0x7f8b38101990 2024-06-02T04:49:34.090 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:34.087+0000 7f8b3f1c1700 1 -- 172.21.15.76:0/4181827302 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b381a6190 con 0x7f8b38101990 2024-06-02T04:49:34.091 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:34.088+0000 7f8b3f1c1700 1 -- 172.21.15.76:0/4181827302 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b38109550 con 0x7f8b38101990 2024-06-02T04:49:34.091 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:34.089+0000 7f8b35ffb700 1 -- 172.21.15.76:0/4181827302 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f8b240105d0 con 0x7f8b38101990 2024-06-02T04:49:34.091 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:34.090+0000 7f8b35ffb700 1 --2- 172.21.15.76:0/4181827302 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f8b280a11b0 0x7f8b280a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:34.091 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:34.090+0000 7f8b3cf5d700 1 --2- 172.21.15.76:0/4181827302 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f8b280a11b0 0x7f8b280a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:34.091 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:34.090+0000 7f8b35ffb700 1 -- 172.21.15.76:0/4181827302 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f8b240ccc20 con 0x7f8b38101990 2024-06-02T04:49:34.092 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:34.090+0000 7f8b3cf5d700 1 --2- 172.21.15.76:0/4181827302 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f8b280a11b0 0x7f8b280a3670 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f8b2c006010 tx=0x7f8b2c003680 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:34.095 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:34.095+0000 7f8b35ffb700 1 -- 172.21.15.76:0/4181827302 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f8b24095ee0 con 0x7f8b38101990 2024-06-02T04:49:34.333 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:34.332+0000 7f8b3f1c1700 1 -- 172.21.15.76:0/4181827302 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f8b38074780 con 0x7f8b38101990 2024-06-02T04:49:34.333 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:34.333+0000 7f8b35ffb700 1 -- 172.21.15.76:0/4181827302 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v24) v1 ==== 53+0+88 (secure 0 0 0) 0x7f8b24016070 con 0x7f8b38101990 2024-06-02T04:49:34.333 INFO:teuthology.orchestra.run.smithi076.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-06-02T04:49:34.335 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:34.335+0000 7f8b3f1c1700 1 -- 172.21.15.76:0/4181827302 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f8b280a11b0 msgr2=0x7f8b280a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:34.335 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:34.335+0000 7f8b3f1c1700 1 --2- 172.21.15.76:0/4181827302 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f8b280a11b0 0x7f8b280a3670 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f8b2c006010 tx=0x7f8b2c003680 comp rx=0 tx=0).stop 2024-06-02T04:49:34.335 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:34.335+0000 7f8b3f1c1700 1 -- 172.21.15.76:0/4181827302 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8b38101990 msgr2=0x7f8b380737e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:34.336 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:34.335+0000 7f8b3f1c1700 1 --2- 172.21.15.76:0/4181827302 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8b38101990 0x7f8b380737e0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f8b2400d950 tx=0x7f8b2400dc60 comp rx=0 tx=0).stop 2024-06-02T04:49:34.336 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:34.335+0000 7f8b3f1c1700 1 -- 172.21.15.76:0/4181827302 shutdown_connections 2024-06-02T04:49:34.336 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:34.335+0000 7f8b3f1c1700 1 --2- 172.21.15.76:0/4181827302 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f8b280a11b0 0x7f8b280a3670 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:34.336 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:34.335+0000 7f8b3f1c1700 1 --2- 172.21.15.76:0/4181827302 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8b38107030 0x7f8b38073d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:34.336 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:34.335+0000 7f8b3f1c1700 1 --2- 172.21.15.76:0/4181827302 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8b38100ff0 0x7f8b380732a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:34.336 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:34.335+0000 7f8b3f1c1700 1 --2- 172.21.15.76:0/4181827302 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8b38101990 0x7f8b380737e0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:34.336 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:34.335+0000 7f8b3f1c1700 1 -- 172.21.15.76:0/4181827302 >> 172.21.15.76:0/4181827302 conn(0x7f8b38078190 msgr2=0x7f8b380fff60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:34.336 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:34.335+0000 7f8b3f1c1700 1 -- 172.21.15.76:0/4181827302 shutdown_connections 2024-06-02T04:49:34.336 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:34.335+0000 7f8b3f1c1700 1 -- 172.21.15.76:0/4181827302 wait complete. 2024-06-02T04:49:34.715 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-06-02T04:49:34.715 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-06-02T04:49:34.715 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi076.front.sepia.ceph.com 2024-06-02T04:49:34.715 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-06-02T04:49:34.715 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /tmp/cephfs 2024-06-02T04:49:34.715 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-06-02T04:49:34.715 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-06-02T04:49:34.716 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-06-02T04:49:34.716 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/tmp/cephfs' 2024-06-02T04:49:34.716 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T04:49:34.716 DEBUG:teuthology.orchestra.run.smithi076:> ip addr 2024-06-02T04:49:34.734 INFO:teuthology.orchestra.run.smithi076.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-06-02T04:49:34.735 INFO:teuthology.orchestra.run.smithi076.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-06-02T04:49:34.735 INFO:teuthology.orchestra.run.smithi076.stdout: inet 127.0.0.1/8 scope host lo 2024-06-02T04:49:34.735 INFO:teuthology.orchestra.run.smithi076.stdout: valid_lft forever preferred_lft forever 2024-06-02T04:49:34.735 INFO:teuthology.orchestra.run.smithi076.stdout: inet6 ::1/128 scope host 2024-06-02T04:49:34.735 INFO:teuthology.orchestra.run.smithi076.stdout: valid_lft forever preferred_lft forever 2024-06-02T04:49:34.735 INFO:teuthology.orchestra.run.smithi076.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-02T04:49:34.735 INFO:teuthology.orchestra.run.smithi076.stdout: link/ether 0c:c4:7a:d8:da:66 brd ff:ff:ff:ff:ff:ff 2024-06-02T04:49:34.735 INFO:teuthology.orchestra.run.smithi076.stdout: altname enp7s0f0 2024-06-02T04:49:34.735 INFO:teuthology.orchestra.run.smithi076.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-02T04:49:34.735 INFO:teuthology.orchestra.run.smithi076.stdout: link/ether 0c:c4:7a:d8:da:67 brd ff:ff:ff:ff:ff:ff 2024-06-02T04:49:34.735 INFO:teuthology.orchestra.run.smithi076.stdout: altname enp7s0f1 2024-06-02T04:49:34.736 INFO:teuthology.orchestra.run.smithi076.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-02T04:49:34.736 INFO:teuthology.orchestra.run.smithi076.stdout: link/ether 0c:c4:7a:8f:47:e0 brd ff:ff:ff:ff:ff:ff 2024-06-02T04:49:34.736 INFO:teuthology.orchestra.run.smithi076.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-06-02T04:49:34.736 INFO:teuthology.orchestra.run.smithi076.stdout: link/ether 0c:c4:7a:8f:47:e1 brd ff:ff:ff:ff:ff:ff 2024-06-02T04:49:34.736 INFO:teuthology.orchestra.run.smithi076.stdout: inet 172.21.15.76/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-06-02T04:49:34.736 INFO:teuthology.orchestra.run.smithi076.stdout: valid_lft 41811sec preferred_lft 41811sec 2024-06-02T04:49:34.736 INFO:teuthology.orchestra.run.smithi076.stdout: inet6 fe80::e45d:bce6:31a8:760b/64 scope link noprefixroute 2024-06-02T04:49:34.736 INFO:teuthology.orchestra.run.smithi076.stdout: valid_lft forever preferred_lft forever 2024-06-02T04:49:34.736 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-06-02T04:49:34.736 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T04:49:34.737 DEBUG:teuthology.orchestra.run.smithi076:> (cd / && exec bash -c ' 2024-06-02T04:49:34.737 DEBUG:teuthology.orchestra.run.smithi076:> set -e 2024-06-02T04:49:34.737 DEBUG:teuthology.orchestra.run.smithi076:> sudo ip link add name ceph-brx type bridge 2024-06-02T04:49:34.737 DEBUG:teuthology.orchestra.run.smithi076:> sudo ip addr flush dev ceph-brx 2024-06-02T04:49:34.737 DEBUG:teuthology.orchestra.run.smithi076:> sudo ip link set ceph-brx up 2024-06-02T04:49:34.737 DEBUG:teuthology.orchestra.run.smithi076:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-06-02T04:49:34.737 DEBUG:teuthology.orchestra.run.smithi076:> ') 2024-06-02T04:49:34.858 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T04:49:34.858 DEBUG:teuthology.orchestra.run.smithi076:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-06-02T04:49:34.886 INFO:teuthology.orchestra.run.smithi076.stdout:1 2024-06-02T04:49:34.887 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T04:49:34.887 DEBUG:teuthology.orchestra.run.smithi076:> route 2024-06-02T04:49:34.946 INFO:teuthology.orchestra.run.smithi076.stdout:Kernel IP routing table 2024-06-02T04:49:34.946 INFO:teuthology.orchestra.run.smithi076.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-06-02T04:49:34.947 INFO:teuthology.orchestra.run.smithi076.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-06-02T04:49:34.947 INFO:teuthology.orchestra.run.smithi076.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-06-02T04:49:34.947 INFO:teuthology.orchestra.run.smithi076.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-06-02T04:49:34.947 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T04:49:34.947 DEBUG:teuthology.orchestra.run.smithi076:> (cd / && exec bash -c ' 2024-06-02T04:49:34.947 DEBUG:teuthology.orchestra.run.smithi076:> set -e 2024-06-02T04:49:34.947 DEBUG:teuthology.orchestra.run.smithi076:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-06-02T04:49:34.947 DEBUG:teuthology.orchestra.run.smithi076:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-06-02T04:49:34.947 DEBUG:teuthology.orchestra.run.smithi076:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-06-02T04:49:34.947 DEBUG:teuthology.orchestra.run.smithi076:> ') 2024-06-02T04:49:35.054 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T04:49:35.054 DEBUG:teuthology.orchestra.run.smithi076:> ip netns list 2024-06-02T04:49:35.071 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T04:49:35.071 DEBUG:teuthology.orchestra.run.smithi076:> ip netns list-id 2024-06-02T04:49:35.129 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T04:49:35.130 DEBUG:teuthology.orchestra.run.smithi076:> (cd / && exec bash -c ' 2024-06-02T04:49:35.130 DEBUG:teuthology.orchestra.run.smithi076:> set -e 2024-06-02T04:49:35.130 DEBUG:teuthology.orchestra.run.smithi076:> sudo ip netns add ceph-ns--tmp-cephfs 2024-06-02T04:49:35.130 DEBUG:teuthology.orchestra.run.smithi076:> sudo ip netns set ceph-ns--tmp-cephfs 0 2024-06-02T04:49:35.130 DEBUG:teuthology.orchestra.run.smithi076:> ') 2024-06-02T04:49:35.224 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--tmp-cephfs' with 192.168.0.1/16 2024-06-02T04:49:35.224 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T04:49:35.225 DEBUG:teuthology.orchestra.run.smithi076:> (cd / && exec bash -c ' 2024-06-02T04:49:35.225 DEBUG:teuthology.orchestra.run.smithi076:> set -e 2024-06-02T04:49:35.225 DEBUG:teuthology.orchestra.run.smithi076:> sudo ip link add veth0 netns ceph-ns--tmp-cephfs type veth peer name brx.0 2024-06-02T04:49:35.225 DEBUG:teuthology.orchestra.run.smithi076:> sudo ip netns exec ceph-ns--tmp-cephfs ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-06-02T04:49:35.225 DEBUG:teuthology.orchestra.run.smithi076:> sudo ip netns exec ceph-ns--tmp-cephfs ip link set veth0 up 2024-06-02T04:49:35.225 DEBUG:teuthology.orchestra.run.smithi076:> sudo ip netns exec ceph-ns--tmp-cephfs ip link set lo up 2024-06-02T04:49:35.225 DEBUG:teuthology.orchestra.run.smithi076:> sudo ip netns exec ceph-ns--tmp-cephfs ip route add default via 192.168.255.254 2024-06-02T04:49:35.225 DEBUG:teuthology.orchestra.run.smithi076:> ') 2024-06-02T04:49:35.280 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:35 smithi076 ceph-mon[42935]: pgmap v266: 129 pgs: 129 active+clean; 639 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-02T04:49:35.280 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:35 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/4181827302' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-06-02T04:49:35.435 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T04:49:35.435 DEBUG:teuthology.orchestra.run.smithi076:> (cd / && exec bash -c ' 2024-06-02T04:49:35.435 DEBUG:teuthology.orchestra.run.smithi076:> set -e 2024-06-02T04:49:35.435 DEBUG:teuthology.orchestra.run.smithi076:> sudo ip link set brx.0 up 2024-06-02T04:49:35.436 DEBUG:teuthology.orchestra.run.smithi076:> sudo ip link set dev brx.0 master ceph-brx 2024-06-02T04:49:35.436 DEBUG:teuthology.orchestra.run.smithi076:> ') 2024-06-02T04:49:35.535 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {'mntopts': ['context=system_u:object_r:postgresql_db_t:s0'], 'mount_subvol_num': 0, 'mountpoint': '/tmp/cephfs'} 2024-06-02T04:49:35.535 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-02T04:49:35.535 DEBUG:teuthology.orchestra.run.smithi076:> mkdir -p -v /tmp/cephfs 2024-06-02T04:49:35.552 INFO:teuthology.orchestra.run.smithi076.stdout:mkdir: created directory '/tmp/cephfs' 2024-06-02T04:49:35.552 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-02T04:49:35.553 DEBUG:teuthology.orchestra.run.smithi076:> chmod 0000 /tmp/cephfs 2024-06-02T04:49:35.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:35 smithi119 ceph-mon[46633]: pgmap v266: 129 pgs: 129 active+clean; 639 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-02T04:49:35.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:35 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/4181827302' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-06-02T04:49:35.609 DEBUG:teuthology.orchestra.run.smithi076:> sudo modprobe fuse 2024-06-02T04:49:35.677 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-06-02T04:49:35.678 DEBUG:teuthology.orchestra.run.smithi076:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-06-02T04:49:35.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:35 smithi192 ceph-mon[47933]: pgmap v266: 129 pgs: 129 active+clean; 639 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-02T04:49:35.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:35 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/4181827302' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-06-02T04:49:35.744 INFO:teuthology.orchestra.run.smithi076.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-06-02T04:49:35.745 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-06-02T04:49:35.746 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T04:49:35.746 DEBUG:teuthology.orchestra.run.smithi076:> ls /sys/fs/fuse/connections 2024-06-02T04:49:35.803 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-06-02T04:49:35.803 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--tmp-cephfs sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /tmp/cephfs --id 0 --client_mountpoint=/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e --client_fs=cephfs -o context=system_u:object_r:postgresql_db_t:s0) 2024-06-02T04:49:35.845 DEBUG:teuthology.orchestra.run.smithi076:> sudo modprobe fuse 2024-06-02T04:49:35.871 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-06-02T04:49:35.871 DEBUG:teuthology.orchestra.run.smithi076:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-06-02T04:49:35.936 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi076.stderr:2024-06-02T04:49:35.936+0000 7fafe3b015c0 -1 init, newargv = 0x555f6f069c50 newargc=17 2024-06-02T04:49:35.936 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi076.stderr:ceph-fuse[110234]: starting ceph client 2024-06-02T04:49:35.939 INFO:teuthology.orchestra.run.smithi076.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-06-02T04:49:35.940 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-06-02T04:49:35.940 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T04:49:35.941 DEBUG:teuthology.orchestra.run.smithi076:> ls /sys/fs/fuse/connections 2024-06-02T04:49:35.956 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi076.stderr:ceph-fuse[110234]: starting fuse 2024-06-02T04:49:35.973 INFO:teuthology.orchestra.run.smithi076.stdout:124 2024-06-02T04:49:35.973 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [124] 2024-06-02T04:49:35.974 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-06-02T04:49:35.974 DEBUG:teuthology.orchestra.run.smithi076:> import glob 2024-06-02T04:49:35.974 DEBUG:teuthology.orchestra.run.smithi076:> import re 2024-06-02T04:49:35.974 DEBUG:teuthology.orchestra.run.smithi076:> import os 2024-06-02T04:49:35.974 DEBUG:teuthology.orchestra.run.smithi076:> import subprocess 2024-06-02T04:49:35.974 DEBUG:teuthology.orchestra.run.smithi076:> 2024-06-02T04:49:35.974 DEBUG:teuthology.orchestra.run.smithi076:> def _find_admin_socket(client_name): 2024-06-02T04:49:35.974 DEBUG:teuthology.orchestra.run.smithi076:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-06-02T04:49:35.974 DEBUG:teuthology.orchestra.run.smithi076:> files = glob.glob(asok_path) 2024-06-02T04:49:35.974 DEBUG:teuthology.orchestra.run.smithi076:> mountpoint = "/tmp/cephfs" 2024-06-02T04:49:35.975 DEBUG:teuthology.orchestra.run.smithi076:> 2024-06-02T04:49:35.975 DEBUG:teuthology.orchestra.run.smithi076:> # Given a non-glob path, it better be there 2024-06-02T04:49:35.975 DEBUG:teuthology.orchestra.run.smithi076:> if "*" not in asok_path: 2024-06-02T04:49:35.975 DEBUG:teuthology.orchestra.run.smithi076:> assert(len(files) == 1) 2024-06-02T04:49:35.975 DEBUG:teuthology.orchestra.run.smithi076:> return files[0] 2024-06-02T04:49:35.975 DEBUG:teuthology.orchestra.run.smithi076:> 2024-06-02T04:49:35.975 DEBUG:teuthology.orchestra.run.smithi076:> for f in files: 2024-06-02T04:49:35.975 DEBUG:teuthology.orchestra.run.smithi076:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-06-02T04:49:35.975 DEBUG:teuthology.orchestra.run.smithi076:> if os.path.exists("/proc/{0}".format(pid)): 2024-06-02T04:49:35.975 DEBUG:teuthology.orchestra.run.smithi076:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-06-02T04:49:35.975 DEBUG:teuthology.orchestra.run.smithi076:> contents = proc_f.read() 2024-06-02T04:49:35.975 DEBUG:teuthology.orchestra.run.smithi076:> if mountpoint in contents: 2024-06-02T04:49:35.975 DEBUG:teuthology.orchestra.run.smithi076:> return f 2024-06-02T04:49:35.975 DEBUG:teuthology.orchestra.run.smithi076:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-06-02T04:49:35.975 DEBUG:teuthology.orchestra.run.smithi076:> 2024-06-02T04:49:35.976 DEBUG:teuthology.orchestra.run.smithi076:> print(_find_admin_socket("client.0")) 2024-06-02T04:49:35.976 DEBUG:teuthology.orchestra.run.smithi076:> ' 2024-06-02T04:49:36.098 INFO:teuthology.orchestra.run.smithi076.stdout:/var/run/ceph/ceph-client.0.110234.asok 2024-06-02T04:49:36.280 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.110234.asok 2024-06-02T04:49:36.280 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T04:49:36.280 DEBUG:teuthology.orchestra.run.smithi076:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.110234.asok status 2024-06-02T04:49:36.438 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-06-02T04:49:36.439 INFO:teuthology.orchestra.run.smithi076.stdout: "metadata": { 2024-06-02T04:49:36.439 INFO:teuthology.orchestra.run.smithi076.stdout: "ceph_sha1": "3bb45379356e8aa965152e0b8c663715c5df9bda", 2024-06-02T04:49:36.439 INFO:teuthology.orchestra.run.smithi076.stdout: "ceph_version": "ceph version 18.2.2-1381-g3bb45379 (3bb45379356e8aa965152e0b8c663715c5df9bda) reef (stable)", 2024-06-02T04:49:36.439 INFO:teuthology.orchestra.run.smithi076.stdout: "entity_id": "0", 2024-06-02T04:49:36.439 INFO:teuthology.orchestra.run.smithi076.stdout: "hostname": "smithi076", 2024-06-02T04:49:36.439 INFO:teuthology.orchestra.run.smithi076.stdout: "mount_point": "/tmp/cephfs", 2024-06-02T04:49:36.439 INFO:teuthology.orchestra.run.smithi076.stdout: "pid": "110234", 2024-06-02T04:49:36.439 INFO:teuthology.orchestra.run.smithi076.stdout: "root": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e" 2024-06-02T04:49:36.439 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:49:36.439 INFO:teuthology.orchestra.run.smithi076.stdout: "dentry_count": 0, 2024-06-02T04:49:36.439 INFO:teuthology.orchestra.run.smithi076.stdout: "dentry_pinned_count": 0, 2024-06-02T04:49:36.439 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 15429, 2024-06-02T04:49:36.440 INFO:teuthology.orchestra.run.smithi076.stdout: "inst": { 2024-06-02T04:49:36.440 INFO:teuthology.orchestra.run.smithi076.stdout: "name": { 2024-06-02T04:49:36.440 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "client", 2024-06-02T04:49:36.440 INFO:teuthology.orchestra.run.smithi076.stdout: "num": 15429 2024-06-02T04:49:36.440 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:49:36.440 INFO:teuthology.orchestra.run.smithi076.stdout: "addr": { 2024-06-02T04:49:36.440 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "v1", 2024-06-02T04:49:36.440 INFO:teuthology.orchestra.run.smithi076.stdout: "addr": "192.168.0.1:0", 2024-06-02T04:49:36.440 INFO:teuthology.orchestra.run.smithi076.stdout: "nonce": 370600299 2024-06-02T04:49:36.440 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T04:49:36.440 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:49:36.440 INFO:teuthology.orchestra.run.smithi076.stdout: "addr": { 2024-06-02T04:49:36.440 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "v1", 2024-06-02T04:49:36.441 INFO:teuthology.orchestra.run.smithi076.stdout: "addr": "192.168.0.1:0", 2024-06-02T04:49:36.441 INFO:teuthology.orchestra.run.smithi076.stdout: "nonce": 370600299 2024-06-02T04:49:36.441 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:49:36.441 INFO:teuthology.orchestra.run.smithi076.stdout: "inst_str": "client.15429 192.168.0.1:0/370600299", 2024-06-02T04:49:36.441 INFO:teuthology.orchestra.run.smithi076.stdout: "addr_str": "192.168.0.1:0/370600299", 2024-06-02T04:49:36.441 INFO:teuthology.orchestra.run.smithi076.stdout: "inode_count": 5, 2024-06-02T04:49:36.441 INFO:teuthology.orchestra.run.smithi076.stdout: "mds_epoch": 24, 2024-06-02T04:49:36.441 INFO:teuthology.orchestra.run.smithi076.stdout: "osd_epoch": 82, 2024-06-02T04:49:36.441 INFO:teuthology.orchestra.run.smithi076.stdout: "osd_epoch_barrier": 80, 2024-06-02T04:49:36.441 INFO:teuthology.orchestra.run.smithi076.stdout: "blocklisted": false, 2024-06-02T04:49:36.441 INFO:teuthology.orchestra.run.smithi076.stdout: "fs_name": "cephfs" 2024-06-02T04:49:36.441 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-06-02T04:49:36.449 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T04:49:36.449 DEBUG:teuthology.orchestra.run.smithi076:> stat --file-system '--printf=%T 2024-06-02T04:49:36.449 DEBUG:teuthology.orchestra.run.smithi076:> ' -- /tmp/cephfs 2024-06-02T04:49:36.466 INFO:teuthology.orchestra.run.smithi076.stdout:fuseblk 2024-06-02T04:49:36.466 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /tmp/cephfs 2024-06-02T04:49:36.466 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T04:49:36.467 DEBUG:teuthology.orchestra.run.smithi076:> sudo chmod 1777 /tmp/cephfs 2024-06-02T04:49:36.538 INFO:teuthology.run_tasks:Running task exec... 2024-06-02T04:49:36.548 INFO:teuthology.task.exec:Executing custom commands... 2024-06-02T04:49:36.548 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi076.front.sepia.ceph.com 2024-06-02T04:49:36.548 DEBUG:teuthology.orchestra.run.smithi076:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate true' 2024-06-02T04:49:36.707 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:36.703+0000 7f28d3a56700 1 -- 172.21.15.76:0/3491631811 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f28cc101990 msgr2=0x7f28cc108240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:36.707 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:36.703+0000 7f28d3a56700 1 --2- 172.21.15.76:0/3491631811 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f28cc101990 0x7f28cc108240 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f28c400b0d0 tx=0x7f28c400b3e0 comp rx=0 tx=0).stop 2024-06-02T04:49:36.707 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:36.703+0000 7f28d3a56700 1 -- 172.21.15.76:0/3491631811 shutdown_connections 2024-06-02T04:49:36.707 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:36.703+0000 7f28d3a56700 1 --2- 172.21.15.76:0/3491631811 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f28cc101990 0x7f28cc108240 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:36.707 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:36.703+0000 7f28d3a56700 1 --2- 172.21.15.76:0/3491631811 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28cc0ffe00 0x7f28cc100220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:36.707 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:36.703+0000 7f28d3a56700 1 --2- 172.21.15.76:0/3491631811 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f28cc100ff0 0x7f28cc101450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:36.707 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:36.703+0000 7f28d3a56700 1 -- 172.21.15.76:0/3491631811 >> 172.21.15.76:0/3491631811 conn(0x7f28cc0fb390 msgr2=0x7f28cc0fd7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:36.707 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:36.703+0000 7f28d3a56700 1 -- 172.21.15.76:0/3491631811 shutdown_connections 2024-06-02T04:49:36.707 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:36.703+0000 7f28d3a56700 1 -- 172.21.15.76:0/3491631811 wait complete. 2024-06-02T04:49:36.708 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:36.704+0000 7f28d3a56700 1 Processor -- start 2024-06-02T04:49:36.708 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:36.704+0000 7f28d3a56700 1 -- start start 2024-06-02T04:49:36.708 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:36.704+0000 7f28d3a56700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28cc0ffe00 0x7f28cc068e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:36.708 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:36.704+0000 7f28d3a56700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f28cc100ff0 0x7f28cc19bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:36.708 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:36.704+0000 7f28d3a56700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f28cc101990 0x7f28cc19e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:36.708 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:36.704+0000 7f28d3a56700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28cc19e920 con 0x7f28cc100ff0 2024-06-02T04:49:36.708 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:36.704+0000 7f28d3a56700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28cc19ea90 con 0x7f28cc0ffe00 2024-06-02T04:49:36.708 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:36.704+0000 7f28d3a56700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28cc19ec50 con 0x7f28cc101990 2024-06-02T04:49:36.708 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:36.704+0000 7f28d0ff1700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f28cc100ff0 0x7f28cc19bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:36.708 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:36.704+0000 7f28d0ff1700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f28cc100ff0 0x7f28cc19bb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:54972/0 (socket says 172.21.15.76:54972) 2024-06-02T04:49:36.708 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:36.704+0000 7f28d0ff1700 1 -- 172.21.15.76:0/1105226245 learned_addr learned my addr 172.21.15.76:0/1105226245 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:49:36.708 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:36.705+0000 7f28d1ff3700 1 --2- 172.21.15.76:0/1105226245 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f28cc101990 0x7f28cc19e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:36.708 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:36.705+0000 7f28d17f2700 1 --2- 172.21.15.76:0/1105226245 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28cc0ffe00 0x7f28cc068e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:36.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:36.705+0000 7f28d0ff1700 1 -- 172.21.15.76:0/1105226245 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f28cc101990 msgr2=0x7f28cc19e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:36.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:36.705+0000 7f28d0ff1700 1 --2- 172.21.15.76:0/1105226245 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f28cc101990 0x7f28cc19e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:36.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:36.705+0000 7f28d0ff1700 1 -- 172.21.15.76:0/1105226245 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28cc0ffe00 msgr2=0x7f28cc068e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:36.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:36.705+0000 7f28d0ff1700 1 --2- 172.21.15.76:0/1105226245 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28cc0ffe00 0x7f28cc068e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:36.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:36.705+0000 7f28d0ff1700 1 -- 172.21.15.76:0/1105226245 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28c4009d00 con 0x7f28cc100ff0 2024-06-02T04:49:36.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:36.705+0000 7f28d0ff1700 1 --2- 172.21.15.76:0/1105226245 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f28cc100ff0 0x7f28cc19bb30 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f28c800c9b0 tx=0x7f28c800cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:36.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:36.705+0000 7f28c27fc700 1 -- 172.21.15.76:0/1105226245 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c8007b00 con 0x7f28cc100ff0 2024-06-02T04:49:36.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:36.705+0000 7f28c27fc700 1 -- 172.21.15.76:0/1105226245 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f28c8007c60 con 0x7f28cc100ff0 2024-06-02T04:49:36.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:36.705+0000 7f28d3a56700 1 -- 172.21.15.76:0/1105226245 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28cc19ef30 con 0x7f28cc100ff0 2024-06-02T04:49:36.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:36.705+0000 7f28c27fc700 1 -- 172.21.15.76:0/1105226245 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c8018660 con 0x7f28cc100ff0 2024-06-02T04:49:36.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:36.705+0000 7f28d3a56700 1 -- 172.21.15.76:0/1105226245 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28cc19f3b0 con 0x7f28cc100ff0 2024-06-02T04:49:36.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:36.706+0000 7f28d3a56700 1 -- 172.21.15.76:0/1105226245 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28cc107250 con 0x7f28cc100ff0 2024-06-02T04:49:36.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:36.707+0000 7f28c27fc700 1 -- 172.21.15.76:0/1105226245 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f28c800f450 con 0x7f28cc100ff0 2024-06-02T04:49:36.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:36.707+0000 7f28c27fc700 1 --2- 172.21.15.76:0/1105226245 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f28b80a11b0 0x7f28b80a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:36.711 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:36.708+0000 7f28d17f2700 1 --2- 172.21.15.76:0/1105226245 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f28b80a11b0 0x7f28b80a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:36.711 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:36.708+0000 7f28c27fc700 1 -- 172.21.15.76:0/1105226245 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f28c80cd0a0 con 0x7f28cc100ff0 2024-06-02T04:49:36.711 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:36.708+0000 7f28d17f2700 1 --2- 172.21.15.76:0/1105226245 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f28b80a11b0 0x7f28b80a3670 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f28cc100e50 tx=0x7f28bc005cf0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:36.711 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:36.711+0000 7f28c27fc700 1 -- 172.21.15.76:0/1105226245 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f28c8096450 con 0x7f28cc100ff0 2024-06-02T04:49:36.959 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:36.959+0000 7f28d3a56700 1 -- 172.21.15.76:0/1105226245 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} v 0) v1 -- 0x7f28cc067e30 con 0x7f28cc100ff0 2024-06-02T04:49:37.270 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.270+0000 7f28c27fc700 1 -- 172.21.15.76:0/1105226245 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]=0 v25) v1 ==== 117+0+0 (secure 0 0 0) 0x7f28c809ee60 con 0x7f28cc100ff0 2024-06-02T04:49:37.274 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.273+0000 7f28d3a56700 1 -- 172.21.15.76:0/1105226245 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f28b80a11b0 msgr2=0x7f28b80a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:37.274 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.273+0000 7f28d3a56700 1 --2- 172.21.15.76:0/1105226245 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f28b80a11b0 0x7f28b80a3670 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f28cc100e50 tx=0x7f28bc005cf0 comp rx=0 tx=0).stop 2024-06-02T04:49:37.274 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.273+0000 7f28d3a56700 1 -- 172.21.15.76:0/1105226245 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f28cc100ff0 msgr2=0x7f28cc19bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:37.274 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.273+0000 7f28d3a56700 1 --2- 172.21.15.76:0/1105226245 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f28cc100ff0 0x7f28cc19bb30 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f28c800c9b0 tx=0x7f28c800cd70 comp rx=0 tx=0).stop 2024-06-02T04:49:37.274 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.273+0000 7f28d3a56700 1 -- 172.21.15.76:0/1105226245 shutdown_connections 2024-06-02T04:49:37.275 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.273+0000 7f28d3a56700 1 --2- 172.21.15.76:0/1105226245 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f28cc101990 0x7f28cc19e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:37.275 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.273+0000 7f28d3a56700 1 --2- 172.21.15.76:0/1105226245 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f28b80a11b0 0x7f28b80a3670 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:37.275 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.273+0000 7f28d3a56700 1 --2- 172.21.15.76:0/1105226245 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28cc0ffe00 0x7f28cc068e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:37.275 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.273+0000 7f28d3a56700 1 --2- 172.21.15.76:0/1105226245 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f28cc100ff0 0x7f28cc19bb30 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:37.275 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.273+0000 7f28d3a56700 1 -- 172.21.15.76:0/1105226245 >> 172.21.15.76:0/1105226245 conn(0x7f28cc0fb390 msgr2=0x7f28cc104390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:37.275 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.273+0000 7f28d3a56700 1 -- 172.21.15.76:0/1105226245 shutdown_connections 2024-06-02T04:49:37.275 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.273+0000 7f28d3a56700 1 -- 172.21.15.76:0/1105226245 wait complete. 2024-06-02T04:49:37.292 INFO:teuthology.run_tasks:Running task check-counter... 2024-06-02T04:49:37.303 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-06-02T04:49:37.315 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-02T04:49:37.439 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.438+0000 7f552295b700 1 -- 172.21.15.76:0/70827109 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f551c0ffd60 msgr2=0x7f551c100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:37.439 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.438+0000 7f552295b700 1 --2- 172.21.15.76:0/70827109 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f551c0ffd60 0x7f551c100180 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f550c0099c0 tx=0x7f550c009cd0 comp rx=0 tx=0).stop 2024-06-02T04:49:37.439 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.438+0000 7f552295b700 1 -- 172.21.15.76:0/70827109 shutdown_connections 2024-06-02T04:49:37.439 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.438+0000 7f552295b700 1 --2- 172.21.15.76:0/70827109 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f551c1018f0 0x7f551c1081a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:37.439 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.438+0000 7f552295b700 1 --2- 172.21.15.76:0/70827109 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f551c0ffd60 0x7f551c100180 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:37.439 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.438+0000 7f552295b700 1 --2- 172.21.15.76:0/70827109 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f551c100f50 0x7f551c1013b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:37.439 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.438+0000 7f552295b700 1 -- 172.21.15.76:0/70827109 >> 172.21.15.76:0/70827109 conn(0x7f551c0fb2f0 msgr2=0x7f551c0fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:37.439 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.438+0000 7f552295b700 1 -- 172.21.15.76:0/70827109 shutdown_connections 2024-06-02T04:49:37.439 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.438+0000 7f552295b700 1 -- 172.21.15.76:0/70827109 wait complete. 2024-06-02T04:49:37.442 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.439+0000 7f552295b700 1 Processor -- start 2024-06-02T04:49:37.442 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.439+0000 7f552295b700 1 -- start start 2024-06-02T04:49:37.442 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.439+0000 7f552295b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f551c0ffd60 0x7f551c068b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:37.442 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.439+0000 7f552295b700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f551c100f50 0x7f551c19bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:37.442 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.439+0000 7f552295b700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f551c1018f0 0x7f551c19e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:37.442 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.439+0000 7f552295b700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f551c19e8a0 con 0x7f551c1018f0 2024-06-02T04:49:37.442 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.439+0000 7f552295b700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f551c19ea10 con 0x7f551c100f50 2024-06-02T04:49:37.442 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.439+0000 7f552295b700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f551c19ebd0 con 0x7f551c0ffd60 2024-06-02T04:49:37.443 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.439+0000 7f5520ef8700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f551c1018f0 0x7f551c19e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:37.443 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.440+0000 7f5520ef8700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f551c1018f0 0x7f551c19e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:54996/0 (socket says 172.21.15.76:54996) 2024-06-02T04:49:37.443 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.440+0000 7f5520ef8700 1 -- 172.21.15.76:0/4209142073 learned_addr learned my addr 172.21.15.76:0/4209142073 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:49:37.443 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.440+0000 7f551b7fe700 1 --2- 172.21.15.76:0/4209142073 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f551c100f50 0x7f551c19bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:37.443 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.440+0000 7f551bfff700 1 --2- 172.21.15.76:0/4209142073 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f551c0ffd60 0x7f551c068b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:37.443 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.440+0000 7f5520ef8700 1 -- 172.21.15.76:0/4209142073 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f551c0ffd60 msgr2=0x7f551c068b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:37.443 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.440+0000 7f5520ef8700 1 --2- 172.21.15.76:0/4209142073 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f551c0ffd60 0x7f551c068b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:37.443 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.440+0000 7f5520ef8700 1 -- 172.21.15.76:0/4209142073 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f551c100f50 msgr2=0x7f551c19bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:37.443 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.440+0000 7f5520ef8700 1 --2- 172.21.15.76:0/4209142073 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f551c100f50 0x7f551c19bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:37.443 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.440+0000 7f5520ef8700 1 -- 172.21.15.76:0/4209142073 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f550c0095f0 con 0x7f551c1018f0 2024-06-02T04:49:37.443 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.440+0000 7f551bfff700 1 --2- 172.21.15.76:0/4209142073 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f551c0ffd60 0x7f551c068b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:49:37.443 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.440+0000 7f5520ef8700 1 --2- 172.21.15.76:0/4209142073 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f551c1018f0 0x7f551c19e100 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f5514007ee0 tx=0x7f551400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:37.443 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.440+0000 7f55197fa700 1 -- 172.21.15.76:0/4209142073 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5514017070 con 0x7f551c1018f0 2024-06-02T04:49:37.444 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.440+0000 7f55197fa700 1 -- 172.21.15.76:0/4209142073 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f551400f040 con 0x7f551c1018f0 2024-06-02T04:49:37.444 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.440+0000 7f552295b700 1 -- 172.21.15.76:0/4209142073 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f551c19eeb0 con 0x7f551c1018f0 2024-06-02T04:49:37.444 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.440+0000 7f55197fa700 1 -- 172.21.15.76:0/4209142073 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5514005710 con 0x7f551c1018f0 2024-06-02T04:49:37.444 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.440+0000 7f552295b700 1 -- 172.21.15.76:0/4209142073 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f551c19f330 con 0x7f551c1018f0 2024-06-02T04:49:37.444 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.441+0000 7f552295b700 1 -- 172.21.15.76:0/4209142073 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f551c107250 con 0x7f551c1018f0 2024-06-02T04:49:37.444 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.442+0000 7f55197fa700 1 -- 172.21.15.76:0/4209142073 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f5514005870 con 0x7f551c1018f0 2024-06-02T04:49:37.445 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.443+0000 7f55197fa700 1 --2- 172.21.15.76:0/4209142073 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f55080a1120 0x7f55080a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:37.445 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.443+0000 7f551bfff700 1 --2- 172.21.15.76:0/4209142073 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f55080a1120 0x7f55080a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:37.445 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.443+0000 7f55197fa700 1 -- 172.21.15.76:0/4209142073 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f55140cca40 con 0x7f551c1018f0 2024-06-02T04:49:37.445 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.443+0000 7f551bfff700 1 --2- 172.21.15.76:0/4209142073 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f55080a1120 0x7f55080a35e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f550c003780 tx=0x7f550c000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:37.446 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.446+0000 7f55197fa700 1 -- 172.21.15.76:0/4209142073 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f5514095ec0 con 0x7f551c1018f0 2024-06-02T04:49:37.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:37 smithi119 ceph-mon[46633]: pgmap v267: 129 pgs: 129 active+clean; 639 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-02T04:49:37.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:37 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/1105226245' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-06-02T04:49:37.644 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.644+0000 7f552295b700 1 -- 172.21.15.76:0/4209142073 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f551c10b4f0 con 0x7f551c1018f0 2024-06-02T04:49:37.645 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.645+0000 7f55197fa700 1 -- 172.21.15.76:0/4209142073 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+24453 (secure 0 0 0) 0x7f55140b9030 con 0x7f551c1018f0 2024-06-02T04:49:37.646 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:49:37.646 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":82,"fsid":"60ab6d30-209a-11ef-bc9b-c7b262605968","created":"2024-06-02T04:42:21.007333+0000","modified":"2024-06-02T04:49:07.862801+0000","last_up_change":"2024-06-02T04:47:29.822242+0000","last_in_change":"2024-06-02T04:47:14.253449+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T04:44:56.408602+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-02T04:48:01.194954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-02T04:48:01.828863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-02T04:48:04.916565+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"33a51ba2-be5c-41d0-b5d1-8d6039f2ca4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6802","nonce":2869602045},{"type":"v1","addr":"172.21.15.76:6803","nonce":2869602045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6804","nonce":2869602045},{"type":"v1","addr":"172.21.15.76:6805","nonce":2869602045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6808","nonce":2869602045},{"type":"v1","addr":"172.21.15.76:6809","nonce":2869602045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6806","nonce":2869602045},{"type":"v1","addr":"172.21.15.76:6807","nonce":2869602045}]},"public_addr":"172.21.15.76:6803/2869602045","cluster_addr":"172.21.15.76:6805/2869602045","heartbeat_back_addr":"172.21.15.76:6809/2869602045","heartbeat_front_addr":"172.21.15.76:6807/2869602045","state":["exists","up"]},{"osd":1,"uuid":"ace46e13-3bb7-4103-973a-6860554df8b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":2353738098},{"type":"v1","addr":"172.21.15.119:6801","nonce":2353738098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":2353738098},{"type":"v1","addr":"172.21.15.119:6803","nonce":2353738098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":2353738098},{"type":"v1","addr":"172.21.15.119:6807","nonce":2353738098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":2353738098},{"type":"v1","addr":"172.21.15.119:6805","nonce":2353738098}]},"public_addr":"172.21.15.119:6801/2353738098","cluster_addr":"172.21.15.119:6803/2353738098","heartbeat_back_addr":"172.21.15.119:6807/2353738098","heartbeat_front_addr":"172.21.15.119:6805/2353738098","state":["exists","up"]},{"osd":2,"uuid":"4addc09e-77a9-428a-bcc4-38194f486cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":3206918546},{"type":"v1","addr":"172.21.15.192:6801","nonce":3206918546}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":3206918546},{"type":"v1","addr":"172.21.15.192:6803","nonce":3206918546}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":3206918546},{"type":"v1","addr":"172.21.15.192:6807","nonce":3206918546}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":3206918546},{"type":"v1","addr":"172.21.15.192:6805","nonce":3206918546}]},"public_addr":"172.21.15.192:6801/3206918546","cluster_addr":"172.21.15.192:6803/3206918546","heartbeat_back_addr":"172.21.15.192:6807/3206918546","heartbeat_front_addr":"172.21.15.192:6805/3206918546","state":["exists","up"]},{"osd":3,"uuid":"dc525518-82c6-49ed-8ca8-e3bd5bfc18d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6810","nonce":3747864233},{"type":"v1","addr":"172.21.15.76:6811","nonce":3747864233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6812","nonce":3747864233},{"type":"v1","addr":"172.21.15.76:6813","nonce":3747864233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6816","nonce":3747864233},{"type":"v1","addr":"172.21.15.76:6817","nonce":3747864233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6814","nonce":3747864233},{"type":"v1","addr":"172.21.15.76:6815","nonce":3747864233}]},"public_addr":"172.21.15.76:6811/3747864233","cluster_addr":"172.21.15.76:6813/3747864233","heartbeat_back_addr":"172.21.15.76:6817/3747864233","heartbeat_front_addr":"172.21.15.76:6815/3747864233","state":["exists","up"]},{"osd":4,"uuid":"eef293d0-cb87-47b3-9751-c6437a1cf079","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":2571629047},{"type":"v1","addr":"172.21.15.119:6809","nonce":2571629047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":2571629047},{"type":"v1","addr":"172.21.15.119:6811","nonce":2571629047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":2571629047},{"type":"v1","addr":"172.21.15.119:6815","nonce":2571629047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":2571629047},{"type":"v1","addr":"172.21.15.119:6813","nonce":2571629047}]},"public_addr":"172.21.15.119:6809/2571629047","cluster_addr":"172.21.15.119:6811/2571629047","heartbeat_back_addr":"172.21.15.119:6815/2571629047","heartbeat_front_addr":"172.21.15.119:6813/2571629047","state":["exists","up"]},{"osd":5,"uuid":"60eb8c6e-766c-49d0-9997-44f85776b3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3285065416},{"type":"v1","addr":"172.21.15.192:6809","nonce":3285065416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":3285065416},{"type":"v1","addr":"172.21.15.192:6811","nonce":3285065416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3285065416},{"type":"v1","addr":"172.21.15.192:6815","nonce":3285065416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":3285065416},{"type":"v1","addr":"172.21.15.192:6813","nonce":3285065416}]},"public_addr":"172.21.15.192:6809/3285065416","cluster_addr":"172.21.15.192:6811/3285065416","heartbeat_back_addr":"172.21.15.192:6815/3285065416","heartbeat_front_addr":"172.21.15.192:6813/3285065416","state":["exists","up"]},{"osd":6,"uuid":"e6dc8b9d-dd06-4870-a506-def8201b7e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6818","nonce":2951381580},{"type":"v1","addr":"172.21.15.76:6819","nonce":2951381580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6820","nonce":2951381580},{"type":"v1","addr":"172.21.15.76:6821","nonce":2951381580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6824","nonce":2951381580},{"type":"v1","addr":"172.21.15.76:6825","nonce":2951381580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6822","nonce":2951381580},{"type":"v1","addr":"172.21.15.76:6823","nonce":2951381580}]},"public_addr":"172.21.15.76:6819/2951381580","cluster_addr":"172.21.15.76:6821/2951381580","heartbeat_back_addr":"172.21.15.76:6825/2951381580","heartbeat_front_addr":"172.21.15.76:6823/2951381580","state":["exists","up"]},{"osd":7,"uuid":"2f5dccb3-39a1-4f25-8715-fa264d59db97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1802558756},{"type":"v1","addr":"172.21.15.119:6817","nonce":1802558756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1802558756},{"type":"v1","addr":"172.21.15.119:6819","nonce":1802558756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1802558756},{"type":"v1","addr":"172.21.15.119:6823","nonce":1802558756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1802558756},{"type":"v1","addr":"172.21.15.119:6821","nonce":1802558756}]},"public_addr":"172.21.15.119:6817/1802558756","cluster_addr":"172.21.15.119:6819/1802558756","heartbeat_back_addr":"172.21.15.119:6823/1802558756","heartbeat_front_addr":"172.21.15.119:6821/1802558756","state":["exists","up"]},{"osd":8,"uuid":"39b6ccd0-16e7-4cd5-87e0-d827e9172984","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":1214972276},{"type":"v1","addr":"172.21.15.192:6817","nonce":1214972276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":1214972276},{"type":"v1","addr":"172.21.15.192:6819","nonce":1214972276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":1214972276},{"type":"v1","addr":"172.21.15.192:6823","nonce":1214972276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":1214972276},{"type":"v1","addr":"172.21.15.192:6821","nonce":1214972276}]},"public_addr":"172.21.15.192:6817/1214972276","cluster_addr":"172.21.15.192:6819/1214972276","heartbeat_back_addr":"172.21.15.192:6823/1214972276","heartbeat_front_addr":"172.21.15.192:6821/1214972276","state":["exists","up"]},{"osd":9,"uuid":"851b2155-07bd-45de-bfe0-53021fda733f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6826","nonce":3095501821},{"type":"v1","addr":"172.21.15.76:6827","nonce":3095501821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6828","nonce":3095501821},{"type":"v1","addr":"172.21.15.76:6829","nonce":3095501821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":3095501821},{"type":"v1","addr":"172.21.15.76:6833","nonce":3095501821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6830","nonce":3095501821},{"type":"v1","addr":"172.21.15.76:6831","nonce":3095501821}]},"public_addr":"172.21.15.76:6827/3095501821","cluster_addr":"172.21.15.76:6829/3095501821","heartbeat_back_addr":"172.21.15.76:6833/3095501821","heartbeat_front_addr":"172.21.15.76:6831/3095501821","state":["exists","up"]},{"osd":10,"uuid":"e4b18e7e-bddf-4dd4-84f6-7902ea327cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":4082130894},{"type":"v1","addr":"172.21.15.119:6825","nonce":4082130894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":4082130894},{"type":"v1","addr":"172.21.15.119:6827","nonce":4082130894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":4082130894},{"type":"v1","addr":"172.21.15.119:6831","nonce":4082130894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":4082130894},{"type":"v1","addr":"172.21.15.119:6829","nonce":4082130894}]},"public_addr":"172.21.15.119:6825/4082130894","cluster_addr":"172.21.15.119:6827/4082130894","heartbeat_back_addr":"172.21.15.119:6831/4082130894","heartbeat_front_addr":"172.21.15.119:6829/4082130894","state":["exists","up"]},{"osd":11,"uuid":"54567e18-920c-4ae9-9557-0efba5a1a820","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":439693921},{"type":"v1","addr":"172.21.15.192:6825","nonce":439693921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":439693921},{"type":"v1","addr":"172.21.15.192:6827","nonce":439693921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":439693921},{"type":"v1","addr":"172.21.15.192:6831","nonce":439693921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":439693921},{"type":"v1","addr":"172.21.15.192:6829","nonce":439693921}]},"public_addr":"172.21.15.192:6825/439693921","cluster_addr":"172.21.15.192:6827/439693921","heartbeat_back_addr":"172.21.15.192:6831/439693921","heartbeat_front_addr":"172.21.15.192:6829/439693921","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:44:19.922390+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:44:36.895563+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:44:53.699019+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:45:11.167404+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:45:27.955899+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:45:44.850368+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:46:02.003588+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:46:19.019217+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:46:36.189670+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:46:53.919365+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:47:11.563053+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:47:28.822443+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":4}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.8","mappings":[{"from":5,"to":10}]},{"pgid":"4.14","mappings":[{"from":9,"to":8}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.76:6801/4200406736":"2024-06-03T04:43:06.092916+0000","172.21.15.76:6800/4200406736":"2024-06-03T04:43:06.092916+0000","172.21.15.76:0/1524144593":"2024-06-03T04:43:06.092916+0000","172.21.15.76:0/3269372590":"2024-06-03T04:43:06.092916+0000","172.21.15.76:0/3570893846":"2024-06-03T04:42:44.872236+0000","172.21.15.76:0/902035790":"2024-06-03T04:43:06.092916+0000","172.21.15.76:6800/2550846765":"2024-06-03T04:42:44.872236+0000","172.21.15.76:6801/2550846765":"2024-06-03T04:42:44.872236+0000","172.21.15.76:0/2646712763":"2024-06-03T04:42:44.872236+0000","172.21.15.76:0/964578813":"2024-06-03T04:42:44.872236+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T04:49:37.648 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.647+0000 7f552295b700 1 -- 172.21.15.76:0/4209142073 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f55080a1120 msgr2=0x7f55080a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:37.648 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.647+0000 7f552295b700 1 --2- 172.21.15.76:0/4209142073 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f55080a1120 0x7f55080a35e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f550c003780 tx=0x7f550c000bc0 comp rx=0 tx=0).stop 2024-06-02T04:49:37.648 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.647+0000 7f552295b700 1 -- 172.21.15.76:0/4209142073 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f551c1018f0 msgr2=0x7f551c19e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:37.648 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.647+0000 7f552295b700 1 --2- 172.21.15.76:0/4209142073 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f551c1018f0 0x7f551c19e100 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f5514007ee0 tx=0x7f551400d3b0 comp rx=0 tx=0).stop 2024-06-02T04:49:37.648 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.647+0000 7f552295b700 1 -- 172.21.15.76:0/4209142073 shutdown_connections 2024-06-02T04:49:37.648 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.647+0000 7f552295b700 1 --2- 172.21.15.76:0/4209142073 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f551c1018f0 0x7f551c19e100 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:37.648 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.647+0000 7f552295b700 1 --2- 172.21.15.76:0/4209142073 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f551c0ffd60 0x7f551c068b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:37.648 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.647+0000 7f552295b700 1 --2- 172.21.15.76:0/4209142073 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f55080a1120 0x7f55080a35e0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:37.648 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.647+0000 7f552295b700 1 --2- 172.21.15.76:0/4209142073 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f551c100f50 0x7f551c19bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:37.648 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.647+0000 7f552295b700 1 -- 172.21.15.76:0/4209142073 >> 172.21.15.76:0/4209142073 conn(0x7f551c0fb2f0 msgr2=0x7f551c104390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:37.648 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.647+0000 7f552295b700 1 -- 172.21.15.76:0/4209142073 shutdown_connections 2024-06-02T04:49:37.649 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.648+0000 7f552295b700 1 -- 172.21.15.76:0/4209142073 wait complete. 2024-06-02T04:49:37.659 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:37 smithi076 ceph-mon[42935]: pgmap v267: 129 pgs: 129 active+clean; 639 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-02T04:49:37.659 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:37 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/1105226245' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-06-02T04:49:37.661 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-06-02T04:44:56.408602+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-06-02T04:48:01.194954+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-06-02T04:48:01.828863+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '76', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-06-02T04:48:04.916565+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-06-02T04:49:37.661 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-06-02T04:49:37.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:37 smithi192 ceph-mon[47933]: pgmap v267: 129 pgs: 129 active+clean; 639 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-02T04:49:37.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:37 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/1105226245' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-06-02T04:49:37.789 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.786+0000 7fb78fa42700 1 -- 172.21.15.76:0/2226747397 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb7880ffe60 msgr2=0x7fb788100280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:37.789 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.786+0000 7fb78fa42700 1 --2- 172.21.15.76:0/2226747397 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb7880ffe60 0x7fb788100280 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fb784009990 tx=0x7fb784009ca0 comp rx=0 tx=0).stop 2024-06-02T04:49:37.789 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.786+0000 7fb78fa42700 1 -- 172.21.15.76:0/2226747397 shutdown_connections 2024-06-02T04:49:37.789 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.786+0000 7fb78fa42700 1 --2- 172.21.15.76:0/2226747397 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb788101970 0x7fb788108290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:37.789 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.786+0000 7fb78fa42700 1 --2- 172.21.15.76:0/2226747397 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb7880ffe60 0x7fb788100280 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:37.789 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.786+0000 7fb78fa42700 1 --2- 172.21.15.76:0/2226747397 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb788100fb0 0x7fb788101430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:37.789 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.786+0000 7fb78fa42700 1 -- 172.21.15.76:0/2226747397 >> 172.21.15.76:0/2226747397 conn(0x7fb7880fb3f0 msgr2=0x7fb7880fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:37.789 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.787+0000 7fb78fa42700 1 -- 172.21.15.76:0/2226747397 shutdown_connections 2024-06-02T04:49:37.789 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.787+0000 7fb78fa42700 1 -- 172.21.15.76:0/2226747397 wait complete. 2024-06-02T04:49:37.790 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.787+0000 7fb78fa42700 1 Processor -- start 2024-06-02T04:49:37.790 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.787+0000 7fb78fa42700 1 -- start start 2024-06-02T04:49:37.790 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.787+0000 7fb78fa42700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb7880ffe60 0x7fb788068b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:37.790 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.787+0000 7fb78fa42700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb788100fb0 0x7fb78819bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:37.790 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.787+0000 7fb78fa42700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb788101970 0x7fb78819e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:37.790 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.787+0000 7fb78fa42700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb78819e900 con 0x7fb788100fb0 2024-06-02T04:49:37.790 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.787+0000 7fb78fa42700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb78819ea70 con 0x7fb7880ffe60 2024-06-02T04:49:37.790 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.787+0000 7fb78fa42700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb78819ec30 con 0x7fb788101970 2024-06-02T04:49:37.790 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.787+0000 7fb78cfdd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb788100fb0 0x7fb78819bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:37.790 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.787+0000 7fb78cfdd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb788100fb0 0x7fb78819bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:55006/0 (socket says 172.21.15.76:55006) 2024-06-02T04:49:37.790 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.788+0000 7fb78cfdd700 1 -- 172.21.15.76:0/2196997612 learned_addr learned my addr 172.21.15.76:0/2196997612 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:49:37.790 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.788+0000 7fb78d7de700 1 --2- 172.21.15.76:0/2196997612 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb7880ffe60 0x7fb788068b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:37.791 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.788+0000 7fb78cfdd700 1 -- 172.21.15.76:0/2196997612 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb788101970 msgr2=0x7fb78819e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:37.791 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.788+0000 7fb78cfdd700 1 --2- 172.21.15.76:0/2196997612 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb788101970 0x7fb78819e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:37.791 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.788+0000 7fb78cfdd700 1 -- 172.21.15.76:0/2196997612 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb7880ffe60 msgr2=0x7fb788068b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:37.791 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.788+0000 7fb78cfdd700 1 --2- 172.21.15.76:0/2196997612 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb7880ffe60 0x7fb788068b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:37.791 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.788+0000 7fb78cfdd700 1 -- 172.21.15.76:0/2196997612 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7840095f0 con 0x7fb788100fb0 2024-06-02T04:49:37.791 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.788+0000 7fb78d7de700 1 --2- 172.21.15.76:0/2196997612 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb7880ffe60 0x7fb788068b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:49:37.791 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.788+0000 7fb78cfdd700 1 --2- 172.21.15.76:0/2196997612 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb788100fb0 0x7fb78819bb70 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fb77800e9a0 tx=0x7fb77800ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:37.791 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.788+0000 7fb77e7fc700 1 -- 172.21.15.76:0/2196997612 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb778009790 con 0x7fb788100fb0 2024-06-02T04:49:37.791 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.788+0000 7fb77e7fc700 1 -- 172.21.15.76:0/2196997612 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb77800cbd0 con 0x7fb788100fb0 2024-06-02T04:49:37.791 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.788+0000 7fb78fa42700 1 -- 172.21.15.76:0/2196997612 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb78819ef10 con 0x7fb788100fb0 2024-06-02T04:49:37.791 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.788+0000 7fb77e7fc700 1 -- 172.21.15.76:0/2196997612 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb778018680 con 0x7fb788100fb0 2024-06-02T04:49:37.791 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.788+0000 7fb78fa42700 1 -- 172.21.15.76:0/2196997612 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb78819f390 con 0x7fb788100fb0 2024-06-02T04:49:37.792 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.789+0000 7fb78fa42700 1 -- 172.21.15.76:0/2196997612 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb788107320 con 0x7fb788100fb0 2024-06-02T04:49:37.792 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.790+0000 7fb77e7fc700 1 -- 172.21.15.76:0/2196997612 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fb77800cd40 con 0x7fb788100fb0 2024-06-02T04:49:37.792 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.791+0000 7fb77e7fc700 1 --2- 172.21.15.76:0/2196997612 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fb7740a1120 0x7fb7740a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:37.793 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.791+0000 7fb77e7fc700 1 -- 172.21.15.76:0/2196997612 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fb778014070 con 0x7fb788100fb0 2024-06-02T04:49:37.793 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.791+0000 7fb78d7de700 1 --2- 172.21.15.76:0/2196997612 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fb7740a1120 0x7fb7740a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:37.793 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.791+0000 7fb78d7de700 1 --2- 172.21.15.76:0/2196997612 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fb7740a1120 0x7fb7740a35e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb78400b2e0 tx=0x7fb784005c20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:37.794 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.794+0000 7fb77e7fc700 1 -- 172.21.15.76:0/2196997612 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fb778096590 con 0x7fb788100fb0 2024-06-02T04:49:37.990 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.990+0000 7fb78fa42700 1 -- 172.21.15.76:0/2196997612 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb78810b560 con 0x7fb788100fb0 2024-06-02T04:49:37.990 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.990+0000 7fb77e7fc700 1 -- 172.21.15.76:0/2196997612 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb778026020 con 0x7fb788100fb0 2024-06-02T04:49:37.991 INFO:teuthology.orchestra.run.smithi076.stdout:pg_num: 1 2024-06-02T04:49:37.993 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.992+0000 7fb78fa42700 1 -- 172.21.15.76:0/2196997612 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fb7740a1120 msgr2=0x7fb7740a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:37.993 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.992+0000 7fb78fa42700 1 --2- 172.21.15.76:0/2196997612 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fb7740a1120 0x7fb7740a35e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb78400b2e0 tx=0x7fb784005c20 comp rx=0 tx=0).stop 2024-06-02T04:49:37.993 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.992+0000 7fb78fa42700 1 -- 172.21.15.76:0/2196997612 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb788100fb0 msgr2=0x7fb78819bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:37.993 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.992+0000 7fb78fa42700 1 --2- 172.21.15.76:0/2196997612 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb788100fb0 0x7fb78819bb70 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fb77800e9a0 tx=0x7fb77800ed60 comp rx=0 tx=0).stop 2024-06-02T04:49:37.993 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.992+0000 7fb78fa42700 1 -- 172.21.15.76:0/2196997612 shutdown_connections 2024-06-02T04:49:37.993 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.992+0000 7fb78fa42700 1 --2- 172.21.15.76:0/2196997612 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb788101970 0x7fb78819e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:37.993 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.992+0000 7fb78fa42700 1 --2- 172.21.15.76:0/2196997612 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fb7740a1120 0x7fb7740a35e0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:37.993 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.992+0000 7fb78fa42700 1 --2- 172.21.15.76:0/2196997612 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb7880ffe60 0x7fb788068b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:37.993 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.992+0000 7fb78fa42700 1 --2- 172.21.15.76:0/2196997612 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb788100fb0 0x7fb78819bb70 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:37.993 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.992+0000 7fb78fa42700 1 -- 172.21.15.76:0/2196997612 >> 172.21.15.76:0/2196997612 conn(0x7fb7880fb3f0 msgr2=0x7fb788104460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:37.994 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.992+0000 7fb78fa42700 1 -- 172.21.15.76:0/2196997612 shutdown_connections 2024-06-02T04:49:37.994 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:37.992+0000 7fb78fa42700 1 -- 172.21.15.76:0/2196997612 wait complete. 2024-06-02T04:49:38.005 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-06-02T04:49:38.129 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.129+0000 7ff3dd06b700 1 -- 172.21.15.76:0/2483261529 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff3d80ff5e0 msgr2=0x7ff3d80ffa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:38.130 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.129+0000 7ff3dd06b700 1 --2- 172.21.15.76:0/2483261529 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff3d80ff5e0 0x7ff3d80ffa00 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc0099c0 tx=0x7ff3cc009cd0 comp rx=0 tx=0).stop 2024-06-02T04:49:38.130 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.129+0000 7ff3dd06b700 1 -- 172.21.15.76:0/2483261529 shutdown_connections 2024-06-02T04:49:38.130 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.129+0000 7ff3dd06b700 1 --2- 172.21.15.76:0/2483261529 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff3d8101170 0x7ff3d8107a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:38.130 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.129+0000 7ff3dd06b700 1 --2- 172.21.15.76:0/2483261529 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff3d80ff5e0 0x7ff3d80ffa00 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:38.130 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.129+0000 7ff3dd06b700 1 --2- 172.21.15.76:0/2483261529 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff3d81007d0 0x7ff3d8100c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:38.130 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.129+0000 7ff3dd06b700 1 -- 172.21.15.76:0/2483261529 >> 172.21.15.76:0/2483261529 conn(0x7ff3d80fab50 msgr2=0x7ff3d80fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:38.130 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.129+0000 7ff3dd06b700 1 -- 172.21.15.76:0/2483261529 shutdown_connections 2024-06-02T04:49:38.130 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.129+0000 7ff3dd06b700 1 -- 172.21.15.76:0/2483261529 wait complete. 2024-06-02T04:49:38.132 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.130+0000 7ff3dd06b700 1 Processor -- start 2024-06-02T04:49:38.133 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.130+0000 7ff3dd06b700 1 -- start start 2024-06-02T04:49:38.133 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.130+0000 7ff3dd06b700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff3d80ff5e0 0x7ff3d8195da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:38.133 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.130+0000 7ff3dd06b700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff3d81007d0 0x7ff3d81962e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:38.133 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.130+0000 7ff3dd06b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff3d8101170 0x7ff3d819d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:38.133 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.130+0000 7ff3dd06b700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3d819d8d0 con 0x7ff3d81007d0 2024-06-02T04:49:38.133 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.130+0000 7ff3dd06b700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3d819da10 con 0x7ff3d80ff5e0 2024-06-02T04:49:38.133 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.130+0000 7ff3dd06b700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3d819dba0 con 0x7ff3d8101170 2024-06-02T04:49:38.133 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.131+0000 7ff3d659c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff3d81007d0 0x7ff3d81962e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:38.133 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.131+0000 7ff3d659c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff3d81007d0 0x7ff3d81962e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:55032/0 (socket says 172.21.15.76:55032) 2024-06-02T04:49:38.133 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.131+0000 7ff3d659c700 1 -- 172.21.15.76:0/3060891321 learned_addr learned my addr 172.21.15.76:0/3060891321 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:49:38.133 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.131+0000 7ff3d759e700 1 --2- 172.21.15.76:0/3060891321 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff3d8101170 0x7ff3d819d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:38.133 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.131+0000 7ff3d6d9d700 1 --2- 172.21.15.76:0/3060891321 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff3d80ff5e0 0x7ff3d8195da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:38.133 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.131+0000 7ff3d659c700 1 -- 172.21.15.76:0/3060891321 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff3d8101170 msgr2=0x7ff3d819d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:38.133 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.131+0000 7ff3d659c700 1 --2- 172.21.15.76:0/3060891321 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff3d8101170 0x7ff3d819d300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:38.134 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.131+0000 7ff3d659c700 1 -- 172.21.15.76:0/3060891321 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff3d80ff5e0 msgr2=0x7ff3d8195da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:38.134 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.131+0000 7ff3d659c700 1 --2- 172.21.15.76:0/3060891321 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff3d80ff5e0 0x7ff3d8195da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:38.134 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.131+0000 7ff3d659c700 1 -- 172.21.15.76:0/3060891321 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3cc0095f0 con 0x7ff3d81007d0 2024-06-02T04:49:38.134 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.131+0000 7ff3d6d9d700 1 --2- 172.21.15.76:0/3060891321 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff3d80ff5e0 0x7ff3d8195da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:49:38.134 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.131+0000 7ff3d659c700 1 --2- 172.21.15.76:0/3060891321 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff3d81007d0 0x7ff3d81962e0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7ff3c800d950 tx=0x7ff3c800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:38.134 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.131+0000 7ff3bffff700 1 -- 172.21.15.76:0/3060891321 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c8009940 con 0x7ff3d81007d0 2024-06-02T04:49:38.134 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.131+0000 7ff3dd06b700 1 -- 172.21.15.76:0/3060891321 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3d819de80 con 0x7ff3d81007d0 2024-06-02T04:49:38.134 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.131+0000 7ff3bffff700 1 -- 172.21.15.76:0/3060891321 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff3c8010460 con 0x7ff3d81007d0 2024-06-02T04:49:38.134 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.131+0000 7ff3bffff700 1 -- 172.21.15.76:0/3060891321 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c800f620 con 0x7ff3d81007d0 2024-06-02T04:49:38.134 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.131+0000 7ff3dd06b700 1 -- 172.21.15.76:0/3060891321 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3d819e350 con 0x7ff3d81007d0 2024-06-02T04:49:38.134 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.132+0000 7ff3dd06b700 1 -- 172.21.15.76:0/3060891321 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3d81061b0 con 0x7ff3d81007d0 2024-06-02T04:49:38.135 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.134+0000 7ff3bffff700 1 -- 172.21.15.76:0/3060891321 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7ff3c80105d0 con 0x7ff3d81007d0 2024-06-02T04:49:38.135 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.134+0000 7ff3bffff700 1 --2- 172.21.15.76:0/3060891321 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7ff3c00a1120 0x7ff3c00a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:38.135 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.134+0000 7ff3d6d9d700 1 --2- 172.21.15.76:0/3060891321 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7ff3c00a1120 0x7ff3c00a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:38.135 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.134+0000 7ff3bffff700 1 -- 172.21.15.76:0/3060891321 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 9020+0+0 (secure 0 0 0) 0x7ff3c80cca50 con 0x7ff3d81007d0 2024-06-02T04:49:38.135 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.135+0000 7ff3d6d9d700 1 --2- 172.21.15.76:0/3060891321 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7ff3c00a1120 0x7ff3c00a35e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc000c00 tx=0x7ff3cc005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:38.137 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.137+0000 7ff3bffff700 1 -- 172.21.15.76:0/3060891321 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7ff3c8095ed0 con 0x7ff3d81007d0 2024-06-02T04:49:38.339 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.338+0000 7ff3dd06b700 1 -- 172.21.15.76:0/3060891321 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff3d810ae40 con 0x7ff3d81007d0 2024-06-02T04:49:38.339 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.339+0000 7ff3bffff700 1 -- 172.21.15.76:0/3060891321 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v82) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff3c8016020 con 0x7ff3d81007d0 2024-06-02T04:49:38.339 INFO:teuthology.orchestra.run.smithi076.stdout:pg_num: 32 2024-06-02T04:49:38.342 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.341+0000 7ff3dd06b700 1 -- 172.21.15.76:0/3060891321 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7ff3c00a1120 msgr2=0x7ff3c00a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:38.342 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.341+0000 7ff3dd06b700 1 --2- 172.21.15.76:0/3060891321 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7ff3c00a1120 0x7ff3c00a35e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc000c00 tx=0x7ff3cc005fb0 comp rx=0 tx=0).stop 2024-06-02T04:49:38.342 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.341+0000 7ff3dd06b700 1 -- 172.21.15.76:0/3060891321 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff3d81007d0 msgr2=0x7ff3d81962e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:38.342 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.341+0000 7ff3dd06b700 1 --2- 172.21.15.76:0/3060891321 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff3d81007d0 0x7ff3d81962e0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7ff3c800d950 tx=0x7ff3c800dc60 comp rx=0 tx=0).stop 2024-06-02T04:49:38.342 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.341+0000 7ff3dd06b700 1 -- 172.21.15.76:0/3060891321 shutdown_connections 2024-06-02T04:49:38.342 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.341+0000 7ff3dd06b700 1 --2- 172.21.15.76:0/3060891321 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff3d8101170 0x7ff3d819d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:38.342 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.341+0000 7ff3dd06b700 1 --2- 172.21.15.76:0/3060891321 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7ff3c00a1120 0x7ff3c00a35e0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:38.342 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.341+0000 7ff3dd06b700 1 --2- 172.21.15.76:0/3060891321 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff3d80ff5e0 0x7ff3d8195da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:38.342 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.341+0000 7ff3dd06b700 1 --2- 172.21.15.76:0/3060891321 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff3d81007d0 0x7ff3d81962e0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:38.342 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.341+0000 7ff3dd06b700 1 -- 172.21.15.76:0/3060891321 >> 172.21.15.76:0/3060891321 conn(0x7ff3d80fab50 msgr2=0x7ff3d80fc010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:38.342 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.341+0000 7ff3dd06b700 1 -- 172.21.15.76:0/3060891321 shutdown_connections 2024-06-02T04:49:38.342 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.341+0000 7ff3dd06b700 1 -- 172.21.15.76:0/3060891321 wait complete. 2024-06-02T04:49:38.354 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-06-02T04:49:38.482 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.479+0000 7f626bc97700 1 -- 172.21.15.76:0/3417432169 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f62640ffe60 msgr2=0x7f6264100280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:38.482 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.479+0000 7f626bc97700 1 --2- 172.21.15.76:0/3417432169 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f62640ffe60 0x7f6264100280 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f6254009990 tx=0x7f6254009ca0 comp rx=0 tx=0).stop 2024-06-02T04:49:38.482 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.479+0000 7f626bc97700 1 -- 172.21.15.76:0/3417432169 shutdown_connections 2024-06-02T04:49:38.482 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.479+0000 7f626bc97700 1 --2- 172.21.15.76:0/3417432169 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6264101970 0x7f6264108290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:38.482 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.479+0000 7f626bc97700 1 --2- 172.21.15.76:0/3417432169 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f62640ffe60 0x7f6264100280 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:38.482 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.479+0000 7f626bc97700 1 --2- 172.21.15.76:0/3417432169 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6264100fb0 0x7f6264101430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:38.482 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.479+0000 7f626bc97700 1 -- 172.21.15.76:0/3417432169 >> 172.21.15.76:0/3417432169 conn(0x7f62640fb3f0 msgr2=0x7f62640fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:38.482 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.479+0000 7f626bc97700 1 -- 172.21.15.76:0/3417432169 shutdown_connections 2024-06-02T04:49:38.482 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.479+0000 7f626bc97700 1 -- 172.21.15.76:0/3417432169 wait complete. 2024-06-02T04:49:38.482 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.480+0000 7f626bc97700 1 Processor -- start 2024-06-02T04:49:38.483 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.480+0000 7f626bc97700 1 -- start start 2024-06-02T04:49:38.483 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.480+0000 7f626bc97700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f62640ffe60 0x7f6264068b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:38.483 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.480+0000 7f626bc97700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6264100fb0 0x7f626419df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:38.483 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.480+0000 7f626bc97700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6264101970 0x7f62641a04a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:38.483 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.480+0000 7f626bc97700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62641a0b00 con 0x7f62640ffe60 2024-06-02T04:49:38.483 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.480+0000 7f626bc97700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62641a0c70 con 0x7f6264100fb0 2024-06-02T04:49:38.483 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.480+0000 7f626bc97700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62641a0e30 con 0x7f6264101970 2024-06-02T04:49:38.483 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.480+0000 7f6269a33700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f62640ffe60 0x7f6264068b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:38.483 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.480+0000 7f6269a33700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f62640ffe60 0x7f6264068b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:55058/0 (socket says 172.21.15.76:55058) 2024-06-02T04:49:38.483 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.480+0000 7f6269a33700 1 -- 172.21.15.76:0/1820376769 learned_addr learned my addr 172.21.15.76:0/1820376769 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:49:38.483 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.480+0000 7f626a234700 1 --2- 172.21.15.76:0/1820376769 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6264101970 0x7f62641a04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:38.483 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.480+0000 7f6269a33700 1 -- 172.21.15.76:0/1820376769 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6264101970 msgr2=0x7f62641a04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:38.483 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.480+0000 7f6269a33700 1 --2- 172.21.15.76:0/1820376769 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6264101970 0x7f62641a04a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:38.484 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.480+0000 7f6269a33700 1 -- 172.21.15.76:0/1820376769 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6264100fb0 msgr2=0x7f626419df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:38.484 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.480+0000 7f6269232700 1 --2- 172.21.15.76:0/1820376769 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6264100fb0 0x7f626419df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:38.484 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.480+0000 7f6269a33700 1 --2- 172.21.15.76:0/1820376769 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6264100fb0 0x7f626419df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:38.484 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.480+0000 7f6269a33700 1 -- 172.21.15.76:0/1820376769 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62540095f0 con 0x7f62640ffe60 2024-06-02T04:49:38.484 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.480+0000 7f6269232700 1 --2- 172.21.15.76:0/1820376769 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6264100fb0 0x7f626419df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:49:38.484 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.480+0000 7f6269a33700 1 --2- 172.21.15.76:0/1820376769 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f62640ffe60 0x7f6264068b10 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f6254000c00 tx=0x7f6254003b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:38.484 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.480+0000 7f625affd700 1 -- 172.21.15.76:0/1820376769 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f625401d070 con 0x7f62640ffe60 2024-06-02T04:49:38.484 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.481+0000 7f625affd700 1 -- 172.21.15.76:0/1820376769 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f625400bd10 con 0x7f62640ffe60 2024-06-02T04:49:38.484 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.481+0000 7f625affd700 1 -- 172.21.15.76:0/1820376769 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6254022e60 con 0x7f62640ffe60 2024-06-02T04:49:38.484 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.481+0000 7f626bc97700 1 -- 172.21.15.76:0/1820376769 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62641a10b0 con 0x7f62640ffe60 2024-06-02T04:49:38.484 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.481+0000 7f626bc97700 1 -- 172.21.15.76:0/1820376769 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62641a1480 con 0x7f62640ffe60 2024-06-02T04:49:38.484 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.481+0000 7f626bc97700 1 -- 172.21.15.76:0/1820376769 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62641072d0 con 0x7f62640ffe60 2024-06-02T04:49:38.485 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.482+0000 7f625affd700 1 -- 172.21.15.76:0/1820376769 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f6254022470 con 0x7f62640ffe60 2024-06-02T04:49:38.485 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.483+0000 7f625affd700 1 --2- 172.21.15.76:0/1820376769 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f62500a1120 0x7f62500a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:38.485 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.483+0000 7f625affd700 1 -- 172.21.15.76:0/1820376769 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f62540ce2a0 con 0x7f62640ffe60 2024-06-02T04:49:38.485 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.483+0000 7f6269232700 1 --2- 172.21.15.76:0/1820376769 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f62500a1120 0x7f62500a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:38.485 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.484+0000 7f6269232700 1 --2- 172.21.15.76:0/1820376769 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f62500a1120 0x7f62500a35e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f6260005fd0 tx=0x7f6260005dc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:38.487 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.487+0000 7f625affd700 1 -- 172.21.15.76:0/1820376769 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f62540977b0 con 0x7f62640ffe60 2024-06-02T04:49:38.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:38 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/1105226245' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-06-02T04:49:38.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:38 smithi119 ceph-mon[46633]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-06-02T04:49:38.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:38 smithi119 ceph-mon[46633]: mgrmap e18: x(active, since 6m), standbys: z, y 2024-06-02T04:49:38.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:38 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/4209142073' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:49:38.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:38 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/2196997612' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-02T04:49:38.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:38 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/1105226245' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-06-02T04:49:38.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:38 smithi192 ceph-mon[47933]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-06-02T04:49:38.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:38 smithi192 ceph-mon[47933]: mgrmap e18: x(active, since 6m), standbys: z, y 2024-06-02T04:49:38.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:38 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/4209142073' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:49:38.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:38 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/2196997612' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-02T04:49:38.688 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.687+0000 7f626bc97700 1 -- 172.21.15.76:0/1820376769 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f626410b670 con 0x7f62640ffe60 2024-06-02T04:49:38.688 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.688+0000 7f625affd700 1 -- 172.21.15.76:0/1820376769 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v82) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6254022720 con 0x7f62640ffe60 2024-06-02T04:49:38.688 INFO:teuthology.orchestra.run.smithi076.stdout:pg_num: 64 2024-06-02T04:49:38.691 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.690+0000 7f626bc97700 1 -- 172.21.15.76:0/1820376769 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f62500a1120 msgr2=0x7f62500a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:38.691 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.690+0000 7f626bc97700 1 --2- 172.21.15.76:0/1820376769 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f62500a1120 0x7f62500a35e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f6260005fd0 tx=0x7f6260005dc0 comp rx=0 tx=0).stop 2024-06-02T04:49:38.691 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.690+0000 7f626bc97700 1 -- 172.21.15.76:0/1820376769 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f62640ffe60 msgr2=0x7f6264068b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:38.691 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.690+0000 7f626bc97700 1 --2- 172.21.15.76:0/1820376769 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f62640ffe60 0x7f6264068b10 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f6254000c00 tx=0x7f6254003b00 comp rx=0 tx=0).stop 2024-06-02T04:49:38.691 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.690+0000 7f626bc97700 1 -- 172.21.15.76:0/1820376769 shutdown_connections 2024-06-02T04:49:38.691 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.690+0000 7f626bc97700 1 --2- 172.21.15.76:0/1820376769 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6264101970 0x7f62641a04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:38.691 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.690+0000 7f626bc97700 1 --2- 172.21.15.76:0/1820376769 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f62640ffe60 0x7f6264068b10 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:38.691 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.690+0000 7f626bc97700 1 --2- 172.21.15.76:0/1820376769 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f62500a1120 0x7f62500a35e0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:38.691 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.690+0000 7f626bc97700 1 --2- 172.21.15.76:0/1820376769 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6264100fb0 0x7f626419df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:38.692 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.690+0000 7f626bc97700 1 -- 172.21.15.76:0/1820376769 >> 172.21.15.76:0/1820376769 conn(0x7f62640fb3f0 msgr2=0x7f6264104410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:38.692 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.691+0000 7f626bc97700 1 -- 172.21.15.76:0/1820376769 shutdown_connections 2024-06-02T04:49:38.692 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.691+0000 7f626bc97700 1 -- 172.21.15.76:0/1820376769 wait complete. 2024-06-02T04:49:38.703 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:38 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/1105226245' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-06-02T04:49:38.703 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:38 smithi076 ceph-mon[42935]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-06-02T04:49:38.703 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:38 smithi076 ceph-mon[42935]: mgrmap e18: x(active, since 6m), standbys: z, y 2024-06-02T04:49:38.704 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:38 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/4209142073' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:49:38.704 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:38 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/2196997612' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-02T04:49:38.704 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-06-02T04:49:38.832 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.830+0000 7f9690629700 1 -- 172.21.15.76:0/2084490556 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9688102b10 msgr2=0x7f96881093c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:38.832 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.830+0000 7f9690629700 1 --2- 172.21.15.76:0/2084490556 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9688102b10 0x7f96881093c0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f968000b0d0 tx=0x7f968000b3e0 comp rx=0 tx=0).stop 2024-06-02T04:49:38.833 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.830+0000 7f9690629700 1 -- 172.21.15.76:0/2084490556 shutdown_connections 2024-06-02T04:49:38.833 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.830+0000 7f9690629700 1 --2- 172.21.15.76:0/2084490556 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9688102b10 0x7f96881093c0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:38.833 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.830+0000 7f9690629700 1 --2- 172.21.15.76:0/2084490556 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9688100f80 0x7f96881013a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:38.833 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.830+0000 7f9690629700 1 --2- 172.21.15.76:0/2084490556 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9688102170 0x7f96881025d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:38.833 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.830+0000 7f9690629700 1 -- 172.21.15.76:0/2084490556 >> 172.21.15.76:0/2084490556 conn(0x7f96880fc4f0 msgr2=0x7f96880fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:38.833 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.830+0000 7f9690629700 1 -- 172.21.15.76:0/2084490556 shutdown_connections 2024-06-02T04:49:38.833 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.830+0000 7f9690629700 1 -- 172.21.15.76:0/2084490556 wait complete. 2024-06-02T04:49:38.833 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.830+0000 7f9690629700 1 Processor -- start 2024-06-02T04:49:38.833 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.830+0000 7f9690629700 1 -- start start 2024-06-02T04:49:38.833 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.831+0000 7f9690629700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9688100f80 0x7f9688074d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:38.833 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.831+0000 7f9690629700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9688102170 0x7f9688073390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:38.833 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.831+0000 7f9690629700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9688102b10 0x7f96880738d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:38.833 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.831+0000 7f9690629700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9688074070 con 0x7f9688100f80 2024-06-02T04:49:38.833 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.831+0000 7f9690629700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96880741e0 con 0x7f9688102b10 2024-06-02T04:49:38.834 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.831+0000 7f9690629700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96881a0ec0 con 0x7f9688102170 2024-06-02T04:49:38.834 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.831+0000 7f968e3c5700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9688100f80 0x7f9688074d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:38.834 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.831+0000 7f968e3c5700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9688100f80 0x7f9688074d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:55072/0 (socket says 172.21.15.76:55072) 2024-06-02T04:49:38.834 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.831+0000 7f968e3c5700 1 -- 172.21.15.76:0/1337518817 learned_addr learned my addr 172.21.15.76:0/1337518817 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:49:38.834 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.831+0000 7f968dbc4700 1 --2- 172.21.15.76:0/1337518817 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9688102170 0x7f9688073390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:38.834 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.831+0000 7f968ebc6700 1 --2- 172.21.15.76:0/1337518817 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9688102b10 0x7f96880738d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:38.834 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.831+0000 7f968e3c5700 1 -- 172.21.15.76:0/1337518817 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9688102170 msgr2=0x7f9688073390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:38.834 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.831+0000 7f968e3c5700 1 --2- 172.21.15.76:0/1337518817 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9688102170 0x7f9688073390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:38.834 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.831+0000 7f968e3c5700 1 -- 172.21.15.76:0/1337518817 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9688102b10 msgr2=0x7f96880738d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:38.834 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.831+0000 7f968e3c5700 1 --2- 172.21.15.76:0/1337518817 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9688102b10 0x7f96880738d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:38.834 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.831+0000 7f968e3c5700 1 -- 172.21.15.76:0/1337518817 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9680009d00 con 0x7f9688100f80 2024-06-02T04:49:38.834 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.831+0000 7f968dbc4700 1 --2- 172.21.15.76:0/1337518817 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9688102170 0x7f9688073390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:49:38.835 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.831+0000 7f968e3c5700 1 --2- 172.21.15.76:0/1337518817 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9688100f80 0x7f9688074d00 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f967800c990 tx=0x7f967800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:38.835 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.831+0000 7f967f7fe700 1 -- 172.21.15.76:0/1337518817 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9678007aa0 con 0x7f9688100f80 2024-06-02T04:49:38.835 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.831+0000 7f967f7fe700 1 -- 172.21.15.76:0/1337518817 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9678007c00 con 0x7f9688100f80 2024-06-02T04:49:38.835 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.831+0000 7f9690629700 1 -- 172.21.15.76:0/1337518817 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96881a1150 con 0x7f9688100f80 2024-06-02T04:49:38.835 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.831+0000 7f967f7fe700 1 -- 172.21.15.76:0/1337518817 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9678018660 con 0x7f9688100f80 2024-06-02T04:49:38.835 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.831+0000 7f9690629700 1 -- 172.21.15.76:0/1337518817 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96881a1660 con 0x7f9688100f80 2024-06-02T04:49:38.835 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.832+0000 7f9690629700 1 -- 172.21.15.76:0/1337518817 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9688108330 con 0x7f9688100f80 2024-06-02T04:49:38.836 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.833+0000 7f967f7fe700 1 -- 172.21.15.76:0/1337518817 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f967800f450 con 0x7f9688100f80 2024-06-02T04:49:38.836 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.834+0000 7f967f7fe700 1 --2- 172.21.15.76:0/1337518817 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f96740a1120 0x7f96740a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:38.836 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.834+0000 7f968dbc4700 1 --2- 172.21.15.76:0/1337518817 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f96740a1120 0x7f96740a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:38.836 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.834+0000 7f967f7fe700 1 -- 172.21.15.76:0/1337518817 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f96780cccc0 con 0x7f9688100f80 2024-06-02T04:49:38.836 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.834+0000 7f968dbc4700 1 --2- 172.21.15.76:0/1337518817 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f96740a1120 0x7f96740a35e0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f9684005950 tx=0x7f9684005f50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:38.837 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:38.837+0000 7f967f7fe700 1 -- 172.21.15.76:0/1337518817 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f96780961d0 con 0x7f9688100f80 2024-06-02T04:49:39.037 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.037+0000 7f9690629700 1 -- 172.21.15.76:0/1337518817 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f968810c890 con 0x7f9688100f80 2024-06-02T04:49:39.038 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.038+0000 7f967f7fe700 1 -- 172.21.15.76:0/1337518817 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v82) v1 ==== 103+0+11 (secure 0 0 0) 0x7f967800fe60 con 0x7f9688100f80 2024-06-02T04:49:39.038 INFO:teuthology.orchestra.run.smithi076.stdout:pg_num: 32 2024-06-02T04:49:39.040 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.040+0000 7f9690629700 1 -- 172.21.15.76:0/1337518817 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f96740a1120 msgr2=0x7f96740a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:39.040 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.040+0000 7f9690629700 1 --2- 172.21.15.76:0/1337518817 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f96740a1120 0x7f96740a35e0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f9684005950 tx=0x7f9684005f50 comp rx=0 tx=0).stop 2024-06-02T04:49:39.041 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.040+0000 7f9690629700 1 -- 172.21.15.76:0/1337518817 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9688100f80 msgr2=0x7f9688074d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:39.041 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.040+0000 7f9690629700 1 --2- 172.21.15.76:0/1337518817 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9688100f80 0x7f9688074d00 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f967800c990 tx=0x7f967800cd50 comp rx=0 tx=0).stop 2024-06-02T04:49:39.041 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.040+0000 7f9690629700 1 -- 172.21.15.76:0/1337518817 shutdown_connections 2024-06-02T04:49:39.041 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.040+0000 7f9690629700 1 --2- 172.21.15.76:0/1337518817 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f96740a1120 0x7f96740a35e0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:39.041 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.040+0000 7f9690629700 1 --2- 172.21.15.76:0/1337518817 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9688102b10 0x7f96880738d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:39.041 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.040+0000 7f9690629700 1 --2- 172.21.15.76:0/1337518817 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9688100f80 0x7f9688074d00 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:39.041 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.040+0000 7f9690629700 1 --2- 172.21.15.76:0/1337518817 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9688102170 0x7f9688073390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:39.041 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.040+0000 7f9690629700 1 -- 172.21.15.76:0/1337518817 >> 172.21.15.76:0/1337518817 conn(0x7f96880fc4f0 msgr2=0x7f9688105470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:39.041 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.040+0000 7f9690629700 1 -- 172.21.15.76:0/1337518817 shutdown_connections 2024-06-02T04:49:39.041 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.040+0000 7f9690629700 1 -- 172.21.15.76:0/1337518817 wait complete. 2024-06-02T04:49:39.053 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-02T04:49:39.177 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.174+0000 7fba2c5e7700 1 -- 172.21.15.76:0/1609732364 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fba24106bf0 msgr2=0x7fba24108fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:39.177 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.174+0000 7fba2c5e7700 1 --2- 172.21.15.76:0/1609732364 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fba24106bf0 0x7fba24108fe0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fba1c00b0a0 tx=0x7fba1c00b3b0 comp rx=0 tx=0).stop 2024-06-02T04:49:39.177 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.175+0000 7fba2c5e7700 1 -- 172.21.15.76:0/1609732364 shutdown_connections 2024-06-02T04:49:39.177 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.175+0000 7fba2c5e7700 1 --2- 172.21.15.76:0/1609732364 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fba24106bf0 0x7fba24108fe0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:39.177 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.175+0000 7fba2c5e7700 1 --2- 172.21.15.76:0/1609732364 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba24101990 0x7fba24103d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:39.177 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.175+0000 7fba2c5e7700 1 --2- 172.21.15.76:0/1609732364 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba241042c0 0x7fba241066b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:39.177 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.175+0000 7fba2c5e7700 1 -- 172.21.15.76:0/1609732364 >> 172.21.15.76:0/1609732364 conn(0x7fba240fb2e0 msgr2=0x7fba240fd720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:39.178 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.175+0000 7fba2c5e7700 1 -- 172.21.15.76:0/1609732364 shutdown_connections 2024-06-02T04:49:39.178 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.175+0000 7fba2c5e7700 1 -- 172.21.15.76:0/1609732364 wait complete. 2024-06-02T04:49:39.178 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.175+0000 7fba2c5e7700 1 Processor -- start 2024-06-02T04:49:39.178 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.175+0000 7fba2c5e7700 1 -- start start 2024-06-02T04:49:39.178 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.175+0000 7fba2c5e7700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fba24101990 0x7fba24196e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:39.178 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.175+0000 7fba2c5e7700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba241042c0 0x7fba24197340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:39.178 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.175+0000 7fba2c5e7700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba24106bf0 0x7fba2419e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:39.178 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.175+0000 7fba2c5e7700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba2419e8f0 con 0x7fba24101990 2024-06-02T04:49:39.178 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.175+0000 7fba2c5e7700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba2419ea60 con 0x7fba241042c0 2024-06-02T04:49:39.178 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.175+0000 7fba2c5e7700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba2419ec20 con 0x7fba24106bf0 2024-06-02T04:49:39.178 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.175+0000 7fba2a383700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fba24101990 0x7fba24196e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:39.178 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.175+0000 7fba2a383700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fba24101990 0x7fba24196e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:55078/0 (socket says 172.21.15.76:55078) 2024-06-02T04:49:39.178 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.175+0000 7fba2a383700 1 -- 172.21.15.76:0/2178322744 learned_addr learned my addr 172.21.15.76:0/2178322744 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:49:39.179 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.176+0000 7fba29b82700 1 --2- 172.21.15.76:0/2178322744 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba241042c0 0x7fba24197340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:39.179 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.176+0000 7fba2ab84700 1 --2- 172.21.15.76:0/2178322744 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba24106bf0 0x7fba2419e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:39.179 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.176+0000 7fba2a383700 1 -- 172.21.15.76:0/2178322744 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba24106bf0 msgr2=0x7fba2419e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:39.179 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.176+0000 7fba2a383700 1 --2- 172.21.15.76:0/2178322744 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba24106bf0 0x7fba2419e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:39.179 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.176+0000 7fba2a383700 1 -- 172.21.15.76:0/2178322744 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba241042c0 msgr2=0x7fba24197340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:39.179 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.176+0000 7fba2a383700 1 --2- 172.21.15.76:0/2178322744 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba241042c0 0x7fba24197340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:39.179 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.176+0000 7fba2a383700 1 -- 172.21.15.76:0/2178322744 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba1c009d00 con 0x7fba24101990 2024-06-02T04:49:39.179 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.176+0000 7fba2ab84700 1 --2- 172.21.15.76:0/2178322744 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba24106bf0 0x7fba2419e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:49:39.179 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.176+0000 7fba2a383700 1 --2- 172.21.15.76:0/2178322744 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fba24101990 0x7fba24196e00 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fba2000e9a0 tx=0x7fba2000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:39.179 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.176+0000 7fba1b7fe700 1 -- 172.21.15.76:0/2178322744 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba20009790 con 0x7fba24101990 2024-06-02T04:49:39.179 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.176+0000 7fba1b7fe700 1 -- 172.21.15.76:0/2178322744 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fba2000cbd0 con 0x7fba24101990 2024-06-02T04:49:39.179 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.176+0000 7fba2c5e7700 1 -- 172.21.15.76:0/2178322744 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba2419ef00 con 0x7fba24101990 2024-06-02T04:49:39.179 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.176+0000 7fba1b7fe700 1 -- 172.21.15.76:0/2178322744 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba20018680 con 0x7fba24101990 2024-06-02T04:49:39.180 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.176+0000 7fba2c5e7700 1 -- 172.21.15.76:0/2178322744 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba2419f320 con 0x7fba24101990 2024-06-02T04:49:39.180 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.177+0000 7fba2c5e7700 1 -- 172.21.15.76:0/2178322744 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba240fce60 con 0x7fba24101990 2024-06-02T04:49:39.180 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.178+0000 7fba1b7fe700 1 -- 172.21.15.76:0/2178322744 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fba2000cd40 con 0x7fba24101990 2024-06-02T04:49:39.180 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.178+0000 7fba1b7fe700 1 --2- 172.21.15.76:0/2178322744 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fba100a1120 0x7fba100a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:39.180 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.179+0000 7fba29b82700 1 --2- 172.21.15.76:0/2178322744 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fba100a1120 0x7fba100a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:39.181 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.179+0000 7fba1b7fe700 1 -- 172.21.15.76:0/2178322744 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fba20014070 con 0x7fba24101990 2024-06-02T04:49:39.181 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.179+0000 7fba29b82700 1 --2- 172.21.15.76:0/2178322744 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fba100a1120 0x7fba100a35e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fba14009c60 tx=0x7fba14009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:39.182 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.182+0000 7fba1b7fe700 1 -- 172.21.15.76:0/2178322744 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fba20096670 con 0x7fba24101990 2024-06-02T04:49:39.382 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.381+0000 7fba2c5e7700 1 -- 172.21.15.76:0/2178322744 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fba2410c4e0 con 0x7fba24101990 2024-06-02T04:49:39.383 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.383+0000 7fba1b7fe700 1 -- 172.21.15.76:0/2178322744 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+24453 (secure 0 0 0) 0x7fba20099c90 con 0x7fba24101990 2024-06-02T04:49:39.384 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:49:39.384 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":82,"fsid":"60ab6d30-209a-11ef-bc9b-c7b262605968","created":"2024-06-02T04:42:21.007333+0000","modified":"2024-06-02T04:49:07.862801+0000","last_up_change":"2024-06-02T04:47:29.822242+0000","last_in_change":"2024-06-02T04:47:14.253449+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T04:44:56.408602+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-02T04:48:01.194954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-02T04:48:01.828863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-02T04:48:04.916565+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"33a51ba2-be5c-41d0-b5d1-8d6039f2ca4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6802","nonce":2869602045},{"type":"v1","addr":"172.21.15.76:6803","nonce":2869602045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6804","nonce":2869602045},{"type":"v1","addr":"172.21.15.76:6805","nonce":2869602045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6808","nonce":2869602045},{"type":"v1","addr":"172.21.15.76:6809","nonce":2869602045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6806","nonce":2869602045},{"type":"v1","addr":"172.21.15.76:6807","nonce":2869602045}]},"public_addr":"172.21.15.76:6803/2869602045","cluster_addr":"172.21.15.76:6805/2869602045","heartbeat_back_addr":"172.21.15.76:6809/2869602045","heartbeat_front_addr":"172.21.15.76:6807/2869602045","state":["exists","up"]},{"osd":1,"uuid":"ace46e13-3bb7-4103-973a-6860554df8b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":2353738098},{"type":"v1","addr":"172.21.15.119:6801","nonce":2353738098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":2353738098},{"type":"v1","addr":"172.21.15.119:6803","nonce":2353738098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":2353738098},{"type":"v1","addr":"172.21.15.119:6807","nonce":2353738098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":2353738098},{"type":"v1","addr":"172.21.15.119:6805","nonce":2353738098}]},"public_addr":"172.21.15.119:6801/2353738098","cluster_addr":"172.21.15.119:6803/2353738098","heartbeat_back_addr":"172.21.15.119:6807/2353738098","heartbeat_front_addr":"172.21.15.119:6805/2353738098","state":["exists","up"]},{"osd":2,"uuid":"4addc09e-77a9-428a-bcc4-38194f486cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":3206918546},{"type":"v1","addr":"172.21.15.192:6801","nonce":3206918546}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":3206918546},{"type":"v1","addr":"172.21.15.192:6803","nonce":3206918546}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":3206918546},{"type":"v1","addr":"172.21.15.192:6807","nonce":3206918546}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":3206918546},{"type":"v1","addr":"172.21.15.192:6805","nonce":3206918546}]},"public_addr":"172.21.15.192:6801/3206918546","cluster_addr":"172.21.15.192:6803/3206918546","heartbeat_back_addr":"172.21.15.192:6807/3206918546","heartbeat_front_addr":"172.21.15.192:6805/3206918546","state":["exists","up"]},{"osd":3,"uuid":"dc525518-82c6-49ed-8ca8-e3bd5bfc18d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6810","nonce":3747864233},{"type":"v1","addr":"172.21.15.76:6811","nonce":3747864233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6812","nonce":3747864233},{"type":"v1","addr":"172.21.15.76:6813","nonce":3747864233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6816","nonce":3747864233},{"type":"v1","addr":"172.21.15.76:6817","nonce":3747864233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6814","nonce":3747864233},{"type":"v1","addr":"172.21.15.76:6815","nonce":3747864233}]},"public_addr":"172.21.15.76:6811/3747864233","cluster_addr":"172.21.15.76:6813/3747864233","heartbeat_back_addr":"172.21.15.76:6817/3747864233","heartbeat_front_addr":"172.21.15.76:6815/3747864233","state":["exists","up"]},{"osd":4,"uuid":"eef293d0-cb87-47b3-9751-c6437a1cf079","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":2571629047},{"type":"v1","addr":"172.21.15.119:6809","nonce":2571629047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":2571629047},{"type":"v1","addr":"172.21.15.119:6811","nonce":2571629047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":2571629047},{"type":"v1","addr":"172.21.15.119:6815","nonce":2571629047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":2571629047},{"type":"v1","addr":"172.21.15.119:6813","nonce":2571629047}]},"public_addr":"172.21.15.119:6809/2571629047","cluster_addr":"172.21.15.119:6811/2571629047","heartbeat_back_addr":"172.21.15.119:6815/2571629047","heartbeat_front_addr":"172.21.15.119:6813/2571629047","state":["exists","up"]},{"osd":5,"uuid":"60eb8c6e-766c-49d0-9997-44f85776b3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3285065416},{"type":"v1","addr":"172.21.15.192:6809","nonce":3285065416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":3285065416},{"type":"v1","addr":"172.21.15.192:6811","nonce":3285065416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3285065416},{"type":"v1","addr":"172.21.15.192:6815","nonce":3285065416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":3285065416},{"type":"v1","addr":"172.21.15.192:6813","nonce":3285065416}]},"public_addr":"172.21.15.192:6809/3285065416","cluster_addr":"172.21.15.192:6811/3285065416","heartbeat_back_addr":"172.21.15.192:6815/3285065416","heartbeat_front_addr":"172.21.15.192:6813/3285065416","state":["exists","up"]},{"osd":6,"uuid":"e6dc8b9d-dd06-4870-a506-def8201b7e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6818","nonce":2951381580},{"type":"v1","addr":"172.21.15.76:6819","nonce":2951381580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6820","nonce":2951381580},{"type":"v1","addr":"172.21.15.76:6821","nonce":2951381580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6824","nonce":2951381580},{"type":"v1","addr":"172.21.15.76:6825","nonce":2951381580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6822","nonce":2951381580},{"type":"v1","addr":"172.21.15.76:6823","nonce":2951381580}]},"public_addr":"172.21.15.76:6819/2951381580","cluster_addr":"172.21.15.76:6821/2951381580","heartbeat_back_addr":"172.21.15.76:6825/2951381580","heartbeat_front_addr":"172.21.15.76:6823/2951381580","state":["exists","up"]},{"osd":7,"uuid":"2f5dccb3-39a1-4f25-8715-fa264d59db97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1802558756},{"type":"v1","addr":"172.21.15.119:6817","nonce":1802558756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1802558756},{"type":"v1","addr":"172.21.15.119:6819","nonce":1802558756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1802558756},{"type":"v1","addr":"172.21.15.119:6823","nonce":1802558756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1802558756},{"type":"v1","addr":"172.21.15.119:6821","nonce":1802558756}]},"public_addr":"172.21.15.119:6817/1802558756","cluster_addr":"172.21.15.119:6819/1802558756","heartbeat_back_addr":"172.21.15.119:6823/1802558756","heartbeat_front_addr":"172.21.15.119:6821/1802558756","state":["exists","up"]},{"osd":8,"uuid":"39b6ccd0-16e7-4cd5-87e0-d827e9172984","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":1214972276},{"type":"v1","addr":"172.21.15.192:6817","nonce":1214972276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":1214972276},{"type":"v1","addr":"172.21.15.192:6819","nonce":1214972276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":1214972276},{"type":"v1","addr":"172.21.15.192:6823","nonce":1214972276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":1214972276},{"type":"v1","addr":"172.21.15.192:6821","nonce":1214972276}]},"public_addr":"172.21.15.192:6817/1214972276","cluster_addr":"172.21.15.192:6819/1214972276","heartbeat_back_addr":"172.21.15.192:6823/1214972276","heartbeat_front_addr":"172.21.15.192:6821/1214972276","state":["exists","up"]},{"osd":9,"uuid":"851b2155-07bd-45de-bfe0-53021fda733f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6826","nonce":3095501821},{"type":"v1","addr":"172.21.15.76:6827","nonce":3095501821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6828","nonce":3095501821},{"type":"v1","addr":"172.21.15.76:6829","nonce":3095501821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":3095501821},{"type":"v1","addr":"172.21.15.76:6833","nonce":3095501821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6830","nonce":3095501821},{"type":"v1","addr":"172.21.15.76:6831","nonce":3095501821}]},"public_addr":"172.21.15.76:6827/3095501821","cluster_addr":"172.21.15.76:6829/3095501821","heartbeat_back_addr":"172.21.15.76:6833/3095501821","heartbeat_front_addr":"172.21.15.76:6831/3095501821","state":["exists","up"]},{"osd":10,"uuid":"e4b18e7e-bddf-4dd4-84f6-7902ea327cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":4082130894},{"type":"v1","addr":"172.21.15.119:6825","nonce":4082130894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":4082130894},{"type":"v1","addr":"172.21.15.119:6827","nonce":4082130894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":4082130894},{"type":"v1","addr":"172.21.15.119:6831","nonce":4082130894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":4082130894},{"type":"v1","addr":"172.21.15.119:6829","nonce":4082130894}]},"public_addr":"172.21.15.119:6825/4082130894","cluster_addr":"172.21.15.119:6827/4082130894","heartbeat_back_addr":"172.21.15.119:6831/4082130894","heartbeat_front_addr":"172.21.15.119:6829/4082130894","state":["exists","up"]},{"osd":11,"uuid":"54567e18-920c-4ae9-9557-0efba5a1a820","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":439693921},{"type":"v1","addr":"172.21.15.192:6825","nonce":439693921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":439693921},{"type":"v1","addr":"172.21.15.192:6827","nonce":439693921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":439693921},{"type":"v1","addr":"172.21.15.192:6831","nonce":439693921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":439693921},{"type":"v1","addr":"172.21.15.192:6829","nonce":439693921}]},"public_addr":"172.21.15.192:6825/439693921","cluster_addr":"172.21.15.192:6827/439693921","heartbeat_back_addr":"172.21.15.192:6831/439693921","heartbeat_front_addr":"172.21.15.192:6829/439693921","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:44:19.922390+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:44:36.895563+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:44:53.699019+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:45:11.167404+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:45:27.955899+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:45:44.850368+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:46:02.003588+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:46:19.019217+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:46:36.189670+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:46:53.919365+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:47:11.563053+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:47:28.822443+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":4}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.8","mappings":[{"from":5,"to":10}]},{"pgid":"4.14","mappings":[{"from":9,"to":8}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.76:6801/4200406736":"2024-06-03T04:43:06.092916+0000","172.21.15.76:6800/4200406736":"2024-06-03T04:43:06.092916+0000","172.21.15.76:0/1524144593":"2024-06-03T04:43:06.092916+0000","172.21.15.76:0/3269372590":"2024-06-03T04:43:06.092916+0000","172.21.15.76:0/3570893846":"2024-06-03T04:42:44.872236+0000","172.21.15.76:0/902035790":"2024-06-03T04:43:06.092916+0000","172.21.15.76:6800/2550846765":"2024-06-03T04:42:44.872236+0000","172.21.15.76:6801/2550846765":"2024-06-03T04:42:44.872236+0000","172.21.15.76:0/2646712763":"2024-06-03T04:42:44.872236+0000","172.21.15.76:0/964578813":"2024-06-03T04:42:44.872236+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T04:49:39.385 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.385+0000 7fba2c5e7700 1 -- 172.21.15.76:0/2178322744 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fba100a1120 msgr2=0x7fba100a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:39.386 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.385+0000 7fba2c5e7700 1 --2- 172.21.15.76:0/2178322744 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fba100a1120 0x7fba100a35e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fba14009c60 tx=0x7fba14009260 comp rx=0 tx=0).stop 2024-06-02T04:49:39.386 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.385+0000 7fba2c5e7700 1 -- 172.21.15.76:0/2178322744 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fba24101990 msgr2=0x7fba24196e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:39.386 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.385+0000 7fba2c5e7700 1 --2- 172.21.15.76:0/2178322744 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fba24101990 0x7fba24196e00 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fba2000e9a0 tx=0x7fba2000ecb0 comp rx=0 tx=0).stop 2024-06-02T04:49:39.386 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.385+0000 7fba2c5e7700 1 -- 172.21.15.76:0/2178322744 shutdown_connections 2024-06-02T04:49:39.386 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.385+0000 7fba2c5e7700 1 --2- 172.21.15.76:0/2178322744 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba24106bf0 0x7fba2419e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:39.386 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.385+0000 7fba2c5e7700 1 --2- 172.21.15.76:0/2178322744 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fba24101990 0x7fba24196e00 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:39.386 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.385+0000 7fba2c5e7700 1 --2- 172.21.15.76:0/2178322744 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fba100a1120 0x7fba100a35e0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:39.387 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.385+0000 7fba2c5e7700 1 --2- 172.21.15.76:0/2178322744 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba241042c0 0x7fba24197340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:39.387 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.385+0000 7fba2c5e7700 1 -- 172.21.15.76:0/2178322744 >> 172.21.15.76:0/2178322744 conn(0x7fba240fb2e0 msgr2=0x7fba24103880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:39.387 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.385+0000 7fba2c5e7700 1 -- 172.21.15.76:0/2178322744 shutdown_connections 2024-06-02T04:49:39.387 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.385+0000 7fba2c5e7700 1 -- 172.21.15.76:0/2178322744 wait complete. 2024-06-02T04:49:39.396 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:39 smithi076 ceph-mon[42935]: pgmap v268: 129 pgs: 129 active+clean; 640 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-06-02T04:49:39.396 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:39 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/3060891321' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-06-02T04:49:39.396 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:39 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/1820376769' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-06-02T04:49:39.397 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:39 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/1337518817' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-06-02T04:49:39.398 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-06-02T04:44:56.408602+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-06-02T04:48:01.194954+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-06-02T04:48:01.828863+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '76', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-06-02T04:48:04.916565+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-06-02T04:49:39.399 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-06-02T04:49:39.526 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.524+0000 7f71bbc33700 1 -- 172.21.15.76:0/1883252637 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f71b40ffe80 msgr2=0x7f71b41002a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:39.526 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.524+0000 7f71bbc33700 1 --2- 172.21.15.76:0/1883252637 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f71b40ffe80 0x7f71b41002a0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f71a4009990 tx=0x7f71a4009ca0 comp rx=0 tx=0).stop 2024-06-02T04:49:39.526 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.524+0000 7f71bbc33700 1 -- 172.21.15.76:0/1883252637 shutdown_connections 2024-06-02T04:49:39.526 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.524+0000 7f71bbc33700 1 --2- 172.21.15.76:0/1883252637 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71b4101990 0x7f71b41082b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:39.527 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.524+0000 7f71bbc33700 1 --2- 172.21.15.76:0/1883252637 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f71b40ffe80 0x7f71b41002a0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:39.527 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.524+0000 7f71bbc33700 1 --2- 172.21.15.76:0/1883252637 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71b4100fd0 0x7f71b4101450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:39.527 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.524+0000 7f71bbc33700 1 -- 172.21.15.76:0/1883252637 >> 172.21.15.76:0/1883252637 conn(0x7f71b40fb3f0 msgr2=0x7f71b40fd830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:39.527 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.524+0000 7f71bbc33700 1 -- 172.21.15.76:0/1883252637 shutdown_connections 2024-06-02T04:49:39.527 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.524+0000 7f71bbc33700 1 -- 172.21.15.76:0/1883252637 wait complete. 2024-06-02T04:49:39.527 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.524+0000 7f71bbc33700 1 Processor -- start 2024-06-02T04:49:39.527 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.524+0000 7f71bbc33700 1 -- start start 2024-06-02T04:49:39.527 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.525+0000 7f71bbc33700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71b40ffe80 0x7f71b4195d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:39.527 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.525+0000 7f71bbc33700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f71b4100fd0 0x7f71b41962c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:39.527 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.525+0000 7f71bbc33700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71b4101990 0x7f71b419d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:39.527 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.525+0000 7f71bbc33700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b419d870 con 0x7f71b4100fd0 2024-06-02T04:49:39.527 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.525+0000 7f71bbc33700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b419d9e0 con 0x7f71b4101990 2024-06-02T04:49:39.527 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.525+0000 7f71bbc33700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b419dba0 con 0x7f71b40ffe80 2024-06-02T04:49:39.528 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.525+0000 7f71b91ce700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f71b4100fd0 0x7f71b41962c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:39.528 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.525+0000 7f71b91ce700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f71b4100fd0 0x7f71b41962c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:55092/0 (socket says 172.21.15.76:55092) 2024-06-02T04:49:39.528 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.525+0000 7f71b91ce700 1 -- 172.21.15.76:0/474488924 learned_addr learned my addr 172.21.15.76:0/474488924 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:49:39.528 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.525+0000 7f71ba1d0700 1 --2- 172.21.15.76:0/474488924 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71b4101990 0x7f71b419d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:39.528 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.525+0000 7f71b99cf700 1 --2- 172.21.15.76:0/474488924 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71b40ffe80 0x7f71b4195d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:39.528 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.525+0000 7f71b91ce700 1 -- 172.21.15.76:0/474488924 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71b40ffe80 msgr2=0x7f71b4195d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:39.528 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.525+0000 7f71b91ce700 1 --2- 172.21.15.76:0/474488924 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71b40ffe80 0x7f71b4195d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:39.528 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.525+0000 7f71b91ce700 1 -- 172.21.15.76:0/474488924 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71b4101990 msgr2=0x7f71b419d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:39.528 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.525+0000 7f71b91ce700 1 --2- 172.21.15.76:0/474488924 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71b4101990 0x7f71b419d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:39.528 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.525+0000 7f71b91ce700 1 -- 172.21.15.76:0/474488924 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71a40095f0 con 0x7f71b4100fd0 2024-06-02T04:49:39.528 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.525+0000 7f71b91ce700 1 --2- 172.21.15.76:0/474488924 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f71b4100fd0 0x7f71b41962c0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f71b000d950 tx=0x7f71b000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:39.528 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.525+0000 7f71aaffd700 1 -- 172.21.15.76:0/474488924 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b0009940 con 0x7f71b4100fd0 2024-06-02T04:49:39.528 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.525+0000 7f71aaffd700 1 -- 172.21.15.76:0/474488924 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f71b0010460 con 0x7f71b4100fd0 2024-06-02T04:49:39.529 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.525+0000 7f71bbc33700 1 -- 172.21.15.76:0/474488924 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71b419de80 con 0x7f71b4100fd0 2024-06-02T04:49:39.529 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.525+0000 7f71aaffd700 1 -- 172.21.15.76:0/474488924 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b000f620 con 0x7f71b4100fd0 2024-06-02T04:49:39.529 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.525+0000 7f71bbc33700 1 -- 172.21.15.76:0/474488924 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71b419e2a0 con 0x7f71b4100fd0 2024-06-02T04:49:39.530 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.526+0000 7f71bbc33700 1 -- 172.21.15.76:0/474488924 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71b4107330 con 0x7f71b4100fd0 2024-06-02T04:49:39.530 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.528+0000 7f71aaffd700 1 -- 172.21.15.76:0/474488924 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f71b00105d0 con 0x7f71b4100fd0 2024-06-02T04:49:39.530 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.529+0000 7f71aaffd700 1 --2- 172.21.15.76:0/474488924 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f71a00a1120 0x7f71a00a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:39.531 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.529+0000 7f71b99cf700 1 --2- 172.21.15.76:0/474488924 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f71a00a1120 0x7f71a00a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:39.531 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.529+0000 7f71aaffd700 1 -- 172.21.15.76:0/474488924 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f71b00cca80 con 0x7f71b4100fd0 2024-06-02T04:49:39.531 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.529+0000 7f71b99cf700 1 --2- 172.21.15.76:0/474488924 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f71a00a1120 0x7f71a00a35e0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f71a4006010 tx=0x7f71a4003720 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:39.532 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.532+0000 7f71aaffd700 1 -- 172.21.15.76:0/474488924 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f71b0095ea0 con 0x7f71b4100fd0 2024-06-02T04:49:39.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:39 smithi119 ceph-mon[46633]: pgmap v268: 129 pgs: 129 active+clean; 640 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-06-02T04:49:39.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:39 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/3060891321' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-06-02T04:49:39.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:39 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/1820376769' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-06-02T04:49:39.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:39 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/1337518817' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-06-02T04:49:39.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:39 smithi192 ceph-mon[47933]: pgmap v268: 129 pgs: 129 active+clean; 640 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-06-02T04:49:39.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:39 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/3060891321' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-06-02T04:49:39.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:39 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/1820376769' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-06-02T04:49:39.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:39 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/1337518817' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-06-02T04:49:39.729 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.728+0000 7f71bbc33700 1 -- 172.21.15.76:0/474488924 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f71b4106d10 con 0x7f71b4100fd0 2024-06-02T04:49:39.729 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.729+0000 7f71aaffd700 1 -- 172.21.15.76:0/474488924 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) v1 ==== 93+0+10 (secure 0 0 0) 0x7f71b0020020 con 0x7f71b4100fd0 2024-06-02T04:49:39.729 INFO:teuthology.orchestra.run.smithi076.stdout:pg_num: 1 2024-06-02T04:49:39.731 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.731+0000 7f71bbc33700 1 -- 172.21.15.76:0/474488924 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f71a00a1120 msgr2=0x7f71a00a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:39.731 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.731+0000 7f71bbc33700 1 --2- 172.21.15.76:0/474488924 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f71a00a1120 0x7f71a00a35e0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f71a4006010 tx=0x7f71a4003720 comp rx=0 tx=0).stop 2024-06-02T04:49:39.731 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.731+0000 7f71bbc33700 1 -- 172.21.15.76:0/474488924 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f71b4100fd0 msgr2=0x7f71b41962c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:39.732 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.731+0000 7f71bbc33700 1 --2- 172.21.15.76:0/474488924 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f71b4100fd0 0x7f71b41962c0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f71b000d950 tx=0x7f71b000dc60 comp rx=0 tx=0).stop 2024-06-02T04:49:39.732 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.731+0000 7f71bbc33700 1 -- 172.21.15.76:0/474488924 shutdown_connections 2024-06-02T04:49:39.732 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.731+0000 7f71bbc33700 1 --2- 172.21.15.76:0/474488924 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f71a00a1120 0x7f71a00a35e0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:39.732 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.731+0000 7f71bbc33700 1 --2- 172.21.15.76:0/474488924 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71b4101990 0x7f71b419d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:39.732 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.731+0000 7f71bbc33700 1 --2- 172.21.15.76:0/474488924 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71b40ffe80 0x7f71b4195d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:39.732 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.731+0000 7f71bbc33700 1 --2- 172.21.15.76:0/474488924 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f71b4100fd0 0x7f71b41962c0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:39.732 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.731+0000 7f71bbc33700 1 -- 172.21.15.76:0/474488924 >> 172.21.15.76:0/474488924 conn(0x7f71b40fb3f0 msgr2=0x7f71b4104470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:39.732 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.731+0000 7f71bbc33700 1 -- 172.21.15.76:0/474488924 shutdown_connections 2024-06-02T04:49:39.732 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.731+0000 7f71bbc33700 1 -- 172.21.15.76:0/474488924 wait complete. 2024-06-02T04:49:39.744 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-06-02T04:49:39.870 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.869+0000 7f7548a25700 1 -- 172.21.15.76:0/3034603641 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7544102ab0 msgr2=0x7f75441093d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:39.870 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.869+0000 7f7548a25700 1 --2- 172.21.15.76:0/3034603641 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7544102ab0 0x7f75441093d0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f753c009990 tx=0x7f753c009ca0 comp rx=0 tx=0).stop 2024-06-02T04:49:39.870 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.869+0000 7f7548a25700 1 -- 172.21.15.76:0/3034603641 shutdown_connections 2024-06-02T04:49:39.870 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.869+0000 7f7548a25700 1 --2- 172.21.15.76:0/3034603641 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7544102ab0 0x7f75441093d0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:39.870 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.869+0000 7f7548a25700 1 --2- 172.21.15.76:0/3034603641 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7544100f20 0x7f7544101360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:39.870 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.869+0000 7f7548a25700 1 --2- 172.21.15.76:0/3034603641 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f75441020f0 0x7f7544102570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:39.870 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.869+0000 7f7548a25700 1 -- 172.21.15.76:0/3034603641 >> 172.21.15.76:0/3034603641 conn(0x7f75440fc4e0 msgr2=0x7f75440fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:39.870 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.869+0000 7f7548a25700 1 -- 172.21.15.76:0/3034603641 shutdown_connections 2024-06-02T04:49:39.870 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.869+0000 7f7548a25700 1 -- 172.21.15.76:0/3034603641 wait complete. 2024-06-02T04:49:39.873 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.870+0000 7f7548a25700 1 Processor -- start 2024-06-02T04:49:39.873 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.870+0000 7f7548a25700 1 -- start start 2024-06-02T04:49:39.873 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.870+0000 7f7548a25700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7544100f20 0x7f7544196db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:39.873 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.870+0000 7f7548a25700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f75441020f0 0x7f75441972f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:39.873 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.870+0000 7f7548a25700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7544102ab0 0x7f754419e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:39.873 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.870+0000 7f7548a25700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f754419e8e0 con 0x7f7544102ab0 2024-06-02T04:49:39.873 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.870+0000 7f7548a25700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f754419ea20 con 0x7f7544100f20 2024-06-02T04:49:39.873 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.870+0000 7f7548a25700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f754419ebb0 con 0x7f75441020f0 2024-06-02T04:49:39.874 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.870+0000 7f7542d9d700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7544102ab0 0x7f754419e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:39.874 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.870+0000 7f7542d9d700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7544102ab0 0x7f754419e310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:55102/0 (socket says 172.21.15.76:55102) 2024-06-02T04:49:39.874 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.870+0000 7f7542d9d700 1 -- 172.21.15.76:0/2965278280 learned_addr learned my addr 172.21.15.76:0/2965278280 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:49:39.874 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.870+0000 7f7541d9b700 1 --2- 172.21.15.76:0/2965278280 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f75441020f0 0x7f75441972f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:39.874 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.871+0000 7f754259c700 1 --2- 172.21.15.76:0/2965278280 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7544100f20 0x7f7544196db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:39.874 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.871+0000 7f7542d9d700 1 -- 172.21.15.76:0/2965278280 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f75441020f0 msgr2=0x7f75441972f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:39.874 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.871+0000 7f7542d9d700 1 --2- 172.21.15.76:0/2965278280 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f75441020f0 0x7f75441972f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:39.874 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.871+0000 7f7542d9d700 1 -- 172.21.15.76:0/2965278280 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7544100f20 msgr2=0x7f7544196db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:39.874 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.871+0000 7f7542d9d700 1 --2- 172.21.15.76:0/2965278280 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7544100f20 0x7f7544196db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:39.874 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.871+0000 7f7542d9d700 1 -- 172.21.15.76:0/2965278280 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f753c0095f0 con 0x7f7544102ab0 2024-06-02T04:49:39.874 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.871+0000 7f754259c700 1 --2- 172.21.15.76:0/2965278280 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7544100f20 0x7f7544196db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:49:39.875 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.871+0000 7f7542d9d700 1 --2- 172.21.15.76:0/2965278280 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7544102ab0 0x7f754419e310 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f753c0092e0 tx=0x7f753c009510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:39.875 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.871+0000 7f753b7fe700 1 -- 172.21.15.76:0/2965278280 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f753c01d070 con 0x7f7544102ab0 2024-06-02T04:49:39.875 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.871+0000 7f753b7fe700 1 -- 172.21.15.76:0/2965278280 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f753c00bed0 con 0x7f7544102ab0 2024-06-02T04:49:39.875 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.871+0000 7f753b7fe700 1 -- 172.21.15.76:0/2965278280 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f753c022ea0 con 0x7f7544102ab0 2024-06-02T04:49:39.875 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.871+0000 7f7548a25700 1 -- 172.21.15.76:0/2965278280 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f754419ee30 con 0x7f7544102ab0 2024-06-02T04:49:39.875 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.871+0000 7f7548a25700 1 -- 172.21.15.76:0/2965278280 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f754419f1a0 con 0x7f7544102ab0 2024-06-02T04:49:39.875 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.872+0000 7f7548a25700 1 -- 172.21.15.76:0/2965278280 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7544108410 con 0x7f7544102ab0 2024-06-02T04:49:39.875 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.873+0000 7f753b7fe700 1 -- 172.21.15.76:0/2965278280 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f753c022600 con 0x7f7544102ab0 2024-06-02T04:49:39.876 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.873+0000 7f753b7fe700 1 --2- 172.21.15.76:0/2965278280 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f75300a11a0 0x7f75300a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:39.876 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.874+0000 7f754259c700 1 --2- 172.21.15.76:0/2965278280 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f75300a11a0 0x7f75300a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:39.876 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.874+0000 7f753b7fe700 1 -- 172.21.15.76:0/2965278280 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f753c0ce430 con 0x7f7544102ab0 2024-06-02T04:49:39.876 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.874+0000 7f754259c700 1 --2- 172.21.15.76:0/2965278280 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f75300a11a0 0x7f75300a3660 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f7544100c40 tx=0x7f753400b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:39.878 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:39.877+0000 7f753b7fe700 1 -- 172.21.15.76:0/2965278280 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f753c0978e0 con 0x7f7544102ab0 2024-06-02T04:49:40.076 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.076+0000 7f7548a25700 1 -- 172.21.15.76:0/2965278280 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f754410c640 con 0x7f7544102ab0 2024-06-02T04:49:40.077 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.076+0000 7f753b7fe700 1 -- 172.21.15.76:0/2965278280 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v82) v1 ==== 104+0+11 (secure 0 0 0) 0x7f753c09af00 con 0x7f7544102ab0 2024-06-02T04:49:40.077 INFO:teuthology.orchestra.run.smithi076.stdout:pg_num: 32 2024-06-02T04:49:40.079 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.078+0000 7f7548a25700 1 -- 172.21.15.76:0/2965278280 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f75300a11a0 msgr2=0x7f75300a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:40.079 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.078+0000 7f7548a25700 1 --2- 172.21.15.76:0/2965278280 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f75300a11a0 0x7f75300a3660 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f7544100c40 tx=0x7f753400b040 comp rx=0 tx=0).stop 2024-06-02T04:49:40.079 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.078+0000 7f7548a25700 1 -- 172.21.15.76:0/2965278280 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7544102ab0 msgr2=0x7f754419e310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:40.079 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.078+0000 7f7548a25700 1 --2- 172.21.15.76:0/2965278280 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7544102ab0 0x7f754419e310 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f753c0092e0 tx=0x7f753c009510 comp rx=0 tx=0).stop 2024-06-02T04:49:40.079 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.078+0000 7f7548a25700 1 -- 172.21.15.76:0/2965278280 shutdown_connections 2024-06-02T04:49:40.079 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.078+0000 7f7548a25700 1 --2- 172.21.15.76:0/2965278280 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7544102ab0 0x7f754419e310 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:40.079 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.078+0000 7f7548a25700 1 --2- 172.21.15.76:0/2965278280 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f75300a11a0 0x7f75300a3660 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:40.079 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.078+0000 7f7548a25700 1 --2- 172.21.15.76:0/2965278280 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7544100f20 0x7f7544196db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:40.079 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.078+0000 7f7548a25700 1 --2- 172.21.15.76:0/2965278280 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f75441020f0 0x7f75441972f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:40.080 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.078+0000 7f7548a25700 1 -- 172.21.15.76:0/2965278280 >> 172.21.15.76:0/2965278280 conn(0x7f75440fc4e0 msgr2=0x7f7544105550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:40.080 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.078+0000 7f7548a25700 1 -- 172.21.15.76:0/2965278280 shutdown_connections 2024-06-02T04:49:40.080 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.078+0000 7f7548a25700 1 -- 172.21.15.76:0/2965278280 wait complete. 2024-06-02T04:49:40.091 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-06-02T04:49:40.217 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.216+0000 7f6d3102f700 1 -- 172.21.15.76:0/4117941141 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6d2c102b90 msgr2=0x7f6d2c109440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:40.217 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.216+0000 7f6d3102f700 1 --2- 172.21.15.76:0/4117941141 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6d2c102b90 0x7f6d2c109440 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f6d2400b0a0 tx=0x7f6d2400b3b0 comp rx=0 tx=0).stop 2024-06-02T04:49:40.217 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.216+0000 7f6d3102f700 1 -- 172.21.15.76:0/4117941141 shutdown_connections 2024-06-02T04:49:40.217 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.216+0000 7f6d3102f700 1 --2- 172.21.15.76:0/4117941141 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6d2c102b90 0x7f6d2c109440 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:40.217 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.216+0000 7f6d3102f700 1 --2- 172.21.15.76:0/4117941141 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d2c0ff220 0x7f6d2c0ff640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:40.217 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.216+0000 7f6d3102f700 1 --2- 172.21.15.76:0/4117941141 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6d2c1021f0 0x7f6d2c102650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:40.218 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.216+0000 7f6d3102f700 1 -- 172.21.15.76:0/4117941141 >> 172.21.15.76:0/4117941141 conn(0x7f6d2c0fab50 msgr2=0x7f6d2c0fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:40.218 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.216+0000 7f6d3102f700 1 -- 172.21.15.76:0/4117941141 shutdown_connections 2024-06-02T04:49:40.218 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.216+0000 7f6d3102f700 1 -- 172.21.15.76:0/4117941141 wait complete. 2024-06-02T04:49:40.218 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.217+0000 7f6d3102f700 1 Processor -- start 2024-06-02T04:49:40.220 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.217+0000 7f6d3102f700 1 -- start start 2024-06-02T04:49:40.220 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.217+0000 7f6d3102f700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6d2c0ff220 0x7f6d2c196ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:40.220 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.217+0000 7f6d3102f700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d2c1021f0 0x7f6d2c197430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:40.220 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.217+0000 7f6d3102f700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6d2c102b90 0x7f6d2c19e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:40.220 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.217+0000 7f6d3102f700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d2c19ea20 con 0x7f6d2c102b90 2024-06-02T04:49:40.220 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.217+0000 7f6d3102f700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d2c19eb60 con 0x7f6d2c0ff220 2024-06-02T04:49:40.220 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.217+0000 7f6d3102f700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d2c19ecf0 con 0x7f6d2c1021f0 2024-06-02T04:49:40.220 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.218+0000 7f6d2b59e700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6d2c102b90 0x7f6d2c19e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:40.220 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.218+0000 7f6d2b59e700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6d2c102b90 0x7f6d2c19e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:55124/0 (socket says 172.21.15.76:55124) 2024-06-02T04:49:40.220 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.218+0000 7f6d2b59e700 1 -- 172.21.15.76:0/1690317335 learned_addr learned my addr 172.21.15.76:0/1690317335 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:49:40.220 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.218+0000 7f6d2ad9d700 1 --2- 172.21.15.76:0/1690317335 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6d2c0ff220 0x7f6d2c196ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:40.220 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.218+0000 7f6d2a59c700 1 --2- 172.21.15.76:0/1690317335 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d2c1021f0 0x7f6d2c197430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:40.221 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.218+0000 7f6d2b59e700 1 -- 172.21.15.76:0/1690317335 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d2c1021f0 msgr2=0x7f6d2c197430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:40.221 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.218+0000 7f6d2b59e700 1 --2- 172.21.15.76:0/1690317335 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d2c1021f0 0x7f6d2c197430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:40.221 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.218+0000 7f6d2b59e700 1 -- 172.21.15.76:0/1690317335 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6d2c0ff220 msgr2=0x7f6d2c196ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:40.221 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.218+0000 7f6d2b59e700 1 --2- 172.21.15.76:0/1690317335 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6d2c0ff220 0x7f6d2c196ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:40.221 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.218+0000 7f6d2b59e700 1 -- 172.21.15.76:0/1690317335 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d24009d00 con 0x7f6d2c102b90 2024-06-02T04:49:40.221 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.218+0000 7f6d2b59e700 1 --2- 172.21.15.76:0/1690317335 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6d2c102b90 0x7f6d2c19e450 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f6d24004d00 tx=0x7f6d24004d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:40.221 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.218+0000 7f6d23fff700 1 -- 172.21.15.76:0/1690317335 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d2400e040 con 0x7f6d2c102b90 2024-06-02T04:49:40.221 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.218+0000 7f6d23fff700 1 -- 172.21.15.76:0/1690317335 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6d2400cec0 con 0x7f6d2c102b90 2024-06-02T04:49:40.221 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.218+0000 7f6d3102f700 1 -- 172.21.15.76:0/1690317335 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d2c19ef70 con 0x7f6d2c102b90 2024-06-02T04:49:40.221 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.218+0000 7f6d23fff700 1 -- 172.21.15.76:0/1690317335 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d2401ba30 con 0x7f6d2c102b90 2024-06-02T04:49:40.221 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.218+0000 7f6d3102f700 1 -- 172.21.15.76:0/1690317335 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d2c19f390 con 0x7f6d2c102b90 2024-06-02T04:49:40.221 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.219+0000 7f6d3102f700 1 -- 172.21.15.76:0/1690317335 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d2c108450 con 0x7f6d2c102b90 2024-06-02T04:49:40.222 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.220+0000 7f6d23fff700 1 -- 172.21.15.76:0/1690317335 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f6d2401bb90 con 0x7f6d2c102b90 2024-06-02T04:49:40.222 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.221+0000 7f6d23fff700 1 --2- 172.21.15.76:0/1690317335 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f6d180a1120 0x7f6d180a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:40.222 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.221+0000 7f6d2ad9d700 1 --2- 172.21.15.76:0/1690317335 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f6d180a1120 0x7f6d180a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:40.223 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.221+0000 7f6d23fff700 1 -- 172.21.15.76:0/1690317335 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f6d240cec90 con 0x7f6d2c102b90 2024-06-02T04:49:40.223 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.221+0000 7f6d2ad9d700 1 --2- 172.21.15.76:0/1690317335 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f6d180a1120 0x7f6d180a35e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c067df0 tx=0x7f6d1c00a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:40.224 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.224+0000 7f6d23fff700 1 -- 172.21.15.76:0/1690317335 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f6d240981a0 con 0x7f6d2c102b90 2024-06-02T04:49:40.423 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.422+0000 7f6d3102f700 1 -- 172.21.15.76:0/1690317335 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6d2c107e30 con 0x7f6d2c102b90 2024-06-02T04:49:40.423 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.423+0000 7f6d23fff700 1 -- 172.21.15.76:0/1690317335 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v82) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6d2409b7c0 con 0x7f6d2c102b90 2024-06-02T04:49:40.423 INFO:teuthology.orchestra.run.smithi076.stdout:pg_num: 64 2024-06-02T04:49:40.425 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.425+0000 7f6d3102f700 1 -- 172.21.15.76:0/1690317335 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f6d180a1120 msgr2=0x7f6d180a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:40.425 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.425+0000 7f6d3102f700 1 --2- 172.21.15.76:0/1690317335 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f6d180a1120 0x7f6d180a35e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c067df0 tx=0x7f6d1c00a380 comp rx=0 tx=0).stop 2024-06-02T04:49:40.425 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.425+0000 7f6d3102f700 1 -- 172.21.15.76:0/1690317335 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6d2c102b90 msgr2=0x7f6d2c19e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:40.425 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.425+0000 7f6d3102f700 1 --2- 172.21.15.76:0/1690317335 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6d2c102b90 0x7f6d2c19e450 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f6d24004d00 tx=0x7f6d24004d30 comp rx=0 tx=0).stop 2024-06-02T04:49:40.426 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.425+0000 7f6d3102f700 1 -- 172.21.15.76:0/1690317335 shutdown_connections 2024-06-02T04:49:40.426 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.425+0000 7f6d3102f700 1 --2- 172.21.15.76:0/1690317335 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6d2c102b90 0x7f6d2c19e450 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:40.426 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.425+0000 7f6d3102f700 1 --2- 172.21.15.76:0/1690317335 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f6d180a1120 0x7f6d180a35e0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:40.426 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.425+0000 7f6d3102f700 1 --2- 172.21.15.76:0/1690317335 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6d2c0ff220 0x7f6d2c196ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:40.426 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.425+0000 7f6d3102f700 1 --2- 172.21.15.76:0/1690317335 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d2c1021f0 0x7f6d2c197430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:40.426 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.425+0000 7f6d3102f700 1 -- 172.21.15.76:0/1690317335 >> 172.21.15.76:0/1690317335 conn(0x7f6d2c0fab50 msgr2=0x7f6d2c105590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:40.426 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.425+0000 7f6d3102f700 1 -- 172.21.15.76:0/1690317335 shutdown_connections 2024-06-02T04:49:40.426 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.425+0000 7f6d3102f700 1 -- 172.21.15.76:0/1690317335 wait complete. 2024-06-02T04:49:40.436 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:40 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/2178322744' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:49:40.436 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:40 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/474488924' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-02T04:49:40.437 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:40 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/2965278280' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-06-02T04:49:40.438 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-06-02T04:49:40.562 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.562+0000 7fb1a702c700 1 -- 172.21.15.76:0/1746479614 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb1a0101990 msgr2=0x7fb1a01082b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:40.563 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.562+0000 7fb1a702c700 1 --2- 172.21.15.76:0/1746479614 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb1a0101990 0x7fb1a01082b0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fb19800b0a0 tx=0x7fb19800b3b0 comp rx=0 tx=0).stop 2024-06-02T04:49:40.563 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.562+0000 7fb1a702c700 1 -- 172.21.15.76:0/1746479614 shutdown_connections 2024-06-02T04:49:40.563 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.562+0000 7fb1a702c700 1 --2- 172.21.15.76:0/1746479614 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb1a0101990 0x7fb1a01082b0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:40.563 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.562+0000 7fb1a702c700 1 --2- 172.21.15.76:0/1746479614 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1a00ffe80 0x7fb1a01002a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:40.563 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.562+0000 7fb1a702c700 1 --2- 172.21.15.76:0/1746479614 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1a0100fd0 0x7fb1a0101450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:40.563 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.562+0000 7fb1a702c700 1 -- 172.21.15.76:0/1746479614 >> 172.21.15.76:0/1746479614 conn(0x7fb1a00fb3f0 msgr2=0x7fb1a00fd830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:40.563 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.562+0000 7fb1a702c700 1 -- 172.21.15.76:0/1746479614 shutdown_connections 2024-06-02T04:49:40.563 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.562+0000 7fb1a702c700 1 -- 172.21.15.76:0/1746479614 wait complete. 2024-06-02T04:49:40.565 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.563+0000 7fb1a702c700 1 Processor -- start 2024-06-02T04:49:40.565 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.563+0000 7fb1a702c700 1 -- start start 2024-06-02T04:49:40.566 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.563+0000 7fb1a702c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb1a00ffe80 0x7fb1a0195d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:40.566 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.563+0000 7fb1a702c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1a0100fd0 0x7fb1a01962a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:40.566 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.563+0000 7fb1a702c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1a0101990 0x7fb1a019d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:40.566 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.563+0000 7fb1a702c700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a019d850 con 0x7fb1a00ffe80 2024-06-02T04:49:40.566 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.563+0000 7fb1a702c700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a019d9c0 con 0x7fb1a0100fd0 2024-06-02T04:49:40.566 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.563+0000 7fb1a702c700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a019db80 con 0x7fb1a0101990 2024-06-02T04:49:40.566 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.563+0000 7fb1a4dc8700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb1a00ffe80 0x7fb1a0195d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:40.566 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.563+0000 7fb1a4dc8700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb1a00ffe80 0x7fb1a0195d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:55132/0 (socket says 172.21.15.76:55132) 2024-06-02T04:49:40.566 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.563+0000 7fb1a4dc8700 1 -- 172.21.15.76:0/4053319646 learned_addr learned my addr 172.21.15.76:0/4053319646 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:49:40.566 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.563+0000 7fb19ffff700 1 --2- 172.21.15.76:0/4053319646 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1a0100fd0 0x7fb1a01962a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:40.566 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.563+0000 7fb1a55c9700 1 --2- 172.21.15.76:0/4053319646 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1a0101990 0x7fb1a019d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:40.566 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.563+0000 7fb1a4dc8700 1 -- 172.21.15.76:0/4053319646 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1a0101990 msgr2=0x7fb1a019d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:40.567 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.563+0000 7fb1a4dc8700 1 --2- 172.21.15.76:0/4053319646 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1a0101990 0x7fb1a019d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:40.567 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.563+0000 7fb1a4dc8700 1 -- 172.21.15.76:0/4053319646 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1a0100fd0 msgr2=0x7fb1a01962a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:40.567 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.563+0000 7fb1a4dc8700 1 --2- 172.21.15.76:0/4053319646 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1a0100fd0 0x7fb1a01962a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:40.567 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.563+0000 7fb1a4dc8700 1 -- 172.21.15.76:0/4053319646 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb198009d00 con 0x7fb1a00ffe80 2024-06-02T04:49:40.567 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.563+0000 7fb19ffff700 1 --2- 172.21.15.76:0/4053319646 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1a0100fd0 0x7fb1a01962a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:49:40.567 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.564+0000 7fb1a4dc8700 1 --2- 172.21.15.76:0/4053319646 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb1a00ffe80 0x7fb1a0195d60 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fb19400d950 tx=0x7fb19400dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:40.567 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.564+0000 7fb19dffb700 1 -- 172.21.15.76:0/4053319646 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb194009b40 con 0x7fb1a00ffe80 2024-06-02T04:49:40.567 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.564+0000 7fb1a702c700 1 -- 172.21.15.76:0/4053319646 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1a019de60 con 0x7fb1a00ffe80 2024-06-02T04:49:40.567 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.564+0000 7fb19dffb700 1 -- 172.21.15.76:0/4053319646 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb194009ca0 con 0x7fb1a00ffe80 2024-06-02T04:49:40.567 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.564+0000 7fb19dffb700 1 -- 172.21.15.76:0/4053319646 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb19400f620 con 0x7fb1a00ffe80 2024-06-02T04:49:40.567 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.564+0000 7fb1a702c700 1 -- 172.21.15.76:0/4053319646 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1a019e290 con 0x7fb1a00ffe80 2024-06-02T04:49:40.567 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.565+0000 7fb1a702c700 1 -- 172.21.15.76:0/4053319646 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1a0107240 con 0x7fb1a00ffe80 2024-06-02T04:49:40.568 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.566+0000 7fb19dffb700 1 -- 172.21.15.76:0/4053319646 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fb194010460 con 0x7fb1a00ffe80 2024-06-02T04:49:40.568 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.567+0000 7fb19dffb700 1 --2- 172.21.15.76:0/4053319646 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fb1900a1120 0x7fb1900a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:40.568 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.567+0000 7fb19ffff700 1 --2- 172.21.15.76:0/4053319646 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fb1900a1120 0x7fb1900a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:40.568 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.567+0000 7fb19dffb700 1 -- 172.21.15.76:0/4053319646 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fb1940ccfe0 con 0x7fb1a00ffe80 2024-06-02T04:49:40.568 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.567+0000 7fb19ffff700 1 --2- 172.21.15.76:0/4053319646 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fb1900a1120 0x7fb1900a35e0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb18c005fd0 tx=0x7fb18c005e30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:40.571 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.571+0000 7fb19dffb700 1 -- 172.21.15.76:0/4053319646 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fb194096400 con 0x7fb1a00ffe80 2024-06-02T04:49:40.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:40 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/2178322744' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:49:40.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:40 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/474488924' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-02T04:49:40.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:40 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/2965278280' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-06-02T04:49:40.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:40 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/2178322744' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:49:40.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:40 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/474488924' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-02T04:49:40.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:40 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/2965278280' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-06-02T04:49:40.767 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.767+0000 7fb1a702c700 1 -- 172.21.15.76:0/4053319646 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fb1a002cda0 con 0x7fb1a00ffe80 2024-06-02T04:49:40.768 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.767+0000 7fb19dffb700 1 -- 172.21.15.76:0/4053319646 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v82) v1 ==== 103+0+11 (secure 0 0 0) 0x7fb1940200a0 con 0x7fb1a00ffe80 2024-06-02T04:49:40.768 INFO:teuthology.orchestra.run.smithi076.stdout:pg_num: 32 2024-06-02T04:49:40.770 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.770+0000 7fb1a702c700 1 -- 172.21.15.76:0/4053319646 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fb1900a1120 msgr2=0x7fb1900a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:40.770 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.770+0000 7fb1a702c700 1 --2- 172.21.15.76:0/4053319646 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fb1900a1120 0x7fb1900a35e0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb18c005fd0 tx=0x7fb18c005e30 comp rx=0 tx=0).stop 2024-06-02T04:49:40.770 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.770+0000 7fb1a702c700 1 -- 172.21.15.76:0/4053319646 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb1a00ffe80 msgr2=0x7fb1a0195d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:40.770 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.770+0000 7fb1a702c700 1 --2- 172.21.15.76:0/4053319646 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb1a00ffe80 0x7fb1a0195d60 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fb19400d950 tx=0x7fb19400dd10 comp rx=0 tx=0).stop 2024-06-02T04:49:40.770 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.770+0000 7fb1a702c700 1 -- 172.21.15.76:0/4053319646 shutdown_connections 2024-06-02T04:49:40.770 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.770+0000 7fb1a702c700 1 --2- 172.21.15.76:0/4053319646 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1a0101990 0x7fb1a019d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:40.770 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.770+0000 7fb1a702c700 1 --2- 172.21.15.76:0/4053319646 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb1a00ffe80 0x7fb1a0195d60 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:40.771 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.770+0000 7fb1a702c700 1 --2- 172.21.15.76:0/4053319646 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fb1900a1120 0x7fb1900a35e0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:40.771 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.770+0000 7fb1a702c700 1 --2- 172.21.15.76:0/4053319646 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1a0100fd0 0x7fb1a01962a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:40.771 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.770+0000 7fb1a702c700 1 -- 172.21.15.76:0/4053319646 >> 172.21.15.76:0/4053319646 conn(0x7fb1a00fb3f0 msgr2=0x7fb1a0104380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:40.771 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.770+0000 7fb1a702c700 1 -- 172.21.15.76:0/4053319646 shutdown_connections 2024-06-02T04:49:40.771 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.770+0000 7fb1a702c700 1 -- 172.21.15.76:0/4053319646 wait complete. 2024-06-02T04:49:40.783 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-06-02T04:49:40.783 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T04:49:40.907 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.904+0000 7fb6a74ef700 1 -- 172.21.15.76:0/29571356 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb6a0104240 msgr2=0x7fb6a0106630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:40.907 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.904+0000 7fb6a74ef700 1 --2- 172.21.15.76:0/29571356 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb6a0104240 0x7fb6a0106630 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fb69c009990 tx=0x7fb69c009ca0 comp rx=0 tx=0).stop 2024-06-02T04:49:40.907 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.904+0000 7fb6a74ef700 1 -- 172.21.15.76:0/29571356 shutdown_connections 2024-06-02T04:49:40.907 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.904+0000 7fb6a74ef700 1 --2- 172.21.15.76:0/29571356 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb6a0106b70 0x7fb6a0108fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:40.907 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.904+0000 7fb6a74ef700 1 --2- 172.21.15.76:0/29571356 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb6a0101910 0x7fb6a0103d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:40.907 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.904+0000 7fb6a74ef700 1 --2- 172.21.15.76:0/29571356 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb6a0104240 0x7fb6a0106630 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:40.908 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.904+0000 7fb6a74ef700 1 -- 172.21.15.76:0/29571356 >> 172.21.15.76:0/29571356 conn(0x7fb6a00fb300 msgr2=0x7fb6a00fd740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:40.908 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.904+0000 7fb6a74ef700 1 -- 172.21.15.76:0/29571356 shutdown_connections 2024-06-02T04:49:40.908 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.904+0000 7fb6a74ef700 1 -- 172.21.15.76:0/29571356 wait complete. 2024-06-02T04:49:40.908 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.905+0000 7fb6a74ef700 1 Processor -- start 2024-06-02T04:49:40.908 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.905+0000 7fb6a74ef700 1 -- start start 2024-06-02T04:49:40.908 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.905+0000 7fb6a74ef700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb6a0101910 0x7fb6a0196cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:40.908 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.905+0000 7fb6a74ef700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb6a0104240 0x7fb6a0197210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:40.908 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.905+0000 7fb6a74ef700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb6a0106b70 0x7fb6a019e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:40.908 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.905+0000 7fb6a74ef700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a019e7c0 con 0x7fb6a0106b70 2024-06-02T04:49:40.908 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.905+0000 7fb6a74ef700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a019e930 con 0x7fb6a0101910 2024-06-02T04:49:40.908 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.905+0000 7fb6a74ef700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a019eaf0 con 0x7fb6a0104240 2024-06-02T04:49:40.908 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.905+0000 7fb6a5a8c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb6a0106b70 0x7fb6a019e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:40.909 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.905+0000 7fb6a5a8c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb6a0106b70 0x7fb6a019e1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:55154/0 (socket says 172.21.15.76:55154) 2024-06-02T04:49:40.909 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.905+0000 7fb6a5a8c700 1 -- 172.21.15.76:0/2529040243 learned_addr learned my addr 172.21.15.76:0/2529040243 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:49:40.909 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.906+0000 7fb6a528b700 1 --2- 172.21.15.76:0/2529040243 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb6a0101910 0x7fb6a0196cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:40.909 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.906+0000 7fb6a4a8a700 1 --2- 172.21.15.76:0/2529040243 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb6a0104240 0x7fb6a0197210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:40.909 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.906+0000 7fb6a5a8c700 1 -- 172.21.15.76:0/2529040243 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb6a0104240 msgr2=0x7fb6a0197210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:40.909 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.906+0000 7fb6a5a8c700 1 --2- 172.21.15.76:0/2529040243 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb6a0104240 0x7fb6a0197210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:40.909 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.906+0000 7fb6a5a8c700 1 -- 172.21.15.76:0/2529040243 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb6a0101910 msgr2=0x7fb6a0196cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:40.909 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.906+0000 7fb6a5a8c700 1 --2- 172.21.15.76:0/2529040243 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb6a0101910 0x7fb6a0196cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:40.909 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.906+0000 7fb6a5a8c700 1 -- 172.21.15.76:0/2529040243 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb69c0095f0 con 0x7fb6a0106b70 2024-06-02T04:49:40.909 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.906+0000 7fb6a4a8a700 1 --2- 172.21.15.76:0/2529040243 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb6a0104240 0x7fb6a0197210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:49:40.909 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.906+0000 7fb6a528b700 1 --2- 172.21.15.76:0/2529040243 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb6a0101910 0x7fb6a0196cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:49:40.909 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.906+0000 7fb6a5a8c700 1 --2- 172.21.15.76:0/2529040243 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb6a0106b70 0x7fb6a019e1f0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fb69800ada0 tx=0x7fb69800c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:40.909 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.906+0000 7fb6967fc700 1 -- 172.21.15.76:0/2529040243 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb69800f070 con 0x7fb6a0106b70 2024-06-02T04:49:40.909 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.906+0000 7fb6967fc700 1 -- 172.21.15.76:0/2529040243 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb698007b30 con 0x7fb6a0106b70 2024-06-02T04:49:40.910 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.906+0000 7fb6a74ef700 1 -- 172.21.15.76:0/2529040243 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6a019edd0 con 0x7fb6a0106b70 2024-06-02T04:49:40.910 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.906+0000 7fb6967fc700 1 -- 172.21.15.76:0/2529040243 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6980053e0 con 0x7fb6a0106b70 2024-06-02T04:49:40.910 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.906+0000 7fb6a74ef700 1 -- 172.21.15.76:0/2529040243 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6a019f1d0 con 0x7fb6a0106b70 2024-06-02T04:49:40.910 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.907+0000 7fb6a74ef700 1 -- 172.21.15.76:0/2529040243 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6a00fce80 con 0x7fb6a0106b70 2024-06-02T04:49:40.910 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.908+0000 7fb6967fc700 1 -- 172.21.15.76:0/2529040243 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fb69800c980 con 0x7fb6a0106b70 2024-06-02T04:49:40.911 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.908+0000 7fb6967fc700 1 --2- 172.21.15.76:0/2529040243 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fb68c0a1120 0x7fb68c0a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:40.911 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.909+0000 7fb6a528b700 1 --2- 172.21.15.76:0/2529040243 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fb68c0a1120 0x7fb68c0a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:40.911 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.909+0000 7fb6967fc700 1 -- 172.21.15.76:0/2529040243 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fb6980cc2b0 con 0x7fb6a0106b70 2024-06-02T04:49:40.911 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.909+0000 7fb6a528b700 1 --2- 172.21.15.76:0/2529040243 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fb68c0a1120 0x7fb68c0a35e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fb690005950 tx=0x7fb6900058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:40.913 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:40.913+0000 7fb6967fc700 1 -- 172.21.15.76:0/2529040243 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fb698095860 con 0x7fb6a0106b70 2024-06-02T04:49:41.157 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.157+0000 7fb6a74ef700 1 -- 172.21.15.76:0/2529040243 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb6a0068060 con 0x7fb6a0106b70 2024-06-02T04:49:41.158 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.158+0000 7fb6967fc700 1 -- 172.21.15.76:0/2529040243 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+10874 (secure 0 0 0) 0x7fb69800cc30 con 0x7fb6a0106b70 2024-06-02T04:49:41.158 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:49:41.158 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6835/3029342152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3029342152},{"type":"v1","addr":"172.21.15.76:6835","nonce":3029342152}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6837/1207985317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":1207985317},{"type":"v1","addr":"172.21.15.76:6837","nonce":1207985317}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14607,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6839/928709755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":928709755},{"type":"v1","addr":"172.21.15.76:6839","nonce":928709755}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6841/4162178633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6840","nonce":4162178633},{"type":"v1","addr":"172.21.15.76:6841","nonce":4162178633}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/1543944863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":1543944863},{"type":"v1","addr":"172.21.15.119:6833","nonce":1543944863}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24418,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6833/1527921393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1527921393},{"type":"v1","addr":"172.21.15.192:6833","nonce":1527921393}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-02T04:48:02.662812+0000","modified":"2024-06-02T04:49:37.267371+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24491,"mds_1":24475,"mds_2":24463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24434":{"gid":24434,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6835/2746840347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":2746840347},{"type":"v1","addr":"172.21.15.119:6835","nonce":2746840347}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24451":{"gid":24451,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.192:6835/783181340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":783181340},{"type":"v1","addr":"172.21.15.192:6835","nonce":783181340}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24458":{"gid":24458,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6837/2171687478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":2171687478},{"type":"v1","addr":"172.21.15.119:6837","nonce":2171687478}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24463":{"gid":24463,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":11,"addr":"172.21.15.192:6837/960773710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":960773710},{"type":"v1","addr":"172.21.15.192:6837","nonce":960773710}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24475":{"gid":24475,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.192:6839/3978681402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":3978681402},{"type":"v1","addr":"172.21.15.192:6839","nonce":3978681402}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.119:6839/4098406903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":4098406903},{"type":"v1","addr":"172.21.15.119:6839","nonce":4098406903}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-06-02T04:49:41.161 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.160+0000 7fb6a74ef700 1 -- 172.21.15.76:0/2529040243 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fb68c0a1120 msgr2=0x7fb68c0a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:41.161 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.160+0000 7fb6a74ef700 1 --2- 172.21.15.76:0/2529040243 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fb68c0a1120 0x7fb68c0a35e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fb690005950 tx=0x7fb6900058e0 comp rx=0 tx=0).stop 2024-06-02T04:49:41.161 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.160+0000 7fb6a74ef700 1 -- 172.21.15.76:0/2529040243 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb6a0106b70 msgr2=0x7fb6a019e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:41.161 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.160+0000 7fb6a74ef700 1 --2- 172.21.15.76:0/2529040243 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb6a0106b70 0x7fb6a019e1f0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fb69800ada0 tx=0x7fb69800c330 comp rx=0 tx=0).stop 2024-06-02T04:49:41.161 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.160+0000 7fb6a74ef700 1 -- 172.21.15.76:0/2529040243 shutdown_connections 2024-06-02T04:49:41.161 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.160+0000 7fb6a74ef700 1 --2- 172.21.15.76:0/2529040243 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb6a0106b70 0x7fb6a019e1f0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:41.161 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.160+0000 7fb6a74ef700 1 --2- 172.21.15.76:0/2529040243 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fb68c0a1120 0x7fb68c0a35e0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:41.161 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.160+0000 7fb6a74ef700 1 --2- 172.21.15.76:0/2529040243 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb6a0101910 0x7fb6a0196cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:41.161 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.160+0000 7fb6a74ef700 1 --2- 172.21.15.76:0/2529040243 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb6a0104240 0x7fb6a0197210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:41.162 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.160+0000 7fb6a74ef700 1 -- 172.21.15.76:0/2529040243 >> 172.21.15.76:0/2529040243 conn(0x7fb6a00fb300 msgr2=0x7fb6a0102270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:41.162 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.160+0000 7fb6a74ef700 1 -- 172.21.15.76:0/2529040243 shutdown_connections 2024-06-02T04:49:41.162 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.160+0000 7fb6a74ef700 1 -- 172.21.15.76:0/2529040243 wait complete. 2024-06-02T04:49:41.162 INFO:teuthology.orchestra.run.smithi076.stderr:dumped fsmap epoch 25 2024-06-02T04:49:41.173 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-06-02T04:49:41.173 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-06-02T04:49:41.173 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-02T04:49:41.299 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.297+0000 7f45655b1700 1 -- 172.21.15.76:0/2220492678 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f45600ffd60 msgr2=0x7f4560100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:41.299 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.297+0000 7f45655b1700 1 --2- 172.21.15.76:0/2220492678 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f45600ffd60 0x7f4560100180 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f45500099c0 tx=0x7f4550009cd0 comp rx=0 tx=0).stop 2024-06-02T04:49:41.299 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.297+0000 7f45655b1700 1 -- 172.21.15.76:0/2220492678 shutdown_connections 2024-06-02T04:49:41.300 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.297+0000 7f45655b1700 1 --2- 172.21.15.76:0/2220492678 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f45601018f0 0x7f45601081a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:41.300 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.297+0000 7f45655b1700 1 --2- 172.21.15.76:0/2220492678 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f45600ffd60 0x7f4560100180 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:41.300 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.297+0000 7f45655b1700 1 --2- 172.21.15.76:0/2220492678 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4560100f50 0x7f45601013b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:41.300 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.297+0000 7f45655b1700 1 -- 172.21.15.76:0/2220492678 >> 172.21.15.76:0/2220492678 conn(0x7f45600fb2f0 msgr2=0x7f45600fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:41.300 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.297+0000 7f45655b1700 1 -- 172.21.15.76:0/2220492678 shutdown_connections 2024-06-02T04:49:41.300 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.297+0000 7f45655b1700 1 -- 172.21.15.76:0/2220492678 wait complete. 2024-06-02T04:49:41.300 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.297+0000 7f45655b1700 1 Processor -- start 2024-06-02T04:49:41.300 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.298+0000 7f45655b1700 1 -- start start 2024-06-02T04:49:41.300 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.298+0000 7f45655b1700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f45600ffd60 0x7f4560103ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:41.300 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.298+0000 7f45655b1700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4560100f50 0x7f4560102330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:41.300 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.298+0000 7f45655b1700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f45601018f0 0x7f4560102870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:41.300 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.298+0000 7f45655b1700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4560103010 con 0x7f45600ffd60 2024-06-02T04:49:41.300 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.298+0000 7f45655b1700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4560103180 con 0x7f45601018f0 2024-06-02T04:49:41.301 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.298+0000 7f45655b1700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45601a0dc0 con 0x7f4560100f50 2024-06-02T04:49:41.301 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.298+0000 7f455effd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f45600ffd60 0x7f4560103ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:41.301 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.298+0000 7f455effd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f45600ffd60 0x7f4560103ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:55176/0 (socket says 172.21.15.76:55176) 2024-06-02T04:49:41.301 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.298+0000 7f455effd700 1 -- 172.21.15.76:0/2544686299 learned_addr learned my addr 172.21.15.76:0/2544686299 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:49:41.301 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.298+0000 7f455e7fc700 1 --2- 172.21.15.76:0/2544686299 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4560100f50 0x7f4560102330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:41.301 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.298+0000 7f455f7fe700 1 --2- 172.21.15.76:0/2544686299 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f45601018f0 0x7f4560102870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:41.301 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.298+0000 7f455effd700 1 -- 172.21.15.76:0/2544686299 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4560100f50 msgr2=0x7f4560102330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:41.301 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.298+0000 7f455effd700 1 --2- 172.21.15.76:0/2544686299 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4560100f50 0x7f4560102330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:41.301 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.298+0000 7f455effd700 1 -- 172.21.15.76:0/2544686299 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f45601018f0 msgr2=0x7f4560102870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:41.301 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.298+0000 7f455effd700 1 --2- 172.21.15.76:0/2544686299 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f45601018f0 0x7f4560102870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:41.301 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.298+0000 7f455effd700 1 -- 172.21.15.76:0/2544686299 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45500095f0 con 0x7f45600ffd60 2024-06-02T04:49:41.301 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.298+0000 7f455effd700 1 --2- 172.21.15.76:0/2544686299 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f45600ffd60 0x7f4560103ca0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f4550009f50 tx=0x7f4550005b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:41.302 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.299+0000 7f4557fff700 1 -- 172.21.15.76:0/2544686299 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f455001d070 con 0x7f45600ffd60 2024-06-02T04:49:41.302 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.299+0000 7f4557fff700 1 -- 172.21.15.76:0/2544686299 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f455000bda0 con 0x7f45600ffd60 2024-06-02T04:49:41.302 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.299+0000 7f45655b1700 1 -- 172.21.15.76:0/2544686299 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45601a0ff0 con 0x7f45600ffd60 2024-06-02T04:49:41.302 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.299+0000 7f4557fff700 1 -- 172.21.15.76:0/2544686299 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4550022c70 con 0x7f45600ffd60 2024-06-02T04:49:41.302 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.299+0000 7f45655b1700 1 -- 172.21.15.76:0/2544686299 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45601a1360 con 0x7f45600ffd60 2024-06-02T04:49:41.303 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.300+0000 7f45655b1700 1 -- 172.21.15.76:0/2544686299 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4560067c10 con 0x7f45600ffd60 2024-06-02T04:49:41.303 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.301+0000 7f4557fff700 1 -- 172.21.15.76:0/2544686299 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f4550022470 con 0x7f45600ffd60 2024-06-02T04:49:41.303 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.301+0000 7f4557fff700 1 --2- 172.21.15.76:0/2544686299 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f454c0a1120 0x7f454c0a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:41.303 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.301+0000 7f455e7fc700 1 --2- 172.21.15.76:0/2544686299 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f454c0a1120 0x7f454c0a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:41.303 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.301+0000 7f4557fff700 1 -- 172.21.15.76:0/2544686299 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f45500ce350 con 0x7f45600ffd60 2024-06-02T04:49:41.303 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.302+0000 7f455e7fc700 1 --2- 172.21.15.76:0/2544686299 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f454c0a1120 0x7f454c0a35e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f4548005950 tx=0x7f454800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:41.305 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.305+0000 7f4557fff700 1 -- 172.21.15.76:0/2544686299 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f4550097800 con 0x7f45600ffd60 2024-06-02T04:49:41.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:41 smithi076 ceph-mon[42935]: pgmap v269: 129 pgs: 129 active+clean; 645 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2024-06-02T04:49:41.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:41 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/1690317335' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-06-02T04:49:41.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:41 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/4053319646' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-06-02T04:49:41.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:41 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/2529040243' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:49:41.498 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.498+0000 7f45655b1700 1 -- 172.21.15.76:0/2544686299 --> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4560068770 con 0x7f454c0a1120 2024-06-02T04:49:41.510 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.510+0000 7f4557fff700 1 -- 172.21.15.76:0/2544686299 <== mgr.14152 v2:172.21.15.76:6800/2591353090 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+427459 (secure 0 0 0) 0x7f4560068770 con 0x7f454c0a1120 2024-06-02T04:49:41.517 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:49:41.520 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.514+0000 7f45655b1700 1 -- 172.21.15.76:0/2544686299 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f454c0a1120 msgr2=0x7f454c0a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:41.520 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.514+0000 7f45655b1700 1 --2- 172.21.15.76:0/2544686299 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f454c0a1120 0x7f454c0a35e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f4548005950 tx=0x7f454800b410 comp rx=0 tx=0).stop 2024-06-02T04:49:41.520 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.514+0000 7f45655b1700 1 -- 172.21.15.76:0/2544686299 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f45600ffd60 msgr2=0x7f4560103ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:41.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.514+0000 7f45655b1700 1 --2- 172.21.15.76:0/2544686299 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f45600ffd60 0x7f4560103ca0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f4550009f50 tx=0x7f4550005b00 comp rx=0 tx=0).stop 2024-06-02T04:49:41.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.514+0000 7f45655b1700 1 -- 172.21.15.76:0/2544686299 shutdown_connections 2024-06-02T04:49:41.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.514+0000 7f45655b1700 1 --2- 172.21.15.76:0/2544686299 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f454c0a1120 0x7f454c0a35e0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:41.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.514+0000 7f45655b1700 1 --2- 172.21.15.76:0/2544686299 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f45601018f0 0x7f4560102870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:41.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.514+0000 7f45655b1700 1 --2- 172.21.15.76:0/2544686299 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f45600ffd60 0x7f4560103ca0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:41.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.514+0000 7f45655b1700 1 --2- 172.21.15.76:0/2544686299 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4560100f50 0x7f4560102330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:41.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.514+0000 7f45655b1700 1 -- 172.21.15.76:0/2544686299 >> 172.21.15.76:0/2544686299 conn(0x7f45600fb2f0 msgr2=0x7f4560068060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:41.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.514+0000 7f45655b1700 1 -- 172.21.15.76:0/2544686299 shutdown_connections 2024-06-02T04:49:41.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.514+0000 7f45655b1700 1 -- 172.21.15.76:0/2544686299 wait complete. 2024-06-02T04:49:41.521 INFO:teuthology.orchestra.run.smithi076.stderr:dumped all 2024-06-02T04:49:41.527 INFO:teuthology.orchestra.run.smithi076.stdout:{"pg_ready":true,"pg_map":{"version":269,"stamp":"2024-06-02T04:49:40.176092+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":660017,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":576,"num_read_kb":411,"num_write":346,"num_write_kb":3064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":1180736,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":767,"ondisk_log_size":767,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":372180,"kb_used_data":11100,"kb_used_omap":18,"kb_used_meta":360941,"kb_avail":1124569644,"statfs":{"total":1151940427776,"available":1151559315456,"internally_reserved":0,"allocated":11366400,"data_stored":7480222,"data_compressed":317847,"data_compressed_allocated":430080,"data_compressed_original":2359296,"omap_allocated":19131,"internal_metadata":369603909},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5664,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":52,"num_write":9,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003885"},"pg_stats":[{"pgid":"3.3f","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.217391+0000","last_change":"2024-06-02T04:48:02.689765+0000","last_active":"2024-06-02T04:49:36.217391+0000","last_peered":"2024-06-02T04:49:36.217391+0000","last_clean":"2024-06-02T04:49:36.217391+0000","last_became_active":"2024-06-02T04:48:02.689464+0000","last_became_peered":"2024-06-02T04:48:02.689464+0000","last_unstale":"2024-06-02T04:49:36.217391+0000","last_undegraded":"2024-06-02T04:49:36.217391+0000","last_fullsized":"2024-06-02T04:49:36.217391+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:13:19.743519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"82'4","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.201250+0000","last_change":"2024-06-02T04:48:02.691499+0000","last_active":"2024-06-02T04:49:36.201250+0000","last_peered":"2024-06-02T04:49:36.201250+0000","last_clean":"2024-06-02T04:49:36.201250+0000","last_became_active":"2024-06-02T04:48:02.691179+0000","last_became_peered":"2024-06-02T04:48:02.691179+0000","last_unstale":"2024-06-02T04:49:36.201250+0000","last_undegraded":"2024-06-02T04:49:36.201250+0000","last_fullsized":"2024-06-02T04:49:36.201250+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T14:00:17.118877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.212494+0000","last_change":"2024-06-02T04:48:02.688527+0000","last_active":"2024-06-02T04:49:36.212494+0000","last_peered":"2024-06-02T04:49:36.212494+0000","last_clean":"2024-06-02T04:49:36.212494+0000","last_became_active":"2024-06-02T04:48:02.688184+0000","last_became_peered":"2024-06-02T04:48:02.688184+0000","last_unstale":"2024-06-02T04:49:36.212494+0000","last_undegraded":"2024-06-02T04:49:36.212494+0000","last_fullsized":"2024-06-02T04:49:36.212494+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T08:40:35.052887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.870618+0000","last_change":"2024-06-02T04:48:02.695277+0000","last_active":"2024-06-02T04:49:06.870618+0000","last_peered":"2024-06-02T04:49:06.870618+0000","last_clean":"2024-06-02T04:49:06.870618+0000","last_became_active":"2024-06-02T04:48:02.694951+0000","last_became_peered":"2024-06-02T04:48:02.694951+0000","last_unstale":"2024-06-02T04:49:06.870618+0000","last_undegraded":"2024-06-02T04:49:06.870618+0000","last_fullsized":"2024-06-02T04:49:06.870618+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T14:13:50.672421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"82'4","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.211340+0000","last_change":"2024-06-02T04:48:02.691454+0000","last_active":"2024-06-02T04:49:36.211340+0000","last_peered":"2024-06-02T04:49:36.211340+0000","last_clean":"2024-06-02T04:49:36.211340+0000","last_became_active":"2024-06-02T04:48:02.691083+0000","last_became_peered":"2024-06-02T04:48:02.691083+0000","last_unstale":"2024-06-02T04:49:36.211340+0000","last_undegraded":"2024-06-02T04:49:36.211340+0000","last_fullsized":"2024-06-02T04:49:36.211340+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T07:12:58.481115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.205381+0000","last_change":"2024-06-02T04:48:02.690371+0000","last_active":"2024-06-02T04:49:36.205381+0000","last_peered":"2024-06-02T04:49:36.205381+0000","last_clean":"2024-06-02T04:49:36.205381+0000","last_became_active":"2024-06-02T04:48:02.682047+0000","last_became_peered":"2024-06-02T04:48:02.682047+0000","last_unstale":"2024-06-02T04:49:36.205381+0000","last_undegraded":"2024-06-02T04:49:36.205381+0000","last_fullsized":"2024-06-02T04:49:36.205381+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:17:59.717575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.200626+0000","last_change":"2024-06-02T04:48:02.697823+0000","last_active":"2024-06-02T04:49:36.200626+0000","last_peered":"2024-06-02T04:49:36.200626+0000","last_clean":"2024-06-02T04:49:36.200626+0000","last_became_active":"2024-06-02T04:48:02.697491+0000","last_became_peered":"2024-06-02T04:48:02.697491+0000","last_unstale":"2024-06-02T04:49:36.200626+0000","last_undegraded":"2024-06-02T04:49:36.200626+0000","last_fullsized":"2024-06-02T04:49:36.200626+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T16:08:39.689192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.204224+0000","last_change":"2024-06-02T04:48:02.702564+0000","last_active":"2024-06-02T04:49:36.204224+0000","last_peered":"2024-06-02T04:49:36.204224+0000","last_clean":"2024-06-02T04:49:36.204224+0000","last_became_active":"2024-06-02T04:48:02.702259+0000","last_became_peered":"2024-06-02T04:48:02.702259+0000","last_unstale":"2024-06-02T04:49:36.204224+0000","last_undegraded":"2024-06-02T04:49:36.204224+0000","last_fullsized":"2024-06-02T04:49:36.204224+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T12:33:28.945414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"82'11","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.216962+0000","last_change":"2024-06-02T04:48:02.694090+0000","last_active":"2024-06-02T04:49:36.216962+0000","last_peered":"2024-06-02T04:49:36.216962+0000","last_clean":"2024-06-02T04:49:36.216962+0000","last_became_active":"2024-06-02T04:48:02.693723+0000","last_became_peered":"2024-06-02T04:48:02.693723+0000","last_unstale":"2024-06-02T04:49:36.216962+0000","last_undegraded":"2024-06-02T04:49:36.216962+0000","last_fullsized":"2024-06-02T04:49:36.216962+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:33:26.628450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"82'16","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.217661+0000","last_change":"2024-06-02T04:48:02.702201+0000","last_active":"2024-06-02T04:49:36.217661+0000","last_peered":"2024-06-02T04:49:36.217661+0000","last_clean":"2024-06-02T04:49:36.217661+0000","last_became_active":"2024-06-02T04:48:02.701834+0000","last_became_peered":"2024-06-02T04:48:02.701834+0000","last_unstale":"2024-06-02T04:49:36.217661+0000","last_undegraded":"2024-06-02T04:49:36.217661+0000","last_fullsized":"2024-06-02T04:49:36.217661+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T08:22:24.009015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.205694+0000","last_change":"2024-06-02T04:48:02.700280+0000","last_active":"2024-06-02T04:49:36.205694+0000","last_peered":"2024-06-02T04:49:36.205694+0000","last_clean":"2024-06-02T04:49:36.205694+0000","last_became_active":"2024-06-02T04:48:02.699852+0000","last_became_peered":"2024-06-02T04:48:02.699852+0000","last_unstale":"2024-06-02T04:49:36.205694+0000","last_undegraded":"2024-06-02T04:49:36.205694+0000","last_fullsized":"2024-06-02T04:49:36.205694+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T16:45:28.228692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.870539+0000","last_change":"2024-06-02T04:48:02.689951+0000","last_active":"2024-06-02T04:49:06.870539+0000","last_peered":"2024-06-02T04:49:06.870539+0000","last_clean":"2024-06-02T04:49:06.870539+0000","last_became_active":"2024-06-02T04:48:02.689249+0000","last_became_peered":"2024-06-02T04:48:02.689249+0000","last_unstale":"2024-06-02T04:49:06.870539+0000","last_undegraded":"2024-06-02T04:49:06.870539+0000","last_fullsized":"2024-06-02T04:49:06.870539+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:09:43.620165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"82'10","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.212047+0000","last_change":"2024-06-02T04:48:02.691126+0000","last_active":"2024-06-02T04:49:36.212047+0000","last_peered":"2024-06-02T04:49:36.212047+0000","last_clean":"2024-06-02T04:49:36.212047+0000","last_became_active":"2024-06-02T04:48:02.690825+0000","last_became_peered":"2024-06-02T04:48:02.690825+0000","last_unstale":"2024-06-02T04:49:36.212047+0000","last_undegraded":"2024-06-02T04:49:36.212047+0000","last_fullsized":"2024-06-02T04:49:36.212047+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:03:36.461555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.206718+0000","last_change":"2024-06-02T04:48:02.692802+0000","last_active":"2024-06-02T04:49:36.206718+0000","last_peered":"2024-06-02T04:49:36.206718+0000","last_clean":"2024-06-02T04:49:36.206718+0000","last_became_active":"2024-06-02T04:48:02.692495+0000","last_became_peered":"2024-06-02T04:48:02.692495+0000","last_unstale":"2024-06-02T04:49:36.206718+0000","last_undegraded":"2024-06-02T04:49:36.206718+0000","last_fullsized":"2024-06-02T04:49:36.206718+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T14:57:10.991752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.207575+0000","last_change":"2024-06-02T04:48:02.702968+0000","last_active":"2024-06-02T04:49:36.207575+0000","last_peered":"2024-06-02T04:49:36.207575+0000","last_clean":"2024-06-02T04:49:36.207575+0000","last_became_active":"2024-06-02T04:48:02.702672+0000","last_became_peered":"2024-06-02T04:48:02.702672+0000","last_unstale":"2024-06-02T04:49:36.207575+0000","last_undegraded":"2024-06-02T04:49:36.207575+0000","last_fullsized":"2024-06-02T04:49:36.207575+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:04:38.385228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.213438+0000","last_change":"2024-06-02T04:48:02.701329+0000","last_active":"2024-06-02T04:49:36.213438+0000","last_peered":"2024-06-02T04:49:36.213438+0000","last_clean":"2024-06-02T04:49:36.213438+0000","last_became_active":"2024-06-02T04:48:02.701064+0000","last_became_peered":"2024-06-02T04:48:02.701064+0000","last_unstale":"2024-06-02T04:49:36.213438+0000","last_undegraded":"2024-06-02T04:49:36.213438+0000","last_fullsized":"2024-06-02T04:49:36.213438+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:28:06.265050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.218866+0000","last_change":"2024-06-02T04:48:02.688538+0000","last_active":"2024-06-02T04:49:36.218866+0000","last_peered":"2024-06-02T04:49:36.218866+0000","last_clean":"2024-06-02T04:49:36.218866+0000","last_became_active":"2024-06-02T04:48:02.688175+0000","last_became_peered":"2024-06-02T04:48:02.688175+0000","last_unstale":"2024-06-02T04:49:36.218866+0000","last_undegraded":"2024-06-02T04:49:36.218866+0000","last_fullsized":"2024-06-02T04:49:36.218866+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T07:30:47.310924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"82'10","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.201771+0000","last_change":"2024-06-02T04:48:02.688515+0000","last_active":"2024-06-02T04:49:36.201771+0000","last_peered":"2024-06-02T04:49:36.201771+0000","last_clean":"2024-06-02T04:49:36.201771+0000","last_became_active":"2024-06-02T04:48:02.688205+0000","last_became_peered":"2024-06-02T04:48:02.688205+0000","last_unstale":"2024-06-02T04:49:36.201771+0000","last_undegraded":"2024-06-02T04:49:36.201771+0000","last_fullsized":"2024-06-02T04:49:36.201771+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:20:05.829628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.200775+0000","last_change":"2024-06-02T04:48:02.688376+0000","last_active":"2024-06-02T04:49:36.200775+0000","last_peered":"2024-06-02T04:49:36.200775+0000","last_clean":"2024-06-02T04:49:36.200775+0000","last_became_active":"2024-06-02T04:48:02.688055+0000","last_became_peered":"2024-06-02T04:48:02.688055+0000","last_unstale":"2024-06-02T04:49:36.200775+0000","last_undegraded":"2024-06-02T04:49:36.200775+0000","last_fullsized":"2024-06-02T04:49:36.200775+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:55:41.327635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.866856+0000","last_change":"2024-06-02T04:48:06.713517+0000","last_active":"2024-06-02T04:49:06.866856+0000","last_peered":"2024-06-02T04:49:06.866856+0000","last_clean":"2024-06-02T04:49:06.866856+0000","last_became_active":"2024-06-02T04:48:06.713187+0000","last_became_peered":"2024-06-02T04:48:06.713187+0000","last_unstale":"2024-06-02T04:49:06.866856+0000","last_undegraded":"2024-06-02T04:49:06.866856+0000","last_fullsized":"2024-06-02T04:49:06.866856+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:11:46.598023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"80'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.871616+0000","last_change":"2024-06-02T04:48:02.271595+0000","last_active":"2024-06-02T04:49:06.871616+0000","last_peered":"2024-06-02T04:49:06.871616+0000","last_clean":"2024-06-02T04:49:06.871616+0000","last_became_active":"2024-06-02T04:48:02.271326+0000","last_became_peered":"2024-06-02T04:48:02.271326+0000","last_unstale":"2024-06-02T04:49:06.871616+0000","last_undegraded":"2024-06-02T04:49:06.871616+0000","last_fullsized":"2024-06-02T04:49:06.871616+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:23:31.096224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.202931+0000","last_change":"2024-06-02T04:48:02.696542+0000","last_active":"2024-06-02T04:49:36.202931+0000","last_peered":"2024-06-02T04:49:36.202931+0000","last_clean":"2024-06-02T04:49:36.202931+0000","last_became_active":"2024-06-02T04:48:02.696260+0000","last_became_peered":"2024-06-02T04:48:02.696260+0000","last_unstale":"2024-06-02T04:49:36.202931+0000","last_undegraded":"2024-06-02T04:49:36.202931+0000","last_fullsized":"2024-06-02T04:49:36.202931+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T06:28:04.097035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.867997+0000","last_change":"2024-06-02T04:48:06.713685+0000","last_active":"2024-06-02T04:49:06.867997+0000","last_peered":"2024-06-02T04:49:06.867997+0000","last_clean":"2024-06-02T04:49:06.867997+0000","last_became_active":"2024-06-02T04:48:06.713254+0000","last_became_peered":"2024-06-02T04:48:06.713254+0000","last_unstale":"2024-06-02T04:49:06.867997+0000","last_undegraded":"2024-06-02T04:49:06.867997+0000","last_fullsized":"2024-06-02T04:49:06.867997+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:12:48.304229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.873436+0000","last_change":"2024-06-02T04:48:02.268361+0000","last_active":"2024-06-02T04:49:06.873436+0000","last_peered":"2024-06-02T04:49:06.873436+0000","last_clean":"2024-06-02T04:49:06.873436+0000","last_became_active":"2024-06-02T04:48:02.268053+0000","last_became_peered":"2024-06-02T04:48:02.268053+0000","last_unstale":"2024-06-02T04:49:06.873436+0000","last_undegraded":"2024-06-02T04:49:06.873436+0000","last_fullsized":"2024-06-02T04:49:06.873436+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T16:04:13.955351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.212183+0000","last_change":"2024-06-02T04:48:02.686322+0000","last_active":"2024-06-02T04:49:36.212183+0000","last_peered":"2024-06-02T04:49:36.212183+0000","last_clean":"2024-06-02T04:49:36.212183+0000","last_became_active":"2024-06-02T04:48:02.685978+0000","last_became_peered":"2024-06-02T04:48:02.685978+0000","last_unstale":"2024-06-02T04:49:36.212183+0000","last_undegraded":"2024-06-02T04:49:36.212183+0000","last_fullsized":"2024-06-02T04:49:36.212183+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T12:12:19.157330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:07.893261+0000","last_change":"2024-06-02T04:49:07.893261+0000","last_active":"2024-06-02T04:49:07.893261+0000","last_peered":"2024-06-02T04:49:07.893261+0000","last_clean":"2024-06-02T04:49:07.893261+0000","last_became_active":"2024-06-02T04:49:07.892835+0000","last_became_peered":"2024-06-02T04:49:07.892835+0000","last_unstale":"2024-06-02T04:49:07.893261+0000","last_undegraded":"2024-06-02T04:49:07.893261+0000","last_fullsized":"2024-06-02T04:49:07.893261+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T06:52:12.541009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,8,5],"acting":[4,3,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"80'4","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:07.883791+0000","last_change":"2024-06-02T04:49:07.883791+0000","last_active":"2024-06-02T04:49:07.883791+0000","last_peered":"2024-06-02T04:49:07.883791+0000","last_clean":"2024-06-02T04:49:07.883791+0000","last_became_active":"2024-06-02T04:49:07.877259+0000","last_became_peered":"2024-06-02T04:49:07.877259+0000","last_unstale":"2024-06-02T04:49:07.883791+0000","last_undegraded":"2024-06-02T04:49:07.883791+0000","last_fullsized":"2024-06-02T04:49:07.883791+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T12:06:25.663857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.216264+0000","last_change":"2024-06-02T04:48:02.699659+0000","last_active":"2024-06-02T04:49:36.216264+0000","last_peered":"2024-06-02T04:49:36.216264+0000","last_clean":"2024-06-02T04:49:36.216264+0000","last_became_active":"2024-06-02T04:48:02.699321+0000","last_became_peered":"2024-06-02T04:48:02.699321+0000","last_unstale":"2024-06-02T04:49:36.216264+0000","last_undegraded":"2024-06-02T04:49:36.216264+0000","last_fullsized":"2024-06-02T04:49:36.216264+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:33:35.088215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.868049+0000","last_change":"2024-06-02T04:48:06.712031+0000","last_active":"2024-06-02T04:49:06.868049+0000","last_peered":"2024-06-02T04:49:06.868049+0000","last_clean":"2024-06-02T04:49:06.868049+0000","last_became_active":"2024-06-02T04:48:06.711637+0000","last_became_peered":"2024-06-02T04:48:06.711637+0000","last_unstale":"2024-06-02T04:49:06.868049+0000","last_undegraded":"2024-06-02T04:49:06.868049+0000","last_fullsized":"2024-06-02T04:49:06.868049+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T06:10:05.281793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"75'2","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.870616+0000","last_change":"2024-06-02T04:48:02.268698+0000","last_active":"2024-06-02T04:49:06.870616+0000","last_peered":"2024-06-02T04:49:06.870616+0000","last_clean":"2024-06-02T04:49:06.870616+0000","last_became_active":"2024-06-02T04:48:02.268286+0000","last_became_peered":"2024-06-02T04:48:02.268286+0000","last_unstale":"2024-06-02T04:49:06.870616+0000","last_undegraded":"2024-06-02T04:49:06.870616+0000","last_fullsized":"2024-06-02T04:49:06.870616+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T10:37:42.354104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"82'15","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.214177+0000","last_change":"2024-06-02T04:48:02.702280+0000","last_active":"2024-06-02T04:49:36.214177+0000","last_peered":"2024-06-02T04:49:36.214177+0000","last_clean":"2024-06-02T04:49:36.214177+0000","last_became_active":"2024-06-02T04:48:02.701830+0000","last_became_peered":"2024-06-02T04:48:02.701830+0000","last_unstale":"2024-06-02T04:49:36.214177+0000","last_undegraded":"2024-06-02T04:49:36.214177+0000","last_fullsized":"2024-06-02T04:49:36.214177+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T06:44:06.324024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.866642+0000","last_change":"2024-06-02T04:48:06.708484+0000","last_active":"2024-06-02T04:49:06.866642+0000","last_peered":"2024-06-02T04:49:06.866642+0000","last_clean":"2024-06-02T04:49:06.866642+0000","last_became_active":"2024-06-02T04:48:06.708048+0000","last_became_peered":"2024-06-02T04:48:06.708048+0000","last_unstale":"2024-06-02T04:49:06.866642+0000","last_undegraded":"2024-06-02T04:49:06.866642+0000","last_fullsized":"2024-06-02T04:49:06.866642+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:30:42.361362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"82'8","reported_seq":99,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.376851+0000","last_change":"2024-06-02T04:48:02.274961+0000","last_active":"2024-06-02T04:49:36.376851+0000","last_peered":"2024-06-02T04:49:36.376851+0000","last_clean":"2024-06-02T04:49:36.376851+0000","last_became_active":"2024-06-02T04:48:02.274617+0000","last_became_peered":"2024-06-02T04:48:02.274617+0000","last_unstale":"2024-06-02T04:49:36.376851+0000","last_undegraded":"2024-06-02T04:49:36.376851+0000","last_fullsized":"2024-06-02T04:49:36.376851+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T16:47:17.136996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":73,"num_read_kb":4,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.206987+0000","last_change":"2024-06-02T04:48:02.684722+0000","last_active":"2024-06-02T04:49:36.206987+0000","last_peered":"2024-06-02T04:49:36.206987+0000","last_clean":"2024-06-02T04:49:36.206987+0000","last_became_active":"2024-06-02T04:48:02.684354+0000","last_became_peered":"2024-06-02T04:48:02.684354+0000","last_unstale":"2024-06-02T04:49:36.206987+0000","last_undegraded":"2024-06-02T04:49:36.206987+0000","last_fullsized":"2024-06-02T04:49:36.206987+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T07:46:54.136882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.866495+0000","last_change":"2024-06-02T04:48:06.713498+0000","last_active":"2024-06-02T04:49:06.866495+0000","last_peered":"2024-06-02T04:49:06.866495+0000","last_clean":"2024-06-02T04:49:06.866495+0000","last_became_active":"2024-06-02T04:48:06.712949+0000","last_became_peered":"2024-06-02T04:48:06.712949+0000","last_unstale":"2024-06-02T04:49:06.866495+0000","last_undegraded":"2024-06-02T04:49:06.866495+0000","last_fullsized":"2024-06-02T04:49:06.866495+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:37:31.586703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"80'3","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.869522+0000","last_change":"2024-06-02T04:48:02.266358+0000","last_active":"2024-06-02T04:49:06.869522+0000","last_peered":"2024-06-02T04:49:06.869522+0000","last_clean":"2024-06-02T04:49:06.869522+0000","last_became_active":"2024-06-02T04:48:02.266008+0000","last_became_peered":"2024-06-02T04:48:02.266008+0000","last_unstale":"2024-06-02T04:49:06.869522+0000","last_undegraded":"2024-06-02T04:49:06.869522+0000","last_fullsized":"2024-06-02T04:49:06.869522+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:07:13.104170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.211013+0000","last_change":"2024-06-02T04:48:02.702234+0000","last_active":"2024-06-02T04:49:36.211013+0000","last_peered":"2024-06-02T04:49:36.211013+0000","last_clean":"2024-06-02T04:49:36.211013+0000","last_became_active":"2024-06-02T04:48:02.701927+0000","last_became_peered":"2024-06-02T04:48:02.701927+0000","last_unstale":"2024-06-02T04:49:36.211013+0000","last_undegraded":"2024-06-02T04:49:36.211013+0000","last_fullsized":"2024-06-02T04:49:36.211013+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:55:55.940957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.868152+0000","last_change":"2024-06-02T04:48:06.713257+0000","last_active":"2024-06-02T04:49:06.868152+0000","last_peered":"2024-06-02T04:49:06.868152+0000","last_clean":"2024-06-02T04:49:06.868152+0000","last_became_active":"2024-06-02T04:48:06.712862+0000","last_became_peered":"2024-06-02T04:48:06.712862+0000","last_unstale":"2024-06-02T04:49:06.868152+0000","last_undegraded":"2024-06-02T04:49:06.868152+0000","last_fullsized":"2024-06-02T04:49:06.868152+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T06:23:35.115824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"80'2","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.864687+0000","last_change":"2024-06-02T04:48:02.258838+0000","last_active":"2024-06-02T04:49:06.864687+0000","last_peered":"2024-06-02T04:49:06.864687+0000","last_clean":"2024-06-02T04:49:06.864687+0000","last_became_active":"2024-06-02T04:48:02.258516+0000","last_became_peered":"2024-06-02T04:48:02.258516+0000","last_unstale":"2024-06-02T04:49:06.864687+0000","last_undegraded":"2024-06-02T04:49:06.864687+0000","last_fullsized":"2024-06-02T04:49:06.864687+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:32:04.161724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.207684+0000","last_change":"2024-06-02T04:48:02.690043+0000","last_active":"2024-06-02T04:49:36.207684+0000","last_peered":"2024-06-02T04:49:36.207684+0000","last_clean":"2024-06-02T04:49:36.207684+0000","last_became_active":"2024-06-02T04:48:02.689748+0000","last_became_peered":"2024-06-02T04:48:02.689748+0000","last_unstale":"2024-06-02T04:49:36.207684+0000","last_undegraded":"2024-06-02T04:49:36.207684+0000","last_fullsized":"2024-06-02T04:49:36.207684+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:50:23.694653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.870025+0000","last_change":"2024-06-02T04:48:06.704093+0000","last_active":"2024-06-02T04:49:06.870025+0000","last_peered":"2024-06-02T04:49:06.870025+0000","last_clean":"2024-06-02T04:49:06.870025+0000","last_became_active":"2024-06-02T04:48:06.703732+0000","last_became_peered":"2024-06-02T04:48:06.703732+0000","last_unstale":"2024-06-02T04:49:06.870025+0000","last_undegraded":"2024-06-02T04:49:06.870025+0000","last_fullsized":"2024-06-02T04:49:06.870025+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:50:10.434364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"80'1","reported_seq":19,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.872182+0000","last_change":"2024-06-02T04:48:02.274753+0000","last_active":"2024-06-02T04:49:06.872182+0000","last_peered":"2024-06-02T04:49:06.872182+0000","last_clean":"2024-06-02T04:49:06.872182+0000","last_became_active":"2024-06-02T04:48:02.274390+0000","last_became_peered":"2024-06-02T04:48:02.274390+0000","last_unstale":"2024-06-02T04:49:06.872182+0000","last_undegraded":"2024-06-02T04:49:06.872182+0000","last_fullsized":"2024-06-02T04:49:06.872182+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:42:38.790750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"82'11","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.198701+0000","last_change":"2024-06-02T04:48:02.684832+0000","last_active":"2024-06-02T04:49:36.198701+0000","last_peered":"2024-06-02T04:49:36.198701+0000","last_clean":"2024-06-02T04:49:36.198701+0000","last_became_active":"2024-06-02T04:48:02.684520+0000","last_became_peered":"2024-06-02T04:48:02.684520+0000","last_unstale":"2024-06-02T04:49:36.198701+0000","last_undegraded":"2024-06-02T04:49:36.198701+0000","last_fullsized":"2024-06-02T04:49:36.198701+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:08:33.038975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.873171+0000","last_change":"2024-06-02T04:48:06.704725+0000","last_active":"2024-06-02T04:49:06.873171+0000","last_peered":"2024-06-02T04:49:06.873171+0000","last_clean":"2024-06-02T04:49:06.873171+0000","last_became_active":"2024-06-02T04:48:06.704284+0000","last_became_peered":"2024-06-02T04:48:06.704284+0000","last_unstale":"2024-06-02T04:49:06.873171+0000","last_undegraded":"2024-06-02T04:49:06.873171+0000","last_fullsized":"2024-06-02T04:49:06.873171+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:56:04.558505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"82'4","reported_seq":93,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:37.378534+0000","last_change":"2024-06-02T04:48:02.267048+0000","last_active":"2024-06-02T04:49:37.378534+0000","last_peered":"2024-06-02T04:49:37.378534+0000","last_clean":"2024-06-02T04:49:37.378534+0000","last_became_active":"2024-06-02T04:48:02.266707+0000","last_became_peered":"2024-06-02T04:48:02.266707+0000","last_unstale":"2024-06-02T04:49:37.378534+0000","last_undegraded":"2024-06-02T04:49:37.378534+0000","last_fullsized":"2024-06-02T04:49:37.378534+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:36:25.633728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":71,"num_read_kb":71,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"82'10","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.214446+0000","last_change":"2024-06-02T04:48:02.700485+0000","last_active":"2024-06-02T04:49:36.214446+0000","last_peered":"2024-06-02T04:49:36.214446+0000","last_clean":"2024-06-02T04:49:36.214446+0000","last_became_active":"2024-06-02T04:48:02.700228+0000","last_became_peered":"2024-06-02T04:48:02.700228+0000","last_unstale":"2024-06-02T04:49:36.214446+0000","last_undegraded":"2024-06-02T04:49:36.214446+0000","last_fullsized":"2024-06-02T04:49:36.214446+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T06:39:18.244476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.869511+0000","last_change":"2024-06-02T04:48:06.716821+0000","last_active":"2024-06-02T04:49:06.869511+0000","last_peered":"2024-06-02T04:49:06.869511+0000","last_clean":"2024-06-02T04:49:06.869511+0000","last_became_active":"2024-06-02T04:48:06.716432+0000","last_became_peered":"2024-06-02T04:48:06.716432+0000","last_unstale":"2024-06-02T04:49:06.869511+0000","last_undegraded":"2024-06-02T04:49:06.869511+0000","last_fullsized":"2024-06-02T04:49:06.869511+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T12:06:50.164797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"80'2","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.872989+0000","last_change":"2024-06-02T04:48:02.272377+0000","last_active":"2024-06-02T04:49:06.872989+0000","last_peered":"2024-06-02T04:49:06.872989+0000","last_clean":"2024-06-02T04:49:06.872989+0000","last_became_active":"2024-06-02T04:48:02.272017+0000","last_became_peered":"2024-06-02T04:48:02.272017+0000","last_unstale":"2024-06-02T04:49:06.872989+0000","last_undegraded":"2024-06-02T04:49:06.872989+0000","last_fullsized":"2024-06-02T04:49:06.872989+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T10:24:14.945609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.208529+0000","last_change":"2024-06-02T04:48:02.687056+0000","last_active":"2024-06-02T04:49:36.208529+0000","last_peered":"2024-06-02T04:49:36.208529+0000","last_clean":"2024-06-02T04:49:36.208529+0000","last_became_active":"2024-06-02T04:48:02.686729+0000","last_became_peered":"2024-06-02T04:48:02.686729+0000","last_unstale":"2024-06-02T04:49:36.208529+0000","last_undegraded":"2024-06-02T04:49:36.208529+0000","last_fullsized":"2024-06-02T04:49:36.208529+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:54:44.636489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.868621+0000","last_change":"2024-06-02T04:48:06.713816+0000","last_active":"2024-06-02T04:49:06.868621+0000","last_peered":"2024-06-02T04:49:06.868621+0000","last_clean":"2024-06-02T04:49:06.868621+0000","last_became_active":"2024-06-02T04:48:06.713372+0000","last_became_peered":"2024-06-02T04:48:06.713372+0000","last_unstale":"2024-06-02T04:49:06.868621+0000","last_undegraded":"2024-06-02T04:49:06.868621+0000","last_fullsized":"2024-06-02T04:49:06.868621+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T10:12:46.455263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"80'4","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.872949+0000","last_change":"2024-06-02T04:48:02.274971+0000","last_active":"2024-06-02T04:49:06.872949+0000","last_peered":"2024-06-02T04:49:06.872949+0000","last_clean":"2024-06-02T04:49:06.872949+0000","last_became_active":"2024-06-02T04:48:02.274137+0000","last_became_peered":"2024-06-02T04:48:02.274137+0000","last_unstale":"2024-06-02T04:49:06.872949+0000","last_undegraded":"2024-06-02T04:49:06.872949+0000","last_fullsized":"2024-06-02T04:49:06.872949+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:41:45.634923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"82'11","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.216665+0000","last_change":"2024-06-02T04:49:07.874181+0000","last_active":"2024-06-02T04:49:36.216665+0000","last_peered":"2024-06-02T04:49:36.216665+0000","last_clean":"2024-06-02T04:49:36.216665+0000","last_became_active":"2024-06-02T04:49:07.873791+0000","last_became_peered":"2024-06-02T04:49:07.873791+0000","last_unstale":"2024-06-02T04:49:36.216665+0000","last_undegraded":"2024-06-02T04:49:36.216665+0000","last_fullsized":"2024-06-02T04:49:36.216665+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T16:04:26.712712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.870118+0000","last_change":"2024-06-02T04:48:06.713061+0000","last_active":"2024-06-02T04:49:06.870118+0000","last_peered":"2024-06-02T04:49:06.870118+0000","last_clean":"2024-06-02T04:49:06.870118+0000","last_became_active":"2024-06-02T04:48:06.712687+0000","last_became_peered":"2024-06-02T04:48:06.712687+0000","last_unstale":"2024-06-02T04:49:06.870118+0000","last_undegraded":"2024-06-02T04:49:06.870118+0000","last_fullsized":"2024-06-02T04:49:06.870118+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T08:46:02.417626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"82'36","reported_seq":205,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:38.380102+0000","last_change":"2024-06-02T04:48:02.270101+0000","last_active":"2024-06-02T04:49:38.380102+0000","last_peered":"2024-06-02T04:49:38.380102+0000","last_clean":"2024-06-02T04:49:38.380102+0000","last_became_active":"2024-06-02T04:48:02.269637+0000","last_became_peered":"2024-06-02T04:48:02.269637+0000","last_unstale":"2024-06-02T04:49:38.380102+0000","last_undegraded":"2024-06-02T04:49:38.380102+0000","last_fullsized":"2024-06-02T04:49:38.380102+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:37:07.572299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64494,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":151,"num_read_kb":139,"num_write":37,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.212023+0000","last_change":"2024-06-02T04:48:02.698435+0000","last_active":"2024-06-02T04:49:36.212023+0000","last_peered":"2024-06-02T04:49:36.212023+0000","last_clean":"2024-06-02T04:49:36.212023+0000","last_became_active":"2024-06-02T04:48:02.698071+0000","last_became_peered":"2024-06-02T04:48:02.698071+0000","last_unstale":"2024-06-02T04:49:36.212023+0000","last_undegraded":"2024-06-02T04:49:36.212023+0000","last_fullsized":"2024-06-02T04:49:36.212023+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:45:38.673256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.873537+0000","last_change":"2024-06-02T04:48:06.705965+0000","last_active":"2024-06-02T04:49:06.873537+0000","last_peered":"2024-06-02T04:49:06.873537+0000","last_clean":"2024-06-02T04:49:06.873537+0000","last_became_active":"2024-06-02T04:48:06.705527+0000","last_became_peered":"2024-06-02T04:48:06.705527+0000","last_unstale":"2024-06-02T04:49:06.873537+0000","last_undegraded":"2024-06-02T04:49:06.873537+0000","last_fullsized":"2024-06-02T04:49:06.873537+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:41:54.100212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"80'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.866138+0000","last_change":"2024-06-02T04:48:02.273389+0000","last_active":"2024-06-02T04:49:06.866138+0000","last_peered":"2024-06-02T04:49:06.866138+0000","last_clean":"2024-06-02T04:49:06.866138+0000","last_became_active":"2024-06-02T04:48:02.271701+0000","last_became_peered":"2024-06-02T04:48:02.271701+0000","last_unstale":"2024-06-02T04:49:06.866138+0000","last_undegraded":"2024-06-02T04:49:06.866138+0000","last_fullsized":"2024-06-02T04:49:06.866138+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:46:48.304156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.201640+0000","last_change":"2024-06-02T04:48:02.689417+0000","last_active":"2024-06-02T04:49:36.201640+0000","last_peered":"2024-06-02T04:49:36.201640+0000","last_clean":"2024-06-02T04:49:36.201640+0000","last_became_active":"2024-06-02T04:48:02.689108+0000","last_became_peered":"2024-06-02T04:48:02.689108+0000","last_unstale":"2024-06-02T04:49:36.201640+0000","last_undegraded":"2024-06-02T04:49:36.201640+0000","last_fullsized":"2024-06-02T04:49:36.201640+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:23:14.231198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:07.875780+0000","last_change":"2024-06-02T04:49:07.875780+0000","last_active":"2024-06-02T04:49:07.875780+0000","last_peered":"2024-06-02T04:49:07.875780+0000","last_clean":"2024-06-02T04:49:07.875780+0000","last_became_active":"2024-06-02T04:49:07.875310+0000","last_became_peered":"2024-06-02T04:49:07.875310+0000","last_unstale":"2024-06-02T04:49:07.875780+0000","last_undegraded":"2024-06-02T04:49:07.875780+0000","last_fullsized":"2024-06-02T04:49:07.875780+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:46:26.921686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,7,6],"acting":[11,8,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"80'3","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.873166+0000","last_change":"2024-06-02T04:48:02.274386+0000","last_active":"2024-06-02T04:49:06.873166+0000","last_peered":"2024-06-02T04:49:06.873166+0000","last_clean":"2024-06-02T04:49:06.873166+0000","last_became_active":"2024-06-02T04:48:02.274001+0000","last_became_peered":"2024-06-02T04:48:02.274001+0000","last_unstale":"2024-06-02T04:49:06.873166+0000","last_undegraded":"2024-06-02T04:49:06.873166+0000","last_fullsized":"2024-06-02T04:49:06.873166+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T14:02:10.256428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"82'15","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.218594+0000","last_change":"2024-06-02T04:48:02.706735+0000","last_active":"2024-06-02T04:49:36.218594+0000","last_peered":"2024-06-02T04:49:36.218594+0000","last_clean":"2024-06-02T04:49:36.218594+0000","last_became_active":"2024-06-02T04:48:02.706475+0000","last_became_peered":"2024-06-02T04:48:02.706475+0000","last_unstale":"2024-06-02T04:49:36.218594+0000","last_undegraded":"2024-06-02T04:49:36.218594+0000","last_fullsized":"2024-06-02T04:49:36.218594+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T10:59:57.946798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.871496+0000","last_change":"2024-06-02T04:48:06.713266+0000","last_active":"2024-06-02T04:49:06.871496+0000","last_peered":"2024-06-02T04:49:06.871496+0000","last_clean":"2024-06-02T04:49:06.871496+0000","last_became_active":"2024-06-02T04:48:06.712659+0000","last_became_peered":"2024-06-02T04:48:06.712659+0000","last_unstale":"2024-06-02T04:49:06.871496+0000","last_undegraded":"2024-06-02T04:49:06.871496+0000","last_fullsized":"2024-06-02T04:49:06.871496+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T16:30:21.140420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"80'4","reported_seq":92,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:33.373117+0000","last_change":"2024-06-02T04:48:02.265157+0000","last_active":"2024-06-02T04:49:33.373117+0000","last_peered":"2024-06-02T04:49:33.373117+0000","last_clean":"2024-06-02T04:49:33.373117+0000","last_became_active":"2024-06-02T04:48:02.264782+0000","last_became_peered":"2024-06-02T04:48:02.264782+0000","last_unstale":"2024-06-02T04:49:33.373117+0000","last_undegraded":"2024-06-02T04:49:33.373117+0000","last_fullsized":"2024-06-02T04:49:33.373117+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:55:35.177299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":933,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":71,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.209474+0000","last_change":"2024-06-02T04:48:02.698864+0000","last_active":"2024-06-02T04:49:36.209474+0000","last_peered":"2024-06-02T04:49:36.209474+0000","last_clean":"2024-06-02T04:49:36.209474+0000","last_became_active":"2024-06-02T04:48:02.698547+0000","last_became_peered":"2024-06-02T04:48:02.698547+0000","last_unstale":"2024-06-02T04:49:36.209474+0000","last_undegraded":"2024-06-02T04:49:36.209474+0000","last_fullsized":"2024-06-02T04:49:36.209474+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:03:39.835164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.865160+0000","last_change":"2024-06-02T04:48:06.713198+0000","last_active":"2024-06-02T04:49:06.865160+0000","last_peered":"2024-06-02T04:49:06.865160+0000","last_clean":"2024-06-02T04:49:06.865160+0000","last_became_active":"2024-06-02T04:48:06.712806+0000","last_became_peered":"2024-06-02T04:48:06.712806+0000","last_unstale":"2024-06-02T04:49:06.865160+0000","last_undegraded":"2024-06-02T04:49:06.865160+0000","last_fullsized":"2024-06-02T04:49:06.865160+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:48:09.492933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"80'15","reported_seq":34,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.869408+0000","last_change":"2024-06-02T04:48:02.277744+0000","last_active":"2024-06-02T04:49:06.869408+0000","last_peered":"2024-06-02T04:49:06.869408+0000","last_clean":"2024-06-02T04:49:06.869408+0000","last_became_active":"2024-06-02T04:48:02.277044+0000","last_became_peered":"2024-06-02T04:48:02.277044+0000","last_unstale":"2024-06-02T04:49:06.869408+0000","last_undegraded":"2024-06-02T04:49:06.869408+0000","last_fullsized":"2024-06-02T04:49:06.869408+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:47:38.606233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.211595+0000","last_change":"2024-06-02T04:48:02.702234+0000","last_active":"2024-06-02T04:49:36.211595+0000","last_peered":"2024-06-02T04:49:36.211595+0000","last_clean":"2024-06-02T04:49:36.211595+0000","last_became_active":"2024-06-02T04:48:02.701857+0000","last_became_peered":"2024-06-02T04:48:02.701857+0000","last_unstale":"2024-06-02T04:49:36.211595+0000","last_undegraded":"2024-06-02T04:49:36.211595+0000","last_fullsized":"2024-06-02T04:49:36.211595+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:01:52.901690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.872667+0000","last_change":"2024-06-02T04:48:06.704575+0000","last_active":"2024-06-02T04:49:06.872667+0000","last_peered":"2024-06-02T04:49:06.872667+0000","last_clean":"2024-06-02T04:49:06.872667+0000","last_became_active":"2024-06-02T04:48:06.704129+0000","last_became_peered":"2024-06-02T04:48:06.704129+0000","last_unstale":"2024-06-02T04:49:06.872667+0000","last_undegraded":"2024-06-02T04:49:06.872667+0000","last_fullsized":"2024-06-02T04:49:06.872667+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:43:53.481252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.869952+0000","last_change":"2024-06-02T04:48:02.268816+0000","last_active":"2024-06-02T04:49:06.869952+0000","last_peered":"2024-06-02T04:49:06.869952+0000","last_clean":"2024-06-02T04:49:06.869952+0000","last_became_active":"2024-06-02T04:48:02.268469+0000","last_became_peered":"2024-06-02T04:48:02.268469+0000","last_unstale":"2024-06-02T04:49:06.869952+0000","last_undegraded":"2024-06-02T04:49:06.869952+0000","last_fullsized":"2024-06-02T04:49:06.869952+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:42:32.434414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.218718+0000","last_change":"2024-06-02T04:48:02.704536+0000","last_active":"2024-06-02T04:49:36.218718+0000","last_peered":"2024-06-02T04:49:36.218718+0000","last_clean":"2024-06-02T04:49:36.218718+0000","last_became_active":"2024-06-02T04:48:02.704149+0000","last_became_peered":"2024-06-02T04:48:02.704149+0000","last_unstale":"2024-06-02T04:49:36.218718+0000","last_undegraded":"2024-06-02T04:49:36.218718+0000","last_fullsized":"2024-06-02T04:49:36.218718+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T07:59:40.379135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:07.877906+0000","last_change":"2024-06-02T04:49:07.877906+0000","last_active":"2024-06-02T04:49:07.877906+0000","last_peered":"2024-06-02T04:49:07.877906+0000","last_clean":"2024-06-02T04:49:07.877906+0000","last_became_active":"2024-06-02T04:49:07.877072+0000","last_became_peered":"2024-06-02T04:49:07.877072+0000","last_unstale":"2024-06-02T04:49:07.877906+0000","last_undegraded":"2024-06-02T04:49:07.877906+0000","last_fullsized":"2024-06-02T04:49:07.877906+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:49:59.825416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.871187+0000","last_change":"2024-06-02T04:48:02.270893+0000","last_active":"2024-06-02T04:49:06.871187+0000","last_peered":"2024-06-02T04:49:06.871187+0000","last_clean":"2024-06-02T04:49:06.871187+0000","last_became_active":"2024-06-02T04:48:02.270566+0000","last_became_peered":"2024-06-02T04:48:02.270566+0000","last_unstale":"2024-06-02T04:49:06.871187+0000","last_undegraded":"2024-06-02T04:49:06.871187+0000","last_fullsized":"2024-06-02T04:49:06.871187+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:57:36.202043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'4","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.204040+0000","last_change":"2024-06-02T04:48:02.693528+0000","last_active":"2024-06-02T04:49:36.204040+0000","last_peered":"2024-06-02T04:49:36.204040+0000","last_clean":"2024-06-02T04:49:36.204040+0000","last_became_active":"2024-06-02T04:48:02.693240+0000","last_became_peered":"2024-06-02T04:48:02.693240+0000","last_unstale":"2024-06-02T04:49:36.204040+0000","last_undegraded":"2024-06-02T04:49:36.204040+0000","last_fullsized":"2024-06-02T04:49:36.204040+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T14:48:59.338977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.864871+0000","last_change":"2024-06-02T04:48:06.710454+0000","last_active":"2024-06-02T04:49:06.864871+0000","last_peered":"2024-06-02T04:49:06.864871+0000","last_clean":"2024-06-02T04:49:06.864871+0000","last_became_active":"2024-06-02T04:48:06.710090+0000","last_became_peered":"2024-06-02T04:48:06.710090+0000","last_unstale":"2024-06-02T04:49:06.864871+0000","last_undegraded":"2024-06-02T04:49:06.864871+0000","last_fullsized":"2024-06-02T04:49:06.864871+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:27:52.401032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"80'1","reported_seq":19,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.872363+0000","last_change":"2024-06-02T04:48:02.271748+0000","last_active":"2024-06-02T04:49:06.872363+0000","last_peered":"2024-06-02T04:49:06.872363+0000","last_clean":"2024-06-02T04:49:06.872363+0000","last_became_active":"2024-06-02T04:48:02.270941+0000","last_became_peered":"2024-06-02T04:48:02.270941+0000","last_unstale":"2024-06-02T04:49:06.872363+0000","last_undegraded":"2024-06-02T04:49:06.872363+0000","last_fullsized":"2024-06-02T04:49:06.872363+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T14:22:37.698956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.216956+0000","last_change":"2024-06-02T04:48:02.690331+0000","last_active":"2024-06-02T04:49:36.216956+0000","last_peered":"2024-06-02T04:49:36.216956+0000","last_clean":"2024-06-02T04:49:36.216956+0000","last_became_active":"2024-06-02T04:48:02.681983+0000","last_became_peered":"2024-06-02T04:48:02.681983+0000","last_unstale":"2024-06-02T04:49:36.216956+0000","last_undegraded":"2024-06-02T04:49:36.216956+0000","last_fullsized":"2024-06-02T04:49:36.216956+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T14:09:12.117847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.865289+0000","last_change":"2024-06-02T04:48:06.962698+0000","last_active":"2024-06-02T04:49:06.865289+0000","last_peered":"2024-06-02T04:49:06.865289+0000","last_clean":"2024-06-02T04:49:06.865289+0000","last_became_active":"2024-06-02T04:48:06.962283+0000","last_became_peered":"2024-06-02T04:48:06.962283+0000","last_unstale":"2024-06-02T04:49:06.865289+0000","last_undegraded":"2024-06-02T04:49:06.865289+0000","last_fullsized":"2024-06-02T04:49:06.865289+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T14:33:49.504150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.210803+0000","last_change":"2024-06-02T04:48:02.702856+0000","last_active":"2024-06-02T04:49:36.210803+0000","last_peered":"2024-06-02T04:49:36.210803+0000","last_clean":"2024-06-02T04:49:36.210803+0000","last_became_active":"2024-06-02T04:48:02.702513+0000","last_became_peered":"2024-06-02T04:48:02.702513+0000","last_unstale":"2024-06-02T04:49:36.210803+0000","last_undegraded":"2024-06-02T04:49:36.210803+0000","last_fullsized":"2024-06-02T04:49:36.210803+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T07:10:35.957386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"82'5","reported_seq":94,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:37.378451+0000","last_change":"2024-06-02T04:48:02.265627+0000","last_active":"2024-06-02T04:49:37.378451+0000","last_peered":"2024-06-02T04:49:37.378451+0000","last_clean":"2024-06-02T04:49:37.378451+0000","last_became_active":"2024-06-02T04:48:02.265301+0000","last_became_peered":"2024-06-02T04:48:02.265301+0000","last_unstale":"2024-06-02T04:49:37.378451+0000","last_undegraded":"2024-06-02T04:49:37.378451+0000","last_fullsized":"2024-06-02T04:49:37.378451+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T10:46:10.211378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":71,"num_read_kb":71,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"80'1","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.873068+0000","last_change":"2024-06-02T04:48:06.709988+0000","last_active":"2024-06-02T04:49:06.873068+0000","last_peered":"2024-06-02T04:49:06.873068+0000","last_clean":"2024-06-02T04:49:06.873068+0000","last_became_active":"2024-06-02T04:48:06.709642+0000","last_became_peered":"2024-06-02T04:48:06.709642+0000","last_unstale":"2024-06-02T04:49:06.873068+0000","last_undegraded":"2024-06-02T04:49:06.873068+0000","last_fullsized":"2024-06-02T04:49:06.873068+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T10:09:46.250709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.212511+0000","last_change":"2024-06-02T04:48:02.696666+0000","last_active":"2024-06-02T04:49:36.212511+0000","last_peered":"2024-06-02T04:49:36.212511+0000","last_clean":"2024-06-02T04:49:36.212511+0000","last_became_active":"2024-06-02T04:48:02.696343+0000","last_became_peered":"2024-06-02T04:48:02.696343+0000","last_unstale":"2024-06-02T04:49:36.212511+0000","last_undegraded":"2024-06-02T04:49:36.212511+0000","last_fullsized":"2024-06-02T04:49:36.212511+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T12:31:13.426174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"80'3","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.868521+0000","last_change":"2024-06-02T04:48:02.268619+0000","last_active":"2024-06-02T04:49:06.868521+0000","last_peered":"2024-06-02T04:49:06.868521+0000","last_clean":"2024-06-02T04:49:06.868521+0000","last_became_active":"2024-06-02T04:48:02.268244+0000","last_became_peered":"2024-06-02T04:48:02.268244+0000","last_unstale":"2024-06-02T04:49:06.868521+0000","last_undegraded":"2024-06-02T04:49:06.868521+0000","last_fullsized":"2024-06-02T04:49:06.868521+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:15:13.469046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"19'137","reported_seq":328,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.872115+0000","last_change":"2024-06-02T04:47:15.713382+0000","last_active":"2024-06-02T04:49:06.872115+0000","last_peered":"2024-06-02T04:49:06.872115+0000","last_clean":"2024-06-02T04:49:06.872115+0000","last_became_active":"2024-06-02T04:47:15.712972+0000","last_became_peered":"2024-06-02T04:47:15.712972+0000","last_unstale":"2024-06-02T04:49:06.872115+0000","last_undegraded":"2024-06-02T04:49:06.872115+0000","last_fullsized":"2024-06-02T04:49:06.872115+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:44:56.604079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:44:56.604079+0000","last_clean_scrub_stamp":"2024-06-02T04:44:56.604079+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T12:54:02.306899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.872863+0000","last_change":"2024-06-02T04:48:06.964717+0000","last_active":"2024-06-02T04:49:06.872863+0000","last_peered":"2024-06-02T04:49:06.872863+0000","last_clean":"2024-06-02T04:49:06.872863+0000","last_became_active":"2024-06-02T04:48:06.964244+0000","last_became_peered":"2024-06-02T04:48:06.964244+0000","last_unstale":"2024-06-02T04:49:06.872863+0000","last_undegraded":"2024-06-02T04:49:06.872863+0000","last_fullsized":"2024-06-02T04:49:06.872863+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:26:58.901182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"82'5","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.200231+0000","last_change":"2024-06-02T04:49:07.892022+0000","last_active":"2024-06-02T04:49:36.200231+0000","last_peered":"2024-06-02T04:49:36.200231+0000","last_clean":"2024-06-02T04:49:36.200231+0000","last_became_active":"2024-06-02T04:49:07.891678+0000","last_became_peered":"2024-06-02T04:49:07.891678+0000","last_unstale":"2024-06-02T04:49:36.200231+0000","last_undegraded":"2024-06-02T04:49:36.200231+0000","last_fullsized":"2024-06-02T04:49:36.200231+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T07:01:06.354621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"80'3","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:07.880368+0000","last_change":"2024-06-02T04:49:07.880368+0000","last_active":"2024-06-02T04:49:07.880368+0000","last_peered":"2024-06-02T04:49:07.880368+0000","last_clean":"2024-06-02T04:49:07.880368+0000","last_became_active":"2024-06-02T04:49:07.876731+0000","last_became_peered":"2024-06-02T04:49:07.876731+0000","last_unstale":"2024-06-02T04:49:07.880368+0000","last_undegraded":"2024-06-02T04:49:07.880368+0000","last_fullsized":"2024-06-02T04:49:07.880368+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T12:48:38.495222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4],"acting":[7,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.867776+0000","last_change":"2024-06-02T04:48:06.703427+0000","last_active":"2024-06-02T04:49:06.867776+0000","last_peered":"2024-06-02T04:49:06.867776+0000","last_clean":"2024-06-02T04:49:06.867776+0000","last_became_active":"2024-06-02T04:48:06.702442+0000","last_became_peered":"2024-06-02T04:48:06.702442+0000","last_unstale":"2024-06-02T04:49:06.867776+0000","last_undegraded":"2024-06-02T04:49:06.867776+0000","last_fullsized":"2024-06-02T04:49:06.867776+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T14:47:12.376520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"80'1","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.870604+0000","last_change":"2024-06-02T04:48:02.277241+0000","last_active":"2024-06-02T04:49:06.870604+0000","last_peered":"2024-06-02T04:49:06.870604+0000","last_clean":"2024-06-02T04:49:06.870604+0000","last_became_active":"2024-06-02T04:48:02.276903+0000","last_became_peered":"2024-06-02T04:48:02.276903+0000","last_unstale":"2024-06-02T04:49:06.870604+0000","last_undegraded":"2024-06-02T04:49:06.870604+0000","last_fullsized":"2024-06-02T04:49:06.870604+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:16:40.664225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.200095+0000","last_change":"2024-06-02T04:48:02.682260+0000","last_active":"2024-06-02T04:49:36.200095+0000","last_peered":"2024-06-02T04:49:36.200095+0000","last_clean":"2024-06-02T04:49:36.200095+0000","last_became_active":"2024-06-02T04:48:02.681962+0000","last_became_peered":"2024-06-02T04:48:02.681962+0000","last_unstale":"2024-06-02T04:49:36.200095+0000","last_undegraded":"2024-06-02T04:49:36.200095+0000","last_fullsized":"2024-06-02T04:49:36.200095+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:42:26.588628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.872911+0000","last_change":"2024-06-02T04:48:06.963380+0000","last_active":"2024-06-02T04:49:06.872911+0000","last_peered":"2024-06-02T04:49:06.872911+0000","last_clean":"2024-06-02T04:49:06.872911+0000","last_became_active":"2024-06-02T04:48:06.962717+0000","last_became_peered":"2024-06-02T04:48:06.962717+0000","last_unstale":"2024-06-02T04:49:06.872911+0000","last_undegraded":"2024-06-02T04:49:06.872911+0000","last_fullsized":"2024-06-02T04:49:06.872911+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T07:05:46.983987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"80'5","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.871715+0000","last_change":"2024-06-02T04:48:02.270183+0000","last_active":"2024-06-02T04:49:06.871715+0000","last_peered":"2024-06-02T04:49:06.871715+0000","last_clean":"2024-06-02T04:49:06.871715+0000","last_became_active":"2024-06-02T04:48:02.269880+0000","last_became_peered":"2024-06-02T04:48:02.269880+0000","last_unstale":"2024-06-02T04:49:06.871715+0000","last_undegraded":"2024-06-02T04:49:06.871715+0000","last_fullsized":"2024-06-02T04:49:06.871715+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T16:12:41.959174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.201281+0000","last_change":"2024-06-02T04:48:02.696692+0000","last_active":"2024-06-02T04:49:36.201281+0000","last_peered":"2024-06-02T04:49:36.201281+0000","last_clean":"2024-06-02T04:49:36.201281+0000","last_became_active":"2024-06-02T04:48:02.696398+0000","last_became_peered":"2024-06-02T04:48:02.696398+0000","last_unstale":"2024-06-02T04:49:36.201281+0000","last_undegraded":"2024-06-02T04:49:36.201281+0000","last_fullsized":"2024-06-02T04:49:36.201281+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T14:12:15.108989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.865826+0000","last_change":"2024-06-02T04:48:06.706766+0000","last_active":"2024-06-02T04:49:06.865826+0000","last_peered":"2024-06-02T04:49:06.865826+0000","last_clean":"2024-06-02T04:49:06.865826+0000","last_became_active":"2024-06-02T04:48:06.706440+0000","last_became_peered":"2024-06-02T04:48:06.706440+0000","last_unstale":"2024-06-02T04:49:06.865826+0000","last_undegraded":"2024-06-02T04:49:06.865826+0000","last_fullsized":"2024-06-02T04:49:06.865826+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:24:20.283467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"80'4","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.869382+0000","last_change":"2024-06-02T04:48:02.265259+0000","last_active":"2024-06-02T04:49:06.869382+0000","last_peered":"2024-06-02T04:49:06.869382+0000","last_clean":"2024-06-02T04:49:06.869382+0000","last_became_active":"2024-06-02T04:48:02.264931+0000","last_became_peered":"2024-06-02T04:48:02.264931+0000","last_unstale":"2024-06-02T04:49:06.869382+0000","last_undegraded":"2024-06-02T04:49:06.869382+0000","last_fullsized":"2024-06-02T04:49:06.869382+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:06:18.360519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.207713+0000","last_change":"2024-06-02T04:48:02.684808+0000","last_active":"2024-06-02T04:49:36.207713+0000","last_peered":"2024-06-02T04:49:36.207713+0000","last_clean":"2024-06-02T04:49:36.207713+0000","last_became_active":"2024-06-02T04:48:02.684492+0000","last_became_peered":"2024-06-02T04:48:02.684492+0000","last_unstale":"2024-06-02T04:49:36.207713+0000","last_undegraded":"2024-06-02T04:49:36.207713+0000","last_fullsized":"2024-06-02T04:49:36.207713+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T12:10:01.537377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.868148+0000","last_change":"2024-06-02T04:48:06.965041+0000","last_active":"2024-06-02T04:49:06.868148+0000","last_peered":"2024-06-02T04:49:06.868148+0000","last_clean":"2024-06-02T04:49:06.868148+0000","last_became_active":"2024-06-02T04:48:06.964487+0000","last_became_peered":"2024-06-02T04:48:06.964487+0000","last_unstale":"2024-06-02T04:49:06.868148+0000","last_undegraded":"2024-06-02T04:49:06.868148+0000","last_fullsized":"2024-06-02T04:49:06.868148+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:51:05.082026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.874688+0000","last_change":"2024-06-02T04:48:02.271485+0000","last_active":"2024-06-02T04:49:06.874688+0000","last_peered":"2024-06-02T04:49:06.874688+0000","last_clean":"2024-06-02T04:49:06.874688+0000","last_became_active":"2024-06-02T04:48:02.271156+0000","last_became_peered":"2024-06-02T04:48:02.271156+0000","last_unstale":"2024-06-02T04:49:06.874688+0000","last_undegraded":"2024-06-02T04:49:06.874688+0000","last_fullsized":"2024-06-02T04:49:06.874688+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:57:34.467559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"82'2","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.177199+0000","last_change":"2024-06-02T04:48:02.673700+0000","last_active":"2024-06-02T04:49:36.177199+0000","last_peered":"2024-06-02T04:49:36.177199+0000","last_clean":"2024-06-02T04:49:36.177199+0000","last_became_active":"2024-06-02T04:48:02.673262+0000","last_became_peered":"2024-06-02T04:48:02.673262+0000","last_unstale":"2024-06-02T04:49:36.177199+0000","last_undegraded":"2024-06-02T04:49:36.177199+0000","last_fullsized":"2024-06-02T04:49:36.177199+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:45:00.682562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.871595+0000","last_change":"2024-06-02T04:48:06.716848+0000","last_active":"2024-06-02T04:49:06.871595+0000","last_peered":"2024-06-02T04:49:06.871595+0000","last_clean":"2024-06-02T04:49:06.871595+0000","last_became_active":"2024-06-02T04:48:06.716411+0000","last_became_peered":"2024-06-02T04:48:06.716411+0000","last_unstale":"2024-06-02T04:49:06.871595+0000","last_undegraded":"2024-06-02T04:49:06.871595+0000","last_fullsized":"2024-06-02T04:49:06.871595+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T06:09:36.074569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"80'3","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.873311+0000","last_change":"2024-06-02T04:48:02.269426+0000","last_active":"2024-06-02T04:49:06.873311+0000","last_peered":"2024-06-02T04:49:06.873311+0000","last_clean":"2024-06-02T04:49:06.873311+0000","last_became_active":"2024-06-02T04:48:02.269115+0000","last_became_peered":"2024-06-02T04:48:02.269115+0000","last_unstale":"2024-06-02T04:49:06.873311+0000","last_undegraded":"2024-06-02T04:49:06.873311+0000","last_fullsized":"2024-06-02T04:49:06.873311+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:18:28.568367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.212859+0000","last_change":"2024-06-02T04:48:02.694234+0000","last_active":"2024-06-02T04:49:36.212859+0000","last_peered":"2024-06-02T04:49:36.212859+0000","last_clean":"2024-06-02T04:49:36.212859+0000","last_became_active":"2024-06-02T04:48:02.693916+0000","last_became_peered":"2024-06-02T04:48:02.693916+0000","last_unstale":"2024-06-02T04:49:36.212859+0000","last_undegraded":"2024-06-02T04:49:36.212859+0000","last_fullsized":"2024-06-02T04:49:36.212859+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T16:47:44.939277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"80'1","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.869829+0000","last_change":"2024-06-02T04:48:06.716026+0000","last_active":"2024-06-02T04:49:06.869829+0000","last_peered":"2024-06-02T04:49:06.869829+0000","last_clean":"2024-06-02T04:49:06.869829+0000","last_became_active":"2024-06-02T04:48:06.715730+0000","last_became_peered":"2024-06-02T04:48:06.715730+0000","last_unstale":"2024-06-02T04:49:06.869829+0000","last_undegraded":"2024-06-02T04:49:06.869829+0000","last_fullsized":"2024-06-02T04:49:06.869829+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:35:53.707307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"80'1","reported_seq":19,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.866068+0000","last_change":"2024-06-02T04:48:02.271576+0000","last_active":"2024-06-02T04:49:06.866068+0000","last_peered":"2024-06-02T04:49:06.866068+0000","last_clean":"2024-06-02T04:49:06.866068+0000","last_became_active":"2024-06-02T04:48:02.271101+0000","last_became_peered":"2024-06-02T04:48:02.271101+0000","last_unstale":"2024-06-02T04:49:06.866068+0000","last_undegraded":"2024-06-02T04:49:06.866068+0000","last_fullsized":"2024-06-02T04:49:06.866068+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T08:35:37.467479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.197637+0000","last_change":"2024-06-02T04:48:02.702773+0000","last_active":"2024-06-02T04:49:36.197637+0000","last_peered":"2024-06-02T04:49:36.197637+0000","last_clean":"2024-06-02T04:49:36.197637+0000","last_became_active":"2024-06-02T04:48:02.702415+0000","last_became_peered":"2024-06-02T04:48:02.702415+0000","last_unstale":"2024-06-02T04:49:36.197637+0000","last_undegraded":"2024-06-02T04:49:36.197637+0000","last_fullsized":"2024-06-02T04:49:36.197637+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:18:55.084384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.868264+0000","last_change":"2024-06-02T04:48:06.963120+0000","last_active":"2024-06-02T04:49:06.868264+0000","last_peered":"2024-06-02T04:49:06.868264+0000","last_clean":"2024-06-02T04:49:06.868264+0000","last_became_active":"2024-06-02T04:48:06.962509+0000","last_became_peered":"2024-06-02T04:48:06.962509+0000","last_unstale":"2024-06-02T04:49:06.868264+0000","last_undegraded":"2024-06-02T04:49:06.868264+0000","last_fullsized":"2024-06-02T04:49:06.868264+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T04:55:34.509179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.869516+0000","last_change":"2024-06-02T04:48:02.273511+0000","last_active":"2024-06-02T04:49:06.869516+0000","last_peered":"2024-06-02T04:49:06.869516+0000","last_clean":"2024-06-02T04:49:06.869516+0000","last_became_active":"2024-06-02T04:48:02.273100+0000","last_became_peered":"2024-06-02T04:48:02.273100+0000","last_unstale":"2024-06-02T04:49:06.869516+0000","last_undegraded":"2024-06-02T04:49:06.869516+0000","last_fullsized":"2024-06-02T04:49:06.869516+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:04:11.742406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.208874+0000","last_change":"2024-06-02T04:48:02.696594+0000","last_active":"2024-06-02T04:49:36.208874+0000","last_peered":"2024-06-02T04:49:36.208874+0000","last_clean":"2024-06-02T04:49:36.208874+0000","last_became_active":"2024-06-02T04:48:02.696278+0000","last_became_peered":"2024-06-02T04:48:02.696278+0000","last_unstale":"2024-06-02T04:49:36.208874+0000","last_undegraded":"2024-06-02T04:49:36.208874+0000","last_fullsized":"2024-06-02T04:49:36.208874+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T16:10:16.275451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.874218+0000","last_change":"2024-06-02T04:48:06.701837+0000","last_active":"2024-06-02T04:49:06.874218+0000","last_peered":"2024-06-02T04:49:06.874218+0000","last_clean":"2024-06-02T04:49:06.874218+0000","last_became_active":"2024-06-02T04:48:06.701454+0000","last_became_peered":"2024-06-02T04:48:06.701454+0000","last_unstale":"2024-06-02T04:49:06.874218+0000","last_undegraded":"2024-06-02T04:49:06.874218+0000","last_fullsized":"2024-06-02T04:49:06.874218+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T16:25:46.585200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"80'3","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.866695+0000","last_change":"2024-06-02T04:48:02.272941+0000","last_active":"2024-06-02T04:49:06.866695+0000","last_peered":"2024-06-02T04:49:06.866695+0000","last_clean":"2024-06-02T04:49:06.866695+0000","last_became_active":"2024-06-02T04:48:02.270149+0000","last_became_peered":"2024-06-02T04:48:02.270149+0000","last_unstale":"2024-06-02T04:49:06.866695+0000","last_undegraded":"2024-06-02T04:49:06.866695+0000","last_fullsized":"2024-06-02T04:49:06.866695+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T04:54:09.813917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.211539+0000","last_change":"2024-06-02T04:48:02.699722+0000","last_active":"2024-06-02T04:49:36.211539+0000","last_peered":"2024-06-02T04:49:36.211539+0000","last_clean":"2024-06-02T04:49:36.211539+0000","last_became_active":"2024-06-02T04:48:02.699376+0000","last_became_peered":"2024-06-02T04:48:02.699376+0000","last_unstale":"2024-06-02T04:49:36.211539+0000","last_undegraded":"2024-06-02T04:49:36.211539+0000","last_fullsized":"2024-06-02T04:49:36.211539+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T08:12:24.048499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.869637+0000","last_change":"2024-06-02T04:48:06.706493+0000","last_active":"2024-06-02T04:49:06.869637+0000","last_peered":"2024-06-02T04:49:06.869637+0000","last_clean":"2024-06-02T04:49:06.869637+0000","last_became_active":"2024-06-02T04:48:06.706135+0000","last_became_peered":"2024-06-02T04:48:06.706135+0000","last_unstale":"2024-06-02T04:49:06.869637+0000","last_undegraded":"2024-06-02T04:49:06.869637+0000","last_fullsized":"2024-06-02T04:49:06.869637+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:54:51.491641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"75'1","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.873217+0000","last_change":"2024-06-02T04:48:02.271534+0000","last_active":"2024-06-02T04:49:06.873217+0000","last_peered":"2024-06-02T04:49:06.873217+0000","last_clean":"2024-06-02T04:49:06.873217+0000","last_became_active":"2024-06-02T04:48:02.271144+0000","last_became_peered":"2024-06-02T04:48:02.271144+0000","last_unstale":"2024-06-02T04:49:06.873217+0000","last_undegraded":"2024-06-02T04:49:06.873217+0000","last_fullsized":"2024-06-02T04:49:06.873217+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:45:10.221432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.205004+0000","last_change":"2024-06-02T04:48:02.697089+0000","last_active":"2024-06-02T04:49:36.205004+0000","last_peered":"2024-06-02T04:49:36.205004+0000","last_clean":"2024-06-02T04:49:36.205004+0000","last_became_active":"2024-06-02T04:48:02.696755+0000","last_became_peered":"2024-06-02T04:48:02.696755+0000","last_unstale":"2024-06-02T04:49:36.205004+0000","last_undegraded":"2024-06-02T04:49:36.205004+0000","last_fullsized":"2024-06-02T04:49:36.205004+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T08:56:18.715019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:07.878105+0000","last_change":"2024-06-02T04:49:07.877440+0000","last_active":"2024-06-02T04:49:07.878105+0000","last_peered":"2024-06-02T04:49:07.878105+0000","last_clean":"2024-06-02T04:49:07.878105+0000","last_became_active":"2024-06-02T04:49:07.877002+0000","last_became_peered":"2024-06-02T04:49:07.877002+0000","last_unstale":"2024-06-02T04:49:07.878105+0000","last_undegraded":"2024-06-02T04:49:07.878105+0000","last_fullsized":"2024-06-02T04:49:07.878105+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T10:08:54.744309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,7,1],"acting":[10,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.e","version":"75'2","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.865165+0000","last_change":"2024-06-02T04:48:02.265912+0000","last_active":"2024-06-02T04:49:06.865165+0000","last_peered":"2024-06-02T04:49:06.865165+0000","last_clean":"2024-06-02T04:49:06.865165+0000","last_became_active":"2024-06-02T04:48:02.265494+0000","last_became_peered":"2024-06-02T04:48:02.265494+0000","last_unstale":"2024-06-02T04:49:06.865165+0000","last_undegraded":"2024-06-02T04:49:06.865165+0000","last_fullsized":"2024-06-02T04:49:06.865165+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T10:21:58.897765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.213799+0000","last_change":"2024-06-02T04:48:02.693091+0000","last_active":"2024-06-02T04:49:36.213799+0000","last_peered":"2024-06-02T04:49:36.213799+0000","last_clean":"2024-06-02T04:49:36.213799+0000","last_became_active":"2024-06-02T04:48:02.692025+0000","last_became_peered":"2024-06-02T04:48:02.692025+0000","last_unstale":"2024-06-02T04:49:36.213799+0000","last_undegraded":"2024-06-02T04:49:36.213799+0000","last_fullsized":"2024-06-02T04:49:36.213799+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T14:36:35.813881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.212739+0000","last_change":"2024-06-02T04:48:02.694381+0000","last_active":"2024-06-02T04:49:36.212739+0000","last_peered":"2024-06-02T04:49:36.212739+0000","last_clean":"2024-06-02T04:49:36.212739+0000","last_became_active":"2024-06-02T04:48:02.694049+0000","last_became_peered":"2024-06-02T04:48:02.694049+0000","last_unstale":"2024-06-02T04:49:36.212739+0000","last_undegraded":"2024-06-02T04:49:36.212739+0000","last_fullsized":"2024-06-02T04:49:36.212739+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:04:31.920810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"82'10","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.185860+0000","last_change":"2024-06-02T04:48:02.702174+0000","last_active":"2024-06-02T04:49:36.185860+0000","last_peered":"2024-06-02T04:49:36.185860+0000","last_clean":"2024-06-02T04:49:36.185860+0000","last_became_active":"2024-06-02T04:48:02.701893+0000","last_became_peered":"2024-06-02T04:48:02.701893+0000","last_unstale":"2024-06-02T04:49:36.185860+0000","last_undegraded":"2024-06-02T04:49:36.185860+0000","last_fullsized":"2024-06-02T04:49:36.185860+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:39:07.224256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.197557+0000","last_change":"2024-06-02T04:48:02.688547+0000","last_active":"2024-06-02T04:49:36.197557+0000","last_peered":"2024-06-02T04:49:36.197557+0000","last_clean":"2024-06-02T04:49:36.197557+0000","last_became_active":"2024-06-02T04:48:02.688183+0000","last_became_peered":"2024-06-02T04:48:02.688183+0000","last_unstale":"2024-06-02T04:49:36.197557+0000","last_undegraded":"2024-06-02T04:49:36.197557+0000","last_fullsized":"2024-06-02T04:49:36.197557+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:47:22.399630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.207474+0000","last_change":"2024-06-02T04:48:02.702958+0000","last_active":"2024-06-02T04:49:36.207474+0000","last_peered":"2024-06-02T04:49:36.207474+0000","last_clean":"2024-06-02T04:49:36.207474+0000","last_became_active":"2024-06-02T04:48:02.702640+0000","last_became_peered":"2024-06-02T04:48:02.702640+0000","last_unstale":"2024-06-02T04:49:36.207474+0000","last_undegraded":"2024-06-02T04:49:36.207474+0000","last_fullsized":"2024-06-02T04:49:36.207474+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T12:53:17.406762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"82'4","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.199772+0000","last_change":"2024-06-02T04:49:07.892927+0000","last_active":"2024-06-02T04:49:36.199772+0000","last_peered":"2024-06-02T04:49:36.199772+0000","last_clean":"2024-06-02T04:49:36.199772+0000","last_became_active":"2024-06-02T04:49:07.892589+0000","last_became_peered":"2024-06-02T04:49:07.892589+0000","last_unstale":"2024-06-02T04:49:36.199772+0000","last_undegraded":"2024-06-02T04:49:36.199772+0000","last_fullsized":"2024-06-02T04:49:36.199772+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T08:37:06.703061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"82'6","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.211826+0000","last_change":"2024-06-02T04:49:07.892107+0000","last_active":"2024-06-02T04:49:36.211826+0000","last_peered":"2024-06-02T04:49:36.211826+0000","last_clean":"2024-06-02T04:49:36.211826+0000","last_became_active":"2024-06-02T04:49:07.891716+0000","last_became_peered":"2024-06-02T04:49:07.891716+0000","last_unstale":"2024-06-02T04:49:36.211826+0000","last_undegraded":"2024-06-02T04:49:36.211826+0000","last_fullsized":"2024-06-02T04:49:36.211826+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T10:25:12.557665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"82'15","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.205165+0000","last_change":"2024-06-02T04:48:02.698865+0000","last_active":"2024-06-02T04:49:36.205165+0000","last_peered":"2024-06-02T04:49:36.205165+0000","last_clean":"2024-06-02T04:49:36.205165+0000","last_became_active":"2024-06-02T04:48:02.698554+0000","last_became_peered":"2024-06-02T04:48:02.698554+0000","last_unstale":"2024-06-02T04:49:36.205165+0000","last_undegraded":"2024-06-02T04:49:36.205165+0000","last_fullsized":"2024-06-02T04:49:36.205165+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:19:14.413170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"82'2","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.216241+0000","last_change":"2024-06-02T04:48:02.694345+0000","last_active":"2024-06-02T04:49:36.216241+0000","last_peered":"2024-06-02T04:49:36.216241+0000","last_clean":"2024-06-02T04:49:36.216241+0000","last_became_active":"2024-06-02T04:48:02.693866+0000","last_became_peered":"2024-06-02T04:48:02.693866+0000","last_unstale":"2024-06-02T04:49:36.216241+0000","last_undegraded":"2024-06-02T04:49:36.216241+0000","last_fullsized":"2024-06-02T04:49:36.216241+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:56:09.409774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.202853+0000","last_change":"2024-06-02T04:48:02.689609+0000","last_active":"2024-06-02T04:49:36.202853+0000","last_peered":"2024-06-02T04:49:36.202853+0000","last_clean":"2024-06-02T04:49:36.202853+0000","last_became_active":"2024-06-02T04:48:02.689279+0000","last_became_peered":"2024-06-02T04:48:02.689279+0000","last_unstale":"2024-06-02T04:49:36.202853+0000","last_undegraded":"2024-06-02T04:49:36.202853+0000","last_fullsized":"2024-06-02T04:49:36.202853+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T14:05:04.600923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.200357+0000","last_change":"2024-06-02T04:48:02.694124+0000","last_active":"2024-06-02T04:49:36.200357+0000","last_peered":"2024-06-02T04:49:36.200357+0000","last_clean":"2024-06-02T04:49:36.200357+0000","last_became_active":"2024-06-02T04:48:02.693787+0000","last_became_peered":"2024-06-02T04:48:02.693787+0000","last_unstale":"2024-06-02T04:49:36.200357+0000","last_undegraded":"2024-06-02T04:49:36.200357+0000","last_fullsized":"2024-06-02T04:49:36.200357+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T07:56:27.274107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"82'10","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.217256+0000","last_change":"2024-06-02T04:48:02.698736+0000","last_active":"2024-06-02T04:49:36.217256+0000","last_peered":"2024-06-02T04:49:36.217256+0000","last_clean":"2024-06-02T04:49:36.217256+0000","last_became_active":"2024-06-02T04:48:02.698285+0000","last_became_peered":"2024-06-02T04:48:02.698285+0000","last_unstale":"2024-06-02T04:49:36.217256+0000","last_undegraded":"2024-06-02T04:49:36.217256+0000","last_fullsized":"2024-06-02T04:49:36.217256+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T04:53:31.655139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"82'11","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.209741+0000","last_change":"2024-06-02T04:48:02.689942+0000","last_active":"2024-06-02T04:49:36.209741+0000","last_peered":"2024-06-02T04:49:36.209741+0000","last_clean":"2024-06-02T04:49:36.209741+0000","last_became_active":"2024-06-02T04:48:02.689096+0000","last_became_peered":"2024-06-02T04:48:02.689096+0000","last_unstale":"2024-06-02T04:49:36.209741+0000","last_undegraded":"2024-06-02T04:49:36.209741+0000","last_fullsized":"2024-06-02T04:49:36.209741+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:11:06.451048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.218470+0000","last_change":"2024-06-02T04:48:02.691514+0000","last_active":"2024-06-02T04:49:36.218470+0000","last_peered":"2024-06-02T04:49:36.218470+0000","last_clean":"2024-06-02T04:49:36.218470+0000","last_became_active":"2024-06-02T04:48:02.691169+0000","last_became_peered":"2024-06-02T04:48:02.691169+0000","last_unstale":"2024-06-02T04:49:36.218470+0000","last_undegraded":"2024-06-02T04:49:36.218470+0000","last_fullsized":"2024-06-02T04:49:36.218470+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T06:03:54.513910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":483,"ondisk_log_size":483,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":280790,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":69415,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":450,"num_read_kb":302,"num_write":163,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":425984,"data_stored":205097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":145,"ondisk_log_size":145,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":71,"seq":304942678044,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":905216,"data_stored":460853,"data_compressed":17559,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 04:49:34 2024","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.57399999999999995,"15min":0.51900000000000002},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":9.5549999999999997,"5min":9.5549999999999997,"15min":9.5549999999999997},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.65800000000000003,"15min":0.60899999999999999},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":9.5749999999999993,"5min":9.5749999999999993,"15min":9.5749999999999993},"last":0.55600000000000005}]},{"osd":1,"last update":"Sun Jun 2 04:49:34 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.59799999999999998,"15min":0.59999999999999998},"min":{"1min":0.42899999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.77400000000000002,"5min":0.998,"15min":0.998},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.439,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.68999999999999995,"5min":1.052,"15min":1.052},"last":0.753}]},{"osd":2,"last update":"Sun Jun 2 04:49:34 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.44600000000000001,"15min":0.438},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.45000000000000001,"15min":0.44400000000000001},"min":{"1min":0.32200000000000001,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.59799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":4,"last update":"Sun Jun 2 04:49:34 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.61299999999999999,"15min":0.61099999999999999},"min":{"1min":0.498,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.78800000000000003,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.627,"5min":0.59399999999999997,"15min":0.58799999999999997},"min":{"1min":0.51500000000000001,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.65300000000000002}]},{"osd":5,"last update":"Sun Jun 2 04:49:34 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.54800000000000004,"15min":0.54300000000000004},"min":{"1min":0.39000000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.76700000000000002,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.38400000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.53300000000000003}]},{"osd":6,"last update":"Sun Jun 2 04:49:34 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.626,"15min":0.63300000000000001},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.88700000000000001,"5min":1.159,"15min":1.159},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.68300000000000005,"15min":0.68899999999999995},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.86899999999999999,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.66400000000000003}]},{"osd":7,"last update":"Sun Jun 2 04:49:34 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.68799999999999994,"15min":0.68999999999999995},"min":{"1min":0.51000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.872,"5min":1.075,"15min":1.075},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.69099999999999995,"15min":0.69299999999999995},"min":{"1min":0.498,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.88300000000000001,"5min":1.123,"15min":1.123},"last":0.70899999999999996}]},{"osd":8,"last update":"Sun Jun 2 04:49:02 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.78300000000000003}]},{"osd":9,"last update":"Sun Jun 2 04:49:34 2024","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.77200000000000002,"15min":0.751},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":4.452,"5min":4.452,"15min":4.452},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.73999999999999999,"15min":0.745},"min":{"1min":0.52800000000000002,"5min":0.505,"15min":0.505},"max":{"1min":0.94699999999999995,"5min":1.429,"15min":1.429},"last":0.83799999999999997}]},{"osd":10,"last update":"Sun Jun 2 04:49:34 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.70399999999999996,"15min":0.70299999999999996},"min":{"1min":0.52200000000000002,"5min":0.505,"15min":0.505},"max":{"1min":0.92700000000000005,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.75,"15min":0.748},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.93300000000000005,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.82699999999999996}]}]},{"osd":10,"up_from":64,"seq":274877906977,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32140,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713012,"statfs":{"total":95995035648,"available":95962124288,"internally_reserved":0,"allocated":1052672,"data_stored":1113581,"data_compressed":53272,"data_compressed_allocated":69632,"data_compressed_original":638976,"omap_allocated":1599,"internal_metadata":31848897},"hb_peers":[0,1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 04:49:06 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.69799999999999995}]},{"osd":1,"last update":"Sun Jun 2 04:49:19 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.44900000000000001,"15min":0.44400000000000001},"min":{"1min":0.33500000000000002,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.625,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.502,"5min":0.47599999999999998,"15min":0.47199999999999998},"min":{"1min":0.28899999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.72199999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.34399999999999997}]},{"osd":2,"last update":"Sun Jun 2 04:49:19 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.627,"15min":0.629},"min":{"1min":0.441,"5min":0.375,"15min":0.375},"max":{"1min":0.72499999999999998,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.623,"15min":0.621},"min":{"1min":0.50600000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.78200000000000003,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.54400000000000004}]},{"osd":3,"last update":"Sun Jun 2 04:49:19 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.55300000000000005,"15min":0.55500000000000005},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.71099999999999997,"5min":0.879,"15min":0.879},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.59399999999999997,"15min":0.58599999999999997},"min":{"1min":0.432,"5min":0.377,"15min":0.377},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.57099999999999995}]},{"osd":4,"last update":"Sun Jun 2 04:49:19 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.56999999999999995,"15min":0.56200000000000006},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.53900000000000003,"15min":0.53500000000000003},"min":{"1min":0.33500000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.42499999999999999}]},{"osd":5,"last update":"Sun Jun 2 04:49:19 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.67800000000000005,"15min":0.67400000000000004},"min":{"1min":0.57299999999999995,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.67500000000000004,"15min":0.67700000000000005},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.80400000000000005,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.505}]},{"osd":6,"last update":"Sun Jun 2 04:49:19 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.61499999999999999,"15min":0.61199999999999999},"min":{"1min":0.40300000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.84899999999999998,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.68899999999999995,"15min":0.68300000000000005},"min":{"1min":0.51700000000000002,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.91300000000000003,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.70999999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":8,"last update":"Sun Jun 2 04:49:19 2024","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.77500000000000002,"15min":0.77200000000000002},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.751,"15min":0.753},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.73999999999999999}]},{"osd":9,"last update":"Sun Jun 2 04:49:19 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.745,"15min":0.74199999999999999},"min":{"1min":0.55300000000000005,"5min":0.441,"15min":0.441},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.72199999999999998,"15min":0.72299999999999998},"min":{"1min":0.51000000000000001,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.95899999999999996,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.78500000000000003}]},{"osd":11,"last update":"Sun Jun 2 04:49:36 2024","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.79200000000000004,"15min":0.78800000000000003},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.751},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.76600000000000001}]}]},{"osd":9,"up_from":60,"seq":257698037796,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32020,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713132,"statfs":{"total":95995035648,"available":95962247168,"internally_reserved":0,"allocated":925696,"data_stored":465185,"data_compressed":17559,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1599,"internal_metadata":31848897},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 04:49:00 2024","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.439,"15min":0.45200000000000001},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.51600000000000001,"5min":0.621,"15min":0.621},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.443,"15min":0.46000000000000002},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.45400000000000001,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.39500000000000002}]},{"osd":1,"last update":"Sun Jun 2 04:49:00 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.59899999999999998,"15min":0.60699999999999998},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.74199999999999999,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.61299999999999999,"15min":0.625},"min":{"1min":0.41599999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.72599999999999998,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.42599999999999999}]},{"osd":2,"last update":"Sun Jun 2 04:49:00 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.60699999999999998,"15min":0.62},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.68999999999999995,"5min":0.748,"15min":0.748},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.57699999999999996,"15min":0.58499999999999996},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.72799999999999998,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.31900000000000001}]},{"osd":3,"last update":"Sun Jun 2 04:49:00 2024","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.51800000000000002,"15min":0.53900000000000003},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.52000000000000002,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.55900000000000005,"15min":0.58099999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.45100000000000001}]},{"osd":4,"last update":"Sun Jun 2 04:49:00 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.60799999999999998,"15min":0.621},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.71099999999999997,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.64900000000000002,"15min":0.65900000000000003},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.79500000000000004,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.50800000000000001}]},{"osd":5,"last update":"Sun Jun 2 04:49:00 2024","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.60399999999999998,"15min":0.61699999999999999},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.71299999999999997,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.67100000000000004,"15min":0.68300000000000005},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.74099999999999999,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.56000000000000005}]},{"osd":6,"last update":"Sun Jun 2 04:47:56 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.505}]},{"osd":7,"last update":"Sun Jun 2 04:49:00 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.75900000000000001,"15min":0.78500000000000003},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.82299999999999995,"5min":1.081,"15min":1.081},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.73999999999999999,"15min":0.76100000000000001},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.83599999999999997,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.52800000000000002}]},{"osd":8,"last update":"Sun Jun 2 04:49:00 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.76000000000000001,"15min":0.78400000000000003},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.79900000000000004,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.498},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.73599999999999999,"15min":0.75800000000000001},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.80700000000000005,"5min":1.01,"15min":1.01},"last":0.51700000000000002}]},{"osd":10,"last update":"Sun Jun 2 04:49:14 2024","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.73199999999999998,"15min":0.74399999999999999},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.86199999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.69599999999999995,"15min":0.70999999999999996},"min":{"1min":0.48299999999999998,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.78600000000000003,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.58099999999999996}]},{"osd":11,"last update":"Sun Jun 2 04:49:06 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.61399999999999999}]}]},{"osd":8,"up_from":53,"seq":227633266727,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":917504,"data_stored":460678,"data_compressed":17559,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 04:48:38 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.54600000000000004,"15min":0.54300000000000004},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.77300000000000002,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.52800000000000002,"15min":0.52400000000000002},"min":{"1min":0.45900000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.41999999999999998}]},{"osd":1,"last update":"Sun Jun 2 04:48:38 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.53900000000000003,"15min":0.53300000000000003},"min":{"1min":0.36899999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.64400000000000002}]},{"osd":2,"last update":"Sun Jun 2 04:48:38 2024","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.42699999999999999,"15min":0.42299999999999999},"min":{"1min":0.311,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.437,"15min":0.433},"min":{"1min":0.26900000000000002,"5min":0.245,"15min":0.245},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.38900000000000001}]},{"osd":3,"last update":"Sun Jun 2 04:48:38 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.53500000000000003,"15min":0.52900000000000003},"min":{"1min":0.35099999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.56100000000000005,"15min":0.55700000000000005},"min":{"1min":0.41199999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.72999999999999998,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.439}]},{"osd":4,"last update":"Sun Jun 2 04:48:38 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.56999999999999995,"15min":0.56799999999999995},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.40999999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.76100000000000001,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.72699999999999998}]},{"osd":5,"last update":"Sun Jun 2 04:48:38 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.52500000000000002,"15min":0.52100000000000002},"min":{"1min":0.33100000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.80800000000000005,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.53500000000000003,"15min":0.53100000000000003},"min":{"1min":0.379,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.82199999999999995,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.50900000000000001}]},{"osd":6,"last update":"Sun Jun 2 04:48:38 2024","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.628,"15min":0.625},"min":{"1min":0.5,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.79100000000000004,"5min":0.876,"15min":0.876},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.63200000000000001,"15min":0.628},"min":{"1min":0.40600000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.84099999999999997,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.622}]},{"osd":7,"last update":"Sun Jun 2 04:48:38 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.66400000000000003,"15min":0.65900000000000003},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.91000000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.67300000000000004,"15min":0.66700000000000004},"min":{"1min":0.50900000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.67800000000000005}]},{"osd":9,"last update":"Sun Jun 2 04:48:59 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.67100000000000004,"15min":0.66100000000000003},"min":{"1min":0.51600000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.68999999999999995,"15min":0.68500000000000005},"min":{"1min":0.47099999999999997,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.91800000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.69099999999999995}]},{"osd":10,"last update":"Sun Jun 2 04:49:18 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.72999999999999998,"15min":0.72399999999999998},"min":{"1min":0.58199999999999996,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.92600000000000005,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.751,"5min":0.73799999999999999,"15min":0.73599999999999999},"min":{"1min":0.60699999999999998,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.94099999999999995,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.75600000000000001}]},{"osd":11,"last update":"Sun Jun 2 04:49:04 2024","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.745}]}]},{"osd":7,"up_from":46,"seq":197568495659,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32068,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713084,"statfs":{"total":95995035648,"available":95962198016,"internally_reserved":0,"allocated":970752,"data_stored":1057217,"data_compressed":53272,"data_compressed_allocated":69632,"data_compressed_original":638976,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 04:47:20 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.30199999999999999}]},{"osd":1,"last update":"Sun Jun 2 04:49:25 2024","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.29499999999999998,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.60099999999999998,"5min":0.746,"15min":0.746},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.435,"5min":0.433,"15min":0.42299999999999999},"min":{"1min":0.29399999999999998,"5min":0.253,"15min":0.253},"max":{"1min":0.56599999999999995,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.42499999999999999}]},{"osd":2,"last update":"Sun Jun 2 04:49:25 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58299999999999996,"15min":0.57299999999999995},"min":{"1min":0.38400000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.745,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.621,"5min":0.59199999999999997,"15min":0.57699999999999996},"min":{"1min":0.39300000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.78500000000000003,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.54200000000000004}]},{"osd":3,"last update":"Sun Jun 2 04:49:25 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.58599999999999997,"15min":0.58699999999999997},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.77500000000000002,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.56699999999999995,"15min":0.55900000000000005},"min":{"1min":0.38200000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.66500000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.65100000000000002}]},{"osd":4,"last update":"Sun Jun 2 04:49:25 2024","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.44400000000000001,"15min":0.438},"min":{"1min":0.312,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.53700000000000003,"15min":0.53500000000000003},"min":{"1min":0.38400000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.71899999999999997,"5min":0.879,"15min":0.879},"last":0.52200000000000002}]},{"osd":5,"last update":"Sun Jun 2 04:49:25 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.60599999999999998,"15min":0.59699999999999998},"min":{"1min":0.41899999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.81699999999999995,"5min":0.873,"15min":0.873},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.66200000000000003,"15min":0.66000000000000003},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.85099999999999998,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.60899999999999999}]},{"osd":6,"last update":"Sun Jun 2 04:49:25 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.625,"15min":0.623},"min":{"1min":0.40300000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.75800000000000001,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.61899999999999999,"15min":0.61199999999999999},"min":{"1min":0.45200000000000001,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.83299999999999996,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.57499999999999996}]},{"osd":8,"last update":"Sun Jun 2 04:48:42 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.70799999999999996,"15min":0.69799999999999995},"min":{"1min":0.54500000000000004,"5min":0.441,"15min":0.441},"max":{"1min":1.0069999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.66900000000000004,"15min":0.66000000000000003},"min":{"1min":0.55400000000000005,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.61799999999999999}]},{"osd":9,"last update":"Sun Jun 2 04:48:57 2024","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.72599999999999998,"15min":0.72799999999999998},"min":{"1min":0.51600000000000001,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.97399999999999998,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.70699999999999996,"15min":0.70899999999999996},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.879,"5min":1.042,"15min":1.042},"last":0.68100000000000005}]},{"osd":10,"last update":"Sun Jun 2 04:49:20 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.70899999999999996,"15min":0.71899999999999997},"min":{"1min":0.46999999999999997,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.83299999999999996,"5min":1.012,"15min":1.012},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.72399999999999998,"15min":0.72999999999999998},"min":{"1min":0.49199999999999999,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.878,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.71599999999999997}]},{"osd":11,"last update":"Sun Jun 2 04:49:04 2024","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.70499999999999996}]}]},{"osd":6,"up_from":40,"seq":171798691886,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":901120,"data_stored":456265,"data_compressed":17559,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 04:49:08 2024","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.40100000000000002,"15min":0.39200000000000002},"min":{"1min":0.28599999999999998,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":1.956,"5min":1.956,"15min":1.956},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.40899999999999997,"15min":0.41299999999999998},"min":{"1min":0.29899999999999999,"5min":0.251,"15min":0.251},"max":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":0.32200000000000001}]},{"osd":1,"last update":"Sun Jun 2 04:49:08 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.40600000000000003,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.034,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.627,"15min":0.59999999999999998},"min":{"1min":0.39700000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":6.0759999999999996,"5min":6.0759999999999996,"15min":6.0759999999999996},"last":0.45700000000000002}]},{"osd":2,"last update":"Sun Jun 2 04:49:08 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.57799999999999996,"15min":0.57299999999999995},"min":{"1min":0.38900000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.63400000000000001,"15min":0.59999999999999998},"min":{"1min":0.371,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":6.2229999999999999,"5min":6.2229999999999999,"15min":6.2229999999999999},"last":0.503}]},{"osd":3,"last update":"Sun Jun 2 04:49:08 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.505,"15min":0.47499999999999998},"min":{"1min":0.29799999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":6.2789999999999999,"5min":6.2789999999999999,"15min":6.2789999999999999},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.47999999999999998,"15min":0.47599999999999998},"min":{"1min":0.34100000000000003,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.984,"5min":1.984,"15min":1.984},"last":0.39100000000000001}]},{"osd":4,"last update":"Sun Jun 2 04:49:08 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.59799999999999998,"15min":0.60299999999999998},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.88200000000000001,"5min":1.032,"15min":1.032},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.67000000000000004,"15min":0.65300000000000002},"min":{"1min":0.38700000000000001,"5min":0.373,"15min":0.373},"max":{"1min":6.1280000000000001,"5min":6.1280000000000001,"15min":6.1280000000000001},"last":0.47599999999999998}]},{"osd":5,"last update":"Sun Jun 2 04:49:08 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.629,"15min":0.625},"min":{"1min":0.436,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.8540000000000001,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64300000000000002,"15min":0.65100000000000002},"min":{"1min":0.40999999999999998,"5min":0.379,"15min":0.379},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.57599999999999996}]},{"osd":7,"last update":"Sun Jun 2 04:49:27 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.63200000000000001,"15min":0.63800000000000001},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.68700000000000006,"15min":0.66300000000000003},"min":{"1min":0.41999999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":6.1609999999999996,"5min":6.1609999999999996,"15min":6.1609999999999996},"last":0.436}]},{"osd":8,"last update":"Sun Jun 2 04:48:39 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.68500000000000005,"15min":0.68000000000000005},"min":{"1min":0.501,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.897,"5min":1.897,"15min":1.897},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.69699999999999995,"15min":0.69899999999999995},"min":{"1min":0.47299999999999998,"5min":0.443,"15min":0.443},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.52600000000000002}]},{"osd":9,"last update":"Sun Jun 2 04:49:00 2024","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.65500000000000003,"15min":0.62},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":6.2530000000000001,"5min":6.2530000000000001,"15min":6.2530000000000001},"last":0.40300000000000002},{"interface":"front","average":{"1min":1.2110000000000001,"5min":0.71999999999999997,"15min":0.63800000000000001},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":12.939,"5min":12.939,"15min":12.939},"last":0.54100000000000004}]},{"osd":10,"last update":"Sun Jun 2 04:49:19 2024","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.68500000000000005,"15min":0.67900000000000005},"min":{"1min":0.56399999999999995,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.73199999999999998,"15min":0.69299999999999995},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":6.1929999999999996,"5min":6.1929999999999996,"15min":6.1929999999999996},"last":0.51900000000000002}]},{"osd":11,"last update":"Sun Jun 2 04:49:08 2024","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.929,"5min":1.929,"15min":1.929},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.621}]}]},{"osd":1,"up_from":12,"seq":51539607616,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36156,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708996,"statfs":{"total":95995035648,"available":95958011904,"internally_reserved":0,"allocated":970752,"data_stored":520669,"data_compressed":17559,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 04:48:46 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.51100000000000001,"15min":0.49099999999999999},"min":{"1min":0.32100000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.85599999999999998,"5min":1.131,"15min":1.131},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.50600000000000001,"15min":0.49099999999999999},"min":{"1min":0.32700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.47499999999999998}]},{"osd":2,"last update":"Sun Jun 2 04:49:00 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.52300000000000002,"15min":0.51400000000000001},"min":{"1min":0.40799999999999997,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.72999999999999998,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.53700000000000003,"15min":0.51100000000000001},"min":{"1min":0.38800000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.79700000000000004,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.58199999999999996}]},{"osd":3,"last update":"Sun Jun 2 04:49:17 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.54600000000000004,"15min":0.503},"min":{"1min":0.36899999999999999,"5min":0.316,"15min":0.316},"max":{"1min":3.2509999999999999,"5min":3.2509999999999999,"15min":3.2509999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51200000000000001,"15min":0.504},"min":{"1min":0.376,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.70499999999999996,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.50800000000000001}]},{"osd":4,"last update":"Sun Jun 2 04:49:03 2024","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.41099999999999998}]},{"osd":5,"last update":"Sun Jun 2 04:48:54 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.56000000000000005,"15min":0.54100000000000004},"min":{"1min":0.41999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.78000000000000003,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.624,"15min":0.59999999999999998},"min":{"1min":0.441,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.88300000000000001,"5min":1.212,"15min":1.212},"last":0.67500000000000004}]},{"osd":6,"last update":"Sun Jun 2 04:49:12 2024","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.61699999999999999,"15min":0.59699999999999998},"min":{"1min":0.45900000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.90300000000000002,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.75},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.61299999999999999,"15min":0.59699999999999998},"min":{"1min":0.44700000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.91600000000000004,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.70199999999999996}]},{"osd":7,"last update":"Sun Jun 2 04:49:28 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.53500000000000003,"15min":0.53700000000000003},"min":{"1min":0.36299999999999999,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.70399999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59099999999999997,"15min":0.58299999999999996},"min":{"1min":0.40100000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.77600000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.76600000000000001}]},{"osd":8,"last update":"Sun Jun 2 04:48:41 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.67300000000000004,"15min":0.67400000000000004},"min":{"1min":0.45700000000000002,"5min":0.435,"15min":0.435},"max":{"1min":0.85399999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72899999999999998,"15min":0.72999999999999998},"min":{"1min":0.46600000000000003,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.97499999999999998,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.84499999999999997}]},{"osd":9,"last update":"Sun Jun 2 04:49:00 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.52700000000000002,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.95399999999999996,"5min":1.288,"15min":1.288},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.71399999999999997,"15min":0.70999999999999996},"min":{"1min":0.56999999999999995,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.80700000000000005}]},{"osd":10,"last update":"Sun Jun 2 04:49:17 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.65800000000000003,"15min":0.65700000000000003},"min":{"1min":0.49199999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.84099999999999997,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.751,"5min":0.746,"15min":0.745},"min":{"1min":0.60099999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.86299999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.79500000000000004}]},{"osd":11,"last update":"Sun Jun 2 04:49:03 2024","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.86499999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738434,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32016,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713136,"statfs":{"total":95995035648,"available":95962251264,"internally_reserved":0,"allocated":925696,"data_stored":457653,"data_compressed":17559,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jun 2 04:48:43 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.51000000000000001,"15min":0.46999999999999997},"min":{"1min":0.35199999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.51000000000000001,"15min":0.46500000000000002},"min":{"1min":0.32000000000000001,"5min":0.315,"15min":0.315},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.51200000000000001}]},{"osd":2,"last update":"Sun Jun 2 04:49:03 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.52000000000000002,"15min":0.47599999999999998},"min":{"1min":0.46000000000000002,"5min":0.314,"15min":0.314},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.54000000000000004,"15min":0.48699999999999999},"min":{"1min":0.42599999999999999,"5min":0.307,"15min":0.307},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.63}]},{"osd":3,"last update":"Sun Jun 2 04:49:03 2024","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.31900000000000001}]},{"osd":4,"last update":"Sun Jun 2 04:48:37 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.54800000000000004,"15min":0.52100000000000002},"min":{"1min":0.38200000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.53800000000000003,"15min":0.52400000000000002},"min":{"1min":0.42599999999999999,"5min":0.372,"15min":0.372},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.53800000000000003}]},{"osd":5,"last update":"Sun Jun 2 04:48:52 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.57199999999999995,"15min":0.53900000000000003},"min":{"1min":0.377,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.57299999999999995,"15min":0.54100000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.61799999999999999}]},{"osd":6,"last update":"Sun Jun 2 04:49:09 2024","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.48499999999999999,"15min":0.49099999999999999},"min":{"1min":0.30099999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.47399999999999998,"15min":0.46999999999999997},"min":{"1min":0.33000000000000002,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.441}]},{"osd":7,"last update":"Sun Jun 2 04:49:09 2024","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.71099999999999997}]},{"osd":8,"last update":"Sun Jun 2 04:48:41 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.64200000000000002,"15min":0.64500000000000002},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.70299999999999996,"15min":0.70699999999999996},"min":{"1min":0.54500000000000004,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.67600000000000005}]},{"osd":9,"last update":"Sun Jun 2 04:48:57 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.627,"15min":0.63700000000000001},"min":{"1min":0.36699999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.60799999999999998,"15min":0.60999999999999999},"min":{"1min":0.39600000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.56599999999999995}]},{"osd":10,"last update":"Sun Jun 2 04:49:18 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.68899999999999995,"15min":0.68600000000000005},"min":{"1min":0.52300000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.67700000000000005,"15min":0.68100000000000005},"min":{"1min":0.52500000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.69899999999999995}]},{"osd":11,"last update":"Sun Jun 2 04:49:35 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.66700000000000004,"15min":0.66900000000000004},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.72299999999999998,"15min":0.72599999999999998},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.76300000000000001}]}]},{"osd":2,"up_from":16,"seq":68719476796,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32084,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713068,"statfs":{"total":95995035648,"available":95962181632,"internally_reserved":0,"allocated":991232,"data_stored":517321,"data_compressed":17559,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 04:49:07 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.51700000000000002,"15min":0.49299999999999999},"min":{"1min":0.434,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.51100000000000001,"15min":0.51000000000000001},"min":{"1min":0.39500000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.70099999999999996,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.63300000000000001}]},{"osd":1,"last update":"Sun Jun 2 04:49:07 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.56100000000000005,"15min":0.53700000000000003},"min":{"1min":0.46200000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.57699999999999996,"15min":0.55600000000000005},"min":{"1min":0.40899999999999997,"5min":0.254,"15min":0.254},"max":{"1min":0.92000000000000004,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.61899999999999999}]},{"osd":3,"last update":"Sun Jun 2 04:49:22 2024","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.43099999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.79400000000000004,"5min":1.472,"15min":1.472},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.62,"5min":0.55100000000000005,"15min":0.53300000000000003},"min":{"1min":0.48099999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.77400000000000002,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.503}]},{"osd":4,"last update":"Sun Jun 2 04:49:02 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.44900000000000001}]},{"osd":5,"last update":"Sun Jun 2 04:48:53 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.46400000000000002,"15min":0.42599999999999999},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.48499999999999999,"15min":0.45300000000000001},"min":{"1min":0.34100000000000003,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.56200000000000006}]},{"osd":6,"last update":"Sun Jun 2 04:49:07 2024","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.60199999999999998,"15min":0.59299999999999997},"min":{"1min":0.441,"5min":0.372,"15min":0.372},"max":{"1min":0.90400000000000003,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.67100000000000004,"15min":0.64300000000000002},"min":{"1min":0.66900000000000004,"5min":0.438,"15min":0.438},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.66200000000000003}]},{"osd":7,"last update":"Sun Jun 2 04:49:07 2024","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.72099999999999997}]},{"osd":8,"last update":"Sun Jun 2 04:48:42 2024","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.56699999999999995,"15min":0.56100000000000005},"min":{"1min":0.42399999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.63100000000000001,"15min":0.621},"min":{"1min":0.41499999999999998,"5min":0.37,"15min":0.37},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.745}]},{"osd":9,"last update":"Sun Jun 2 04:49:02 2024","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.65700000000000003,"15min":0.64600000000000002},"min":{"1min":0.52400000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.75900000000000001,"15min":0.747},"min":{"1min":0.66600000000000004,"5min":0.5,"15min":0.5},"max":{"1min":0.99299999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.76900000000000002}]},{"osd":10,"last update":"Sun Jun 2 04:49:17 2024","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.68799999999999994,"15min":0.66900000000000004},"min":{"1min":0.60899999999999999,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.72899999999999998,"15min":0.71499999999999997},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.75600000000000001}]},{"osd":11,"last update":"Sun Jun 2 04:49:02 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.73399999999999999}]}]},{"osd":3,"up_from":22,"seq":94489280568,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32004,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713148,"statfs":{"total":95995035648,"available":95962263552,"internally_reserved":0,"allocated":913408,"data_stored":456459,"data_compressed":17559,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 04:49:22 2024","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":0.46899999999999997,"15min":0.35999999999999999},"min":{"1min":0.26700000000000002,"5min":0.221,"15min":0.221},"max":{"1min":11.061999999999999,"5min":11.061999999999999,"15min":11.061999999999999},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.35999999999999999,"15min":0.34399999999999997},"min":{"1min":0.27500000000000002,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.31}]},{"osd":1,"last update":"Sun Jun 2 04:49:22 2024","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.58399999999999996,"15min":0.496},"min":{"1min":0.35699999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":7.3600000000000003,"5min":7.3600000000000003,"15min":7.3600000000000003},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.51100000000000001,"15min":0.46899999999999997},"min":{"1min":0.38200000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.53300000000000003}]},{"osd":2,"last update":"Sun Jun 2 04:49:22 2024","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.56100000000000005,"15min":0.56399999999999995},"min":{"1min":0.40300000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.3420000000000001,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.65000000000000002,"15min":0.61499999999999999},"min":{"1min":0.41299999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":7.2869999999999999,"5min":7.2869999999999999,"15min":7.2869999999999999},"last":0.443}]},{"osd":4,"last update":"Sun Jun 2 04:48:38 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.51400000000000001,"15min":0.499},"min":{"1min":0.41599999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.67300000000000004,"5min":0.877,"15min":0.877},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.52600000000000002,"15min":0.505},"min":{"1min":0.40999999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.72299999999999998,"5min":0.751,"15min":0.751},"last":0.47599999999999998}]},{"osd":5,"last update":"Sun Jun 2 04:48:54 2024","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.63400000000000001,"15min":0.57999999999999996},"min":{"1min":0.38900000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":7.3220000000000001,"5min":7.3220000000000001,"15min":7.3220000000000001},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55300000000000005,"15min":0.54900000000000004},"min":{"1min":0.39800000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.90000000000000002,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.46300000000000002}]},{"osd":6,"last update":"Sun Jun 2 04:49:08 2024","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":0.61099999999999999,"15min":0.51500000000000001},"min":{"1min":0.36299999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":11.128,"5min":11.128,"15min":11.128},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.55900000000000005,"15min":0.5},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":7.6159999999999997,"5min":7.6159999999999997,"15min":7.6159999999999997},"last":0.32700000000000001}]},{"osd":7,"last update":"Sun Jun 2 04:49:29 2024","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.67900000000000005,"15min":0.63200000000000001},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":7.3869999999999996,"5min":7.3869999999999996,"15min":7.3869999999999996},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64700000000000002,"15min":0.65100000000000002},"min":{"1min":0.46000000000000002,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.60199999999999998}]},{"osd":8,"last update":"Sun Jun 2 04:47:39 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.51100000000000001}]},{"osd":9,"last update":"Sun Jun 2 04:49:03 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.58299999999999996,"15min":0.58899999999999997},"min":{"1min":0.41899999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.72599999999999998,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.504},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.66000000000000003,"15min":0.60899999999999999},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":7.2389999999999999,"5min":7.2389999999999999,"15min":7.2389999999999999},"last":0.36599999999999999}]},{"osd":10,"last update":"Sun Jun 2 04:49:17 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.68200000000000005,"15min":0.68400000000000005},"min":{"1min":0.54800000000000004,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.871,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.68000000000000005,"15min":0.67500000000000004},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.63400000000000001}]},{"osd":11,"last update":"Sun Jun 2 04:49:03 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.54300000000000004}]}]},{"osd":4,"up_from":29,"seq":124554051637,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32012,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713140,"statfs":{"total":95995035648,"available":95962255360,"internally_reserved":0,"allocated":913408,"data_stored":461260,"data_compressed":17559,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 04:47:31 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.49199999999999999,"15min":0.48099999999999998},"min":{"1min":0.32400000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.495,"15min":0.48699999999999999},"min":{"1min":0.35199999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.78900000000000003,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.34300000000000003}]},{"osd":1,"last update":"Sun Jun 2 04:48:33 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.36099999999999999,"15min":0.34300000000000003},"min":{"1min":0.27500000000000002,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.38900000000000001,"15min":0.36699999999999999},"min":{"1min":0.30199999999999999,"5min":0.217,"15min":0.217},"max":{"1min":0.72799999999999998,"5min":0.877,"15min":0.877},"last":0.47999999999999998}]},{"osd":2,"last update":"Sun Jun 2 04:48:33 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.53900000000000003,"15min":0.52800000000000002},"min":{"1min":0.41899999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.624,"5min":0.56399999999999995,"15min":0.53800000000000003},"min":{"1min":0.47099999999999997,"5min":0.377,"15min":0.377},"max":{"1min":0.80800000000000005,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.58299999999999996}]},{"osd":3,"last update":"Sun Jun 2 04:48:33 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.54000000000000004,"15min":0.51800000000000002},"min":{"1min":0.373,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.748},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.52000000000000002,"15min":0.51000000000000001},"min":{"1min":0.38100000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.72899999999999998,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.63700000000000001}]},{"osd":5,"last update":"Sun Jun 2 04:48:53 2024","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.60999999999999999,"15min":0.60199999999999998},"min":{"1min":0.46100000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.85499999999999998,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.621,"15min":0.59999999999999998},"min":{"1min":0.46500000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.96599999999999997,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.60599999999999998}]},{"osd":6,"last update":"Sun Jun 2 04:49:10 2024","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.58299999999999996,"15min":0.56100000000000005},"min":{"1min":0.441,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.59299999999999997,"15min":0.57699999999999996},"min":{"1min":0.41199999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.79500000000000004,"5min":1.03,"15min":1.03},"last":0.68000000000000005}]},{"osd":7,"last update":"Sun Jun 2 04:49:25 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.54000000000000004,"15min":0.52500000000000002},"min":{"1min":0.41599999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.57599999999999996,"15min":0.55500000000000005},"min":{"1min":0.40100000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.82199999999999995,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.66100000000000003}]},{"osd":8,"last update":"Sun Jun 2 04:48:40 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.60599999999999998,"15min":0.60399999999999998},"min":{"1min":0.45100000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.78200000000000003,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71499999999999997,"15min":0.71399999999999997},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.94399999999999995,"5min":1.071,"15min":1.071},"last":0.79500000000000004}]},{"osd":9,"last update":"Sun Jun 2 04:48:58 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.74099999999999999,"15min":0.745},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.62,"5min":0.64200000000000002,"15min":0.64600000000000002},"min":{"1min":0.47699999999999998,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.83999999999999997,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.73499999999999999}]},{"osd":10,"last update":"Sun Jun 2 04:49:16 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.748,"15min":0.75800000000000001},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.93100000000000005,"5min":1.071,"15min":1.071},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.76400000000000001,"15min":0.77000000000000002},"min":{"1min":0.52800000000000002,"5min":0.504,"15min":0.504},"max":{"1min":0.99399999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.83699999999999997}]},{"osd":11,"last update":"Sun Jun 2 04:49:02 2024","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.86499999999999999}]}]},{"osd":5,"up_from":33,"seq":141733920818,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":978944,"data_stored":1053081,"data_compressed":53272,"data_compressed_allocated":69632,"data_compressed_original":638976,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 04:48:50 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.504,"15min":0.48499999999999999},"min":{"1min":0.40200000000000002,"5min":0.249,"15min":0.249},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.496},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.47499999999999998,"15min":0.45100000000000001},"min":{"1min":0.374,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.47599999999999998}]},{"osd":1,"last update":"Sun Jun 2 04:48:50 2024","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.55300000000000005,"15min":0.52900000000000003},"min":{"1min":0.5,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.79500000000000004,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.55100000000000005,"15min":0.53500000000000003},"min":{"1min":0.47099999999999997,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.77900000000000003,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.625}]},{"osd":2,"last update":"Sun Jun 2 04:48:50 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.40999999999999998,"15min":0.39500000000000002},"min":{"1min":0.317,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.40899999999999997,"15min":0.38700000000000001},"min":{"1min":0.316,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.58099999999999996}]},{"osd":3,"last update":"Sun Jun 2 04:48:50 2024","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.53000000000000003,"15min":0.52000000000000002},"min":{"1min":0.38800000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.621,"5min":0.53900000000000003,"15min":0.51200000000000001},"min":{"1min":0.46100000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.80200000000000005,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.77000000000000002}]},{"osd":4,"last update":"Sun Jun 2 04:48:50 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.58199999999999996,"15min":0.55900000000000005},"min":{"1min":0.54200000000000004,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.58999999999999997,"15min":0.57599999999999996},"min":{"1min":0.54300000000000004,"5min":0.313,"15min":0.313},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.79400000000000004}]},{"osd":6,"last update":"Sun Jun 2 04:49:07 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.58899999999999997,"15min":0.57699999999999996},"min":{"1min":0.439,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.60799999999999998,"15min":0.58499999999999996},"min":{"1min":0.52800000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.875,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.95399999999999996}]},{"osd":7,"last update":"Sun Jun 2 04:49:23 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.67000000000000004,"15min":0.65900000000000003},"min":{"1min":0.56799999999999995,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.86199999999999999,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.752,"5min":0.67600000000000005,"15min":0.65400000000000003},"min":{"1min":0.45600000000000002,"5min":0.435,"15min":0.435},"max":{"1min":0.93300000000000005,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.81799999999999995}]},{"osd":8,"last update":"Sun Jun 2 04:48:43 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.60699999999999998,"15min":0.59099999999999997},"min":{"1min":0.42099999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.623,"15min":0.61599999999999999},"min":{"1min":0.39000000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.90000000000000002,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.75700000000000001}]},{"osd":9,"last update":"Sun Jun 2 04:49:04 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.65700000000000003,"15min":0.64500000000000002},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.69199999999999995,"15min":0.67600000000000005},"min":{"1min":0.60699999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.92300000000000004}]},{"osd":10,"last update":"Sun Jun 2 04:49:18 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.70499999999999996,"15min":0.69899999999999995},"min":{"1min":0.53700000000000003,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.92100000000000004,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.75},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.745,"15min":0.73399999999999999},"min":{"1min":0.66000000000000003,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.95499999999999996,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.85599999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34075,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34075,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34075,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35713,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35713,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35713,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35713,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35713,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":64494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":62420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":989,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":67038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-02T04:49:41.534 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-02T04:49:41.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:41 smithi119 ceph-mon[46633]: pgmap v269: 129 pgs: 129 active+clean; 645 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2024-06-02T04:49:41.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:41 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/1690317335' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-06-02T04:49:41.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:41 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/4053319646' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-06-02T04:49:41.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:41 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/2529040243' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:49:41.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:41 smithi192 ceph-mon[47933]: pgmap v269: 129 pgs: 129 active+clean; 645 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2024-06-02T04:49:41.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:41 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/1690317335' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-06-02T04:49:41.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:41 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/4053319646' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-06-02T04:49:41.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:41 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/2529040243' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:49:41.690 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.689+0000 7f13a2709700 1 -- 172.21.15.76:0/1907265240 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f139c100e80 msgr2=0x7f139c1012a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:41.690 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.689+0000 7f13a2709700 1 --2- 172.21.15.76:0/1907265240 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f139c100e80 0x7f139c1012a0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f138c009990 tx=0x7f138c009ca0 comp rx=0 tx=0).stop 2024-06-02T04:49:41.690 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.689+0000 7f13a2709700 1 -- 172.21.15.76:0/1907265240 shutdown_connections 2024-06-02T04:49:41.690 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.689+0000 7f13a2709700 1 --2- 172.21.15.76:0/1907265240 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f139c102990 0x7f139c1092b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:41.690 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.689+0000 7f13a2709700 1 --2- 172.21.15.76:0/1907265240 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f139c100e80 0x7f139c1012a0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:41.690 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.689+0000 7f13a2709700 1 --2- 172.21.15.76:0/1907265240 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f139c101fd0 0x7f139c102450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:41.690 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.689+0000 7f13a2709700 1 -- 172.21.15.76:0/1907265240 >> 172.21.15.76:0/1907265240 conn(0x7f139c0fc410 msgr2=0x7f139c0fe830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:41.691 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.689+0000 7f13a2709700 1 -- 172.21.15.76:0/1907265240 shutdown_connections 2024-06-02T04:49:41.691 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.689+0000 7f13a2709700 1 -- 172.21.15.76:0/1907265240 wait complete. 2024-06-02T04:49:41.691 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.690+0000 7f13a2709700 1 Processor -- start 2024-06-02T04:49:41.691 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.690+0000 7f13a2709700 1 -- start start 2024-06-02T04:49:41.693 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.690+0000 7f13a2709700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f139c100e80 0x7f139c196ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:41.693 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.690+0000 7f13a2709700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f139c101fd0 0x7f139c1971e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:41.693 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.690+0000 7f13a2709700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f139c102990 0x7f139c19e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:41.693 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.690+0000 7f13a2709700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f139c19e790 con 0x7f139c101fd0 2024-06-02T04:49:41.693 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.690+0000 7f13a2709700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f139c19e900 con 0x7f139c102990 2024-06-02T04:49:41.693 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.690+0000 7f13a2709700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f139c19eac0 con 0x7f139c100e80 2024-06-02T04:49:41.693 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.690+0000 7f139b7fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f139c101fd0 0x7f139c1971e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:41.693 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.690+0000 7f139b7fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f139c101fd0 0x7f139c1971e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:55198/0 (socket says 172.21.15.76:55198) 2024-06-02T04:49:41.693 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.690+0000 7f139b7fe700 1 -- 172.21.15.76:0/4015641592 learned_addr learned my addr 172.21.15.76:0/4015641592 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:49:41.694 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.691+0000 7f139bfff700 1 --2- 172.21.15.76:0/4015641592 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f139c100e80 0x7f139c196ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:41.694 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.691+0000 7f13a0ca6700 1 --2- 172.21.15.76:0/4015641592 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f139c102990 0x7f139c19e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:41.694 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.691+0000 7f139b7fe700 1 -- 172.21.15.76:0/4015641592 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f139c100e80 msgr2=0x7f139c196ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:41.694 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.691+0000 7f139b7fe700 1 --2- 172.21.15.76:0/4015641592 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f139c100e80 0x7f139c196ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:41.694 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.691+0000 7f139b7fe700 1 -- 172.21.15.76:0/4015641592 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f139c102990 msgr2=0x7f139c19e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:41.694 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.691+0000 7f139b7fe700 1 --2- 172.21.15.76:0/4015641592 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f139c102990 0x7f139c19e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:41.694 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.691+0000 7f139b7fe700 1 -- 172.21.15.76:0/4015641592 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f138c0095f0 con 0x7f139c101fd0 2024-06-02T04:49:41.694 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.691+0000 7f139b7fe700 1 --2- 172.21.15.76:0/4015641592 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f139c101fd0 0x7f139c1971e0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f139000c920 tx=0x7f139000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:41.694 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.691+0000 7f13997fa700 1 -- 172.21.15.76:0/4015641592 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1390004a30 con 0x7f139c101fd0 2024-06-02T04:49:41.694 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.691+0000 7f13997fa700 1 -- 172.21.15.76:0/4015641592 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f13900054b0 con 0x7f139c101fd0 2024-06-02T04:49:41.694 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.691+0000 7f13a2709700 1 -- 172.21.15.76:0/4015641592 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f139c19eda0 con 0x7f139c101fd0 2024-06-02T04:49:41.694 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.691+0000 7f13997fa700 1 -- 172.21.15.76:0/4015641592 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1390007ab0 con 0x7f139c101fd0 2024-06-02T04:49:41.694 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.691+0000 7f13a2709700 1 -- 172.21.15.76:0/4015641592 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f139c19f1f0 con 0x7f139c101fd0 2024-06-02T04:49:41.695 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.692+0000 7f13a2709700 1 -- 172.21.15.76:0/4015641592 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f139c108310 con 0x7f139c101fd0 2024-06-02T04:49:41.695 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.693+0000 7f13997fa700 1 -- 172.21.15.76:0/4015641592 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f1390007c50 con 0x7f139c101fd0 2024-06-02T04:49:41.695 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.694+0000 7f13997fa700 1 --2- 172.21.15.76:0/4015641592 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f13840a1120 0x7f13840a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:41.695 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.694+0000 7f139bfff700 1 --2- 172.21.15.76:0/4015641592 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f13840a1120 0x7f13840a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:41.696 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.694+0000 7f13997fa700 1 -- 172.21.15.76:0/4015641592 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f13900cc840 con 0x7f139c101fd0 2024-06-02T04:49:41.696 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.694+0000 7f139bfff700 1 --2- 172.21.15.76:0/4015641592 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f13840a1120 0x7f13840a35e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f138c00c010 tx=0x7f138c003720 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:41.698 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.698+0000 7f13997fa700 1 -- 172.21.15.76:0/4015641592 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f1390095c60 con 0x7f139c101fd0 2024-06-02T04:49:41.893 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.892+0000 7f13a2709700 1 -- 172.21.15.76:0/4015641592 --> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f139c02cf00 con 0x7f13840a1120 2024-06-02T04:49:41.905 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.905+0000 7f13997fa700 1 -- 172.21.15.76:0/4015641592 <== mgr.14152 v2:172.21.15.76:6800/2591353090 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+427459 (secure 0 0 0) 0x7f139c02cf00 con 0x7f13840a1120 2024-06-02T04:49:41.910 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:49:41.913 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.909+0000 7f13a2709700 1 -- 172.21.15.76:0/4015641592 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f13840a1120 msgr2=0x7f13840a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:41.913 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.909+0000 7f13a2709700 1 --2- 172.21.15.76:0/4015641592 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f13840a1120 0x7f13840a35e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f138c00c010 tx=0x7f138c003720 comp rx=0 tx=0).stop 2024-06-02T04:49:41.913 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.909+0000 7f13a2709700 1 -- 172.21.15.76:0/4015641592 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f139c101fd0 msgr2=0x7f139c1971e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:41.913 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.909+0000 7f13a2709700 1 --2- 172.21.15.76:0/4015641592 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f139c101fd0 0x7f139c1971e0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f139000c920 tx=0x7f139000cc30 comp rx=0 tx=0).stop 2024-06-02T04:49:41.913 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.909+0000 7f13a2709700 1 -- 172.21.15.76:0/4015641592 shutdown_connections 2024-06-02T04:49:41.913 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.909+0000 7f13a2709700 1 --2- 172.21.15.76:0/4015641592 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f13840a1120 0x7f13840a35e0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:41.913 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.909+0000 7f13a2709700 1 --2- 172.21.15.76:0/4015641592 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f139c102990 0x7f139c19e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:41.913 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.909+0000 7f13a2709700 1 --2- 172.21.15.76:0/4015641592 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f139c100e80 0x7f139c196ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:41.914 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.909+0000 7f13a2709700 1 --2- 172.21.15.76:0/4015641592 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f139c101fd0 0x7f139c1971e0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:41.914 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.909+0000 7f13a2709700 1 -- 172.21.15.76:0/4015641592 >> 172.21.15.76:0/4015641592 conn(0x7f139c0fc410 msgr2=0x7f139c105450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:41.914 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.909+0000 7f13a2709700 1 -- 172.21.15.76:0/4015641592 shutdown_connections 2024-06-02T04:49:41.914 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:41.909+0000 7f13a2709700 1 -- 172.21.15.76:0/4015641592 wait complete. 2024-06-02T04:49:41.914 INFO:teuthology.orchestra.run.smithi076.stderr:dumped all 2024-06-02T04:49:41.921 INFO:teuthology.orchestra.run.smithi076.stdout:{"pg_ready":true,"pg_map":{"version":269,"stamp":"2024-06-02T04:49:40.176092+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":660017,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":576,"num_read_kb":411,"num_write":346,"num_write_kb":3064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":1180736,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":767,"ondisk_log_size":767,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":372180,"kb_used_data":11100,"kb_used_omap":18,"kb_used_meta":360941,"kb_avail":1124569644,"statfs":{"total":1151940427776,"available":1151559315456,"internally_reserved":0,"allocated":11366400,"data_stored":7480222,"data_compressed":317847,"data_compressed_allocated":430080,"data_compressed_original":2359296,"omap_allocated":19131,"internal_metadata":369603909},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5664,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":52,"num_write":9,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003885"},"pg_stats":[{"pgid":"3.3f","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.217391+0000","last_change":"2024-06-02T04:48:02.689765+0000","last_active":"2024-06-02T04:49:36.217391+0000","last_peered":"2024-06-02T04:49:36.217391+0000","last_clean":"2024-06-02T04:49:36.217391+0000","last_became_active":"2024-06-02T04:48:02.689464+0000","last_became_peered":"2024-06-02T04:48:02.689464+0000","last_unstale":"2024-06-02T04:49:36.217391+0000","last_undegraded":"2024-06-02T04:49:36.217391+0000","last_fullsized":"2024-06-02T04:49:36.217391+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:13:19.743519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"82'4","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.201250+0000","last_change":"2024-06-02T04:48:02.691499+0000","last_active":"2024-06-02T04:49:36.201250+0000","last_peered":"2024-06-02T04:49:36.201250+0000","last_clean":"2024-06-02T04:49:36.201250+0000","last_became_active":"2024-06-02T04:48:02.691179+0000","last_became_peered":"2024-06-02T04:48:02.691179+0000","last_unstale":"2024-06-02T04:49:36.201250+0000","last_undegraded":"2024-06-02T04:49:36.201250+0000","last_fullsized":"2024-06-02T04:49:36.201250+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T14:00:17.118877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.212494+0000","last_change":"2024-06-02T04:48:02.688527+0000","last_active":"2024-06-02T04:49:36.212494+0000","last_peered":"2024-06-02T04:49:36.212494+0000","last_clean":"2024-06-02T04:49:36.212494+0000","last_became_active":"2024-06-02T04:48:02.688184+0000","last_became_peered":"2024-06-02T04:48:02.688184+0000","last_unstale":"2024-06-02T04:49:36.212494+0000","last_undegraded":"2024-06-02T04:49:36.212494+0000","last_fullsized":"2024-06-02T04:49:36.212494+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T08:40:35.052887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.870618+0000","last_change":"2024-06-02T04:48:02.695277+0000","last_active":"2024-06-02T04:49:06.870618+0000","last_peered":"2024-06-02T04:49:06.870618+0000","last_clean":"2024-06-02T04:49:06.870618+0000","last_became_active":"2024-06-02T04:48:02.694951+0000","last_became_peered":"2024-06-02T04:48:02.694951+0000","last_unstale":"2024-06-02T04:49:06.870618+0000","last_undegraded":"2024-06-02T04:49:06.870618+0000","last_fullsized":"2024-06-02T04:49:06.870618+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T14:13:50.672421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"82'4","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.211340+0000","last_change":"2024-06-02T04:48:02.691454+0000","last_active":"2024-06-02T04:49:36.211340+0000","last_peered":"2024-06-02T04:49:36.211340+0000","last_clean":"2024-06-02T04:49:36.211340+0000","last_became_active":"2024-06-02T04:48:02.691083+0000","last_became_peered":"2024-06-02T04:48:02.691083+0000","last_unstale":"2024-06-02T04:49:36.211340+0000","last_undegraded":"2024-06-02T04:49:36.211340+0000","last_fullsized":"2024-06-02T04:49:36.211340+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T07:12:58.481115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.205381+0000","last_change":"2024-06-02T04:48:02.690371+0000","last_active":"2024-06-02T04:49:36.205381+0000","last_peered":"2024-06-02T04:49:36.205381+0000","last_clean":"2024-06-02T04:49:36.205381+0000","last_became_active":"2024-06-02T04:48:02.682047+0000","last_became_peered":"2024-06-02T04:48:02.682047+0000","last_unstale":"2024-06-02T04:49:36.205381+0000","last_undegraded":"2024-06-02T04:49:36.205381+0000","last_fullsized":"2024-06-02T04:49:36.205381+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:17:59.717575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.200626+0000","last_change":"2024-06-02T04:48:02.697823+0000","last_active":"2024-06-02T04:49:36.200626+0000","last_peered":"2024-06-02T04:49:36.200626+0000","last_clean":"2024-06-02T04:49:36.200626+0000","last_became_active":"2024-06-02T04:48:02.697491+0000","last_became_peered":"2024-06-02T04:48:02.697491+0000","last_unstale":"2024-06-02T04:49:36.200626+0000","last_undegraded":"2024-06-02T04:49:36.200626+0000","last_fullsized":"2024-06-02T04:49:36.200626+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T16:08:39.689192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.204224+0000","last_change":"2024-06-02T04:48:02.702564+0000","last_active":"2024-06-02T04:49:36.204224+0000","last_peered":"2024-06-02T04:49:36.204224+0000","last_clean":"2024-06-02T04:49:36.204224+0000","last_became_active":"2024-06-02T04:48:02.702259+0000","last_became_peered":"2024-06-02T04:48:02.702259+0000","last_unstale":"2024-06-02T04:49:36.204224+0000","last_undegraded":"2024-06-02T04:49:36.204224+0000","last_fullsized":"2024-06-02T04:49:36.204224+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T12:33:28.945414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"82'11","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.216962+0000","last_change":"2024-06-02T04:48:02.694090+0000","last_active":"2024-06-02T04:49:36.216962+0000","last_peered":"2024-06-02T04:49:36.216962+0000","last_clean":"2024-06-02T04:49:36.216962+0000","last_became_active":"2024-06-02T04:48:02.693723+0000","last_became_peered":"2024-06-02T04:48:02.693723+0000","last_unstale":"2024-06-02T04:49:36.216962+0000","last_undegraded":"2024-06-02T04:49:36.216962+0000","last_fullsized":"2024-06-02T04:49:36.216962+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:33:26.628450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"82'16","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.217661+0000","last_change":"2024-06-02T04:48:02.702201+0000","last_active":"2024-06-02T04:49:36.217661+0000","last_peered":"2024-06-02T04:49:36.217661+0000","last_clean":"2024-06-02T04:49:36.217661+0000","last_became_active":"2024-06-02T04:48:02.701834+0000","last_became_peered":"2024-06-02T04:48:02.701834+0000","last_unstale":"2024-06-02T04:49:36.217661+0000","last_undegraded":"2024-06-02T04:49:36.217661+0000","last_fullsized":"2024-06-02T04:49:36.217661+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T08:22:24.009015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.205694+0000","last_change":"2024-06-02T04:48:02.700280+0000","last_active":"2024-06-02T04:49:36.205694+0000","last_peered":"2024-06-02T04:49:36.205694+0000","last_clean":"2024-06-02T04:49:36.205694+0000","last_became_active":"2024-06-02T04:48:02.699852+0000","last_became_peered":"2024-06-02T04:48:02.699852+0000","last_unstale":"2024-06-02T04:49:36.205694+0000","last_undegraded":"2024-06-02T04:49:36.205694+0000","last_fullsized":"2024-06-02T04:49:36.205694+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T16:45:28.228692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.870539+0000","last_change":"2024-06-02T04:48:02.689951+0000","last_active":"2024-06-02T04:49:06.870539+0000","last_peered":"2024-06-02T04:49:06.870539+0000","last_clean":"2024-06-02T04:49:06.870539+0000","last_became_active":"2024-06-02T04:48:02.689249+0000","last_became_peered":"2024-06-02T04:48:02.689249+0000","last_unstale":"2024-06-02T04:49:06.870539+0000","last_undegraded":"2024-06-02T04:49:06.870539+0000","last_fullsized":"2024-06-02T04:49:06.870539+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:09:43.620165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"82'10","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.212047+0000","last_change":"2024-06-02T04:48:02.691126+0000","last_active":"2024-06-02T04:49:36.212047+0000","last_peered":"2024-06-02T04:49:36.212047+0000","last_clean":"2024-06-02T04:49:36.212047+0000","last_became_active":"2024-06-02T04:48:02.690825+0000","last_became_peered":"2024-06-02T04:48:02.690825+0000","last_unstale":"2024-06-02T04:49:36.212047+0000","last_undegraded":"2024-06-02T04:49:36.212047+0000","last_fullsized":"2024-06-02T04:49:36.212047+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:03:36.461555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.206718+0000","last_change":"2024-06-02T04:48:02.692802+0000","last_active":"2024-06-02T04:49:36.206718+0000","last_peered":"2024-06-02T04:49:36.206718+0000","last_clean":"2024-06-02T04:49:36.206718+0000","last_became_active":"2024-06-02T04:48:02.692495+0000","last_became_peered":"2024-06-02T04:48:02.692495+0000","last_unstale":"2024-06-02T04:49:36.206718+0000","last_undegraded":"2024-06-02T04:49:36.206718+0000","last_fullsized":"2024-06-02T04:49:36.206718+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T14:57:10.991752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.207575+0000","last_change":"2024-06-02T04:48:02.702968+0000","last_active":"2024-06-02T04:49:36.207575+0000","last_peered":"2024-06-02T04:49:36.207575+0000","last_clean":"2024-06-02T04:49:36.207575+0000","last_became_active":"2024-06-02T04:48:02.702672+0000","last_became_peered":"2024-06-02T04:48:02.702672+0000","last_unstale":"2024-06-02T04:49:36.207575+0000","last_undegraded":"2024-06-02T04:49:36.207575+0000","last_fullsized":"2024-06-02T04:49:36.207575+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:04:38.385228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.213438+0000","last_change":"2024-06-02T04:48:02.701329+0000","last_active":"2024-06-02T04:49:36.213438+0000","last_peered":"2024-06-02T04:49:36.213438+0000","last_clean":"2024-06-02T04:49:36.213438+0000","last_became_active":"2024-06-02T04:48:02.701064+0000","last_became_peered":"2024-06-02T04:48:02.701064+0000","last_unstale":"2024-06-02T04:49:36.213438+0000","last_undegraded":"2024-06-02T04:49:36.213438+0000","last_fullsized":"2024-06-02T04:49:36.213438+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:28:06.265050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.218866+0000","last_change":"2024-06-02T04:48:02.688538+0000","last_active":"2024-06-02T04:49:36.218866+0000","last_peered":"2024-06-02T04:49:36.218866+0000","last_clean":"2024-06-02T04:49:36.218866+0000","last_became_active":"2024-06-02T04:48:02.688175+0000","last_became_peered":"2024-06-02T04:48:02.688175+0000","last_unstale":"2024-06-02T04:49:36.218866+0000","last_undegraded":"2024-06-02T04:49:36.218866+0000","last_fullsized":"2024-06-02T04:49:36.218866+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T07:30:47.310924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"82'10","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.201771+0000","last_change":"2024-06-02T04:48:02.688515+0000","last_active":"2024-06-02T04:49:36.201771+0000","last_peered":"2024-06-02T04:49:36.201771+0000","last_clean":"2024-06-02T04:49:36.201771+0000","last_became_active":"2024-06-02T04:48:02.688205+0000","last_became_peered":"2024-06-02T04:48:02.688205+0000","last_unstale":"2024-06-02T04:49:36.201771+0000","last_undegraded":"2024-06-02T04:49:36.201771+0000","last_fullsized":"2024-06-02T04:49:36.201771+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:20:05.829628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.200775+0000","last_change":"2024-06-02T04:48:02.688376+0000","last_active":"2024-06-02T04:49:36.200775+0000","last_peered":"2024-06-02T04:49:36.200775+0000","last_clean":"2024-06-02T04:49:36.200775+0000","last_became_active":"2024-06-02T04:48:02.688055+0000","last_became_peered":"2024-06-02T04:48:02.688055+0000","last_unstale":"2024-06-02T04:49:36.200775+0000","last_undegraded":"2024-06-02T04:49:36.200775+0000","last_fullsized":"2024-06-02T04:49:36.200775+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:55:41.327635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.866856+0000","last_change":"2024-06-02T04:48:06.713517+0000","last_active":"2024-06-02T04:49:06.866856+0000","last_peered":"2024-06-02T04:49:06.866856+0000","last_clean":"2024-06-02T04:49:06.866856+0000","last_became_active":"2024-06-02T04:48:06.713187+0000","last_became_peered":"2024-06-02T04:48:06.713187+0000","last_unstale":"2024-06-02T04:49:06.866856+0000","last_undegraded":"2024-06-02T04:49:06.866856+0000","last_fullsized":"2024-06-02T04:49:06.866856+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:11:46.598023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"80'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.871616+0000","last_change":"2024-06-02T04:48:02.271595+0000","last_active":"2024-06-02T04:49:06.871616+0000","last_peered":"2024-06-02T04:49:06.871616+0000","last_clean":"2024-06-02T04:49:06.871616+0000","last_became_active":"2024-06-02T04:48:02.271326+0000","last_became_peered":"2024-06-02T04:48:02.271326+0000","last_unstale":"2024-06-02T04:49:06.871616+0000","last_undegraded":"2024-06-02T04:49:06.871616+0000","last_fullsized":"2024-06-02T04:49:06.871616+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:23:31.096224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.202931+0000","last_change":"2024-06-02T04:48:02.696542+0000","last_active":"2024-06-02T04:49:36.202931+0000","last_peered":"2024-06-02T04:49:36.202931+0000","last_clean":"2024-06-02T04:49:36.202931+0000","last_became_active":"2024-06-02T04:48:02.696260+0000","last_became_peered":"2024-06-02T04:48:02.696260+0000","last_unstale":"2024-06-02T04:49:36.202931+0000","last_undegraded":"2024-06-02T04:49:36.202931+0000","last_fullsized":"2024-06-02T04:49:36.202931+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T06:28:04.097035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.867997+0000","last_change":"2024-06-02T04:48:06.713685+0000","last_active":"2024-06-02T04:49:06.867997+0000","last_peered":"2024-06-02T04:49:06.867997+0000","last_clean":"2024-06-02T04:49:06.867997+0000","last_became_active":"2024-06-02T04:48:06.713254+0000","last_became_peered":"2024-06-02T04:48:06.713254+0000","last_unstale":"2024-06-02T04:49:06.867997+0000","last_undegraded":"2024-06-02T04:49:06.867997+0000","last_fullsized":"2024-06-02T04:49:06.867997+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:12:48.304229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.873436+0000","last_change":"2024-06-02T04:48:02.268361+0000","last_active":"2024-06-02T04:49:06.873436+0000","last_peered":"2024-06-02T04:49:06.873436+0000","last_clean":"2024-06-02T04:49:06.873436+0000","last_became_active":"2024-06-02T04:48:02.268053+0000","last_became_peered":"2024-06-02T04:48:02.268053+0000","last_unstale":"2024-06-02T04:49:06.873436+0000","last_undegraded":"2024-06-02T04:49:06.873436+0000","last_fullsized":"2024-06-02T04:49:06.873436+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T16:04:13.955351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.212183+0000","last_change":"2024-06-02T04:48:02.686322+0000","last_active":"2024-06-02T04:49:36.212183+0000","last_peered":"2024-06-02T04:49:36.212183+0000","last_clean":"2024-06-02T04:49:36.212183+0000","last_became_active":"2024-06-02T04:48:02.685978+0000","last_became_peered":"2024-06-02T04:48:02.685978+0000","last_unstale":"2024-06-02T04:49:36.212183+0000","last_undegraded":"2024-06-02T04:49:36.212183+0000","last_fullsized":"2024-06-02T04:49:36.212183+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T12:12:19.157330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:07.893261+0000","last_change":"2024-06-02T04:49:07.893261+0000","last_active":"2024-06-02T04:49:07.893261+0000","last_peered":"2024-06-02T04:49:07.893261+0000","last_clean":"2024-06-02T04:49:07.893261+0000","last_became_active":"2024-06-02T04:49:07.892835+0000","last_became_peered":"2024-06-02T04:49:07.892835+0000","last_unstale":"2024-06-02T04:49:07.893261+0000","last_undegraded":"2024-06-02T04:49:07.893261+0000","last_fullsized":"2024-06-02T04:49:07.893261+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T06:52:12.541009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,8,5],"acting":[4,3,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"80'4","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:07.883791+0000","last_change":"2024-06-02T04:49:07.883791+0000","last_active":"2024-06-02T04:49:07.883791+0000","last_peered":"2024-06-02T04:49:07.883791+0000","last_clean":"2024-06-02T04:49:07.883791+0000","last_became_active":"2024-06-02T04:49:07.877259+0000","last_became_peered":"2024-06-02T04:49:07.877259+0000","last_unstale":"2024-06-02T04:49:07.883791+0000","last_undegraded":"2024-06-02T04:49:07.883791+0000","last_fullsized":"2024-06-02T04:49:07.883791+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T12:06:25.663857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.216264+0000","last_change":"2024-06-02T04:48:02.699659+0000","last_active":"2024-06-02T04:49:36.216264+0000","last_peered":"2024-06-02T04:49:36.216264+0000","last_clean":"2024-06-02T04:49:36.216264+0000","last_became_active":"2024-06-02T04:48:02.699321+0000","last_became_peered":"2024-06-02T04:48:02.699321+0000","last_unstale":"2024-06-02T04:49:36.216264+0000","last_undegraded":"2024-06-02T04:49:36.216264+0000","last_fullsized":"2024-06-02T04:49:36.216264+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:33:35.088215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.868049+0000","last_change":"2024-06-02T04:48:06.712031+0000","last_active":"2024-06-02T04:49:06.868049+0000","last_peered":"2024-06-02T04:49:06.868049+0000","last_clean":"2024-06-02T04:49:06.868049+0000","last_became_active":"2024-06-02T04:48:06.711637+0000","last_became_peered":"2024-06-02T04:48:06.711637+0000","last_unstale":"2024-06-02T04:49:06.868049+0000","last_undegraded":"2024-06-02T04:49:06.868049+0000","last_fullsized":"2024-06-02T04:49:06.868049+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T06:10:05.281793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"75'2","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.870616+0000","last_change":"2024-06-02T04:48:02.268698+0000","last_active":"2024-06-02T04:49:06.870616+0000","last_peered":"2024-06-02T04:49:06.870616+0000","last_clean":"2024-06-02T04:49:06.870616+0000","last_became_active":"2024-06-02T04:48:02.268286+0000","last_became_peered":"2024-06-02T04:48:02.268286+0000","last_unstale":"2024-06-02T04:49:06.870616+0000","last_undegraded":"2024-06-02T04:49:06.870616+0000","last_fullsized":"2024-06-02T04:49:06.870616+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T10:37:42.354104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"82'15","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.214177+0000","last_change":"2024-06-02T04:48:02.702280+0000","last_active":"2024-06-02T04:49:36.214177+0000","last_peered":"2024-06-02T04:49:36.214177+0000","last_clean":"2024-06-02T04:49:36.214177+0000","last_became_active":"2024-06-02T04:48:02.701830+0000","last_became_peered":"2024-06-02T04:48:02.701830+0000","last_unstale":"2024-06-02T04:49:36.214177+0000","last_undegraded":"2024-06-02T04:49:36.214177+0000","last_fullsized":"2024-06-02T04:49:36.214177+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T06:44:06.324024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.866642+0000","last_change":"2024-06-02T04:48:06.708484+0000","last_active":"2024-06-02T04:49:06.866642+0000","last_peered":"2024-06-02T04:49:06.866642+0000","last_clean":"2024-06-02T04:49:06.866642+0000","last_became_active":"2024-06-02T04:48:06.708048+0000","last_became_peered":"2024-06-02T04:48:06.708048+0000","last_unstale":"2024-06-02T04:49:06.866642+0000","last_undegraded":"2024-06-02T04:49:06.866642+0000","last_fullsized":"2024-06-02T04:49:06.866642+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:30:42.361362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"82'8","reported_seq":99,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.376851+0000","last_change":"2024-06-02T04:48:02.274961+0000","last_active":"2024-06-02T04:49:36.376851+0000","last_peered":"2024-06-02T04:49:36.376851+0000","last_clean":"2024-06-02T04:49:36.376851+0000","last_became_active":"2024-06-02T04:48:02.274617+0000","last_became_peered":"2024-06-02T04:48:02.274617+0000","last_unstale":"2024-06-02T04:49:36.376851+0000","last_undegraded":"2024-06-02T04:49:36.376851+0000","last_fullsized":"2024-06-02T04:49:36.376851+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T16:47:17.136996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":73,"num_read_kb":4,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.206987+0000","last_change":"2024-06-02T04:48:02.684722+0000","last_active":"2024-06-02T04:49:36.206987+0000","last_peered":"2024-06-02T04:49:36.206987+0000","last_clean":"2024-06-02T04:49:36.206987+0000","last_became_active":"2024-06-02T04:48:02.684354+0000","last_became_peered":"2024-06-02T04:48:02.684354+0000","last_unstale":"2024-06-02T04:49:36.206987+0000","last_undegraded":"2024-06-02T04:49:36.206987+0000","last_fullsized":"2024-06-02T04:49:36.206987+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T07:46:54.136882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.866495+0000","last_change":"2024-06-02T04:48:06.713498+0000","last_active":"2024-06-02T04:49:06.866495+0000","last_peered":"2024-06-02T04:49:06.866495+0000","last_clean":"2024-06-02T04:49:06.866495+0000","last_became_active":"2024-06-02T04:48:06.712949+0000","last_became_peered":"2024-06-02T04:48:06.712949+0000","last_unstale":"2024-06-02T04:49:06.866495+0000","last_undegraded":"2024-06-02T04:49:06.866495+0000","last_fullsized":"2024-06-02T04:49:06.866495+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:37:31.586703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"80'3","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.869522+0000","last_change":"2024-06-02T04:48:02.266358+0000","last_active":"2024-06-02T04:49:06.869522+0000","last_peered":"2024-06-02T04:49:06.869522+0000","last_clean":"2024-06-02T04:49:06.869522+0000","last_became_active":"2024-06-02T04:48:02.266008+0000","last_became_peered":"2024-06-02T04:48:02.266008+0000","last_unstale":"2024-06-02T04:49:06.869522+0000","last_undegraded":"2024-06-02T04:49:06.869522+0000","last_fullsized":"2024-06-02T04:49:06.869522+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:07:13.104170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.211013+0000","last_change":"2024-06-02T04:48:02.702234+0000","last_active":"2024-06-02T04:49:36.211013+0000","last_peered":"2024-06-02T04:49:36.211013+0000","last_clean":"2024-06-02T04:49:36.211013+0000","last_became_active":"2024-06-02T04:48:02.701927+0000","last_became_peered":"2024-06-02T04:48:02.701927+0000","last_unstale":"2024-06-02T04:49:36.211013+0000","last_undegraded":"2024-06-02T04:49:36.211013+0000","last_fullsized":"2024-06-02T04:49:36.211013+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:55:55.940957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.868152+0000","last_change":"2024-06-02T04:48:06.713257+0000","last_active":"2024-06-02T04:49:06.868152+0000","last_peered":"2024-06-02T04:49:06.868152+0000","last_clean":"2024-06-02T04:49:06.868152+0000","last_became_active":"2024-06-02T04:48:06.712862+0000","last_became_peered":"2024-06-02T04:48:06.712862+0000","last_unstale":"2024-06-02T04:49:06.868152+0000","last_undegraded":"2024-06-02T04:49:06.868152+0000","last_fullsized":"2024-06-02T04:49:06.868152+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T06:23:35.115824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"80'2","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.864687+0000","last_change":"2024-06-02T04:48:02.258838+0000","last_active":"2024-06-02T04:49:06.864687+0000","last_peered":"2024-06-02T04:49:06.864687+0000","last_clean":"2024-06-02T04:49:06.864687+0000","last_became_active":"2024-06-02T04:48:02.258516+0000","last_became_peered":"2024-06-02T04:48:02.258516+0000","last_unstale":"2024-06-02T04:49:06.864687+0000","last_undegraded":"2024-06-02T04:49:06.864687+0000","last_fullsized":"2024-06-02T04:49:06.864687+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:32:04.161724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.207684+0000","last_change":"2024-06-02T04:48:02.690043+0000","last_active":"2024-06-02T04:49:36.207684+0000","last_peered":"2024-06-02T04:49:36.207684+0000","last_clean":"2024-06-02T04:49:36.207684+0000","last_became_active":"2024-06-02T04:48:02.689748+0000","last_became_peered":"2024-06-02T04:48:02.689748+0000","last_unstale":"2024-06-02T04:49:36.207684+0000","last_undegraded":"2024-06-02T04:49:36.207684+0000","last_fullsized":"2024-06-02T04:49:36.207684+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:50:23.694653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.870025+0000","last_change":"2024-06-02T04:48:06.704093+0000","last_active":"2024-06-02T04:49:06.870025+0000","last_peered":"2024-06-02T04:49:06.870025+0000","last_clean":"2024-06-02T04:49:06.870025+0000","last_became_active":"2024-06-02T04:48:06.703732+0000","last_became_peered":"2024-06-02T04:48:06.703732+0000","last_unstale":"2024-06-02T04:49:06.870025+0000","last_undegraded":"2024-06-02T04:49:06.870025+0000","last_fullsized":"2024-06-02T04:49:06.870025+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:50:10.434364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"80'1","reported_seq":19,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.872182+0000","last_change":"2024-06-02T04:48:02.274753+0000","last_active":"2024-06-02T04:49:06.872182+0000","last_peered":"2024-06-02T04:49:06.872182+0000","last_clean":"2024-06-02T04:49:06.872182+0000","last_became_active":"2024-06-02T04:48:02.274390+0000","last_became_peered":"2024-06-02T04:48:02.274390+0000","last_unstale":"2024-06-02T04:49:06.872182+0000","last_undegraded":"2024-06-02T04:49:06.872182+0000","last_fullsized":"2024-06-02T04:49:06.872182+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:42:38.790750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"82'11","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.198701+0000","last_change":"2024-06-02T04:48:02.684832+0000","last_active":"2024-06-02T04:49:36.198701+0000","last_peered":"2024-06-02T04:49:36.198701+0000","last_clean":"2024-06-02T04:49:36.198701+0000","last_became_active":"2024-06-02T04:48:02.684520+0000","last_became_peered":"2024-06-02T04:48:02.684520+0000","last_unstale":"2024-06-02T04:49:36.198701+0000","last_undegraded":"2024-06-02T04:49:36.198701+0000","last_fullsized":"2024-06-02T04:49:36.198701+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:08:33.038975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.873171+0000","last_change":"2024-06-02T04:48:06.704725+0000","last_active":"2024-06-02T04:49:06.873171+0000","last_peered":"2024-06-02T04:49:06.873171+0000","last_clean":"2024-06-02T04:49:06.873171+0000","last_became_active":"2024-06-02T04:48:06.704284+0000","last_became_peered":"2024-06-02T04:48:06.704284+0000","last_unstale":"2024-06-02T04:49:06.873171+0000","last_undegraded":"2024-06-02T04:49:06.873171+0000","last_fullsized":"2024-06-02T04:49:06.873171+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:56:04.558505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"82'4","reported_seq":93,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:37.378534+0000","last_change":"2024-06-02T04:48:02.267048+0000","last_active":"2024-06-02T04:49:37.378534+0000","last_peered":"2024-06-02T04:49:37.378534+0000","last_clean":"2024-06-02T04:49:37.378534+0000","last_became_active":"2024-06-02T04:48:02.266707+0000","last_became_peered":"2024-06-02T04:48:02.266707+0000","last_unstale":"2024-06-02T04:49:37.378534+0000","last_undegraded":"2024-06-02T04:49:37.378534+0000","last_fullsized":"2024-06-02T04:49:37.378534+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:36:25.633728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":71,"num_read_kb":71,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"82'10","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.214446+0000","last_change":"2024-06-02T04:48:02.700485+0000","last_active":"2024-06-02T04:49:36.214446+0000","last_peered":"2024-06-02T04:49:36.214446+0000","last_clean":"2024-06-02T04:49:36.214446+0000","last_became_active":"2024-06-02T04:48:02.700228+0000","last_became_peered":"2024-06-02T04:48:02.700228+0000","last_unstale":"2024-06-02T04:49:36.214446+0000","last_undegraded":"2024-06-02T04:49:36.214446+0000","last_fullsized":"2024-06-02T04:49:36.214446+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T06:39:18.244476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.869511+0000","last_change":"2024-06-02T04:48:06.716821+0000","last_active":"2024-06-02T04:49:06.869511+0000","last_peered":"2024-06-02T04:49:06.869511+0000","last_clean":"2024-06-02T04:49:06.869511+0000","last_became_active":"2024-06-02T04:48:06.716432+0000","last_became_peered":"2024-06-02T04:48:06.716432+0000","last_unstale":"2024-06-02T04:49:06.869511+0000","last_undegraded":"2024-06-02T04:49:06.869511+0000","last_fullsized":"2024-06-02T04:49:06.869511+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T12:06:50.164797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"80'2","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.872989+0000","last_change":"2024-06-02T04:48:02.272377+0000","last_active":"2024-06-02T04:49:06.872989+0000","last_peered":"2024-06-02T04:49:06.872989+0000","last_clean":"2024-06-02T04:49:06.872989+0000","last_became_active":"2024-06-02T04:48:02.272017+0000","last_became_peered":"2024-06-02T04:48:02.272017+0000","last_unstale":"2024-06-02T04:49:06.872989+0000","last_undegraded":"2024-06-02T04:49:06.872989+0000","last_fullsized":"2024-06-02T04:49:06.872989+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T10:24:14.945609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.208529+0000","last_change":"2024-06-02T04:48:02.687056+0000","last_active":"2024-06-02T04:49:36.208529+0000","last_peered":"2024-06-02T04:49:36.208529+0000","last_clean":"2024-06-02T04:49:36.208529+0000","last_became_active":"2024-06-02T04:48:02.686729+0000","last_became_peered":"2024-06-02T04:48:02.686729+0000","last_unstale":"2024-06-02T04:49:36.208529+0000","last_undegraded":"2024-06-02T04:49:36.208529+0000","last_fullsized":"2024-06-02T04:49:36.208529+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:54:44.636489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.868621+0000","last_change":"2024-06-02T04:48:06.713816+0000","last_active":"2024-06-02T04:49:06.868621+0000","last_peered":"2024-06-02T04:49:06.868621+0000","last_clean":"2024-06-02T04:49:06.868621+0000","last_became_active":"2024-06-02T04:48:06.713372+0000","last_became_peered":"2024-06-02T04:48:06.713372+0000","last_unstale":"2024-06-02T04:49:06.868621+0000","last_undegraded":"2024-06-02T04:49:06.868621+0000","last_fullsized":"2024-06-02T04:49:06.868621+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T10:12:46.455263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"80'4","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.872949+0000","last_change":"2024-06-02T04:48:02.274971+0000","last_active":"2024-06-02T04:49:06.872949+0000","last_peered":"2024-06-02T04:49:06.872949+0000","last_clean":"2024-06-02T04:49:06.872949+0000","last_became_active":"2024-06-02T04:48:02.274137+0000","last_became_peered":"2024-06-02T04:48:02.274137+0000","last_unstale":"2024-06-02T04:49:06.872949+0000","last_undegraded":"2024-06-02T04:49:06.872949+0000","last_fullsized":"2024-06-02T04:49:06.872949+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:41:45.634923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"82'11","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.216665+0000","last_change":"2024-06-02T04:49:07.874181+0000","last_active":"2024-06-02T04:49:36.216665+0000","last_peered":"2024-06-02T04:49:36.216665+0000","last_clean":"2024-06-02T04:49:36.216665+0000","last_became_active":"2024-06-02T04:49:07.873791+0000","last_became_peered":"2024-06-02T04:49:07.873791+0000","last_unstale":"2024-06-02T04:49:36.216665+0000","last_undegraded":"2024-06-02T04:49:36.216665+0000","last_fullsized":"2024-06-02T04:49:36.216665+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T16:04:26.712712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.870118+0000","last_change":"2024-06-02T04:48:06.713061+0000","last_active":"2024-06-02T04:49:06.870118+0000","last_peered":"2024-06-02T04:49:06.870118+0000","last_clean":"2024-06-02T04:49:06.870118+0000","last_became_active":"2024-06-02T04:48:06.712687+0000","last_became_peered":"2024-06-02T04:48:06.712687+0000","last_unstale":"2024-06-02T04:49:06.870118+0000","last_undegraded":"2024-06-02T04:49:06.870118+0000","last_fullsized":"2024-06-02T04:49:06.870118+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T08:46:02.417626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"82'36","reported_seq":205,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:38.380102+0000","last_change":"2024-06-02T04:48:02.270101+0000","last_active":"2024-06-02T04:49:38.380102+0000","last_peered":"2024-06-02T04:49:38.380102+0000","last_clean":"2024-06-02T04:49:38.380102+0000","last_became_active":"2024-06-02T04:48:02.269637+0000","last_became_peered":"2024-06-02T04:48:02.269637+0000","last_unstale":"2024-06-02T04:49:38.380102+0000","last_undegraded":"2024-06-02T04:49:38.380102+0000","last_fullsized":"2024-06-02T04:49:38.380102+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:37:07.572299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64494,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":151,"num_read_kb":139,"num_write":37,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.212023+0000","last_change":"2024-06-02T04:48:02.698435+0000","last_active":"2024-06-02T04:49:36.212023+0000","last_peered":"2024-06-02T04:49:36.212023+0000","last_clean":"2024-06-02T04:49:36.212023+0000","last_became_active":"2024-06-02T04:48:02.698071+0000","last_became_peered":"2024-06-02T04:48:02.698071+0000","last_unstale":"2024-06-02T04:49:36.212023+0000","last_undegraded":"2024-06-02T04:49:36.212023+0000","last_fullsized":"2024-06-02T04:49:36.212023+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:45:38.673256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.873537+0000","last_change":"2024-06-02T04:48:06.705965+0000","last_active":"2024-06-02T04:49:06.873537+0000","last_peered":"2024-06-02T04:49:06.873537+0000","last_clean":"2024-06-02T04:49:06.873537+0000","last_became_active":"2024-06-02T04:48:06.705527+0000","last_became_peered":"2024-06-02T04:48:06.705527+0000","last_unstale":"2024-06-02T04:49:06.873537+0000","last_undegraded":"2024-06-02T04:49:06.873537+0000","last_fullsized":"2024-06-02T04:49:06.873537+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:41:54.100212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"80'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.866138+0000","last_change":"2024-06-02T04:48:02.273389+0000","last_active":"2024-06-02T04:49:06.866138+0000","last_peered":"2024-06-02T04:49:06.866138+0000","last_clean":"2024-06-02T04:49:06.866138+0000","last_became_active":"2024-06-02T04:48:02.271701+0000","last_became_peered":"2024-06-02T04:48:02.271701+0000","last_unstale":"2024-06-02T04:49:06.866138+0000","last_undegraded":"2024-06-02T04:49:06.866138+0000","last_fullsized":"2024-06-02T04:49:06.866138+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:46:48.304156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.201640+0000","last_change":"2024-06-02T04:48:02.689417+0000","last_active":"2024-06-02T04:49:36.201640+0000","last_peered":"2024-06-02T04:49:36.201640+0000","last_clean":"2024-06-02T04:49:36.201640+0000","last_became_active":"2024-06-02T04:48:02.689108+0000","last_became_peered":"2024-06-02T04:48:02.689108+0000","last_unstale":"2024-06-02T04:49:36.201640+0000","last_undegraded":"2024-06-02T04:49:36.201640+0000","last_fullsized":"2024-06-02T04:49:36.201640+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:23:14.231198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:07.875780+0000","last_change":"2024-06-02T04:49:07.875780+0000","last_active":"2024-06-02T04:49:07.875780+0000","last_peered":"2024-06-02T04:49:07.875780+0000","last_clean":"2024-06-02T04:49:07.875780+0000","last_became_active":"2024-06-02T04:49:07.875310+0000","last_became_peered":"2024-06-02T04:49:07.875310+0000","last_unstale":"2024-06-02T04:49:07.875780+0000","last_undegraded":"2024-06-02T04:49:07.875780+0000","last_fullsized":"2024-06-02T04:49:07.875780+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:46:26.921686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,7,6],"acting":[11,8,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"80'3","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.873166+0000","last_change":"2024-06-02T04:48:02.274386+0000","last_active":"2024-06-02T04:49:06.873166+0000","last_peered":"2024-06-02T04:49:06.873166+0000","last_clean":"2024-06-02T04:49:06.873166+0000","last_became_active":"2024-06-02T04:48:02.274001+0000","last_became_peered":"2024-06-02T04:48:02.274001+0000","last_unstale":"2024-06-02T04:49:06.873166+0000","last_undegraded":"2024-06-02T04:49:06.873166+0000","last_fullsized":"2024-06-02T04:49:06.873166+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T14:02:10.256428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"82'15","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.218594+0000","last_change":"2024-06-02T04:48:02.706735+0000","last_active":"2024-06-02T04:49:36.218594+0000","last_peered":"2024-06-02T04:49:36.218594+0000","last_clean":"2024-06-02T04:49:36.218594+0000","last_became_active":"2024-06-02T04:48:02.706475+0000","last_became_peered":"2024-06-02T04:48:02.706475+0000","last_unstale":"2024-06-02T04:49:36.218594+0000","last_undegraded":"2024-06-02T04:49:36.218594+0000","last_fullsized":"2024-06-02T04:49:36.218594+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T10:59:57.946798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.871496+0000","last_change":"2024-06-02T04:48:06.713266+0000","last_active":"2024-06-02T04:49:06.871496+0000","last_peered":"2024-06-02T04:49:06.871496+0000","last_clean":"2024-06-02T04:49:06.871496+0000","last_became_active":"2024-06-02T04:48:06.712659+0000","last_became_peered":"2024-06-02T04:48:06.712659+0000","last_unstale":"2024-06-02T04:49:06.871496+0000","last_undegraded":"2024-06-02T04:49:06.871496+0000","last_fullsized":"2024-06-02T04:49:06.871496+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T16:30:21.140420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"80'4","reported_seq":92,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:33.373117+0000","last_change":"2024-06-02T04:48:02.265157+0000","last_active":"2024-06-02T04:49:33.373117+0000","last_peered":"2024-06-02T04:49:33.373117+0000","last_clean":"2024-06-02T04:49:33.373117+0000","last_became_active":"2024-06-02T04:48:02.264782+0000","last_became_peered":"2024-06-02T04:48:02.264782+0000","last_unstale":"2024-06-02T04:49:33.373117+0000","last_undegraded":"2024-06-02T04:49:33.373117+0000","last_fullsized":"2024-06-02T04:49:33.373117+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:55:35.177299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":933,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":71,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.209474+0000","last_change":"2024-06-02T04:48:02.698864+0000","last_active":"2024-06-02T04:49:36.209474+0000","last_peered":"2024-06-02T04:49:36.209474+0000","last_clean":"2024-06-02T04:49:36.209474+0000","last_became_active":"2024-06-02T04:48:02.698547+0000","last_became_peered":"2024-06-02T04:48:02.698547+0000","last_unstale":"2024-06-02T04:49:36.209474+0000","last_undegraded":"2024-06-02T04:49:36.209474+0000","last_fullsized":"2024-06-02T04:49:36.209474+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:03:39.835164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.865160+0000","last_change":"2024-06-02T04:48:06.713198+0000","last_active":"2024-06-02T04:49:06.865160+0000","last_peered":"2024-06-02T04:49:06.865160+0000","last_clean":"2024-06-02T04:49:06.865160+0000","last_became_active":"2024-06-02T04:48:06.712806+0000","last_became_peered":"2024-06-02T04:48:06.712806+0000","last_unstale":"2024-06-02T04:49:06.865160+0000","last_undegraded":"2024-06-02T04:49:06.865160+0000","last_fullsized":"2024-06-02T04:49:06.865160+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:48:09.492933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"80'15","reported_seq":34,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.869408+0000","last_change":"2024-06-02T04:48:02.277744+0000","last_active":"2024-06-02T04:49:06.869408+0000","last_peered":"2024-06-02T04:49:06.869408+0000","last_clean":"2024-06-02T04:49:06.869408+0000","last_became_active":"2024-06-02T04:48:02.277044+0000","last_became_peered":"2024-06-02T04:48:02.277044+0000","last_unstale":"2024-06-02T04:49:06.869408+0000","last_undegraded":"2024-06-02T04:49:06.869408+0000","last_fullsized":"2024-06-02T04:49:06.869408+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:47:38.606233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.211595+0000","last_change":"2024-06-02T04:48:02.702234+0000","last_active":"2024-06-02T04:49:36.211595+0000","last_peered":"2024-06-02T04:49:36.211595+0000","last_clean":"2024-06-02T04:49:36.211595+0000","last_became_active":"2024-06-02T04:48:02.701857+0000","last_became_peered":"2024-06-02T04:48:02.701857+0000","last_unstale":"2024-06-02T04:49:36.211595+0000","last_undegraded":"2024-06-02T04:49:36.211595+0000","last_fullsized":"2024-06-02T04:49:36.211595+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:01:52.901690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.872667+0000","last_change":"2024-06-02T04:48:06.704575+0000","last_active":"2024-06-02T04:49:06.872667+0000","last_peered":"2024-06-02T04:49:06.872667+0000","last_clean":"2024-06-02T04:49:06.872667+0000","last_became_active":"2024-06-02T04:48:06.704129+0000","last_became_peered":"2024-06-02T04:48:06.704129+0000","last_unstale":"2024-06-02T04:49:06.872667+0000","last_undegraded":"2024-06-02T04:49:06.872667+0000","last_fullsized":"2024-06-02T04:49:06.872667+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:43:53.481252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.869952+0000","last_change":"2024-06-02T04:48:02.268816+0000","last_active":"2024-06-02T04:49:06.869952+0000","last_peered":"2024-06-02T04:49:06.869952+0000","last_clean":"2024-06-02T04:49:06.869952+0000","last_became_active":"2024-06-02T04:48:02.268469+0000","last_became_peered":"2024-06-02T04:48:02.268469+0000","last_unstale":"2024-06-02T04:49:06.869952+0000","last_undegraded":"2024-06-02T04:49:06.869952+0000","last_fullsized":"2024-06-02T04:49:06.869952+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:42:32.434414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.218718+0000","last_change":"2024-06-02T04:48:02.704536+0000","last_active":"2024-06-02T04:49:36.218718+0000","last_peered":"2024-06-02T04:49:36.218718+0000","last_clean":"2024-06-02T04:49:36.218718+0000","last_became_active":"2024-06-02T04:48:02.704149+0000","last_became_peered":"2024-06-02T04:48:02.704149+0000","last_unstale":"2024-06-02T04:49:36.218718+0000","last_undegraded":"2024-06-02T04:49:36.218718+0000","last_fullsized":"2024-06-02T04:49:36.218718+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T07:59:40.379135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:07.877906+0000","last_change":"2024-06-02T04:49:07.877906+0000","last_active":"2024-06-02T04:49:07.877906+0000","last_peered":"2024-06-02T04:49:07.877906+0000","last_clean":"2024-06-02T04:49:07.877906+0000","last_became_active":"2024-06-02T04:49:07.877072+0000","last_became_peered":"2024-06-02T04:49:07.877072+0000","last_unstale":"2024-06-02T04:49:07.877906+0000","last_undegraded":"2024-06-02T04:49:07.877906+0000","last_fullsized":"2024-06-02T04:49:07.877906+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:49:59.825416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.871187+0000","last_change":"2024-06-02T04:48:02.270893+0000","last_active":"2024-06-02T04:49:06.871187+0000","last_peered":"2024-06-02T04:49:06.871187+0000","last_clean":"2024-06-02T04:49:06.871187+0000","last_became_active":"2024-06-02T04:48:02.270566+0000","last_became_peered":"2024-06-02T04:48:02.270566+0000","last_unstale":"2024-06-02T04:49:06.871187+0000","last_undegraded":"2024-06-02T04:49:06.871187+0000","last_fullsized":"2024-06-02T04:49:06.871187+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:57:36.202043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'4","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.204040+0000","last_change":"2024-06-02T04:48:02.693528+0000","last_active":"2024-06-02T04:49:36.204040+0000","last_peered":"2024-06-02T04:49:36.204040+0000","last_clean":"2024-06-02T04:49:36.204040+0000","last_became_active":"2024-06-02T04:48:02.693240+0000","last_became_peered":"2024-06-02T04:48:02.693240+0000","last_unstale":"2024-06-02T04:49:36.204040+0000","last_undegraded":"2024-06-02T04:49:36.204040+0000","last_fullsized":"2024-06-02T04:49:36.204040+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T14:48:59.338977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.864871+0000","last_change":"2024-06-02T04:48:06.710454+0000","last_active":"2024-06-02T04:49:06.864871+0000","last_peered":"2024-06-02T04:49:06.864871+0000","last_clean":"2024-06-02T04:49:06.864871+0000","last_became_active":"2024-06-02T04:48:06.710090+0000","last_became_peered":"2024-06-02T04:48:06.710090+0000","last_unstale":"2024-06-02T04:49:06.864871+0000","last_undegraded":"2024-06-02T04:49:06.864871+0000","last_fullsized":"2024-06-02T04:49:06.864871+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:27:52.401032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"80'1","reported_seq":19,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.872363+0000","last_change":"2024-06-02T04:48:02.271748+0000","last_active":"2024-06-02T04:49:06.872363+0000","last_peered":"2024-06-02T04:49:06.872363+0000","last_clean":"2024-06-02T04:49:06.872363+0000","last_became_active":"2024-06-02T04:48:02.270941+0000","last_became_peered":"2024-06-02T04:48:02.270941+0000","last_unstale":"2024-06-02T04:49:06.872363+0000","last_undegraded":"2024-06-02T04:49:06.872363+0000","last_fullsized":"2024-06-02T04:49:06.872363+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T14:22:37.698956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.216956+0000","last_change":"2024-06-02T04:48:02.690331+0000","last_active":"2024-06-02T04:49:36.216956+0000","last_peered":"2024-06-02T04:49:36.216956+0000","last_clean":"2024-06-02T04:49:36.216956+0000","last_became_active":"2024-06-02T04:48:02.681983+0000","last_became_peered":"2024-06-02T04:48:02.681983+0000","last_unstale":"2024-06-02T04:49:36.216956+0000","last_undegraded":"2024-06-02T04:49:36.216956+0000","last_fullsized":"2024-06-02T04:49:36.216956+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T14:09:12.117847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.865289+0000","last_change":"2024-06-02T04:48:06.962698+0000","last_active":"2024-06-02T04:49:06.865289+0000","last_peered":"2024-06-02T04:49:06.865289+0000","last_clean":"2024-06-02T04:49:06.865289+0000","last_became_active":"2024-06-02T04:48:06.962283+0000","last_became_peered":"2024-06-02T04:48:06.962283+0000","last_unstale":"2024-06-02T04:49:06.865289+0000","last_undegraded":"2024-06-02T04:49:06.865289+0000","last_fullsized":"2024-06-02T04:49:06.865289+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T14:33:49.504150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.210803+0000","last_change":"2024-06-02T04:48:02.702856+0000","last_active":"2024-06-02T04:49:36.210803+0000","last_peered":"2024-06-02T04:49:36.210803+0000","last_clean":"2024-06-02T04:49:36.210803+0000","last_became_active":"2024-06-02T04:48:02.702513+0000","last_became_peered":"2024-06-02T04:48:02.702513+0000","last_unstale":"2024-06-02T04:49:36.210803+0000","last_undegraded":"2024-06-02T04:49:36.210803+0000","last_fullsized":"2024-06-02T04:49:36.210803+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T07:10:35.957386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"82'5","reported_seq":94,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:37.378451+0000","last_change":"2024-06-02T04:48:02.265627+0000","last_active":"2024-06-02T04:49:37.378451+0000","last_peered":"2024-06-02T04:49:37.378451+0000","last_clean":"2024-06-02T04:49:37.378451+0000","last_became_active":"2024-06-02T04:48:02.265301+0000","last_became_peered":"2024-06-02T04:48:02.265301+0000","last_unstale":"2024-06-02T04:49:37.378451+0000","last_undegraded":"2024-06-02T04:49:37.378451+0000","last_fullsized":"2024-06-02T04:49:37.378451+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T10:46:10.211378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":71,"num_read_kb":71,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"80'1","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.873068+0000","last_change":"2024-06-02T04:48:06.709988+0000","last_active":"2024-06-02T04:49:06.873068+0000","last_peered":"2024-06-02T04:49:06.873068+0000","last_clean":"2024-06-02T04:49:06.873068+0000","last_became_active":"2024-06-02T04:48:06.709642+0000","last_became_peered":"2024-06-02T04:48:06.709642+0000","last_unstale":"2024-06-02T04:49:06.873068+0000","last_undegraded":"2024-06-02T04:49:06.873068+0000","last_fullsized":"2024-06-02T04:49:06.873068+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T10:09:46.250709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.212511+0000","last_change":"2024-06-02T04:48:02.696666+0000","last_active":"2024-06-02T04:49:36.212511+0000","last_peered":"2024-06-02T04:49:36.212511+0000","last_clean":"2024-06-02T04:49:36.212511+0000","last_became_active":"2024-06-02T04:48:02.696343+0000","last_became_peered":"2024-06-02T04:48:02.696343+0000","last_unstale":"2024-06-02T04:49:36.212511+0000","last_undegraded":"2024-06-02T04:49:36.212511+0000","last_fullsized":"2024-06-02T04:49:36.212511+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T12:31:13.426174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"80'3","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.868521+0000","last_change":"2024-06-02T04:48:02.268619+0000","last_active":"2024-06-02T04:49:06.868521+0000","last_peered":"2024-06-02T04:49:06.868521+0000","last_clean":"2024-06-02T04:49:06.868521+0000","last_became_active":"2024-06-02T04:48:02.268244+0000","last_became_peered":"2024-06-02T04:48:02.268244+0000","last_unstale":"2024-06-02T04:49:06.868521+0000","last_undegraded":"2024-06-02T04:49:06.868521+0000","last_fullsized":"2024-06-02T04:49:06.868521+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:15:13.469046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"19'137","reported_seq":328,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.872115+0000","last_change":"2024-06-02T04:47:15.713382+0000","last_active":"2024-06-02T04:49:06.872115+0000","last_peered":"2024-06-02T04:49:06.872115+0000","last_clean":"2024-06-02T04:49:06.872115+0000","last_became_active":"2024-06-02T04:47:15.712972+0000","last_became_peered":"2024-06-02T04:47:15.712972+0000","last_unstale":"2024-06-02T04:49:06.872115+0000","last_undegraded":"2024-06-02T04:49:06.872115+0000","last_fullsized":"2024-06-02T04:49:06.872115+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:44:56.604079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:44:56.604079+0000","last_clean_scrub_stamp":"2024-06-02T04:44:56.604079+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T12:54:02.306899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.872863+0000","last_change":"2024-06-02T04:48:06.964717+0000","last_active":"2024-06-02T04:49:06.872863+0000","last_peered":"2024-06-02T04:49:06.872863+0000","last_clean":"2024-06-02T04:49:06.872863+0000","last_became_active":"2024-06-02T04:48:06.964244+0000","last_became_peered":"2024-06-02T04:48:06.964244+0000","last_unstale":"2024-06-02T04:49:06.872863+0000","last_undegraded":"2024-06-02T04:49:06.872863+0000","last_fullsized":"2024-06-02T04:49:06.872863+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:26:58.901182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"82'5","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.200231+0000","last_change":"2024-06-02T04:49:07.892022+0000","last_active":"2024-06-02T04:49:36.200231+0000","last_peered":"2024-06-02T04:49:36.200231+0000","last_clean":"2024-06-02T04:49:36.200231+0000","last_became_active":"2024-06-02T04:49:07.891678+0000","last_became_peered":"2024-06-02T04:49:07.891678+0000","last_unstale":"2024-06-02T04:49:36.200231+0000","last_undegraded":"2024-06-02T04:49:36.200231+0000","last_fullsized":"2024-06-02T04:49:36.200231+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T07:01:06.354621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"80'3","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:07.880368+0000","last_change":"2024-06-02T04:49:07.880368+0000","last_active":"2024-06-02T04:49:07.880368+0000","last_peered":"2024-06-02T04:49:07.880368+0000","last_clean":"2024-06-02T04:49:07.880368+0000","last_became_active":"2024-06-02T04:49:07.876731+0000","last_became_peered":"2024-06-02T04:49:07.876731+0000","last_unstale":"2024-06-02T04:49:07.880368+0000","last_undegraded":"2024-06-02T04:49:07.880368+0000","last_fullsized":"2024-06-02T04:49:07.880368+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T12:48:38.495222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4],"acting":[7,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.867776+0000","last_change":"2024-06-02T04:48:06.703427+0000","last_active":"2024-06-02T04:49:06.867776+0000","last_peered":"2024-06-02T04:49:06.867776+0000","last_clean":"2024-06-02T04:49:06.867776+0000","last_became_active":"2024-06-02T04:48:06.702442+0000","last_became_peered":"2024-06-02T04:48:06.702442+0000","last_unstale":"2024-06-02T04:49:06.867776+0000","last_undegraded":"2024-06-02T04:49:06.867776+0000","last_fullsized":"2024-06-02T04:49:06.867776+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T14:47:12.376520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"80'1","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.870604+0000","last_change":"2024-06-02T04:48:02.277241+0000","last_active":"2024-06-02T04:49:06.870604+0000","last_peered":"2024-06-02T04:49:06.870604+0000","last_clean":"2024-06-02T04:49:06.870604+0000","last_became_active":"2024-06-02T04:48:02.276903+0000","last_became_peered":"2024-06-02T04:48:02.276903+0000","last_unstale":"2024-06-02T04:49:06.870604+0000","last_undegraded":"2024-06-02T04:49:06.870604+0000","last_fullsized":"2024-06-02T04:49:06.870604+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:16:40.664225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.200095+0000","last_change":"2024-06-02T04:48:02.682260+0000","last_active":"2024-06-02T04:49:36.200095+0000","last_peered":"2024-06-02T04:49:36.200095+0000","last_clean":"2024-06-02T04:49:36.200095+0000","last_became_active":"2024-06-02T04:48:02.681962+0000","last_became_peered":"2024-06-02T04:48:02.681962+0000","last_unstale":"2024-06-02T04:49:36.200095+0000","last_undegraded":"2024-06-02T04:49:36.200095+0000","last_fullsized":"2024-06-02T04:49:36.200095+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:42:26.588628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.872911+0000","last_change":"2024-06-02T04:48:06.963380+0000","last_active":"2024-06-02T04:49:06.872911+0000","last_peered":"2024-06-02T04:49:06.872911+0000","last_clean":"2024-06-02T04:49:06.872911+0000","last_became_active":"2024-06-02T04:48:06.962717+0000","last_became_peered":"2024-06-02T04:48:06.962717+0000","last_unstale":"2024-06-02T04:49:06.872911+0000","last_undegraded":"2024-06-02T04:49:06.872911+0000","last_fullsized":"2024-06-02T04:49:06.872911+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T07:05:46.983987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"80'5","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.871715+0000","last_change":"2024-06-02T04:48:02.270183+0000","last_active":"2024-06-02T04:49:06.871715+0000","last_peered":"2024-06-02T04:49:06.871715+0000","last_clean":"2024-06-02T04:49:06.871715+0000","last_became_active":"2024-06-02T04:48:02.269880+0000","last_became_peered":"2024-06-02T04:48:02.269880+0000","last_unstale":"2024-06-02T04:49:06.871715+0000","last_undegraded":"2024-06-02T04:49:06.871715+0000","last_fullsized":"2024-06-02T04:49:06.871715+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T16:12:41.959174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.201281+0000","last_change":"2024-06-02T04:48:02.696692+0000","last_active":"2024-06-02T04:49:36.201281+0000","last_peered":"2024-06-02T04:49:36.201281+0000","last_clean":"2024-06-02T04:49:36.201281+0000","last_became_active":"2024-06-02T04:48:02.696398+0000","last_became_peered":"2024-06-02T04:48:02.696398+0000","last_unstale":"2024-06-02T04:49:36.201281+0000","last_undegraded":"2024-06-02T04:49:36.201281+0000","last_fullsized":"2024-06-02T04:49:36.201281+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T14:12:15.108989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.865826+0000","last_change":"2024-06-02T04:48:06.706766+0000","last_active":"2024-06-02T04:49:06.865826+0000","last_peered":"2024-06-02T04:49:06.865826+0000","last_clean":"2024-06-02T04:49:06.865826+0000","last_became_active":"2024-06-02T04:48:06.706440+0000","last_became_peered":"2024-06-02T04:48:06.706440+0000","last_unstale":"2024-06-02T04:49:06.865826+0000","last_undegraded":"2024-06-02T04:49:06.865826+0000","last_fullsized":"2024-06-02T04:49:06.865826+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:24:20.283467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"80'4","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.869382+0000","last_change":"2024-06-02T04:48:02.265259+0000","last_active":"2024-06-02T04:49:06.869382+0000","last_peered":"2024-06-02T04:49:06.869382+0000","last_clean":"2024-06-02T04:49:06.869382+0000","last_became_active":"2024-06-02T04:48:02.264931+0000","last_became_peered":"2024-06-02T04:48:02.264931+0000","last_unstale":"2024-06-02T04:49:06.869382+0000","last_undegraded":"2024-06-02T04:49:06.869382+0000","last_fullsized":"2024-06-02T04:49:06.869382+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:06:18.360519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.207713+0000","last_change":"2024-06-02T04:48:02.684808+0000","last_active":"2024-06-02T04:49:36.207713+0000","last_peered":"2024-06-02T04:49:36.207713+0000","last_clean":"2024-06-02T04:49:36.207713+0000","last_became_active":"2024-06-02T04:48:02.684492+0000","last_became_peered":"2024-06-02T04:48:02.684492+0000","last_unstale":"2024-06-02T04:49:36.207713+0000","last_undegraded":"2024-06-02T04:49:36.207713+0000","last_fullsized":"2024-06-02T04:49:36.207713+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T12:10:01.537377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.868148+0000","last_change":"2024-06-02T04:48:06.965041+0000","last_active":"2024-06-02T04:49:06.868148+0000","last_peered":"2024-06-02T04:49:06.868148+0000","last_clean":"2024-06-02T04:49:06.868148+0000","last_became_active":"2024-06-02T04:48:06.964487+0000","last_became_peered":"2024-06-02T04:48:06.964487+0000","last_unstale":"2024-06-02T04:49:06.868148+0000","last_undegraded":"2024-06-02T04:49:06.868148+0000","last_fullsized":"2024-06-02T04:49:06.868148+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:51:05.082026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.874688+0000","last_change":"2024-06-02T04:48:02.271485+0000","last_active":"2024-06-02T04:49:06.874688+0000","last_peered":"2024-06-02T04:49:06.874688+0000","last_clean":"2024-06-02T04:49:06.874688+0000","last_became_active":"2024-06-02T04:48:02.271156+0000","last_became_peered":"2024-06-02T04:48:02.271156+0000","last_unstale":"2024-06-02T04:49:06.874688+0000","last_undegraded":"2024-06-02T04:49:06.874688+0000","last_fullsized":"2024-06-02T04:49:06.874688+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:57:34.467559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"82'2","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.177199+0000","last_change":"2024-06-02T04:48:02.673700+0000","last_active":"2024-06-02T04:49:36.177199+0000","last_peered":"2024-06-02T04:49:36.177199+0000","last_clean":"2024-06-02T04:49:36.177199+0000","last_became_active":"2024-06-02T04:48:02.673262+0000","last_became_peered":"2024-06-02T04:48:02.673262+0000","last_unstale":"2024-06-02T04:49:36.177199+0000","last_undegraded":"2024-06-02T04:49:36.177199+0000","last_fullsized":"2024-06-02T04:49:36.177199+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:45:00.682562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.871595+0000","last_change":"2024-06-02T04:48:06.716848+0000","last_active":"2024-06-02T04:49:06.871595+0000","last_peered":"2024-06-02T04:49:06.871595+0000","last_clean":"2024-06-02T04:49:06.871595+0000","last_became_active":"2024-06-02T04:48:06.716411+0000","last_became_peered":"2024-06-02T04:48:06.716411+0000","last_unstale":"2024-06-02T04:49:06.871595+0000","last_undegraded":"2024-06-02T04:49:06.871595+0000","last_fullsized":"2024-06-02T04:49:06.871595+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T06:09:36.074569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"80'3","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.873311+0000","last_change":"2024-06-02T04:48:02.269426+0000","last_active":"2024-06-02T04:49:06.873311+0000","last_peered":"2024-06-02T04:49:06.873311+0000","last_clean":"2024-06-02T04:49:06.873311+0000","last_became_active":"2024-06-02T04:48:02.269115+0000","last_became_peered":"2024-06-02T04:48:02.269115+0000","last_unstale":"2024-06-02T04:49:06.873311+0000","last_undegraded":"2024-06-02T04:49:06.873311+0000","last_fullsized":"2024-06-02T04:49:06.873311+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:18:28.568367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.212859+0000","last_change":"2024-06-02T04:48:02.694234+0000","last_active":"2024-06-02T04:49:36.212859+0000","last_peered":"2024-06-02T04:49:36.212859+0000","last_clean":"2024-06-02T04:49:36.212859+0000","last_became_active":"2024-06-02T04:48:02.693916+0000","last_became_peered":"2024-06-02T04:48:02.693916+0000","last_unstale":"2024-06-02T04:49:36.212859+0000","last_undegraded":"2024-06-02T04:49:36.212859+0000","last_fullsized":"2024-06-02T04:49:36.212859+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T16:47:44.939277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"80'1","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.869829+0000","last_change":"2024-06-02T04:48:06.716026+0000","last_active":"2024-06-02T04:49:06.869829+0000","last_peered":"2024-06-02T04:49:06.869829+0000","last_clean":"2024-06-02T04:49:06.869829+0000","last_became_active":"2024-06-02T04:48:06.715730+0000","last_became_peered":"2024-06-02T04:48:06.715730+0000","last_unstale":"2024-06-02T04:49:06.869829+0000","last_undegraded":"2024-06-02T04:49:06.869829+0000","last_fullsized":"2024-06-02T04:49:06.869829+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:35:53.707307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"80'1","reported_seq":19,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.866068+0000","last_change":"2024-06-02T04:48:02.271576+0000","last_active":"2024-06-02T04:49:06.866068+0000","last_peered":"2024-06-02T04:49:06.866068+0000","last_clean":"2024-06-02T04:49:06.866068+0000","last_became_active":"2024-06-02T04:48:02.271101+0000","last_became_peered":"2024-06-02T04:48:02.271101+0000","last_unstale":"2024-06-02T04:49:06.866068+0000","last_undegraded":"2024-06-02T04:49:06.866068+0000","last_fullsized":"2024-06-02T04:49:06.866068+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T08:35:37.467479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.197637+0000","last_change":"2024-06-02T04:48:02.702773+0000","last_active":"2024-06-02T04:49:36.197637+0000","last_peered":"2024-06-02T04:49:36.197637+0000","last_clean":"2024-06-02T04:49:36.197637+0000","last_became_active":"2024-06-02T04:48:02.702415+0000","last_became_peered":"2024-06-02T04:48:02.702415+0000","last_unstale":"2024-06-02T04:49:36.197637+0000","last_undegraded":"2024-06-02T04:49:36.197637+0000","last_fullsized":"2024-06-02T04:49:36.197637+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:18:55.084384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.868264+0000","last_change":"2024-06-02T04:48:06.963120+0000","last_active":"2024-06-02T04:49:06.868264+0000","last_peered":"2024-06-02T04:49:06.868264+0000","last_clean":"2024-06-02T04:49:06.868264+0000","last_became_active":"2024-06-02T04:48:06.962509+0000","last_became_peered":"2024-06-02T04:48:06.962509+0000","last_unstale":"2024-06-02T04:49:06.868264+0000","last_undegraded":"2024-06-02T04:49:06.868264+0000","last_fullsized":"2024-06-02T04:49:06.868264+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T04:55:34.509179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.869516+0000","last_change":"2024-06-02T04:48:02.273511+0000","last_active":"2024-06-02T04:49:06.869516+0000","last_peered":"2024-06-02T04:49:06.869516+0000","last_clean":"2024-06-02T04:49:06.869516+0000","last_became_active":"2024-06-02T04:48:02.273100+0000","last_became_peered":"2024-06-02T04:48:02.273100+0000","last_unstale":"2024-06-02T04:49:06.869516+0000","last_undegraded":"2024-06-02T04:49:06.869516+0000","last_fullsized":"2024-06-02T04:49:06.869516+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:04:11.742406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.208874+0000","last_change":"2024-06-02T04:48:02.696594+0000","last_active":"2024-06-02T04:49:36.208874+0000","last_peered":"2024-06-02T04:49:36.208874+0000","last_clean":"2024-06-02T04:49:36.208874+0000","last_became_active":"2024-06-02T04:48:02.696278+0000","last_became_peered":"2024-06-02T04:48:02.696278+0000","last_unstale":"2024-06-02T04:49:36.208874+0000","last_undegraded":"2024-06-02T04:49:36.208874+0000","last_fullsized":"2024-06-02T04:49:36.208874+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T16:10:16.275451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.874218+0000","last_change":"2024-06-02T04:48:06.701837+0000","last_active":"2024-06-02T04:49:06.874218+0000","last_peered":"2024-06-02T04:49:06.874218+0000","last_clean":"2024-06-02T04:49:06.874218+0000","last_became_active":"2024-06-02T04:48:06.701454+0000","last_became_peered":"2024-06-02T04:48:06.701454+0000","last_unstale":"2024-06-02T04:49:06.874218+0000","last_undegraded":"2024-06-02T04:49:06.874218+0000","last_fullsized":"2024-06-02T04:49:06.874218+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T16:25:46.585200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"80'3","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.866695+0000","last_change":"2024-06-02T04:48:02.272941+0000","last_active":"2024-06-02T04:49:06.866695+0000","last_peered":"2024-06-02T04:49:06.866695+0000","last_clean":"2024-06-02T04:49:06.866695+0000","last_became_active":"2024-06-02T04:48:02.270149+0000","last_became_peered":"2024-06-02T04:48:02.270149+0000","last_unstale":"2024-06-02T04:49:06.866695+0000","last_undegraded":"2024-06-02T04:49:06.866695+0000","last_fullsized":"2024-06-02T04:49:06.866695+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T04:54:09.813917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.211539+0000","last_change":"2024-06-02T04:48:02.699722+0000","last_active":"2024-06-02T04:49:36.211539+0000","last_peered":"2024-06-02T04:49:36.211539+0000","last_clean":"2024-06-02T04:49:36.211539+0000","last_became_active":"2024-06-02T04:48:02.699376+0000","last_became_peered":"2024-06-02T04:48:02.699376+0000","last_unstale":"2024-06-02T04:49:36.211539+0000","last_undegraded":"2024-06-02T04:49:36.211539+0000","last_fullsized":"2024-06-02T04:49:36.211539+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T08:12:24.048499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.869637+0000","last_change":"2024-06-02T04:48:06.706493+0000","last_active":"2024-06-02T04:49:06.869637+0000","last_peered":"2024-06-02T04:49:06.869637+0000","last_clean":"2024-06-02T04:49:06.869637+0000","last_became_active":"2024-06-02T04:48:06.706135+0000","last_became_peered":"2024-06-02T04:48:06.706135+0000","last_unstale":"2024-06-02T04:49:06.869637+0000","last_undegraded":"2024-06-02T04:49:06.869637+0000","last_fullsized":"2024-06-02T04:49:06.869637+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:54:51.491641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"75'1","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.873217+0000","last_change":"2024-06-02T04:48:02.271534+0000","last_active":"2024-06-02T04:49:06.873217+0000","last_peered":"2024-06-02T04:49:06.873217+0000","last_clean":"2024-06-02T04:49:06.873217+0000","last_became_active":"2024-06-02T04:48:02.271144+0000","last_became_peered":"2024-06-02T04:48:02.271144+0000","last_unstale":"2024-06-02T04:49:06.873217+0000","last_undegraded":"2024-06-02T04:49:06.873217+0000","last_fullsized":"2024-06-02T04:49:06.873217+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:45:10.221432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.205004+0000","last_change":"2024-06-02T04:48:02.697089+0000","last_active":"2024-06-02T04:49:36.205004+0000","last_peered":"2024-06-02T04:49:36.205004+0000","last_clean":"2024-06-02T04:49:36.205004+0000","last_became_active":"2024-06-02T04:48:02.696755+0000","last_became_peered":"2024-06-02T04:48:02.696755+0000","last_unstale":"2024-06-02T04:49:36.205004+0000","last_undegraded":"2024-06-02T04:49:36.205004+0000","last_fullsized":"2024-06-02T04:49:36.205004+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T08:56:18.715019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:07.878105+0000","last_change":"2024-06-02T04:49:07.877440+0000","last_active":"2024-06-02T04:49:07.878105+0000","last_peered":"2024-06-02T04:49:07.878105+0000","last_clean":"2024-06-02T04:49:07.878105+0000","last_became_active":"2024-06-02T04:49:07.877002+0000","last_became_peered":"2024-06-02T04:49:07.877002+0000","last_unstale":"2024-06-02T04:49:07.878105+0000","last_undegraded":"2024-06-02T04:49:07.878105+0000","last_fullsized":"2024-06-02T04:49:07.878105+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T10:08:54.744309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,7,1],"acting":[10,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.e","version":"75'2","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.865165+0000","last_change":"2024-06-02T04:48:02.265912+0000","last_active":"2024-06-02T04:49:06.865165+0000","last_peered":"2024-06-02T04:49:06.865165+0000","last_clean":"2024-06-02T04:49:06.865165+0000","last_became_active":"2024-06-02T04:48:02.265494+0000","last_became_peered":"2024-06-02T04:48:02.265494+0000","last_unstale":"2024-06-02T04:49:06.865165+0000","last_undegraded":"2024-06-02T04:49:06.865165+0000","last_fullsized":"2024-06-02T04:49:06.865165+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T10:21:58.897765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.213799+0000","last_change":"2024-06-02T04:48:02.693091+0000","last_active":"2024-06-02T04:49:36.213799+0000","last_peered":"2024-06-02T04:49:36.213799+0000","last_clean":"2024-06-02T04:49:36.213799+0000","last_became_active":"2024-06-02T04:48:02.692025+0000","last_became_peered":"2024-06-02T04:48:02.692025+0000","last_unstale":"2024-06-02T04:49:36.213799+0000","last_undegraded":"2024-06-02T04:49:36.213799+0000","last_fullsized":"2024-06-02T04:49:36.213799+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T14:36:35.813881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.212739+0000","last_change":"2024-06-02T04:48:02.694381+0000","last_active":"2024-06-02T04:49:36.212739+0000","last_peered":"2024-06-02T04:49:36.212739+0000","last_clean":"2024-06-02T04:49:36.212739+0000","last_became_active":"2024-06-02T04:48:02.694049+0000","last_became_peered":"2024-06-02T04:48:02.694049+0000","last_unstale":"2024-06-02T04:49:36.212739+0000","last_undegraded":"2024-06-02T04:49:36.212739+0000","last_fullsized":"2024-06-02T04:49:36.212739+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:04:31.920810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"82'10","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.185860+0000","last_change":"2024-06-02T04:48:02.702174+0000","last_active":"2024-06-02T04:49:36.185860+0000","last_peered":"2024-06-02T04:49:36.185860+0000","last_clean":"2024-06-02T04:49:36.185860+0000","last_became_active":"2024-06-02T04:48:02.701893+0000","last_became_peered":"2024-06-02T04:48:02.701893+0000","last_unstale":"2024-06-02T04:49:36.185860+0000","last_undegraded":"2024-06-02T04:49:36.185860+0000","last_fullsized":"2024-06-02T04:49:36.185860+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:39:07.224256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.197557+0000","last_change":"2024-06-02T04:48:02.688547+0000","last_active":"2024-06-02T04:49:36.197557+0000","last_peered":"2024-06-02T04:49:36.197557+0000","last_clean":"2024-06-02T04:49:36.197557+0000","last_became_active":"2024-06-02T04:48:02.688183+0000","last_became_peered":"2024-06-02T04:48:02.688183+0000","last_unstale":"2024-06-02T04:49:36.197557+0000","last_undegraded":"2024-06-02T04:49:36.197557+0000","last_fullsized":"2024-06-02T04:49:36.197557+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:47:22.399630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.207474+0000","last_change":"2024-06-02T04:48:02.702958+0000","last_active":"2024-06-02T04:49:36.207474+0000","last_peered":"2024-06-02T04:49:36.207474+0000","last_clean":"2024-06-02T04:49:36.207474+0000","last_became_active":"2024-06-02T04:48:02.702640+0000","last_became_peered":"2024-06-02T04:48:02.702640+0000","last_unstale":"2024-06-02T04:49:36.207474+0000","last_undegraded":"2024-06-02T04:49:36.207474+0000","last_fullsized":"2024-06-02T04:49:36.207474+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T12:53:17.406762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"82'4","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.199772+0000","last_change":"2024-06-02T04:49:07.892927+0000","last_active":"2024-06-02T04:49:36.199772+0000","last_peered":"2024-06-02T04:49:36.199772+0000","last_clean":"2024-06-02T04:49:36.199772+0000","last_became_active":"2024-06-02T04:49:07.892589+0000","last_became_peered":"2024-06-02T04:49:07.892589+0000","last_unstale":"2024-06-02T04:49:36.199772+0000","last_undegraded":"2024-06-02T04:49:36.199772+0000","last_fullsized":"2024-06-02T04:49:36.199772+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T08:37:06.703061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"82'6","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.211826+0000","last_change":"2024-06-02T04:49:07.892107+0000","last_active":"2024-06-02T04:49:36.211826+0000","last_peered":"2024-06-02T04:49:36.211826+0000","last_clean":"2024-06-02T04:49:36.211826+0000","last_became_active":"2024-06-02T04:49:07.891716+0000","last_became_peered":"2024-06-02T04:49:07.891716+0000","last_unstale":"2024-06-02T04:49:36.211826+0000","last_undegraded":"2024-06-02T04:49:36.211826+0000","last_fullsized":"2024-06-02T04:49:36.211826+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T10:25:12.557665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"82'15","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.205165+0000","last_change":"2024-06-02T04:48:02.698865+0000","last_active":"2024-06-02T04:49:36.205165+0000","last_peered":"2024-06-02T04:49:36.205165+0000","last_clean":"2024-06-02T04:49:36.205165+0000","last_became_active":"2024-06-02T04:48:02.698554+0000","last_became_peered":"2024-06-02T04:48:02.698554+0000","last_unstale":"2024-06-02T04:49:36.205165+0000","last_undegraded":"2024-06-02T04:49:36.205165+0000","last_fullsized":"2024-06-02T04:49:36.205165+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:19:14.413170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"82'2","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.216241+0000","last_change":"2024-06-02T04:48:02.694345+0000","last_active":"2024-06-02T04:49:36.216241+0000","last_peered":"2024-06-02T04:49:36.216241+0000","last_clean":"2024-06-02T04:49:36.216241+0000","last_became_active":"2024-06-02T04:48:02.693866+0000","last_became_peered":"2024-06-02T04:48:02.693866+0000","last_unstale":"2024-06-02T04:49:36.216241+0000","last_undegraded":"2024-06-02T04:49:36.216241+0000","last_fullsized":"2024-06-02T04:49:36.216241+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:56:09.409774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.202853+0000","last_change":"2024-06-02T04:48:02.689609+0000","last_active":"2024-06-02T04:49:36.202853+0000","last_peered":"2024-06-02T04:49:36.202853+0000","last_clean":"2024-06-02T04:49:36.202853+0000","last_became_active":"2024-06-02T04:48:02.689279+0000","last_became_peered":"2024-06-02T04:48:02.689279+0000","last_unstale":"2024-06-02T04:49:36.202853+0000","last_undegraded":"2024-06-02T04:49:36.202853+0000","last_fullsized":"2024-06-02T04:49:36.202853+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T14:05:04.600923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.200357+0000","last_change":"2024-06-02T04:48:02.694124+0000","last_active":"2024-06-02T04:49:36.200357+0000","last_peered":"2024-06-02T04:49:36.200357+0000","last_clean":"2024-06-02T04:49:36.200357+0000","last_became_active":"2024-06-02T04:48:02.693787+0000","last_became_peered":"2024-06-02T04:48:02.693787+0000","last_unstale":"2024-06-02T04:49:36.200357+0000","last_undegraded":"2024-06-02T04:49:36.200357+0000","last_fullsized":"2024-06-02T04:49:36.200357+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T07:56:27.274107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"82'10","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.217256+0000","last_change":"2024-06-02T04:48:02.698736+0000","last_active":"2024-06-02T04:49:36.217256+0000","last_peered":"2024-06-02T04:49:36.217256+0000","last_clean":"2024-06-02T04:49:36.217256+0000","last_became_active":"2024-06-02T04:48:02.698285+0000","last_became_peered":"2024-06-02T04:48:02.698285+0000","last_unstale":"2024-06-02T04:49:36.217256+0000","last_undegraded":"2024-06-02T04:49:36.217256+0000","last_fullsized":"2024-06-02T04:49:36.217256+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T04:53:31.655139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"82'11","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.209741+0000","last_change":"2024-06-02T04:48:02.689942+0000","last_active":"2024-06-02T04:49:36.209741+0000","last_peered":"2024-06-02T04:49:36.209741+0000","last_clean":"2024-06-02T04:49:36.209741+0000","last_became_active":"2024-06-02T04:48:02.689096+0000","last_became_peered":"2024-06-02T04:48:02.689096+0000","last_unstale":"2024-06-02T04:49:36.209741+0000","last_undegraded":"2024-06-02T04:49:36.209741+0000","last_fullsized":"2024-06-02T04:49:36.209741+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:11:06.451048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.218470+0000","last_change":"2024-06-02T04:48:02.691514+0000","last_active":"2024-06-02T04:49:36.218470+0000","last_peered":"2024-06-02T04:49:36.218470+0000","last_clean":"2024-06-02T04:49:36.218470+0000","last_became_active":"2024-06-02T04:48:02.691169+0000","last_became_peered":"2024-06-02T04:48:02.691169+0000","last_unstale":"2024-06-02T04:49:36.218470+0000","last_undegraded":"2024-06-02T04:49:36.218470+0000","last_fullsized":"2024-06-02T04:49:36.218470+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T06:03:54.513910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":483,"ondisk_log_size":483,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":280790,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":69415,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":450,"num_read_kb":302,"num_write":163,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":425984,"data_stored":205097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":145,"ondisk_log_size":145,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":71,"seq":304942678044,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":905216,"data_stored":460853,"data_compressed":17559,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 04:49:34 2024","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.57399999999999995,"15min":0.51900000000000002},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":9.5549999999999997,"5min":9.5549999999999997,"15min":9.5549999999999997},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.65800000000000003,"15min":0.60899999999999999},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":9.5749999999999993,"5min":9.5749999999999993,"15min":9.5749999999999993},"last":0.55600000000000005}]},{"osd":1,"last update":"Sun Jun 2 04:49:34 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.59799999999999998,"15min":0.59999999999999998},"min":{"1min":0.42899999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.77400000000000002,"5min":0.998,"15min":0.998},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.439,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.68999999999999995,"5min":1.052,"15min":1.052},"last":0.753}]},{"osd":2,"last update":"Sun Jun 2 04:49:34 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.44600000000000001,"15min":0.438},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.45000000000000001,"15min":0.44400000000000001},"min":{"1min":0.32200000000000001,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.59799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":4,"last update":"Sun Jun 2 04:49:34 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.61299999999999999,"15min":0.61099999999999999},"min":{"1min":0.498,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.78800000000000003,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.627,"5min":0.59399999999999997,"15min":0.58799999999999997},"min":{"1min":0.51500000000000001,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.65300000000000002}]},{"osd":5,"last update":"Sun Jun 2 04:49:34 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.54800000000000004,"15min":0.54300000000000004},"min":{"1min":0.39000000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.76700000000000002,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.38400000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.53300000000000003}]},{"osd":6,"last update":"Sun Jun 2 04:49:34 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.626,"15min":0.63300000000000001},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.88700000000000001,"5min":1.159,"15min":1.159},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.68300000000000005,"15min":0.68899999999999995},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.86899999999999999,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.66400000000000003}]},{"osd":7,"last update":"Sun Jun 2 04:49:34 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.68799999999999994,"15min":0.68999999999999995},"min":{"1min":0.51000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.872,"5min":1.075,"15min":1.075},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.69099999999999995,"15min":0.69299999999999995},"min":{"1min":0.498,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.88300000000000001,"5min":1.123,"15min":1.123},"last":0.70899999999999996}]},{"osd":8,"last update":"Sun Jun 2 04:49:02 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.78300000000000003}]},{"osd":9,"last update":"Sun Jun 2 04:49:34 2024","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.77200000000000002,"15min":0.751},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":4.452,"5min":4.452,"15min":4.452},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.73999999999999999,"15min":0.745},"min":{"1min":0.52800000000000002,"5min":0.505,"15min":0.505},"max":{"1min":0.94699999999999995,"5min":1.429,"15min":1.429},"last":0.83799999999999997}]},{"osd":10,"last update":"Sun Jun 2 04:49:34 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.70399999999999996,"15min":0.70299999999999996},"min":{"1min":0.52200000000000002,"5min":0.505,"15min":0.505},"max":{"1min":0.92700000000000005,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.75,"15min":0.748},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.93300000000000005,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.82699999999999996}]}]},{"osd":10,"up_from":64,"seq":274877906977,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32140,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713012,"statfs":{"total":95995035648,"available":95962124288,"internally_reserved":0,"allocated":1052672,"data_stored":1113581,"data_compressed":53272,"data_compressed_allocated":69632,"data_compressed_original":638976,"omap_allocated":1599,"internal_metadata":31848897},"hb_peers":[0,1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 04:49:06 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.69799999999999995}]},{"osd":1,"last update":"Sun Jun 2 04:49:19 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.44900000000000001,"15min":0.44400000000000001},"min":{"1min":0.33500000000000002,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.625,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.502,"5min":0.47599999999999998,"15min":0.47199999999999998},"min":{"1min":0.28899999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.72199999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.34399999999999997}]},{"osd":2,"last update":"Sun Jun 2 04:49:19 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.627,"15min":0.629},"min":{"1min":0.441,"5min":0.375,"15min":0.375},"max":{"1min":0.72499999999999998,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.623,"15min":0.621},"min":{"1min":0.50600000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.78200000000000003,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.54400000000000004}]},{"osd":3,"last update":"Sun Jun 2 04:49:19 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.55300000000000005,"15min":0.55500000000000005},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.71099999999999997,"5min":0.879,"15min":0.879},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.59399999999999997,"15min":0.58599999999999997},"min":{"1min":0.432,"5min":0.377,"15min":0.377},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.57099999999999995}]},{"osd":4,"last update":"Sun Jun 2 04:49:19 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.56999999999999995,"15min":0.56200000000000006},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.53900000000000003,"15min":0.53500000000000003},"min":{"1min":0.33500000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.42499999999999999}]},{"osd":5,"last update":"Sun Jun 2 04:49:19 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.67800000000000005,"15min":0.67400000000000004},"min":{"1min":0.57299999999999995,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.67500000000000004,"15min":0.67700000000000005},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.80400000000000005,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.505}]},{"osd":6,"last update":"Sun Jun 2 04:49:19 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.61499999999999999,"15min":0.61199999999999999},"min":{"1min":0.40300000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.84899999999999998,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.68899999999999995,"15min":0.68300000000000005},"min":{"1min":0.51700000000000002,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.91300000000000003,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.70999999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":8,"last update":"Sun Jun 2 04:49:19 2024","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.77500000000000002,"15min":0.77200000000000002},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.751,"15min":0.753},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.73999999999999999}]},{"osd":9,"last update":"Sun Jun 2 04:49:19 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.745,"15min":0.74199999999999999},"min":{"1min":0.55300000000000005,"5min":0.441,"15min":0.441},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.72199999999999998,"15min":0.72299999999999998},"min":{"1min":0.51000000000000001,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.95899999999999996,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.78500000000000003}]},{"osd":11,"last update":"Sun Jun 2 04:49:36 2024","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.79200000000000004,"15min":0.78800000000000003},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.751},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.76600000000000001}]}]},{"osd":9,"up_from":60,"seq":257698037796,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32020,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713132,"statfs":{"total":95995035648,"available":95962247168,"internally_reserved":0,"allocated":925696,"data_stored":465185,"data_compressed":17559,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1599,"internal_metadata":31848897},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 04:49:00 2024","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.439,"15min":0.45200000000000001},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.51600000000000001,"5min":0.621,"15min":0.621},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.443,"15min":0.46000000000000002},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.45400000000000001,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.39500000000000002}]},{"osd":1,"last update":"Sun Jun 2 04:49:00 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.59899999999999998,"15min":0.60699999999999998},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.74199999999999999,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.61299999999999999,"15min":0.625},"min":{"1min":0.41599999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.72599999999999998,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.42599999999999999}]},{"osd":2,"last update":"Sun Jun 2 04:49:00 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.60699999999999998,"15min":0.62},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.68999999999999995,"5min":0.748,"15min":0.748},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.57699999999999996,"15min":0.58499999999999996},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.72799999999999998,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.31900000000000001}]},{"osd":3,"last update":"Sun Jun 2 04:49:00 2024","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.51800000000000002,"15min":0.53900000000000003},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.52000000000000002,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.55900000000000005,"15min":0.58099999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.45100000000000001}]},{"osd":4,"last update":"Sun Jun 2 04:49:00 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.60799999999999998,"15min":0.621},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.71099999999999997,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.64900000000000002,"15min":0.65900000000000003},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.79500000000000004,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.50800000000000001}]},{"osd":5,"last update":"Sun Jun 2 04:49:00 2024","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.60399999999999998,"15min":0.61699999999999999},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.71299999999999997,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.67100000000000004,"15min":0.68300000000000005},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.74099999999999999,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.56000000000000005}]},{"osd":6,"last update":"Sun Jun 2 04:47:56 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.505}]},{"osd":7,"last update":"Sun Jun 2 04:49:00 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.75900000000000001,"15min":0.78500000000000003},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.82299999999999995,"5min":1.081,"15min":1.081},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.73999999999999999,"15min":0.76100000000000001},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.83599999999999997,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.52800000000000002}]},{"osd":8,"last update":"Sun Jun 2 04:49:00 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.76000000000000001,"15min":0.78400000000000003},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.79900000000000004,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.498},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.73599999999999999,"15min":0.75800000000000001},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.80700000000000005,"5min":1.01,"15min":1.01},"last":0.51700000000000002}]},{"osd":10,"last update":"Sun Jun 2 04:49:14 2024","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.73199999999999998,"15min":0.74399999999999999},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.86199999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.69599999999999995,"15min":0.70999999999999996},"min":{"1min":0.48299999999999998,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.78600000000000003,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.58099999999999996}]},{"osd":11,"last update":"Sun Jun 2 04:49:06 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.61399999999999999}]}]},{"osd":8,"up_from":53,"seq":227633266727,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":917504,"data_stored":460678,"data_compressed":17559,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 04:48:38 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.54600000000000004,"15min":0.54300000000000004},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.77300000000000002,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.52800000000000002,"15min":0.52400000000000002},"min":{"1min":0.45900000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.41999999999999998}]},{"osd":1,"last update":"Sun Jun 2 04:48:38 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.53900000000000003,"15min":0.53300000000000003},"min":{"1min":0.36899999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.64400000000000002}]},{"osd":2,"last update":"Sun Jun 2 04:48:38 2024","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.42699999999999999,"15min":0.42299999999999999},"min":{"1min":0.311,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.437,"15min":0.433},"min":{"1min":0.26900000000000002,"5min":0.245,"15min":0.245},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.38900000000000001}]},{"osd":3,"last update":"Sun Jun 2 04:48:38 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.53500000000000003,"15min":0.52900000000000003},"min":{"1min":0.35099999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.56100000000000005,"15min":0.55700000000000005},"min":{"1min":0.41199999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.72999999999999998,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.439}]},{"osd":4,"last update":"Sun Jun 2 04:48:38 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.56999999999999995,"15min":0.56799999999999995},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.40999999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.76100000000000001,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.72699999999999998}]},{"osd":5,"last update":"Sun Jun 2 04:48:38 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.52500000000000002,"15min":0.52100000000000002},"min":{"1min":0.33100000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.80800000000000005,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.53500000000000003,"15min":0.53100000000000003},"min":{"1min":0.379,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.82199999999999995,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.50900000000000001}]},{"osd":6,"last update":"Sun Jun 2 04:48:38 2024","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.628,"15min":0.625},"min":{"1min":0.5,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.79100000000000004,"5min":0.876,"15min":0.876},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.63200000000000001,"15min":0.628},"min":{"1min":0.40600000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.84099999999999997,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.622}]},{"osd":7,"last update":"Sun Jun 2 04:48:38 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.66400000000000003,"15min":0.65900000000000003},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.91000000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.67300000000000004,"15min":0.66700000000000004},"min":{"1min":0.50900000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.67800000000000005}]},{"osd":9,"last update":"Sun Jun 2 04:48:59 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.67100000000000004,"15min":0.66100000000000003},"min":{"1min":0.51600000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.68999999999999995,"15min":0.68500000000000005},"min":{"1min":0.47099999999999997,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.91800000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.69099999999999995}]},{"osd":10,"last update":"Sun Jun 2 04:49:18 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.72999999999999998,"15min":0.72399999999999998},"min":{"1min":0.58199999999999996,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.92600000000000005,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.751,"5min":0.73799999999999999,"15min":0.73599999999999999},"min":{"1min":0.60699999999999998,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.94099999999999995,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.75600000000000001}]},{"osd":11,"last update":"Sun Jun 2 04:49:04 2024","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.745}]}]},{"osd":7,"up_from":46,"seq":197568495659,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32068,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713084,"statfs":{"total":95995035648,"available":95962198016,"internally_reserved":0,"allocated":970752,"data_stored":1057217,"data_compressed":53272,"data_compressed_allocated":69632,"data_compressed_original":638976,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 04:47:20 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.30199999999999999}]},{"osd":1,"last update":"Sun Jun 2 04:49:25 2024","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.29499999999999998,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.60099999999999998,"5min":0.746,"15min":0.746},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.435,"5min":0.433,"15min":0.42299999999999999},"min":{"1min":0.29399999999999998,"5min":0.253,"15min":0.253},"max":{"1min":0.56599999999999995,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.42499999999999999}]},{"osd":2,"last update":"Sun Jun 2 04:49:25 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58299999999999996,"15min":0.57299999999999995},"min":{"1min":0.38400000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.745,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.621,"5min":0.59199999999999997,"15min":0.57699999999999996},"min":{"1min":0.39300000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.78500000000000003,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.54200000000000004}]},{"osd":3,"last update":"Sun Jun 2 04:49:25 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.58599999999999997,"15min":0.58699999999999997},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.77500000000000002,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.56699999999999995,"15min":0.55900000000000005},"min":{"1min":0.38200000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.66500000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.65100000000000002}]},{"osd":4,"last update":"Sun Jun 2 04:49:25 2024","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.44400000000000001,"15min":0.438},"min":{"1min":0.312,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.53700000000000003,"15min":0.53500000000000003},"min":{"1min":0.38400000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.71899999999999997,"5min":0.879,"15min":0.879},"last":0.52200000000000002}]},{"osd":5,"last update":"Sun Jun 2 04:49:25 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.60599999999999998,"15min":0.59699999999999998},"min":{"1min":0.41899999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.81699999999999995,"5min":0.873,"15min":0.873},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.66200000000000003,"15min":0.66000000000000003},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.85099999999999998,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.60899999999999999}]},{"osd":6,"last update":"Sun Jun 2 04:49:25 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.625,"15min":0.623},"min":{"1min":0.40300000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.75800000000000001,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.61899999999999999,"15min":0.61199999999999999},"min":{"1min":0.45200000000000001,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.83299999999999996,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.57499999999999996}]},{"osd":8,"last update":"Sun Jun 2 04:48:42 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.70799999999999996,"15min":0.69799999999999995},"min":{"1min":0.54500000000000004,"5min":0.441,"15min":0.441},"max":{"1min":1.0069999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.66900000000000004,"15min":0.66000000000000003},"min":{"1min":0.55400000000000005,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.61799999999999999}]},{"osd":9,"last update":"Sun Jun 2 04:48:57 2024","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.72599999999999998,"15min":0.72799999999999998},"min":{"1min":0.51600000000000001,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.97399999999999998,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.70699999999999996,"15min":0.70899999999999996},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.879,"5min":1.042,"15min":1.042},"last":0.68100000000000005}]},{"osd":10,"last update":"Sun Jun 2 04:49:20 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.70899999999999996,"15min":0.71899999999999997},"min":{"1min":0.46999999999999997,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.83299999999999996,"5min":1.012,"15min":1.012},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.72399999999999998,"15min":0.72999999999999998},"min":{"1min":0.49199999999999999,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.878,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.71599999999999997}]},{"osd":11,"last update":"Sun Jun 2 04:49:04 2024","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.70499999999999996}]}]},{"osd":6,"up_from":40,"seq":171798691886,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":901120,"data_stored":456265,"data_compressed":17559,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 04:49:08 2024","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.40100000000000002,"15min":0.39200000000000002},"min":{"1min":0.28599999999999998,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":1.956,"5min":1.956,"15min":1.956},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.40899999999999997,"15min":0.41299999999999998},"min":{"1min":0.29899999999999999,"5min":0.251,"15min":0.251},"max":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":0.32200000000000001}]},{"osd":1,"last update":"Sun Jun 2 04:49:08 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.40600000000000003,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.034,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.627,"15min":0.59999999999999998},"min":{"1min":0.39700000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":6.0759999999999996,"5min":6.0759999999999996,"15min":6.0759999999999996},"last":0.45700000000000002}]},{"osd":2,"last update":"Sun Jun 2 04:49:08 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.57799999999999996,"15min":0.57299999999999995},"min":{"1min":0.38900000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.63400000000000001,"15min":0.59999999999999998},"min":{"1min":0.371,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":6.2229999999999999,"5min":6.2229999999999999,"15min":6.2229999999999999},"last":0.503}]},{"osd":3,"last update":"Sun Jun 2 04:49:08 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.505,"15min":0.47499999999999998},"min":{"1min":0.29799999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":6.2789999999999999,"5min":6.2789999999999999,"15min":6.2789999999999999},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.47999999999999998,"15min":0.47599999999999998},"min":{"1min":0.34100000000000003,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.984,"5min":1.984,"15min":1.984},"last":0.39100000000000001}]},{"osd":4,"last update":"Sun Jun 2 04:49:08 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.59799999999999998,"15min":0.60299999999999998},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.88200000000000001,"5min":1.032,"15min":1.032},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.67000000000000004,"15min":0.65300000000000002},"min":{"1min":0.38700000000000001,"5min":0.373,"15min":0.373},"max":{"1min":6.1280000000000001,"5min":6.1280000000000001,"15min":6.1280000000000001},"last":0.47599999999999998}]},{"osd":5,"last update":"Sun Jun 2 04:49:08 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.629,"15min":0.625},"min":{"1min":0.436,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.8540000000000001,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64300000000000002,"15min":0.65100000000000002},"min":{"1min":0.40999999999999998,"5min":0.379,"15min":0.379},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.57599999999999996}]},{"osd":7,"last update":"Sun Jun 2 04:49:27 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.63200000000000001,"15min":0.63800000000000001},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.68700000000000006,"15min":0.66300000000000003},"min":{"1min":0.41999999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":6.1609999999999996,"5min":6.1609999999999996,"15min":6.1609999999999996},"last":0.436}]},{"osd":8,"last update":"Sun Jun 2 04:48:39 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.68500000000000005,"15min":0.68000000000000005},"min":{"1min":0.501,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.897,"5min":1.897,"15min":1.897},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.69699999999999995,"15min":0.69899999999999995},"min":{"1min":0.47299999999999998,"5min":0.443,"15min":0.443},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.52600000000000002}]},{"osd":9,"last update":"Sun Jun 2 04:49:00 2024","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.65500000000000003,"15min":0.62},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":6.2530000000000001,"5min":6.2530000000000001,"15min":6.2530000000000001},"last":0.40300000000000002},{"interface":"front","average":{"1min":1.2110000000000001,"5min":0.71999999999999997,"15min":0.63800000000000001},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":12.939,"5min":12.939,"15min":12.939},"last":0.54100000000000004}]},{"osd":10,"last update":"Sun Jun 2 04:49:19 2024","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.68500000000000005,"15min":0.67900000000000005},"min":{"1min":0.56399999999999995,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.73199999999999998,"15min":0.69299999999999995},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":6.1929999999999996,"5min":6.1929999999999996,"15min":6.1929999999999996},"last":0.51900000000000002}]},{"osd":11,"last update":"Sun Jun 2 04:49:08 2024","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.929,"5min":1.929,"15min":1.929},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.621}]}]},{"osd":1,"up_from":12,"seq":51539607616,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36156,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708996,"statfs":{"total":95995035648,"available":95958011904,"internally_reserved":0,"allocated":970752,"data_stored":520669,"data_compressed":17559,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 04:48:46 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.51100000000000001,"15min":0.49099999999999999},"min":{"1min":0.32100000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.85599999999999998,"5min":1.131,"15min":1.131},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.50600000000000001,"15min":0.49099999999999999},"min":{"1min":0.32700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.47499999999999998}]},{"osd":2,"last update":"Sun Jun 2 04:49:00 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.52300000000000002,"15min":0.51400000000000001},"min":{"1min":0.40799999999999997,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.72999999999999998,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.53700000000000003,"15min":0.51100000000000001},"min":{"1min":0.38800000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.79700000000000004,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.58199999999999996}]},{"osd":3,"last update":"Sun Jun 2 04:49:17 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.54600000000000004,"15min":0.503},"min":{"1min":0.36899999999999999,"5min":0.316,"15min":0.316},"max":{"1min":3.2509999999999999,"5min":3.2509999999999999,"15min":3.2509999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51200000000000001,"15min":0.504},"min":{"1min":0.376,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.70499999999999996,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.50800000000000001}]},{"osd":4,"last update":"Sun Jun 2 04:49:03 2024","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.41099999999999998}]},{"osd":5,"last update":"Sun Jun 2 04:48:54 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.56000000000000005,"15min":0.54100000000000004},"min":{"1min":0.41999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.78000000000000003,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.624,"15min":0.59999999999999998},"min":{"1min":0.441,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.88300000000000001,"5min":1.212,"15min":1.212},"last":0.67500000000000004}]},{"osd":6,"last update":"Sun Jun 2 04:49:12 2024","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.61699999999999999,"15min":0.59699999999999998},"min":{"1min":0.45900000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.90300000000000002,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.75},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.61299999999999999,"15min":0.59699999999999998},"min":{"1min":0.44700000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.91600000000000004,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.70199999999999996}]},{"osd":7,"last update":"Sun Jun 2 04:49:28 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.53500000000000003,"15min":0.53700000000000003},"min":{"1min":0.36299999999999999,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.70399999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59099999999999997,"15min":0.58299999999999996},"min":{"1min":0.40100000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.77600000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.76600000000000001}]},{"osd":8,"last update":"Sun Jun 2 04:48:41 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.67300000000000004,"15min":0.67400000000000004},"min":{"1min":0.45700000000000002,"5min":0.435,"15min":0.435},"max":{"1min":0.85399999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72899999999999998,"15min":0.72999999999999998},"min":{"1min":0.46600000000000003,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.97499999999999998,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.84499999999999997}]},{"osd":9,"last update":"Sun Jun 2 04:49:00 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.52700000000000002,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.95399999999999996,"5min":1.288,"15min":1.288},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.71399999999999997,"15min":0.70999999999999996},"min":{"1min":0.56999999999999995,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.80700000000000005}]},{"osd":10,"last update":"Sun Jun 2 04:49:17 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.65800000000000003,"15min":0.65700000000000003},"min":{"1min":0.49199999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.84099999999999997,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.751,"5min":0.746,"15min":0.745},"min":{"1min":0.60099999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.86299999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.79500000000000004}]},{"osd":11,"last update":"Sun Jun 2 04:49:03 2024","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.86499999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738434,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32016,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713136,"statfs":{"total":95995035648,"available":95962251264,"internally_reserved":0,"allocated":925696,"data_stored":457653,"data_compressed":17559,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jun 2 04:48:43 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.51000000000000001,"15min":0.46999999999999997},"min":{"1min":0.35199999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.51000000000000001,"15min":0.46500000000000002},"min":{"1min":0.32000000000000001,"5min":0.315,"15min":0.315},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.51200000000000001}]},{"osd":2,"last update":"Sun Jun 2 04:49:03 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.52000000000000002,"15min":0.47599999999999998},"min":{"1min":0.46000000000000002,"5min":0.314,"15min":0.314},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.54000000000000004,"15min":0.48699999999999999},"min":{"1min":0.42599999999999999,"5min":0.307,"15min":0.307},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.63}]},{"osd":3,"last update":"Sun Jun 2 04:49:03 2024","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.31900000000000001}]},{"osd":4,"last update":"Sun Jun 2 04:48:37 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.54800000000000004,"15min":0.52100000000000002},"min":{"1min":0.38200000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.53800000000000003,"15min":0.52400000000000002},"min":{"1min":0.42599999999999999,"5min":0.372,"15min":0.372},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.53800000000000003}]},{"osd":5,"last update":"Sun Jun 2 04:48:52 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.57199999999999995,"15min":0.53900000000000003},"min":{"1min":0.377,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.57299999999999995,"15min":0.54100000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.61799999999999999}]},{"osd":6,"last update":"Sun Jun 2 04:49:09 2024","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.48499999999999999,"15min":0.49099999999999999},"min":{"1min":0.30099999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.47399999999999998,"15min":0.46999999999999997},"min":{"1min":0.33000000000000002,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.441}]},{"osd":7,"last update":"Sun Jun 2 04:49:09 2024","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.71099999999999997}]},{"osd":8,"last update":"Sun Jun 2 04:48:41 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.64200000000000002,"15min":0.64500000000000002},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.70299999999999996,"15min":0.70699999999999996},"min":{"1min":0.54500000000000004,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.67600000000000005}]},{"osd":9,"last update":"Sun Jun 2 04:48:57 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.627,"15min":0.63700000000000001},"min":{"1min":0.36699999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.60799999999999998,"15min":0.60999999999999999},"min":{"1min":0.39600000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.56599999999999995}]},{"osd":10,"last update":"Sun Jun 2 04:49:18 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.68899999999999995,"15min":0.68600000000000005},"min":{"1min":0.52300000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.67700000000000005,"15min":0.68100000000000005},"min":{"1min":0.52500000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.69899999999999995}]},{"osd":11,"last update":"Sun Jun 2 04:49:35 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.66700000000000004,"15min":0.66900000000000004},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.72299999999999998,"15min":0.72599999999999998},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.76300000000000001}]}]},{"osd":2,"up_from":16,"seq":68719476796,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32084,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713068,"statfs":{"total":95995035648,"available":95962181632,"internally_reserved":0,"allocated":991232,"data_stored":517321,"data_compressed":17559,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 04:49:07 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.51700000000000002,"15min":0.49299999999999999},"min":{"1min":0.434,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.51100000000000001,"15min":0.51000000000000001},"min":{"1min":0.39500000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.70099999999999996,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.63300000000000001}]},{"osd":1,"last update":"Sun Jun 2 04:49:07 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.56100000000000005,"15min":0.53700000000000003},"min":{"1min":0.46200000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.57699999999999996,"15min":0.55600000000000005},"min":{"1min":0.40899999999999997,"5min":0.254,"15min":0.254},"max":{"1min":0.92000000000000004,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.61899999999999999}]},{"osd":3,"last update":"Sun Jun 2 04:49:22 2024","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.43099999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.79400000000000004,"5min":1.472,"15min":1.472},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.62,"5min":0.55100000000000005,"15min":0.53300000000000003},"min":{"1min":0.48099999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.77400000000000002,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.503}]},{"osd":4,"last update":"Sun Jun 2 04:49:02 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.44900000000000001}]},{"osd":5,"last update":"Sun Jun 2 04:48:53 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.46400000000000002,"15min":0.42599999999999999},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.48499999999999999,"15min":0.45300000000000001},"min":{"1min":0.34100000000000003,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.56200000000000006}]},{"osd":6,"last update":"Sun Jun 2 04:49:07 2024","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.60199999999999998,"15min":0.59299999999999997},"min":{"1min":0.441,"5min":0.372,"15min":0.372},"max":{"1min":0.90400000000000003,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.67100000000000004,"15min":0.64300000000000002},"min":{"1min":0.66900000000000004,"5min":0.438,"15min":0.438},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.66200000000000003}]},{"osd":7,"last update":"Sun Jun 2 04:49:07 2024","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.72099999999999997}]},{"osd":8,"last update":"Sun Jun 2 04:48:42 2024","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.56699999999999995,"15min":0.56100000000000005},"min":{"1min":0.42399999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.63100000000000001,"15min":0.621},"min":{"1min":0.41499999999999998,"5min":0.37,"15min":0.37},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.745}]},{"osd":9,"last update":"Sun Jun 2 04:49:02 2024","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.65700000000000003,"15min":0.64600000000000002},"min":{"1min":0.52400000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.75900000000000001,"15min":0.747},"min":{"1min":0.66600000000000004,"5min":0.5,"15min":0.5},"max":{"1min":0.99299999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.76900000000000002}]},{"osd":10,"last update":"Sun Jun 2 04:49:17 2024","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.68799999999999994,"15min":0.66900000000000004},"min":{"1min":0.60899999999999999,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.72899999999999998,"15min":0.71499999999999997},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.75600000000000001}]},{"osd":11,"last update":"Sun Jun 2 04:49:02 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.73399999999999999}]}]},{"osd":3,"up_from":22,"seq":94489280568,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32004,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713148,"statfs":{"total":95995035648,"available":95962263552,"internally_reserved":0,"allocated":913408,"data_stored":456459,"data_compressed":17559,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 04:49:22 2024","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":0.46899999999999997,"15min":0.35999999999999999},"min":{"1min":0.26700000000000002,"5min":0.221,"15min":0.221},"max":{"1min":11.061999999999999,"5min":11.061999999999999,"15min":11.061999999999999},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.35999999999999999,"15min":0.34399999999999997},"min":{"1min":0.27500000000000002,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.31}]},{"osd":1,"last update":"Sun Jun 2 04:49:22 2024","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.58399999999999996,"15min":0.496},"min":{"1min":0.35699999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":7.3600000000000003,"5min":7.3600000000000003,"15min":7.3600000000000003},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.51100000000000001,"15min":0.46899999999999997},"min":{"1min":0.38200000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.53300000000000003}]},{"osd":2,"last update":"Sun Jun 2 04:49:22 2024","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.56100000000000005,"15min":0.56399999999999995},"min":{"1min":0.40300000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.3420000000000001,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.65000000000000002,"15min":0.61499999999999999},"min":{"1min":0.41299999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":7.2869999999999999,"5min":7.2869999999999999,"15min":7.2869999999999999},"last":0.443}]},{"osd":4,"last update":"Sun Jun 2 04:48:38 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.51400000000000001,"15min":0.499},"min":{"1min":0.41599999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.67300000000000004,"5min":0.877,"15min":0.877},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.52600000000000002,"15min":0.505},"min":{"1min":0.40999999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.72299999999999998,"5min":0.751,"15min":0.751},"last":0.47599999999999998}]},{"osd":5,"last update":"Sun Jun 2 04:48:54 2024","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.63400000000000001,"15min":0.57999999999999996},"min":{"1min":0.38900000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":7.3220000000000001,"5min":7.3220000000000001,"15min":7.3220000000000001},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55300000000000005,"15min":0.54900000000000004},"min":{"1min":0.39800000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.90000000000000002,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.46300000000000002}]},{"osd":6,"last update":"Sun Jun 2 04:49:08 2024","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":0.61099999999999999,"15min":0.51500000000000001},"min":{"1min":0.36299999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":11.128,"5min":11.128,"15min":11.128},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.55900000000000005,"15min":0.5},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":7.6159999999999997,"5min":7.6159999999999997,"15min":7.6159999999999997},"last":0.32700000000000001}]},{"osd":7,"last update":"Sun Jun 2 04:49:29 2024","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.67900000000000005,"15min":0.63200000000000001},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":7.3869999999999996,"5min":7.3869999999999996,"15min":7.3869999999999996},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64700000000000002,"15min":0.65100000000000002},"min":{"1min":0.46000000000000002,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.60199999999999998}]},{"osd":8,"last update":"Sun Jun 2 04:47:39 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.51100000000000001}]},{"osd":9,"last update":"Sun Jun 2 04:49:03 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.58299999999999996,"15min":0.58899999999999997},"min":{"1min":0.41899999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.72599999999999998,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.504},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.66000000000000003,"15min":0.60899999999999999},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":7.2389999999999999,"5min":7.2389999999999999,"15min":7.2389999999999999},"last":0.36599999999999999}]},{"osd":10,"last update":"Sun Jun 2 04:49:17 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.68200000000000005,"15min":0.68400000000000005},"min":{"1min":0.54800000000000004,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.871,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.68000000000000005,"15min":0.67500000000000004},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.63400000000000001}]},{"osd":11,"last update":"Sun Jun 2 04:49:03 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.54300000000000004}]}]},{"osd":4,"up_from":29,"seq":124554051637,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32012,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713140,"statfs":{"total":95995035648,"available":95962255360,"internally_reserved":0,"allocated":913408,"data_stored":461260,"data_compressed":17559,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 04:47:31 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.49199999999999999,"15min":0.48099999999999998},"min":{"1min":0.32400000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.495,"15min":0.48699999999999999},"min":{"1min":0.35199999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.78900000000000003,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.34300000000000003}]},{"osd":1,"last update":"Sun Jun 2 04:48:33 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.36099999999999999,"15min":0.34300000000000003},"min":{"1min":0.27500000000000002,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.38900000000000001,"15min":0.36699999999999999},"min":{"1min":0.30199999999999999,"5min":0.217,"15min":0.217},"max":{"1min":0.72799999999999998,"5min":0.877,"15min":0.877},"last":0.47999999999999998}]},{"osd":2,"last update":"Sun Jun 2 04:48:33 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.53900000000000003,"15min":0.52800000000000002},"min":{"1min":0.41899999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.624,"5min":0.56399999999999995,"15min":0.53800000000000003},"min":{"1min":0.47099999999999997,"5min":0.377,"15min":0.377},"max":{"1min":0.80800000000000005,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.58299999999999996}]},{"osd":3,"last update":"Sun Jun 2 04:48:33 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.54000000000000004,"15min":0.51800000000000002},"min":{"1min":0.373,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.748},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.52000000000000002,"15min":0.51000000000000001},"min":{"1min":0.38100000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.72899999999999998,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.63700000000000001}]},{"osd":5,"last update":"Sun Jun 2 04:48:53 2024","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.60999999999999999,"15min":0.60199999999999998},"min":{"1min":0.46100000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.85499999999999998,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.621,"15min":0.59999999999999998},"min":{"1min":0.46500000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.96599999999999997,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.60599999999999998}]},{"osd":6,"last update":"Sun Jun 2 04:49:10 2024","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.58299999999999996,"15min":0.56100000000000005},"min":{"1min":0.441,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.59299999999999997,"15min":0.57699999999999996},"min":{"1min":0.41199999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.79500000000000004,"5min":1.03,"15min":1.03},"last":0.68000000000000005}]},{"osd":7,"last update":"Sun Jun 2 04:49:25 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.54000000000000004,"15min":0.52500000000000002},"min":{"1min":0.41599999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.57599999999999996,"15min":0.55500000000000005},"min":{"1min":0.40100000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.82199999999999995,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.66100000000000003}]},{"osd":8,"last update":"Sun Jun 2 04:48:40 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.60599999999999998,"15min":0.60399999999999998},"min":{"1min":0.45100000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.78200000000000003,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71499999999999997,"15min":0.71399999999999997},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.94399999999999995,"5min":1.071,"15min":1.071},"last":0.79500000000000004}]},{"osd":9,"last update":"Sun Jun 2 04:48:58 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.74099999999999999,"15min":0.745},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.62,"5min":0.64200000000000002,"15min":0.64600000000000002},"min":{"1min":0.47699999999999998,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.83999999999999997,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.73499999999999999}]},{"osd":10,"last update":"Sun Jun 2 04:49:16 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.748,"15min":0.75800000000000001},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.93100000000000005,"5min":1.071,"15min":1.071},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.76400000000000001,"15min":0.77000000000000002},"min":{"1min":0.52800000000000002,"5min":0.504,"15min":0.504},"max":{"1min":0.99399999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.83699999999999997}]},{"osd":11,"last update":"Sun Jun 2 04:49:02 2024","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.86499999999999999}]}]},{"osd":5,"up_from":33,"seq":141733920818,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":978944,"data_stored":1053081,"data_compressed":53272,"data_compressed_allocated":69632,"data_compressed_original":638976,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 04:48:50 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.504,"15min":0.48499999999999999},"min":{"1min":0.40200000000000002,"5min":0.249,"15min":0.249},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.496},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.47499999999999998,"15min":0.45100000000000001},"min":{"1min":0.374,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.47599999999999998}]},{"osd":1,"last update":"Sun Jun 2 04:48:50 2024","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.55300000000000005,"15min":0.52900000000000003},"min":{"1min":0.5,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.79500000000000004,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.55100000000000005,"15min":0.53500000000000003},"min":{"1min":0.47099999999999997,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.77900000000000003,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.625}]},{"osd":2,"last update":"Sun Jun 2 04:48:50 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.40999999999999998,"15min":0.39500000000000002},"min":{"1min":0.317,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.40899999999999997,"15min":0.38700000000000001},"min":{"1min":0.316,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.58099999999999996}]},{"osd":3,"last update":"Sun Jun 2 04:48:50 2024","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.53000000000000003,"15min":0.52000000000000002},"min":{"1min":0.38800000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.621,"5min":0.53900000000000003,"15min":0.51200000000000001},"min":{"1min":0.46100000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.80200000000000005,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.77000000000000002}]},{"osd":4,"last update":"Sun Jun 2 04:48:50 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.58199999999999996,"15min":0.55900000000000005},"min":{"1min":0.54200000000000004,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.58999999999999997,"15min":0.57599999999999996},"min":{"1min":0.54300000000000004,"5min":0.313,"15min":0.313},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.79400000000000004}]},{"osd":6,"last update":"Sun Jun 2 04:49:07 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.58899999999999997,"15min":0.57699999999999996},"min":{"1min":0.439,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.60799999999999998,"15min":0.58499999999999996},"min":{"1min":0.52800000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.875,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.95399999999999996}]},{"osd":7,"last update":"Sun Jun 2 04:49:23 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.67000000000000004,"15min":0.65900000000000003},"min":{"1min":0.56799999999999995,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.86199999999999999,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.752,"5min":0.67600000000000005,"15min":0.65400000000000003},"min":{"1min":0.45600000000000002,"5min":0.435,"15min":0.435},"max":{"1min":0.93300000000000005,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.81799999999999995}]},{"osd":8,"last update":"Sun Jun 2 04:48:43 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.60699999999999998,"15min":0.59099999999999997},"min":{"1min":0.42099999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.623,"15min":0.61599999999999999},"min":{"1min":0.39000000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.90000000000000002,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.75700000000000001}]},{"osd":9,"last update":"Sun Jun 2 04:49:04 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.65700000000000003,"15min":0.64500000000000002},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.69199999999999995,"15min":0.67600000000000005},"min":{"1min":0.60699999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.92300000000000004}]},{"osd":10,"last update":"Sun Jun 2 04:49:18 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.70499999999999996,"15min":0.69899999999999995},"min":{"1min":0.53700000000000003,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.92100000000000004,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.75},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.745,"15min":0.73399999999999999},"min":{"1min":0.66000000000000003,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.95499999999999996,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.85599999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34075,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34075,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34075,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35713,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35713,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35713,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35713,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35713,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":64494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":62420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":989,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":67038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-02T04:49:41.978 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-06-02T04:49:41.979 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-02T04:49:42.102 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.101+0000 7f2ab6334700 1 -- 172.21.15.76:0/3419420751 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2ab01018f0 msgr2=0x7f2ab01081a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:42.102 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.101+0000 7f2ab6334700 1 --2- 172.21.15.76:0/3419420751 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2ab01018f0 0x7f2ab01081a0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f2aa800b0d0 tx=0x7f2aa800b3e0 comp rx=0 tx=0).stop 2024-06-02T04:49:42.102 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.101+0000 7f2ab6334700 1 -- 172.21.15.76:0/3419420751 shutdown_connections 2024-06-02T04:49:42.102 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.101+0000 7f2ab6334700 1 --2- 172.21.15.76:0/3419420751 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2ab01018f0 0x7f2ab01081a0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:42.102 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.101+0000 7f2ab6334700 1 --2- 172.21.15.76:0/3419420751 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2ab00ffd60 0x7f2ab0100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:42.103 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.101+0000 7f2ab6334700 1 --2- 172.21.15.76:0/3419420751 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2ab0100f50 0x7f2ab01013b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:42.103 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.101+0000 7f2ab6334700 1 -- 172.21.15.76:0/3419420751 >> 172.21.15.76:0/3419420751 conn(0x7f2ab00fb2f0 msgr2=0x7f2ab00fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:42.103 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.101+0000 7f2ab6334700 1 -- 172.21.15.76:0/3419420751 shutdown_connections 2024-06-02T04:49:42.103 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.101+0000 7f2ab6334700 1 -- 172.21.15.76:0/3419420751 wait complete. 2024-06-02T04:49:42.103 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.102+0000 7f2ab6334700 1 Processor -- start 2024-06-02T04:49:42.103 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.102+0000 7f2ab6334700 1 -- start start 2024-06-02T04:49:42.105 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.102+0000 7f2ab6334700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2ab00ffd60 0x7f2ab0196e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:42.105 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.102+0000 7f2ab6334700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2ab0100f50 0x7f2ab0197390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:42.105 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.102+0000 7f2ab6334700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2ab01018f0 0x7f2ab019e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:42.105 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.102+0000 7f2ab6334700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab019e930 con 0x7f2ab00ffd60 2024-06-02T04:49:42.105 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.102+0000 7f2ab6334700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab019ea70 con 0x7f2ab01018f0 2024-06-02T04:49:42.105 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.102+0000 7f2ab6334700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab019ec00 con 0x7f2ab0100f50 2024-06-02T04:49:42.106 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.102+0000 7f2aaffff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2ab00ffd60 0x7f2ab0196e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:42.106 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.102+0000 7f2aaffff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2ab00ffd60 0x7f2ab0196e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:55214/0 (socket says 172.21.15.76:55214) 2024-06-02T04:49:42.106 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.102+0000 7f2aaffff700 1 -- 172.21.15.76:0/4178268004 learned_addr learned my addr 172.21.15.76:0/4178268004 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:49:42.106 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.102+0000 7f2ab48d1700 1 --2- 172.21.15.76:0/4178268004 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2ab01018f0 0x7f2ab019e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:42.106 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.102+0000 7f2aaf7fe700 1 --2- 172.21.15.76:0/4178268004 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2ab0100f50 0x7f2ab0197390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:42.106 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.102+0000 7f2aaffff700 1 -- 172.21.15.76:0/4178268004 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2ab0100f50 msgr2=0x7f2ab0197390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:42.106 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.102+0000 7f2aaffff700 1 --2- 172.21.15.76:0/4178268004 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2ab0100f50 0x7f2ab0197390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:42.106 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.102+0000 7f2aaffff700 1 -- 172.21.15.76:0/4178268004 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2ab01018f0 msgr2=0x7f2ab019e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:42.106 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.102+0000 7f2aaffff700 1 --2- 172.21.15.76:0/4178268004 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2ab01018f0 0x7f2ab019e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:42.106 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.103+0000 7f2aaffff700 1 -- 172.21.15.76:0/4178268004 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aa8009d00 con 0x7f2ab00ffd60 2024-06-02T04:49:42.106 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.103+0000 7f2aaffff700 1 --2- 172.21.15.76:0/4178268004 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2ab00ffd60 0x7f2ab0196e50 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f2aa000b500 tx=0x7f2aa000b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:42.106 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.103+0000 7f2aad7fa700 1 -- 172.21.15.76:0/4178268004 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aa0011830 con 0x7f2ab00ffd60 2024-06-02T04:49:42.107 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.103+0000 7f2aad7fa700 1 -- 172.21.15.76:0/4178268004 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2aa0011e20 con 0x7f2ab00ffd60 2024-06-02T04:49:42.107 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.103+0000 7f2ab6334700 1 -- 172.21.15.76:0/4178268004 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ab019eee0 con 0x7f2ab00ffd60 2024-06-02T04:49:42.107 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.103+0000 7f2aad7fa700 1 -- 172.21.15.76:0/4178268004 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aa0010dd0 con 0x7f2ab00ffd60 2024-06-02T04:49:42.107 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.103+0000 7f2ab6334700 1 -- 172.21.15.76:0/4178268004 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ab019f380 con 0x7f2ab00ffd60 2024-06-02T04:49:42.107 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.104+0000 7f2ab6334700 1 -- 172.21.15.76:0/4178268004 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ab0067c10 con 0x7f2ab00ffd60 2024-06-02T04:49:42.107 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.105+0000 7f2aad7fa700 1 -- 172.21.15.76:0/4178268004 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f2aa0011990 con 0x7f2ab00ffd60 2024-06-02T04:49:42.107 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.105+0000 7f2aad7fa700 1 --2- 172.21.15.76:0/4178268004 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f2a9c0a1120 0x7f2a9c0a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:42.108 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.106+0000 7f2aaf7fe700 1 --2- 172.21.15.76:0/4178268004 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f2a9c0a1120 0x7f2a9c0a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:42.108 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.106+0000 7f2aad7fa700 1 -- 172.21.15.76:0/4178268004 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f2aa00cca30 con 0x7f2ab00ffd60 2024-06-02T04:49:42.108 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.106+0000 7f2aaf7fe700 1 --2- 172.21.15.76:0/4178268004 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f2a9c0a1120 0x7f2a9c0a35e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f2a9800ba60 tx=0x7f2a98005d50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:42.109 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.109+0000 7f2aad7fa700 1 -- 172.21.15.76:0/4178268004 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f2aa0095e50 con 0x7f2ab00ffd60 2024-06-02T04:49:42.305 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.305+0000 7f2ab6334700 1 -- 172.21.15.76:0/4178268004 --> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2ab00fd4a0 con 0x7f2a9c0a1120 2024-06-02T04:49:42.317 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.317+0000 7f2aad7fa700 1 -- 172.21.15.76:0/4178268004 <== mgr.14152 v2:172.21.15.76:6800/2591353090 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+427304 (secure 0 0 0) 0x7f2ab00fd4a0 con 0x7f2a9c0a1120 2024-06-02T04:49:42.322 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:49:42.326 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.321+0000 7f2ab6334700 1 -- 172.21.15.76:0/4178268004 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f2a9c0a1120 msgr2=0x7f2a9c0a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:42.326 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.321+0000 7f2ab6334700 1 --2- 172.21.15.76:0/4178268004 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f2a9c0a1120 0x7f2a9c0a35e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f2a9800ba60 tx=0x7f2a98005d50 comp rx=0 tx=0).stop 2024-06-02T04:49:42.326 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.321+0000 7f2ab6334700 1 -- 172.21.15.76:0/4178268004 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2ab00ffd60 msgr2=0x7f2ab0196e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:42.326 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.321+0000 7f2ab6334700 1 --2- 172.21.15.76:0/4178268004 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2ab00ffd60 0x7f2ab0196e50 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f2aa000b500 tx=0x7f2aa000b810 comp rx=0 tx=0).stop 2024-06-02T04:49:42.326 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.321+0000 7f2ab6334700 1 -- 172.21.15.76:0/4178268004 shutdown_connections 2024-06-02T04:49:42.326 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.321+0000 7f2ab6334700 1 --2- 172.21.15.76:0/4178268004 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f2a9c0a1120 0x7f2a9c0a35e0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:42.326 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.321+0000 7f2ab6334700 1 --2- 172.21.15.76:0/4178268004 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2ab01018f0 0x7f2ab019e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:42.326 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.321+0000 7f2ab6334700 1 --2- 172.21.15.76:0/4178268004 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2ab00ffd60 0x7f2ab0196e50 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:42.326 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.321+0000 7f2ab6334700 1 --2- 172.21.15.76:0/4178268004 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2ab0100f50 0x7f2ab0197390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:42.327 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.321+0000 7f2ab6334700 1 -- 172.21.15.76:0/4178268004 >> 172.21.15.76:0/4178268004 conn(0x7f2ab00fb2f0 msgr2=0x7f2ab00fcd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:42.327 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.321+0000 7f2ab6334700 1 -- 172.21.15.76:0/4178268004 shutdown_connections 2024-06-02T04:49:42.327 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.321+0000 7f2ab6334700 1 -- 172.21.15.76:0/4178268004 wait complete. 2024-06-02T04:49:42.327 INFO:teuthology.orchestra.run.smithi076.stderr:dumped all 2024-06-02T04:49:42.333 INFO:teuthology.orchestra.run.smithi076.stdout:{"pg_ready":true,"pg_map":{"version":270,"stamp":"2024-06-02T04:49:42.176562+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":660638,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":587,"num_read_kb":412,"num_write":353,"num_write_kb":3068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":1180736,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":788,"ondisk_log_size":788,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":372160,"kb_used_data":11104,"kb_used_omap":18,"kb_used_meta":360941,"kb_avail":1124569664,"statfs":{"total":1151940427776,"available":1151559335936,"internally_reserved":0,"allocated":11370496,"data_stored":7487749,"data_compressed":317847,"data_compressed_allocated":430080,"data_compressed_original":2359296,"omap_allocated":19131,"internal_metadata":369603909},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":6285,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":38,"num_write":16,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003779"},"pg_stats":[{"pgid":"3.3f","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.217391+0000","last_change":"2024-06-02T04:48:02.689765+0000","last_active":"2024-06-02T04:49:36.217391+0000","last_peered":"2024-06-02T04:49:36.217391+0000","last_clean":"2024-06-02T04:49:36.217391+0000","last_became_active":"2024-06-02T04:48:02.689464+0000","last_became_peered":"2024-06-02T04:48:02.689464+0000","last_unstale":"2024-06-02T04:49:36.217391+0000","last_undegraded":"2024-06-02T04:49:36.217391+0000","last_fullsized":"2024-06-02T04:49:36.217391+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:13:19.743519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"82'4","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.201250+0000","last_change":"2024-06-02T04:48:02.691499+0000","last_active":"2024-06-02T04:49:36.201250+0000","last_peered":"2024-06-02T04:49:36.201250+0000","last_clean":"2024-06-02T04:49:36.201250+0000","last_became_active":"2024-06-02T04:48:02.691179+0000","last_became_peered":"2024-06-02T04:48:02.691179+0000","last_unstale":"2024-06-02T04:49:36.201250+0000","last_undegraded":"2024-06-02T04:49:36.201250+0000","last_fullsized":"2024-06-02T04:49:36.201250+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T14:00:17.118877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.212494+0000","last_change":"2024-06-02T04:48:02.688527+0000","last_active":"2024-06-02T04:49:36.212494+0000","last_peered":"2024-06-02T04:49:36.212494+0000","last_clean":"2024-06-02T04:49:36.212494+0000","last_became_active":"2024-06-02T04:48:02.688184+0000","last_became_peered":"2024-06-02T04:48:02.688184+0000","last_unstale":"2024-06-02T04:49:36.212494+0000","last_undegraded":"2024-06-02T04:49:36.212494+0000","last_fullsized":"2024-06-02T04:49:36.212494+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T08:40:35.052887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.210472+0000","last_change":"2024-06-02T04:48:02.695277+0000","last_active":"2024-06-02T04:49:36.210472+0000","last_peered":"2024-06-02T04:49:36.210472+0000","last_clean":"2024-06-02T04:49:36.210472+0000","last_became_active":"2024-06-02T04:48:02.694951+0000","last_became_peered":"2024-06-02T04:48:02.694951+0000","last_unstale":"2024-06-02T04:49:36.210472+0000","last_undegraded":"2024-06-02T04:49:36.210472+0000","last_fullsized":"2024-06-02T04:49:36.210472+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T14:13:50.672421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"82'4","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.211340+0000","last_change":"2024-06-02T04:48:02.691454+0000","last_active":"2024-06-02T04:49:36.211340+0000","last_peered":"2024-06-02T04:49:36.211340+0000","last_clean":"2024-06-02T04:49:36.211340+0000","last_became_active":"2024-06-02T04:48:02.691083+0000","last_became_peered":"2024-06-02T04:48:02.691083+0000","last_unstale":"2024-06-02T04:49:36.211340+0000","last_undegraded":"2024-06-02T04:49:36.211340+0000","last_fullsized":"2024-06-02T04:49:36.211340+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T07:12:58.481115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.205381+0000","last_change":"2024-06-02T04:48:02.690371+0000","last_active":"2024-06-02T04:49:36.205381+0000","last_peered":"2024-06-02T04:49:36.205381+0000","last_clean":"2024-06-02T04:49:36.205381+0000","last_became_active":"2024-06-02T04:48:02.682047+0000","last_became_peered":"2024-06-02T04:48:02.682047+0000","last_unstale":"2024-06-02T04:49:36.205381+0000","last_undegraded":"2024-06-02T04:49:36.205381+0000","last_fullsized":"2024-06-02T04:49:36.205381+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:17:59.717575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.200626+0000","last_change":"2024-06-02T04:48:02.697823+0000","last_active":"2024-06-02T04:49:36.200626+0000","last_peered":"2024-06-02T04:49:36.200626+0000","last_clean":"2024-06-02T04:49:36.200626+0000","last_became_active":"2024-06-02T04:48:02.697491+0000","last_became_peered":"2024-06-02T04:48:02.697491+0000","last_unstale":"2024-06-02T04:49:36.200626+0000","last_undegraded":"2024-06-02T04:49:36.200626+0000","last_fullsized":"2024-06-02T04:49:36.200626+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T16:08:39.689192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.204224+0000","last_change":"2024-06-02T04:48:02.702564+0000","last_active":"2024-06-02T04:49:36.204224+0000","last_peered":"2024-06-02T04:49:36.204224+0000","last_clean":"2024-06-02T04:49:36.204224+0000","last_became_active":"2024-06-02T04:48:02.702259+0000","last_became_peered":"2024-06-02T04:48:02.702259+0000","last_unstale":"2024-06-02T04:49:36.204224+0000","last_undegraded":"2024-06-02T04:49:36.204224+0000","last_fullsized":"2024-06-02T04:49:36.204224+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T12:33:28.945414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"82'11","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.216962+0000","last_change":"2024-06-02T04:48:02.694090+0000","last_active":"2024-06-02T04:49:36.216962+0000","last_peered":"2024-06-02T04:49:36.216962+0000","last_clean":"2024-06-02T04:49:36.216962+0000","last_became_active":"2024-06-02T04:48:02.693723+0000","last_became_peered":"2024-06-02T04:48:02.693723+0000","last_unstale":"2024-06-02T04:49:36.216962+0000","last_undegraded":"2024-06-02T04:49:36.216962+0000","last_fullsized":"2024-06-02T04:49:36.216962+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:33:26.628450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"82'16","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.217661+0000","last_change":"2024-06-02T04:48:02.702201+0000","last_active":"2024-06-02T04:49:36.217661+0000","last_peered":"2024-06-02T04:49:36.217661+0000","last_clean":"2024-06-02T04:49:36.217661+0000","last_became_active":"2024-06-02T04:48:02.701834+0000","last_became_peered":"2024-06-02T04:48:02.701834+0000","last_unstale":"2024-06-02T04:49:36.217661+0000","last_undegraded":"2024-06-02T04:49:36.217661+0000","last_fullsized":"2024-06-02T04:49:36.217661+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T08:22:24.009015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.205694+0000","last_change":"2024-06-02T04:48:02.700280+0000","last_active":"2024-06-02T04:49:36.205694+0000","last_peered":"2024-06-02T04:49:36.205694+0000","last_clean":"2024-06-02T04:49:36.205694+0000","last_became_active":"2024-06-02T04:48:02.699852+0000","last_became_peered":"2024-06-02T04:48:02.699852+0000","last_unstale":"2024-06-02T04:49:36.205694+0000","last_undegraded":"2024-06-02T04:49:36.205694+0000","last_fullsized":"2024-06-02T04:49:36.205694+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T16:45:28.228692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.216777+0000","last_change":"2024-06-02T04:48:02.689951+0000","last_active":"2024-06-02T04:49:36.216777+0000","last_peered":"2024-06-02T04:49:36.216777+0000","last_clean":"2024-06-02T04:49:36.216777+0000","last_became_active":"2024-06-02T04:48:02.689249+0000","last_became_peered":"2024-06-02T04:48:02.689249+0000","last_unstale":"2024-06-02T04:49:36.216777+0000","last_undegraded":"2024-06-02T04:49:36.216777+0000","last_fullsized":"2024-06-02T04:49:36.216777+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:09:43.620165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"82'10","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.212047+0000","last_change":"2024-06-02T04:48:02.691126+0000","last_active":"2024-06-02T04:49:36.212047+0000","last_peered":"2024-06-02T04:49:36.212047+0000","last_clean":"2024-06-02T04:49:36.212047+0000","last_became_active":"2024-06-02T04:48:02.690825+0000","last_became_peered":"2024-06-02T04:48:02.690825+0000","last_unstale":"2024-06-02T04:49:36.212047+0000","last_undegraded":"2024-06-02T04:49:36.212047+0000","last_fullsized":"2024-06-02T04:49:36.212047+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:03:36.461555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.206718+0000","last_change":"2024-06-02T04:48:02.692802+0000","last_active":"2024-06-02T04:49:36.206718+0000","last_peered":"2024-06-02T04:49:36.206718+0000","last_clean":"2024-06-02T04:49:36.206718+0000","last_became_active":"2024-06-02T04:48:02.692495+0000","last_became_peered":"2024-06-02T04:48:02.692495+0000","last_unstale":"2024-06-02T04:49:36.206718+0000","last_undegraded":"2024-06-02T04:49:36.206718+0000","last_fullsized":"2024-06-02T04:49:36.206718+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T14:57:10.991752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.207575+0000","last_change":"2024-06-02T04:48:02.702968+0000","last_active":"2024-06-02T04:49:36.207575+0000","last_peered":"2024-06-02T04:49:36.207575+0000","last_clean":"2024-06-02T04:49:36.207575+0000","last_became_active":"2024-06-02T04:48:02.702672+0000","last_became_peered":"2024-06-02T04:48:02.702672+0000","last_unstale":"2024-06-02T04:49:36.207575+0000","last_undegraded":"2024-06-02T04:49:36.207575+0000","last_fullsized":"2024-06-02T04:49:36.207575+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:04:38.385228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.213438+0000","last_change":"2024-06-02T04:48:02.701329+0000","last_active":"2024-06-02T04:49:36.213438+0000","last_peered":"2024-06-02T04:49:36.213438+0000","last_clean":"2024-06-02T04:49:36.213438+0000","last_became_active":"2024-06-02T04:48:02.701064+0000","last_became_peered":"2024-06-02T04:48:02.701064+0000","last_unstale":"2024-06-02T04:49:36.213438+0000","last_undegraded":"2024-06-02T04:49:36.213438+0000","last_fullsized":"2024-06-02T04:49:36.213438+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:28:06.265050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.218866+0000","last_change":"2024-06-02T04:48:02.688538+0000","last_active":"2024-06-02T04:49:36.218866+0000","last_peered":"2024-06-02T04:49:36.218866+0000","last_clean":"2024-06-02T04:49:36.218866+0000","last_became_active":"2024-06-02T04:48:02.688175+0000","last_became_peered":"2024-06-02T04:48:02.688175+0000","last_unstale":"2024-06-02T04:49:36.218866+0000","last_undegraded":"2024-06-02T04:49:36.218866+0000","last_fullsized":"2024-06-02T04:49:36.218866+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T07:30:47.310924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"82'10","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.201771+0000","last_change":"2024-06-02T04:48:02.688515+0000","last_active":"2024-06-02T04:49:36.201771+0000","last_peered":"2024-06-02T04:49:36.201771+0000","last_clean":"2024-06-02T04:49:36.201771+0000","last_became_active":"2024-06-02T04:48:02.688205+0000","last_became_peered":"2024-06-02T04:48:02.688205+0000","last_unstale":"2024-06-02T04:49:36.201771+0000","last_undegraded":"2024-06-02T04:49:36.201771+0000","last_fullsized":"2024-06-02T04:49:36.201771+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:20:05.829628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.200775+0000","last_change":"2024-06-02T04:48:02.688376+0000","last_active":"2024-06-02T04:49:36.200775+0000","last_peered":"2024-06-02T04:49:36.200775+0000","last_clean":"2024-06-02T04:49:36.200775+0000","last_became_active":"2024-06-02T04:48:02.688055+0000","last_became_peered":"2024-06-02T04:48:02.688055+0000","last_unstale":"2024-06-02T04:49:36.200775+0000","last_undegraded":"2024-06-02T04:49:36.200775+0000","last_fullsized":"2024-06-02T04:49:36.200775+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:55:41.327635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.866856+0000","last_change":"2024-06-02T04:48:06.713517+0000","last_active":"2024-06-02T04:49:06.866856+0000","last_peered":"2024-06-02T04:49:06.866856+0000","last_clean":"2024-06-02T04:49:06.866856+0000","last_became_active":"2024-06-02T04:48:06.713187+0000","last_became_peered":"2024-06-02T04:48:06.713187+0000","last_unstale":"2024-06-02T04:49:06.866856+0000","last_undegraded":"2024-06-02T04:49:06.866856+0000","last_fullsized":"2024-06-02T04:49:06.866856+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:11:46.598023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"80'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.871616+0000","last_change":"2024-06-02T04:48:02.271595+0000","last_active":"2024-06-02T04:49:06.871616+0000","last_peered":"2024-06-02T04:49:06.871616+0000","last_clean":"2024-06-02T04:49:06.871616+0000","last_became_active":"2024-06-02T04:48:02.271326+0000","last_became_peered":"2024-06-02T04:48:02.271326+0000","last_unstale":"2024-06-02T04:49:06.871616+0000","last_undegraded":"2024-06-02T04:49:06.871616+0000","last_fullsized":"2024-06-02T04:49:06.871616+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:23:31.096224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.202931+0000","last_change":"2024-06-02T04:48:02.696542+0000","last_active":"2024-06-02T04:49:36.202931+0000","last_peered":"2024-06-02T04:49:36.202931+0000","last_clean":"2024-06-02T04:49:36.202931+0000","last_became_active":"2024-06-02T04:48:02.696260+0000","last_became_peered":"2024-06-02T04:48:02.696260+0000","last_unstale":"2024-06-02T04:49:36.202931+0000","last_undegraded":"2024-06-02T04:49:36.202931+0000","last_fullsized":"2024-06-02T04:49:36.202931+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T06:28:04.097035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.867997+0000","last_change":"2024-06-02T04:48:06.713685+0000","last_active":"2024-06-02T04:49:06.867997+0000","last_peered":"2024-06-02T04:49:06.867997+0000","last_clean":"2024-06-02T04:49:06.867997+0000","last_became_active":"2024-06-02T04:48:06.713254+0000","last_became_peered":"2024-06-02T04:48:06.713254+0000","last_unstale":"2024-06-02T04:49:06.867997+0000","last_undegraded":"2024-06-02T04:49:06.867997+0000","last_fullsized":"2024-06-02T04:49:06.867997+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:12:48.304229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.873436+0000","last_change":"2024-06-02T04:48:02.268361+0000","last_active":"2024-06-02T04:49:06.873436+0000","last_peered":"2024-06-02T04:49:06.873436+0000","last_clean":"2024-06-02T04:49:06.873436+0000","last_became_active":"2024-06-02T04:48:02.268053+0000","last_became_peered":"2024-06-02T04:48:02.268053+0000","last_unstale":"2024-06-02T04:49:06.873436+0000","last_undegraded":"2024-06-02T04:49:06.873436+0000","last_fullsized":"2024-06-02T04:49:06.873436+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T16:04:13.955351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.212183+0000","last_change":"2024-06-02T04:48:02.686322+0000","last_active":"2024-06-02T04:49:36.212183+0000","last_peered":"2024-06-02T04:49:36.212183+0000","last_clean":"2024-06-02T04:49:36.212183+0000","last_became_active":"2024-06-02T04:48:02.685978+0000","last_became_peered":"2024-06-02T04:48:02.685978+0000","last_unstale":"2024-06-02T04:49:36.212183+0000","last_undegraded":"2024-06-02T04:49:36.212183+0000","last_fullsized":"2024-06-02T04:49:36.212183+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T12:12:19.157330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:07.893261+0000","last_change":"2024-06-02T04:49:07.893261+0000","last_active":"2024-06-02T04:49:07.893261+0000","last_peered":"2024-06-02T04:49:07.893261+0000","last_clean":"2024-06-02T04:49:07.893261+0000","last_became_active":"2024-06-02T04:49:07.892835+0000","last_became_peered":"2024-06-02T04:49:07.892835+0000","last_unstale":"2024-06-02T04:49:07.893261+0000","last_undegraded":"2024-06-02T04:49:07.893261+0000","last_fullsized":"2024-06-02T04:49:07.893261+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T06:52:12.541009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,8,5],"acting":[4,3,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"80'4","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:07.883791+0000","last_change":"2024-06-02T04:49:07.883791+0000","last_active":"2024-06-02T04:49:07.883791+0000","last_peered":"2024-06-02T04:49:07.883791+0000","last_clean":"2024-06-02T04:49:07.883791+0000","last_became_active":"2024-06-02T04:49:07.877259+0000","last_became_peered":"2024-06-02T04:49:07.877259+0000","last_unstale":"2024-06-02T04:49:07.883791+0000","last_undegraded":"2024-06-02T04:49:07.883791+0000","last_fullsized":"2024-06-02T04:49:07.883791+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T12:06:25.663857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.216264+0000","last_change":"2024-06-02T04:48:02.699659+0000","last_active":"2024-06-02T04:49:36.216264+0000","last_peered":"2024-06-02T04:49:36.216264+0000","last_clean":"2024-06-02T04:49:36.216264+0000","last_became_active":"2024-06-02T04:48:02.699321+0000","last_became_peered":"2024-06-02T04:48:02.699321+0000","last_unstale":"2024-06-02T04:49:36.216264+0000","last_undegraded":"2024-06-02T04:49:36.216264+0000","last_fullsized":"2024-06-02T04:49:36.216264+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:33:35.088215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.868049+0000","last_change":"2024-06-02T04:48:06.712031+0000","last_active":"2024-06-02T04:49:06.868049+0000","last_peered":"2024-06-02T04:49:06.868049+0000","last_clean":"2024-06-02T04:49:06.868049+0000","last_became_active":"2024-06-02T04:48:06.711637+0000","last_became_peered":"2024-06-02T04:48:06.711637+0000","last_unstale":"2024-06-02T04:49:06.868049+0000","last_undegraded":"2024-06-02T04:49:06.868049+0000","last_fullsized":"2024-06-02T04:49:06.868049+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T06:10:05.281793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"75'2","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.870616+0000","last_change":"2024-06-02T04:48:02.268698+0000","last_active":"2024-06-02T04:49:06.870616+0000","last_peered":"2024-06-02T04:49:06.870616+0000","last_clean":"2024-06-02T04:49:06.870616+0000","last_became_active":"2024-06-02T04:48:02.268286+0000","last_became_peered":"2024-06-02T04:48:02.268286+0000","last_unstale":"2024-06-02T04:49:06.870616+0000","last_undegraded":"2024-06-02T04:49:06.870616+0000","last_fullsized":"2024-06-02T04:49:06.870616+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T10:37:42.354104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"82'15","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.214177+0000","last_change":"2024-06-02T04:48:02.702280+0000","last_active":"2024-06-02T04:49:36.214177+0000","last_peered":"2024-06-02T04:49:36.214177+0000","last_clean":"2024-06-02T04:49:36.214177+0000","last_became_active":"2024-06-02T04:48:02.701830+0000","last_became_peered":"2024-06-02T04:48:02.701830+0000","last_unstale":"2024-06-02T04:49:36.214177+0000","last_undegraded":"2024-06-02T04:49:36.214177+0000","last_fullsized":"2024-06-02T04:49:36.214177+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T06:44:06.324024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.866642+0000","last_change":"2024-06-02T04:48:06.708484+0000","last_active":"2024-06-02T04:49:06.866642+0000","last_peered":"2024-06-02T04:49:06.866642+0000","last_clean":"2024-06-02T04:49:06.866642+0000","last_became_active":"2024-06-02T04:48:06.708048+0000","last_became_peered":"2024-06-02T04:48:06.708048+0000","last_unstale":"2024-06-02T04:49:06.866642+0000","last_undegraded":"2024-06-02T04:49:06.866642+0000","last_fullsized":"2024-06-02T04:49:06.866642+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:30:42.361362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"82'8","reported_seq":104,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:40.383586+0000","last_change":"2024-06-02T04:48:02.274961+0000","last_active":"2024-06-02T04:49:40.383586+0000","last_peered":"2024-06-02T04:49:40.383586+0000","last_clean":"2024-06-02T04:49:40.383586+0000","last_became_active":"2024-06-02T04:48:02.274617+0000","last_became_peered":"2024-06-02T04:48:02.274617+0000","last_unstale":"2024-06-02T04:49:40.383586+0000","last_undegraded":"2024-06-02T04:49:40.383586+0000","last_fullsized":"2024-06-02T04:49:40.383586+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T16:47:17.136996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":78,"num_read_kb":4,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.206987+0000","last_change":"2024-06-02T04:48:02.684722+0000","last_active":"2024-06-02T04:49:36.206987+0000","last_peered":"2024-06-02T04:49:36.206987+0000","last_clean":"2024-06-02T04:49:36.206987+0000","last_became_active":"2024-06-02T04:48:02.684354+0000","last_became_peered":"2024-06-02T04:48:02.684354+0000","last_unstale":"2024-06-02T04:49:36.206987+0000","last_undegraded":"2024-06-02T04:49:36.206987+0000","last_fullsized":"2024-06-02T04:49:36.206987+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T07:46:54.136882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.866495+0000","last_change":"2024-06-02T04:48:06.713498+0000","last_active":"2024-06-02T04:49:06.866495+0000","last_peered":"2024-06-02T04:49:06.866495+0000","last_clean":"2024-06-02T04:49:06.866495+0000","last_became_active":"2024-06-02T04:48:06.712949+0000","last_became_peered":"2024-06-02T04:48:06.712949+0000","last_unstale":"2024-06-02T04:49:06.866495+0000","last_undegraded":"2024-06-02T04:49:06.866495+0000","last_fullsized":"2024-06-02T04:49:06.866495+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:37:31.586703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"80'3","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.869522+0000","last_change":"2024-06-02T04:48:02.266358+0000","last_active":"2024-06-02T04:49:06.869522+0000","last_peered":"2024-06-02T04:49:06.869522+0000","last_clean":"2024-06-02T04:49:06.869522+0000","last_became_active":"2024-06-02T04:48:02.266008+0000","last_became_peered":"2024-06-02T04:48:02.266008+0000","last_unstale":"2024-06-02T04:49:06.869522+0000","last_undegraded":"2024-06-02T04:49:06.869522+0000","last_fullsized":"2024-06-02T04:49:06.869522+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:07:13.104170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.211013+0000","last_change":"2024-06-02T04:48:02.702234+0000","last_active":"2024-06-02T04:49:36.211013+0000","last_peered":"2024-06-02T04:49:36.211013+0000","last_clean":"2024-06-02T04:49:36.211013+0000","last_became_active":"2024-06-02T04:48:02.701927+0000","last_became_peered":"2024-06-02T04:48:02.701927+0000","last_unstale":"2024-06-02T04:49:36.211013+0000","last_undegraded":"2024-06-02T04:49:36.211013+0000","last_fullsized":"2024-06-02T04:49:36.211013+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:55:55.940957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.868152+0000","last_change":"2024-06-02T04:48:06.713257+0000","last_active":"2024-06-02T04:49:06.868152+0000","last_peered":"2024-06-02T04:49:06.868152+0000","last_clean":"2024-06-02T04:49:06.868152+0000","last_became_active":"2024-06-02T04:48:06.712862+0000","last_became_peered":"2024-06-02T04:48:06.712862+0000","last_unstale":"2024-06-02T04:49:06.868152+0000","last_undegraded":"2024-06-02T04:49:06.868152+0000","last_fullsized":"2024-06-02T04:49:06.868152+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T06:23:35.115824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"80'2","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.864687+0000","last_change":"2024-06-02T04:48:02.258838+0000","last_active":"2024-06-02T04:49:06.864687+0000","last_peered":"2024-06-02T04:49:06.864687+0000","last_clean":"2024-06-02T04:49:06.864687+0000","last_became_active":"2024-06-02T04:48:02.258516+0000","last_became_peered":"2024-06-02T04:48:02.258516+0000","last_unstale":"2024-06-02T04:49:06.864687+0000","last_undegraded":"2024-06-02T04:49:06.864687+0000","last_fullsized":"2024-06-02T04:49:06.864687+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:32:04.161724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.207684+0000","last_change":"2024-06-02T04:48:02.690043+0000","last_active":"2024-06-02T04:49:36.207684+0000","last_peered":"2024-06-02T04:49:36.207684+0000","last_clean":"2024-06-02T04:49:36.207684+0000","last_became_active":"2024-06-02T04:48:02.689748+0000","last_became_peered":"2024-06-02T04:48:02.689748+0000","last_unstale":"2024-06-02T04:49:36.207684+0000","last_undegraded":"2024-06-02T04:49:36.207684+0000","last_fullsized":"2024-06-02T04:49:36.207684+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:50:23.694653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.870025+0000","last_change":"2024-06-02T04:48:06.704093+0000","last_active":"2024-06-02T04:49:06.870025+0000","last_peered":"2024-06-02T04:49:06.870025+0000","last_clean":"2024-06-02T04:49:06.870025+0000","last_became_active":"2024-06-02T04:48:06.703732+0000","last_became_peered":"2024-06-02T04:48:06.703732+0000","last_unstale":"2024-06-02T04:49:06.870025+0000","last_undegraded":"2024-06-02T04:49:06.870025+0000","last_fullsized":"2024-06-02T04:49:06.870025+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:50:10.434364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"80'1","reported_seq":19,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.872182+0000","last_change":"2024-06-02T04:48:02.274753+0000","last_active":"2024-06-02T04:49:06.872182+0000","last_peered":"2024-06-02T04:49:06.872182+0000","last_clean":"2024-06-02T04:49:06.872182+0000","last_became_active":"2024-06-02T04:48:02.274390+0000","last_became_peered":"2024-06-02T04:48:02.274390+0000","last_unstale":"2024-06-02T04:49:06.872182+0000","last_undegraded":"2024-06-02T04:49:06.872182+0000","last_fullsized":"2024-06-02T04:49:06.872182+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:42:38.790750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"82'11","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.198701+0000","last_change":"2024-06-02T04:48:02.684832+0000","last_active":"2024-06-02T04:49:36.198701+0000","last_peered":"2024-06-02T04:49:36.198701+0000","last_clean":"2024-06-02T04:49:36.198701+0000","last_became_active":"2024-06-02T04:48:02.684520+0000","last_became_peered":"2024-06-02T04:48:02.684520+0000","last_unstale":"2024-06-02T04:49:36.198701+0000","last_undegraded":"2024-06-02T04:49:36.198701+0000","last_fullsized":"2024-06-02T04:49:36.198701+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:08:33.038975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.873171+0000","last_change":"2024-06-02T04:48:06.704725+0000","last_active":"2024-06-02T04:49:06.873171+0000","last_peered":"2024-06-02T04:49:06.873171+0000","last_clean":"2024-06-02T04:49:06.873171+0000","last_became_active":"2024-06-02T04:48:06.704284+0000","last_became_peered":"2024-06-02T04:48:06.704284+0000","last_unstale":"2024-06-02T04:49:06.873171+0000","last_undegraded":"2024-06-02T04:49:06.873171+0000","last_fullsized":"2024-06-02T04:49:06.873171+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:56:04.558505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"82'4","reported_seq":93,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:37.378534+0000","last_change":"2024-06-02T04:48:02.267048+0000","last_active":"2024-06-02T04:49:37.378534+0000","last_peered":"2024-06-02T04:49:37.378534+0000","last_clean":"2024-06-02T04:49:37.378534+0000","last_became_active":"2024-06-02T04:48:02.266707+0000","last_became_peered":"2024-06-02T04:48:02.266707+0000","last_unstale":"2024-06-02T04:49:37.378534+0000","last_undegraded":"2024-06-02T04:49:37.378534+0000","last_fullsized":"2024-06-02T04:49:37.378534+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:36:25.633728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":71,"num_read_kb":71,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"82'10","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.214446+0000","last_change":"2024-06-02T04:48:02.700485+0000","last_active":"2024-06-02T04:49:36.214446+0000","last_peered":"2024-06-02T04:49:36.214446+0000","last_clean":"2024-06-02T04:49:36.214446+0000","last_became_active":"2024-06-02T04:48:02.700228+0000","last_became_peered":"2024-06-02T04:48:02.700228+0000","last_unstale":"2024-06-02T04:49:36.214446+0000","last_undegraded":"2024-06-02T04:49:36.214446+0000","last_fullsized":"2024-06-02T04:49:36.214446+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T06:39:18.244476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.869511+0000","last_change":"2024-06-02T04:48:06.716821+0000","last_active":"2024-06-02T04:49:06.869511+0000","last_peered":"2024-06-02T04:49:06.869511+0000","last_clean":"2024-06-02T04:49:06.869511+0000","last_became_active":"2024-06-02T04:48:06.716432+0000","last_became_peered":"2024-06-02T04:48:06.716432+0000","last_unstale":"2024-06-02T04:49:06.869511+0000","last_undegraded":"2024-06-02T04:49:06.869511+0000","last_fullsized":"2024-06-02T04:49:06.869511+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T12:06:50.164797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"80'2","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.872989+0000","last_change":"2024-06-02T04:48:02.272377+0000","last_active":"2024-06-02T04:49:06.872989+0000","last_peered":"2024-06-02T04:49:06.872989+0000","last_clean":"2024-06-02T04:49:06.872989+0000","last_became_active":"2024-06-02T04:48:02.272017+0000","last_became_peered":"2024-06-02T04:48:02.272017+0000","last_unstale":"2024-06-02T04:49:06.872989+0000","last_undegraded":"2024-06-02T04:49:06.872989+0000","last_fullsized":"2024-06-02T04:49:06.872989+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T10:24:14.945609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.208529+0000","last_change":"2024-06-02T04:48:02.687056+0000","last_active":"2024-06-02T04:49:36.208529+0000","last_peered":"2024-06-02T04:49:36.208529+0000","last_clean":"2024-06-02T04:49:36.208529+0000","last_became_active":"2024-06-02T04:48:02.686729+0000","last_became_peered":"2024-06-02T04:48:02.686729+0000","last_unstale":"2024-06-02T04:49:36.208529+0000","last_undegraded":"2024-06-02T04:49:36.208529+0000","last_fullsized":"2024-06-02T04:49:36.208529+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:54:44.636489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.868621+0000","last_change":"2024-06-02T04:48:06.713816+0000","last_active":"2024-06-02T04:49:06.868621+0000","last_peered":"2024-06-02T04:49:06.868621+0000","last_clean":"2024-06-02T04:49:06.868621+0000","last_became_active":"2024-06-02T04:48:06.713372+0000","last_became_peered":"2024-06-02T04:48:06.713372+0000","last_unstale":"2024-06-02T04:49:06.868621+0000","last_undegraded":"2024-06-02T04:49:06.868621+0000","last_fullsized":"2024-06-02T04:49:06.868621+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T10:12:46.455263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"80'4","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.872949+0000","last_change":"2024-06-02T04:48:02.274971+0000","last_active":"2024-06-02T04:49:06.872949+0000","last_peered":"2024-06-02T04:49:06.872949+0000","last_clean":"2024-06-02T04:49:06.872949+0000","last_became_active":"2024-06-02T04:48:02.274137+0000","last_became_peered":"2024-06-02T04:48:02.274137+0000","last_unstale":"2024-06-02T04:49:06.872949+0000","last_undegraded":"2024-06-02T04:49:06.872949+0000","last_fullsized":"2024-06-02T04:49:06.872949+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:41:45.634923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"82'11","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.216665+0000","last_change":"2024-06-02T04:49:07.874181+0000","last_active":"2024-06-02T04:49:36.216665+0000","last_peered":"2024-06-02T04:49:36.216665+0000","last_clean":"2024-06-02T04:49:36.216665+0000","last_became_active":"2024-06-02T04:49:07.873791+0000","last_became_peered":"2024-06-02T04:49:07.873791+0000","last_unstale":"2024-06-02T04:49:36.216665+0000","last_undegraded":"2024-06-02T04:49:36.216665+0000","last_fullsized":"2024-06-02T04:49:36.216665+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T16:04:26.712712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.870118+0000","last_change":"2024-06-02T04:48:06.713061+0000","last_active":"2024-06-02T04:49:06.870118+0000","last_peered":"2024-06-02T04:49:06.870118+0000","last_clean":"2024-06-02T04:49:06.870118+0000","last_became_active":"2024-06-02T04:48:06.712687+0000","last_became_peered":"2024-06-02T04:48:06.712687+0000","last_unstale":"2024-06-02T04:49:06.870118+0000","last_undegraded":"2024-06-02T04:49:06.870118+0000","last_fullsized":"2024-06-02T04:49:06.870118+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T08:46:02.417626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"82'36","reported_seq":205,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:38.380102+0000","last_change":"2024-06-02T04:48:02.270101+0000","last_active":"2024-06-02T04:49:38.380102+0000","last_peered":"2024-06-02T04:49:38.380102+0000","last_clean":"2024-06-02T04:49:38.380102+0000","last_became_active":"2024-06-02T04:48:02.269637+0000","last_became_peered":"2024-06-02T04:48:02.269637+0000","last_unstale":"2024-06-02T04:49:38.380102+0000","last_undegraded":"2024-06-02T04:49:38.380102+0000","last_fullsized":"2024-06-02T04:49:38.380102+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:37:07.572299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64494,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":151,"num_read_kb":139,"num_write":37,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.212023+0000","last_change":"2024-06-02T04:48:02.698435+0000","last_active":"2024-06-02T04:49:36.212023+0000","last_peered":"2024-06-02T04:49:36.212023+0000","last_clean":"2024-06-02T04:49:36.212023+0000","last_became_active":"2024-06-02T04:48:02.698071+0000","last_became_peered":"2024-06-02T04:48:02.698071+0000","last_unstale":"2024-06-02T04:49:36.212023+0000","last_undegraded":"2024-06-02T04:49:36.212023+0000","last_fullsized":"2024-06-02T04:49:36.212023+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:45:38.673256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.873537+0000","last_change":"2024-06-02T04:48:06.705965+0000","last_active":"2024-06-02T04:49:06.873537+0000","last_peered":"2024-06-02T04:49:06.873537+0000","last_clean":"2024-06-02T04:49:06.873537+0000","last_became_active":"2024-06-02T04:48:06.705527+0000","last_became_peered":"2024-06-02T04:48:06.705527+0000","last_unstale":"2024-06-02T04:49:06.873537+0000","last_undegraded":"2024-06-02T04:49:06.873537+0000","last_fullsized":"2024-06-02T04:49:06.873537+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:41:54.100212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"80'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.866138+0000","last_change":"2024-06-02T04:48:02.273389+0000","last_active":"2024-06-02T04:49:06.866138+0000","last_peered":"2024-06-02T04:49:06.866138+0000","last_clean":"2024-06-02T04:49:06.866138+0000","last_became_active":"2024-06-02T04:48:02.271701+0000","last_became_peered":"2024-06-02T04:48:02.271701+0000","last_unstale":"2024-06-02T04:49:06.866138+0000","last_undegraded":"2024-06-02T04:49:06.866138+0000","last_fullsized":"2024-06-02T04:49:06.866138+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:46:48.304156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.201640+0000","last_change":"2024-06-02T04:48:02.689417+0000","last_active":"2024-06-02T04:49:36.201640+0000","last_peered":"2024-06-02T04:49:36.201640+0000","last_clean":"2024-06-02T04:49:36.201640+0000","last_became_active":"2024-06-02T04:48:02.689108+0000","last_became_peered":"2024-06-02T04:48:02.689108+0000","last_unstale":"2024-06-02T04:49:36.201640+0000","last_undegraded":"2024-06-02T04:49:36.201640+0000","last_fullsized":"2024-06-02T04:49:36.201640+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:23:14.231198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:07.875780+0000","last_change":"2024-06-02T04:49:07.875780+0000","last_active":"2024-06-02T04:49:07.875780+0000","last_peered":"2024-06-02T04:49:07.875780+0000","last_clean":"2024-06-02T04:49:07.875780+0000","last_became_active":"2024-06-02T04:49:07.875310+0000","last_became_peered":"2024-06-02T04:49:07.875310+0000","last_unstale":"2024-06-02T04:49:07.875780+0000","last_undegraded":"2024-06-02T04:49:07.875780+0000","last_fullsized":"2024-06-02T04:49:07.875780+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:46:26.921686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,7,6],"acting":[11,8,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"80'3","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.873166+0000","last_change":"2024-06-02T04:48:02.274386+0000","last_active":"2024-06-02T04:49:06.873166+0000","last_peered":"2024-06-02T04:49:06.873166+0000","last_clean":"2024-06-02T04:49:06.873166+0000","last_became_active":"2024-06-02T04:48:02.274001+0000","last_became_peered":"2024-06-02T04:48:02.274001+0000","last_unstale":"2024-06-02T04:49:06.873166+0000","last_undegraded":"2024-06-02T04:49:06.873166+0000","last_fullsized":"2024-06-02T04:49:06.873166+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T14:02:10.256428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"82'15","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.218594+0000","last_change":"2024-06-02T04:48:02.706735+0000","last_active":"2024-06-02T04:49:36.218594+0000","last_peered":"2024-06-02T04:49:36.218594+0000","last_clean":"2024-06-02T04:49:36.218594+0000","last_became_active":"2024-06-02T04:48:02.706475+0000","last_became_peered":"2024-06-02T04:48:02.706475+0000","last_unstale":"2024-06-02T04:49:36.218594+0000","last_undegraded":"2024-06-02T04:49:36.218594+0000","last_fullsized":"2024-06-02T04:49:36.218594+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T10:59:57.946798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.871496+0000","last_change":"2024-06-02T04:48:06.713266+0000","last_active":"2024-06-02T04:49:06.871496+0000","last_peered":"2024-06-02T04:49:06.871496+0000","last_clean":"2024-06-02T04:49:06.871496+0000","last_became_active":"2024-06-02T04:48:06.712659+0000","last_became_peered":"2024-06-02T04:48:06.712659+0000","last_unstale":"2024-06-02T04:49:06.871496+0000","last_undegraded":"2024-06-02T04:49:06.871496+0000","last_fullsized":"2024-06-02T04:49:06.871496+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T16:30:21.140420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"82'6","reported_seq":100,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:38.380210+0000","last_change":"2024-06-02T04:48:02.265157+0000","last_active":"2024-06-02T04:49:38.380210+0000","last_peered":"2024-06-02T04:49:38.380210+0000","last_clean":"2024-06-02T04:49:38.380210+0000","last_became_active":"2024-06-02T04:48:02.264782+0000","last_became_peered":"2024-06-02T04:48:02.264782+0000","last_unstale":"2024-06-02T04:49:38.380210+0000","last_undegraded":"2024-06-02T04:49:38.380210+0000","last_fullsized":"2024-06-02T04:49:38.380210+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:55:35.177299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1554,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":77,"num_read_kb":5,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.209474+0000","last_change":"2024-06-02T04:48:02.698864+0000","last_active":"2024-06-02T04:49:36.209474+0000","last_peered":"2024-06-02T04:49:36.209474+0000","last_clean":"2024-06-02T04:49:36.209474+0000","last_became_active":"2024-06-02T04:48:02.698547+0000","last_became_peered":"2024-06-02T04:48:02.698547+0000","last_unstale":"2024-06-02T04:49:36.209474+0000","last_undegraded":"2024-06-02T04:49:36.209474+0000","last_fullsized":"2024-06-02T04:49:36.209474+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:03:39.835164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.865160+0000","last_change":"2024-06-02T04:48:06.713198+0000","last_active":"2024-06-02T04:49:06.865160+0000","last_peered":"2024-06-02T04:49:06.865160+0000","last_clean":"2024-06-02T04:49:06.865160+0000","last_became_active":"2024-06-02T04:48:06.712806+0000","last_became_peered":"2024-06-02T04:48:06.712806+0000","last_unstale":"2024-06-02T04:49:06.865160+0000","last_undegraded":"2024-06-02T04:49:06.865160+0000","last_fullsized":"2024-06-02T04:49:06.865160+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:48:09.492933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"80'15","reported_seq":34,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.869408+0000","last_change":"2024-06-02T04:48:02.277744+0000","last_active":"2024-06-02T04:49:06.869408+0000","last_peered":"2024-06-02T04:49:06.869408+0000","last_clean":"2024-06-02T04:49:06.869408+0000","last_became_active":"2024-06-02T04:48:02.277044+0000","last_became_peered":"2024-06-02T04:48:02.277044+0000","last_unstale":"2024-06-02T04:49:06.869408+0000","last_undegraded":"2024-06-02T04:49:06.869408+0000","last_fullsized":"2024-06-02T04:49:06.869408+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:47:38.606233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.211595+0000","last_change":"2024-06-02T04:48:02.702234+0000","last_active":"2024-06-02T04:49:36.211595+0000","last_peered":"2024-06-02T04:49:36.211595+0000","last_clean":"2024-06-02T04:49:36.211595+0000","last_became_active":"2024-06-02T04:48:02.701857+0000","last_became_peered":"2024-06-02T04:48:02.701857+0000","last_unstale":"2024-06-02T04:49:36.211595+0000","last_undegraded":"2024-06-02T04:49:36.211595+0000","last_fullsized":"2024-06-02T04:49:36.211595+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:01:52.901690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.872667+0000","last_change":"2024-06-02T04:48:06.704575+0000","last_active":"2024-06-02T04:49:06.872667+0000","last_peered":"2024-06-02T04:49:06.872667+0000","last_clean":"2024-06-02T04:49:06.872667+0000","last_became_active":"2024-06-02T04:48:06.704129+0000","last_became_peered":"2024-06-02T04:48:06.704129+0000","last_unstale":"2024-06-02T04:49:06.872667+0000","last_undegraded":"2024-06-02T04:49:06.872667+0000","last_fullsized":"2024-06-02T04:49:06.872667+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:43:53.481252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.869952+0000","last_change":"2024-06-02T04:48:02.268816+0000","last_active":"2024-06-02T04:49:06.869952+0000","last_peered":"2024-06-02T04:49:06.869952+0000","last_clean":"2024-06-02T04:49:06.869952+0000","last_became_active":"2024-06-02T04:48:02.268469+0000","last_became_peered":"2024-06-02T04:48:02.268469+0000","last_unstale":"2024-06-02T04:49:06.869952+0000","last_undegraded":"2024-06-02T04:49:06.869952+0000","last_fullsized":"2024-06-02T04:49:06.869952+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:42:32.434414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.218718+0000","last_change":"2024-06-02T04:48:02.704536+0000","last_active":"2024-06-02T04:49:36.218718+0000","last_peered":"2024-06-02T04:49:36.218718+0000","last_clean":"2024-06-02T04:49:36.218718+0000","last_became_active":"2024-06-02T04:48:02.704149+0000","last_became_peered":"2024-06-02T04:48:02.704149+0000","last_unstale":"2024-06-02T04:49:36.218718+0000","last_undegraded":"2024-06-02T04:49:36.218718+0000","last_fullsized":"2024-06-02T04:49:36.218718+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T07:59:40.379135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:07.877906+0000","last_change":"2024-06-02T04:49:07.877906+0000","last_active":"2024-06-02T04:49:07.877906+0000","last_peered":"2024-06-02T04:49:07.877906+0000","last_clean":"2024-06-02T04:49:07.877906+0000","last_became_active":"2024-06-02T04:49:07.877072+0000","last_became_peered":"2024-06-02T04:49:07.877072+0000","last_unstale":"2024-06-02T04:49:07.877906+0000","last_undegraded":"2024-06-02T04:49:07.877906+0000","last_fullsized":"2024-06-02T04:49:07.877906+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:49:59.825416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.871187+0000","last_change":"2024-06-02T04:48:02.270893+0000","last_active":"2024-06-02T04:49:06.871187+0000","last_peered":"2024-06-02T04:49:06.871187+0000","last_clean":"2024-06-02T04:49:06.871187+0000","last_became_active":"2024-06-02T04:48:02.270566+0000","last_became_peered":"2024-06-02T04:48:02.270566+0000","last_unstale":"2024-06-02T04:49:06.871187+0000","last_undegraded":"2024-06-02T04:49:06.871187+0000","last_fullsized":"2024-06-02T04:49:06.871187+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:57:36.202043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'4","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.204040+0000","last_change":"2024-06-02T04:48:02.693528+0000","last_active":"2024-06-02T04:49:36.204040+0000","last_peered":"2024-06-02T04:49:36.204040+0000","last_clean":"2024-06-02T04:49:36.204040+0000","last_became_active":"2024-06-02T04:48:02.693240+0000","last_became_peered":"2024-06-02T04:48:02.693240+0000","last_unstale":"2024-06-02T04:49:36.204040+0000","last_undegraded":"2024-06-02T04:49:36.204040+0000","last_fullsized":"2024-06-02T04:49:36.204040+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T14:48:59.338977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.864871+0000","last_change":"2024-06-02T04:48:06.710454+0000","last_active":"2024-06-02T04:49:06.864871+0000","last_peered":"2024-06-02T04:49:06.864871+0000","last_clean":"2024-06-02T04:49:06.864871+0000","last_became_active":"2024-06-02T04:48:06.710090+0000","last_became_peered":"2024-06-02T04:48:06.710090+0000","last_unstale":"2024-06-02T04:49:06.864871+0000","last_undegraded":"2024-06-02T04:49:06.864871+0000","last_fullsized":"2024-06-02T04:49:06.864871+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:27:52.401032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"80'1","reported_seq":19,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.872363+0000","last_change":"2024-06-02T04:48:02.271748+0000","last_active":"2024-06-02T04:49:06.872363+0000","last_peered":"2024-06-02T04:49:06.872363+0000","last_clean":"2024-06-02T04:49:06.872363+0000","last_became_active":"2024-06-02T04:48:02.270941+0000","last_became_peered":"2024-06-02T04:48:02.270941+0000","last_unstale":"2024-06-02T04:49:06.872363+0000","last_undegraded":"2024-06-02T04:49:06.872363+0000","last_fullsized":"2024-06-02T04:49:06.872363+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T14:22:37.698956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.216956+0000","last_change":"2024-06-02T04:48:02.690331+0000","last_active":"2024-06-02T04:49:36.216956+0000","last_peered":"2024-06-02T04:49:36.216956+0000","last_clean":"2024-06-02T04:49:36.216956+0000","last_became_active":"2024-06-02T04:48:02.681983+0000","last_became_peered":"2024-06-02T04:48:02.681983+0000","last_unstale":"2024-06-02T04:49:36.216956+0000","last_undegraded":"2024-06-02T04:49:36.216956+0000","last_fullsized":"2024-06-02T04:49:36.216956+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T14:09:12.117847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.865289+0000","last_change":"2024-06-02T04:48:06.962698+0000","last_active":"2024-06-02T04:49:06.865289+0000","last_peered":"2024-06-02T04:49:06.865289+0000","last_clean":"2024-06-02T04:49:06.865289+0000","last_became_active":"2024-06-02T04:48:06.962283+0000","last_became_peered":"2024-06-02T04:48:06.962283+0000","last_unstale":"2024-06-02T04:49:06.865289+0000","last_undegraded":"2024-06-02T04:49:06.865289+0000","last_fullsized":"2024-06-02T04:49:06.865289+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T14:33:49.504150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.210803+0000","last_change":"2024-06-02T04:48:02.702856+0000","last_active":"2024-06-02T04:49:36.210803+0000","last_peered":"2024-06-02T04:49:36.210803+0000","last_clean":"2024-06-02T04:49:36.210803+0000","last_became_active":"2024-06-02T04:48:02.702513+0000","last_became_peered":"2024-06-02T04:48:02.702513+0000","last_unstale":"2024-06-02T04:49:36.210803+0000","last_undegraded":"2024-06-02T04:49:36.210803+0000","last_fullsized":"2024-06-02T04:49:36.210803+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T07:10:35.957386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"82'5","reported_seq":94,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:37.378451+0000","last_change":"2024-06-02T04:48:02.265627+0000","last_active":"2024-06-02T04:49:37.378451+0000","last_peered":"2024-06-02T04:49:37.378451+0000","last_clean":"2024-06-02T04:49:37.378451+0000","last_became_active":"2024-06-02T04:48:02.265301+0000","last_became_peered":"2024-06-02T04:48:02.265301+0000","last_unstale":"2024-06-02T04:49:37.378451+0000","last_undegraded":"2024-06-02T04:49:37.378451+0000","last_fullsized":"2024-06-02T04:49:37.378451+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T10:46:10.211378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":71,"num_read_kb":71,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"80'1","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.873068+0000","last_change":"2024-06-02T04:48:06.709988+0000","last_active":"2024-06-02T04:49:06.873068+0000","last_peered":"2024-06-02T04:49:06.873068+0000","last_clean":"2024-06-02T04:49:06.873068+0000","last_became_active":"2024-06-02T04:48:06.709642+0000","last_became_peered":"2024-06-02T04:48:06.709642+0000","last_unstale":"2024-06-02T04:49:06.873068+0000","last_undegraded":"2024-06-02T04:49:06.873068+0000","last_fullsized":"2024-06-02T04:49:06.873068+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T10:09:46.250709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.212511+0000","last_change":"2024-06-02T04:48:02.696666+0000","last_active":"2024-06-02T04:49:36.212511+0000","last_peered":"2024-06-02T04:49:36.212511+0000","last_clean":"2024-06-02T04:49:36.212511+0000","last_became_active":"2024-06-02T04:48:02.696343+0000","last_became_peered":"2024-06-02T04:48:02.696343+0000","last_unstale":"2024-06-02T04:49:36.212511+0000","last_undegraded":"2024-06-02T04:49:36.212511+0000","last_fullsized":"2024-06-02T04:49:36.212511+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T12:31:13.426174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"80'3","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.868521+0000","last_change":"2024-06-02T04:48:02.268619+0000","last_active":"2024-06-02T04:49:06.868521+0000","last_peered":"2024-06-02T04:49:06.868521+0000","last_clean":"2024-06-02T04:49:06.868521+0000","last_became_active":"2024-06-02T04:48:02.268244+0000","last_became_peered":"2024-06-02T04:48:02.268244+0000","last_unstale":"2024-06-02T04:49:06.868521+0000","last_undegraded":"2024-06-02T04:49:06.868521+0000","last_fullsized":"2024-06-02T04:49:06.868521+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:15:13.469046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"19'137","reported_seq":328,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.872115+0000","last_change":"2024-06-02T04:47:15.713382+0000","last_active":"2024-06-02T04:49:06.872115+0000","last_peered":"2024-06-02T04:49:06.872115+0000","last_clean":"2024-06-02T04:49:06.872115+0000","last_became_active":"2024-06-02T04:47:15.712972+0000","last_became_peered":"2024-06-02T04:47:15.712972+0000","last_unstale":"2024-06-02T04:49:06.872115+0000","last_undegraded":"2024-06-02T04:49:06.872115+0000","last_fullsized":"2024-06-02T04:49:06.872115+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:44:56.604079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:44:56.604079+0000","last_clean_scrub_stamp":"2024-06-02T04:44:56.604079+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T12:54:02.306899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.872863+0000","last_change":"2024-06-02T04:48:06.964717+0000","last_active":"2024-06-02T04:49:06.872863+0000","last_peered":"2024-06-02T04:49:06.872863+0000","last_clean":"2024-06-02T04:49:06.872863+0000","last_became_active":"2024-06-02T04:48:06.964244+0000","last_became_peered":"2024-06-02T04:48:06.964244+0000","last_unstale":"2024-06-02T04:49:06.872863+0000","last_undegraded":"2024-06-02T04:49:06.872863+0000","last_fullsized":"2024-06-02T04:49:06.872863+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:26:58.901182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"82'5","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.200231+0000","last_change":"2024-06-02T04:49:07.892022+0000","last_active":"2024-06-02T04:49:36.200231+0000","last_peered":"2024-06-02T04:49:36.200231+0000","last_clean":"2024-06-02T04:49:36.200231+0000","last_became_active":"2024-06-02T04:49:07.891678+0000","last_became_peered":"2024-06-02T04:49:07.891678+0000","last_unstale":"2024-06-02T04:49:36.200231+0000","last_undegraded":"2024-06-02T04:49:36.200231+0000","last_fullsized":"2024-06-02T04:49:36.200231+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T07:01:06.354621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"80'3","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:07.880368+0000","last_change":"2024-06-02T04:49:07.880368+0000","last_active":"2024-06-02T04:49:07.880368+0000","last_peered":"2024-06-02T04:49:07.880368+0000","last_clean":"2024-06-02T04:49:07.880368+0000","last_became_active":"2024-06-02T04:49:07.876731+0000","last_became_peered":"2024-06-02T04:49:07.876731+0000","last_unstale":"2024-06-02T04:49:07.880368+0000","last_undegraded":"2024-06-02T04:49:07.880368+0000","last_fullsized":"2024-06-02T04:49:07.880368+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T12:48:38.495222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4],"acting":[7,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.867776+0000","last_change":"2024-06-02T04:48:06.703427+0000","last_active":"2024-06-02T04:49:06.867776+0000","last_peered":"2024-06-02T04:49:06.867776+0000","last_clean":"2024-06-02T04:49:06.867776+0000","last_became_active":"2024-06-02T04:48:06.702442+0000","last_became_peered":"2024-06-02T04:48:06.702442+0000","last_unstale":"2024-06-02T04:49:06.867776+0000","last_undegraded":"2024-06-02T04:49:06.867776+0000","last_fullsized":"2024-06-02T04:49:06.867776+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T14:47:12.376520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"80'1","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.870604+0000","last_change":"2024-06-02T04:48:02.277241+0000","last_active":"2024-06-02T04:49:06.870604+0000","last_peered":"2024-06-02T04:49:06.870604+0000","last_clean":"2024-06-02T04:49:06.870604+0000","last_became_active":"2024-06-02T04:48:02.276903+0000","last_became_peered":"2024-06-02T04:48:02.276903+0000","last_unstale":"2024-06-02T04:49:06.870604+0000","last_undegraded":"2024-06-02T04:49:06.870604+0000","last_fullsized":"2024-06-02T04:49:06.870604+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:16:40.664225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.200095+0000","last_change":"2024-06-02T04:48:02.682260+0000","last_active":"2024-06-02T04:49:36.200095+0000","last_peered":"2024-06-02T04:49:36.200095+0000","last_clean":"2024-06-02T04:49:36.200095+0000","last_became_active":"2024-06-02T04:48:02.681962+0000","last_became_peered":"2024-06-02T04:48:02.681962+0000","last_unstale":"2024-06-02T04:49:36.200095+0000","last_undegraded":"2024-06-02T04:49:36.200095+0000","last_fullsized":"2024-06-02T04:49:36.200095+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:42:26.588628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.872911+0000","last_change":"2024-06-02T04:48:06.963380+0000","last_active":"2024-06-02T04:49:06.872911+0000","last_peered":"2024-06-02T04:49:06.872911+0000","last_clean":"2024-06-02T04:49:06.872911+0000","last_became_active":"2024-06-02T04:48:06.962717+0000","last_became_peered":"2024-06-02T04:48:06.962717+0000","last_unstale":"2024-06-02T04:49:06.872911+0000","last_undegraded":"2024-06-02T04:49:06.872911+0000","last_fullsized":"2024-06-02T04:49:06.872911+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T07:05:46.983987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"82'6","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:07.890518+0000","last_change":"2024-06-02T04:48:02.270183+0000","last_active":"2024-06-02T04:49:07.890518+0000","last_peered":"2024-06-02T04:49:07.890518+0000","last_clean":"2024-06-02T04:49:07.890518+0000","last_became_active":"2024-06-02T04:48:02.269880+0000","last_became_peered":"2024-06-02T04:48:02.269880+0000","last_unstale":"2024-06-02T04:49:07.890518+0000","last_undegraded":"2024-06-02T04:49:07.890518+0000","last_fullsized":"2024-06-02T04:49:07.890518+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T16:12:41.959174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.201281+0000","last_change":"2024-06-02T04:48:02.696692+0000","last_active":"2024-06-02T04:49:36.201281+0000","last_peered":"2024-06-02T04:49:36.201281+0000","last_clean":"2024-06-02T04:49:36.201281+0000","last_became_active":"2024-06-02T04:48:02.696398+0000","last_became_peered":"2024-06-02T04:48:02.696398+0000","last_unstale":"2024-06-02T04:49:36.201281+0000","last_undegraded":"2024-06-02T04:49:36.201281+0000","last_fullsized":"2024-06-02T04:49:36.201281+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T14:12:15.108989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.865826+0000","last_change":"2024-06-02T04:48:06.706766+0000","last_active":"2024-06-02T04:49:06.865826+0000","last_peered":"2024-06-02T04:49:06.865826+0000","last_clean":"2024-06-02T04:49:06.865826+0000","last_became_active":"2024-06-02T04:48:06.706440+0000","last_became_peered":"2024-06-02T04:48:06.706440+0000","last_unstale":"2024-06-02T04:49:06.865826+0000","last_undegraded":"2024-06-02T04:49:06.865826+0000","last_fullsized":"2024-06-02T04:49:06.865826+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:24:20.283467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"80'4","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.869382+0000","last_change":"2024-06-02T04:48:02.265259+0000","last_active":"2024-06-02T04:49:06.869382+0000","last_peered":"2024-06-02T04:49:06.869382+0000","last_clean":"2024-06-02T04:49:06.869382+0000","last_became_active":"2024-06-02T04:48:02.264931+0000","last_became_peered":"2024-06-02T04:48:02.264931+0000","last_unstale":"2024-06-02T04:49:06.869382+0000","last_undegraded":"2024-06-02T04:49:06.869382+0000","last_fullsized":"2024-06-02T04:49:06.869382+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:06:18.360519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.207713+0000","last_change":"2024-06-02T04:48:02.684808+0000","last_active":"2024-06-02T04:49:36.207713+0000","last_peered":"2024-06-02T04:49:36.207713+0000","last_clean":"2024-06-02T04:49:36.207713+0000","last_became_active":"2024-06-02T04:48:02.684492+0000","last_became_peered":"2024-06-02T04:48:02.684492+0000","last_unstale":"2024-06-02T04:49:36.207713+0000","last_undegraded":"2024-06-02T04:49:36.207713+0000","last_fullsized":"2024-06-02T04:49:36.207713+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T12:10:01.537377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.868148+0000","last_change":"2024-06-02T04:48:06.965041+0000","last_active":"2024-06-02T04:49:06.868148+0000","last_peered":"2024-06-02T04:49:06.868148+0000","last_clean":"2024-06-02T04:49:06.868148+0000","last_became_active":"2024-06-02T04:48:06.964487+0000","last_became_peered":"2024-06-02T04:48:06.964487+0000","last_unstale":"2024-06-02T04:49:06.868148+0000","last_undegraded":"2024-06-02T04:49:06.868148+0000","last_fullsized":"2024-06-02T04:49:06.868148+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:51:05.082026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.874688+0000","last_change":"2024-06-02T04:48:02.271485+0000","last_active":"2024-06-02T04:49:06.874688+0000","last_peered":"2024-06-02T04:49:06.874688+0000","last_clean":"2024-06-02T04:49:06.874688+0000","last_became_active":"2024-06-02T04:48:02.271156+0000","last_became_peered":"2024-06-02T04:48:02.271156+0000","last_unstale":"2024-06-02T04:49:06.874688+0000","last_undegraded":"2024-06-02T04:49:06.874688+0000","last_fullsized":"2024-06-02T04:49:06.874688+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:57:34.467559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"82'2","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.177199+0000","last_change":"2024-06-02T04:48:02.673700+0000","last_active":"2024-06-02T04:49:36.177199+0000","last_peered":"2024-06-02T04:49:36.177199+0000","last_clean":"2024-06-02T04:49:36.177199+0000","last_became_active":"2024-06-02T04:48:02.673262+0000","last_became_peered":"2024-06-02T04:48:02.673262+0000","last_unstale":"2024-06-02T04:49:36.177199+0000","last_undegraded":"2024-06-02T04:49:36.177199+0000","last_fullsized":"2024-06-02T04:49:36.177199+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:45:00.682562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.871595+0000","last_change":"2024-06-02T04:48:06.716848+0000","last_active":"2024-06-02T04:49:06.871595+0000","last_peered":"2024-06-02T04:49:06.871595+0000","last_clean":"2024-06-02T04:49:06.871595+0000","last_became_active":"2024-06-02T04:48:06.716411+0000","last_became_peered":"2024-06-02T04:48:06.716411+0000","last_unstale":"2024-06-02T04:49:06.871595+0000","last_undegraded":"2024-06-02T04:49:06.871595+0000","last_fullsized":"2024-06-02T04:49:06.871595+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T06:09:36.074569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"80'3","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.873311+0000","last_change":"2024-06-02T04:48:02.269426+0000","last_active":"2024-06-02T04:49:06.873311+0000","last_peered":"2024-06-02T04:49:06.873311+0000","last_clean":"2024-06-02T04:49:06.873311+0000","last_became_active":"2024-06-02T04:48:02.269115+0000","last_became_peered":"2024-06-02T04:48:02.269115+0000","last_unstale":"2024-06-02T04:49:06.873311+0000","last_undegraded":"2024-06-02T04:49:06.873311+0000","last_fullsized":"2024-06-02T04:49:06.873311+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:18:28.568367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.212859+0000","last_change":"2024-06-02T04:48:02.694234+0000","last_active":"2024-06-02T04:49:36.212859+0000","last_peered":"2024-06-02T04:49:36.212859+0000","last_clean":"2024-06-02T04:49:36.212859+0000","last_became_active":"2024-06-02T04:48:02.693916+0000","last_became_peered":"2024-06-02T04:48:02.693916+0000","last_unstale":"2024-06-02T04:49:36.212859+0000","last_undegraded":"2024-06-02T04:49:36.212859+0000","last_fullsized":"2024-06-02T04:49:36.212859+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T16:47:44.939277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"80'1","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.869829+0000","last_change":"2024-06-02T04:48:06.716026+0000","last_active":"2024-06-02T04:49:06.869829+0000","last_peered":"2024-06-02T04:49:06.869829+0000","last_clean":"2024-06-02T04:49:06.869829+0000","last_became_active":"2024-06-02T04:48:06.715730+0000","last_became_peered":"2024-06-02T04:48:06.715730+0000","last_unstale":"2024-06-02T04:49:06.869829+0000","last_undegraded":"2024-06-02T04:49:06.869829+0000","last_fullsized":"2024-06-02T04:49:06.869829+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:35:53.707307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"82'2","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:07.875409+0000","last_change":"2024-06-02T04:48:02.271576+0000","last_active":"2024-06-02T04:49:07.875409+0000","last_peered":"2024-06-02T04:49:07.875409+0000","last_clean":"2024-06-02T04:49:07.875409+0000","last_became_active":"2024-06-02T04:48:02.271101+0000","last_became_peered":"2024-06-02T04:48:02.271101+0000","last_unstale":"2024-06-02T04:49:07.875409+0000","last_undegraded":"2024-06-02T04:49:07.875409+0000","last_fullsized":"2024-06-02T04:49:07.875409+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T08:35:37.467479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.197637+0000","last_change":"2024-06-02T04:48:02.702773+0000","last_active":"2024-06-02T04:49:36.197637+0000","last_peered":"2024-06-02T04:49:36.197637+0000","last_clean":"2024-06-02T04:49:36.197637+0000","last_became_active":"2024-06-02T04:48:02.702415+0000","last_became_peered":"2024-06-02T04:48:02.702415+0000","last_unstale":"2024-06-02T04:49:36.197637+0000","last_undegraded":"2024-06-02T04:49:36.197637+0000","last_fullsized":"2024-06-02T04:49:36.197637+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:18:55.084384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.868264+0000","last_change":"2024-06-02T04:48:06.963120+0000","last_active":"2024-06-02T04:49:06.868264+0000","last_peered":"2024-06-02T04:49:06.868264+0000","last_clean":"2024-06-02T04:49:06.868264+0000","last_became_active":"2024-06-02T04:48:06.962509+0000","last_became_peered":"2024-06-02T04:48:06.962509+0000","last_unstale":"2024-06-02T04:49:06.868264+0000","last_undegraded":"2024-06-02T04:49:06.868264+0000","last_fullsized":"2024-06-02T04:49:06.868264+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T04:55:34.509179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.869516+0000","last_change":"2024-06-02T04:48:02.273511+0000","last_active":"2024-06-02T04:49:06.869516+0000","last_peered":"2024-06-02T04:49:06.869516+0000","last_clean":"2024-06-02T04:49:06.869516+0000","last_became_active":"2024-06-02T04:48:02.273100+0000","last_became_peered":"2024-06-02T04:48:02.273100+0000","last_unstale":"2024-06-02T04:49:06.869516+0000","last_undegraded":"2024-06-02T04:49:06.869516+0000","last_fullsized":"2024-06-02T04:49:06.869516+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:04:11.742406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.208874+0000","last_change":"2024-06-02T04:48:02.696594+0000","last_active":"2024-06-02T04:49:36.208874+0000","last_peered":"2024-06-02T04:49:36.208874+0000","last_clean":"2024-06-02T04:49:36.208874+0000","last_became_active":"2024-06-02T04:48:02.696278+0000","last_became_peered":"2024-06-02T04:48:02.696278+0000","last_unstale":"2024-06-02T04:49:36.208874+0000","last_undegraded":"2024-06-02T04:49:36.208874+0000","last_fullsized":"2024-06-02T04:49:36.208874+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T16:10:16.275451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.874218+0000","last_change":"2024-06-02T04:48:06.701837+0000","last_active":"2024-06-02T04:49:06.874218+0000","last_peered":"2024-06-02T04:49:06.874218+0000","last_clean":"2024-06-02T04:49:06.874218+0000","last_became_active":"2024-06-02T04:48:06.701454+0000","last_became_peered":"2024-06-02T04:48:06.701454+0000","last_unstale":"2024-06-02T04:49:06.874218+0000","last_undegraded":"2024-06-02T04:49:06.874218+0000","last_fullsized":"2024-06-02T04:49:06.874218+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T16:25:46.585200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"80'3","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.866695+0000","last_change":"2024-06-02T04:48:02.272941+0000","last_active":"2024-06-02T04:49:06.866695+0000","last_peered":"2024-06-02T04:49:06.866695+0000","last_clean":"2024-06-02T04:49:06.866695+0000","last_became_active":"2024-06-02T04:48:02.270149+0000","last_became_peered":"2024-06-02T04:48:02.270149+0000","last_unstale":"2024-06-02T04:49:06.866695+0000","last_undegraded":"2024-06-02T04:49:06.866695+0000","last_fullsized":"2024-06-02T04:49:06.866695+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T04:54:09.813917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.211539+0000","last_change":"2024-06-02T04:48:02.699722+0000","last_active":"2024-06-02T04:49:36.211539+0000","last_peered":"2024-06-02T04:49:36.211539+0000","last_clean":"2024-06-02T04:49:36.211539+0000","last_became_active":"2024-06-02T04:48:02.699376+0000","last_became_peered":"2024-06-02T04:48:02.699376+0000","last_unstale":"2024-06-02T04:49:36.211539+0000","last_undegraded":"2024-06-02T04:49:36.211539+0000","last_fullsized":"2024-06-02T04:49:36.211539+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T08:12:24.048499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.869637+0000","last_change":"2024-06-02T04:48:06.706493+0000","last_active":"2024-06-02T04:49:06.869637+0000","last_peered":"2024-06-02T04:49:06.869637+0000","last_clean":"2024-06-02T04:49:06.869637+0000","last_became_active":"2024-06-02T04:48:06.706135+0000","last_became_peered":"2024-06-02T04:48:06.706135+0000","last_unstale":"2024-06-02T04:49:06.869637+0000","last_undegraded":"2024-06-02T04:49:06.869637+0000","last_fullsized":"2024-06-02T04:49:06.869637+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:54:51.491641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"75'1","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.873217+0000","last_change":"2024-06-02T04:48:02.271534+0000","last_active":"2024-06-02T04:49:06.873217+0000","last_peered":"2024-06-02T04:49:06.873217+0000","last_clean":"2024-06-02T04:49:06.873217+0000","last_became_active":"2024-06-02T04:48:02.271144+0000","last_became_peered":"2024-06-02T04:48:02.271144+0000","last_unstale":"2024-06-02T04:49:06.873217+0000","last_undegraded":"2024-06-02T04:49:06.873217+0000","last_fullsized":"2024-06-02T04:49:06.873217+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:45:10.221432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.205004+0000","last_change":"2024-06-02T04:48:02.697089+0000","last_active":"2024-06-02T04:49:36.205004+0000","last_peered":"2024-06-02T04:49:36.205004+0000","last_clean":"2024-06-02T04:49:36.205004+0000","last_became_active":"2024-06-02T04:48:02.696755+0000","last_became_peered":"2024-06-02T04:48:02.696755+0000","last_unstale":"2024-06-02T04:49:36.205004+0000","last_undegraded":"2024-06-02T04:49:36.205004+0000","last_fullsized":"2024-06-02T04:49:36.205004+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T08:56:18.715019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:07.878105+0000","last_change":"2024-06-02T04:49:07.877440+0000","last_active":"2024-06-02T04:49:07.878105+0000","last_peered":"2024-06-02T04:49:07.878105+0000","last_clean":"2024-06-02T04:49:07.878105+0000","last_became_active":"2024-06-02T04:49:07.877002+0000","last_became_peered":"2024-06-02T04:49:07.877002+0000","last_unstale":"2024-06-02T04:49:07.878105+0000","last_undegraded":"2024-06-02T04:49:07.878105+0000","last_fullsized":"2024-06-02T04:49:07.878105+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:05.682082+0000","last_clean_scrub_stamp":"2024-06-02T04:48:05.682082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T10:08:54.744309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,7,1],"acting":[10,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.e","version":"75'2","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:49:06.865165+0000","last_change":"2024-06-02T04:48:02.265912+0000","last_active":"2024-06-02T04:49:06.865165+0000","last_peered":"2024-06-02T04:49:06.865165+0000","last_clean":"2024-06-02T04:49:06.865165+0000","last_became_active":"2024-06-02T04:48:02.265494+0000","last_became_peered":"2024-06-02T04:48:02.265494+0000","last_unstale":"2024-06-02T04:49:06.865165+0000","last_undegraded":"2024-06-02T04:49:06.865165+0000","last_fullsized":"2024-06-02T04:49:06.865165+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:01.245125+0000","last_clean_scrub_stamp":"2024-06-02T04:48:01.245125+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T10:21:58.897765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.213799+0000","last_change":"2024-06-02T04:48:02.693091+0000","last_active":"2024-06-02T04:49:36.213799+0000","last_peered":"2024-06-02T04:49:36.213799+0000","last_clean":"2024-06-02T04:49:36.213799+0000","last_became_active":"2024-06-02T04:48:02.692025+0000","last_became_peered":"2024-06-02T04:48:02.692025+0000","last_unstale":"2024-06-02T04:49:36.213799+0000","last_undegraded":"2024-06-02T04:49:36.213799+0000","last_fullsized":"2024-06-02T04:49:36.213799+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T14:36:35.813881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.212739+0000","last_change":"2024-06-02T04:48:02.694381+0000","last_active":"2024-06-02T04:49:36.212739+0000","last_peered":"2024-06-02T04:49:36.212739+0000","last_clean":"2024-06-02T04:49:36.212739+0000","last_became_active":"2024-06-02T04:48:02.694049+0000","last_became_peered":"2024-06-02T04:48:02.694049+0000","last_unstale":"2024-06-02T04:49:36.212739+0000","last_undegraded":"2024-06-02T04:49:36.212739+0000","last_fullsized":"2024-06-02T04:49:36.212739+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:04:31.920810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"82'12","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.214072+0000","last_change":"2024-06-02T04:48:02.702174+0000","last_active":"2024-06-02T04:49:36.214072+0000","last_peered":"2024-06-02T04:49:36.214072+0000","last_clean":"2024-06-02T04:49:36.214072+0000","last_became_active":"2024-06-02T04:48:02.701893+0000","last_became_peered":"2024-06-02T04:48:02.701893+0000","last_unstale":"2024-06-02T04:49:36.214072+0000","last_undegraded":"2024-06-02T04:49:36.214072+0000","last_fullsized":"2024-06-02T04:49:36.214072+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:39:07.224256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.197557+0000","last_change":"2024-06-02T04:48:02.688547+0000","last_active":"2024-06-02T04:49:36.197557+0000","last_peered":"2024-06-02T04:49:36.197557+0000","last_clean":"2024-06-02T04:49:36.197557+0000","last_became_active":"2024-06-02T04:48:02.688183+0000","last_became_peered":"2024-06-02T04:48:02.688183+0000","last_unstale":"2024-06-02T04:49:36.197557+0000","last_undegraded":"2024-06-02T04:49:36.197557+0000","last_fullsized":"2024-06-02T04:49:36.197557+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:47:22.399630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.207474+0000","last_change":"2024-06-02T04:48:02.702958+0000","last_active":"2024-06-02T04:49:36.207474+0000","last_peered":"2024-06-02T04:49:36.207474+0000","last_clean":"2024-06-02T04:49:36.207474+0000","last_became_active":"2024-06-02T04:48:02.702640+0000","last_became_peered":"2024-06-02T04:48:02.702640+0000","last_unstale":"2024-06-02T04:49:36.207474+0000","last_undegraded":"2024-06-02T04:49:36.207474+0000","last_fullsized":"2024-06-02T04:49:36.207474+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T12:53:17.406762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"82'4","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.199772+0000","last_change":"2024-06-02T04:49:07.892927+0000","last_active":"2024-06-02T04:49:36.199772+0000","last_peered":"2024-06-02T04:49:36.199772+0000","last_clean":"2024-06-02T04:49:36.199772+0000","last_became_active":"2024-06-02T04:49:07.892589+0000","last_became_peered":"2024-06-02T04:49:07.892589+0000","last_unstale":"2024-06-02T04:49:36.199772+0000","last_undegraded":"2024-06-02T04:49:36.199772+0000","last_fullsized":"2024-06-02T04:49:36.199772+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T08:37:06.703061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"82'6","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.211826+0000","last_change":"2024-06-02T04:49:07.892107+0000","last_active":"2024-06-02T04:49:36.211826+0000","last_peered":"2024-06-02T04:49:36.211826+0000","last_clean":"2024-06-02T04:49:36.211826+0000","last_became_active":"2024-06-02T04:49:07.891716+0000","last_became_peered":"2024-06-02T04:49:07.891716+0000","last_unstale":"2024-06-02T04:49:36.211826+0000","last_undegraded":"2024-06-02T04:49:36.211826+0000","last_fullsized":"2024-06-02T04:49:36.211826+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T10:25:12.557665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"82'15","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.213918+0000","last_change":"2024-06-02T04:48:02.698865+0000","last_active":"2024-06-02T04:49:36.213918+0000","last_peered":"2024-06-02T04:49:36.213918+0000","last_clean":"2024-06-02T04:49:36.213918+0000","last_became_active":"2024-06-02T04:48:02.698554+0000","last_became_peered":"2024-06-02T04:48:02.698554+0000","last_unstale":"2024-06-02T04:49:36.213918+0000","last_undegraded":"2024-06-02T04:49:36.213918+0000","last_fullsized":"2024-06-02T04:49:36.213918+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:19:14.413170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"82'2","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.216241+0000","last_change":"2024-06-02T04:48:02.694345+0000","last_active":"2024-06-02T04:49:36.216241+0000","last_peered":"2024-06-02T04:49:36.216241+0000","last_clean":"2024-06-02T04:49:36.216241+0000","last_became_active":"2024-06-02T04:48:02.693866+0000","last_became_peered":"2024-06-02T04:48:02.693866+0000","last_unstale":"2024-06-02T04:49:36.216241+0000","last_undegraded":"2024-06-02T04:49:36.216241+0000","last_fullsized":"2024-06-02T04:49:36.216241+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:56:09.409774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.202853+0000","last_change":"2024-06-02T04:48:02.689609+0000","last_active":"2024-06-02T04:49:36.202853+0000","last_peered":"2024-06-02T04:49:36.202853+0000","last_clean":"2024-06-02T04:49:36.202853+0000","last_became_active":"2024-06-02T04:48:02.689279+0000","last_became_peered":"2024-06-02T04:48:02.689279+0000","last_unstale":"2024-06-02T04:49:36.202853+0000","last_undegraded":"2024-06-02T04:49:36.202853+0000","last_fullsized":"2024-06-02T04:49:36.202853+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T14:05:04.600923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.200357+0000","last_change":"2024-06-02T04:48:02.694124+0000","last_active":"2024-06-02T04:49:36.200357+0000","last_peered":"2024-06-02T04:49:36.200357+0000","last_clean":"2024-06-02T04:49:36.200357+0000","last_became_active":"2024-06-02T04:48:02.693787+0000","last_became_peered":"2024-06-02T04:48:02.693787+0000","last_unstale":"2024-06-02T04:49:36.200357+0000","last_undegraded":"2024-06-02T04:49:36.200357+0000","last_fullsized":"2024-06-02T04:49:36.200357+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T07:56:27.274107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"82'10","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.217256+0000","last_change":"2024-06-02T04:48:02.698736+0000","last_active":"2024-06-02T04:49:36.217256+0000","last_peered":"2024-06-02T04:49:36.217256+0000","last_clean":"2024-06-02T04:49:36.217256+0000","last_became_active":"2024-06-02T04:48:02.698285+0000","last_became_peered":"2024-06-02T04:48:02.698285+0000","last_unstale":"2024-06-02T04:49:36.217256+0000","last_undegraded":"2024-06-02T04:49:36.217256+0000","last_fullsized":"2024-06-02T04:49:36.217256+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T04:53:31.655139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"82'11","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.209741+0000","last_change":"2024-06-02T04:48:02.689942+0000","last_active":"2024-06-02T04:49:36.209741+0000","last_peered":"2024-06-02T04:49:36.209741+0000","last_clean":"2024-06-02T04:49:36.209741+0000","last_became_active":"2024-06-02T04:48:02.689096+0000","last_became_peered":"2024-06-02T04:48:02.689096+0000","last_unstale":"2024-06-02T04:49:36.209741+0000","last_undegraded":"2024-06-02T04:49:36.209741+0000","last_fullsized":"2024-06-02T04:49:36.209741+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:11:06.451048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:49:36.218470+0000","last_change":"2024-06-02T04:48:02.691514+0000","last_active":"2024-06-02T04:49:36.218470+0000","last_peered":"2024-06-02T04:49:36.218470+0000","last_clean":"2024-06-02T04:49:36.218470+0000","last_became_active":"2024-06-02T04:48:02.691169+0000","last_became_peered":"2024-06-02T04:48:02.691169+0000","last_unstale":"2024-06-02T04:49:36.218470+0000","last_undegraded":"2024-06-02T04:49:36.218470+0000","last_fullsized":"2024-06-02T04:49:36.218470+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:48:02.246907+0000","last_clean_scrub_stamp":"2024-06-02T04:48:02.246907+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T06:03:54.513910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":280790,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":70036,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":461,"num_read_kb":303,"num_write":170,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":210108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":149,"ondisk_log_size":149,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":71,"seq":304942678044,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":905216,"data_stored":460853,"data_compressed":17559,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 04:49:34 2024","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.57399999999999995,"15min":0.51900000000000002},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":9.5549999999999997,"5min":9.5549999999999997,"15min":9.5549999999999997},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.65800000000000003,"15min":0.60899999999999999},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":9.5749999999999993,"5min":9.5749999999999993,"15min":9.5749999999999993},"last":0.55600000000000005}]},{"osd":1,"last update":"Sun Jun 2 04:49:34 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.59799999999999998,"15min":0.59999999999999998},"min":{"1min":0.42899999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.77400000000000002,"5min":0.998,"15min":0.998},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.439,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.68999999999999995,"5min":1.052,"15min":1.052},"last":0.753}]},{"osd":2,"last update":"Sun Jun 2 04:49:34 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.44600000000000001,"15min":0.438},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.45000000000000001,"15min":0.44400000000000001},"min":{"1min":0.32200000000000001,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.59799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":4,"last update":"Sun Jun 2 04:49:34 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.61299999999999999,"15min":0.61099999999999999},"min":{"1min":0.498,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.78800000000000003,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.627,"5min":0.59399999999999997,"15min":0.58799999999999997},"min":{"1min":0.51500000000000001,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.65300000000000002}]},{"osd":5,"last update":"Sun Jun 2 04:49:34 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.54800000000000004,"15min":0.54300000000000004},"min":{"1min":0.39000000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.76700000000000002,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.38400000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.53300000000000003}]},{"osd":6,"last update":"Sun Jun 2 04:49:34 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.626,"15min":0.63300000000000001},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.88700000000000001,"5min":1.159,"15min":1.159},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.68300000000000005,"15min":0.68899999999999995},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.86899999999999999,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.66400000000000003}]},{"osd":7,"last update":"Sun Jun 2 04:49:34 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.68799999999999994,"15min":0.68999999999999995},"min":{"1min":0.51000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.872,"5min":1.075,"15min":1.075},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.69099999999999995,"15min":0.69299999999999995},"min":{"1min":0.498,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.88300000000000001,"5min":1.123,"15min":1.123},"last":0.70899999999999996}]},{"osd":8,"last update":"Sun Jun 2 04:49:02 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.78300000000000003}]},{"osd":9,"last update":"Sun Jun 2 04:49:34 2024","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.77200000000000002,"15min":0.751},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":4.452,"5min":4.452,"15min":4.452},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.73999999999999999,"15min":0.745},"min":{"1min":0.52800000000000002,"5min":0.505,"15min":0.505},"max":{"1min":0.94699999999999995,"5min":1.429,"15min":1.429},"last":0.83799999999999997}]},{"osd":10,"last update":"Sun Jun 2 04:49:34 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.70399999999999996,"15min":0.70299999999999996},"min":{"1min":0.52200000000000002,"5min":0.505,"15min":0.505},"max":{"1min":0.92700000000000005,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.75,"15min":0.748},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.93300000000000005,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.82699999999999996}]}]},{"osd":10,"up_from":64,"seq":274877906977,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32140,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713012,"statfs":{"total":95995035648,"available":95962124288,"internally_reserved":0,"allocated":1052672,"data_stored":1113581,"data_compressed":53272,"data_compressed_allocated":69632,"data_compressed_original":638976,"omap_allocated":1599,"internal_metadata":31848897},"hb_peers":[0,1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 04:49:06 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.69799999999999995}]},{"osd":1,"last update":"Sun Jun 2 04:49:19 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.44900000000000001,"15min":0.44400000000000001},"min":{"1min":0.33500000000000002,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.625,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.502,"5min":0.47599999999999998,"15min":0.47199999999999998},"min":{"1min":0.28899999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.72199999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.34399999999999997}]},{"osd":2,"last update":"Sun Jun 2 04:49:19 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.627,"15min":0.629},"min":{"1min":0.441,"5min":0.375,"15min":0.375},"max":{"1min":0.72499999999999998,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.623,"15min":0.621},"min":{"1min":0.50600000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.78200000000000003,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.54400000000000004}]},{"osd":3,"last update":"Sun Jun 2 04:49:19 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.55300000000000005,"15min":0.55500000000000005},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.71099999999999997,"5min":0.879,"15min":0.879},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.59399999999999997,"15min":0.58599999999999997},"min":{"1min":0.432,"5min":0.377,"15min":0.377},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.57099999999999995}]},{"osd":4,"last update":"Sun Jun 2 04:49:19 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.56999999999999995,"15min":0.56200000000000006},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.53900000000000003,"15min":0.53500000000000003},"min":{"1min":0.33500000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.42499999999999999}]},{"osd":5,"last update":"Sun Jun 2 04:49:19 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.67800000000000005,"15min":0.67400000000000004},"min":{"1min":0.57299999999999995,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.67500000000000004,"15min":0.67700000000000005},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.80400000000000005,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.505}]},{"osd":6,"last update":"Sun Jun 2 04:49:19 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.61499999999999999,"15min":0.61199999999999999},"min":{"1min":0.40300000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.84899999999999998,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.68899999999999995,"15min":0.68300000000000005},"min":{"1min":0.51700000000000002,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.91300000000000003,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.70999999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":8,"last update":"Sun Jun 2 04:49:19 2024","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.77500000000000002,"15min":0.77200000000000002},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.751,"15min":0.753},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.73999999999999999}]},{"osd":9,"last update":"Sun Jun 2 04:49:19 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.745,"15min":0.74199999999999999},"min":{"1min":0.55300000000000005,"5min":0.441,"15min":0.441},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.72199999999999998,"15min":0.72299999999999998},"min":{"1min":0.51000000000000001,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.95899999999999996,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.78500000000000003}]},{"osd":11,"last update":"Sun Jun 2 04:49:36 2024","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.79200000000000004,"15min":0.78800000000000003},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.751},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.76600000000000001}]}]},{"osd":9,"up_from":60,"seq":257698037797,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32016,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713136,"statfs":{"total":95995035648,"available":95962251264,"internally_reserved":0,"allocated":925696,"data_stored":465185,"data_compressed":17559,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1599,"internal_metadata":31848897},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 04:49:00 2024","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.439,"15min":0.45200000000000001},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.51600000000000001,"5min":0.621,"15min":0.621},"last":0.307},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.443,"15min":0.46000000000000002},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.45400000000000001,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.254}]},{"osd":1,"last update":"Sun Jun 2 04:49:00 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.59899999999999998,"15min":0.60699999999999998},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.74199999999999999,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.61299999999999999,"15min":0.625},"min":{"1min":0.41599999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.72599999999999998,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.63200000000000001}]},{"osd":2,"last update":"Sun Jun 2 04:49:00 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.60699999999999998,"15min":0.62},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.68999999999999995,"5min":0.748,"15min":0.748},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.57699999999999996,"15min":0.58499999999999996},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.72799999999999998,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.56399999999999995}]},{"osd":3,"last update":"Sun Jun 2 04:49:00 2024","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.51800000000000002,"15min":0.53900000000000003},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.52000000000000002,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.55900000000000005,"15min":0.58099999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.33500000000000002}]},{"osd":4,"last update":"Sun Jun 2 04:49:00 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.60799999999999998,"15min":0.621},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.71099999999999997,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.64900000000000002,"15min":0.65900000000000003},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.79500000000000004,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.57199999999999995}]},{"osd":5,"last update":"Sun Jun 2 04:49:00 2024","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.60399999999999998,"15min":0.61699999999999999},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.71299999999999997,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.67100000000000004,"15min":0.68300000000000005},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.74099999999999999,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.5}]},{"osd":6,"last update":"Sun Jun 2 04:47:56 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.505}]},{"osd":7,"last update":"Sun Jun 2 04:49:00 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.75900000000000001,"15min":0.78500000000000003},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.82299999999999995,"5min":1.081,"15min":1.081},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.73999999999999999,"15min":0.76100000000000001},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.83599999999999997,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.46700000000000003}]},{"osd":8,"last update":"Sun Jun 2 04:49:00 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.76000000000000001,"15min":0.78400000000000003},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.79900000000000004,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.73599999999999999,"15min":0.75800000000000001},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.80700000000000005,"5min":1.01,"15min":1.01},"last":0.61699999999999999}]},{"osd":10,"last update":"Sun Jun 2 04:49:14 2024","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.73199999999999998,"15min":0.74399999999999999},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.86199999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.434},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.69599999999999995,"15min":0.70999999999999996},"min":{"1min":0.48299999999999998,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.78600000000000003,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.51200000000000001}]},{"osd":11,"last update":"Sun Jun 2 04:49:06 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.60699999999999998}]}]},{"osd":8,"up_from":53,"seq":227633266727,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":917504,"data_stored":460678,"data_compressed":17559,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 04:48:38 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.54600000000000004,"15min":0.54300000000000004},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.77300000000000002,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.52800000000000002,"15min":0.52400000000000002},"min":{"1min":0.45900000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.41999999999999998}]},{"osd":1,"last update":"Sun Jun 2 04:48:38 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.53900000000000003,"15min":0.53300000000000003},"min":{"1min":0.36899999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.64400000000000002}]},{"osd":2,"last update":"Sun Jun 2 04:48:38 2024","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.42699999999999999,"15min":0.42299999999999999},"min":{"1min":0.311,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.437,"15min":0.433},"min":{"1min":0.26900000000000002,"5min":0.245,"15min":0.245},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.38900000000000001}]},{"osd":3,"last update":"Sun Jun 2 04:48:38 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.53500000000000003,"15min":0.52900000000000003},"min":{"1min":0.35099999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.56100000000000005,"15min":0.55700000000000005},"min":{"1min":0.41199999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.72999999999999998,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.439}]},{"osd":4,"last update":"Sun Jun 2 04:48:38 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.56999999999999995,"15min":0.56799999999999995},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.40999999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.76100000000000001,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.72699999999999998}]},{"osd":5,"last update":"Sun Jun 2 04:48:38 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.52500000000000002,"15min":0.52100000000000002},"min":{"1min":0.33100000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.80800000000000005,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.53500000000000003,"15min":0.53100000000000003},"min":{"1min":0.379,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.82199999999999995,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.50900000000000001}]},{"osd":6,"last update":"Sun Jun 2 04:48:38 2024","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.628,"15min":0.625},"min":{"1min":0.5,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.79100000000000004,"5min":0.876,"15min":0.876},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.63200000000000001,"15min":0.628},"min":{"1min":0.40600000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.84099999999999997,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.622}]},{"osd":7,"last update":"Sun Jun 2 04:48:38 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.66400000000000003,"15min":0.65900000000000003},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.91000000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.67300000000000004,"15min":0.66700000000000004},"min":{"1min":0.50900000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.67800000000000005}]},{"osd":9,"last update":"Sun Jun 2 04:48:59 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.67100000000000004,"15min":0.66100000000000003},"min":{"1min":0.51600000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.68999999999999995,"15min":0.68500000000000005},"min":{"1min":0.47099999999999997,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.91800000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.69099999999999995}]},{"osd":10,"last update":"Sun Jun 2 04:49:18 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.72999999999999998,"15min":0.72399999999999998},"min":{"1min":0.58199999999999996,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.92600000000000005,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.751,"5min":0.73799999999999999,"15min":0.73599999999999999},"min":{"1min":0.60699999999999998,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.94099999999999995,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.75600000000000001}]},{"osd":11,"last update":"Sun Jun 2 04:49:04 2024","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.745}]}]},{"osd":7,"up_from":46,"seq":197568495660,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32060,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713092,"statfs":{"total":95995035648,"available":95962206208,"internally_reserved":0,"allocated":970752,"data_stored":1058459,"data_compressed":53272,"data_compressed_allocated":69632,"data_compressed_original":638976,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 04:47:20 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.30199999999999999}]},{"osd":1,"last update":"Sun Jun 2 04:49:25 2024","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.29499999999999998,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.60099999999999998,"5min":0.746,"15min":0.746},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.435,"5min":0.433,"15min":0.42299999999999999},"min":{"1min":0.29399999999999998,"5min":0.253,"15min":0.253},"max":{"1min":0.56599999999999995,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.53100000000000003}]},{"osd":2,"last update":"Sun Jun 2 04:49:25 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58299999999999996,"15min":0.57299999999999995},"min":{"1min":0.38400000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.745,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.621,"5min":0.59199999999999997,"15min":0.57699999999999996},"min":{"1min":0.39300000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.78500000000000003,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.65300000000000002}]},{"osd":3,"last update":"Sun Jun 2 04:49:25 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.58599999999999997,"15min":0.58699999999999997},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.77500000000000002,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.56699999999999995,"15min":0.55900000000000005},"min":{"1min":0.38200000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.66500000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.57399999999999995}]},{"osd":4,"last update":"Sun Jun 2 04:49:25 2024","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.44400000000000001,"15min":0.438},"min":{"1min":0.312,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.53700000000000003,"15min":0.53500000000000003},"min":{"1min":0.38400000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.71899999999999997,"5min":0.879,"15min":0.879},"last":0.67400000000000004}]},{"osd":5,"last update":"Sun Jun 2 04:49:25 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.60599999999999998,"15min":0.59699999999999998},"min":{"1min":0.41899999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.81699999999999995,"5min":0.873,"15min":0.873},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.66200000000000003,"15min":0.66000000000000003},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.85099999999999998,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.78900000000000003}]},{"osd":6,"last update":"Sun Jun 2 04:49:25 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.625,"15min":0.623},"min":{"1min":0.40300000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.75800000000000001,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.61899999999999999,"15min":0.61199999999999999},"min":{"1min":0.45200000000000001,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.83299999999999996,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.59199999999999997}]},{"osd":8,"last update":"Sun Jun 2 04:48:42 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.70799999999999996,"15min":0.69799999999999995},"min":{"1min":0.54500000000000004,"5min":0.441,"15min":0.441},"max":{"1min":1.0069999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.66900000000000004,"15min":0.66000000000000003},"min":{"1min":0.55400000000000005,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.81499999999999995}]},{"osd":9,"last update":"Sun Jun 2 04:48:57 2024","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.72599999999999998,"15min":0.72799999999999998},"min":{"1min":0.51600000000000001,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.97399999999999998,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.70699999999999996,"15min":0.70899999999999996},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.879,"5min":1.042,"15min":1.042},"last":0.82699999999999996}]},{"osd":10,"last update":"Sun Jun 2 04:49:20 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.70899999999999996,"15min":0.71899999999999997},"min":{"1min":0.46999999999999997,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.83299999999999996,"5min":1.012,"15min":1.012},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.72399999999999998,"15min":0.72999999999999998},"min":{"1min":0.49199999999999999,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.878,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.89200000000000002}]},{"osd":11,"last update":"Sun Jun 2 04:49:04 2024","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.93700000000000006},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.876}]}]},{"osd":6,"up_from":40,"seq":171798691886,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":901120,"data_stored":456265,"data_compressed":17559,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 04:49:08 2024","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.40100000000000002,"15min":0.39200000000000002},"min":{"1min":0.28599999999999998,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":1.956,"5min":1.956,"15min":1.956},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.40899999999999997,"15min":0.41299999999999998},"min":{"1min":0.29899999999999999,"5min":0.251,"15min":0.251},"max":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":0.32200000000000001}]},{"osd":1,"last update":"Sun Jun 2 04:49:08 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.40600000000000003,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.034,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.627,"15min":0.59999999999999998},"min":{"1min":0.39700000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":6.0759999999999996,"5min":6.0759999999999996,"15min":6.0759999999999996},"last":0.45700000000000002}]},{"osd":2,"last update":"Sun Jun 2 04:49:08 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.57799999999999996,"15min":0.57299999999999995},"min":{"1min":0.38900000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.63400000000000001,"15min":0.59999999999999998},"min":{"1min":0.371,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":6.2229999999999999,"5min":6.2229999999999999,"15min":6.2229999999999999},"last":0.503}]},{"osd":3,"last update":"Sun Jun 2 04:49:08 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.505,"15min":0.47499999999999998},"min":{"1min":0.29799999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":6.2789999999999999,"5min":6.2789999999999999,"15min":6.2789999999999999},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.47999999999999998,"15min":0.47599999999999998},"min":{"1min":0.34100000000000003,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.984,"5min":1.984,"15min":1.984},"last":0.39100000000000001}]},{"osd":4,"last update":"Sun Jun 2 04:49:08 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.59799999999999998,"15min":0.60299999999999998},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.88200000000000001,"5min":1.032,"15min":1.032},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.67000000000000004,"15min":0.65300000000000002},"min":{"1min":0.38700000000000001,"5min":0.373,"15min":0.373},"max":{"1min":6.1280000000000001,"5min":6.1280000000000001,"15min":6.1280000000000001},"last":0.47599999999999998}]},{"osd":5,"last update":"Sun Jun 2 04:49:08 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.629,"15min":0.625},"min":{"1min":0.436,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.8540000000000001,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64300000000000002,"15min":0.65100000000000002},"min":{"1min":0.40999999999999998,"5min":0.379,"15min":0.379},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.57599999999999996}]},{"osd":7,"last update":"Sun Jun 2 04:49:27 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.63200000000000001,"15min":0.63800000000000001},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.68700000000000006,"15min":0.66300000000000003},"min":{"1min":0.41999999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":6.1609999999999996,"5min":6.1609999999999996,"15min":6.1609999999999996},"last":0.436}]},{"osd":8,"last update":"Sun Jun 2 04:48:39 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.68500000000000005,"15min":0.68000000000000005},"min":{"1min":0.501,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.897,"5min":1.897,"15min":1.897},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.69699999999999995,"15min":0.69899999999999995},"min":{"1min":0.47299999999999998,"5min":0.443,"15min":0.443},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.52600000000000002}]},{"osd":9,"last update":"Sun Jun 2 04:49:00 2024","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.65500000000000003,"15min":0.62},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":6.2530000000000001,"5min":6.2530000000000001,"15min":6.2530000000000001},"last":0.40300000000000002},{"interface":"front","average":{"1min":1.2110000000000001,"5min":0.71999999999999997,"15min":0.63800000000000001},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":12.939,"5min":12.939,"15min":12.939},"last":0.54100000000000004}]},{"osd":10,"last update":"Sun Jun 2 04:49:19 2024","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.68500000000000005,"15min":0.67900000000000005},"min":{"1min":0.56399999999999995,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.73199999999999998,"15min":0.69299999999999995},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":6.1929999999999996,"5min":6.1929999999999996,"15min":6.1929999999999996},"last":0.51900000000000002}]},{"osd":11,"last update":"Sun Jun 2 04:49:08 2024","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.929,"5min":1.929,"15min":1.929},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.621}]}]},{"osd":1,"up_from":12,"seq":51539607616,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36156,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708996,"statfs":{"total":95995035648,"available":95958011904,"internally_reserved":0,"allocated":970752,"data_stored":520669,"data_compressed":17559,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 04:48:46 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.51100000000000001,"15min":0.49099999999999999},"min":{"1min":0.32100000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.85599999999999998,"5min":1.131,"15min":1.131},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.50600000000000001,"15min":0.49099999999999999},"min":{"1min":0.32700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.47499999999999998}]},{"osd":2,"last update":"Sun Jun 2 04:49:00 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.52300000000000002,"15min":0.51400000000000001},"min":{"1min":0.40799999999999997,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.72999999999999998,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.53700000000000003,"15min":0.51100000000000001},"min":{"1min":0.38800000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.79700000000000004,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.58199999999999996}]},{"osd":3,"last update":"Sun Jun 2 04:49:17 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.54600000000000004,"15min":0.503},"min":{"1min":0.36899999999999999,"5min":0.316,"15min":0.316},"max":{"1min":3.2509999999999999,"5min":3.2509999999999999,"15min":3.2509999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51200000000000001,"15min":0.504},"min":{"1min":0.376,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.70499999999999996,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.50800000000000001}]},{"osd":4,"last update":"Sun Jun 2 04:49:03 2024","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.41099999999999998}]},{"osd":5,"last update":"Sun Jun 2 04:48:54 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.56000000000000005,"15min":0.54100000000000004},"min":{"1min":0.41999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.78000000000000003,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.624,"15min":0.59999999999999998},"min":{"1min":0.441,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.88300000000000001,"5min":1.212,"15min":1.212},"last":0.67500000000000004}]},{"osd":6,"last update":"Sun Jun 2 04:49:12 2024","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.61699999999999999,"15min":0.59699999999999998},"min":{"1min":0.45900000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.90300000000000002,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.75},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.61299999999999999,"15min":0.59699999999999998},"min":{"1min":0.44700000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.91600000000000004,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.70199999999999996}]},{"osd":7,"last update":"Sun Jun 2 04:49:28 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.53500000000000003,"15min":0.53700000000000003},"min":{"1min":0.36299999999999999,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.70399999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59099999999999997,"15min":0.58299999999999996},"min":{"1min":0.40100000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.77600000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.76600000000000001}]},{"osd":8,"last update":"Sun Jun 2 04:48:41 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.67300000000000004,"15min":0.67400000000000004},"min":{"1min":0.45700000000000002,"5min":0.435,"15min":0.435},"max":{"1min":0.85399999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72899999999999998,"15min":0.72999999999999998},"min":{"1min":0.46600000000000003,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.97499999999999998,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.84499999999999997}]},{"osd":9,"last update":"Sun Jun 2 04:49:00 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.52700000000000002,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.95399999999999996,"5min":1.288,"15min":1.288},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.71399999999999997,"15min":0.70999999999999996},"min":{"1min":0.56999999999999995,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.80700000000000005}]},{"osd":10,"last update":"Sun Jun 2 04:49:17 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.65800000000000003,"15min":0.65700000000000003},"min":{"1min":0.49199999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.84099999999999997,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.751,"5min":0.746,"15min":0.745},"min":{"1min":0.60099999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.86299999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.79500000000000004}]},{"osd":11,"last update":"Sun Jun 2 04:49:03 2024","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.86499999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738434,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32016,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713136,"statfs":{"total":95995035648,"available":95962251264,"internally_reserved":0,"allocated":925696,"data_stored":457653,"data_compressed":17559,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jun 2 04:48:43 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.51000000000000001,"15min":0.46999999999999997},"min":{"1min":0.35199999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.51000000000000001,"15min":0.46500000000000002},"min":{"1min":0.32000000000000001,"5min":0.315,"15min":0.315},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.51200000000000001}]},{"osd":2,"last update":"Sun Jun 2 04:49:03 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.52000000000000002,"15min":0.47599999999999998},"min":{"1min":0.46000000000000002,"5min":0.314,"15min":0.314},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.54000000000000004,"15min":0.48699999999999999},"min":{"1min":0.42599999999999999,"5min":0.307,"15min":0.307},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.63}]},{"osd":3,"last update":"Sun Jun 2 04:49:03 2024","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.31900000000000001}]},{"osd":4,"last update":"Sun Jun 2 04:48:37 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.54800000000000004,"15min":0.52100000000000002},"min":{"1min":0.38200000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.53800000000000003,"15min":0.52400000000000002},"min":{"1min":0.42599999999999999,"5min":0.372,"15min":0.372},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.53800000000000003}]},{"osd":5,"last update":"Sun Jun 2 04:48:52 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.57199999999999995,"15min":0.53900000000000003},"min":{"1min":0.377,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.57299999999999995,"15min":0.54100000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.61799999999999999}]},{"osd":6,"last update":"Sun Jun 2 04:49:09 2024","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.48499999999999999,"15min":0.49099999999999999},"min":{"1min":0.30099999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.47399999999999998,"15min":0.46999999999999997},"min":{"1min":0.33000000000000002,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.441}]},{"osd":7,"last update":"Sun Jun 2 04:49:09 2024","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.71099999999999997}]},{"osd":8,"last update":"Sun Jun 2 04:48:41 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.64200000000000002,"15min":0.64500000000000002},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.70299999999999996,"15min":0.70699999999999996},"min":{"1min":0.54500000000000004,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.67600000000000005}]},{"osd":9,"last update":"Sun Jun 2 04:48:57 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.627,"15min":0.63700000000000001},"min":{"1min":0.36699999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.60799999999999998,"15min":0.60999999999999999},"min":{"1min":0.39600000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.56599999999999995}]},{"osd":10,"last update":"Sun Jun 2 04:49:18 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.68899999999999995,"15min":0.68600000000000005},"min":{"1min":0.52300000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.67700000000000005,"15min":0.68100000000000005},"min":{"1min":0.52500000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.69899999999999995}]},{"osd":11,"last update":"Sun Jun 2 04:49:35 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.66700000000000004,"15min":0.66900000000000004},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.72299999999999998,"15min":0.72599999999999998},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.76300000000000001}]}]},{"osd":2,"up_from":16,"seq":68719476797,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32084,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713068,"statfs":{"total":95995035648,"available":95962181632,"internally_reserved":0,"allocated":995328,"data_stored":522985,"data_compressed":17559,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 04:49:07 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.51700000000000002,"15min":0.49299999999999999},"min":{"1min":0.434,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.51100000000000001,"15min":0.51000000000000001},"min":{"1min":0.39500000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.70099999999999996,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.49399999999999999}]},{"osd":1,"last update":"Sun Jun 2 04:49:07 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.56100000000000005,"15min":0.53700000000000003},"min":{"1min":0.46200000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.57699999999999996,"15min":0.55600000000000005},"min":{"1min":0.40899999999999997,"5min":0.254,"15min":0.254},"max":{"1min":0.92000000000000004,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.65100000000000002}]},{"osd":3,"last update":"Sun Jun 2 04:49:22 2024","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.43099999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.79400000000000004,"5min":1.472,"15min":1.472},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.62,"5min":0.55100000000000005,"15min":0.53300000000000003},"min":{"1min":0.48099999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.77400000000000002,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.57499999999999996}]},{"osd":4,"last update":"Sun Jun 2 04:49:02 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.59299999999999997}]},{"osd":5,"last update":"Sun Jun 2 04:48:53 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.46400000000000002,"15min":0.42599999999999999},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.623},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.48499999999999999,"15min":0.45300000000000001},"min":{"1min":0.34100000000000003,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.63500000000000001}]},{"osd":6,"last update":"Sun Jun 2 04:49:07 2024","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.60199999999999998,"15min":0.59299999999999997},"min":{"1min":0.441,"5min":0.372,"15min":0.372},"max":{"1min":0.90400000000000003,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.67100000000000004,"15min":0.64300000000000002},"min":{"1min":0.66900000000000004,"5min":0.438,"15min":0.438},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.71099999999999997}]},{"osd":7,"last update":"Sun Jun 2 04:49:07 2024","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.747},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.75700000000000001}]},{"osd":8,"last update":"Sun Jun 2 04:48:42 2024","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.56699999999999995,"15min":0.56100000000000005},"min":{"1min":0.42399999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.63100000000000001,"15min":0.621},"min":{"1min":0.41499999999999998,"5min":0.37,"15min":0.37},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.80800000000000005}]},{"osd":9,"last update":"Sun Jun 2 04:49:02 2024","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.65700000000000003,"15min":0.64600000000000002},"min":{"1min":0.52400000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.75900000000000001,"15min":0.747},"min":{"1min":0.66600000000000004,"5min":0.5,"15min":0.5},"max":{"1min":0.99299999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.78100000000000003}]},{"osd":10,"last update":"Sun Jun 2 04:49:17 2024","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.68799999999999994,"15min":0.66900000000000004},"min":{"1min":0.60899999999999999,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.72899999999999998,"15min":0.71499999999999997},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.82399999999999995}]},{"osd":11,"last update":"Sun Jun 2 04:49:02 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.76800000000000002}]}]},{"osd":3,"up_from":22,"seq":94489280568,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32004,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713148,"statfs":{"total":95995035648,"available":95962263552,"internally_reserved":0,"allocated":913408,"data_stored":456459,"data_compressed":17559,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 04:49:22 2024","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":0.46899999999999997,"15min":0.35999999999999999},"min":{"1min":0.26700000000000002,"5min":0.221,"15min":0.221},"max":{"1min":11.061999999999999,"5min":11.061999999999999,"15min":11.061999999999999},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.35999999999999999,"15min":0.34399999999999997},"min":{"1min":0.27500000000000002,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.31}]},{"osd":1,"last update":"Sun Jun 2 04:49:22 2024","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.58399999999999996,"15min":0.496},"min":{"1min":0.35699999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":7.3600000000000003,"5min":7.3600000000000003,"15min":7.3600000000000003},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.51100000000000001,"15min":0.46899999999999997},"min":{"1min":0.38200000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.53300000000000003}]},{"osd":2,"last update":"Sun Jun 2 04:49:22 2024","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.56100000000000005,"15min":0.56399999999999995},"min":{"1min":0.40300000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.3420000000000001,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.65000000000000002,"15min":0.61499999999999999},"min":{"1min":0.41299999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":7.2869999999999999,"5min":7.2869999999999999,"15min":7.2869999999999999},"last":0.443}]},{"osd":4,"last update":"Sun Jun 2 04:48:38 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.51400000000000001,"15min":0.499},"min":{"1min":0.41599999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.67300000000000004,"5min":0.877,"15min":0.877},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.52600000000000002,"15min":0.505},"min":{"1min":0.40999999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.72299999999999998,"5min":0.751,"15min":0.751},"last":0.47599999999999998}]},{"osd":5,"last update":"Sun Jun 2 04:48:54 2024","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.63400000000000001,"15min":0.57999999999999996},"min":{"1min":0.38900000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":7.3220000000000001,"5min":7.3220000000000001,"15min":7.3220000000000001},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55300000000000005,"15min":0.54900000000000004},"min":{"1min":0.39800000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.90000000000000002,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.46300000000000002}]},{"osd":6,"last update":"Sun Jun 2 04:49:08 2024","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":0.61099999999999999,"15min":0.51500000000000001},"min":{"1min":0.36299999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":11.128,"5min":11.128,"15min":11.128},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.55900000000000005,"15min":0.5},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":7.6159999999999997,"5min":7.6159999999999997,"15min":7.6159999999999997},"last":0.32700000000000001}]},{"osd":7,"last update":"Sun Jun 2 04:49:29 2024","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.67900000000000005,"15min":0.63200000000000001},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":7.3869999999999996,"5min":7.3869999999999996,"15min":7.3869999999999996},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64700000000000002,"15min":0.65100000000000002},"min":{"1min":0.46000000000000002,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.60199999999999998}]},{"osd":8,"last update":"Sun Jun 2 04:47:39 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.51100000000000001}]},{"osd":9,"last update":"Sun Jun 2 04:49:03 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.58299999999999996,"15min":0.58899999999999997},"min":{"1min":0.41899999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.72599999999999998,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.504},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.66000000000000003,"15min":0.60899999999999999},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":7.2389999999999999,"5min":7.2389999999999999,"15min":7.2389999999999999},"last":0.36599999999999999}]},{"osd":10,"last update":"Sun Jun 2 04:49:17 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.68200000000000005,"15min":0.68400000000000005},"min":{"1min":0.54800000000000004,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.871,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.68000000000000005,"15min":0.67500000000000004},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.63400000000000001}]},{"osd":11,"last update":"Sun Jun 2 04:49:03 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.54300000000000004}]}]},{"osd":4,"up_from":29,"seq":124554051638,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32004,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713148,"statfs":{"total":95995035648,"available":95962263552,"internally_reserved":0,"allocated":913408,"data_stored":461881,"data_compressed":17559,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 04:47:31 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.49199999999999999,"15min":0.48099999999999998},"min":{"1min":0.32400000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.495,"15min":0.48699999999999999},"min":{"1min":0.35199999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.78900000000000003,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.34300000000000003}]},{"osd":1,"last update":"Sun Jun 2 04:49:35 2024","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.376,"15min":0.34799999999999998},"min":{"1min":0.32800000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.58699999999999997,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.40699999999999997,"15min":0.373},"min":{"1min":0.30199999999999999,"5min":0.217,"15min":0.217},"max":{"1min":0.61099999999999999,"5min":0.877,"15min":0.877},"last":0.39100000000000001}]},{"osd":2,"last update":"Sun Jun 2 04:49:35 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.55500000000000005,"15min":0.53300000000000003},"min":{"1min":0.443,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.58499999999999996,"15min":0.54500000000000004},"min":{"1min":0.54100000000000004,"5min":0.377,"15min":0.377},"max":{"1min":0.72999999999999998,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.55600000000000005}]},{"osd":3,"last update":"Sun Jun 2 04:49:35 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.55600000000000005,"15min":0.52300000000000002},"min":{"1min":0.38800000000000001,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.752,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.51800000000000002,"15min":0.50900000000000001},"min":{"1min":0.38300000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.68400000000000005,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.441}]},{"osd":5,"last update":"Sun Jun 2 04:48:53 2024","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.60999999999999999,"15min":0.60199999999999998},"min":{"1min":0.46100000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.85499999999999998,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.621,"15min":0.59999999999999998},"min":{"1min":0.46500000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.96599999999999997,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.68400000000000005}]},{"osd":6,"last update":"Sun Jun 2 04:49:10 2024","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.58299999999999996,"15min":0.56100000000000005},"min":{"1min":0.441,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.59299999999999997,"15min":0.57699999999999996},"min":{"1min":0.41199999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.79500000000000004,"5min":1.03,"15min":1.03},"last":0.45900000000000002}]},{"osd":7,"last update":"Sun Jun 2 04:49:25 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.54000000000000004,"15min":0.52500000000000002},"min":{"1min":0.41599999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.497},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.57599999999999996,"15min":0.55500000000000005},"min":{"1min":0.40100000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.82199999999999995,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.626}]},{"osd":8,"last update":"Sun Jun 2 04:48:40 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.60599999999999998,"15min":0.60399999999999998},"min":{"1min":0.45100000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.78200000000000003,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71499999999999997,"15min":0.71399999999999997},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.94399999999999995,"5min":1.071,"15min":1.071},"last":0.69299999999999995}]},{"osd":9,"last update":"Sun Jun 2 04:48:58 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.74099999999999999,"15min":0.745},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.62,"5min":0.64200000000000002,"15min":0.64600000000000002},"min":{"1min":0.47699999999999998,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.83999999999999997,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.60199999999999998}]},{"osd":10,"last update":"Sun Jun 2 04:49:16 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.748,"15min":0.75800000000000001},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.93100000000000005,"5min":1.071,"15min":1.071},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.76400000000000001,"15min":0.77000000000000002},"min":{"1min":0.52800000000000002,"5min":0.504,"15min":0.504},"max":{"1min":0.99399999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.73199999999999998}]},{"osd":11,"last update":"Sun Jun 2 04:49:02 2024","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.71099999999999997}]}]},{"osd":5,"up_from":33,"seq":141733920819,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":978944,"data_stored":1053081,"data_compressed":53272,"data_compressed_allocated":69632,"data_compressed_original":638976,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 04:48:50 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.504,"15min":0.48499999999999999},"min":{"1min":0.40200000000000002,"5min":0.249,"15min":0.249},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.47499999999999998,"15min":0.45100000000000001},"min":{"1min":0.374,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.40699999999999997}]},{"osd":1,"last update":"Sun Jun 2 04:48:50 2024","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.55300000000000005,"15min":0.52900000000000003},"min":{"1min":0.5,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.79500000000000004,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.55100000000000005,"15min":0.53500000000000003},"min":{"1min":0.47099999999999997,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.77900000000000003,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.505}]},{"osd":2,"last update":"Sun Jun 2 04:48:50 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.40999999999999998,"15min":0.39500000000000002},"min":{"1min":0.317,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.376},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.40899999999999997,"15min":0.38700000000000001},"min":{"1min":0.316,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.35499999999999998}]},{"osd":3,"last update":"Sun Jun 2 04:48:50 2024","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.53000000000000003,"15min":0.52000000000000002},"min":{"1min":0.38800000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.621,"5min":0.53900000000000003,"15min":0.51200000000000001},"min":{"1min":0.46100000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.80200000000000005,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.47999999999999998}]},{"osd":4,"last update":"Sun Jun 2 04:48:50 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.58199999999999996,"15min":0.55900000000000005},"min":{"1min":0.54200000000000004,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.58999999999999997,"15min":0.57599999999999996},"min":{"1min":0.54300000000000004,"5min":0.313,"15min":0.313},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.52400000000000002}]},{"osd":6,"last update":"Sun Jun 2 04:49:07 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.58899999999999997,"15min":0.57699999999999996},"min":{"1min":0.439,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.60799999999999998,"15min":0.58499999999999996},"min":{"1min":0.52800000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.875,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.57299999999999995}]},{"osd":7,"last update":"Sun Jun 2 04:49:23 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.67000000000000004,"15min":0.65900000000000003},"min":{"1min":0.56799999999999995,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.86199999999999999,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.752,"5min":0.67600000000000005,"15min":0.65400000000000003},"min":{"1min":0.45600000000000002,"5min":0.435,"15min":0.435},"max":{"1min":0.93300000000000005,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.621}]},{"osd":8,"last update":"Sun Jun 2 04:48:43 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.60699999999999998,"15min":0.59099999999999997},"min":{"1min":0.42099999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.623,"15min":0.61599999999999999},"min":{"1min":0.39000000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.90000000000000002,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.60199999999999998}]},{"osd":9,"last update":"Sun Jun 2 04:49:04 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.65700000000000003,"15min":0.64500000000000002},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.69199999999999995,"15min":0.67600000000000005},"min":{"1min":0.60699999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.64200000000000002}]},{"osd":10,"last update":"Sun Jun 2 04:49:18 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.70499999999999996,"15min":0.69899999999999995},"min":{"1min":0.53700000000000003,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.92100000000000004,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.626},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.745,"15min":0.73399999999999999},"min":{"1min":0.66000000000000003,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.95499999999999996,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.67000000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34075,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34075,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34075,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35713,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35713,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35713,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35713,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35713,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":64494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":66810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":67038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-02T04:49:42.341 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-02T04:49:42.499 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.496+0000 7fba07dc6700 1 -- 172.21.15.76:0/4152055242 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fba00101900 msgr2=0x7fba001081b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:42.499 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.496+0000 7fba07dc6700 1 --2- 172.21.15.76:0/4152055242 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fba00101900 0x7fba001081b0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fb9f800b0d0 tx=0x7fb9f800b3e0 comp rx=0 tx=0).stop 2024-06-02T04:49:42.500 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.496+0000 7fba07dc6700 1 -- 172.21.15.76:0/4152055242 shutdown_connections 2024-06-02T04:49:42.500 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.496+0000 7fba07dc6700 1 --2- 172.21.15.76:0/4152055242 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fba00101900 0x7fba001081b0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:42.500 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.496+0000 7fba07dc6700 1 --2- 172.21.15.76:0/4152055242 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba000ffd70 0x7fba00100190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:42.500 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.496+0000 7fba07dc6700 1 --2- 172.21.15.76:0/4152055242 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba00100f60 0x7fba001013c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:42.500 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.496+0000 7fba07dc6700 1 -- 172.21.15.76:0/4152055242 >> 172.21.15.76:0/4152055242 conn(0x7fba000fb2e0 msgr2=0x7fba000fd720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:42.500 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.496+0000 7fba07dc6700 1 -- 172.21.15.76:0/4152055242 shutdown_connections 2024-06-02T04:49:42.500 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.496+0000 7fba07dc6700 1 -- 172.21.15.76:0/4152055242 wait complete. 2024-06-02T04:49:42.500 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.497+0000 7fba07dc6700 1 Processor -- start 2024-06-02T04:49:42.500 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.497+0000 7fba07dc6700 1 -- start start 2024-06-02T04:49:42.500 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.497+0000 7fba07dc6700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba000ffd70 0x7fba00196e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:42.500 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.497+0000 7fba07dc6700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba00100f60 0x7fba00197380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:42.500 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.497+0000 7fba07dc6700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fba00101900 0x7fba0019e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:42.500 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.497+0000 7fba07dc6700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba0019e970 con 0x7fba00101900 2024-06-02T04:49:42.501 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.497+0000 7fba07dc6700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba0019eab0 con 0x7fba000ffd70 2024-06-02T04:49:42.501 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.497+0000 7fba07dc6700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba0019ec40 con 0x7fba00100f60 2024-06-02T04:49:42.501 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.497+0000 7fba06363700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fba00101900 0x7fba0019e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:42.501 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.497+0000 7fba06363700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fba00101900 0x7fba0019e3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:57836/0 (socket says 172.21.15.76:57836) 2024-06-02T04:49:42.501 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.497+0000 7fba06363700 1 -- 172.21.15.76:0/727524367 learned_addr learned my addr 172.21.15.76:0/727524367 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:49:42.501 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.497+0000 7fba05b62700 1 --2- 172.21.15.76:0/727524367 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba000ffd70 0x7fba00196e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:42.501 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.497+0000 7fba05361700 1 --2- 172.21.15.76:0/727524367 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba00100f60 0x7fba00197380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:42.501 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.498+0000 7fba06363700 1 -- 172.21.15.76:0/727524367 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba00100f60 msgr2=0x7fba00197380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:42.501 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.498+0000 7fba06363700 1 --2- 172.21.15.76:0/727524367 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba00100f60 0x7fba00197380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:42.501 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.498+0000 7fba06363700 1 -- 172.21.15.76:0/727524367 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba000ffd70 msgr2=0x7fba00196e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:42.501 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.498+0000 7fba06363700 1 --2- 172.21.15.76:0/727524367 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba000ffd70 0x7fba00196e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:42.501 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.498+0000 7fba06363700 1 -- 172.21.15.76:0/727524367 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9f8009d00 con 0x7fba00101900 2024-06-02T04:49:42.502 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.498+0000 7fba06363700 1 --2- 172.21.15.76:0/727524367 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fba00101900 0x7fba0019e3a0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fb9f8007b60 tx=0x7fb9f80094c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:42.502 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.498+0000 7fb9f6ffd700 1 -- 172.21.15.76:0/727524367 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f800e040 con 0x7fba00101900 2024-06-02T04:49:42.502 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.498+0000 7fb9f6ffd700 1 -- 172.21.15.76:0/727524367 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb9f801dd20 con 0x7fba00101900 2024-06-02T04:49:42.502 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.498+0000 7fba07dc6700 1 -- 172.21.15.76:0/727524367 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba0019eec0 con 0x7fba00101900 2024-06-02T04:49:42.502 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.498+0000 7fb9f6ffd700 1 -- 172.21.15.76:0/727524367 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f8012dc0 con 0x7fba00101900 2024-06-02T04:49:42.502 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.498+0000 7fba07dc6700 1 -- 172.21.15.76:0/727524367 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba0019f2f0 con 0x7fba00101900 2024-06-02T04:49:42.502 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.499+0000 7fba07dc6700 1 -- 172.21.15.76:0/727524367 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba00067380 con 0x7fba00101900 2024-06-02T04:49:42.503 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.500+0000 7fb9f6ffd700 1 -- 172.21.15.76:0/727524367 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fb9f801d890 con 0x7fba00101900 2024-06-02T04:49:42.503 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.501+0000 7fb9f6ffd700 1 --2- 172.21.15.76:0/727524367 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fb9ec0a11a0 0x7fb9ec0a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:42.503 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.501+0000 7fba05b62700 1 --2- 172.21.15.76:0/727524367 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fb9ec0a11a0 0x7fb9ec0a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:42.503 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.501+0000 7fb9f6ffd700 1 -- 172.21.15.76:0/727524367 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fb9f80ce8c0 con 0x7fba00101900 2024-06-02T04:49:42.503 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.501+0000 7fba05b62700 1 --2- 172.21.15.76:0/727524367 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fb9ec0a11a0 0x7fb9ec0a3660 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fba00100dc0 tx=0x7fb9f000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:42.505 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.505+0000 7fb9f6ffd700 1 -- 172.21.15.76:0/727524367 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fb9f8097dd0 con 0x7fba00101900 2024-06-02T04:49:42.704 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.704+0000 7fba07dc6700 1 -- 172.21.15.76:0/727524367 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fba0010b440 con 0x7fba00101900 2024-06-02T04:49:42.706 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.706+0000 7fb9f6ffd700 1 -- 172.21.15.76:0/727524367 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+24453 (secure 0 0 0) 0x7fb9f809b3f0 con 0x7fba00101900 2024-06-02T04:49:42.706 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:49:42.706 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":82,"fsid":"60ab6d30-209a-11ef-bc9b-c7b262605968","created":"2024-06-02T04:42:21.007333+0000","modified":"2024-06-02T04:49:07.862801+0000","last_up_change":"2024-06-02T04:47:29.822242+0000","last_in_change":"2024-06-02T04:47:14.253449+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T04:44:56.408602+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-02T04:48:01.194954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-02T04:48:01.828863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-02T04:48:04.916565+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"33a51ba2-be5c-41d0-b5d1-8d6039f2ca4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6802","nonce":2869602045},{"type":"v1","addr":"172.21.15.76:6803","nonce":2869602045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6804","nonce":2869602045},{"type":"v1","addr":"172.21.15.76:6805","nonce":2869602045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6808","nonce":2869602045},{"type":"v1","addr":"172.21.15.76:6809","nonce":2869602045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6806","nonce":2869602045},{"type":"v1","addr":"172.21.15.76:6807","nonce":2869602045}]},"public_addr":"172.21.15.76:6803/2869602045","cluster_addr":"172.21.15.76:6805/2869602045","heartbeat_back_addr":"172.21.15.76:6809/2869602045","heartbeat_front_addr":"172.21.15.76:6807/2869602045","state":["exists","up"]},{"osd":1,"uuid":"ace46e13-3bb7-4103-973a-6860554df8b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":2353738098},{"type":"v1","addr":"172.21.15.119:6801","nonce":2353738098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":2353738098},{"type":"v1","addr":"172.21.15.119:6803","nonce":2353738098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":2353738098},{"type":"v1","addr":"172.21.15.119:6807","nonce":2353738098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":2353738098},{"type":"v1","addr":"172.21.15.119:6805","nonce":2353738098}]},"public_addr":"172.21.15.119:6801/2353738098","cluster_addr":"172.21.15.119:6803/2353738098","heartbeat_back_addr":"172.21.15.119:6807/2353738098","heartbeat_front_addr":"172.21.15.119:6805/2353738098","state":["exists","up"]},{"osd":2,"uuid":"4addc09e-77a9-428a-bcc4-38194f486cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":3206918546},{"type":"v1","addr":"172.21.15.192:6801","nonce":3206918546}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":3206918546},{"type":"v1","addr":"172.21.15.192:6803","nonce":3206918546}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":3206918546},{"type":"v1","addr":"172.21.15.192:6807","nonce":3206918546}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":3206918546},{"type":"v1","addr":"172.21.15.192:6805","nonce":3206918546}]},"public_addr":"172.21.15.192:6801/3206918546","cluster_addr":"172.21.15.192:6803/3206918546","heartbeat_back_addr":"172.21.15.192:6807/3206918546","heartbeat_front_addr":"172.21.15.192:6805/3206918546","state":["exists","up"]},{"osd":3,"uuid":"dc525518-82c6-49ed-8ca8-e3bd5bfc18d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6810","nonce":3747864233},{"type":"v1","addr":"172.21.15.76:6811","nonce":3747864233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6812","nonce":3747864233},{"type":"v1","addr":"172.21.15.76:6813","nonce":3747864233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6816","nonce":3747864233},{"type":"v1","addr":"172.21.15.76:6817","nonce":3747864233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6814","nonce":3747864233},{"type":"v1","addr":"172.21.15.76:6815","nonce":3747864233}]},"public_addr":"172.21.15.76:6811/3747864233","cluster_addr":"172.21.15.76:6813/3747864233","heartbeat_back_addr":"172.21.15.76:6817/3747864233","heartbeat_front_addr":"172.21.15.76:6815/3747864233","state":["exists","up"]},{"osd":4,"uuid":"eef293d0-cb87-47b3-9751-c6437a1cf079","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":2571629047},{"type":"v1","addr":"172.21.15.119:6809","nonce":2571629047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":2571629047},{"type":"v1","addr":"172.21.15.119:6811","nonce":2571629047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":2571629047},{"type":"v1","addr":"172.21.15.119:6815","nonce":2571629047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":2571629047},{"type":"v1","addr":"172.21.15.119:6813","nonce":2571629047}]},"public_addr":"172.21.15.119:6809/2571629047","cluster_addr":"172.21.15.119:6811/2571629047","heartbeat_back_addr":"172.21.15.119:6815/2571629047","heartbeat_front_addr":"172.21.15.119:6813/2571629047","state":["exists","up"]},{"osd":5,"uuid":"60eb8c6e-766c-49d0-9997-44f85776b3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3285065416},{"type":"v1","addr":"172.21.15.192:6809","nonce":3285065416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":3285065416},{"type":"v1","addr":"172.21.15.192:6811","nonce":3285065416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3285065416},{"type":"v1","addr":"172.21.15.192:6815","nonce":3285065416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":3285065416},{"type":"v1","addr":"172.21.15.192:6813","nonce":3285065416}]},"public_addr":"172.21.15.192:6809/3285065416","cluster_addr":"172.21.15.192:6811/3285065416","heartbeat_back_addr":"172.21.15.192:6815/3285065416","heartbeat_front_addr":"172.21.15.192:6813/3285065416","state":["exists","up"]},{"osd":6,"uuid":"e6dc8b9d-dd06-4870-a506-def8201b7e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6818","nonce":2951381580},{"type":"v1","addr":"172.21.15.76:6819","nonce":2951381580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6820","nonce":2951381580},{"type":"v1","addr":"172.21.15.76:6821","nonce":2951381580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6824","nonce":2951381580},{"type":"v1","addr":"172.21.15.76:6825","nonce":2951381580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6822","nonce":2951381580},{"type":"v1","addr":"172.21.15.76:6823","nonce":2951381580}]},"public_addr":"172.21.15.76:6819/2951381580","cluster_addr":"172.21.15.76:6821/2951381580","heartbeat_back_addr":"172.21.15.76:6825/2951381580","heartbeat_front_addr":"172.21.15.76:6823/2951381580","state":["exists","up"]},{"osd":7,"uuid":"2f5dccb3-39a1-4f25-8715-fa264d59db97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1802558756},{"type":"v1","addr":"172.21.15.119:6817","nonce":1802558756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1802558756},{"type":"v1","addr":"172.21.15.119:6819","nonce":1802558756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1802558756},{"type":"v1","addr":"172.21.15.119:6823","nonce":1802558756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1802558756},{"type":"v1","addr":"172.21.15.119:6821","nonce":1802558756}]},"public_addr":"172.21.15.119:6817/1802558756","cluster_addr":"172.21.15.119:6819/1802558756","heartbeat_back_addr":"172.21.15.119:6823/1802558756","heartbeat_front_addr":"172.21.15.119:6821/1802558756","state":["exists","up"]},{"osd":8,"uuid":"39b6ccd0-16e7-4cd5-87e0-d827e9172984","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":1214972276},{"type":"v1","addr":"172.21.15.192:6817","nonce":1214972276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":1214972276},{"type":"v1","addr":"172.21.15.192:6819","nonce":1214972276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":1214972276},{"type":"v1","addr":"172.21.15.192:6823","nonce":1214972276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":1214972276},{"type":"v1","addr":"172.21.15.192:6821","nonce":1214972276}]},"public_addr":"172.21.15.192:6817/1214972276","cluster_addr":"172.21.15.192:6819/1214972276","heartbeat_back_addr":"172.21.15.192:6823/1214972276","heartbeat_front_addr":"172.21.15.192:6821/1214972276","state":["exists","up"]},{"osd":9,"uuid":"851b2155-07bd-45de-bfe0-53021fda733f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6826","nonce":3095501821},{"type":"v1","addr":"172.21.15.76:6827","nonce":3095501821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6828","nonce":3095501821},{"type":"v1","addr":"172.21.15.76:6829","nonce":3095501821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":3095501821},{"type":"v1","addr":"172.21.15.76:6833","nonce":3095501821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6830","nonce":3095501821},{"type":"v1","addr":"172.21.15.76:6831","nonce":3095501821}]},"public_addr":"172.21.15.76:6827/3095501821","cluster_addr":"172.21.15.76:6829/3095501821","heartbeat_back_addr":"172.21.15.76:6833/3095501821","heartbeat_front_addr":"172.21.15.76:6831/3095501821","state":["exists","up"]},{"osd":10,"uuid":"e4b18e7e-bddf-4dd4-84f6-7902ea327cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":4082130894},{"type":"v1","addr":"172.21.15.119:6825","nonce":4082130894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":4082130894},{"type":"v1","addr":"172.21.15.119:6827","nonce":4082130894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":4082130894},{"type":"v1","addr":"172.21.15.119:6831","nonce":4082130894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":4082130894},{"type":"v1","addr":"172.21.15.119:6829","nonce":4082130894}]},"public_addr":"172.21.15.119:6825/4082130894","cluster_addr":"172.21.15.119:6827/4082130894","heartbeat_back_addr":"172.21.15.119:6831/4082130894","heartbeat_front_addr":"172.21.15.119:6829/4082130894","state":["exists","up"]},{"osd":11,"uuid":"54567e18-920c-4ae9-9557-0efba5a1a820","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":439693921},{"type":"v1","addr":"172.21.15.192:6825","nonce":439693921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":439693921},{"type":"v1","addr":"172.21.15.192:6827","nonce":439693921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":439693921},{"type":"v1","addr":"172.21.15.192:6831","nonce":439693921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":439693921},{"type":"v1","addr":"172.21.15.192:6829","nonce":439693921}]},"public_addr":"172.21.15.192:6825/439693921","cluster_addr":"172.21.15.192:6827/439693921","heartbeat_back_addr":"172.21.15.192:6831/439693921","heartbeat_front_addr":"172.21.15.192:6829/439693921","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:44:19.922390+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:44:36.895563+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:44:53.699019+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:45:11.167404+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:45:27.955899+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:45:44.850368+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:46:02.003588+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:46:19.019217+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:46:36.189670+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:46:53.919365+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:47:11.563053+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:47:28.822443+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":4}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.8","mappings":[{"from":5,"to":10}]},{"pgid":"4.14","mappings":[{"from":9,"to":8}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.76:6801/4200406736":"2024-06-03T04:43:06.092916+0000","172.21.15.76:6800/4200406736":"2024-06-03T04:43:06.092916+0000","172.21.15.76:0/1524144593":"2024-06-03T04:43:06.092916+0000","172.21.15.76:0/3269372590":"2024-06-03T04:43:06.092916+0000","172.21.15.76:0/3570893846":"2024-06-03T04:42:44.872236+0000","172.21.15.76:0/902035790":"2024-06-03T04:43:06.092916+0000","172.21.15.76:6800/2550846765":"2024-06-03T04:42:44.872236+0000","172.21.15.76:6801/2550846765":"2024-06-03T04:42:44.872236+0000","172.21.15.76:0/2646712763":"2024-06-03T04:42:44.872236+0000","172.21.15.76:0/964578813":"2024-06-03T04:42:44.872236+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T04:49:42.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.708+0000 7fba07dc6700 1 -- 172.21.15.76:0/727524367 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fb9ec0a11a0 msgr2=0x7fb9ec0a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:42.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.708+0000 7fba07dc6700 1 --2- 172.21.15.76:0/727524367 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fb9ec0a11a0 0x7fb9ec0a3660 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fba00100dc0 tx=0x7fb9f000b410 comp rx=0 tx=0).stop 2024-06-02T04:49:42.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.708+0000 7fba07dc6700 1 -- 172.21.15.76:0/727524367 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fba00101900 msgr2=0x7fba0019e3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:42.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.708+0000 7fba07dc6700 1 --2- 172.21.15.76:0/727524367 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fba00101900 0x7fba0019e3a0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fb9f8007b60 tx=0x7fb9f80094c0 comp rx=0 tx=0).stop 2024-06-02T04:49:42.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.708+0000 7fba07dc6700 1 -- 172.21.15.76:0/727524367 shutdown_connections 2024-06-02T04:49:42.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.708+0000 7fba07dc6700 1 --2- 172.21.15.76:0/727524367 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fba00101900 0x7fba0019e3a0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:42.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.708+0000 7fba07dc6700 1 --2- 172.21.15.76:0/727524367 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fb9ec0a11a0 0x7fb9ec0a3660 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:42.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.708+0000 7fba07dc6700 1 --2- 172.21.15.76:0/727524367 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba000ffd70 0x7fba00196e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:42.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.708+0000 7fba07dc6700 1 --2- 172.21.15.76:0/727524367 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba00100f60 0x7fba00197380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:42.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.708+0000 7fba07dc6700 1 -- 172.21.15.76:0/727524367 >> 172.21.15.76:0/727524367 conn(0x7fba000fb2e0 msgr2=0x7fba000692c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:42.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.708+0000 7fba07dc6700 1 -- 172.21.15.76:0/727524367 shutdown_connections 2024-06-02T04:49:42.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.708+0000 7fba07dc6700 1 -- 172.21.15.76:0/727524367 wait complete. 2024-06-02T04:49:42.722 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-06-02T04:44:56.408602+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-06-02T04:48:01.194954+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-06-02T04:48:01.828863+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '76', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-06-02T04:48:04.916565+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-06-02T04:49:42.722 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-06-02T04:49:42.850 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.848+0000 7f109159d700 1 -- 172.21.15.76:0/2963865242 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f108c101870 msgr2=0x7f108c108120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:42.851 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.848+0000 7f109159d700 1 --2- 172.21.15.76:0/2963865242 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f108c101870 0x7f108c108120 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f108400b0d0 tx=0x7f108400b3e0 comp rx=0 tx=0).stop 2024-06-02T04:49:42.851 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.848+0000 7f109159d700 1 -- 172.21.15.76:0/2963865242 shutdown_connections 2024-06-02T04:49:42.851 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.848+0000 7f109159d700 1 --2- 172.21.15.76:0/2963865242 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f108c101870 0x7f108c108120 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:42.851 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.848+0000 7f109159d700 1 --2- 172.21.15.76:0/2963865242 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f108c0ffce0 0x7f108c100100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:42.851 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.848+0000 7f109159d700 1 --2- 172.21.15.76:0/2963865242 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f108c100ed0 0x7f108c101330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:42.851 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.848+0000 7f109159d700 1 -- 172.21.15.76:0/2963865242 >> 172.21.15.76:0/2963865242 conn(0x7f108c0fb250 msgr2=0x7f108c0fd690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:42.851 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.848+0000 7f109159d700 1 -- 172.21.15.76:0/2963865242 shutdown_connections 2024-06-02T04:49:42.851 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.848+0000 7f109159d700 1 -- 172.21.15.76:0/2963865242 wait complete. 2024-06-02T04:49:42.851 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.848+0000 7f109159d700 1 Processor -- start 2024-06-02T04:49:42.852 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.848+0000 7f109159d700 1 -- start start 2024-06-02T04:49:42.852 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.849+0000 7f109159d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f108c0ffce0 0x7f108c198f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:42.852 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.849+0000 7f109159d700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f108c100ed0 0x7f108c1994b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:42.852 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.849+0000 7f109159d700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f108c101870 0x7f108c1a04d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:42.852 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.849+0000 7f109159d700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f108c1a0aa0 con 0x7f108c100ed0 2024-06-02T04:49:42.852 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.849+0000 7f109159d700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f108c1a0be0 con 0x7f108c101870 2024-06-02T04:49:42.852 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.849+0000 7f109159d700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f108c1a0d70 con 0x7f108c0ffce0 2024-06-02T04:49:42.852 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.849+0000 7f108b7fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f108c100ed0 0x7f108c1994b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:42.852 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.849+0000 7f108b7fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f108c100ed0 0x7f108c1994b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:57846/0 (socket says 172.21.15.76:57846) 2024-06-02T04:49:42.852 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.849+0000 7f108b7fe700 1 -- 172.21.15.76:0/3843974901 learned_addr learned my addr 172.21.15.76:0/3843974901 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:49:42.852 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.849+0000 7f1090d9c700 1 --2- 172.21.15.76:0/3843974901 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f108c101870 0x7f108c1a04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:42.852 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.849+0000 7f108bfff700 1 --2- 172.21.15.76:0/3843974901 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f108c0ffce0 0x7f108c198f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:42.853 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.849+0000 7f108b7fe700 1 -- 172.21.15.76:0/3843974901 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f108c0ffce0 msgr2=0x7f108c198f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:42.853 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.849+0000 7f108b7fe700 1 --2- 172.21.15.76:0/3843974901 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f108c0ffce0 0x7f108c198f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:42.853 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.849+0000 7f108b7fe700 1 -- 172.21.15.76:0/3843974901 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f108c101870 msgr2=0x7f108c1a04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:42.853 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.849+0000 7f108b7fe700 1 --2- 172.21.15.76:0/3843974901 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f108c101870 0x7f108c1a04d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:42.853 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.849+0000 7f108b7fe700 1 -- 172.21.15.76:0/3843974901 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1084009d00 con 0x7f108c100ed0 2024-06-02T04:49:42.853 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.849+0000 7f1090d9c700 1 --2- 172.21.15.76:0/3843974901 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f108c101870 0x7f108c1a04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T04:49:42.853 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.849+0000 7f108b7fe700 1 --2- 172.21.15.76:0/3843974901 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f108c100ed0 0x7f108c1994b0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f107c00e9a0 tx=0x7f107c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:42.853 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.849+0000 7f10897fa700 1 -- 172.21.15.76:0/3843974901 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f107c009790 con 0x7f108c100ed0 2024-06-02T04:49:42.853 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.850+0000 7f10897fa700 1 -- 172.21.15.76:0/3843974901 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f107c010430 con 0x7f108c100ed0 2024-06-02T04:49:42.853 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.850+0000 7f109159d700 1 -- 172.21.15.76:0/3843974901 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f108c1a0ff0 con 0x7f108c100ed0 2024-06-02T04:49:42.853 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.850+0000 7f10897fa700 1 -- 172.21.15.76:0/3843974901 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f107c00cea0 con 0x7f108c100ed0 2024-06-02T04:49:42.854 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.850+0000 7f109159d700 1 -- 172.21.15.76:0/3843974901 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f108c1a1520 con 0x7f108c100ed0 2024-06-02T04:49:42.854 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.850+0000 7f109159d700 1 -- 172.21.15.76:0/3843974901 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f108c067310 con 0x7f108c100ed0 2024-06-02T04:49:42.855 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.852+0000 7f10897fa700 1 -- 172.21.15.76:0/3843974901 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f107c0105a0 con 0x7f108c100ed0 2024-06-02T04:49:42.855 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.852+0000 7f10897fa700 1 --2- 172.21.15.76:0/3843974901 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f10740a1220 0x7f10740a36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:42.855 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.853+0000 7f108bfff700 1 --2- 172.21.15.76:0/3843974901 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f10740a1220 0x7f10740a36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:42.855 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.853+0000 7f10897fa700 1 -- 172.21.15.76:0/3843974901 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f107c014070 con 0x7f108c100ed0 2024-06-02T04:49:42.855 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.853+0000 7f108bfff700 1 --2- 172.21.15.76:0/3843974901 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f10740a1220 0x7f10740a36e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f108c100d30 tx=0x7f108000a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:42.855 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:42.855+0000 7f10897fa700 1 -- 172.21.15.76:0/3843974901 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f107c0969f0 con 0x7f108c100ed0 2024-06-02T04:49:43.055 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.054+0000 7f109159d700 1 -- 172.21.15.76:0/3843974901 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f108c10b4f0 con 0x7f108c100ed0 2024-06-02T04:49:43.055 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.055+0000 7f10897fa700 1 -- 172.21.15.76:0/3843974901 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) v1 ==== 93+0+10 (secure 0 0 0) 0x7f107c09a010 con 0x7f108c100ed0 2024-06-02T04:49:43.055 INFO:teuthology.orchestra.run.smithi076.stdout:pg_num: 1 2024-06-02T04:49:43.057 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.057+0000 7f109159d700 1 -- 172.21.15.76:0/3843974901 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f10740a1220 msgr2=0x7f10740a36e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:43.057 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.057+0000 7f109159d700 1 --2- 172.21.15.76:0/3843974901 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f10740a1220 0x7f10740a36e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f108c100d30 tx=0x7f108000a380 comp rx=0 tx=0).stop 2024-06-02T04:49:43.057 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.057+0000 7f109159d700 1 -- 172.21.15.76:0/3843974901 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f108c100ed0 msgr2=0x7f108c1994b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:43.057 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.057+0000 7f109159d700 1 --2- 172.21.15.76:0/3843974901 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f108c100ed0 0x7f108c1994b0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f107c00e9a0 tx=0x7f107c00ecb0 comp rx=0 tx=0).stop 2024-06-02T04:49:43.057 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.057+0000 7f109159d700 1 -- 172.21.15.76:0/3843974901 shutdown_connections 2024-06-02T04:49:43.058 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.057+0000 7f109159d700 1 --2- 172.21.15.76:0/3843974901 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f10740a1220 0x7f10740a36e0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:43.058 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.057+0000 7f109159d700 1 --2- 172.21.15.76:0/3843974901 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f108c101870 0x7f108c1a04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:43.058 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.057+0000 7f109159d700 1 --2- 172.21.15.76:0/3843974901 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f108c0ffce0 0x7f108c198f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:43.058 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.057+0000 7f109159d700 1 --2- 172.21.15.76:0/3843974901 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f108c100ed0 0x7f108c1994b0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:43.058 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.057+0000 7f109159d700 1 -- 172.21.15.76:0/3843974901 >> 172.21.15.76:0/3843974901 conn(0x7f108c0fb250 msgr2=0x7f108c069050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:43.058 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.057+0000 7f109159d700 1 -- 172.21.15.76:0/3843974901 shutdown_connections 2024-06-02T04:49:43.058 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.057+0000 7f109159d700 1 -- 172.21.15.76:0/3843974901 wait complete. 2024-06-02T04:49:43.069 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-06-02T04:49:43.195 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.194+0000 7f5d3ca4c700 1 -- 172.21.15.76:0/2810021726 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5d380ffd90 msgr2=0x7f5d381001b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:43.195 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.194+0000 7f5d3ca4c700 1 --2- 172.21.15.76:0/2810021726 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5d380ffd90 0x7f5d381001b0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f5d2c0099c0 tx=0x7f5d2c009cd0 comp rx=0 tx=0).stop 2024-06-02T04:49:43.195 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.194+0000 7f5d3ca4c700 1 -- 172.21.15.76:0/2810021726 shutdown_connections 2024-06-02T04:49:43.195 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.194+0000 7f5d3ca4c700 1 --2- 172.21.15.76:0/2810021726 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5d38101920 0x7f5d381081d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:43.195 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.194+0000 7f5d3ca4c700 1 --2- 172.21.15.76:0/2810021726 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5d380ffd90 0x7f5d381001b0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:43.195 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.194+0000 7f5d3ca4c700 1 --2- 172.21.15.76:0/2810021726 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5d38100f80 0x7f5d381013e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:43.195 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.194+0000 7f5d3ca4c700 1 -- 172.21.15.76:0/2810021726 >> 172.21.15.76:0/2810021726 conn(0x7f5d380fb300 msgr2=0x7f5d380fd740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:43.195 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.194+0000 7f5d3ca4c700 1 -- 172.21.15.76:0/2810021726 shutdown_connections 2024-06-02T04:49:43.195 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.194+0000 7f5d3ca4c700 1 -- 172.21.15.76:0/2810021726 wait complete. 2024-06-02T04:49:43.197 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.195+0000 7f5d3ca4c700 1 Processor -- start 2024-06-02T04:49:43.198 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.195+0000 7f5d3ca4c700 1 -- start start 2024-06-02T04:49:43.198 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.195+0000 7f5d3ca4c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5d380ffd90 0x7f5d38195c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:43.198 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.195+0000 7f5d3ca4c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5d38100f80 0x7f5d38196140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:43.198 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.195+0000 7f5d3ca4c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5d38101920 0x7f5d3819d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:43.198 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.195+0000 7f5d3ca4c700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d3819d730 con 0x7f5d380ffd90 2024-06-02T04:49:43.198 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.195+0000 7f5d3ca4c700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d3819d870 con 0x7f5d38101920 2024-06-02T04:49:43.198 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.195+0000 7f5d3ca4c700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d3819da00 con 0x7f5d38100f80 2024-06-02T04:49:43.198 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.195+0000 7f5d3659c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5d380ffd90 0x7f5d38195c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:43.198 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.195+0000 7f5d3659c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5d380ffd90 0x7f5d38195c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:57850/0 (socket says 172.21.15.76:57850) 2024-06-02T04:49:43.198 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.195+0000 7f5d3659c700 1 -- 172.21.15.76:0/2228415803 learned_addr learned my addr 172.21.15.76:0/2228415803 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:49:43.198 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.195+0000 7f5d36d9d700 1 --2- 172.21.15.76:0/2228415803 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5d38101920 0x7f5d3819d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:43.198 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.195+0000 7f5d35d9b700 1 --2- 172.21.15.76:0/2228415803 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5d38100f80 0x7f5d38196140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:43.199 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.195+0000 7f5d3659c700 1 -- 172.21.15.76:0/2228415803 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5d38100f80 msgr2=0x7f5d38196140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:43.199 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.195+0000 7f5d3659c700 1 --2- 172.21.15.76:0/2228415803 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5d38100f80 0x7f5d38196140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:43.199 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.195+0000 7f5d3659c700 1 -- 172.21.15.76:0/2228415803 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5d38101920 msgr2=0x7f5d3819d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:43.199 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.195+0000 7f5d3659c700 1 --2- 172.21.15.76:0/2228415803 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5d38101920 0x7f5d3819d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:43.199 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.195+0000 7f5d3659c700 1 -- 172.21.15.76:0/2228415803 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d2c0095f0 con 0x7f5d380ffd90 2024-06-02T04:49:43.199 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.196+0000 7f5d3659c700 1 --2- 172.21.15.76:0/2228415803 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5d380ffd90 0x7f5d38195c00 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f5d2c000c00 tx=0x7f5d2c00fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:43.199 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.196+0000 7f5d277fe700 1 -- 172.21.15.76:0/2228415803 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d2c01d070 con 0x7f5d380ffd90 2024-06-02T04:49:43.199 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.196+0000 7f5d3ca4c700 1 -- 172.21.15.76:0/2228415803 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d3819dc80 con 0x7f5d380ffd90 2024-06-02T04:49:43.199 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.196+0000 7f5d277fe700 1 -- 172.21.15.76:0/2228415803 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5d2c00bd30 con 0x7f5d380ffd90 2024-06-02T04:49:43.199 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.196+0000 7f5d277fe700 1 -- 172.21.15.76:0/2228415803 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d2c0173f0 con 0x7f5d380ffd90 2024-06-02T04:49:43.199 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.196+0000 7f5d3ca4c700 1 -- 172.21.15.76:0/2228415803 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d3819e0a0 con 0x7f5d380ffd90 2024-06-02T04:49:43.199 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.197+0000 7f5d3ca4c700 1 -- 172.21.15.76:0/2228415803 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d38107260 con 0x7f5d380ffd90 2024-06-02T04:49:43.200 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.198+0000 7f5d277fe700 1 -- 172.21.15.76:0/2228415803 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f5d2c022470 con 0x7f5d380ffd90 2024-06-02T04:49:43.200 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.199+0000 7f5d277fe700 1 --2- 172.21.15.76:0/2228415803 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f5d200a1110 0x7f5d200a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:43.200 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.199+0000 7f5d35d9b700 1 --2- 172.21.15.76:0/2228415803 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f5d200a1110 0x7f5d200a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:43.200 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.199+0000 7f5d277fe700 1 -- 172.21.15.76:0/2228415803 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f5d2c0ce220 con 0x7f5d380ffd90 2024-06-02T04:49:43.200 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.199+0000 7f5d35d9b700 1 --2- 172.21.15.76:0/2228415803 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f5d200a1110 0x7f5d200a35d0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f5d28009c60 tx=0x7f5d28009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:43.202 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.202+0000 7f5d277fe700 1 -- 172.21.15.76:0/2228415803 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f5d2c097730 con 0x7f5d380ffd90 2024-06-02T04:49:43.401 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.400+0000 7f5d3ca4c700 1 -- 172.21.15.76:0/2228415803 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5d3810b450 con 0x7f5d380ffd90 2024-06-02T04:49:43.401 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.401+0000 7f5d277fe700 1 -- 172.21.15.76:0/2228415803 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v82) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5d2c09ad50 con 0x7f5d380ffd90 2024-06-02T04:49:43.401 INFO:teuthology.orchestra.run.smithi076.stdout:pg_num: 32 2024-06-02T04:49:43.404 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.403+0000 7f5d3ca4c700 1 -- 172.21.15.76:0/2228415803 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f5d200a1110 msgr2=0x7f5d200a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:43.404 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.403+0000 7f5d3ca4c700 1 --2- 172.21.15.76:0/2228415803 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f5d200a1110 0x7f5d200a35d0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f5d28009c60 tx=0x7f5d28009260 comp rx=0 tx=0).stop 2024-06-02T04:49:43.404 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.403+0000 7f5d3ca4c700 1 -- 172.21.15.76:0/2228415803 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5d380ffd90 msgr2=0x7f5d38195c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:43.404 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.403+0000 7f5d3ca4c700 1 --2- 172.21.15.76:0/2228415803 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5d380ffd90 0x7f5d38195c00 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f5d2c000c00 tx=0x7f5d2c00fa00 comp rx=0 tx=0).stop 2024-06-02T04:49:43.404 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.403+0000 7f5d3ca4c700 1 -- 172.21.15.76:0/2228415803 shutdown_connections 2024-06-02T04:49:43.404 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.403+0000 7f5d3ca4c700 1 --2- 172.21.15.76:0/2228415803 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f5d200a1110 0x7f5d200a35d0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:43.404 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.403+0000 7f5d3ca4c700 1 --2- 172.21.15.76:0/2228415803 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5d38101920 0x7f5d3819d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:43.404 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.403+0000 7f5d3ca4c700 1 --2- 172.21.15.76:0/2228415803 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5d380ffd90 0x7f5d38195c00 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:43.404 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.403+0000 7f5d3ca4c700 1 --2- 172.21.15.76:0/2228415803 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5d38100f80 0x7f5d38196140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:43.404 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.403+0000 7f5d3ca4c700 1 -- 172.21.15.76:0/2228415803 >> 172.21.15.76:0/2228415803 conn(0x7f5d380fb300 msgr2=0x7f5d381043a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:43.404 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.403+0000 7f5d3ca4c700 1 -- 172.21.15.76:0/2228415803 shutdown_connections 2024-06-02T04:49:43.404 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.403+0000 7f5d3ca4c700 1 -- 172.21.15.76:0/2228415803 wait complete. 2024-06-02T04:49:43.414 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:43 smithi076 ceph-mon[42935]: from='client.15507 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-02T04:49:43.415 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:43 smithi076 ceph-mon[42935]: from='client.15513 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-02T04:49:43.415 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:43 smithi076 ceph-mon[42935]: pgmap v270: 129 pgs: 129 active+clean; 645 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.4 KiB/s wr, 7 op/s 2024-06-02T04:49:43.415 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:43 smithi076 ceph-mon[42935]: from='client.15519 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-02T04:49:43.415 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:43 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/727524367' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:49:43.415 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:43 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/3843974901' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-02T04:49:43.416 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-06-02T04:49:43.543 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.541+0000 7fb90f61c700 1 -- 172.21.15.76:0/587367070 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb9081021f0 msgr2=0x7fb908102650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:43.543 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.541+0000 7fb90f61c700 1 --2- 172.21.15.76:0/587367070 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb9081021f0 0x7fb908102650 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fb904009990 tx=0x7fb904009ca0 comp rx=0 tx=0).stop 2024-06-02T04:49:43.544 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.541+0000 7fb90f61c700 1 -- 172.21.15.76:0/587367070 shutdown_connections 2024-06-02T04:49:43.544 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.541+0000 7fb90f61c700 1 --2- 172.21.15.76:0/587367070 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb908102b90 0x7fb908109440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:43.544 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.541+0000 7fb90f61c700 1 --2- 172.21.15.76:0/587367070 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb9080ff220 0x7fb9080ff640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:43.544 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.541+0000 7fb90f61c700 1 --2- 172.21.15.76:0/587367070 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb9081021f0 0x7fb908102650 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:43.544 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.541+0000 7fb90f61c700 1 -- 172.21.15.76:0/587367070 >> 172.21.15.76:0/587367070 conn(0x7fb9080fab50 msgr2=0x7fb9080fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:43.544 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.541+0000 7fb90f61c700 1 -- 172.21.15.76:0/587367070 shutdown_connections 2024-06-02T04:49:43.544 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.541+0000 7fb90f61c700 1 -- 172.21.15.76:0/587367070 wait complete. 2024-06-02T04:49:43.544 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.542+0000 7fb90f61c700 1 Processor -- start 2024-06-02T04:49:43.544 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.542+0000 7fb90f61c700 1 -- start start 2024-06-02T04:49:43.544 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.542+0000 7fb90f61c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb9080ff220 0x7fb9081990b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:43.544 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.542+0000 7fb90f61c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb9081021f0 0x7fb9081995f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:43.544 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.542+0000 7fb90f61c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb908102b90 0x7fb9081a0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:43.544 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.542+0000 7fb90f61c700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9081a0be0 con 0x7fb908102b90 2024-06-02T04:49:43.545 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.542+0000 7fb90f61c700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9081a0d20 con 0x7fb9080ff220 2024-06-02T04:49:43.545 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.542+0000 7fb90f61c700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9081a0eb0 con 0x7fb9081021f0 2024-06-02T04:49:43.545 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.542+0000 7fb90dbb9700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb908102b90 0x7fb9081a0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:43.545 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.542+0000 7fb90dbb9700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb908102b90 0x7fb9081a0610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:57866/0 (socket says 172.21.15.76:57866) 2024-06-02T04:49:43.545 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.542+0000 7fb90dbb9700 1 -- 172.21.15.76:0/2901751744 learned_addr learned my addr 172.21.15.76:0/2901751744 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:49:43.545 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.542+0000 7fb90cbb7700 1 --2- 172.21.15.76:0/2901751744 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb9081021f0 0x7fb9081995f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:43.545 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.542+0000 7fb90d3b8700 1 --2- 172.21.15.76:0/2901751744 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb9080ff220 0x7fb9081990b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:43.545 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.543+0000 7fb90dbb9700 1 -- 172.21.15.76:0/2901751744 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb9081021f0 msgr2=0x7fb9081995f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:43.545 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.543+0000 7fb90dbb9700 1 --2- 172.21.15.76:0/2901751744 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb9081021f0 0x7fb9081995f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:43.545 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.543+0000 7fb90dbb9700 1 -- 172.21.15.76:0/2901751744 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb9080ff220 msgr2=0x7fb9081990b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:43.545 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.543+0000 7fb90dbb9700 1 --2- 172.21.15.76:0/2901751744 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb9080ff220 0x7fb9081990b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:43.545 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.543+0000 7fb90dbb9700 1 -- 172.21.15.76:0/2901751744 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9040095f0 con 0x7fb908102b90 2024-06-02T04:49:43.545 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.543+0000 7fb90cbb7700 1 --2- 172.21.15.76:0/2901751744 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb9081021f0 0x7fb9081995f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:49:43.545 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.543+0000 7fb90dbb9700 1 --2- 172.21.15.76:0/2901751744 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb908102b90 0x7fb9081a0610 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fb900007ee0 tx=0x7fb90000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:43.546 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.543+0000 7fb8fa7fc700 1 -- 172.21.15.76:0/2901751744 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb900017070 con 0x7fb908102b90 2024-06-02T04:49:43.546 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.543+0000 7fb8fa7fc700 1 -- 172.21.15.76:0/2901751744 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb90000f040 con 0x7fb908102b90 2024-06-02T04:49:43.546 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.543+0000 7fb90f61c700 1 -- 172.21.15.76:0/2901751744 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9081a1190 con 0x7fb908102b90 2024-06-02T04:49:43.546 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.543+0000 7fb8fa7fc700 1 -- 172.21.15.76:0/2901751744 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb900005710 con 0x7fb908102b90 2024-06-02T04:49:43.546 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.543+0000 7fb90f61c700 1 -- 172.21.15.76:0/2901751744 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9081a16a0 con 0x7fb908102b90 2024-06-02T04:49:43.547 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.544+0000 7fb90f61c700 1 -- 172.21.15.76:0/2901751744 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb908067460 con 0x7fb908102b90 2024-06-02T04:49:43.547 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.545+0000 7fb8fa7fc700 1 -- 172.21.15.76:0/2901751744 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fb900005870 con 0x7fb908102b90 2024-06-02T04:49:43.547 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.545+0000 7fb8fa7fc700 1 --2- 172.21.15.76:0/2901751744 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fb8f40a11a0 0x7fb8f40a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:43.547 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.546+0000 7fb90d3b8700 1 --2- 172.21.15.76:0/2901751744 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fb8f40a11a0 0x7fb8f40a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:43.547 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.546+0000 7fb8fa7fc700 1 -- 172.21.15.76:0/2901751744 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fb9000ccab0 con 0x7fb908102b90 2024-06-02T04:49:43.547 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.546+0000 7fb90d3b8700 1 --2- 172.21.15.76:0/2901751744 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fb8f40a11a0 0x7fb8f40a3660 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fb8fc006fd0 tx=0x7fb8fc008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:43.549 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.549+0000 7fb8fa7fc700 1 -- 172.21.15.76:0/2901751744 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fb900095f30 con 0x7fb908102b90 2024-06-02T04:49:43.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:43 smithi119 ceph-mon[46633]: from='client.15507 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-02T04:49:43.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:43 smithi119 ceph-mon[46633]: from='client.15513 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-02T04:49:43.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:43 smithi119 ceph-mon[46633]: pgmap v270: 129 pgs: 129 active+clean; 645 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.4 KiB/s wr, 7 op/s 2024-06-02T04:49:43.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:43 smithi119 ceph-mon[46633]: from='client.15519 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-02T04:49:43.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:43 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/727524367' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:49:43.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:43 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/3843974901' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-02T04:49:43.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:43 smithi192 ceph-mon[47933]: from='client.15507 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-02T04:49:43.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:43 smithi192 ceph-mon[47933]: from='client.15513 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-02T04:49:43.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:43 smithi192 ceph-mon[47933]: pgmap v270: 129 pgs: 129 active+clean; 645 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.4 KiB/s wr, 7 op/s 2024-06-02T04:49:43.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:43 smithi192 ceph-mon[47933]: from='client.15519 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-02T04:49:43.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:43 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/727524367' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:49:43.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:43 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/3843974901' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-02T04:49:43.746 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.746+0000 7fb90f61c700 1 -- 172.21.15.76:0/2901751744 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb90810c6b0 con 0x7fb908102b90 2024-06-02T04:49:43.746 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.746+0000 7fb8fa7fc700 1 -- 172.21.15.76:0/2901751744 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v82) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb900099550 con 0x7fb908102b90 2024-06-02T04:49:43.746 INFO:teuthology.orchestra.run.smithi076.stdout:pg_num: 64 2024-06-02T04:49:43.749 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.748+0000 7fb90f61c700 1 -- 172.21.15.76:0/2901751744 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fb8f40a11a0 msgr2=0x7fb8f40a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:43.749 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.748+0000 7fb90f61c700 1 --2- 172.21.15.76:0/2901751744 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fb8f40a11a0 0x7fb8f40a3660 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fb8fc006fd0 tx=0x7fb8fc008040 comp rx=0 tx=0).stop 2024-06-02T04:49:43.749 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.748+0000 7fb90f61c700 1 -- 172.21.15.76:0/2901751744 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb908102b90 msgr2=0x7fb9081a0610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:43.749 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.748+0000 7fb90f61c700 1 --2- 172.21.15.76:0/2901751744 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb908102b90 0x7fb9081a0610 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fb900007ee0 tx=0x7fb90000d3b0 comp rx=0 tx=0).stop 2024-06-02T04:49:43.749 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.748+0000 7fb90f61c700 1 -- 172.21.15.76:0/2901751744 shutdown_connections 2024-06-02T04:49:43.749 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.748+0000 7fb90f61c700 1 --2- 172.21.15.76:0/2901751744 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb908102b90 0x7fb9081a0610 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:43.749 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.748+0000 7fb90f61c700 1 --2- 172.21.15.76:0/2901751744 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fb8f40a11a0 0x7fb8f40a3660 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:43.749 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.748+0000 7fb90f61c700 1 --2- 172.21.15.76:0/2901751744 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb9080ff220 0x7fb9081990b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:43.749 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.748+0000 7fb90f61c700 1 --2- 172.21.15.76:0/2901751744 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb9081021f0 0x7fb9081995f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:43.749 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.748+0000 7fb90f61c700 1 -- 172.21.15.76:0/2901751744 >> 172.21.15.76:0/2901751744 conn(0x7fb9080fab50 msgr2=0x7fb9081079c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:43.749 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.748+0000 7fb90f61c700 1 -- 172.21.15.76:0/2901751744 shutdown_connections 2024-06-02T04:49:43.750 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.748+0000 7fb90f61c700 1 -- 172.21.15.76:0/2901751744 wait complete. 2024-06-02T04:49:43.761 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-06-02T04:49:43.888 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.885+0000 7f2ecf030700 1 -- 172.21.15.76:0/959939599 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2ec80ffe70 msgr2=0x7f2ec8100290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:43.888 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.885+0000 7f2ecf030700 1 --2- 172.21.15.76:0/959939599 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2ec80ffe70 0x7f2ec8100290 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc009990 tx=0x7f2ebc009ca0 comp rx=0 tx=0).stop 2024-06-02T04:49:43.888 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.885+0000 7f2ecf030700 1 -- 172.21.15.76:0/959939599 shutdown_connections 2024-06-02T04:49:43.888 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.885+0000 7f2ecf030700 1 --2- 172.21.15.76:0/959939599 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2ec8101980 0x7f2ec81082a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:43.888 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.886+0000 7f2ecf030700 1 --2- 172.21.15.76:0/959939599 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2ec80ffe70 0x7f2ec8100290 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:43.889 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.886+0000 7f2ecf030700 1 --2- 172.21.15.76:0/959939599 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2ec8100fc0 0x7f2ec8101440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:43.889 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.886+0000 7f2ecf030700 1 -- 172.21.15.76:0/959939599 >> 172.21.15.76:0/959939599 conn(0x7f2ec80fb400 msgr2=0x7f2ec80fd820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:43.889 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.886+0000 7f2ecf030700 1 -- 172.21.15.76:0/959939599 shutdown_connections 2024-06-02T04:49:43.889 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.886+0000 7f2ecf030700 1 -- 172.21.15.76:0/959939599 wait complete. 2024-06-02T04:49:43.889 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.886+0000 7f2ecf030700 1 Processor -- start 2024-06-02T04:49:43.889 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.886+0000 7f2ecf030700 1 -- start start 2024-06-02T04:49:43.889 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.886+0000 7f2ecf030700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2ec80ffe70 0x7f2ec8195d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:43.889 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.886+0000 7f2ecf030700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2ec8100fc0 0x7f2ec81962d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:43.889 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.886+0000 7f2ecf030700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2ec8101980 0x7f2ec819d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:43.889 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.886+0000 7f2ecf030700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec819d880 con 0x7f2ec80ffe70 2024-06-02T04:49:43.889 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.886+0000 7f2ecf030700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec819d9f0 con 0x7f2ec8100fc0 2024-06-02T04:49:43.889 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.886+0000 7f2ecf030700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec819dbb0 con 0x7f2ec8101980 2024-06-02T04:49:43.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.886+0000 7f2eccdcc700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2ec80ffe70 0x7f2ec8195d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:43.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.886+0000 7f2eccdcc700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2ec80ffe70 0x7f2ec8195d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:57896/0 (socket says 172.21.15.76:57896) 2024-06-02T04:49:43.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.886+0000 7f2eccdcc700 1 -- 172.21.15.76:0/932250093 learned_addr learned my addr 172.21.15.76:0/932250093 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:49:43.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.887+0000 7f2ecd5cd700 1 --2- 172.21.15.76:0/932250093 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2ec8101980 0x7f2ec819d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:43.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.887+0000 7f2ec7fff700 1 --2- 172.21.15.76:0/932250093 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2ec8100fc0 0x7f2ec81962d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:43.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.887+0000 7f2eccdcc700 1 -- 172.21.15.76:0/932250093 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2ec8101980 msgr2=0x7f2ec819d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:43.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.887+0000 7f2eccdcc700 1 --2- 172.21.15.76:0/932250093 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2ec8101980 0x7f2ec819d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:43.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.887+0000 7f2eccdcc700 1 -- 172.21.15.76:0/932250093 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2ec8100fc0 msgr2=0x7f2ec81962d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:43.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.887+0000 7f2eccdcc700 1 --2- 172.21.15.76:0/932250093 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2ec8100fc0 0x7f2ec81962d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:43.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.887+0000 7f2eccdcc700 1 -- 172.21.15.76:0/932250093 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ebc0095f0 con 0x7f2ec80ffe70 2024-06-02T04:49:43.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.887+0000 7f2ecd5cd700 1 --2- 172.21.15.76:0/932250093 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2ec8101980 0x7f2ec819d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:49:43.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.887+0000 7f2ec7fff700 1 --2- 172.21.15.76:0/932250093 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2ec8100fc0 0x7f2ec81962d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:49:43.891 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.887+0000 7f2eccdcc700 1 --2- 172.21.15.76:0/932250093 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2ec80ffe70 0x7f2ec8195d90 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc000c00 tx=0x7f2ebc005b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:43.891 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.887+0000 7f2ec5ffb700 1 -- 172.21.15.76:0/932250093 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ebc01d070 con 0x7f2ec80ffe70 2024-06-02T04:49:43.891 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.887+0000 7f2ec5ffb700 1 -- 172.21.15.76:0/932250093 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2ebc00bd10 con 0x7f2ec80ffe70 2024-06-02T04:49:43.891 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.887+0000 7f2ecf030700 1 -- 172.21.15.76:0/932250093 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ec819de30 con 0x7f2ec80ffe70 2024-06-02T04:49:43.891 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.887+0000 7f2ec5ffb700 1 -- 172.21.15.76:0/932250093 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ebc022c60 con 0x7f2ec80ffe70 2024-06-02T04:49:43.891 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.887+0000 7f2ecf030700 1 -- 172.21.15.76:0/932250093 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ec819e1a0 con 0x7f2ec80ffe70 2024-06-02T04:49:43.892 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.888+0000 7f2ecf030700 1 -- 172.21.15.76:0/932250093 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ec81072d0 con 0x7f2ec80ffe70 2024-06-02T04:49:43.892 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.890+0000 7f2ec5ffb700 1 -- 172.21.15.76:0/932250093 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f2ebc003f80 con 0x7f2ec80ffe70 2024-06-02T04:49:43.892 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.890+0000 7f2ec5ffb700 1 --2- 172.21.15.76:0/932250093 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f2eb80a1120 0x7f2eb80a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:43.892 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.891+0000 7f2ec7fff700 1 --2- 172.21.15.76:0/932250093 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f2eb80a1120 0x7f2eb80a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:43.892 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.891+0000 7f2ec5ffb700 1 -- 172.21.15.76:0/932250093 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f2ebc0ce7b0 con 0x7f2ec80ffe70 2024-06-02T04:49:43.892 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.891+0000 7f2ec7fff700 1 --2- 172.21.15.76:0/932250093 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f2eb80a1120 0x7f2eb80a35e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f2eb4005fd0 tx=0x7f2eb4005ee0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:43.894 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:43.894+0000 7f2ec5ffb700 1 -- 172.21.15.76:0/932250093 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f2ebc097c60 con 0x7f2ec80ffe70 2024-06-02T04:49:44.093 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.093+0000 7f2ecf030700 1 -- 172.21.15.76:0/932250093 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f2ec810b680 con 0x7f2ec80ffe70 2024-06-02T04:49:44.093 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.093+0000 7f2ec5ffb700 1 -- 172.21.15.76:0/932250093 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v82) v1 ==== 103+0+11 (secure 0 0 0) 0x7f2ebc0860a0 con 0x7f2ec80ffe70 2024-06-02T04:49:44.093 INFO:teuthology.orchestra.run.smithi076.stdout:pg_num: 32 2024-06-02T04:49:44.096 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.095+0000 7f2ecf030700 1 -- 172.21.15.76:0/932250093 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f2eb80a1120 msgr2=0x7f2eb80a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:44.096 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.095+0000 7f2ecf030700 1 --2- 172.21.15.76:0/932250093 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f2eb80a1120 0x7f2eb80a35e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f2eb4005fd0 tx=0x7f2eb4005ee0 comp rx=0 tx=0).stop 2024-06-02T04:49:44.096 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.095+0000 7f2ecf030700 1 -- 172.21.15.76:0/932250093 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2ec80ffe70 msgr2=0x7f2ec8195d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:44.096 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.095+0000 7f2ecf030700 1 --2- 172.21.15.76:0/932250093 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2ec80ffe70 0x7f2ec8195d90 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc000c00 tx=0x7f2ebc005b00 comp rx=0 tx=0).stop 2024-06-02T04:49:44.096 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.095+0000 7f2ecf030700 1 -- 172.21.15.76:0/932250093 shutdown_connections 2024-06-02T04:49:44.096 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.095+0000 7f2ecf030700 1 --2- 172.21.15.76:0/932250093 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2ec8101980 0x7f2ec819d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:44.096 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.095+0000 7f2ecf030700 1 --2- 172.21.15.76:0/932250093 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2ec80ffe70 0x7f2ec8195d90 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:44.096 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.095+0000 7f2ecf030700 1 --2- 172.21.15.76:0/932250093 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f2eb80a1120 0x7f2eb80a35e0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:44.096 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.095+0000 7f2ecf030700 1 --2- 172.21.15.76:0/932250093 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2ec8100fc0 0x7f2ec81962d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:44.096 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.095+0000 7f2ecf030700 1 -- 172.21.15.76:0/932250093 >> 172.21.15.76:0/932250093 conn(0x7f2ec80fb400 msgr2=0x7f2ec8104410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:44.096 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.095+0000 7f2ecf030700 1 -- 172.21.15.76:0/932250093 shutdown_connections 2024-06-02T04:49:44.097 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.095+0000 7f2ecf030700 1 -- 172.21.15.76:0/932250093 wait complete. 2024-06-02T04:49:44.108 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T04:49:44.233 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.231+0000 7f2877b43700 1 -- 172.21.15.76:0/622910416 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f28700ffd90 msgr2=0x7f28701001b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:44.233 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.231+0000 7f2877b43700 1 --2- 172.21.15.76:0/622910416 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f28700ffd90 0x7f28701001b0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f28640099c0 tx=0x7f2864009cd0 comp rx=0 tx=0).stop 2024-06-02T04:49:44.233 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.231+0000 7f2877b43700 1 -- 172.21.15.76:0/622910416 shutdown_connections 2024-06-02T04:49:44.234 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.231+0000 7f2877b43700 1 --2- 172.21.15.76:0/622910416 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2870101920 0x7f28701081d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:44.234 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.231+0000 7f2877b43700 1 --2- 172.21.15.76:0/622910416 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f28700ffd90 0x7f28701001b0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:44.234 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.231+0000 7f2877b43700 1 --2- 172.21.15.76:0/622910416 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2870100f80 0x7f28701013e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:44.234 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.231+0000 7f2877b43700 1 -- 172.21.15.76:0/622910416 >> 172.21.15.76:0/622910416 conn(0x7f28700fb320 msgr2=0x7f28700fd740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:44.234 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.231+0000 7f2877b43700 1 -- 172.21.15.76:0/622910416 shutdown_connections 2024-06-02T04:49:44.234 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.231+0000 7f2877b43700 1 -- 172.21.15.76:0/622910416 wait complete. 2024-06-02T04:49:44.234 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.232+0000 7f2877b43700 1 Processor -- start 2024-06-02T04:49:44.234 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.232+0000 7f2877b43700 1 -- start start 2024-06-02T04:49:44.234 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.232+0000 7f2877b43700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f28700ffd90 0x7f2870196d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:44.234 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.232+0000 7f2877b43700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2870100f80 0x7f2870197250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:44.234 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.232+0000 7f2877b43700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2870101920 0x7f287019e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:44.235 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.232+0000 7f2877b43700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f287019e830 con 0x7f2870101920 2024-06-02T04:49:44.235 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.232+0000 7f2877b43700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f287019e9a0 con 0x7f2870100f80 2024-06-02T04:49:44.235 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.232+0000 7f2877b43700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f287019eb60 con 0x7f28700ffd90 2024-06-02T04:49:44.235 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.232+0000 7f28760e0700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2870101920 0x7f287019e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:44.235 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.232+0000 7f28760e0700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2870101920 0x7f287019e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:57914/0 (socket says 172.21.15.76:57914) 2024-06-02T04:49:44.235 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.232+0000 7f28760e0700 1 -- 172.21.15.76:0/100266557 learned_addr learned my addr 172.21.15.76:0/100266557 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:49:44.235 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.232+0000 7f28758df700 1 --2- 172.21.15.76:0/100266557 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f28700ffd90 0x7f2870196d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:44.235 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.232+0000 7f28750de700 1 --2- 172.21.15.76:0/100266557 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2870100f80 0x7f2870197250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:44.235 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.232+0000 7f28760e0700 1 -- 172.21.15.76:0/100266557 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f28700ffd90 msgr2=0x7f2870196d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:44.235 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.232+0000 7f28760e0700 1 --2- 172.21.15.76:0/100266557 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f28700ffd90 0x7f2870196d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:44.236 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.232+0000 7f28760e0700 1 -- 172.21.15.76:0/100266557 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2870100f80 msgr2=0x7f2870197250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:44.236 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.232+0000 7f28760e0700 1 --2- 172.21.15.76:0/100266557 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2870100f80 0x7f2870197250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:44.236 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.232+0000 7f28760e0700 1 -- 172.21.15.76:0/100266557 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28640095f0 con 0x7f2870101920 2024-06-02T04:49:44.236 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.232+0000 7f28760e0700 1 --2- 172.21.15.76:0/100266557 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2870101920 0x7f287019e260 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f2868007ee0 tx=0x7f286800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:44.236 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.232+0000 7f2862ffd700 1 -- 172.21.15.76:0/100266557 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2868017070 con 0x7f2870101920 2024-06-02T04:49:44.236 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.233+0000 7f2862ffd700 1 -- 172.21.15.76:0/100266557 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f286800f040 con 0x7f2870101920 2024-06-02T04:49:44.236 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.233+0000 7f2862ffd700 1 -- 172.21.15.76:0/100266557 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2868005710 con 0x7f2870101920 2024-06-02T04:49:44.236 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.233+0000 7f2877b43700 1 -- 172.21.15.76:0/100266557 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f287019ee40 con 0x7f2870101920 2024-06-02T04:49:44.236 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.233+0000 7f2877b43700 1 -- 172.21.15.76:0/100266557 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f287019f270 con 0x7f2870101920 2024-06-02T04:49:44.237 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.233+0000 7f2877b43700 1 -- 172.21.15.76:0/100266557 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2870068060 con 0x7f2870101920 2024-06-02T04:49:44.237 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.235+0000 7f2862ffd700 1 -- 172.21.15.76:0/100266557 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f2868005870 con 0x7f2870101920 2024-06-02T04:49:44.237 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.235+0000 7f2862ffd700 1 --2- 172.21.15.76:0/100266557 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f285c0a1120 0x7f285c0a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:44.238 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.235+0000 7f28758df700 1 --2- 172.21.15.76:0/100266557 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f285c0a1120 0x7f285c0a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:44.238 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.235+0000 7f2862ffd700 1 -- 172.21.15.76:0/100266557 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f28680ccb10 con 0x7f2870101920 2024-06-02T04:49:44.238 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.236+0000 7f28758df700 1 --2- 172.21.15.76:0/100266557 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f285c0a1120 0x7f285c0a35e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f2864009990 tx=0x7f2864005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:44.239 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.239+0000 7f2862ffd700 1 -- 172.21.15.76:0/100266557 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f2868095f90 con 0x7f2870101920 2024-06-02T04:49:44.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:44 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/2228415803' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-06-02T04:49:44.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:44 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/2901751744' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-06-02T04:49:44.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:44 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/932250093' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-06-02T04:49:44.484 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.483+0000 7f2877b43700 1 -- 172.21.15.76:0/100266557 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f287010b450 con 0x7f2870101920 2024-06-02T04:49:44.484 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.484+0000 7f2862ffd700 1 -- 172.21.15.76:0/100266557 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+10874 (secure 0 0 0) 0x7f28680995b0 con 0x7f2870101920 2024-06-02T04:49:44.484 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:49:44.485 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6835/3029342152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3029342152},{"type":"v1","addr":"172.21.15.76:6835","nonce":3029342152}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6837/1207985317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":1207985317},{"type":"v1","addr":"172.21.15.76:6837","nonce":1207985317}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14607,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6839/928709755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":928709755},{"type":"v1","addr":"172.21.15.76:6839","nonce":928709755}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6841/4162178633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6840","nonce":4162178633},{"type":"v1","addr":"172.21.15.76:6841","nonce":4162178633}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/1543944863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":1543944863},{"type":"v1","addr":"172.21.15.119:6833","nonce":1543944863}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24418,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6833/1527921393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1527921393},{"type":"v1","addr":"172.21.15.192:6833","nonce":1527921393}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-02T04:48:02.662812+0000","modified":"2024-06-02T04:49:37.267371+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24491,"mds_1":24475,"mds_2":24463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24434":{"gid":24434,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6835/2746840347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":2746840347},{"type":"v1","addr":"172.21.15.119:6835","nonce":2746840347}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24451":{"gid":24451,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.192:6835/783181340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":783181340},{"type":"v1","addr":"172.21.15.192:6835","nonce":783181340}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24458":{"gid":24458,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6837/2171687478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":2171687478},{"type":"v1","addr":"172.21.15.119:6837","nonce":2171687478}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24463":{"gid":24463,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":11,"addr":"172.21.15.192:6837/960773710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":960773710},{"type":"v1","addr":"172.21.15.192:6837","nonce":960773710}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24475":{"gid":24475,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.192:6839/3978681402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":3978681402},{"type":"v1","addr":"172.21.15.192:6839","nonce":3978681402}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.119:6839/4098406903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":4098406903},{"type":"v1","addr":"172.21.15.119:6839","nonce":4098406903}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-06-02T04:49:44.487 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.486+0000 7f2877b43700 1 -- 172.21.15.76:0/100266557 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f285c0a1120 msgr2=0x7f285c0a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:44.487 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.486+0000 7f2877b43700 1 --2- 172.21.15.76:0/100266557 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f285c0a1120 0x7f285c0a35e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f2864009990 tx=0x7f2864005fb0 comp rx=0 tx=0).stop 2024-06-02T04:49:44.487 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.486+0000 7f2877b43700 1 -- 172.21.15.76:0/100266557 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2870101920 msgr2=0x7f287019e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:44.487 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.486+0000 7f2877b43700 1 --2- 172.21.15.76:0/100266557 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2870101920 0x7f287019e260 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f2868007ee0 tx=0x7f286800d3b0 comp rx=0 tx=0).stop 2024-06-02T04:49:44.487 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.486+0000 7f2877b43700 1 -- 172.21.15.76:0/100266557 shutdown_connections 2024-06-02T04:49:44.487 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.486+0000 7f2877b43700 1 --2- 172.21.15.76:0/100266557 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2870101920 0x7f287019e260 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:44.487 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.486+0000 7f2877b43700 1 --2- 172.21.15.76:0/100266557 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f28700ffd90 0x7f2870196d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:44.488 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.486+0000 7f2877b43700 1 --2- 172.21.15.76:0/100266557 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f285c0a1120 0x7f285c0a35e0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:44.488 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.486+0000 7f2877b43700 1 --2- 172.21.15.76:0/100266557 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2870100f80 0x7f2870197250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:44.488 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.486+0000 7f2877b43700 1 -- 172.21.15.76:0/100266557 >> 172.21.15.76:0/100266557 conn(0x7f28700fb320 msgr2=0x7f28700fba60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:44.488 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.486+0000 7f2877b43700 1 -- 172.21.15.76:0/100266557 shutdown_connections 2024-06-02T04:49:44.488 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.486+0000 7f2877b43700 1 -- 172.21.15.76:0/100266557 wait complete. 2024-06-02T04:49:44.489 INFO:teuthology.orchestra.run.smithi076.stderr:dumped fsmap epoch 25 2024-06-02T04:49:44.499 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-02T04:49:44.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:44 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/2228415803' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-06-02T04:49:44.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:44 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/2901751744' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-06-02T04:49:44.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:44 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/932250093' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-06-02T04:49:44.624 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.621+0000 7f37de1b3700 1 -- 172.21.15.76:0/495658799 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f37d8106bc0 msgr2=0x7f37d8108fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:44.624 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.621+0000 7f37de1b3700 1 --2- 172.21.15.76:0/495658799 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f37d8106bc0 0x7f37d8108fd0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f37d000b0a0 tx=0x7f37d000b3b0 comp rx=0 tx=0).stop 2024-06-02T04:49:44.624 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.621+0000 7f37de1b3700 1 -- 172.21.15.76:0/495658799 shutdown_connections 2024-06-02T04:49:44.625 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.621+0000 7f37de1b3700 1 --2- 172.21.15.76:0/495658799 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f37d8106bc0 0x7f37d8108fd0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:44.625 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.621+0000 7f37de1b3700 1 --2- 172.21.15.76:0/495658799 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f37d8101960 0x7f37d8103d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:44.625 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.621+0000 7f37de1b3700 1 --2- 172.21.15.76:0/495658799 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f37d8104290 0x7f37d8106680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:44.625 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.621+0000 7f37de1b3700 1 -- 172.21.15.76:0/495658799 >> 172.21.15.76:0/495658799 conn(0x7f37d80fb2f0 msgr2=0x7f37d80fd730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:44.625 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.621+0000 7f37de1b3700 1 -- 172.21.15.76:0/495658799 shutdown_connections 2024-06-02T04:49:44.625 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.621+0000 7f37de1b3700 1 -- 172.21.15.76:0/495658799 wait complete. 2024-06-02T04:49:44.625 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.622+0000 7f37de1b3700 1 Processor -- start 2024-06-02T04:49:44.625 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.622+0000 7f37de1b3700 1 -- start start 2024-06-02T04:49:44.625 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.622+0000 7f37de1b3700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f37d8101960 0x7f37d8101230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:44.625 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.622+0000 7f37de1b3700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f37d8104290 0x7f37d80ff910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:44.625 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.622+0000 7f37de1b3700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f37d8106bc0 0x7f37d80ffe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:44.625 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.622+0000 7f37de1b3700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37d8100550 con 0x7f37d8104290 2024-06-02T04:49:44.625 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.622+0000 7f37de1b3700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37d81006c0 con 0x7f37d8106bc0 2024-06-02T04:49:44.626 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.622+0000 7f37de1b3700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37d81a0e80 con 0x7f37d8101960 2024-06-02T04:49:44.626 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.622+0000 7f37d6ffd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f37d8104290 0x7f37d80ff910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:44.626 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.622+0000 7f37d6ffd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f37d8104290 0x7f37d80ff910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:57930/0 (socket says 172.21.15.76:57930) 2024-06-02T04:49:44.626 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.622+0000 7f37d6ffd700 1 -- 172.21.15.76:0/4244993615 learned_addr learned my addr 172.21.15.76:0/4244993615 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:49:44.626 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.622+0000 7f37d77fe700 1 --2- 172.21.15.76:0/4244993615 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f37d8101960 0x7f37d8101230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:44.626 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.622+0000 7f37d7fff700 1 --2- 172.21.15.76:0/4244993615 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f37d8106bc0 0x7f37d80ffe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:44.626 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.622+0000 7f37d6ffd700 1 -- 172.21.15.76:0/4244993615 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f37d8101960 msgr2=0x7f37d8101230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:44.626 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.622+0000 7f37d6ffd700 1 --2- 172.21.15.76:0/4244993615 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f37d8101960 0x7f37d8101230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:44.626 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.622+0000 7f37d6ffd700 1 -- 172.21.15.76:0/4244993615 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f37d8106bc0 msgr2=0x7f37d80ffe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:44.626 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.622+0000 7f37d6ffd700 1 --2- 172.21.15.76:0/4244993615 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f37d8106bc0 0x7f37d80ffe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:44.626 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.622+0000 7f37d6ffd700 1 -- 172.21.15.76:0/4244993615 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37d0009d00 con 0x7f37d8104290 2024-06-02T04:49:44.626 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.622+0000 7f37d6ffd700 1 --2- 172.21.15.76:0/4244993615 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f37d8104290 0x7f37d80ff910 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f37cc00d950 tx=0x7f37cc00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:44.626 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.623+0000 7f37d4ff9700 1 -- 172.21.15.76:0/4244993615 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37cc009940 con 0x7f37d8104290 2024-06-02T04:49:44.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.623+0000 7f37d4ff9700 1 -- 172.21.15.76:0/4244993615 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f37cc010460 con 0x7f37d8104290 2024-06-02T04:49:44.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.623+0000 7f37de1b3700 1 -- 172.21.15.76:0/4244993615 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37d81a10e0 con 0x7f37d8104290 2024-06-02T04:49:44.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.623+0000 7f37d4ff9700 1 -- 172.21.15.76:0/4244993615 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37cc00f620 con 0x7f37d8104290 2024-06-02T04:49:44.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.623+0000 7f37de1b3700 1 -- 172.21.15.76:0/4244993615 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37d81a15f0 con 0x7f37d8104290 2024-06-02T04:49:44.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.624+0000 7f37de1b3700 1 -- 172.21.15.76:0/4244993615 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37d80fce70 con 0x7f37d8104290 2024-06-02T04:49:44.628 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.625+0000 7f37d4ff9700 1 -- 172.21.15.76:0/4244993615 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f37cc0105d0 con 0x7f37d8104290 2024-06-02T04:49:44.628 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.625+0000 7f37d4ff9700 1 --2- 172.21.15.76:0/4244993615 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f37c00a1120 0x7f37c00a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:44.628 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.625+0000 7f37d77fe700 1 --2- 172.21.15.76:0/4244993615 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f37c00a1120 0x7f37c00a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:44.628 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.625+0000 7f37d4ff9700 1 -- 172.21.15.76:0/4244993615 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f37cc0cca20 con 0x7f37d8104290 2024-06-02T04:49:44.628 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.626+0000 7f37d77fe700 1 --2- 172.21.15.76:0/4244993615 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f37c00a1120 0x7f37c00a35e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f37c8009c60 tx=0x7f37c8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:44.629 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.629+0000 7f37d4ff9700 1 -- 172.21.15.76:0/4244993615 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f37cc095ea0 con 0x7f37d8104290 2024-06-02T04:49:44.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:44 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/2228415803' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-06-02T04:49:44.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:44 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/2901751744' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-06-02T04:49:44.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:44 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/932250093' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-06-02T04:49:44.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.831+0000 7f37de1b3700 1 -- 172.21.15.76:0/4244993615 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f37d8067380 con 0x7f37d8104290 2024-06-02T04:49:44.833 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.832+0000 7f37d4ff9700 1 -- 172.21.15.76:0/4244993615 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+24453 (secure 0 0 0) 0x7f37cc016090 con 0x7f37d8104290 2024-06-02T04:49:44.833 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:49:44.833 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":82,"fsid":"60ab6d30-209a-11ef-bc9b-c7b262605968","created":"2024-06-02T04:42:21.007333+0000","modified":"2024-06-02T04:49:07.862801+0000","last_up_change":"2024-06-02T04:47:29.822242+0000","last_in_change":"2024-06-02T04:47:14.253449+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T04:44:56.408602+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-02T04:48:01.194954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-02T04:48:01.828863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-02T04:48:04.916565+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"33a51ba2-be5c-41d0-b5d1-8d6039f2ca4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6802","nonce":2869602045},{"type":"v1","addr":"172.21.15.76:6803","nonce":2869602045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6804","nonce":2869602045},{"type":"v1","addr":"172.21.15.76:6805","nonce":2869602045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6808","nonce":2869602045},{"type":"v1","addr":"172.21.15.76:6809","nonce":2869602045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6806","nonce":2869602045},{"type":"v1","addr":"172.21.15.76:6807","nonce":2869602045}]},"public_addr":"172.21.15.76:6803/2869602045","cluster_addr":"172.21.15.76:6805/2869602045","heartbeat_back_addr":"172.21.15.76:6809/2869602045","heartbeat_front_addr":"172.21.15.76:6807/2869602045","state":["exists","up"]},{"osd":1,"uuid":"ace46e13-3bb7-4103-973a-6860554df8b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":2353738098},{"type":"v1","addr":"172.21.15.119:6801","nonce":2353738098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":2353738098},{"type":"v1","addr":"172.21.15.119:6803","nonce":2353738098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":2353738098},{"type":"v1","addr":"172.21.15.119:6807","nonce":2353738098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":2353738098},{"type":"v1","addr":"172.21.15.119:6805","nonce":2353738098}]},"public_addr":"172.21.15.119:6801/2353738098","cluster_addr":"172.21.15.119:6803/2353738098","heartbeat_back_addr":"172.21.15.119:6807/2353738098","heartbeat_front_addr":"172.21.15.119:6805/2353738098","state":["exists","up"]},{"osd":2,"uuid":"4addc09e-77a9-428a-bcc4-38194f486cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":3206918546},{"type":"v1","addr":"172.21.15.192:6801","nonce":3206918546}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":3206918546},{"type":"v1","addr":"172.21.15.192:6803","nonce":3206918546}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":3206918546},{"type":"v1","addr":"172.21.15.192:6807","nonce":3206918546}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":3206918546},{"type":"v1","addr":"172.21.15.192:6805","nonce":3206918546}]},"public_addr":"172.21.15.192:6801/3206918546","cluster_addr":"172.21.15.192:6803/3206918546","heartbeat_back_addr":"172.21.15.192:6807/3206918546","heartbeat_front_addr":"172.21.15.192:6805/3206918546","state":["exists","up"]},{"osd":3,"uuid":"dc525518-82c6-49ed-8ca8-e3bd5bfc18d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6810","nonce":3747864233},{"type":"v1","addr":"172.21.15.76:6811","nonce":3747864233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6812","nonce":3747864233},{"type":"v1","addr":"172.21.15.76:6813","nonce":3747864233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6816","nonce":3747864233},{"type":"v1","addr":"172.21.15.76:6817","nonce":3747864233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6814","nonce":3747864233},{"type":"v1","addr":"172.21.15.76:6815","nonce":3747864233}]},"public_addr":"172.21.15.76:6811/3747864233","cluster_addr":"172.21.15.76:6813/3747864233","heartbeat_back_addr":"172.21.15.76:6817/3747864233","heartbeat_front_addr":"172.21.15.76:6815/3747864233","state":["exists","up"]},{"osd":4,"uuid":"eef293d0-cb87-47b3-9751-c6437a1cf079","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":2571629047},{"type":"v1","addr":"172.21.15.119:6809","nonce":2571629047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":2571629047},{"type":"v1","addr":"172.21.15.119:6811","nonce":2571629047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":2571629047},{"type":"v1","addr":"172.21.15.119:6815","nonce":2571629047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":2571629047},{"type":"v1","addr":"172.21.15.119:6813","nonce":2571629047}]},"public_addr":"172.21.15.119:6809/2571629047","cluster_addr":"172.21.15.119:6811/2571629047","heartbeat_back_addr":"172.21.15.119:6815/2571629047","heartbeat_front_addr":"172.21.15.119:6813/2571629047","state":["exists","up"]},{"osd":5,"uuid":"60eb8c6e-766c-49d0-9997-44f85776b3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3285065416},{"type":"v1","addr":"172.21.15.192:6809","nonce":3285065416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":3285065416},{"type":"v1","addr":"172.21.15.192:6811","nonce":3285065416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3285065416},{"type":"v1","addr":"172.21.15.192:6815","nonce":3285065416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":3285065416},{"type":"v1","addr":"172.21.15.192:6813","nonce":3285065416}]},"public_addr":"172.21.15.192:6809/3285065416","cluster_addr":"172.21.15.192:6811/3285065416","heartbeat_back_addr":"172.21.15.192:6815/3285065416","heartbeat_front_addr":"172.21.15.192:6813/3285065416","state":["exists","up"]},{"osd":6,"uuid":"e6dc8b9d-dd06-4870-a506-def8201b7e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6818","nonce":2951381580},{"type":"v1","addr":"172.21.15.76:6819","nonce":2951381580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6820","nonce":2951381580},{"type":"v1","addr":"172.21.15.76:6821","nonce":2951381580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6824","nonce":2951381580},{"type":"v1","addr":"172.21.15.76:6825","nonce":2951381580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6822","nonce":2951381580},{"type":"v1","addr":"172.21.15.76:6823","nonce":2951381580}]},"public_addr":"172.21.15.76:6819/2951381580","cluster_addr":"172.21.15.76:6821/2951381580","heartbeat_back_addr":"172.21.15.76:6825/2951381580","heartbeat_front_addr":"172.21.15.76:6823/2951381580","state":["exists","up"]},{"osd":7,"uuid":"2f5dccb3-39a1-4f25-8715-fa264d59db97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1802558756},{"type":"v1","addr":"172.21.15.119:6817","nonce":1802558756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1802558756},{"type":"v1","addr":"172.21.15.119:6819","nonce":1802558756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1802558756},{"type":"v1","addr":"172.21.15.119:6823","nonce":1802558756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1802558756},{"type":"v1","addr":"172.21.15.119:6821","nonce":1802558756}]},"public_addr":"172.21.15.119:6817/1802558756","cluster_addr":"172.21.15.119:6819/1802558756","heartbeat_back_addr":"172.21.15.119:6823/1802558756","heartbeat_front_addr":"172.21.15.119:6821/1802558756","state":["exists","up"]},{"osd":8,"uuid":"39b6ccd0-16e7-4cd5-87e0-d827e9172984","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":1214972276},{"type":"v1","addr":"172.21.15.192:6817","nonce":1214972276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":1214972276},{"type":"v1","addr":"172.21.15.192:6819","nonce":1214972276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":1214972276},{"type":"v1","addr":"172.21.15.192:6823","nonce":1214972276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":1214972276},{"type":"v1","addr":"172.21.15.192:6821","nonce":1214972276}]},"public_addr":"172.21.15.192:6817/1214972276","cluster_addr":"172.21.15.192:6819/1214972276","heartbeat_back_addr":"172.21.15.192:6823/1214972276","heartbeat_front_addr":"172.21.15.192:6821/1214972276","state":["exists","up"]},{"osd":9,"uuid":"851b2155-07bd-45de-bfe0-53021fda733f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6826","nonce":3095501821},{"type":"v1","addr":"172.21.15.76:6827","nonce":3095501821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6828","nonce":3095501821},{"type":"v1","addr":"172.21.15.76:6829","nonce":3095501821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":3095501821},{"type":"v1","addr":"172.21.15.76:6833","nonce":3095501821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6830","nonce":3095501821},{"type":"v1","addr":"172.21.15.76:6831","nonce":3095501821}]},"public_addr":"172.21.15.76:6827/3095501821","cluster_addr":"172.21.15.76:6829/3095501821","heartbeat_back_addr":"172.21.15.76:6833/3095501821","heartbeat_front_addr":"172.21.15.76:6831/3095501821","state":["exists","up"]},{"osd":10,"uuid":"e4b18e7e-bddf-4dd4-84f6-7902ea327cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":4082130894},{"type":"v1","addr":"172.21.15.119:6825","nonce":4082130894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":4082130894},{"type":"v1","addr":"172.21.15.119:6827","nonce":4082130894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":4082130894},{"type":"v1","addr":"172.21.15.119:6831","nonce":4082130894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":4082130894},{"type":"v1","addr":"172.21.15.119:6829","nonce":4082130894}]},"public_addr":"172.21.15.119:6825/4082130894","cluster_addr":"172.21.15.119:6827/4082130894","heartbeat_back_addr":"172.21.15.119:6831/4082130894","heartbeat_front_addr":"172.21.15.119:6829/4082130894","state":["exists","up"]},{"osd":11,"uuid":"54567e18-920c-4ae9-9557-0efba5a1a820","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":439693921},{"type":"v1","addr":"172.21.15.192:6825","nonce":439693921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":439693921},{"type":"v1","addr":"172.21.15.192:6827","nonce":439693921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":439693921},{"type":"v1","addr":"172.21.15.192:6831","nonce":439693921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":439693921},{"type":"v1","addr":"172.21.15.192:6829","nonce":439693921}]},"public_addr":"172.21.15.192:6825/439693921","cluster_addr":"172.21.15.192:6827/439693921","heartbeat_back_addr":"172.21.15.192:6831/439693921","heartbeat_front_addr":"172.21.15.192:6829/439693921","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:44:19.922390+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:44:36.895563+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:44:53.699019+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:45:11.167404+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:45:27.955899+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:45:44.850368+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:46:02.003588+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:46:19.019217+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:46:36.189670+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:46:53.919365+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:47:11.563053+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:47:28.822443+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":4}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.8","mappings":[{"from":5,"to":10}]},{"pgid":"4.14","mappings":[{"from":9,"to":8}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.76:6801/4200406736":"2024-06-03T04:43:06.092916+0000","172.21.15.76:6800/4200406736":"2024-06-03T04:43:06.092916+0000","172.21.15.76:0/1524144593":"2024-06-03T04:43:06.092916+0000","172.21.15.76:0/3269372590":"2024-06-03T04:43:06.092916+0000","172.21.15.76:0/3570893846":"2024-06-03T04:42:44.872236+0000","172.21.15.76:0/902035790":"2024-06-03T04:43:06.092916+0000","172.21.15.76:6800/2550846765":"2024-06-03T04:42:44.872236+0000","172.21.15.76:6801/2550846765":"2024-06-03T04:42:44.872236+0000","172.21.15.76:0/2646712763":"2024-06-03T04:42:44.872236+0000","172.21.15.76:0/964578813":"2024-06-03T04:42:44.872236+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T04:49:44.835 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.835+0000 7f37de1b3700 1 -- 172.21.15.76:0/4244993615 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f37c00a1120 msgr2=0x7f37c00a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:44.835 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.835+0000 7f37de1b3700 1 --2- 172.21.15.76:0/4244993615 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f37c00a1120 0x7f37c00a35e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f37c8009c60 tx=0x7f37c8009260 comp rx=0 tx=0).stop 2024-06-02T04:49:44.835 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.835+0000 7f37de1b3700 1 -- 172.21.15.76:0/4244993615 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f37d8104290 msgr2=0x7f37d80ff910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:44.835 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.835+0000 7f37de1b3700 1 --2- 172.21.15.76:0/4244993615 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f37d8104290 0x7f37d80ff910 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f37cc00d950 tx=0x7f37cc00dc60 comp rx=0 tx=0).stop 2024-06-02T04:49:44.836 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.835+0000 7f37de1b3700 1 -- 172.21.15.76:0/4244993615 shutdown_connections 2024-06-02T04:49:44.836 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.835+0000 7f37de1b3700 1 --2- 172.21.15.76:0/4244993615 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f37c00a1120 0x7f37c00a35e0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:44.836 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.835+0000 7f37de1b3700 1 --2- 172.21.15.76:0/4244993615 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f37d8106bc0 0x7f37d80ffe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:44.836 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.835+0000 7f37de1b3700 1 --2- 172.21.15.76:0/4244993615 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f37d8101960 0x7f37d8101230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:44.836 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.835+0000 7f37de1b3700 1 --2- 172.21.15.76:0/4244993615 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f37d8104290 0x7f37d80ff910 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:44.836 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.835+0000 7f37de1b3700 1 -- 172.21.15.76:0/4244993615 >> 172.21.15.76:0/4244993615 conn(0x7f37d80fb2f0 msgr2=0x7f37d81022c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:44.836 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.835+0000 7f37de1b3700 1 -- 172.21.15.76:0/4244993615 shutdown_connections 2024-06-02T04:49:44.836 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.835+0000 7f37de1b3700 1 -- 172.21.15.76:0/4244993615 wait complete. 2024-06-02T04:49:44.848 DEBUG:tasks.fwd_scrub:Yielding 2024-06-02T04:49:44.848 INFO:teuthology.run_tasks:Running task background_exec... 2024-06-02T04:49:44.859 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi076.front.sepia.ceph.com 2024-06-02T04:49:44.860 DEBUG:teuthology.orchestra.run.smithi076:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-06-02T04:49:44.860 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-06-02T04:49:44.860 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-06-02T04:49:44.860 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-06-02T04:49:44.862 INFO:teuthology.run_tasks:Running task exec... 2024-06-02T04:49:44.880 INFO:teuthology.task.exec:Executing custom commands... 2024-06-02T04:49:44.881 INFO:teuthology.task.exec:Running commands on role client.0 host ubuntu@smithi076.front.sepia.ceph.com 2024-06-02T04:49:44.881 DEBUG:teuthology.orchestra.run.smithi076:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -l /tmp/cephfs/ && sudo df -h /tmp/cephfs/' 2024-06-02T04:49:44.923 INFO:teuthology.orchestra.run.smithi076.stdout:total 0 2024-06-02T04:49:44.935 INFO:teuthology.orchestra.run.smithi076.stdout:Filesystem Size Used Avail Use% Mounted on 2024-06-02T04:49:44.935 INFO:teuthology.orchestra.run.smithi076.stdout:ceph-fuse 1.1T 364M 1.1T 1% /tmp/cephfs 2024-06-02T04:49:44.937 DEBUG:teuthology.orchestra.run.smithi076:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo mkdir -m 755 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres && sudo chown postgres:postgres /tmp/cephfs/postgres' 2024-06-02T04:49:45.007 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.994+0000 7fdbd779b700 1 -- 172.21.15.76:0/905963368 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdbd0102c50 msgr2=0x7fdbd0109500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:45.008 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.994+0000 7fdbd779b700 1 --2- 172.21.15.76:0/905963368 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdbd0102c50 0x7fdbd0109500 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fdbc800b0a0 tx=0x7fdbc800b3b0 comp rx=0 tx=0).stop 2024-06-02T04:49:45.008 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.994+0000 7fdbd779b700 1 -- 172.21.15.76:0/905963368 shutdown_connections 2024-06-02T04:49:45.008 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.994+0000 7fdbd779b700 1 --2- 172.21.15.76:0/905963368 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdbd0102c50 0x7fdbd0109500 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:45.008 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.994+0000 7fdbd779b700 1 --2- 172.21.15.76:0/905963368 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdbd00ff240 0x7fdbd00ff660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:45.008 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.994+0000 7fdbd779b700 1 --2- 172.21.15.76:0/905963368 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdbd01022b0 0x7fdbd0102710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:45.008 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.994+0000 7fdbd779b700 1 -- 172.21.15.76:0/905963368 >> 172.21.15.76:0/905963368 conn(0x7fdbd00fab50 msgr2=0x7fdbd00fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:45.009 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.994+0000 7fdbd779b700 1 -- 172.21.15.76:0/905963368 shutdown_connections 2024-06-02T04:49:45.009 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.994+0000 7fdbd779b700 1 -- 172.21.15.76:0/905963368 wait complete. 2024-06-02T04:49:45.009 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.995+0000 7fdbd779b700 1 Processor -- start 2024-06-02T04:49:45.009 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.995+0000 7fdbd779b700 1 -- start start 2024-06-02T04:49:45.009 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.995+0000 7fdbd779b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdbd00ff240 0x7fdbd0101bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:45.009 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.995+0000 7fdbd779b700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdbd01022b0 0x7fdbd0100260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:45.009 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.995+0000 7fdbd779b700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdbd0102c50 0x7fdbd01007a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:45.009 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.995+0000 7fdbd779b700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd0100f40 con 0x7fdbd0102c50 2024-06-02T04:49:45.009 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.995+0000 7fdbd779b700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd01010b0 con 0x7fdbd01022b0 2024-06-02T04:49:45.010 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.995+0000 7fdbd779b700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd01a0f50 con 0x7fdbd00ff240 2024-06-02T04:49:45.010 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.995+0000 7fdbd5d38700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdbd0102c50 0x7fdbd01007a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:45.010 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.995+0000 7fdbd5d38700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdbd0102c50 0x7fdbd01007a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:57948/0 (socket says 172.21.15.76:57948) 2024-06-02T04:49:45.010 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.995+0000 7fdbd5d38700 1 -- 172.21.15.76:0/1758643379 learned_addr learned my addr 172.21.15.76:0/1758643379 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:49:45.010 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.995+0000 7fdbd5537700 1 --2- 172.21.15.76:0/1758643379 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdbd00ff240 0x7fdbd0101bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:45.010 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.995+0000 7fdbd4d36700 1 --2- 172.21.15.76:0/1758643379 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdbd01022b0 0x7fdbd0100260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:45.010 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.995+0000 7fdbd5d38700 1 -- 172.21.15.76:0/1758643379 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdbd00ff240 msgr2=0x7fdbd0101bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:45.010 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.995+0000 7fdbd5d38700 1 --2- 172.21.15.76:0/1758643379 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdbd00ff240 0x7fdbd0101bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:45.010 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.995+0000 7fdbd5d38700 1 -- 172.21.15.76:0/1758643379 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdbd01022b0 msgr2=0x7fdbd0100260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:45.010 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.995+0000 7fdbd5d38700 1 --2- 172.21.15.76:0/1758643379 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdbd01022b0 0x7fdbd0100260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:45.010 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.995+0000 7fdbd5d38700 1 -- 172.21.15.76:0/1758643379 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbc8009d00 con 0x7fdbd0102c50 2024-06-02T04:49:45.010 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.995+0000 7fdbd5537700 1 --2- 172.21.15.76:0/1758643379 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdbd00ff240 0x7fdbd0101bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T04:49:45.011 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.996+0000 7fdbd5d38700 1 --2- 172.21.15.76:0/1758643379 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdbd0102c50 0x7fdbd01007a0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fdbc800b780 tx=0x7fdbc800bcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:45.011 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.996+0000 7fdbc67fc700 1 -- 172.21.15.76:0/1758643379 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc800e040 con 0x7fdbd0102c50 2024-06-02T04:49:45.011 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.996+0000 7fdbc67fc700 1 -- 172.21.15.76:0/1758643379 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdbc8003e10 con 0x7fdbd0102c50 2024-06-02T04:49:45.011 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.996+0000 7fdbd779b700 1 -- 172.21.15.76:0/1758643379 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbd01a1180 con 0x7fdbd0102c50 2024-06-02T04:49:45.011 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.996+0000 7fdbc67fc700 1 -- 172.21.15.76:0/1758643379 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc80052c0 con 0x7fdbd0102c50 2024-06-02T04:49:45.011 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.996+0000 7fdbd779b700 1 -- 172.21.15.76:0/1758643379 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbd01a15a0 con 0x7fdbd0102c50 2024-06-02T04:49:45.011 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.998+0000 7fdbc67fc700 1 -- 172.21.15.76:0/1758643379 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fdbc8005420 con 0x7fdbd0102c50 2024-06-02T04:49:45.011 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.999+0000 7fdbc67fc700 1 --2- 172.21.15.76:0/1758643379 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fdbbc0a1120 0x7fdbbc0a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:45.011 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.999+0000 7fdbd5537700 1 --2- 172.21.15.76:0/1758643379 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fdbbc0a1120 0x7fdbbc0a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:45.011 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:44.999+0000 7fdbc67fc700 1 -- 172.21.15.76:0/1758643379 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fdbc80cdd60 con 0x7fdbd0102c50 2024-06-02T04:49:45.011 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.000+0000 7fdbd5537700 1 --2- 172.21.15.76:0/1758643379 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fdbbc0a1120 0x7fdbbc0a35e0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fdbd0067d30 tx=0x7fdbcc007400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:45.011 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.000+0000 7fdbe3956b80 1 Processor -- start 2024-06-02T04:49:45.011 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.000+0000 7fdbe3956b80 1 -- start start 2024-06-02T04:49:45.012 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.000+0000 7fdbe3956b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56478c5575c0 0x56478c5579e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:45.012 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.000+0000 7fdbe3956b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56478c557f20 0x56478c5583a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:45.012 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.000+0000 7fdbe3956b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56478c5588e0 0x56478c558d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:45.012 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.000+0000 7fdbe3956b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x56478c4ae1d0 con 0x56478c557f20 2024-06-02T04:49:45.012 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.000+0000 7fdbe3956b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x56478c4abb90 con 0x56478c5575c0 2024-06-02T04:49:45.012 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.000+0000 7fdbe3956b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x56478c4a7480 con 0x56478c5588e0 2024-06-02T04:49:45.012 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.000+0000 7fdbd4d36700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56478c557f20 0x56478c5583a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:45.012 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.000+0000 7fdbd4d36700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56478c557f20 0x56478c5583a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:57958/0 (socket says 172.21.15.76:57958) 2024-06-02T04:49:45.012 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.000+0000 7fdbd4d36700 1 -- 172.21.15.76:0/1088366061 learned_addr learned my addr 172.21.15.76:0/1088366061 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:49:45.012 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.000+0000 7fdbd5537700 1 --2- 172.21.15.76:0/1088366061 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56478c5575c0 0x56478c5579e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:45.012 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.000+0000 7fdbd5d38700 1 --2- 172.21.15.76:0/1088366061 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56478c5588e0 0x56478c558d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:45.012 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.000+0000 7fdbd4d36700 1 -- 172.21.15.76:0/1088366061 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56478c5588e0 msgr2=0x56478c558d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:49:45.012 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.000+0000 7fdbd4d36700 1 --2- 172.21.15.76:0/1088366061 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56478c5588e0 0x56478c558d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:45.013 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.000+0000 7fdbd4d36700 1 -- 172.21.15.76:0/1088366061 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56478c5575c0 msgr2=0x56478c5579e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:49:45.013 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.000+0000 7fdbd4d36700 1 --2- 172.21.15.76:0/1088366061 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56478c5575c0 0x56478c5579e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:45.013 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.000+0000 7fdbd4d36700 1 -- 172.21.15.76:0/1088366061 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56478c328430 con 0x56478c557f20 2024-06-02T04:49:45.013 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.000+0000 7fdbd5537700 1 --2- 172.21.15.76:0/1088366061 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56478c5575c0 0x56478c5579e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:49:45.013 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.000+0000 7fdbd4d36700 1 --2- 172.21.15.76:0/1088366061 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56478c557f20 0x56478c5583a0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fdbc0009d00 tx=0x7fdbc0011720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c8db8c74685df1c server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:45.013 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.001+0000 7fdbbb7fe700 1 -- 172.21.15.76:0/1088366061 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc0004230 con 0x56478c557f20 2024-06-02T04:49:45.013 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.001+0000 7fdbbb7fe700 1 -- 172.21.15.76:0/1088366061 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdbc0004390 con 0x56478c557f20 2024-06-02T04:49:45.013 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.001+0000 7fdbbb7fe700 1 -- 172.21.15.76:0/1088366061 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc0019710 con 0x56478c557f20 2024-06-02T04:49:45.013 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.001+0000 7fdbe3956b80 1 -- 172.21.15.76:0/1088366061 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56478c557f20 msgr2=0x56478c5583a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:45.013 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.001+0000 7fdbe3956b80 1 --2- 172.21.15.76:0/1088366061 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56478c557f20 0x56478c5583a0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fdbc0009d00 tx=0x7fdbc0011720 comp rx=0 tx=0).stop 2024-06-02T04:49:45.013 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.001+0000 7fdbe3956b80 1 -- 172.21.15.76:0/1088366061 shutdown_connections 2024-06-02T04:49:45.013 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.001+0000 7fdbe3956b80 1 --2- 172.21.15.76:0/1088366061 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56478c5588e0 0x56478c558d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:45.013 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.001+0000 7fdbe3956b80 1 --2- 172.21.15.76:0/1088366061 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56478c5575c0 0x56478c5579e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:45.013 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.001+0000 7fdbe3956b80 1 --2- 172.21.15.76:0/1088366061 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56478c557f20 0x56478c5583a0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:45.014 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.001+0000 7fdbe3956b80 1 -- 172.21.15.76:0/1088366061 >> 172.21.15.76:0/1088366061 conn(0x56478c4b5290 msgr2=0x56478c551e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:45.014 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.001+0000 7fdbe3956b80 1 -- 172.21.15.76:0/1088366061 shutdown_connections 2024-06-02T04:49:45.014 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.001+0000 7fdbe3956b80 1 -- 172.21.15.76:0/1088366061 wait complete. 2024-06-02T04:49:45.014 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.002+0000 7fdbe3956b80 1 -- start start 2024-06-02T04:49:45.014 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.002+0000 7fdbe3956b80 1 Processor -- start 2024-06-02T04:49:45.014 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.002+0000 7fdbe3956b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56478c5575c0 0x56478c560df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:45.014 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.002+0000 7fdbe3956b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56478c557f20 0x56478c561330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:45.014 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.002+0000 7fdbe3956b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56478c5588e0 0x56478c568370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:45.014 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.002+0000 7fdbe3956b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x56478c4435e0 con 0x56478c5588e0 2024-06-02T04:49:45.014 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.002+0000 7fdbe3956b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x56478c443280 con 0x56478c5575c0 2024-06-02T04:49:45.014 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.002+0000 7fdbe3956b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x56478c32a720 con 0x56478c557f20 2024-06-02T04:49:45.014 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.002+0000 7fdbe3956b80 10 client.0 _ll_register_callbacks cb 0x56478c44cbb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:49:45.014 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.002+0000 7fdbd5d38700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56478c5588e0 0x56478c568370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:45.015 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.002+0000 7fdbd5d38700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56478c5588e0 0x56478c568370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:57972/0 (socket says 172.21.15.76:57972) 2024-06-02T04:49:45.015 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.002+0000 7fdbd5d38700 1 -- 172.21.15.76:0/3600972622 learned_addr learned my addr 172.21.15.76:0/3600972622 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:49:45.015 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.003+0000 7fdbd4d36700 1 --2- 172.21.15.76:0/3600972622 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56478c557f20 0x56478c561330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:45.015 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.003+0000 7fdbd5537700 1 --2- 172.21.15.76:0/3600972622 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56478c5575c0 0x56478c560df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:45.015 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.003+0000 7fdbd5d38700 1 -- 172.21.15.76:0/3600972622 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56478c557f20 msgr2=0x56478c561330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:49:45.015 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.003+0000 7fdbd5d38700 1 --2- 172.21.15.76:0/3600972622 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56478c557f20 0x56478c561330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:45.015 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.003+0000 7fdbd5d38700 1 -- 172.21.15.76:0/3600972622 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56478c5575c0 msgr2=0x56478c560df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:49:45.015 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.003+0000 7fdbd5d38700 1 --2- 172.21.15.76:0/3600972622 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56478c5575c0 0x56478c560df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:45.015 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.003+0000 7fdbd5d38700 1 -- 172.21.15.76:0/3600972622 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbc0009960 con 0x56478c5588e0 2024-06-02T04:49:45.015 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.003+0000 7fdbd5d38700 1 --2- 172.21.15.76:0/3600972622 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56478c5588e0 0x56478c568370 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fdbc80cb4f0 tx=0x7fdbc809aa90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56d08b854faf04bd server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:45.015 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.003+0000 7fdbb8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-06-02T04:49:45.015 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.003+0000 7fdbb8ff9700 1 -- 172.21.15.76:0/3600972622 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc809a5c0 con 0x56478c5588e0 2024-06-02T04:49:45.015 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.003+0000 7fdbb8ff9700 1 -- 172.21.15.76:0/3600972622 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fdbc8009480 con 0x56478c5588e0 2024-06-02T04:49:45.015 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.003+0000 7fdbe3956b80 1 -- 172.21.15.76:0/3600972622 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56478c4002f0 con 0x56478c5588e0 2024-06-02T04:49:45.016 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.003+0000 7fdbb8ff9700 1 -- 172.21.15.76:0/3600972622 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdbc809aed0 con 0x56478c5588e0 2024-06-02T04:49:45.016 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.003+0000 7fdbe3956b80 10 client.15573 fetch_fsmap learned FSMap version 25 2024-06-02T04:49:45.016 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.003+0000 7fdbe3956b80 1 -- 172.21.15.76:0/3600972622 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x56478c2d4be0 con 0x56478c5588e0 2024-06-02T04:49:45.016 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.004+0000 7fdbb8ff9700 1 -- 172.21.15.76:0/3600972622 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdbc8060e90 con 0x56478c5588e0 2024-06-02T04:49:45.016 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.004+0000 7fdbb8ff9700 1 -- 172.21.15.76:0/3600972622 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 25) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fdbc80a2e30 con 0x56478c5588e0 2024-06-02T04:49:45.016 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.004+0000 7fdbe3956b80 10 client.15573 fetch_fsmap finished waiting for FSMap version 25 2024-06-02T04:49:45.016 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.004+0000 7fdbe3956b80 10 client.15573 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-06-02T04:49:45.016 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.004+0000 7fdbe3956b80 20 client.15573 populate_metadata read hostname 'smithi076' 2024-06-02T04:49:45.016 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.004+0000 7fdbe3956b80 1 --2- 172.21.15.76:0/3600972622 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x56478c56c9c0 0x56478c56edb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:45.016 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.004+0000 7fdbe3956b80 4 client.15573 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T04:49:45.016 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.004+0000 7fdbe3956b80 1 -- 172.21.15.76:0/3600972622 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56478c526890 con 0x56478c56c9c0 2024-06-02T04:49:45.016 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.004+0000 7fdbd5537700 1 --2- 172.21.15.76:0/3600972622 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x56478c56c9c0 0x56478c56edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:45.016 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.004+0000 7fdbd5537700 1 --2- 172.21.15.76:0/3600972622 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x56478c56c9c0 0x56478c56edb0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=74151f3bdd187aa9 server_cookie=74e3152cfd7be626 in_seq=0 out_seq=0 2024-06-02T04:49:45.016 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.004+0000 7fdbb8ff9700 10 client.15573 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:49:45.017 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.005+0000 7fdbb8ff9700 1 -- 172.21.15.76:0/3600972622 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56478c526890 con 0x56478c56c9c0 2024-06-02T04:49:45.017 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.005+0000 7fdbb8ff9700 10 client.15573 handle_command_reply: tid=0 2024-06-02T04:49:45.017 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.005+0000 7fdbe3956b80 1 client.15573 shutdown 2024-06-02T04:49:45.017 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.005+0000 7fdbe3956b80 1 -- 172.21.15.76:0/3600972622 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56478c5588e0 msgr2=0x56478c568370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:45.017 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.005+0000 7fdbe3956b80 1 --2- 172.21.15.76:0/3600972622 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56478c5588e0 0x56478c568370 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fdbc80cb4f0 tx=0x7fdbc809aa90 comp rx=0 tx=0).stop 2024-06-02T04:49:45.017 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.005+0000 7fdbe3956b80 1 -- 172.21.15.76:0/3600972622 shutdown_connections 2024-06-02T04:49:45.017 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.005+0000 7fdbe3956b80 1 --2- 172.21.15.76:0/3600972622 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x56478c56c9c0 0x56478c56edb0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:45.017 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.005+0000 7fdbe3956b80 1 --2- 172.21.15.76:0/3600972622 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56478c5588e0 0x56478c568370 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:45.017 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.005+0000 7fdbe3956b80 1 --2- 172.21.15.76:0/3600972622 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56478c5575c0 0x56478c560df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:45.017 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.005+0000 7fdbb8ff9700 0 client.15573 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:49:45.017 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.005+0000 7fdbe3956b80 1 --2- 172.21.15.76:0/3600972622 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56478c557f20 0x56478c561330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:45.017 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.005+0000 7fdbe3956b80 1 -- 172.21.15.76:0/3600972622 >> 172.21.15.76:0/3600972622 conn(0x56478c4b5290 msgr2=0x56478c551620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:45.017 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.005+0000 7fdbe3956b80 1 -- 172.21.15.76:0/3600972622 shutdown_connections 2024-06-02T04:49:45.018 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.005+0000 7fdbe3956b80 1 -- 172.21.15.76:0/3600972622 wait complete. 2024-06-02T04:49:45.018 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.006+0000 7fdbe3956b80 20 client.15573 trim_cache size 0 max 16384 2024-06-02T04:49:45.025 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.023+0000 7fdbe3956b80 1 Processor -- start 2024-06-02T04:49:45.025 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.024+0000 7fdbe3956b80 1 -- start start 2024-06-02T04:49:45.025 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.024+0000 7fdbe3956b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56478c5575c0 0x56478c551e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:45.025 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.024+0000 7fdbe3956b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56478c557f20 0x56478c552370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:45.025 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.024+0000 7fdbe3956b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56478c5588e0 0x56478c568300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:45.025 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.024+0000 7fdbe3956b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x56478c55fe30 con 0x56478c557f20 2024-06-02T04:49:45.025 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.024+0000 7fdbe3956b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x56478c54a0c0 con 0x56478c5588e0 2024-06-02T04:49:45.026 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.024+0000 7fdbe3956b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x56478c560300 con 0x56478c5575c0 2024-06-02T04:49:45.026 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.024+0000 7fdbd4d36700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56478c557f20 0x56478c552370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:45.026 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.024+0000 7fdbd5d38700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56478c5588e0 0x56478c568300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:45.026 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.024+0000 7fdbd4d36700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56478c557f20 0x56478c552370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:57982/0 (socket says 172.21.15.76:57982) 2024-06-02T04:49:45.026 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.024+0000 7fdbd5537700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56478c5575c0 0x56478c551e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:45.026 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.024+0000 7fdbd4d36700 1 -- 172.21.15.76:0/1515587388 learned_addr learned my addr 172.21.15.76:0/1515587388 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:49:45.026 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.024+0000 7fdbd5537700 1 -- 172.21.15.76:0/1515587388 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56478c5588e0 msgr2=0x56478c568300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:49:45.026 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.024+0000 7fdbd5537700 1 --2- 172.21.15.76:0/1515587388 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56478c5588e0 0x56478c568300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:45.026 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.024+0000 7fdbd5537700 1 -- 172.21.15.76:0/1515587388 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56478c557f20 msgr2=0x56478c552370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:49:45.026 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.024+0000 7fdbd5537700 1 --2- 172.21.15.76:0/1515587388 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56478c557f20 0x56478c552370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:45.026 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.024+0000 7fdbd5537700 1 -- 172.21.15.76:0/1515587388 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56478c46d5e0 con 0x56478c5575c0 2024-06-02T04:49:45.026 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.024+0000 7fdbd5d38700 1 --2- 172.21.15.76:0/1515587388 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56478c5588e0 0x56478c568300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T04:49:45.026 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.025+0000 7fdbd5537700 1 --2- 172.21.15.76:0/1515587388 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56478c5575c0 0x56478c551e30 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x56478c443390 tx=0x7fdbcc013000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=97fd780ba3b53eeb server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:45.027 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.025+0000 7fdbbbfff700 1 -- 172.21.15.76:0/1515587388 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbcc025070 con 0x56478c5575c0 2024-06-02T04:49:45.027 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.025+0000 7fdbbbfff700 1 -- 172.21.15.76:0/1515587388 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdbcc015070 con 0x56478c5575c0 2024-06-02T04:49:45.027 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.025+0000 7fdbbbfff700 1 -- 172.21.15.76:0/1515587388 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbcc027570 con 0x56478c5575c0 2024-06-02T04:49:45.031 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.025+0000 7fdbe3956b80 1 -- 172.21.15.76:0/1515587388 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56478c5575c0 msgr2=0x56478c551e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:45.031 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.025+0000 7fdbe3956b80 1 --2- 172.21.15.76:0/1515587388 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56478c5575c0 0x56478c551e30 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x56478c443390 tx=0x7fdbcc013000 comp rx=0 tx=0).stop 2024-06-02T04:49:45.031 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.025+0000 7fdbe3956b80 1 -- 172.21.15.76:0/1515587388 shutdown_connections 2024-06-02T04:49:45.031 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.025+0000 7fdbe3956b80 1 --2- 172.21.15.76:0/1515587388 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56478c5588e0 0x56478c568300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:45.031 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.025+0000 7fdbe3956b80 1 --2- 172.21.15.76:0/1515587388 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56478c5575c0 0x56478c551e30 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:45.031 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.025+0000 7fdbe3956b80 1 --2- 172.21.15.76:0/1515587388 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56478c557f20 0x56478c552370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:45.031 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.025+0000 7fdbe3956b80 1 -- 172.21.15.76:0/1515587388 >> 172.21.15.76:0/1515587388 conn(0x56478c4b5290 msgr2=0x56478c558cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:45.031 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.025+0000 7fdbe3956b80 1 -- 172.21.15.76:0/1515587388 shutdown_connections 2024-06-02T04:49:45.032 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.026+0000 7fdbe3956b80 1 -- 172.21.15.76:0/1515587388 wait complete. 2024-06-02T04:49:45.032 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.026+0000 7fdbe3956b80 1 -- start start 2024-06-02T04:49:45.032 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.026+0000 7fdbe3956b80 1 Processor -- start 2024-06-02T04:49:45.032 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.026+0000 7fdbe3956b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56478c5575c0 0x56478c5650d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:45.032 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.026+0000 7fdbe3956b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56478c557f20 0x56478c565610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:45.032 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.026+0000 7fdbe3956b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56478c5588e0 0x56478c5c2e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:45.032 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.026+0000 7fdbe3956b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x56478c565c30 con 0x56478c5575c0 2024-06-02T04:49:45.032 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.026+0000 7fdbe3956b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x56478c5c33c0 con 0x56478c557f20 2024-06-02T04:49:45.032 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.026+0000 7fdbe3956b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x56478c5c3500 con 0x56478c5588e0 2024-06-02T04:49:45.032 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.026+0000 7fdbe3956b80 10 client.0 _ll_register_callbacks cb 0x56478c44cbb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:49:45.032 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.026+0000 7fdbd5537700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56478c5575c0 0x56478c5650d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:45.032 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.026+0000 7fdbd5537700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56478c5575c0 0x56478c5650d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:57988/0 (socket says 172.21.15.76:57988) 2024-06-02T04:49:45.032 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.026+0000 7fdbd5537700 1 -- 172.21.15.76:0/243220118 learned_addr learned my addr 172.21.15.76:0/243220118 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:49:45.032 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.027+0000 7fdbd4d36700 1 --2- 172.21.15.76:0/243220118 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56478c557f20 0x56478c565610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:45.033 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.027+0000 7fdbd5d38700 1 --2- 172.21.15.76:0/243220118 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56478c5588e0 0x56478c5c2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:45.033 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.027+0000 7fdbd5537700 1 -- 172.21.15.76:0/243220118 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56478c5588e0 msgr2=0x56478c5c2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:49:45.033 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.027+0000 7fdbd5537700 1 --2- 172.21.15.76:0/243220118 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56478c5588e0 0x56478c5c2e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:45.033 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.027+0000 7fdbd5537700 1 -- 172.21.15.76:0/243220118 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56478c557f20 msgr2=0x56478c565610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:49:45.033 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.027+0000 7fdbd5537700 1 --2- 172.21.15.76:0/243220118 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56478c557f20 0x56478c565610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:45.033 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.027+0000 7fdbd5537700 1 -- 172.21.15.76:0/243220118 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56478c2d4be0 con 0x56478c5575c0 2024-06-02T04:49:45.033 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.027+0000 7fdbd4d36700 1 --2- 172.21.15.76:0/243220118 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56478c557f20 0x56478c565610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:49:45.033 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.027+0000 7fdbd5d38700 1 --2- 172.21.15.76:0/243220118 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56478c5588e0 0x56478c5c2e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:49:45.033 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.027+0000 7fdbd5537700 1 --2- 172.21.15.76:0/243220118 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56478c5575c0 0x56478c5650d0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc011700 tx=0x7fdbcc021860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39e79508be356e4c server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:45.033 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.027+0000 7fdbb8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-06-02T04:49:45.033 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.027+0000 7fdbb8ff9700 1 -- 172.21.15.76:0/243220118 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbcc025070 con 0x56478c5575c0 2024-06-02T04:49:45.033 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.027+0000 7fdbb8ff9700 1 -- 172.21.15.76:0/243220118 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fdbcc017070 con 0x56478c5575c0 2024-06-02T04:49:45.033 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.027+0000 7fdbe3956b80 1 -- 172.21.15.76:0/243220118 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdbc0004390 con 0x56478c5575c0 2024-06-02T04:49:45.034 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.027+0000 7fdbb8ff9700 1 -- 172.21.15.76:0/243220118 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdbcc021e40 con 0x56478c5575c0 2024-06-02T04:49:45.034 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.027+0000 7fdbe3956b80 10 client.15579 fetch_fsmap learned FSMap version 25 2024-06-02T04:49:45.034 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.027+0000 7fdbe3956b80 1 -- 172.21.15.76:0/243220118 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x7fdbcc011960 con 0x56478c5575c0 2024-06-02T04:49:45.034 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.027+0000 7fdbb8ff9700 1 -- 172.21.15.76:0/243220118 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdbc0004390 con 0x56478c5575c0 2024-06-02T04:49:45.034 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.028+0000 7fdbb8ff9700 1 -- 172.21.15.76:0/243220118 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 25) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fdbcc005590 con 0x56478c5575c0 2024-06-02T04:49:45.034 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.028+0000 7fdbe3956b80 10 client.15579 fetch_fsmap finished waiting for FSMap version 25 2024-06-02T04:49:45.034 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.028+0000 7fdbe3956b80 10 client.15579 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-06-02T04:49:45.034 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.028+0000 7fdbe3956b80 20 client.15579 populate_metadata read hostname 'smithi076' 2024-06-02T04:49:45.034 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.028+0000 7fdbe3956b80 1 --2- 172.21.15.76:0/243220118 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x56478c5c4e90 0x56478c5c72b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:45.034 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.028+0000 7fdbe3956b80 4 client.15579 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-06-02T04:49:45.034 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.028+0000 7fdbe3956b80 1 -- 172.21.15.76:0/243220118 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x56478c49ff40 con 0x56478c5c4e90 2024-06-02T04:49:45.034 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.028+0000 7fdbd4d36700 1 --2- 172.21.15.76:0/243220118 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x56478c5c4e90 0x56478c5c72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:45.034 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.029+0000 7fdbb8ff9700 10 client.15579 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:49:45.034 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.029+0000 7fdbd4d36700 1 --2- 172.21.15.76:0/243220118 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x56478c5c4e90 0x56478c5c72b0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dffc1e1ec250157 server_cookie=19d340619102dcd3 in_seq=0 out_seq=0 2024-06-02T04:49:45.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.030+0000 7fdbb8ff9700 1 -- 172.21.15.76:0/243220118 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x56478c49ff40 con 0x56478c5c4e90 2024-06-02T04:49:45.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.030+0000 7fdbb8ff9700 10 client.15579 handle_command_reply: tid=0 2024-06-02T04:49:45.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.030+0000 7fdbe3956b80 1 client.15579 shutdown 2024-06-02T04:49:45.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.030+0000 7fdbe3956b80 1 -- 172.21.15.76:0/243220118 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56478c5575c0 msgr2=0x56478c5650d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:45.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.030+0000 7fdbe3956b80 1 --2- 172.21.15.76:0/243220118 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56478c5575c0 0x56478c5650d0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc011700 tx=0x7fdbcc021860 comp rx=0 tx=0).stop 2024-06-02T04:49:45.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.030+0000 7fdbe3956b80 1 -- 172.21.15.76:0/243220118 shutdown_connections 2024-06-02T04:49:45.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.030+0000 7fdbe3956b80 1 --2- 172.21.15.76:0/243220118 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x56478c5c4e90 0x56478c5c72b0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:45.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.030+0000 7fdbe3956b80 1 --2- 172.21.15.76:0/243220118 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56478c5588e0 0x56478c5c2e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:45.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.030+0000 7fdbb8ff9700 0 client.15579 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:49:45.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.030+0000 7fdbe3956b80 1 --2- 172.21.15.76:0/243220118 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56478c5575c0 0x56478c5650d0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:45.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.030+0000 7fdbe3956b80 1 --2- 172.21.15.76:0/243220118 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56478c557f20 0x56478c565610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:45.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.030+0000 7fdbe3956b80 1 -- 172.21.15.76:0/243220118 >> 172.21.15.76:0/243220118 conn(0x56478c4b5290 msgr2=0x56478c551e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:45.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.030+0000 7fdbe3956b80 1 -- 172.21.15.76:0/243220118 shutdown_connections 2024-06-02T04:49:45.036 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.030+0000 7fdbe3956b80 1 -- 172.21.15.76:0/243220118 wait complete. 2024-06-02T04:49:45.036 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.030+0000 7fdbe3956b80 20 client.15579 trim_cache size 0 max 16384 2024-06-02T04:49:45.036 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-06-02T04:49:45.036 INFO:teuthology.orchestra.run.smithi076.stdout: "return_code": 0, 2024-06-02T04:49:45.036 INFO:teuthology.orchestra.run.smithi076.stdout: "scrub_tag": "ac1eefb7-3a8b-4e58-9bb5-f47f56627e35", 2024-06-02T04:49:45.036 INFO:teuthology.orchestra.run.smithi076.stdout: "mode": "asynchronous" 2024-06-02T04:49:45.036 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-06-02T04:49:45.037 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.031+0000 7fdbd779b700 1 -- 172.21.15.76:0/1758643379 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fdbbc0a1120 msgr2=0x7fdbbc0a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:45.037 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.031+0000 7fdbd779b700 1 --2- 172.21.15.76:0/1758643379 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fdbbc0a1120 0x7fdbbc0a35e0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fdbd0067d30 tx=0x7fdbcc007400 comp rx=0 tx=0).stop 2024-06-02T04:49:45.037 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.031+0000 7fdbd779b700 1 -- 172.21.15.76:0/1758643379 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdbd0102c50 msgr2=0x7fdbd01007a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:45.037 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.031+0000 7fdbd779b700 1 --2- 172.21.15.76:0/1758643379 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdbd0102c50 0x7fdbd01007a0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fdbc800b780 tx=0x7fdbc800bcc0 comp rx=0 tx=0).stop 2024-06-02T04:49:45.037 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.031+0000 7fdbd779b700 1 -- 172.21.15.76:0/1758643379 shutdown_connections 2024-06-02T04:49:45.037 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.031+0000 7fdbd779b700 1 --2- 172.21.15.76:0/1758643379 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdbd0102c50 0x7fdbd01007a0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:45.037 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.031+0000 7fdbd779b700 1 --2- 172.21.15.76:0/1758643379 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdbd00ff240 0x7fdbd0101bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:45.038 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.031+0000 7fdbd779b700 1 --2- 172.21.15.76:0/1758643379 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fdbbc0a1120 0x7fdbbc0a35e0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:45.038 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.031+0000 7fdbd779b700 1 --2- 172.21.15.76:0/1758643379 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdbd01022b0 0x7fdbd0100260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:45.038 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.031+0000 7fdbd779b700 1 -- 172.21.15.76:0/1758643379 >> 172.21.15.76:0/1758643379 conn(0x7fdbd00fab50 msgr2=0x7fdbd01056d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:45.038 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.031+0000 7fdbd779b700 1 -- 172.21.15.76:0/1758643379 shutdown_connections 2024-06-02T04:49:45.038 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.031+0000 7fdbd779b700 1 -- 172.21.15.76:0/1758643379 wait complete. 2024-06-02T04:49:45.039 DEBUG:teuthology.orchestra.run.smithi076:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- mkdir -m 700 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres/data' 2024-06-02T04:49:45.045 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-06-02T04:49:45.129 DEBUG:teuthology.orchestra.run.smithi076:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo semanage fcontext -a -t postgresql_db_t "/tmp/cephfs/postgres(/.*)?"' 2024-06-02T04:49:45.217 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.214+0000 7f6d6a2d8700 1 -- 172.21.15.76:0/1224413519 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6d64100b70 msgr2=0x7f6d64100ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:45.218 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.214+0000 7f6d6a2d8700 1 --2- 172.21.15.76:0/1224413519 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6d64100b70 0x7f6d64100ff0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f6d5c00b0a0 tx=0x7f6d5c00b3b0 comp rx=0 tx=0).stop 2024-06-02T04:49:45.218 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.214+0000 7f6d6a2d8700 1 -- 172.21.15.76:0/1224413519 shutdown_connections 2024-06-02T04:49:45.218 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.214+0000 7f6d6a2d8700 1 --2- 172.21.15.76:0/1224413519 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6d64100b70 0x7f6d64100ff0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:45.218 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.214+0000 7f6d6a2d8700 1 --2- 172.21.15.76:0/1224413519 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d640ff850 0x7f6d640ffc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:45.218 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.214+0000 7f6d6a2d8700 1 --2- 172.21.15.76:0/1224413519 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6d641001b0 0x7f6d64100630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:45.218 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.214+0000 7f6d6a2d8700 1 -- 172.21.15.76:0/1224413519 >> 172.21.15.76:0/1224413519 conn(0x7f6d640fb3f0 msgr2=0x7f6d640fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:45.218 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.214+0000 7f6d6a2d8700 1 -- 172.21.15.76:0/1224413519 shutdown_connections 2024-06-02T04:49:45.218 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.215+0000 7f6d6a2d8700 1 -- 172.21.15.76:0/1224413519 wait complete. 2024-06-02T04:49:45.218 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.215+0000 7f6d6a2d8700 1 Processor -- start 2024-06-02T04:49:45.218 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.215+0000 7f6d6a2d8700 1 -- start start 2024-06-02T04:49:45.218 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.215+0000 7f6d6a2d8700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6d640ff850 0x7f6d64199090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:45.218 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.215+0000 7f6d6a2d8700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6d641001b0 0x7f6d641995d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:45.219 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.215+0000 7f6d6a2d8700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d64100b70 0x7f6d641a05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:45.219 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.215+0000 7f6d6a2d8700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d641a0bc0 con 0x7f6d641001b0 2024-06-02T04:49:45.219 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.215+0000 7f6d6a2d8700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d641a0d00 con 0x7f6d640ff850 2024-06-02T04:49:45.219 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.215+0000 7f6d6a2d8700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d641a0e90 con 0x7f6d64100b70 2024-06-02T04:49:45.219 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.216+0000 7f6d637fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6d641001b0 0x7f6d641995d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:45.219 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.216+0000 7f6d637fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6d641001b0 0x7f6d641995d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:58006/0 (socket says 172.21.15.76:58006) 2024-06-02T04:49:45.219 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.216+0000 7f6d637fe700 1 -- 172.21.15.76:0/652633988 learned_addr learned my addr 172.21.15.76:0/652633988 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:49:45.219 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.216+0000 7f6d68875700 1 --2- 172.21.15.76:0/652633988 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d64100b70 0x7f6d641a05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:45.219 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.216+0000 7f6d63fff700 1 --2- 172.21.15.76:0/652633988 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6d640ff850 0x7f6d64199090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:45.219 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.216+0000 7f6d637fe700 1 -- 172.21.15.76:0/652633988 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d64100b70 msgr2=0x7f6d641a05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:45.219 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.216+0000 7f6d637fe700 1 --2- 172.21.15.76:0/652633988 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d64100b70 0x7f6d641a05f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:45.219 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.216+0000 7f6d637fe700 1 -- 172.21.15.76:0/652633988 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6d640ff850 msgr2=0x7f6d64199090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:45.219 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.216+0000 7f6d637fe700 1 --2- 172.21.15.76:0/652633988 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6d640ff850 0x7f6d64199090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:45.220 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.216+0000 7f6d637fe700 1 -- 172.21.15.76:0/652633988 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d5c009d00 con 0x7f6d641001b0 2024-06-02T04:49:45.220 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.216+0000 7f6d637fe700 1 --2- 172.21.15.76:0/652633988 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6d641001b0 0x7f6d641995d0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f6d5800c9b0 tx=0x7f6d5800ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:45.220 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.216+0000 7f6d617fa700 1 -- 172.21.15.76:0/652633988 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d58007b00 con 0x7f6d641001b0 2024-06-02T04:49:45.220 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.216+0000 7f6d6a2d8700 1 -- 172.21.15.76:0/652633988 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d641a1170 con 0x7f6d641001b0 2024-06-02T04:49:45.220 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.216+0000 7f6d617fa700 1 -- 172.21.15.76:0/652633988 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6d58007c60 con 0x7f6d641001b0 2024-06-02T04:49:45.220 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.216+0000 7f6d617fa700 1 -- 172.21.15.76:0/652633988 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d58018660 con 0x7f6d641001b0 2024-06-02T04:49:45.220 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.216+0000 7f6d6a2d8700 1 -- 172.21.15.76:0/652633988 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d641a1680 con 0x7f6d641001b0 2024-06-02T04:49:45.226 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.218+0000 7f6d617fa700 1 -- 172.21.15.76:0/652633988 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f6d5800f450 con 0x7f6d641001b0 2024-06-02T04:49:45.226 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.219+0000 7f6d617fa700 1 --2- 172.21.15.76:0/652633988 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f6d4c0a1120 0x7f6d4c0a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:45.227 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.219+0000 7f6d617fa700 1 -- 172.21.15.76:0/652633988 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f6d580ccbe0 con 0x7f6d641001b0 2024-06-02T04:49:45.227 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.219+0000 7f6d63fff700 1 --2- 172.21.15.76:0/652633988 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f6d4c0a1120 0x7f6d4c0a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:45.227 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.219+0000 7f6d63fff700 1 --2- 172.21.15.76:0/652633988 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f6d4c0a1120 0x7f6d4c0a35e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f6d54005950 tx=0x7f6d540058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:45.227 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.220+0000 7f6d76493b80 1 Processor -- start 2024-06-02T04:49:45.227 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.220+0000 7f6d76493b80 1 -- start start 2024-06-02T04:49:45.227 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.220+0000 7f6d76493b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560917871540 0x560917871960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:45.227 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.220+0000 7f6d76493b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560917871ea0 0x560917872320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:45.227 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.220+0000 7f6d76493b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560917872860 0x560917872ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:45.227 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.220+0000 7f6d76493b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609177c8150 con 0x560917871ea0 2024-06-02T04:49:45.227 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.220+0000 7f6d76493b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609177c5b10 con 0x560917871540 2024-06-02T04:49:45.227 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.220+0000 7f6d76493b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609177c1400 con 0x560917872860 2024-06-02T04:49:45.228 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.220+0000 7f6d637fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560917871ea0 0x560917872320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:45.228 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.220+0000 7f6d637fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560917871ea0 0x560917872320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:58022/0 (socket says 172.21.15.76:58022) 2024-06-02T04:49:45.228 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.220+0000 7f6d637fe700 1 -- 172.21.15.76:0/3637242311 learned_addr learned my addr 172.21.15.76:0/3637242311 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:49:45.228 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.221+0000 7f6d63fff700 1 --2- 172.21.15.76:0/3637242311 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560917871540 0x560917871960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:45.228 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.221+0000 7f6d68875700 1 --2- 172.21.15.76:0/3637242311 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560917872860 0x560917872ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:45.228 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.221+0000 7f6d637fe700 1 -- 172.21.15.76:0/3637242311 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560917872860 msgr2=0x560917872ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:49:45.228 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.221+0000 7f6d637fe700 1 --2- 172.21.15.76:0/3637242311 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560917872860 0x560917872ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:45.228 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.221+0000 7f6d637fe700 1 -- 172.21.15.76:0/3637242311 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560917871540 msgr2=0x560917871960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:49:45.228 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.221+0000 7f6d637fe700 1 --2- 172.21.15.76:0/3637242311 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560917871540 0x560917871960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:45.228 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.221+0000 7f6d637fe700 1 -- 172.21.15.76:0/3637242311 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5609176423b0 con 0x560917871ea0 2024-06-02T04:49:45.228 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.221+0000 7f6d637fe700 1 --2- 172.21.15.76:0/3637242311 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560917871ea0 0x560917872320 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f6d58096220 tx=0x7f6d58099990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1b24a64f99d600 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:45.228 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.221+0000 7f6d4a7fc700 1 -- 172.21.15.76:0/3637242311 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d5809a420 con 0x560917871ea0 2024-06-02T04:49:45.228 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.221+0000 7f6d4a7fc700 1 -- 172.21.15.76:0/3637242311 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6d58007dd0 con 0x560917871ea0 2024-06-02T04:49:45.229 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.221+0000 7f6d4a7fc700 1 -- 172.21.15.76:0/3637242311 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d5800f700 con 0x560917871ea0 2024-06-02T04:49:45.229 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.222+0000 7f6d76493b80 1 -- 172.21.15.76:0/3637242311 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560917871ea0 msgr2=0x560917872320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:45.229 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.222+0000 7f6d76493b80 1 --2- 172.21.15.76:0/3637242311 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560917871ea0 0x560917872320 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f6d58096220 tx=0x7f6d58099990 comp rx=0 tx=0).stop 2024-06-02T04:49:45.229 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.222+0000 7f6d76493b80 1 -- 172.21.15.76:0/3637242311 shutdown_connections 2024-06-02T04:49:45.229 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.222+0000 7f6d76493b80 1 --2- 172.21.15.76:0/3637242311 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560917872860 0x560917872ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:45.229 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.222+0000 7f6d76493b80 1 --2- 172.21.15.76:0/3637242311 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560917871540 0x560917871960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:45.229 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.222+0000 7f6d76493b80 1 --2- 172.21.15.76:0/3637242311 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560917871ea0 0x560917872320 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:45.229 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.222+0000 7f6d76493b80 1 -- 172.21.15.76:0/3637242311 >> 172.21.15.76:0/3637242311 conn(0x5609177cf210 msgr2=0x56091786bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:45.229 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.222+0000 7f6d76493b80 1 -- 172.21.15.76:0/3637242311 shutdown_connections 2024-06-02T04:49:45.229 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.222+0000 7f6d76493b80 1 -- 172.21.15.76:0/3637242311 wait complete. 2024-06-02T04:49:45.229 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.222+0000 7f6d76493b80 1 -- start start 2024-06-02T04:49:45.229 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.223+0000 7f6d76493b80 1 Processor -- start 2024-06-02T04:49:45.229 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.223+0000 7f6d76493b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560917871540 0x56091787adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:45.229 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.223+0000 7f6d76493b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560917871ea0 0x56091787b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:45.230 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.223+0000 7f6d76493b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560917872860 0x560917882370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:45.230 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.223+0000 7f6d76493b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x56091775d560 con 0x560917871ea0 2024-06-02T04:49:45.230 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.223+0000 7f6d76493b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x56091775d200 con 0x560917871540 2024-06-02T04:49:45.230 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.223+0000 7f6d76493b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609176446a0 con 0x560917872860 2024-06-02T04:49:45.230 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.223+0000 7f6d76493b80 10 client.0 _ll_register_callbacks cb 0x560917766b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:49:45.230 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.223+0000 7f6d637fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560917871ea0 0x56091787b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:45.230 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.223+0000 7f6d637fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560917871ea0 0x56091787b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:58024/0 (socket says 172.21.15.76:58024) 2024-06-02T04:49:45.230 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.223+0000 7f6d637fe700 1 -- 172.21.15.76:0/509594403 learned_addr learned my addr 172.21.15.76:0/509594403 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:49:45.230 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.223+0000 7f6d63fff700 1 --2- 172.21.15.76:0/509594403 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560917871540 0x56091787adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:45.230 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.223+0000 7f6d68875700 1 --2- 172.21.15.76:0/509594403 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560917872860 0x560917882370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:45.230 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.223+0000 7f6d637fe700 1 -- 172.21.15.76:0/509594403 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560917872860 msgr2=0x560917882370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:49:45.230 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.223+0000 7f6d637fe700 1 --2- 172.21.15.76:0/509594403 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560917872860 0x560917882370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:45.230 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.223+0000 7f6d637fe700 1 -- 172.21.15.76:0/509594403 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560917871540 msgr2=0x56091787adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:49:45.231 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.223+0000 7f6d637fe700 1 --2- 172.21.15.76:0/509594403 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560917871540 0x56091787adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:45.231 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.223+0000 7f6d637fe700 1 -- 172.21.15.76:0/509594403 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d641a1680 con 0x560917871ea0 2024-06-02T04:49:45.231 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.223+0000 7f6d637fe700 1 --2- 172.21.15.76:0/509594403 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560917871ea0 0x56091787b330 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f6d580ca420 tx=0x7f6d5800cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a058cf404bbc5a2a server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:45.231 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.223+0000 7f6d437fe700 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-06-02T04:49:45.231 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.224+0000 7f6d437fe700 1 -- 172.21.15.76:0/509594403 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d58063070 con 0x560917871ea0 2024-06-02T04:49:45.231 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.224+0000 7f6d437fe700 1 -- 172.21.15.76:0/509594403 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f6d58099d20 con 0x560917871ea0 2024-06-02T04:49:45.231 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.224+0000 7f6d76493b80 1 -- 172.21.15.76:0/509594403 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56091771a270 con 0x560917871ea0 2024-06-02T04:49:45.231 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.224+0000 7f6d437fe700 1 -- 172.21.15.76:0/509594403 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6d5809a420 con 0x560917871ea0 2024-06-02T04:49:45.231 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.224+0000 7f6d76493b80 10 client.15591 fetch_fsmap learned FSMap version 25 2024-06-02T04:49:45.231 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.224+0000 7f6d76493b80 1 -- 172.21.15.76:0/509594403 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x5609175eeb60 con 0x560917871ea0 2024-06-02T04:49:45.231 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.224+0000 7f6d437fe700 1 -- 172.21.15.76:0/509594403 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56091771a270 con 0x560917871ea0 2024-06-02T04:49:45.231 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.224+0000 7f6d437fe700 1 -- 172.21.15.76:0/509594403 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 25) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f6d58099210 con 0x560917871ea0 2024-06-02T04:49:45.231 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.224+0000 7f6d76493b80 10 client.15591 fetch_fsmap finished waiting for FSMap version 25 2024-06-02T04:49:45.231 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.224+0000 7f6d76493b80 10 client.15591 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-06-02T04:49:45.232 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.224+0000 7f6d76493b80 20 client.15591 populate_metadata read hostname 'smithi076' 2024-06-02T04:49:45.232 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.224+0000 7f6d76493b80 1 --2- 172.21.15.76:0/509594403 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x560917886610 0x560917888a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:45.232 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.224+0000 7f6d76493b80 4 client.15591 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T04:49:45.232 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.224+0000 7f6d76493b80 1 -- 172.21.15.76:0/509594403 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560917840810 con 0x560917886610 2024-06-02T04:49:45.232 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.224+0000 7f6d63fff700 1 --2- 172.21.15.76:0/509594403 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x560917886610 0x560917888a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:45.232 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.225+0000 7f6d437fe700 10 client.15591 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:49:45.232 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.225+0000 7f6d63fff700 1 --2- 172.21.15.76:0/509594403 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x560917886610 0x560917888a30 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e68f21a4e39aa5ae server_cookie=ace4ea3c1e0b27e1 in_seq=0 out_seq=0 2024-06-02T04:49:45.232 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.225+0000 7f6d437fe700 1 -- 172.21.15.76:0/509594403 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x560917840810 con 0x560917886610 2024-06-02T04:49:45.232 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.225+0000 7f6d437fe700 10 client.15591 handle_command_reply: tid=0 2024-06-02T04:49:45.232 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.225+0000 7f6d76493b80 1 client.15591 shutdown 2024-06-02T04:49:45.232 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.226+0000 7f6d76493b80 1 -- 172.21.15.76:0/509594403 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560917871ea0 msgr2=0x56091787b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:45.232 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.226+0000 7f6d76493b80 1 --2- 172.21.15.76:0/509594403 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560917871ea0 0x56091787b330 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f6d580ca420 tx=0x7f6d5800cf70 comp rx=0 tx=0).stop 2024-06-02T04:49:45.232 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.226+0000 7f6d76493b80 1 -- 172.21.15.76:0/509594403 shutdown_connections 2024-06-02T04:49:45.233 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.226+0000 7f6d76493b80 1 --2- 172.21.15.76:0/509594403 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x560917886610 0x560917888a30 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:45.233 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.226+0000 7f6d76493b80 1 --2- 172.21.15.76:0/509594403 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560917872860 0x560917882370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:45.233 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.226+0000 7f6d76493b80 1 --2- 172.21.15.76:0/509594403 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560917871540 0x56091787adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:45.233 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.226+0000 7f6d437fe700 0 client.15591 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:49:45.233 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.226+0000 7f6d76493b80 1 --2- 172.21.15.76:0/509594403 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560917871ea0 0x56091787b330 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:45.233 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.226+0000 7f6d76493b80 1 -- 172.21.15.76:0/509594403 >> 172.21.15.76:0/509594403 conn(0x5609177cf210 msgr2=0x56091786b5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:45.233 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.226+0000 7f6d76493b80 1 -- 172.21.15.76:0/509594403 shutdown_connections 2024-06-02T04:49:45.233 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.226+0000 7f6d76493b80 1 -- 172.21.15.76:0/509594403 wait complete. 2024-06-02T04:49:45.233 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.226+0000 7f6d76493b80 20 client.15591 trim_cache size 0 max 16384 2024-06-02T04:49:45.263 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.261+0000 7f6d76493b80 1 Processor -- start 2024-06-02T04:49:45.263 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.261+0000 7f6d76493b80 1 -- start start 2024-06-02T04:49:45.263 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.261+0000 7f6d76493b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560917871540 0x56091787a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:45.263 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.261+0000 7f6d76493b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560917871ea0 0x560917882330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:45.263 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.261+0000 7f6d76493b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560917872860 0x56091788d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:45.263 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.261+0000 7f6d76493b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x56091787a960 con 0x560917871540 2024-06-02T04:49:45.263 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.261+0000 7f6d76493b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x560917868dc0 con 0x560917872860 2024-06-02T04:49:45.263 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.262+0000 7f6d76493b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x56091787ba70 con 0x560917871ea0 2024-06-02T04:49:45.263 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.262+0000 7f6d63fff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560917871540 0x56091787a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:45.263 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.262+0000 7f6d63fff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560917871540 0x56091787a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:58032/0 (socket says 172.21.15.76:58032) 2024-06-02T04:49:45.264 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.262+0000 7f6d63fff700 1 -- 172.21.15.76:0/1056794974 learned_addr learned my addr 172.21.15.76:0/1056794974 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:49:45.264 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.262+0000 7f6d68875700 1 --2- 172.21.15.76:0/1056794974 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560917872860 0x56091788d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:45.264 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.262+0000 7f6d637fe700 1 --2- 172.21.15.76:0/1056794974 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560917871ea0 0x560917882330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:45.264 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.262+0000 7f6d63fff700 1 -- 172.21.15.76:0/1056794974 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560917871ea0 msgr2=0x560917882330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:49:45.264 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.262+0000 7f6d63fff700 1 --2- 172.21.15.76:0/1056794974 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560917871ea0 0x560917882330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:45.264 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.262+0000 7f6d63fff700 1 -- 172.21.15.76:0/1056794974 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560917872860 msgr2=0x56091788d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:49:45.264 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.262+0000 7f6d63fff700 1 --2- 172.21.15.76:0/1056794974 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560917872860 0x56091788d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:45.264 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.262+0000 7f6d63fff700 1 -- 172.21.15.76:0/1056794974 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560917787560 con 0x560917871540 2024-06-02T04:49:45.264 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.262+0000 7f6d68875700 1 --2- 172.21.15.76:0/1056794974 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560917872860 0x56091788d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:49:45.264 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.262+0000 7f6d637fe700 1 --2- 172.21.15.76:0/1056794974 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560917871ea0 0x560917882330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:49:45.264 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.262+0000 7f6d63fff700 1 --2- 172.21.15.76:0/1056794974 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560917871540 0x56091787a370 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x560917889350 tx=0x7f6d54012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fc91958181c0c87 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:45.264 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.262+0000 7f6d4affd700 1 -- 172.21.15.76:0/1056794974 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d54024040 con 0x560917871540 2024-06-02T04:49:45.264 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.262+0000 7f6d4affd700 1 -- 172.21.15.76:0/1056794974 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6d5402a8a0 con 0x560917871540 2024-06-02T04:49:45.265 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.262+0000 7f6d4affd700 1 -- 172.21.15.76:0/1056794974 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d5401faa0 con 0x560917871540 2024-06-02T04:49:45.269 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.263+0000 7f6d76493b80 1 -- 172.21.15.76:0/1056794974 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560917871540 msgr2=0x56091787a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:45.269 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.263+0000 7f6d76493b80 1 --2- 172.21.15.76:0/1056794974 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560917871540 0x56091787a370 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x560917889350 tx=0x7f6d54012000 comp rx=0 tx=0).stop 2024-06-02T04:49:45.269 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.263+0000 7f6d76493b80 1 -- 172.21.15.76:0/1056794974 shutdown_connections 2024-06-02T04:49:45.269 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.263+0000 7f6d76493b80 1 --2- 172.21.15.76:0/1056794974 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560917872860 0x56091788d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:45.269 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.263+0000 7f6d76493b80 1 --2- 172.21.15.76:0/1056794974 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560917871540 0x56091787a370 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:45.269 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.263+0000 7f6d76493b80 1 --2- 172.21.15.76:0/1056794974 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560917871ea0 0x560917882330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:45.269 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.263+0000 7f6d76493b80 1 -- 172.21.15.76:0/1056794974 >> 172.21.15.76:0/1056794974 conn(0x5609177cf210 msgr2=0x560917868210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:45.269 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.263+0000 7f6d76493b80 1 -- 172.21.15.76:0/1056794974 shutdown_connections 2024-06-02T04:49:45.269 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.263+0000 7f6d76493b80 1 -- 172.21.15.76:0/1056794974 wait complete. 2024-06-02T04:49:45.269 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.263+0000 7f6d76493b80 1 -- start start 2024-06-02T04:49:45.269 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.264+0000 7f6d76493b80 1 Processor -- start 2024-06-02T04:49:45.270 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.264+0000 7f6d76493b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560917871540 0x56091787dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:45.270 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.264+0000 7f6d76493b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560917871ea0 0x56091787e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:45.270 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.264+0000 7f6d76493b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560917872860 0x560917881120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:45.270 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.264+0000 7f6d76493b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x560917881660 con 0x560917871ea0 2024-06-02T04:49:45.270 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.264+0000 7f6d76493b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609178817d0 con 0x560917871540 2024-06-02T04:49:45.270 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.264+0000 7f6d76493b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x560917881990 con 0x560917872860 2024-06-02T04:49:45.270 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.264+0000 7f6d76493b80 10 client.0 _ll_register_callbacks cb 0x560917766b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:49:45.270 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.264+0000 7f6d637fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560917871ea0 0x56091787e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:45.270 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.264+0000 7f6d637fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560917871ea0 0x56091787e1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:58046/0 (socket says 172.21.15.76:58046) 2024-06-02T04:49:45.270 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.264+0000 7f6d637fe700 1 -- 172.21.15.76:0/1896380788 learned_addr learned my addr 172.21.15.76:0/1896380788 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:49:45.270 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.264+0000 7f6d63fff700 1 --2- 172.21.15.76:0/1896380788 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560917871540 0x56091787dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:45.271 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.264+0000 7f6d68875700 1 --2- 172.21.15.76:0/1896380788 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560917872860 0x560917881120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:45.271 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.264+0000 7f6d637fe700 1 -- 172.21.15.76:0/1896380788 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560917872860 msgr2=0x560917881120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:49:45.271 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.264+0000 7f6d637fe700 1 --2- 172.21.15.76:0/1896380788 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560917872860 0x560917881120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:45.271 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.264+0000 7f6d637fe700 1 -- 172.21.15.76:0/1896380788 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560917871540 msgr2=0x56091787dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:49:45.271 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.264+0000 7f6d637fe700 1 --2- 172.21.15.76:0/1896380788 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560917871540 0x56091787dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:45.271 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.264+0000 7f6d637fe700 1 -- 172.21.15.76:0/1896380788 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d5400f9a0 con 0x560917871ea0 2024-06-02T04:49:45.271 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.264+0000 7f6d637fe700 1 --2- 172.21.15.76:0/1896380788 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560917871ea0 0x56091787e1a0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f6d58096790 tx=0x7f6d580982d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17636f5224b5befe server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:45.271 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.264+0000 7f6d437fe700 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-06-02T04:49:45.271 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.265+0000 7f6d437fe700 1 -- 172.21.15.76:0/1896380788 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d580832d0 con 0x560917871ea0 2024-06-02T04:49:45.271 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.265+0000 7f6d437fe700 1 -- 172.21.15.76:0/1896380788 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f6d5809a420 con 0x560917871ea0 2024-06-02T04:49:45.271 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.265+0000 7f6d76493b80 1 -- 172.21.15.76:0/1896380788 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6d58007dd0 con 0x560917871ea0 2024-06-02T04:49:45.271 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.265+0000 7f6d437fe700 1 -- 172.21.15.76:0/1896380788 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6d58063050 con 0x560917871ea0 2024-06-02T04:49:45.271 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.265+0000 7f6d76493b80 10 client.15597 fetch_fsmap learned FSMap version 25 2024-06-02T04:49:45.272 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.265+0000 7f6d76493b80 1 -- 172.21.15.76:0/1896380788 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x560917646cd0 con 0x560917871ea0 2024-06-02T04:49:45.272 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.265+0000 7f6d437fe700 1 -- 172.21.15.76:0/1896380788 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6d58007dd0 con 0x560917871ea0 2024-06-02T04:49:45.272 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.265+0000 7f6d437fe700 1 -- 172.21.15.76:0/1896380788 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 25) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f6d58098c80 con 0x560917871ea0 2024-06-02T04:49:45.272 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.265+0000 7f6d76493b80 10 client.15597 fetch_fsmap finished waiting for FSMap version 25 2024-06-02T04:49:45.272 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.265+0000 7f6d76493b80 10 client.15597 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-06-02T04:49:45.272 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.265+0000 7f6d76493b80 20 client.15597 populate_metadata read hostname 'smithi076' 2024-06-02T04:49:45.272 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.265+0000 7f6d76493b80 1 --2- 172.21.15.76:0/1896380788 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5609178dd1c0 0x5609178df5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:45.272 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.265+0000 7f6d76493b80 4 client.15597 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-06-02T04:49:45.272 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.265+0000 7f6d76493b80 1 -- 172.21.15.76:0/1896380788 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5609177b9ec0 con 0x5609178dd1c0 2024-06-02T04:49:45.272 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.265+0000 7f6d63fff700 1 --2- 172.21.15.76:0/1896380788 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5609178dd1c0 0x5609178df5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:45.272 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.266+0000 7f6d437fe700 10 client.15597 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:49:45.272 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.266+0000 7f6d63fff700 1 --2- 172.21.15.76:0/1896380788 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5609178dd1c0 0x5609178df5e0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1fd8b3f498bac624 server_cookie=11d158afc6e606ce in_seq=0 out_seq=0 2024-06-02T04:49:45.272 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.266+0000 7f6d437fe700 1 -- 172.21.15.76:0/1896380788 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x5609177b9ec0 con 0x5609178dd1c0 2024-06-02T04:49:45.273 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.266+0000 7f6d437fe700 10 client.15597 handle_command_reply: tid=0 2024-06-02T04:49:45.273 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.266+0000 7f6d76493b80 1 client.15597 shutdown 2024-06-02T04:49:45.273 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.266+0000 7f6d76493b80 1 -- 172.21.15.76:0/1896380788 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560917871ea0 msgr2=0x56091787e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:45.273 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.266+0000 7f6d76493b80 1 --2- 172.21.15.76:0/1896380788 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560917871ea0 0x56091787e1a0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f6d58096790 tx=0x7f6d580982d0 comp rx=0 tx=0).stop 2024-06-02T04:49:45.273 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.266+0000 7f6d76493b80 1 -- 172.21.15.76:0/1896380788 shutdown_connections 2024-06-02T04:49:45.273 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.266+0000 7f6d76493b80 1 --2- 172.21.15.76:0/1896380788 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5609178dd1c0 0x5609178df5e0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:45.273 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.266+0000 7f6d76493b80 1 --2- 172.21.15.76:0/1896380788 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560917872860 0x560917881120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:45.273 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.266+0000 7f6d76493b80 1 --2- 172.21.15.76:0/1896380788 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560917871540 0x56091787dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:45.273 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.266+0000 7f6d437fe700 0 client.15597 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:49:45.273 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.266+0000 7f6d76493b80 1 --2- 172.21.15.76:0/1896380788 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560917871ea0 0x56091787e1a0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:45.273 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.266+0000 7f6d76493b80 1 -- 172.21.15.76:0/1896380788 >> 172.21.15.76:0/1896380788 conn(0x5609177cf210 msgr2=0x56091788d3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:45.273 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.266+0000 7f6d76493b80 1 -- 172.21.15.76:0/1896380788 shutdown_connections 2024-06-02T04:49:45.273 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.266+0000 7f6d76493b80 1 -- 172.21.15.76:0/1896380788 wait complete. 2024-06-02T04:49:45.274 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.267+0000 7f6d76493b80 20 client.15597 trim_cache size 0 max 16384 2024-06-02T04:49:45.274 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-06-02T04:49:45.274 INFO:teuthology.orchestra.run.smithi076.stdout: "status": "IDLE (waiting for more scrubs)", 2024-06-02T04:49:45.274 INFO:teuthology.orchestra.run.smithi076.stdout: "scrubs": { 2024-06-02T04:49:45.274 INFO:teuthology.orchestra.run.smithi076.stdout: "ac1eefb7-3a8b-4e58-9bb5-f47f56627e35": { 2024-06-02T04:49:45.274 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/", 2024-06-02T04:49:45.274 INFO:teuthology.orchestra.run.smithi076.stdout: "tag": "ac1eefb7-3a8b-4e58-9bb5-f47f56627e35", 2024-06-02T04:49:45.274 INFO:teuthology.orchestra.run.smithi076.stdout: "options": "recursive,force" 2024-06-02T04:49:45.274 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T04:49:45.274 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T04:49:45.275 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-06-02T04:49:45.275 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.267+0000 7f6d6a2d8700 1 -- 172.21.15.76:0/652633988 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f6d4c0a1120 msgr2=0x7f6d4c0a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:45.275 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.267+0000 7f6d6a2d8700 1 --2- 172.21.15.76:0/652633988 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f6d4c0a1120 0x7f6d4c0a35e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f6d54005950 tx=0x7f6d540058e0 comp rx=0 tx=0).stop 2024-06-02T04:49:45.275 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.267+0000 7f6d6a2d8700 1 -- 172.21.15.76:0/652633988 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6d641001b0 msgr2=0x7f6d641995d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:45.275 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.267+0000 7f6d6a2d8700 1 --2- 172.21.15.76:0/652633988 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6d641001b0 0x7f6d641995d0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f6d5800c9b0 tx=0x7f6d5800ccc0 comp rx=0 tx=0).stop 2024-06-02T04:49:45.276 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.267+0000 7f6d6a2d8700 1 -- 172.21.15.76:0/652633988 shutdown_connections 2024-06-02T04:49:45.276 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.267+0000 7f6d6a2d8700 1 --2- 172.21.15.76:0/652633988 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d64100b70 0x7f6d641a05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:45.276 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.267+0000 7f6d6a2d8700 1 --2- 172.21.15.76:0/652633988 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f6d4c0a1120 0x7f6d4c0a35e0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:45.276 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.267+0000 7f6d6a2d8700 1 --2- 172.21.15.76:0/652633988 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6d640ff850 0x7f6d64199090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:45.276 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.267+0000 7f6d6a2d8700 1 --2- 172.21.15.76:0/652633988 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6d641001b0 0x7f6d641995d0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:45.276 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.267+0000 7f6d6a2d8700 1 -- 172.21.15.76:0/652633988 >> 172.21.15.76:0/652633988 conn(0x7f6d640fb3f0 msgr2=0x7f6d640fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:45.276 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.267+0000 7f6d6a2d8700 1 -- 172.21.15.76:0/652633988 shutdown_connections 2024-06-02T04:49:45.276 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:49:45.267+0000 7f6d6a2d8700 1 -- 172.21.15.76:0/652633988 wait complete. 2024-06-02T04:49:45.280 INFO:tasks.cephfs.filesystem:scrub status for tag:ac1eefb7-3a8b-4e58-9bb5-f47f56627e35 - {'path': '/', 'tag': 'ac1eefb7-3a8b-4e58-9bb5-f47f56627e35', 'options': 'recursive,force'} 2024-06-02T04:49:45.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:45 smithi076 ceph-mon[42935]: pgmap v271: 129 pgs: 129 active+clean; 645 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-06-02T04:49:45.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:45 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/100266557' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:49:45.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:45 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/4244993615' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:49:45.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:45 smithi076 ceph-mon[42935]: scrub queued for path: / 2024-06-02T04:49:45.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:45 smithi076 ceph-mon[42935]: scrub summary: idle+waiting paths [/] 2024-06-02T04:49:45.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:45 smithi076 ceph-mon[42935]: scrub summary: active paths [/] 2024-06-02T04:49:45.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:45 smithi076 ceph-mon[42935]: scrub summary: idle+waiting paths [/] 2024-06-02T04:49:45.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:45 smithi119 ceph-mon[46633]: pgmap v271: 129 pgs: 129 active+clean; 645 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-06-02T04:49:45.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:45 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/100266557' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:49:45.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:45 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/4244993615' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:49:45.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:45 smithi119 ceph-mon[46633]: scrub queued for path: / 2024-06-02T04:49:45.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:45 smithi119 ceph-mon[46633]: scrub summary: idle+waiting paths [/] 2024-06-02T04:49:45.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:45 smithi119 ceph-mon[46633]: scrub summary: active paths [/] 2024-06-02T04:49:45.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:45 smithi119 ceph-mon[46633]: scrub summary: idle+waiting paths [/] 2024-06-02T04:49:45.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:45 smithi192 ceph-mon[47933]: pgmap v271: 129 pgs: 129 active+clean; 645 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-06-02T04:49:45.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:45 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/100266557' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:49:45.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:45 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/4244993615' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:49:45.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:45 smithi192 ceph-mon[47933]: scrub queued for path: / 2024-06-02T04:49:45.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:45 smithi192 ceph-mon[47933]: scrub summary: idle+waiting paths [/] 2024-06-02T04:49:45.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:45 smithi192 ceph-mon[47933]: scrub summary: active paths [/] 2024-06-02T04:49:45.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:45 smithi192 ceph-mon[47933]: scrub summary: idle+waiting paths [/] 2024-06-02T04:49:47.590 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:47 smithi076 ceph-mon[42935]: pgmap v272: 129 pgs: 129 active+clean; 645 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.4 KiB/s wr, 8 op/s 2024-06-02T04:49:47.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:47 smithi119 ceph-mon[46633]: pgmap v272: 129 pgs: 129 active+clean; 645 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.4 KiB/s wr, 8 op/s 2024-06-02T04:49:47.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:47 smithi192 ceph-mon[47933]: pgmap v272: 129 pgs: 129 active+clean; 645 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.4 KiB/s wr, 8 op/s 2024-06-02T04:49:47.721 DEBUG:teuthology.orchestra.run.smithi076:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo grep -i postgresql /etc/selinux/targeted/contexts/files/file_contexts.local' 2024-06-02T04:49:47.763 INFO:teuthology.orchestra.run.smithi076.stdout:/tmp/cephfs/postgres(/.*)? system_u:object_r:postgresql_db_t:s0 2024-06-02T04:49:47.765 DEBUG:teuthology.orchestra.run.smithi076:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo restorecon -R -v /tmp/cephfs/postgres' 2024-06-02T04:49:47.847 DEBUG:teuthology.orchestra.run.smithi076:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -lZaR /tmp/cephfs/postgres/' 2024-06-02T04:49:47.930 INFO:teuthology.orchestra.run.smithi076.stdout:/tmp/cephfs/postgres/: 2024-06-02T04:49:47.930 INFO:teuthology.orchestra.run.smithi076.stdout:total 2 2024-06-02T04:49:47.931 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 . 2024-06-02T04:49:47.931 INFO:teuthology.orchestra.run.smithi076.stdout:drwxrwxrwt. 3 root root system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 .. 2024-06-02T04:49:47.931 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 data 2024-06-02T04:49:47.931 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:49:47.931 INFO:teuthology.orchestra.run.smithi076.stdout:/tmp/cephfs/postgres/data: 2024-06-02T04:49:47.931 INFO:teuthology.orchestra.run.smithi076.stdout:total 1 2024-06-02T04:49:47.931 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 . 2024-06-02T04:49:47.931 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 .. 2024-06-02T04:49:47.933 DEBUG:teuthology.orchestra.run.smithi076:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo mkdir -p /etc/systemd/system/postgresql.service.d/ && printf '"'"'[Service]\nEnvironment=PGDATA=/tmp/cephfs/postgres/data\nEnvironment=PGLOG=/tmp/cephfs/postgres/pgstartup.log\n'"'"' | sudo tee /etc/systemd/system/postgresql.service.d/env.conf' 2024-06-02T04:49:48.020 INFO:teuthology.orchestra.run.smithi076.stdout:[Service] 2024-06-02T04:49:48.020 INFO:teuthology.orchestra.run.smithi076.stdout:Environment=PGDATA=/tmp/cephfs/postgres/data 2024-06-02T04:49:48.020 INFO:teuthology.orchestra.run.smithi076.stdout:Environment=PGLOG=/tmp/cephfs/postgres/pgstartup.log 2024-06-02T04:49:48.022 DEBUG:teuthology.orchestra.run.smithi076:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- postgresql-setup --initdb' 2024-06-02T04:49:48.101 INFO:teuthology.orchestra.run.smithi076.stderr: * Initializing database in '/tmp/cephfs/postgres/data' 2024-06-02T04:49:49.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:49 smithi119 ceph-mon[46633]: pgmap v273: 129 pgs: 129 active+clean; 645 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.4 KiB/s wr, 7 op/s 2024-06-02T04:49:49.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:49 smithi192 ceph-mon[47933]: pgmap v273: 129 pgs: 129 active+clean; 645 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.4 KiB/s wr, 7 op/s 2024-06-02T04:49:49.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:49 smithi076 ceph-mon[42935]: pgmap v273: 129 pgs: 129 active+clean; 645 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.4 KiB/s wr, 7 op/s 2024-06-02T04:49:51.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:51 smithi119 ceph-mon[46633]: pgmap v274: 129 pgs: 129 active+clean; 1.2 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 51 KiB/s wr, 11 op/s 2024-06-02T04:49:51.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:51 smithi192 ceph-mon[47933]: pgmap v274: 129 pgs: 129 active+clean; 1.2 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 51 KiB/s wr, 11 op/s 2024-06-02T04:49:51.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:51 smithi076 ceph-mon[42935]: pgmap v274: 129 pgs: 129 active+clean; 1.2 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 51 KiB/s wr, 11 op/s 2024-06-02T04:49:53.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:53 smithi119 ceph-mon[46633]: pgmap v275: 129 pgs: 129 active+clean; 20 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 1.8 MiB/s wr, 27 op/s 2024-06-02T04:49:53.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:53 smithi192 ceph-mon[47933]: pgmap v275: 129 pgs: 129 active+clean; 20 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 1.8 MiB/s wr, 27 op/s 2024-06-02T04:49:53.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:53 smithi076 ceph-mon[42935]: pgmap v275: 129 pgs: 129 active+clean; 20 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 1.8 MiB/s wr, 27 op/s 2024-06-02T04:49:55.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:55 smithi119 ceph-mon[46633]: pgmap v276: 129 pgs: 129 active+clean; 22 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 2.0 MiB/s wr, 34 op/s 2024-06-02T04:49:55.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:55 smithi192 ceph-mon[47933]: pgmap v276: 129 pgs: 129 active+clean; 22 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 2.0 MiB/s wr, 34 op/s 2024-06-02T04:49:55.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:55 smithi076 ceph-mon[42935]: pgmap v276: 129 pgs: 129 active+clean; 22 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 2.0 MiB/s wr, 34 op/s 2024-06-02T04:49:57.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:57 smithi119 ceph-mon[46633]: pgmap v277: 129 pgs: 129 active+clean; 28 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 2.8 MiB/s wr, 63 op/s 2024-06-02T04:49:57.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:57 smithi119 ceph-mon[46633]: scrub summary: idle 2024-06-02T04:49:57.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:57 smithi192 ceph-mon[47933]: pgmap v277: 129 pgs: 129 active+clean; 28 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 2.8 MiB/s wr, 63 op/s 2024-06-02T04:49:57.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:57 smithi192 ceph-mon[47933]: scrub summary: idle 2024-06-02T04:49:57.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:57 smithi076 ceph-mon[42935]: pgmap v277: 129 pgs: 129 active+clean; 28 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 2.8 MiB/s wr, 63 op/s 2024-06-02T04:49:57.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:57 smithi076 ceph-mon[42935]: scrub summary: idle 2024-06-02T04:49:58.032 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.029+0000 7fa27614f700 1 -- 172.21.15.76:0/3816941184 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa270101920 msgr2=0x7fa270108240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:58.033 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.029+0000 7fa27614f700 1 --2- 172.21.15.76:0/3816941184 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa270101920 0x7fa270108240 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fa26800b0a0 tx=0x7fa26800b3b0 comp rx=0 tx=0).stop 2024-06-02T04:49:58.033 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.029+0000 7fa27614f700 1 -- 172.21.15.76:0/3816941184 shutdown_connections 2024-06-02T04:49:58.033 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.029+0000 7fa27614f700 1 --2- 172.21.15.76:0/3816941184 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa270101920 0x7fa270108240 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:58.033 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.029+0000 7fa27614f700 1 --2- 172.21.15.76:0/3816941184 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa2700ffe10 0x7fa270100230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:58.033 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.029+0000 7fa27614f700 1 --2- 172.21.15.76:0/3816941184 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa270100f60 0x7fa2701013e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:58.033 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.029+0000 7fa27614f700 1 -- 172.21.15.76:0/3816941184 >> 172.21.15.76:0/3816941184 conn(0x7fa2700fb380 msgr2=0x7fa2700fd7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:58.033 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.029+0000 7fa27614f700 1 -- 172.21.15.76:0/3816941184 shutdown_connections 2024-06-02T04:49:58.033 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.029+0000 7fa27614f700 1 -- 172.21.15.76:0/3816941184 wait complete. 2024-06-02T04:49:58.033 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.030+0000 7fa27614f700 1 Processor -- start 2024-06-02T04:49:58.033 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.030+0000 7fa27614f700 1 -- start start 2024-06-02T04:49:58.034 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.030+0000 7fa27614f700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa2700ffe10 0x7fa27006a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:58.034 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.030+0000 7fa27614f700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa270100f60 0x7fa27019bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:58.034 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.030+0000 7fa27614f700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa270101920 0x7fa27019e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:58.034 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.030+0000 7fa27614f700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa27019e960 con 0x7fa270100f60 2024-06-02T04:49:58.034 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.030+0000 7fa27614f700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa27019ead0 con 0x7fa270101920 2024-06-02T04:49:58.034 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.030+0000 7fa27614f700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa27019ec90 con 0x7fa2700ffe10 2024-06-02T04:49:58.034 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.030+0000 7fa26effd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa270100f60 0x7fa27019bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:58.034 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.030+0000 7fa26effd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa270100f60 0x7fa27019bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:38166/0 (socket says 172.21.15.76:38166) 2024-06-02T04:49:58.034 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.030+0000 7fa26effd700 1 -- 172.21.15.76:0/4236782774 learned_addr learned my addr 172.21.15.76:0/4236782774 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:49:58.034 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.030+0000 7fa26ffff700 1 --2- 172.21.15.76:0/4236782774 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa270101920 0x7fa27019e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:58.034 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.030+0000 7fa26f7fe700 1 --2- 172.21.15.76:0/4236782774 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa2700ffe10 0x7fa27006a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:58.034 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.030+0000 7fa26effd700 1 -- 172.21.15.76:0/4236782774 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa2700ffe10 msgr2=0x7fa27006a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:58.035 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.030+0000 7fa26effd700 1 --2- 172.21.15.76:0/4236782774 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa2700ffe10 0x7fa27006a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:58.035 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.030+0000 7fa26effd700 1 -- 172.21.15.76:0/4236782774 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa270101920 msgr2=0x7fa27019e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:58.035 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.030+0000 7fa26effd700 1 --2- 172.21.15.76:0/4236782774 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa270101920 0x7fa27019e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:58.035 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.030+0000 7fa26effd700 1 -- 172.21.15.76:0/4236782774 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa268009d00 con 0x7fa270100f60 2024-06-02T04:49:58.035 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.030+0000 7fa26f7fe700 1 --2- 172.21.15.76:0/4236782774 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa2700ffe10 0x7fa27006a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:49:58.035 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.031+0000 7fa26effd700 1 --2- 172.21.15.76:0/4236782774 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa270100f60 0x7fa27019bb70 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fa26000d980 tx=0x7fa26000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:58.035 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.031+0000 7fa26cff9700 1 -- 172.21.15.76:0/4236782774 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa260004220 con 0x7fa270100f60 2024-06-02T04:49:58.035 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.031+0000 7fa26cff9700 1 -- 172.21.15.76:0/4236782774 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa260007640 con 0x7fa270100f60 2024-06-02T04:49:58.035 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.031+0000 7fa27614f700 1 -- 172.21.15.76:0/4236782774 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa27019ef70 con 0x7fa270100f60 2024-06-02T04:49:58.035 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.031+0000 7fa26cff9700 1 -- 172.21.15.76:0/4236782774 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2600055e0 con 0x7fa270100f60 2024-06-02T04:49:58.035 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.031+0000 7fa27614f700 1 -- 172.21.15.76:0/4236782774 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa27019f3f0 con 0x7fa270100f60 2024-06-02T04:49:58.041 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.033+0000 7fa26cff9700 1 -- 172.21.15.76:0/4236782774 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fa260004750 con 0x7fa270100f60 2024-06-02T04:49:58.041 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.034+0000 7fa26cff9700 1 --2- 172.21.15.76:0/4236782774 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fa2580a1120 0x7fa2580a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:58.041 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.034+0000 7fa26cff9700 1 -- 172.21.15.76:0/4236782774 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fa2600cc930 con 0x7fa270100f60 2024-06-02T04:49:58.041 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.034+0000 7fa26f7fe700 1 --2- 172.21.15.76:0/4236782774 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fa2580a1120 0x7fa2580a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:58.041 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.034+0000 7fa26f7fe700 1 --2- 172.21.15.76:0/4236782774 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fa2580a1120 0x7fa2580a35e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fa264005fd0 tx=0x7fa264005f60 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:58.042 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.035+0000 7fa28230ab80 1 Processor -- start 2024-06-02T04:49:58.042 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.035+0000 7fa28230ab80 1 -- start start 2024-06-02T04:49:58.042 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.035+0000 7fa28230ab80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b153444a80 0x55b153444ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:58.042 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.035+0000 7fa28230ab80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b1534453e0 0x55b153445cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:58.042 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.035+0000 7fa28230ab80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b1534462d0 0x55b153446750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:58.042 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.035+0000 7fa28230ab80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b15339c0f0 con 0x55b1534462d0 2024-06-02T04:49:58.042 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.035+0000 7fa28230ab80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b153399ab0 con 0x55b153444a80 2024-06-02T04:49:58.042 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.035+0000 7fa28230ab80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1533953a0 con 0x55b1534453e0 2024-06-02T04:49:58.042 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.035+0000 7fa26ffff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b1534462d0 0x55b153446750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:58.042 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.035+0000 7fa26ffff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b1534462d0 0x55b153446750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:38180/0 (socket says 172.21.15.76:38180) 2024-06-02T04:49:58.042 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.035+0000 7fa26ffff700 1 -- 172.21.15.76:0/3180768402 learned_addr learned my addr 172.21.15.76:0/3180768402 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:49:58.042 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.035+0000 7fa26f7fe700 1 --2- 172.21.15.76:0/3180768402 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b153444a80 0x55b153444ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:58.043 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.035+0000 7fa26effd700 1 --2- 172.21.15.76:0/3180768402 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b1534453e0 0x55b153445cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:58.043 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.035+0000 7fa26ffff700 1 -- 172.21.15.76:0/3180768402 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b1534453e0 msgr2=0x55b153445cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:49:58.043 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.035+0000 7fa26ffff700 1 --2- 172.21.15.76:0/3180768402 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b1534453e0 0x55b153445cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:58.043 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.035+0000 7fa26ffff700 1 -- 172.21.15.76:0/3180768402 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b153444a80 msgr2=0x55b153444ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:49:58.043 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.035+0000 7fa26ffff700 1 --2- 172.21.15.76:0/3180768402 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b153444a80 0x55b153444ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:58.043 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.035+0000 7fa26ffff700 1 -- 172.21.15.76:0/3180768402 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b153216350 con 0x55b1534462d0 2024-06-02T04:49:58.043 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.035+0000 7fa26f7fe700 1 --2- 172.21.15.76:0/3180768402 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b153444a80 0x55b153444ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T04:49:58.043 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.036+0000 7fa26ffff700 1 --2- 172.21.15.76:0/3180768402 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b1534462d0 0x55b153446750 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fa268009cb0 tx=0x7fa2680074e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eea473b622c35b88 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:58.043 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.036+0000 7fa255ffb700 1 -- 172.21.15.76:0/3180768402 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa26800e040 con 0x55b1534462d0 2024-06-02T04:49:58.043 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.036+0000 7fa255ffb700 1 -- 172.21.15.76:0/3180768402 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa268007700 con 0x55b1534462d0 2024-06-02T04:49:58.043 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.036+0000 7fa255ffb700 1 -- 172.21.15.76:0/3180768402 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa26801c680 con 0x55b1534462d0 2024-06-02T04:49:58.043 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.036+0000 7fa28230ab80 1 -- 172.21.15.76:0/3180768402 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b1534462d0 msgr2=0x55b153446750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:58.044 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.036+0000 7fa28230ab80 1 --2- 172.21.15.76:0/3180768402 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b1534462d0 0x55b153446750 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fa268009cb0 tx=0x7fa2680074e0 comp rx=0 tx=0).stop 2024-06-02T04:49:58.044 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.036+0000 7fa28230ab80 1 -- 172.21.15.76:0/3180768402 shutdown_connections 2024-06-02T04:49:58.044 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.036+0000 7fa28230ab80 1 --2- 172.21.15.76:0/3180768402 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b1534462d0 0x55b153446750 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:58.044 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.036+0000 7fa28230ab80 1 --2- 172.21.15.76:0/3180768402 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b153444a80 0x55b153444ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:58.044 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.036+0000 7fa28230ab80 1 --2- 172.21.15.76:0/3180768402 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b1534453e0 0x55b153445cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:58.044 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.036+0000 7fa28230ab80 1 -- 172.21.15.76:0/3180768402 >> 172.21.15.76:0/3180768402 conn(0x55b1533a31b0 msgr2=0x55b153441440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:58.044 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.036+0000 7fa28230ab80 1 -- 172.21.15.76:0/3180768402 shutdown_connections 2024-06-02T04:49:58.044 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.036+0000 7fa28230ab80 1 -- 172.21.15.76:0/3180768402 wait complete. 2024-06-02T04:49:58.044 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.037+0000 7fa28230ab80 1 -- start start 2024-06-02T04:49:58.044 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.037+0000 7fa28230ab80 1 Processor -- start 2024-06-02T04:49:58.044 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.037+0000 7fa28230ab80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b153444a80 0x55b15344e810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:58.044 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.037+0000 7fa28230ab80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b1534453e0 0x55b15344ed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:58.044 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.037+0000 7fa28230ab80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b1534462d0 0x55b153455d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:58.045 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.037+0000 7fa28230ab80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b153331500 con 0x55b1534462d0 2024-06-02T04:49:58.045 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.037+0000 7fa28230ab80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1533311a0 con 0x55b1534453e0 2024-06-02T04:49:58.045 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.037+0000 7fa28230ab80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b153218640 con 0x55b153444a80 2024-06-02T04:49:58.045 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.037+0000 7fa28230ab80 10 client.0 _ll_register_callbacks cb 0x55b15333aad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:49:58.045 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.037+0000 7fa26ffff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b1534462d0 0x55b153455d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:58.045 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.037+0000 7fa26ffff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b1534462d0 0x55b153455d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:38196/0 (socket says 172.21.15.76:38196) 2024-06-02T04:49:58.045 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.037+0000 7fa26ffff700 1 -- 172.21.15.76:0/1379793605 learned_addr learned my addr 172.21.15.76:0/1379793605 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:49:58.045 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.037+0000 7fa26f7fe700 1 --2- 172.21.15.76:0/1379793605 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b153444a80 0x55b15344e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:58.045 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.037+0000 7fa26effd700 1 --2- 172.21.15.76:0/1379793605 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b1534453e0 0x55b15344ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:58.045 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.038+0000 7fa26ffff700 1 -- 172.21.15.76:0/1379793605 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b153444a80 msgr2=0x55b15344e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:49:58.045 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.038+0000 7fa26ffff700 1 --2- 172.21.15.76:0/1379793605 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b153444a80 0x55b15344e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:58.045 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.038+0000 7fa26ffff700 1 -- 172.21.15.76:0/1379793605 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b1534453e0 msgr2=0x55b15344ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:49:58.045 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.038+0000 7fa26ffff700 1 --2- 172.21.15.76:0/1379793605 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b1534453e0 0x55b15344ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:58.046 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.038+0000 7fa26ffff700 1 -- 172.21.15.76:0/1379793605 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa26400bdf0 con 0x55b1534462d0 2024-06-02T04:49:58.046 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.038+0000 7fa26f7fe700 1 --2- 172.21.15.76:0/1379793605 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b153444a80 0x55b15344e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T04:49:58.046 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.038+0000 7fa26effd700 1 --2- 172.21.15.76:0/1379793605 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b1534453e0 0x55b15344ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T04:49:58.046 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.038+0000 7fa26ffff700 1 --2- 172.21.15.76:0/1379793605 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b1534462d0 0x55b153455d90 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fa26800b3f0 tx=0x7fa268007890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7add6606cf7192d server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:58.046 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.038+0000 7fa24effd700 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-06-02T04:49:58.046 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.038+0000 7fa24effd700 1 -- 172.21.15.76:0/1379793605 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa26800e040 con 0x55b1534462d0 2024-06-02T04:49:58.046 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.038+0000 7fa24effd700 1 -- 172.21.15.76:0/1379793605 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fa268025670 con 0x55b1534462d0 2024-06-02T04:49:58.046 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.038+0000 7fa28230ab80 1 -- 172.21.15.76:0/1379793605 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b1532ee210 con 0x55b1534462d0 2024-06-02T04:49:58.046 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.038+0000 7fa24effd700 1 -- 172.21.15.76:0/1379793605 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa268025830 con 0x55b1534462d0 2024-06-02T04:49:58.046 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.038+0000 7fa28230ab80 10 client.15609 fetch_fsmap learned FSMap version 26 2024-06-02T04:49:58.046 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.038+0000 7fa28230ab80 1 -- 172.21.15.76:0/1379793605 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7fa270108b70 con 0x55b1534462d0 2024-06-02T04:49:58.046 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.038+0000 7fa24effd700 1 -- 172.21.15.76:0/1379793605 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b1532ee210 con 0x55b1534462d0 2024-06-02T04:49:58.046 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.038+0000 7fa24effd700 1 -- 172.21.15.76:0/1379793605 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 26) v1 ==== 7474+0+0 (secure 0 0 0) 0x7fa268019070 con 0x55b1534462d0 2024-06-02T04:49:58.047 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.038+0000 7fa28230ab80 10 client.15609 fetch_fsmap finished waiting for FSMap version 26 2024-06-02T04:49:58.047 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.038+0000 7fa28230ab80 10 client.15609 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T04:49:58.047 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.039+0000 7fa28230ab80 20 client.15609 populate_metadata read hostname 'smithi076' 2024-06-02T04:49:58.047 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.039+0000 7fa28230ab80 1 --2- 172.21.15.76:0/1379793605 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55b15345a300 0x55b15345c720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:58.047 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.039+0000 7fa28230ab80 4 client.15609 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T04:49:58.047 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.039+0000 7fa28230ab80 1 -- 172.21.15.76:0/1379793605 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b1534147b0 con 0x55b15345a300 2024-06-02T04:49:58.047 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.039+0000 7fa26f7fe700 1 --2- 172.21.15.76:0/1379793605 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55b15345a300 0x55b15345c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:58.047 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.039+0000 7fa24effd700 10 client.15609 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:49:58.047 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.039+0000 7fa26f7fe700 1 --2- 172.21.15.76:0/1379793605 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55b15345a300 0x55b15345c720 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=272c70d110943ae5 server_cookie=a5acd778563b67d1 in_seq=0 out_seq=0 2024-06-02T04:49:58.048 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.040+0000 7fa24effd700 1 -- 172.21.15.76:0/1379793605 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55b1534147b0 con 0x55b15345a300 2024-06-02T04:49:58.048 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.040+0000 7fa24effd700 10 client.15609 handle_command_reply: tid=0 2024-06-02T04:49:58.048 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.040+0000 7fa28230ab80 1 client.15609 shutdown 2024-06-02T04:49:58.049 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.041+0000 7fa28230ab80 1 -- 172.21.15.76:0/1379793605 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b1534462d0 msgr2=0x55b153455d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:58.049 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.041+0000 7fa28230ab80 1 --2- 172.21.15.76:0/1379793605 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b1534462d0 0x55b153455d90 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fa26800b3f0 tx=0x7fa268007890 comp rx=0 tx=0).stop 2024-06-02T04:49:58.049 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.041+0000 7fa28230ab80 1 -- 172.21.15.76:0/1379793605 shutdown_connections 2024-06-02T04:49:58.049 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.041+0000 7fa28230ab80 1 --2- 172.21.15.76:0/1379793605 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55b15345a300 0x55b15345c720 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:58.049 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.041+0000 7fa28230ab80 1 --2- 172.21.15.76:0/1379793605 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b1534462d0 0x55b153455d90 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:58.049 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.041+0000 7fa28230ab80 1 --2- 172.21.15.76:0/1379793605 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b153444a80 0x55b15344e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:58.049 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.041+0000 7fa28230ab80 1 --2- 172.21.15.76:0/1379793605 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b1534453e0 0x55b15344ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:58.049 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.041+0000 7fa24effd700 0 client.15609 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:49:58.049 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.041+0000 7fa28230ab80 1 -- 172.21.15.76:0/1379793605 >> 172.21.15.76:0/1379793605 conn(0x55b1533a31b0 msgr2=0x55b15343f860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:58.049 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.041+0000 7fa28230ab80 1 -- 172.21.15.76:0/1379793605 shutdown_connections 2024-06-02T04:49:58.049 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.041+0000 7fa28230ab80 1 -- 172.21.15.76:0/1379793605 wait complete. 2024-06-02T04:49:58.049 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.041+0000 7fa28230ab80 20 client.15609 trim_cache size 0 max 16384 2024-06-02T04:49:58.061 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.055+0000 7fa28230ab80 1 Processor -- start 2024-06-02T04:49:58.061 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.055+0000 7fa28230ab80 1 -- start start 2024-06-02T04:49:58.061 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.055+0000 7fa28230ab80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b153444a80 0x55b153456440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:58.061 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.056+0000 7fa28230ab80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b1534453e0 0x55b15344dd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:58.061 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.056+0000 7fa28230ab80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b1534462d0 0x55b1534466b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:58.061 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.056+0000 7fa28230ab80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b15344e3d0 con 0x55b1534462d0 2024-06-02T04:49:58.062 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.056+0000 7fa28230ab80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1534457c0 con 0x55b1534453e0 2024-06-02T04:49:58.062 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.056+0000 7fa28230ab80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1534618f0 con 0x55b153444a80 2024-06-02T04:49:58.062 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.056+0000 7fa26ffff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b1534462d0 0x55b1534466b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:58.062 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.056+0000 7fa26ffff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b1534462d0 0x55b1534466b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:38202/0 (socket says 172.21.15.76:38202) 2024-06-02T04:49:58.062 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.056+0000 7fa26ffff700 1 -- 172.21.15.76:0/289033211 learned_addr learned my addr 172.21.15.76:0/289033211 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:49:58.062 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.056+0000 7fa26effd700 1 --2- 172.21.15.76:0/289033211 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b1534453e0 0x55b15344dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:58.062 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.056+0000 7fa26f7fe700 1 --2- 172.21.15.76:0/289033211 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b153444a80 0x55b153456440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:58.062 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.056+0000 7fa26ffff700 1 -- 172.21.15.76:0/289033211 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b153444a80 msgr2=0x55b153456440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:49:58.062 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.056+0000 7fa26ffff700 1 --2- 172.21.15.76:0/289033211 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b153444a80 0x55b153456440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:58.062 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.056+0000 7fa26ffff700 1 -- 172.21.15.76:0/289033211 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b1534453e0 msgr2=0x55b15344dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:49:58.062 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.056+0000 7fa26ffff700 1 --2- 172.21.15.76:0/289033211 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b1534453e0 0x55b15344dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:58.062 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.056+0000 7fa26ffff700 1 -- 172.21.15.76:0/289033211 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b1531c2b00 con 0x55b1534462d0 2024-06-02T04:49:58.062 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.056+0000 7fa26ffff700 1 --2- 172.21.15.76:0/289033211 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b1534462d0 0x55b1534466b0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fa268009a20 tx=0x7fa26800b060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2589aa584bf6ef3d server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:58.063 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.056+0000 7fa2567fc700 1 -- 172.21.15.76:0/289033211 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa26800e070 con 0x55b1534462d0 2024-06-02T04:49:58.063 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.056+0000 7fa2567fc700 1 -- 172.21.15.76:0/289033211 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa26801c8d0 con 0x55b1534462d0 2024-06-02T04:49:58.063 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.056+0000 7fa2567fc700 1 -- 172.21.15.76:0/289033211 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa268025a70 con 0x55b1534462d0 2024-06-02T04:49:58.063 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.057+0000 7fa28230ab80 1 -- 172.21.15.76:0/289033211 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b1534462d0 msgr2=0x55b1534466b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:58.063 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.057+0000 7fa28230ab80 1 --2- 172.21.15.76:0/289033211 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b1534462d0 0x55b1534466b0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fa268009a20 tx=0x7fa26800b060 comp rx=0 tx=0).stop 2024-06-02T04:49:58.063 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.057+0000 7fa28230ab80 1 -- 172.21.15.76:0/289033211 shutdown_connections 2024-06-02T04:49:58.063 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.057+0000 7fa28230ab80 1 --2- 172.21.15.76:0/289033211 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b1534462d0 0x55b1534466b0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:58.063 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.057+0000 7fa28230ab80 1 --2- 172.21.15.76:0/289033211 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b153444a80 0x55b153456440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:58.063 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.057+0000 7fa28230ab80 1 --2- 172.21.15.76:0/289033211 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b1534453e0 0x55b15344dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:58.063 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.057+0000 7fa28230ab80 1 -- 172.21.15.76:0/289033211 >> 172.21.15.76:0/289033211 conn(0x55b1533a31b0 msgr2=0x55b153441020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:58.063 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.057+0000 7fa28230ab80 1 -- 172.21.15.76:0/289033211 shutdown_connections 2024-06-02T04:49:58.063 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.057+0000 7fa28230ab80 1 -- 172.21.15.76:0/289033211 wait complete. 2024-06-02T04:49:58.064 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.057+0000 7fa28230ab80 1 -- start start 2024-06-02T04:49:58.064 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.057+0000 7fa28230ab80 1 Processor -- start 2024-06-02T04:49:58.064 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.058+0000 7fa28230ab80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b153444a80 0x55b1534aba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:58.064 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.058+0000 7fa28230ab80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b1534453e0 0x55b1534abf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:58.064 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.058+0000 7fa28230ab80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b1534462d0 0x55b1534b29b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:58.064 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.058+0000 7fa28230ab80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1534b2ef0 con 0x55b1534462d0 2024-06-02T04:49:58.064 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.058+0000 7fa28230ab80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1534b3060 con 0x55b153444a80 2024-06-02T04:49:58.064 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.058+0000 7fa28230ab80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1534b3220 con 0x55b1534453e0 2024-06-02T04:49:58.064 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.058+0000 7fa28230ab80 10 client.0 _ll_register_callbacks cb 0x55b15333aad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:49:58.064 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.058+0000 7fa26f7fe700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b153444a80 0x55b1534aba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:58.064 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.058+0000 7fa26f7fe700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b153444a80 0x55b1534aba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:59870/0 (socket says 172.21.15.76:59870) 2024-06-02T04:49:58.064 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.058+0000 7fa26f7fe700 1 -- 172.21.15.76:0/3794849930 learned_addr learned my addr 172.21.15.76:0/3794849930 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:49:58.064 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.058+0000 7fa26ffff700 1 --2- 172.21.15.76:0/3794849930 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b1534462d0 0x55b1534b29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:58.065 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.058+0000 7fa26effd700 1 --2- 172.21.15.76:0/3794849930 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b1534453e0 0x55b1534abf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:58.065 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.058+0000 7fa26ffff700 1 -- 172.21.15.76:0/3794849930 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b1534453e0 msgr2=0x55b1534abf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:49:58.065 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.058+0000 7fa26ffff700 1 --2- 172.21.15.76:0/3794849930 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b1534453e0 0x55b1534abf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:58.065 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.058+0000 7fa26ffff700 1 -- 172.21.15.76:0/3794849930 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b153444a80 msgr2=0x55b1534aba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:49:58.065 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.058+0000 7fa26ffff700 1 --2- 172.21.15.76:0/3794849930 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b153444a80 0x55b1534aba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:58.065 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.058+0000 7fa26ffff700 1 -- 172.21.15.76:0/3794849930 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa270108b70 con 0x55b1534462d0 2024-06-02T04:49:58.065 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.058+0000 7fa26f7fe700 1 --2- 172.21.15.76:0/3794849930 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b153444a80 0x55b1534aba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T04:49:58.065 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.059+0000 7fa26ffff700 1 --2- 172.21.15.76:0/3794849930 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b1534462d0 0x55b1534b29b0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fa26800ba10 tx=0x7fa2680074a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10eaff6824a05f11 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:49:58.065 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.059+0000 7fa24effd700 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-06-02T04:49:58.066 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.059+0000 7fa24effd700 1 -- 172.21.15.76:0/3794849930 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa26800e070 con 0x55b1534462d0 2024-06-02T04:49:58.066 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.059+0000 7fa24effd700 1 -- 172.21.15.76:0/3794849930 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fa26801c650 con 0x55b1534462d0 2024-06-02T04:49:58.066 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.059+0000 7fa28230ab80 1 -- 172.21.15.76:0/3794849930 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa268007700 con 0x55b1534462d0 2024-06-02T04:49:58.066 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.059+0000 7fa24effd700 1 -- 172.21.15.76:0/3794849930 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa268025770 con 0x55b1534462d0 2024-06-02T04:49:58.066 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.059+0000 7fa28230ab80 10 client.15615 fetch_fsmap learned FSMap version 26 2024-06-02T04:49:58.066 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.059+0000 7fa28230ab80 1 -- 172.21.15.76:0/3794849930 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55b15335b500 con 0x55b1534462d0 2024-06-02T04:49:58.066 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.059+0000 7fa24effd700 1 -- 172.21.15.76:0/3794849930 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa268007700 con 0x55b1534462d0 2024-06-02T04:49:58.066 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.059+0000 7fa24effd700 1 -- 172.21.15.76:0/3794849930 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 26) v1 ==== 7474+0+0 (secure 0 0 0) 0x7fa26800b0d0 con 0x55b1534462d0 2024-06-02T04:49:58.066 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.059+0000 7fa28230ab80 10 client.15615 fetch_fsmap finished waiting for FSMap version 26 2024-06-02T04:49:58.066 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.059+0000 7fa28230ab80 10 client.15615 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T04:49:58.066 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.059+0000 7fa28230ab80 20 client.15615 populate_metadata read hostname 'smithi076' 2024-06-02T04:49:58.066 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.059+0000 7fa28230ab80 1 --2- 172.21.15.76:0/3794849930 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55b153452000 0x55b1534543f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:49:58.066 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.059+0000 7fa28230ab80 4 client.15615 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T04:49:58.067 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.059+0000 7fa28230ab80 1 -- 172.21.15.76:0/3794849930 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55b15338de60 con 0x55b153452000 2024-06-02T04:49:58.067 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.060+0000 7fa26f7fe700 1 --2- 172.21.15.76:0/3794849930 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55b153452000 0x55b1534543f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:49:58.067 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.060+0000 7fa26f7fe700 1 --2- 172.21.15.76:0/3794849930 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55b153452000 0x55b1534543f0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=984ac9c34adfc4c5 server_cookie=571d568c31c64a12 in_seq=0 out_seq=0 2024-06-02T04:49:58.067 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.060+0000 7fa24effd700 10 client.15615 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:49:58.598 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:58 smithi119 ceph-mon[46633]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-06-02T04:49:58.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:58 smithi192 ceph-mon[47933]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-06-02T04:49:58.731 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.729+0000 7fa24effd700 1 -- 172.21.15.76:0/3794849930 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55b15338de60 con 0x55b153452000 2024-06-02T04:49:58.731 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.729+0000 7fa24effd700 10 client.15615 handle_command_reply: tid=0 2024-06-02T04:49:58.731 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.729+0000 7fa28230ab80 1 client.15615 shutdown 2024-06-02T04:49:58.731 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.729+0000 7fa28230ab80 1 -- 172.21.15.76:0/3794849930 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b1534462d0 msgr2=0x55b1534b29b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:58.731 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.729+0000 7fa28230ab80 1 --2- 172.21.15.76:0/3794849930 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b1534462d0 0x55b1534b29b0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fa26800ba10 tx=0x7fa2680074a0 comp rx=0 tx=0).stop 2024-06-02T04:49:58.732 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.729+0000 7fa28230ab80 1 -- 172.21.15.76:0/3794849930 shutdown_connections 2024-06-02T04:49:58.732 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.729+0000 7fa28230ab80 1 --2- 172.21.15.76:0/3794849930 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55b153452000 0x55b1534543f0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:58.732 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.729+0000 7fa28230ab80 1 --2- 172.21.15.76:0/3794849930 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b1534462d0 0x55b1534b29b0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:58.732 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.729+0000 7fa28230ab80 1 --2- 172.21.15.76:0/3794849930 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b153444a80 0x55b1534aba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:58.732 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.729+0000 7fa24effd700 0 client.15615 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:49:58.732 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.729+0000 7fa28230ab80 1 --2- 172.21.15.76:0/3794849930 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b1534453e0 0x55b1534abf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:58.732 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.729+0000 7fa28230ab80 1 -- 172.21.15.76:0/3794849930 >> 172.21.15.76:0/3794849930 conn(0x55b1533a31b0 msgr2=0x55b15344c400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:58.732 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.729+0000 7fa28230ab80 1 -- 172.21.15.76:0/3794849930 shutdown_connections 2024-06-02T04:49:58.732 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.729+0000 7fa28230ab80 1 -- 172.21.15.76:0/3794849930 wait complete. 2024-06-02T04:49:58.732 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.729+0000 7fa28230ab80 20 client.15615 trim_cache size 0 max 16384 2024-06-02T04:49:58.733 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:{ 2024-06-02T04:49:58.733 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "message": "", 2024-06-02T04:49:58.733 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "return_code": 0 2024-06-02T04:49:58.733 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:} 2024-06-02T04:49:58.735 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.730+0000 7fa27614f700 1 -- 172.21.15.76:0/4236782774 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fa2580a1120 msgr2=0x7fa2580a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:58.735 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.730+0000 7fa27614f700 1 --2- 172.21.15.76:0/4236782774 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fa2580a1120 0x7fa2580a35e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fa264005fd0 tx=0x7fa264005f60 comp rx=0 tx=0).stop 2024-06-02T04:49:58.735 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.730+0000 7fa27614f700 1 -- 172.21.15.76:0/4236782774 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa270100f60 msgr2=0x7fa27019bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:49:58.735 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.730+0000 7fa27614f700 1 --2- 172.21.15.76:0/4236782774 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa270100f60 0x7fa27019bb70 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fa26000d980 tx=0x7fa26000dc90 comp rx=0 tx=0).stop 2024-06-02T04:49:58.735 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.730+0000 7fa27614f700 1 -- 172.21.15.76:0/4236782774 shutdown_connections 2024-06-02T04:49:58.735 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.730+0000 7fa27614f700 1 --2- 172.21.15.76:0/4236782774 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fa2580a1120 0x7fa2580a35e0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:58.736 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.730+0000 7fa27614f700 1 --2- 172.21.15.76:0/4236782774 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa270101920 0x7fa27019e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:58.736 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.730+0000 7fa27614f700 1 --2- 172.21.15.76:0/4236782774 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa2700ffe10 0x7fa27006a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:58.736 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.730+0000 7fa27614f700 1 --2- 172.21.15.76:0/4236782774 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa270100f60 0x7fa27019bb70 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:49:58.736 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.730+0000 7fa27614f700 1 -- 172.21.15.76:0/4236782774 >> 172.21.15.76:0/4236782774 conn(0x7fa2700fb380 msgr2=0x7fa270104370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:49:58.736 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.730+0000 7fa27614f700 1 -- 172.21.15.76:0/4236782774 shutdown_connections 2024-06-02T04:49:58.736 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:49:58.730+0000 7fa27614f700 1 -- 172.21.15.76:0/4236782774 wait complete. 2024-06-02T04:49:58.737 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:58 smithi076 ceph-mon[42935]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-06-02T04:49:59.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:49:59 smithi119 ceph-mon[46633]: pgmap v278: 129 pgs: 129 active+clean; 29 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 3.1 MiB/s wr, 75 op/s 2024-06-02T04:49:59.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:49:59 smithi192 ceph-mon[47933]: pgmap v278: 129 pgs: 129 active+clean; 29 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 3.1 MiB/s wr, 75 op/s 2024-06-02T04:49:59.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:49:59 smithi076 ceph-mon[42935]: pgmap v278: 129 pgs: 129 active+clean; 29 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 3.1 MiB/s wr, 75 op/s 2024-06-02T04:50:00.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:00 smithi119 ceph-mon[46633]: overall HEALTH_OK 2024-06-02T04:50:00.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:00 smithi192 ceph-mon[47933]: overall HEALTH_OK 2024-06-02T04:50:00.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:00 smithi076 ceph-mon[42935]: overall HEALTH_OK 2024-06-02T04:50:01.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:01 smithi119 ceph-mon[46633]: pgmap v279: 129 pgs: 129 active+clean; 33 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 314 KiB/s rd, 3.4 MiB/s wr, 132 op/s 2024-06-02T04:50:01.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:01 smithi192 ceph-mon[47933]: pgmap v279: 129 pgs: 129 active+clean; 33 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 314 KiB/s rd, 3.4 MiB/s wr, 132 op/s 2024-06-02T04:50:01.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:01 smithi076 ceph-mon[42935]: pgmap v279: 129 pgs: 129 active+clean; 33 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 314 KiB/s rd, 3.4 MiB/s wr, 132 op/s 2024-06-02T04:50:02.207 INFO:teuthology.orchestra.run.smithi076.stderr: * Initialized, logs are in /var/lib/pgsql/initdb_postgresql.log 2024-06-02T04:50:02.209 DEBUG:teuthology.orchestra.run.smithi076:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -lZaR /tmp/cephfs/postgres/' 2024-06-02T04:50:02.637 INFO:teuthology.orchestra.run.smithi076.stdout:/tmp/cephfs/postgres/: 2024-06-02T04:50:02.637 INFO:teuthology.orchestra.run.smithi076.stdout:total 2 2024-06-02T04:50:02.637 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 39557450 Jun 2 04:49 . 2024-06-02T04:50:02.637 INFO:teuthology.orchestra.run.smithi076.stdout:drwxrwxrwt. 3 root root system_u:object_r:postgresql_db_t:s0 39557450 Jun 2 04:49 .. 2024-06-02T04:50:02.637 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39557450 Jun 2 04:50 data 2024-06-02T04:50:02.637 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:50:02.637 INFO:teuthology.orchestra.run.smithi076.stdout:/tmp/cephfs/postgres/data: 2024-06-02T04:50:02.637 INFO:teuthology.orchestra.run.smithi076.stdout:total 40 2024-06-02T04:50:02.637 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39557450 Jun 2 04:50 . 2024-06-02T04:50:02.637 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 39557450 Jun 2 04:49 .. 2024-06-02T04:50:02.637 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 22144521 Jun 2 04:49 base 2024-06-02T04:50:02.637 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 565760 Jun 2 04:49 global 2024-06-02T04:50:02.638 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:50 log 2024-06-02T04:50:02.638 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 pg_commit_ts 2024-06-02T04:50:02.638 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 pg_dynshmem 2024-06-02T04:50:02.638 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 4269 Jun 2 04:49 pg_hba.conf 2024-06-02T04:50:02.638 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1636 Jun 2 04:49 pg_ident.conf 2024-06-02T04:50:02.638 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Jun 2 04:49 pg_logical 2024-06-02T04:50:02.638 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 pg_multixact 2024-06-02T04:50:02.638 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 pg_notify 2024-06-02T04:50:02.638 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 pg_replslot 2024-06-02T04:50:02.638 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 pg_serial 2024-06-02T04:50:02.638 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 pg_snapshots 2024-06-02T04:50:02.638 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 pg_stat 2024-06-02T04:50:02.639 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 pg_stat_tmp 2024-06-02T04:50:02.639 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 pg_subtrans 2024-06-02T04:50:02.639 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 pg_tblspc 2024-06-02T04:50:02.639 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 pg_twophase 2024-06-02T04:50:02.639 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Jun 2 04:49 PG_VERSION 2024-06-02T04:50:02.639 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 04:49 pg_wal 2024-06-02T04:50:02.639 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 pg_xact 2024-06-02T04:50:02.639 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 88 Jun 2 04:49 postgresql.auto.conf 2024-06-02T04:50:02.639 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 22989 Jun 2 04:49 postgresql.conf 2024-06-02T04:50:02.639 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:50:02.639 INFO:teuthology.orchestra.run.smithi076.stdout:/tmp/cephfs/postgres/data/base: 2024-06-02T04:50:02.639 INFO:teuthology.orchestra.run.smithi076.stdout:total 3 2024-06-02T04:50:02.640 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 22144521 Jun 2 04:49 . 2024-06-02T04:50:02.640 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39557450 Jun 2 04:50 .. 2024-06-02T04:50:02.640 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7381507 Jun 2 04:49 1 2024-06-02T04:50:02.640 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7381507 Jun 2 04:49 12346 2024-06-02T04:50:02.640 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7381507 Jun 2 04:49 12347 2024-06-02T04:50:02.640 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:50:02.640 INFO:teuthology.orchestra.run.smithi076.stdout:/tmp/cephfs/postgres/data/base/1: 2024-06-02T04:50:02.640 INFO:teuthology.orchestra.run.smithi076.stdout:total 7210 2024-06-02T04:50:02.640 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7381507 Jun 2 04:49 . 2024-06-02T04:50:02.640 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 22144521 Jun 2 04:49 .. 2024-06-02T04:50:02.640 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 112 2024-06-02T04:50:02.640 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 113 2024-06-02T04:50:02.640 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Jun 2 04:49 12182 2024-06-02T04:50:02.641 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 12182_fsm 2024-06-02T04:50:02.641 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 12182_vm 2024-06-02T04:50:02.641 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 12184 2024-06-02T04:50:02.641 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 12186 2024-06-02T04:50:02.641 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 12187 2024-06-02T04:50:02.641 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 12187_fsm 2024-06-02T04:50:02.641 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 12187_vm 2024-06-02T04:50:02.641 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 12189 2024-06-02T04:50:02.641 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 12191 2024-06-02T04:50:02.641 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 12192 2024-06-02T04:50:02.641 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 12192_fsm 2024-06-02T04:50:02.641 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 12192_vm 2024-06-02T04:50:02.641 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 12194 2024-06-02T04:50:02.642 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 12196 2024-06-02T04:50:02.642 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 12197 2024-06-02T04:50:02.642 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 12197_fsm 2024-06-02T04:50:02.642 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 12197_vm 2024-06-02T04:50:02.642 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 12199 2024-06-02T04:50:02.642 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 12201 2024-06-02T04:50:02.642 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 12202 2024-06-02T04:50:02.642 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 12202_fsm 2024-06-02T04:50:02.642 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 12202_vm 2024-06-02T04:50:02.642 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 12204 2024-06-02T04:50:02.642 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 12206 2024-06-02T04:50:02.642 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 12207 2024-06-02T04:50:02.642 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 12207_fsm 2024-06-02T04:50:02.642 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 12207_vm 2024-06-02T04:50:02.643 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 12209 2024-06-02T04:50:02.643 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 12211 2024-06-02T04:50:02.643 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 12212 2024-06-02T04:50:02.643 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 12214 2024-06-02T04:50:02.643 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 12216 2024-06-02T04:50:02.643 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 73728 Jun 2 04:49 1247 2024-06-02T04:50:02.643 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 1247_fsm 2024-06-02T04:50:02.643 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 1247_vm 2024-06-02T04:50:02.643 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 393216 Jun 2 04:49 1249 2024-06-02T04:50:02.643 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 1249_fsm 2024-06-02T04:50:02.643 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 1249_vm 2024-06-02T04:50:02.643 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 606208 Jun 2 04:49 1255 2024-06-02T04:50:02.643 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 1255_fsm 2024-06-02T04:50:02.643 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 1255_vm 2024-06-02T04:50:02.644 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Jun 2 04:49 1259 2024-06-02T04:50:02.644 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 1259_fsm 2024-06-02T04:50:02.644 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 1259_vm 2024-06-02T04:50:02.644 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 1417 2024-06-02T04:50:02.644 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 1417_vm 2024-06-02T04:50:02.644 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 1418 2024-06-02T04:50:02.644 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 1418_vm 2024-06-02T04:50:02.644 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 174 2024-06-02T04:50:02.644 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 175 2024-06-02T04:50:02.644 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2187 2024-06-02T04:50:02.644 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2224 2024-06-02T04:50:02.644 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2224_vm 2024-06-02T04:50:02.645 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2328 2024-06-02T04:50:02.645 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2328_vm 2024-06-02T04:50:02.645 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2336 2024-06-02T04:50:02.645 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2336_vm 2024-06-02T04:50:02.645 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2337 2024-06-02T04:50:02.645 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2600 2024-06-02T04:50:02.645 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2600_fsm 2024-06-02T04:50:02.645 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2600_vm 2024-06-02T04:50:02.645 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2601 2024-06-02T04:50:02.645 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2601_fsm 2024-06-02T04:50:02.645 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2601_vm 2024-06-02T04:50:02.645 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Jun 2 04:49 2602 2024-06-02T04:50:02.645 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2602_fsm 2024-06-02T04:50:02.645 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2602_vm 2024-06-02T04:50:02.646 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 04:49 2603 2024-06-02T04:50:02.646 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2603_fsm 2024-06-02T04:50:02.646 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2603_vm 2024-06-02T04:50:02.646 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2604 2024-06-02T04:50:02.646 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2604_vm 2024-06-02T04:50:02.646 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2605 2024-06-02T04:50:02.646 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2605_fsm 2024-06-02T04:50:02.646 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2605_vm 2024-06-02T04:50:02.646 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2606 2024-06-02T04:50:02.646 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2606_fsm 2024-06-02T04:50:02.646 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2606_vm 2024-06-02T04:50:02.646 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2607 2024-06-02T04:50:02.646 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2607_fsm 2024-06-02T04:50:02.647 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2607_vm 2024-06-02T04:50:02.647 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 442368 Jun 2 04:49 2608 2024-06-02T04:50:02.647 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2608_fsm 2024-06-02T04:50:02.647 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2608_vm 2024-06-02T04:50:02.647 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 286720 Jun 2 04:49 2609 2024-06-02T04:50:02.647 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2609_fsm 2024-06-02T04:50:02.647 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2609_vm 2024-06-02T04:50:02.647 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2610 2024-06-02T04:50:02.647 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2610_fsm 2024-06-02T04:50:02.647 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2610_vm 2024-06-02T04:50:02.647 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2611 2024-06-02T04:50:02.647 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2611_vm 2024-06-02T04:50:02.647 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2612 2024-06-02T04:50:02.648 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2612_fsm 2024-06-02T04:50:02.648 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2612_vm 2024-06-02T04:50:02.648 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2613 2024-06-02T04:50:02.648 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2613_vm 2024-06-02T04:50:02.648 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2615 2024-06-02T04:50:02.648 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2615_fsm 2024-06-02T04:50:02.648 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2615_vm 2024-06-02T04:50:02.648 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2616 2024-06-02T04:50:02.648 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2616_fsm 2024-06-02T04:50:02.648 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2616_vm 2024-06-02T04:50:02.648 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Jun 2 04:49 2617 2024-06-02T04:50:02.648 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2617_fsm 2024-06-02T04:50:02.648 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2617_vm 2024-06-02T04:50:02.648 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Jun 2 04:49 2618 2024-06-02T04:50:02.649 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2618_fsm 2024-06-02T04:50:02.649 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2618_vm 2024-06-02T04:50:02.649 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 131072 Jun 2 04:49 2619 2024-06-02T04:50:02.649 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2619_fsm 2024-06-02T04:50:02.649 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2619_vm 2024-06-02T04:50:02.649 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2620 2024-06-02T04:50:02.649 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2620_vm 2024-06-02T04:50:02.649 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2650 2024-06-02T04:50:02.649 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2651 2024-06-02T04:50:02.649 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2652 2024-06-02T04:50:02.649 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jun 2 04:49 2653 2024-06-02T04:50:02.649 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jun 2 04:49 2654 2024-06-02T04:50:02.649 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 04:49 2655 2024-06-02T04:50:02.650 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2656 2024-06-02T04:50:02.650 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2657 2024-06-02T04:50:02.650 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Jun 2 04:49 2658 2024-06-02T04:50:02.650 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Jun 2 04:49 2659 2024-06-02T04:50:02.650 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2660 2024-06-02T04:50:02.650 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2661 2024-06-02T04:50:02.650 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 04:49 2662 2024-06-02T04:50:02.650 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Jun 2 04:49 2663 2024-06-02T04:50:02.650 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2664 2024-06-02T04:50:02.650 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2665 2024-06-02T04:50:02.650 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2666 2024-06-02T04:50:02.650 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2667 2024-06-02T04:50:02.650 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2668 2024-06-02T04:50:02.650 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2669 2024-06-02T04:50:02.651 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2670 2024-06-02T04:50:02.651 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 327680 Jun 2 04:49 2673 2024-06-02T04:50:02.651 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 385024 Jun 2 04:49 2674 2024-06-02T04:50:02.651 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 180224 Jun 2 04:49 2675 2024-06-02T04:50:02.651 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2678 2024-06-02T04:50:02.651 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2679 2024-06-02T04:50:02.651 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2680 2024-06-02T04:50:02.651 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2681 2024-06-02T04:50:02.651 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2682 2024-06-02T04:50:02.651 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2683 2024-06-02T04:50:02.651 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2684 2024-06-02T04:50:02.651 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2685 2024-06-02T04:50:02.651 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2686 2024-06-02T04:50:02.651 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2687 2024-06-02T04:50:02.652 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jun 2 04:49 2688 2024-06-02T04:50:02.652 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Jun 2 04:49 2689 2024-06-02T04:50:02.652 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Jun 2 04:49 2690 2024-06-02T04:50:02.652 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 270336 Jun 2 04:49 2691 2024-06-02T04:50:02.652 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2692 2024-06-02T04:50:02.652 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2693 2024-06-02T04:50:02.652 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2696 2024-06-02T04:50:02.652 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2699 2024-06-02T04:50:02.652 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2701 2024-06-02T04:50:02.652 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2702 2024-06-02T04:50:02.652 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2703 2024-06-02T04:50:02.652 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jun 2 04:49 2704 2024-06-02T04:50:02.652 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2753 2024-06-02T04:50:02.653 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2753_fsm 2024-06-02T04:50:02.653 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2753_vm 2024-06-02T04:50:02.653 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2754 2024-06-02T04:50:02.653 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2755 2024-06-02T04:50:02.653 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 04:49 2756 2024-06-02T04:50:02.653 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 04:49 2757 2024-06-02T04:50:02.653 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2830 2024-06-02T04:50:02.653 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2830_vm 2024-06-02T04:50:02.653 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2831 2024-06-02T04:50:02.653 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2832 2024-06-02T04:50:02.653 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2832_vm 2024-06-02T04:50:02.653 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2833 2024-06-02T04:50:02.653 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2834 2024-06-02T04:50:02.654 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2834_vm 2024-06-02T04:50:02.654 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2835 2024-06-02T04:50:02.654 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2836 2024-06-02T04:50:02.654 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2836_vm 2024-06-02T04:50:02.654 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2837 2024-06-02T04:50:02.654 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 417792 Jun 2 04:49 2838 2024-06-02T04:50:02.654 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2838_fsm 2024-06-02T04:50:02.654 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2838_vm 2024-06-02T04:50:02.654 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2839 2024-06-02T04:50:02.654 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2840 2024-06-02T04:50:02.654 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2840_fsm 2024-06-02T04:50:02.654 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2840_vm 2024-06-02T04:50:02.654 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2841 2024-06-02T04:50:02.655 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2995 2024-06-02T04:50:02.655 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2995_vm 2024-06-02T04:50:02.655 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2996 2024-06-02T04:50:02.655 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3079 2024-06-02T04:50:02.655 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 3079_fsm 2024-06-02T04:50:02.655 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3079_vm 2024-06-02T04:50:02.655 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 3080 2024-06-02T04:50:02.655 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 3081 2024-06-02T04:50:02.655 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 3085 2024-06-02T04:50:02.655 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3118 2024-06-02T04:50:02.655 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3118_vm 2024-06-02T04:50:02.655 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3119 2024-06-02T04:50:02.655 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 3164 2024-06-02T04:50:02.655 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3256 2024-06-02T04:50:02.655 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3256_vm 2024-06-02T04:50:02.656 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3257 2024-06-02T04:50:02.656 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3258 2024-06-02T04:50:02.656 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3350 2024-06-02T04:50:02.656 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3350_vm 2024-06-02T04:50:02.656 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3351 2024-06-02T04:50:02.656 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3379 2024-06-02T04:50:02.656 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3380 2024-06-02T04:50:02.656 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3381 2024-06-02T04:50:02.656 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3381_vm 2024-06-02T04:50:02.656 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 3394 2024-06-02T04:50:02.656 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 3394_fsm 2024-06-02T04:50:02.656 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3394_vm 2024-06-02T04:50:02.656 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 3395 2024-06-02T04:50:02.657 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3439 2024-06-02T04:50:02.657 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3439_vm 2024-06-02T04:50:02.657 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3440 2024-06-02T04:50:02.657 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jun 2 04:49 3455 2024-06-02T04:50:02.657 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 3456 2024-06-02T04:50:02.657 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 3456_fsm 2024-06-02T04:50:02.657 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3456_vm 2024-06-02T04:50:02.657 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3466 2024-06-02T04:50:02.657 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3466_vm 2024-06-02T04:50:02.657 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3467 2024-06-02T04:50:02.657 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3468 2024-06-02T04:50:02.657 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3501 2024-06-02T04:50:02.657 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3501_vm 2024-06-02T04:50:02.657 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3502 2024-06-02T04:50:02.658 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3503 2024-06-02T04:50:02.658 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3534 2024-06-02T04:50:02.658 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3541 2024-06-02T04:50:02.658 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 3541_fsm 2024-06-02T04:50:02.658 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3541_vm 2024-06-02T04:50:02.658 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 3542 2024-06-02T04:50:02.658 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3574 2024-06-02T04:50:02.658 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3575 2024-06-02T04:50:02.658 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3576 2024-06-02T04:50:02.658 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3576_vm 2024-06-02T04:50:02.658 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3596 2024-06-02T04:50:02.658 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3596_vm 2024-06-02T04:50:02.658 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3597 2024-06-02T04:50:02.658 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3598 2024-06-02T04:50:02.659 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3598_vm 2024-06-02T04:50:02.659 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3599 2024-06-02T04:50:02.659 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3600 2024-06-02T04:50:02.659 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 3600_fsm 2024-06-02T04:50:02.659 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3600_vm 2024-06-02T04:50:02.659 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3601 2024-06-02T04:50:02.659 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 3601_fsm 2024-06-02T04:50:02.659 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3601_vm 2024-06-02T04:50:02.659 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3602 2024-06-02T04:50:02.659 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 3602_fsm 2024-06-02T04:50:02.896 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3602_vm 2024-06-02T04:50:02.896 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 3603 2024-06-02T04:50:02.896 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 3603_fsm 2024-06-02T04:50:02.896 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3603_vm 2024-06-02T04:50:02.896 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 3604 2024-06-02T04:50:02.896 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 3605 2024-06-02T04:50:02.896 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 3606 2024-06-02T04:50:02.896 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 3607 2024-06-02T04:50:02.896 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 3608 2024-06-02T04:50:02.897 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 04:49 3609 2024-06-02T04:50:02.897 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 3712 2024-06-02T04:50:02.897 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3764 2024-06-02T04:50:02.897 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 3764_fsm 2024-06-02T04:50:02.897 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3764_vm 2024-06-02T04:50:02.897 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 3766 2024-06-02T04:50:02.897 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 3767 2024-06-02T04:50:02.897 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3997 2024-06-02T04:50:02.897 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 5002 2024-06-02T04:50:02.897 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 548 2024-06-02T04:50:02.897 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 549 2024-06-02T04:50:02.897 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 6102 2024-06-02T04:50:02.897 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 6102_vm 2024-06-02T04:50:02.898 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 6104 2024-06-02T04:50:02.898 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 6104_vm 2024-06-02T04:50:02.898 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 6106 2024-06-02T04:50:02.898 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 6106_vm 2024-06-02T04:50:02.898 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 6110 2024-06-02T04:50:02.898 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 6111 2024-06-02T04:50:02.898 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 6112 2024-06-02T04:50:02.898 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 6113 2024-06-02T04:50:02.898 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 6117 2024-06-02T04:50:02.898 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 826 2024-06-02T04:50:02.898 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 826_vm 2024-06-02T04:50:02.898 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 827 2024-06-02T04:50:02.898 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 828 2024-06-02T04:50:02.899 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Jun 2 04:49 pg_filenode.map 2024-06-02T04:50:02.899 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Jun 2 04:49 PG_VERSION 2024-06-02T04:50:02.899 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:50:02.899 INFO:teuthology.orchestra.run.smithi076.stdout:/tmp/cephfs/postgres/data/base/12346: 2024-06-02T04:50:02.899 INFO:teuthology.orchestra.run.smithi076.stdout:total 7210 2024-06-02T04:50:02.899 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7381507 Jun 2 04:49 . 2024-06-02T04:50:02.899 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 22144521 Jun 2 04:49 .. 2024-06-02T04:50:02.899 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 112 2024-06-02T04:50:02.899 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 113 2024-06-02T04:50:02.900 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Jun 2 04:49 12182 2024-06-02T04:50:02.900 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 12182_fsm 2024-06-02T04:50:02.900 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 12182_vm 2024-06-02T04:50:02.900 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 12184 2024-06-02T04:50:02.900 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 12186 2024-06-02T04:50:02.900 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 12187 2024-06-02T04:50:02.900 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 12187_fsm 2024-06-02T04:50:02.900 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 12187_vm 2024-06-02T04:50:02.900 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 12189 2024-06-02T04:50:02.900 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 12191 2024-06-02T04:50:02.900 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 12192 2024-06-02T04:50:02.900 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 12192_fsm 2024-06-02T04:50:02.900 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 12192_vm 2024-06-02T04:50:02.900 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 12194 2024-06-02T04:50:02.901 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 12196 2024-06-02T04:50:02.901 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 12197 2024-06-02T04:50:02.901 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 12197_fsm 2024-06-02T04:50:02.901 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 12197_vm 2024-06-02T04:50:02.901 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 12199 2024-06-02T04:50:02.901 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 12201 2024-06-02T04:50:02.901 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 12202 2024-06-02T04:50:02.901 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 12202_fsm 2024-06-02T04:50:02.901 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 12202_vm 2024-06-02T04:50:02.901 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 12204 2024-06-02T04:50:02.901 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 12206 2024-06-02T04:50:02.901 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 12207 2024-06-02T04:50:02.901 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 12207_fsm 2024-06-02T04:50:02.901 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 12207_vm 2024-06-02T04:50:02.902 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 12209 2024-06-02T04:50:02.902 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 12211 2024-06-02T04:50:02.902 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 12212 2024-06-02T04:50:02.902 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 12214 2024-06-02T04:50:02.902 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 12216 2024-06-02T04:50:02.902 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 73728 Jun 2 04:49 1247 2024-06-02T04:50:02.902 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 1247_fsm 2024-06-02T04:50:02.902 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 1247_vm 2024-06-02T04:50:02.902 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 393216 Jun 2 04:49 1249 2024-06-02T04:50:02.902 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 1249_fsm 2024-06-02T04:50:02.902 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 1249_vm 2024-06-02T04:50:02.902 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 606208 Jun 2 04:49 1255 2024-06-02T04:50:02.902 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 1255_fsm 2024-06-02T04:50:02.903 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 1255_vm 2024-06-02T04:50:02.903 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Jun 2 04:49 1259 2024-06-02T04:50:02.903 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 1259_fsm 2024-06-02T04:50:02.903 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 1259_vm 2024-06-02T04:50:02.903 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 1417 2024-06-02T04:50:02.903 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 1417_vm 2024-06-02T04:50:02.903 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 1418 2024-06-02T04:50:02.903 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 1418_vm 2024-06-02T04:50:02.903 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 174 2024-06-02T04:50:02.903 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 175 2024-06-02T04:50:02.903 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2187 2024-06-02T04:50:02.903 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2224 2024-06-02T04:50:02.903 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2224_vm 2024-06-02T04:50:02.904 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2328 2024-06-02T04:50:02.904 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2328_vm 2024-06-02T04:50:02.904 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2336 2024-06-02T04:50:02.904 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2336_vm 2024-06-02T04:50:02.904 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2337 2024-06-02T04:50:02.904 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2600 2024-06-02T04:50:02.904 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2600_fsm 2024-06-02T04:50:02.904 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2600_vm 2024-06-02T04:50:02.904 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2601 2024-06-02T04:50:02.904 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2601_fsm 2024-06-02T04:50:02.904 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2601_vm 2024-06-02T04:50:02.904 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Jun 2 04:49 2602 2024-06-02T04:50:02.905 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2602_fsm 2024-06-02T04:50:02.905 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2602_vm 2024-06-02T04:50:02.905 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 04:49 2603 2024-06-02T04:50:02.905 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2603_fsm 2024-06-02T04:50:02.905 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2603_vm 2024-06-02T04:50:02.905 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2604 2024-06-02T04:50:02.905 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2604_vm 2024-06-02T04:50:02.905 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2605 2024-06-02T04:50:02.905 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2605_fsm 2024-06-02T04:50:02.905 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2605_vm 2024-06-02T04:50:02.905 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2606 2024-06-02T04:50:02.905 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2606_fsm 2024-06-02T04:50:02.905 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2606_vm 2024-06-02T04:50:02.905 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2607 2024-06-02T04:50:02.905 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2607_fsm 2024-06-02T04:50:02.906 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2607_vm 2024-06-02T04:50:02.906 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 442368 Jun 2 04:49 2608 2024-06-02T04:50:02.906 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2608_fsm 2024-06-02T04:50:02.906 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2608_vm 2024-06-02T04:50:02.906 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 286720 Jun 2 04:49 2609 2024-06-02T04:50:02.906 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2609_fsm 2024-06-02T04:50:02.906 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2609_vm 2024-06-02T04:50:02.906 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2610 2024-06-02T04:50:02.906 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2610_fsm 2024-06-02T04:50:02.906 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2610_vm 2024-06-02T04:50:02.906 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2611 2024-06-02T04:50:02.906 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2611_vm 2024-06-02T04:50:02.906 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2612 2024-06-02T04:50:02.907 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2612_fsm 2024-06-02T04:50:02.907 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2612_vm 2024-06-02T04:50:02.907 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2613 2024-06-02T04:50:02.907 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2613_vm 2024-06-02T04:50:02.907 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2615 2024-06-02T04:50:02.907 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2615_fsm 2024-06-02T04:50:02.907 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2615_vm 2024-06-02T04:50:02.907 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2616 2024-06-02T04:50:02.907 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2616_fsm 2024-06-02T04:50:02.907 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2616_vm 2024-06-02T04:50:02.907 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Jun 2 04:49 2617 2024-06-02T04:50:02.908 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2617_fsm 2024-06-02T04:50:02.908 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2617_vm 2024-06-02T04:50:02.908 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Jun 2 04:49 2618 2024-06-02T04:50:02.908 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2618_fsm 2024-06-02T04:50:02.908 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2618_vm 2024-06-02T04:50:02.908 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 131072 Jun 2 04:49 2619 2024-06-02T04:50:02.908 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2619_fsm 2024-06-02T04:50:02.908 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2619_vm 2024-06-02T04:50:02.908 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2620 2024-06-02T04:50:02.908 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2620_vm 2024-06-02T04:50:02.908 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2650 2024-06-02T04:50:02.908 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2651 2024-06-02T04:50:02.909 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2652 2024-06-02T04:50:02.909 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jun 2 04:49 2653 2024-06-02T04:50:02.909 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jun 2 04:49 2654 2024-06-02T04:50:02.909 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 04:49 2655 2024-06-02T04:50:02.909 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2656 2024-06-02T04:50:02.909 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2657 2024-06-02T04:50:02.909 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Jun 2 04:49 2658 2024-06-02T04:50:02.909 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Jun 2 04:49 2659 2024-06-02T04:50:02.909 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2660 2024-06-02T04:50:02.909 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2661 2024-06-02T04:50:02.909 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 04:49 2662 2024-06-02T04:50:02.910 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Jun 2 04:49 2663 2024-06-02T04:50:02.910 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2664 2024-06-02T04:50:02.910 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2665 2024-06-02T04:50:02.910 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2666 2024-06-02T04:50:02.910 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2667 2024-06-02T04:50:02.910 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2668 2024-06-02T04:50:02.910 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2669 2024-06-02T04:50:02.910 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2670 2024-06-02T04:50:02.910 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 327680 Jun 2 04:49 2673 2024-06-02T04:50:02.911 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 385024 Jun 2 04:49 2674 2024-06-02T04:50:02.911 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 180224 Jun 2 04:49 2675 2024-06-02T04:50:02.911 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2678 2024-06-02T04:50:02.911 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2679 2024-06-02T04:50:02.911 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2680 2024-06-02T04:50:02.911 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2681 2024-06-02T04:50:02.911 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2682 2024-06-02T04:50:02.911 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2683 2024-06-02T04:50:02.911 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2684 2024-06-02T04:50:02.911 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2685 2024-06-02T04:50:02.911 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2686 2024-06-02T04:50:02.911 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2687 2024-06-02T04:50:02.911 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jun 2 04:49 2688 2024-06-02T04:50:02.912 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Jun 2 04:49 2689 2024-06-02T04:50:02.912 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Jun 2 04:49 2690 2024-06-02T04:50:02.912 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 270336 Jun 2 04:49 2691 2024-06-02T04:50:02.912 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2692 2024-06-02T04:50:02.912 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2693 2024-06-02T04:50:02.912 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2696 2024-06-02T04:50:02.912 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2699 2024-06-02T04:50:02.912 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2701 2024-06-02T04:50:02.912 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2702 2024-06-02T04:50:02.912 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2703 2024-06-02T04:50:02.912 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jun 2 04:49 2704 2024-06-02T04:50:02.913 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2753 2024-06-02T04:50:02.913 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2753_fsm 2024-06-02T04:50:02.913 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2753_vm 2024-06-02T04:50:02.913 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2754 2024-06-02T04:50:02.913 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2755 2024-06-02T04:50:02.913 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 04:49 2756 2024-06-02T04:50:02.913 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 04:49 2757 2024-06-02T04:50:02.913 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2830 2024-06-02T04:50:02.913 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2830_vm 2024-06-02T04:50:02.913 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2831 2024-06-02T04:50:02.913 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2832 2024-06-02T04:50:02.913 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2832_vm 2024-06-02T04:50:02.914 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2833 2024-06-02T04:50:02.914 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2834 2024-06-02T04:50:02.914 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2834_vm 2024-06-02T04:50:02.914 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2835 2024-06-02T04:50:02.914 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2836 2024-06-02T04:50:02.914 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2836_vm 2024-06-02T04:50:02.914 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2837 2024-06-02T04:50:02.914 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 417792 Jun 2 04:49 2838 2024-06-02T04:50:02.914 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2838_fsm 2024-06-02T04:50:02.914 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2838_vm 2024-06-02T04:50:02.914 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2839 2024-06-02T04:50:02.914 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2840 2024-06-02T04:50:02.915 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2840_fsm 2024-06-02T04:50:02.915 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2840_vm 2024-06-02T04:50:02.915 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2841 2024-06-02T04:50:02.915 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2995 2024-06-02T04:50:02.915 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2995_vm 2024-06-02T04:50:02.915 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2996 2024-06-02T04:50:02.915 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3079 2024-06-02T04:50:02.915 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 3079_fsm 2024-06-02T04:50:02.915 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3079_vm 2024-06-02T04:50:02.915 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 3080 2024-06-02T04:50:02.915 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 3081 2024-06-02T04:50:02.915 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 3085 2024-06-02T04:50:02.915 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3118 2024-06-02T04:50:02.916 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3118_vm 2024-06-02T04:50:02.916 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3119 2024-06-02T04:50:02.916 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 3164 2024-06-02T04:50:02.916 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3256 2024-06-02T04:50:02.916 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3256_vm 2024-06-02T04:50:02.916 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3257 2024-06-02T04:50:02.916 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3258 2024-06-02T04:50:02.916 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3350 2024-06-02T04:50:02.916 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3350_vm 2024-06-02T04:50:02.916 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3351 2024-06-02T04:50:02.916 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3379 2024-06-02T04:50:02.916 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3380 2024-06-02T04:50:02.916 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3381 2024-06-02T04:50:02.917 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3381_vm 2024-06-02T04:50:02.917 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 3394 2024-06-02T04:50:02.917 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 3394_fsm 2024-06-02T04:50:02.917 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3394_vm 2024-06-02T04:50:02.917 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 3395 2024-06-02T04:50:02.917 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3439 2024-06-02T04:50:02.917 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3439_vm 2024-06-02T04:50:02.917 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3440 2024-06-02T04:50:02.917 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jun 2 04:49 3455 2024-06-02T04:50:02.918 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 3456 2024-06-02T04:50:02.918 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 3456_fsm 2024-06-02T04:50:02.918 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3456_vm 2024-06-02T04:50:02.918 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3466 2024-06-02T04:50:02.918 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3466_vm 2024-06-02T04:50:02.918 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3467 2024-06-02T04:50:02.918 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3468 2024-06-02T04:50:02.918 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3501 2024-06-02T04:50:02.918 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3501_vm 2024-06-02T04:50:02.918 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3502 2024-06-02T04:50:02.918 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3503 2024-06-02T04:50:02.918 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3534 2024-06-02T04:50:02.919 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3541 2024-06-02T04:50:02.919 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 3541_fsm 2024-06-02T04:50:02.919 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3541_vm 2024-06-02T04:50:02.919 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 3542 2024-06-02T04:50:02.919 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3574 2024-06-02T04:50:02.919 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3575 2024-06-02T04:50:02.919 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3576 2024-06-02T04:50:02.920 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3576_vm 2024-06-02T04:50:02.920 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3596 2024-06-02T04:50:02.920 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3596_vm 2024-06-02T04:50:02.920 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3597 2024-06-02T04:50:02.920 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3598 2024-06-02T04:50:02.920 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3598_vm 2024-06-02T04:50:02.921 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3599 2024-06-02T04:50:02.921 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3600 2024-06-02T04:50:02.921 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 3600_fsm 2024-06-02T04:50:02.921 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3600_vm 2024-06-02T04:50:02.921 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3601 2024-06-02T04:50:02.921 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 3601_fsm 2024-06-02T04:50:02.922 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3601_vm 2024-06-02T04:50:02.922 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3602 2024-06-02T04:50:03.152 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 3602_fsm 2024-06-02T04:50:03.152 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3602_vm 2024-06-02T04:50:03.153 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 3603 2024-06-02T04:50:03.153 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 3603_fsm 2024-06-02T04:50:03.153 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3603_vm 2024-06-02T04:50:03.153 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 3604 2024-06-02T04:50:03.153 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 3605 2024-06-02T04:50:03.153 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 3606 2024-06-02T04:50:03.153 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 3607 2024-06-02T04:50:03.153 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 3608 2024-06-02T04:50:03.153 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 04:49 3609 2024-06-02T04:50:03.153 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 3712 2024-06-02T04:50:03.153 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3764 2024-06-02T04:50:03.153 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 3764_fsm 2024-06-02T04:50:03.154 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3764_vm 2024-06-02T04:50:03.154 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 3766 2024-06-02T04:50:03.154 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 3767 2024-06-02T04:50:03.154 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3997 2024-06-02T04:50:03.154 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 5002 2024-06-02T04:50:03.154 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 548 2024-06-02T04:50:03.154 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 549 2024-06-02T04:50:03.154 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 6102 2024-06-02T04:50:03.154 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 6102_vm 2024-06-02T04:50:03.154 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 6104 2024-06-02T04:50:03.154 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 6104_vm 2024-06-02T04:50:03.154 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 6106 2024-06-02T04:50:03.154 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 6106_vm 2024-06-02T04:50:03.155 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 6110 2024-06-02T04:50:03.155 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 6111 2024-06-02T04:50:03.155 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 6112 2024-06-02T04:50:03.155 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 6113 2024-06-02T04:50:03.155 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 6117 2024-06-02T04:50:03.155 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 826 2024-06-02T04:50:03.155 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 826_vm 2024-06-02T04:50:03.155 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 827 2024-06-02T04:50:03.155 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 828 2024-06-02T04:50:03.155 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Jun 2 04:49 pg_filenode.map 2024-06-02T04:50:03.155 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Jun 2 04:49 PG_VERSION 2024-06-02T04:50:03.155 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:50:03.155 INFO:teuthology.orchestra.run.smithi076.stdout:/tmp/cephfs/postgres/data/base/12347: 2024-06-02T04:50:03.155 INFO:teuthology.orchestra.run.smithi076.stdout:total 7210 2024-06-02T04:50:03.156 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7381507 Jun 2 04:49 . 2024-06-02T04:50:03.156 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 22144521 Jun 2 04:49 .. 2024-06-02T04:50:03.156 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 112 2024-06-02T04:50:03.156 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 113 2024-06-02T04:50:03.156 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Jun 2 04:49 12182 2024-06-02T04:50:03.156 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 12182_fsm 2024-06-02T04:50:03.156 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 12182_vm 2024-06-02T04:50:03.156 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 12184 2024-06-02T04:50:03.156 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 12186 2024-06-02T04:50:03.156 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 12187 2024-06-02T04:50:03.156 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 12187_fsm 2024-06-02T04:50:03.156 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 12187_vm 2024-06-02T04:50:03.156 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 12189 2024-06-02T04:50:03.156 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 12191 2024-06-02T04:50:03.157 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 12192 2024-06-02T04:50:03.157 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 12192_fsm 2024-06-02T04:50:03.157 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 12192_vm 2024-06-02T04:50:03.157 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 12194 2024-06-02T04:50:03.157 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 12196 2024-06-02T04:50:03.157 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 12197 2024-06-02T04:50:03.157 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 12197_fsm 2024-06-02T04:50:03.157 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 12197_vm 2024-06-02T04:50:03.157 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 12199 2024-06-02T04:50:03.157 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 12201 2024-06-02T04:50:03.157 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 12202 2024-06-02T04:50:03.157 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 12202_fsm 2024-06-02T04:50:03.157 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 12202_vm 2024-06-02T04:50:03.157 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 12204 2024-06-02T04:50:03.157 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 12206 2024-06-02T04:50:03.158 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 12207 2024-06-02T04:50:03.158 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 12207_fsm 2024-06-02T04:50:03.158 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 12207_vm 2024-06-02T04:50:03.158 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 12209 2024-06-02T04:50:03.158 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 12211 2024-06-02T04:50:03.158 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 12212 2024-06-02T04:50:03.158 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 12214 2024-06-02T04:50:03.158 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 12216 2024-06-02T04:50:03.158 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 73728 Jun 2 04:49 1247 2024-06-02T04:50:03.158 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 1247_fsm 2024-06-02T04:50:03.158 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 1247_vm 2024-06-02T04:50:03.158 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 393216 Jun 2 04:49 1249 2024-06-02T04:50:03.158 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 1249_fsm 2024-06-02T04:50:03.158 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 1249_vm 2024-06-02T04:50:03.159 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 606208 Jun 2 04:49 1255 2024-06-02T04:50:03.159 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 1255_fsm 2024-06-02T04:50:03.159 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 1255_vm 2024-06-02T04:50:03.159 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Jun 2 04:49 1259 2024-06-02T04:50:03.159 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 1259_fsm 2024-06-02T04:50:03.159 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 1259_vm 2024-06-02T04:50:03.159 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 1417 2024-06-02T04:50:03.159 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 1417_vm 2024-06-02T04:50:03.159 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 1418 2024-06-02T04:50:03.159 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 1418_vm 2024-06-02T04:50:03.159 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 174 2024-06-02T04:50:03.159 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 175 2024-06-02T04:50:03.159 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2187 2024-06-02T04:50:03.160 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2224 2024-06-02T04:50:03.160 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2224_vm 2024-06-02T04:50:03.160 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2328 2024-06-02T04:50:03.160 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2328_vm 2024-06-02T04:50:03.160 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2336 2024-06-02T04:50:03.160 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2336_vm 2024-06-02T04:50:03.160 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2337 2024-06-02T04:50:03.160 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2600 2024-06-02T04:50:03.160 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2600_fsm 2024-06-02T04:50:03.160 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2600_vm 2024-06-02T04:50:03.160 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2601 2024-06-02T04:50:03.160 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2601_fsm 2024-06-02T04:50:03.160 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2601_vm 2024-06-02T04:50:03.160 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Jun 2 04:49 2602 2024-06-02T04:50:03.161 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2602_fsm 2024-06-02T04:50:03.161 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2602_vm 2024-06-02T04:50:03.161 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 04:49 2603 2024-06-02T04:50:03.161 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2603_fsm 2024-06-02T04:50:03.161 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2603_vm 2024-06-02T04:50:03.161 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2604 2024-06-02T04:50:03.161 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2604_vm 2024-06-02T04:50:03.161 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2605 2024-06-02T04:50:03.161 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2605_fsm 2024-06-02T04:50:03.161 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2605_vm 2024-06-02T04:50:03.161 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2606 2024-06-02T04:50:03.161 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2606_fsm 2024-06-02T04:50:03.161 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2606_vm 2024-06-02T04:50:03.161 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2607 2024-06-02T04:50:03.162 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2607_fsm 2024-06-02T04:50:03.162 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2607_vm 2024-06-02T04:50:03.162 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 442368 Jun 2 04:49 2608 2024-06-02T04:50:03.162 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2608_fsm 2024-06-02T04:50:03.162 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2608_vm 2024-06-02T04:50:03.162 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 286720 Jun 2 04:49 2609 2024-06-02T04:50:03.162 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2609_fsm 2024-06-02T04:50:03.162 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2609_vm 2024-06-02T04:50:03.162 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2610 2024-06-02T04:50:03.162 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2610_fsm 2024-06-02T04:50:03.162 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2610_vm 2024-06-02T04:50:03.162 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2611 2024-06-02T04:50:03.163 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2611_vm 2024-06-02T04:50:03.163 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2612 2024-06-02T04:50:03.163 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2612_fsm 2024-06-02T04:50:03.163 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2612_vm 2024-06-02T04:50:03.163 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2613 2024-06-02T04:50:03.163 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2613_vm 2024-06-02T04:50:03.163 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2615 2024-06-02T04:50:03.163 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2615_fsm 2024-06-02T04:50:03.163 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2615_vm 2024-06-02T04:50:03.163 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2616 2024-06-02T04:50:03.163 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2616_fsm 2024-06-02T04:50:03.163 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2616_vm 2024-06-02T04:50:03.163 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Jun 2 04:49 2617 2024-06-02T04:50:03.163 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2617_fsm 2024-06-02T04:50:03.164 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2617_vm 2024-06-02T04:50:03.164 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Jun 2 04:49 2618 2024-06-02T04:50:03.164 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2618_fsm 2024-06-02T04:50:03.164 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2618_vm 2024-06-02T04:50:03.164 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 131072 Jun 2 04:49 2619 2024-06-02T04:50:03.164 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2619_fsm 2024-06-02T04:50:03.164 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2619_vm 2024-06-02T04:50:03.164 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2620 2024-06-02T04:50:03.164 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2620_vm 2024-06-02T04:50:03.164 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2650 2024-06-02T04:50:03.164 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2651 2024-06-02T04:50:03.164 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2652 2024-06-02T04:50:03.164 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jun 2 04:49 2653 2024-06-02T04:50:03.164 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jun 2 04:49 2654 2024-06-02T04:50:03.165 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 04:49 2655 2024-06-02T04:50:03.165 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2656 2024-06-02T04:50:03.165 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2657 2024-06-02T04:50:03.165 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Jun 2 04:49 2658 2024-06-02T04:50:03.165 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Jun 2 04:49 2659 2024-06-02T04:50:03.165 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2660 2024-06-02T04:50:03.165 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2661 2024-06-02T04:50:03.165 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 04:49 2662 2024-06-02T04:50:03.165 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Jun 2 04:49 2663 2024-06-02T04:50:03.165 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2664 2024-06-02T04:50:03.165 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2665 2024-06-02T04:50:03.165 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2666 2024-06-02T04:50:03.165 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2667 2024-06-02T04:50:03.166 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2668 2024-06-02T04:50:03.166 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2669 2024-06-02T04:50:03.166 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2670 2024-06-02T04:50:03.166 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 327680 Jun 2 04:49 2673 2024-06-02T04:50:03.166 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 385024 Jun 2 04:49 2674 2024-06-02T04:50:03.166 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 180224 Jun 2 04:49 2675 2024-06-02T04:50:03.166 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2678 2024-06-02T04:50:03.166 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2679 2024-06-02T04:50:03.166 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2680 2024-06-02T04:50:03.166 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2681 2024-06-02T04:50:03.166 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2682 2024-06-02T04:50:03.166 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2683 2024-06-02T04:50:03.167 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2684 2024-06-02T04:50:03.167 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2685 2024-06-02T04:50:03.167 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2686 2024-06-02T04:50:03.167 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2687 2024-06-02T04:50:03.167 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jun 2 04:49 2688 2024-06-02T04:50:03.167 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Jun 2 04:49 2689 2024-06-02T04:50:03.167 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Jun 2 04:49 2690 2024-06-02T04:50:03.167 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 270336 Jun 2 04:49 2691 2024-06-02T04:50:03.167 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2692 2024-06-02T04:50:03.167 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2693 2024-06-02T04:50:03.167 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2696 2024-06-02T04:50:03.167 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2699 2024-06-02T04:50:03.167 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2701 2024-06-02T04:50:03.167 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2702 2024-06-02T04:50:03.168 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2703 2024-06-02T04:50:03.168 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jun 2 04:49 2704 2024-06-02T04:50:03.168 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2753 2024-06-02T04:50:03.168 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2753_fsm 2024-06-02T04:50:03.168 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2753_vm 2024-06-02T04:50:03.168 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2754 2024-06-02T04:50:03.168 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2755 2024-06-02T04:50:03.168 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 04:49 2756 2024-06-02T04:50:03.168 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 04:49 2757 2024-06-02T04:50:03.168 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2830 2024-06-02T04:50:03.168 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2830_vm 2024-06-02T04:50:03.168 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2831 2024-06-02T04:50:03.168 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2832 2024-06-02T04:50:03.169 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2832_vm 2024-06-02T04:50:03.169 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2833 2024-06-02T04:50:03.169 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2834 2024-06-02T04:50:03.169 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2834_vm 2024-06-02T04:50:03.169 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2835 2024-06-02T04:50:03.169 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2836 2024-06-02T04:50:03.169 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2836_vm 2024-06-02T04:50:03.169 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2837 2024-06-02T04:50:03.169 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 417792 Jun 2 04:49 2838 2024-06-02T04:50:03.169 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2838_fsm 2024-06-02T04:50:03.169 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2838_vm 2024-06-02T04:50:03.169 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2839 2024-06-02T04:50:03.170 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2840 2024-06-02T04:50:03.170 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2840_fsm 2024-06-02T04:50:03.170 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2840_vm 2024-06-02T04:50:03.170 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2841 2024-06-02T04:50:03.170 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2995 2024-06-02T04:50:03.170 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2995_vm 2024-06-02T04:50:03.170 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2996 2024-06-02T04:50:03.170 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3079 2024-06-02T04:50:03.170 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 3079_fsm 2024-06-02T04:50:03.170 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3079_vm 2024-06-02T04:50:03.170 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 3080 2024-06-02T04:50:03.170 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 3081 2024-06-02T04:50:03.170 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 3085 2024-06-02T04:50:03.170 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3118 2024-06-02T04:50:03.171 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3118_vm 2024-06-02T04:50:03.171 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3119 2024-06-02T04:50:03.171 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 3164 2024-06-02T04:50:03.171 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3256 2024-06-02T04:50:03.171 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3256_vm 2024-06-02T04:50:03.171 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3257 2024-06-02T04:50:03.171 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3258 2024-06-02T04:50:03.171 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3350 2024-06-02T04:50:03.171 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3350_vm 2024-06-02T04:50:03.171 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3351 2024-06-02T04:50:03.171 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3379 2024-06-02T04:50:03.171 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3380 2024-06-02T04:50:03.171 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3381 2024-06-02T04:50:03.172 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3381_vm 2024-06-02T04:50:03.172 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 3394 2024-06-02T04:50:03.172 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 3394_fsm 2024-06-02T04:50:03.172 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3394_vm 2024-06-02T04:50:03.172 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 3395 2024-06-02T04:50:03.172 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3439 2024-06-02T04:50:03.172 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3439_vm 2024-06-02T04:50:03.172 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3440 2024-06-02T04:50:03.172 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jun 2 04:49 3455 2024-06-02T04:50:03.172 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 3456 2024-06-02T04:50:03.172 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 3456_fsm 2024-06-02T04:50:03.172 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3456_vm 2024-06-02T04:50:03.172 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3466 2024-06-02T04:50:03.172 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3466_vm 2024-06-02T04:50:03.173 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3467 2024-06-02T04:50:03.173 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3468 2024-06-02T04:50:03.173 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3501 2024-06-02T04:50:03.173 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3501_vm 2024-06-02T04:50:03.173 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3502 2024-06-02T04:50:03.173 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3503 2024-06-02T04:50:03.173 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3534 2024-06-02T04:50:03.173 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3541 2024-06-02T04:50:03.173 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 3541_fsm 2024-06-02T04:50:03.173 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3541_vm 2024-06-02T04:50:03.173 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 3542 2024-06-02T04:50:03.173 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3574 2024-06-02T04:50:03.173 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3575 2024-06-02T04:50:03.173 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3576 2024-06-02T04:50:03.174 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3576_vm 2024-06-02T04:50:03.174 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3596 2024-06-02T04:50:03.174 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3596_vm 2024-06-02T04:50:03.174 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3597 2024-06-02T04:50:03.174 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3598 2024-06-02T04:50:03.174 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3598_vm 2024-06-02T04:50:03.174 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3599 2024-06-02T04:50:03.174 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3600 2024-06-02T04:50:03.174 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 3600_fsm 2024-06-02T04:50:03.174 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3600_vm 2024-06-02T04:50:03.174 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3601 2024-06-02T04:50:03.174 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 3601_fsm 2024-06-02T04:50:03.174 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3601_vm 2024-06-02T04:50:03.175 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3602 2024-06-02T04:50:03.195 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 3602_fsm 2024-06-02T04:50:03.195 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3602_vm 2024-06-02T04:50:03.195 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 3603 2024-06-02T04:50:03.195 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 3603_fsm 2024-06-02T04:50:03.195 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3603_vm 2024-06-02T04:50:03.195 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 3604 2024-06-02T04:50:03.195 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 3605 2024-06-02T04:50:03.195 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 3606 2024-06-02T04:50:03.195 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 3607 2024-06-02T04:50:03.195 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 3608 2024-06-02T04:50:03.196 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 04:49 3609 2024-06-02T04:50:03.196 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 3712 2024-06-02T04:50:03.196 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3764 2024-06-02T04:50:03.196 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 3764_fsm 2024-06-02T04:50:03.196 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3764_vm 2024-06-02T04:50:03.196 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 3766 2024-06-02T04:50:03.196 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 3767 2024-06-02T04:50:03.196 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3997 2024-06-02T04:50:03.196 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 5002 2024-06-02T04:50:03.196 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 548 2024-06-02T04:50:03.196 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 549 2024-06-02T04:50:03.196 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 6102 2024-06-02T04:50:03.197 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 6102_vm 2024-06-02T04:50:03.197 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 6104 2024-06-02T04:50:03.197 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 6104_vm 2024-06-02T04:50:03.197 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 6106 2024-06-02T04:50:03.197 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 6106_vm 2024-06-02T04:50:03.197 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 6110 2024-06-02T04:50:03.197 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 6111 2024-06-02T04:50:03.197 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 6112 2024-06-02T04:50:03.197 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 6113 2024-06-02T04:50:03.197 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 6117 2024-06-02T04:50:03.197 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 826 2024-06-02T04:50:03.197 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 826_vm 2024-06-02T04:50:03.197 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 827 2024-06-02T04:50:03.198 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 828 2024-06-02T04:50:03.198 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Jun 2 04:49 pg_filenode.map 2024-06-02T04:50:03.198 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Jun 2 04:49 PG_VERSION 2024-06-02T04:50:03.198 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:50:03.198 INFO:teuthology.orchestra.run.smithi076.stdout:/tmp/cephfs/postgres/data/global: 2024-06-02T04:50:03.198 INFO:teuthology.orchestra.run.smithi076.stdout:total 554 2024-06-02T04:50:03.198 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 565760 Jun 2 04:49 . 2024-06-02T04:50:03.198 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39557450 Jun 2 04:50 .. 2024-06-02T04:50:03.198 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 1136 2024-06-02T04:50:03.198 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 1136_fsm 2024-06-02T04:50:03.198 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 1136_vm 2024-06-02T04:50:03.198 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 1137 2024-06-02T04:50:03.198 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 1213 2024-06-02T04:50:03.199 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 1213_fsm 2024-06-02T04:50:03.199 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 1213_vm 2024-06-02T04:50:03.199 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 1214 2024-06-02T04:50:03.199 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 1214_fsm 2024-06-02T04:50:03.199 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 1214_vm 2024-06-02T04:50:03.199 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 1232 2024-06-02T04:50:03.199 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 1233 2024-06-02T04:50:03.199 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 1260 2024-06-02T04:50:03.199 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 1260_fsm 2024-06-02T04:50:03.199 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 1260_vm 2024-06-02T04:50:03.199 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 1261 2024-06-02T04:50:03.199 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 1261_fsm 2024-06-02T04:50:03.199 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 1261_vm 2024-06-02T04:50:03.199 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 1262 2024-06-02T04:50:03.200 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 1262_fsm 2024-06-02T04:50:03.200 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 1262_vm 2024-06-02T04:50:03.200 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2396 2024-06-02T04:50:03.200 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2396_fsm 2024-06-02T04:50:03.200 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2396_vm 2024-06-02T04:50:03.200 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2397 2024-06-02T04:50:03.200 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2671 2024-06-02T04:50:03.200 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2672 2024-06-02T04:50:03.200 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2676 2024-06-02T04:50:03.200 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2677 2024-06-02T04:50:03.200 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2694 2024-06-02T04:50:03.200 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2695 2024-06-02T04:50:03.200 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2697 2024-06-02T04:50:03.201 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2698 2024-06-02T04:50:03.201 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2846 2024-06-02T04:50:03.201 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2846_vm 2024-06-02T04:50:03.201 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2847 2024-06-02T04:50:03.201 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2964 2024-06-02T04:50:03.201 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2964_vm 2024-06-02T04:50:03.201 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2965 2024-06-02T04:50:03.201 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2966 2024-06-02T04:50:03.201 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2966_vm 2024-06-02T04:50:03.201 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2967 2024-06-02T04:50:03.201 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3592 2024-06-02T04:50:03.229 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3592_vm 2024-06-02T04:50:03.229 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3593 2024-06-02T04:50:03.229 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 4060 2024-06-02T04:50:03.229 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 4060_vm 2024-06-02T04:50:03.230 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 4061 2024-06-02T04:50:03.230 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 6000 2024-06-02T04:50:03.230 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 6000_vm 2024-06-02T04:50:03.230 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 6001 2024-06-02T04:50:03.230 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 6002 2024-06-02T04:50:03.230 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 6100 2024-06-02T04:50:03.231 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 6100_vm 2024-06-02T04:50:03.231 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 6114 2024-06-02T04:50:03.231 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 6115 2024-06-02T04:50:03.231 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 pg_control 2024-06-02T04:50:03.231 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Jun 2 04:49 pg_filenode.map 2024-06-02T04:50:03.231 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:50:03.231 INFO:teuthology.orchestra.run.smithi076.stdout:/tmp/cephfs/postgres/data/log: 2024-06-02T04:50:03.232 INFO:teuthology.orchestra.run.smithi076.stdout:total 1 2024-06-02T04:50:03.232 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:50 . 2024-06-02T04:50:03.232 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39557450 Jun 2 04:50 .. 2024-06-02T04:50:03.232 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:50:03.232 INFO:teuthology.orchestra.run.smithi076.stdout:/tmp/cephfs/postgres/data/pg_commit_ts: 2024-06-02T04:50:03.232 INFO:teuthology.orchestra.run.smithi076.stdout:total 1 2024-06-02T04:50:03.233 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 . 2024-06-02T04:50:03.233 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39557450 Jun 2 04:50 .. 2024-06-02T04:50:03.233 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:50:03.233 INFO:teuthology.orchestra.run.smithi076.stdout:/tmp/cephfs/postgres/data/pg_dynshmem: 2024-06-02T04:50:03.233 INFO:teuthology.orchestra.run.smithi076.stdout:total 1 2024-06-02T04:50:03.233 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 . 2024-06-02T04:50:03.233 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39557450 Jun 2 04:50 .. 2024-06-02T04:50:03.234 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:50:03.234 INFO:teuthology.orchestra.run.smithi076.stdout:/tmp/cephfs/postgres/data/pg_logical: 2024-06-02T04:50:03.234 INFO:teuthology.orchestra.run.smithi076.stdout:total 3 2024-06-02T04:50:03.234 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Jun 2 04:49 . 2024-06-02T04:50:03.234 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39557450 Jun 2 04:50 .. 2024-06-02T04:50:03.234 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 mappings 2024-06-02T04:50:03.235 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Jun 2 04:49 replorigin_checkpoint 2024-06-02T04:50:03.235 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 snapshots 2024-06-02T04:50:03.235 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:50:03.235 INFO:teuthology.orchestra.run.smithi076.stdout:/tmp/cephfs/postgres/data/pg_logical/mappings: 2024-06-02T04:50:03.235 INFO:teuthology.orchestra.run.smithi076.stdout:total 1 2024-06-02T04:50:03.235 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 . 2024-06-02T04:50:03.235 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Jun 2 04:49 .. 2024-06-02T04:50:03.235 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:50:03.235 INFO:teuthology.orchestra.run.smithi076.stdout:/tmp/cephfs/postgres/data/pg_logical/snapshots: 2024-06-02T04:50:03.235 INFO:teuthology.orchestra.run.smithi076.stdout:total 1 2024-06-02T04:50:03.236 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 . 2024-06-02T04:50:03.236 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Jun 2 04:49 .. 2024-06-02T04:50:03.236 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:50:03.236 INFO:teuthology.orchestra.run.smithi076.stdout:/tmp/cephfs/postgres/data/pg_multixact: 2024-06-02T04:50:03.236 INFO:teuthology.orchestra.run.smithi076.stdout:total 2 2024-06-02T04:50:03.236 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 . 2024-06-02T04:50:03.236 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39557450 Jun 2 04:50 .. 2024-06-02T04:50:03.236 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 members 2024-06-02T04:50:03.236 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 offsets 2024-06-02T04:50:03.236 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:50:03.236 INFO:teuthology.orchestra.run.smithi076.stdout:/tmp/cephfs/postgres/data/pg_multixact/members: 2024-06-02T04:50:03.236 INFO:teuthology.orchestra.run.smithi076.stdout:total 9 2024-06-02T04:50:03.236 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 . 2024-06-02T04:50:03.237 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 .. 2024-06-02T04:50:03.237 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 0000 2024-06-02T04:50:03.237 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:50:03.237 INFO:teuthology.orchestra.run.smithi076.stdout:/tmp/cephfs/postgres/data/pg_multixact/offsets: 2024-06-02T04:50:03.237 INFO:teuthology.orchestra.run.smithi076.stdout:total 9 2024-06-02T04:50:03.237 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 . 2024-06-02T04:50:03.266 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 .. 2024-06-02T04:50:03.267 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 0000 2024-06-02T04:50:03.267 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:50:03.267 INFO:teuthology.orchestra.run.smithi076.stdout:/tmp/cephfs/postgres/data/pg_notify: 2024-06-02T04:50:03.267 INFO:teuthology.orchestra.run.smithi076.stdout:total 9 2024-06-02T04:50:03.267 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 . 2024-06-02T04:50:03.267 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39557450 Jun 2 04:50 .. 2024-06-02T04:50:03.267 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 0000 2024-06-02T04:50:03.267 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:50:03.267 INFO:teuthology.orchestra.run.smithi076.stdout:/tmp/cephfs/postgres/data/pg_replslot: 2024-06-02T04:50:03.267 INFO:teuthology.orchestra.run.smithi076.stdout:total 1 2024-06-02T04:50:03.267 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 . 2024-06-02T04:50:03.267 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39557450 Jun 2 04:50 .. 2024-06-02T04:50:03.267 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:50:03.267 INFO:teuthology.orchestra.run.smithi076.stdout:/tmp/cephfs/postgres/data/pg_serial: 2024-06-02T04:50:03.268 INFO:teuthology.orchestra.run.smithi076.stdout:total 1 2024-06-02T04:50:03.268 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 . 2024-06-02T04:50:03.268 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39557450 Jun 2 04:50 .. 2024-06-02T04:50:03.268 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:50:03.268 INFO:teuthology.orchestra.run.smithi076.stdout:/tmp/cephfs/postgres/data/pg_snapshots: 2024-06-02T04:50:03.268 INFO:teuthology.orchestra.run.smithi076.stdout:total 1 2024-06-02T04:50:03.268 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 . 2024-06-02T04:50:03.268 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39557450 Jun 2 04:50 .. 2024-06-02T04:50:03.268 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:50:03.268 INFO:teuthology.orchestra.run.smithi076.stdout:/tmp/cephfs/postgres/data/pg_stat: 2024-06-02T04:50:03.268 INFO:teuthology.orchestra.run.smithi076.stdout:total 1 2024-06-02T04:50:03.268 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 . 2024-06-02T04:50:03.268 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39557450 Jun 2 04:50 .. 2024-06-02T04:50:03.269 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:50:03.269 INFO:teuthology.orchestra.run.smithi076.stdout:/tmp/cephfs/postgres/data/pg_stat_tmp: 2024-06-02T04:50:03.269 INFO:teuthology.orchestra.run.smithi076.stdout:total 1 2024-06-02T04:50:03.269 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 . 2024-06-02T04:50:03.269 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39557450 Jun 2 04:50 .. 2024-06-02T04:50:03.269 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:50:03.269 INFO:teuthology.orchestra.run.smithi076.stdout:/tmp/cephfs/postgres/data/pg_subtrans: 2024-06-02T04:50:03.269 INFO:teuthology.orchestra.run.smithi076.stdout:total 9 2024-06-02T04:50:03.269 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 . 2024-06-02T04:50:03.269 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39557450 Jun 2 04:50 .. 2024-06-02T04:50:03.269 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 0000 2024-06-02T04:50:03.269 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:50:03.269 INFO:teuthology.orchestra.run.smithi076.stdout:/tmp/cephfs/postgres/data/pg_tblspc: 2024-06-02T04:50:03.269 INFO:teuthology.orchestra.run.smithi076.stdout:total 1 2024-06-02T04:50:03.269 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 . 2024-06-02T04:50:03.270 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39557450 Jun 2 04:50 .. 2024-06-02T04:50:03.270 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:50:03.270 INFO:teuthology.orchestra.run.smithi076.stdout:/tmp/cephfs/postgres/data/pg_twophase: 2024-06-02T04:50:03.270 INFO:teuthology.orchestra.run.smithi076.stdout:total 1 2024-06-02T04:50:03.270 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 . 2024-06-02T04:50:03.270 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39557450 Jun 2 04:50 .. 2024-06-02T04:50:03.270 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:50:03.270 INFO:teuthology.orchestra.run.smithi076.stdout:/tmp/cephfs/postgres/data/pg_wal: 2024-06-02T04:50:03.270 INFO:teuthology.orchestra.run.smithi076.stdout:total 16386 2024-06-02T04:50:03.270 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 04:49 . 2024-06-02T04:50:03.270 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39557450 Jun 2 04:50 .. 2024-06-02T04:50:03.270 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 04:49 000000010000000000000001 2024-06-02T04:50:03.271 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 archive_status 2024-06-02T04:50:03.271 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:50:03.271 INFO:teuthology.orchestra.run.smithi076.stdout:/tmp/cephfs/postgres/data/pg_wal/archive_status: 2024-06-02T04:50:03.271 INFO:teuthology.orchestra.run.smithi076.stdout:total 1 2024-06-02T04:50:03.271 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 . 2024-06-02T04:50:03.271 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 04:49 .. 2024-06-02T04:50:03.271 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:50:03.271 INFO:teuthology.orchestra.run.smithi076.stdout:/tmp/cephfs/postgres/data/pg_xact: 2024-06-02T04:50:03.271 INFO:teuthology.orchestra.run.smithi076.stdout:total 9 2024-06-02T04:50:03.271 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 . 2024-06-02T04:50:03.271 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39557450 Jun 2 04:50 .. 2024-06-02T04:50:03.271 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 0000 2024-06-02T04:50:03.272 DEBUG:teuthology.orchestra.run.smithi076:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo systemctl start postgresql' 2024-06-02T04:50:03.518 DEBUG:teuthology.orchestra.run.smithi076:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- pgbench -s 32 -i' 2024-06-02T04:50:03.542 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:03 smithi076 ceph-mon[42935]: pgmap v280: 129 pgs: 129 active+clean; 45 MiB data, 447 MiB used, 1.0 TiB / 1.0 TiB avail; 654 KiB/s rd, 4.9 MiB/s wr, 293 op/s 2024-06-02T04:50:03.542 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:03 smithi076 ceph-mon[42935]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-06-02T04:50:03.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:03 smithi119 ceph-mon[46633]: pgmap v280: 129 pgs: 129 active+clean; 45 MiB data, 447 MiB used, 1.0 TiB / 1.0 TiB avail; 654 KiB/s rd, 4.9 MiB/s wr, 293 op/s 2024-06-02T04:50:03.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:03 smithi119 ceph-mon[46633]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-06-02T04:50:03.617 INFO:teuthology.orchestra.run.smithi076.stderr:NOTICE: table "pgbench_history" does not exist, skipping 2024-06-02T04:50:03.654 INFO:teuthology.orchestra.run.smithi076.stderr:NOTICE: table "pgbench_tellers" does not exist, skipping 2024-06-02T04:50:03.658 INFO:teuthology.orchestra.run.smithi076.stderr:NOTICE: table "pgbench_accounts" does not exist, skipping 2024-06-02T04:50:03.663 INFO:teuthology.orchestra.run.smithi076.stderr:NOTICE: table "pgbench_branches" does not exist, skipping 2024-06-02T04:50:03.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:03 smithi192 ceph-mon[47933]: pgmap v280: 129 pgs: 129 active+clean; 45 MiB data, 447 MiB used, 1.0 TiB / 1.0 TiB avail; 654 KiB/s rd, 4.9 MiB/s wr, 293 op/s 2024-06-02T04:50:03.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:03 smithi192 ceph-mon[47933]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-06-02T04:50:03.687 INFO:teuthology.orchestra.run.smithi076.stderr:creating tables... 2024-06-02T04:50:04.183 INFO:teuthology.orchestra.run.smithi076.stderr:100000 of 3200000 tuples (3%) done (elapsed 0.49 s, remaining 15.30 s) 2024-06-02T04:50:05.380 INFO:teuthology.orchestra.run.smithi076.stderr:200000 of 3200000 tuples (6%) done (elapsed 1.69 s, remaining 25.35 s) 2024-06-02T04:50:05.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:05 smithi119 ceph-mon[46633]: pgmap v281: 129 pgs: 129 active+clean; 47 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 665 KiB/s rd, 3.3 MiB/s wr, 327 op/s 2024-06-02T04:50:05.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:05 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:50:05.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:05 smithi192 ceph-mon[47933]: pgmap v281: 129 pgs: 129 active+clean; 47 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 665 KiB/s rd, 3.3 MiB/s wr, 327 op/s 2024-06-02T04:50:05.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:05 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:50:05.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:05 smithi076 ceph-mon[42935]: pgmap v281: 129 pgs: 129 active+clean; 47 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 665 KiB/s rd, 3.3 MiB/s wr, 327 op/s 2024-06-02T04:50:05.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:05 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:50:06.297 INFO:teuthology.orchestra.run.smithi076.stderr:300000 of 3200000 tuples (9%) done (elapsed 2.61 s, remaining 25.20 s) 2024-06-02T04:50:07.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:06 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:50:07.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:06 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:50:07.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:06 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:50:07.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:06 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:50:07.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:06 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:50:07.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:06 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:50:07.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:06 smithi192 ceph-mon[47933]: pgmap v282: 129 pgs: 129 active+clean; 51 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 698 KiB/s rd, 3.5 MiB/s wr, 323 op/s 2024-06-02T04:50:07.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:06 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:50:07.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:06 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:50:07.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:06 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:50:07.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:06 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:50:07.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:06 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:50:07.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:06 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:50:07.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:06 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:50:07.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:06 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:50:07.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:06 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:50:07.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:06 smithi076 ceph-mon[42935]: pgmap v282: 129 pgs: 129 active+clean; 51 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 698 KiB/s rd, 3.5 MiB/s wr, 323 op/s 2024-06-02T04:50:07.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:06 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:50:07.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:06 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:50:07.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:06 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:50:07.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:06 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:50:07.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:06 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:50:07.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:06 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:50:07.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:06 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:50:07.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:06 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:50:07.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:06 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:50:07.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:06 smithi119 ceph-mon[46633]: pgmap v282: 129 pgs: 129 active+clean; 51 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 698 KiB/s rd, 3.5 MiB/s wr, 323 op/s 2024-06-02T04:50:07.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:06 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:50:07.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:06 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:50:07.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:06 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:50:07.463 INFO:teuthology.orchestra.run.smithi076.stderr:400000 of 3200000 tuples (12%) done (elapsed 3.77 s, remaining 26.41 s) 2024-06-02T04:50:08.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:07 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]: dispatch 2024-06-02T04:50:08.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:07 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4, 8, 11]}]: dispatch 2024-06-02T04:50:08.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:07 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]: dispatch 2024-06-02T04:50:08.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:07 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4, 8, 11]}]: dispatch 2024-06-02T04:50:08.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:07 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]: dispatch 2024-06-02T04:50:08.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:07 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4, 8, 11]}]: dispatch 2024-06-02T04:50:08.685 INFO:teuthology.orchestra.run.smithi076.stderr:500000 of 3200000 tuples (15%) done (elapsed 5.00 s, remaining 26.98 s) 2024-06-02T04:50:09.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:08 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]': finished 2024-06-02T04:50:09.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:08 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4, 8, 11]}]': finished 2024-06-02T04:50:09.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:08 smithi192 ceph-mon[47933]: osdmap e83: 12 total, 12 up, 12 in 2024-06-02T04:50:09.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:08 smithi192 ceph-mon[47933]: pgmap v284: 129 pgs: 129 active+clean; 96 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 759 KiB/s rd, 12 MiB/s wr, 361 op/s 2024-06-02T04:50:09.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:08 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]': finished 2024-06-02T04:50:09.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:08 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4, 8, 11]}]': finished 2024-06-02T04:50:09.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:08 smithi076 ceph-mon[42935]: osdmap e83: 12 total, 12 up, 12 in 2024-06-02T04:50:09.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:08 smithi076 ceph-mon[42935]: pgmap v284: 129 pgs: 129 active+clean; 96 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 759 KiB/s rd, 12 MiB/s wr, 361 op/s 2024-06-02T04:50:09.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:08 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]': finished 2024-06-02T04:50:09.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:08 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4, 8, 11]}]': finished 2024-06-02T04:50:09.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:08 smithi119 ceph-mon[46633]: osdmap e83: 12 total, 12 up, 12 in 2024-06-02T04:50:09.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:08 smithi119 ceph-mon[46633]: pgmap v284: 129 pgs: 129 active+clean; 96 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 759 KiB/s rd, 12 MiB/s wr, 361 op/s 2024-06-02T04:50:09.504 INFO:teuthology.orchestra.run.smithi076.stderr:600000 of 3200000 tuples (18%) done (elapsed 5.81 s, remaining 25.20 s) 2024-06-02T04:50:10.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:09 smithi192 ceph-mon[47933]: osdmap e84: 12 total, 12 up, 12 in 2024-06-02T04:50:10.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:09 smithi076 ceph-mon[42935]: osdmap e84: 12 total, 12 up, 12 in 2024-06-02T04:50:10.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:09 smithi119 ceph-mon[46633]: osdmap e84: 12 total, 12 up, 12 in 2024-06-02T04:50:10.694 INFO:teuthology.orchestra.run.smithi076.stderr:700000 of 3200000 tuples (21%) done (elapsed 7.00 s, remaining 25.02 s) 2024-06-02T04:50:11.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:10 smithi192 ceph-mon[47933]: pgmap v286: 129 pgs: 129 active+clean; 116 MiB data, 486 MiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 17 MiB/s wr, 120 op/s; 0 B/s, 7 keys/s, 0 objects/s recovering 2024-06-02T04:50:11.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:10 smithi076 ceph-mon[42935]: pgmap v286: 129 pgs: 129 active+clean; 116 MiB data, 486 MiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 17 MiB/s wr, 120 op/s; 0 B/s, 7 keys/s, 0 objects/s recovering 2024-06-02T04:50:11.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:10 smithi119 ceph-mon[46633]: pgmap v286: 129 pgs: 129 active+clean; 116 MiB data, 486 MiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 17 MiB/s wr, 120 op/s; 0 B/s, 7 keys/s, 0 objects/s recovering 2024-06-02T04:50:11.852 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.852+0000 7f552da1d700 1 -- 172.21.15.76:0/1047169842 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5528106bf0 msgr2=0x7f5528109060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:11.853 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.852+0000 7f552da1d700 1 --2- 172.21.15.76:0/1047169842 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5528106bf0 0x7f5528109060 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f552000b0a0 tx=0x7f552000b3b0 comp rx=0 tx=0).stop 2024-06-02T04:50:11.853 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.852+0000 7f552da1d700 1 -- 172.21.15.76:0/1047169842 shutdown_connections 2024-06-02T04:50:11.853 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.852+0000 7f552da1d700 1 --2- 172.21.15.76:0/1047169842 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5528106bf0 0x7f5528109060 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:11.853 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.852+0000 7f552da1d700 1 --2- 172.21.15.76:0/1047169842 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5528101990 0x7f5528103d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:11.853 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.852+0000 7f552da1d700 1 --2- 172.21.15.76:0/1047169842 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f55281042c0 0x7f55281066b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:11.853 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.852+0000 7f552da1d700 1 -- 172.21.15.76:0/1047169842 >> 172.21.15.76:0/1047169842 conn(0x7f55280fb380 msgr2=0x7f55280fd7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:50:11.853 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.852+0000 7f552da1d700 1 -- 172.21.15.76:0/1047169842 shutdown_connections 2024-06-02T04:50:11.853 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.852+0000 7f552da1d700 1 -- 172.21.15.76:0/1047169842 wait complete. 2024-06-02T04:50:11.853 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.852+0000 7f552da1d700 1 Processor -- start 2024-06-02T04:50:11.855 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.853+0000 7f552da1d700 1 -- start start 2024-06-02T04:50:11.855 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.853+0000 7f552da1d700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5528101990 0x7f5528196e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:11.855 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.853+0000 7f552da1d700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f55281042c0 0x7f5528197370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:11.855 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.853+0000 7f552da1d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5528106bf0 0x7f552819e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:11.855 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.853+0000 7f552da1d700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f552819e960 con 0x7f55281042c0 2024-06-02T04:50:11.856 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.853+0000 7f552da1d700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f552819eaa0 con 0x7f5528101990 2024-06-02T04:50:11.856 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.853+0000 7f552da1d700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f552819ec30 con 0x7f5528106bf0 2024-06-02T04:50:11.856 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.853+0000 7f55267fc700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f55281042c0 0x7f5528197370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:11.856 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.853+0000 7f55267fc700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f55281042c0 0x7f5528197370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:33142/0 (socket says 172.21.15.76:33142) 2024-06-02T04:50:11.856 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.853+0000 7f55267fc700 1 -- 172.21.15.76:0/2842624330 learned_addr learned my addr 172.21.15.76:0/2842624330 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:50:11.856 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.853+0000 7f55277fe700 1 --2- 172.21.15.76:0/2842624330 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5528106bf0 0x7f552819e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:11.856 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.853+0000 7f5526ffd700 1 --2- 172.21.15.76:0/2842624330 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5528101990 0x7f5528196e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:11.856 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.853+0000 7f55267fc700 1 -- 172.21.15.76:0/2842624330 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5528106bf0 msgr2=0x7f552819e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:11.856 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.853+0000 7f55267fc700 1 --2- 172.21.15.76:0/2842624330 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5528106bf0 0x7f552819e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:11.856 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.853+0000 7f55267fc700 1 -- 172.21.15.76:0/2842624330 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5528101990 msgr2=0x7f5528196e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:11.856 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.853+0000 7f55267fc700 1 --2- 172.21.15.76:0/2842624330 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5528101990 0x7f5528196e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:11.856 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.853+0000 7f55267fc700 1 -- 172.21.15.76:0/2842624330 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5520009d00 con 0x7f55281042c0 2024-06-02T04:50:11.856 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.854+0000 7f55267fc700 1 --2- 172.21.15.76:0/2842624330 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f55281042c0 0x7f5528197370 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f551c00e9a0 tx=0x7f551c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:50:11.857 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.854+0000 7f552ca1b700 1 -- 172.21.15.76:0/2842624330 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f551c009790 con 0x7f55281042c0 2024-06-02T04:50:11.857 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.854+0000 7f552da1d700 1 -- 172.21.15.76:0/2842624330 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f552819ef10 con 0x7f55281042c0 2024-06-02T04:50:11.857 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.854+0000 7f552ca1b700 1 -- 172.21.15.76:0/2842624330 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f551c010430 con 0x7f55281042c0 2024-06-02T04:50:11.857 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.854+0000 7f552ca1b700 1 -- 172.21.15.76:0/2842624330 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f551c00cea0 con 0x7f55281042c0 2024-06-02T04:50:11.857 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.854+0000 7f552da1d700 1 -- 172.21.15.76:0/2842624330 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f552819f390 con 0x7f55281042c0 2024-06-02T04:50:11.859 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.856+0000 7f552ca1b700 1 -- 172.21.15.76:0/2842624330 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f551c0105a0 con 0x7f55281042c0 2024-06-02T04:50:11.859 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.857+0000 7f552ca1b700 1 --2- 172.21.15.76:0/2842624330 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f55100a1120 0x7f55100a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:11.859 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.857+0000 7f5526ffd700 1 --2- 172.21.15.76:0/2842624330 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f55100a1120 0x7f55100a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:11.859 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.857+0000 7f552ca1b700 1 -- 172.21.15.76:0/2842624330 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f551c014070 con 0x7f55281042c0 2024-06-02T04:50:11.859 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.858+0000 7f5539bd8b80 1 Processor -- start 2024-06-02T04:50:11.859 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.858+0000 7f5539bd8b80 1 -- start start 2024-06-02T04:50:11.859 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.858+0000 7f5526ffd700 1 --2- 172.21.15.76:0/2842624330 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f55100a1120 0x7f55100a35e0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f5518007c60 tx=0x7f55180073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:50:11.860 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.858+0000 7f5539bd8b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5604efed4e90 0x5604efed52b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:11.860 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.858+0000 7f5539bd8b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5604efed57f0 0x5604efed6100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:11.860 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.858+0000 7f5539bd8b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5604efed66e0 0x5604efed6b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:11.860 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.858+0000 7f5539bd8b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604efe280f0 con 0x5604efed66e0 2024-06-02T04:50:11.860 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.858+0000 7f5539bd8b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604efe25ab0 con 0x5604efed4e90 2024-06-02T04:50:11.860 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.858+0000 7f5539bd8b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604efe213a0 con 0x5604efed57f0 2024-06-02T04:50:11.860 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.858+0000 7f55277fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5604efed66e0 0x5604efed6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:11.860 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.858+0000 7f55277fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5604efed66e0 0x5604efed6b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:33148/0 (socket says 172.21.15.76:33148) 2024-06-02T04:50:11.860 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.858+0000 7f55277fe700 1 -- 172.21.15.76:0/3538359089 learned_addr learned my addr 172.21.15.76:0/3538359089 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:50:11.860 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.858+0000 7f55267fc700 1 --2- 172.21.15.76:0/3538359089 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5604efed57f0 0x5604efed6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:11.860 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.858+0000 7f5526ffd700 1 --2- 172.21.15.76:0/3538359089 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5604efed4e90 0x5604efed52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:11.860 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.858+0000 7f55277fe700 1 -- 172.21.15.76:0/3538359089 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5604efed57f0 msgr2=0x5604efed6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:50:11.860 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.858+0000 7f55277fe700 1 --2- 172.21.15.76:0/3538359089 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5604efed57f0 0x5604efed6100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:11.861 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.858+0000 7f55277fe700 1 -- 172.21.15.76:0/3538359089 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5604efed4e90 msgr2=0x5604efed52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:50:11.861 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.858+0000 7f55277fe700 1 --2- 172.21.15.76:0/3538359089 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5604efed4e90 0x5604efed52b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:11.861 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.858+0000 7f55277fe700 1 -- 172.21.15.76:0/3538359089 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5604efca2350 con 0x5604efed66e0 2024-06-02T04:50:11.861 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.859+0000 7f55277fe700 1 --2- 172.21.15.76:0/3538359089 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5604efed66e0 0x5604efed6b60 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f552000b0a0 tx=0x7f55200092e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cf2e3d128ca6e68 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:50:11.861 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.859+0000 7f550dffb700 1 -- 172.21.15.76:0/3538359089 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f552000e040 con 0x5604efed66e0 2024-06-02T04:50:11.861 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.859+0000 7f550dffb700 1 -- 172.21.15.76:0/3538359089 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f55200094d0 con 0x5604efed66e0 2024-06-02T04:50:11.861 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.859+0000 7f550dffb700 1 -- 172.21.15.76:0/3538359089 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5520003d60 con 0x5604efed66e0 2024-06-02T04:50:11.865 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.859+0000 7f5539bd8b80 1 -- 172.21.15.76:0/3538359089 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5604efed66e0 msgr2=0x5604efed6b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:11.865 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.859+0000 7f5539bd8b80 1 --2- 172.21.15.76:0/3538359089 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5604efed66e0 0x5604efed6b60 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f552000b0a0 tx=0x7f55200092e0 comp rx=0 tx=0).stop 2024-06-02T04:50:11.865 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.859+0000 7f5539bd8b80 1 -- 172.21.15.76:0/3538359089 shutdown_connections 2024-06-02T04:50:11.865 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.860+0000 7f5539bd8b80 1 --2- 172.21.15.76:0/3538359089 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5604efed66e0 0x5604efed6b60 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:11.866 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.860+0000 7f5539bd8b80 1 --2- 172.21.15.76:0/3538359089 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5604efed4e90 0x5604efed52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:11.866 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.860+0000 7f5539bd8b80 1 --2- 172.21.15.76:0/3538359089 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5604efed57f0 0x5604efed6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:11.866 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.860+0000 7f5539bd8b80 1 -- 172.21.15.76:0/3538359089 >> 172.21.15.76:0/3538359089 conn(0x5604efe2f1b0 msgr2=0x5604efecd440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:50:11.866 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.860+0000 7f5539bd8b80 1 -- 172.21.15.76:0/3538359089 shutdown_connections 2024-06-02T04:50:11.866 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.860+0000 7f5539bd8b80 1 -- 172.21.15.76:0/3538359089 wait complete. 2024-06-02T04:50:11.866 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.860+0000 7f5539bd8b80 1 -- start start 2024-06-02T04:50:11.866 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.860+0000 7f5539bd8b80 1 Processor -- start 2024-06-02T04:50:11.866 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.860+0000 7f5539bd8b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5604efed4e90 0x5604efedec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:11.866 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.860+0000 7f5539bd8b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5604efed57f0 0x5604efedf190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:11.866 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.860+0000 7f5539bd8b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5604efed66e0 0x5604efee61d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:11.866 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.860+0000 7f5539bd8b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604efdbd500 con 0x5604efed57f0 2024-06-02T04:50:11.866 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.860+0000 7f5539bd8b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604efdbd1a0 con 0x5604efed4e90 2024-06-02T04:50:11.867 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.860+0000 7f5539bd8b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604efca4640 con 0x5604efed66e0 2024-06-02T04:50:11.867 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.861+0000 7f5539bd8b80 10 client.0 _ll_register_callbacks cb 0x5604efdc6ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:50:11.867 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.861+0000 7f55267fc700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5604efed57f0 0x5604efedf190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:11.867 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.861+0000 7f55267fc700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5604efed57f0 0x5604efedf190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:33156/0 (socket says 172.21.15.76:33156) 2024-06-02T04:50:11.867 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.861+0000 7f5526ffd700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5604efed4e90 0x5604efedec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:11.867 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.861+0000 7f55267fc700 1 -- 172.21.15.76:0/325321052 learned_addr learned my addr 172.21.15.76:0/325321052 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:50:11.867 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.861+0000 7f55277fe700 1 --2- 172.21.15.76:0/325321052 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5604efed66e0 0x5604efee61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:11.867 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.861+0000 7f55267fc700 1 -- 172.21.15.76:0/325321052 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5604efed66e0 msgr2=0x5604efee61d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:50:11.867 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.861+0000 7f55267fc700 1 --2- 172.21.15.76:0/325321052 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5604efed66e0 0x5604efee61d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:11.868 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.861+0000 7f55267fc700 1 -- 172.21.15.76:0/325321052 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5604efed4e90 msgr2=0x5604efedec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:50:11.868 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.861+0000 7f55267fc700 1 --2- 172.21.15.76:0/325321052 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5604efed4e90 0x5604efedec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:11.868 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.861+0000 7f55267fc700 1 -- 172.21.15.76:0/325321052 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5528109c50 con 0x5604efed57f0 2024-06-02T04:50:11.868 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.861+0000 7f55267fc700 1 --2- 172.21.15.76:0/325321052 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5604efed57f0 0x5604efedf190 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f551c0ca560 tx=0x7f551c09a3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91911e8856950dd1 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:50:11.868 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.861+0000 7f5506ffd700 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-06-02T04:50:11.868 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.861+0000 7f5506ffd700 1 -- 172.21.15.76:0/325321052 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f551c0a2050 con 0x5604efed57f0 2024-06-02T04:50:11.868 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.861+0000 7f5506ffd700 1 -- 172.21.15.76:0/325321052 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f551c099e60 con 0x5604efed57f0 2024-06-02T04:50:11.868 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.861+0000 7f5539bd8b80 1 -- 172.21.15.76:0/325321052 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5604efd7a210 con 0x5604efed57f0 2024-06-02T04:50:11.868 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.861+0000 7f5506ffd700 1 -- 172.21.15.76:0/325321052 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f551c09dc90 con 0x5604efed57f0 2024-06-02T04:50:11.868 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.861+0000 7f5539bd8b80 10 client.15627 fetch_fsmap learned FSMap version 27 2024-06-02T04:50:11.869 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.861+0000 7f5539bd8b80 1 -- 172.21.15.76:0/325321052 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x5604efc4eb00 con 0x5604efed57f0 2024-06-02T04:50:11.869 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.862+0000 7f5506ffd700 1 -- 172.21.15.76:0/325321052 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5604efd7a210 con 0x5604efed57f0 2024-06-02T04:50:11.869 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.862+0000 7f5506ffd700 1 -- 172.21.15.76:0/325321052 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 27) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f551c095e50 con 0x5604efed57f0 2024-06-02T04:50:11.869 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.862+0000 7f5539bd8b80 10 client.15627 fetch_fsmap finished waiting for FSMap version 27 2024-06-02T04:50:11.869 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.862+0000 7f5539bd8b80 10 client.15627 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T04:50:11.869 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.862+0000 7f5539bd8b80 20 client.15627 populate_metadata read hostname 'smithi076' 2024-06-02T04:50:11.869 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.862+0000 7f5539bd8b80 1 --2- 172.21.15.76:0/325321052 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5604efeeaa90 0x5604efeeceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:11.869 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.862+0000 7f5539bd8b80 4 client.15627 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T04:50:11.869 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.862+0000 7f5539bd8b80 1 -- 172.21.15.76:0/325321052 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5604efea07b0 con 0x5604efeeaa90 2024-06-02T04:50:11.869 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.862+0000 7f5526ffd700 1 --2- 172.21.15.76:0/325321052 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5604efeeaa90 0x5604efeeceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:11.869 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.862+0000 7f5506ffd700 10 client.15627 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:50:11.869 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.862+0000 7f5526ffd700 1 --2- 172.21.15.76:0/325321052 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5604efeeaa90 0x5604efeeceb0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=62e4e9efb9e5ef4 server_cookie=4f75bdf6383f2336 in_seq=0 out_seq=0 2024-06-02T04:50:11.869 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.863+0000 7f5506ffd700 1 -- 172.21.15.76:0/325321052 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5604efea07b0 con 0x5604efeeaa90 2024-06-02T04:50:11.869 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.863+0000 7f5506ffd700 10 client.15627 handle_command_reply: tid=0 2024-06-02T04:50:11.870 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.863+0000 7f5539bd8b80 1 client.15627 shutdown 2024-06-02T04:50:11.870 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.863+0000 7f5539bd8b80 1 -- 172.21.15.76:0/325321052 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5604efed57f0 msgr2=0x5604efedf190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:11.870 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.863+0000 7f5539bd8b80 1 --2- 172.21.15.76:0/325321052 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5604efed57f0 0x5604efedf190 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f551c0ca560 tx=0x7f551c09a3a0 comp rx=0 tx=0).stop 2024-06-02T04:50:11.870 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.863+0000 7f5539bd8b80 1 -- 172.21.15.76:0/325321052 shutdown_connections 2024-06-02T04:50:11.870 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.863+0000 7f5539bd8b80 1 --2- 172.21.15.76:0/325321052 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5604efeeaa90 0x5604efeeceb0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:11.870 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.863+0000 7f5539bd8b80 1 --2- 172.21.15.76:0/325321052 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5604efed66e0 0x5604efee61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:11.870 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.863+0000 7f5539bd8b80 1 --2- 172.21.15.76:0/325321052 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5604efed4e90 0x5604efedec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:11.870 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.863+0000 7f5539bd8b80 1 --2- 172.21.15.76:0/325321052 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5604efed57f0 0x5604efedf190 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:11.870 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.863+0000 7f5539bd8b80 1 -- 172.21.15.76:0/325321052 >> 172.21.15.76:0/325321052 conn(0x5604efe2f1b0 msgr2=0x5604efecb860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:50:11.870 INFO:teuthology.orchestra.run.smithi076.stderr:800000 of 3200000 tuples (25%) done (elapsed 8.17 s, remaining 24.52 s) 2024-06-02T04:50:11.871 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.863+0000 7f5506ffd700 0 client.15627 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:50:11.871 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.863+0000 7f5539bd8b80 1 -- 172.21.15.76:0/325321052 shutdown_connections 2024-06-02T04:50:11.871 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.863+0000 7f5539bd8b80 1 -- 172.21.15.76:0/325321052 wait complete. 2024-06-02T04:50:11.871 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.864+0000 7f5539bd8b80 20 client.15627 trim_cache size 0 max 16384 2024-06-02T04:50:11.880 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.879+0000 7f5539bd8b80 1 Processor -- start 2024-06-02T04:50:11.880 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.879+0000 7f5539bd8b80 1 -- start start 2024-06-02T04:50:11.880 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.879+0000 7f5539bd8b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5604efed4e90 0x5604efed6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:11.880 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.879+0000 7f5539bd8b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5604efed57f0 0x5604efee6190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:11.880 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.879+0000 7f5539bd8b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5604efed66e0 0x5604efef1810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:11.880 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.879+0000 7f5539bd8b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604efed4a50 con 0x5604efed66e0 2024-06-02T04:50:11.881 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.879+0000 7f5539bd8b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604efec67c0 con 0x5604efed57f0 2024-06-02T04:50:11.881 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.879+0000 7f5539bd8b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604efecc930 con 0x5604efed4e90 2024-06-02T04:50:11.881 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.879+0000 7f55277fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5604efed66e0 0x5604efef1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:11.881 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.879+0000 7f55267fc700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5604efed57f0 0x5604efee6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:11.881 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.879+0000 7f55267fc700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5604efed57f0 0x5604efee6190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:58374/0 (socket says 172.21.15.76:58374) 2024-06-02T04:50:11.881 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.879+0000 7f5526ffd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5604efed4e90 0x5604efed6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:11.881 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.879+0000 7f55277fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5604efed66e0 0x5604efef1810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:33162/0 (socket says 172.21.15.76:33162) 2024-06-02T04:50:11.881 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.879+0000 7f55267fc700 1 -- 172.21.15.76:0/2038943876 learned_addr learned my addr 172.21.15.76:0/2038943876 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:50:11.881 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.879+0000 7f55277fe700 1 -- 172.21.15.76:0/2038943876 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5604efed4e90 msgr2=0x5604efed6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:50:11.881 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.879+0000 7f55277fe700 1 --2- 172.21.15.76:0/2038943876 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5604efed4e90 0x5604efed6ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:11.881 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.879+0000 7f55277fe700 1 -- 172.21.15.76:0/2038943876 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5604efed57f0 msgr2=0x5604efee6190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:50:11.881 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.879+0000 7f55277fe700 1 --2- 172.21.15.76:0/2038943876 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5604efed57f0 0x5604efee6190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:11.881 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.879+0000 7f55277fe700 1 -- 172.21.15.76:0/2038943876 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5604efde7500 con 0x5604efed66e0 2024-06-02T04:50:11.882 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.879+0000 7f55267fc700 1 --2- 172.21.15.76:0/2038943876 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5604efed57f0 0x5604efee6190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T04:50:11.882 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.880+0000 7f55277fe700 1 --2- 172.21.15.76:0/2038943876 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5604efed66e0 0x5604efef1810 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f55200079c0 tx=0x7f5520006160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9057ec2eb74b846 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:50:11.882 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.880+0000 7f550e7fc700 1 -- 172.21.15.76:0/2038943876 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f552000e040 con 0x5604efed66e0 2024-06-02T04:50:11.882 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.880+0000 7f550e7fc700 1 -- 172.21.15.76:0/2038943876 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f55200076a0 con 0x5604efed66e0 2024-06-02T04:50:11.882 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.880+0000 7f550e7fc700 1 -- 172.21.15.76:0/2038943876 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5520005400 con 0x5604efed66e0 2024-06-02T04:50:11.885 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.881+0000 7f5539bd8b80 1 -- 172.21.15.76:0/2038943876 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5604efed66e0 msgr2=0x5604efef1810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:11.885 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.881+0000 7f5539bd8b80 1 --2- 172.21.15.76:0/2038943876 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5604efed66e0 0x5604efef1810 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f55200079c0 tx=0x7f5520006160 comp rx=0 tx=0).stop 2024-06-02T04:50:11.885 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.881+0000 7f5539bd8b80 1 -- 172.21.15.76:0/2038943876 shutdown_connections 2024-06-02T04:50:11.885 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.881+0000 7f5539bd8b80 1 --2- 172.21.15.76:0/2038943876 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5604efed66e0 0x5604efef1810 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:11.885 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.881+0000 7f5539bd8b80 1 --2- 172.21.15.76:0/2038943876 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5604efed4e90 0x5604efed6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:11.886 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.881+0000 7f5539bd8b80 1 --2- 172.21.15.76:0/2038943876 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5604efed57f0 0x5604efee6190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:11.886 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.881+0000 7f5539bd8b80 1 -- 172.21.15.76:0/2038943876 >> 172.21.15.76:0/2038943876 conn(0x5604efe2f1b0 msgr2=0x5604efede160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:50:11.886 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.881+0000 7f5539bd8b80 1 -- 172.21.15.76:0/2038943876 shutdown_connections 2024-06-02T04:50:11.886 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.881+0000 7f5539bd8b80 1 -- 172.21.15.76:0/2038943876 wait complete. 2024-06-02T04:50:11.886 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.881+0000 7f5539bd8b80 1 -- start start 2024-06-02T04:50:11.886 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.881+0000 7f5539bd8b80 1 Processor -- start 2024-06-02T04:50:11.886 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.881+0000 7f5539bd8b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5604efed4e90 0x5604efee32a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:11.886 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.881+0000 7f5539bd8b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5604efed57f0 0x5604efee37e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:11.886 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.881+0000 7f5539bd8b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5604efed66e0 0x5604efee47f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:11.886 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.881+0000 7f5539bd8b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604efee4d30 con 0x5604efed57f0 2024-06-02T04:50:11.886 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.881+0000 7f5539bd8b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604efee4ea0 con 0x5604efed4e90 2024-06-02T04:50:11.886 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.881+0000 7f5539bd8b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604efee5060 con 0x5604efed66e0 2024-06-02T04:50:11.887 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.882+0000 7f5539bd8b80 10 client.0 _ll_register_callbacks cb 0x5604efdc6ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:50:11.887 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.882+0000 7f55267fc700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5604efed57f0 0x5604efee37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:11.887 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.882+0000 7f55267fc700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5604efed57f0 0x5604efee37e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:33168/0 (socket says 172.21.15.76:33168) 2024-06-02T04:50:11.887 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.882+0000 7f55267fc700 1 -- 172.21.15.76:0/3831315624 learned_addr learned my addr 172.21.15.76:0/3831315624 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:50:11.887 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.882+0000 7f5526ffd700 1 --2- 172.21.15.76:0/3831315624 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5604efed4e90 0x5604efee32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:11.887 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.882+0000 7f55277fe700 1 --2- 172.21.15.76:0/3831315624 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5604efed66e0 0x5604efee47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:11.887 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.882+0000 7f55267fc700 1 -- 172.21.15.76:0/3831315624 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5604efed66e0 msgr2=0x5604efee47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:50:11.887 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.882+0000 7f55267fc700 1 --2- 172.21.15.76:0/3831315624 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5604efed66e0 0x5604efee47f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:11.887 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.882+0000 7f55267fc700 1 -- 172.21.15.76:0/3831315624 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5604efed4e90 msgr2=0x5604efee32a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:50:11.887 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.882+0000 7f55267fc700 1 --2- 172.21.15.76:0/3831315624 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5604efed4e90 0x5604efee32a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:11.887 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.882+0000 7f55267fc700 1 -- 172.21.15.76:0/3831315624 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5604efc4eb00 con 0x5604efed57f0 2024-06-02T04:50:11.887 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.882+0000 7f55277fe700 1 --2- 172.21.15.76:0/3831315624 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5604efed66e0 0x5604efee47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:50:11.888 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.882+0000 7f55267fc700 1 --2- 172.21.15.76:0/3831315624 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5604efed57f0 0x5604efee37e0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f551c0cc010 tx=0x7f551c0b8360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19549264195bd88a server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:50:11.888 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.882+0000 7f5506ffd700 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-06-02T04:50:11.888 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.882+0000 7f5506ffd700 1 -- 172.21.15.76:0/3831315624 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f551c0a2050 con 0x5604efed57f0 2024-06-02T04:50:11.888 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.882+0000 7f5506ffd700 1 -- 172.21.15.76:0/3831315624 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f551c099e60 con 0x5604efed57f0 2024-06-02T04:50:11.888 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.882+0000 7f5539bd8b80 1 -- 172.21.15.76:0/3831315624 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f55200094d0 con 0x5604efed57f0 2024-06-02T04:50:11.888 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.882+0000 7f5506ffd700 1 -- 172.21.15.76:0/3831315624 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f551c0056b0 con 0x5604efed57f0 2024-06-02T04:50:11.888 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.882+0000 7f5539bd8b80 10 client.15633 fetch_fsmap learned FSMap version 27 2024-06-02T04:50:11.888 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.882+0000 7f5539bd8b80 1 -- 172.21.15.76:0/3831315624 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x5604efca2350 con 0x5604efed57f0 2024-06-02T04:50:11.888 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.883+0000 7f5506ffd700 1 -- 172.21.15.76:0/3831315624 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f55200094d0 con 0x5604efed57f0 2024-06-02T04:50:11.888 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.883+0000 7f5506ffd700 1 -- 172.21.15.76:0/3831315624 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 27) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f551c09ebb0 con 0x5604efed57f0 2024-06-02T04:50:11.888 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.883+0000 7f5539bd8b80 10 client.15633 fetch_fsmap finished waiting for FSMap version 27 2024-06-02T04:50:11.888 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.883+0000 7f5539bd8b80 10 client.15633 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T04:50:11.889 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.883+0000 7f5539bd8b80 20 client.15633 populate_metadata read hostname 'smithi076' 2024-06-02T04:50:11.889 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.883+0000 7f5539bd8b80 1 --2- 172.21.15.76:0/3831315624 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5604eff40f80 0x5604eff43370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:11.889 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.883+0000 7f5539bd8b80 4 client.15633 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T04:50:11.889 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.883+0000 7f5539bd8b80 1 -- 172.21.15.76:0/3831315624 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5604efe19e60 con 0x5604eff40f80 2024-06-02T04:50:11.889 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.883+0000 7f5526ffd700 1 --2- 172.21.15.76:0/3831315624 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5604eff40f80 0x5604eff43370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:11.889 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.883+0000 7f5506ffd700 10 client.15633 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:50:11.889 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.883+0000 7f5526ffd700 1 --2- 172.21.15.76:0/3831315624 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5604eff40f80 0x5604eff43370 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce38b584a14aa9d2 server_cookie=7ec2fb516af92454 in_seq=0 out_seq=0 2024-06-02T04:50:11.951 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.950+0000 7f5506ffd700 1 -- 172.21.15.76:0/3831315624 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5604efe19e60 con 0x5604eff40f80 2024-06-02T04:50:11.951 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.950+0000 7f5506ffd700 10 client.15633 handle_command_reply: tid=0 2024-06-02T04:50:11.952 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.950+0000 7f5539bd8b80 1 client.15633 shutdown 2024-06-02T04:50:11.952 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.950+0000 7f5539bd8b80 1 -- 172.21.15.76:0/3831315624 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5604efed57f0 msgr2=0x5604efee37e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:11.952 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.950+0000 7f5539bd8b80 1 --2- 172.21.15.76:0/3831315624 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5604efed57f0 0x5604efee37e0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f551c0cc010 tx=0x7f551c0b8360 comp rx=0 tx=0).stop 2024-06-02T04:50:11.952 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.950+0000 7f5539bd8b80 1 -- 172.21.15.76:0/3831315624 shutdown_connections 2024-06-02T04:50:11.952 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.950+0000 7f5539bd8b80 1 --2- 172.21.15.76:0/3831315624 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5604eff40f80 0x5604eff43370 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:11.952 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.950+0000 7f5539bd8b80 1 --2- 172.21.15.76:0/3831315624 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5604efed66e0 0x5604efee47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:11.952 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.950+0000 7f5506ffd700 0 client.15633 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:50:11.952 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.950+0000 7f5539bd8b80 1 --2- 172.21.15.76:0/3831315624 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5604efed4e90 0x5604efee32a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:11.952 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.950+0000 7f5539bd8b80 1 --2- 172.21.15.76:0/3831315624 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5604efed57f0 0x5604efee37e0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:11.952 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.950+0000 7f5539bd8b80 1 -- 172.21.15.76:0/3831315624 >> 172.21.15.76:0/3831315624 conn(0x5604efe2f1b0 msgr2=0x5604efef1810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:50:11.952 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.951+0000 7f5539bd8b80 1 -- 172.21.15.76:0/3831315624 shutdown_connections 2024-06-02T04:50:11.953 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.951+0000 7f5539bd8b80 1 -- 172.21.15.76:0/3831315624 wait complete. 2024-06-02T04:50:11.953 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.951+0000 7f5539bd8b80 20 client.15633 trim_cache size 0 max 16384 2024-06-02T04:50:11.953 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:{ 2024-06-02T04:50:11.953 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "message": "", 2024-06-02T04:50:11.953 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "return_code": 0 2024-06-02T04:50:11.953 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:} 2024-06-02T04:50:11.954 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.951+0000 7f552da1d700 1 -- 172.21.15.76:0/2842624330 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f55100a1120 msgr2=0x7f55100a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:11.954 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.951+0000 7f552da1d700 1 --2- 172.21.15.76:0/2842624330 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f55100a1120 0x7f55100a35e0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f5518007c60 tx=0x7f55180073d0 comp rx=0 tx=0).stop 2024-06-02T04:50:11.954 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.951+0000 7f552da1d700 1 -- 172.21.15.76:0/2842624330 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f55281042c0 msgr2=0x7f5528197370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:11.954 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.951+0000 7f552da1d700 1 --2- 172.21.15.76:0/2842624330 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f55281042c0 0x7f5528197370 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f551c00e9a0 tx=0x7f551c00ecb0 comp rx=0 tx=0).stop 2024-06-02T04:50:11.954 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.951+0000 7f552da1d700 1 -- 172.21.15.76:0/2842624330 shutdown_connections 2024-06-02T04:50:11.954 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.951+0000 7f552da1d700 1 --2- 172.21.15.76:0/2842624330 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5528106bf0 0x7f552819e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:11.954 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.951+0000 7f552da1d700 1 --2- 172.21.15.76:0/2842624330 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f55100a1120 0x7f55100a35e0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:11.955 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.951+0000 7f552da1d700 1 --2- 172.21.15.76:0/2842624330 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5528101990 0x7f5528196e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:11.955 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.951+0000 7f552da1d700 1 --2- 172.21.15.76:0/2842624330 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f55281042c0 0x7f5528197370 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:11.955 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.951+0000 7f552da1d700 1 -- 172.21.15.76:0/2842624330 >> 172.21.15.76:0/2842624330 conn(0x7f55280fb380 msgr2=0x7f5528102410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:50:11.955 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.951+0000 7f552da1d700 1 -- 172.21.15.76:0/2842624330 shutdown_connections 2024-06-02T04:50:11.955 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:11.951+0000 7f552da1d700 1 -- 172.21.15.76:0/2842624330 wait complete. 2024-06-02T04:50:12.744 INFO:teuthology.orchestra.run.smithi076.stderr:900000 of 3200000 tuples (28%) done (elapsed 9.05 s, remaining 23.14 s) 2024-06-02T04:50:13.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:13 smithi119 ceph-mon[46633]: pgmap v287: 129 pgs: 129 active+clean; 176 MiB data, 502 MiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 33 MiB/s wr, 64 op/s; 0 B/s, 7 keys/s, 0 objects/s recovering 2024-06-02T04:50:13.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:13 smithi192 ceph-mon[47933]: pgmap v287: 129 pgs: 129 active+clean; 176 MiB data, 502 MiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 33 MiB/s wr, 64 op/s; 0 B/s, 7 keys/s, 0 objects/s recovering 2024-06-02T04:50:13.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:13 smithi076 ceph-mon[42935]: pgmap v287: 129 pgs: 129 active+clean; 176 MiB data, 502 MiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 33 MiB/s wr, 64 op/s; 0 B/s, 7 keys/s, 0 objects/s recovering 2024-06-02T04:50:13.959 INFO:teuthology.orchestra.run.smithi076.stderr:1000000 of 3200000 tuples (31%) done (elapsed 10.27 s, remaining 22.59 s) 2024-06-02T04:50:15.077 INFO:teuthology.orchestra.run.smithi076.stderr:1100000 of 3200000 tuples (34%) done (elapsed 11.39 s, remaining 21.74 s) 2024-06-02T04:50:15.281 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-06-02T04:50:15.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.429+0000 7f12525db700 1 -- 172.21.15.76:0/2567834116 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f124c100fd0 msgr2=0x7f124c101450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:15.430 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.429+0000 7f12525db700 1 --2- 172.21.15.76:0/2567834116 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f124c100fd0 0x7f124c101450 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f1240009990 tx=0x7f1240009ca0 comp rx=0 tx=0).stop 2024-06-02T04:50:15.430 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.429+0000 7f12525db700 1 -- 172.21.15.76:0/2567834116 shutdown_connections 2024-06-02T04:50:15.430 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.429+0000 7f12525db700 1 --2- 172.21.15.76:0/2567834116 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f124c101990 0x7f124c1082b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:15.430 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.429+0000 7f12525db700 1 --2- 172.21.15.76:0/2567834116 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f124c0ffe80 0x7f124c1002a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:15.430 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.429+0000 7f12525db700 1 --2- 172.21.15.76:0/2567834116 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f124c100fd0 0x7f124c101450 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:15.430 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.429+0000 7f12525db700 1 -- 172.21.15.76:0/2567834116 >> 172.21.15.76:0/2567834116 conn(0x7f124c0fb3f0 msgr2=0x7f124c0fd830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:50:15.430 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.429+0000 7f12525db700 1 -- 172.21.15.76:0/2567834116 shutdown_connections 2024-06-02T04:50:15.430 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.429+0000 7f12525db700 1 -- 172.21.15.76:0/2567834116 wait complete. 2024-06-02T04:50:15.430 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.429+0000 7f12525db700 1 Processor -- start 2024-06-02T04:50:15.430 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.429+0000 7f12525db700 1 -- start start 2024-06-02T04:50:15.432 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.430+0000 7f12525db700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f124c0ffe80 0x7f124c196e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:15.432 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.430+0000 7f12525db700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f124c100fd0 0x7f124c1973b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:15.432 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.430+0000 7f12525db700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f124c101990 0x7f124c19e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:15.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.430+0000 7f12525db700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f124c19e950 con 0x7f124c0ffe80 2024-06-02T04:50:15.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.430+0000 7f12525db700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f124c19ea90 con 0x7f124c101990 2024-06-02T04:50:15.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.430+0000 7f12525db700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f124c19ec20 con 0x7f124c100fd0 2024-06-02T04:50:15.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.430+0000 7f124bfff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f124c0ffe80 0x7f124c196e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:15.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.430+0000 7f124bfff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f124c0ffe80 0x7f124c196e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:47538/0 (socket says 172.21.15.76:47538) 2024-06-02T04:50:15.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.430+0000 7f124bfff700 1 -- 172.21.15.76:0/540993623 learned_addr learned my addr 172.21.15.76:0/540993623 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:50:15.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.430+0000 7f1250b78700 1 --2- 172.21.15.76:0/540993623 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f124c101990 0x7f124c19e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:15.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.430+0000 7f124b7fe700 1 --2- 172.21.15.76:0/540993623 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f124c100fd0 0x7f124c1973b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:15.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.430+0000 7f124bfff700 1 -- 172.21.15.76:0/540993623 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f124c100fd0 msgr2=0x7f124c1973b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:15.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.430+0000 7f124bfff700 1 --2- 172.21.15.76:0/540993623 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f124c100fd0 0x7f124c1973b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:15.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.430+0000 7f124bfff700 1 -- 172.21.15.76:0/540993623 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f124c101990 msgr2=0x7f124c19e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:15.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.430+0000 7f124bfff700 1 --2- 172.21.15.76:0/540993623 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f124c101990 0x7f124c19e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:15.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.430+0000 7f124bfff700 1 -- 172.21.15.76:0/540993623 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12400095f0 con 0x7f124c0ffe80 2024-06-02T04:50:15.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.430+0000 7f1250b78700 1 --2- 172.21.15.76:0/540993623 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f124c101990 0x7f124c19e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:50:15.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.430+0000 7f124bfff700 1 --2- 172.21.15.76:0/540993623 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f124c0ffe80 0x7f124c196e70 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f123c00e9a0 tx=0x7f123c00ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:50:15.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.430+0000 7f12497fa700 1 -- 172.21.15.76:0/540993623 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f123c009790 con 0x7f124c0ffe80 2024-06-02T04:50:15.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.431+0000 7f12497fa700 1 -- 172.21.15.76:0/540993623 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f123c00cbd0 con 0x7f124c0ffe80 2024-06-02T04:50:15.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.431+0000 7f12525db700 1 -- 172.21.15.76:0/540993623 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f124c19ef00 con 0x7f124c0ffe80 2024-06-02T04:50:15.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.431+0000 7f12497fa700 1 -- 172.21.15.76:0/540993623 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f123c018680 con 0x7f124c0ffe80 2024-06-02T04:50:15.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.431+0000 7f12525db700 1 -- 172.21.15.76:0/540993623 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f124c19f320 con 0x7f124c0ffe80 2024-06-02T04:50:15.437 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.433+0000 7f12497fa700 1 -- 172.21.15.76:0/540993623 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f123c00cd40 con 0x7f124c0ffe80 2024-06-02T04:50:15.437 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.434+0000 7f12497fa700 1 --2- 172.21.15.76:0/540993623 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f12340a1120 0x7f12340a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:15.437 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.434+0000 7f12497fa700 1 -- 172.21.15.76:0/540993623 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f123c014070 con 0x7f124c0ffe80 2024-06-02T04:50:15.437 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.434+0000 7f124b7fe700 1 --2- 172.21.15.76:0/540993623 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f12340a1120 0x7f12340a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:15.437 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.434+0000 7f124b7fe700 1 --2- 172.21.15.76:0/540993623 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f12340a1120 0x7f12340a35e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f124000b2e0 tx=0x7f1240005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:50:15.438 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.434+0000 7f125e796b80 1 Processor -- start 2024-06-02T04:50:15.438 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.434+0000 7f125e796b80 1 -- start start 2024-06-02T04:50:15.438 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.435+0000 7f125e796b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561365a98540 0x561365a98960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:15.438 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.435+0000 7f125e796b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561365a98ea0 0x561365a99320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:15.438 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.435+0000 7f125e796b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561365a99860 0x561365a99ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:15.438 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.435+0000 7f125e796b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613659ef150 con 0x561365a98540 2024-06-02T04:50:15.438 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.435+0000 7f125e796b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613659ecb10 con 0x561365a98ea0 2024-06-02T04:50:15.438 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.435+0000 7f125e796b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613659e8400 con 0x561365a99860 2024-06-02T04:50:15.438 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.435+0000 7f124bfff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561365a98540 0x561365a98960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:15.438 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.435+0000 7f124bfff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561365a98540 0x561365a98960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:47552/0 (socket says 172.21.15.76:47552) 2024-06-02T04:50:15.438 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.435+0000 7f124bfff700 1 -- 172.21.15.76:0/2551386383 learned_addr learned my addr 172.21.15.76:0/2551386383 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:50:15.438 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.435+0000 7f124b7fe700 1 --2- 172.21.15.76:0/2551386383 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561365a98ea0 0x561365a99320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:15.438 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.435+0000 7f1250b78700 1 --2- 172.21.15.76:0/2551386383 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561365a99860 0x561365a99ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:15.439 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.435+0000 7f124bfff700 1 -- 172.21.15.76:0/2551386383 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561365a99860 msgr2=0x561365a99ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:50:15.439 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.435+0000 7f124bfff700 1 --2- 172.21.15.76:0/2551386383 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561365a99860 0x561365a99ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:15.439 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.435+0000 7f124bfff700 1 -- 172.21.15.76:0/2551386383 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561365a98ea0 msgr2=0x561365a99320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:50:15.439 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.435+0000 7f124bfff700 1 --2- 172.21.15.76:0/2551386383 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561365a98ea0 0x561365a99320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:15.439 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.435+0000 7f124bfff700 1 -- 172.21.15.76:0/2551386383 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5613658693b0 con 0x561365a98540 2024-06-02T04:50:15.439 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.435+0000 7f124bfff700 1 --2- 172.21.15.76:0/2551386383 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561365a98540 0x561365a98960 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f123c096530 tx=0x7f123c09a7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8664e9707cdbd2b server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:50:15.439 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.436+0000 7f12327fc700 1 -- 172.21.15.76:0/2551386383 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f123c09de60 con 0x561365a98540 2024-06-02T04:50:15.439 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.436+0000 7f12327fc700 1 -- 172.21.15.76:0/2551386383 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f123c0a24b0 con 0x561365a98540 2024-06-02T04:50:15.439 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.436+0000 7f12327fc700 1 -- 172.21.15.76:0/2551386383 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f123c0a2280 con 0x561365a98540 2024-06-02T04:50:15.439 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.436+0000 7f125e796b80 1 -- 172.21.15.76:0/2551386383 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561365a98540 msgr2=0x561365a98960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:15.439 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.436+0000 7f125e796b80 1 --2- 172.21.15.76:0/2551386383 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561365a98540 0x561365a98960 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f123c096530 tx=0x7f123c09a7b0 comp rx=0 tx=0).stop 2024-06-02T04:50:15.439 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.436+0000 7f125e796b80 1 -- 172.21.15.76:0/2551386383 shutdown_connections 2024-06-02T04:50:15.440 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.436+0000 7f125e796b80 1 --2- 172.21.15.76:0/2551386383 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561365a99860 0x561365a99ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:15.440 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.436+0000 7f125e796b80 1 --2- 172.21.15.76:0/2551386383 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561365a98540 0x561365a98960 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:15.440 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.436+0000 7f125e796b80 1 --2- 172.21.15.76:0/2551386383 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561365a98ea0 0x561365a99320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:15.440 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.437+0000 7f125e796b80 1 -- 172.21.15.76:0/2551386383 >> 172.21.15.76:0/2551386383 conn(0x5613659f6210 msgr2=0x561365a92de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:50:15.440 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.437+0000 7f125e796b80 1 -- 172.21.15.76:0/2551386383 shutdown_connections 2024-06-02T04:50:15.440 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.437+0000 7f125e796b80 1 -- 172.21.15.76:0/2551386383 wait complete. 2024-06-02T04:50:15.440 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.437+0000 7f125e796b80 1 -- start start 2024-06-02T04:50:15.440 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.437+0000 7f125e796b80 1 Processor -- start 2024-06-02T04:50:15.443 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.437+0000 7f125e796b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561365a98540 0x561365aa1e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:15.444 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.437+0000 7f125e796b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561365a98ea0 0x561365aa2380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:15.444 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.437+0000 7f125e796b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561365a99860 0x561365aa93c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:15.444 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.437+0000 7f125e796b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x561365984560 con 0x561365a99860 2024-06-02T04:50:15.444 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.437+0000 7f125e796b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x561365984200 con 0x561365a98ea0 2024-06-02T04:50:15.444 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.437+0000 7f125e796b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x56136586b6a0 con 0x561365a98540 2024-06-02T04:50:15.444 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.437+0000 7f125e796b80 10 client.0 _ll_register_callbacks cb 0x56136598db30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:50:15.444 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.438+0000 7f124b7fe700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561365a98ea0 0x561365aa2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:15.444 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.438+0000 7f124bfff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561365a98540 0x561365aa1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:15.444 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.438+0000 7f1250b78700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561365a99860 0x561365aa93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:15.444 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.438+0000 7f124b7fe700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561365a98ea0 0x561365aa2380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:52886/0 (socket says 172.21.15.76:52886) 2024-06-02T04:50:15.444 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.438+0000 7f124b7fe700 1 -- 172.21.15.76:0/3562840528 learned_addr learned my addr 172.21.15.76:0/3562840528 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:50:15.444 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.438+0000 7f124bfff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561365a98540 0x561365aa1e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:59868/0 (socket says 172.21.15.76:59868) 2024-06-02T04:50:15.444 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.438+0000 7f124b7fe700 1 -- 172.21.15.76:0/3562840528 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561365a98540 msgr2=0x561365aa1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:50:15.445 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.438+0000 7f124b7fe700 1 --2- 172.21.15.76:0/3562840528 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561365a98540 0x561365aa1e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:15.445 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.438+0000 7f124b7fe700 1 -- 172.21.15.76:0/3562840528 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561365a99860 msgr2=0x561365aa93c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:50:15.445 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.438+0000 7f124b7fe700 1 --2- 172.21.15.76:0/3562840528 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561365a99860 0x561365aa93c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:15.445 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.438+0000 7f124b7fe700 1 -- 172.21.15.76:0/3562840528 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f124c19f320 con 0x561365a98ea0 2024-06-02T04:50:15.445 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.438+0000 7f124bfff700 1 --2- 172.21.15.76:0/3562840528 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561365a98540 0x561365aa1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T04:50:15.445 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.438+0000 7f124b7fe700 1 --2- 172.21.15.76:0/3562840528 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561365a98ea0 0x561365aa2380 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1240015000 tx=0x7f1240009310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a722eb112e66ef1 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:50:15.445 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.438+0000 7f122b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-06-02T04:50:15.445 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.439+0000 7f122b7fe700 1 -- 172.21.15.76:0/3562840528 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f124002d070 con 0x561365a98ea0 2024-06-02T04:50:15.445 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.439+0000 7f125e796b80 1 -- 172.21.15.76:0/3562840528 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561365941270 con 0x561365a98ea0 2024-06-02T04:50:15.445 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.439+0000 7f122b7fe700 1 -- 172.21.15.76:0/3562840528 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f124000b8c0 con 0x561365a98ea0 2024-06-02T04:50:15.445 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.439+0000 7f122b7fe700 1 -- 172.21.15.76:0/3562840528 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f124001e070 con 0x561365a98ea0 2024-06-02T04:50:15.445 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.439+0000 7f125e796b80 10 client.25184 fetch_fsmap learned FSMap version 27 2024-06-02T04:50:15.445 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.439+0000 7f125e796b80 1 -- 172.21.15.76:0/3562840528 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x561365815b60 con 0x561365a98ea0 2024-06-02T04:50:15.446 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.439+0000 7f122b7fe700 1 -- 172.21.15.76:0/3562840528 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x561365941270 con 0x561365a98ea0 2024-06-02T04:50:15.446 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.439+0000 7f122b7fe700 1 -- 172.21.15.76:0/3562840528 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 27) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f1240004c70 con 0x561365a98ea0 2024-06-02T04:50:15.446 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.439+0000 7f125e796b80 10 client.25184 fetch_fsmap finished waiting for FSMap version 27 2024-06-02T04:50:15.446 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.439+0000 7f125e796b80 10 client.25184 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-06-02T04:50:15.446 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.439+0000 7f125e796b80 20 client.25184 populate_metadata read hostname 'smithi076' 2024-06-02T04:50:15.446 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.439+0000 7f125e796b80 1 --2- 172.21.15.76:0/3562840528 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x561365aadc40 0x561365ab0060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:15.446 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.439+0000 7f125e796b80 4 client.25184 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T04:50:15.446 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.439+0000 7f125e796b80 1 -- 172.21.15.76:0/3562840528 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561365a67810 con 0x561365aadc40 2024-06-02T04:50:15.446 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.439+0000 7f124bfff700 1 --2- 172.21.15.76:0/3562840528 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x561365aadc40 0x561365ab0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:15.446 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.440+0000 7f122b7fe700 10 client.25184 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:50:15.446 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.440+0000 7f124bfff700 1 --2- 172.21.15.76:0/3562840528 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x561365aadc40 0x561365ab0060 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=710895c3111fcf8e server_cookie=fcf79c9c54bb305b in_seq=0 out_seq=0 2024-06-02T04:50:15.446 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.440+0000 7f122b7fe700 1 -- 172.21.15.76:0/3562840528 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x561365a67810 con 0x561365aadc40 2024-06-02T04:50:15.447 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.440+0000 7f122b7fe700 10 client.25184 handle_command_reply: tid=0 2024-06-02T04:50:15.447 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.440+0000 7f125e796b80 1 client.25184 shutdown 2024-06-02T04:50:15.447 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.441+0000 7f125e796b80 1 -- 172.21.15.76:0/3562840528 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561365a98ea0 msgr2=0x561365aa2380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:15.447 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.441+0000 7f125e796b80 1 --2- 172.21.15.76:0/3562840528 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561365a98ea0 0x561365aa2380 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1240015000 tx=0x7f1240009310 comp rx=0 tx=0).stop 2024-06-02T04:50:15.447 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.441+0000 7f125e796b80 1 -- 172.21.15.76:0/3562840528 shutdown_connections 2024-06-02T04:50:15.447 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.441+0000 7f125e796b80 1 --2- 172.21.15.76:0/3562840528 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x561365aadc40 0x561365ab0060 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:15.447 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.441+0000 7f125e796b80 1 --2- 172.21.15.76:0/3562840528 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561365a99860 0x561365aa93c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:15.447 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.441+0000 7f125e796b80 1 --2- 172.21.15.76:0/3562840528 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561365a98540 0x561365aa1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:15.447 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.441+0000 7f125e796b80 1 --2- 172.21.15.76:0/3562840528 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561365a98ea0 0x561365aa2380 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:15.447 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.441+0000 7f125e796b80 1 -- 172.21.15.76:0/3562840528 >> 172.21.15.76:0/3562840528 conn(0x5613659f6210 msgr2=0x561365a925a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:50:15.447 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.441+0000 7f122b7fe700 0 client.25184 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:50:15.447 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.441+0000 7f125e796b80 1 -- 172.21.15.76:0/3562840528 shutdown_connections 2024-06-02T04:50:15.447 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.441+0000 7f125e796b80 1 -- 172.21.15.76:0/3562840528 wait complete. 2024-06-02T04:50:15.447 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.441+0000 7f125e796b80 20 client.25184 trim_cache size 0 max 16384 2024-06-02T04:50:15.464 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.463+0000 7f125e796b80 1 Processor -- start 2024-06-02T04:50:15.465 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.463+0000 7f125e796b80 1 -- start start 2024-06-02T04:50:15.465 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.463+0000 7f125e796b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561365a98540 0x561365aa13c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:15.465 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.463+0000 7f125e796b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561365a98ea0 0x561365aa92e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:15.465 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.463+0000 7f125e796b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561365a99860 0x561365a99c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:15.465 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.463+0000 7f125e796b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x561365aaa540 con 0x561365a99860 2024-06-02T04:50:15.465 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.463+0000 7f125e796b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x561365aa19b0 con 0x561365a98540 2024-06-02T04:50:15.465 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.463+0000 7f125e796b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x561365aa9820 con 0x561365a98ea0 2024-06-02T04:50:15.465 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.463+0000 7f124b7fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561365a98ea0 0x561365aa92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:15.465 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.463+0000 7f1250b78700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561365a99860 0x561365a99c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:15.465 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.463+0000 7f124b7fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561365a98ea0 0x561365aa92e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:59872/0 (socket says 172.21.15.76:59872) 2024-06-02T04:50:15.465 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.463+0000 7f124b7fe700 1 -- 172.21.15.76:0/2194080690 learned_addr learned my addr 172.21.15.76:0/2194080690 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:50:15.465 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.463+0000 7f124bfff700 1 --2- 172.21.15.76:0/2194080690 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561365a98540 0x561365aa13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:15.466 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.464+0000 7f124b7fe700 1 -- 172.21.15.76:0/2194080690 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561365a98540 msgr2=0x561365aa13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:50:15.466 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.464+0000 7f124b7fe700 1 --2- 172.21.15.76:0/2194080690 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561365a98540 0x561365aa13c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:15.466 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.464+0000 7f124b7fe700 1 -- 172.21.15.76:0/2194080690 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561365a99860 msgr2=0x561365a99c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:50:15.466 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.464+0000 7f124b7fe700 1 --2- 172.21.15.76:0/2194080690 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561365a99860 0x561365a99c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:15.466 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.464+0000 7f124b7fe700 1 -- 172.21.15.76:0/2194080690 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5613659ae560 con 0x561365a98ea0 2024-06-02T04:50:15.466 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.464+0000 7f124bfff700 1 --2- 172.21.15.76:0/2194080690 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561365a98540 0x561365aa13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T04:50:15.466 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.464+0000 7f124b7fe700 1 --2- 172.21.15.76:0/2194080690 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561365a98ea0 0x561365aa92e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1240005830 tx=0x7f1240005a80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eceb0669c03b9c26 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:50:15.466 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.464+0000 7f1232ffd700 1 -- 172.21.15.76:0/2194080690 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f124002d020 con 0x561365a98ea0 2024-06-02T04:50:15.466 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.464+0000 7f1232ffd700 1 -- 172.21.15.76:0/2194080690 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1240003cf0 con 0x561365a98ea0 2024-06-02T04:50:15.466 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.464+0000 7f1232ffd700 1 -- 172.21.15.76:0/2194080690 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f124000ba30 con 0x561365a98ea0 2024-06-02T04:50:15.470 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.465+0000 7f125e796b80 1 -- 172.21.15.76:0/2194080690 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561365a98ea0 msgr2=0x561365aa92e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:15.470 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.465+0000 7f125e796b80 1 --2- 172.21.15.76:0/2194080690 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561365a98ea0 0x561365aa92e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1240005830 tx=0x7f1240005a80 comp rx=0 tx=0).stop 2024-06-02T04:50:15.470 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.465+0000 7f125e796b80 1 -- 172.21.15.76:0/2194080690 shutdown_connections 2024-06-02T04:50:15.470 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.465+0000 7f125e796b80 1 --2- 172.21.15.76:0/2194080690 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561365a99860 0x561365a99c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:15.470 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.465+0000 7f125e796b80 1 --2- 172.21.15.76:0/2194080690 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561365a98540 0x561365aa13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:15.471 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.465+0000 7f125e796b80 1 --2- 172.21.15.76:0/2194080690 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561365a98ea0 0x561365aa92e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:15.471 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.465+0000 7f125e796b80 1 -- 172.21.15.76:0/2194080690 >> 172.21.15.76:0/2194080690 conn(0x5613659f6210 msgr2=0x561365a8f210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:50:15.471 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.465+0000 7f125e796b80 1 -- 172.21.15.76:0/2194080690 shutdown_connections 2024-06-02T04:50:15.471 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.465+0000 7f125e796b80 1 -- 172.21.15.76:0/2194080690 wait complete. 2024-06-02T04:50:15.471 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.465+0000 7f125e796b80 1 -- start start 2024-06-02T04:50:15.471 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.466+0000 7f125e796b80 1 Processor -- start 2024-06-02T04:50:15.471 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.466+0000 7f125e796b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561365a98540 0x561365aa60e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:15.471 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.466+0000 7f125e796b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561365a98ea0 0x561365aa6620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:15.471 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.466+0000 7f125e796b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561365a99860 0x561365b020e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:15.472 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.466+0000 7f125e796b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x561365aa95f0 con 0x561365a99860 2024-06-02T04:50:15.472 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.466+0000 7f125e796b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x561365aa9760 con 0x561365a98ea0 2024-06-02T04:50:15.472 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.466+0000 7f125e796b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x561365b02620 con 0x561365a98540 2024-06-02T04:50:15.472 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.466+0000 7f125e796b80 10 client.0 _ll_register_callbacks cb 0x56136598db30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:50:15.472 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.466+0000 7f124bfff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561365a98540 0x561365aa60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:15.472 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.466+0000 7f124bfff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561365a98540 0x561365aa60e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:59874/0 (socket says 172.21.15.76:59874) 2024-06-02T04:50:15.473 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.466+0000 7f124bfff700 1 -- 172.21.15.76:0/3006720986 learned_addr learned my addr 172.21.15.76:0/3006720986 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:50:15.473 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.466+0000 7f1250b78700 1 --2- 172.21.15.76:0/3006720986 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561365a99860 0x561365b020e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:15.473 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.466+0000 7f124b7fe700 1 --2- 172.21.15.76:0/3006720986 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561365a98ea0 0x561365aa6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:15.473 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.466+0000 7f124bfff700 1 -- 172.21.15.76:0/3006720986 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561365a98ea0 msgr2=0x561365aa6620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:50:15.473 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.466+0000 7f124bfff700 1 --2- 172.21.15.76:0/3006720986 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561365a98ea0 0x561365aa6620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:15.473 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.466+0000 7f124bfff700 1 -- 172.21.15.76:0/3006720986 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561365a99860 msgr2=0x561365b020e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:50:15.474 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.466+0000 7f124bfff700 1 --2- 172.21.15.76:0/3006720986 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561365a99860 0x561365b020e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:15.474 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.466+0000 7f124bfff700 1 -- 172.21.15.76:0/3006720986 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5613658693b0 con 0x561365a98540 2024-06-02T04:50:15.474 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.466+0000 7f124bfff700 1 --2- 172.21.15.76:0/3006720986 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561365a98540 0x561365aa60e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f123c00e970 tx=0x7f123c00efa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d4f1c656c6654511 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:50:15.474 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.466+0000 7f122b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.192:3300/0 2024-06-02T04:50:15.474 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.467+0000 7f122b7fe700 1 -- 172.21.15.76:0/3006720986 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f123c09de60 con 0x561365a98540 2024-06-02T04:50:15.474 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.467+0000 7f125e796b80 1 -- 172.21.15.76:0/3006720986 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f123c0a24b0 con 0x561365a98540 2024-06-02T04:50:15.474 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.467+0000 7f122b7fe700 1 -- 172.21.15.76:0/3006720986 <== mon.1 v2:172.21.15.192:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f123c0983d0 con 0x561365a98540 2024-06-02T04:50:15.475 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.467+0000 7f122b7fe700 1 -- 172.21.15.76:0/3006720986 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f123c0b2be0 con 0x561365a98540 2024-06-02T04:50:15.475 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.467+0000 7f125e796b80 10 client.25135 fetch_fsmap learned FSMap version 27 2024-06-02T04:50:15.475 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.467+0000 7f125e796b80 1 -- 172.21.15.76:0/3006720986 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x561365815b60 con 0x561365a98540 2024-06-02T04:50:15.475 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.467+0000 7f122b7fe700 1 -- 172.21.15.76:0/3006720986 <== mon.1 v2:172.21.15.192:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f123c0a24b0 con 0x561365a98540 2024-06-02T04:50:15.475 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.467+0000 7f122b7fe700 1 -- 172.21.15.76:0/3006720986 <== mon.1 v2:172.21.15.192:3300/0 5 ==== fsmap(e 27) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f123c0caba0 con 0x561365a98540 2024-06-02T04:50:15.475 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.467+0000 7f125e796b80 10 client.25135 fetch_fsmap finished waiting for FSMap version 27 2024-06-02T04:50:15.475 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.467+0000 7f125e796b80 10 client.25135 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-06-02T04:50:15.475 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.467+0000 7f125e796b80 20 client.25135 populate_metadata read hostname 'smithi076' 2024-06-02T04:50:15.475 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.467+0000 7f125e796b80 1 --2- 172.21.15.76:0/3006720986 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x561365b03d30 0x561365b06150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:15.475 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.467+0000 7f125e796b80 4 client.25135 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-06-02T04:50:15.475 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.467+0000 7f125e796b80 1 -- 172.21.15.76:0/3006720986 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5613659e0ec0 con 0x561365b03d30 2024-06-02T04:50:15.475 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.467+0000 7f124b7fe700 1 --2- 172.21.15.76:0/3006720986 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x561365b03d30 0x561365b06150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:15.475 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.468+0000 7f124b7fe700 1 --2- 172.21.15.76:0/3006720986 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x561365b03d30 0x561365b06150 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8b206dd9cfaa5c server_cookie=c2135261fcc14de4 in_seq=0 out_seq=0 2024-06-02T04:50:15.476 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.468+0000 7f122b7fe700 10 client.25135 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:50:15.476 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.468+0000 7f122b7fe700 1 -- 172.21.15.76:0/3006720986 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x5613659e0ec0 con 0x561365b03d30 2024-06-02T04:50:15.476 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.468+0000 7f122b7fe700 10 client.25135 handle_command_reply: tid=0 2024-06-02T04:50:15.476 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.468+0000 7f125e796b80 1 client.25135 shutdown 2024-06-02T04:50:15.476 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.468+0000 7f125e796b80 1 -- 172.21.15.76:0/3006720986 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561365a98540 msgr2=0x561365aa60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:15.476 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.468+0000 7f125e796b80 1 --2- 172.21.15.76:0/3006720986 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561365a98540 0x561365aa60e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f123c00e970 tx=0x7f123c00efa0 comp rx=0 tx=0).stop 2024-06-02T04:50:15.476 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.468+0000 7f125e796b80 1 -- 172.21.15.76:0/3006720986 shutdown_connections 2024-06-02T04:50:15.476 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.468+0000 7f125e796b80 1 --2- 172.21.15.76:0/3006720986 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x561365b03d30 0x561365b06150 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:15.476 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.468+0000 7f125e796b80 1 --2- 172.21.15.76:0/3006720986 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561365a99860 0x561365b020e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:15.476 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.468+0000 7f125e796b80 1 --2- 172.21.15.76:0/3006720986 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561365a98540 0x561365aa60e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:15.476 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.468+0000 7f125e796b80 1 --2- 172.21.15.76:0/3006720986 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561365a98ea0 0x561365aa6620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:15.476 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.468+0000 7f122b7fe700 0 client.25135 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:50:15.476 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.468+0000 7f125e796b80 1 -- 172.21.15.76:0/3006720986 >> 172.21.15.76:0/3006720986 conn(0x5613659f6210 msgr2=0x561365a99c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:50:15.477 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.468+0000 7f125e796b80 1 -- 172.21.15.76:0/3006720986 shutdown_connections 2024-06-02T04:50:15.477 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.468+0000 7f125e796b80 1 -- 172.21.15.76:0/3006720986 wait complete. 2024-06-02T04:50:15.477 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.468+0000 7f125e796b80 20 client.25135 trim_cache size 0 max 16384 2024-06-02T04:50:15.477 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-06-02T04:50:15.477 INFO:teuthology.orchestra.run.smithi076.stdout: "status": "no active scrubs running", 2024-06-02T04:50:15.477 INFO:teuthology.orchestra.run.smithi076.stdout: "scrubs": {} 2024-06-02T04:50:15.477 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-06-02T04:50:15.478 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.469+0000 7f12525db700 1 -- 172.21.15.76:0/540993623 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f12340a1120 msgr2=0x7f12340a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:15.478 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.469+0000 7f12525db700 1 --2- 172.21.15.76:0/540993623 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f12340a1120 0x7f12340a35e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f124000b2e0 tx=0x7f1240005fb0 comp rx=0 tx=0).stop 2024-06-02T04:50:15.478 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.469+0000 7f12525db700 1 -- 172.21.15.76:0/540993623 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f124c0ffe80 msgr2=0x7f124c196e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:15.478 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.469+0000 7f12525db700 1 --2- 172.21.15.76:0/540993623 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f124c0ffe80 0x7f124c196e70 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f123c00e9a0 tx=0x7f123c00ed60 comp rx=0 tx=0).stop 2024-06-02T04:50:15.479 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.469+0000 7f12525db700 1 -- 172.21.15.76:0/540993623 shutdown_connections 2024-06-02T04:50:15.479 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.469+0000 7f12525db700 1 --2- 172.21.15.76:0/540993623 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f12340a1120 0x7f12340a35e0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:15.479 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.469+0000 7f12525db700 1 --2- 172.21.15.76:0/540993623 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f124c101990 0x7f124c19e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:15.479 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.469+0000 7f12525db700 1 --2- 172.21.15.76:0/540993623 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f124c0ffe80 0x7f124c196e70 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:15.479 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.469+0000 7f12525db700 1 --2- 172.21.15.76:0/540993623 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f124c100fd0 0x7f124c1973b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:15.479 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.469+0000 7f12525db700 1 -- 172.21.15.76:0/540993623 >> 172.21.15.76:0/540993623 conn(0x7f124c0fb3f0 msgr2=0x7f124c069280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:50:15.479 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.469+0000 7f12525db700 1 -- 172.21.15.76:0/540993623 shutdown_connections 2024-06-02T04:50:15.479 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.469+0000 7f12525db700 1 -- 172.21.15.76:0/540993623 wait complete. 2024-06-02T04:50:15.482 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-06-02T04:50:15.482 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T04:50:15.507 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:15 smithi076 ceph-mon[42935]: pgmap v288: 129 pgs: 129 active+clean; 192 MiB data, 509 MiB used, 1.0 TiB / 1.0 TiB avail; 203 KiB/s rd, 36 MiB/s wr, 78 op/s; 0 B/s, 7 keys/s, 0 objects/s recovering 2024-06-02T04:50:15.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:15 smithi119 ceph-mon[46633]: pgmap v288: 129 pgs: 129 active+clean; 192 MiB data, 509 MiB used, 1.0 TiB / 1.0 TiB avail; 203 KiB/s rd, 36 MiB/s wr, 78 op/s; 0 B/s, 7 keys/s, 0 objects/s recovering 2024-06-02T04:50:15.620 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.617+0000 7f8213a51700 1 -- 172.21.15.76:0/1721052492 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f820c100f50 msgr2=0x7f820c1013b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:15.620 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.617+0000 7f8213a51700 1 --2- 172.21.15.76:0/1721052492 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f820c100f50 0x7f820c1013b0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f81fc0099c0 tx=0x7f81fc009cd0 comp rx=0 tx=0).stop 2024-06-02T04:50:15.621 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.617+0000 7f8213a51700 1 -- 172.21.15.76:0/1721052492 shutdown_connections 2024-06-02T04:50:15.621 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.617+0000 7f8213a51700 1 --2- 172.21.15.76:0/1721052492 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f820c1018f0 0x7f820c1081a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:15.621 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.617+0000 7f8213a51700 1 --2- 172.21.15.76:0/1721052492 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f820c0ffd60 0x7f820c100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:15.621 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.617+0000 7f8213a51700 1 --2- 172.21.15.76:0/1721052492 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f820c100f50 0x7f820c1013b0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:15.621 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.617+0000 7f8213a51700 1 -- 172.21.15.76:0/1721052492 >> 172.21.15.76:0/1721052492 conn(0x7f820c0fb2f0 msgr2=0x7f820c0fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:50:15.621 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.617+0000 7f8213a51700 1 -- 172.21.15.76:0/1721052492 shutdown_connections 2024-06-02T04:50:15.621 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.617+0000 7f8213a51700 1 -- 172.21.15.76:0/1721052492 wait complete. 2024-06-02T04:50:15.621 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.618+0000 7f8213a51700 1 Processor -- start 2024-06-02T04:50:15.621 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.618+0000 7f8213a51700 1 -- start start 2024-06-02T04:50:15.621 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.618+0000 7f8213a51700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f820c0ffd60 0x7f820c195cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:15.621 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.618+0000 7f8213a51700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f820c100f50 0x7f820c1961f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:15.622 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.618+0000 7f8213a51700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f820c1018f0 0x7f820c19d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:15.622 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.618+0000 7f8213a51700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f820c19d7a0 con 0x7f820c100f50 2024-06-02T04:50:15.622 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.618+0000 7f8213a51700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f820c19d910 con 0x7f820c0ffd60 2024-06-02T04:50:15.622 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.618+0000 7f8213a51700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f820c19dad0 con 0x7f820c1018f0 2024-06-02T04:50:15.622 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.618+0000 7f8210fec700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f820c100f50 0x7f820c1961f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:15.622 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.618+0000 7f8210fec700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f820c100f50 0x7f820c1961f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:47588/0 (socket says 172.21.15.76:47588) 2024-06-02T04:50:15.622 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.618+0000 7f8210fec700 1 -- 172.21.15.76:0/378325683 learned_addr learned my addr 172.21.15.76:0/378325683 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:50:15.622 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.618+0000 7f82117ed700 1 --2- 172.21.15.76:0/378325683 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f820c0ffd60 0x7f820c195cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:15.622 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.618+0000 7f8211fee700 1 --2- 172.21.15.76:0/378325683 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f820c1018f0 0x7f820c19d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:15.623 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.618+0000 7f8210fec700 1 -- 172.21.15.76:0/378325683 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f820c1018f0 msgr2=0x7f820c19d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:15.623 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.618+0000 7f8210fec700 1 --2- 172.21.15.76:0/378325683 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f820c1018f0 0x7f820c19d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:15.623 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.618+0000 7f8210fec700 1 -- 172.21.15.76:0/378325683 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f820c0ffd60 msgr2=0x7f820c195cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:15.623 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.618+0000 7f8210fec700 1 --2- 172.21.15.76:0/378325683 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f820c0ffd60 0x7f820c195cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:15.623 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.618+0000 7f8210fec700 1 -- 172.21.15.76:0/378325683 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81fc0095f0 con 0x7f820c100f50 2024-06-02T04:50:15.623 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.618+0000 7f8211fee700 1 --2- 172.21.15.76:0/378325683 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f820c1018f0 0x7f820c19d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:50:15.623 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.618+0000 7f82117ed700 1 --2- 172.21.15.76:0/378325683 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f820c0ffd60 0x7f820c195cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:50:15.623 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.619+0000 7f8210fec700 1 --2- 172.21.15.76:0/378325683 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f820c100f50 0x7f820c1961f0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f81fc005910 tx=0x7f81fc005b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:50:15.623 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.619+0000 7f82027fc700 1 -- 172.21.15.76:0/378325683 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81fc01d070 con 0x7f820c100f50 2024-06-02T04:50:15.623 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.619+0000 7f82027fc700 1 -- 172.21.15.76:0/378325683 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f81fc00bd30 con 0x7f820c100f50 2024-06-02T04:50:15.623 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.619+0000 7f8213a51700 1 -- 172.21.15.76:0/378325683 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f820c19dd50 con 0x7f820c100f50 2024-06-02T04:50:15.623 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.619+0000 7f82027fc700 1 -- 172.21.15.76:0/378325683 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81fc022dc0 con 0x7f820c100f50 2024-06-02T04:50:15.624 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.619+0000 7f8213a51700 1 -- 172.21.15.76:0/378325683 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f820c19e1d0 con 0x7f820c100f50 2024-06-02T04:50:15.624 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.620+0000 7f8213a51700 1 -- 172.21.15.76:0/378325683 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f820c107220 con 0x7f820c100f50 2024-06-02T04:50:15.624 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.621+0000 7f82027fc700 1 -- 172.21.15.76:0/378325683 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f81fc004010 con 0x7f820c100f50 2024-06-02T04:50:15.625 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.622+0000 7f82027fc700 1 --2- 172.21.15.76:0/378325683 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f81f80a11a0 0x7f81f80a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:15.625 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.622+0000 7f82117ed700 1 --2- 172.21.15.76:0/378325683 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f81f80a11a0 0x7f81f80a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:15.625 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.622+0000 7f82027fc700 1 -- 172.21.15.76:0/378325683 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f81fc0cde70 con 0x7f820c100f50 2024-06-02T04:50:15.625 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.622+0000 7f82117ed700 1 --2- 172.21.15.76:0/378325683 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f81f80a11a0 0x7f81f80a3660 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f820c197130 tx=0x7f820800b690 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:50:15.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.627+0000 7f82027fc700 1 -- 172.21.15.76:0/378325683 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f81fc0973d0 con 0x7f820c100f50 2024-06-02T04:50:15.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:15 smithi192 ceph-mon[47933]: pgmap v288: 129 pgs: 129 active+clean; 192 MiB data, 509 MiB used, 1.0 TiB / 1.0 TiB avail; 203 KiB/s rd, 36 MiB/s wr, 78 op/s; 0 B/s, 7 keys/s, 0 objects/s recovering 2024-06-02T04:50:15.904 INFO:teuthology.orchestra.run.smithi076.stderr:1200000 of 3200000 tuples (37%) done (elapsed 12.21 s, remaining 20.36 s) 2024-06-02T04:50:15.945 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.945+0000 7f8213a51700 1 -- 172.21.15.76:0/378325683 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f820c10b5e0 con 0x7f820c100f50 2024-06-02T04:50:15.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.946+0000 7f82027fc700 1 -- 172.21.15.76:0/378325683 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+10877 (secure 0 0 0) 0x7f81fc09a9f0 con 0x7f820c100f50 2024-06-02T04:50:15.946 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:50:15.946 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6835/3029342152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3029342152},{"type":"v1","addr":"172.21.15.76:6835","nonce":3029342152}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6837/1207985317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":1207985317},{"type":"v1","addr":"172.21.15.76:6837","nonce":1207985317}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14607,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6839/928709755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":928709755},{"type":"v1","addr":"172.21.15.76:6839","nonce":928709755}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6841/4162178633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6840","nonce":4162178633},{"type":"v1","addr":"172.21.15.76:6841","nonce":4162178633}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/1543944863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":1543944863},{"type":"v1","addr":"172.21.15.119:6833","nonce":1543944863}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24418,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6833/1527921393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1527921393},{"type":"v1","addr":"172.21.15.192:6833","nonce":1527921393}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":27,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-02T04:48:02.662812+0000","modified":"2024-06-02T04:50:02.328040+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24491,"mds_1":24475,"mds_2":24463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24434":{"gid":24434,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6835/2746840347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":2746840347},{"type":"v1","addr":"172.21.15.119:6835","nonce":2746840347}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24451":{"gid":24451,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.192:6835/783181340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":783181340},{"type":"v1","addr":"172.21.15.192:6835","nonce":783181340}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24458":{"gid":24458,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6837/2171687478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":2171687478},{"type":"v1","addr":"172.21.15.119:6837","nonce":2171687478}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24463":{"gid":24463,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":11,"addr":"172.21.15.192:6837/960773710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":960773710},{"type":"v1","addr":"172.21.15.192:6837","nonce":960773710}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24475":{"gid":24475,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.192:6839/3978681402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":3978681402},{"type":"v1","addr":"172.21.15.192:6839","nonce":3978681402}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.119:6839/4098406903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":4098406903},{"type":"v1","addr":"172.21.15.119:6839","nonce":4098406903}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-06-02T04:50:15.949 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.948+0000 7f8213a51700 1 -- 172.21.15.76:0/378325683 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f81f80a11a0 msgr2=0x7f81f80a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:15.949 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.948+0000 7f8213a51700 1 --2- 172.21.15.76:0/378325683 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f81f80a11a0 0x7f81f80a3660 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f820c197130 tx=0x7f820800b690 comp rx=0 tx=0).stop 2024-06-02T04:50:15.949 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.948+0000 7f8213a51700 1 -- 172.21.15.76:0/378325683 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f820c100f50 msgr2=0x7f820c1961f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:15.949 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.948+0000 7f8213a51700 1 --2- 172.21.15.76:0/378325683 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f820c100f50 0x7f820c1961f0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f81fc005910 tx=0x7f81fc005b00 comp rx=0 tx=0).stop 2024-06-02T04:50:15.949 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.948+0000 7f8213a51700 1 -- 172.21.15.76:0/378325683 shutdown_connections 2024-06-02T04:50:15.949 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.948+0000 7f8213a51700 1 --2- 172.21.15.76:0/378325683 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f820c1018f0 0x7f820c19d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:15.949 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.948+0000 7f8213a51700 1 --2- 172.21.15.76:0/378325683 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f81f80a11a0 0x7f81f80a3660 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:15.949 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.948+0000 7f8213a51700 1 --2- 172.21.15.76:0/378325683 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f820c0ffd60 0x7f820c195cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:15.949 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.948+0000 7f8213a51700 1 --2- 172.21.15.76:0/378325683 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f820c100f50 0x7f820c1961f0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:15.949 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.948+0000 7f8213a51700 1 -- 172.21.15.76:0/378325683 >> 172.21.15.76:0/378325683 conn(0x7f820c0fb2f0 msgr2=0x7f820c104360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:50:15.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.949+0000 7f8213a51700 1 -- 172.21.15.76:0/378325683 shutdown_connections 2024-06-02T04:50:15.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:15.949+0000 7f8213a51700 1 -- 172.21.15.76:0/378325683 wait complete. 2024-06-02T04:50:15.950 INFO:teuthology.orchestra.run.smithi076.stderr:dumped fsmap epoch 27 2024-06-02T04:50:15.963 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-06-02T04:50:16.147 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.145+0000 7f18037cd700 1 -- 172.21.15.76:0/1873320260 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f17fc0ff5e0 msgr2=0x7f17fc0ffa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:16.148 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.145+0000 7f18037cd700 1 --2- 172.21.15.76:0/1873320260 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f17fc0ff5e0 0x7f17fc0ffa00 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f17f80099c0 tx=0x7f17f8009cd0 comp rx=0 tx=0).stop 2024-06-02T04:50:16.148 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.145+0000 7f18037cd700 1 -- 172.21.15.76:0/1873320260 shutdown_connections 2024-06-02T04:50:16.148 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.145+0000 7f18037cd700 1 --2- 172.21.15.76:0/1873320260 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f17fc101170 0x7f17fc107a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:16.148 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.145+0000 7f18037cd700 1 --2- 172.21.15.76:0/1873320260 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f17fc0ff5e0 0x7f17fc0ffa00 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:16.148 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.145+0000 7f18037cd700 1 --2- 172.21.15.76:0/1873320260 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f17fc1007d0 0x7f17fc100c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:16.148 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.145+0000 7f18037cd700 1 -- 172.21.15.76:0/1873320260 >> 172.21.15.76:0/1873320260 conn(0x7f17fc0fab50 msgr2=0x7f17fc0fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:50:16.148 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.145+0000 7f18037cd700 1 -- 172.21.15.76:0/1873320260 shutdown_connections 2024-06-02T04:50:16.148 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.145+0000 7f18037cd700 1 -- 172.21.15.76:0/1873320260 wait complete. 2024-06-02T04:50:16.148 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.146+0000 7f18037cd700 1 Processor -- start 2024-06-02T04:50:16.148 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.146+0000 7f18037cd700 1 -- start start 2024-06-02T04:50:16.148 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.146+0000 7f18037cd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f17fc0ff5e0 0x7f17fc107170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:16.148 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.146+0000 7f18037cd700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f17fc1007d0 0x7f17fc1076b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:16.148 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.146+0000 7f18037cd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f17fc101170 0x7f17fc1a49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:16.149 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.146+0000 7f18037cd700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17fc1a4fb0 con 0x7f17fc101170 2024-06-02T04:50:16.149 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.146+0000 7f18037cd700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17fc1a50f0 con 0x7f17fc1007d0 2024-06-02T04:50:16.149 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.146+0000 7f18037cd700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17fc1a5280 con 0x7f17fc0ff5e0 2024-06-02T04:50:16.149 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.146+0000 7f1801d6a700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f17fc101170 0x7f17fc1a49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:16.149 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.146+0000 7f1801d6a700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f17fc101170 0x7f17fc1a49e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:47604/0 (socket says 172.21.15.76:47604) 2024-06-02T04:50:16.149 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.146+0000 7f1801d6a700 1 -- 172.21.15.76:0/2310113002 learned_addr learned my addr 172.21.15.76:0/2310113002 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:50:16.149 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.146+0000 7f1801569700 1 --2- 172.21.15.76:0/2310113002 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f17fc0ff5e0 0x7f17fc107170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:16.149 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.146+0000 7f1800d68700 1 --2- 172.21.15.76:0/2310113002 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f17fc1007d0 0x7f17fc1076b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:16.149 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.147+0000 7f1801d6a700 1 -- 172.21.15.76:0/2310113002 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f17fc0ff5e0 msgr2=0x7f17fc107170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:16.149 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.147+0000 7f1801d6a700 1 --2- 172.21.15.76:0/2310113002 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f17fc0ff5e0 0x7f17fc107170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:16.149 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.147+0000 7f1801d6a700 1 -- 172.21.15.76:0/2310113002 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f17fc1007d0 msgr2=0x7f17fc1076b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:16.149 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.147+0000 7f1801d6a700 1 --2- 172.21.15.76:0/2310113002 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f17fc1007d0 0x7f17fc1076b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:16.149 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.147+0000 7f1801d6a700 1 -- 172.21.15.76:0/2310113002 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17f80095f0 con 0x7f17fc101170 2024-06-02T04:50:16.150 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.147+0000 7f1801d6a700 1 --2- 172.21.15.76:0/2310113002 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f17fc101170 0x7f17fc1a49e0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f17f4007ee0 tx=0x7f17f400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:50:16.150 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.147+0000 7f17f27fc700 1 -- 172.21.15.76:0/2310113002 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f4017070 con 0x7f17fc101170 2024-06-02T04:50:16.150 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.147+0000 7f17f27fc700 1 -- 172.21.15.76:0/2310113002 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f17f400f040 con 0x7f17fc101170 2024-06-02T04:50:16.150 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.147+0000 7f18037cd700 1 -- 172.21.15.76:0/2310113002 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17fc1a5560 con 0x7f17fc101170 2024-06-02T04:50:16.150 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.147+0000 7f17f27fc700 1 -- 172.21.15.76:0/2310113002 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f4005570 con 0x7f17fc101170 2024-06-02T04:50:16.150 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.147+0000 7f18037cd700 1 -- 172.21.15.76:0/2310113002 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17fc1a5a70 con 0x7f17fc101170 2024-06-02T04:50:16.151 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.149+0000 7f17f27fc700 1 -- 172.21.15.76:0/2310113002 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f17f400db20 con 0x7f17fc101170 2024-06-02T04:50:16.151 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.150+0000 7f17f27fc700 1 --2- 172.21.15.76:0/2310113002 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f17e80a11a0 0x7f17e80a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:16.151 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.150+0000 7f1801569700 1 --2- 172.21.15.76:0/2310113002 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f17e80a11a0 0x7f17e80a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:16.151 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.150+0000 7f17f27fc700 1 -- 172.21.15.76:0/2310113002 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f17f40cc340 con 0x7f17fc101170 2024-06-02T04:50:16.151 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.151+0000 7f1801569700 1 --2- 172.21.15.76:0/2310113002 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f17e80a11a0 0x7f17e80a3660 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f17f8006010 tx=0x7f17f8000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:50:16.153 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.151+0000 7f180f988b80 1 Processor -- start 2024-06-02T04:50:16.153 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.151+0000 7f180f988b80 1 -- start start 2024-06-02T04:50:16.153 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.152+0000 7f180f988b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557c58a1f540 0x557c58a1f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:16.153 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.152+0000 7f180f988b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557c58a1fea0 0x557c58a20320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:16.153 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.152+0000 7f180f988b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557c58a20860 0x557c58a20ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:16.153 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.152+0000 7f180f988b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c58976150 con 0x557c58a20860 2024-06-02T04:50:16.153 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.152+0000 7f180f988b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c58973b10 con 0x557c58a1fea0 2024-06-02T04:50:16.153 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.152+0000 7f180f988b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c5896f400 con 0x557c58a1f540 2024-06-02T04:50:16.153 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.152+0000 7f1801d6a700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557c58a20860 0x557c58a20ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:16.153 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.152+0000 7f1801d6a700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557c58a20860 0x557c58a20ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:47606/0 (socket says 172.21.15.76:47606) 2024-06-02T04:50:16.154 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.152+0000 7f1801d6a700 1 -- 172.21.15.76:0/238955427 learned_addr learned my addr 172.21.15.76:0/238955427 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:50:16.154 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.152+0000 7f1801569700 1 --2- 172.21.15.76:0/238955427 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557c58a1f540 0x557c58a1f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:16.154 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.152+0000 7f1800d68700 1 --2- 172.21.15.76:0/238955427 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557c58a1fea0 0x557c58a20320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:16.154 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.152+0000 7f1801569700 1 -- 172.21.15.76:0/238955427 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557c58a1fea0 msgr2=0x557c58a20320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:50:16.154 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.152+0000 7f1801569700 1 --2- 172.21.15.76:0/238955427 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557c58a1fea0 0x557c58a20320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:16.154 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.152+0000 7f1801569700 1 -- 172.21.15.76:0/238955427 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557c58a20860 msgr2=0x557c58a20ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:50:16.154 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.152+0000 7f1801569700 1 --2- 172.21.15.76:0/238955427 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557c58a20860 0x557c58a20ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:16.154 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.152+0000 7f1801569700 1 -- 172.21.15.76:0/238955427 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557c587f03b0 con 0x557c58a1f540 2024-06-02T04:50:16.154 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.152+0000 7f1801569700 1 --2- 172.21.15.76:0/238955427 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557c58a1f540 0x557c58a1f960 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f17f80098e0 tx=0x7f17f8020000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d9f28f361f69b94e server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:50:16.154 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.153+0000 7f17e77fe700 1 -- 172.21.15.76:0/238955427 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f802b070 con 0x557c58a1f540 2024-06-02T04:50:16.154 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.153+0000 7f17e77fe700 1 -- 172.21.15.76:0/238955427 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f17f801e040 con 0x557c58a1f540 2024-06-02T04:50:16.154 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.153+0000 7f17e77fe700 1 -- 172.21.15.76:0/238955427 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f8003820 con 0x557c58a1f540 2024-06-02T04:50:16.159 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.153+0000 7f180f988b80 1 -- 172.21.15.76:0/238955427 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557c58a1f540 msgr2=0x557c58a1f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:16.159 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.153+0000 7f180f988b80 1 --2- 172.21.15.76:0/238955427 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557c58a1f540 0x557c58a1f960 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f17f80098e0 tx=0x7f17f8020000 comp rx=0 tx=0).stop 2024-06-02T04:50:16.159 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.153+0000 7f180f988b80 1 -- 172.21.15.76:0/238955427 shutdown_connections 2024-06-02T04:50:16.159 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.153+0000 7f180f988b80 1 --2- 172.21.15.76:0/238955427 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557c58a20860 0x557c58a20ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:16.159 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.153+0000 7f180f988b80 1 --2- 172.21.15.76:0/238955427 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557c58a1f540 0x557c58a1f960 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:16.159 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.153+0000 7f180f988b80 1 --2- 172.21.15.76:0/238955427 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557c58a1fea0 0x557c58a20320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:16.159 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.154+0000 7f180f988b80 1 -- 172.21.15.76:0/238955427 >> 172.21.15.76:0/238955427 conn(0x557c5897d210 msgr2=0x557c58a19de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:50:16.159 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.154+0000 7f180f988b80 1 -- 172.21.15.76:0/238955427 shutdown_connections 2024-06-02T04:50:16.159 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.154+0000 7f180f988b80 1 -- 172.21.15.76:0/238955427 wait complete. 2024-06-02T04:50:16.159 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.154+0000 7f180f988b80 1 -- start start 2024-06-02T04:50:16.159 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.154+0000 7f180f988b80 1 Processor -- start 2024-06-02T04:50:16.160 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.154+0000 7f180f988b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557c58a1f540 0x557c58a28d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:16.160 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.154+0000 7f180f988b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557c58a1fea0 0x557c58a29250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:16.160 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.154+0000 7f180f988b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557c58a20860 0x557c58a30290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:16.160 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.154+0000 7f180f988b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c5890b560 con 0x557c58a20860 2024-06-02T04:50:16.160 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.154+0000 7f180f988b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c5890b200 con 0x557c58a1f540 2024-06-02T04:50:16.160 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.154+0000 7f180f988b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c587f26a0 con 0x557c58a1fea0 2024-06-02T04:50:16.160 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.154+0000 7f180f988b80 10 client.0 _ll_register_callbacks cb 0x557c58914b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:50:16.160 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.154+0000 7f1801d6a700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557c58a20860 0x557c58a30290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:16.160 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.155+0000 7f1801d6a700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557c58a20860 0x557c58a30290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:47620/0 (socket says 172.21.15.76:47620) 2024-06-02T04:50:16.160 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.155+0000 7f1801d6a700 1 -- 172.21.15.76:0/3549750583 learned_addr learned my addr 172.21.15.76:0/3549750583 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:50:16.160 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.155+0000 7f1801569700 1 --2- 172.21.15.76:0/3549750583 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557c58a1f540 0x557c58a28d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:16.160 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.155+0000 7f1800d68700 1 --2- 172.21.15.76:0/3549750583 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557c58a1fea0 0x557c58a29250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:16.160 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.155+0000 7f1801569700 1 -- 172.21.15.76:0/3549750583 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557c58a1fea0 msgr2=0x557c58a29250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:50:16.161 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.155+0000 7f1801569700 1 --2- 172.21.15.76:0/3549750583 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557c58a1fea0 0x557c58a29250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:16.161 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.155+0000 7f1801569700 1 -- 172.21.15.76:0/3549750583 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557c58a20860 msgr2=0x557c58a30290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:50:16.161 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.155+0000 7f1801569700 1 --2- 172.21.15.76:0/3549750583 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557c58a20860 0x557c58a30290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:16.161 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.155+0000 7f1801569700 1 -- 172.21.15.76:0/3549750583 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17fc108370 con 0x557c58a1f540 2024-06-02T04:50:16.161 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.155+0000 7f1801d6a700 1 --2- 172.21.15.76:0/3549750583 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557c58a20860 0x557c58a30290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T04:50:16.161 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.155+0000 7f1801569700 1 --2- 172.21.15.76:0/3549750583 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557c58a1f540 0x557c58a28d10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f17f8009d10 tx=0x7f17f8004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f6e1a9b6571741a1 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:50:16.161 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.155+0000 7f17e4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-06-02T04:50:16.161 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.155+0000 7f17e4ff9700 1 -- 172.21.15.76:0/3549750583 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f802b050 con 0x557c58a1f540 2024-06-02T04:50:16.161 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.155+0000 7f17e4ff9700 1 -- 172.21.15.76:0/3549750583 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f17f800bca0 con 0x557c58a1f540 2024-06-02T04:50:16.161 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.155+0000 7f180f988b80 1 -- 172.21.15.76:0/3549750583 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557c588c8270 con 0x557c58a1f540 2024-06-02T04:50:16.161 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.155+0000 7f17e4ff9700 1 -- 172.21.15.76:0/3549750583 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f17f800ba40 con 0x557c58a1f540 2024-06-02T04:50:16.161 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.156+0000 7f180f988b80 10 client.25205 fetch_fsmap learned FSMap version 27 2024-06-02T04:50:16.162 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.156+0000 7f180f988b80 1 -- 172.21.15.76:0/3549750583 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x557c5879cb60 con 0x557c58a1f540 2024-06-02T04:50:16.162 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.156+0000 7f17e4ff9700 1 -- 172.21.15.76:0/3549750583 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x557c588c8270 con 0x557c58a1f540 2024-06-02T04:50:16.162 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.156+0000 7f17e4ff9700 1 -- 172.21.15.76:0/3549750583 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 27) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f17f8024900 con 0x557c58a1f540 2024-06-02T04:50:16.162 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.156+0000 7f180f988b80 10 client.25205 fetch_fsmap finished waiting for FSMap version 27 2024-06-02T04:50:16.162 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.156+0000 7f180f988b80 10 client.25205 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-06-02T04:50:16.162 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.156+0000 7f180f988b80 20 client.25205 populate_metadata read hostname 'smithi076' 2024-06-02T04:50:16.162 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.156+0000 7f180f988b80 1 --2- 172.21.15.76:0/3549750583 >> [v2:172.21.15.192:6836/960773710,v1:172.21.15.192:6837/960773710] conn(0x557c58a344c0 0x557c58a368e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:16.162 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.156+0000 7f180f988b80 4 client.25205 mds_command: new command op to 24463 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T04:50:16.162 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.156+0000 7f180f988b80 1 -- 172.21.15.76:0/3549750583 --> [v2:172.21.15.192:6836/960773710,v1:172.21.15.192:6837/960773710] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557c589ee810 con 0x557c58a344c0 2024-06-02T04:50:16.162 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.156+0000 7f1800d68700 1 --2- 172.21.15.76:0/3549750583 >> [v2:172.21.15.192:6836/960773710,v1:172.21.15.192:6837/960773710] conn(0x557c58a344c0 0x557c58a368e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:16.162 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.157+0000 7f17e4ff9700 10 client.25205 ms_handle_connect on v2:172.21.15.192:6836/960773710 2024-06-02T04:50:16.162 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.157+0000 7f1800d68700 1 --2- 172.21.15.76:0/3549750583 >> [v2:172.21.15.192:6836/960773710,v1:172.21.15.192:6837/960773710] conn(0x557c58a344c0 0x557c58a368e0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d4959847802e05b7 server_cookie=31e3682dca0ce12 in_seq=0 out_seq=0 2024-06-02T04:50:16.163 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.157+0000 7f17e4ff9700 1 -- 172.21.15.76:0/3549750583 <== mds.2 v2:172.21.15.192:6836/960773710 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x557c589ee810 con 0x557c58a344c0 2024-06-02T04:50:16.163 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.157+0000 7f17e4ff9700 10 client.25205 handle_command_reply: tid=0 2024-06-02T04:50:16.163 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.157+0000 7f180f988b80 1 client.25205 shutdown 2024-06-02T04:50:16.163 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.157+0000 7f180f988b80 1 -- 172.21.15.76:0/3549750583 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557c58a1f540 msgr2=0x557c58a28d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:16.163 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.157+0000 7f180f988b80 1 --2- 172.21.15.76:0/3549750583 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557c58a1f540 0x557c58a28d10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f17f8009d10 tx=0x7f17f8004730 comp rx=0 tx=0).stop 2024-06-02T04:50:16.163 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.158+0000 7f180f988b80 1 -- 172.21.15.76:0/3549750583 shutdown_connections 2024-06-02T04:50:16.163 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.158+0000 7f180f988b80 1 --2- 172.21.15.76:0/3549750583 >> [v2:172.21.15.192:6836/960773710,v1:172.21.15.192:6837/960773710] conn(0x557c58a344c0 0x557c58a368e0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:16.163 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.158+0000 7f180f988b80 1 --2- 172.21.15.76:0/3549750583 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557c58a20860 0x557c58a30290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:16.163 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.158+0000 7f17e4ff9700 0 client.25205 ms_handle_reset on v2:172.21.15.192:6836/960773710 2024-06-02T04:50:16.163 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.158+0000 7f180f988b80 1 --2- 172.21.15.76:0/3549750583 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557c58a1f540 0x557c58a28d10 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:16.163 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.158+0000 7f180f988b80 1 --2- 172.21.15.76:0/3549750583 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557c58a1fea0 0x557c58a29250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:16.163 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.158+0000 7f180f988b80 1 -- 172.21.15.76:0/3549750583 >> 172.21.15.76:0/3549750583 conn(0x557c5897d210 msgr2=0x557c58a195a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:50:16.163 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.158+0000 7f180f988b80 1 -- 172.21.15.76:0/3549750583 shutdown_connections 2024-06-02T04:50:16.163 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.158+0000 7f180f988b80 1 -- 172.21.15.76:0/3549750583 wait complete. 2024-06-02T04:50:16.164 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.158+0000 7f180f988b80 20 client.25205 trim_cache size 0 max 16384 2024-06-02T04:50:16.173 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.172+0000 7f180f988b80 1 Processor -- start 2024-06-02T04:50:16.174 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.172+0000 7f180f988b80 1 -- start start 2024-06-02T04:50:16.174 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.172+0000 7f180f988b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557c58a1f540 0x557c58a30940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:16.174 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.172+0000 7f180f988b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557c58a1fea0 0x557c58a30250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:16.174 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.172+0000 7f180f988b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557c58a20860 0x557c58a28290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:16.174 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.172+0000 7f180f988b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c58a16dc0 con 0x557c58a20860 2024-06-02T04:50:16.174 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.172+0000 7f180f988b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c58a1b830 con 0x557c58a1f540 2024-06-02T04:50:16.174 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.172+0000 7f180f988b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c58a1b0d0 con 0x557c58a1fea0 2024-06-02T04:50:16.174 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.173+0000 7f1801d6a700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557c58a20860 0x557c58a28290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:16.174 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.173+0000 7f1801d6a700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557c58a20860 0x557c58a28290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:47636/0 (socket says 172.21.15.76:47636) 2024-06-02T04:50:16.174 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.173+0000 7f1801d6a700 1 -- 172.21.15.76:0/3533989735 learned_addr learned my addr 172.21.15.76:0/3533989735 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:50:16.174 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.173+0000 7f1801569700 1 --2- 172.21.15.76:0/3533989735 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557c58a1f540 0x557c58a30940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:16.175 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.173+0000 7f1801d6a700 1 -- 172.21.15.76:0/3533989735 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557c58a1fea0 msgr2=0x557c58a30250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:50:16.175 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.173+0000 7f1801d6a700 1 --2- 172.21.15.76:0/3533989735 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557c58a1fea0 0x557c58a30250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:16.175 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.173+0000 7f1801d6a700 1 -- 172.21.15.76:0/3533989735 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557c58a1f540 msgr2=0x557c58a30940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:50:16.175 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.173+0000 7f1801d6a700 1 --2- 172.21.15.76:0/3533989735 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557c58a1f540 0x557c58a30940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:16.175 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.173+0000 7f1801d6a700 1 -- 172.21.15.76:0/3533989735 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557c58935560 con 0x557c58a20860 2024-06-02T04:50:16.175 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.173+0000 7f1801d6a700 1 --2- 172.21.15.76:0/3533989735 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557c58a20860 0x557c58a28290 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f17f40a13a0 tx=0x7f17f4084040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7049174ddc405ce server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:50:16.175 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.173+0000 7f17e7fff700 1 -- 172.21.15.76:0/3533989735 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f4098db0 con 0x557c58a20860 2024-06-02T04:50:16.175 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.173+0000 7f17e7fff700 1 -- 172.21.15.76:0/3533989735 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f17f4095790 con 0x557c58a20860 2024-06-02T04:50:16.175 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.173+0000 7f17e7fff700 1 -- 172.21.15.76:0/3533989735 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f409d280 con 0x557c58a20860 2024-06-02T04:50:16.179 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.174+0000 7f180f988b80 1 -- 172.21.15.76:0/3533989735 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557c58a20860 msgr2=0x557c58a28290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:16.179 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.174+0000 7f180f988b80 1 --2- 172.21.15.76:0/3533989735 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557c58a20860 0x557c58a28290 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f17f40a13a0 tx=0x7f17f4084040 comp rx=0 tx=0).stop 2024-06-02T04:50:16.179 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.174+0000 7f180f988b80 1 -- 172.21.15.76:0/3533989735 shutdown_connections 2024-06-02T04:50:16.180 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.174+0000 7f180f988b80 1 --2- 172.21.15.76:0/3533989735 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557c58a20860 0x557c58a28290 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:16.180 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.174+0000 7f180f988b80 1 --2- 172.21.15.76:0/3533989735 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557c58a1f540 0x557c58a30940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:16.180 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.174+0000 7f180f988b80 1 --2- 172.21.15.76:0/3533989735 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557c58a1fea0 0x557c58a30250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:16.180 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.174+0000 7f180f988b80 1 -- 172.21.15.76:0/3533989735 >> 172.21.15.76:0/3533989735 conn(0x557c5897d210 msgr2=0x557c58a20c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:50:16.180 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.174+0000 7f180f988b80 1 -- 172.21.15.76:0/3533989735 shutdown_connections 2024-06-02T04:50:16.180 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.174+0000 7f180f988b80 1 -- 172.21.15.76:0/3533989735 wait complete. 2024-06-02T04:50:16.180 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.174+0000 7f180f988b80 1 -- start start 2024-06-02T04:50:16.180 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.175+0000 7f180f988b80 1 Processor -- start 2024-06-02T04:50:16.180 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.175+0000 7f180f988b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557c58a1f540 0x557c58a2ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:16.180 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.175+0000 7f180f988b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557c58a1fea0 0x557c58a2bf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:16.180 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.175+0000 7f180f988b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557c58a20860 0x557c58a2ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:16.180 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.175+0000 7f180f988b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c58a2f3d0 con 0x557c58a1fea0 2024-06-02T04:50:16.180 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.175+0000 7f180f988b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c58a2f540 con 0x557c58a20860 2024-06-02T04:50:16.181 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.175+0000 7f180f988b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c58a2f700 con 0x557c58a1f540 2024-06-02T04:50:16.181 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.175+0000 7f180f988b80 10 client.0 _ll_register_callbacks cb 0x557c58914b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:50:16.181 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.175+0000 7f1800d68700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557c58a1fea0 0x557c58a2bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:16.181 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.175+0000 7f1800d68700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557c58a1fea0 0x557c58a2bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:47648/0 (socket says 172.21.15.76:47648) 2024-06-02T04:50:16.181 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.175+0000 7f1800d68700 1 -- 172.21.15.76:0/2730563581 learned_addr learned my addr 172.21.15.76:0/2730563581 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:50:16.181 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.175+0000 7f1801569700 1 --2- 172.21.15.76:0/2730563581 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557c58a1f540 0x557c58a2ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:16.181 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.175+0000 7f1801d6a700 1 --2- 172.21.15.76:0/2730563581 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557c58a20860 0x557c58a2ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:16.181 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.175+0000 7f1800d68700 1 -- 172.21.15.76:0/2730563581 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557c58a1f540 msgr2=0x557c58a2ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:50:16.181 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.175+0000 7f1800d68700 1 --2- 172.21.15.76:0/2730563581 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557c58a1f540 0x557c58a2ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:16.181 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.175+0000 7f1800d68700 1 -- 172.21.15.76:0/2730563581 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557c58a20860 msgr2=0x557c58a2ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:50:16.181 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.175+0000 7f1800d68700 1 --2- 172.21.15.76:0/2730563581 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557c58a20860 0x557c58a2ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:16.181 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.175+0000 7f1800d68700 1 -- 172.21.15.76:0/2730563581 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17fc1a5a70 con 0x557c58a1fea0 2024-06-02T04:50:16.181 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.175+0000 7f1801d6a700 1 --2- 172.21.15.76:0/2730563581 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557c58a20860 0x557c58a2ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:50:16.182 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.176+0000 7f1801569700 1 --2- 172.21.15.76:0/2730563581 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557c58a1f540 0x557c58a2ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:50:16.182 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.176+0000 7f1800d68700 1 --2- 172.21.15.76:0/2730563581 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557c58a1fea0 0x557c58a2bf80 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f17ec000c00 tx=0x7f17ec015700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee8732ef2228cce4 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:50:16.182 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.176+0000 7f17e4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-06-02T04:50:16.182 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.176+0000 7f17e4ff9700 1 -- 172.21.15.76:0/2730563581 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17ec01b040 con 0x557c58a1fea0 2024-06-02T04:50:16.182 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.176+0000 7f17e4ff9700 1 -- 172.21.15.76:0/2730563581 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f17ec015e10 con 0x557c58a1fea0 2024-06-02T04:50:16.182 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.176+0000 7f180f988b80 1 -- 172.21.15.76:0/2730563581 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f17f801e040 con 0x557c58a1fea0 2024-06-02T04:50:16.182 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.176+0000 7f17e4ff9700 1 -- 172.21.15.76:0/2730563581 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f17ec01eb80 con 0x557c58a1fea0 2024-06-02T04:50:16.182 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.176+0000 7f180f988b80 10 client.15675 fetch_fsmap learned FSMap version 27 2024-06-02T04:50:16.182 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.176+0000 7f180f988b80 1 -- 172.21.15.76:0/2730563581 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x557c587f4cd0 con 0x557c58a1fea0 2024-06-02T04:50:16.182 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.176+0000 7f17e4ff9700 1 -- 172.21.15.76:0/2730563581 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f17f801e040 con 0x557c58a1fea0 2024-06-02T04:50:16.182 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.176+0000 7f17e4ff9700 1 -- 172.21.15.76:0/2730563581 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 27) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f17ec01e050 con 0x557c58a1fea0 2024-06-02T04:50:16.182 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.176+0000 7f180f988b80 10 client.15675 fetch_fsmap finished waiting for FSMap version 27 2024-06-02T04:50:16.182 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.176+0000 7f180f988b80 10 client.15675 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-06-02T04:50:16.183 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.176+0000 7f180f988b80 20 client.15675 populate_metadata read hostname 'smithi076' 2024-06-02T04:50:16.183 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.176+0000 7f180f988b80 1 --2- 172.21.15.76:0/2730563581 >> [v2:172.21.15.192:6836/960773710,v1:172.21.15.192:6837/960773710] conn(0x557c58a8b390 0x557c58a8d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:16.183 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.176+0000 7f180f988b80 4 client.15675 mds_command: new command op to 24463 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-06-02T04:50:16.183 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.176+0000 7f180f988b80 1 -- 172.21.15.76:0/2730563581 --> [v2:172.21.15.192:6836/960773710,v1:172.21.15.192:6837/960773710] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x557c58967ec0 con 0x557c58a8b390 2024-06-02T04:50:16.183 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.177+0000 7f1801569700 1 --2- 172.21.15.76:0/2730563581 >> [v2:172.21.15.192:6836/960773710,v1:172.21.15.192:6837/960773710] conn(0x557c58a8b390 0x557c58a8d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:16.183 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.177+0000 7f17e4ff9700 10 client.15675 ms_handle_connect on v2:172.21.15.192:6836/960773710 2024-06-02T04:50:16.183 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.177+0000 7f1801569700 1 --2- 172.21.15.76:0/2730563581 >> [v2:172.21.15.192:6836/960773710,v1:172.21.15.192:6837/960773710] conn(0x557c58a8b390 0x557c58a8d7b0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8b4d488b5078739c server_cookie=b3c5b54a22ef11a in_seq=0 out_seq=0 2024-06-02T04:50:16.183 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.177+0000 7f17e4ff9700 1 -- 172.21.15.76:0/2730563581 <== mds.2 v2:172.21.15.192:6836/960773710 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x557c58967ec0 con 0x557c58a8b390 2024-06-02T04:50:16.183 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.177+0000 7f17e4ff9700 10 client.15675 handle_command_reply: tid=0 2024-06-02T04:50:16.183 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.177+0000 7f180f988b80 1 client.15675 shutdown 2024-06-02T04:50:16.183 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.178+0000 7f180f988b80 1 -- 172.21.15.76:0/2730563581 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557c58a1fea0 msgr2=0x557c58a2bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:16.183 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.178+0000 7f180f988b80 1 --2- 172.21.15.76:0/2730563581 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557c58a1fea0 0x557c58a2bf80 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f17ec000c00 tx=0x7f17ec015700 comp rx=0 tx=0).stop 2024-06-02T04:50:16.183 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.178+0000 7f180f988b80 1 -- 172.21.15.76:0/2730563581 shutdown_connections 2024-06-02T04:50:16.184 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.178+0000 7f180f988b80 1 --2- 172.21.15.76:0/2730563581 >> [v2:172.21.15.192:6836/960773710,v1:172.21.15.192:6837/960773710] conn(0x557c58a8b390 0x557c58a8d7b0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:16.184 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.178+0000 7f180f988b80 1 --2- 172.21.15.76:0/2730563581 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557c58a20860 0x557c58a2ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:16.184 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.178+0000 7f17e4ff9700 0 client.15675 ms_handle_reset on v2:172.21.15.192:6836/960773710 2024-06-02T04:50:16.184 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.178+0000 7f180f988b80 1 --2- 172.21.15.76:0/2730563581 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557c58a1f540 0x557c58a2ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:16.184 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.178+0000 7f180f988b80 1 --2- 172.21.15.76:0/2730563581 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557c58a1fea0 0x557c58a2bf80 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:16.184 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.178+0000 7f180f988b80 1 -- 172.21.15.76:0/2730563581 >> 172.21.15.76:0/2730563581 conn(0x557c5897d210 msgr2=0x557c58a28290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:50:16.184 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.178+0000 7f180f988b80 1 -- 172.21.15.76:0/2730563581 shutdown_connections 2024-06-02T04:50:16.184 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.178+0000 7f180f988b80 1 -- 172.21.15.76:0/2730563581 wait complete. 2024-06-02T04:50:16.184 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.178+0000 7f180f988b80 20 client.15675 trim_cache size 0 max 16384 2024-06-02T04:50:16.184 INFO:teuthology.orchestra.run.smithi076.stdout:[] 2024-06-02T04:50:16.185 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.178+0000 7f18037cd700 1 -- 172.21.15.76:0/2310113002 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f17e80a11a0 msgr2=0x7f17e80a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:16.185 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.178+0000 7f18037cd700 1 --2- 172.21.15.76:0/2310113002 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f17e80a11a0 0x7f17e80a3660 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f17f8006010 tx=0x7f17f8000bc0 comp rx=0 tx=0).stop 2024-06-02T04:50:16.185 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.178+0000 7f18037cd700 1 -- 172.21.15.76:0/2310113002 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f17fc101170 msgr2=0x7f17fc1a49e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:16.186 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.178+0000 7f18037cd700 1 --2- 172.21.15.76:0/2310113002 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f17fc101170 0x7f17fc1a49e0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f17f4007ee0 tx=0x7f17f400d3b0 comp rx=0 tx=0).stop 2024-06-02T04:50:16.186 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.178+0000 7f18037cd700 1 -- 172.21.15.76:0/2310113002 shutdown_connections 2024-06-02T04:50:16.186 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.178+0000 7f18037cd700 1 --2- 172.21.15.76:0/2310113002 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f17fc101170 0x7f17fc1a49e0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:16.186 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.178+0000 7f18037cd700 1 --2- 172.21.15.76:0/2310113002 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f17fc0ff5e0 0x7f17fc107170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:16.186 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.178+0000 7f18037cd700 1 --2- 172.21.15.76:0/2310113002 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f17e80a11a0 0x7f17e80a3660 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:16.186 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.178+0000 7f18037cd700 1 --2- 172.21.15.76:0/2310113002 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f17fc1007d0 0x7f17fc1076b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:16.186 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.178+0000 7f18037cd700 1 -- 172.21.15.76:0/2310113002 >> 172.21.15.76:0/2310113002 conn(0x7f17fc0fab50 msgr2=0x7f17fc10d210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:50:16.186 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.178+0000 7f18037cd700 1 -- 172.21.15.76:0/2310113002 shutdown_connections 2024-06-02T04:50:16.186 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.178+0000 7f18037cd700 1 -- 172.21.15.76:0/2310113002 wait complete. 2024-06-02T04:50:16.192 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-06-02T04:50:16.349 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.349+0000 7fdb65fdc700 1 -- 172.21.15.76:0/453598938 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdb600ffe60 msgr2=0x7fdb60100280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:16.350 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.349+0000 7fdb65fdc700 1 --2- 172.21.15.76:0/453598938 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdb600ffe60 0x7fdb60100280 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fdb50009990 tx=0x7fdb50009ca0 comp rx=0 tx=0).stop 2024-06-02T04:50:16.350 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.349+0000 7fdb65fdc700 1 -- 172.21.15.76:0/453598938 shutdown_connections 2024-06-02T04:50:16.350 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.349+0000 7fdb65fdc700 1 --2- 172.21.15.76:0/453598938 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb60101970 0x7fdb60108290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:16.350 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.349+0000 7fdb65fdc700 1 --2- 172.21.15.76:0/453598938 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdb600ffe60 0x7fdb60100280 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:16.350 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.349+0000 7fdb65fdc700 1 --2- 172.21.15.76:0/453598938 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdb60100fb0 0x7fdb60101430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:16.350 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.349+0000 7fdb65fdc700 1 -- 172.21.15.76:0/453598938 >> 172.21.15.76:0/453598938 conn(0x7fdb600fb3f0 msgr2=0x7fdb600fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:50:16.350 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.349+0000 7fdb65fdc700 1 -- 172.21.15.76:0/453598938 shutdown_connections 2024-06-02T04:50:16.350 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.349+0000 7fdb65fdc700 1 -- 172.21.15.76:0/453598938 wait complete. 2024-06-02T04:50:16.350 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.350+0000 7fdb65fdc700 1 Processor -- start 2024-06-02T04:50:16.352 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.350+0000 7fdb65fdc700 1 -- start start 2024-06-02T04:50:16.352 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.350+0000 7fdb65fdc700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdb600ffe60 0x7fdb60196e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:16.352 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.350+0000 7fdb65fdc700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb60100fb0 0x7fdb60197390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:16.353 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.350+0000 7fdb65fdc700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdb60101970 0x7fdb6019e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:16.353 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.350+0000 7fdb65fdc700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6019e980 con 0x7fdb60101970 2024-06-02T04:50:16.353 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.350+0000 7fdb65fdc700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6019eac0 con 0x7fdb60100fb0 2024-06-02T04:50:16.353 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.350+0000 7fdb65fdc700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6019ec50 con 0x7fdb600ffe60 2024-06-02T04:50:16.353 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.350+0000 7fdb5ffff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdb60101970 0x7fdb6019e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:16.353 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.350+0000 7fdb5ffff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdb60101970 0x7fdb6019e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:47668/0 (socket says 172.21.15.76:47668) 2024-06-02T04:50:16.353 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.350+0000 7fdb5ffff700 1 -- 172.21.15.76:0/297988446 learned_addr learned my addr 172.21.15.76:0/297988446 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:50:16.353 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.350+0000 7fdb5f7fe700 1 --2- 172.21.15.76:0/297988446 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdb600ffe60 0x7fdb60196e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:16.353 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.350+0000 7fdb5effd700 1 --2- 172.21.15.76:0/297988446 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb60100fb0 0x7fdb60197390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:16.353 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.350+0000 7fdb5ffff700 1 -- 172.21.15.76:0/297988446 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdb600ffe60 msgr2=0x7fdb60196e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:16.353 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.350+0000 7fdb5ffff700 1 --2- 172.21.15.76:0/297988446 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdb600ffe60 0x7fdb60196e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:16.353 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.350+0000 7fdb5ffff700 1 -- 172.21.15.76:0/297988446 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb60100fb0 msgr2=0x7fdb60197390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:16.354 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.350+0000 7fdb5ffff700 1 --2- 172.21.15.76:0/297988446 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb60100fb0 0x7fdb60197390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:16.354 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.351+0000 7fdb5ffff700 1 -- 172.21.15.76:0/297988446 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb500095f0 con 0x7fdb60101970 2024-06-02T04:50:16.354 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.351+0000 7fdb5effd700 1 --2- 172.21.15.76:0/297988446 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb60100fb0 0x7fdb60197390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:50:16.354 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.351+0000 7fdb5ffff700 1 --2- 172.21.15.76:0/297988446 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdb60101970 0x7fdb6019e3b0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fdb58007ee0 tx=0x7fdb5800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:50:16.354 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.351+0000 7fdb5cff9700 1 -- 172.21.15.76:0/297988446 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb5800ddd0 con 0x7fdb60101970 2024-06-02T04:50:16.354 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.351+0000 7fdb5cff9700 1 -- 172.21.15.76:0/297988446 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdb5800f040 con 0x7fdb60101970 2024-06-02T04:50:16.354 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.351+0000 7fdb65fdc700 1 -- 172.21.15.76:0/297988446 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb6019ef30 con 0x7fdb60101970 2024-06-02T04:50:16.354 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.351+0000 7fdb5cff9700 1 -- 172.21.15.76:0/297988446 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb58004870 con 0x7fdb60101970 2024-06-02T04:50:16.354 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.351+0000 7fdb65fdc700 1 -- 172.21.15.76:0/297988446 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb6019f3b0 con 0x7fdb60101970 2024-06-02T04:50:16.356 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.353+0000 7fdb5cff9700 1 -- 172.21.15.76:0/297988446 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fdb58003a00 con 0x7fdb60101970 2024-06-02T04:50:16.356 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.354+0000 7fdb5cff9700 1 --2- 172.21.15.76:0/297988446 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fdb480a1120 0x7fdb480a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:16.357 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.354+0000 7fdb5cff9700 1 -- 172.21.15.76:0/297988446 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7fdb580cc590 con 0x7fdb60101970 2024-06-02T04:50:16.357 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.354+0000 7fdb5f7fe700 1 --2- 172.21.15.76:0/297988446 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fdb480a1120 0x7fdb480a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:16.357 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.354+0000 7fdb5f7fe700 1 --2- 172.21.15.76:0/297988446 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fdb480a1120 0x7fdb480a35e0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fdb5000b5c0 tx=0x7fdb50005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:50:16.357 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.355+0000 7fdb72197b80 1 Processor -- start 2024-06-02T04:50:16.357 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.355+0000 7fdb72197b80 1 -- start start 2024-06-02T04:50:16.357 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.355+0000 7fdb72197b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56420ff32350 0x56420ff32770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:16.357 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.355+0000 7fdb72197b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56420ff32cb0 0x56420ff3ff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:16.357 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.355+0000 7fdb72197b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56420ff404b0 0x56420ff428a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:16.357 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.355+0000 7fdb72197b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x56420fe89150 con 0x56420ff32350 2024-06-02T04:50:16.357 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.355+0000 7fdb72197b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x56420fe86b10 con 0x56420ff404b0 2024-06-02T04:50:16.357 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.355+0000 7fdb72197b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x56420fe82400 con 0x56420ff32cb0 2024-06-02T04:50:16.357 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.355+0000 7fdb5f7fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56420ff32350 0x56420ff32770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:16.357 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.355+0000 7fdb5f7fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56420ff32350 0x56420ff32770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:47680/0 (socket says 172.21.15.76:47680) 2024-06-02T04:50:16.358 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.355+0000 7fdb5f7fe700 1 -- 172.21.15.76:0/4107066080 learned_addr learned my addr 172.21.15.76:0/4107066080 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:50:16.358 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.355+0000 7fdb5effd700 1 --2- 172.21.15.76:0/4107066080 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56420ff32cb0 0x56420ff3ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:16.358 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.355+0000 7fdb5ffff700 1 --2- 172.21.15.76:0/4107066080 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56420ff404b0 0x56420ff428a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:16.358 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.355+0000 7fdb5f7fe700 1 -- 172.21.15.76:0/4107066080 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56420ff32cb0 msgr2=0x56420ff3ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:50:16.358 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.355+0000 7fdb5f7fe700 1 --2- 172.21.15.76:0/4107066080 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56420ff32cb0 0x56420ff3ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:16.358 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.355+0000 7fdb5f7fe700 1 -- 172.21.15.76:0/4107066080 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56420ff404b0 msgr2=0x56420ff428a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:50:16.358 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.355+0000 7fdb5f7fe700 1 --2- 172.21.15.76:0/4107066080 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56420ff404b0 0x56420ff428a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:16.358 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.355+0000 7fdb5f7fe700 1 -- 172.21.15.76:0/4107066080 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56420fd033b0 con 0x56420ff32350 2024-06-02T04:50:16.358 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.356+0000 7fdb5f7fe700 1 --2- 172.21.15.76:0/4107066080 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56420ff32350 0x56420ff32770 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fdb5000bfe0 tx=0x7fdb5001f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84b9f02783a5f59b server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:50:16.358 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.356+0000 7fdb45ffb700 1 -- 172.21.15.76:0/4107066080 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb5002b070 con 0x56420ff32350 2024-06-02T04:50:16.358 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.356+0000 7fdb45ffb700 1 -- 172.21.15.76:0/4107066080 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdb5001e040 con 0x56420ff32350 2024-06-02T04:50:16.358 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.356+0000 7fdb45ffb700 1 -- 172.21.15.76:0/4107066080 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb50004a50 con 0x56420ff32350 2024-06-02T04:50:16.362 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.357+0000 7fdb72197b80 1 -- 172.21.15.76:0/4107066080 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56420ff32350 msgr2=0x56420ff32770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:16.362 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.357+0000 7fdb72197b80 1 --2- 172.21.15.76:0/4107066080 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56420ff32350 0x56420ff32770 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fdb5000bfe0 tx=0x7fdb5001f000 comp rx=0 tx=0).stop 2024-06-02T04:50:16.363 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.357+0000 7fdb72197b80 1 -- 172.21.15.76:0/4107066080 shutdown_connections 2024-06-02T04:50:16.363 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.357+0000 7fdb72197b80 1 --2- 172.21.15.76:0/4107066080 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56420ff404b0 0x56420ff428a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:16.363 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.357+0000 7fdb72197b80 1 --2- 172.21.15.76:0/4107066080 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56420ff32350 0x56420ff32770 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:16.363 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.357+0000 7fdb72197b80 1 --2- 172.21.15.76:0/4107066080 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56420ff32cb0 0x56420ff3ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:16.363 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.357+0000 7fdb72197b80 1 -- 172.21.15.76:0/4107066080 >> 172.21.15.76:0/4107066080 conn(0x56420fe90210 msgr2=0x56420ff2cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:50:16.363 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.357+0000 7fdb72197b80 1 -- 172.21.15.76:0/4107066080 shutdown_connections 2024-06-02T04:50:16.363 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.357+0000 7fdb72197b80 1 -- 172.21.15.76:0/4107066080 wait complete. 2024-06-02T04:50:16.363 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.357+0000 7fdb72197b80 1 -- start start 2024-06-02T04:50:16.363 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.358+0000 7fdb72197b80 1 Processor -- start 2024-06-02T04:50:16.363 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.358+0000 7fdb72197b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56420ff32350 0x56420ff44550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:16.363 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.358+0000 7fdb72197b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56420ff32cb0 0x56420ff44a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:16.363 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.358+0000 7fdb72197b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56420ff404b0 0x56420ff4bad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:16.363 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.358+0000 7fdb72197b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x56420fe1e560 con 0x56420ff404b0 2024-06-02T04:50:16.364 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.358+0000 7fdb72197b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x56420fe1e200 con 0x56420ff32350 2024-06-02T04:50:16.364 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.358+0000 7fdb72197b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x56420fd056a0 con 0x56420ff32cb0 2024-06-02T04:50:16.364 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.358+0000 7fdb72197b80 10 client.0 _ll_register_callbacks cb 0x56420fe27b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:50:16.364 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.358+0000 7fdb5ffff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56420ff404b0 0x56420ff4bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:16.364 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.358+0000 7fdb5ffff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56420ff404b0 0x56420ff4bad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:47688/0 (socket says 172.21.15.76:47688) 2024-06-02T04:50:16.364 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.358+0000 7fdb5ffff700 1 -- 172.21.15.76:0/211825408 learned_addr learned my addr 172.21.15.76:0/211825408 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:50:16.364 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.358+0000 7fdb5effd700 1 --2- 172.21.15.76:0/211825408 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56420ff32cb0 0x56420ff44a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:16.364 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.358+0000 7fdb5f7fe700 1 --2- 172.21.15.76:0/211825408 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56420ff32350 0x56420ff44550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:16.364 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.358+0000 7fdb5ffff700 1 -- 172.21.15.76:0/211825408 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56420ff32cb0 msgr2=0x56420ff44a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:50:16.364 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.359+0000 7fdb5ffff700 1 --2- 172.21.15.76:0/211825408 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56420ff32cb0 0x56420ff44a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:16.364 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.359+0000 7fdb5ffff700 1 -- 172.21.15.76:0/211825408 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56420ff32350 msgr2=0x56420ff44550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:50:16.364 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.359+0000 7fdb5ffff700 1 --2- 172.21.15.76:0/211825408 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56420ff32350 0x56420ff44550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:16.364 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.359+0000 7fdb5ffff700 1 -- 172.21.15.76:0/211825408 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb60108bc0 con 0x56420ff404b0 2024-06-02T04:50:16.364 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.359+0000 7fdb5ffff700 1 --2- 172.21.15.76:0/211825408 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56420ff404b0 0x56420ff4bad0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fdb58099630 tx=0x7fdb58099520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc318431bcf9a147 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:50:16.365 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.359+0000 7fdb3effd700 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-06-02T04:50:16.365 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.359+0000 7fdb3effd700 1 -- 172.21.15.76:0/211825408 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb580996a0 con 0x56420ff404b0 2024-06-02T04:50:16.365 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.359+0000 7fdb3effd700 1 -- 172.21.15.76:0/211825408 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7fdb5809d4d0 con 0x56420ff404b0 2024-06-02T04:50:16.365 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.359+0000 7fdb72197b80 1 -- 172.21.15.76:0/211825408 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56420fddb270 con 0x56420ff404b0 2024-06-02T04:50:16.365 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.359+0000 7fdb3effd700 1 -- 172.21.15.76:0/211825408 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdb580a1b20 con 0x56420ff404b0 2024-06-02T04:50:16.365 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.359+0000 7fdb72197b80 10 client.15687 fetch_fsmap learned FSMap version 27 2024-06-02T04:50:16.365 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.359+0000 7fdb72197b80 1 -- 172.21.15.76:0/211825408 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x56420fcafb60 con 0x56420ff404b0 2024-06-02T04:50:16.365 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.359+0000 7fdb3effd700 1 -- 172.21.15.76:0/211825408 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56420fddb270 con 0x56420ff404b0 2024-06-02T04:50:16.365 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.359+0000 7fdb3effd700 1 -- 172.21.15.76:0/211825408 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 27) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fdb58099900 con 0x56420ff404b0 2024-06-02T04:50:16.365 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.359+0000 7fdb72197b80 10 client.15687 fetch_fsmap finished waiting for FSMap version 27 2024-06-02T04:50:16.365 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.359+0000 7fdb72197b80 10 client.15687 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-06-02T04:50:16.365 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.359+0000 7fdb72197b80 20 client.15687 populate_metadata read hostname 'smithi076' 2024-06-02T04:50:16.365 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.359+0000 7fdb72197b80 1 --2- 172.21.15.76:0/211825408 >> [v2:172.21.15.192:6838/3978681402,v1:172.21.15.192:6839/3978681402] conn(0x56420ff50400 0x56420ff52820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:16.366 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.359+0000 7fdb72197b80 4 client.15687 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T04:50:16.366 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.360+0000 7fdb72197b80 1 -- 172.21.15.76:0/211825408 --> [v2:172.21.15.192:6838/3978681402,v1:172.21.15.192:6839/3978681402] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56420ff01810 con 0x56420ff50400 2024-06-02T04:50:16.366 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.360+0000 7fdb5f7fe700 1 --2- 172.21.15.76:0/211825408 >> [v2:172.21.15.192:6838/3978681402,v1:172.21.15.192:6839/3978681402] conn(0x56420ff50400 0x56420ff52820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:16.366 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.360+0000 7fdb5f7fe700 1 --2- 172.21.15.76:0/211825408 >> [v2:172.21.15.192:6838/3978681402,v1:172.21.15.192:6839/3978681402] conn(0x56420ff50400 0x56420ff52820 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=620061a10613484f server_cookie=265c80d5ecab6a82 in_seq=0 out_seq=0 2024-06-02T04:50:16.366 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.360+0000 7fdb3effd700 10 client.15687 ms_handle_connect on v2:172.21.15.192:6838/3978681402 2024-06-02T04:50:16.366 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.361+0000 7fdb3effd700 1 -- 172.21.15.76:0/211825408 <== mds.1 v2:172.21.15.192:6838/3978681402 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56420ff01810 con 0x56420ff50400 2024-06-02T04:50:16.366 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.361+0000 7fdb3effd700 10 client.15687 handle_command_reply: tid=0 2024-06-02T04:50:16.366 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.361+0000 7fdb72197b80 1 client.15687 shutdown 2024-06-02T04:50:16.366 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.361+0000 7fdb72197b80 1 -- 172.21.15.76:0/211825408 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56420ff404b0 msgr2=0x56420ff4bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:16.366 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.361+0000 7fdb72197b80 1 --2- 172.21.15.76:0/211825408 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56420ff404b0 0x56420ff4bad0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fdb58099630 tx=0x7fdb58099520 comp rx=0 tx=0).stop 2024-06-02T04:50:16.366 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.361+0000 7fdb72197b80 1 -- 172.21.15.76:0/211825408 shutdown_connections 2024-06-02T04:50:16.366 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.361+0000 7fdb72197b80 1 --2- 172.21.15.76:0/211825408 >> [v2:172.21.15.192:6838/3978681402,v1:172.21.15.192:6839/3978681402] conn(0x56420ff50400 0x56420ff52820 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:16.366 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.361+0000 7fdb72197b80 1 --2- 172.21.15.76:0/211825408 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56420ff404b0 0x56420ff4bad0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:16.367 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.361+0000 7fdb72197b80 1 --2- 172.21.15.76:0/211825408 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56420ff32350 0x56420ff44550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:16.367 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.361+0000 7fdb72197b80 1 --2- 172.21.15.76:0/211825408 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56420ff32cb0 0x56420ff44a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:16.367 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.361+0000 7fdb3effd700 0 client.15687 ms_handle_reset on v2:172.21.15.192:6838/3978681402 2024-06-02T04:50:16.367 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.361+0000 7fdb72197b80 1 -- 172.21.15.76:0/211825408 >> 172.21.15.76:0/211825408 conn(0x56420fe90210 msgr2=0x56420ff2c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:50:16.367 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.362+0000 7fdb72197b80 1 -- 172.21.15.76:0/211825408 shutdown_connections 2024-06-02T04:50:16.367 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.362+0000 7fdb72197b80 1 -- 172.21.15.76:0/211825408 wait complete. 2024-06-02T04:50:16.367 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.362+0000 7fdb72197b80 20 client.15687 trim_cache size 0 max 16384 2024-06-02T04:50:16.382 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.379+0000 7fdb72197b80 1 Processor -- start 2024-06-02T04:50:16.382 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.379+0000 7fdb72197b80 1 -- start start 2024-06-02T04:50:16.382 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.379+0000 7fdb72197b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56420ff32350 0x56420ff527f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:16.382 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.379+0000 7fdb72197b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56420ff32cb0 0x56420ff4ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:16.382 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.379+0000 7fdb72197b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56420ff404b0 0x56420ff43a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:16.383 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.379+0000 7fdb72197b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x56420ff3f940 con 0x56420ff32cb0 2024-06-02T04:50:16.383 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.379+0000 7fdb72197b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x56420ff2e0d0 con 0x56420ff32350 2024-06-02T04:50:16.383 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.379+0000 7fdb72197b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x56420ff50010 con 0x56420ff404b0 2024-06-02T04:50:16.383 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.379+0000 7fdb5effd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56420ff32cb0 0x56420ff4ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:16.383 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.380+0000 7fdb5effd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56420ff32cb0 0x56420ff4ba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:47704/0 (socket says 172.21.15.76:47704) 2024-06-02T04:50:16.383 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.380+0000 7fdb5effd700 1 -- 172.21.15.76:0/4043513631 learned_addr learned my addr 172.21.15.76:0/4043513631 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:50:16.383 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.380+0000 7fdb5f7fe700 1 --2- 172.21.15.76:0/4043513631 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56420ff32350 0x56420ff527f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:16.383 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.380+0000 7fdb5ffff700 1 --2- 172.21.15.76:0/4043513631 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56420ff404b0 0x56420ff43a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:16.383 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.380+0000 7fdb5effd700 1 -- 172.21.15.76:0/4043513631 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56420ff404b0 msgr2=0x56420ff43a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:50:16.383 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.380+0000 7fdb5effd700 1 --2- 172.21.15.76:0/4043513631 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56420ff404b0 0x56420ff43a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:16.383 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.380+0000 7fdb5effd700 1 -- 172.21.15.76:0/4043513631 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56420ff32350 msgr2=0x56420ff527f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:50:16.383 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.380+0000 7fdb5effd700 1 --2- 172.21.15.76:0/4043513631 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56420ff32350 0x56420ff527f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:16.383 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.380+0000 7fdb5effd700 1 -- 172.21.15.76:0/4043513631 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56420fe48560 con 0x56420ff32cb0 2024-06-02T04:50:16.384 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.380+0000 7fdb5effd700 1 --2- 172.21.15.76:0/4043513631 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56420ff32cb0 0x56420ff4ba90 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fdb5400b810 tx=0x7fdb5400bb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fad43c831c5418b server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:50:16.384 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.380+0000 7fdb467fc700 1 -- 172.21.15.76:0/4043513631 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb54017070 con 0x56420ff32cb0 2024-06-02T04:50:16.384 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.380+0000 7fdb467fc700 1 -- 172.21.15.76:0/4043513631 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdb54003bd0 con 0x56420ff32cb0 2024-06-02T04:50:16.384 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.380+0000 7fdb467fc700 1 -- 172.21.15.76:0/4043513631 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb54011b40 con 0x56420ff32cb0 2024-06-02T04:50:16.384 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.381+0000 7fdb72197b80 1 -- 172.21.15.76:0/4043513631 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56420ff32cb0 msgr2=0x56420ff4ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:16.384 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.381+0000 7fdb72197b80 1 --2- 172.21.15.76:0/4043513631 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56420ff32cb0 0x56420ff4ba90 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fdb5400b810 tx=0x7fdb5400bb20 comp rx=0 tx=0).stop 2024-06-02T04:50:16.384 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.381+0000 7fdb72197b80 1 -- 172.21.15.76:0/4043513631 shutdown_connections 2024-06-02T04:50:16.384 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.381+0000 7fdb72197b80 1 --2- 172.21.15.76:0/4043513631 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56420ff404b0 0x56420ff43a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:16.384 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.381+0000 7fdb72197b80 1 --2- 172.21.15.76:0/4043513631 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56420ff32350 0x56420ff527f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:16.384 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.381+0000 7fdb72197b80 1 --2- 172.21.15.76:0/4043513631 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56420ff32cb0 0x56420ff4ba90 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:16.384 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.381+0000 7fdb72197b80 1 -- 172.21.15.76:0/4043513631 >> 172.21.15.76:0/4043513631 conn(0x56420fe90210 msgr2=0x56420ff3fcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:50:16.384 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.381+0000 7fdb72197b80 1 -- 172.21.15.76:0/4043513631 shutdown_connections 2024-06-02T04:50:16.384 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.381+0000 7fdb72197b80 1 -- 172.21.15.76:0/4043513631 wait complete. 2024-06-02T04:50:16.385 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.382+0000 7fdb72197b80 1 -- start start 2024-06-02T04:50:16.385 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.382+0000 7fdb72197b80 1 Processor -- start 2024-06-02T04:50:16.388 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.382+0000 7fdb72197b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56420ff32350 0x56420ff497c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:16.388 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.382+0000 7fdb72197b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56420ff32cb0 0x56420ff49d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:16.388 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.382+0000 7fdb72197b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56420ff404b0 0x56420ff4ad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:16.388 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.382+0000 7fdb72197b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x56420ff4b250 con 0x56420ff404b0 2024-06-02T04:50:16.388 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.382+0000 7fdb72197b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x56420ff4b3c0 con 0x56420ff32cb0 2024-06-02T04:50:16.388 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.382+0000 7fdb72197b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x56420ff4b580 con 0x56420ff32350 2024-06-02T04:50:16.388 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.382+0000 7fdb72197b80 10 client.0 _ll_register_callbacks cb 0x56420fe27b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:50:16.388 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.382+0000 7fdb5effd700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56420ff32cb0 0x56420ff49d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:16.388 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.382+0000 7fdb5effd700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56420ff32cb0 0x56420ff49d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:53020/0 (socket says 172.21.15.76:53020) 2024-06-02T04:50:16.389 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.382+0000 7fdb5effd700 1 -- 172.21.15.76:0/4046932578 learned_addr learned my addr 172.21.15.76:0/4046932578 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:50:16.389 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.382+0000 7fdb5ffff700 1 --2- 172.21.15.76:0/4046932578 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56420ff404b0 0x56420ff4ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:16.389 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.382+0000 7fdb5f7fe700 1 --2- 172.21.15.76:0/4046932578 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56420ff32350 0x56420ff497c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:16.389 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.383+0000 7fdb5effd700 1 -- 172.21.15.76:0/4046932578 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56420ff32350 msgr2=0x56420ff497c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:50:16.389 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.383+0000 7fdb5effd700 1 --2- 172.21.15.76:0/4046932578 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56420ff32350 0x56420ff497c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:16.389 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.383+0000 7fdb5effd700 1 -- 172.21.15.76:0/4046932578 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56420ff404b0 msgr2=0x56420ff4ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:50:16.389 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.383+0000 7fdb5effd700 1 --2- 172.21.15.76:0/4046932578 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56420ff404b0 0x56420ff4ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:16.389 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.383+0000 7fdb5effd700 1 -- 172.21.15.76:0/4046932578 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb540043d0 con 0x56420ff32cb0 2024-06-02T04:50:16.389 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.383+0000 7fdb5ffff700 1 --2- 172.21.15.76:0/4046932578 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56420ff404b0 0x56420ff4ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T04:50:16.389 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.383+0000 7fdb5f7fe700 1 --2- 172.21.15.76:0/4046932578 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56420ff32350 0x56420ff497c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T04:50:16.389 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.383+0000 7fdb5effd700 1 --2- 172.21.15.76:0/4046932578 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56420ff32cb0 0x56420ff49d00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fdb5400b7e0 tx=0x7fdb54003f70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ad4a4429185b6dcb server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:50:16.389 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.383+0000 7fdb3effd700 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-06-02T04:50:16.389 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.383+0000 7fdb3effd700 1 -- 172.21.15.76:0/4046932578 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb54017070 con 0x56420ff32cb0 2024-06-02T04:50:16.390 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.383+0000 7fdb3effd700 1 -- 172.21.15.76:0/4046932578 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7fdb54003950 con 0x56420ff32cb0 2024-06-02T04:50:16.390 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.383+0000 7fdb72197b80 1 -- 172.21.15.76:0/4046932578 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdb5001e040 con 0x56420ff32cb0 2024-06-02T04:50:16.390 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.383+0000 7fdb3effd700 1 -- 172.21.15.76:0/4046932578 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdb54011880 con 0x56420ff32cb0 2024-06-02T04:50:16.390 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.383+0000 7fdb72197b80 10 client.25226 fetch_fsmap learned FSMap version 27 2024-06-02T04:50:16.390 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.383+0000 7fdb72197b80 1 -- 172.21.15.76:0/4046932578 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x56420fd07cd0 con 0x56420ff32cb0 2024-06-02T04:50:16.390 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.384+0000 7fdb3effd700 1 -- 172.21.15.76:0/4046932578 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdb5001e040 con 0x56420ff32cb0 2024-06-02T04:50:16.390 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.384+0000 7fdb3effd700 1 -- 172.21.15.76:0/4046932578 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 27) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fdb54004750 con 0x56420ff32cb0 2024-06-02T04:50:16.390 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.384+0000 7fdb72197b80 10 client.25226 fetch_fsmap finished waiting for FSMap version 27 2024-06-02T04:50:16.390 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.384+0000 7fdb72197b80 10 client.25226 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-06-02T04:50:16.390 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.384+0000 7fdb72197b80 20 client.25226 populate_metadata read hostname 'smithi076' 2024-06-02T04:50:16.390 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.384+0000 7fdb72197b80 1 --2- 172.21.15.76:0/4046932578 >> [v2:172.21.15.192:6838/3978681402,v1:172.21.15.192:6839/3978681402] conn(0x56420ffa7870 0x56420ffa9c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:16.390 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.384+0000 7fdb72197b80 4 client.25226 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-06-02T04:50:16.390 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.384+0000 7fdb72197b80 1 -- 172.21.15.76:0/4046932578 --> [v2:172.21.15.192:6838/3978681402,v1:172.21.15.192:6839/3978681402] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x56420fe7aec0 con 0x56420ffa7870 2024-06-02T04:50:16.391 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.384+0000 7fdb5f7fe700 1 --2- 172.21.15.76:0/4046932578 >> [v2:172.21.15.192:6838/3978681402,v1:172.21.15.192:6839/3978681402] conn(0x56420ffa7870 0x56420ffa9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:16.391 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.384+0000 7fdb3effd700 10 client.25226 ms_handle_connect on v2:172.21.15.192:6838/3978681402 2024-06-02T04:50:16.391 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.384+0000 7fdb5f7fe700 1 --2- 172.21.15.76:0/4046932578 >> [v2:172.21.15.192:6838/3978681402,v1:172.21.15.192:6839/3978681402] conn(0x56420ffa7870 0x56420ffa9c90 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=bf557f548ee21f06 server_cookie=34aa29074c2f6bfd in_seq=0 out_seq=0 2024-06-02T04:50:16.391 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.385+0000 7fdb3effd700 1 -- 172.21.15.76:0/4046932578 <== mds.1 v2:172.21.15.192:6838/3978681402 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x56420fe7aec0 con 0x56420ffa7870 2024-06-02T04:50:16.391 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.385+0000 7fdb3effd700 10 client.25226 handle_command_reply: tid=0 2024-06-02T04:50:16.391 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.385+0000 7fdb72197b80 1 client.25226 shutdown 2024-06-02T04:50:16.391 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.385+0000 7fdb72197b80 1 -- 172.21.15.76:0/4046932578 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56420ff32cb0 msgr2=0x56420ff49d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:16.391 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.385+0000 7fdb72197b80 1 --2- 172.21.15.76:0/4046932578 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56420ff32cb0 0x56420ff49d00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fdb5400b7e0 tx=0x7fdb54003f70 comp rx=0 tx=0).stop 2024-06-02T04:50:16.391 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.385+0000 7fdb72197b80 1 -- 172.21.15.76:0/4046932578 shutdown_connections 2024-06-02T04:50:16.391 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.385+0000 7fdb72197b80 1 --2- 172.21.15.76:0/4046932578 >> [v2:172.21.15.192:6838/3978681402,v1:172.21.15.192:6839/3978681402] conn(0x56420ffa7870 0x56420ffa9c90 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:16.391 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.385+0000 7fdb72197b80 1 --2- 172.21.15.76:0/4046932578 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56420ff404b0 0x56420ff4ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:16.391 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.385+0000 7fdb3effd700 0 client.25226 ms_handle_reset on v2:172.21.15.192:6838/3978681402 2024-06-02T04:50:16.391 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.385+0000 7fdb72197b80 1 --2- 172.21.15.76:0/4046932578 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56420ff32350 0x56420ff497c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:16.391 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.385+0000 7fdb72197b80 1 --2- 172.21.15.76:0/4046932578 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56420ff32cb0 0x56420ff49d00 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:16.392 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.385+0000 7fdb72197b80 1 -- 172.21.15.76:0/4046932578 >> 172.21.15.76:0/4046932578 conn(0x56420fe90210 msgr2=0x56420ff444f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:50:16.392 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.385+0000 7fdb72197b80 1 -- 172.21.15.76:0/4046932578 shutdown_connections 2024-06-02T04:50:16.392 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.385+0000 7fdb72197b80 1 -- 172.21.15.76:0/4046932578 wait complete. 2024-06-02T04:50:16.392 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.385+0000 7fdb72197b80 20 client.25226 trim_cache size 0 max 16384 2024-06-02T04:50:16.392 INFO:teuthology.orchestra.run.smithi076.stdout:[] 2024-06-02T04:50:16.393 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.385+0000 7fdb65fdc700 1 -- 172.21.15.76:0/297988446 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fdb480a1120 msgr2=0x7fdb480a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:16.393 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.385+0000 7fdb65fdc700 1 --2- 172.21.15.76:0/297988446 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fdb480a1120 0x7fdb480a35e0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fdb5000b5c0 tx=0x7fdb50005fb0 comp rx=0 tx=0).stop 2024-06-02T04:50:16.393 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.385+0000 7fdb65fdc700 1 -- 172.21.15.76:0/297988446 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdb60101970 msgr2=0x7fdb6019e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:16.393 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.385+0000 7fdb65fdc700 1 --2- 172.21.15.76:0/297988446 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdb60101970 0x7fdb6019e3b0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fdb58007ee0 tx=0x7fdb5800d3b0 comp rx=0 tx=0).stop 2024-06-02T04:50:16.393 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.386+0000 7fdb65fdc700 1 -- 172.21.15.76:0/297988446 shutdown_connections 2024-06-02T04:50:16.393 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.386+0000 7fdb65fdc700 1 --2- 172.21.15.76:0/297988446 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdb60101970 0x7fdb6019e3b0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:16.393 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.386+0000 7fdb65fdc700 1 --2- 172.21.15.76:0/297988446 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdb600ffe60 0x7fdb60196e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:16.393 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.386+0000 7fdb65fdc700 1 --2- 172.21.15.76:0/297988446 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fdb480a1120 0x7fdb480a35e0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:16.394 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.386+0000 7fdb65fdc700 1 --2- 172.21.15.76:0/297988446 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb60100fb0 0x7fdb60197390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:16.394 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.386+0000 7fdb65fdc700 1 -- 172.21.15.76:0/297988446 >> 172.21.15.76:0/297988446 conn(0x7fdb600fb3f0 msgr2=0x7fdb60068060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:50:16.394 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.386+0000 7fdb65fdc700 1 -- 172.21.15.76:0/297988446 shutdown_connections 2024-06-02T04:50:16.394 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.386+0000 7fdb65fdc700 1 -- 172.21.15.76:0/297988446 wait complete. 2024-06-02T04:50:16.399 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-06-02T04:50:16.483 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:16 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/378325683' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:50:16.541 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.541+0000 7f41c183c700 1 -- 172.21.15.76:0/2702927976 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f41bc100fc0 msgr2=0x7f41bc101440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:16.542 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.541+0000 7f41c183c700 1 --2- 172.21.15.76:0/2702927976 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f41bc100fc0 0x7f41bc101440 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f41b000faf0 tx=0x7f41b000fe00 comp rx=0 tx=0).stop 2024-06-02T04:50:16.542 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.541+0000 7f41c183c700 1 -- 172.21.15.76:0/2702927976 shutdown_connections 2024-06-02T04:50:16.542 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.541+0000 7f41c183c700 1 --2- 172.21.15.76:0/2702927976 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f41bc101980 0x7f41bc1082a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:16.542 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.541+0000 7f41c183c700 1 --2- 172.21.15.76:0/2702927976 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41bc0ffe70 0x7f41bc100290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:16.542 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.541+0000 7f41c183c700 1 --2- 172.21.15.76:0/2702927976 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f41bc100fc0 0x7f41bc101440 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:16.542 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.541+0000 7f41c183c700 1 -- 172.21.15.76:0/2702927976 >> 172.21.15.76:0/2702927976 conn(0x7f41bc0fb400 msgr2=0x7f41bc0fd820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:50:16.542 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.541+0000 7f41c183c700 1 -- 172.21.15.76:0/2702927976 shutdown_connections 2024-06-02T04:50:16.542 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.541+0000 7f41c183c700 1 -- 172.21.15.76:0/2702927976 wait complete. 2024-06-02T04:50:16.542 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.542+0000 7f41c183c700 1 Processor -- start 2024-06-02T04:50:16.544 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.542+0000 7f41c183c700 1 -- start start 2024-06-02T04:50:16.544 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.542+0000 7f41c183c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f41bc0ffe70 0x7f41bc194bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:16.544 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.542+0000 7f41c183c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41bc100fc0 0x7f41bc195100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:16.544 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.542+0000 7f41c183c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f41bc101980 0x7f41bc19c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:16.544 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.542+0000 7f41c183c700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41bc19c6f0 con 0x7f41bc0ffe70 2024-06-02T04:50:16.545 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.542+0000 7f41c183c700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41bc19c830 con 0x7f41bc100fc0 2024-06-02T04:50:16.545 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.542+0000 7f41c183c700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41bc19c9c0 con 0x7f41bc101980 2024-06-02T04:50:16.545 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.542+0000 7f41baffd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f41bc0ffe70 0x7f41bc194bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:16.545 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.542+0000 7f41baffd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f41bc0ffe70 0x7f41bc194bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:47734/0 (socket says 172.21.15.76:47734) 2024-06-02T04:50:16.545 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.542+0000 7f41baffd700 1 -- 172.21.15.76:0/794383531 learned_addr learned my addr 172.21.15.76:0/794383531 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:50:16.545 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.542+0000 7f41bb7fe700 1 --2- 172.21.15.76:0/794383531 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f41bc101980 0x7f41bc19c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:16.545 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.542+0000 7f41ba7fc700 1 --2- 172.21.15.76:0/794383531 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41bc100fc0 0x7f41bc195100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:16.545 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.542+0000 7f41baffd700 1 -- 172.21.15.76:0/794383531 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f41bc101980 msgr2=0x7f41bc19c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:16.545 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.542+0000 7f41baffd700 1 --2- 172.21.15.76:0/794383531 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f41bc101980 0x7f41bc19c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:16.545 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.542+0000 7f41baffd700 1 -- 172.21.15.76:0/794383531 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41bc100fc0 msgr2=0x7f41bc195100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:16.545 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.542+0000 7f41baffd700 1 --2- 172.21.15.76:0/794383531 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41bc100fc0 0x7f41bc195100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:16.545 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.542+0000 7f41baffd700 1 -- 172.21.15.76:0/794383531 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41ac009520 con 0x7f41bc0ffe70 2024-06-02T04:50:16.546 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.542+0000 7f41bb7fe700 1 --2- 172.21.15.76:0/794383531 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f41bc101980 0x7f41bc19c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T04:50:16.546 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.543+0000 7f41baffd700 1 --2- 172.21.15.76:0/794383531 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f41bc0ffe70 0x7f41bc194bc0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f41ac00eb30 tx=0x7f41ac00ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:50:16.546 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.543+0000 7f41c083a700 1 -- 172.21.15.76:0/794383531 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41ac009880 con 0x7f41bc0ffe70 2024-06-02T04:50:16.546 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.543+0000 7f41c183c700 1 -- 172.21.15.76:0/794383531 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41b000f750 con 0x7f41bc0ffe70 2024-06-02T04:50:16.546 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.543+0000 7f41c083a700 1 -- 172.21.15.76:0/794383531 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f41ac0044b0 con 0x7f41bc0ffe70 2024-06-02T04:50:16.546 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.543+0000 7f41c083a700 1 -- 172.21.15.76:0/794383531 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41ac003ce0 con 0x7f41bc0ffe70 2024-06-02T04:50:16.546 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.543+0000 7f41c183c700 1 -- 172.21.15.76:0/794383531 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41bc19d020 con 0x7f41bc0ffe70 2024-06-02T04:50:16.549 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.545+0000 7f41c083a700 1 -- 172.21.15.76:0/794383531 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f41ac003e40 con 0x7f41bc0ffe70 2024-06-02T04:50:16.549 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.546+0000 7f41c083a700 1 --2- 172.21.15.76:0/794383531 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f41a40a1120 0x7f41a40a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:16.549 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.546+0000 7f41c083a700 1 -- 172.21.15.76:0/794383531 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f41ac014070 con 0x7f41bc0ffe70 2024-06-02T04:50:16.549 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.546+0000 7f41ba7fc700 1 --2- 172.21.15.76:0/794383531 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f41a40a1120 0x7f41a40a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:16.549 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.546+0000 7f41ba7fc700 1 --2- 172.21.15.76:0/794383531 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f41a40a1120 0x7f41a40a35e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f41b0009870 tx=0x7f41b000ff90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:50:16.549 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.546+0000 7f41cd9f7b80 1 Processor -- start 2024-06-02T04:50:16.549 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.547+0000 7f41cd9f7b80 1 -- start start 2024-06-02T04:50:16.549 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.547+0000 7f41cd9f7b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e837b37540 0x55e837b37960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:16.550 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.547+0000 7f41cd9f7b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e837b37ea0 0x55e837b38320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:16.550 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.547+0000 7f41cd9f7b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e837b38860 0x55e837b38ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:16.550 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.547+0000 7f41cd9f7b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e837a8e150 con 0x55e837b37540 2024-06-02T04:50:16.550 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.547+0000 7f41cd9f7b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e837a8bb10 con 0x55e837b38860 2024-06-02T04:50:16.550 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.547+0000 7f41cd9f7b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e837a87400 con 0x55e837b37ea0 2024-06-02T04:50:16.550 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.547+0000 7f41baffd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e837b37540 0x55e837b37960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:16.550 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.547+0000 7f41baffd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e837b37540 0x55e837b37960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:47736/0 (socket says 172.21.15.76:47736) 2024-06-02T04:50:16.550 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.547+0000 7f41baffd700 1 -- 172.21.15.76:0/1437488541 learned_addr learned my addr 172.21.15.76:0/1437488541 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:50:16.550 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.547+0000 7f41ba7fc700 1 --2- 172.21.15.76:0/1437488541 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e837b37ea0 0x55e837b38320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:16.550 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.547+0000 7f41bb7fe700 1 --2- 172.21.15.76:0/1437488541 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e837b38860 0x55e837b38ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:16.550 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.547+0000 7f41baffd700 1 -- 172.21.15.76:0/1437488541 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e837b37ea0 msgr2=0x55e837b38320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:50:16.550 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.547+0000 7f41baffd700 1 --2- 172.21.15.76:0/1437488541 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e837b37ea0 0x55e837b38320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:16.550 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.547+0000 7f41baffd700 1 -- 172.21.15.76:0/1437488541 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e837b38860 msgr2=0x55e837b38ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:50:16.551 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.547+0000 7f41baffd700 1 --2- 172.21.15.76:0/1437488541 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e837b38860 0x55e837b38ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:16.551 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.547+0000 7f41baffd700 1 -- 172.21.15.76:0/1437488541 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e8379083b0 con 0x55e837b37540 2024-06-02T04:50:16.551 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.547+0000 7f41ba7fc700 1 --2- 172.21.15.76:0/1437488541 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e837b37ea0 0x55e837b38320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T04:50:16.551 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.547+0000 7f41baffd700 1 --2- 172.21.15.76:0/1437488541 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e837b37540 0x55e837b37960 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f41ac0a2130 tx=0x7f41ac014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4812f9868b2d44e8 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:50:16.551 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.548+0000 7f41a1ffb700 1 -- 172.21.15.76:0/1437488541 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41ac09a8e0 con 0x55e837b37540 2024-06-02T04:50:16.551 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.548+0000 7f41a1ffb700 1 -- 172.21.15.76:0/1437488541 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f41ac00cbd0 con 0x55e837b37540 2024-06-02T04:50:16.551 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.548+0000 7f41a1ffb700 1 -- 172.21.15.76:0/1437488541 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41ac01fde0 con 0x55e837b37540 2024-06-02T04:50:16.551 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.548+0000 7f41cd9f7b80 1 -- 172.21.15.76:0/1437488541 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e837b37540 msgr2=0x55e837b37960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:16.551 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.548+0000 7f41cd9f7b80 1 --2- 172.21.15.76:0/1437488541 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e837b37540 0x55e837b37960 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f41ac0a2130 tx=0x7f41ac014000 comp rx=0 tx=0).stop 2024-06-02T04:50:16.551 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.548+0000 7f41cd9f7b80 1 -- 172.21.15.76:0/1437488541 shutdown_connections 2024-06-02T04:50:16.551 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.548+0000 7f41cd9f7b80 1 --2- 172.21.15.76:0/1437488541 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e837b38860 0x55e837b38ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:16.551 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.548+0000 7f41cd9f7b80 1 --2- 172.21.15.76:0/1437488541 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e837b37540 0x55e837b37960 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:16.551 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.548+0000 7f41cd9f7b80 1 --2- 172.21.15.76:0/1437488541 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e837b37ea0 0x55e837b38320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:16.552 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.548+0000 7f41cd9f7b80 1 -- 172.21.15.76:0/1437488541 >> 172.21.15.76:0/1437488541 conn(0x55e837a95210 msgr2=0x55e837b31de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:50:16.552 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.548+0000 7f41cd9f7b80 1 -- 172.21.15.76:0/1437488541 shutdown_connections 2024-06-02T04:50:16.552 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.548+0000 7f41cd9f7b80 1 -- 172.21.15.76:0/1437488541 wait complete. 2024-06-02T04:50:16.552 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.549+0000 7f41cd9f7b80 1 -- start start 2024-06-02T04:50:16.552 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.549+0000 7f41cd9f7b80 1 Processor -- start 2024-06-02T04:50:16.555 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.549+0000 7f41cd9f7b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e837b37540 0x55e837b40e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:16.555 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.549+0000 7f41cd9f7b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e837b37ea0 0x55e837b41350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:16.555 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.549+0000 7f41cd9f7b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e837b38860 0x55e837b48390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:16.555 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.549+0000 7f41cd9f7b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e837a23560 con 0x55e837b37ea0 2024-06-02T04:50:16.555 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.549+0000 7f41cd9f7b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e837a23200 con 0x55e837b37540 2024-06-02T04:50:16.555 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.549+0000 7f41cd9f7b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e83790a6a0 con 0x55e837b38860 2024-06-02T04:50:16.555 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.549+0000 7f41cd9f7b80 10 client.0 _ll_register_callbacks cb 0x55e837a2cb30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:50:16.556 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.549+0000 7f41ba7fc700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e837b37ea0 0x55e837b41350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:16.556 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.549+0000 7f41ba7fc700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e837b37ea0 0x55e837b41350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:47738/0 (socket says 172.21.15.76:47738) 2024-06-02T04:50:16.556 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.549+0000 7f41ba7fc700 1 -- 172.21.15.76:0/1278823766 learned_addr learned my addr 172.21.15.76:0/1278823766 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:50:16.556 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.549+0000 7f41baffd700 1 --2- 172.21.15.76:0/1278823766 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e837b37540 0x55e837b40e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:16.556 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.550+0000 7f41bb7fe700 1 --2- 172.21.15.76:0/1278823766 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e837b38860 0x55e837b48390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:16.556 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.550+0000 7f41ba7fc700 1 -- 172.21.15.76:0/1278823766 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e837b38860 msgr2=0x55e837b48390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:50:16.556 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.550+0000 7f41ba7fc700 1 --2- 172.21.15.76:0/1278823766 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e837b38860 0x55e837b48390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:16.556 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.550+0000 7f41ba7fc700 1 -- 172.21.15.76:0/1278823766 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e837b37540 msgr2=0x55e837b40e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:50:16.556 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.550+0000 7f41ba7fc700 1 --2- 172.21.15.76:0/1278823766 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e837b37540 0x55e837b40e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:16.556 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.550+0000 7f41ba7fc700 1 -- 172.21.15.76:0/1278823766 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41bc108bd0 con 0x55e837b37ea0 2024-06-02T04:50:16.556 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.550+0000 7f41ba7fc700 1 --2- 172.21.15.76:0/1278823766 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e837b37ea0 0x55e837b41350 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f41b0018000 tx=0x7f41b0009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96043cbf885483d server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:50:16.556 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.550+0000 7f419affd700 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-06-02T04:50:16.556 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.550+0000 7f419affd700 1 -- 172.21.15.76:0/1278823766 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41b0003fb0 con 0x55e837b37ea0 2024-06-02T04:50:16.556 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.550+0000 7f419affd700 1 -- 172.21.15.76:0/1278823766 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f41b0004110 con 0x55e837b37ea0 2024-06-02T04:50:16.557 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.550+0000 7f41cd9f7b80 1 -- 172.21.15.76:0/1278823766 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e8379e0270 con 0x55e837b37ea0 2024-06-02T04:50:16.557 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.550+0000 7f419affd700 1 -- 172.21.15.76:0/1278823766 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f41b00042d0 con 0x55e837b37ea0 2024-06-02T04:50:16.557 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.550+0000 7f41cd9f7b80 10 client.15705 fetch_fsmap learned FSMap version 27 2024-06-02T04:50:16.557 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.550+0000 7f41cd9f7b80 1 -- 172.21.15.76:0/1278823766 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7f41bc19d020 con 0x55e837b37ea0 2024-06-02T04:50:16.557 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.550+0000 7f419affd700 1 -- 172.21.15.76:0/1278823766 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55e8379e0270 con 0x55e837b37ea0 2024-06-02T04:50:16.557 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.551+0000 7f419affd700 1 -- 172.21.15.76:0/1278823766 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 27) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f41b002a070 con 0x55e837b37ea0 2024-06-02T04:50:16.557 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.551+0000 7f41cd9f7b80 10 client.15705 fetch_fsmap finished waiting for FSMap version 27 2024-06-02T04:50:16.557 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.551+0000 7f41cd9f7b80 10 client.15705 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-06-02T04:50:16.557 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.551+0000 7f41cd9f7b80 20 client.15705 populate_metadata read hostname 'smithi076' 2024-06-02T04:50:16.557 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.551+0000 7f41cd9f7b80 1 --2- 172.21.15.76:0/1278823766 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55e837b4ccc0 0x55e837b4f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:16.557 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.551+0000 7f41cd9f7b80 4 client.15705 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T04:50:16.557 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.551+0000 7f41cd9f7b80 1 -- 172.21.15.76:0/1278823766 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e837b06810 con 0x55e837b4ccc0 2024-06-02T04:50:16.557 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.551+0000 7f41baffd700 1 --2- 172.21.15.76:0/1278823766 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55e837b4ccc0 0x55e837b4f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:16.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.551+0000 7f419affd700 10 client.15705 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:50:16.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.551+0000 7f41baffd700 1 --2- 172.21.15.76:0/1278823766 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55e837b4ccc0 0x55e837b4f0e0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e4c324c1fc4c4e1 server_cookie=180408cf81ad14c4 in_seq=0 out_seq=0 2024-06-02T04:50:16.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.552+0000 7f419affd700 1 -- 172.21.15.76:0/1278823766 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55e837b06810 con 0x55e837b4ccc0 2024-06-02T04:50:16.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.552+0000 7f419affd700 10 client.15705 handle_command_reply: tid=0 2024-06-02T04:50:16.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.552+0000 7f41cd9f7b80 1 client.15705 shutdown 2024-06-02T04:50:16.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.552+0000 7f41cd9f7b80 1 -- 172.21.15.76:0/1278823766 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e837b37ea0 msgr2=0x55e837b41350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:16.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.552+0000 7f41cd9f7b80 1 --2- 172.21.15.76:0/1278823766 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e837b37ea0 0x55e837b41350 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f41b0018000 tx=0x7f41b0009310 comp rx=0 tx=0).stop 2024-06-02T04:50:16.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.552+0000 7f41cd9f7b80 1 -- 172.21.15.76:0/1278823766 shutdown_connections 2024-06-02T04:50:16.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.552+0000 7f41cd9f7b80 1 --2- 172.21.15.76:0/1278823766 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55e837b4ccc0 0x55e837b4f0e0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:16.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.552+0000 7f41cd9f7b80 1 --2- 172.21.15.76:0/1278823766 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e837b38860 0x55e837b48390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:16.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.552+0000 7f41cd9f7b80 1 --2- 172.21.15.76:0/1278823766 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e837b37540 0x55e837b40e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:16.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.552+0000 7f419affd700 0 client.15705 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:50:16.559 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.552+0000 7f41cd9f7b80 1 --2- 172.21.15.76:0/1278823766 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e837b37ea0 0x55e837b41350 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:16.559 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.552+0000 7f41cd9f7b80 1 -- 172.21.15.76:0/1278823766 >> 172.21.15.76:0/1278823766 conn(0x55e837a95210 msgr2=0x55e837b315a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:50:16.559 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.552+0000 7f41cd9f7b80 1 -- 172.21.15.76:0/1278823766 shutdown_connections 2024-06-02T04:50:16.559 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.552+0000 7f41cd9f7b80 1 -- 172.21.15.76:0/1278823766 wait complete. 2024-06-02T04:50:16.559 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.552+0000 7f41cd9f7b80 20 client.15705 trim_cache size 0 max 16384 2024-06-02T04:50:16.568 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.566+0000 7f41cd9f7b80 1 Processor -- start 2024-06-02T04:50:16.568 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.567+0000 7f41cd9f7b80 1 -- start start 2024-06-02T04:50:16.568 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.567+0000 7f41cd9f7b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e837b37540 0x55e837b48a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:16.568 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.567+0000 7f41cd9f7b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e837b37ea0 0x55e837b48350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:16.568 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.567+0000 7f41cd9f7b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e837b38860 0x55e837b40320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:16.568 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.567+0000 7f41cd9f7b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e837b2edc0 con 0x55e837b37ea0 2024-06-02T04:50:16.569 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.567+0000 7f41cd9f7b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e837b33570 con 0x55e837b37540 2024-06-02T04:50:16.569 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.567+0000 7f41cd9f7b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e837b542d0 con 0x55e837b38860 2024-06-02T04:50:16.569 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.567+0000 7f41ba7fc700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e837b37ea0 0x55e837b48350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:16.569 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.567+0000 7f41ba7fc700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e837b37ea0 0x55e837b48350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:47748/0 (socket says 172.21.15.76:47748) 2024-06-02T04:50:16.569 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.567+0000 7f41ba7fc700 1 -- 172.21.15.76:0/2636863255 learned_addr learned my addr 172.21.15.76:0/2636863255 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:50:16.569 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.567+0000 7f41baffd700 1 --2- 172.21.15.76:0/2636863255 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e837b37540 0x55e837b48a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:16.569 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.567+0000 7f41bb7fe700 1 --2- 172.21.15.76:0/2636863255 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e837b38860 0x55e837b40320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:16.569 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.567+0000 7f41ba7fc700 1 -- 172.21.15.76:0/2636863255 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e837b38860 msgr2=0x55e837b40320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:50:16.569 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.567+0000 7f41ba7fc700 1 --2- 172.21.15.76:0/2636863255 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e837b38860 0x55e837b40320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:16.569 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.567+0000 7f41ba7fc700 1 -- 172.21.15.76:0/2636863255 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e837b37540 msgr2=0x55e837b48a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:50:16.569 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.567+0000 7f41ba7fc700 1 --2- 172.21.15.76:0/2636863255 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e837b37540 0x55e837b48a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:16.569 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.567+0000 7f41ba7fc700 1 -- 172.21.15.76:0/2636863255 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e8378b4b60 con 0x55e837b37ea0 2024-06-02T04:50:16.569 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.567+0000 7f41baffd700 1 --2- 172.21.15.76:0/2636863255 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e837b37540 0x55e837b48a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T04:50:16.570 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.567+0000 7f41ba7fc700 1 --2- 172.21.15.76:0/2636863255 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e837b37ea0 0x55e837b48350 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f41b0037670 tx=0x7f41b0005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83c9ac1e4b616d65 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:50:16.570 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.568+0000 7f41a27fc700 1 -- 172.21.15.76:0/2636863255 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41b0005a00 con 0x55e837b37ea0 2024-06-02T04:50:16.570 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.568+0000 7f41a27fc700 1 -- 172.21.15.76:0/2636863255 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f41b00054d0 con 0x55e837b37ea0 2024-06-02T04:50:16.570 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.568+0000 7f41a27fc700 1 -- 172.21.15.76:0/2636863255 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41b00040a0 con 0x55e837b37ea0 2024-06-02T04:50:16.574 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.568+0000 7f41cd9f7b80 1 -- 172.21.15.76:0/2636863255 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e837b37ea0 msgr2=0x55e837b48350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:16.574 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.568+0000 7f41cd9f7b80 1 --2- 172.21.15.76:0/2636863255 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e837b37ea0 0x55e837b48350 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f41b0037670 tx=0x7f41b0005e80 comp rx=0 tx=0).stop 2024-06-02T04:50:16.574 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.568+0000 7f41cd9f7b80 1 -- 172.21.15.76:0/2636863255 shutdown_connections 2024-06-02T04:50:16.574 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.568+0000 7f41cd9f7b80 1 --2- 172.21.15.76:0/2636863255 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e837b38860 0x55e837b40320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:16.574 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.568+0000 7f41cd9f7b80 1 --2- 172.21.15.76:0/2636863255 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e837b37540 0x55e837b48a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:16.574 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.568+0000 7f41cd9f7b80 1 --2- 172.21.15.76:0/2636863255 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e837b37ea0 0x55e837b48350 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:16.574 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.568+0000 7f41cd9f7b80 1 -- 172.21.15.76:0/2636863255 >> 172.21.15.76:0/2636863255 conn(0x55e837a95210 msgr2=0x55e837b38c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:50:16.574 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.568+0000 7f41cd9f7b80 1 -- 172.21.15.76:0/2636863255 shutdown_connections 2024-06-02T04:50:16.574 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.568+0000 7f41cd9f7b80 1 -- 172.21.15.76:0/2636863255 wait complete. 2024-06-02T04:50:16.575 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.569+0000 7f41cd9f7b80 1 -- start start 2024-06-02T04:50:16.575 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.569+0000 7f41cd9f7b80 1 Processor -- start 2024-06-02T04:50:16.575 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.569+0000 7f41cd9f7b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e837b37540 0x55e837b44070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:16.575 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.569+0000 7f41cd9f7b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e837b37ea0 0x55e837b445b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:16.575 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.569+0000 7f41cd9f7b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e837b38860 0x55e837b475d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:16.575 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.569+0000 7f41cd9f7b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e837b47b10 con 0x55e837b37540 2024-06-02T04:50:16.575 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.569+0000 7f41cd9f7b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e837b47c80 con 0x55e837b38860 2024-06-02T04:50:16.575 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.569+0000 7f41cd9f7b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e837b47e40 con 0x55e837b37ea0 2024-06-02T04:50:16.575 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.569+0000 7f41cd9f7b80 10 client.0 _ll_register_callbacks cb 0x55e837a2cb30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:50:16.575 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.569+0000 7f41baffd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e837b37540 0x55e837b44070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:16.575 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.569+0000 7f41baffd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e837b37540 0x55e837b44070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:47752/0 (socket says 172.21.15.76:47752) 2024-06-02T04:50:16.575 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.569+0000 7f41baffd700 1 -- 172.21.15.76:0/3913715597 learned_addr learned my addr 172.21.15.76:0/3913715597 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:50:16.575 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.569+0000 7f41ba7fc700 1 --2- 172.21.15.76:0/3913715597 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e837b37ea0 0x55e837b445b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:16.576 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.570+0000 7f41bb7fe700 1 --2- 172.21.15.76:0/3913715597 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e837b38860 0x55e837b475d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:16.576 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.570+0000 7f41ba7fc700 1 -- 172.21.15.76:0/3913715597 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e837b38860 msgr2=0x55e837b475d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:50:16.576 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.570+0000 7f41ba7fc700 1 --2- 172.21.15.76:0/3913715597 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e837b38860 0x55e837b475d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:16.576 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.570+0000 7f41ba7fc700 1 -- 172.21.15.76:0/3913715597 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e837b37540 msgr2=0x55e837b44070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:50:16.576 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.570+0000 7f41ba7fc700 1 --2- 172.21.15.76:0/3913715597 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e837b37540 0x55e837b44070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:16.576 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.570+0000 7f41ba7fc700 1 -- 172.21.15.76:0/3913715597 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e8379083b0 con 0x55e837b37ea0 2024-06-02T04:50:16.576 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.570+0000 7f41baffd700 1 --2- 172.21.15.76:0/3913715597 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e837b37540 0x55e837b44070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T04:50:16.576 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.570+0000 7f41ba7fc700 1 --2- 172.21.15.76:0/3913715597 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e837b37ea0 0x55e837b445b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f41b00058b0 tx=0x7f41b0009360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d7da8ecd3c47b69 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:50:16.576 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.570+0000 7f419affd700 10 client.0 ms_handle_connect on v2:172.21.15.192:3300/0 2024-06-02T04:50:16.576 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.570+0000 7f419affd700 1 -- 172.21.15.76:0/3913715597 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41b0037bd0 con 0x55e837b37ea0 2024-06-02T04:50:16.576 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.570+0000 7f41cd9f7b80 1 -- 172.21.15.76:0/3913715597 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f41ac00cbd0 con 0x55e837b37ea0 2024-06-02T04:50:16.576 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.570+0000 7f419affd700 1 -- 172.21.15.76:0/3913715597 <== mon.1 v2:172.21.15.192:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f41b0003e20 con 0x55e837b37ea0 2024-06-02T04:50:16.576 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.570+0000 7f419affd700 1 -- 172.21.15.76:0/3913715597 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f41b0003fe0 con 0x55e837b37ea0 2024-06-02T04:50:16.577 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.570+0000 7f41cd9f7b80 10 client.25186 fetch_fsmap learned FSMap version 27 2024-06-02T04:50:16.577 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.570+0000 7f41cd9f7b80 1 -- 172.21.15.76:0/3913715597 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7f41bc19d020 con 0x55e837b37ea0 2024-06-02T04:50:16.577 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.571+0000 7f419affd700 1 -- 172.21.15.76:0/3913715597 <== mon.1 v2:172.21.15.192:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f41b0058080 con 0x55e837b37ea0 2024-06-02T04:50:16.577 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.571+0000 7f419affd700 1 -- 172.21.15.76:0/3913715597 <== mon.1 v2:172.21.15.192:3300/0 5 ==== fsmap(e 27) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f41b002a070 con 0x55e837b37ea0 2024-06-02T04:50:16.577 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.571+0000 7f41cd9f7b80 10 client.25186 fetch_fsmap finished waiting for FSMap version 27 2024-06-02T04:50:16.577 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.571+0000 7f41cd9f7b80 10 client.25186 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-06-02T04:50:16.577 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.571+0000 7f41cd9f7b80 20 client.25186 populate_metadata read hostname 'smithi076' 2024-06-02T04:50:16.577 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.571+0000 7f41cd9f7b80 1 --2- 172.21.15.76:0/3913715597 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55e837ba3bc0 0x55e837ba5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:16.577 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.571+0000 7f41cd9f7b80 4 client.25186 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-06-02T04:50:16.577 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.571+0000 7f41cd9f7b80 1 -- 172.21.15.76:0/3913715597 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55e837a7fec0 con 0x55e837ba3bc0 2024-06-02T04:50:16.577 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.571+0000 7f41baffd700 1 --2- 172.21.15.76:0/3913715597 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55e837ba3bc0 0x55e837ba5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:16.577 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.571+0000 7f419affd700 10 client.25186 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:50:16.577 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.571+0000 7f41baffd700 1 --2- 172.21.15.76:0/3913715597 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55e837ba3bc0 0x55e837ba5fe0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=19d72c0193b7d917 server_cookie=f02cb5174d9b27ca in_seq=0 out_seq=0 2024-06-02T04:50:16.578 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.572+0000 7f419affd700 1 -- 172.21.15.76:0/3913715597 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55e837a7fec0 con 0x55e837ba3bc0 2024-06-02T04:50:16.578 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.572+0000 7f419affd700 10 client.25186 handle_command_reply: tid=0 2024-06-02T04:50:16.578 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.572+0000 7f41cd9f7b80 1 client.25186 shutdown 2024-06-02T04:50:16.578 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.572+0000 7f41cd9f7b80 1 -- 172.21.15.76:0/3913715597 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e837b37ea0 msgr2=0x55e837b445b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:16.578 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.572+0000 7f41cd9f7b80 1 --2- 172.21.15.76:0/3913715597 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e837b37ea0 0x55e837b445b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f41b00058b0 tx=0x7f41b0009360 comp rx=0 tx=0).stop 2024-06-02T04:50:16.578 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.572+0000 7f41cd9f7b80 1 -- 172.21.15.76:0/3913715597 shutdown_connections 2024-06-02T04:50:16.578 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.572+0000 7f41cd9f7b80 1 --2- 172.21.15.76:0/3913715597 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55e837ba3bc0 0x55e837ba5fe0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:16.578 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.572+0000 7f41cd9f7b80 1 --2- 172.21.15.76:0/3913715597 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e837b38860 0x55e837b475d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:16.578 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.572+0000 7f419affd700 0 client.25186 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:50:16.578 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.572+0000 7f41cd9f7b80 1 --2- 172.21.15.76:0/3913715597 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e837b37540 0x55e837b44070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:16.578 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.572+0000 7f41cd9f7b80 1 --2- 172.21.15.76:0/3913715597 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e837b37ea0 0x55e837b445b0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:16.578 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.572+0000 7f41cd9f7b80 1 -- 172.21.15.76:0/3913715597 >> 172.21.15.76:0/3913715597 conn(0x55e837a95210 msgr2=0x55e837b3b790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:50:16.578 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.572+0000 7f41cd9f7b80 1 -- 172.21.15.76:0/3913715597 shutdown_connections 2024-06-02T04:50:16.578 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.572+0000 7f41cd9f7b80 1 -- 172.21.15.76:0/3913715597 wait complete. 2024-06-02T04:50:16.579 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.572+0000 7f41cd9f7b80 20 client.25186 trim_cache size 0 max 16384 2024-06-02T04:50:16.579 INFO:teuthology.orchestra.run.smithi076.stdout:[] 2024-06-02T04:50:16.580 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.573+0000 7f41c183c700 1 -- 172.21.15.76:0/794383531 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f41a40a1120 msgr2=0x7f41a40a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:16.580 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.573+0000 7f41c183c700 1 --2- 172.21.15.76:0/794383531 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f41a40a1120 0x7f41a40a35e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f41b0009870 tx=0x7f41b000ff90 comp rx=0 tx=0).stop 2024-06-02T04:50:16.580 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.573+0000 7f41c183c700 1 -- 172.21.15.76:0/794383531 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f41bc0ffe70 msgr2=0x7f41bc194bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:16.580 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.573+0000 7f41c183c700 1 --2- 172.21.15.76:0/794383531 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f41bc0ffe70 0x7f41bc194bc0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f41ac00eb30 tx=0x7f41ac00ee40 comp rx=0 tx=0).stop 2024-06-02T04:50:16.580 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.573+0000 7f41c183c700 1 -- 172.21.15.76:0/794383531 shutdown_connections 2024-06-02T04:50:16.580 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.573+0000 7f41c183c700 1 --2- 172.21.15.76:0/794383531 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f41bc101980 0x7f41bc19c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:16.580 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.573+0000 7f41c183c700 1 --2- 172.21.15.76:0/794383531 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f41bc0ffe70 0x7f41bc194bc0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:16.580 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.573+0000 7f41c183c700 1 --2- 172.21.15.76:0/794383531 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f41a40a1120 0x7f41a40a35e0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:16.580 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.573+0000 7f41c183c700 1 --2- 172.21.15.76:0/794383531 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41bc100fc0 0x7f41bc195100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:16.580 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.573+0000 7f41c183c700 1 -- 172.21.15.76:0/794383531 >> 172.21.15.76:0/794383531 conn(0x7f41bc0fb400 msgr2=0x7f41bc104470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:50:16.580 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.573+0000 7f41c183c700 1 -- 172.21.15.76:0/794383531 shutdown_connections 2024-06-02T04:50:16.580 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:16.573+0000 7f41c183c700 1 -- 172.21.15.76:0/794383531 wait complete. 2024-06-02T04:50:16.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:16 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/378325683' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:50:16.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:16 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/378325683' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:50:17.162 INFO:teuthology.orchestra.run.smithi076.stderr:1300000 of 3200000 tuples (40%) done (elapsed 13.47 s, remaining 19.69 s) 2024-06-02T04:50:17.586 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-06-02T04:50:17.586 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-06-02T04:50:17.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:17 smithi119 ceph-mon[46633]: pgmap v289: 129 pgs: 129 active+clean; 252 MiB data, 518 MiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 38 MiB/s wr, 74 op/s; 0 B/s, 6 keys/s, 0 objects/s recovering 2024-06-02T04:50:17.612 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:17 smithi076 ceph-mon[42935]: pgmap v289: 129 pgs: 129 active+clean; 252 MiB data, 518 MiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 38 MiB/s wr, 74 op/s; 0 B/s, 6 keys/s, 0 objects/s recovering 2024-06-02T04:50:17.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-mon[47933]: pgmap v289: 129 pgs: 129 active+clean; 252 MiB data, 518 MiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 38 MiB/s wr, 74 op/s; 0 B/s, 6 keys/s, 0 objects/s recovering 2024-06-02T04:50:17.733 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.733+0000 7feda16ea700 1 -- 172.21.15.76:0/830426850 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fed9c101970 msgr2=0x7fed9c108290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:17.734 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.733+0000 7feda16ea700 1 --2- 172.21.15.76:0/830426850 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fed9c101970 0x7fed9c108290 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fed9400b0a0 tx=0x7fed9400b3b0 comp rx=0 tx=0).stop 2024-06-02T04:50:17.734 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.733+0000 7feda16ea700 1 -- 172.21.15.76:0/830426850 shutdown_connections 2024-06-02T04:50:17.734 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.733+0000 7feda16ea700 1 --2- 172.21.15.76:0/830426850 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fed9c101970 0x7fed9c108290 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:17.734 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.733+0000 7feda16ea700 1 --2- 172.21.15.76:0/830426850 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed9c0ffe60 0x7fed9c100280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:17.734 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.733+0000 7feda16ea700 1 --2- 172.21.15.76:0/830426850 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fed9c100fb0 0x7fed9c101430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:17.734 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.733+0000 7feda16ea700 1 -- 172.21.15.76:0/830426850 >> 172.21.15.76:0/830426850 conn(0x7fed9c0fb3f0 msgr2=0x7fed9c0fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:50:17.734 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.733+0000 7feda16ea700 1 -- 172.21.15.76:0/830426850 shutdown_connections 2024-06-02T04:50:17.734 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.733+0000 7feda16ea700 1 -- 172.21.15.76:0/830426850 wait complete. 2024-06-02T04:50:17.734 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.733+0000 7feda16ea700 1 Processor -- start 2024-06-02T04:50:17.736 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.734+0000 7feda16ea700 1 -- start start 2024-06-02T04:50:17.736 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.734+0000 7feda16ea700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed9c0ffe60 0x7fed9c196f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:17.736 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.734+0000 7feda16ea700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fed9c100fb0 0x7fed9c197480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:17.736 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.734+0000 7feda16ea700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fed9c101970 0x7fed9c19e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:17.736 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.734+0000 7feda16ea700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed9c19ea70 con 0x7fed9c101970 2024-06-02T04:50:17.736 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.734+0000 7feda16ea700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed9c19ebb0 con 0x7fed9c0ffe60 2024-06-02T04:50:17.736 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.734+0000 7feda16ea700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed9c19ed40 con 0x7fed9c100fb0 2024-06-02T04:50:17.736 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.734+0000 7fed9b7fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fed9c101970 0x7fed9c19e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:17.737 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.734+0000 7fed9b7fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fed9c101970 0x7fed9c19e4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:47770/0 (socket says 172.21.15.76:47770) 2024-06-02T04:50:17.737 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.734+0000 7fed9affd700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed9c0ffe60 0x7fed9c196f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:17.737 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.734+0000 7fed9b7fe700 1 -- 172.21.15.76:0/1763976908 learned_addr learned my addr 172.21.15.76:0/1763976908 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:50:17.737 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.734+0000 7fed9a7fc700 1 --2- 172.21.15.76:0/1763976908 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fed9c100fb0 0x7fed9c197480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:17.737 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.734+0000 7fed9affd700 1 -- 172.21.15.76:0/1763976908 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fed9c100fb0 msgr2=0x7fed9c197480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:17.737 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.734+0000 7fed9affd700 1 --2- 172.21.15.76:0/1763976908 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fed9c100fb0 0x7fed9c197480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:17.737 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.735+0000 7fed9affd700 1 -- 172.21.15.76:0/1763976908 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fed9c101970 msgr2=0x7fed9c19e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:17.737 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.735+0000 7fed9affd700 1 --2- 172.21.15.76:0/1763976908 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fed9c101970 0x7fed9c19e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:17.737 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.735+0000 7fed9affd700 1 -- 172.21.15.76:0/1763976908 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed94009d00 con 0x7fed9c0ffe60 2024-06-02T04:50:17.737 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.735+0000 7fed9b7fe700 1 --2- 172.21.15.76:0/1763976908 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fed9c101970 0x7fed9c19e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T04:50:17.737 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.735+0000 7fed9affd700 1 --2- 172.21.15.76:0/1763976908 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed9c0ffe60 0x7fed9c196f40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fed8c00e9f0 tx=0x7fed8c00ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:50:17.737 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.735+0000 7fed83fff700 1 -- 172.21.15.76:0/1763976908 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed8c00c9c0 con 0x7fed9c0ffe60 2024-06-02T04:50:17.737 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.735+0000 7feda16ea700 1 -- 172.21.15.76:0/1763976908 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed9c1022c0 con 0x7fed9c0ffe60 2024-06-02T04:50:17.738 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.735+0000 7fed83fff700 1 -- 172.21.15.76:0/1763976908 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fed8c010430 con 0x7fed9c0ffe60 2024-06-02T04:50:17.738 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.735+0000 7fed83fff700 1 -- 172.21.15.76:0/1763976908 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed8c018680 con 0x7fed9c0ffe60 2024-06-02T04:50:17.738 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.735+0000 7feda16ea700 1 -- 172.21.15.76:0/1763976908 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed9c1027d0 con 0x7fed9c0ffe60 2024-06-02T04:50:17.740 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.737+0000 7fed83fff700 1 -- 172.21.15.76:0/1763976908 <== mon.2 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fed8c0105a0 con 0x7fed9c0ffe60 2024-06-02T04:50:17.740 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.738+0000 7fed83fff700 1 --2- 172.21.15.76:0/1763976908 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fed840a1120 0x7fed840a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:17.740 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.738+0000 7fed9a7fc700 1 --2- 172.21.15.76:0/1763976908 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fed840a1120 0x7fed840a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:17.740 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.738+0000 7fed83fff700 1 -- 172.21.15.76:0/1763976908 <== mon.2 v2:172.21.15.119:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7fed8c014070 con 0x7fed9c0ffe60 2024-06-02T04:50:17.740 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.738+0000 7fedad8a5b80 1 Processor -- start 2024-06-02T04:50:17.740 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.739+0000 7fedad8a5b80 1 -- start start 2024-06-02T04:50:17.740 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.739+0000 7fedad8a5b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55646d298dd0 0x55646d2991f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:17.740 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.739+0000 7fedad8a5b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55646d299730 0x55646d299bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:17.740 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.739+0000 7fed9a7fc700 1 --2- 172.21.15.76:0/1763976908 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fed840a1120 0x7fed840a35e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fed90005950 tx=0x7fed9000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:50:17.741 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.739+0000 7fedad8a5b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55646d29a0f0 0x55646d29a570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:17.741 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.739+0000 7fedad8a5b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55646d1e71d0 con 0x55646d29a0f0 2024-06-02T04:50:17.741 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.739+0000 7fedad8a5b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55646d1e4b90 con 0x55646d298dd0 2024-06-02T04:50:17.741 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.739+0000 7fedad8a5b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55646d1e0480 con 0x55646d299730 2024-06-02T04:50:17.741 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.739+0000 7fed9b7fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55646d29a0f0 0x55646d29a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:17.741 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.739+0000 7fed9b7fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55646d29a0f0 0x55646d29a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:47786/0 (socket says 172.21.15.76:47786) 2024-06-02T04:50:17.741 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.739+0000 7fed9affd700 1 --2- 172.21.15.76:0/4059799648 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55646d298dd0 0x55646d2991f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:17.741 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.739+0000 7fed9b7fe700 1 -- 172.21.15.76:0/4059799648 learned_addr learned my addr 172.21.15.76:0/4059799648 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:50:17.741 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.739+0000 7fed9a7fc700 1 --2- 172.21.15.76:0/4059799648 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55646d299730 0x55646d299bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:17.741 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.739+0000 7fed9affd700 1 -- 172.21.15.76:0/4059799648 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55646d299730 msgr2=0x55646d299bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:50:17.741 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.739+0000 7fed9affd700 1 --2- 172.21.15.76:0/4059799648 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55646d299730 0x55646d299bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:17.741 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.739+0000 7fed9affd700 1 -- 172.21.15.76:0/4059799648 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55646d29a0f0 msgr2=0x55646d29a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:50:17.741 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.739+0000 7fed9affd700 1 --2- 172.21.15.76:0/4059799648 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55646d29a0f0 0x55646d29a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:17.741 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.739+0000 7fed9affd700 1 -- 172.21.15.76:0/4059799648 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55646d061430 con 0x55646d298dd0 2024-06-02T04:50:17.742 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.739+0000 7fed9a7fc700 1 --2- 172.21.15.76:0/4059799648 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55646d299730 0x55646d299bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:50:17.742 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.739+0000 7fed9b7fe700 1 --2- 172.21.15.76:0/4059799648 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55646d29a0f0 0x55646d29a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T04:50:17.742 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.739+0000 7fed9affd700 1 --2- 172.21.15.76:0/4059799648 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55646d298dd0 0x55646d2991f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fed8c0ca4c0 tx=0x7fed8c099a50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a8d2fe3ec51a33ed server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:50:17.742 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.740+0000 7fed817fa700 1 -- 172.21.15.76:0/4059799648 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed8c09a540 con 0x55646d298dd0 2024-06-02T04:50:17.742 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.740+0000 7fed817fa700 1 -- 172.21.15.76:0/4059799648 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fed8c099e40 con 0x55646d298dd0 2024-06-02T04:50:17.742 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.740+0000 7fed817fa700 1 -- 172.21.15.76:0/4059799648 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed8c099590 con 0x55646d298dd0 2024-06-02T04:50:17.746 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.740+0000 7fedad8a5b80 1 -- 172.21.15.76:0/4059799648 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55646d298dd0 msgr2=0x55646d2991f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:17.746 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.740+0000 7fedad8a5b80 1 --2- 172.21.15.76:0/4059799648 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55646d298dd0 0x55646d2991f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fed8c0ca4c0 tx=0x7fed8c099a50 comp rx=0 tx=0).stop 2024-06-02T04:50:17.746 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.740+0000 7fedad8a5b80 1 -- 172.21.15.76:0/4059799648 shutdown_connections 2024-06-02T04:50:17.746 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.740+0000 7fedad8a5b80 1 --2- 172.21.15.76:0/4059799648 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55646d29a0f0 0x55646d29a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:17.746 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.740+0000 7fedad8a5b80 1 --2- 172.21.15.76:0/4059799648 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55646d298dd0 0x55646d2991f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:17.746 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.740+0000 7fedad8a5b80 1 --2- 172.21.15.76:0/4059799648 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55646d299730 0x55646d299bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:17.746 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.740+0000 7fedad8a5b80 1 -- 172.21.15.76:0/4059799648 >> 172.21.15.76:0/4059799648 conn(0x55646d1ee290 msgr2=0x55646d28ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:50:17.746 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.740+0000 7fedad8a5b80 1 -- 172.21.15.76:0/4059799648 shutdown_connections 2024-06-02T04:50:17.747 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.740+0000 7fedad8a5b80 1 -- 172.21.15.76:0/4059799648 wait complete. 2024-06-02T04:50:17.747 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.741+0000 7fedad8a5b80 1 -- start start 2024-06-02T04:50:17.747 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.741+0000 7fedad8a5b80 1 Processor -- start 2024-06-02T04:50:17.747 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.741+0000 7fedad8a5b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55646d298dd0 0x55646d2a26d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:17.747 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.741+0000 7fedad8a5b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55646d299730 0x55646d2a2c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:17.747 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.741+0000 7fedad8a5b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55646d29a0f0 0x55646d2a9c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:17.747 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.741+0000 7fedad8a5b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55646d17c5e0 con 0x55646d29a0f0 2024-06-02T04:50:17.747 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.741+0000 7fedad8a5b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55646d17c280 con 0x55646d298dd0 2024-06-02T04:50:17.747 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.741+0000 7fedad8a5b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55646d063720 con 0x55646d299730 2024-06-02T04:50:17.747 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.741+0000 7fedad8a5b80 10 client.0 _ll_register_callbacks cb 0x55646d185bb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:50:17.747 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.741+0000 7fed9affd700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55646d298dd0 0x55646d2a26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:17.747 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.741+0000 7fed9b7fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55646d29a0f0 0x55646d2a9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:17.747 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.741+0000 7fed9affd700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55646d298dd0 0x55646d2a26d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:53104/0 (socket says 172.21.15.76:53104) 2024-06-02T04:50:17.748 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.741+0000 7fed9affd700 1 -- 172.21.15.76:0/3881590690 learned_addr learned my addr 172.21.15.76:0/3881590690 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:50:17.748 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.741+0000 7fed9b7fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55646d29a0f0 0x55646d2a9c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:47790/0 (socket says 172.21.15.76:47790) 2024-06-02T04:50:17.748 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.741+0000 7fed9a7fc700 1 --2- 172.21.15.76:0/3881590690 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55646d299730 0x55646d2a2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:17.748 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.742+0000 7fed9affd700 1 -- 172.21.15.76:0/3881590690 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55646d299730 msgr2=0x55646d2a2c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:50:17.748 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.742+0000 7fed9affd700 1 --2- 172.21.15.76:0/3881590690 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55646d299730 0x55646d2a2c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:17.748 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.742+0000 7fed9affd700 1 -- 172.21.15.76:0/3881590690 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55646d29a0f0 msgr2=0x55646d2a9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:50:17.748 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.742+0000 7fed9affd700 1 --2- 172.21.15.76:0/3881590690 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55646d29a0f0 0x55646d2a9c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:17.748 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.742+0000 7fed9affd700 1 -- 172.21.15.76:0/3881590690 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed9c108bc0 con 0x55646d298dd0 2024-06-02T04:50:17.748 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.742+0000 7fed9b7fe700 1 --2- 172.21.15.76:0/3881590690 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55646d29a0f0 0x55646d2a9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T04:50:17.748 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.742+0000 7fed9affd700 1 --2- 172.21.15.76:0/3881590690 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55646d298dd0 0x55646d2a26d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fed8c099b40 tx=0x7fed8c009790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2760f5f7ffe5ad61 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:50:17.748 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.742+0000 7fed7eff5700 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-06-02T04:50:17.748 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.742+0000 7fed7eff5700 1 -- 172.21.15.76:0/3881590690 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed8c0a22c0 con 0x55646d298dd0 2024-06-02T04:50:17.748 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.742+0000 7fed7eff5700 1 -- 172.21.15.76:0/3881590690 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7fed8c0a2040 con 0x55646d298dd0 2024-06-02T04:50:17.749 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.742+0000 7fedad8a5b80 1 -- 172.21.15.76:0/3881590690 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55646d1392f0 con 0x55646d298dd0 2024-06-02T04:50:17.749 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.742+0000 7fed7eff5700 1 -- 172.21.15.76:0/3881590690 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fed8c00cb20 con 0x55646d298dd0 2024-06-02T04:50:17.749 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.742+0000 7fedad8a5b80 10 client.25256 fetch_fsmap learned FSMap version 27 2024-06-02T04:50:17.749 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.742+0000 7fedad8a5b80 1 -- 172.21.15.76:0/3881590690 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7fed9c1027d0 con 0x55646d298dd0 2024-06-02T04:50:17.749 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.742+0000 7fed7eff5700 1 -- 172.21.15.76:0/3881590690 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55646d1392f0 con 0x55646d298dd0 2024-06-02T04:50:17.749 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.743+0000 7fed7eff5700 1 -- 172.21.15.76:0/3881590690 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 27) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fed8c09eb90 con 0x55646d298dd0 2024-06-02T04:50:17.749 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.743+0000 7fedad8a5b80 10 client.25256 fetch_fsmap finished waiting for FSMap version 27 2024-06-02T04:50:17.749 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.743+0000 7fedad8a5b80 10 client.25256 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-06-02T04:50:17.749 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.743+0000 7fedad8a5b80 20 client.25256 populate_metadata read hostname 'smithi076' 2024-06-02T04:50:17.749 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.743+0000 7fedad8a5b80 1 --2- 172.21.15.76:0/3881590690 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55646d2ae150 0x55646d2b0570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:17.749 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.743+0000 7fedad8a5b80 4 client.25256 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T04:50:17.749 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.743+0000 7fedad8a5b80 1 -- 172.21.15.76:0/3881590690 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55646d25f890 con 0x55646d2ae150 2024-06-02T04:50:17.749 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.743+0000 7fed9a7fc700 1 --2- 172.21.15.76:0/3881590690 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55646d2ae150 0x55646d2b0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:17.750 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.743+0000 7fed7eff5700 10 client.25256 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:50:17.750 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.743+0000 7fed9a7fc700 1 --2- 172.21.15.76:0/3881590690 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55646d2ae150 0x55646d2b0570 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d0a974e907debc0 server_cookie=6cca2da6e7cf5f1c in_seq=0 out_seq=0 2024-06-02T04:50:17.750 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.744+0000 7fed7eff5700 1 -- 172.21.15.76:0/3881590690 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55646d25f890 con 0x55646d2ae150 2024-06-02T04:50:17.750 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.744+0000 7fed7eff5700 10 client.25256 handle_command_reply: tid=0 2024-06-02T04:50:17.750 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.744+0000 7fedad8a5b80 1 client.25256 shutdown 2024-06-02T04:50:17.750 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.744+0000 7fedad8a5b80 1 -- 172.21.15.76:0/3881590690 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55646d298dd0 msgr2=0x55646d2a26d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:17.750 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.744+0000 7fedad8a5b80 1 --2- 172.21.15.76:0/3881590690 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55646d298dd0 0x55646d2a26d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fed8c099b40 tx=0x7fed8c009790 comp rx=0 tx=0).stop 2024-06-02T04:50:17.750 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.744+0000 7fedad8a5b80 1 -- 172.21.15.76:0/3881590690 shutdown_connections 2024-06-02T04:50:17.750 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.744+0000 7fedad8a5b80 1 --2- 172.21.15.76:0/3881590690 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55646d2ae150 0x55646d2b0570 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:17.750 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.744+0000 7fedad8a5b80 1 --2- 172.21.15.76:0/3881590690 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55646d29a0f0 0x55646d2a9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:17.750 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.744+0000 7fedad8a5b80 1 --2- 172.21.15.76:0/3881590690 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55646d298dd0 0x55646d2a26d0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:17.750 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.744+0000 7fedad8a5b80 1 --2- 172.21.15.76:0/3881590690 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55646d299730 0x55646d2a2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:17.750 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.744+0000 7fedad8a5b80 1 -- 172.21.15.76:0/3881590690 >> 172.21.15.76:0/3881590690 conn(0x55646d1ee290 msgr2=0x55646d28a620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:50:17.750 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.744+0000 7fed7eff5700 0 client.25256 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:50:17.751 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.744+0000 7fedad8a5b80 1 -- 172.21.15.76:0/3881590690 shutdown_connections 2024-06-02T04:50:17.751 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.744+0000 7fedad8a5b80 1 -- 172.21.15.76:0/3881590690 wait complete. 2024-06-02T04:50:17.751 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.744+0000 7fedad8a5b80 20 client.25256 trim_cache size 0 max 16384 2024-06-02T04:50:17.777 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.770+0000 7fedad8a5b80 1 Processor -- start 2024-06-02T04:50:17.777 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.770+0000 7fedad8a5b80 1 -- start start 2024-06-02T04:50:17.777 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.770+0000 7fedad8a5b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55646d298dd0 0x55646d29d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:17.777 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.770+0000 7fedad8a5b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55646d299730 0x55646d29d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:17.777 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.770+0000 7fedad8a5b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55646d29a0f0 0x55646d2a9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:17.778 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.770+0000 7fedad8a5b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55646d2a0de0 con 0x55646d29a0f0 2024-06-02T04:50:17.778 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.770+0000 7fedad8a5b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55646d25f890 con 0x55646d299730 2024-06-02T04:50:17.778 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.770+0000 7fedad8a5b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55646d1392f0 con 0x55646d298dd0 2024-06-02T04:50:17.778 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.770+0000 7fed9b7fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55646d29a0f0 0x55646d2a9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:17.778 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.770+0000 7fed9b7fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55646d29a0f0 0x55646d2a9c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:47800/0 (socket says 172.21.15.76:47800) 2024-06-02T04:50:17.778 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.770+0000 7fed9b7fe700 1 -- 172.21.15.76:0/1984854825 learned_addr learned my addr 172.21.15.76:0/1984854825 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:50:17.778 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.770+0000 7fed9a7fc700 1 --2- 172.21.15.76:0/1984854825 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55646d299730 0x55646d29d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:17.778 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.770+0000 7fed9affd700 1 --2- 172.21.15.76:0/1984854825 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55646d298dd0 0x55646d29d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:17.778 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.770+0000 7fed9b7fe700 1 -- 172.21.15.76:0/1984854825 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55646d298dd0 msgr2=0x55646d29d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:50:17.778 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.770+0000 7fed9b7fe700 1 --2- 172.21.15.76:0/1984854825 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55646d298dd0 0x55646d29d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:17.778 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.770+0000 7fed9b7fe700 1 -- 172.21.15.76:0/1984854825 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55646d299730 msgr2=0x55646d29d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:50:17.779 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.770+0000 7fed9b7fe700 1 --2- 172.21.15.76:0/1984854825 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55646d299730 0x55646d29d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:17.779 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.770+0000 7fed9b7fe700 1 -- 172.21.15.76:0/1984854825 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55646d00dbe0 con 0x55646d29a0f0 2024-06-02T04:50:17.779 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.770+0000 7fed9affd700 1 --2- 172.21.15.76:0/1984854825 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55646d298dd0 0x55646d29d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:50:17.779 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.771+0000 7fed9b7fe700 1 --2- 172.21.15.76:0/1984854825 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55646d29a0f0 0x55646d2a9c10 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fed940077e0 tx=0x7fed94007810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bb240d598b6590d server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:50:17.779 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.771+0000 7fed81ffb700 1 -- 172.21.15.76:0/1984854825 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed9400e040 con 0x55646d29a0f0 2024-06-02T04:50:17.779 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.771+0000 7fed81ffb700 1 -- 172.21.15.76:0/1984854825 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fed94003e90 con 0x55646d29a0f0 2024-06-02T04:50:17.779 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.771+0000 7fed81ffb700 1 -- 172.21.15.76:0/1984854825 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed94005860 con 0x55646d29a0f0 2024-06-02T04:50:17.779 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.772+0000 7fedad8a5b80 1 -- 172.21.15.76:0/1984854825 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55646d29a0f0 msgr2=0x55646d2a9c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:17.779 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.772+0000 7fedad8a5b80 1 --2- 172.21.15.76:0/1984854825 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55646d29a0f0 0x55646d2a9c10 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fed940077e0 tx=0x7fed94007810 comp rx=0 tx=0).stop 2024-06-02T04:50:17.779 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.772+0000 7fedad8a5b80 1 -- 172.21.15.76:0/1984854825 shutdown_connections 2024-06-02T04:50:17.779 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.772+0000 7fedad8a5b80 1 --2- 172.21.15.76:0/1984854825 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55646d29a0f0 0x55646d2a9c10 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:17.779 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.772+0000 7fedad8a5b80 1 --2- 172.21.15.76:0/1984854825 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55646d298dd0 0x55646d29d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:17.780 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.772+0000 7fedad8a5b80 1 --2- 172.21.15.76:0/1984854825 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55646d299730 0x55646d29d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:17.780 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.772+0000 7fedad8a5b80 1 -- 172.21.15.76:0/1984854825 >> 172.21.15.76:0/1984854825 conn(0x55646d1ee290 msgr2=0x55646d2a06d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:50:17.780 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.772+0000 7fedad8a5b80 1 -- 172.21.15.76:0/1984854825 shutdown_connections 2024-06-02T04:50:17.780 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.772+0000 7fedad8a5b80 1 -- 172.21.15.76:0/1984854825 wait complete. 2024-06-02T04:50:17.780 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.772+0000 7fedad8a5b80 1 -- start start 2024-06-02T04:50:17.780 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.772+0000 7fedad8a5b80 1 Processor -- start 2024-06-02T04:50:17.780 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.772+0000 7fedad8a5b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55646d298dd0 0x55646d2a99d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:17.780 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.772+0000 7fedad8a5b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55646d299730 0x55646d2a8030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:17.780 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.772+0000 7fedad8a5b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55646d29a0f0 0x55646d2a8570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:17.780 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.772+0000 7fedad8a5b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55646d2a8ab0 con 0x55646d29a0f0 2024-06-02T04:50:17.780 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.772+0000 7fedad8a5b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55646d2a8c20 con 0x55646d298dd0 2024-06-02T04:50:17.780 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.772+0000 7fedad8a5b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55646d2a8de0 con 0x55646d299730 2024-06-02T04:50:17.781 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.773+0000 7fedad8a5b80 10 client.0 _ll_register_callbacks cb 0x55646d185bb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:50:17.781 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.773+0000 7fed9affd700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55646d298dd0 0x55646d2a99d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:17.781 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.773+0000 7fed9affd700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55646d298dd0 0x55646d2a99d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:53110/0 (socket says 172.21.15.76:53110) 2024-06-02T04:50:17.781 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.773+0000 7fed9affd700 1 -- 172.21.15.76:0/569628708 learned_addr learned my addr 172.21.15.76:0/569628708 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:50:17.781 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.773+0000 7fed9b7fe700 1 --2- 172.21.15.76:0/569628708 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55646d29a0f0 0x55646d2a8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:17.781 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.773+0000 7fed9a7fc700 1 --2- 172.21.15.76:0/569628708 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55646d299730 0x55646d2a8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:17.781 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.773+0000 7fed9affd700 1 -- 172.21.15.76:0/569628708 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55646d299730 msgr2=0x55646d2a8030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:50:17.781 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.773+0000 7fed9affd700 1 --2- 172.21.15.76:0/569628708 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55646d299730 0x55646d2a8030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:17.781 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.773+0000 7fed9affd700 1 -- 172.21.15.76:0/569628708 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55646d29a0f0 msgr2=0x55646d2a8570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:50:17.781 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.773+0000 7fed9affd700 1 --2- 172.21.15.76:0/569628708 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55646d29a0f0 0x55646d2a8570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:17.781 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.773+0000 7fed9affd700 1 -- 172.21.15.76:0/569628708 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed940075a0 con 0x55646d298dd0 2024-06-02T04:50:17.781 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.773+0000 7fed9affd700 1 --2- 172.21.15.76:0/569628708 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55646d298dd0 0x55646d2a99d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fed8c00c5b0 tx=0x7fed8c010bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c35269d621fe72b3 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:50:17.782 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.773+0000 7fed7eff5700 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-06-02T04:50:17.782 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.773+0000 7fed7eff5700 1 -- 172.21.15.76:0/569628708 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed8c09a540 con 0x55646d298dd0 2024-06-02T04:50:17.782 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.773+0000 7fedad8a5b80 1 -- 172.21.15.76:0/569628708 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fed8c099e40 con 0x55646d298dd0 2024-06-02T04:50:17.782 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.773+0000 7fed7eff5700 1 -- 172.21.15.76:0/569628708 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7fed8c0a22c0 con 0x55646d298dd0 2024-06-02T04:50:17.782 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.774+0000 7fed7eff5700 1 -- 172.21.15.76:0/569628708 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fed8c099980 con 0x55646d298dd0 2024-06-02T04:50:17.782 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.774+0000 7fedad8a5b80 10 client.25262 fetch_fsmap learned FSMap version 27 2024-06-02T04:50:17.782 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.774+0000 7fedad8a5b80 1 -- 172.21.15.76:0/569628708 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55646d1a65e0 con 0x55646d298dd0 2024-06-02T04:50:17.782 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.774+0000 7fed7eff5700 1 -- 172.21.15.76:0/569628708 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fed8c099e40 con 0x55646d298dd0 2024-06-02T04:50:17.782 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.774+0000 7fed7eff5700 1 -- 172.21.15.76:0/569628708 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 27) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fed8c098f10 con 0x55646d298dd0 2024-06-02T04:50:17.782 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.774+0000 7fedad8a5b80 10 client.25262 fetch_fsmap finished waiting for FSMap version 27 2024-06-02T04:50:17.782 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.774+0000 7fedad8a5b80 10 client.25262 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-06-02T04:50:17.782 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.774+0000 7fedad8a5b80 20 client.25262 populate_metadata read hostname 'smithi076' 2024-06-02T04:50:17.782 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.774+0000 7fedad8a5b80 1 --2- 172.21.15.76:0/569628708 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55646d305a50 0x55646d307e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:17.783 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.774+0000 7fedad8a5b80 4 client.25262 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-06-02T04:50:17.783 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.774+0000 7fedad8a5b80 1 -- 172.21.15.76:0/569628708 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55646d1d8f40 con 0x55646d305a50 2024-06-02T04:50:17.783 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.774+0000 7fed9a7fc700 1 --2- 172.21.15.76:0/569628708 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55646d305a50 0x55646d307e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:17.783 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.775+0000 7fed7eff5700 10 client.25262 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:50:17.783 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.775+0000 7fed9a7fc700 1 --2- 172.21.15.76:0/569628708 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55646d305a50 0x55646d307e70 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=55f4603c65e425c1 server_cookie=146cd4e2186585ee in_seq=0 out_seq=0 2024-06-02T04:50:17.783 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.775+0000 7fed7eff5700 1 -- 172.21.15.76:0/569628708 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55646d1d8f40 con 0x55646d305a50 2024-06-02T04:50:17.783 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.775+0000 7fed7eff5700 10 client.25262 handle_command_reply: tid=0 2024-06-02T04:50:17.783 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.775+0000 7fedad8a5b80 1 client.25262 shutdown 2024-06-02T04:50:17.783 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.775+0000 7fedad8a5b80 1 -- 172.21.15.76:0/569628708 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55646d298dd0 msgr2=0x55646d2a99d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:17.783 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.775+0000 7fedad8a5b80 1 --2- 172.21.15.76:0/569628708 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55646d298dd0 0x55646d2a99d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fed8c00c5b0 tx=0x7fed8c010bc0 comp rx=0 tx=0).stop 2024-06-02T04:50:17.783 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.775+0000 7fedad8a5b80 1 -- 172.21.15.76:0/569628708 shutdown_connections 2024-06-02T04:50:17.784 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.775+0000 7fedad8a5b80 1 --2- 172.21.15.76:0/569628708 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55646d305a50 0x55646d307e70 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:17.784 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.775+0000 7fedad8a5b80 1 --2- 172.21.15.76:0/569628708 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55646d29a0f0 0x55646d2a8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:17.784 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.775+0000 7fedad8a5b80 1 --2- 172.21.15.76:0/569628708 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55646d298dd0 0x55646d2a99d0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:17.784 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.775+0000 7fedad8a5b80 1 --2- 172.21.15.76:0/569628708 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55646d299730 0x55646d2a8030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:17.784 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.776+0000 7fedad8a5b80 1 -- 172.21.15.76:0/569628708 >> 172.21.15.76:0/569628708 conn(0x55646d1ee290 msgr2=0x55646d29d150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:50:17.784 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.776+0000 7fed7eff5700 0 client.25262 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:50:17.784 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.776+0000 7fedad8a5b80 1 -- 172.21.15.76:0/569628708 shutdown_connections 2024-06-02T04:50:17.784 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.776+0000 7fedad8a5b80 1 -- 172.21.15.76:0/569628708 wait complete. 2024-06-02T04:50:17.784 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.776+0000 7fedad8a5b80 20 client.25262 trim_cache size 0 max 16384 2024-06-02T04:50:17.785 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-06-02T04:50:17.785 INFO:teuthology.orchestra.run.smithi076.stdout: "return_code": 0, 2024-06-02T04:50:17.785 INFO:teuthology.orchestra.run.smithi076.stdout: "scrub_tag": "cd548bfa-bc8b-4577-ad55-b1f1b56ccf8f", 2024-06-02T04:50:17.785 INFO:teuthology.orchestra.run.smithi076.stdout: "mode": "asynchronous" 2024-06-02T04:50:17.785 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-06-02T04:50:17.786 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.776+0000 7feda16ea700 1 -- 172.21.15.76:0/1763976908 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fed840a1120 msgr2=0x7fed840a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:17.786 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.776+0000 7feda16ea700 1 --2- 172.21.15.76:0/1763976908 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fed840a1120 0x7fed840a35e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fed90005950 tx=0x7fed9000b410 comp rx=0 tx=0).stop 2024-06-02T04:50:17.786 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.776+0000 7feda16ea700 1 -- 172.21.15.76:0/1763976908 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed9c0ffe60 msgr2=0x7fed9c196f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:17.786 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.776+0000 7feda16ea700 1 --2- 172.21.15.76:0/1763976908 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed9c0ffe60 0x7fed9c196f40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fed8c00e9f0 tx=0x7fed8c00ed00 comp rx=0 tx=0).stop 2024-06-02T04:50:17.786 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.777+0000 7feda16ea700 1 -- 172.21.15.76:0/1763976908 shutdown_connections 2024-06-02T04:50:17.786 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.777+0000 7feda16ea700 1 --2- 172.21.15.76:0/1763976908 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fed9c101970 0x7fed9c19e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:17.787 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.777+0000 7feda16ea700 1 --2- 172.21.15.76:0/1763976908 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fed840a1120 0x7fed840a35e0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:17.787 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.777+0000 7feda16ea700 1 --2- 172.21.15.76:0/1763976908 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed9c0ffe60 0x7fed9c196f40 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:17.787 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.777+0000 7feda16ea700 1 --2- 172.21.15.76:0/1763976908 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fed9c100fb0 0x7fed9c197480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:17.787 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.777+0000 7feda16ea700 1 -- 172.21.15.76:0/1763976908 >> 172.21.15.76:0/1763976908 conn(0x7fed9c0fb3f0 msgr2=0x7fed9c0680a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:50:17.787 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.777+0000 7feda16ea700 1 -- 172.21.15.76:0/1763976908 shutdown_connections 2024-06-02T04:50:17.787 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.777+0000 7feda16ea700 1 -- 172.21.15.76:0/1763976908 wait complete. 2024-06-02T04:50:17.792 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-06-02T04:50:17.982 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.981+0000 7fcb6b4fa700 1 -- 172.21.15.76:0/3465035171 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcb641019e0 msgr2=0x7fcb64103dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:17.983 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.981+0000 7fcb6b4fa700 1 --2- 172.21.15.76:0/3465035171 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcb641019e0 0x7fcb64103dd0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fcb60009990 tx=0x7fcb60009ca0 comp rx=0 tx=0).stop 2024-06-02T04:50:17.983 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.981+0000 7fcb6b4fa700 1 -- 172.21.15.76:0/3465035171 shutdown_connections 2024-06-02T04:50:17.983 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.981+0000 7fcb6b4fa700 1 --2- 172.21.15.76:0/3465035171 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcb64106c40 0x7fcb641090b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:17.983 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.981+0000 7fcb6b4fa700 1 --2- 172.21.15.76:0/3465035171 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcb641019e0 0x7fcb64103dd0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:17.983 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.981+0000 7fcb6b4fa700 1 --2- 172.21.15.76:0/3465035171 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcb64104310 0x7fcb64106700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:17.983 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.981+0000 7fcb6b4fa700 1 -- 172.21.15.76:0/3465035171 >> 172.21.15.76:0/3465035171 conn(0x7fcb640fb3f0 msgr2=0x7fcb640fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:50:17.983 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.981+0000 7fcb6b4fa700 1 -- 172.21.15.76:0/3465035171 shutdown_connections 2024-06-02T04:50:17.983 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.981+0000 7fcb6b4fa700 1 -- 172.21.15.76:0/3465035171 wait complete. 2024-06-02T04:50:17.983 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.982+0000 7fcb6b4fa700 1 Processor -- start 2024-06-02T04:50:17.984 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.982+0000 7fcb6b4fa700 1 -- start start 2024-06-02T04:50:17.986 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.983+0000 7fcb6b4fa700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcb641019e0 0x7fcb64196da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:17.986 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.983+0000 7fcb6b4fa700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcb64104310 0x7fcb641972e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:17.986 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.983+0000 7fcb6b4fa700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcb64106c40 0x7fcb6419e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:17.986 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.983+0000 7fcb6b4fa700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb6419e890 con 0x7fcb64104310 2024-06-02T04:50:17.986 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.983+0000 7fcb6b4fa700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb6419ea00 con 0x7fcb64106c40 2024-06-02T04:50:17.986 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.983+0000 7fcb6b4fa700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb6419ebc0 con 0x7fcb641019e0 2024-06-02T04:50:17.986 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.983+0000 7fcb68a95700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcb64104310 0x7fcb641972e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:17.986 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.983+0000 7fcb68a95700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcb64104310 0x7fcb641972e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:47828/0 (socket says 172.21.15.76:47828) 2024-06-02T04:50:17.986 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.983+0000 7fcb68a95700 1 -- 172.21.15.76:0/3197428158 learned_addr learned my addr 172.21.15.76:0/3197428158 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:50:17.986 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.983+0000 7fcb69296700 1 --2- 172.21.15.76:0/3197428158 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcb641019e0 0x7fcb64196da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:17.987 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.983+0000 7fcb69a97700 1 --2- 172.21.15.76:0/3197428158 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcb64106c40 0x7fcb6419e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:17.987 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.983+0000 7fcb68a95700 1 -- 172.21.15.76:0/3197428158 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcb641019e0 msgr2=0x7fcb64196da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:17.987 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.983+0000 7fcb68a95700 1 --2- 172.21.15.76:0/3197428158 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcb641019e0 0x7fcb64196da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:17.987 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.983+0000 7fcb68a95700 1 -- 172.21.15.76:0/3197428158 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcb64106c40 msgr2=0x7fcb6419e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:17.987 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.983+0000 7fcb68a95700 1 --2- 172.21.15.76:0/3197428158 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcb64106c40 0x7fcb6419e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:17.987 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.983+0000 7fcb68a95700 1 -- 172.21.15.76:0/3197428158 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb600095f0 con 0x7fcb64104310 2024-06-02T04:50:17.987 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.983+0000 7fcb68a95700 1 --2- 172.21.15.76:0/3197428158 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcb64104310 0x7fcb641972e0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fcb5400d980 tx=0x7fcb5400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:50:17.987 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.983+0000 7fcb5a7fc700 1 -- 172.21.15.76:0/3197428158 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb54004220 con 0x7fcb64104310 2024-06-02T04:50:17.987 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.983+0000 7fcb5a7fc700 1 -- 172.21.15.76:0/3197428158 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcb54007640 con 0x7fcb64104310 2024-06-02T04:50:17.987 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.983+0000 7fcb6b4fa700 1 -- 172.21.15.76:0/3197428158 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb6419eea0 con 0x7fcb64104310 2024-06-02T04:50:17.987 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.983+0000 7fcb5a7fc700 1 -- 172.21.15.76:0/3197428158 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb540055e0 con 0x7fcb64104310 2024-06-02T04:50:17.987 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.983+0000 7fcb6b4fa700 1 -- 172.21.15.76:0/3197428158 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb6419f2c0 con 0x7fcb64104310 2024-06-02T04:50:17.987 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.986+0000 7fcb5a7fc700 1 -- 172.21.15.76:0/3197428158 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fcb54004750 con 0x7fcb64104310 2024-06-02T04:50:17.993 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.986+0000 7fcb5a7fc700 1 --2- 172.21.15.76:0/3197428158 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fcb500a1120 0x7fcb500a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:17.993 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.987+0000 7fcb69296700 1 --2- 172.21.15.76:0/3197428158 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fcb500a1120 0x7fcb500a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:17.993 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.987+0000 7fcb5a7fc700 1 -- 172.21.15.76:0/3197428158 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7fcb540cca70 con 0x7fcb64104310 2024-06-02T04:50:17.993 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.987+0000 7fcb69296700 1 --2- 172.21.15.76:0/3197428158 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fcb500a1120 0x7fcb500a35e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fcb64198220 tx=0x7fcb6000b610 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:50:17.993 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.988+0000 7fcb776b5b80 1 Processor -- start 2024-06-02T04:50:17.993 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.988+0000 7fcb776b5b80 1 -- start start 2024-06-02T04:50:17.993 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.988+0000 7fcb776b5b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5635fb778950 0x5635fb778d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:17.994 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.988+0000 7fcb776b5b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5635fb7792b0 0x5635fb779730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:17.994 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.988+0000 7fcb776b5b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5635fb779c70 0x5635fb77a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:17.994 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.988+0000 7fcb776b5b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635fb6cb150 con 0x5635fb779c70 2024-06-02T04:50:17.994 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.988+0000 7fcb776b5b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635fb6c8b10 con 0x5635fb778950 2024-06-02T04:50:17.994 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.988+0000 7fcb776b5b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635fb6c4400 con 0x5635fb7792b0 2024-06-02T04:50:17.994 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.988+0000 7fcb69a97700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5635fb779c70 0x5635fb77a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:17.994 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.988+0000 7fcb69a97700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5635fb779c70 0x5635fb77a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:47834/0 (socket says 172.21.15.76:47834) 2024-06-02T04:50:17.994 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.988+0000 7fcb69a97700 1 -- 172.21.15.76:0/91052524 learned_addr learned my addr 172.21.15.76:0/91052524 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:50:17.994 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.988+0000 7fcb69296700 1 --2- 172.21.15.76:0/91052524 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5635fb778950 0x5635fb778d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:17.994 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.988+0000 7fcb68a95700 1 --2- 172.21.15.76:0/91052524 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5635fb7792b0 0x5635fb779730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:17.994 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.988+0000 7fcb69a97700 1 -- 172.21.15.76:0/91052524 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5635fb7792b0 msgr2=0x5635fb779730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:50:17.994 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.988+0000 7fcb69a97700 1 --2- 172.21.15.76:0/91052524 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5635fb7792b0 0x5635fb779730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:17.995 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.988+0000 7fcb69a97700 1 -- 172.21.15.76:0/91052524 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5635fb778950 msgr2=0x5635fb778d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:50:17.995 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.988+0000 7fcb69a97700 1 --2- 172.21.15.76:0/91052524 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5635fb778950 0x5635fb778d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:17.995 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.988+0000 7fcb69a97700 1 -- 172.21.15.76:0/91052524 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5635fb5453b0 con 0x5635fb779c70 2024-06-02T04:50:17.995 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.989+0000 7fcb69a97700 1 --2- 172.21.15.76:0/91052524 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5635fb779c70 0x5635fb77a0f0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c009440 tx=0x7fcb5c009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daa4163f2ad45d9e server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:50:17.995 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.989+0000 7fcb4f7fe700 1 -- 172.21.15.76:0/91052524 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb5c00e070 con 0x5635fb779c70 2024-06-02T04:50:17.995 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.989+0000 7fcb4f7fe700 1 -- 172.21.15.76:0/91052524 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcb5c00f040 con 0x5635fb779c70 2024-06-02T04:50:17.995 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.989+0000 7fcb4f7fe700 1 -- 172.21.15.76:0/91052524 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb5c015a20 con 0x5635fb779c70 2024-06-02T04:50:17.995 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.990+0000 7fcb776b5b80 1 -- 172.21.15.76:0/91052524 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5635fb779c70 msgr2=0x5635fb77a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:17.995 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.990+0000 7fcb776b5b80 1 --2- 172.21.15.76:0/91052524 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5635fb779c70 0x5635fb77a0f0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c009440 tx=0x7fcb5c009920 comp rx=0 tx=0).stop 2024-06-02T04:50:17.995 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.990+0000 7fcb776b5b80 1 -- 172.21.15.76:0/91052524 shutdown_connections 2024-06-02T04:50:17.995 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.990+0000 7fcb776b5b80 1 --2- 172.21.15.76:0/91052524 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5635fb779c70 0x5635fb77a0f0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:17.995 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.990+0000 7fcb776b5b80 1 --2- 172.21.15.76:0/91052524 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5635fb778950 0x5635fb778d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:17.996 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.990+0000 7fcb776b5b80 1 --2- 172.21.15.76:0/91052524 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5635fb7792b0 0x5635fb779730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:17.996 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.990+0000 7fcb776b5b80 1 -- 172.21.15.76:0/91052524 >> 172.21.15.76:0/91052524 conn(0x5635fb6d2210 msgr2=0x5635fb76ede0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:50:17.996 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.990+0000 7fcb776b5b80 1 -- 172.21.15.76:0/91052524 shutdown_connections 2024-06-02T04:50:17.996 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.990+0000 7fcb776b5b80 1 -- 172.21.15.76:0/91052524 wait complete. 2024-06-02T04:50:17.996 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.990+0000 7fcb776b5b80 1 -- start start 2024-06-02T04:50:17.996 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.990+0000 7fcb776b5b80 1 Processor -- start 2024-06-02T04:50:17.996 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.990+0000 7fcb776b5b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5635fb778950 0x5635fb7821c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:17.996 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.991+0000 7fcb776b5b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5635fb7792b0 0x5635fb782700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:17.996 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.991+0000 7fcb776b5b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5635fb779c70 0x5635fb789740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:17.996 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.991+0000 7fcb776b5b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635fb660560 con 0x5635fb7792b0 2024-06-02T04:50:17.996 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.991+0000 7fcb776b5b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635fb660200 con 0x5635fb779c70 2024-06-02T04:50:17.996 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.991+0000 7fcb776b5b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635fb5476a0 con 0x5635fb778950 2024-06-02T04:50:17.996 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.991+0000 7fcb776b5b80 10 client.0 _ll_register_callbacks cb 0x5635fb669b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:50:17.996 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.991+0000 7fcb68a95700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5635fb7792b0 0x5635fb782700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:17.997 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.991+0000 7fcb68a95700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5635fb7792b0 0x5635fb782700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:47840/0 (socket says 172.21.15.76:47840) 2024-06-02T04:50:17.997 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.991+0000 7fcb69a97700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5635fb779c70 0x5635fb789740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:17.997 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.991+0000 7fcb68a95700 1 -- 172.21.15.76:0/429623566 learned_addr learned my addr 172.21.15.76:0/429623566 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:50:17.997 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.991+0000 7fcb69296700 1 --2- 172.21.15.76:0/429623566 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5635fb778950 0x5635fb7821c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:17.997 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.991+0000 7fcb68a95700 1 -- 172.21.15.76:0/429623566 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5635fb778950 msgr2=0x5635fb7821c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:50:17.997 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.991+0000 7fcb68a95700 1 --2- 172.21.15.76:0/429623566 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5635fb778950 0x5635fb7821c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:17.997 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.991+0000 7fcb68a95700 1 -- 172.21.15.76:0/429623566 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5635fb779c70 msgr2=0x5635fb789740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:50:17.997 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.991+0000 7fcb68a95700 1 --2- 172.21.15.76:0/429623566 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5635fb779c70 0x5635fb789740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:17.997 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.991+0000 7fcb68a95700 1 -- 172.21.15.76:0/429623566 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb5c0090f0 con 0x5635fb7792b0 2024-06-02T04:50:17.997 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.991+0000 7fcb68a95700 1 --2- 172.21.15.76:0/429623566 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5635fb7792b0 0x5635fb782700 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fcb540ca230 tx=0x7fcb54004400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bfa0cb32ac8fbbe server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:50:17.997 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.991+0000 7fcb4cff9700 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-06-02T04:50:17.997 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.991+0000 7fcb4cff9700 1 -- 172.21.15.76:0/429623566 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb54099270 con 0x5635fb7792b0 2024-06-02T04:50:17.998 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.991+0000 7fcb776b5b80 1 -- 172.21.15.76:0/429623566 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5635fb61d270 con 0x5635fb7792b0 2024-06-02T04:50:17.998 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.991+0000 7fcb4cff9700 1 -- 172.21.15.76:0/429623566 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7fcb54099b80 con 0x5635fb7792b0 2024-06-02T04:50:17.998 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.992+0000 7fcb4cff9700 1 -- 172.21.15.76:0/429623566 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcb5409d9b0 con 0x5635fb7792b0 2024-06-02T04:50:17.998 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.992+0000 7fcb776b5b80 10 client.15741 fetch_fsmap learned FSMap version 27 2024-06-02T04:50:17.998 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.992+0000 7fcb776b5b80 1 -- 172.21.15.76:0/429623566 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x5635fb4f1b60 con 0x5635fb7792b0 2024-06-02T04:50:17.998 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.992+0000 7fcb4cff9700 1 -- 172.21.15.76:0/429623566 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5635fb61d270 con 0x5635fb7792b0 2024-06-02T04:50:17.998 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.992+0000 7fcb4cff9700 1 -- 172.21.15.76:0/429623566 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 27) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fcb5409ac20 con 0x5635fb7792b0 2024-06-02T04:50:17.998 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.992+0000 7fcb776b5b80 10 client.15741 fetch_fsmap finished waiting for FSMap version 27 2024-06-02T04:50:17.998 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.992+0000 7fcb776b5b80 10 client.15741 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-06-02T04:50:17.998 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.992+0000 7fcb776b5b80 20 client.15741 populate_metadata read hostname 'smithi076' 2024-06-02T04:50:17.998 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.992+0000 7fcb776b5b80 1 --2- 172.21.15.76:0/429623566 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5635fb78e070 0x5635fb790490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:17.998 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.992+0000 7fcb776b5b80 4 client.15741 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T04:50:17.999 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.992+0000 7fcb776b5b80 1 -- 172.21.15.76:0/429623566 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5635fb743810 con 0x5635fb78e070 2024-06-02T04:50:17.999 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.992+0000 7fcb69296700 1 --2- 172.21.15.76:0/429623566 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5635fb78e070 0x5635fb790490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:17.999 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.993+0000 7fcb4cff9700 10 client.15741 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:50:17.999 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.993+0000 7fcb69296700 1 --2- 172.21.15.76:0/429623566 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5635fb78e070 0x5635fb790490 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=411dd01e941f0db5 server_cookie=1ca110d4b22c3b97 in_seq=0 out_seq=0 2024-06-02T04:50:18.000 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.993+0000 7fcb4cff9700 1 -- 172.21.15.76:0/429623566 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5635fb743810 con 0x5635fb78e070 2024-06-02T04:50:18.000 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.993+0000 7fcb4cff9700 10 client.15741 handle_command_reply: tid=0 2024-06-02T04:50:18.000 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.993+0000 7fcb776b5b80 1 client.15741 shutdown 2024-06-02T04:50:18.000 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.993+0000 7fcb776b5b80 1 -- 172.21.15.76:0/429623566 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5635fb7792b0 msgr2=0x5635fb782700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:18.000 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.993+0000 7fcb776b5b80 1 --2- 172.21.15.76:0/429623566 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5635fb7792b0 0x5635fb782700 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fcb540ca230 tx=0x7fcb54004400 comp rx=0 tx=0).stop 2024-06-02T04:50:18.000 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.993+0000 7fcb776b5b80 1 -- 172.21.15.76:0/429623566 shutdown_connections 2024-06-02T04:50:18.000 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.993+0000 7fcb776b5b80 1 --2- 172.21.15.76:0/429623566 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5635fb78e070 0x5635fb790490 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:18.001 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.993+0000 7fcb776b5b80 1 --2- 172.21.15.76:0/429623566 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5635fb779c70 0x5635fb789740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:18.001 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.993+0000 7fcb776b5b80 1 --2- 172.21.15.76:0/429623566 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5635fb778950 0x5635fb7821c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:18.001 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.993+0000 7fcb776b5b80 1 --2- 172.21.15.76:0/429623566 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5635fb7792b0 0x5635fb782700 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:18.001 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.993+0000 7fcb4cff9700 0 client.15741 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:50:18.001 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.994+0000 7fcb776b5b80 1 -- 172.21.15.76:0/429623566 >> 172.21.15.76:0/429623566 conn(0x5635fb6d2210 msgr2=0x5635fb76e5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:50:18.001 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.994+0000 7fcb776b5b80 1 -- 172.21.15.76:0/429623566 shutdown_connections 2024-06-02T04:50:18.001 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.994+0000 7fcb776b5b80 1 -- 172.21.15.76:0/429623566 wait complete. 2024-06-02T04:50:18.001 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:17.994+0000 7fcb776b5b80 20 client.15741 trim_cache size 0 max 16384 2024-06-02T04:50:18.025 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:18.018+0000 7fcb776b5b80 1 Processor -- start 2024-06-02T04:50:18.025 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:18.018+0000 7fcb776b5b80 1 -- start start 2024-06-02T04:50:18.025 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:18.018+0000 7fcb776b5b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5635fb778950 0x5635fb7816d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:18.025 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:18.018+0000 7fcb776b5b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5635fb7792b0 0x5635fb789700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:18.025 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:18.018+0000 7fcb776b5b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5635fb779c70 0x5635fb794df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:18.026 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:18.018+0000 7fcb776b5b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635fb78b450 con 0x5635fb779c70 2024-06-02T04:50:18.026 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:18.018+0000 7fcb776b5b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635fb769800 con 0x5635fb778950 2024-06-02T04:50:18.026 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:18.018+0000 7fcb776b5b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635fb782e40 con 0x5635fb7792b0 2024-06-02T04:50:18.026 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:18.018+0000 7fcb69a97700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5635fb779c70 0x5635fb794df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:18.026 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:18.018+0000 7fcb69a97700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5635fb779c70 0x5635fb794df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:47852/0 (socket says 172.21.15.76:47852) 2024-06-02T04:50:18.026 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:18.018+0000 7fcb69a97700 1 -- 172.21.15.76:0/1830123188 learned_addr learned my addr 172.21.15.76:0/1830123188 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:50:18.026 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:18.018+0000 7fcb68a95700 1 --2- 172.21.15.76:0/1830123188 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5635fb7792b0 0x5635fb789700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:18.026 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:18.018+0000 7fcb69296700 1 --2- 172.21.15.76:0/1830123188 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5635fb778950 0x5635fb7816d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:18.026 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:18.019+0000 7fcb69a97700 1 -- 172.21.15.76:0/1830123188 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5635fb7792b0 msgr2=0x5635fb789700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:50:18.026 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:18.019+0000 7fcb69a97700 1 --2- 172.21.15.76:0/1830123188 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5635fb7792b0 0x5635fb789700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:18.027 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:18.019+0000 7fcb69a97700 1 -- 172.21.15.76:0/1830123188 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5635fb778950 msgr2=0x5635fb7816d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:50:18.027 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:18.019+0000 7fcb69a97700 1 --2- 172.21.15.76:0/1830123188 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5635fb778950 0x5635fb7816d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:18.027 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:18.019+0000 7fcb69a97700 1 -- 172.21.15.76:0/1830123188 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5635fb68a560 con 0x5635fb779c70 2024-06-02T04:50:18.027 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:18.019+0000 7fcb68a95700 1 --2- 172.21.15.76:0/1830123188 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5635fb7792b0 0x5635fb789700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T04:50:18.027 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:18.019+0000 7fcb69a97700 1 --2- 172.21.15.76:0/1830123188 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5635fb779c70 0x5635fb794df0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x5635fb76fd40 tx=0x7fcb5c006060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4de5bc831413a3d server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:50:18.027 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:18.019+0000 7fcb4ffff700 1 -- 172.21.15.76:0/1830123188 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb5c00e040 con 0x5635fb779c70 2024-06-02T04:50:18.027 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:18.019+0000 7fcb4ffff700 1 -- 172.21.15.76:0/1830123188 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcb5c004c90 con 0x5635fb779c70 2024-06-02T04:50:18.027 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:18.019+0000 7fcb4ffff700 1 -- 172.21.15.76:0/1830123188 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb5c0137b0 con 0x5635fb779c70 2024-06-02T04:50:18.028 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:18.020+0000 7fcb776b5b80 1 -- 172.21.15.76:0/1830123188 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5635fb779c70 msgr2=0x5635fb794df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:18.028 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:18.020+0000 7fcb776b5b80 1 --2- 172.21.15.76:0/1830123188 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5635fb779c70 0x5635fb794df0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x5635fb76fd40 tx=0x7fcb5c006060 comp rx=0 tx=0).stop 2024-06-02T04:50:18.028 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:18.020+0000 7fcb776b5b80 1 -- 172.21.15.76:0/1830123188 shutdown_connections 2024-06-02T04:50:18.028 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:18.020+0000 7fcb776b5b80 1 --2- 172.21.15.76:0/1830123188 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5635fb779c70 0x5635fb794df0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:18.028 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:18.020+0000 7fcb776b5b80 1 --2- 172.21.15.76:0/1830123188 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5635fb778950 0x5635fb7816d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:18.028 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:18.020+0000 7fcb776b5b80 1 --2- 172.21.15.76:0/1830123188 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5635fb7792b0 0x5635fb789700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:18.029 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:18.020+0000 7fcb776b5b80 1 -- 172.21.15.76:0/1830123188 >> 172.21.15.76:0/1830123188 conn(0x5635fb6d2210 msgr2=0x5635fb77a050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:50:18.029 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:18.020+0000 7fcb776b5b80 1 -- 172.21.15.76:0/1830123188 shutdown_connections 2024-06-02T04:50:18.029 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:18.020+0000 7fcb776b5b80 1 -- 172.21.15.76:0/1830123188 wait complete. 2024-06-02T04:50:18.029 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:18.020+0000 7fcb776b5b80 1 -- start start 2024-06-02T04:50:18.029 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:18.020+0000 7fcb776b5b80 1 Processor -- start 2024-06-02T04:50:18.029 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:18.021+0000 7fcb776b5b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5635fb778950 0x5635fb784c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:18.029 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:18.021+0000 7fcb776b5b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5635fb7792b0 0x5635fb785150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:18.030 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:18.021+0000 7fcb776b5b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5635fb779c70 0x5635fb788170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:18.030 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:18.021+0000 7fcb776b5b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635fb7886b0 con 0x5635fb778950 2024-06-02T04:50:18.030 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:18.021+0000 7fcb776b5b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635fb788820 con 0x5635fb779c70 2024-06-02T04:50:18.031 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:18.021+0000 7fcb776b5b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635fb7889e0 con 0x5635fb7792b0 2024-06-02T04:50:18.031 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:18.021+0000 7fcb776b5b80 10 client.0 _ll_register_callbacks cb 0x5635fb669b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:50:18.031 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:18.021+0000 7fcb69296700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5635fb778950 0x5635fb784c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:18.031 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:18.021+0000 7fcb69296700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5635fb778950 0x5635fb784c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:47854/0 (socket says 172.21.15.76:47854) 2024-06-02T04:50:18.032 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:18.021+0000 7fcb69296700 1 -- 172.21.15.76:0/1747370570 learned_addr learned my addr 172.21.15.76:0/1747370570 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:50:18.032 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:18.021+0000 7fcb68a95700 1 --2- 172.21.15.76:0/1747370570 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5635fb7792b0 0x5635fb785150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:18.032 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:18.021+0000 7fcb69a97700 1 --2- 172.21.15.76:0/1747370570 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5635fb779c70 0x5635fb788170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:18.032 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:18.021+0000 7fcb68a95700 1 -- 172.21.15.76:0/1747370570 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5635fb779c70 msgr2=0x5635fb788170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:50:18.033 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:18.021+0000 7fcb68a95700 1 --2- 172.21.15.76:0/1747370570 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5635fb779c70 0x5635fb788170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:18.033 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:18.021+0000 7fcb68a95700 1 -- 172.21.15.76:0/1747370570 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5635fb778950 msgr2=0x5635fb784c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:50:18.033 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:18.021+0000 7fcb68a95700 1 --2- 172.21.15.76:0/1747370570 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5635fb778950 0x5635fb784c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:18.033 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:18.021+0000 7fcb68a95700 1 -- 172.21.15.76:0/1747370570 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5635fb4f1b60 con 0x5635fb7792b0 2024-06-02T04:50:18.033 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:18.021+0000 7fcb69296700 1 --2- 172.21.15.76:0/1747370570 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5635fb778950 0x5635fb784c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T04:50:18.034 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:18.022+0000 7fcb68a95700 1 --2- 172.21.15.76:0/1747370570 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5635fb7792b0 0x5635fb785150 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fcb54097ed0 tx=0x7fcb54095d40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d684b199e95cc66 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:50:18.034 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:18.022+0000 7fcb4cff9700 10 client.0 ms_handle_connect on v2:172.21.15.192:3300/0 2024-06-02T04:50:18.034 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:18.022+0000 7fcb4cff9700 1 -- 172.21.15.76:0/1747370570 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb54014040 con 0x5635fb7792b0 2024-06-02T04:50:18.034 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:18.022+0000 7fcb776b5b80 1 -- 172.21.15.76:0/1747370570 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcb5c00f040 con 0x5635fb7792b0 2024-06-02T04:50:18.034 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:18.022+0000 7fcb4cff9700 1 -- 172.21.15.76:0/1747370570 <== mon.1 v2:172.21.15.192:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7fcb54099b80 con 0x5635fb7792b0 2024-06-02T04:50:18.034 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:18.022+0000 7fcb4cff9700 1 -- 172.21.15.76:0/1747370570 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcb54004fa0 con 0x5635fb7792b0 2024-06-02T04:50:18.034 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:18.022+0000 7fcb776b5b80 10 client.25222 fetch_fsmap learned FSMap version 27 2024-06-02T04:50:18.034 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:18.022+0000 7fcb776b5b80 1 -- 172.21.15.76:0/1747370570 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x5635fb5453b0 con 0x5635fb7792b0 2024-06-02T04:50:18.034 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:18.022+0000 7fcb4cff9700 1 -- 172.21.15.76:0/1747370570 <== mon.1 v2:172.21.15.192:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcb5c00f040 con 0x5635fb7792b0 2024-06-02T04:50:18.034 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:18.022+0000 7fcb4cff9700 1 -- 172.21.15.76:0/1747370570 <== mon.1 v2:172.21.15.192:3300/0 5 ==== fsmap(e 27) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fcb54099070 con 0x5635fb7792b0 2024-06-02T04:50:18.034 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:18.022+0000 7fcb776b5b80 10 client.25222 fetch_fsmap finished waiting for FSMap version 27 2024-06-02T04:50:18.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:18.022+0000 7fcb776b5b80 10 client.25222 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-06-02T04:50:18.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:18.022+0000 7fcb776b5b80 20 client.25222 populate_metadata read hostname 'smithi076' 2024-06-02T04:50:18.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:18.022+0000 7fcb776b5b80 1 --2- 172.21.15.76:0/1747370570 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5635fb7e4840 0x5635fb7e6c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:18.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:18.022+0000 7fcb776b5b80 4 client.25222 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-06-02T04:50:18.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:18.023+0000 7fcb776b5b80 1 -- 172.21.15.76:0/1747370570 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5635fb6bcec0 con 0x5635fb7e4840 2024-06-02T04:50:18.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:18.023+0000 7fcb69296700 1 --2- 172.21.15.76:0/1747370570 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5635fb7e4840 0x5635fb7e6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:18.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:18.023+0000 7fcb4cff9700 10 client.25222 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:50:18.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:18.023+0000 7fcb69296700 1 --2- 172.21.15.76:0/1747370570 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5635fb7e4840 0x5635fb7e6c60 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fbdaa4322f3d2293 server_cookie=aa1718837c3b1c2c in_seq=0 out_seq=0 2024-06-02T04:50:18.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:18.023+0000 7fcb4cff9700 1 -- 172.21.15.76:0/1747370570 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x5635fb6bcec0 con 0x5635fb7e4840 2024-06-02T04:50:18.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:18.023+0000 7fcb4cff9700 10 client.25222 handle_command_reply: tid=0 2024-06-02T04:50:18.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:18.023+0000 7fcb776b5b80 1 client.25222 shutdown 2024-06-02T04:50:18.036 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:18.023+0000 7fcb776b5b80 1 -- 172.21.15.76:0/1747370570 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5635fb7792b0 msgr2=0x5635fb785150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:18.036 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:18.023+0000 7fcb776b5b80 1 --2- 172.21.15.76:0/1747370570 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5635fb7792b0 0x5635fb785150 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fcb54097ed0 tx=0x7fcb54095d40 comp rx=0 tx=0).stop 2024-06-02T04:50:18.036 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:18.023+0000 7fcb776b5b80 1 -- 172.21.15.76:0/1747370570 shutdown_connections 2024-06-02T04:50:18.036 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:18.023+0000 7fcb776b5b80 1 --2- 172.21.15.76:0/1747370570 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5635fb7e4840 0x5635fb7e6c60 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:18.036 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:18.023+0000 7fcb776b5b80 1 --2- 172.21.15.76:0/1747370570 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5635fb779c70 0x5635fb788170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:18.036 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:18.023+0000 7fcb776b5b80 1 --2- 172.21.15.76:0/1747370570 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5635fb778950 0x5635fb784c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:18.036 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:18.023+0000 7fcb4cff9700 0 client.25222 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:50:18.036 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:18.023+0000 7fcb776b5b80 1 --2- 172.21.15.76:0/1747370570 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5635fb7792b0 0x5635fb785150 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:18.036 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:18.023+0000 7fcb776b5b80 1 -- 172.21.15.76:0/1747370570 >> 172.21.15.76:0/1747370570 conn(0x5635fb6d2210 msgr2=0x5635fb794df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:50:18.036 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:18.024+0000 7fcb776b5b80 1 -- 172.21.15.76:0/1747370570 shutdown_connections 2024-06-02T04:50:18.036 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:18.024+0000 7fcb776b5b80 1 -- 172.21.15.76:0/1747370570 wait complete. 2024-06-02T04:50:18.036 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:18.024+0000 7fcb776b5b80 20 client.25222 trim_cache size 0 max 16384 2024-06-02T04:50:18.037 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-06-02T04:50:18.037 INFO:teuthology.orchestra.run.smithi076.stdout: "status": "IDLE (waiting for more scrubs)", 2024-06-02T04:50:18.037 INFO:teuthology.orchestra.run.smithi076.stdout: "scrubs": { 2024-06-02T04:50:18.037 INFO:teuthology.orchestra.run.smithi076.stdout: "cd548bfa-bc8b-4577-ad55-b1f1b56ccf8f": { 2024-06-02T04:50:18.037 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/", 2024-06-02T04:50:18.037 INFO:teuthology.orchestra.run.smithi076.stdout: "tag": "cd548bfa-bc8b-4577-ad55-b1f1b56ccf8f", 2024-06-02T04:50:18.037 INFO:teuthology.orchestra.run.smithi076.stdout: "options": "recursive,force" 2024-06-02T04:50:18.037 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T04:50:18.037 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T04:50:18.037 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-06-02T04:50:18.039 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:18.024+0000 7fcb6b4fa700 1 -- 172.21.15.76:0/3197428158 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fcb500a1120 msgr2=0x7fcb500a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:18.039 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:18.024+0000 7fcb6b4fa700 1 --2- 172.21.15.76:0/3197428158 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fcb500a1120 0x7fcb500a35e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fcb64198220 tx=0x7fcb6000b610 comp rx=0 tx=0).stop 2024-06-02T04:50:18.039 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:18.024+0000 7fcb6b4fa700 1 -- 172.21.15.76:0/3197428158 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcb64104310 msgr2=0x7fcb641972e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:18.039 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:18.024+0000 7fcb6b4fa700 1 --2- 172.21.15.76:0/3197428158 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcb64104310 0x7fcb641972e0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fcb5400d980 tx=0x7fcb5400dc90 comp rx=0 tx=0).stop 2024-06-02T04:50:18.039 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:18.024+0000 7fcb6b4fa700 1 -- 172.21.15.76:0/3197428158 shutdown_connections 2024-06-02T04:50:18.039 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:18.024+0000 7fcb6b4fa700 1 --2- 172.21.15.76:0/3197428158 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fcb500a1120 0x7fcb500a35e0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:18.039 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:18.024+0000 7fcb6b4fa700 1 --2- 172.21.15.76:0/3197428158 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcb64106c40 0x7fcb6419e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:18.039 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:18.024+0000 7fcb6b4fa700 1 --2- 172.21.15.76:0/3197428158 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcb641019e0 0x7fcb64196da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:18.040 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:18.024+0000 7fcb6b4fa700 1 --2- 172.21.15.76:0/3197428158 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcb64104310 0x7fcb641972e0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:18.040 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:18.024+0000 7fcb6b4fa700 1 -- 172.21.15.76:0/3197428158 >> 172.21.15.76:0/3197428158 conn(0x7fcb640fb3f0 msgr2=0x7fcb641038d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:50:18.040 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:18.024+0000 7fcb6b4fa700 1 -- 172.21.15.76:0/3197428158 shutdown_connections 2024-06-02T04:50:18.040 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:18.024+0000 7fcb6b4fa700 1 -- 172.21.15.76:0/3197428158 wait complete. 2024-06-02T04:50:18.040 INFO:tasks.cephfs.filesystem:scrub status for tag:cd548bfa-bc8b-4577-ad55-b1f1b56ccf8f - {'path': '/', 'tag': 'cd548bfa-bc8b-4577-ad55-b1f1b56ccf8f', 'options': 'recursive,force'} 2024-06-02T04:50:18.188 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.801+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000046a [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/3603_vm auth v554 ap=1 s=8192 n(v0 rc2024-06-02T04:49:57.458510+0000 b8192 1=1+0) (iversion lock) caps={15429=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d8bf600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000046a:[<0x10000000393/3603_vm v304>,<0x10000000014/12346 v2935>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x1000000046a:[<0x10000000393/3603_vm v554>,<0x10000000014/12346 v7683>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.188 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.801+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000046b [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/3575 auth v558 ap=1 s=8192 n(v0 rc2024-06-02T04:49:57.462320+0000 b8192 1=1+0) (iversion lock) caps={15429=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d8bfb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000046b:[<0x10000000393/3575 v306>,<0x10000000014/12346 v2935>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x1000000046b:[<0x10000000393/3575 v558>,<0x10000000014/12346 v7683>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.188 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.802+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000046c [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/3467 auth v562 ap=1 s=8192 n(v0 rc2024-06-02T04:49:57.465697+0000 b8192 1=1+0) (iversion lock) caps={15429=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d8c0100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000046c:[<0x10000000393/3467 v308>,<0x10000000014/12346 v2935>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x1000000046c:[<0x10000000393/3467 v562>,<0x10000000014/12346 v7683>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.188 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.802+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000046d [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2617_fsm auth v566 ap=1 s=24576 n(v0 rc2024-06-02T04:49:57.469339+0000 b24576 1=1+0) (iversion lock) caps={15429=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d8c0680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000046d:[<0x10000000393/2617_fsm v310>,<0x10000000014/12346 v2935>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x1000000046d:[<0x10000000393/2617_fsm v566>,<0x10000000014/12346 v7683>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.188 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.802+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000046e [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/3119 auth v570 ap=1 s=8192 n(v0 rc2024-06-02T04:49:57.472790+0000 b8192 1=1+0) (iversion lock) caps={15429=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d8c0c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000046e:[<0x10000000393/3119 v312>,<0x10000000014/12346 v2935>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x1000000046e:[<0x10000000393/3119 v570>,<0x10000000014/12346 v7683>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.189 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.802+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000471 [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2603_fsm auth v582 ap=1 s=24576 n(v0 rc2024-06-02T04:49:57.485631+0000 b24576 1=1+0) (iversion lock) caps={15429=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d8ca000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000471:[<0x10000000393/2603_fsm v318>,<0x10000000014/12346 v2935>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x10000000471:[<0x10000000393/2603_fsm v582>,<0x10000000014/12346 v7683>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.189 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.802+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000046f [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2674 auth v574 ap=1 s=385024 n(v0 rc2024-06-02T04:49:57.477447+0000 b385024 1=1+0) (iversion lock) caps={15429=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d8c1180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000046f:[<0x10000000393/2674 v314>,<0x10000000014/12346 v2935>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x1000000046f:[<0x10000000393/2674 v574>,<0x10000000014/12346 v7683>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.189 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.803+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000470 [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2668 auth v578 ap=1 s=16384 n(v0 rc2024-06-02T04:49:57.481492+0000 b16384 1=1+0) (iversion lock) caps={15429=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d8c1700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000470:[<0x10000000393/2668 v316>,<0x10000000014/12346 v2935>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x10000000470:[<0x10000000393/2668 v578>,<0x10000000014/12346 v7683>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.189 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.803+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000472 [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/6110 auth v586 ap=1 s=8192 n(v0 rc2024-06-02T04:49:57.489245+0000 b8192 1=1+0) (iversion lock) caps={15429=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d8ca580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000472:[<0x10000000393/6110 v320>,<0x10000000014/12346 v2935>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x10000000472:[<0x10000000393/6110 v586>,<0x10000000014/12346 v7683>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.189 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.803+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000473 [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2702 auth v590 ap=1 s=8192 n(v0 rc2024-06-02T04:49:57.492626+0000 b8192 1=1+0) (iversion lock) caps={15429=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d8cab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000473:[<0x10000000393/2702 v322>,<0x10000000014/12346 v2935>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x10000000473:[<0x10000000393/2702 v590>,<0x10000000014/12346 v7683>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.189 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.803+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000474 [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2655 auth v594 ap=1 s=32768 n(v0 rc2024-06-02T04:49:57.496296+0000 b32768 1=1+0) (iversion lock) caps={15429=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d8cb080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000474:[<0x10000000393/2655 v324>,<0x10000000014/12346 v2935>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x10000000474:[<0x10000000393/2655 v594>,<0x10000000014/12346 v7683>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.189 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.803+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000476 [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/3712 auth v602 ap=1 s=16384 n(v0 rc2024-06-02T04:49:57.503269+0000 b16384 1=1+0) (iversion lock) caps={15429=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d8cbb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000476:[<0x10000000393/3712 v328>,<0x10000000014/12346 v2935>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x10000000476:[<0x10000000393/3712 v602>,<0x10000000014/12346 v7683>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.189 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.804+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000475 [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/3597 auth v598 ap=1 s=8192 n(v0 rc2024-06-02T04:49:57.499799+0000 b8192 1=1+0) (iversion lock) caps={15429=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d8cb600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000475:[<0x10000000393/3597 v326>,<0x10000000014/12346 v2935>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x10000000475:[<0x10000000393/3597 v598>,<0x10000000014/12346 v7683>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.189 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.804+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000477 [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2608 auth v606 ap=1 s=442368 n(v0 rc2024-06-02T04:49:57.508493+0000 b442368 1=1+0) (iversion lock) caps={15429=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d8cc100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000477:[<0x10000000393/2608 v330>,<0x10000000014/12346 v2935>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x10000000477:[<0x10000000393/2608 v606>,<0x10000000014/12346 v7683>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.189 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.804+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000479 [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/12187_vm auth v614 ap=1 s=8192 n(v0 rc2024-06-02T04:49:57.516137+0000 b8192 1=1+0) (iversion lock) caps={15429=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d8ccc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000479:[<0x10000000393/12187_vm v334>,<0x10000000014/12346 v2935>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x10000000479:[<0x10000000393/12187_vm v614>,<0x10000000014/12346 v7683>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.189 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.804+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000047a [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/3164 auth v618 ap=1 s=16384 n(v0 rc2024-06-02T04:49:57.520081+0000 b16384 1=1+0) (iversion lock) caps={15429=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d8cd180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000047a:[<0x10000000393/3164 v336>,<0x10000000014/12346 v2935>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x1000000047a:[<0x10000000393/3164 v618>,<0x10000000014/12346 v7683>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.190 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.804+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000047b [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/3501_vm auth v712 ap=1 s=0 n(v0 1=1+0) (iversion lock) caps={15429=pAsLsXsFs/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d8cd700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000047b:[<0x10000000393/3501_vm v338>,<0x10000000014/12346 v2935>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x1000000047b:[<0x10000000393/3501_vm v712>,<0x10000000014/12346 v7683>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.190 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.805+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000047c [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/6111 auth v622 ap=1 s=8192 n(v0 rc2024-06-02T04:49:57.526201+0000 b8192 1=1+0) (iversion lock) caps={15429=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d8d4000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000047c:[<0x10000000393/6111 v340>,<0x10000000014/12346 v2935>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x1000000047c:[<0x10000000393/6111 v622>,<0x10000000014/12346 v7683>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.190 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.805+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000478 [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2831 auth v610 ap=1 s=8192 n(v0 rc2024-06-02T04:49:57.512462+0000 b8192 1=1+0) (iversion lock) caps={15429=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d8cc680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000478:[<0x10000000393/2831 v332>,<0x10000000014/12346 v2935>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x10000000478:[<0x10000000393/2831 v610>,<0x10000000014/12346 v7683>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.190 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.805+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000047d [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2682 auth v626 ap=1 s=16384 n(v0 rc2024-06-02T04:49:57.529946+0000 b16384 1=1+0) (iversion lock) caps={15429=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d8d4580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000047d:[<0x10000000393/2682 v342>,<0x10000000014/12346 v2935>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x1000000047d:[<0x10000000393/2682 v626>,<0x10000000014/12346 v7683>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.190 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.805+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000047e [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/113 auth v630 ap=1 s=8192 n(v0 rc2024-06-02T04:49:57.533644+0000 b8192 1=1+0) (iversion lock) caps={15429=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d8d4b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000047e:[<0x10000000393/113 v344>,<0x10000000014/12346 v2935>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x1000000047e:[<0x10000000393/113 v630>,<0x10000000014/12346 v7683>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.190 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.805+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000047f [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/3604 auth v634 ap=1 s=16384 n(v0 rc2024-06-02T04:49:57.537483+0000 b16384 1=1+0) (iversion lock) caps={15429=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d8d5080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000047f:[<0x10000000393/3604 v346>,<0x10000000014/12346 v2935>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x1000000047f:[<0x10000000393/3604 v634>,<0x10000000014/12346 v7683>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.190 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.806+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000480 [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2691 auth v638 ap=1 s=270336 n(v0 rc2024-06-02T04:49:57.542577+0000 b270336 1=1+0) (iversion lock) caps={15429=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d8d5600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000480:[<0x10000000393/2691 v348>,<0x10000000014/12346 v2935>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x10000000480:[<0x10000000393/2691 v638>,<0x10000000014/12346 v7683>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.190 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.806+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000481 [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2605_vm auth v642 ap=1 s=8192 n(v0 rc2024-06-02T04:49:57.546142+0000 b8192 1=1+0) (iversion lock) caps={15429=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d8d5b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000481:[<0x10000000393/2605_vm v350>,<0x10000000014/12346 v2935>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x10000000481:[<0x10000000393/2605_vm v642>,<0x10000000014/12346 v7683>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.190 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.806+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000484 [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2663 auth v654 ap=1 s=49152 n(v0 rc2024-06-02T04:49:57.558401+0000 b49152 1=1+0) (iversion lock) caps={15429=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d8d6c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000484:[<0x10000000393/2663 v356>,<0x10000000014/12346 v2935>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x10000000484:[<0x10000000393/2663 v654>,<0x10000000014/12346 v7683>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.190 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.806+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000482 [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/3440 auth v646 ap=1 s=8192 n(v0 rc2024-06-02T04:49:57.550563+0000 b8192 1=1+0) (iversion lock) caps={15429=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d8d6100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000482:[<0x10000000393/3440 v352>,<0x10000000014/12346 v2935>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x10000000482:[<0x10000000393/3440 v646>,<0x10000000014/12346 v7683>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.191 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.806+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000486 [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2836 auth v714 ap=1 s=0 n(v0 1=1+0) (iversion lock) caps={15429=pAsLsXsFs/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d8d7700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000486:[<0x10000000393/2836 v360>,<0x10000000014/12346 v2935>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x10000000486:[<0x10000000393/2836 v714>,<0x10000000014/12346 v7683>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.191 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.807+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000488 [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/1247 auth v666 ap=1 s=73728 n(v0 rc2024-06-02T04:49:57.574537+0000 b73728 1=1+0) (iversion lock) caps={15429=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d8dc580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000488:[<0x10000000393/1247 v364>,<0x10000000014/12346 v2935>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x10000000488:[<0x10000000393/1247 v666>,<0x10000000014/12346 v7683>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.191 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.807+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000487 [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/548 auth v662 ap=1 s=8192 n(v0 rc2024-06-02T04:49:57.570407+0000 b8192 1=1+0) (iversion lock) caps={15429=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d8dc000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000487:[<0x10000000393/548 v362>,<0x10000000014/12346 v2935>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x10000000487:[<0x10000000393/548 v662>,<0x10000000014/12346 v7683>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.191 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.807+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000485 [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2838 auth v658 ap=1 s=417792 n(v0 rc2024-06-02T04:49:57.563513+0000 b417792 1=1+0) (iversion lock) caps={15429=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d8d7180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000485:[<0x10000000393/2838 v358>,<0x10000000014/12346 v2935>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x10000000485:[<0x10000000393/2838 v658>,<0x10000000014/12346 v7683>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.191 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.807+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000483 [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2685 auth v650 ap=1 s=16384 n(v0 rc2024-06-02T04:49:57.554638+0000 b16384 1=1+0) (iversion lock) caps={15429=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d8d6680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000483:[<0x10000000393/2685 v354>,<0x10000000014/12346 v2935>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x10000000483:[<0x10000000393/2685 v650>,<0x10000000014/12346 v7683>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.191 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.808+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000048a [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/3764 auth v674 ap=1 s=8192 n(v0 rc2024-06-02T04:49:57.583141+0000 b8192 1=1+0) (iversion lock) caps={15429=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d8dd080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000048a:[<0x10000000393/3764 v368>,<0x10000000014/12346 v2935>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x1000000048a:[<0x10000000393/3764 v674>,<0x10000000014/12346 v7683>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.191 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.808+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000048b [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/3080 auth v678 ap=1 s=16384 n(v0 rc2024-06-02T04:49:57.587179+0000 b16384 1=1+0) (iversion lock) caps={15429=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d8dd600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000048b:[<0x10000000393/3080 v370>,<0x10000000014/12346 v2935>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x1000000048b:[<0x10000000393/3080 v678>,<0x10000000014/12346 v7683>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.191 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.808+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000489 [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2603 auth v670 ap=1 s=32768 n(v0 rc2024-06-02T04:49:57.578266+0000 b32768 1=1+0) (iversion lock) caps={15429=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d8dcb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000489:[<0x10000000393/2603 v366>,<0x10000000014/12346 v2935>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x10000000489:[<0x10000000393/2603 v670>,<0x10000000014/12346 v7683>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.191 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.808+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000048c [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/3394_vm auth v682 ap=1 s=8192 n(v0 rc2024-06-02T04:49:57.592100+0000 b8192 1=1+0) (iversion lock) caps={15429=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d8ddb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000048c:[<0x10000000393/3394_vm v372>,<0x10000000014/12346 v2935>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x1000000048c:[<0x10000000393/3394_vm v682>,<0x10000000014/12346 v7683>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.191 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.808+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000048d [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2754 auth v686 ap=1 s=16384 n(v0 rc2024-06-02T04:49:57.595945+0000 b16384 1=1+0) (iversion lock) caps={15429=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d8de100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000048d:[<0x10000000393/2754 v374>,<0x10000000014/12346 v2935>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x1000000048d:[<0x10000000393/2754 v686>,<0x10000000014/12346 v7683>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.192 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.808+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000048e [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/12199 auth v716 ap=1 s=0 n(v0 1=1+0) (iversion lock) caps={15429=pAsLsXsFs/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d8de680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000048e:[<0x10000000393/12199 v376>,<0x10000000014/12346 v2935>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x1000000048e:[<0x10000000393/12199 v716>,<0x10000000014/12346 v7683>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.192 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.809+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000048f [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/3455 auth v690 ap=1 s=40960 n(v0 rc2024-06-02T04:49:57.602592+0000 b40960 1=1+0) (iversion lock) caps={15429=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d8dec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000048f:[<0x10000000393/3455 v378>,<0x10000000014/12346 v2935>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x1000000048f:[<0x10000000393/3455 v690>,<0x10000000014/12346 v7683>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.192 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.809+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000490 [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/12182_fsm auth v694 ap=1 s=24576 n(v0 rc2024-06-02T04:49:57.609150+0000 b24576 1=1+0) (iversion lock) caps={15429=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d8df180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000490:[<0x10000000393/12182_fsm v380>,<0x10000000014/12346 v2935>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x10000000490:[<0x10000000393/12182_fsm v694>,<0x10000000014/12346 v7683>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.192 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.809+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000491 [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/1259 auth v698 ap=1 s=90112 n(v0 rc2024-06-02T04:49:57.613723+0000 b90112 1=1+0) (iversion lock) caps={15429=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d8df700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000491:[<0x10000000393/1259 v382>,<0x10000000014/12346 v2935>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x10000000491:[<0x10000000393/1259 v698>,<0x10000000014/12346 v7683>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.192 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.809+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000492 [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/12207 auth v702 ap=1 s=8192 n(v0 rc2024-06-02T04:49:57.618103+0000 b8192 1=1+0) (iversion lock) caps={15429=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d8e4000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000492:[<0x10000000393/12207 v384>,<0x10000000014/12346 v2935>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x10000000492:[<0x10000000393/12207 v702>,<0x10000000014/12346 v7683>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.192 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.809+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000493 [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2610 auth v706 ap=1 s=24576 n(v0 rc2024-06-02T04:49:57.621829+0000 b24576 1=1+0) (iversion lock) caps={15429=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d8e4580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000493:[<0x10000000393/2610 v386>,<0x10000000014/12346 v2935>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x10000000493:[<0x10000000393/2610 v706>,<0x10000000014/12346 v7683>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.192 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.810+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000495 [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2613 auth v718 ap=1 s=0 n(v0 1=1+0) (iversion lock) caps={15429=pAsLsXsFs/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d8e5080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000495:[<0x10000000393/2613 v390>,<0x10000000014/12346 v2935>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x10000000495:[<0x10000000393/2613 v718>,<0x10000000014/12346 v7683>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.192 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.810+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000494 [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/3606 auth v710 ap=1 s=16384 n(v0 rc2024-06-02T04:49:57.625620+0000 b16384 1=1+0) (iversion lock) caps={15429=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d8e4b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000494:[<0x10000000393/3606 v388>,<0x10000000014/12346 v2935>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x10000000494:[<0x10000000393/3606 v710>,<0x10000000014/12346 v7683>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.192 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.817+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000320 [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3603_vm auth v680 ap=1 s=8192 n(v0 rc2024-06-02T04:49:52.107865+0000 b8192 1=1+0) (iversion lock) caps={15429=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d881600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000320:[<0x10000000015/3603_vm v552>,<0x10000000014/1 v2937>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x10000000320:[<0x10000000015/3603_vm v680>,<0x10000000014/1 v7931>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.192 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.817+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002e3 [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3467 auth v610 ap=1 s=8192 n(v0 rc2024-06-02T04:49:49.803599+0000 b8192 1=1+0) (iversion lock) caps={15429=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d882100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000002e3:[<0x10000000015/3467 v522>,<0x10000000014/1 v2937>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x100000002e3:[<0x10000000015/3467 v610>,<0x10000000014/1 v7931>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.192 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.818+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000235 [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2617_fsm auth v682 ap=1 s=24576 n(v0 rc2024-06-02T04:49:51.954317+0000 b24576 1=1+0) (iversion lock) caps={15429=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d882680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000235:[<0x10000000015/2617_fsm v554>,<0x10000000014/1 v2937>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x10000000235:[<0x10000000015/2617_fsm v682>,<0x10000000014/1 v7931>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.193 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.818+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002f6 [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3119 auth v614 ap=1 s=8192 n(v0 rc2024-06-02T04:49:49.725544+0000 b8192 1=1+0) (iversion lock) caps={15429=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d882c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000002f6:[<0x10000000015/3119 v532>,<0x10000000014/1 v2937>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x100000002f6:[<0x10000000015/3119 v614>,<0x10000000014/1 v7931>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.193 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.818+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002df [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3575 auth v606 ap=1 s=8192 n(v0 rc2024-06-02T04:49:49.819227+0000 b8192 1=1+0) (iversion lock) caps={15429=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d881b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000002df:[<0x10000000015/3575 v536>,<0x10000000014/1 v2937>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x100000002df:[<0x10000000015/3575 v606>,<0x10000000014/1 v7931>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.193 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.818+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002b9 [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2674 auth v684 ap=1 s=385024 n(v0 rc2024-06-02T04:49:52.011177+0000 b385024 1=1+0) (iversion lock) caps={15429=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d883180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000002b9:[<0x10000000015/2674 v556>,<0x10000000014/1 v2937>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x100000002b9:[<0x10000000015/2674 v684>,<0x10000000014/1 v7931>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.193 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.818+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002b3 [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2668 auth v686 ap=1 s=16384 n(v0 rc2024-06-02T04:49:51.991237+0000 b16384 1=1+0) (iversion lock) caps={15429=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d883700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000002b3:[<0x10000000015/2668 v558>,<0x10000000014/1 v2937>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x100000002b3:[<0x10000000015/2668 v686>,<0x10000000014/1 v7931>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.193 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.818+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000023f [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2603_fsm auth v618 ap=1 s=24576 n(v0 rc2024-06-02T04:49:51.895986+0000 b24576 1=1+0) (iversion lock) caps={15429=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d898000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000023f:[<0x10000000015/2603_fsm v548>,<0x10000000014/1 v2937>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x1000000023f:[<0x10000000015/2603_fsm v618>,<0x10000000014/1 v7931>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.193 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.818+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002e2 [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2702 auth v626 ap=1 s=8192 n(v0 rc2024-06-02T04:49:49.807421+0000 b8192 1=1+0) (iversion lock) caps={15429=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d898b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000002e2:[<0x10000000015/2702 v520>,<0x10000000014/1 v2937>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x100000002e2:[<0x10000000015/2702 v626>,<0x10000000014/1 v7931>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.193 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.819+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000029e [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2655 auth v688 ap=1 s=32768 n(v0 rc2024-06-02T04:49:51.975319+0000 b32768 1=1+0) (iversion lock) caps={15429=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d899080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000029e:[<0x10000000015/2655 v560>,<0x10000000014/1 v2937>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x1000000029e:[<0x10000000015/2655 v688>,<0x10000000014/1 v7931>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.193 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.819+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000304 [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/6110 auth v622 ap=1 s=8192 n(v0 rc2024-06-02T04:49:49.676073+0000 b8192 1=1+0) (iversion lock) caps={15429=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d898580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000304:[<0x10000000015/6110 v538>,<0x10000000014/1 v2937>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x10000000304:[<0x10000000015/6110 v622>,<0x10000000014/1 v7931>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.193 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.819+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002fa [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3597 auth v630 ap=1 s=8192 n(v0 rc2024-06-02T04:49:49.708524+0000 b8192 1=1+0) (iversion lock) caps={15429=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d899600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000002fa:[<0x10000000015/3597 v534>,<0x10000000014/1 v2937>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x100000002fa:[<0x10000000015/3597 v630>,<0x10000000014/1 v7931>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.193 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.819+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002e6 [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3712 auth v690 ap=1 s=16384 n(v0 rc2024-06-02T04:49:52.116232+0000 b16384 1=1+0) (iversion lock) caps={15429=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d899b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000002e6:[<0x10000000015/3712 v562>,<0x10000000014/1 v2937>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x100000002e6:[<0x10000000015/3712 v690>,<0x10000000014/1 v7931>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.193 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.819+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000252 [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2608 auth v692 ap=1 s=442368 n(v0 rc2024-06-02T04:49:51.920746+0000 b442368 1=1+0) (iversion lock) caps={15429=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d89a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000252:[<0x10000000015/2608 v564>,<0x10000000014/1 v2937>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x10000000252:[<0x10000000015/2608 v692>,<0x10000000014/1 v7931>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.194 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.819+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000280 [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2831 auth v634 ap=1 s=8192 n(v0 rc2024-06-02T04:49:50.197241+0000 b8192 1=1+0) (iversion lock) caps={15429=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d89a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000280:[<0x10000000015/2831 v516>,<0x10000000014/1 v2937>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x10000000280:[<0x10000000015/2831 v634>,<0x10000000014/1 v7931>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.194 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.820+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000038c [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/12187_vm auth v694 ap=1 s=8192 n(v0 rc2024-06-02T04:49:52.133033+0000 b8192 1=1+0) (iversion lock) caps={15429=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d89ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000038c:[<0x10000000015/12187_vm v566>,<0x10000000014/1 v2937>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x1000000038c:[<0x10000000015/12187_vm v694>,<0x10000000014/1 v7931>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.194 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.820+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002ad [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3164 auth v696 ap=1 s=16384 n(v0 rc2024-06-02T04:49:52.077119+0000 b16384 1=1+0) (iversion lock) caps={15429=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d89b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000002ad:[<0x10000000015/3164 v568>,<0x10000000014/1 v2937>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x100000002ad:[<0x10000000015/3164 v696>,<0x10000000014/1 v7931>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.194 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.820+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000337 [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3501_vm auth v638 ap=1 s=0 n(v0 1=1+0) (iversion lock) caps={15429=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d89b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000337:[<0x10000000015/3501_vm v512>,<0x10000000014/1 v2937>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x10000000337:[<0x10000000015/3501_vm v638>,<0x10000000014/1 v7931>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.194 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.820+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000305 [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/6111 auth v642 ap=1 s=8192 n(v0 rc2024-06-02T04:49:49.672862+0000 b8192 1=1+0) (iversion lock) caps={15429=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d8a2000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000305:[<0x10000000015/6111 v540>,<0x10000000014/1 v2937>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x10000000305:[<0x10000000015/6111 v642>,<0x10000000014/1 v7931>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.194 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.820+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002c5 [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2682 auth v698 ap=1 s=16384 n(v0 rc2024-06-02T04:49:52.020261+0000 b16384 1=1+0) (iversion lock) caps={15429=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d8a2580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000002c5:[<0x10000000015/2682 v570>,<0x10000000014/1 v2937>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x100000002c5:[<0x10000000015/2682 v698>,<0x10000000014/1 v7931>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.194 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.821+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002f2 [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/113 auth v646 ap=1 s=8192 n(v0 rc2024-06-02T04:49:49.742065+0000 b8192 1=1+0) (iversion lock) caps={15429=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d8a2b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000002f2:[<0x10000000015/113 v530>,<0x10000000014/1 v2937>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x100000002f2:[<0x10000000015/113 v646>,<0x10000000014/1 v7931>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.194 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.821+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002e8 [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3604 auth v700 ap=1 s=16384 n(v0 rc2024-06-02T04:49:52.109019+0000 b16384 1=1+0) (iversion lock) caps={15429=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d8a3080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000002e8:[<0x10000000015/3604 v572>,<0x10000000014/1 v2937>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x100000002e8:[<0x10000000015/3604 v700>,<0x10000000014/1 v7931>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.194 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.821+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000340 [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2605_vm auth v650 ap=1 s=8192 n(v0 rc2024-06-02T04:49:51.901008+0000 b8192 1=1+0) (iversion lock) caps={15429=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d8a3b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000340:[<0x10000000015/2605_vm v550>,<0x10000000014/1 v2937>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x10000000340:[<0x10000000015/2605_vm v650>,<0x10000000014/1 v7931>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.194 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.821+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002d5 [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2691 auth v702 ap=1 s=270336 n(v0 rc2024-06-02T04:49:52.033144+0000 b270336 1=1+0) (iversion lock) caps={15429=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d8a3600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000002d5:[<0x10000000015/2691 v574>,<0x10000000014/1 v2937>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x100000002d5:[<0x10000000015/2691 v702>,<0x10000000014/1 v7931>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.195 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.821+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000028f [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3440 auth v654 ap=1 s=8192 n(v0 rc2024-06-02T04:49:50.161969+0000 b8192 1=1+0) (iversion lock) caps={15429=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d8a4100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000028f:[<0x10000000015/3440 v518>,<0x10000000014/1 v2937>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x1000000028f:[<0x10000000015/3440 v654>,<0x10000000014/1 v7931>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.195 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.821+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002cc [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2685 auth v704 ap=1 s=16384 n(v0 rc2024-06-02T04:49:52.022535+0000 b16384 1=1+0) (iversion lock) caps={15429=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d8a4680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000002cc:[<0x10000000015/2685 v576>,<0x10000000014/1 v2937>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x100000002cc:[<0x10000000015/2685 v704>,<0x10000000014/1 v7931>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.195 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.822+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002ab [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2663 auth v706 ap=1 s=49152 n(v0 rc2024-06-02T04:49:51.984880+0000 b49152 1=1+0) (iversion lock) caps={15429=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d8a4c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000002ab:[<0x10000000015/2663 v578>,<0x10000000014/1 v2937>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x100000002ab:[<0x10000000015/2663 v706>,<0x10000000014/1 v7931>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.195 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.822+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000288 [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2838 auth v708 ap=1 s=417792 n(v0 rc2024-06-02T04:49:52.059613+0000 b417792 1=1+0) (iversion lock) caps={15429=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d8a5180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000288:[<0x10000000015/2838 v580>,<0x10000000014/1 v2937>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x10000000288:[<0x10000000015/2838 v708>,<0x10000000014/1 v7931>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.195 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.822+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000286 [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2836 auth v658 ap=1 s=0 n(v0 1=1+0) (iversion lock) caps={15429=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d8a5700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000286:[<0x10000000015/2836 v514>,<0x10000000014/1 v2937>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x10000000286:[<0x10000000015/2836 v658>,<0x10000000014/1 v7931>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.195 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.822+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002f1 [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/548 auth v662 ap=1 s=8192 n(v0 rc2024-06-02T04:49:49.745184+0000 b8192 1=1+0) (iversion lock) caps={15429=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d8b4000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000002f1:[<0x10000000015/548 v526>,<0x10000000014/1 v2937>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x100000002f1:[<0x10000000015/548 v662>,<0x10000000014/1 v7931>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.195 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.823+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000022a [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/1247 auth v666 ap=1 s=73728 n(v0 rc2024-06-02T04:49:51.861401+0000 b73728 1=1+0) (iversion lock) caps={15429=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d8b4580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000022a:[<0x10000000015/1247 v542>,<0x10000000014/1 v2937>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x1000000022a:[<0x10000000015/1247 v666>,<0x10000000014/1 v7931>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.195 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.823+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000023e [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2603 auth v670 ap=1 s=32768 n(v0 rc2024-06-02T04:49:51.895225+0000 b32768 1=1+0) (iversion lock) caps={15429=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d8b4b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000023e:[<0x10000000015/2603 v546>,<0x10000000014/1 v2937>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x1000000023e:[<0x10000000015/2603 v670>,<0x10000000014/1 v7931>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.195 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.823+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000267 [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3764 auth v710 ap=1 s=8192 n(v0 rc2024-06-02T04:49:52.117505+0000 b8192 1=1+0) (iversion lock) caps={15429=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d8b5080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000267:[<0x10000000015/3764 v582>,<0x10000000014/1 v2937>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x10000000267:[<0x10000000015/3764 v710>,<0x10000000014/1 v7931>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.195 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.823+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002fc [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3080 auth v712 ap=1 s=16384 n(v0 rc2024-06-02T04:49:52.072878+0000 b16384 1=1+0) (iversion lock) caps={15429=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d8b5600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000002fc:[<0x10000000015/3080 v584>,<0x10000000014/1 v2937>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x100000002fc:[<0x10000000015/3080 v712>,<0x10000000014/1 v7931>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.195 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.823+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000334 [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3394_vm auth v714 ap=1 s=8192 n(v0 rc2024-06-02T04:49:52.081250+0000 b8192 1=1+0) (iversion lock) caps={15429=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d8b5b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000334:[<0x10000000015/3394_vm v586>,<0x10000000014/1 v2937>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x10000000334:[<0x10000000015/3394_vm v714>,<0x10000000014/1 v7931>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.196 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.823+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002d1 [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2754 auth v716 ap=1 s=16384 n(v0 rc2024-06-02T04:49:52.044951+0000 b16384 1=1+0) (iversion lock) caps={15429=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d8b6100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000002d1:[<0x10000000015/2754 v588>,<0x10000000014/1 v2937>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x100000002d1:[<0x10000000015/2754 v716>,<0x10000000014/1 v7931>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.196 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.824+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000374 [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/12199 auth v674 ap=1 s=0 n(v0 1=1+0) (iversion lock) caps={15429=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d8b6680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000374:[<0x10000000015/12199 v528>,<0x10000000014/1 v2937>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x10000000374:[<0x10000000015/12199 v674>,<0x10000000014/1 v7931>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.196 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.824+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002ac [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3455 auth v718 ap=1 s=40960 n(v0 rc2024-06-02T04:49:52.085052+0000 b40960 1=1+0) (iversion lock) caps={15429=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d8b6c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000002ac:[<0x10000000015/3455 v590>,<0x10000000014/1 v2937>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x100000002ac:[<0x10000000015/3455 v718>,<0x10000000014/1 v7931>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.196 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.824+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000037f [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/12182_fsm auth v720 ap=1 s=24576 n(v0 rc2024-06-02T04:49:52.128561+0000 b24576 1=1+0) (iversion lock) caps={15429=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d8b7180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000037f:[<0x10000000015/12182_fsm v592>,<0x10000000014/1 v2937>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x1000000037f:[<0x10000000015/12182_fsm v720>,<0x10000000014/1 v7931>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.196 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.824+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000379 [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/12207 auth v724 ap=1 s=8192 n(v0 rc2024-06-02T04:49:52.145357+0000 b8192 1=1+0) (iversion lock) caps={15429=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d8be000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000379:[<0x10000000015/12207 v594>,<0x10000000014/1 v2937>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x10000000379:[<0x10000000015/12207 v724>,<0x10000000014/1 v7931>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.196 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.824+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000022e [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/1259 auth v722 ap=1 s=90112 n(v0 rc2024-06-02T04:49:57.811083+0000 b90112 1=1+0) (iversion lock) caps={15429=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d8b7700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000022e:[<0x10000000015/1259 v600>,<0x10000000014/1 v2937>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x1000000022e:[<0x10000000015/1259 v722>,<0x10000000014/1 v7931>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.196 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.824+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000233 [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2610 auth v726 ap=1 s=24576 n(v0 rc2024-06-02T04:49:51.934321+0000 b24576 1=1+0) (iversion lock) caps={15429=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d8be580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000233:[<0x10000000015/2610 v596>,<0x10000000014/1 v2937>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x10000000233:[<0x10000000015/2610 v726>,<0x10000000014/1 v7931>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.196 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.825+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002ea [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3606 auth v728 ap=1 s=16384 n(v0 rc2024-06-02T04:49:52.110983+0000 b16384 1=1+0) (iversion lock) caps={15429=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d8beb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000002ea:[<0x10000000015/3606 v598>,<0x10000000014/1 v2937>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x100000002ea:[<0x10000000015/3606 v728>,<0x10000000014/1 v7931>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.196 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.826+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000243 [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2613 auth v678 ap=1 s=0 n(v0 1=1+0) (iversion lock) caps={15429=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d8bf080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000243:[<0x10000000015/2613 v524>,<0x10000000014/1 v2937>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x10000000243:[<0x10000000015/2613 v678>,<0x10000000014/1 v7931>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.196 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.826+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000024f [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2615 auth v656 ap=1 s=8192 n(v0 rc2024-06-02T04:49:51.941192+0000 b8192 1=1+0) (iversion lock) caps={15429=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d82c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000024f:[<0x10000000015/2615 v564>,<0x10000000014/1 v2937>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x1000000024f:[<0x10000000015/2615 v656>,<0x10000000014/1 v7931>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.196 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.826+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000275 [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3456_fsm auth v660 ap=1 s=24576 n(v0 rc2024-06-02T04:49:52.087009+0000 b24576 1=1+0) (iversion lock) caps={15429=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d82c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000275:[<0x10000000015/3456_fsm v566>,<0x10000000014/1 v2937>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x10000000275:[<0x10000000015/3456_fsm v660>,<0x10000000014/1 v7931>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.196 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.826+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000376 [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/12202 auth v664 ap=1 s=8192 n(v0 rc2024-06-02T04:49:52.141713+0000 b8192 1=1+0) (iversion lock) caps={15429=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d82cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000376:[<0x10000000015/12202 v568>,<0x10000000014/1 v2937>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x10000000376:[<0x10000000015/12202 v664>,<0x10000000014/1 v7931>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.197 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.826+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000031c [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/1247_vm auth v668 ap=1 s=8192 n(v0 rc2024-06-02T04:49:51.862810+0000 b8192 1=1+0) (iversion lock) caps={15429=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d82d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000031c:[<0x10000000015/1247_vm v570>,<0x10000000014/1 v2937>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x1000000031c:[<0x10000000015/1247_vm v668>,<0x10000000014/1 v7931>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.197 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.826+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000024c [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2605 auth v672 ap=1 s=16384 n(v0 rc2024-06-02T04:49:51.897597+0000 b16384 1=1+0) (iversion lock) caps={15429=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d82d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000024c:[<0x10000000015/2605 v572>,<0x10000000014/1 v2937>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x1000000024c:[<0x10000000015/2605 v672>,<0x10000000014/1 v7931>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.197 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.827+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000268 [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3764_fsm auth v676 ap=1 s=24576 n(v0 rc2024-06-02T04:49:52.118985+0000 b24576 1=1+0) (iversion lock) caps={15429=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d82db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000268:[<0x10000000015/3764_fsm v574>,<0x10000000014/1 v2937>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x10000000268:[<0x10000000015/3764_fsm v676>,<0x10000000014/1 v7931>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.197 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.827+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000033a [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2608_vm auth v680 ap=1 s=8192 n(v0 rc2024-06-02T04:49:51.922442+0000 b8192 1=1+0) (iversion lock) caps={15429=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d82e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000033a:[<0x10000000015/2608_vm v576>,<0x10000000014/1 v2937>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x1000000033a:[<0x10000000015/2608_vm v680>,<0x10000000014/1 v7931>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.197 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.827+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002ed [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3767 auth v684 ap=1 s=16384 n(v0 rc2024-06-02T04:49:52.123528+0000 b16384 1=1+0) (iversion lock) caps={15429=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d82e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000002ed:[<0x10000000015/3767 v578>,<0x10000000014/1 v2937>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x100000002ed:[<0x10000000015/3767 v684>,<0x10000000014/1 v7931>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.197 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.827+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000242 [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2995 auth v696 ap=1 s=0 n(v0 1=1+0) (iversion lock) caps={15429=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d82f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000242:[<0x10000000015/2995 v584>,<0x10000000014/1 v2937>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x10000000242:[<0x10000000015/2995 v696>,<0x10000000014/1 v7931>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.197 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.827+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000033e [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3456_vm auth v688 ap=1 s=8192 n(v0 rc2024-06-02T04:49:52.088040+0000 b8192 1=1+0) (iversion lock) caps={15429=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d82ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000033e:[<0x10000000015/3456_vm v580>,<0x10000000014/1 v2937>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x1000000033e:[<0x10000000015/3456_vm v688>,<0x10000000014/1 v7931>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.197 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.828+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002b4 [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2669 auth v692 ap=1 s=16384 n(v0 rc2024-06-02T04:49:51.992542+0000 b16384 1=1+0) (iversion lock) caps={15429=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d82f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000002b4:[<0x10000000015/2669 v582>,<0x10000000014/1 v2937>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x100000002b4:[<0x10000000015/2669 v692>,<0x10000000014/1 v7931>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.197 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.828+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002bd [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3503 auth v700 ap=1 s=8192 n(v0 rc2024-06-02T04:49:49.978788+0000 b8192 1=1+0) (iversion lock) caps={15429=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d830000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000002bd:[<0x10000000015/3503 v586>,<0x10000000014/1 v2937>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x100000002bd:[<0x10000000015/3503 v700>,<0x10000000014/1 v7931>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.197 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.828+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000368 [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2607_fsm auth v708 ap=1 s=24576 n(v0 rc2024-06-02T04:49:51.908721+0000 b24576 1=1+0) (iversion lock) caps={15429=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d830b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000368:[<0x10000000015/2607_fsm v590>,<0x10000000014/1 v2937>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x10000000368:[<0x10000000015/2607_fsm v708>,<0x10000000014/1 v7931>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.197 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.828+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000375 [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/12201 auth v704 ap=1 s=8192 n(v0 rc2024-06-02T04:49:51.096549+0000 b8192 1=1+0) (iversion lock) caps={15429=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d830580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000375:[<0x10000000015/12201 v588>,<0x10000000014/1 v2937>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x10000000375:[<0x10000000015/12201 v704>,<0x10000000014/1 v7931>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.198 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.828+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002e0 [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2699 auth v712 ap=1 s=8192 n(v0 rc2024-06-02T04:49:49.815034+0000 b8192 1=1+0) (iversion lock) caps={15429=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d831080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000002e0:[<0x10000000015/2699 v592>,<0x10000000014/1 v2937>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x100000002e0:[<0x10000000015/2699 v712>,<0x10000000014/1 v7931>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.198 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.828+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002a2 [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2658 auth v716 ap=1 s=106496 n(v0 rc2024-06-02T04:49:51.977842+0000 b106496 1=1+0) (iversion lock) caps={15429=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d831600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000002a2:[<0x10000000015/2658 v594>,<0x10000000014/1 v2937>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x100000002a2:[<0x10000000015/2658 v716>,<0x10000000014/1 v7931>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.198 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.828+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002f8 [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/828 auth v724 ap=1 s=8192 n(v0 rc2024-06-02T04:49:49.716112+0000 b8192 1=1+0) (iversion lock) caps={15429=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d832100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000002f8:[<0x10000000015/828 v598>,<0x10000000014/1 v2937>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x100000002f8:[<0x10000000015/828 v724>,<0x10000000014/1 v7931>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.198 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.828+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000333 [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2612_vm auth v720 ap=1 s=8192 n(v0 rc2024-06-02T04:49:51.940324+0000 b8192 1=1+0) (iversion lock) caps={15429=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d831b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000333:[<0x10000000015/2612_vm v596>,<0x10000000014/1 v2937>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x10000000333:[<0x10000000015/2612_vm v720>,<0x10000000014/1 v7931>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.198 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.829+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000387 [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/12202_vm auth v728 ap=1 s=8192 n(v0 rc2024-06-02T04:49:52.144640+0000 b8192 1=1+0) (iversion lock) caps={15429=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d832680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000387:[<0x10000000015/12202_vm v600>,<0x10000000014/1 v2937>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x10000000387:[<0x10000000015/12202_vm v728>,<0x10000000014/1 v7931>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.198 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.829+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000032e [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2616_vm auth{0=1} v736 ap=1 s=8192 n(v0 rc2024-06-02T04:49:51.950436+0000 b8192 1=1+0) (iversion lock) caps={15429=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x56376d833180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000032e:[<0x10000000015/2616_vm v604>,<0x10000000014/1 v2937>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x1000000032e:[<0x10000000015/2616_vm v736>,<0x10000000014/1 v7931>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.198 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.829+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002b1 [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2666 auth v744 ap=1 s=16384 n(v0 rc2024-06-02T04:49:51.988766+0000 b16384 1=1+0) (iversion lock) caps={15429=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d834000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000002b1:[<0x10000000015/2666 v608>,<0x10000000014/1 v2937>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x100000002b1:[<0x10000000015/2666 v744>,<0x10000000014/1 v7931>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.198 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.829+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002e9 [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3605 auth{0=1} v732 ap=1 s=16384 n(v0 rc2024-06-02T04:49:52.109985+0000 b16384 1=1+0) (iversion lock) caps={15429=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x56376d832c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000002e9:[<0x10000000015/3605 v602>,<0x10000000014/1 v2937>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x100000002e9:[<0x10000000015/3605 v732>,<0x10000000014/1 v7931>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.198 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.829+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002e7 [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3609 auth v740 ap=1 s=32768 n(v0 rc2024-06-02T04:49:52.115131+0000 b32768 1=1+0) (iversion lock) caps={15429=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d833700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000002e7:[<0x10000000015/3609 v606>,<0x10000000014/1 v2937>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x100000002e7:[<0x10000000015/3609 v740>,<0x10000000014/1 v7931>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.198 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.830+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000345 [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2603_vm auth v748 ap=1 s=8192 n(v0 rc2024-06-02T04:49:51.896594+0000 b8192 1=1+0) (iversion lock) caps={15429=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d834580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000345:[<0x10000000015/2603_vm v610>,<0x10000000014/1 v2937>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x10000000345:[<0x10000000015/2603_vm v748>,<0x10000000014/1 v7931>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.199 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.830+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000270 [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/826 auth v752 ap=1 s=0 n(v0 1=1+0) (iversion lock) caps={15429=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d834b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000270:[<0x10000000015/826 v612>,<0x10000000014/1 v2937>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x10000000270:[<0x10000000015/826 v752>,<0x10000000014/1 v7931>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.199 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.830+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000032d [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2617_vm auth v756 ap=1 s=8192 n(v0 rc2024-06-02T04:49:51.955143+0000 b8192 1=1+0) (iversion lock) caps={15429=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d835080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000032d:[<0x10000000015/2617_vm v614>,<0x10000000014/1 v2937>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x1000000032d:[<0x10000000015/2617_vm v756>,<0x10000000014/1 v7931>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.199 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.830+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000347 [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2601_vm auth v760 ap=1 s=8192 n(v0 rc2024-06-02T04:49:51.891249+0000 b8192 1=1+0) (iversion lock) caps={15429=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d835600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000347:[<0x10000000015/2601_vm v616>,<0x10000000014/1 v2937>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x10000000347:[<0x10000000015/2601_vm v760>,<0x10000000014/1 v7931>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.199 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.830+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000277 [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3541 auth v764 ap=1 s=8192 n(v0 rc2024-06-02T04:49:52.088922+0000 b8192 1=1+0) (iversion lock) caps={15429=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d835b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000277:[<0x10000000015/3541 v618>,<0x10000000014/1 v2937>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x10000000277:[<0x10000000015/3541 v764>,<0x10000000014/1 v7931>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.199 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.830+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000263 [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3600 auth v768 ap=1 s=8192 n(v0 rc2024-06-02T04:49:52.094164+0000 b8192 1=1+0) (iversion lock) caps={15429=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d836100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000263:[<0x10000000015/3600 v620>,<0x10000000014/1 v2937>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x10000000263:[<0x10000000015/3600 v768>,<0x10000000014/1 v7931>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.199 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.831+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002cf [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2688 auth v772 ap=1 s=40960 n(v0 rc2024-06-02T04:49:52.025185+0000 b40960 1=1+0) (iversion lock) caps={15429=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d836680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000002cf:[<0x10000000015/2688 v622>,<0x10000000014/1 v2937>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x100000002cf:[<0x10000000015/2688 v772>,<0x10000000014/1 v7931>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.199 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.831+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000230 [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2604 auth v776 ap=1 s=0 n(v0 1=1+0) (iversion lock) caps={15429=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d836c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000230:[<0x10000000015/2604 v624>,<0x10000000014/1 v2937>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x10000000230:[<0x10000000015/2604 v776>,<0x10000000014/1 v7931>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.199 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.831+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000034d [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3439_vm auth v780 ap=1 s=0 n(v0 1=1+0) (iversion lock) caps={15429=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d837180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000034d:[<0x10000000015/3439_vm v626>,<0x10000000014/1 v2937>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x1000000034d:[<0x10000000015/3439_vm v780>,<0x10000000014/1 v7931>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.199 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.831+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000024b [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2609 auth v784 ap=1 s=286720 n(v0 rc2024-06-02T04:49:51.930802+0000 b286720 1=1+0) (iversion lock) caps={15429=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d837700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000024b:[<0x10000000015/2609 v628>,<0x10000000014/1 v2937>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x1000000024b:[<0x10000000015/2609 v784>,<0x10000000014/1 v7931>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.199 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.831+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000228 [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/1255 auth v788 ap=1 s=606208 n(v0 rc2024-06-02T04:49:51.882587+0000 b606208 1=1+0) (iversion lock) caps={15429=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d84c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000228:[<0x10000000015/1255 v630>,<0x10000000014/1 v2937>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x10000000228:[<0x10000000015/1255 v788>,<0x10000000014/1 v7931>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.199 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.832+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000240 [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2612 auth v792 ap=1 s=8192 n(v0 rc2024-06-02T04:49:51.937435+0000 b8192 1=1+0) (iversion lock) caps={15429=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d84c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000240:[<0x10000000015/2612 v632>,<0x10000000014/1 v2937>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x10000000240:[<0x10000000015/2612 v792>,<0x10000000014/1 v7931>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.200 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.832+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000298 [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2650 auth v796 ap=1 s=16384 n(v0 rc2024-06-02T04:49:51.967884+0000 b16384 1=1+0) (iversion lock) caps={15429=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d84cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000298:[<0x10000000015/2650 v634>,<0x10000000014/1 v2937>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x10000000298:[<0x10000000015/2650 v796>,<0x10000000014/1 v7931>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.200 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.832+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000023c [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2602 auth v800 ap=1 s=49152 n(v0 rc2024-06-02T04:49:51.892414+0000 b49152 1=1+0) (iversion lock) caps={15429=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d84d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000023c:[<0x10000000015/2602 v636>,<0x10000000014/1 v2937>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x1000000023c:[<0x10000000015/2602 v800>,<0x10000000014/1 v7931>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.200 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.832+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000352 [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2834_vm auth v804 ap=1 s=0 n(v0 1=1+0) (iversion lock) caps={15429=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d84d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000352:[<0x10000000015/2834_vm v638>,<0x10000000014/1 v2937>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x10000000352:[<0x10000000015/2834_vm v804>,<0x10000000014/1 v7931>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.200 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.832+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002c3 [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3395 auth v808 ap=1 s=16384 n(v0 rc2024-06-02T04:49:52.082529+0000 b16384 1=1+0) (iversion lock) caps={15429=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d84db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000002c3:[<0x10000000015/3395 v640>,<0x10000000014/1 v2937>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x100000002c3:[<0x10000000015/3395 v808>,<0x10000000014/1 v7931>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.200 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.832+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002ba [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2675 auth v812 ap=1 s=180224 n(v0 rc2024-06-02T04:49:52.015946+0000 b180224 1=1+0) (iversion lock) caps={15429=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d84e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000002ba:[<0x10000000015/2675 v642>,<0x10000000014/1 v2937>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x100000002ba:[<0x10000000015/2675 v812>,<0x10000000014/1 v7931>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.200 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.833+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002f4 [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/174 auth v820 ap=1 s=8192 n(v0 rc2024-06-02T04:49:49.734921+0000 b8192 1=1+0) (iversion lock) caps={15429=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d84ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000002f4:[<0x10000000015/174 v646>,<0x10000000014/1 v2937>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x100000002f4:[<0x10000000015/174 v820>,<0x10000000014/1 v7931>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.200 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.833+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000036c [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/12186 auth v816 ap=1 s=8192 n(v0 rc2024-06-02T04:49:51.055923+0000 b8192 1=1+0) (iversion lock) caps={15429=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d84e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000036c:[<0x10000000015/12186 v644>,<0x10000000014/1 v2937>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x1000000036c:[<0x10000000015/12186 v816>,<0x10000000014/1 v7931>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.200 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.833+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000025f [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3602 auth v824 ap=1 s=8192 n(v0 rc2024-06-02T04:49:52.100427+0000 b8192 1=1+0) (iversion lock) caps={15429=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d84f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000025f:[<0x10000000015/3602 v648>,<0x10000000014/1 v2937>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x1000000025f:[<0x10000000015/3602 v824>,<0x10000000014/1 v7931>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.200 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.833+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000027a [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2224 auth v828 ap=1 s=0 n(v0 1=1+0) (iversion lock) caps={15429=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d84f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000027a:[<0x10000000015/2224 v650>,<0x10000000014/1 v2937>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x1000000027a:[<0x10000000015/2224 v828>,<0x10000000014/1 v7931>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.200 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 04:50:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T04:50:17.833+0000 7f2b3eee6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002d0 [2,head] /volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2689 auth v832 ap=1 s=49152 n(v0 rc2024-06-02T04:49:52.026195+0000 b49152 1=1+0) (iversion lock) caps={15429=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56376d854000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000002d0:[<0x10000000015/2689 v652>,<0x10000000014/1 v2937>,<0x10000000006/base v532>,<0x10000000005/data v105>,<0x10000000003/postgres v25>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v41>,<0x10000000001/sv_0 v57>,<0x10000000000/qa v43>,<0x1/volumes v36>]//[3]","memoryvalue":"(4)0x100000002d0:[<0x10000000015/2689 v832>,<0x10000000014/1 v7931>,<0x10000000006/base v727>,<0x10000000005/data v251>,<0x10000000003/postgres v49>,<0x10000000002/48e4c007-96b2-4b96-99d9-566b25a0083e v31>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v68>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-02T04:50:18.396 INFO:teuthology.orchestra.run.smithi076.stderr:1400000 of 3200000 tuples (43%) done (elapsed 14.71 s, remaining 18.91 s) 2024-06-02T04:50:18.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: scrub queued for path: / 2024-06-02T04:50:18.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: scrub summary: idle+waiting paths [/] 2024-06-02T04:50:18.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: scrub summary: active paths [/] 2024-06-02T04:50:18.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: scrub summary: active paths [/] 2024-06-02T04:50:18.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: Scrub error on inode 0x1000000046a (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/3603_vm) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: Scrub error on inode 0x1000000046b (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/3575) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.598 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: Scrub error on inode 0x1000000046c (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/3467) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.598 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: Scrub error on inode 0x1000000046d (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2617_fsm) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.598 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: Scrub error on inode 0x1000000046e (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/3119) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.598 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: Scrub error on inode 0x10000000471 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2603_fsm) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.598 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: Scrub error on inode 0x1000000046f (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2674) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.598 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: Scrub error on inode 0x10000000470 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2668) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.598 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: Scrub error on inode 0x10000000472 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/6110) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.598 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: Scrub error on inode 0x10000000473 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2702) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.598 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: Scrub error on inode 0x10000000474 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2655) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.598 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: Scrub error on inode 0x10000000476 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/3712) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.598 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: Scrub error on inode 0x10000000475 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/3597) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.599 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: Scrub error on inode 0x10000000477 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2608) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.599 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: Scrub error on inode 0x10000000479 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/12187_vm) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.599 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: Scrub error on inode 0x1000000047a (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/3164) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.599 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: Scrub error on inode 0x1000000047b (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/3501_vm) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.599 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: Scrub error on inode 0x1000000047c (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/6111) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.599 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: Scrub error on inode 0x10000000478 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2831) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.599 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: Scrub error on inode 0x1000000047d (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2682) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.599 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: Scrub error on inode 0x1000000047e (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/113) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.599 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: Scrub error on inode 0x1000000047f (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/3604) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.599 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: Scrub error on inode 0x10000000480 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2691) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.599 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: Scrub error on inode 0x10000000481 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2605_vm) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.599 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: Scrub error on inode 0x10000000484 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2663) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.599 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: Scrub error on inode 0x10000000482 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/3440) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.600 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: Scrub error on inode 0x10000000486 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2836) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.600 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: Scrub error on inode 0x10000000488 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/1247) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.600 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: Scrub error on inode 0x10000000487 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/548) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.600 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: Scrub error on inode 0x10000000485 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2838) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.600 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: Scrub error on inode 0x10000000483 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2685) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.600 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: Scrub error on inode 0x1000000048a (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/3764) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.600 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: Scrub error on inode 0x1000000048b (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/3080) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.600 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: Scrub error on inode 0x10000000489 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2603) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.600 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: Scrub error on inode 0x1000000048c (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/3394_vm) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.600 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: Scrub error on inode 0x1000000048d (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2754) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.600 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: Scrub error on inode 0x1000000048e (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/12199) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.601 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: Scrub error on inode 0x1000000048f (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/3455) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.601 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: Scrub error on inode 0x10000000490 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/12182_fsm) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.601 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: Scrub error on inode 0x10000000491 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/1259) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.601 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: Scrub error on inode 0x10000000492 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/12207) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.601 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: Scrub error on inode 0x10000000493 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2610) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.601 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: Scrub error on inode 0x10000000495 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2613) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.601 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: Scrub error on inode 0x10000000494 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/3606) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.601 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: Scrub error on inode 0x10000000320 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3603_vm) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.601 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: Scrub error on inode 0x100000002e3 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3467) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.601 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: Scrub error on inode 0x10000000235 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2617_fsm) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.601 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: Scrub error on inode 0x100000002f6 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3119) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.601 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: Scrub error on inode 0x100000002df (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3575) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.601 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: Scrub error on inode 0x100000002b9 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2674) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.602 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: Scrub error on inode 0x100000002b3 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2668) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.602 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: Scrub error on inode 0x1000000023f (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2603_fsm) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.602 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: Scrub error on inode 0x100000002e2 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2702) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.602 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: Scrub error on inode 0x1000000029e (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2655) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.602 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: Scrub error on inode 0x10000000304 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/6110) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.602 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: Scrub error on inode 0x100000002fa (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3597) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.602 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: Scrub error on inode 0x100000002e6 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3712) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.602 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: Scrub error on inode 0x10000000252 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2608) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.602 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: Scrub error on inode 0x10000000280 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2831) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.602 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: Scrub error on inode 0x1000000038c (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/12187_vm) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.602 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: Scrub error on inode 0x100000002ad (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3164) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.602 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: Scrub error on inode 0x10000000337 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3501_vm) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.603 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: Scrub error on inode 0x10000000305 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/6111) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.603 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: Scrub error on inode 0x100000002c5 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2682) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.603 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: Scrub error on inode 0x100000002f2 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/113) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.603 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: Scrub error on inode 0x100000002e8 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3604) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.603 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: Scrub error on inode 0x10000000340 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2605_vm) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.603 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: Scrub error on inode 0x100000002d5 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2691) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.603 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: Scrub error on inode 0x1000000028f (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3440) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.603 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: Scrub error on inode 0x100000002cc (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2685) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.603 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: Scrub error on inode 0x100000002ab (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2663) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.603 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: Scrub error on inode 0x10000000288 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2838) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.603 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: Scrub error on inode 0x10000000286 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2836) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.603 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: Scrub error on inode 0x100000002f1 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/548) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.603 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: Scrub error on inode 0x1000000022a (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/1247) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.604 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: Scrub error on inode 0x1000000023e (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2603) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.604 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: Scrub error on inode 0x10000000267 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3764) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.604 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: Scrub error on inode 0x100000002fc (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3080) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.604 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: Scrub error on inode 0x10000000334 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3394_vm) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.604 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: Scrub error on inode 0x100000002d1 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2754) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.604 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: Scrub error on inode 0x10000000374 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/12199) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.604 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: Scrub error on inode 0x100000002ac (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3455) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.604 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: Scrub error on inode 0x1000000037f (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/12182_fsm) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.604 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: Scrub error on inode 0x10000000379 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/12207) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.604 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: Scrub error on inode 0x1000000022e (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/1259) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.604 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: Scrub error on inode 0x10000000233 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2610) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.604 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: Scrub error on inode 0x100000002ea (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3606) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.604 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: Scrub error on inode 0x10000000243 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2613) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.605 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: Scrub error on inode 0x1000000024f (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2615) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.605 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: Scrub error on inode 0x10000000275 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3456_fsm) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.605 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: Scrub error on inode 0x10000000376 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/12202) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.605 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: Scrub error on inode 0x1000000031c (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/1247_vm) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.605 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: Scrub error on inode 0x1000000024c (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2605) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.605 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: Scrub error on inode 0x10000000268 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3764_fsm) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.605 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: Scrub error on inode 0x1000000033a (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2608_vm) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.605 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: Scrub error on inode 0x100000002ed (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3767) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.605 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: Scrub error on inode 0x10000000242 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2995) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.605 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: Scrub error on inode 0x1000000033e (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3456_vm) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.605 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: Scrub error on inode 0x100000002b4 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2669) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.605 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: Scrub error on inode 0x100000002bd (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3503) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.605 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: Scrub error on inode 0x10000000368 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2607_fsm) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.605 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: Scrub error on inode 0x10000000375 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/12201) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.606 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: Scrub error on inode 0x100000002e0 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2699) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.606 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: Scrub error on inode 0x100000002a2 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2658) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.606 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: Scrub error on inode 0x100000002f8 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/828) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.606 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: Scrub error on inode 0x10000000333 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2612_vm) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.606 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: Scrub error on inode 0x10000000387 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/12202_vm) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.606 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: Scrub error on inode 0x1000000032e (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2616_vm) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.606 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: Scrub error on inode 0x100000002b1 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2666) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.606 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: Scrub error on inode 0x100000002e9 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3605) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.606 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: Scrub error on inode 0x100000002e7 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3609) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.606 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:18 smithi119 ceph-mon[46633]: scrub summary: idle+waiting paths [/] 2024-06-02T04:50:18.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: scrub queued for path: / 2024-06-02T04:50:18.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: scrub summary: idle+waiting paths [/] 2024-06-02T04:50:18.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: scrub summary: active paths [/] 2024-06-02T04:50:18.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: scrub summary: active paths [/] 2024-06-02T04:50:18.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: Scrub error on inode 0x1000000046a (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/3603_vm) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: Scrub error on inode 0x1000000046b (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/3575) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: Scrub error on inode 0x1000000046c (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/3467) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.683 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: Scrub error on inode 0x1000000046d (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2617_fsm) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.683 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: Scrub error on inode 0x1000000046e (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/3119) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.683 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: Scrub error on inode 0x10000000471 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2603_fsm) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.683 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: Scrub error on inode 0x1000000046f (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2674) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.683 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: Scrub error on inode 0x10000000470 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2668) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.683 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: Scrub error on inode 0x10000000472 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/6110) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.683 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: Scrub error on inode 0x10000000473 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2702) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.683 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: Scrub error on inode 0x10000000474 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2655) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.683 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: Scrub error on inode 0x10000000476 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/3712) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.683 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: Scrub error on inode 0x10000000475 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/3597) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.683 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: Scrub error on inode 0x10000000477 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2608) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.683 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: Scrub error on inode 0x10000000479 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/12187_vm) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.684 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: Scrub error on inode 0x1000000047a (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/3164) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.684 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: Scrub error on inode 0x1000000047b (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/3501_vm) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.684 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: Scrub error on inode 0x1000000047c (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/6111) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.684 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: Scrub error on inode 0x10000000478 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2831) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.684 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: Scrub error on inode 0x1000000047d (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2682) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.684 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: Scrub error on inode 0x1000000047e (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/113) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.684 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: Scrub error on inode 0x1000000047f (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/3604) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.684 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: Scrub error on inode 0x10000000480 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2691) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.684 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: Scrub error on inode 0x10000000481 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2605_vm) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.684 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: Scrub error on inode 0x10000000484 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2663) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.684 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: Scrub error on inode 0x10000000482 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/3440) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.684 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: Scrub error on inode 0x10000000486 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2836) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.684 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: Scrub error on inode 0x10000000488 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/1247) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.685 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: Scrub error on inode 0x10000000487 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/548) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.685 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: Scrub error on inode 0x10000000485 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2838) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.685 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: Scrub error on inode 0x10000000483 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2685) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.685 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: Scrub error on inode 0x1000000048a (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/3764) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.685 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: Scrub error on inode 0x1000000048b (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/3080) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.685 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: Scrub error on inode 0x10000000489 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2603) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.685 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: Scrub error on inode 0x1000000048c (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/3394_vm) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.685 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: Scrub error on inode 0x1000000048d (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2754) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.685 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: Scrub error on inode 0x1000000048e (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/12199) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.685 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: Scrub error on inode 0x1000000048f (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/3455) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.685 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: Scrub error on inode 0x10000000490 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/12182_fsm) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.685 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: Scrub error on inode 0x10000000491 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/1259) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.685 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: Scrub error on inode 0x10000000492 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/12207) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.686 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: Scrub error on inode 0x10000000493 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2610) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.686 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: Scrub error on inode 0x10000000495 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2613) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.686 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: Scrub error on inode 0x10000000494 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/3606) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.686 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: Scrub error on inode 0x10000000320 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3603_vm) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.686 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: Scrub error on inode 0x100000002e3 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3467) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.686 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: Scrub error on inode 0x10000000235 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2617_fsm) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.686 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: Scrub error on inode 0x100000002f6 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3119) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.686 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: Scrub error on inode 0x100000002df (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3575) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.686 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: Scrub error on inode 0x100000002b9 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2674) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.686 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: Scrub error on inode 0x100000002b3 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2668) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.686 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: Scrub error on inode 0x1000000023f (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2603_fsm) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.686 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: Scrub error on inode 0x100000002e2 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2702) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.686 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: Scrub error on inode 0x1000000029e (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2655) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.687 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: Scrub error on inode 0x10000000304 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/6110) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.687 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: Scrub error on inode 0x100000002fa (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3597) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.687 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: Scrub error on inode 0x100000002e6 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3712) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.687 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: Scrub error on inode 0x10000000252 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2608) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.687 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: Scrub error on inode 0x10000000280 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2831) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.687 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: Scrub error on inode 0x1000000038c (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/12187_vm) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.687 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: Scrub error on inode 0x100000002ad (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3164) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.687 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: Scrub error on inode 0x10000000337 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3501_vm) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.687 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: Scrub error on inode 0x10000000305 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/6111) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.687 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: Scrub error on inode 0x100000002c5 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2682) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.687 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: Scrub error on inode 0x100000002f2 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/113) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.687 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: Scrub error on inode 0x100000002e8 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3604) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.687 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: Scrub error on inode 0x10000000340 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2605_vm) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.688 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: Scrub error on inode 0x100000002d5 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2691) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.688 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: Scrub error on inode 0x1000000028f (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3440) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.688 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: Scrub error on inode 0x100000002cc (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2685) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.688 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: Scrub error on inode 0x100000002ab (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2663) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.688 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: Scrub error on inode 0x10000000288 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2838) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.688 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: Scrub error on inode 0x10000000286 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2836) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.688 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: Scrub error on inode 0x100000002f1 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/548) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.688 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: Scrub error on inode 0x1000000022a (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/1247) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.689 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: Scrub error on inode 0x1000000023e (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2603) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.689 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: Scrub error on inode 0x10000000267 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3764) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.689 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: Scrub error on inode 0x100000002fc (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3080) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.689 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: Scrub error on inode 0x10000000334 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3394_vm) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.689 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: Scrub error on inode 0x100000002d1 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2754) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.689 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: Scrub error on inode 0x10000000374 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/12199) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.689 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: Scrub error on inode 0x100000002ac (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3455) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.689 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: Scrub error on inode 0x1000000037f (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/12182_fsm) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.689 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: Scrub error on inode 0x10000000379 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/12207) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.689 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: Scrub error on inode 0x1000000022e (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/1259) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.689 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: Scrub error on inode 0x10000000233 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2610) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.689 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: Scrub error on inode 0x100000002ea (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3606) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.689 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: Scrub error on inode 0x10000000243 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2613) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.690 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: Scrub error on inode 0x1000000024f (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2615) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.690 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: Scrub error on inode 0x10000000275 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3456_fsm) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.690 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: Scrub error on inode 0x10000000376 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/12202) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.690 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: Scrub error on inode 0x1000000031c (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/1247_vm) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.690 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: Scrub error on inode 0x1000000024c (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2605) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.690 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: Scrub error on inode 0x10000000268 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3764_fsm) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.690 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: Scrub error on inode 0x1000000033a (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2608_vm) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.690 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: Scrub error on inode 0x100000002ed (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3767) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.690 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: Scrub error on inode 0x10000000242 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2995) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.690 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: Scrub error on inode 0x1000000033e (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3456_vm) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.690 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: Scrub error on inode 0x100000002b4 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2669) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.691 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: Scrub error on inode 0x100000002bd (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3503) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.691 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: Scrub error on inode 0x10000000368 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2607_fsm) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.691 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: Scrub error on inode 0x10000000375 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/12201) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.691 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: Scrub error on inode 0x100000002e0 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2699) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.691 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: Scrub error on inode 0x100000002a2 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2658) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.691 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: Scrub error on inode 0x100000002f8 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/828) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.691 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: Scrub error on inode 0x10000000333 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2612_vm) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.691 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: Scrub error on inode 0x10000000387 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/12202_vm) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.691 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: Scrub error on inode 0x1000000032e (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2616_vm) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.691 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: Scrub error on inode 0x100000002b1 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2666) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.691 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: Scrub error on inode 0x100000002e9 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3605) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.692 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: Scrub error on inode 0x100000002e7 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3609) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.692 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:18 smithi192 ceph-mon[47933]: scrub summary: idle+waiting paths [/] 2024-06-02T04:50:18.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: scrub queued for path: / 2024-06-02T04:50:18.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: scrub summary: idle+waiting paths [/] 2024-06-02T04:50:18.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: scrub summary: active paths [/] 2024-06-02T04:50:18.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: scrub summary: active paths [/] 2024-06-02T04:50:18.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: Scrub error on inode 0x1000000046a (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/3603_vm) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.735 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: Scrub error on inode 0x1000000046b (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/3575) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.735 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: Scrub error on inode 0x1000000046c (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/3467) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.735 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: Scrub error on inode 0x1000000046d (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2617_fsm) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.735 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: Scrub error on inode 0x1000000046e (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/3119) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.735 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: Scrub error on inode 0x10000000471 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2603_fsm) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.735 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: Scrub error on inode 0x1000000046f (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2674) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.735 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: Scrub error on inode 0x10000000470 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2668) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.735 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: Scrub error on inode 0x10000000472 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/6110) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.735 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: Scrub error on inode 0x10000000473 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2702) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.735 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: Scrub error on inode 0x10000000474 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2655) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.735 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: Scrub error on inode 0x10000000476 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/3712) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.735 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: Scrub error on inode 0x10000000475 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/3597) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.736 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: Scrub error on inode 0x10000000477 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2608) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.736 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: Scrub error on inode 0x10000000479 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/12187_vm) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.736 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: Scrub error on inode 0x1000000047a (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/3164) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.736 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: Scrub error on inode 0x1000000047b (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/3501_vm) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.736 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: Scrub error on inode 0x1000000047c (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/6111) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.736 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: Scrub error on inode 0x10000000478 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2831) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.736 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: Scrub error on inode 0x1000000047d (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2682) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.736 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: Scrub error on inode 0x1000000047e (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/113) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.736 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: Scrub error on inode 0x1000000047f (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/3604) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.736 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: Scrub error on inode 0x10000000480 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2691) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.736 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: Scrub error on inode 0x10000000481 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2605_vm) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.736 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: Scrub error on inode 0x10000000484 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2663) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.736 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: Scrub error on inode 0x10000000482 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/3440) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.736 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: Scrub error on inode 0x10000000486 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2836) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.737 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: Scrub error on inode 0x10000000488 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/1247) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.737 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: Scrub error on inode 0x10000000487 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/548) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.737 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: Scrub error on inode 0x10000000485 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2838) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.737 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: Scrub error on inode 0x10000000483 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2685) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.737 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: Scrub error on inode 0x1000000048a (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/3764) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.737 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: Scrub error on inode 0x1000000048b (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/3080) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.737 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: Scrub error on inode 0x10000000489 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2603) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.737 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: Scrub error on inode 0x1000000048c (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/3394_vm) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.737 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: Scrub error on inode 0x1000000048d (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2754) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.737 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: Scrub error on inode 0x1000000048e (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/12199) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.737 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: Scrub error on inode 0x1000000048f (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/3455) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.737 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: Scrub error on inode 0x10000000490 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/12182_fsm) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.737 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: Scrub error on inode 0x10000000491 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/1259) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.738 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: Scrub error on inode 0x10000000492 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/12207) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.738 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: Scrub error on inode 0x10000000493 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2610) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.738 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: Scrub error on inode 0x10000000495 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2613) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.738 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: Scrub error on inode 0x10000000494 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/3606) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.738 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: Scrub error on inode 0x10000000320 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3603_vm) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.738 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: Scrub error on inode 0x100000002e3 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3467) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.738 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: Scrub error on inode 0x10000000235 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2617_fsm) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.738 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: Scrub error on inode 0x100000002f6 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3119) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.738 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: Scrub error on inode 0x100000002df (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3575) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.738 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: Scrub error on inode 0x100000002b9 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2674) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.738 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: Scrub error on inode 0x100000002b3 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2668) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.738 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: Scrub error on inode 0x1000000023f (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2603_fsm) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.738 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: Scrub error on inode 0x100000002e2 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2702) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.739 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: Scrub error on inode 0x1000000029e (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2655) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.739 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: Scrub error on inode 0x10000000304 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/6110) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.739 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: Scrub error on inode 0x100000002fa (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3597) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.739 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: Scrub error on inode 0x100000002e6 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3712) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.739 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: Scrub error on inode 0x10000000252 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2608) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.739 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: Scrub error on inode 0x10000000280 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2831) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.739 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: Scrub error on inode 0x1000000038c (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/12187_vm) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.739 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: Scrub error on inode 0x100000002ad (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3164) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.739 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: Scrub error on inode 0x10000000337 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3501_vm) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.739 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: Scrub error on inode 0x10000000305 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/6111) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.739 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: Scrub error on inode 0x100000002c5 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2682) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.739 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: Scrub error on inode 0x100000002f2 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/113) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.739 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: Scrub error on inode 0x100000002e8 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3604) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.740 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: Scrub error on inode 0x10000000340 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2605_vm) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.740 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: Scrub error on inode 0x100000002d5 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2691) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.740 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: Scrub error on inode 0x1000000028f (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3440) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.740 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: Scrub error on inode 0x100000002cc (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2685) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.740 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: Scrub error on inode 0x100000002ab (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2663) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.740 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: Scrub error on inode 0x10000000288 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2838) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.740 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: Scrub error on inode 0x10000000286 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2836) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.740 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: Scrub error on inode 0x100000002f1 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/548) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.740 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: Scrub error on inode 0x1000000022a (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/1247) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.740 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: Scrub error on inode 0x1000000023e (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2603) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.740 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: Scrub error on inode 0x10000000267 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3764) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.740 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: Scrub error on inode 0x100000002fc (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3080) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.740 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: Scrub error on inode 0x10000000334 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3394_vm) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.741 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: Scrub error on inode 0x100000002d1 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2754) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.741 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: Scrub error on inode 0x10000000374 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/12199) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.741 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: Scrub error on inode 0x100000002ac (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3455) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.741 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: Scrub error on inode 0x1000000037f (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/12182_fsm) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.741 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: Scrub error on inode 0x10000000379 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/12207) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.741 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: Scrub error on inode 0x1000000022e (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/1259) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.741 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: Scrub error on inode 0x10000000233 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2610) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.741 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: Scrub error on inode 0x100000002ea (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3606) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.741 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: Scrub error on inode 0x10000000243 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2613) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.741 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: Scrub error on inode 0x1000000024f (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2615) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.741 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: Scrub error on inode 0x10000000275 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3456_fsm) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.741 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: Scrub error on inode 0x10000000376 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/12202) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.742 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: Scrub error on inode 0x1000000031c (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/1247_vm) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.742 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: Scrub error on inode 0x1000000024c (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2605) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.742 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: Scrub error on inode 0x10000000268 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3764_fsm) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.742 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: Scrub error on inode 0x1000000033a (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2608_vm) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.742 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: Scrub error on inode 0x100000002ed (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3767) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.742 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: Scrub error on inode 0x10000000242 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2995) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.742 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: Scrub error on inode 0x1000000033e (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3456_vm) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.742 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: Scrub error on inode 0x100000002b4 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2669) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.742 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: Scrub error on inode 0x100000002bd (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3503) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.743 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: Scrub error on inode 0x10000000368 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2607_fsm) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.743 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: Scrub error on inode 0x10000000375 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/12201) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.743 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: Scrub error on inode 0x100000002e0 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2699) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.743 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: Scrub error on inode 0x100000002a2 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2658) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.743 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: Scrub error on inode 0x100000002f8 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/828) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.743 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: Scrub error on inode 0x10000000333 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2612_vm) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.743 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: Scrub error on inode 0x10000000387 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/12202_vm) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.743 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: Scrub error on inode 0x1000000032e (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2616_vm) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.743 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: Scrub error on inode 0x100000002b1 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2666) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.743 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: Scrub error on inode 0x100000002e9 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3605) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.743 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: Scrub error on inode 0x100000002e7 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3609) see mds.i log and `damage ls` output for details 2024-06-02T04:50:18.743 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:18 smithi076 ceph-mon[42935]: scrub summary: idle+waiting paths [/] 2024-06-02T04:50:19.166 INFO:teuthology.orchestra.run.smithi076.stderr:1500000 of 3200000 tuples (46%) done (elapsed 15.48 s, remaining 17.54 s) 2024-06-02T04:50:19.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:19 smithi119 ceph-mon[46633]: scrub summary: active paths [/] 2024-06-02T04:50:19.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:19 smithi119 ceph-mon[46633]: Scrub error on inode 0x10000000345 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2603_vm) see mds.i log and `damage ls` output for details 2024-06-02T04:50:19.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:19 smithi119 ceph-mon[46633]: Scrub error on inode 0x10000000270 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/826) see mds.i log and `damage ls` output for details 2024-06-02T04:50:19.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:19 smithi119 ceph-mon[46633]: Scrub error on inode 0x1000000032d (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2617_vm) see mds.i log and `damage ls` output for details 2024-06-02T04:50:19.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:19 smithi119 ceph-mon[46633]: Scrub error on inode 0x10000000347 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2601_vm) see mds.i log and `damage ls` output for details 2024-06-02T04:50:19.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:19 smithi119 ceph-mon[46633]: Scrub error on inode 0x10000000277 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3541) see mds.i log and `damage ls` output for details 2024-06-02T04:50:19.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:19 smithi119 ceph-mon[46633]: Scrub error on inode 0x10000000263 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3600) see mds.i log and `damage ls` output for details 2024-06-02T04:50:19.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:19 smithi119 ceph-mon[46633]: Scrub error on inode 0x100000002cf (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2688) see mds.i log and `damage ls` output for details 2024-06-02T04:50:19.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:19 smithi119 ceph-mon[46633]: Scrub error on inode 0x10000000230 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2604) see mds.i log and `damage ls` output for details 2024-06-02T04:50:19.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:19 smithi119 ceph-mon[46633]: Scrub error on inode 0x1000000034d (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3439_vm) see mds.i log and `damage ls` output for details 2024-06-02T04:50:19.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:19 smithi119 ceph-mon[46633]: Scrub error on inode 0x1000000024b (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2609) see mds.i log and `damage ls` output for details 2024-06-02T04:50:19.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:19 smithi119 ceph-mon[46633]: Scrub error on inode 0x10000000228 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/1255) see mds.i log and `damage ls` output for details 2024-06-02T04:50:19.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:19 smithi119 ceph-mon[46633]: Scrub error on inode 0x10000000240 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2612) see mds.i log and `damage ls` output for details 2024-06-02T04:50:19.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:19 smithi119 ceph-mon[46633]: Scrub error on inode 0x10000000298 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2650) see mds.i log and `damage ls` output for details 2024-06-02T04:50:19.598 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:19 smithi119 ceph-mon[46633]: Scrub error on inode 0x1000000023c (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2602) see mds.i log and `damage ls` output for details 2024-06-02T04:50:19.598 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:19 smithi119 ceph-mon[46633]: Scrub error on inode 0x10000000352 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2834_vm) see mds.i log and `damage ls` output for details 2024-06-02T04:50:19.598 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:19 smithi119 ceph-mon[46633]: Scrub error on inode 0x100000002c3 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3395) see mds.i log and `damage ls` output for details 2024-06-02T04:50:19.598 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:19 smithi119 ceph-mon[46633]: Scrub error on inode 0x100000002ba (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2675) see mds.i log and `damage ls` output for details 2024-06-02T04:50:19.598 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:19 smithi119 ceph-mon[46633]: Scrub error on inode 0x100000002f4 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/174) see mds.i log and `damage ls` output for details 2024-06-02T04:50:19.598 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:19 smithi119 ceph-mon[46633]: Scrub error on inode 0x1000000036c (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/12186) see mds.i log and `damage ls` output for details 2024-06-02T04:50:19.598 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:19 smithi119 ceph-mon[46633]: Scrub error on inode 0x1000000025f (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3602) see mds.i log and `damage ls` output for details 2024-06-02T04:50:19.598 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:19 smithi119 ceph-mon[46633]: Scrub error on inode 0x1000000027a (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2224) see mds.i log and `damage ls` output for details 2024-06-02T04:50:19.598 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:19 smithi119 ceph-mon[46633]: Scrub error on inode 0x100000002d0 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2689) see mds.i log and `damage ls` output for details 2024-06-02T04:50:19.598 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:19 smithi119 ceph-mon[46633]: scrub summary: idle+waiting paths [/] 2024-06-02T04:50:19.598 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:19 smithi119 ceph-mon[46633]: scrub summary: idle+waiting paths [/] 2024-06-02T04:50:19.598 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:19 smithi119 ceph-mon[46633]: pgmap v290: 129 pgs: 129 active+clean; 293 MiB data, 527 MiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 40 MiB/s wr, 87 op/s; 0 B/s, 5 keys/s, 0 objects/s recovering 2024-06-02T04:50:19.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:19 smithi192 ceph-mon[47933]: scrub summary: active paths [/] 2024-06-02T04:50:19.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:19 smithi192 ceph-mon[47933]: Scrub error on inode 0x10000000345 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2603_vm) see mds.i log and `damage ls` output for details 2024-06-02T04:50:19.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:19 smithi192 ceph-mon[47933]: Scrub error on inode 0x10000000270 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/826) see mds.i log and `damage ls` output for details 2024-06-02T04:50:19.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:19 smithi192 ceph-mon[47933]: Scrub error on inode 0x1000000032d (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2617_vm) see mds.i log and `damage ls` output for details 2024-06-02T04:50:19.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:19 smithi192 ceph-mon[47933]: Scrub error on inode 0x10000000347 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2601_vm) see mds.i log and `damage ls` output for details 2024-06-02T04:50:19.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:19 smithi192 ceph-mon[47933]: Scrub error on inode 0x10000000277 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3541) see mds.i log and `damage ls` output for details 2024-06-02T04:50:19.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:19 smithi192 ceph-mon[47933]: Scrub error on inode 0x10000000263 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3600) see mds.i log and `damage ls` output for details 2024-06-02T04:50:19.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:19 smithi192 ceph-mon[47933]: Scrub error on inode 0x100000002cf (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2688) see mds.i log and `damage ls` output for details 2024-06-02T04:50:19.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:19 smithi192 ceph-mon[47933]: Scrub error on inode 0x10000000230 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2604) see mds.i log and `damage ls` output for details 2024-06-02T04:50:19.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:19 smithi192 ceph-mon[47933]: Scrub error on inode 0x1000000034d (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3439_vm) see mds.i log and `damage ls` output for details 2024-06-02T04:50:19.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:19 smithi192 ceph-mon[47933]: Scrub error on inode 0x1000000024b (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2609) see mds.i log and `damage ls` output for details 2024-06-02T04:50:19.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:19 smithi192 ceph-mon[47933]: Scrub error on inode 0x10000000228 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/1255) see mds.i log and `damage ls` output for details 2024-06-02T04:50:19.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:19 smithi192 ceph-mon[47933]: Scrub error on inode 0x10000000240 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2612) see mds.i log and `damage ls` output for details 2024-06-02T04:50:19.683 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:19 smithi192 ceph-mon[47933]: Scrub error on inode 0x10000000298 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2650) see mds.i log and `damage ls` output for details 2024-06-02T04:50:19.683 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:19 smithi192 ceph-mon[47933]: Scrub error on inode 0x1000000023c (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2602) see mds.i log and `damage ls` output for details 2024-06-02T04:50:19.683 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:19 smithi192 ceph-mon[47933]: Scrub error on inode 0x10000000352 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2834_vm) see mds.i log and `damage ls` output for details 2024-06-02T04:50:19.683 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:19 smithi192 ceph-mon[47933]: Scrub error on inode 0x100000002c3 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3395) see mds.i log and `damage ls` output for details 2024-06-02T04:50:19.683 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:19 smithi192 ceph-mon[47933]: Scrub error on inode 0x100000002ba (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2675) see mds.i log and `damage ls` output for details 2024-06-02T04:50:19.683 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:19 smithi192 ceph-mon[47933]: Scrub error on inode 0x100000002f4 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/174) see mds.i log and `damage ls` output for details 2024-06-02T04:50:19.683 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:19 smithi192 ceph-mon[47933]: Scrub error on inode 0x1000000036c (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/12186) see mds.i log and `damage ls` output for details 2024-06-02T04:50:19.683 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:19 smithi192 ceph-mon[47933]: Scrub error on inode 0x1000000025f (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3602) see mds.i log and `damage ls` output for details 2024-06-02T04:50:19.683 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:19 smithi192 ceph-mon[47933]: Scrub error on inode 0x1000000027a (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2224) see mds.i log and `damage ls` output for details 2024-06-02T04:50:19.683 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:19 smithi192 ceph-mon[47933]: Scrub error on inode 0x100000002d0 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2689) see mds.i log and `damage ls` output for details 2024-06-02T04:50:19.683 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:19 smithi192 ceph-mon[47933]: scrub summary: idle+waiting paths [/] 2024-06-02T04:50:19.683 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:19 smithi192 ceph-mon[47933]: scrub summary: idle+waiting paths [/] 2024-06-02T04:50:19.683 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:19 smithi192 ceph-mon[47933]: pgmap v290: 129 pgs: 129 active+clean; 293 MiB data, 527 MiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 40 MiB/s wr, 87 op/s; 0 B/s, 5 keys/s, 0 objects/s recovering 2024-06-02T04:50:19.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:19 smithi076 ceph-mon[42935]: scrub summary: active paths [/] 2024-06-02T04:50:19.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:19 smithi076 ceph-mon[42935]: Scrub error on inode 0x10000000345 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2603_vm) see mds.i log and `damage ls` output for details 2024-06-02T04:50:19.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:19 smithi076 ceph-mon[42935]: Scrub error on inode 0x10000000270 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/826) see mds.i log and `damage ls` output for details 2024-06-02T04:50:19.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:19 smithi076 ceph-mon[42935]: Scrub error on inode 0x1000000032d (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2617_vm) see mds.i log and `damage ls` output for details 2024-06-02T04:50:19.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:19 smithi076 ceph-mon[42935]: Scrub error on inode 0x10000000347 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2601_vm) see mds.i log and `damage ls` output for details 2024-06-02T04:50:19.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:19 smithi076 ceph-mon[42935]: Scrub error on inode 0x10000000277 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3541) see mds.i log and `damage ls` output for details 2024-06-02T04:50:19.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:19 smithi076 ceph-mon[42935]: Scrub error on inode 0x10000000263 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3600) see mds.i log and `damage ls` output for details 2024-06-02T04:50:19.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:19 smithi076 ceph-mon[42935]: Scrub error on inode 0x100000002cf (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2688) see mds.i log and `damage ls` output for details 2024-06-02T04:50:19.735 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:19 smithi076 ceph-mon[42935]: Scrub error on inode 0x10000000230 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2604) see mds.i log and `damage ls` output for details 2024-06-02T04:50:19.735 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:19 smithi076 ceph-mon[42935]: Scrub error on inode 0x1000000034d (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3439_vm) see mds.i log and `damage ls` output for details 2024-06-02T04:50:19.735 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:19 smithi076 ceph-mon[42935]: Scrub error on inode 0x1000000024b (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2609) see mds.i log and `damage ls` output for details 2024-06-02T04:50:19.735 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:19 smithi076 ceph-mon[42935]: Scrub error on inode 0x10000000228 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/1255) see mds.i log and `damage ls` output for details 2024-06-02T04:50:19.735 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:19 smithi076 ceph-mon[42935]: Scrub error on inode 0x10000000240 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2612) see mds.i log and `damage ls` output for details 2024-06-02T04:50:19.735 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:19 smithi076 ceph-mon[42935]: Scrub error on inode 0x10000000298 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2650) see mds.i log and `damage ls` output for details 2024-06-02T04:50:19.735 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:19 smithi076 ceph-mon[42935]: Scrub error on inode 0x1000000023c (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2602) see mds.i log and `damage ls` output for details 2024-06-02T04:50:19.735 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:19 smithi076 ceph-mon[42935]: Scrub error on inode 0x10000000352 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2834_vm) see mds.i log and `damage ls` output for details 2024-06-02T04:50:19.735 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:19 smithi076 ceph-mon[42935]: Scrub error on inode 0x100000002c3 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3395) see mds.i log and `damage ls` output for details 2024-06-02T04:50:19.735 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:19 smithi076 ceph-mon[42935]: Scrub error on inode 0x100000002ba (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2675) see mds.i log and `damage ls` output for details 2024-06-02T04:50:19.735 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:19 smithi076 ceph-mon[42935]: Scrub error on inode 0x100000002f4 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/174) see mds.i log and `damage ls` output for details 2024-06-02T04:50:19.735 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:19 smithi076 ceph-mon[42935]: Scrub error on inode 0x1000000036c (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/12186) see mds.i log and `damage ls` output for details 2024-06-02T04:50:19.735 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:19 smithi076 ceph-mon[42935]: Scrub error on inode 0x1000000025f (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3602) see mds.i log and `damage ls` output for details 2024-06-02T04:50:19.735 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:19 smithi076 ceph-mon[42935]: Scrub error on inode 0x1000000027a (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2224) see mds.i log and `damage ls` output for details 2024-06-02T04:50:19.736 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:19 smithi076 ceph-mon[42935]: Scrub error on inode 0x100000002d0 (/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2689) see mds.i log and `damage ls` output for details 2024-06-02T04:50:19.736 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:19 smithi076 ceph-mon[42935]: scrub summary: idle+waiting paths [/] 2024-06-02T04:50:19.736 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:19 smithi076 ceph-mon[42935]: scrub summary: idle+waiting paths [/] 2024-06-02T04:50:19.736 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:19 smithi076 ceph-mon[42935]: pgmap v290: 129 pgs: 129 active+clean; 293 MiB data, 527 MiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 40 MiB/s wr, 87 op/s; 0 B/s, 5 keys/s, 0 objects/s recovering 2024-06-02T04:50:20.384 INFO:teuthology.orchestra.run.smithi076.stderr:1600000 of 3200000 tuples (50%) done (elapsed 16.69 s, remaining 16.69 s) 2024-06-02T04:50:21.185 INFO:teuthology.orchestra.run.smithi076.stderr:1700000 of 3200000 tuples (53%) done (elapsed 17.50 s, remaining 15.44 s) 2024-06-02T04:50:21.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:21 smithi119 ceph-mon[46633]: pgmap v291: 129 pgs: 129 active+clean; 329 MiB data, 541 MiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 42 MiB/s wr, 97 op/s; 0 B/s, 5 keys/s, 0 objects/s recovering 2024-06-02T04:50:21.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:21 smithi192 ceph-mon[47933]: pgmap v291: 129 pgs: 129 active+clean; 329 MiB data, 541 MiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 42 MiB/s wr, 97 op/s; 0 B/s, 5 keys/s, 0 objects/s recovering 2024-06-02T04:50:21.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:21 smithi076 ceph-mon[42935]: pgmap v291: 129 pgs: 129 active+clean; 329 MiB data, 541 MiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 42 MiB/s wr, 97 op/s; 0 B/s, 5 keys/s, 0 objects/s recovering 2024-06-02T04:50:22.367 INFO:teuthology.orchestra.run.smithi076.stderr:1800000 of 3200000 tuples (56%) done (elapsed 18.68 s, remaining 14.53 s) 2024-06-02T04:50:23.580 INFO:teuthology.orchestra.run.smithi076.stderr:1900000 of 3200000 tuples (59%) done (elapsed 19.89 s, remaining 13.61 s) 2024-06-02T04:50:23.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:23 smithi119 ceph-mon[46633]: pgmap v292: 129 pgs: 129 active+clean; 385 MiB data, 555 MiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 46 MiB/s wr, 138 op/s 2024-06-02T04:50:23.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:23 smithi192 ceph-mon[47933]: pgmap v292: 129 pgs: 129 active+clean; 385 MiB data, 555 MiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 46 MiB/s wr, 138 op/s 2024-06-02T04:50:23.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:23 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mon-a[42912]: 2024-06-02T04:50:23.258+0000 7f151640d700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-06-02T04:50:23.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:23 smithi076 ceph-mon[42935]: pgmap v292: 129 pgs: 129 active+clean; 385 MiB data, 555 MiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 46 MiB/s wr, 138 op/s 2024-06-02T04:50:24.428 INFO:teuthology.orchestra.run.smithi076.stderr:2000000 of 3200000 tuples (62%) done (elapsed 20.74 s, remaining 12.44 s) 2024-06-02T04:50:24.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:24 smithi119 ceph-mon[46633]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-06-02T04:50:24.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:24 smithi119 ceph-mon[46633]: mds.? [v2:172.21.15.192:6838/3978681402,v1:172.21.15.192:6839/3978681402] up:active 2024-06-02T04:50:24.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:24 smithi119 ceph-mon[46633]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-06-02T04:50:24.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:24 smithi192 ceph-mon[47933]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-06-02T04:50:24.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:24 smithi192 ceph-mon[47933]: mds.? [v2:172.21.15.192:6838/3978681402,v1:172.21.15.192:6839/3978681402] up:active 2024-06-02T04:50:24.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:24 smithi192 ceph-mon[47933]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-06-02T04:50:24.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:24 smithi076 ceph-mon[42935]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-06-02T04:50:24.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:24 smithi076 ceph-mon[42935]: mds.? [v2:172.21.15.192:6838/3978681402,v1:172.21.15.192:6839/3978681402] up:active 2024-06-02T04:50:24.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:24 smithi076 ceph-mon[42935]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-06-02T04:50:25.079 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.076+0000 7f544b0c2700 1 -- 172.21.15.76:0/3200627511 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5444100ff0 msgr2=0x7f5444101450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:25.079 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.076+0000 7f544b0c2700 1 --2- 172.21.15.76:0/3200627511 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5444100ff0 0x7f5444101450 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f54300099c0 tx=0x7f5430009cd0 comp rx=0 tx=0).stop 2024-06-02T04:50:25.079 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.076+0000 7f544b0c2700 1 -- 172.21.15.76:0/3200627511 shutdown_connections 2024-06-02T04:50:25.079 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.076+0000 7f544b0c2700 1 --2- 172.21.15.76:0/3200627511 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5444101990 0x7f5444108240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:25.079 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.076+0000 7f544b0c2700 1 --2- 172.21.15.76:0/3200627511 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f54440ffe00 0x7f5444100220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:25.079 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.076+0000 7f544b0c2700 1 --2- 172.21.15.76:0/3200627511 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5444100ff0 0x7f5444101450 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:25.079 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.076+0000 7f544b0c2700 1 -- 172.21.15.76:0/3200627511 >> 172.21.15.76:0/3200627511 conn(0x7f54440fb390 msgr2=0x7f54440fd7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:50:25.079 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.076+0000 7f544b0c2700 1 -- 172.21.15.76:0/3200627511 shutdown_connections 2024-06-02T04:50:25.079 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.076+0000 7f544b0c2700 1 -- 172.21.15.76:0/3200627511 wait complete. 2024-06-02T04:50:25.080 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.077+0000 7f544b0c2700 1 Processor -- start 2024-06-02T04:50:25.080 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.077+0000 7f544b0c2700 1 -- start start 2024-06-02T04:50:25.080 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.077+0000 7f544b0c2700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54440ffe00 0x7f5444195c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:25.080 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.077+0000 7f544b0c2700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5444100ff0 0x7f54441961d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:25.080 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.077+0000 7f544b0c2700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5444101990 0x7f544419d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:25.080 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.077+0000 7f544b0c2700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f544419d780 con 0x7f5444101990 2024-06-02T04:50:25.080 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.077+0000 7f544b0c2700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f544419d8f0 con 0x7f5444100ff0 2024-06-02T04:50:25.080 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.077+0000 7f544b0c2700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f544419dab0 con 0x7f54440ffe00 2024-06-02T04:50:25.080 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.077+0000 7f544965f700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5444101990 0x7f544419d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:25.080 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.077+0000 7f544965f700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5444101990 0x7f544419d1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:38344/0 (socket says 172.21.15.76:38344) 2024-06-02T04:50:25.080 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.077+0000 7f544965f700 1 -- 172.21.15.76:0/877518285 learned_addr learned my addr 172.21.15.76:0/877518285 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:50:25.080 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.077+0000 7f5448e5e700 1 --2- 172.21.15.76:0/877518285 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54440ffe00 0x7f5444195c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:25.080 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.077+0000 7f5443fff700 1 --2- 172.21.15.76:0/877518285 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5444100ff0 0x7f54441961d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:25.081 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.078+0000 7f544965f700 1 -- 172.21.15.76:0/877518285 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54440ffe00 msgr2=0x7f5444195c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:25.081 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.078+0000 7f544965f700 1 --2- 172.21.15.76:0/877518285 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54440ffe00 0x7f5444195c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:25.081 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.078+0000 7f544965f700 1 -- 172.21.15.76:0/877518285 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5444100ff0 msgr2=0x7f54441961d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:25.081 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.078+0000 7f544965f700 1 --2- 172.21.15.76:0/877518285 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5444100ff0 0x7f54441961d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:25.081 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.078+0000 7f544965f700 1 -- 172.21.15.76:0/877518285 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54300095f0 con 0x7f5444101990 2024-06-02T04:50:25.081 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.078+0000 7f544965f700 1 --2- 172.21.15.76:0/877518285 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5444101990 0x7f544419d1b0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f543c007ee0 tx=0x7f543c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:50:25.081 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.078+0000 7f5441ffb700 1 -- 172.21.15.76:0/877518285 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f543c017070 con 0x7f5444101990 2024-06-02T04:50:25.081 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.078+0000 7f5441ffb700 1 -- 172.21.15.76:0/877518285 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f543c00f040 con 0x7f5444101990 2024-06-02T04:50:25.081 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.078+0000 7f5441ffb700 1 -- 172.21.15.76:0/877518285 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f543c005570 con 0x7f5444101990 2024-06-02T04:50:25.081 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.078+0000 7f544b0c2700 1 -- 172.21.15.76:0/877518285 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54440683a0 con 0x7f5444101990 2024-06-02T04:50:25.081 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.078+0000 7f544b0c2700 1 -- 172.21.15.76:0/877518285 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5444068860 con 0x7f5444101990 2024-06-02T04:50:25.084 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.081+0000 7f5441ffb700 1 -- 172.21.15.76:0/877518285 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f543c00db20 con 0x7f5444101990 2024-06-02T04:50:25.084 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.082+0000 7f5441ffb700 1 --2- 172.21.15.76:0/877518285 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f54340a11a0 0x7f54340a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:25.084 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.082+0000 7f5448e5e700 1 --2- 172.21.15.76:0/877518285 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f54340a11a0 0x7f54340a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:25.084 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.082+0000 7f5441ffb700 1 -- 172.21.15.76:0/877518285 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f543c0cf170 con 0x7f5444101990 2024-06-02T04:50:25.084 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.082+0000 7f545727db80 1 Processor -- start 2024-06-02T04:50:25.084 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.082+0000 7f545727db80 1 -- start start 2024-06-02T04:50:25.084 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.083+0000 7f5448e5e700 1 --2- 172.21.15.76:0/877518285 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f54340a11a0 0x7f54340a3660 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f5444197110 tx=0x7f5438009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:50:25.084 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.083+0000 7f545727db80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55859f154a80 0x55859f154ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:25.085 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.083+0000 7f545727db80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55859f1553e0 0x55859f155cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:25.085 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.083+0000 7f545727db80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55859f1562d0 0x55859f156750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:25.085 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.083+0000 7f545727db80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55859f0ac0f0 con 0x55859f154a80 2024-06-02T04:50:25.085 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.083+0000 7f545727db80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55859f0a9ab0 con 0x55859f1562d0 2024-06-02T04:50:25.085 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.083+0000 7f545727db80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55859f0a53a0 con 0x55859f1553e0 2024-06-02T04:50:25.085 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.083+0000 7f5448e5e700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55859f154a80 0x55859f154ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:25.085 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.083+0000 7f5448e5e700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55859f154a80 0x55859f154ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:38346/0 (socket says 172.21.15.76:38346) 2024-06-02T04:50:25.085 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.083+0000 7f5448e5e700 1 -- 172.21.15.76:0/224012932 learned_addr learned my addr 172.21.15.76:0/224012932 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:50:25.085 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.083+0000 7f544965f700 1 --2- 172.21.15.76:0/224012932 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55859f1562d0 0x55859f156750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:25.085 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.083+0000 7f5443fff700 1 --2- 172.21.15.76:0/224012932 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55859f1553e0 0x55859f155cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:25.085 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.083+0000 7f5448e5e700 1 -- 172.21.15.76:0/224012932 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55859f1553e0 msgr2=0x55859f155cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:50:25.085 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.083+0000 7f5448e5e700 1 --2- 172.21.15.76:0/224012932 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55859f1553e0 0x55859f155cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:25.086 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.083+0000 7f5448e5e700 1 -- 172.21.15.76:0/224012932 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55859f1562d0 msgr2=0x55859f156750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:50:25.086 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.083+0000 7f5448e5e700 1 --2- 172.21.15.76:0/224012932 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55859f1562d0 0x55859f156750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:25.086 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.083+0000 7f5448e5e700 1 -- 172.21.15.76:0/224012932 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55859ef26350 con 0x55859f154a80 2024-06-02T04:50:25.086 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.083+0000 7f5448e5e700 1 --2- 172.21.15.76:0/224012932 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55859f154a80 0x55859f154ea0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f5438011d30 tx=0x7f5438014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98bc80479c241361 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:50:25.086 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.083+0000 7f542effd700 1 -- 172.21.15.76:0/224012932 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f543800eb20 con 0x55859f154a80 2024-06-02T04:50:25.086 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.084+0000 7f542effd700 1 -- 172.21.15.76:0/224012932 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5438021070 con 0x55859f154a80 2024-06-02T04:50:25.086 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.084+0000 7f542effd700 1 -- 172.21.15.76:0/224012932 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f543801d410 con 0x55859f154a80 2024-06-02T04:50:25.090 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.084+0000 7f545727db80 1 -- 172.21.15.76:0/224012932 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55859f154a80 msgr2=0x55859f154ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:25.090 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.084+0000 7f545727db80 1 --2- 172.21.15.76:0/224012932 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55859f154a80 0x55859f154ea0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f5438011d30 tx=0x7f5438014000 comp rx=0 tx=0).stop 2024-06-02T04:50:25.090 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.084+0000 7f545727db80 1 -- 172.21.15.76:0/224012932 shutdown_connections 2024-06-02T04:50:25.091 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.084+0000 7f545727db80 1 --2- 172.21.15.76:0/224012932 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55859f1562d0 0x55859f156750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:25.091 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.084+0000 7f545727db80 1 --2- 172.21.15.76:0/224012932 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55859f154a80 0x55859f154ea0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:25.091 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.084+0000 7f545727db80 1 --2- 172.21.15.76:0/224012932 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55859f1553e0 0x55859f155cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:25.091 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.084+0000 7f545727db80 1 -- 172.21.15.76:0/224012932 >> 172.21.15.76:0/224012932 conn(0x55859f0b31b0 msgr2=0x55859f151440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:50:25.091 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.084+0000 7f545727db80 1 -- 172.21.15.76:0/224012932 shutdown_connections 2024-06-02T04:50:25.091 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.084+0000 7f545727db80 1 -- 172.21.15.76:0/224012932 wait complete. 2024-06-02T04:50:25.091 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.085+0000 7f545727db80 1 -- start start 2024-06-02T04:50:25.091 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.085+0000 7f545727db80 1 Processor -- start 2024-06-02T04:50:25.091 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.085+0000 7f545727db80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55859f154a80 0x55859f15e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:25.091 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.085+0000 7f545727db80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55859f1553e0 0x55859f15ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:25.091 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.085+0000 7f545727db80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55859f1562d0 0x55859f165e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:25.091 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.085+0000 7f545727db80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55859f041500 con 0x55859f154a80 2024-06-02T04:50:25.092 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.085+0000 7f545727db80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55859f0411a0 con 0x55859f1553e0 2024-06-02T04:50:25.092 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.085+0000 7f545727db80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55859ef28640 con 0x55859f1562d0 2024-06-02T04:50:25.092 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.085+0000 7f545727db80 10 client.0 _ll_register_callbacks cb 0x55859f04aad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:50:25.092 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.085+0000 7f5448e5e700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55859f154a80 0x55859f15e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:25.092 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.085+0000 7f5448e5e700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55859f154a80 0x55859f15e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:38356/0 (socket says 172.21.15.76:38356) 2024-06-02T04:50:25.092 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.085+0000 7f5448e5e700 1 -- 172.21.15.76:0/2894927202 learned_addr learned my addr 172.21.15.76:0/2894927202 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:50:25.092 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.085+0000 7f5443fff700 1 --2- 172.21.15.76:0/2894927202 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55859f1553e0 0x55859f15ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:25.092 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.086+0000 7f544965f700 1 --2- 172.21.15.76:0/2894927202 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55859f1562d0 0x55859f165e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:25.092 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.086+0000 7f5443fff700 1 -- 172.21.15.76:0/2894927202 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55859f1562d0 msgr2=0x55859f165e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:50:25.092 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.086+0000 7f5443fff700 1 --2- 172.21.15.76:0/2894927202 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55859f1562d0 0x55859f165e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:25.092 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.086+0000 7f5443fff700 1 -- 172.21.15.76:0/2894927202 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55859f154a80 msgr2=0x55859f15e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:50:25.092 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.086+0000 7f5443fff700 1 --2- 172.21.15.76:0/2894927202 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55859f154a80 0x55859f15e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:25.092 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.086+0000 7f5443fff700 1 -- 172.21.15.76:0/2894927202 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5438017070 con 0x55859f1553e0 2024-06-02T04:50:25.093 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.086+0000 7f5448e5e700 1 --2- 172.21.15.76:0/2894927202 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55859f154a80 0x55859f15e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T04:50:25.093 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.086+0000 7f5443fff700 1 --2- 172.21.15.76:0/2894927202 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55859f1553e0 0x55859f15ede0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5430009fd0 tx=0x7f5430005270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dae807af83047843 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:50:25.093 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.086+0000 7f5423fff700 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-06-02T04:50:25.093 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.086+0000 7f5423fff700 1 -- 172.21.15.76:0/2894927202 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5430003960 con 0x55859f1553e0 2024-06-02T04:50:25.093 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.086+0000 7f545727db80 1 -- 172.21.15.76:0/2894927202 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55859effe210 con 0x55859f1553e0 2024-06-02T04:50:25.093 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.086+0000 7f5423fff700 1 -- 172.21.15.76:0/2894927202 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f54300056a0 con 0x55859f1553e0 2024-06-02T04:50:25.093 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.086+0000 7f5423fff700 1 -- 172.21.15.76:0/2894927202 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f54300058e0 con 0x55859f1553e0 2024-06-02T04:50:25.093 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.086+0000 7f545727db80 10 client.25292 fetch_fsmap learned FSMap version 28 2024-06-02T04:50:25.093 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.086+0000 7f545727db80 1 -- 172.21.15.76:0/2894927202 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55859eed2b00 con 0x55859f1553e0 2024-06-02T04:50:25.093 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.086+0000 7f5423fff700 1 -- 172.21.15.76:0/2894927202 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55859effe210 con 0x55859f1553e0 2024-06-02T04:50:25.093 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.087+0000 7f5423fff700 1 -- 172.21.15.76:0/2894927202 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 28) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f543000fa00 con 0x55859f1553e0 2024-06-02T04:50:25.093 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.087+0000 7f545727db80 10 client.25292 fetch_fsmap finished waiting for FSMap version 28 2024-06-02T04:50:25.093 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.087+0000 7f545727db80 10 client.25292 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T04:50:25.094 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.087+0000 7f545727db80 20 client.25292 populate_metadata read hostname 'smithi076' 2024-06-02T04:50:25.094 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.087+0000 7f545727db80 1 --2- 172.21.15.76:0/2894927202 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55859f16a680 0x55859f16caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:25.094 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.087+0000 7f545727db80 4 client.25292 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T04:50:25.094 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.087+0000 7f545727db80 1 -- 172.21.15.76:0/2894927202 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55859f1247b0 con 0x55859f16a680 2024-06-02T04:50:25.094 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.087+0000 7f5448e5e700 1 --2- 172.21.15.76:0/2894927202 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55859f16a680 0x55859f16caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:25.094 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.087+0000 7f5423fff700 10 client.25292 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:50:25.094 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.087+0000 7f5448e5e700 1 --2- 172.21.15.76:0/2894927202 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55859f16a680 0x55859f16caa0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=afb7828932da9808 server_cookie=cb70b9effdbef08b in_seq=0 out_seq=0 2024-06-02T04:50:25.094 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.088+0000 7f5423fff700 1 -- 172.21.15.76:0/2894927202 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55859f1247b0 con 0x55859f16a680 2024-06-02T04:50:25.094 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.088+0000 7f5423fff700 10 client.25292 handle_command_reply: tid=0 2024-06-02T04:50:25.094 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.088+0000 7f545727db80 1 client.25292 shutdown 2024-06-02T04:50:25.094 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.088+0000 7f545727db80 1 -- 172.21.15.76:0/2894927202 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55859f1553e0 msgr2=0x55859f15ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:25.094 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.088+0000 7f545727db80 1 --2- 172.21.15.76:0/2894927202 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55859f1553e0 0x55859f15ede0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5430009fd0 tx=0x7f5430005270 comp rx=0 tx=0).stop 2024-06-02T04:50:25.095 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.088+0000 7f545727db80 1 -- 172.21.15.76:0/2894927202 shutdown_connections 2024-06-02T04:50:25.095 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.088+0000 7f545727db80 1 --2- 172.21.15.76:0/2894927202 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55859f16a680 0x55859f16caa0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:25.095 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.088+0000 7f545727db80 1 --2- 172.21.15.76:0/2894927202 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55859f1562d0 0x55859f165e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:25.095 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.088+0000 7f545727db80 1 --2- 172.21.15.76:0/2894927202 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55859f154a80 0x55859f15e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:25.095 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.088+0000 7f5423fff700 0 client.25292 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:50:25.095 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.088+0000 7f545727db80 1 --2- 172.21.15.76:0/2894927202 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55859f1553e0 0x55859f15ede0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:25.095 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.088+0000 7f545727db80 1 -- 172.21.15.76:0/2894927202 >> 172.21.15.76:0/2894927202 conn(0x55859f0b31b0 msgr2=0x55859f14f860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:50:25.095 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.088+0000 7f545727db80 1 -- 172.21.15.76:0/2894927202 shutdown_connections 2024-06-02T04:50:25.095 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.088+0000 7f545727db80 1 -- 172.21.15.76:0/2894927202 wait complete. 2024-06-02T04:50:25.095 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.088+0000 7f545727db80 20 client.25292 trim_cache size 0 max 16384 2024-06-02T04:50:25.112 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.110+0000 7f545727db80 1 Processor -- start 2024-06-02T04:50:25.112 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.110+0000 7f545727db80 1 -- start start 2024-06-02T04:50:25.112 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.110+0000 7f545727db80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55859f154a80 0x55859f1664d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:25.112 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.110+0000 7f545727db80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55859f1553e0 0x55859f165de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:25.112 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.110+0000 7f545727db80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55859f1562d0 0x55859f15ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:25.112 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.110+0000 7f545727db80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55859f15e410 con 0x55859f1562d0 2024-06-02T04:50:25.112 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.110+0000 7f545727db80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55859f155f00 con 0x55859f1553e0 2024-06-02T04:50:25.112 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.110+0000 7f545727db80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55859f1559f0 con 0x55859f154a80 2024-06-02T04:50:25.112 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.110+0000 7f544965f700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55859f1562d0 0x55859f15ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:25.112 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.111+0000 7f544965f700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55859f1562d0 0x55859f15ddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:38360/0 (socket says 172.21.15.76:38360) 2024-06-02T04:50:25.112 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.111+0000 7f544965f700 1 -- 172.21.15.76:0/4099844333 learned_addr learned my addr 172.21.15.76:0/4099844333 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:50:25.112 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.111+0000 7f5448e5e700 1 --2- 172.21.15.76:0/4099844333 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55859f154a80 0x55859f1664d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:25.113 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.111+0000 7f5443fff700 1 --2- 172.21.15.76:0/4099844333 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55859f1553e0 0x55859f165de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:25.113 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.111+0000 7f544965f700 1 -- 172.21.15.76:0/4099844333 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55859f154a80 msgr2=0x55859f1664d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:50:25.113 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.111+0000 7f544965f700 1 --2- 172.21.15.76:0/4099844333 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55859f154a80 0x55859f1664d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:25.113 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.111+0000 7f544965f700 1 -- 172.21.15.76:0/4099844333 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55859f1553e0 msgr2=0x55859f165de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:50:25.113 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.111+0000 7f544965f700 1 --2- 172.21.15.76:0/4099844333 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55859f1553e0 0x55859f165de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:25.113 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.111+0000 7f544965f700 1 -- 172.21.15.76:0/4099844333 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55859f06b500 con 0x55859f1562d0 2024-06-02T04:50:25.113 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.111+0000 7f544965f700 1 --2- 172.21.15.76:0/4099844333 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55859f1562d0 0x55859f15ddb0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f543c095660 tx=0x7f543c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=350ffd4e853f1deb server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:50:25.113 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.111+0000 7f542f7fe700 1 -- 172.21.15.76:0/4099844333 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f543c004c40 con 0x55859f1562d0 2024-06-02T04:50:25.113 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.111+0000 7f542f7fe700 1 -- 172.21.15.76:0/4099844333 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f543c010250 con 0x55859f1562d0 2024-06-02T04:50:25.113 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.111+0000 7f542f7fe700 1 -- 172.21.15.76:0/4099844333 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f543c096d30 con 0x55859f1562d0 2024-06-02T04:50:25.116 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.112+0000 7f545727db80 1 -- 172.21.15.76:0/4099844333 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55859f1562d0 msgr2=0x55859f15ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:25.116 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.112+0000 7f545727db80 1 --2- 172.21.15.76:0/4099844333 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55859f1562d0 0x55859f15ddb0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f543c095660 tx=0x7f543c00b040 comp rx=0 tx=0).stop 2024-06-02T04:50:25.116 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.112+0000 7f545727db80 1 -- 172.21.15.76:0/4099844333 shutdown_connections 2024-06-02T04:50:25.116 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.112+0000 7f545727db80 1 --2- 172.21.15.76:0/4099844333 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55859f1562d0 0x55859f15ddb0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:25.116 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.112+0000 7f545727db80 1 --2- 172.21.15.76:0/4099844333 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55859f154a80 0x55859f1664d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:25.116 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.112+0000 7f545727db80 1 --2- 172.21.15.76:0/4099844333 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55859f1553e0 0x55859f165de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:25.116 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.112+0000 7f545727db80 1 -- 172.21.15.76:0/4099844333 >> 172.21.15.76:0/4099844333 conn(0x55859f0b31b0 msgr2=0x55859f15c890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:50:25.117 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.112+0000 7f545727db80 1 -- 172.21.15.76:0/4099844333 shutdown_connections 2024-06-02T04:50:25.117 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.112+0000 7f545727db80 1 -- 172.21.15.76:0/4099844333 wait complete. 2024-06-02T04:50:25.117 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.112+0000 7f545727db80 1 -- start start 2024-06-02T04:50:25.117 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.112+0000 7f545727db80 1 Processor -- start 2024-06-02T04:50:25.117 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.113+0000 7f545727db80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55859f154a80 0x55859f1635c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:25.117 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.113+0000 7f545727db80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55859f1553e0 0x55859f163b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:25.117 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.113+0000 7f545727db80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55859f1562d0 0x55859f164b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:25.117 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.113+0000 7f545727db80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55859f165050 con 0x55859f1562d0 2024-06-02T04:50:25.117 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.113+0000 7f545727db80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55859f1651c0 con 0x55859f154a80 2024-06-02T04:50:25.117 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.113+0000 7f545727db80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55859f165380 con 0x55859f1553e0 2024-06-02T04:50:25.117 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.113+0000 7f545727db80 10 client.0 _ll_register_callbacks cb 0x55859f04aad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:50:25.117 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.113+0000 7f5443fff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55859f1553e0 0x55859f163b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:25.117 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.113+0000 7f5448e5e700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55859f154a80 0x55859f1635c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:25.117 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.113+0000 7f5443fff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55859f1553e0 0x55859f163b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:60528/0 (socket says 172.21.15.76:60528) 2024-06-02T04:50:25.118 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.113+0000 7f5443fff700 1 -- 172.21.15.76:0/3410358154 learned_addr learned my addr 172.21.15.76:0/3410358154 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:50:25.118 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.113+0000 7f5448e5e700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55859f154a80 0x55859f1635c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:36350/0 (socket says 172.21.15.76:36350) 2024-06-02T04:50:25.118 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.113+0000 7f544965f700 1 --2- 172.21.15.76:0/3410358154 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55859f1562d0 0x55859f164b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:25.118 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.113+0000 7f5443fff700 1 -- 172.21.15.76:0/3410358154 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55859f154a80 msgr2=0x55859f1635c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:50:25.118 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.113+0000 7f5443fff700 1 --2- 172.21.15.76:0/3410358154 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55859f154a80 0x55859f1635c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:25.118 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.113+0000 7f5443fff700 1 -- 172.21.15.76:0/3410358154 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55859f1562d0 msgr2=0x55859f164b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:50:25.118 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.113+0000 7f5443fff700 1 --2- 172.21.15.76:0/3410358154 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55859f1562d0 0x55859f164b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:25.118 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.113+0000 7f5443fff700 1 -- 172.21.15.76:0/3410358154 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5444068860 con 0x55859f1553e0 2024-06-02T04:50:25.118 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.113+0000 7f5448e5e700 1 --2- 172.21.15.76:0/3410358154 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55859f154a80 0x55859f1635c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T04:50:25.118 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.114+0000 7f5443fff700 1 --2- 172.21.15.76:0/3410358154 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55859f1553e0 0x55859f163b00 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f543000bf10 tx=0x7f5430003a10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=884e36f3ecbd15e4 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:50:25.118 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.114+0000 7f5423fff700 10 client.0 ms_handle_connect on v2:172.21.15.192:3300/0 2024-06-02T04:50:25.118 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.114+0000 7f5423fff700 1 -- 172.21.15.76:0/3410358154 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f543000b540 con 0x55859f1553e0 2024-06-02T04:50:25.119 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.114+0000 7f545727db80 1 -- 172.21.15.76:0/3410358154 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5438021070 con 0x55859f1553e0 2024-06-02T04:50:25.119 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.114+0000 7f5423fff700 1 -- 172.21.15.76:0/3410358154 <== mon.1 v2:172.21.15.192:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f543000bcd0 con 0x55859f1553e0 2024-06-02T04:50:25.119 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.114+0000 7f5423fff700 1 -- 172.21.15.76:0/3410358154 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5430005bc0 con 0x55859f1553e0 2024-06-02T04:50:25.119 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.114+0000 7f545727db80 10 client.25240 fetch_fsmap learned FSMap version 28 2024-06-02T04:50:25.119 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.114+0000 7f545727db80 1 -- 172.21.15.76:0/3410358154 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55859ef2ac70 con 0x55859f1553e0 2024-06-02T04:50:25.119 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.114+0000 7f5423fff700 1 -- 172.21.15.76:0/3410358154 <== mon.1 v2:172.21.15.192:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5438021070 con 0x55859f1553e0 2024-06-02T04:50:25.119 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.114+0000 7f5423fff700 1 -- 172.21.15.76:0/3410358154 <== mon.1 v2:172.21.15.192:3300/0 5 ==== fsmap(e 28) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f543002b070 con 0x55859f1553e0 2024-06-02T04:50:25.119 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.114+0000 7f545727db80 10 client.25240 fetch_fsmap finished waiting for FSMap version 28 2024-06-02T04:50:25.119 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.114+0000 7f545727db80 10 client.25240 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T04:50:25.119 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.114+0000 7f545727db80 20 client.25240 populate_metadata read hostname 'smithi076' 2024-06-02T04:50:25.119 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.114+0000 7f545727db80 1 --2- 172.21.15.76:0/3410358154 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55859f1c10a0 0x55859f1c34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:25.119 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.114+0000 7f545727db80 4 client.25240 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T04:50:25.119 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.114+0000 7f545727db80 1 -- 172.21.15.76:0/3410358154 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55859f09de60 con 0x55859f1c10a0 2024-06-02T04:50:25.120 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.115+0000 7f5448e5e700 1 --2- 172.21.15.76:0/3410358154 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55859f1c10a0 0x55859f1c34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:25.120 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.115+0000 7f5423fff700 10 client.25240 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:50:25.120 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.115+0000 7f5448e5e700 1 --2- 172.21.15.76:0/3410358154 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55859f1c10a0 0x55859f1c34c0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2fa80b70c471e9b server_cookie=d759b6012814ce52 in_seq=0 out_seq=0 2024-06-02T04:50:25.130 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.126+0000 7f5423fff700 1 -- 172.21.15.76:0/3410358154 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55859f09de60 con 0x55859f1c10a0 2024-06-02T04:50:25.130 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.126+0000 7f5423fff700 10 client.25240 handle_command_reply: tid=0 2024-06-02T04:50:25.131 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.126+0000 7f545727db80 1 client.25240 shutdown 2024-06-02T04:50:25.131 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.127+0000 7f545727db80 1 -- 172.21.15.76:0/3410358154 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55859f1553e0 msgr2=0x55859f163b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:25.131 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.127+0000 7f545727db80 1 --2- 172.21.15.76:0/3410358154 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55859f1553e0 0x55859f163b00 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f543000bf10 tx=0x7f5430003a10 comp rx=0 tx=0).stop 2024-06-02T04:50:25.131 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.127+0000 7f545727db80 1 -- 172.21.15.76:0/3410358154 shutdown_connections 2024-06-02T04:50:25.131 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.127+0000 7f545727db80 1 --2- 172.21.15.76:0/3410358154 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55859f1c10a0 0x55859f1c34c0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:25.131 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.127+0000 7f545727db80 1 --2- 172.21.15.76:0/3410358154 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55859f1562d0 0x55859f164b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:25.131 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.127+0000 7f545727db80 1 --2- 172.21.15.76:0/3410358154 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55859f154a80 0x55859f1635c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:25.131 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.127+0000 7f545727db80 1 --2- 172.21.15.76:0/3410358154 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55859f1553e0 0x55859f163b00 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:25.131 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.127+0000 7f545727db80 1 -- 172.21.15.76:0/3410358154 >> 172.21.15.76:0/3410358154 conn(0x55859f0b31b0 msgr2=0x55859f15e840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:50:25.131 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.127+0000 7f5423fff700 0 client.25240 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:50:25.131 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.127+0000 7f545727db80 1 -- 172.21.15.76:0/3410358154 shutdown_connections 2024-06-02T04:50:25.131 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.127+0000 7f545727db80 1 -- 172.21.15.76:0/3410358154 wait complete. 2024-06-02T04:50:25.132 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.127+0000 7f545727db80 20 client.25240 trim_cache size 0 max 16384 2024-06-02T04:50:25.132 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:{ 2024-06-02T04:50:25.132 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "message": "", 2024-06-02T04:50:25.132 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "return_code": 0 2024-06-02T04:50:25.132 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:} 2024-06-02T04:50:25.133 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.127+0000 7f544b0c2700 1 -- 172.21.15.76:0/877518285 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f54340a11a0 msgr2=0x7f54340a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:25.133 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.127+0000 7f544b0c2700 1 --2- 172.21.15.76:0/877518285 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f54340a11a0 0x7f54340a3660 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f5444197110 tx=0x7f5438009260 comp rx=0 tx=0).stop 2024-06-02T04:50:25.133 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.127+0000 7f544b0c2700 1 -- 172.21.15.76:0/877518285 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5444101990 msgr2=0x7f544419d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:25.133 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.127+0000 7f544b0c2700 1 --2- 172.21.15.76:0/877518285 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5444101990 0x7f544419d1b0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f543c007ee0 tx=0x7f543c00d3b0 comp rx=0 tx=0).stop 2024-06-02T04:50:25.133 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.127+0000 7f544b0c2700 1 -- 172.21.15.76:0/877518285 shutdown_connections 2024-06-02T04:50:25.133 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.127+0000 7f544b0c2700 1 --2- 172.21.15.76:0/877518285 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5444101990 0x7f544419d1b0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:25.133 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.127+0000 7f544b0c2700 1 --2- 172.21.15.76:0/877518285 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54440ffe00 0x7f5444195c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:25.133 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.127+0000 7f544b0c2700 1 --2- 172.21.15.76:0/877518285 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f54340a11a0 0x7f54340a3660 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:25.133 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.127+0000 7f544b0c2700 1 --2- 172.21.15.76:0/877518285 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5444100ff0 0x7f54441961d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:25.133 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.127+0000 7f544b0c2700 1 -- 172.21.15.76:0/877518285 >> 172.21.15.76:0/877518285 conn(0x7f54440fb390 msgr2=0x7f5444104410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:50:25.133 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.128+0000 7f544b0c2700 1 -- 172.21.15.76:0/877518285 shutdown_connections 2024-06-02T04:50:25.134 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:25.128+0000 7f544b0c2700 1 -- 172.21.15.76:0/877518285 wait complete. 2024-06-02T04:50:25.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:25 smithi119 ceph-mon[46633]: pgmap v293: 129 pgs: 129 active+clean; 405 MiB data, 562 MiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 38 MiB/s wr, 138 op/s 2024-06-02T04:50:25.649 INFO:teuthology.orchestra.run.smithi076.stderr:2100000 of 3200000 tuples (65%) done (elapsed 21.96 s, remaining 11.50 s) 2024-06-02T04:50:25.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:25 smithi192 ceph-mon[47933]: pgmap v293: 129 pgs: 129 active+clean; 405 MiB data, 562 MiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 38 MiB/s wr, 138 op/s 2024-06-02T04:50:25.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:25 smithi076 ceph-mon[42935]: pgmap v293: 129 pgs: 129 active+clean; 405 MiB data, 562 MiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 38 MiB/s wr, 138 op/s 2024-06-02T04:50:26.829 INFO:teuthology.orchestra.run.smithi076.stderr:2200000 of 3200000 tuples (68%) done (elapsed 23.14 s, remaining 10.52 s) 2024-06-02T04:50:27.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:27 smithi119 ceph-mon[46633]: pgmap v294: 129 pgs: 129 active+clean; 461 MiB data, 579 MiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 46 MiB/s wr, 131 op/s 2024-06-02T04:50:27.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:27 smithi119 ceph-mon[46633]: scrub summary: idle 2024-06-02T04:50:27.658 INFO:teuthology.orchestra.run.smithi076.stderr:2300000 of 3200000 tuples (71%) done (elapsed 23.97 s, remaining 9.38 s) 2024-06-02T04:50:27.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:27 smithi192 ceph-mon[47933]: pgmap v294: 129 pgs: 129 active+clean; 461 MiB data, 579 MiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 46 MiB/s wr, 131 op/s 2024-06-02T04:50:27.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:27 smithi192 ceph-mon[47933]: scrub summary: idle 2024-06-02T04:50:27.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:27 smithi076 ceph-mon[42935]: pgmap v294: 129 pgs: 129 active+clean; 461 MiB data, 579 MiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 46 MiB/s wr, 131 op/s 2024-06-02T04:50:27.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:27 smithi076 ceph-mon[42935]: scrub summary: idle 2024-06-02T04:50:28.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:28 smithi119 ceph-mon[46633]: scrub summary: idle 2024-06-02T04:50:28.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:28 smithi119 ceph-mon[46633]: scrub summary: idle 2024-06-02T04:50:28.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:28 smithi192 ceph-mon[47933]: scrub summary: idle 2024-06-02T04:50:28.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:28 smithi192 ceph-mon[47933]: scrub summary: idle 2024-06-02T04:50:28.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:28 smithi076 ceph-mon[42935]: scrub summary: idle 2024-06-02T04:50:28.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:28 smithi076 ceph-mon[42935]: scrub summary: idle 2024-06-02T04:50:28.844 INFO:teuthology.orchestra.run.smithi076.stderr:2400000 of 3200000 tuples (75%) done (elapsed 25.15 s, remaining 8.38 s) 2024-06-02T04:50:29.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:29 smithi119 ceph-mon[46633]: pgmap v295: 129 pgs: 129 active+clean; 525 MiB data, 598 MiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 46 MiB/s wr, 123 op/s 2024-06-02T04:50:29.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:29 smithi192 ceph-mon[47933]: pgmap v295: 129 pgs: 129 active+clean; 525 MiB data, 598 MiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 46 MiB/s wr, 123 op/s 2024-06-02T04:50:29.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:29 smithi076 ceph-mon[42935]: pgmap v295: 129 pgs: 129 active+clean; 525 MiB data, 598 MiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 46 MiB/s wr, 123 op/s 2024-06-02T04:50:29.957 INFO:teuthology.orchestra.run.smithi076.stderr:2500000 of 3200000 tuples (78%) done (elapsed 26.27 s, remaining 7.35 s) 2024-06-02T04:50:30.787 INFO:teuthology.orchestra.run.smithi076.stderr:2600000 of 3200000 tuples (81%) done (elapsed 27.10 s, remaining 6.25 s) 2024-06-02T04:50:31.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:31 smithi119 ceph-mon[46633]: pgmap v296: 129 pgs: 129 active+clean; 553 MiB data, 606 MiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 43 MiB/s wr, 104 op/s 2024-06-02T04:50:31.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:31 smithi192 ceph-mon[47933]: pgmap v296: 129 pgs: 129 active+clean; 553 MiB data, 606 MiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 43 MiB/s wr, 104 op/s 2024-06-02T04:50:31.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:31 smithi076 ceph-mon[42935]: pgmap v296: 129 pgs: 129 active+clean; 553 MiB data, 606 MiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 43 MiB/s wr, 104 op/s 2024-06-02T04:50:32.012 INFO:teuthology.orchestra.run.smithi076.stderr:2700000 of 3200000 tuples (84%) done (elapsed 28.32 s, remaining 5.24 s) 2024-06-02T04:50:32.796 INFO:teuthology.orchestra.run.smithi076.stderr:2800000 of 3200000 tuples (87%) done (elapsed 29.11 s, remaining 4.16 s) 2024-06-02T04:50:33.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:33 smithi119 ceph-mon[46633]: pgmap v297: 129 pgs: 129 active+clean; 609 MiB data, 625 MiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 47 MiB/s wr, 93 op/s 2024-06-02T04:50:33.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:33 smithi192 ceph-mon[47933]: pgmap v297: 129 pgs: 129 active+clean; 609 MiB data, 625 MiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 47 MiB/s wr, 93 op/s 2024-06-02T04:50:33.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:33 smithi076 ceph-mon[42935]: pgmap v297: 129 pgs: 129 active+clean; 609 MiB data, 625 MiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 47 MiB/s wr, 93 op/s 2024-06-02T04:50:33.995 INFO:teuthology.orchestra.run.smithi076.stderr:2900000 of 3200000 tuples (90%) done (elapsed 30.31 s, remaining 3.14 s) 2024-06-02T04:50:35.187 INFO:teuthology.orchestra.run.smithi076.stderr:3000000 of 3200000 tuples (93%) done (elapsed 31.50 s, remaining 2.10 s) 2024-06-02T04:50:35.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:35 smithi119 ceph-mon[46633]: pgmap v298: 129 pgs: 129 active+clean; 629 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 41 MiB/s wr, 46 op/s 2024-06-02T04:50:35.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:35 smithi192 ceph-mon[47933]: pgmap v298: 129 pgs: 129 active+clean; 629 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 41 MiB/s wr, 46 op/s 2024-06-02T04:50:35.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:35 smithi076 ceph-mon[42935]: pgmap v298: 129 pgs: 129 active+clean; 629 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 41 MiB/s wr, 46 op/s 2024-06-02T04:50:35.993 INFO:teuthology.orchestra.run.smithi076.stderr:3100000 of 3200000 tuples (96%) done (elapsed 32.30 s, remaining 1.04 s) 2024-06-02T04:50:37.167 INFO:teuthology.orchestra.run.smithi076.stderr:3200000 of 3200000 tuples (100%) done (elapsed 33.48 s, remaining 0.00 s) 2024-06-02T04:50:37.271 INFO:teuthology.orchestra.run.smithi076.stderr:vacuum... 2024-06-02T04:50:37.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:37 smithi119 ceph-mon[46633]: pgmap v299: 129 pgs: 129 active+clean; 679 MiB data, 647 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 45 MiB/s wr, 36 op/s 2024-06-02T04:50:37.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:37 smithi192 ceph-mon[47933]: pgmap v299: 129 pgs: 129 active+clean; 679 MiB data, 647 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 45 MiB/s wr, 36 op/s 2024-06-02T04:50:37.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:37 smithi076 ceph-mon[42935]: pgmap v299: 129 pgs: 129 active+clean; 679 MiB data, 647 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 45 MiB/s wr, 36 op/s 2024-06-02T04:50:38.254 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.252+0000 7f2d6fd5f700 1 -- 172.21.15.76:0/1567562849 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2d681007a0 msgr2=0x7f2d68100c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:38.255 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.252+0000 7f2d6fd5f700 1 --2- 172.21.15.76:0/1567562849 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2d681007a0 0x7f2d68100c00 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f2d580099c0 tx=0x7f2d58009cd0 comp rx=0 tx=0).stop 2024-06-02T04:50:38.255 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.252+0000 7f2d6fd5f700 1 -- 172.21.15.76:0/1567562849 shutdown_connections 2024-06-02T04:50:38.255 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.252+0000 7f2d6fd5f700 1 --2- 172.21.15.76:0/1567562849 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d68101140 0x7f2d681079f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:38.255 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.252+0000 7f2d6fd5f700 1 --2- 172.21.15.76:0/1567562849 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d680ff5b0 0x7f2d680ff9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:38.255 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.252+0000 7f2d6fd5f700 1 --2- 172.21.15.76:0/1567562849 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2d681007a0 0x7f2d68100c00 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:38.255 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.252+0000 7f2d6fd5f700 1 -- 172.21.15.76:0/1567562849 >> 172.21.15.76:0/1567562849 conn(0x7f2d680fab20 msgr2=0x7f2d680fcf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:50:38.255 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.252+0000 7f2d6fd5f700 1 -- 172.21.15.76:0/1567562849 shutdown_connections 2024-06-02T04:50:38.255 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.252+0000 7f2d6fd5f700 1 -- 172.21.15.76:0/1567562849 wait complete. 2024-06-02T04:50:38.255 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.252+0000 7f2d6fd5f700 1 Processor -- start 2024-06-02T04:50:38.255 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.252+0000 7f2d6fd5f700 1 -- start start 2024-06-02T04:50:38.256 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.253+0000 7f2d6fd5f700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d680ff5b0 0x7f2d681034f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:38.256 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.253+0000 7f2d6fd5f700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d681007a0 0x7f2d68101b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:38.256 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.253+0000 7f2d6fd5f700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2d68101140 0x7f2d681020c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:38.256 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.253+0000 7f2d6fd5f700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d68102860 con 0x7f2d68101140 2024-06-02T04:50:38.256 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.253+0000 7f2d6fd5f700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d681029d0 con 0x7f2d681007a0 2024-06-02T04:50:38.256 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.253+0000 7f2d6fd5f700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d681a0e60 con 0x7f2d680ff5b0 2024-06-02T04:50:38.256 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.253+0000 7f2d6e2fc700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2d68101140 0x7f2d681020c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:38.256 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.253+0000 7f2d6e2fc700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2d68101140 0x7f2d681020c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:35396/0 (socket says 172.21.15.76:35396) 2024-06-02T04:50:38.256 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.253+0000 7f2d6e2fc700 1 -- 172.21.15.76:0/438101694 learned_addr learned my addr 172.21.15.76:0/438101694 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:50:38.256 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.253+0000 7f2d6d2fa700 1 --2- 172.21.15.76:0/438101694 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d681007a0 0x7f2d68101b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:38.256 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.253+0000 7f2d6dafb700 1 --2- 172.21.15.76:0/438101694 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d680ff5b0 0x7f2d681034f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:38.256 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.253+0000 7f2d6e2fc700 1 -- 172.21.15.76:0/438101694 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d680ff5b0 msgr2=0x7f2d681034f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:38.256 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.253+0000 7f2d6e2fc700 1 --2- 172.21.15.76:0/438101694 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d680ff5b0 0x7f2d681034f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:38.257 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.253+0000 7f2d6e2fc700 1 -- 172.21.15.76:0/438101694 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d681007a0 msgr2=0x7f2d68101b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:38.257 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.253+0000 7f2d6e2fc700 1 --2- 172.21.15.76:0/438101694 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d681007a0 0x7f2d68101b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:38.257 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.253+0000 7f2d6e2fc700 1 -- 172.21.15.76:0/438101694 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d580095f0 con 0x7f2d68101140 2024-06-02T04:50:38.257 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.253+0000 7f2d6e2fc700 1 --2- 172.21.15.76:0/438101694 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2d68101140 0x7f2d681020c0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f2d6000ada0 tx=0x7f2d6000c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:50:38.257 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.254+0000 7f2d5effd700 1 -- 172.21.15.76:0/438101694 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d6000f070 con 0x7f2d68101140 2024-06-02T04:50:38.257 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.254+0000 7f2d6fd5f700 1 -- 172.21.15.76:0/438101694 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d681a10f0 con 0x7f2d68101140 2024-06-02T04:50:38.257 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.254+0000 7f2d5effd700 1 -- 172.21.15.76:0/438101694 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2d60007b30 con 0x7f2d68101140 2024-06-02T04:50:38.257 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.254+0000 7f2d5effd700 1 -- 172.21.15.76:0/438101694 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d60005280 con 0x7f2d68101140 2024-06-02T04:50:38.257 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.254+0000 7f2d6fd5f700 1 -- 172.21.15.76:0/438101694 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d681a1600 con 0x7f2d68101140 2024-06-02T04:50:38.259 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.256+0000 7f2d5effd700 1 -- 172.21.15.76:0/438101694 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f2d6000c870 con 0x7f2d68101140 2024-06-02T04:50:38.259 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.257+0000 7f2d5effd700 1 --2- 172.21.15.76:0/438101694 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f2d540a1120 0x7f2d540a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:38.260 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.257+0000 7f2d6dafb700 1 --2- 172.21.15.76:0/438101694 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f2d540a1120 0x7f2d540a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:38.260 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.257+0000 7f2d5effd700 1 -- 172.21.15.76:0/438101694 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f2d600cbfd0 con 0x7f2d68101140 2024-06-02T04:50:38.260 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.258+0000 7f2d6dafb700 1 --2- 172.21.15.76:0/438101694 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f2d540a1120 0x7f2d540a35e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f2d68100600 tx=0x7f2d64009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:50:38.260 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.258+0000 7f2d7bf1ab80 1 Processor -- start 2024-06-02T04:50:38.260 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.258+0000 7f2d7bf1ab80 1 -- start start 2024-06-02T04:50:38.260 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.258+0000 7f2d7bf1ab80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56093874ba80 0x56093874bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:38.260 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.258+0000 7f2d7bf1ab80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56093874c3e0 0x56093874ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:38.260 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.258+0000 7f2d7bf1ab80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56093874d2d0 0x56093874d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:38.260 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.258+0000 7f2d7bf1ab80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609386a30f0 con 0x56093874d2d0 2024-06-02T04:50:38.260 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.258+0000 7f2d7bf1ab80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609386a0ab0 con 0x56093874c3e0 2024-06-02T04:50:38.260 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.258+0000 7f2d7bf1ab80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x56093869c3a0 con 0x56093874ba80 2024-06-02T04:50:38.260 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.258+0000 7f2d6e2fc700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56093874d2d0 0x56093874d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:38.261 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.258+0000 7f2d6e2fc700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56093874d2d0 0x56093874d750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:35402/0 (socket says 172.21.15.76:35402) 2024-06-02T04:50:38.261 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.258+0000 7f2d6e2fc700 1 -- 172.21.15.76:0/3748899387 learned_addr learned my addr 172.21.15.76:0/3748899387 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:50:38.261 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.259+0000 7f2d6dafb700 1 --2- 172.21.15.76:0/3748899387 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56093874ba80 0x56093874bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:38.261 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.259+0000 7f2d6d2fa700 1 --2- 172.21.15.76:0/3748899387 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56093874c3e0 0x56093874ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:38.261 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.259+0000 7f2d6e2fc700 1 -- 172.21.15.76:0/3748899387 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56093874ba80 msgr2=0x56093874bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:50:38.261 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.259+0000 7f2d6e2fc700 1 --2- 172.21.15.76:0/3748899387 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56093874ba80 0x56093874bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:38.261 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.259+0000 7f2d6e2fc700 1 -- 172.21.15.76:0/3748899387 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56093874c3e0 msgr2=0x56093874ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:50:38.261 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.259+0000 7f2d6e2fc700 1 --2- 172.21.15.76:0/3748899387 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56093874c3e0 0x56093874ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:38.261 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.259+0000 7f2d6e2fc700 1 -- 172.21.15.76:0/3748899387 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56093851d350 con 0x56093874d2d0 2024-06-02T04:50:38.261 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.259+0000 7f2d6e2fc700 1 --2- 172.21.15.76:0/3748899387 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56093874d2d0 0x56093874d750 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f2d600a1030 tx=0x7f2d60098de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a06a2324aeac87c9 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:50:38.261 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.259+0000 7f2d53fff700 1 -- 172.21.15.76:0/3748899387 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d60099170 con 0x56093874d2d0 2024-06-02T04:50:38.261 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.259+0000 7f2d53fff700 1 -- 172.21.15.76:0/3748899387 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2d6009cfa0 con 0x56093874d2d0 2024-06-02T04:50:38.261 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.259+0000 7f2d53fff700 1 -- 172.21.15.76:0/3748899387 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d600975f0 con 0x56093874d2d0 2024-06-02T04:50:38.266 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.260+0000 7f2d7bf1ab80 1 -- 172.21.15.76:0/3748899387 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56093874d2d0 msgr2=0x56093874d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:38.266 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.260+0000 7f2d7bf1ab80 1 --2- 172.21.15.76:0/3748899387 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56093874d2d0 0x56093874d750 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f2d600a1030 tx=0x7f2d60098de0 comp rx=0 tx=0).stop 2024-06-02T04:50:38.266 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.260+0000 7f2d7bf1ab80 1 -- 172.21.15.76:0/3748899387 shutdown_connections 2024-06-02T04:50:38.266 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.260+0000 7f2d7bf1ab80 1 --2- 172.21.15.76:0/3748899387 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56093874d2d0 0x56093874d750 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:38.266 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.260+0000 7f2d7bf1ab80 1 --2- 172.21.15.76:0/3748899387 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56093874ba80 0x56093874bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:38.266 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.260+0000 7f2d7bf1ab80 1 --2- 172.21.15.76:0/3748899387 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56093874c3e0 0x56093874ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:38.266 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.260+0000 7f2d7bf1ab80 1 -- 172.21.15.76:0/3748899387 >> 172.21.15.76:0/3748899387 conn(0x5609386aa1b0 msgr2=0x560938748440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:50:38.266 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.260+0000 7f2d7bf1ab80 1 -- 172.21.15.76:0/3748899387 shutdown_connections 2024-06-02T04:50:38.266 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.260+0000 7f2d7bf1ab80 1 -- 172.21.15.76:0/3748899387 wait complete. 2024-06-02T04:50:38.267 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.260+0000 7f2d7bf1ab80 1 -- start start 2024-06-02T04:50:38.267 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.260+0000 7f2d7bf1ab80 1 Processor -- start 2024-06-02T04:50:38.267 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.261+0000 7f2d7bf1ab80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56093874ba80 0x560938755930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:38.267 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.261+0000 7f2d7bf1ab80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56093874c3e0 0x560938755e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:38.267 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.261+0000 7f2d7bf1ab80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56093874d2d0 0x56093875ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:38.267 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.261+0000 7f2d7bf1ab80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x560938638500 con 0x56093874d2d0 2024-06-02T04:50:38.267 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.261+0000 7f2d7bf1ab80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609386381a0 con 0x56093874ba80 2024-06-02T04:50:38.267 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.261+0000 7f2d7bf1ab80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x56093851f640 con 0x56093874c3e0 2024-06-02T04:50:38.267 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.261+0000 7f2d7bf1ab80 10 client.0 _ll_register_callbacks cb 0x560938641ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:50:38.267 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.261+0000 7f2d6dafb700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56093874ba80 0x560938755930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:38.267 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.261+0000 7f2d6dafb700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56093874ba80 0x560938755930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:47148/0 (socket says 172.21.15.76:47148) 2024-06-02T04:50:38.267 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.261+0000 7f2d6dafb700 1 -- 172.21.15.76:0/4083784410 learned_addr learned my addr 172.21.15.76:0/4083784410 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:50:38.267 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.261+0000 7f2d6e2fc700 1 --2- 172.21.15.76:0/4083784410 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56093874d2d0 0x56093875ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:38.267 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.261+0000 7f2d6d2fa700 1 --2- 172.21.15.76:0/4083784410 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56093874c3e0 0x560938755e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:38.268 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.261+0000 7f2d6dafb700 1 -- 172.21.15.76:0/4083784410 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56093874c3e0 msgr2=0x560938755e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:50:38.268 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.261+0000 7f2d6dafb700 1 --2- 172.21.15.76:0/4083784410 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56093874c3e0 0x560938755e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:38.268 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.261+0000 7f2d6dafb700 1 -- 172.21.15.76:0/4083784410 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56093874d2d0 msgr2=0x56093875ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:50:38.268 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.261+0000 7f2d6dafb700 1 --2- 172.21.15.76:0/4083784410 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56093874d2d0 0x56093875ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:38.268 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.261+0000 7f2d6dafb700 1 -- 172.21.15.76:0/4083784410 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d681a1600 con 0x56093874ba80 2024-06-02T04:50:38.268 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.262+0000 7f2d6e2fc700 1 --2- 172.21.15.76:0/4083784410 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56093874d2d0 0x56093875ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T04:50:38.268 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.262+0000 7f2d6dafb700 1 --2- 172.21.15.76:0/4083784410 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56093874ba80 0x560938755930 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2d64015500 tx=0x7f2d64004860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3dfdfc39637d1802 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:50:38.268 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.262+0000 7f2d517fa700 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-06-02T04:50:38.268 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.262+0000 7f2d517fa700 1 -- 172.21.15.76:0/4083784410 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d64015bd0 con 0x56093874ba80 2024-06-02T04:50:38.268 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.262+0000 7f2d517fa700 1 -- 172.21.15.76:0/4083784410 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f2d64015d30 con 0x56093874ba80 2024-06-02T04:50:38.268 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.262+0000 7f2d7bf1ab80 1 -- 172.21.15.76:0/4083784410 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5609385f5210 con 0x56093874ba80 2024-06-02T04:50:38.268 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.262+0000 7f2d517fa700 1 -- 172.21.15.76:0/4083784410 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2d64005a50 con 0x56093874ba80 2024-06-02T04:50:38.269 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.262+0000 7f2d7bf1ab80 10 client.25307 fetch_fsmap learned FSMap version 28 2024-06-02T04:50:38.269 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.262+0000 7f2d7bf1ab80 1 -- 172.21.15.76:0/4083784410 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x5609384c9b00 con 0x56093874ba80 2024-06-02T04:50:38.269 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.262+0000 7f2d517fa700 1 -- 172.21.15.76:0/4083784410 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5609385f5210 con 0x56093874ba80 2024-06-02T04:50:38.269 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.262+0000 7f2d517fa700 1 -- 172.21.15.76:0/4083784410 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 28) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f2d640067e0 con 0x56093874ba80 2024-06-02T04:50:38.269 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.263+0000 7f2d7bf1ab80 10 client.25307 fetch_fsmap finished waiting for FSMap version 28 2024-06-02T04:50:38.269 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.263+0000 7f2d7bf1ab80 10 client.25307 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T04:50:38.269 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.263+0000 7f2d7bf1ab80 20 client.25307 populate_metadata read hostname 'smithi076' 2024-06-02T04:50:38.269 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.263+0000 7f2d7bf1ab80 1 --2- 172.21.15.76:0/4083784410 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5609387617f0 0x560938763c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:38.269 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.263+0000 7f2d7bf1ab80 4 client.25307 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T04:50:38.269 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.263+0000 7f2d7bf1ab80 1 -- 172.21.15.76:0/4083784410 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56093871b7b0 con 0x5609387617f0 2024-06-02T04:50:38.269 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.263+0000 7f2d6d2fa700 1 --2- 172.21.15.76:0/4083784410 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5609387617f0 0x560938763c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:38.269 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.264+0000 7f2d517fa700 10 client.25307 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:50:38.269 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.264+0000 7f2d6d2fa700 1 --2- 172.21.15.76:0/4083784410 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5609387617f0 0x560938763c10 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc7a6de6a1a3c84c server_cookie=40a6e2939630420d in_seq=0 out_seq=0 2024-06-02T04:50:38.270 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.264+0000 7f2d517fa700 1 -- 172.21.15.76:0/4083784410 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56093871b7b0 con 0x5609387617f0 2024-06-02T04:50:38.270 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.264+0000 7f2d517fa700 10 client.25307 handle_command_reply: tid=0 2024-06-02T04:50:38.270 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.264+0000 7f2d7bf1ab80 1 client.25307 shutdown 2024-06-02T04:50:38.270 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.264+0000 7f2d7bf1ab80 1 -- 172.21.15.76:0/4083784410 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56093874ba80 msgr2=0x560938755930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:38.270 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.264+0000 7f2d7bf1ab80 1 --2- 172.21.15.76:0/4083784410 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56093874ba80 0x560938755930 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2d64015500 tx=0x7f2d64004860 comp rx=0 tx=0).stop 2024-06-02T04:50:38.270 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.265+0000 7f2d7bf1ab80 1 -- 172.21.15.76:0/4083784410 shutdown_connections 2024-06-02T04:50:38.270 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.265+0000 7f2d7bf1ab80 1 --2- 172.21.15.76:0/4083784410 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5609387617f0 0x560938763c10 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:38.270 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.265+0000 7f2d7bf1ab80 1 --2- 172.21.15.76:0/4083784410 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56093874d2d0 0x56093875ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:38.270 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.265+0000 7f2d7bf1ab80 1 --2- 172.21.15.76:0/4083784410 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56093874ba80 0x560938755930 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:38.270 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.265+0000 7f2d517fa700 0 client.25307 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:50:38.270 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.265+0000 7f2d7bf1ab80 1 --2- 172.21.15.76:0/4083784410 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56093874c3e0 0x560938755e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:38.270 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.265+0000 7f2d7bf1ab80 1 -- 172.21.15.76:0/4083784410 >> 172.21.15.76:0/4083784410 conn(0x5609386aa1b0 msgr2=0x560938746860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:50:38.271 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.265+0000 7f2d7bf1ab80 1 -- 172.21.15.76:0/4083784410 shutdown_connections 2024-06-02T04:50:38.271 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.265+0000 7f2d7bf1ab80 1 -- 172.21.15.76:0/4083784410 wait complete. 2024-06-02T04:50:38.271 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.265+0000 7f2d7bf1ab80 20 client.25307 trim_cache size 0 max 16384 2024-06-02T04:50:38.286 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.284+0000 7f2d7bf1ab80 1 Processor -- start 2024-06-02T04:50:38.286 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.284+0000 7f2d7bf1ab80 1 -- start start 2024-06-02T04:50:38.286 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.285+0000 7f2d7bf1ab80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56093874ba80 0x56093874be60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:38.286 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.285+0000 7f2d7bf1ab80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56093874c3e0 0x560938754540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:38.286 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.285+0000 7f2d7bf1ab80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56093874d2d0 0x56093875d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:38.287 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.285+0000 7f2d7bf1ab80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x56093874c7f0 con 0x56093874ba80 2024-06-02T04:50:38.287 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.285+0000 7f2d7bf1ab80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x560938753520 con 0x56093874d2d0 2024-06-02T04:50:38.287 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.285+0000 7f2d7bf1ab80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x560938750e30 con 0x56093874c3e0 2024-06-02T04:50:38.287 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.285+0000 7f2d6dafb700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56093874ba80 0x56093874be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:38.287 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.285+0000 7f2d6dafb700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56093874ba80 0x56093874be60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:35418/0 (socket says 172.21.15.76:35418) 2024-06-02T04:50:38.287 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.285+0000 7f2d6dafb700 1 -- 172.21.15.76:0/4017259843 learned_addr learned my addr 172.21.15.76:0/4017259843 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:50:38.287 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.285+0000 7f2d6e2fc700 1 --2- 172.21.15.76:0/4017259843 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56093874d2d0 0x56093875d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:38.287 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.285+0000 7f2d6d2fa700 1 --2- 172.21.15.76:0/4017259843 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56093874c3e0 0x560938754540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:38.287 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.285+0000 7f2d6dafb700 1 -- 172.21.15.76:0/4017259843 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56093874c3e0 msgr2=0x560938754540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:50:38.287 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.285+0000 7f2d6dafb700 1 --2- 172.21.15.76:0/4017259843 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56093874c3e0 0x560938754540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:38.288 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.285+0000 7f2d6dafb700 1 -- 172.21.15.76:0/4017259843 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56093874d2d0 msgr2=0x56093875d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:50:38.288 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.285+0000 7f2d6dafb700 1 --2- 172.21.15.76:0/4017259843 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56093874d2d0 0x56093875d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:38.288 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.285+0000 7f2d6dafb700 1 -- 172.21.15.76:0/4017259843 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560938662500 con 0x56093874ba80 2024-06-02T04:50:38.288 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.285+0000 7f2d6dafb700 1 --2- 172.21.15.76:0/4017259843 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56093874ba80 0x56093874be60 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f2d64010010 tx=0x7f2d64009200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e415794aeb5f75a server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:50:38.288 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.285+0000 7f2d5cff9700 1 -- 172.21.15.76:0/4017259843 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d64015dd0 con 0x56093874ba80 2024-06-02T04:50:38.288 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.286+0000 7f2d5cff9700 1 -- 172.21.15.76:0/4017259843 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2d64015810 con 0x56093874ba80 2024-06-02T04:50:38.288 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.286+0000 7f2d5cff9700 1 -- 172.21.15.76:0/4017259843 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d64006040 con 0x56093874ba80 2024-06-02T04:50:38.290 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.286+0000 7f2d7bf1ab80 1 -- 172.21.15.76:0/4017259843 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56093874ba80 msgr2=0x56093874be60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:38.290 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.286+0000 7f2d7bf1ab80 1 --2- 172.21.15.76:0/4017259843 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56093874ba80 0x56093874be60 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f2d64010010 tx=0x7f2d64009200 comp rx=0 tx=0).stop 2024-06-02T04:50:38.290 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.286+0000 7f2d7bf1ab80 1 -- 172.21.15.76:0/4017259843 shutdown_connections 2024-06-02T04:50:38.290 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.286+0000 7f2d7bf1ab80 1 --2- 172.21.15.76:0/4017259843 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56093874d2d0 0x56093875d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:38.290 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.286+0000 7f2d7bf1ab80 1 --2- 172.21.15.76:0/4017259843 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56093874ba80 0x56093874be60 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:38.291 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.286+0000 7f2d7bf1ab80 1 --2- 172.21.15.76:0/4017259843 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56093874c3e0 0x560938754540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:38.291 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.286+0000 7f2d7bf1ab80 1 -- 172.21.15.76:0/4017259843 >> 172.21.15.76:0/4017259843 conn(0x5609386aa1b0 msgr2=0x5609387538a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:50:38.291 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.286+0000 7f2d7bf1ab80 1 -- 172.21.15.76:0/4017259843 shutdown_connections 2024-06-02T04:50:38.291 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.286+0000 7f2d7bf1ab80 1 -- 172.21.15.76:0/4017259843 wait complete. 2024-06-02T04:50:38.291 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.287+0000 7f2d7bf1ab80 1 -- start start 2024-06-02T04:50:38.291 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.287+0000 7f2d7bf1ab80 1 Processor -- start 2024-06-02T04:50:38.291 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.287+0000 7f2d7bf1ab80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56093874ba80 0x56093875a480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:38.291 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.287+0000 7f2d7bf1ab80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56093874c3e0 0x56093875a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:38.291 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.287+0000 7f2d7bf1ab80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56093874d2d0 0x56093875b820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:38.291 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.287+0000 7f2d7bf1ab80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x56093875bd60 con 0x56093874d2d0 2024-06-02T04:50:38.292 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.287+0000 7f2d7bf1ab80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x56093875bed0 con 0x56093874ba80 2024-06-02T04:50:38.292 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.287+0000 7f2d7bf1ab80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x56093875c090 con 0x56093874c3e0 2024-06-02T04:50:38.292 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.287+0000 7f2d7bf1ab80 10 client.0 _ll_register_callbacks cb 0x560938641ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:50:38.292 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.287+0000 7f2d6e2fc700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56093874d2d0 0x56093875b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:38.292 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.288+0000 7f2d6dafb700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56093874ba80 0x56093875a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:38.292 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.288+0000 7f2d6e2fc700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56093874d2d0 0x56093875b820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:35430/0 (socket says 172.21.15.76:35430) 2024-06-02T04:50:38.292 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.288+0000 7f2d6e2fc700 1 -- 172.21.15.76:0/1454069277 learned_addr learned my addr 172.21.15.76:0/1454069277 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:50:38.292 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.288+0000 7f2d6d2fa700 1 --2- 172.21.15.76:0/1454069277 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56093874c3e0 0x56093875a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:38.292 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.288+0000 7f2d6e2fc700 1 -- 172.21.15.76:0/1454069277 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56093874c3e0 msgr2=0x56093875a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:50:38.292 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.288+0000 7f2d6e2fc700 1 --2- 172.21.15.76:0/1454069277 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56093874c3e0 0x56093875a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:38.292 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.288+0000 7f2d6e2fc700 1 -- 172.21.15.76:0/1454069277 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56093874ba80 msgr2=0x56093875a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:50:38.292 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.288+0000 7f2d6e2fc700 1 --2- 172.21.15.76:0/1454069277 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56093874ba80 0x56093875a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:38.292 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.288+0000 7f2d6e2fc700 1 -- 172.21.15.76:0/1454069277 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5609384c9b00 con 0x56093874d2d0 2024-06-02T04:50:38.293 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.288+0000 7f2d6e2fc700 1 --2- 172.21.15.76:0/1454069277 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56093874d2d0 0x56093875b820 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f2d6000c680 tx=0x7f2d60007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f6b9700c35fdd3b server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:50:38.293 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.288+0000 7f2d517fa700 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-06-02T04:50:38.294 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.290+0000 7f2d517fa700 1 -- 172.21.15.76:0/1454069277 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d60099170 con 0x56093874d2d0 2024-06-02T04:50:38.294 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.290+0000 7f2d517fa700 1 -- 172.21.15.76:0/1454069277 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f2d600a1560 con 0x56093874d2d0 2024-06-02T04:50:38.294 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.290+0000 7f2d7bf1ab80 1 -- 172.21.15.76:0/1454069277 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2d6009cfa0 con 0x56093874d2d0 2024-06-02T04:50:38.294 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.291+0000 7f2d517fa700 1 -- 172.21.15.76:0/1454069277 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2d600993d0 con 0x56093874d2d0 2024-06-02T04:50:38.294 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.291+0000 7f2d7bf1ab80 10 client.15783 fetch_fsmap learned FSMap version 28 2024-06-02T04:50:38.294 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.291+0000 7f2d7bf1ab80 1 -- 172.21.15.76:0/1454069277 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x560938521c70 con 0x56093874d2d0 2024-06-02T04:50:38.295 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.291+0000 7f2d517fa700 1 -- 172.21.15.76:0/1454069277 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2d6009cfa0 con 0x56093874d2d0 2024-06-02T04:50:38.295 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.291+0000 7f2d517fa700 1 -- 172.21.15.76:0/1454069277 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 28) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f2d600a10d0 con 0x56093874d2d0 2024-06-02T04:50:38.295 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.291+0000 7f2d7bf1ab80 10 client.15783 fetch_fsmap finished waiting for FSMap version 28 2024-06-02T04:50:38.295 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.291+0000 7f2d7bf1ab80 10 client.15783 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T04:50:38.295 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.291+0000 7f2d7bf1ab80 20 client.15783 populate_metadata read hostname 'smithi076' 2024-06-02T04:50:38.295 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.291+0000 7f2d7bf1ab80 1 --2- 172.21.15.76:0/1454069277 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5609387b7ef0 0x5609387ba310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:38.295 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.291+0000 7f2d7bf1ab80 4 client.15783 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T04:50:38.295 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.291+0000 7f2d7bf1ab80 1 -- 172.21.15.76:0/1454069277 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x560938694e60 con 0x5609387b7ef0 2024-06-02T04:50:38.295 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.291+0000 7f2d6dafb700 1 --2- 172.21.15.76:0/1454069277 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5609387b7ef0 0x5609387ba310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:38.295 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.292+0000 7f2d517fa700 10 client.15783 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:50:38.295 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.292+0000 7f2d6dafb700 1 --2- 172.21.15.76:0/1454069277 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5609387b7ef0 0x5609387ba310 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=24f8c5ecfd3226bb server_cookie=97c73358ceddc9f5 in_seq=0 out_seq=0 2024-06-02T04:50:38.310 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.309+0000 7f2d517fa700 1 -- 172.21.15.76:0/1454069277 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x560938694e60 con 0x5609387b7ef0 2024-06-02T04:50:38.310 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.309+0000 7f2d517fa700 10 client.15783 handle_command_reply: tid=0 2024-06-02T04:50:38.310 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.309+0000 7f2d7bf1ab80 1 client.15783 shutdown 2024-06-02T04:50:38.310 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.309+0000 7f2d7bf1ab80 1 -- 172.21.15.76:0/1454069277 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56093874d2d0 msgr2=0x56093875b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:38.311 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.309+0000 7f2d7bf1ab80 1 --2- 172.21.15.76:0/1454069277 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56093874d2d0 0x56093875b820 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f2d6000c680 tx=0x7f2d60007a00 comp rx=0 tx=0).stop 2024-06-02T04:50:38.311 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.309+0000 7f2d7bf1ab80 1 -- 172.21.15.76:0/1454069277 shutdown_connections 2024-06-02T04:50:38.311 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.309+0000 7f2d7bf1ab80 1 --2- 172.21.15.76:0/1454069277 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5609387b7ef0 0x5609387ba310 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:38.311 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.309+0000 7f2d7bf1ab80 1 --2- 172.21.15.76:0/1454069277 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56093874d2d0 0x56093875b820 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:38.311 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.309+0000 7f2d7bf1ab80 1 --2- 172.21.15.76:0/1454069277 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56093874ba80 0x56093875a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:38.311 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.309+0000 7f2d517fa700 0 client.15783 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:50:38.311 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.309+0000 7f2d7bf1ab80 1 --2- 172.21.15.76:0/1454069277 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56093874c3e0 0x56093875a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:38.311 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.310+0000 7f2d7bf1ab80 1 -- 172.21.15.76:0/1454069277 >> 172.21.15.76:0/1454069277 conn(0x5609386aa1b0 msgr2=0x560938753860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:50:38.311 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.310+0000 7f2d7bf1ab80 1 -- 172.21.15.76:0/1454069277 shutdown_connections 2024-06-02T04:50:38.311 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.310+0000 7f2d7bf1ab80 1 -- 172.21.15.76:0/1454069277 wait complete. 2024-06-02T04:50:38.311 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.310+0000 7f2d7bf1ab80 20 client.15783 trim_cache size 0 max 16384 2024-06-02T04:50:38.312 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:{ 2024-06-02T04:50:38.312 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "message": "", 2024-06-02T04:50:38.312 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "return_code": 0 2024-06-02T04:50:38.312 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:} 2024-06-02T04:50:38.313 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.310+0000 7f2d6fd5f700 1 -- 172.21.15.76:0/438101694 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f2d540a1120 msgr2=0x7f2d540a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:38.313 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.310+0000 7f2d6fd5f700 1 --2- 172.21.15.76:0/438101694 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f2d540a1120 0x7f2d540a35e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f2d68100600 tx=0x7f2d64009190 comp rx=0 tx=0).stop 2024-06-02T04:50:38.313 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.310+0000 7f2d6fd5f700 1 -- 172.21.15.76:0/438101694 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2d68101140 msgr2=0x7f2d681020c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:38.313 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.310+0000 7f2d6fd5f700 1 --2- 172.21.15.76:0/438101694 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2d68101140 0x7f2d681020c0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f2d6000ada0 tx=0x7f2d6000c330 comp rx=0 tx=0).stop 2024-06-02T04:50:38.313 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.310+0000 7f2d6fd5f700 1 -- 172.21.15.76:0/438101694 shutdown_connections 2024-06-02T04:50:38.313 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.311+0000 7f2d6fd5f700 1 --2- 172.21.15.76:0/438101694 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2d68101140 0x7f2d681020c0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:38.313 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.311+0000 7f2d6fd5f700 1 --2- 172.21.15.76:0/438101694 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d680ff5b0 0x7f2d681034f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:38.313 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.311+0000 7f2d6fd5f700 1 --2- 172.21.15.76:0/438101694 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f2d540a1120 0x7f2d540a35e0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:38.313 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.311+0000 7f2d6fd5f700 1 --2- 172.21.15.76:0/438101694 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d681007a0 0x7f2d68101b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:38.314 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.311+0000 7f2d6fd5f700 1 -- 172.21.15.76:0/438101694 >> 172.21.15.76:0/438101694 conn(0x7f2d680fab20 msgr2=0x7f2d68108370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:50:38.314 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.311+0000 7f2d6fd5f700 1 -- 172.21.15.76:0/438101694 shutdown_connections 2024-06-02T04:50:38.314 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:38.311+0000 7f2d6fd5f700 1 -- 172.21.15.76:0/438101694 wait complete. 2024-06-02T04:50:39.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:39 smithi119 ceph-mon[46633]: pgmap v300: 129 pgs: 129 active+clean; 749 MiB data, 677 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 46 MiB/s wr, 41 op/s 2024-06-02T04:50:39.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:39 smithi192 ceph-mon[47933]: pgmap v300: 129 pgs: 129 active+clean; 749 MiB data, 677 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 46 MiB/s wr, 41 op/s 2024-06-02T04:50:39.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:39 smithi076 ceph-mon[42935]: pgmap v300: 129 pgs: 129 active+clean; 749 MiB data, 677 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 46 MiB/s wr, 41 op/s 2024-06-02T04:50:41.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:41 smithi119 ceph-mon[46633]: pgmap v301: 129 pgs: 129 active+clean; 755 MiB data, 682 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 39 MiB/s wr, 32 op/s 2024-06-02T04:50:41.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:41 smithi192 ceph-mon[47933]: pgmap v301: 129 pgs: 129 active+clean; 755 MiB data, 682 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 39 MiB/s wr, 32 op/s 2024-06-02T04:50:41.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:41 smithi076 ceph-mon[42935]: pgmap v301: 129 pgs: 129 active+clean; 755 MiB data, 682 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 39 MiB/s wr, 32 op/s 2024-06-02T04:50:43.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:43 smithi119 ceph-mon[46633]: pgmap v302: 129 pgs: 129 active+clean; 771 MiB data, 672 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 46 MiB/s wr, 40 op/s 2024-06-02T04:50:43.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:43 smithi119 ceph-mon[46633]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-06-02T04:50:43.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:43 smithi192 ceph-mon[47933]: pgmap v302: 129 pgs: 129 active+clean; 771 MiB data, 672 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 46 MiB/s wr, 40 op/s 2024-06-02T04:50:43.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:43 smithi192 ceph-mon[47933]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-06-02T04:50:43.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:43 smithi076 ceph-mon[42935]: pgmap v302: 129 pgs: 129 active+clean; 771 MiB data, 672 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 46 MiB/s wr, 40 op/s 2024-06-02T04:50:43.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:43 smithi076 ceph-mon[42935]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-06-02T04:50:45.253 INFO:teuthology.orchestra.run.smithi076.stderr:set primary keys... 2024-06-02T04:50:45.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:45 smithi119 ceph-mon[46633]: pgmap v303: 129 pgs: 129 active+clean; 771 MiB data, 676 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 39 MiB/s wr, 36 op/s 2024-06-02T04:50:45.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:45 smithi192 ceph-mon[47933]: pgmap v303: 129 pgs: 129 active+clean; 771 MiB data, 676 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 39 MiB/s wr, 36 op/s 2024-06-02T04:50:45.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:45 smithi076 ceph-mon[42935]: pgmap v303: 129 pgs: 129 active+clean; 771 MiB data, 676 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 39 MiB/s wr, 36 op/s 2024-06-02T04:50:47.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:47 smithi119 ceph-mon[46633]: pgmap v304: 129 pgs: 129 active+clean; 771 MiB data, 676 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 46 MiB/s wr, 40 op/s 2024-06-02T04:50:47.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:47 smithi192 ceph-mon[47933]: pgmap v304: 129 pgs: 129 active+clean; 771 MiB data, 676 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 46 MiB/s wr, 40 op/s 2024-06-02T04:50:47.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:47 smithi076 ceph-mon[42935]: pgmap v304: 129 pgs: 129 active+clean; 771 MiB data, 676 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 46 MiB/s wr, 40 op/s 2024-06-02T04:50:48.041 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-06-02T04:50:48.186 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.185+0000 7fe269810700 1 -- 172.21.15.76:0/1486151531 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe2640ff220 msgr2=0x7fe2640ff640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:48.186 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.185+0000 7fe269810700 1 --2- 172.21.15.76:0/1486151531 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe2640ff220 0x7fe2640ff640 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fe254009990 tx=0x7fe254009ca0 comp rx=0 tx=0).stop 2024-06-02T04:50:48.186 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.185+0000 7fe269810700 1 -- 172.21.15.76:0/1486151531 shutdown_connections 2024-06-02T04:50:48.186 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.185+0000 7fe269810700 1 --2- 172.21.15.76:0/1486151531 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe264102b90 0x7fe264109440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:48.187 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.185+0000 7fe269810700 1 --2- 172.21.15.76:0/1486151531 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe2640ff220 0x7fe2640ff640 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:48.187 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.185+0000 7fe269810700 1 --2- 172.21.15.76:0/1486151531 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe2641021f0 0x7fe264102650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:48.187 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.186+0000 7fe269810700 1 -- 172.21.15.76:0/1486151531 >> 172.21.15.76:0/1486151531 conn(0x7fe2640fab50 msgr2=0x7fe2640fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:50:48.187 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.186+0000 7fe269810700 1 -- 172.21.15.76:0/1486151531 shutdown_connections 2024-06-02T04:50:48.187 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.186+0000 7fe269810700 1 -- 172.21.15.76:0/1486151531 wait complete. 2024-06-02T04:50:48.187 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.186+0000 7fe269810700 1 Processor -- start 2024-06-02T04:50:48.189 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.186+0000 7fe269810700 1 -- start start 2024-06-02T04:50:48.189 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.187+0000 7fe269810700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe2640ff220 0x7fe264196e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:48.189 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.187+0000 7fe269810700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe2641021f0 0x7fe264197380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:48.189 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.187+0000 7fe269810700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe264102b90 0x7fe26419e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:48.189 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.187+0000 7fe269810700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe26419e970 con 0x7fe2641021f0 2024-06-02T04:50:48.189 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.187+0000 7fe269810700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe26419eab0 con 0x7fe2640ff220 2024-06-02T04:50:48.189 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.187+0000 7fe269810700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe26419ec40 con 0x7fe264102b90 2024-06-02T04:50:48.189 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.187+0000 7fe2627fc700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe2641021f0 0x7fe264197380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:48.190 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.187+0000 7fe2627fc700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe2641021f0 0x7fe264197380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:49296/0 (socket says 172.21.15.76:49296) 2024-06-02T04:50:48.190 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.187+0000 7fe262ffd700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe2640ff220 0x7fe264196e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:48.190 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.187+0000 7fe2627fc700 1 -- 172.21.15.76:0/29997199 learned_addr learned my addr 172.21.15.76:0/29997199 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:50:48.190 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.187+0000 7fe2637fe700 1 --2- 172.21.15.76:0/29997199 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe264102b90 0x7fe26419e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:48.190 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.187+0000 7fe2627fc700 1 -- 172.21.15.76:0/29997199 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe264102b90 msgr2=0x7fe26419e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:48.190 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.187+0000 7fe2627fc700 1 --2- 172.21.15.76:0/29997199 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe264102b90 0x7fe26419e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:48.190 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.187+0000 7fe2627fc700 1 -- 172.21.15.76:0/29997199 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe2640ff220 msgr2=0x7fe264196e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:48.190 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.187+0000 7fe2627fc700 1 --2- 172.21.15.76:0/29997199 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe2640ff220 0x7fe264196e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:48.190 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.187+0000 7fe2627fc700 1 -- 172.21.15.76:0/29997199 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2540095f0 con 0x7fe2641021f0 2024-06-02T04:50:48.190 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.187+0000 7fe262ffd700 1 --2- 172.21.15.76:0/29997199 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe2640ff220 0x7fe264196e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T04:50:48.190 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.187+0000 7fe2627fc700 1 --2- 172.21.15.76:0/29997199 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe2641021f0 0x7fe264197380 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fe25800e9a0 tx=0x7fe25800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:50:48.191 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.187+0000 7fe26880e700 1 -- 172.21.15.76:0/29997199 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe258009790 con 0x7fe2641021f0 2024-06-02T04:50:48.191 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.187+0000 7fe26880e700 1 -- 172.21.15.76:0/29997199 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe25800cbd0 con 0x7fe2641021f0 2024-06-02T04:50:48.191 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.187+0000 7fe269810700 1 -- 172.21.15.76:0/29997199 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe26419ef20 con 0x7fe2641021f0 2024-06-02T04:50:48.191 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.187+0000 7fe26880e700 1 -- 172.21.15.76:0/29997199 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe258018680 con 0x7fe2641021f0 2024-06-02T04:50:48.191 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.188+0000 7fe269810700 1 -- 172.21.15.76:0/29997199 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe26419f3f0 con 0x7fe2641021f0 2024-06-02T04:50:48.194 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.190+0000 7fe26880e700 1 -- 172.21.15.76:0/29997199 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fe25800cd40 con 0x7fe2641021f0 2024-06-02T04:50:48.194 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.191+0000 7fe26880e700 1 --2- 172.21.15.76:0/29997199 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fe24c0a11a0 0x7fe24c0a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:48.194 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.191+0000 7fe26880e700 1 -- 172.21.15.76:0/29997199 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7fe258014070 con 0x7fe2641021f0 2024-06-02T04:50:48.194 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.191+0000 7fe262ffd700 1 --2- 172.21.15.76:0/29997199 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fe24c0a11a0 0x7fe24c0a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:48.194 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.191+0000 7fe2759cbb80 1 Processor -- start 2024-06-02T04:50:48.194 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.191+0000 7fe2759cbb80 1 -- start start 2024-06-02T04:50:48.194 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.191+0000 7fe2759cbb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5644a5df2540 0x5644a5df2960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:48.194 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.191+0000 7fe2759cbb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5644a5df2ea0 0x5644a5df3320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:48.195 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.191+0000 7fe2759cbb80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5644a5df3860 0x5644a5df3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:48.195 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.191+0000 7fe2759cbb80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644a5d49150 con 0x5644a5df3860 2024-06-02T04:50:48.195 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.191+0000 7fe2759cbb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644a5d46b10 con 0x5644a5df2540 2024-06-02T04:50:48.195 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.191+0000 7fe2759cbb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644a5d42400 con 0x5644a5df2ea0 2024-06-02T04:50:48.195 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.191+0000 7fe262ffd700 1 --2- 172.21.15.76:0/29997199 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fe24c0a11a0 0x7fe24c0a3660 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fe254006010 tx=0x7fe25400b610 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:50:48.195 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.192+0000 7fe2637fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5644a5df3860 0x5644a5df3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:48.195 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.192+0000 7fe2637fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5644a5df3860 0x5644a5df3ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:49304/0 (socket says 172.21.15.76:49304) 2024-06-02T04:50:48.195 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.192+0000 7fe2637fe700 1 -- 172.21.15.76:0/1151969308 learned_addr learned my addr 172.21.15.76:0/1151969308 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:50:48.195 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.192+0000 7fe262ffd700 1 --2- 172.21.15.76:0/1151969308 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5644a5df2540 0x5644a5df2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:48.195 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.192+0000 7fe2627fc700 1 --2- 172.21.15.76:0/1151969308 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5644a5df2ea0 0x5644a5df3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:48.195 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.192+0000 7fe2637fe700 1 -- 172.21.15.76:0/1151969308 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5644a5df2ea0 msgr2=0x5644a5df3320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:50:48.195 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.192+0000 7fe2637fe700 1 --2- 172.21.15.76:0/1151969308 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5644a5df2ea0 0x5644a5df3320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:48.196 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.192+0000 7fe2637fe700 1 -- 172.21.15.76:0/1151969308 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5644a5df2540 msgr2=0x5644a5df2960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:50:48.196 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.192+0000 7fe2637fe700 1 --2- 172.21.15.76:0/1151969308 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5644a5df2540 0x5644a5df2960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:48.196 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.192+0000 7fe2637fe700 1 -- 172.21.15.76:0/1151969308 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5644a5bc33b0 con 0x5644a5df3860 2024-06-02T04:50:48.196 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.192+0000 7fe2637fe700 1 --2- 172.21.15.76:0/1151969308 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5644a5df3860 0x5644a5df3ce0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fe25c009440 tx=0x7fe25c009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b224c97051d1ec9 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:50:48.196 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.192+0000 7fe249ffb700 1 -- 172.21.15.76:0/1151969308 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe25c00e070 con 0x5644a5df3860 2024-06-02T04:50:48.196 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.192+0000 7fe249ffb700 1 -- 172.21.15.76:0/1151969308 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe25c00f040 con 0x5644a5df3860 2024-06-02T04:50:48.196 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.192+0000 7fe249ffb700 1 -- 172.21.15.76:0/1151969308 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe25c015a80 con 0x5644a5df3860 2024-06-02T04:50:48.196 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.193+0000 7fe2759cbb80 1 -- 172.21.15.76:0/1151969308 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5644a5df3860 msgr2=0x5644a5df3ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:48.196 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.193+0000 7fe2759cbb80 1 --2- 172.21.15.76:0/1151969308 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5644a5df3860 0x5644a5df3ce0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fe25c009440 tx=0x7fe25c009920 comp rx=0 tx=0).stop 2024-06-02T04:50:48.196 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.193+0000 7fe2759cbb80 1 -- 172.21.15.76:0/1151969308 shutdown_connections 2024-06-02T04:50:48.196 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.193+0000 7fe2759cbb80 1 --2- 172.21.15.76:0/1151969308 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5644a5df3860 0x5644a5df3ce0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:48.196 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.193+0000 7fe2759cbb80 1 --2- 172.21.15.76:0/1151969308 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5644a5df2540 0x5644a5df2960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:48.196 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.193+0000 7fe2759cbb80 1 --2- 172.21.15.76:0/1151969308 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5644a5df2ea0 0x5644a5df3320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:48.197 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.194+0000 7fe2759cbb80 1 -- 172.21.15.76:0/1151969308 >> 172.21.15.76:0/1151969308 conn(0x5644a5d50210 msgr2=0x5644a5decde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:50:48.197 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.194+0000 7fe2759cbb80 1 -- 172.21.15.76:0/1151969308 shutdown_connections 2024-06-02T04:50:48.197 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.194+0000 7fe2759cbb80 1 -- 172.21.15.76:0/1151969308 wait complete. 2024-06-02T04:50:48.197 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.194+0000 7fe2759cbb80 1 -- start start 2024-06-02T04:50:48.200 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.194+0000 7fe2759cbb80 1 Processor -- start 2024-06-02T04:50:48.200 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.194+0000 7fe2759cbb80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5644a5df2540 0x5644a5dfbda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:48.200 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.194+0000 7fe2759cbb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5644a5df2ea0 0x5644a5dfc2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:48.200 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.194+0000 7fe2759cbb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5644a5df3860 0x5644a5e03320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:48.200 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.194+0000 7fe2759cbb80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644a5cde560 con 0x5644a5df2540 2024-06-02T04:50:48.200 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.194+0000 7fe2759cbb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644a5cde200 con 0x5644a5df3860 2024-06-02T04:50:48.200 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.194+0000 7fe2759cbb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644a5bc56a0 con 0x5644a5df2ea0 2024-06-02T04:50:48.201 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.194+0000 7fe2759cbb80 10 client.0 _ll_register_callbacks cb 0x5644a5ce7b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:50:48.201 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.195+0000 7fe262ffd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5644a5df2540 0x5644a5dfbda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:48.201 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.195+0000 7fe262ffd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5644a5df2540 0x5644a5dfbda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:49314/0 (socket says 172.21.15.76:49314) 2024-06-02T04:50:48.201 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.195+0000 7fe262ffd700 1 -- 172.21.15.76:0/3476601710 learned_addr learned my addr 172.21.15.76:0/3476601710 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:50:48.201 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.195+0000 7fe2637fe700 1 --2- 172.21.15.76:0/3476601710 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5644a5df3860 0x5644a5e03320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:48.201 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.195+0000 7fe2627fc700 1 --2- 172.21.15.76:0/3476601710 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5644a5df2ea0 0x5644a5dfc2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:48.201 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.195+0000 7fe262ffd700 1 -- 172.21.15.76:0/3476601710 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5644a5df2ea0 msgr2=0x5644a5dfc2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:50:48.201 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.195+0000 7fe262ffd700 1 --2- 172.21.15.76:0/3476601710 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5644a5df2ea0 0x5644a5dfc2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:48.201 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.195+0000 7fe262ffd700 1 -- 172.21.15.76:0/3476601710 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5644a5df3860 msgr2=0x5644a5e03320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:50:48.201 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.195+0000 7fe262ffd700 1 --2- 172.21.15.76:0/3476601710 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5644a5df3860 0x5644a5e03320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:48.201 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.195+0000 7fe262ffd700 1 -- 172.21.15.76:0/3476601710 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe25c0090f0 con 0x5644a5df2540 2024-06-02T04:50:48.201 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.195+0000 7fe262ffd700 1 --2- 172.21.15.76:0/3476601710 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5644a5df2540 0x5644a5dfbda0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fe2540092e0 tx=0x7fe25401a050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cc8cbb0d2483c68 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:50:48.201 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.195+0000 7fe242ffd700 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-06-02T04:50:48.202 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.195+0000 7fe242ffd700 1 -- 172.21.15.76:0/3476601710 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe254028030 con 0x5644a5df2540 2024-06-02T04:50:48.202 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.195+0000 7fe242ffd700 1 -- 172.21.15.76:0/3476601710 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7fe25400fcd0 con 0x5644a5df2540 2024-06-02T04:50:48.202 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.195+0000 7fe2759cbb80 1 -- 172.21.15.76:0/3476601710 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5644a5c9b270 con 0x5644a5df2540 2024-06-02T04:50:48.202 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.195+0000 7fe242ffd700 1 -- 172.21.15.76:0/3476601710 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe25400fe90 con 0x5644a5df2540 2024-06-02T04:50:48.202 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.195+0000 7fe2759cbb80 10 client.15795 fetch_fsmap learned FSMap version 29 2024-06-02T04:50:48.202 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.195+0000 7fe2759cbb80 1 -- 172.21.15.76:0/3476601710 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x5644a5b6fb60 con 0x5644a5df2540 2024-06-02T04:50:48.202 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.196+0000 7fe242ffd700 1 -- 172.21.15.76:0/3476601710 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5644a5c9b270 con 0x5644a5df2540 2024-06-02T04:50:48.202 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.196+0000 7fe242ffd700 1 -- 172.21.15.76:0/3476601710 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 29) v1 ==== 7482+0+0 (secure 0 0 0) 0x7fe254024410 con 0x5644a5df2540 2024-06-02T04:50:48.202 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.196+0000 7fe2759cbb80 10 client.15795 fetch_fsmap finished waiting for FSMap version 29 2024-06-02T04:50:48.202 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.196+0000 7fe2759cbb80 10 client.15795 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-06-02T04:50:48.202 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.196+0000 7fe2759cbb80 20 client.15795 populate_metadata read hostname 'smithi076' 2024-06-02T04:50:48.203 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.196+0000 7fe2759cbb80 1 --2- 172.21.15.76:0/3476601710 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5644a5e07c00 0x5644a5e0a020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:48.203 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.196+0000 7fe2759cbb80 4 client.15795 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T04:50:48.203 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.196+0000 7fe2759cbb80 1 -- 172.21.15.76:0/3476601710 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5644a5dc1810 con 0x5644a5e07c00 2024-06-02T04:50:48.203 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.196+0000 7fe2627fc700 1 --2- 172.21.15.76:0/3476601710 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5644a5e07c00 0x5644a5e0a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:48.203 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.197+0000 7fe242ffd700 10 client.15795 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:50:48.203 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.197+0000 7fe2627fc700 1 --2- 172.21.15.76:0/3476601710 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5644a5e07c00 0x5644a5e0a020 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cbd479b625b6b22d server_cookie=582b61ac2f86e267 in_seq=0 out_seq=0 2024-06-02T04:50:48.203 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.197+0000 7fe242ffd700 1 -- 172.21.15.76:0/3476601710 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5644a5dc1810 con 0x5644a5e07c00 2024-06-02T04:50:48.203 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.197+0000 7fe242ffd700 10 client.15795 handle_command_reply: tid=0 2024-06-02T04:50:48.203 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.197+0000 7fe2759cbb80 1 client.15795 shutdown 2024-06-02T04:50:48.203 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.197+0000 7fe2759cbb80 1 -- 172.21.15.76:0/3476601710 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5644a5df2540 msgr2=0x5644a5dfbda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:48.203 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.197+0000 7fe2759cbb80 1 --2- 172.21.15.76:0/3476601710 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5644a5df2540 0x5644a5dfbda0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fe2540092e0 tx=0x7fe25401a050 comp rx=0 tx=0).stop 2024-06-02T04:50:48.203 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.197+0000 7fe2759cbb80 1 -- 172.21.15.76:0/3476601710 shutdown_connections 2024-06-02T04:50:48.203 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.197+0000 7fe2759cbb80 1 --2- 172.21.15.76:0/3476601710 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5644a5e07c00 0x5644a5e0a020 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:48.204 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.197+0000 7fe2759cbb80 1 --2- 172.21.15.76:0/3476601710 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5644a5df3860 0x5644a5e03320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:48.204 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.197+0000 7fe2759cbb80 1 --2- 172.21.15.76:0/3476601710 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5644a5df2540 0x5644a5dfbda0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:48.204 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.197+0000 7fe242ffd700 0 client.15795 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:50:48.204 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.197+0000 7fe2759cbb80 1 --2- 172.21.15.76:0/3476601710 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5644a5df2ea0 0x5644a5dfc2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:48.204 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.197+0000 7fe2759cbb80 1 -- 172.21.15.76:0/3476601710 >> 172.21.15.76:0/3476601710 conn(0x5644a5d50210 msgr2=0x5644a5dec5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:50:48.204 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.197+0000 7fe2759cbb80 1 -- 172.21.15.76:0/3476601710 shutdown_connections 2024-06-02T04:50:48.204 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.198+0000 7fe2759cbb80 1 -- 172.21.15.76:0/3476601710 wait complete. 2024-06-02T04:50:48.204 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.198+0000 7fe2759cbb80 20 client.15795 trim_cache size 0 max 16384 2024-06-02T04:50:48.217 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.216+0000 7fe2759cbb80 1 Processor -- start 2024-06-02T04:50:48.218 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.216+0000 7fe2759cbb80 1 -- start start 2024-06-02T04:50:48.218 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.216+0000 7fe2759cbb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5644a5df2540 0x5644a5df66f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:48.218 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.216+0000 7fe2759cbb80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5644a5df2ea0 0x5644a5df6c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:48.218 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.216+0000 7fe2759cbb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5644a5df3860 0x5644a5dfbb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:48.218 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.216+0000 7fe2759cbb80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644a5e044a0 con 0x5644a5df2ea0 2024-06-02T04:50:48.218 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.216+0000 7fe2759cbb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644a5dfad60 con 0x5644a5df2540 2024-06-02T04:50:48.218 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.216+0000 7fe2759cbb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644a5ded9a0 con 0x5644a5df3860 2024-06-02T04:50:48.218 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.216+0000 7fe2627fc700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5644a5df2ea0 0x5644a5df6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:48.218 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.216+0000 7fe2627fc700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5644a5df2ea0 0x5644a5df6c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:49324/0 (socket says 172.21.15.76:49324) 2024-06-02T04:50:48.218 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.216+0000 7fe2627fc700 1 -- 172.21.15.76:0/1968587379 learned_addr learned my addr 172.21.15.76:0/1968587379 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:50:48.219 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.216+0000 7fe262ffd700 1 --2- 172.21.15.76:0/1968587379 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5644a5df2540 0x5644a5df66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:48.219 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.217+0000 7fe2637fe700 1 --2- 172.21.15.76:0/1968587379 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5644a5df3860 0x5644a5dfbb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:48.219 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.217+0000 7fe2627fc700 1 -- 172.21.15.76:0/1968587379 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5644a5df3860 msgr2=0x5644a5dfbb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:50:48.219 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.217+0000 7fe2627fc700 1 --2- 172.21.15.76:0/1968587379 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5644a5df3860 0x5644a5dfbb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:48.219 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.217+0000 7fe2627fc700 1 -- 172.21.15.76:0/1968587379 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5644a5df2540 msgr2=0x5644a5df66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:50:48.219 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.217+0000 7fe2627fc700 1 --2- 172.21.15.76:0/1968587379 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5644a5df2540 0x5644a5df66f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:48.219 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.217+0000 7fe2627fc700 1 -- 172.21.15.76:0/1968587379 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5644a5d08560 con 0x5644a5df2ea0 2024-06-02T04:50:48.219 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.217+0000 7fe262ffd700 1 --2- 172.21.15.76:0/1968587379 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5644a5df2540 0x5644a5df66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T04:50:48.219 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.217+0000 7fe2627fc700 1 --2- 172.21.15.76:0/1968587379 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5644a5df2ea0 0x5644a5df6c30 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fe258099e80 tx=0x7fe2580ca470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28abbd1223658a38 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:50:48.219 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.217+0000 7fe24a7fc700 1 -- 172.21.15.76:0/1968587379 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe25809dd20 con 0x5644a5df2ea0 2024-06-02T04:50:48.219 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.217+0000 7fe24a7fc700 1 -- 172.21.15.76:0/1968587379 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe2580a2370 con 0x5644a5df2ea0 2024-06-02T04:50:48.219 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.217+0000 7fe24a7fc700 1 -- 172.21.15.76:0/1968587379 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2580a1ee0 con 0x5644a5df2ea0 2024-06-02T04:50:48.224 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.218+0000 7fe2759cbb80 1 -- 172.21.15.76:0/1968587379 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5644a5df2ea0 msgr2=0x5644a5df6c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:48.224 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.218+0000 7fe2759cbb80 1 --2- 172.21.15.76:0/1968587379 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5644a5df2ea0 0x5644a5df6c30 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fe258099e80 tx=0x7fe2580ca470 comp rx=0 tx=0).stop 2024-06-02T04:50:48.224 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.218+0000 7fe2759cbb80 1 -- 172.21.15.76:0/1968587379 shutdown_connections 2024-06-02T04:50:48.225 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.218+0000 7fe2759cbb80 1 --2- 172.21.15.76:0/1968587379 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5644a5df3860 0x5644a5dfbb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:48.225 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.218+0000 7fe2759cbb80 1 --2- 172.21.15.76:0/1968587379 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5644a5df2540 0x5644a5df66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:48.225 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.218+0000 7fe2759cbb80 1 --2- 172.21.15.76:0/1968587379 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5644a5df2ea0 0x5644a5df6c30 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:48.225 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.218+0000 7fe2759cbb80 1 -- 172.21.15.76:0/1968587379 >> 172.21.15.76:0/1968587379 conn(0x5644a5d50210 msgr2=0x5644a5dfb2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:50:48.225 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.218+0000 7fe2759cbb80 1 -- 172.21.15.76:0/1968587379 shutdown_connections 2024-06-02T04:50:48.225 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.218+0000 7fe2759cbb80 1 -- 172.21.15.76:0/1968587379 wait complete. 2024-06-02T04:50:48.225 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.218+0000 7fe2759cbb80 1 -- start start 2024-06-02T04:50:48.225 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.219+0000 7fe2759cbb80 1 Processor -- start 2024-06-02T04:50:48.225 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.219+0000 7fe2759cbb80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5644a5df2540 0x5644a5e5a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:48.225 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.219+0000 7fe2759cbb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5644a5df2ea0 0x5644a5e5a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:48.225 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.219+0000 7fe2759cbb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5644a5df3860 0x5644a5e61530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:48.225 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.219+0000 7fe2759cbb80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644a5e61a70 con 0x5644a5df2540 2024-06-02T04:50:48.226 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.219+0000 7fe2759cbb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644a5e61bb0 con 0x5644a5df3860 2024-06-02T04:50:48.226 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.219+0000 7fe2759cbb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644a5e61d40 con 0x5644a5df2ea0 2024-06-02T04:50:48.226 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.219+0000 7fe2759cbb80 10 client.0 _ll_register_callbacks cb 0x5644a5ce7b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:50:48.226 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.219+0000 7fe262ffd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5644a5df2540 0x5644a5e5a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:48.226 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.219+0000 7fe2627fc700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5644a5df2ea0 0x5644a5e5a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:48.226 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.219+0000 7fe262ffd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5644a5df2540 0x5644a5e5a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:49328/0 (socket says 172.21.15.76:49328) 2024-06-02T04:50:48.226 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.219+0000 7fe262ffd700 1 -- 172.21.15.76:0/119296208 learned_addr learned my addr 172.21.15.76:0/119296208 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:50:48.226 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.219+0000 7fe2637fe700 1 --2- 172.21.15.76:0/119296208 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5644a5df3860 0x5644a5e61530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:48.226 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.219+0000 7fe262ffd700 1 -- 172.21.15.76:0/119296208 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5644a5df2ea0 msgr2=0x5644a5e5a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:50:48.226 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.219+0000 7fe262ffd700 1 --2- 172.21.15.76:0/119296208 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5644a5df2ea0 0x5644a5e5a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:48.226 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.219+0000 7fe262ffd700 1 -- 172.21.15.76:0/119296208 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5644a5df3860 msgr2=0x5644a5e61530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:50:48.226 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.219+0000 7fe262ffd700 1 --2- 172.21.15.76:0/119296208 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5644a5df3860 0x5644a5e61530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:48.227 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.219+0000 7fe262ffd700 1 -- 172.21.15.76:0/119296208 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5644a5b6fb60 con 0x5644a5df2540 2024-06-02T04:50:48.227 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.219+0000 7fe2637fe700 1 --2- 172.21.15.76:0/119296208 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5644a5df3860 0x5644a5e61530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:50:48.227 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.220+0000 7fe262ffd700 1 --2- 172.21.15.76:0/119296208 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5644a5df2540 0x5644a5e5a320 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fe2540098e0 tx=0x7fe2540249b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cf36bd1ee8b06a5 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:50:48.227 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.220+0000 7fe242ffd700 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-06-02T04:50:48.227 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.220+0000 7fe242ffd700 1 -- 172.21.15.76:0/119296208 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe254028040 con 0x5644a5df2540 2024-06-02T04:50:48.227 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.220+0000 7fe242ffd700 1 -- 172.21.15.76:0/119296208 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7fe254005be0 con 0x5644a5df2540 2024-06-02T04:50:48.227 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.220+0000 7fe2759cbb80 1 -- 172.21.15.76:0/119296208 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe25c00f040 con 0x5644a5df2540 2024-06-02T04:50:48.227 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.220+0000 7fe242ffd700 1 -- 172.21.15.76:0/119296208 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe25400f740 con 0x5644a5df2540 2024-06-02T04:50:48.227 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.220+0000 7fe2759cbb80 10 client.15801 fetch_fsmap learned FSMap version 29 2024-06-02T04:50:48.227 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.220+0000 7fe2759cbb80 1 -- 172.21.15.76:0/119296208 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x7fe26419f3f0 con 0x5644a5df2540 2024-06-02T04:50:48.228 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.220+0000 7fe242ffd700 1 -- 172.21.15.76:0/119296208 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe25c00f040 con 0x5644a5df2540 2024-06-02T04:50:48.228 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.220+0000 7fe242ffd700 1 -- 172.21.15.76:0/119296208 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 29) v1 ==== 7482+0+0 (secure 0 0 0) 0x7fe254037040 con 0x5644a5df2540 2024-06-02T04:50:48.228 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.220+0000 7fe2759cbb80 10 client.15801 fetch_fsmap finished waiting for FSMap version 29 2024-06-02T04:50:48.228 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.220+0000 7fe2759cbb80 10 client.15801 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-06-02T04:50:48.228 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.220+0000 7fe2759cbb80 20 client.15801 populate_metadata read hostname 'smithi076' 2024-06-02T04:50:48.229 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.220+0000 7fe2759cbb80 1 --2- 172.21.15.76:0/119296208 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5644a5e633c0 0x5644a5e657e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:48.229 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.220+0000 7fe2759cbb80 4 client.15801 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-06-02T04:50:48.229 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.220+0000 7fe2759cbb80 1 -- 172.21.15.76:0/119296208 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5644a5d3aec0 con 0x5644a5e633c0 2024-06-02T04:50:48.229 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.221+0000 7fe2627fc700 1 --2- 172.21.15.76:0/119296208 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5644a5e633c0 0x5644a5e657e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:48.229 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.221+0000 7fe242ffd700 10 client.15801 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:50:48.229 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.221+0000 7fe2627fc700 1 --2- 172.21.15.76:0/119296208 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5644a5e633c0 0x5644a5e657e0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=85cbf1e289bd27c2 server_cookie=e8c3993bdff7c03d in_seq=0 out_seq=0 2024-06-02T04:50:48.229 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.221+0000 7fe242ffd700 1 -- 172.21.15.76:0/119296208 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x5644a5d3aec0 con 0x5644a5e633c0 2024-06-02T04:50:48.229 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.221+0000 7fe242ffd700 10 client.15801 handle_command_reply: tid=0 2024-06-02T04:50:48.230 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.221+0000 7fe2759cbb80 1 client.15801 shutdown 2024-06-02T04:50:48.230 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.221+0000 7fe2759cbb80 1 -- 172.21.15.76:0/119296208 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5644a5df2540 msgr2=0x5644a5e5a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:48.230 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.221+0000 7fe2759cbb80 1 --2- 172.21.15.76:0/119296208 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5644a5df2540 0x5644a5e5a320 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fe2540098e0 tx=0x7fe2540249b0 comp rx=0 tx=0).stop 2024-06-02T04:50:48.230 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.221+0000 7fe2759cbb80 1 -- 172.21.15.76:0/119296208 shutdown_connections 2024-06-02T04:50:48.230 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.221+0000 7fe2759cbb80 1 --2- 172.21.15.76:0/119296208 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5644a5e633c0 0x5644a5e657e0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:48.230 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.221+0000 7fe2759cbb80 1 --2- 172.21.15.76:0/119296208 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5644a5df3860 0x5644a5e61530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:48.230 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.221+0000 7fe242ffd700 0 client.15801 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:50:48.230 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.221+0000 7fe2759cbb80 1 --2- 172.21.15.76:0/119296208 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5644a5df2540 0x5644a5e5a320 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:48.230 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.221+0000 7fe2759cbb80 1 --2- 172.21.15.76:0/119296208 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5644a5df2ea0 0x5644a5e5a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:48.230 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.221+0000 7fe2759cbb80 1 -- 172.21.15.76:0/119296208 >> 172.21.15.76:0/119296208 conn(0x5644a5d50210 msgr2=0x5644a5df66f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:50:48.230 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.221+0000 7fe2759cbb80 1 -- 172.21.15.76:0/119296208 shutdown_connections 2024-06-02T04:50:48.230 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.221+0000 7fe2759cbb80 1 -- 172.21.15.76:0/119296208 wait complete. 2024-06-02T04:50:48.231 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.222+0000 7fe2759cbb80 20 client.15801 trim_cache size 0 max 16384 2024-06-02T04:50:48.231 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-06-02T04:50:48.231 INFO:teuthology.orchestra.run.smithi076.stdout: "status": "no active scrubs running", 2024-06-02T04:50:48.231 INFO:teuthology.orchestra.run.smithi076.stdout: "scrubs": {} 2024-06-02T04:50:48.231 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-06-02T04:50:48.232 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.222+0000 7fe269810700 1 -- 172.21.15.76:0/29997199 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fe24c0a11a0 msgr2=0x7fe24c0a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:48.232 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.222+0000 7fe269810700 1 --2- 172.21.15.76:0/29997199 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fe24c0a11a0 0x7fe24c0a3660 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fe254006010 tx=0x7fe25400b610 comp rx=0 tx=0).stop 2024-06-02T04:50:48.232 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.222+0000 7fe269810700 1 -- 172.21.15.76:0/29997199 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe2641021f0 msgr2=0x7fe264197380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:48.232 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.222+0000 7fe269810700 1 --2- 172.21.15.76:0/29997199 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe2641021f0 0x7fe264197380 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fe25800e9a0 tx=0x7fe25800ecb0 comp rx=0 tx=0).stop 2024-06-02T04:50:48.232 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.222+0000 7fe269810700 1 -- 172.21.15.76:0/29997199 shutdown_connections 2024-06-02T04:50:48.232 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.222+0000 7fe269810700 1 --2- 172.21.15.76:0/29997199 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe264102b90 0x7fe26419e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:48.232 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.222+0000 7fe269810700 1 --2- 172.21.15.76:0/29997199 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fe24c0a11a0 0x7fe24c0a3660 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:48.233 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.222+0000 7fe269810700 1 --2- 172.21.15.76:0/29997199 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe2640ff220 0x7fe264196e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:48.233 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.222+0000 7fe269810700 1 --2- 172.21.15.76:0/29997199 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe2641021f0 0x7fe264197380 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:48.233 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.222+0000 7fe269810700 1 -- 172.21.15.76:0/29997199 >> 172.21.15.76:0/29997199 conn(0x7fe2640fab50 msgr2=0x7fe2641056b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:50:48.233 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.222+0000 7fe269810700 1 -- 172.21.15.76:0/29997199 shutdown_connections 2024-06-02T04:50:48.233 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.222+0000 7fe269810700 1 -- 172.21.15.76:0/29997199 wait complete. 2024-06-02T04:50:48.237 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-06-02T04:50:48.237 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T04:50:48.383 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.380+0000 7f1d5bce6700 1 -- 172.21.15.76:0/2110122593 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1d540ffd60 msgr2=0x7f1d54100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:48.383 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.380+0000 7f1d5bce6700 1 --2- 172.21.15.76:0/2110122593 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1d540ffd60 0x7f1d54100180 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f1d500099c0 tx=0x7f1d50009cd0 comp rx=0 tx=0).stop 2024-06-02T04:50:48.383 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.380+0000 7f1d5bce6700 1 -- 172.21.15.76:0/2110122593 shutdown_connections 2024-06-02T04:50:48.383 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.380+0000 7f1d5bce6700 1 --2- 172.21.15.76:0/2110122593 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1d541018f0 0x7f1d541081a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:48.383 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.380+0000 7f1d5bce6700 1 --2- 172.21.15.76:0/2110122593 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1d540ffd60 0x7f1d54100180 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:48.383 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.380+0000 7f1d5bce6700 1 --2- 172.21.15.76:0/2110122593 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1d54100f50 0x7f1d541013b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:48.383 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.380+0000 7f1d5bce6700 1 -- 172.21.15.76:0/2110122593 >> 172.21.15.76:0/2110122593 conn(0x7f1d540fb2f0 msgr2=0x7f1d540fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:50:48.383 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.380+0000 7f1d5bce6700 1 -- 172.21.15.76:0/2110122593 shutdown_connections 2024-06-02T04:50:48.383 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.380+0000 7f1d5bce6700 1 -- 172.21.15.76:0/2110122593 wait complete. 2024-06-02T04:50:48.384 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.380+0000 7f1d5bce6700 1 Processor -- start 2024-06-02T04:50:48.384 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.381+0000 7f1d5bce6700 1 -- start start 2024-06-02T04:50:48.384 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.381+0000 7f1d5bce6700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1d540ffd60 0x7f1d54068ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:48.384 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.381+0000 7f1d5bce6700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1d54100f50 0x7f1d5419ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:48.384 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.381+0000 7f1d5bce6700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1d541018f0 0x7f1d5419e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:48.384 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.381+0000 7f1d5bce6700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d5419e7a0 con 0x7f1d540ffd60 2024-06-02T04:50:48.384 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.381+0000 7f1d5bce6700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d5419e910 con 0x7f1d54100f50 2024-06-02T04:50:48.384 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.381+0000 7f1d5bce6700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d5419ead0 con 0x7f1d541018f0 2024-06-02T04:50:48.384 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.381+0000 7f1d59a82700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1d540ffd60 0x7f1d54068ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:48.384 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.381+0000 7f1d59a82700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1d540ffd60 0x7f1d54068ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:49338/0 (socket says 172.21.15.76:49338) 2024-06-02T04:50:48.384 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.381+0000 7f1d59a82700 1 -- 172.21.15.76:0/426771023 learned_addr learned my addr 172.21.15.76:0/426771023 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:50:48.384 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.381+0000 7f1d59281700 1 --2- 172.21.15.76:0/426771023 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1d54100f50 0x7f1d5419ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:48.385 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.381+0000 7f1d5a283700 1 --2- 172.21.15.76:0/426771023 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1d541018f0 0x7f1d5419e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:48.385 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.381+0000 7f1d59a82700 1 -- 172.21.15.76:0/426771023 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1d541018f0 msgr2=0x7f1d5419e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:48.385 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.381+0000 7f1d59a82700 1 --2- 172.21.15.76:0/426771023 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1d541018f0 0x7f1d5419e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:48.385 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.381+0000 7f1d59a82700 1 -- 172.21.15.76:0/426771023 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1d54100f50 msgr2=0x7f1d5419ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:48.385 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.381+0000 7f1d59a82700 1 --2- 172.21.15.76:0/426771023 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1d54100f50 0x7f1d5419ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:48.385 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.381+0000 7f1d59a82700 1 -- 172.21.15.76:0/426771023 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d500095f0 con 0x7f1d540ffd60 2024-06-02T04:50:48.385 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.381+0000 7f1d59281700 1 --2- 172.21.15.76:0/426771023 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1d54100f50 0x7f1d5419ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T04:50:48.385 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.381+0000 7f1d59a82700 1 --2- 172.21.15.76:0/426771023 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1d540ffd60 0x7f1d54068ac0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f1d50006010 tx=0x7f1d5000f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:50:48.385 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.381+0000 7f1d4affd700 1 -- 172.21.15.76:0/426771023 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d5001d070 con 0x7f1d540ffd60 2024-06-02T04:50:48.385 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.382+0000 7f1d4affd700 1 -- 172.21.15.76:0/426771023 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1d50005030 con 0x7f1d540ffd60 2024-06-02T04:50:48.385 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.382+0000 7f1d5bce6700 1 -- 172.21.15.76:0/426771023 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d5419ed50 con 0x7f1d540ffd60 2024-06-02T04:50:48.385 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.382+0000 7f1d4affd700 1 -- 172.21.15.76:0/426771023 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d50004ab0 con 0x7f1d540ffd60 2024-06-02T04:50:48.385 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.382+0000 7f1d5bce6700 1 -- 172.21.15.76:0/426771023 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d5419f170 con 0x7f1d540ffd60 2024-06-02T04:50:48.386 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.383+0000 7f1d5bce6700 1 -- 172.21.15.76:0/426771023 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d54107270 con 0x7f1d540ffd60 2024-06-02T04:50:48.387 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.384+0000 7f1d4affd700 1 -- 172.21.15.76:0/426771023 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f1d500051a0 con 0x7f1d540ffd60 2024-06-02T04:50:48.387 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.385+0000 7f1d4affd700 1 --2- 172.21.15.76:0/426771023 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f1d400a1120 0x7f1d400a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:48.387 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.385+0000 7f1d59281700 1 --2- 172.21.15.76:0/426771023 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f1d400a1120 0x7f1d400a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:48.387 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.385+0000 7f1d4affd700 1 -- 172.21.15.76:0/426771023 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f1d500cda20 con 0x7f1d540ffd60 2024-06-02T04:50:48.388 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.385+0000 7f1d59281700 1 --2- 172.21.15.76:0/426771023 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f1d400a1120 0x7f1d400a35e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f1d44011490 tx=0x7f1d44009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:50:48.389 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.389+0000 7f1d4affd700 1 -- 172.21.15.76:0/426771023 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f1d50096f00 con 0x7f1d540ffd60 2024-06-02T04:50:48.714 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.714+0000 7f1d5bce6700 1 -- 172.21.15.76:0/426771023 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1d54067c10 con 0x7f1d540ffd60 2024-06-02T04:50:48.715 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.715+0000 7f1d4affd700 1 -- 172.21.15.76:0/426771023 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+10878 (secure 0 0 0) 0x7f1d5009a520 con 0x7f1d540ffd60 2024-06-02T04:50:48.715 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T04:50:48.716 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6835/3029342152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3029342152},{"type":"v1","addr":"172.21.15.76:6835","nonce":3029342152}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6837/1207985317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":1207985317},{"type":"v1","addr":"172.21.15.76:6837","nonce":1207985317}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14607,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6839/928709755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":928709755},{"type":"v1","addr":"172.21.15.76:6839","nonce":928709755}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6841/4162178633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6840","nonce":4162178633},{"type":"v1","addr":"172.21.15.76:6841","nonce":4162178633}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/1543944863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":1543944863},{"type":"v1","addr":"172.21.15.119:6833","nonce":1543944863}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24418,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6833/1527921393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1527921393},{"type":"v1","addr":"172.21.15.192:6833","nonce":1527921393}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-02T04:48:02.662812+0000","modified":"2024-06-02T04:50:42.292855+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24491,"mds_1":24475,"mds_2":24463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24434":{"gid":24434,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6835/2746840347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":2746840347},{"type":"v1","addr":"172.21.15.119:6835","nonce":2746840347}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24451":{"gid":24451,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.192:6835/783181340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":783181340},{"type":"v1","addr":"172.21.15.192:6835","nonce":783181340}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24458":{"gid":24458,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6837/2171687478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":2171687478},{"type":"v1","addr":"172.21.15.119:6837","nonce":2171687478}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24463":{"gid":24463,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":11,"addr":"172.21.15.192:6837/960773710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":960773710},{"type":"v1","addr":"172.21.15.192:6837","nonce":960773710}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24475":{"gid":24475,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":39,"addr":"172.21.15.192:6839/3978681402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":3978681402},{"type":"v1","addr":"172.21.15.192:6839","nonce":3978681402}]},"join_fscid":-1,"export_targets":[0],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.119:6839/4098406903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":4098406903},{"type":"v1","addr":"172.21.15.119:6839","nonce":4098406903}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-06-02T04:50:48.718 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.717+0000 7f1d5bce6700 1 -- 172.21.15.76:0/426771023 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f1d400a1120 msgr2=0x7f1d400a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:48.718 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.717+0000 7f1d5bce6700 1 --2- 172.21.15.76:0/426771023 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f1d400a1120 0x7f1d400a35e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f1d44011490 tx=0x7f1d44009260 comp rx=0 tx=0).stop 2024-06-02T04:50:48.718 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.717+0000 7f1d5bce6700 1 -- 172.21.15.76:0/426771023 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1d540ffd60 msgr2=0x7f1d54068ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:48.718 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.717+0000 7f1d5bce6700 1 --2- 172.21.15.76:0/426771023 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1d540ffd60 0x7f1d54068ac0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f1d50006010 tx=0x7f1d5000f690 comp rx=0 tx=0).stop 2024-06-02T04:50:48.718 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.717+0000 7f1d5bce6700 1 -- 172.21.15.76:0/426771023 shutdown_connections 2024-06-02T04:50:48.718 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.717+0000 7f1d5bce6700 1 --2- 172.21.15.76:0/426771023 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1d541018f0 0x7f1d5419e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:48.718 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.717+0000 7f1d5bce6700 1 --2- 172.21.15.76:0/426771023 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1d540ffd60 0x7f1d54068ac0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:48.718 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.718+0000 7f1d5bce6700 1 --2- 172.21.15.76:0/426771023 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f1d400a1120 0x7f1d400a35e0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:48.718 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.718+0000 7f1d5bce6700 1 --2- 172.21.15.76:0/426771023 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1d54100f50 0x7f1d5419ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:48.719 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.718+0000 7f1d5bce6700 1 -- 172.21.15.76:0/426771023 >> 172.21.15.76:0/426771023 conn(0x7f1d540fb2f0 msgr2=0x7f1d541043b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:50:48.719 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.718+0000 7f1d5bce6700 1 -- 172.21.15.76:0/426771023 shutdown_connections 2024-06-02T04:50:48.719 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.718+0000 7f1d5bce6700 1 -- 172.21.15.76:0/426771023 wait complete. 2024-06-02T04:50:48.719 INFO:teuthology.orchestra.run.smithi076.stderr:dumped fsmap epoch 29 2024-06-02T04:50:48.732 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-06-02T04:50:48.885 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.884+0000 7fbe6a16d700 1 -- 172.21.15.76:0/1650303213 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbe640ffe80 msgr2=0x7fbe641002a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:48.885 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.884+0000 7fbe6a16d700 1 --2- 172.21.15.76:0/1650303213 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbe640ffe80 0x7fbe641002a0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fbe54009990 tx=0x7fbe54009ca0 comp rx=0 tx=0).stop 2024-06-02T04:50:48.885 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.884+0000 7fbe6a16d700 1 -- 172.21.15.76:0/1650303213 shutdown_connections 2024-06-02T04:50:48.885 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.884+0000 7fbe6a16d700 1 --2- 172.21.15.76:0/1650303213 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbe64101990 0x7fbe641082b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:48.885 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.884+0000 7fbe6a16d700 1 --2- 172.21.15.76:0/1650303213 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbe640ffe80 0x7fbe641002a0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:48.885 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.884+0000 7fbe6a16d700 1 --2- 172.21.15.76:0/1650303213 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbe64100fd0 0x7fbe64101450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:48.885 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.884+0000 7fbe6a16d700 1 -- 172.21.15.76:0/1650303213 >> 172.21.15.76:0/1650303213 conn(0x7fbe640fb3f0 msgr2=0x7fbe640fd830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:50:48.885 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.884+0000 7fbe6a16d700 1 -- 172.21.15.76:0/1650303213 shutdown_connections 2024-06-02T04:50:48.885 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.884+0000 7fbe6a16d700 1 -- 172.21.15.76:0/1650303213 wait complete. 2024-06-02T04:50:48.888 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.885+0000 7fbe6a16d700 1 Processor -- start 2024-06-02T04:50:48.888 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.885+0000 7fbe6a16d700 1 -- start start 2024-06-02T04:50:48.888 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.885+0000 7fbe6a16d700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbe640ffe80 0x7fbe64069c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:48.888 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.885+0000 7fbe6a16d700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbe64100fd0 0x7fbe6419bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:48.888 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.885+0000 7fbe6a16d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbe64101990 0x7fbe6419e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:48.888 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.885+0000 7fbe6a16d700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe6419e9a0 con 0x7fbe64100fd0 2024-06-02T04:50:48.889 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.885+0000 7fbe6a16d700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe6419eb10 con 0x7fbe640ffe80 2024-06-02T04:50:48.889 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.885+0000 7fbe6a16d700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe6419ecd0 con 0x7fbe64101990 2024-06-02T04:50:48.889 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.886+0000 7fbe62ffd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbe64100fd0 0x7fbe6419bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:48.889 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.886+0000 7fbe62ffd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbe64100fd0 0x7fbe6419bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:49364/0 (socket says 172.21.15.76:49364) 2024-06-02T04:50:48.889 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.886+0000 7fbe62ffd700 1 -- 172.21.15.76:0/2625853308 learned_addr learned my addr 172.21.15.76:0/2625853308 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:50:48.889 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.886+0000 7fbe637fe700 1 --2- 172.21.15.76:0/2625853308 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbe640ffe80 0x7fbe64069c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:48.889 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.886+0000 7fbe63fff700 1 --2- 172.21.15.76:0/2625853308 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbe64101990 0x7fbe6419e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:48.889 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.886+0000 7fbe62ffd700 1 -- 172.21.15.76:0/2625853308 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbe64101990 msgr2=0x7fbe6419e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:48.889 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.886+0000 7fbe62ffd700 1 --2- 172.21.15.76:0/2625853308 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbe64101990 0x7fbe6419e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:48.889 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.886+0000 7fbe62ffd700 1 -- 172.21.15.76:0/2625853308 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbe640ffe80 msgr2=0x7fbe64069c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:48.889 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.886+0000 7fbe62ffd700 1 --2- 172.21.15.76:0/2625853308 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbe640ffe80 0x7fbe64069c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:48.889 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.886+0000 7fbe62ffd700 1 -- 172.21.15.76:0/2625853308 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe540095f0 con 0x7fbe64100fd0 2024-06-02T04:50:48.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.886+0000 7fbe63fff700 1 --2- 172.21.15.76:0/2625853308 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbe64101990 0x7fbe6419e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:50:48.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.886+0000 7fbe637fe700 1 --2- 172.21.15.76:0/2625853308 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbe640ffe80 0x7fbe64069c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:50:48.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.886+0000 7fbe62ffd700 1 --2- 172.21.15.76:0/2625853308 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbe64100fd0 0x7fbe6419bb90 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fbe5800d950 tx=0x7fbe5800dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:50:48.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.886+0000 7fbe60ff9700 1 -- 172.21.15.76:0/2625853308 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe58009b40 con 0x7fbe64100fd0 2024-06-02T04:50:48.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.886+0000 7fbe60ff9700 1 -- 172.21.15.76:0/2625853308 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbe58009ca0 con 0x7fbe64100fd0 2024-06-02T04:50:48.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.886+0000 7fbe6a16d700 1 -- 172.21.15.76:0/2625853308 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe6419ef50 con 0x7fbe64100fd0 2024-06-02T04:50:48.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.886+0000 7fbe60ff9700 1 -- 172.21.15.76:0/2625853308 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe5800f620 con 0x7fbe64100fd0 2024-06-02T04:50:48.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.886+0000 7fbe6a16d700 1 -- 172.21.15.76:0/2625853308 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe6419f420 con 0x7fbe64100fd0 2024-06-02T04:50:48.896 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.889+0000 7fbe60ff9700 1 -- 172.21.15.76:0/2625853308 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fbe58010460 con 0x7fbe64100fd0 2024-06-02T04:50:48.897 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.889+0000 7fbe60ff9700 1 --2- 172.21.15.76:0/2625853308 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fbe4c0a11a0 0x7fbe4c0a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:48.897 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.889+0000 7fbe60ff9700 1 -- 172.21.15.76:0/2625853308 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7fbe580ccf00 con 0x7fbe64100fd0 2024-06-02T04:50:48.897 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.889+0000 7fbe637fe700 1 --2- 172.21.15.76:0/2625853308 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fbe4c0a11a0 0x7fbe4c0a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:48.897 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.890+0000 7fbe637fe700 1 --2- 172.21.15.76:0/2625853308 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fbe4c0a11a0 0x7fbe4c0a3660 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fbe54006010 tx=0x7fbe5400b5d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:50:48.897 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.890+0000 7fbe76328b80 1 Processor -- start 2024-06-02T04:50:48.897 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.890+0000 7fbe76328b80 1 -- start start 2024-06-02T04:50:48.897 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.891+0000 7fbe76328b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e389fd2540 0x55e389fd2960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:48.897 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.891+0000 7fbe76328b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e389fd2ea0 0x55e389fd3320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:48.897 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.891+0000 7fbe76328b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e389fd3860 0x55e389fd3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:48.897 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.891+0000 7fbe76328b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e389f29150 con 0x55e389fd3860 2024-06-02T04:50:48.897 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.891+0000 7fbe76328b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e389f26b10 con 0x55e389fd2ea0 2024-06-02T04:50:48.898 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.891+0000 7fbe76328b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e389f22400 con 0x55e389fd2540 2024-06-02T04:50:48.898 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.891+0000 7fbe63fff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e389fd3860 0x55e389fd3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:48.898 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.891+0000 7fbe63fff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e389fd3860 0x55e389fd3ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:49378/0 (socket says 172.21.15.76:49378) 2024-06-02T04:50:48.898 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.891+0000 7fbe63fff700 1 -- 172.21.15.76:0/1206862896 learned_addr learned my addr 172.21.15.76:0/1206862896 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:50:48.898 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.891+0000 7fbe62ffd700 1 --2- 172.21.15.76:0/1206862896 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e389fd2ea0 0x55e389fd3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:48.898 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.891+0000 7fbe637fe700 1 --2- 172.21.15.76:0/1206862896 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e389fd2540 0x55e389fd2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:48.898 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.891+0000 7fbe63fff700 1 -- 172.21.15.76:0/1206862896 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e389fd2540 msgr2=0x55e389fd2960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:50:48.898 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.891+0000 7fbe63fff700 1 --2- 172.21.15.76:0/1206862896 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e389fd2540 0x55e389fd2960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:48.898 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.891+0000 7fbe63fff700 1 -- 172.21.15.76:0/1206862896 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e389fd2ea0 msgr2=0x55e389fd3320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:50:48.898 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.891+0000 7fbe63fff700 1 --2- 172.21.15.76:0/1206862896 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e389fd2ea0 0x55e389fd3320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:48.898 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.891+0000 7fbe63fff700 1 -- 172.21.15.76:0/1206862896 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e389da33b0 con 0x55e389fd3860 2024-06-02T04:50:48.898 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.891+0000 7fbe63fff700 1 --2- 172.21.15.76:0/1206862896 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e389fd3860 0x55e389fd3ce0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c009400 tx=0x7fbe5c009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2f768dd363121d4 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:50:48.899 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.891+0000 7fbe49ffb700 1 -- 172.21.15.76:0/1206862896 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe5c014610 con 0x55e389fd3860 2024-06-02T04:50:48.899 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.891+0000 7fbe49ffb700 1 -- 172.21.15.76:0/1206862896 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbe5c00f050 con 0x55e389fd3860 2024-06-02T04:50:48.899 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.891+0000 7fbe49ffb700 1 -- 172.21.15.76:0/1206862896 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe5c013930 con 0x55e389fd3860 2024-06-02T04:50:48.899 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.892+0000 7fbe76328b80 1 -- 172.21.15.76:0/1206862896 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e389fd3860 msgr2=0x55e389fd3ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:48.899 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.892+0000 7fbe76328b80 1 --2- 172.21.15.76:0/1206862896 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e389fd3860 0x55e389fd3ce0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c009400 tx=0x7fbe5c009920 comp rx=0 tx=0).stop 2024-06-02T04:50:48.899 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.892+0000 7fbe76328b80 1 -- 172.21.15.76:0/1206862896 shutdown_connections 2024-06-02T04:50:48.899 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.892+0000 7fbe76328b80 1 --2- 172.21.15.76:0/1206862896 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e389fd3860 0x55e389fd3ce0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:48.899 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.892+0000 7fbe76328b80 1 --2- 172.21.15.76:0/1206862896 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e389fd2540 0x55e389fd2960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:48.899 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.892+0000 7fbe76328b80 1 --2- 172.21.15.76:0/1206862896 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e389fd2ea0 0x55e389fd3320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:48.899 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.892+0000 7fbe76328b80 1 -- 172.21.15.76:0/1206862896 >> 172.21.15.76:0/1206862896 conn(0x55e389f30210 msgr2=0x55e389fccde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:50:48.899 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.892+0000 7fbe76328b80 1 -- 172.21.15.76:0/1206862896 shutdown_connections 2024-06-02T04:50:48.899 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.892+0000 7fbe76328b80 1 -- 172.21.15.76:0/1206862896 wait complete. 2024-06-02T04:50:48.899 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.893+0000 7fbe76328b80 1 -- start start 2024-06-02T04:50:48.900 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.893+0000 7fbe76328b80 1 Processor -- start 2024-06-02T04:50:48.900 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.893+0000 7fbe76328b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e389fd2540 0x55e389fdbdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:48.900 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.893+0000 7fbe76328b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e389fd2ea0 0x55e389fdc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:48.900 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.893+0000 7fbe76328b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e389fd3860 0x55e389fe3330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:48.900 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.893+0000 7fbe76328b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e389ebe560 con 0x55e389fd2ea0 2024-06-02T04:50:48.900 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.893+0000 7fbe76328b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e389ebe200 con 0x55e389fd3860 2024-06-02T04:50:48.900 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.893+0000 7fbe76328b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e389da56a0 con 0x55e389fd2540 2024-06-02T04:50:48.900 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.893+0000 7fbe76328b80 10 client.0 _ll_register_callbacks cb 0x55e389ec7b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:50:48.900 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.893+0000 7fbe62ffd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e389fd2ea0 0x55e389fdc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:48.900 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.893+0000 7fbe62ffd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e389fd2ea0 0x55e389fdc2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:49384/0 (socket says 172.21.15.76:49384) 2024-06-02T04:50:48.900 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.894+0000 7fbe62ffd700 1 -- 172.21.15.76:0/2288470969 learned_addr learned my addr 172.21.15.76:0/2288470969 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:50:48.900 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.894+0000 7fbe637fe700 1 --2- 172.21.15.76:0/2288470969 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e389fd2540 0x55e389fdbdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:48.900 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.894+0000 7fbe63fff700 1 --2- 172.21.15.76:0/2288470969 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e389fd3860 0x55e389fe3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:48.901 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.894+0000 7fbe62ffd700 1 -- 172.21.15.76:0/2288470969 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e389fd2540 msgr2=0x55e389fdbdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:50:48.901 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.894+0000 7fbe62ffd700 1 --2- 172.21.15.76:0/2288470969 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e389fd2540 0x55e389fdbdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:48.901 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.894+0000 7fbe62ffd700 1 -- 172.21.15.76:0/2288470969 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e389fd3860 msgr2=0x55e389fe3330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:50:48.901 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.894+0000 7fbe62ffd700 1 --2- 172.21.15.76:0/2288470969 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e389fd3860 0x55e389fe3330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:48.901 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.894+0000 7fbe62ffd700 1 -- 172.21.15.76:0/2288470969 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe5c0090b0 con 0x55e389fd2ea0 2024-06-02T04:50:48.901 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.894+0000 7fbe62ffd700 1 --2- 172.21.15.76:0/2288470969 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e389fd2ea0 0x55e389fdc2f0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fbe580ca6c0 tx=0x7fbe5809a790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4ad32ab7b01c24e server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:50:48.901 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.894+0000 7fbe42ffd700 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-06-02T04:50:48.901 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.894+0000 7fbe42ffd700 1 -- 172.21.15.76:0/2288470969 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe580a2490 con 0x55e389fd2ea0 2024-06-02T04:50:48.901 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.894+0000 7fbe42ffd700 1 -- 172.21.15.76:0/2288470969 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7fbe5809a270 con 0x55e389fd2ea0 2024-06-02T04:50:48.901 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.894+0000 7fbe76328b80 1 -- 172.21.15.76:0/2288470969 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e389e7b270 con 0x55e389fd2ea0 2024-06-02T04:50:48.901 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.894+0000 7fbe42ffd700 1 -- 172.21.15.76:0/2288470969 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbe5809a430 con 0x55e389fd2ea0 2024-06-02T04:50:48.901 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.894+0000 7fbe76328b80 10 client.15819 fetch_fsmap learned FSMap version 29 2024-06-02T04:50:48.901 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.894+0000 7fbe76328b80 1 -- 172.21.15.76:0/2288470969 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55e389d4fb60 con 0x55e389fd2ea0 2024-06-02T04:50:48.902 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.895+0000 7fbe42ffd700 1 -- 172.21.15.76:0/2288470969 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbe5807a080 con 0x55e389fd2ea0 2024-06-02T04:50:48.902 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.895+0000 7fbe42ffd700 1 -- 172.21.15.76:0/2288470969 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 29) v1 ==== 7482+0+0 (secure 0 0 0) 0x7fbe58099500 con 0x55e389fd2ea0 2024-06-02T04:50:48.902 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.895+0000 7fbe76328b80 10 client.15819 fetch_fsmap finished waiting for FSMap version 29 2024-06-02T04:50:48.902 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.895+0000 7fbe76328b80 10 client.15819 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-06-02T04:50:48.902 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.895+0000 7fbe76328b80 20 client.15819 populate_metadata read hostname 'smithi076' 2024-06-02T04:50:48.902 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.895+0000 7fbe76328b80 1 --2- 172.21.15.76:0/2288470969 >> [v2:172.21.15.192:6836/960773710,v1:172.21.15.192:6837/960773710] conn(0x55e389fe7990 0x55e389fe9db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:48.902 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.895+0000 7fbe76328b80 4 client.15819 mds_command: new command op to 24463 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T04:50:48.902 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.895+0000 7fbe76328b80 1 -- 172.21.15.76:0/2288470969 --> [v2:172.21.15.192:6836/960773710,v1:172.21.15.192:6837/960773710] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e389fa1810 con 0x55e389fe7990 2024-06-02T04:50:48.902 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.895+0000 7fbe637fe700 1 --2- 172.21.15.76:0/2288470969 >> [v2:172.21.15.192:6836/960773710,v1:172.21.15.192:6837/960773710] conn(0x55e389fe7990 0x55e389fe9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:48.903 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.895+0000 7fbe42ffd700 10 client.15819 ms_handle_connect on v2:172.21.15.192:6836/960773710 2024-06-02T04:50:48.903 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.895+0000 7fbe637fe700 1 --2- 172.21.15.76:0/2288470969 >> [v2:172.21.15.192:6836/960773710,v1:172.21.15.192:6837/960773710] conn(0x55e389fe7990 0x55e389fe9db0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b6b7a4b4ca856f server_cookie=c5c6eafcf5c2bf7e in_seq=0 out_seq=0 2024-06-02T04:50:48.903 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.896+0000 7fbe42ffd700 1 -- 172.21.15.76:0/2288470969 <== mds.2 v2:172.21.15.192:6836/960773710 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55e389fa1810 con 0x55e389fe7990 2024-06-02T04:50:48.903 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.896+0000 7fbe42ffd700 10 client.15819 handle_command_reply: tid=0 2024-06-02T04:50:48.903 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.896+0000 7fbe76328b80 1 client.15819 shutdown 2024-06-02T04:50:48.903 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.896+0000 7fbe76328b80 1 -- 172.21.15.76:0/2288470969 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e389fd2ea0 msgr2=0x55e389fdc2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:48.903 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.896+0000 7fbe76328b80 1 --2- 172.21.15.76:0/2288470969 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e389fd2ea0 0x55e389fdc2f0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fbe580ca6c0 tx=0x7fbe5809a790 comp rx=0 tx=0).stop 2024-06-02T04:50:48.903 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.896+0000 7fbe76328b80 1 -- 172.21.15.76:0/2288470969 shutdown_connections 2024-06-02T04:50:48.903 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.896+0000 7fbe76328b80 1 --2- 172.21.15.76:0/2288470969 >> [v2:172.21.15.192:6836/960773710,v1:172.21.15.192:6837/960773710] conn(0x55e389fe7990 0x55e389fe9db0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:48.903 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.896+0000 7fbe76328b80 1 --2- 172.21.15.76:0/2288470969 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e389fd3860 0x55e389fe3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:48.903 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.896+0000 7fbe76328b80 1 --2- 172.21.15.76:0/2288470969 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e389fd2540 0x55e389fdbdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:48.903 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.896+0000 7fbe42ffd700 0 client.15819 ms_handle_reset on v2:172.21.15.192:6836/960773710 2024-06-02T04:50:48.903 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.896+0000 7fbe76328b80 1 --2- 172.21.15.76:0/2288470969 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e389fd2ea0 0x55e389fdc2f0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:48.904 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.896+0000 7fbe76328b80 1 -- 172.21.15.76:0/2288470969 >> 172.21.15.76:0/2288470969 conn(0x55e389f30210 msgr2=0x55e389fd1340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:50:48.904 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.896+0000 7fbe76328b80 1 -- 172.21.15.76:0/2288470969 shutdown_connections 2024-06-02T04:50:48.904 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.896+0000 7fbe76328b80 1 -- 172.21.15.76:0/2288470969 wait complete. 2024-06-02T04:50:48.904 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.897+0000 7fbe76328b80 20 client.15819 trim_cache size 0 max 16384 2024-06-02T04:50:48.914 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.912+0000 7fbe76328b80 1 Processor -- start 2024-06-02T04:50:48.914 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.912+0000 7fbe76328b80 1 -- start start 2024-06-02T04:50:48.914 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.912+0000 7fbe76328b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e389fd2540 0x55e389fdb330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:48.914 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.912+0000 7fbe76328b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e389fd2ea0 0x55e389fe32f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:48.914 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.912+0000 7fbe76328b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e389fd3860 0x55e389fd9db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:48.914 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.912+0000 7fbe76328b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e389feefc0 con 0x55e389fd3860 2024-06-02T04:50:48.914 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.912+0000 7fbe76328b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e389fc7800 con 0x55e389fd2ea0 2024-06-02T04:50:48.914 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.912+0000 7fbe76328b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e389fd9a30 con 0x55e389fd2540 2024-06-02T04:50:48.914 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.912+0000 7fbe63fff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e389fd3860 0x55e389fd9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:48.914 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.912+0000 7fbe63fff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e389fd3860 0x55e389fd9db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:49392/0 (socket says 172.21.15.76:49392) 2024-06-02T04:50:48.914 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.912+0000 7fbe63fff700 1 -- 172.21.15.76:0/2113450364 learned_addr learned my addr 172.21.15.76:0/2113450364 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:50:48.915 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.913+0000 7fbe637fe700 1 --2- 172.21.15.76:0/2113450364 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e389fd2540 0x55e389fdb330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:48.915 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.913+0000 7fbe62ffd700 1 --2- 172.21.15.76:0/2113450364 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e389fd2ea0 0x55e389fe32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:48.915 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.913+0000 7fbe63fff700 1 -- 172.21.15.76:0/2113450364 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e389fd2540 msgr2=0x55e389fdb330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:50:48.915 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.913+0000 7fbe63fff700 1 --2- 172.21.15.76:0/2113450364 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e389fd2540 0x55e389fdb330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:48.915 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.913+0000 7fbe63fff700 1 -- 172.21.15.76:0/2113450364 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e389fd2ea0 msgr2=0x55e389fe32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:50:48.915 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.913+0000 7fbe63fff700 1 --2- 172.21.15.76:0/2113450364 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e389fd2ea0 0x55e389fe32f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:48.915 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.913+0000 7fbe63fff700 1 -- 172.21.15.76:0/2113450364 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e389ee8560 con 0x55e389fd3860 2024-06-02T04:50:48.915 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.913+0000 7fbe637fe700 1 --2- 172.21.15.76:0/2113450364 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e389fd2540 0x55e389fdb330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T04:50:48.915 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.913+0000 7fbe63fff700 1 --2- 172.21.15.76:0/2113450364 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e389fd3860 0x55e389fd9db0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x55e389fcdd40 tx=0x7fbe5c004a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d32ef8b914ddf996 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:50:48.915 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.913+0000 7fbe4a7fc700 1 -- 172.21.15.76:0/2113450364 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe5c023070 con 0x55e389fd3860 2024-06-02T04:50:48.915 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.913+0000 7fbe4a7fc700 1 -- 172.21.15.76:0/2113450364 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbe5c0134e0 con 0x55e389fd3860 2024-06-02T04:50:48.915 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.913+0000 7fbe4a7fc700 1 -- 172.21.15.76:0/2113450364 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe5c014670 con 0x55e389fd3860 2024-06-02T04:50:48.920 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.914+0000 7fbe76328b80 1 -- 172.21.15.76:0/2113450364 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e389fd3860 msgr2=0x55e389fd9db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:48.920 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.914+0000 7fbe76328b80 1 --2- 172.21.15.76:0/2113450364 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e389fd3860 0x55e389fd9db0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x55e389fcdd40 tx=0x7fbe5c004a70 comp rx=0 tx=0).stop 2024-06-02T04:50:48.920 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.914+0000 7fbe76328b80 1 -- 172.21.15.76:0/2113450364 shutdown_connections 2024-06-02T04:50:48.920 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.914+0000 7fbe76328b80 1 --2- 172.21.15.76:0/2113450364 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e389fd3860 0x55e389fd9db0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:48.920 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.914+0000 7fbe76328b80 1 --2- 172.21.15.76:0/2113450364 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e389fd2540 0x55e389fdb330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:48.920 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.914+0000 7fbe76328b80 1 --2- 172.21.15.76:0/2113450364 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e389fd2ea0 0x55e389fe32f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:48.920 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.914+0000 7fbe76328b80 1 -- 172.21.15.76:0/2113450364 >> 172.21.15.76:0/2113450364 conn(0x55e389f30210 msgr2=0x55e389fd3c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:50:48.920 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.914+0000 7fbe76328b80 1 -- 172.21.15.76:0/2113450364 shutdown_connections 2024-06-02T04:50:48.920 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.914+0000 7fbe76328b80 1 -- 172.21.15.76:0/2113450364 wait complete. 2024-06-02T04:50:48.920 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.914+0000 7fbe76328b80 1 -- start start 2024-06-02T04:50:48.920 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.915+0000 7fbe76328b80 1 Processor -- start 2024-06-02T04:50:48.921 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.915+0000 7fbe76328b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e389fd2540 0x55e389fdf390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:48.921 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.915+0000 7fbe76328b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e389fd2ea0 0x55e389fdf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:48.921 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.915+0000 7fbe76328b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e389fd3860 0x55e389fe28a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:48.921 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.915+0000 7fbe76328b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e389fe2de0 con 0x55e389fd2540 2024-06-02T04:50:48.921 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.915+0000 7fbe76328b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e389fe2f50 con 0x55e389fd3860 2024-06-02T04:50:48.921 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.915+0000 7fbe76328b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e389fe3110 con 0x55e389fd2ea0 2024-06-02T04:50:48.921 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.915+0000 7fbe76328b80 10 client.0 _ll_register_callbacks cb 0x55e389ec7b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:50:48.921 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.915+0000 7fbe637fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e389fd2540 0x55e389fdf390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:48.921 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.915+0000 7fbe637fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e389fd2540 0x55e389fdf390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:49408/0 (socket says 172.21.15.76:49408) 2024-06-02T04:50:48.921 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.915+0000 7fbe637fe700 1 -- 172.21.15.76:0/229035148 learned_addr learned my addr 172.21.15.76:0/229035148 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:50:48.921 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.915+0000 7fbe62ffd700 1 --2- 172.21.15.76:0/229035148 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e389fd2ea0 0x55e389fdf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:48.921 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.915+0000 7fbe63fff700 1 --2- 172.21.15.76:0/229035148 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e389fd3860 0x55e389fe28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:48.922 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.915+0000 7fbe637fe700 1 -- 172.21.15.76:0/229035148 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e389fd2ea0 msgr2=0x55e389fdf8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:50:48.922 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.915+0000 7fbe637fe700 1 --2- 172.21.15.76:0/229035148 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e389fd2ea0 0x55e389fdf8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:48.922 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.915+0000 7fbe637fe700 1 -- 172.21.15.76:0/229035148 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e389fd3860 msgr2=0x55e389fe28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:50:48.922 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.916+0000 7fbe637fe700 1 --2- 172.21.15.76:0/229035148 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e389fd3860 0x55e389fe28a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:48.922 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.916+0000 7fbe637fe700 1 -- 172.21.15.76:0/229035148 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe64108be0 con 0x55e389fd2540 2024-06-02T04:50:48.922 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.916+0000 7fbe62ffd700 1 --2- 172.21.15.76:0/229035148 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e389fd2ea0 0x55e389fdf8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T04:50:48.922 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.916+0000 7fbe637fe700 1 --2- 172.21.15.76:0/229035148 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e389fd2540 0x55e389fdf390 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fbe54003f60 tx=0x7fbe54009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6fb14800014c998 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:50:48.922 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.916+0000 7fbe42ffd700 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-06-02T04:50:48.922 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.916+0000 7fbe42ffd700 1 -- 172.21.15.76:0/229035148 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe54005450 con 0x55e389fd2540 2024-06-02T04:50:48.922 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.916+0000 7fbe42ffd700 1 -- 172.21.15.76:0/229035148 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7fbe540055b0 con 0x55e389fd2540 2024-06-02T04:50:48.922 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.916+0000 7fbe76328b80 1 -- 172.21.15.76:0/229035148 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbe5c00f050 con 0x55e389fd2540 2024-06-02T04:50:48.922 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.916+0000 7fbe42ffd700 1 -- 172.21.15.76:0/229035148 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbe54004780 con 0x55e389fd2540 2024-06-02T04:50:48.922 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.916+0000 7fbe76328b80 10 client.15825 fetch_fsmap learned FSMap version 29 2024-06-02T04:50:48.923 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.916+0000 7fbe76328b80 1 -- 172.21.15.76:0/229035148 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55e389da33b0 con 0x55e389fd2540 2024-06-02T04:50:48.923 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.916+0000 7fbe42ffd700 1 -- 172.21.15.76:0/229035148 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbe5c00f050 con 0x55e389fd2540 2024-06-02T04:50:48.923 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.916+0000 7fbe42ffd700 1 -- 172.21.15.76:0/229035148 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 29) v1 ==== 7482+0+0 (secure 0 0 0) 0x7fbe5400bb70 con 0x55e389fd2540 2024-06-02T04:50:48.923 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.916+0000 7fbe76328b80 10 client.15825 fetch_fsmap finished waiting for FSMap version 29 2024-06-02T04:50:48.923 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.916+0000 7fbe76328b80 10 client.15825 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-06-02T04:50:48.923 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.916+0000 7fbe76328b80 20 client.15825 populate_metadata read hostname 'smithi076' 2024-06-02T04:50:48.923 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.916+0000 7fbe76328b80 1 --2- 172.21.15.76:0/229035148 >> [v2:172.21.15.192:6836/960773710,v1:172.21.15.192:6837/960773710] conn(0x55e38a03f080 0x55e38a0414a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:48.923 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.916+0000 7fbe76328b80 4 client.15825 mds_command: new command op to 24463 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-06-02T04:50:48.923 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.916+0000 7fbe76328b80 1 -- 172.21.15.76:0/229035148 --> [v2:172.21.15.192:6836/960773710,v1:172.21.15.192:6837/960773710] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55e389f1aec0 con 0x55e38a03f080 2024-06-02T04:50:48.923 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.917+0000 7fbe62ffd700 1 --2- 172.21.15.76:0/229035148 >> [v2:172.21.15.192:6836/960773710,v1:172.21.15.192:6837/960773710] conn(0x55e38a03f080 0x55e38a0414a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:48.923 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.917+0000 7fbe62ffd700 1 --2- 172.21.15.76:0/229035148 >> [v2:172.21.15.192:6836/960773710,v1:172.21.15.192:6837/960773710] conn(0x55e38a03f080 0x55e38a0414a0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b3c63328637b48cd server_cookie=df618a647c06e42c in_seq=0 out_seq=0 2024-06-02T04:50:48.923 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.917+0000 7fbe42ffd700 10 client.15825 ms_handle_connect on v2:172.21.15.192:6836/960773710 2024-06-02T04:50:48.924 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.917+0000 7fbe42ffd700 1 -- 172.21.15.76:0/229035148 <== mds.2 v2:172.21.15.192:6836/960773710 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55e389f1aec0 con 0x55e38a03f080 2024-06-02T04:50:48.924 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.917+0000 7fbe42ffd700 10 client.15825 handle_command_reply: tid=0 2024-06-02T04:50:48.924 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.917+0000 7fbe76328b80 1 client.15825 shutdown 2024-06-02T04:50:48.924 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.917+0000 7fbe76328b80 1 -- 172.21.15.76:0/229035148 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e389fd2540 msgr2=0x55e389fdf390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:48.924 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.917+0000 7fbe76328b80 1 --2- 172.21.15.76:0/229035148 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e389fd2540 0x55e389fdf390 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fbe54003f60 tx=0x7fbe54009ca0 comp rx=0 tx=0).stop 2024-06-02T04:50:48.924 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.917+0000 7fbe76328b80 1 -- 172.21.15.76:0/229035148 shutdown_connections 2024-06-02T04:50:48.924 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.917+0000 7fbe76328b80 1 --2- 172.21.15.76:0/229035148 >> [v2:172.21.15.192:6836/960773710,v1:172.21.15.192:6837/960773710] conn(0x55e38a03f080 0x55e38a0414a0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:48.924 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.917+0000 7fbe76328b80 1 --2- 172.21.15.76:0/229035148 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e389fd3860 0x55e389fe28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:48.924 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.917+0000 7fbe76328b80 1 --2- 172.21.15.76:0/229035148 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e389fd2540 0x55e389fdf390 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:48.924 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.917+0000 7fbe76328b80 1 --2- 172.21.15.76:0/229035148 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e389fd2ea0 0x55e389fdf8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:48.924 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.917+0000 7fbe42ffd700 0 client.15825 ms_handle_reset on v2:172.21.15.192:6836/960773710 2024-06-02T04:50:48.924 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.917+0000 7fbe76328b80 1 -- 172.21.15.76:0/229035148 >> 172.21.15.76:0/229035148 conn(0x55e389f30210 msgr2=0x55e389fd6790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:50:48.924 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.918+0000 7fbe76328b80 1 -- 172.21.15.76:0/229035148 shutdown_connections 2024-06-02T04:50:48.924 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.918+0000 7fbe76328b80 1 -- 172.21.15.76:0/229035148 wait complete. 2024-06-02T04:50:48.925 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.918+0000 7fbe76328b80 20 client.15825 trim_cache size 0 max 16384 2024-06-02T04:50:48.925 INFO:teuthology.orchestra.run.smithi076.stdout:[] 2024-06-02T04:50:48.926 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.918+0000 7fbe6a16d700 1 -- 172.21.15.76:0/2625853308 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fbe4c0a11a0 msgr2=0x7fbe4c0a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:48.926 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.918+0000 7fbe6a16d700 1 --2- 172.21.15.76:0/2625853308 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fbe4c0a11a0 0x7fbe4c0a3660 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fbe54006010 tx=0x7fbe5400b5d0 comp rx=0 tx=0).stop 2024-06-02T04:50:48.926 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.918+0000 7fbe6a16d700 1 -- 172.21.15.76:0/2625853308 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbe64100fd0 msgr2=0x7fbe6419bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:48.926 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.918+0000 7fbe6a16d700 1 --2- 172.21.15.76:0/2625853308 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbe64100fd0 0x7fbe6419bb90 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fbe5800d950 tx=0x7fbe5800dd10 comp rx=0 tx=0).stop 2024-06-02T04:50:48.926 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.918+0000 7fbe6a16d700 1 -- 172.21.15.76:0/2625853308 shutdown_connections 2024-06-02T04:50:48.926 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.918+0000 7fbe6a16d700 1 --2- 172.21.15.76:0/2625853308 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbe64101990 0x7fbe6419e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:48.926 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.918+0000 7fbe6a16d700 1 --2- 172.21.15.76:0/2625853308 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fbe4c0a11a0 0x7fbe4c0a3660 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:48.926 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.918+0000 7fbe6a16d700 1 --2- 172.21.15.76:0/2625853308 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbe640ffe80 0x7fbe64069c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:48.926 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.918+0000 7fbe6a16d700 1 --2- 172.21.15.76:0/2625853308 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbe64100fd0 0x7fbe6419bb90 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:48.927 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.918+0000 7fbe6a16d700 1 -- 172.21.15.76:0/2625853308 >> 172.21.15.76:0/2625853308 conn(0x7fbe640fb3f0 msgr2=0x7fbe641044a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:50:48.927 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.918+0000 7fbe6a16d700 1 -- 172.21.15.76:0/2625853308 shutdown_connections 2024-06-02T04:50:48.927 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:48.919+0000 7fbe6a16d700 1 -- 172.21.15.76:0/2625853308 wait complete. 2024-06-02T04:50:48.932 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-06-02T04:50:49.076 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.075+0000 7f2104f16700 1 -- 172.21.15.76:0/3373478967 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f21000ffe70 msgr2=0x7f2100100290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:49.076 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.075+0000 7f2104f16700 1 --2- 172.21.15.76:0/3373478967 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f21000ffe70 0x7f2100100290 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f20f0009990 tx=0x7f20f0009ca0 comp rx=0 tx=0).stop 2024-06-02T04:50:49.076 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.075+0000 7f2104f16700 1 -- 172.21.15.76:0/3373478967 shutdown_connections 2024-06-02T04:50:49.076 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.075+0000 7f2104f16700 1 --2- 172.21.15.76:0/3373478967 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2100101980 0x7f21001082a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:49.076 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.075+0000 7f2104f16700 1 --2- 172.21.15.76:0/3373478967 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f21000ffe70 0x7f2100100290 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:49.076 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.075+0000 7f2104f16700 1 --2- 172.21.15.76:0/3373478967 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2100100fc0 0x7f2100101440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:49.076 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.075+0000 7f2104f16700 1 -- 172.21.15.76:0/3373478967 >> 172.21.15.76:0/3373478967 conn(0x7f21000fb400 msgr2=0x7f21000fd820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:50:49.076 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.075+0000 7f2104f16700 1 -- 172.21.15.76:0/3373478967 shutdown_connections 2024-06-02T04:50:49.076 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.075+0000 7f2104f16700 1 -- 172.21.15.76:0/3373478967 wait complete. 2024-06-02T04:50:49.078 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.076+0000 7f2104f16700 1 Processor -- start 2024-06-02T04:50:49.079 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.076+0000 7f2104f16700 1 -- start start 2024-06-02T04:50:49.079 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.076+0000 7f2104f16700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f21000ffe70 0x7f2100196e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:49.079 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.076+0000 7f2104f16700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2100100fc0 0x7f21001973c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:49.079 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.076+0000 7f2104f16700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2100101980 0x7f210019e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:49.079 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.076+0000 7f2104f16700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f210019e9b0 con 0x7f2100101980 2024-06-02T04:50:49.079 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.076+0000 7f2104f16700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f210019eaf0 con 0x7f2100100fc0 2024-06-02T04:50:49.079 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.076+0000 7f2104f16700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f210019ec80 con 0x7f21000ffe70 2024-06-02T04:50:49.079 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.076+0000 7f20fed9d700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2100101980 0x7f210019e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:49.079 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.076+0000 7f20fed9d700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2100101980 0x7f210019e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:49426/0 (socket says 172.21.15.76:49426) 2024-06-02T04:50:49.079 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.076+0000 7f20fed9d700 1 -- 172.21.15.76:0/2720845087 learned_addr learned my addr 172.21.15.76:0/2720845087 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:50:49.079 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.076+0000 7f20fdd9b700 1 --2- 172.21.15.76:0/2720845087 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2100100fc0 0x7f21001973c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:49.079 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.077+0000 7f20fe59c700 1 --2- 172.21.15.76:0/2720845087 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f21000ffe70 0x7f2100196e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:49.079 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.077+0000 7f20fed9d700 1 -- 172.21.15.76:0/2720845087 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f21000ffe70 msgr2=0x7f2100196e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:49.080 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.077+0000 7f20fed9d700 1 --2- 172.21.15.76:0/2720845087 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f21000ffe70 0x7f2100196e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:49.080 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.077+0000 7f20fed9d700 1 -- 172.21.15.76:0/2720845087 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2100100fc0 msgr2=0x7f21001973c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:49.080 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.077+0000 7f20fed9d700 1 --2- 172.21.15.76:0/2720845087 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2100100fc0 0x7f21001973c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:49.080 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.077+0000 7f20fed9d700 1 -- 172.21.15.76:0/2720845087 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20f00095f0 con 0x7f2100101980 2024-06-02T04:50:49.080 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.077+0000 7f20fed9d700 1 --2- 172.21.15.76:0/2720845087 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2100101980 0x7f210019e3e0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f20f800b970 tx=0x7f20f800bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:50:49.080 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.077+0000 7f20ef7fe700 1 -- 172.21.15.76:0/2720845087 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f800c930 con 0x7f2100101980 2024-06-02T04:50:49.080 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.077+0000 7f20ef7fe700 1 -- 172.21.15.76:0/2720845087 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f20f8014440 con 0x7f2100101980 2024-06-02T04:50:49.080 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.077+0000 7f2104f16700 1 -- 172.21.15.76:0/2720845087 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f210019ef60 con 0x7f2100101980 2024-06-02T04:50:49.080 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.077+0000 7f20ef7fe700 1 -- 172.21.15.76:0/2720845087 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f80075d0 con 0x7f2100101980 2024-06-02T04:50:49.080 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.077+0000 7f2104f16700 1 -- 172.21.15.76:0/2720845087 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f210019f390 con 0x7f2100101980 2024-06-02T04:50:49.082 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.080+0000 7f21110d1b80 1 Processor -- start 2024-06-02T04:50:49.082 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.081+0000 7f21110d1b80 1 -- start start 2024-06-02T04:50:49.082 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.081+0000 7f21110d1b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556b0a9a3540 0x556b0a9a3960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:49.082 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.081+0000 7f21110d1b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556b0a9a3ea0 0x556b0a9a4320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:49.082 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.081+0000 7f21110d1b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556b0a9a4860 0x556b0a9a4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:49.083 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.081+0000 7f21110d1b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b0a8fa150 con 0x556b0a9a3540 2024-06-02T04:50:49.083 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.081+0000 7f21110d1b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b0a8f7b10 con 0x556b0a9a4860 2024-06-02T04:50:49.083 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.081+0000 7f21110d1b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b0a8f3400 con 0x556b0a9a3ea0 2024-06-02T04:50:49.083 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.081+0000 7f20fdd9b700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556b0a9a3540 0x556b0a9a3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:49.083 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.081+0000 7f20fdd9b700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556b0a9a3540 0x556b0a9a3960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:49438/0 (socket says 172.21.15.76:49438) 2024-06-02T04:50:49.083 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.081+0000 7f20fdd9b700 1 -- 172.21.15.76:0/1527951222 learned_addr learned my addr 172.21.15.76:0/1527951222 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:50:49.083 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.081+0000 7f20fe59c700 1 --2- 172.21.15.76:0/1527951222 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556b0a9a3ea0 0x556b0a9a4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:49.083 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.081+0000 7f20fdd9b700 1 --2- 172.21.15.76:0/1527951222 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556b0a9a4860 0x556b0a9a4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:49.083 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.081+0000 7f20fdd9b700 1 -- 172.21.15.76:0/1527951222 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556b0a9a3ea0 msgr2=0x556b0a9a4320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:50:49.083 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.081+0000 7f20fdd9b700 1 --2- 172.21.15.76:0/1527951222 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556b0a9a3ea0 0x556b0a9a4320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:49.083 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.081+0000 7f20fdd9b700 1 -- 172.21.15.76:0/1527951222 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556b0a9a4860 msgr2=0x556b0a9a4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:50:49.083 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.081+0000 7f20fdd9b700 1 --2- 172.21.15.76:0/1527951222 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556b0a9a4860 0x556b0a9a4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:49.083 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.081+0000 7f20fdd9b700 1 -- 172.21.15.76:0/1527951222 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556b0a7743b0 con 0x556b0a9a3540 2024-06-02T04:50:49.084 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.082+0000 7f20fe59c700 1 --2- 172.21.15.76:0/1527951222 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556b0a9a3ea0 0x556b0a9a4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T04:50:49.084 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.082+0000 7f20fdd9b700 1 --2- 172.21.15.76:0/1527951222 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556b0a9a3540 0x556b0a9a3960 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f20f4012660 tx=0x7f20f400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9537c4942bb93508 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:50:49.084 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.082+0000 7f20ecff9700 1 -- 172.21.15.76:0/1527951222 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f4004030 con 0x556b0a9a3540 2024-06-02T04:50:49.084 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.082+0000 7f20ecff9700 1 -- 172.21.15.76:0/1527951222 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f20f4004830 con 0x556b0a9a3540 2024-06-02T04:50:49.084 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.082+0000 7f20ecff9700 1 -- 172.21.15.76:0/1527951222 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f4005280 con 0x556b0a9a3540 2024-06-02T04:50:49.088 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.082+0000 7f20ef7fe700 1 -- 172.21.15.76:0/2720845087 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f20f80145b0 con 0x7f2100101980 2024-06-02T04:50:49.089 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.083+0000 7f21110d1b80 1 -- 172.21.15.76:0/1527951222 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556b0a9a3540 msgr2=0x556b0a9a3960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:49.089 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.083+0000 7f21110d1b80 1 --2- 172.21.15.76:0/1527951222 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556b0a9a3540 0x556b0a9a3960 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f20f4012660 tx=0x7f20f400b8e0 comp rx=0 tx=0).stop 2024-06-02T04:50:49.089 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.083+0000 7f21110d1b80 1 -- 172.21.15.76:0/1527951222 shutdown_connections 2024-06-02T04:50:49.089 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.083+0000 7f21110d1b80 1 --2- 172.21.15.76:0/1527951222 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556b0a9a4860 0x556b0a9a4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:49.089 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.083+0000 7f21110d1b80 1 --2- 172.21.15.76:0/1527951222 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556b0a9a3540 0x556b0a9a3960 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:49.089 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.083+0000 7f21110d1b80 1 --2- 172.21.15.76:0/1527951222 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556b0a9a3ea0 0x556b0a9a4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:49.089 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.083+0000 7f21110d1b80 1 -- 172.21.15.76:0/1527951222 >> 172.21.15.76:0/1527951222 conn(0x556b0a901210 msgr2=0x556b0a99dde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:50:49.089 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.083+0000 7f21110d1b80 1 -- 172.21.15.76:0/1527951222 shutdown_connections 2024-06-02T04:50:49.089 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.083+0000 7f21110d1b80 1 -- 172.21.15.76:0/1527951222 wait complete. 2024-06-02T04:50:49.089 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.083+0000 7f21110d1b80 1 -- start start 2024-06-02T04:50:49.089 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.083+0000 7f20ef7fe700 1 --2- 172.21.15.76:0/2720845087 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f20e80a1030 0x7f20e80a34f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:49.089 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.083+0000 7f21110d1b80 1 Processor -- start 2024-06-02T04:50:49.090 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.083+0000 7f20fdd9b700 1 --2- 172.21.15.76:0/2720845087 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f20e80a1030 0x7f20e80a34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:49.090 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.083+0000 7f20ef7fe700 1 -- 172.21.15.76:0/2720845087 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f20f8006e40 con 0x7f2100101980 2024-06-02T04:50:49.090 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.083+0000 7f21110d1b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556b0a9a3540 0x556b0a9acde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:49.090 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.083+0000 7f21110d1b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556b0a9a3ea0 0x556b0a9ad320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:49.090 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.083+0000 7f21110d1b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556b0a9a4860 0x556b0a9b4380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:49.090 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.083+0000 7f21110d1b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b0a88f560 con 0x556b0a9a3ea0 2024-06-02T04:50:49.090 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.083+0000 7f21110d1b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b0a88f200 con 0x556b0a9a4860 2024-06-02T04:50:49.090 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.083+0000 7f21110d1b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b0a7766a0 con 0x556b0a9a3540 2024-06-02T04:50:49.090 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.084+0000 7f21110d1b80 10 client.0 _ll_register_callbacks cb 0x556b0a898b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:50:49.090 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.084+0000 7f20fdd9b700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556b0a9a3ea0 0x556b0a9ad320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:49.090 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.084+0000 7f20fdd9b700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556b0a9a3ea0 0x556b0a9ad320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:49448/0 (socket says 172.21.15.76:49448) 2024-06-02T04:50:49.090 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.084+0000 7f20fdd9b700 1 -- 172.21.15.76:0/1903516831 learned_addr learned my addr 172.21.15.76:0/1903516831 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:50:49.091 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.084+0000 7f20fe59c700 1 --2- 172.21.15.76:0/1903516831 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556b0a9a3540 0x556b0a9acde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:49.091 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.084+0000 7f20fed9d700 1 --2- 172.21.15.76:0/1903516831 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556b0a9a4860 0x556b0a9b4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:49.091 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.084+0000 7f20fdd9b700 1 --2- 172.21.15.76:0/2720845087 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f20e80a1030 0x7f20e80a34f0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f20f4019000 tx=0x7f20f400b790 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:50:49.091 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.084+0000 7f20fdd9b700 1 -- 172.21.15.76:0/1903516831 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556b0a9a3540 msgr2=0x556b0a9acde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:50:49.091 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.084+0000 7f20fdd9b700 1 --2- 172.21.15.76:0/1903516831 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556b0a9a3540 0x556b0a9acde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:49.091 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.084+0000 7f20fdd9b700 1 -- 172.21.15.76:0/1903516831 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556b0a9a4860 msgr2=0x556b0a9b4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:50:49.091 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.084+0000 7f20fdd9b700 1 --2- 172.21.15.76:0/1903516831 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556b0a9a4860 0x556b0a9b4380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:49.091 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.084+0000 7f20fdd9b700 1 -- 172.21.15.76:0/1903516831 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2100108bd0 con 0x556b0a9a3ea0 2024-06-02T04:50:49.091 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.084+0000 7f20fed9d700 1 --2- 172.21.15.76:0/1903516831 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556b0a9a4860 0x556b0a9b4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:50:49.091 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.084+0000 7f20fdd9b700 1 --2- 172.21.15.76:0/1903516831 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556b0a9a3ea0 0x556b0a9ad320 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f20f40123c0 tx=0x7f20f4029000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1482e051e69f2465 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:50:49.091 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.084+0000 7f20e5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-06-02T04:50:49.092 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.084+0000 7f20e5ffb700 1 -- 172.21.15.76:0/1903516831 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f4010940 con 0x556b0a9a3ea0 2024-06-02T04:50:49.092 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.084+0000 7f20e5ffb700 1 -- 172.21.15.76:0/1903516831 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f20f4012e40 con 0x556b0a9a3ea0 2024-06-02T04:50:49.092 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.084+0000 7f21110d1b80 1 -- 172.21.15.76:0/1903516831 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556b0a84c270 con 0x556b0a9a3ea0 2024-06-02T04:50:49.092 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.085+0000 7f20e5ffb700 1 -- 172.21.15.76:0/1903516831 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f20f4010aa0 con 0x556b0a9a3ea0 2024-06-02T04:50:49.092 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.085+0000 7f21110d1b80 10 client.15837 fetch_fsmap learned FSMap version 29 2024-06-02T04:50:49.092 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.085+0000 7f21110d1b80 1 -- 172.21.15.76:0/1903516831 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x7f20f400be20 con 0x556b0a9a3ea0 2024-06-02T04:50:49.092 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.085+0000 7f20e5ffb700 1 -- 172.21.15.76:0/1903516831 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x556b0a84c270 con 0x556b0a9a3ea0 2024-06-02T04:50:49.092 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.085+0000 7f20e5ffb700 1 -- 172.21.15.76:0/1903516831 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 29) v1 ==== 7482+0+0 (secure 0 0 0) 0x7f20f402dcd0 con 0x556b0a9a3ea0 2024-06-02T04:50:49.092 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.085+0000 7f21110d1b80 10 client.15837 fetch_fsmap finished waiting for FSMap version 29 2024-06-02T04:50:49.092 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.085+0000 7f21110d1b80 10 client.15837 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-06-02T04:50:49.092 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.085+0000 7f21110d1b80 20 client.15837 populate_metadata read hostname 'smithi076' 2024-06-02T04:50:49.092 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.085+0000 7f21110d1b80 1 --2- 172.21.15.76:0/1903516831 >> [v2:172.21.15.192:6838/3978681402,v1:172.21.15.192:6839/3978681402] conn(0x556b0a9b8b40 0x556b0a9baf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:49.093 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.085+0000 7f21110d1b80 4 client.15837 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T04:50:49.093 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.085+0000 7f21110d1b80 1 -- 172.21.15.76:0/1903516831 --> [v2:172.21.15.192:6838/3978681402,v1:172.21.15.192:6839/3978681402] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556b0a972810 con 0x556b0a9b8b40 2024-06-02T04:50:49.093 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.085+0000 7f20fe59c700 1 --2- 172.21.15.76:0/1903516831 >> [v2:172.21.15.192:6838/3978681402,v1:172.21.15.192:6839/3978681402] conn(0x556b0a9b8b40 0x556b0a9baf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:49.093 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.086+0000 7f20e5ffb700 10 client.15837 ms_handle_connect on v2:172.21.15.192:6838/3978681402 2024-06-02T04:50:49.093 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.086+0000 7f20fe59c700 1 --2- 172.21.15.76:0/1903516831 >> [v2:172.21.15.192:6838/3978681402,v1:172.21.15.192:6839/3978681402] conn(0x556b0a9b8b40 0x556b0a9baf60 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b797f8a6d62e1ec9 server_cookie=9a6d443d8d839c39 in_seq=0 out_seq=0 2024-06-02T04:50:49.093 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.086+0000 7f20e5ffb700 1 -- 172.21.15.76:0/1903516831 <== mds.1 v2:172.21.15.192:6838/3978681402 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x556b0a972810 con 0x556b0a9b8b40 2024-06-02T04:50:49.093 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.086+0000 7f20e5ffb700 10 client.15837 handle_command_reply: tid=0 2024-06-02T04:50:49.093 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.086+0000 7f21110d1b80 1 client.15837 shutdown 2024-06-02T04:50:49.093 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.086+0000 7f21110d1b80 1 -- 172.21.15.76:0/1903516831 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556b0a9a3ea0 msgr2=0x556b0a9ad320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:49.093 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.086+0000 7f21110d1b80 1 --2- 172.21.15.76:0/1903516831 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556b0a9a3ea0 0x556b0a9ad320 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f20f40123c0 tx=0x7f20f4029000 comp rx=0 tx=0).stop 2024-06-02T04:50:49.093 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.086+0000 7f21110d1b80 1 -- 172.21.15.76:0/1903516831 shutdown_connections 2024-06-02T04:50:49.093 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.086+0000 7f21110d1b80 1 --2- 172.21.15.76:0/1903516831 >> [v2:172.21.15.192:6838/3978681402,v1:172.21.15.192:6839/3978681402] conn(0x556b0a9b8b40 0x556b0a9baf60 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:49.093 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.086+0000 7f21110d1b80 1 --2- 172.21.15.76:0/1903516831 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556b0a9a4860 0x556b0a9b4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:49.094 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.086+0000 7f21110d1b80 1 --2- 172.21.15.76:0/1903516831 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556b0a9a3540 0x556b0a9acde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:49.094 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.086+0000 7f20e5ffb700 0 client.15837 ms_handle_reset on v2:172.21.15.192:6838/3978681402 2024-06-02T04:50:49.094 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.086+0000 7f21110d1b80 1 --2- 172.21.15.76:0/1903516831 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556b0a9a3ea0 0x556b0a9ad320 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:49.094 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.086+0000 7f21110d1b80 1 -- 172.21.15.76:0/1903516831 >> 172.21.15.76:0/1903516831 conn(0x556b0a901210 msgr2=0x556b0a99d5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:50:49.094 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.087+0000 7f21110d1b80 1 -- 172.21.15.76:0/1903516831 shutdown_connections 2024-06-02T04:50:49.094 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.087+0000 7f21110d1b80 1 -- 172.21.15.76:0/1903516831 wait complete. 2024-06-02T04:50:49.094 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.087+0000 7f21110d1b80 20 client.15837 trim_cache size 0 max 16384 2024-06-02T04:50:49.115 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.108+0000 7f21110d1b80 1 Processor -- start 2024-06-02T04:50:49.115 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.108+0000 7f21110d1b80 1 -- start start 2024-06-02T04:50:49.115 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.108+0000 7f21110d1b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556b0a9a3540 0x556b0a9b4a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:49.115 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.108+0000 7f21110d1b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556b0a9a3ea0 0x556b0a9b4340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:49.115 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.108+0000 7f21110d1b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556b0a9a4860 0x556b0a9ac310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:49.115 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.108+0000 7f21110d1b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b0a9b54e0 con 0x556b0a9a4860 2024-06-02T04:50:49.116 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.108+0000 7f21110d1b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b0a9ac970 con 0x556b0a9a3540 2024-06-02T04:50:49.116 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.108+0000 7f21110d1b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b0a99adc0 con 0x556b0a9a3ea0 2024-06-02T04:50:49.116 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.109+0000 7f20fed9d700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556b0a9a4860 0x556b0a9ac310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:49.116 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.109+0000 7f20fdd9b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556b0a9a3ea0 0x556b0a9b4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:49.116 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.109+0000 7f20fdd9b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556b0a9a3ea0 0x556b0a9b4340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:47658/0 (socket says 172.21.15.76:47658) 2024-06-02T04:50:49.116 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.109+0000 7f20fed9d700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556b0a9a4860 0x556b0a9ac310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:49464/0 (socket says 172.21.15.76:49464) 2024-06-02T04:50:49.116 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.109+0000 7f20fdd9b700 1 -- 172.21.15.76:0/4037726606 learned_addr learned my addr 172.21.15.76:0/4037726606 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:50:49.116 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.109+0000 7f20fe59c700 1 --2- 172.21.15.76:0/4037726606 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556b0a9a3540 0x556b0a9b4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:49.116 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.109+0000 7f20fdd9b700 1 -- 172.21.15.76:0/4037726606 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556b0a9a3540 msgr2=0x556b0a9b4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:50:49.116 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.109+0000 7f20fdd9b700 1 --2- 172.21.15.76:0/4037726606 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556b0a9a3540 0x556b0a9b4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:49.116 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.109+0000 7f20fdd9b700 1 -- 172.21.15.76:0/4037726606 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556b0a9a4860 msgr2=0x556b0a9ac310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:50:49.117 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.109+0000 7f20fdd9b700 1 --2- 172.21.15.76:0/4037726606 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556b0a9a4860 0x556b0a9ac310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:49.117 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.109+0000 7f20fdd9b700 1 -- 172.21.15.76:0/4037726606 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556b0a720b60 con 0x556b0a9a3ea0 2024-06-02T04:50:49.117 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.109+0000 7f20fed9d700 1 --2- 172.21.15.76:0/4037726606 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556b0a9a4860 0x556b0a9ac310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T04:50:49.117 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.109+0000 7f20fdd9b700 1 --2- 172.21.15.76:0/4037726606 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556b0a9a3ea0 0x556b0a9b4340 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f20f4004e00 tx=0x7f20f4005950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=85b23bb35a142f6c server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:50:49.117 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.109+0000 7f20ed7fa700 1 -- 172.21.15.76:0/4037726606 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f40121f0 con 0x556b0a9a3ea0 2024-06-02T04:50:49.117 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.109+0000 7f20ed7fa700 1 -- 172.21.15.76:0/4037726606 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f20f4031070 con 0x556b0a9a3ea0 2024-06-02T04:50:49.117 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.109+0000 7f20ed7fa700 1 -- 172.21.15.76:0/4037726606 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f40109a0 con 0x556b0a9a3ea0 2024-06-02T04:50:49.118 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.110+0000 7f21110d1b80 1 -- 172.21.15.76:0/4037726606 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556b0a9a3ea0 msgr2=0x556b0a9b4340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:49.118 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.110+0000 7f21110d1b80 1 --2- 172.21.15.76:0/4037726606 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556b0a9a3ea0 0x556b0a9b4340 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f20f4004e00 tx=0x7f20f4005950 comp rx=0 tx=0).stop 2024-06-02T04:50:49.118 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.110+0000 7f21110d1b80 1 -- 172.21.15.76:0/4037726606 shutdown_connections 2024-06-02T04:50:49.118 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.110+0000 7f21110d1b80 1 --2- 172.21.15.76:0/4037726606 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556b0a9a4860 0x556b0a9ac310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:49.118 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.110+0000 7f21110d1b80 1 --2- 172.21.15.76:0/4037726606 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556b0a9a3540 0x556b0a9b4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:49.118 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.110+0000 7f21110d1b80 1 --2- 172.21.15.76:0/4037726606 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556b0a9a3ea0 0x556b0a9b4340 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:49.118 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.110+0000 7f21110d1b80 1 -- 172.21.15.76:0/4037726606 >> 172.21.15.76:0/4037726606 conn(0x556b0a901210 msgr2=0x556b0a9a4c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:50:49.118 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.110+0000 7f21110d1b80 1 -- 172.21.15.76:0/4037726606 shutdown_connections 2024-06-02T04:50:49.118 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.110+0000 7f21110d1b80 1 -- 172.21.15.76:0/4037726606 wait complete. 2024-06-02T04:50:49.118 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.111+0000 7f21110d1b80 1 -- start start 2024-06-02T04:50:49.119 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.111+0000 7f21110d1b80 1 Processor -- start 2024-06-02T04:50:49.119 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.111+0000 7f21110d1b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556b0a9a3540 0x556b0a9af890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:49.119 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.111+0000 7f21110d1b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556b0a9a3ea0 0x556b0a9afdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:49.119 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.111+0000 7f21110d1b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556b0a9a4860 0x556b0a9b2da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:49.119 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.111+0000 7f21110d1b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b0a9b32e0 con 0x556b0a9a3540 2024-06-02T04:50:49.119 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.111+0000 7f21110d1b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b0a9b3450 con 0x556b0a9a3ea0 2024-06-02T04:50:49.119 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.111+0000 7f21110d1b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b0a9b3610 con 0x556b0a9a4860 2024-06-02T04:50:49.119 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.111+0000 7f21110d1b80 10 client.0 _ll_register_callbacks cb 0x556b0a898b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:50:49.119 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.111+0000 7f20fe59c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556b0a9a3540 0x556b0a9af890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:49.119 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.111+0000 7f20fe59c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556b0a9a3540 0x556b0a9af890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:49466/0 (socket says 172.21.15.76:49466) 2024-06-02T04:50:49.119 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.111+0000 7f20fe59c700 1 -- 172.21.15.76:0/85183585 learned_addr learned my addr 172.21.15.76:0/85183585 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:50:49.120 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.111+0000 7f20fed9d700 1 --2- 172.21.15.76:0/85183585 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556b0a9a4860 0x556b0a9b2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:49.120 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.111+0000 7f20fdd9b700 1 --2- 172.21.15.76:0/85183585 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556b0a9a3ea0 0x556b0a9afdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:49.120 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.111+0000 7f20fe59c700 1 -- 172.21.15.76:0/85183585 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556b0a9a4860 msgr2=0x556b0a9b2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:50:49.120 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.111+0000 7f20fe59c700 1 --2- 172.21.15.76:0/85183585 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556b0a9a4860 0x556b0a9b2da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:49.120 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.111+0000 7f20fe59c700 1 -- 172.21.15.76:0/85183585 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556b0a9a3ea0 msgr2=0x556b0a9afdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:50:49.120 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.111+0000 7f20fe59c700 1 --2- 172.21.15.76:0/85183585 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556b0a9a3ea0 0x556b0a9afdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:49.120 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.111+0000 7f20fe59c700 1 -- 172.21.15.76:0/85183585 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f210019f390 con 0x556b0a9a3540 2024-06-02T04:50:49.120 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.111+0000 7f20fe59c700 1 --2- 172.21.15.76:0/85183585 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556b0a9a3540 0x556b0a9af890 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f20f0009990 tx=0x7f20f000bc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac75631b6ba8768a server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:50:49.121 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.111+0000 7f20e5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-06-02T04:50:49.121 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.112+0000 7f20e5ffb700 1 -- 172.21.15.76:0/85183585 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f002a070 con 0x556b0a9a3540 2024-06-02T04:50:49.121 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.112+0000 7f20e5ffb700 1 -- 172.21.15.76:0/85183585 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f20f0005250 con 0x556b0a9a3540 2024-06-02T04:50:49.121 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.112+0000 7f21110d1b80 1 -- 172.21.15.76:0/85183585 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f20f4004830 con 0x556b0a9a3540 2024-06-02T04:50:49.121 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.112+0000 7f20e5ffb700 1 -- 172.21.15.76:0/85183585 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f20f000bd50 con 0x556b0a9a3540 2024-06-02T04:50:49.121 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.112+0000 7f21110d1b80 10 client.15843 fetch_fsmap learned FSMap version 29 2024-06-02T04:50:49.121 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.112+0000 7f21110d1b80 1 -- 172.21.15.76:0/85183585 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x7f20f400be20 con 0x556b0a9a3540 2024-06-02T04:50:49.121 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.112+0000 7f20e5ffb700 1 -- 172.21.15.76:0/85183585 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f20f4004830 con 0x556b0a9a3540 2024-06-02T04:50:49.121 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.112+0000 7f20e5ffb700 1 -- 172.21.15.76:0/85183585 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 29) v1 ==== 7482+0+0 (secure 0 0 0) 0x7f20f00099c0 con 0x556b0a9a3540 2024-06-02T04:50:49.121 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.112+0000 7f21110d1b80 10 client.15843 fetch_fsmap finished waiting for FSMap version 29 2024-06-02T04:50:49.121 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.112+0000 7f21110d1b80 10 client.15843 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-06-02T04:50:49.121 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.112+0000 7f21110d1b80 20 client.15843 populate_metadata read hostname 'smithi076' 2024-06-02T04:50:49.122 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.112+0000 7f21110d1b80 1 --2- 172.21.15.76:0/85183585 >> [v2:172.21.15.192:6838/3978681402,v1:172.21.15.192:6839/3978681402] conn(0x556b0aa0f870 0x556b0aa11c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:49.122 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.112+0000 7f21110d1b80 4 client.15843 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-06-02T04:50:49.122 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.112+0000 7f21110d1b80 1 -- 172.21.15.76:0/85183585 --> [v2:172.21.15.192:6838/3978681402,v1:172.21.15.192:6839/3978681402] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x556b0a8ebec0 con 0x556b0aa0f870 2024-06-02T04:50:49.122 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.112+0000 7f20fdd9b700 1 --2- 172.21.15.76:0/85183585 >> [v2:172.21.15.192:6838/3978681402,v1:172.21.15.192:6839/3978681402] conn(0x556b0aa0f870 0x556b0aa11c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:49.122 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.113+0000 7f20e5ffb700 10 client.15843 ms_handle_connect on v2:172.21.15.192:6838/3978681402 2024-06-02T04:50:49.122 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.113+0000 7f20fdd9b700 1 --2- 172.21.15.76:0/85183585 >> [v2:172.21.15.192:6838/3978681402,v1:172.21.15.192:6839/3978681402] conn(0x556b0aa0f870 0x556b0aa11c90 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=bef424fb21823443 server_cookie=6fa11307b14e116a in_seq=0 out_seq=0 2024-06-02T04:50:49.122 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.113+0000 7f20e5ffb700 1 -- 172.21.15.76:0/85183585 <== mds.1 v2:172.21.15.192:6838/3978681402 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+27247 (crc 0 0 0) 0x556b0a8ebec0 con 0x556b0aa0f870 2024-06-02T04:50:49.122 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.113+0000 7f20e5ffb700 10 client.15843 handle_command_reply: tid=0 2024-06-02T04:50:49.122 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.113+0000 7f21110d1b80 1 client.15843 shutdown 2024-06-02T04:50:49.122 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.114+0000 7f21110d1b80 1 -- 172.21.15.76:0/85183585 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556b0a9a3540 msgr2=0x556b0a9af890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:49.122 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.114+0000 7f21110d1b80 1 --2- 172.21.15.76:0/85183585 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556b0a9a3540 0x556b0a9af890 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f20f0009990 tx=0x7f20f000bc30 comp rx=0 tx=0).stop 2024-06-02T04:50:49.123 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.114+0000 7f21110d1b80 1 -- 172.21.15.76:0/85183585 shutdown_connections 2024-06-02T04:50:49.123 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.114+0000 7f21110d1b80 1 --2- 172.21.15.76:0/85183585 >> [v2:172.21.15.192:6838/3978681402,v1:172.21.15.192:6839/3978681402] conn(0x556b0aa0f870 0x556b0aa11c90 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:49.123 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.114+0000 7f21110d1b80 1 --2- 172.21.15.76:0/85183585 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556b0a9a4860 0x556b0a9b2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:49.123 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.114+0000 7f21110d1b80 1 --2- 172.21.15.76:0/85183585 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556b0a9a3540 0x556b0a9af890 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:49.123 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.114+0000 7f21110d1b80 1 --2- 172.21.15.76:0/85183585 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556b0a9a3ea0 0x556b0a9afdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:49.123 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.114+0000 7f21110d1b80 1 -- 172.21.15.76:0/85183585 >> 172.21.15.76:0/85183585 conn(0x556b0a901210 msgr2=0x556b0a99ddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:50:49.123 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.114+0000 7f20e5ffb700 0 client.15843 ms_handle_reset on v2:172.21.15.192:6838/3978681402 2024-06-02T04:50:49.123 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.114+0000 7f21110d1b80 1 -- 172.21.15.76:0/85183585 shutdown_connections 2024-06-02T04:50:49.123 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.114+0000 7f21110d1b80 1 -- 172.21.15.76:0/85183585 wait complete. 2024-06-02T04:50:49.123 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.114+0000 7f21110d1b80 20 client.15843 trim_cache size 0 max 16384 2024-06-02T04:50:49.124 INFO:teuthology.orchestra.run.smithi076.stdout:[ 2024-06-02T04:50:49.124 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.124 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.124 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 32432748, 2024-06-02T04:50:49.124 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628608, 2024-06-02T04:50:49.124 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2605_vm" 2024-06-02T04:50:49.124 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.125 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.125 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.125 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 64544536, 2024-06-02T04:50:49.125 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628334, 2024-06-02T04:50:49.125 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/1259" 2024-06-02T04:50:49.125 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.125 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.126 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.126 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 124538429, 2024-06-02T04:50:49.126 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628907, 2024-06-02T04:50:49.126 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/3575" 2024-06-02T04:50:49.126 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.126 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.126 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.126 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 162888174, 2024-06-02T04:50:49.126 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628538, 2024-06-02T04:50:49.127 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3597" 2024-06-02T04:50:49.127 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.127 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.127 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.127 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 260588171, 2024-06-02T04:50:49.127 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628589, 2024-06-02T04:50:49.127 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2617_vm" 2024-06-02T04:50:49.127 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.127 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.128 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.128 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 417690764, 2024-06-02T04:50:49.128 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628921, 2024-06-02T04:50:49.128 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/12187_vm" 2024-06-02T04:50:49.128 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.128 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.128 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.128 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 441715692, 2024-06-02T04:50:49.128 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628522, 2024-06-02T04:50:49.128 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3606" 2024-06-02T04:50:49.129 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.129 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.129 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.129 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 454205470, 2024-06-02T04:50:49.129 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628919, 2024-06-02T04:50:49.129 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2608" 2024-06-02T04:50:49.129 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.129 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.129 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.129 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 514530010, 2024-06-02T04:50:49.130 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628671, 2024-06-02T04:50:49.130 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/12182_fsm" 2024-06-02T04:50:49.130 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.130 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.130 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.130 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 526876221, 2024-06-02T04:50:49.130 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628355, 2024-06-02T04:50:49.130 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2613" 2024-06-02T04:50:49.131 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.131 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.131 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.131 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 545917248, 2024-06-02T04:50:49.131 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628945, 2024-06-02T04:50:49.131 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/1259" 2024-06-02T04:50:49.131 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.131 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.131 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.132 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 550286192, 2024-06-02T04:50:49.132 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628520, 2024-06-02T04:50:49.132 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3604" 2024-06-02T04:50:49.132 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.132 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.132 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.132 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 559349885, 2024-06-02T04:50:49.132 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628518, 2024-06-02T04:50:49.132 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3712" 2024-06-02T04:50:49.133 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.133 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.133 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.133 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 578286030, 2024-06-02T04:50:49.133 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628596, 2024-06-02T04:50:49.133 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3394_vm" 2024-06-02T04:50:49.133 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.133 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.134 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.134 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 585143155, 2024-06-02T04:50:49.134 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628328, 2024-06-02T04:50:49.134 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/1255" 2024-06-02T04:50:49.134 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.134 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.134 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.134 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 596406835, 2024-06-02T04:50:49.134 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628936, 2024-06-02T04:50:49.134 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/1247" 2024-06-02T04:50:49.135 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.135 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.135 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.135 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 631102332, 2024-06-02T04:50:49.135 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628925, 2024-06-02T04:50:49.135 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2682" 2024-06-02T04:50:49.135 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.135 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.135 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.136 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 642909008, 2024-06-02T04:50:49.136 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628909, 2024-06-02T04:50:49.136 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2617_fsm" 2024-06-02T04:50:49.136 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.136 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.136 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.136 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 683433890, 2024-06-02T04:50:49.137 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628915, 2024-06-02T04:50:49.137 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2702" 2024-06-02T04:50:49.137 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.137 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.137 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.137 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 711725871, 2024-06-02T04:50:49.137 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628501, 2024-06-02T04:50:49.137 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2691" 2024-06-02T04:50:49.137 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.137 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.138 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.138 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 749264506, 2024-06-02T04:50:49.138 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628532, 2024-06-02T04:50:49.138 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/174" 2024-06-02T04:50:49.138 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.138 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.138 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.138 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 752007971, 2024-06-02T04:50:49.138 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628606, 2024-06-02T04:50:49.138 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3456_vm" 2024-06-02T04:50:49.138 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.139 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.139 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.139 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 764347491, 2024-06-02T04:50:49.139 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628922, 2024-06-02T04:50:49.139 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/3164" 2024-06-02T04:50:49.139 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.139 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.139 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.139 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 787598747, 2024-06-02T04:50:49.139 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628530, 2024-06-02T04:50:49.139 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/113" 2024-06-02T04:50:49.139 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.140 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.140 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.140 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 836671582, 2024-06-02T04:50:49.140 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628940, 2024-06-02T04:50:49.140 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/3394_vm" 2024-06-02T04:50:49.140 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.140 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.140 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.140 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 860546828, 2024-06-02T04:50:49.140 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628512, 2024-06-02T04:50:49.141 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2699" 2024-06-02T04:50:49.141 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.141 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.141 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.141 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 867659806, 2024-06-02T04:50:49.141 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628496, 2024-06-02T04:50:49.142 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2689" 2024-06-02T04:50:49.142 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.142 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.142 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.142 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 884462362, 2024-06-02T04:50:49.142 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628948, 2024-06-02T04:50:49.142 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/3606" 2024-06-02T04:50:49.142 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.142 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.142 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.142 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 904122148, 2024-06-02T04:50:49.143 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628450, 2024-06-02T04:50:49.143 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2658" 2024-06-02T04:50:49.143 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.143 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.143 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.143 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 908680877, 2024-06-02T04:50:49.143 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628341, 2024-06-02T04:50:49.143 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2617_fsm" 2024-06-02T04:50:49.143 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.143 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.143 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.143 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 921807278, 2024-06-02T04:50:49.144 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628613, 2024-06-02T04:50:49.144 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2603_vm" 2024-06-02T04:50:49.144 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.144 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.144 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.144 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 923550103, 2024-06-02T04:50:49.144 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628941, 2024-06-02T04:50:49.144 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2754" 2024-06-02T04:50:49.144 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.144 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.144 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.144 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 963484879, 2024-06-02T04:50:49.145 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628912, 2024-06-02T04:50:49.145 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2668" 2024-06-02T04:50:49.145 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.145 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.145 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.145 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 1010297541, 2024-06-02T04:50:49.145 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628923, 2024-06-02T04:50:49.145 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/3501_vm" 2024-06-02T04:50:49.145 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.145 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.145 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.145 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 1079634453, 2024-06-02T04:50:49.146 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628684, 2024-06-02T04:50:49.146 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/12187_vm" 2024-06-02T04:50:49.146 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.146 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.146 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.146 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 1225309538, 2024-06-02T04:50:49.146 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628350, 2024-06-02T04:50:49.146 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2603" 2024-06-02T04:50:49.146 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.146 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.147 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.147 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 1303480791, 2024-06-02T04:50:49.147 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628929, 2024-06-02T04:50:49.147 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2605_vm" 2024-06-02T04:50:49.147 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.147 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.147 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.147 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 1360870597, 2024-06-02T04:50:49.147 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628339, 2024-06-02T04:50:49.147 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2610" 2024-06-02T04:50:49.147 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.147 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.148 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.148 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 1411111573, 2024-06-02T04:50:49.148 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628392, 2024-06-02T04:50:49.148 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3764_fsm" 2024-06-02T04:50:49.148 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.148 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.148 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.148 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 1416238594, 2024-06-02T04:50:49.148 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628540, 2024-06-02T04:50:49.148 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3080" 2024-06-02T04:50:49.148 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.148 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.149 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.149 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 1457657640, 2024-06-02T04:50:49.149 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628511, 2024-06-02T04:50:49.149 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3575" 2024-06-02T04:50:49.149 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.149 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.149 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.149 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 1465444535, 2024-06-02T04:50:49.149 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628918, 2024-06-02T04:50:49.149 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/3712" 2024-06-02T04:50:49.150 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.150 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.150 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.150 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 1502693619, 2024-06-02T04:50:49.150 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628931, 2024-06-02T04:50:49.150 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2685" 2024-06-02T04:50:49.150 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.150 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.150 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.151 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 1523448154, 2024-06-02T04:50:49.151 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628391, 2024-06-02T04:50:49.151 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3764" 2024-06-02T04:50:49.151 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.151 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.151 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.151 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 1574222437, 2024-06-02T04:50:49.151 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628679, 2024-06-02T04:50:49.151 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/12202_vm" 2024-06-02T04:50:49.151 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.152 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.152 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.152 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 1607191170, 2024-06-02T04:50:49.152 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628514, 2024-06-02T04:50:49.152 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2702" 2024-06-02T04:50:49.152 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.152 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.152 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.152 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 1695463665, 2024-06-02T04:50:49.152 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628416, 2024-06-02T04:50:49.152 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2831" 2024-06-02T04:50:49.153 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.153 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.153 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.153 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 1723545837, 2024-06-02T04:50:49.153 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628920, 2024-06-02T04:50:49.153 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2831" 2024-06-02T04:50:49.153 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.153 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.153 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.153 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 1745175845, 2024-06-02T04:50:49.153 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628497, 2024-06-02T04:50:49.153 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2754" 2024-06-02T04:50:49.154 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.154 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.154 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.154 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 1854609000, 2024-06-02T04:50:49.154 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628348, 2024-06-02T04:50:49.154 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2602" 2024-06-02T04:50:49.154 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.155 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.155 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.155 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 1857011347, 2024-06-02T04:50:49.155 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628662, 2024-06-02T04:50:49.155 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/12202" 2024-06-02T04:50:49.155 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.155 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.155 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.155 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 1859004698, 2024-06-02T04:50:49.155 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628944, 2024-06-02T04:50:49.156 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/12182_fsm" 2024-06-02T04:50:49.156 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.156 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.156 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.156 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 1941454365, 2024-06-02T04:50:49.156 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628621, 2024-06-02T04:50:49.156 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3439_vm" 2024-06-02T04:50:49.156 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.156 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.156 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.156 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 1958351659, 2024-06-02T04:50:49.157 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628917, 2024-06-02T04:50:49.157 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/3597" 2024-06-02T04:50:49.157 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.157 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.157 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.157 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 1974721056, 2024-06-02T04:50:49.157 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628942, 2024-06-02T04:50:49.157 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/12199" 2024-06-02T04:50:49.157 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.157 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.157 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.157 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 1986203752, 2024-06-02T04:50:49.158 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628576, 2024-06-02T04:50:49.158 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3603_vm" 2024-06-02T04:50:49.158 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.158 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.158 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.158 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 1987226793, 2024-06-02T04:50:49.158 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628440, 2024-06-02T04:50:49.158 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2650" 2024-06-02T04:50:49.158 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.158 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.158 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.159 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 2076886141, 2024-06-02T04:50:49.159 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628473, 2024-06-02T04:50:49.159 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2674" 2024-06-02T04:50:49.159 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.159 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.159 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.159 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 2076930765, 2024-06-02T04:50:49.159 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628431, 2024-06-02T04:50:49.159 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3440" 2024-06-02T04:50:49.159 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.159 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.160 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.160 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 2093392728, 2024-06-02T04:50:49.160 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628926, 2024-06-02T04:50:49.160 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/113" 2024-06-02T04:50:49.160 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.160 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.160 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.160 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 2106913797, 2024-06-02T04:50:49.160 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628383, 2024-06-02T04:50:49.160 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3602" 2024-06-02T04:50:49.160 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.161 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.161 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.161 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 2107272689, 2024-06-02T04:50:49.161 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628364, 2024-06-02T04:50:49.161 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2605" 2024-06-02T04:50:49.161 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.162 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.162 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.162 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 2115185277, 2024-06-02T04:50:49.162 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628652, 2024-06-02T04:50:49.162 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/12186" 2024-06-02T04:50:49.162 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.162 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.162 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.162 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 2172065855, 2024-06-02T04:50:49.162 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628935, 2024-06-02T04:50:49.163 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/548" 2024-06-02T04:50:49.163 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.163 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.163 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.163 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 2186747440, 2024-06-02T04:50:49.163 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628351, 2024-06-02T04:50:49.163 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2603_fsm" 2024-06-02T04:50:49.163 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.163 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.163 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.163 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 2192956523, 2024-06-02T04:50:49.164 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628910, 2024-06-02T04:50:49.164 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/3119" 2024-06-02T04:50:49.164 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.164 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.164 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.164 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 2200277275, 2024-06-02T04:50:49.164 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628914, 2024-06-02T04:50:49.164 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/6110" 2024-06-02T04:50:49.164 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.164 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.164 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.164 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 2215446260, 2024-06-02T04:50:49.165 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628938, 2024-06-02T04:50:49.165 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/3764" 2024-06-02T04:50:49.165 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.165 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.165 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.165 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 2324253675, 2024-06-02T04:50:49.165 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628461, 2024-06-02T04:50:49.165 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3164" 2024-06-02T04:50:49.165 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.165 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.165 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.166 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 2329017168, 2024-06-02T04:50:49.166 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628363, 2024-06-02T04:50:49.166 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2609" 2024-06-02T04:50:49.166 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.166 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.166 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.166 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 2332692223, 2024-06-02T04:50:49.167 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628536, 2024-06-02T04:50:49.167 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/828" 2024-06-02T04:50:49.167 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.167 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.167 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.167 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 2379077851, 2024-06-02T04:50:49.167 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628387, 2024-06-02T04:50:49.167 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3600" 2024-06-02T04:50:49.168 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.168 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.168 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.168 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 2403611470, 2024-06-02T04:50:49.168 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628648, 2024-06-02T04:50:49.168 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2607_fsm" 2024-06-02T04:50:49.168 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.168 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.168 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.168 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 2413562573, 2024-06-02T04:50:49.168 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628521, 2024-06-02T04:50:49.169 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3605" 2024-06-02T04:50:49.169 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.169 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.169 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.169 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 2436548882, 2024-06-02T04:50:49.169 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628336, 2024-06-02T04:50:49.169 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2604" 2024-06-02T04:50:49.169 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.169 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.169 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.169 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 2476301844, 2024-06-02T04:50:49.170 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628525, 2024-06-02T04:50:49.170 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3767" 2024-06-02T04:50:49.170 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.170 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.170 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.170 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 2720394793, 2024-06-02T04:50:49.170 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628932, 2024-06-02T04:50:49.170 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2663" 2024-06-02T04:50:49.170 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.170 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.171 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.171 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 2723237455, 2024-06-02T04:50:49.171 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628916, 2024-06-02T04:50:49.171 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2655" 2024-06-02T04:50:49.171 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.171 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.171 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.171 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 2733058542, 2024-06-02T04:50:49.171 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628572, 2024-06-02T04:50:49.171 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/1247_vm" 2024-06-02T04:50:49.171 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.172 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.172 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.172 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 2765200063, 2024-06-02T04:50:49.172 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628927, 2024-06-02T04:50:49.172 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/3604" 2024-06-02T04:50:49.172 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.172 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.172 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.172 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 2778730627, 2024-06-02T04:50:49.172 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628529, 2024-06-02T04:50:49.172 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/548" 2024-06-02T04:50:49.172 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.173 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.173 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.173 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 2797973818, 2024-06-02T04:50:49.173 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628468, 2024-06-02T04:50:49.173 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2669" 2024-06-02T04:50:49.173 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.173 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.173 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.173 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 2802601920, 2024-06-02T04:50:49.173 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628943, 2024-06-02T04:50:49.173 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/3455" 2024-06-02T04:50:49.174 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.174 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.174 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.174 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 2842064730, 2024-06-02T04:50:49.174 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628928, 2024-06-02T04:50:49.174 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2691" 2024-06-02T04:50:49.174 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.174 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.174 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.174 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 2868206201, 2024-06-02T04:50:49.174 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628939, 2024-06-02T04:50:49.174 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/3080" 2024-06-02T04:50:49.175 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.175 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.175 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.175 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 2880079235, 2024-06-02T04:50:49.175 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628424, 2024-06-02T04:50:49.175 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2838" 2024-06-02T04:50:49.175 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.175 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.175 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.175 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 2885947180, 2024-06-02T04:50:49.176 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628467, 2024-06-02T04:50:49.176 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2668" 2024-06-02T04:50:49.176 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.176 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.176 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.176 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 2897039736, 2024-06-02T04:50:49.176 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628908, 2024-06-02T04:50:49.176 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/3467" 2024-06-02T04:50:49.176 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.177 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.177 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.177 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 2935344973, 2024-06-02T04:50:49.177 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628911, 2024-06-02T04:50:49.177 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2674" 2024-06-02T04:50:49.177 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.177 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.177 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.177 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 2937321378, 2024-06-02T04:50:49.177 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628483, 2024-06-02T04:50:49.178 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3395" 2024-06-02T04:50:49.178 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.178 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.178 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.178 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 2986790486, 2024-06-02T04:50:49.178 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628474, 2024-06-02T04:50:49.178 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2675" 2024-06-02T04:50:49.178 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.178 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.178 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.178 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 3098093337, 2024-06-02T04:50:49.179 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628946, 2024-06-02T04:50:49.179 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/12207" 2024-06-02T04:50:49.179 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.179 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.179 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.179 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 3147116868, 2024-06-02T04:50:49.179 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628407, 2024-06-02T04:50:49.179 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3541" 2024-06-02T04:50:49.179 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.179 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.179 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.179 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 3194063397, 2024-06-02T04:50:49.180 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628352, 2024-06-02T04:50:49.180 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2612" 2024-06-02T04:50:49.180 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.180 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.180 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.180 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 3207565142, 2024-06-02T04:50:49.180 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628913, 2024-06-02T04:50:49.180 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2603_fsm" 2024-06-02T04:50:49.180 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.180 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.180 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.181 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 3247076614, 2024-06-02T04:50:49.181 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628422, 2024-06-02T04:50:49.181 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2836" 2024-06-02T04:50:49.181 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.181 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.181 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.181 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 3282601727, 2024-06-02T04:50:49.181 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628906, 2024-06-02T04:50:49.181 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/3603_vm" 2024-06-02T04:50:49.181 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.181 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.181 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.182 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 3287949552, 2024-06-02T04:50:49.182 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628933, 2024-06-02T04:50:49.182 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2838" 2024-06-02T04:50:49.182 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.182 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.182 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.182 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 3306829868, 2024-06-02T04:50:49.182 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628590, 2024-06-02T04:50:49.182 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2616_vm" 2024-06-02T04:50:49.182 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.182 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.182 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.183 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 3328478053, 2024-06-02T04:50:49.183 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628665, 2024-06-02T04:50:49.183 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/12207" 2024-06-02T04:50:49.183 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.183 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.183 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.183 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 3373730581, 2024-06-02T04:50:49.183 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628534, 2024-06-02T04:50:49.183 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3119" 2024-06-02T04:50:49.183 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.183 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.184 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.184 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 3379723014, 2024-06-02T04:50:49.184 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628602, 2024-06-02T04:50:49.184 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2608_vm" 2024-06-02T04:50:49.184 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.184 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.184 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.184 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 3379990086, 2024-06-02T04:50:49.184 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628400, 2024-06-02T04:50:49.184 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/826" 2024-06-02T04:50:49.184 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.184 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.185 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.185 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 3392191126, 2024-06-02T04:50:49.185 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628549, 2024-06-02T04:50:49.185 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/6111" 2024-06-02T04:50:49.185 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.185 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.185 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.185 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 3398220981, 2024-06-02T04:50:49.185 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628661, 2024-06-02T04:50:49.185 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/12201" 2024-06-02T04:50:49.185 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.185 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.186 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.186 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 3399761707, 2024-06-02T04:50:49.186 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628459, 2024-06-02T04:50:49.186 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2663" 2024-06-02T04:50:49.186 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.186 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.186 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.186 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 3430990550, 2024-06-02T04:50:49.186 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628354, 2024-06-02T04:50:49.186 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2995" 2024-06-02T04:50:49.186 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.187 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.187 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.187 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 3444591256, 2024-06-02T04:50:49.187 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628495, 2024-06-02T04:50:49.187 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2688" 2024-06-02T04:50:49.187 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.187 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.187 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.187 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 3447469189, 2024-06-02T04:50:49.187 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628548, 2024-06-02T04:50:49.187 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/6110" 2024-06-02T04:50:49.188 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.188 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.188 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.188 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 3458768898, 2024-06-02T04:50:49.188 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628930, 2024-06-02T04:50:49.188 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/3440" 2024-06-02T04:50:49.188 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.188 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.188 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.188 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 3519037082, 2024-06-02T04:50:49.188 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628515, 2024-06-02T04:50:49.188 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3467" 2024-06-02T04:50:49.189 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.189 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.189 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.189 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 3529409761, 2024-06-02T04:50:49.189 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628947, 2024-06-02T04:50:49.189 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2610" 2024-06-02T04:50:49.189 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.189 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.189 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.189 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 3566164566, 2024-06-02T04:50:49.189 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628519, 2024-06-02T04:50:49.189 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3609" 2024-06-02T04:50:49.190 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.190 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.190 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.190 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 3599003441, 2024-06-02T04:50:49.190 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628949, 2024-06-02T04:50:49.190 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2613" 2024-06-02T04:50:49.190 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.190 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.190 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.190 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 3640545445, 2024-06-02T04:50:49.190 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628595, 2024-06-02T04:50:49.191 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2612_vm" 2024-06-02T04:50:49.191 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.191 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.191 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.191 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 3658708509, 2024-06-02T04:50:49.191 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628660, 2024-06-02T04:50:49.191 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/12199" 2024-06-02T04:50:49.191 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.191 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.191 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.191 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 3710054065, 2024-06-02T04:50:49.191 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628405, 2024-06-02T04:50:49.192 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3456_fsm" 2024-06-02T04:50:49.192 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.192 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.192 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.192 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 3748625300, 2024-06-02T04:50:49.192 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628924, 2024-06-02T04:50:49.192 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/6111" 2024-06-02T04:50:49.192 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.192 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.192 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.192 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 3771413229, 2024-06-02T04:50:49.192 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628599, 2024-06-02T04:50:49.193 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3501_vm" 2024-06-02T04:50:49.193 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.193 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.193 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.193 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 3772195187, 2024-06-02T04:50:49.193 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628446, 2024-06-02T04:50:49.193 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2655" 2024-06-02T04:50:49.193 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.193 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.193 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.193 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 3782042896, 2024-06-02T04:50:49.193 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628615, 2024-06-02T04:50:49.194 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2601_vm" 2024-06-02T04:50:49.194 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.194 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.194 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.194 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 3831817506, 2024-06-02T04:50:49.194 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628330, 2024-06-02T04:50:49.194 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/1247" 2024-06-02T04:50:49.194 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.194 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.194 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.195 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 3859538687, 2024-06-02T04:50:49.195 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628410, 2024-06-02T04:50:49.195 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2224" 2024-06-02T04:50:49.195 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.195 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.195 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.195 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 3874859675, 2024-06-02T04:50:49.195 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628934, 2024-06-02T04:50:49.195 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2836" 2024-06-02T04:50:49.195 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.195 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.195 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.196 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 3912222530, 2024-06-02T04:50:49.196 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628492, 2024-06-02T04:50:49.196 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2685" 2024-06-02T04:50:49.196 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.196 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.196 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.196 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 4006246633, 2024-06-02T04:50:49.196 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628465, 2024-06-02T04:50:49.196 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2666" 2024-06-02T04:50:49.196 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.196 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.196 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.197 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 4009583519, 2024-06-02T04:50:49.197 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628367, 2024-06-02T04:50:49.197 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2615" 2024-06-02T04:50:49.197 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.197 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.197 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.197 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 4039694339, 2024-06-02T04:50:49.197 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628937, 2024-06-02T04:50:49.197 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2603" 2024-06-02T04:50:49.197 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.197 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.198 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.198 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 4104421272, 2024-06-02T04:50:49.198 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628370, 2024-06-02T04:50:49.198 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2608" 2024-06-02T04:50:49.198 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.198 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.198 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.198 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 4157511418, 2024-06-02T04:50:49.198 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628485, 2024-06-02T04:50:49.198 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2682" 2024-06-02T04:50:49.198 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.199 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.199 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.199 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 4257633875, 2024-06-02T04:50:49.199 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628626, 2024-06-02T04:50:49.199 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2834_vm" 2024-06-02T04:50:49.199 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.199 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.199 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.199 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 4283153395, 2024-06-02T04:50:49.199 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628477, 2024-06-02T04:50:49.199 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3503" 2024-06-02T04:50:49.199 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T04:50:49.200 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T04:50:49.200 INFO:teuthology.orchestra.run.smithi076.stdout: "damage_type": "backtrace", 2024-06-02T04:50:49.200 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 4289635556, 2024-06-02T04:50:49.200 INFO:teuthology.orchestra.run.smithi076.stdout: "ino": 1099511628460, 2024-06-02T04:50:49.200 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3455" 2024-06-02T04:50:49.200 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T04:50:49.200 INFO:teuthology.orchestra.run.smithi076.stdout:] 2024-06-02T04:50:49.201 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.114+0000 7f2104f16700 1 -- 172.21.15.76:0/2720845087 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f20e80a1030 msgr2=0x7f20e80a34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:49.202 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.114+0000 7f2104f16700 1 --2- 172.21.15.76:0/2720845087 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f20e80a1030 0x7f20e80a34f0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f20f4019000 tx=0x7f20f400b790 comp rx=0 tx=0).stop 2024-06-02T04:50:49.202 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.114+0000 7f2104f16700 1 -- 172.21.15.76:0/2720845087 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2100101980 msgr2=0x7f210019e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:49.202 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.114+0000 7f2104f16700 1 --2- 172.21.15.76:0/2720845087 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2100101980 0x7f210019e3e0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f20f800b970 tx=0x7f20f800bc80 comp rx=0 tx=0).stop 2024-06-02T04:50:49.202 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.114+0000 7f2104f16700 1 -- 172.21.15.76:0/2720845087 shutdown_connections 2024-06-02T04:50:49.202 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.115+0000 7f2104f16700 1 --2- 172.21.15.76:0/2720845087 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2100101980 0x7f210019e3e0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:49.202 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.115+0000 7f2104f16700 1 --2- 172.21.15.76:0/2720845087 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f21000ffe70 0x7f2100196e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:49.202 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.115+0000 7f2104f16700 1 --2- 172.21.15.76:0/2720845087 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f20e80a1030 0x7f20e80a34f0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:49.202 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.115+0000 7f2104f16700 1 --2- 172.21.15.76:0/2720845087 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2100100fc0 0x7f21001973c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:49.202 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.115+0000 7f2104f16700 1 -- 172.21.15.76:0/2720845087 >> 172.21.15.76:0/2720845087 conn(0x7f21000fb400 msgr2=0x7f21000694c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:50:49.202 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.115+0000 7f2104f16700 1 -- 172.21.15.76:0/2720845087 shutdown_connections 2024-06-02T04:50:49.203 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.115+0000 7f2104f16700 1 -- 172.21.15.76:0/2720845087 wait complete. 2024-06-02T04:50:49.203 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-06-02T04:50:49.344 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.341+0000 7f1b33fe3700 1 -- 172.21.15.76:0/1397640244 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1b2c1010c0 msgr2=0x7f1b2c101540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:49.344 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.341+0000 7f1b33fe3700 1 --2- 172.21.15.76:0/1397640244 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1b2c1010c0 0x7f1b2c101540 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f1b1c009990 tx=0x7f1b1c009ca0 comp rx=0 tx=0).stop 2024-06-02T04:50:49.344 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.341+0000 7f1b33fe3700 1 -- 172.21.15.76:0/1397640244 shutdown_connections 2024-06-02T04:50:49.344 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.341+0000 7f1b33fe3700 1 --2- 172.21.15.76:0/1397640244 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1b2c101a80 0x7f1b2c108310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:49.344 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.341+0000 7f1b33fe3700 1 --2- 172.21.15.76:0/1397640244 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1b2c1003b0 0x7f1b2c1007d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:49.344 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.341+0000 7f1b33fe3700 1 --2- 172.21.15.76:0/1397640244 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1b2c1010c0 0x7f1b2c101540 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:49.344 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.341+0000 7f1b33fe3700 1 -- 172.21.15.76:0/1397640244 >> 172.21.15.76:0/1397640244 conn(0x7f1b2c0fab80 msgr2=0x7f1b2c0fcfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:50:49.344 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.341+0000 7f1b33fe3700 1 -- 172.21.15.76:0/1397640244 shutdown_connections 2024-06-02T04:50:49.345 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.341+0000 7f1b33fe3700 1 -- 172.21.15.76:0/1397640244 wait complete. 2024-06-02T04:50:49.345 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.342+0000 7f1b33fe3700 1 Processor -- start 2024-06-02T04:50:49.345 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.342+0000 7f1b33fe3700 1 -- start start 2024-06-02T04:50:49.345 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.342+0000 7f1b33fe3700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1b2c1003b0 0x7f1b2c0ffa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:49.345 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.342+0000 7f1b33fe3700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1b2c1010c0 0x7f1b2c19bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:49.345 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.342+0000 7f1b33fe3700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1b2c101a80 0x7f1b2c19e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:49.345 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.342+0000 7f1b33fe3700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b2c19e900 con 0x7f1b2c101a80 2024-06-02T04:50:49.345 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.342+0000 7f1b33fe3700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b2c19ea70 con 0x7f1b2c1010c0 2024-06-02T04:50:49.345 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.342+0000 7f1b33fe3700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b2c19ec30 con 0x7f1b2c1003b0 2024-06-02T04:50:49.345 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.342+0000 7f1b32580700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1b2c101a80 0x7f1b2c19e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:49.345 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.342+0000 7f1b32580700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1b2c101a80 0x7f1b2c19e160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:49484/0 (socket says 172.21.15.76:49484) 2024-06-02T04:50:49.346 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.342+0000 7f1b32580700 1 -- 172.21.15.76:0/782280504 learned_addr learned my addr 172.21.15.76:0/782280504 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:50:49.346 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.342+0000 7f1b31d7f700 1 --2- 172.21.15.76:0/782280504 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1b2c1003b0 0x7f1b2c0ffa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:49.346 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.342+0000 7f1b3157e700 1 --2- 172.21.15.76:0/782280504 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1b2c1010c0 0x7f1b2c19bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:49.346 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.342+0000 7f1b3157e700 1 -- 172.21.15.76:0/782280504 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1b2c1003b0 msgr2=0x7f1b2c0ffa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:49.346 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.342+0000 7f1b3157e700 1 --2- 172.21.15.76:0/782280504 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1b2c1003b0 0x7f1b2c0ffa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:49.346 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.342+0000 7f1b3157e700 1 -- 172.21.15.76:0/782280504 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1b2c101a80 msgr2=0x7f1b2c19e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:49.346 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.342+0000 7f1b3157e700 1 --2- 172.21.15.76:0/782280504 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1b2c101a80 0x7f1b2c19e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:49.346 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.342+0000 7f1b3157e700 1 -- 172.21.15.76:0/782280504 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b1c0095f0 con 0x7f1b2c1010c0 2024-06-02T04:50:49.346 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.342+0000 7f1b32580700 1 --2- 172.21.15.76:0/782280504 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1b2c101a80 0x7f1b2c19e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T04:50:49.346 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.343+0000 7f1b3157e700 1 --2- 172.21.15.76:0/782280504 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1b2c1010c0 0x7f1b2c19bb70 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1b1c000c00 tx=0x7f1b1c0039f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:50:49.346 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.343+0000 7f1b22ffd700 1 -- 172.21.15.76:0/782280504 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b1c01d070 con 0x7f1b2c1010c0 2024-06-02T04:50:49.347 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.343+0000 7f1b22ffd700 1 -- 172.21.15.76:0/782280504 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1b1c00beb0 con 0x7f1b2c1010c0 2024-06-02T04:50:49.347 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.343+0000 7f1b33fe3700 1 -- 172.21.15.76:0/782280504 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b2c19eeb0 con 0x7f1b2c1010c0 2024-06-02T04:50:49.347 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.343+0000 7f1b22ffd700 1 -- 172.21.15.76:0/782280504 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b1c022e80 con 0x7f1b2c1010c0 2024-06-02T04:50:49.347 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.343+0000 7f1b33fe3700 1 -- 172.21.15.76:0/782280504 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b2c19f220 con 0x7f1b2c1010c0 2024-06-02T04:50:49.348 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.345+0000 7f1b22ffd700 1 -- 172.21.15.76:0/782280504 <== mon.2 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f1b1c00f460 con 0x7f1b2c1010c0 2024-06-02T04:50:49.348 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.345+0000 7f1b22ffd700 1 --2- 172.21.15.76:0/782280504 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f1b180a1120 0x7f1b180a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:49.348 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.346+0000 7f1b31d7f700 1 --2- 172.21.15.76:0/782280504 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f1b180a1120 0x7f1b180a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:49.348 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.346+0000 7f1b22ffd700 1 -- 172.21.15.76:0/782280504 <== mon.2 v2:172.21.15.119:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f1b1c0cdeb0 con 0x7f1b2c1010c0 2024-06-02T04:50:49.348 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.346+0000 7f1b31d7f700 1 --2- 172.21.15.76:0/782280504 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f1b180a1120 0x7f1b180a35e0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c069000 tx=0x7f1b28009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:50:49.348 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.348+0000 7f1b4019eb80 1 Processor -- start 2024-06-02T04:50:49.350 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.348+0000 7f1b4019eb80 1 -- start start 2024-06-02T04:50:49.350 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.348+0000 7f1b4019eb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562f57197540 0x562f57197960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:49.350 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.348+0000 7f1b4019eb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562f57197ea0 0x562f57198320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:49.350 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.348+0000 7f1b4019eb80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562f57198860 0x562f57198ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:49.350 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.348+0000 7f1b4019eb80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f570ee150 con 0x562f57198860 2024-06-02T04:50:49.350 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.348+0000 7f1b4019eb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f570ebb10 con 0x562f57197540 2024-06-02T04:50:49.350 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.348+0000 7f1b4019eb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f570e7400 con 0x562f57197ea0 2024-06-02T04:50:49.350 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.348+0000 7f1b31d7f700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562f57197540 0x562f57197960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:49.351 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.348+0000 7f1b32580700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562f57198860 0x562f57198ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:49.351 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.348+0000 7f1b31d7f700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562f57197540 0x562f57197960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:50862/0 (socket says 172.21.15.76:50862) 2024-06-02T04:50:49.351 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.348+0000 7f1b31d7f700 1 -- 172.21.15.76:0/201345456 learned_addr learned my addr 172.21.15.76:0/201345456 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:50:49.351 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.349+0000 7f1b3157e700 1 --2- 172.21.15.76:0/201345456 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562f57197ea0 0x562f57198320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:49.351 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.349+0000 7f1b32580700 1 -- 172.21.15.76:0/201345456 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562f57197ea0 msgr2=0x562f57198320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:50:49.351 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.349+0000 7f1b32580700 1 --2- 172.21.15.76:0/201345456 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562f57197ea0 0x562f57198320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:49.351 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.349+0000 7f1b32580700 1 -- 172.21.15.76:0/201345456 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562f57197540 msgr2=0x562f57197960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:50:49.351 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.349+0000 7f1b32580700 1 --2- 172.21.15.76:0/201345456 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562f57197540 0x562f57197960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:49.351 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.349+0000 7f1b32580700 1 -- 172.21.15.76:0/201345456 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562f56f683b0 con 0x562f57198860 2024-06-02T04:50:49.351 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.349+0000 7f1b31d7f700 1 --2- 172.21.15.76:0/201345456 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562f57197540 0x562f57197960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T04:50:49.351 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.349+0000 7f1b32580700 1 --2- 172.21.15.76:0/201345456 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562f57198860 0x562f57198ce0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f1b240078d0 tx=0x7f1b240091b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de3df73e7371e805 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:50:49.352 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.349+0000 7f1b17fff700 1 -- 172.21.15.76:0/201345456 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b24019070 con 0x562f57198860 2024-06-02T04:50:49.352 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.349+0000 7f1b17fff700 1 -- 172.21.15.76:0/201345456 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1b2400f040 con 0x562f57198860 2024-06-02T04:50:49.352 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.349+0000 7f1b17fff700 1 -- 172.21.15.76:0/201345456 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b24015480 con 0x562f57198860 2024-06-02T04:50:49.356 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.350+0000 7f1b4019eb80 1 -- 172.21.15.76:0/201345456 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562f57198860 msgr2=0x562f57198ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:49.356 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.350+0000 7f1b4019eb80 1 --2- 172.21.15.76:0/201345456 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562f57198860 0x562f57198ce0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f1b240078d0 tx=0x7f1b240091b0 comp rx=0 tx=0).stop 2024-06-02T04:50:49.357 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.350+0000 7f1b4019eb80 1 -- 172.21.15.76:0/201345456 shutdown_connections 2024-06-02T04:50:49.357 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.350+0000 7f1b4019eb80 1 --2- 172.21.15.76:0/201345456 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562f57198860 0x562f57198ce0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:49.357 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.350+0000 7f1b4019eb80 1 --2- 172.21.15.76:0/201345456 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562f57197540 0x562f57197960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:49.357 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.350+0000 7f1b4019eb80 1 --2- 172.21.15.76:0/201345456 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562f57197ea0 0x562f57198320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:49.357 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.350+0000 7f1b4019eb80 1 -- 172.21.15.76:0/201345456 >> 172.21.15.76:0/201345456 conn(0x562f570f5210 msgr2=0x562f57191de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:50:49.357 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.350+0000 7f1b4019eb80 1 -- 172.21.15.76:0/201345456 shutdown_connections 2024-06-02T04:50:49.357 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.350+0000 7f1b4019eb80 1 -- 172.21.15.76:0/201345456 wait complete. 2024-06-02T04:50:49.357 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.351+0000 7f1b4019eb80 1 -- start start 2024-06-02T04:50:49.357 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.351+0000 7f1b4019eb80 1 Processor -- start 2024-06-02T04:50:49.357 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.351+0000 7f1b4019eb80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562f57197540 0x562f571a0e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:49.358 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.351+0000 7f1b4019eb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562f57197ea0 0x562f571a1370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:49.358 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.351+0000 7f1b4019eb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562f57198860 0x562f571a8360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:49.358 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.351+0000 7f1b4019eb80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f57083560 con 0x562f57197540 2024-06-02T04:50:49.358 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.351+0000 7f1b4019eb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f57083200 con 0x562f57198860 2024-06-02T04:50:49.358 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.351+0000 7f1b4019eb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f56f6a6a0 con 0x562f57197ea0 2024-06-02T04:50:49.358 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.351+0000 7f1b4019eb80 10 client.0 _ll_register_callbacks cb 0x562f5708cb30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:50:49.358 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.351+0000 7f1b31d7f700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562f57197540 0x562f571a0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:49.358 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.351+0000 7f1b31d7f700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562f57197540 0x562f571a0e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:49496/0 (socket says 172.21.15.76:49496) 2024-06-02T04:50:49.358 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.351+0000 7f1b31d7f700 1 -- 172.21.15.76:0/3478395129 learned_addr learned my addr 172.21.15.76:0/3478395129 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:50:49.358 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.351+0000 7f1b3157e700 1 --2- 172.21.15.76:0/3478395129 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562f57197ea0 0x562f571a1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:49.358 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.352+0000 7f1b32580700 1 --2- 172.21.15.76:0/3478395129 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562f57198860 0x562f571a8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:49.359 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.352+0000 7f1b31d7f700 1 -- 172.21.15.76:0/3478395129 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562f57197ea0 msgr2=0x562f571a1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:50:49.359 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.352+0000 7f1b31d7f700 1 --2- 172.21.15.76:0/3478395129 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562f57197ea0 0x562f571a1370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:49.359 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.352+0000 7f1b31d7f700 1 -- 172.21.15.76:0/3478395129 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562f57198860 msgr2=0x562f571a8360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:50:49.359 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.352+0000 7f1b31d7f700 1 --2- 172.21.15.76:0/3478395129 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562f57198860 0x562f571a8360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:49.359 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.352+0000 7f1b31d7f700 1 -- 172.21.15.76:0/3478395129 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b28017070 con 0x562f57197540 2024-06-02T04:50:49.359 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.352+0000 7f1b32580700 1 --2- 172.21.15.76:0/3478395129 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562f57198860 0x562f571a8360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:50:49.359 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.352+0000 7f1b31d7f700 1 --2- 172.21.15.76:0/3478395129 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562f57197540 0x562f571a0e30 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f1b2801d8f0 tx=0x7f1b280047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2b20e53a4d0994e server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:50:49.359 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.352+0000 7f1b157fa700 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-06-02T04:50:49.359 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.352+0000 7f1b157fa700 1 -- 172.21.15.76:0/3478395129 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b28022070 con 0x562f57197540 2024-06-02T04:50:49.359 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.352+0000 7f1b157fa700 1 -- 172.21.15.76:0/3478395129 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f1b28004020 con 0x562f57197540 2024-06-02T04:50:49.359 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.352+0000 7f1b4019eb80 1 -- 172.21.15.76:0/3478395129 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562f57040270 con 0x562f57197540 2024-06-02T04:50:49.359 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.352+0000 7f1b157fa700 1 -- 172.21.15.76:0/3478395129 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1b280041e0 con 0x562f57197540 2024-06-02T04:50:49.360 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.352+0000 7f1b4019eb80 10 client.15855 fetch_fsmap learned FSMap version 29 2024-06-02T04:50:49.360 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.352+0000 7f1b4019eb80 1 -- 172.21.15.76:0/3478395129 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x7f1b24007500 con 0x562f57197540 2024-06-02T04:50:49.360 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.352+0000 7f1b157fa700 1 -- 172.21.15.76:0/3478395129 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x562f57040270 con 0x562f57197540 2024-06-02T04:50:49.360 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.353+0000 7f1b157fa700 1 -- 172.21.15.76:0/3478395129 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 29) v1 ==== 7482+0+0 (secure 0 0 0) 0x7f1b28003680 con 0x562f57197540 2024-06-02T04:50:49.360 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.353+0000 7f1b4019eb80 10 client.15855 fetch_fsmap finished waiting for FSMap version 29 2024-06-02T04:50:49.360 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.353+0000 7f1b4019eb80 10 client.15855 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-06-02T04:50:49.360 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.353+0000 7f1b4019eb80 20 client.15855 populate_metadata read hostname 'smithi076' 2024-06-02T04:50:49.360 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.353+0000 7f1b4019eb80 1 --2- 172.21.15.76:0/3478395129 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x562f571acc60 0x562f571af080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:49.360 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.353+0000 7f1b4019eb80 4 client.15855 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T04:50:49.360 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.353+0000 7f1b4019eb80 1 -- 172.21.15.76:0/3478395129 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562f57166810 con 0x562f571acc60 2024-06-02T04:50:49.360 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.353+0000 7f1b3157e700 1 --2- 172.21.15.76:0/3478395129 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x562f571acc60 0x562f571af080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:49.361 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.353+0000 7f1b157fa700 10 client.15855 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:50:49.361 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.353+0000 7f1b3157e700 1 --2- 172.21.15.76:0/3478395129 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x562f571acc60 0x562f571af080 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=70f8b001e9f5a2b4 server_cookie=6781f6e56cea815 in_seq=0 out_seq=0 2024-06-02T04:50:49.361 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.354+0000 7f1b157fa700 1 -- 172.21.15.76:0/3478395129 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x562f57166810 con 0x562f571acc60 2024-06-02T04:50:49.361 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.354+0000 7f1b157fa700 10 client.15855 handle_command_reply: tid=0 2024-06-02T04:50:49.361 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.354+0000 7f1b4019eb80 1 client.15855 shutdown 2024-06-02T04:50:49.361 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.354+0000 7f1b4019eb80 1 -- 172.21.15.76:0/3478395129 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562f57197540 msgr2=0x562f571a0e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:49.361 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.354+0000 7f1b4019eb80 1 --2- 172.21.15.76:0/3478395129 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562f57197540 0x562f571a0e30 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f1b2801d8f0 tx=0x7f1b280047c0 comp rx=0 tx=0).stop 2024-06-02T04:50:49.361 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.354+0000 7f1b4019eb80 1 -- 172.21.15.76:0/3478395129 shutdown_connections 2024-06-02T04:50:49.361 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.354+0000 7f1b4019eb80 1 --2- 172.21.15.76:0/3478395129 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x562f571acc60 0x562f571af080 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:49.361 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.354+0000 7f1b4019eb80 1 --2- 172.21.15.76:0/3478395129 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562f57198860 0x562f571a8360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:49.361 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.354+0000 7f1b4019eb80 1 --2- 172.21.15.76:0/3478395129 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562f57197540 0x562f571a0e30 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:49.361 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.354+0000 7f1b157fa700 0 client.15855 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:50:49.362 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.354+0000 7f1b4019eb80 1 --2- 172.21.15.76:0/3478395129 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562f57197ea0 0x562f571a1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:49.362 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.354+0000 7f1b4019eb80 1 -- 172.21.15.76:0/3478395129 >> 172.21.15.76:0/3478395129 conn(0x562f570f5210 msgr2=0x562f571915a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:50:49.362 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.354+0000 7f1b4019eb80 1 -- 172.21.15.76:0/3478395129 shutdown_connections 2024-06-02T04:50:49.362 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.354+0000 7f1b4019eb80 1 -- 172.21.15.76:0/3478395129 wait complete. 2024-06-02T04:50:49.362 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.355+0000 7f1b4019eb80 20 client.15855 trim_cache size 0 max 16384 2024-06-02T04:50:49.372 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.370+0000 7f1b4019eb80 1 Processor -- start 2024-06-02T04:50:49.372 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.370+0000 7f1b4019eb80 1 -- start start 2024-06-02T04:50:49.372 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.370+0000 7f1b4019eb80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562f57197540 0x562f571a8a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:49.373 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.370+0000 7f1b4019eb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562f57197ea0 0x562f571a82f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:49.373 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.370+0000 7f1b4019eb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562f57198860 0x562f571a0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:49.373 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.370+0000 7f1b4019eb80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f57193790 con 0x562f57197540 2024-06-02T04:50:49.373 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.370+0000 7f1b4019eb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f571aa070 con 0x562f57197ea0 2024-06-02T04:50:49.373 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.370+0000 7f1b4019eb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f5719e9c0 con 0x562f57198860 2024-06-02T04:50:49.373 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.370+0000 7f1b31d7f700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562f57197540 0x562f571a8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:49.373 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.370+0000 7f1b31d7f700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562f57197540 0x562f571a8a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:49502/0 (socket says 172.21.15.76:49502) 2024-06-02T04:50:49.373 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.370+0000 7f1b31d7f700 1 -- 172.21.15.76:0/4086367618 learned_addr learned my addr 172.21.15.76:0/4086367618 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:50:49.373 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.370+0000 7f1b3157e700 1 --2- 172.21.15.76:0/4086367618 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562f57197ea0 0x562f571a82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:49.373 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.371+0000 7f1b32580700 1 --2- 172.21.15.76:0/4086367618 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562f57198860 0x562f571a0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:49.373 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.371+0000 7f1b31d7f700 1 -- 172.21.15.76:0/4086367618 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562f57198860 msgr2=0x562f571a0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:50:49.374 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.371+0000 7f1b31d7f700 1 --2- 172.21.15.76:0/4086367618 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562f57198860 0x562f571a0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:49.374 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.371+0000 7f1b31d7f700 1 -- 172.21.15.76:0/4086367618 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562f57197ea0 msgr2=0x562f571a82f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:50:49.374 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.371+0000 7f1b31d7f700 1 --2- 172.21.15.76:0/4086367618 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562f57197ea0 0x562f571a82f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:49.374 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.371+0000 7f1b31d7f700 1 -- 172.21.15.76:0/4086367618 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562f56f14b60 con 0x562f57197540 2024-06-02T04:50:49.374 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.371+0000 7f1b31d7f700 1 --2- 172.21.15.76:0/4086367618 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562f57197540 0x562f571a8a10 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f1b28013010 tx=0x7f1b2800e3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f0c167c6900f975 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:50:49.374 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.371+0000 7f1b20ff9700 1 -- 172.21.15.76:0/4086367618 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b28022070 con 0x562f57197540 2024-06-02T04:50:49.374 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.371+0000 7f1b20ff9700 1 -- 172.21.15.76:0/4086367618 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1b28004470 con 0x562f57197540 2024-06-02T04:50:49.374 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.371+0000 7f1b20ff9700 1 -- 172.21.15.76:0/4086367618 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b2800e820 con 0x562f57197540 2024-06-02T04:50:49.374 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.372+0000 7f1b4019eb80 1 -- 172.21.15.76:0/4086367618 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562f57197540 msgr2=0x562f571a8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:49.374 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.372+0000 7f1b4019eb80 1 --2- 172.21.15.76:0/4086367618 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562f57197540 0x562f571a8a10 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f1b28013010 tx=0x7f1b2800e3b0 comp rx=0 tx=0).stop 2024-06-02T04:50:49.374 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.372+0000 7f1b4019eb80 1 -- 172.21.15.76:0/4086367618 shutdown_connections 2024-06-02T04:50:49.375 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.372+0000 7f1b4019eb80 1 --2- 172.21.15.76:0/4086367618 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562f57198860 0x562f571a0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:49.375 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.372+0000 7f1b4019eb80 1 --2- 172.21.15.76:0/4086367618 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562f57197540 0x562f571a8a10 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:49.375 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.372+0000 7f1b4019eb80 1 --2- 172.21.15.76:0/4086367618 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562f57197ea0 0x562f571a82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:49.375 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.372+0000 7f1b4019eb80 1 -- 172.21.15.76:0/4086367618 >> 172.21.15.76:0/4086367618 conn(0x562f570f5210 msgr2=0x562f5718e210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:50:49.375 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.372+0000 7f1b4019eb80 1 -- 172.21.15.76:0/4086367618 shutdown_connections 2024-06-02T04:50:49.375 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.372+0000 7f1b4019eb80 1 -- 172.21.15.76:0/4086367618 wait complete. 2024-06-02T04:50:49.375 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.372+0000 7f1b4019eb80 1 -- start start 2024-06-02T04:50:49.375 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.372+0000 7f1b4019eb80 1 Processor -- start 2024-06-02T04:50:49.378 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.373+0000 7f1b4019eb80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562f57197540 0x562f571a5d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:49.379 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.373+0000 7f1b4019eb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562f57197ea0 0x562f571a6280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:49.379 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.373+0000 7f1b4019eb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562f57198860 0x562f571a7290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:49.379 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.373+0000 7f1b4019eb80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f571a77d0 con 0x562f57197540 2024-06-02T04:50:49.379 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.373+0000 7f1b4019eb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f571a7940 con 0x562f57198860 2024-06-02T04:50:49.379 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.373+0000 7f1b4019eb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f571a7b00 con 0x562f57197ea0 2024-06-02T04:50:49.379 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.373+0000 7f1b4019eb80 10 client.0 _ll_register_callbacks cb 0x562f5708cb30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:50:49.379 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.373+0000 7f1b31d7f700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562f57197540 0x562f571a5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:49.379 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.373+0000 7f1b31d7f700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562f57197540 0x562f571a5d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:49508/0 (socket says 172.21.15.76:49508) 2024-06-02T04:50:49.379 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.373+0000 7f1b31d7f700 1 -- 172.21.15.76:0/3256777732 learned_addr learned my addr 172.21.15.76:0/3256777732 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:50:49.379 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.373+0000 7f1b3157e700 1 --2- 172.21.15.76:0/3256777732 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562f57197ea0 0x562f571a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:49.380 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.373+0000 7f1b32580700 1 --2- 172.21.15.76:0/3256777732 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562f57198860 0x562f571a7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:49.380 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.373+0000 7f1b31d7f700 1 -- 172.21.15.76:0/3256777732 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562f57197ea0 msgr2=0x562f571a6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:50:49.380 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.373+0000 7f1b31d7f700 1 --2- 172.21.15.76:0/3256777732 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562f57197ea0 0x562f571a6280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:49.380 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.373+0000 7f1b31d7f700 1 -- 172.21.15.76:0/3256777732 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562f57198860 msgr2=0x562f571a7290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:50:49.380 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.373+0000 7f1b31d7f700 1 --2- 172.21.15.76:0/3256777732 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562f57198860 0x562f571a7290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:49.380 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.373+0000 7f1b31d7f700 1 -- 172.21.15.76:0/3256777732 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b2802c040 con 0x562f57197540 2024-06-02T04:50:49.380 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.373+0000 7f1b31d7f700 1 --2- 172.21.15.76:0/3256777732 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562f57197540 0x562f571a5d40 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f1b2801f040 tx=0x7f1b28004120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db577644a8d0f06d server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:50:49.380 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.373+0000 7f1b157fa700 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-06-02T04:50:49.380 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.374+0000 7f1b157fa700 1 -- 172.21.15.76:0/3256777732 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b28022040 con 0x562f57197540 2024-06-02T04:50:49.380 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.374+0000 7f1b157fa700 1 -- 172.21.15.76:0/3256777732 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f1b2800e9b0 con 0x562f57197540 2024-06-02T04:50:49.381 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.374+0000 7f1b4019eb80 1 -- 172.21.15.76:0/3256777732 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1b2400f040 con 0x562f57197540 2024-06-02T04:50:49.381 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.374+0000 7f1b157fa700 1 -- 172.21.15.76:0/3256777732 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1b2800eb70 con 0x562f57197540 2024-06-02T04:50:49.381 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.374+0000 7f1b4019eb80 10 client.15861 fetch_fsmap learned FSMap version 29 2024-06-02T04:50:49.381 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.374+0000 7f1b4019eb80 1 -- 172.21.15.76:0/3256777732 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x562f570ad560 con 0x562f57197540 2024-06-02T04:50:49.381 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.374+0000 7f1b157fa700 1 -- 172.21.15.76:0/3256777732 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1b2400f040 con 0x562f57197540 2024-06-02T04:50:49.381 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.374+0000 7f1b157fa700 1 -- 172.21.15.76:0/3256777732 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 29) v1 ==== 7482+0+0 (secure 0 0 0) 0x7f1b2803b070 con 0x562f57197540 2024-06-02T04:50:49.381 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.374+0000 7f1b4019eb80 10 client.15861 fetch_fsmap finished waiting for FSMap version 29 2024-06-02T04:50:49.381 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.374+0000 7f1b4019eb80 10 client.15861 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-06-02T04:50:49.381 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.374+0000 7f1b4019eb80 20 client.15861 populate_metadata read hostname 'smithi076' 2024-06-02T04:50:49.381 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.374+0000 7f1b4019eb80 1 --2- 172.21.15.76:0/3256777732 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x562f57203a80 0x562f57205ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:49.381 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.374+0000 7f1b4019eb80 4 client.15861 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-06-02T04:50:49.382 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.374+0000 7f1b4019eb80 1 -- 172.21.15.76:0/3256777732 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x562f570dfec0 con 0x562f57203a80 2024-06-02T04:50:49.382 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.375+0000 7f1b3157e700 1 --2- 172.21.15.76:0/3256777732 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x562f57203a80 0x562f57205ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:49.382 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.375+0000 7f1b157fa700 10 client.15861 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:50:49.382 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.375+0000 7f1b3157e700 1 --2- 172.21.15.76:0/3256777732 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x562f57203a80 0x562f57205ea0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5d6a1cc2cd657fc9 server_cookie=cb4039981e0ccee9 in_seq=0 out_seq=0 2024-06-02T04:50:49.382 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.375+0000 7f1b157fa700 1 -- 172.21.15.76:0/3256777732 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x562f570dfec0 con 0x562f57203a80 2024-06-02T04:50:49.382 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.375+0000 7f1b157fa700 10 client.15861 handle_command_reply: tid=0 2024-06-02T04:50:49.382 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.375+0000 7f1b4019eb80 1 client.15861 shutdown 2024-06-02T04:50:49.382 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.375+0000 7f1b4019eb80 1 -- 172.21.15.76:0/3256777732 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562f57197540 msgr2=0x562f571a5d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:49.382 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.375+0000 7f1b4019eb80 1 --2- 172.21.15.76:0/3256777732 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562f57197540 0x562f571a5d40 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f1b2801f040 tx=0x7f1b28004120 comp rx=0 tx=0).stop 2024-06-02T04:50:49.382 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.376+0000 7f1b4019eb80 1 -- 172.21.15.76:0/3256777732 shutdown_connections 2024-06-02T04:50:49.382 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.376+0000 7f1b4019eb80 1 --2- 172.21.15.76:0/3256777732 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x562f57203a80 0x562f57205ea0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:49.383 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.376+0000 7f1b4019eb80 1 --2- 172.21.15.76:0/3256777732 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562f57198860 0x562f571a7290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:49.383 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.376+0000 7f1b157fa700 0 client.15861 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:50:49.383 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.376+0000 7f1b4019eb80 1 --2- 172.21.15.76:0/3256777732 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562f57197540 0x562f571a5d40 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:49.383 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.376+0000 7f1b4019eb80 1 --2- 172.21.15.76:0/3256777732 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562f57197ea0 0x562f571a6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:49.383 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.376+0000 7f1b4019eb80 1 -- 172.21.15.76:0/3256777732 >> 172.21.15.76:0/3256777732 conn(0x562f570f5210 msgr2=0x562f5719b790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:50:49.383 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.376+0000 7f1b4019eb80 1 -- 172.21.15.76:0/3256777732 shutdown_connections 2024-06-02T04:50:49.383 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.376+0000 7f1b4019eb80 1 -- 172.21.15.76:0/3256777732 wait complete. 2024-06-02T04:50:49.383 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.376+0000 7f1b4019eb80 20 client.15861 trim_cache size 0 max 16384 2024-06-02T04:50:49.383 INFO:teuthology.orchestra.run.smithi076.stdout:[] 2024-06-02T04:50:49.384 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.376+0000 7f1b33fe3700 1 -- 172.21.15.76:0/782280504 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f1b180a1120 msgr2=0x7f1b180a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:49.384 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.376+0000 7f1b33fe3700 1 --2- 172.21.15.76:0/782280504 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f1b180a1120 0x7f1b180a35e0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c069000 tx=0x7f1b28009260 comp rx=0 tx=0).stop 2024-06-02T04:50:49.384 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.376+0000 7f1b33fe3700 1 -- 172.21.15.76:0/782280504 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1b2c1010c0 msgr2=0x7f1b2c19bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:49.384 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.376+0000 7f1b33fe3700 1 --2- 172.21.15.76:0/782280504 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1b2c1010c0 0x7f1b2c19bb70 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1b1c000c00 tx=0x7f1b1c0039f0 comp rx=0 tx=0).stop 2024-06-02T04:50:49.385 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.376+0000 7f1b33fe3700 1 -- 172.21.15.76:0/782280504 shutdown_connections 2024-06-02T04:50:49.385 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.376+0000 7f1b33fe3700 1 --2- 172.21.15.76:0/782280504 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1b2c101a80 0x7f1b2c19e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:49.385 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.376+0000 7f1b33fe3700 1 --2- 172.21.15.76:0/782280504 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1b2c1003b0 0x7f1b2c0ffa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:49.385 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.376+0000 7f1b33fe3700 1 --2- 172.21.15.76:0/782280504 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f1b180a1120 0x7f1b180a35e0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:49.385 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.376+0000 7f1b33fe3700 1 --2- 172.21.15.76:0/782280504 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1b2c1010c0 0x7f1b2c19bb70 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:49.385 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.376+0000 7f1b33fe3700 1 -- 172.21.15.76:0/782280504 >> 172.21.15.76:0/782280504 conn(0x7f1b2c0fab80 msgr2=0x7f1b2c1045c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:50:49.385 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.377+0000 7f1b33fe3700 1 -- 172.21.15.76:0/782280504 shutdown_connections 2024-06-02T04:50:49.385 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T04:50:49.377+0000 7f1b33fe3700 1 -- 172.21.15.76:0/782280504 wait complete. 2024-06-02T04:50:49.388 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:49 smithi076 ceph-mon[42935]: pgmap v305: 129 pgs: 129 active+clean; 812 MiB data, 672 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 51 MiB/s wr, 45 op/s 2024-06-02T04:50:49.388 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:49 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/426771023' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:50:49.389 ERROR:tasks.fwd_scrub:rank 1 damaged: [{'damage_type': 'backtrace', 'id': 32432748, 'ino': 1099511628608, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2605_vm'}, {'damage_type': 'backtrace', 'id': 64544536, 'ino': 1099511628334, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/1259'}, {'damage_type': 'backtrace', 'id': 124538429, 'ino': 1099511628907, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/3575'}, {'damage_type': 'backtrace', 'id': 162888174, 'ino': 1099511628538, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3597'}, {'damage_type': 'backtrace', 'id': 260588171, 'ino': 1099511628589, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2617_vm'}, {'damage_type': 'backtrace', 'id': 417690764, 'ino': 1099511628921, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/12187_vm'}, {'damage_type': 'backtrace', 'id': 441715692, 'ino': 1099511628522, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3606'}, {'damage_type': 'backtrace', 'id': 454205470, 'ino': 1099511628919, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2608'}, {'damage_type': 'backtrace', 'id': 514530010, 'ino': 1099511628671, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/12182_fsm'}, {'damage_type': 'backtrace', 'id': 526876221, 'ino': 1099511628355, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2613'}, {'damage_type': 'backtrace', 'id': 545917248, 'ino': 1099511628945, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/1259'}, {'damage_type': 'backtrace', 'id': 550286192, 'ino': 1099511628520, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3604'}, {'damage_type': 'backtrace', 'id': 559349885, 'ino': 1099511628518, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3712'}, {'damage_type': 'backtrace', 'id': 578286030, 'ino': 1099511628596, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3394_vm'}, {'damage_type': 'backtrace', 'id': 585143155, 'ino': 1099511628328, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/1255'}, {'damage_type': 'backtrace', 'id': 596406835, 'ino': 1099511628936, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/1247'}, {'damage_type': 'backtrace', 'id': 631102332, 'ino': 1099511628925, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2682'}, {'damage_type': 'backtrace', 'id': 642909008, 'ino': 1099511628909, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2617_fsm'}, {'damage_type': 'backtrace', 'id': 683433890, 'ino': 1099511628915, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2702'}, {'damage_type': 'backtrace', 'id': 711725871, 'ino': 1099511628501, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2691'}, {'damage_type': 'backtrace', 'id': 749264506, 'ino': 1099511628532, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/174'}, {'damage_type': 'backtrace', 'id': 752007971, 'ino': 1099511628606, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3456_vm'}, {'damage_type': 'backtrace', 'id': 764347491, 'ino': 1099511628922, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/3164'}, {'damage_type': 'backtrace', 'id': 787598747, 'ino': 1099511628530, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/113'}, {'damage_type': 'backtrace', 'id': 836671582, 'ino': 1099511628940, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/3394_vm'}, {'damage_type': 'backtrace', 'id': 860546828, 'ino': 1099511628512, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2699'}, {'damage_type': 'backtrace', 'id': 867659806, 'ino': 1099511628496, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2689'}, {'damage_type': 'backtrace', 'id': 884462362, 'ino': 1099511628948, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/3606'}, {'damage_type': 'backtrace', 'id': 904122148, 'ino': 1099511628450, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2658'}, {'damage_type': 'backtrace', 'id': 908680877, 'ino': 1099511628341, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2617_fsm'}, {'damage_type': 'backtrace', 'id': 921807278, 'ino': 1099511628613, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2603_vm'}, {'damage_type': 'backtrace', 'id': 923550103, 'ino': 1099511628941, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2754'}, {'damage_type': 'backtrace', 'id': 963484879, 'ino': 1099511628912, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2668'}, {'damage_type': 'backtrace', 'id': 1010297541, 'ino': 1099511628923, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/3501_vm'}, {'damage_type': 'backtrace', 'id': 1079634453, 'ino': 1099511628684, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/12187_vm'}, {'damage_type': 'backtrace', 'id': 1225309538, 'ino': 1099511628350, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2603'}, {'damage_type': 'backtrace', 'id': 1303480791, 'ino': 1099511628929, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2605_vm'}, {'damage_type': 'backtrace', 'id': 1360870597, 'ino': 1099511628339, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2610'}, {'damage_type': 'backtrace', 'id': 1411111573, 'ino': 1099511628392, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3764_fsm'}, {'damage_type': 'backtrace', 'id': 1416238594, 'ino': 1099511628540, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3080'}, {'damage_type': 'backtrace', 'id': 1457657640, 'ino': 1099511628511, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3575'}, {'damage_type': 'backtrace', 'id': 1465444535, 'ino': 1099511628918, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/3712'}, {'damage_type': 'backtrace', 'id': 1502693619, 'ino': 1099511628931, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2685'}, {'damage_type': 'backtrace', 'id': 1523448154, 'ino': 1099511628391, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3764'}, {'damage_type': 'backtrace', 'id': 1574222437, 'ino': 1099511628679, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/12202_vm'}, {'damage_type': 'backtrace', 'id': 1607191170, 'ino': 1099511628514, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2702'}, {'damage_type': 'backtrace', 'id': 1695463665, 'ino': 1099511628416, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2831'}, {'damage_type': 'backtrace', 'id': 1723545837, 'ino': 1099511628920, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2831'}, {'damage_type': 'backtrace', 'id': 1745175845, 'ino': 1099511628497, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2754'}, {'damage_type': 'backtrace', 'id': 1854609000, 'ino': 1099511628348, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2602'}, {'damage_type': 'backtrace', 'id': 1857011347, 'ino': 1099511628662, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/12202'}, {'damage_type': 'backtrace', 'id': 1859004698, 'ino': 1099511628944, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/12182_fsm'}, {'damage_type': 'backtrace', 'id': 1941454365, 'ino': 1099511628621, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3439_vm'}, {'damage_type': 'backtrace', 'id': 1958351659, 'ino': 1099511628917, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/3597'}, {'damage_type': 'backtrace', 'id': 1974721056, 'ino': 1099511628942, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/12199'}, {'damage_type': 'backtrace', 'id': 1986203752, 'ino': 1099511628576, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3603_vm'}, {'damage_type': 'backtrace', 'id': 1987226793, 'ino': 1099511628440, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2650'}, {'damage_type': 'backtrace', 'id': 2076886141, 'ino': 1099511628473, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2674'}, {'damage_type': 'backtrace', 'id': 2076930765, 'ino': 1099511628431, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3440'}, {'damage_type': 'backtrace', 'id': 2093392728, 'ino': 1099511628926, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/113'}, {'damage_type': 'backtrace', 'id': 2106913797, 'ino': 1099511628383, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3602'}, {'damage_type': 'backtrace', 'id': 2107272689, 'ino': 1099511628364, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2605'}, {'damage_type': 'backtrace', 'id': 2115185277, 'ino': 1099511628652, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/12186'}, {'damage_type': 'backtrace', 'id': 2172065855, 'ino': 1099511628935, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/548'}, {'damage_type': 'backtrace', 'id': 2186747440, 'ino': 1099511628351, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2603_fsm'}, {'damage_type': 'backtrace', 'id': 2192956523, 'ino': 1099511628910, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/3119'}, {'damage_type': 'backtrace', 'id': 2200277275, 'ino': 1099511628914, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/6110'}, {'damage_type': 'backtrace', 'id': 2215446260, 'ino': 1099511628938, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/3764'}, {'damage_type': 'backtrace', 'id': 2324253675, 'ino': 1099511628461, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3164'}, {'damage_type': 'backtrace', 'id': 2329017168, 'ino': 1099511628363, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2609'}, {'damage_type': 'backtrace', 'id': 2332692223, 'ino': 1099511628536, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/828'}, {'damage_type': 'backtrace', 'id': 2379077851, 'ino': 1099511628387, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3600'}, {'damage_type': 'backtrace', 'id': 2403611470, 'ino': 1099511628648, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2607_fsm'}, {'damage_type': 'backtrace', 'id': 2413562573, 'ino': 1099511628521, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3605'}, {'damage_type': 'backtrace', 'id': 2436548882, 'ino': 1099511628336, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2604'}, {'damage_type': 'backtrace', 'id': 2476301844, 'ino': 1099511628525, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3767'}, {'damage_type': 'backtrace', 'id': 2720394793, 'ino': 1099511628932, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2663'}, {'damage_type': 'backtrace', 'id': 2723237455, 'ino': 1099511628916, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2655'}, {'damage_type': 'backtrace', 'id': 2733058542, 'ino': 1099511628572, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/1247_vm'}, {'damage_type': 'backtrace', 'id': 2765200063, 'ino': 1099511628927, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/3604'}, {'damage_type': 'backtrace', 'id': 2778730627, 'ino': 1099511628529, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/548'}, {'damage_type': 'backtrace', 'id': 2797973818, 'ino': 1099511628468, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2669'}, {'damage_type': 'backtrace', 'id': 2802601920, 'ino': 1099511628943, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/3455'}, {'damage_type': 'backtrace', 'id': 2842064730, 'ino': 1099511628928, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2691'}, {'damage_type': 'backtrace', 'id': 2868206201, 'ino': 1099511628939, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/3080'}, {'damage_type': 'backtrace', 'id': 2880079235, 'ino': 1099511628424, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2838'}, {'damage_type': 'backtrace', 'id': 2885947180, 'ino': 1099511628467, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2668'}, {'damage_type': 'backtrace', 'id': 2897039736, 'ino': 1099511628908, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/3467'}, {'damage_type': 'backtrace', 'id': 2935344973, 'ino': 1099511628911, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2674'}, {'damage_type': 'backtrace', 'id': 2937321378, 'ino': 1099511628483, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3395'}, {'damage_type': 'backtrace', 'id': 2986790486, 'ino': 1099511628474, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2675'}, {'damage_type': 'backtrace', 'id': 3098093337, 'ino': 1099511628946, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/12207'}, {'damage_type': 'backtrace', 'id': 3147116868, 'ino': 1099511628407, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3541'}, {'damage_type': 'backtrace', 'id': 3194063397, 'ino': 1099511628352, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2612'}, {'damage_type': 'backtrace', 'id': 3207565142, 'ino': 1099511628913, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2603_fsm'}, {'damage_type': 'backtrace', 'id': 3247076614, 'ino': 1099511628422, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2836'}, {'damage_type': 'backtrace', 'id': 3282601727, 'ino': 1099511628906, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/3603_vm'}, {'damage_type': 'backtrace', 'id': 3287949552, 'ino': 1099511628933, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2838'}, {'damage_type': 'backtrace', 'id': 3306829868, 'ino': 1099511628590, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2616_vm'}, {'damage_type': 'backtrace', 'id': 3328478053, 'ino': 1099511628665, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/12207'}, {'damage_type': 'backtrace', 'id': 3373730581, 'ino': 1099511628534, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3119'}, {'damage_type': 'backtrace', 'id': 3379723014, 'ino': 1099511628602, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2608_vm'}, {'damage_type': 'backtrace', 'id': 3379990086, 'ino': 1099511628400, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/826'}, {'damage_type': 'backtrace', 'id': 3392191126, 'ino': 1099511628549, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/6111'}, {'damage_type': 'backtrace', 'id': 3398220981, 'ino': 1099511628661, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/12201'}, {'damage_type': 'backtrace', 'id': 3399761707, 'ino': 1099511628459, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2663'}, {'damage_type': 'backtrace', 'id': 3430990550, 'ino': 1099511628354, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2995'}, {'damage_type': 'backtrace', 'id': 3444591256, 'ino': 1099511628495, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2688'}, {'damage_type': 'backtrace', 'id': 3447469189, 'ino': 1099511628548, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/6110'}, {'damage_type': 'backtrace', 'id': 3458768898, 'ino': 1099511628930, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/3440'}, {'damage_type': 'backtrace', 'id': 3519037082, 'ino': 1099511628515, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3467'}, {'damage_type': 'backtrace', 'id': 3529409761, 'ino': 1099511628947, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2610'}, {'damage_type': 'backtrace', 'id': 3566164566, 'ino': 1099511628519, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3609'}, {'damage_type': 'backtrace', 'id': 3599003441, 'ino': 1099511628949, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2613'}, {'damage_type': 'backtrace', 'id': 3640545445, 'ino': 1099511628595, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2612_vm'}, {'damage_type': 'backtrace', 'id': 3658708509, 'ino': 1099511628660, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/12199'}, {'damage_type': 'backtrace', 'id': 3710054065, 'ino': 1099511628405, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3456_fsm'}, {'damage_type': 'backtrace', 'id': 3748625300, 'ino': 1099511628924, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/6111'}, {'damage_type': 'backtrace', 'id': 3771413229, 'ino': 1099511628599, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3501_vm'}, {'damage_type': 'backtrace', 'id': 3772195187, 'ino': 1099511628446, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2655'}, {'damage_type': 'backtrace', 'id': 3782042896, 'ino': 1099511628615, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2601_vm'}, {'damage_type': 'backtrace', 'id': 3831817506, 'ino': 1099511628330, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/1247'}, {'damage_type': 'backtrace', 'id': 3859538687, 'ino': 1099511628410, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2224'}, {'damage_type': 'backtrace', 'id': 3874859675, 'ino': 1099511628934, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2836'}, {'damage_type': 'backtrace', 'id': 3912222530, 'ino': 1099511628492, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2685'}, {'damage_type': 'backtrace', 'id': 4006246633, 'ino': 1099511628465, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2666'}, {'damage_type': 'backtrace', 'id': 4009583519, 'ino': 1099511628367, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2615'}, {'damage_type': 'backtrace', 'id': 4039694339, 'ino': 1099511628937, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/12346/2603'}, {'damage_type': 'backtrace', 'id': 4104421272, 'ino': 1099511628370, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2608'}, {'damage_type': 'backtrace', 'id': 4157511418, 'ino': 1099511628485, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2682'}, {'damage_type': 'backtrace', 'id': 4257633875, 'ino': 1099511628626, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/2834_vm'}, {'damage_type': 'backtrace', 'id': 4283153395, 'ino': 1099511628477, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3503'}, {'damage_type': 'backtrace', 'id': 4289635556, 'ino': 1099511628460, 'path': '/volumes/qa/sv_0/48e4c007-96b2-4b96-99d9-566b25a0083e/postgres/data/base/1/3455'}] 2024-06-02T04:50:49.390 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph_111a617aaeda17ec8908c7a46e47c4a09ebf905d/qa/tasks/fwd_scrub.py", line 38, in _run self.do_scrub() File "/home/teuthworker/src/git.ceph.com_ceph_111a617aaeda17ec8908c7a46e47c4a09ebf905d/qa/tasks/fwd_scrub.py", line 55, in do_scrub self._scrub() File "/home/teuthworker/src/git.ceph.com_ceph_111a617aaeda17ec8908c7a46e47c4a09ebf905d/qa/tasks/fwd_scrub.py", line 79, in _scrub self._check_damage() File "/home/teuthworker/src/git.ceph.com_ceph_111a617aaeda17ec8908c7a46e47c4a09ebf905d/qa/tasks/fwd_scrub.py", line 90, in _check_damage raise RuntimeError(f"rank damage found: {types}") RuntimeError: rank damage found: {'backtrace'} 2024-06-02T04:50:49.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:49 smithi119 ceph-mon[46633]: pgmap v305: 129 pgs: 129 active+clean; 812 MiB data, 672 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 51 MiB/s wr, 45 op/s 2024-06-02T04:50:49.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:49 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/426771023' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:50:49.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:49 smithi192 ceph-mon[47933]: pgmap v305: 129 pgs: 129 active+clean; 812 MiB data, 672 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 51 MiB/s wr, 45 op/s 2024-06-02T04:50:49.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:49 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/426771023' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:50:51.166 INFO:teuthology.orchestra.run.smithi076.stderr:done. 2024-06-02T04:50:51.170 DEBUG:teuthology.orchestra.run.smithi076:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- pgbench -c 100 -j 4 --progress=5 --time=900' 2024-06-02T04:50:51.314 INFO:teuthology.orchestra.run.smithi076.stderr:starting vacuum...end. 2024-06-02T04:50:51.447 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.446+0000 7f4281eb6700 1 -- 172.21.15.76:0/244821404 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f427c101920 msgr2=0x7f427c108240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:51.447 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.446+0000 7f4281eb6700 1 --2- 172.21.15.76:0/244821404 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f427c101920 0x7f427c108240 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f42740098f0 tx=0x7f4274009c00 comp rx=0 tx=0).stop 2024-06-02T04:50:51.447 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.446+0000 7f4281eb6700 1 -- 172.21.15.76:0/244821404 shutdown_connections 2024-06-02T04:50:51.447 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.446+0000 7f4281eb6700 1 --2- 172.21.15.76:0/244821404 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f427c101920 0x7f427c108240 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:51.447 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.446+0000 7f4281eb6700 1 --2- 172.21.15.76:0/244821404 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f427c0ffe10 0x7f427c100230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:51.448 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.447+0000 7f4281eb6700 1 --2- 172.21.15.76:0/244821404 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f427c100f60 0x7f427c1013e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:51.448 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.447+0000 7f4281eb6700 1 -- 172.21.15.76:0/244821404 >> 172.21.15.76:0/244821404 conn(0x7f427c0fb380 msgr2=0x7f427c0fd7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:50:51.448 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.447+0000 7f4281eb6700 1 -- 172.21.15.76:0/244821404 shutdown_connections 2024-06-02T04:50:51.449 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.447+0000 7f4281eb6700 1 -- 172.21.15.76:0/244821404 wait complete. 2024-06-02T04:50:51.449 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.447+0000 7f4281eb6700 1 Processor -- start 2024-06-02T04:50:51.449 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.448+0000 7f4281eb6700 1 -- start start 2024-06-02T04:50:51.449 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.448+0000 7f4281eb6700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f427c0ffe10 0x7f427c194ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:51.449 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.448+0000 7f4281eb6700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f427c100f60 0x7f427c19a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:51.449 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.448+0000 7f4281eb6700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f427c101920 0x7f427c195320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:51.449 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.448+0000 7f4281eb6700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f427c1ad7a0 con 0x7f427c101920 2024-06-02T04:50:51.450 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.448+0000 7f4281eb6700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f427c06a9c0 con 0x7f427c100f60 2024-06-02T04:50:51.450 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.448+0000 7f4281eb6700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f427c06ab50 con 0x7f427c0ffe10 2024-06-02T04:50:51.450 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.448+0000 7f427affd700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f427c100f60 0x7f427c19a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:51.450 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.448+0000 7f427affd700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f427c100f60 0x7f427c19a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:50900/0 (socket says 172.21.15.76:50900) 2024-06-02T04:50:51.450 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.448+0000 7f427affd700 1 -- 172.21.15.76:0/201981735 learned_addr learned my addr 172.21.15.76:0/201981735 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:50:51.450 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.448+0000 7f427bfff700 1 --2- 172.21.15.76:0/201981735 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f427c101920 0x7f427c195320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:51.450 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.448+0000 7f427affd700 1 -- 172.21.15.76:0/201981735 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f427c0ffe10 msgr2=0x7f427c194ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:51.450 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.448+0000 7f427affd700 1 --2- 172.21.15.76:0/201981735 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f427c0ffe10 0x7f427c194ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:51.450 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.448+0000 7f427affd700 1 -- 172.21.15.76:0/201981735 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f427c101920 msgr2=0x7f427c195320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:51.450 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.448+0000 7f427affd700 1 --2- 172.21.15.76:0/201981735 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f427c101920 0x7f427c195320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:51.450 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.448+0000 7f427affd700 1 -- 172.21.15.76:0/201981735 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4274009520 con 0x7f427c100f60 2024-06-02T04:50:51.450 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.448+0000 7f427bfff700 1 --2- 172.21.15.76:0/201981735 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f427c101920 0x7f427c195320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:50:51.451 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.449+0000 7f427affd700 1 --2- 172.21.15.76:0/201981735 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f427c100f60 0x7f427c19a1a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f427000e9c0 tx=0x7f427000ed80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:50:51.451 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.449+0000 7f4278ff9700 1 -- 172.21.15.76:0/201981735 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f427000cbd0 con 0x7f427c100f60 2024-06-02T04:50:51.451 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.449+0000 7f4278ff9700 1 -- 172.21.15.76:0/201981735 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f427000cd30 con 0x7f427c100f60 2024-06-02T04:50:51.451 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.449+0000 7f4278ff9700 1 -- 172.21.15.76:0/201981735 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4270005520 con 0x7f427c100f60 2024-06-02T04:50:51.451 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.449+0000 7f4281eb6700 1 -- 172.21.15.76:0/201981735 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f427c06ae30 con 0x7f427c100f60 2024-06-02T04:50:51.451 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.449+0000 7f4281eb6700 1 -- 172.21.15.76:0/201981735 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f427c06b2f0 con 0x7f427c100f60 2024-06-02T04:50:51.453 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.453+0000 7f428e071b80 1 Processor -- start 2024-06-02T04:50:51.453 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.453+0000 7f4278ff9700 1 -- 172.21.15.76:0/201981735 <== mon.2 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f4270004750 con 0x7f427c100f60 2024-06-02T04:50:51.453 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.453+0000 7f428e071b80 1 -- start start 2024-06-02T04:50:51.454 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.453+0000 7f428e071b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55636e967a80 0x55636e967ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:51.454 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.453+0000 7f428e071b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55636e9683e0 0x55636e968cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:51.454 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.453+0000 7f428e071b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55636e9692d0 0x55636e969750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:51.454 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.453+0000 7f428e071b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55636e8bf0f0 con 0x55636e967a80 2024-06-02T04:50:51.455 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.453+0000 7f428e071b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55636e8bcab0 con 0x55636e9692d0 2024-06-02T04:50:51.455 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.453+0000 7f428e071b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55636e8b83a0 con 0x55636e9683e0 2024-06-02T04:50:51.455 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.454+0000 7f427affd700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55636e9692d0 0x55636e969750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:51.455 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.454+0000 7f427bfff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55636e967a80 0x55636e967ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:51.455 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.454+0000 7f427bfff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55636e967a80 0x55636e967ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:49520/0 (socket says 172.21.15.76:49520) 2024-06-02T04:50:51.455 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.454+0000 7f427bfff700 1 -- 172.21.15.76:0/1340877791 learned_addr learned my addr 172.21.15.76:0/1340877791 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:50:51.455 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.454+0000 7f4278ff9700 1 --2- 172.21.15.76:0/201981735 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f42640a1220 0x7f42640a36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:51.455 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.454+0000 7f427b7fe700 1 --2- 172.21.15.76:0/1340877791 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55636e9683e0 0x55636e968cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:51.455 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.454+0000 7f427bfff700 1 -- 172.21.15.76:0/1340877791 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55636e9683e0 msgr2=0x55636e968cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:50:51.455 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.454+0000 7f427bfff700 1 --2- 172.21.15.76:0/1340877791 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55636e9683e0 0x55636e968cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:51.455 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.454+0000 7f427bfff700 1 -- 172.21.15.76:0/1340877791 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55636e9692d0 msgr2=0x55636e969750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:50:51.455 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.454+0000 7f427bfff700 1 --2- 172.21.15.76:0/1340877791 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55636e9692d0 0x55636e969750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:51.456 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.454+0000 7f427bfff700 1 -- 172.21.15.76:0/1340877791 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55636e739350 con 0x55636e967a80 2024-06-02T04:50:51.457 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.454+0000 7f4278ff9700 1 -- 172.21.15.76:0/201981735 <== mon.2 v2:172.21.15.119:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f4270014070 con 0x7f427c100f60 2024-06-02T04:50:51.458 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.454+0000 7f427bfff700 1 --2- 172.21.15.76:0/1340877791 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55636e967a80 0x55636e967ea0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f4274005bf0 tx=0x7f427400bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9fbac3e8be69187 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:50:51.458 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.455+0000 7f4261ffb700 1 -- 172.21.15.76:0/1340877791 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f427400fda0 con 0x55636e967a80 2024-06-02T04:50:51.458 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.455+0000 7f4261ffb700 1 -- 172.21.15.76:0/1340877791 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f427400b560 con 0x55636e967a80 2024-06-02T04:50:51.458 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.455+0000 7f4261ffb700 1 -- 172.21.15.76:0/1340877791 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4274005300 con 0x55636e967a80 2024-06-02T04:50:51.458 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.455+0000 7f427bfff700 1 --2- 172.21.15.76:0/201981735 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f42640a1220 0x7f42640a36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:51.458 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.455+0000 7f428e071b80 1 -- 172.21.15.76:0/1340877791 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55636e967a80 msgr2=0x55636e967ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:51.458 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.455+0000 7f428e071b80 1 --2- 172.21.15.76:0/1340877791 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55636e967a80 0x55636e967ea0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f4274005bf0 tx=0x7f427400bec0 comp rx=0 tx=0).stop 2024-06-02T04:50:51.458 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.456+0000 7f428e071b80 1 -- 172.21.15.76:0/1340877791 shutdown_connections 2024-06-02T04:50:51.458 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.456+0000 7f428e071b80 1 --2- 172.21.15.76:0/1340877791 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55636e9692d0 0x55636e969750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:51.458 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.456+0000 7f428e071b80 1 --2- 172.21.15.76:0/1340877791 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55636e967a80 0x55636e967ea0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:51.459 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.456+0000 7f428e071b80 1 --2- 172.21.15.76:0/1340877791 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55636e9683e0 0x55636e968cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:51.459 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.456+0000 7f428e071b80 1 -- 172.21.15.76:0/1340877791 >> 172.21.15.76:0/1340877791 conn(0x55636e8c61b0 msgr2=0x55636e964440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:50:51.459 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.456+0000 7f428e071b80 1 -- 172.21.15.76:0/1340877791 shutdown_connections 2024-06-02T04:50:51.459 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.456+0000 7f428e071b80 1 -- 172.21.15.76:0/1340877791 wait complete. 2024-06-02T04:50:51.459 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.456+0000 7f428e071b80 1 -- start start 2024-06-02T04:50:51.459 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.456+0000 7f428e071b80 1 Processor -- start 2024-06-02T04:50:51.459 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.457+0000 7f428e071b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55636e967a80 0x55636e971800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:51.459 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.457+0000 7f428e071b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55636e9683e0 0x55636e971d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:51.459 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.457+0000 7f428e071b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55636e9692d0 0x55636e978d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:51.459 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.457+0000 7f428e071b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55636e854500 con 0x55636e9692d0 2024-06-02T04:50:51.459 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.457+0000 7f428e071b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55636e8541a0 con 0x55636e967a80 2024-06-02T04:50:51.459 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.457+0000 7f428e071b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55636e73b640 con 0x55636e9683e0 2024-06-02T04:50:51.459 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.457+0000 7f428e071b80 10 client.0 _ll_register_callbacks cb 0x55636e85dad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:50:51.460 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.457+0000 7f427affd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55636e9683e0 0x55636e971d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:51.460 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.457+0000 7f427affd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55636e9683e0 0x55636e971d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:47786/0 (socket says 172.21.15.76:47786) 2024-06-02T04:50:51.460 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.457+0000 7f427affd700 1 -- 172.21.15.76:0/3908635660 learned_addr learned my addr 172.21.15.76:0/3908635660 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:50:51.460 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.457+0000 7f427bfff700 1 --2- 172.21.15.76:0/201981735 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f42640a1220 0x7f42640a36e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f4274005bf0 tx=0x7f427400bec0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:50:51.460 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.457+0000 7f427b7fe700 1 --2- 172.21.15.76:0/3908635660 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55636e967a80 0x55636e971800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:51.460 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.457+0000 7f427bfff700 1 --2- 172.21.15.76:0/3908635660 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55636e9692d0 0x55636e978d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:51.460 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.457+0000 7f427affd700 1 -- 172.21.15.76:0/3908635660 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55636e967a80 msgr2=0x55636e971800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:50:51.460 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.457+0000 7f427affd700 1 --2- 172.21.15.76:0/3908635660 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55636e967a80 0x55636e971800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:51.460 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.457+0000 7f427affd700 1 -- 172.21.15.76:0/3908635660 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55636e9692d0 msgr2=0x55636e978d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:50:51.460 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.457+0000 7f427affd700 1 --2- 172.21.15.76:0/3908635660 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55636e9692d0 0x55636e978d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:51.460 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.457+0000 7f427affd700 1 -- 172.21.15.76:0/3908635660 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f427c0697f0 con 0x55636e9683e0 2024-06-02T04:50:51.462 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.458+0000 7f427b7fe700 1 --2- 172.21.15.76:0/3908635660 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55636e967a80 0x55636e971800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:50:51.462 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.458+0000 7f427affd700 1 --2- 172.21.15.76:0/3908635660 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55636e9683e0 0x55636e971d40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4270020000 tx=0x7f42700097d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3bf6fafa37d37cb8 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:50:51.462 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.458+0000 7f425affd700 10 client.0 ms_handle_connect on v2:172.21.15.192:3300/0 2024-06-02T04:50:51.462 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.458+0000 7f425affd700 1 -- 172.21.15.76:0/3908635660 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4270099f90 con 0x55636e9683e0 2024-06-02T04:50:51.462 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.458+0000 7f425affd700 1 -- 172.21.15.76:0/3908635660 <== mon.1 v2:172.21.15.192:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f427009ddc0 con 0x55636e9683e0 2024-06-02T04:50:51.463 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.458+0000 7f428e071b80 1 -- 172.21.15.76:0/3908635660 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55636e811210 con 0x55636e9683e0 2024-06-02T04:50:51.463 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.458+0000 7f425affd700 1 -- 172.21.15.76:0/3908635660 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f42700a2410 con 0x55636e9683e0 2024-06-02T04:50:51.463 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.458+0000 7f428e071b80 10 client.25336 fetch_fsmap learned FSMap version 29 2024-06-02T04:50:51.463 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.458+0000 7f428e071b80 1 -- 172.21.15.76:0/3908635660 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55636e6e5b00 con 0x55636e9683e0 2024-06-02T04:50:51.463 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.458+0000 7f425affd700 1 -- 172.21.15.76:0/3908635660 <== mon.1 v2:172.21.15.192:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f427007b070 con 0x55636e9683e0 2024-06-02T04:50:51.463 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.458+0000 7f425affd700 1 -- 172.21.15.76:0/3908635660 <== mon.1 v2:172.21.15.192:3300/0 5 ==== fsmap(e 29) v1 ==== 7482+0+0 (secure 0 0 0) 0x7f42700d3070 con 0x55636e9683e0 2024-06-02T04:50:51.463 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.458+0000 7f428e071b80 10 client.25336 fetch_fsmap finished waiting for FSMap version 29 2024-06-02T04:50:51.463 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.458+0000 7f428e071b80 10 client.25336 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T04:50:51.463 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.458+0000 7f428e071b80 20 client.25336 populate_metadata read hostname 'smithi076' 2024-06-02T04:50:51.463 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.458+0000 7f428e071b80 1 --2- 172.21.15.76:0/3908635660 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55636e97d5f0 0x55636e97fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:51.463 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.458+0000 7f428e071b80 4 client.25336 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T04:50:51.463 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.458+0000 7f428e071b80 1 -- 172.21.15.76:0/3908635660 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55636e9377b0 con 0x55636e97d5f0 2024-06-02T04:50:51.463 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.459+0000 7f427b7fe700 1 --2- 172.21.15.76:0/3908635660 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55636e97d5f0 0x55636e97fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:51.464 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.460+0000 7f425affd700 10 client.25336 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:50:51.464 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.460+0000 7f427b7fe700 1 --2- 172.21.15.76:0/3908635660 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55636e97d5f0 0x55636e97fa10 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d0d1d56bbce15be8 server_cookie=7228d503e4d1218 in_seq=0 out_seq=0 2024-06-02T04:50:51.464 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.461+0000 7f425affd700 1 -- 172.21.15.76:0/3908635660 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55636e9377b0 con 0x55636e97d5f0 2024-06-02T04:50:51.464 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.461+0000 7f425affd700 10 client.25336 handle_command_reply: tid=0 2024-06-02T04:50:51.464 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.461+0000 7f428e071b80 1 client.25336 shutdown 2024-06-02T04:50:51.464 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.461+0000 7f428e071b80 1 -- 172.21.15.76:0/3908635660 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55636e9683e0 msgr2=0x55636e971d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:51.464 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.461+0000 7f428e071b80 1 --2- 172.21.15.76:0/3908635660 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55636e9683e0 0x55636e971d40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4270020000 tx=0x7f42700097d0 comp rx=0 tx=0).stop 2024-06-02T04:50:51.464 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.461+0000 7f428e071b80 1 -- 172.21.15.76:0/3908635660 shutdown_connections 2024-06-02T04:50:51.464 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.461+0000 7f428e071b80 1 --2- 172.21.15.76:0/3908635660 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55636e97d5f0 0x55636e97fa10 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:51.464 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.461+0000 7f428e071b80 1 --2- 172.21.15.76:0/3908635660 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55636e9692d0 0x55636e978d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:51.464 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.461+0000 7f428e071b80 1 --2- 172.21.15.76:0/3908635660 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55636e967a80 0x55636e971800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:51.464 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.461+0000 7f425affd700 0 client.25336 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:50:51.464 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.461+0000 7f428e071b80 1 --2- 172.21.15.76:0/3908635660 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55636e9683e0 0x55636e971d40 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:51.465 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.461+0000 7f428e071b80 1 -- 172.21.15.76:0/3908635660 >> 172.21.15.76:0/3908635660 conn(0x55636e8c61b0 msgr2=0x55636e962860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:50:51.465 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.462+0000 7f428e071b80 1 -- 172.21.15.76:0/3908635660 shutdown_connections 2024-06-02T04:50:51.465 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.462+0000 7f428e071b80 1 -- 172.21.15.76:0/3908635660 wait complete. 2024-06-02T04:50:51.465 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.462+0000 7f428e071b80 20 client.25336 trim_cache size 0 max 16384 2024-06-02T04:50:51.480 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.478+0000 7f428e071b80 1 Processor -- start 2024-06-02T04:50:51.480 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.478+0000 7f428e071b80 1 -- start start 2024-06-02T04:50:51.480 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.478+0000 7f428e071b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55636e967a80 0x55636e979430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:51.480 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.478+0000 7f428e071b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55636e9683e0 0x55636e978d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:51.480 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.478+0000 7f428e071b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55636e9692d0 0x55636e970d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:51.480 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.478+0000 7f428e071b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55636e95f9b0 con 0x55636e9683e0 2024-06-02T04:50:51.480 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.478+0000 7f428e071b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55636e9687c0 con 0x55636e9692d0 2024-06-02T04:50:51.480 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.478+0000 7f428e071b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55636e971370 con 0x55636e967a80 2024-06-02T04:50:51.480 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.479+0000 7f427b7fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55636e967a80 0x55636e979430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:51.480 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.479+0000 7f427b7fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55636e967a80 0x55636e979430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:47798/0 (socket says 172.21.15.76:47798) 2024-06-02T04:50:51.480 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.479+0000 7f427b7fe700 1 -- 172.21.15.76:0/4092326025 learned_addr learned my addr 172.21.15.76:0/4092326025 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:50:51.481 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.479+0000 7f427bfff700 1 --2- 172.21.15.76:0/4092326025 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55636e9692d0 0x55636e970d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:51.481 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.479+0000 7f427affd700 1 --2- 172.21.15.76:0/4092326025 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55636e9683e0 0x55636e978d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:51.481 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.479+0000 7f427bfff700 1 -- 172.21.15.76:0/4092326025 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55636e967a80 msgr2=0x55636e979430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:50:51.481 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.479+0000 7f427bfff700 1 --2- 172.21.15.76:0/4092326025 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55636e967a80 0x55636e979430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:51.481 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.479+0000 7f427bfff700 1 -- 172.21.15.76:0/4092326025 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55636e9683e0 msgr2=0x55636e978d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:50:51.481 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.479+0000 7f427bfff700 1 --2- 172.21.15.76:0/4092326025 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55636e9683e0 0x55636e978d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:51.481 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.479+0000 7f427bfff700 1 -- 172.21.15.76:0/4092326025 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55636e87e500 con 0x55636e9692d0 2024-06-02T04:50:51.481 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.479+0000 7f427b7fe700 1 --2- 172.21.15.76:0/4092326025 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55636e967a80 0x55636e979430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T04:50:51.481 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.479+0000 7f427bfff700 1 --2- 172.21.15.76:0/4092326025 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55636e9692d0 0x55636e970d10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f427400f9d0 tx=0x7f4274005520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9597384d9f8853e3 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:50:51.481 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.480+0000 7f42627fc700 1 -- 172.21.15.76:0/4092326025 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f427400fba0 con 0x55636e9692d0 2024-06-02T04:50:51.481 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.480+0000 7f42627fc700 1 -- 172.21.15.76:0/4092326025 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4274035050 con 0x55636e9692d0 2024-06-02T04:50:51.481 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.480+0000 7f42627fc700 1 -- 172.21.15.76:0/4092326025 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42740049c0 con 0x55636e9692d0 2024-06-02T04:50:51.483 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.480+0000 7f428e071b80 1 -- 172.21.15.76:0/4092326025 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55636e9692d0 msgr2=0x55636e970d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:51.483 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.480+0000 7f428e071b80 1 --2- 172.21.15.76:0/4092326025 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55636e9692d0 0x55636e970d10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f427400f9d0 tx=0x7f4274005520 comp rx=0 tx=0).stop 2024-06-02T04:50:51.484 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.480+0000 7f428e071b80 1 -- 172.21.15.76:0/4092326025 shutdown_connections 2024-06-02T04:50:51.484 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.480+0000 7f428e071b80 1 --2- 172.21.15.76:0/4092326025 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55636e9692d0 0x55636e970d10 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:51.484 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.480+0000 7f428e071b80 1 --2- 172.21.15.76:0/4092326025 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55636e967a80 0x55636e979430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:51.484 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.480+0000 7f428e071b80 1 --2- 172.21.15.76:0/4092326025 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55636e9683e0 0x55636e978d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:51.484 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.480+0000 7f428e071b80 1 -- 172.21.15.76:0/4092326025 >> 172.21.15.76:0/4092326025 conn(0x55636e8c61b0 msgr2=0x55636e96f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:50:51.484 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.480+0000 7f428e071b80 1 -- 172.21.15.76:0/4092326025 shutdown_connections 2024-06-02T04:50:51.484 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.480+0000 7f428e071b80 1 -- 172.21.15.76:0/4092326025 wait complete. 2024-06-02T04:50:51.484 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.481+0000 7f428e071b80 1 -- start start 2024-06-02T04:50:51.484 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.481+0000 7f428e071b80 1 Processor -- start 2024-06-02T04:50:51.484 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.481+0000 7f428e071b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55636e967a80 0x55636e976350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:51.484 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.481+0000 7f428e071b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55636e9683e0 0x55636e976890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:51.484 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.481+0000 7f428e071b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55636e9692d0 0x55636e9776e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:51.484 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.481+0000 7f428e071b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55636e977c20 con 0x55636e967a80 2024-06-02T04:50:51.485 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.481+0000 7f428e071b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55636e977d90 con 0x55636e9692d0 2024-06-02T04:50:51.485 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.481+0000 7f428e071b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55636e977f50 con 0x55636e9683e0 2024-06-02T04:50:51.485 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.481+0000 7f428e071b80 10 client.0 _ll_register_callbacks cb 0x55636e85dad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:50:51.485 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.482+0000 7f427bfff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55636e9692d0 0x55636e9776e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:51.485 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.482+0000 7f427bfff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55636e9692d0 0x55636e9776e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:50924/0 (socket says 172.21.15.76:50924) 2024-06-02T04:50:51.485 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.482+0000 7f427bfff700 1 -- 172.21.15.76:0/429073877 learned_addr learned my addr 172.21.15.76:0/429073877 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:50:51.485 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.482+0000 7f427b7fe700 1 --2- 172.21.15.76:0/429073877 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55636e967a80 0x55636e976350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:51.485 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.482+0000 7f427bfff700 1 -- 172.21.15.76:0/429073877 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55636e9683e0 msgr2=0x55636e976890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:50:51.485 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.482+0000 7f427affd700 1 --2- 172.21.15.76:0/429073877 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55636e9683e0 0x55636e976890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:51.485 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.482+0000 7f427bfff700 1 --2- 172.21.15.76:0/429073877 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55636e9683e0 0x55636e976890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:51.485 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.482+0000 7f427bfff700 1 -- 172.21.15.76:0/429073877 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55636e967a80 msgr2=0x55636e976350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:50:51.485 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.482+0000 7f427bfff700 1 --2- 172.21.15.76:0/429073877 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55636e967a80 0x55636e976350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:51.485 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.482+0000 7f427bfff700 1 -- 172.21.15.76:0/429073877 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f426c00aa80 con 0x55636e9692d0 2024-06-02T04:50:51.486 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.482+0000 7f427b7fe700 1 --2- 172.21.15.76:0/429073877 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55636e967a80 0x55636e976350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:50:51.486 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.482+0000 7f427affd700 1 --2- 172.21.15.76:0/429073877 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55636e9683e0 0x55636e976890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:50:51.486 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.482+0000 7f427bfff700 1 --2- 172.21.15.76:0/429073877 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55636e9692d0 0x55636e9776e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f427400bd10 tx=0x7f4274005440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f2c0105873e5ce38 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:50:51.486 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.482+0000 7f425affd700 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-06-02T04:50:51.486 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.482+0000 7f425affd700 1 -- 172.21.15.76:0/429073877 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4274004740 con 0x55636e9692d0 2024-06-02T04:50:51.486 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.482+0000 7f428e071b80 1 -- 172.21.15.76:0/429073877 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f427400b560 con 0x55636e9692d0 2024-06-02T04:50:51.486 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.482+0000 7f425affd700 1 -- 172.21.15.76:0/429073877 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f42740048a0 con 0x55636e9692d0 2024-06-02T04:50:51.486 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.482+0000 7f425affd700 1 -- 172.21.15.76:0/429073877 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4274004a60 con 0x55636e9692d0 2024-06-02T04:50:51.486 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.482+0000 7f428e071b80 10 client.25403 fetch_fsmap learned FSMap version 29 2024-06-02T04:50:51.486 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.482+0000 7f428e071b80 1 -- 172.21.15.76:0/429073877 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55636e739350 con 0x55636e9692d0 2024-06-02T04:50:51.486 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.483+0000 7f425affd700 1 -- 172.21.15.76:0/429073877 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f427400b560 con 0x55636e9692d0 2024-06-02T04:50:51.487 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:51 smithi076 ceph-mon[42935]: pgmap v306: 129 pgs: 129 active+clean; 840 MiB data, 707 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 45 MiB/s wr, 38 op/s 2024-06-02T04:50:51.487 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.483+0000 7f425affd700 1 -- 172.21.15.76:0/429073877 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 29) v1 ==== 7482+0+0 (secure 0 0 0) 0x7f4274041070 con 0x55636e9692d0 2024-06-02T04:50:51.487 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.483+0000 7f428e071b80 10 client.25403 fetch_fsmap finished waiting for FSMap version 29 2024-06-02T04:50:51.488 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.483+0000 7f428e071b80 10 client.25403 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T04:50:51.488 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.483+0000 7f428e071b80 20 client.25403 populate_metadata read hostname 'smithi076' 2024-06-02T04:50:51.488 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.483+0000 7f428e071b80 1 --2- 172.21.15.76:0/429073877 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55636e9d3ef0 0x55636e9d6310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:50:51.488 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.483+0000 7f428e071b80 4 client.25403 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T04:50:51.488 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.483+0000 7f428e071b80 1 -- 172.21.15.76:0/429073877 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55636e8b0e60 con 0x55636e9d3ef0 2024-06-02T04:50:51.488 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.483+0000 7f427b7fe700 1 --2- 172.21.15.76:0/429073877 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55636e9d3ef0 0x55636e9d6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:50:51.488 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.484+0000 7f427b7fe700 1 --2- 172.21.15.76:0/429073877 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55636e9d3ef0 0x55636e9d6310 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d059f4a44238a75 server_cookie=957250d6b26bc7fd in_seq=0 out_seq=0 2024-06-02T04:50:51.488 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.484+0000 7f425affd700 10 client.25403 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:50:51.528 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.527+0000 7f425affd700 1 -- 172.21.15.76:0/429073877 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55636e8b0e60 con 0x55636e9d3ef0 2024-06-02T04:50:51.528 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.527+0000 7f425affd700 10 client.25403 handle_command_reply: tid=0 2024-06-02T04:50:51.528 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.527+0000 7f428e071b80 1 client.25403 shutdown 2024-06-02T04:50:51.528 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.527+0000 7f428e071b80 1 -- 172.21.15.76:0/429073877 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55636e9692d0 msgr2=0x55636e9776e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:51.528 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.527+0000 7f428e071b80 1 --2- 172.21.15.76:0/429073877 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55636e9692d0 0x55636e9776e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f427400bd10 tx=0x7f4274005440 comp rx=0 tx=0).stop 2024-06-02T04:50:51.528 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.527+0000 7f428e071b80 1 -- 172.21.15.76:0/429073877 shutdown_connections 2024-06-02T04:50:51.528 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.527+0000 7f428e071b80 1 --2- 172.21.15.76:0/429073877 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55636e9d3ef0 0x55636e9d6310 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:51.529 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.527+0000 7f428e071b80 1 --2- 172.21.15.76:0/429073877 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55636e9692d0 0x55636e9776e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:51.529 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.527+0000 7f428e071b80 1 --2- 172.21.15.76:0/429073877 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55636e967a80 0x55636e976350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:51.529 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.527+0000 7f428e071b80 1 --2- 172.21.15.76:0/429073877 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55636e9683e0 0x55636e976890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:51.529 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.527+0000 7f428e071b80 1 -- 172.21.15.76:0/429073877 >> 172.21.15.76:0/429073877 conn(0x55636e8c61b0 msgr2=0x55636e96bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:50:51.529 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.527+0000 7f425affd700 0 client.25403 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:50:51.529 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.528+0000 7f428e071b80 1 -- 172.21.15.76:0/429073877 shutdown_connections 2024-06-02T04:50:51.529 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.528+0000 7f428e071b80 1 -- 172.21.15.76:0/429073877 wait complete. 2024-06-02T04:50:51.530 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.528+0000 7f428e071b80 20 client.25403 trim_cache size 0 max 16384 2024-06-02T04:50:51.530 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:{ 2024-06-02T04:50:51.530 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "message": "", 2024-06-02T04:50:51.530 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "return_code": 0 2024-06-02T04:50:51.530 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:} 2024-06-02T04:50:51.531 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.529+0000 7f4281eb6700 1 -- 172.21.15.76:0/201981735 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f42640a1220 msgr2=0x7f42640a36e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:51.531 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.529+0000 7f4281eb6700 1 --2- 172.21.15.76:0/201981735 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f42640a1220 0x7f42640a36e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f4274005bf0 tx=0x7f427400bec0 comp rx=0 tx=0).stop 2024-06-02T04:50:51.531 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.529+0000 7f4281eb6700 1 -- 172.21.15.76:0/201981735 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f427c100f60 msgr2=0x7f427c19a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:50:51.531 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.529+0000 7f4281eb6700 1 --2- 172.21.15.76:0/201981735 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f427c100f60 0x7f427c19a1a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f427000e9c0 tx=0x7f427000ed80 comp rx=0 tx=0).stop 2024-06-02T04:50:51.531 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.529+0000 7f4281eb6700 1 -- 172.21.15.76:0/201981735 shutdown_connections 2024-06-02T04:50:51.531 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.529+0000 7f4281eb6700 1 --2- 172.21.15.76:0/201981735 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f427c101920 0x7f427c195320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:51.531 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.529+0000 7f4281eb6700 1 --2- 172.21.15.76:0/201981735 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f427c0ffe10 0x7f427c194ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:51.531 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.529+0000 7f4281eb6700 1 --2- 172.21.15.76:0/201981735 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f42640a1220 0x7f42640a36e0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:51.531 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.529+0000 7f4281eb6700 1 --2- 172.21.15.76:0/201981735 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f427c100f60 0x7f427c19a1a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:50:51.531 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.529+0000 7f4281eb6700 1 -- 172.21.15.76:0/201981735 >> 172.21.15.76:0/201981735 conn(0x7f427c0fb380 msgr2=0x7f427c102210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:50:51.532 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.529+0000 7f4281eb6700 1 -- 172.21.15.76:0/201981735 shutdown_connections 2024-06-02T04:50:51.532 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:50:51.529+0000 7f4281eb6700 1 -- 172.21.15.76:0/201981735 wait complete. 2024-06-02T04:50:51.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:51 smithi119 ceph-mon[46633]: pgmap v306: 129 pgs: 129 active+clean; 840 MiB data, 707 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 45 MiB/s wr, 38 op/s 2024-06-02T04:50:51.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:51 smithi192 ceph-mon[47933]: pgmap v306: 129 pgs: 129 active+clean; 840 MiB data, 707 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 45 MiB/s wr, 38 op/s 2024-06-02T04:50:53.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:53 smithi119 ceph-mon[46633]: pgmap v307: 129 pgs: 129 active+clean; 909 MiB data, 781 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 48 MiB/s wr, 45 op/s 2024-06-02T04:50:53.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:53 smithi192 ceph-mon[47933]: pgmap v307: 129 pgs: 129 active+clean; 909 MiB data, 781 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 48 MiB/s wr, 45 op/s 2024-06-02T04:50:53.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:53 smithi076 ceph-mon[42935]: pgmap v307: 129 pgs: 129 active+clean; 909 MiB data, 781 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 48 MiB/s wr, 45 op/s 2024-06-02T04:50:55.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:55 smithi119 ceph-mon[46633]: pgmap v308: 129 pgs: 129 active+clean; 938 MiB data, 809 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 42 MiB/s wr, 46 op/s 2024-06-02T04:50:55.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:55 smithi192 ceph-mon[47933]: pgmap v308: 129 pgs: 129 active+clean; 938 MiB data, 809 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 42 MiB/s wr, 46 op/s 2024-06-02T04:50:55.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:55 smithi076 ceph-mon[42935]: pgmap v308: 129 pgs: 129 active+clean; 938 MiB data, 809 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 42 MiB/s wr, 46 op/s 2024-06-02T04:50:56.314 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 5.0 s, 978.8 tps, lat 95.168 ms stddev 181.273 2024-06-02T04:50:57.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:57 smithi119 ceph-mon[46633]: pgmap v309: 129 pgs: 129 active+clean; 957 MiB data, 846 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 45 MiB/s wr, 87 op/s 2024-06-02T04:50:57.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:57 smithi192 ceph-mon[47933]: pgmap v309: 129 pgs: 129 active+clean; 957 MiB data, 846 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 45 MiB/s wr, 87 op/s 2024-06-02T04:50:57.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:57 smithi076 ceph-mon[42935]: pgmap v309: 129 pgs: 129 active+clean; 957 MiB data, 846 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 45 MiB/s wr, 87 op/s 2024-06-02T04:50:59.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:50:59 smithi119 ceph-mon[46633]: pgmap v310: 129 pgs: 129 active+clean; 966 MiB data, 842 MiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 41 MiB/s wr, 170 op/s 2024-06-02T04:50:59.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:50:59 smithi192 ceph-mon[47933]: pgmap v310: 129 pgs: 129 active+clean; 966 MiB data, 842 MiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 41 MiB/s wr, 170 op/s 2024-06-02T04:50:59.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:50:59 smithi076 ceph-mon[42935]: pgmap v310: 129 pgs: 129 active+clean; 966 MiB data, 842 MiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 41 MiB/s wr, 170 op/s 2024-06-02T04:51:01.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 10.0 s, 1174.4 tps, lat 85.202 ms stddev 117.180 2024-06-02T04:51:01.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:51:01 smithi119 ceph-mon[46633]: pgmap v311: 129 pgs: 129 active+clean; 978 MiB data, 867 MiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 31 MiB/s wr, 196 op/s 2024-06-02T04:51:01.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:51:01 smithi192 ceph-mon[47933]: pgmap v311: 129 pgs: 129 active+clean; 978 MiB data, 867 MiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 31 MiB/s wr, 196 op/s 2024-06-02T04:51:01.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:51:01 smithi076 ceph-mon[42935]: pgmap v311: 129 pgs: 129 active+clean; 978 MiB data, 867 MiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 31 MiB/s wr, 196 op/s 2024-06-02T04:51:03.598 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:51:03 smithi119 ceph-mon[46633]: pgmap v312: 129 pgs: 129 active+clean; 1016 MiB data, 908 MiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 36 MiB/s wr, 271 op/s 2024-06-02T04:51:03.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:51:03 smithi192 ceph-mon[47933]: pgmap v312: 129 pgs: 129 active+clean; 1016 MiB data, 908 MiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 36 MiB/s wr, 271 op/s 2024-06-02T04:51:03.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:51:03 smithi076 ceph-mon[42935]: pgmap v312: 129 pgs: 129 active+clean; 1016 MiB data, 908 MiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 36 MiB/s wr, 271 op/s 2024-06-02T04:51:04.694 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.692+0000 7fa205d91700 1 -- 172.21.15.76:0/1952855499 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa200109350 msgr2=0x7fa200109770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:51:04.694 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.692+0000 7fa205d91700 1 --2- 172.21.15.76:0/1952855499 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa200109350 0x7fa200109770 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fa1f000d9e0 tx=0x7fa1f000dcf0 comp rx=0 tx=0).stop 2024-06-02T04:51:04.694 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.692+0000 7fa205d91700 1 -- 172.21.15.76:0/1952855499 shutdown_connections 2024-06-02T04:51:04.694 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.692+0000 7fa205d91700 1 --2- 172.21.15.76:0/1952855499 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa200108940 0x7fa200110200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:04.695 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.692+0000 7fa205d91700 1 --2- 172.21.15.76:0/1952855499 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa200109350 0x7fa200109770 secure :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fa1f000d9e0 tx=0x7fa1f000dcf0 comp rx=0 tx=0).stop 2024-06-02T04:51:04.695 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.692+0000 7fa205d91700 1 --2- 172.21.15.76:0/1952855499 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa200107fa0 0x7fa200108400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:04.695 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.692+0000 7fa205d91700 1 -- 172.21.15.76:0/1952855499 >> 172.21.15.76:0/1952855499 conn(0x7fa20006df30 msgr2=0x7fa200070370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:51:04.695 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.693+0000 7fa205d91700 1 -- 172.21.15.76:0/1952855499 shutdown_connections 2024-06-02T04:51:04.695 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.693+0000 7fa205d91700 1 -- 172.21.15.76:0/1952855499 wait complete. 2024-06-02T04:51:04.697 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.693+0000 7fa205d91700 1 Processor -- start 2024-06-02T04:51:04.697 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.693+0000 7fa205d91700 1 -- start start 2024-06-02T04:51:04.697 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.694+0000 7fa205d91700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa200107fa0 0x7fa2001a1a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:51:04.697 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.694+0000 7fa205d91700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa200108940 0x7fa2001a1f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:51:04.697 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.694+0000 7fa205d91700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa2001a6f80 0x7fa2001a9370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:51:04.697 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.694+0000 7fa205d91700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2001a9940 con 0x7fa2001a6f80 2024-06-02T04:51:04.698 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.694+0000 7fa205d91700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2001a9a80 con 0x7fa200108940 2024-06-02T04:51:04.698 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.694+0000 7fa205d91700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2001a9c10 con 0x7fa200107fa0 2024-06-02T04:51:04.698 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.694+0000 7fa1ff7fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa200107fa0 0x7fa2001a1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:51:04.698 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.694+0000 7fa1ff7fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa200107fa0 0x7fa2001a1a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:41776/0 (socket says 172.21.15.76:41776) 2024-06-02T04:51:04.698 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.694+0000 7fa1ff7fe700 1 -- 172.21.15.76:0/4222348355 learned_addr learned my addr 172.21.15.76:0/4222348355 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:51:04.698 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.694+0000 7fa1f7fff700 1 --2- 172.21.15.76:0/4222348355 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa200108940 0x7fa2001a1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:51:04.699 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.694+0000 7fa1fffff700 1 --2- 172.21.15.76:0/4222348355 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa2001a6f80 0x7fa2001a9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:51:04.699 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.694+0000 7fa1ff7fe700 1 -- 172.21.15.76:0/4222348355 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa200108940 msgr2=0x7fa2001a1f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:51:04.699 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.694+0000 7fa1ff7fe700 1 --2- 172.21.15.76:0/4222348355 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa200108940 0x7fa2001a1f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:04.699 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.694+0000 7fa1ff7fe700 1 -- 172.21.15.76:0/4222348355 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa2001a6f80 msgr2=0x7fa2001a9370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:51:04.699 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.694+0000 7fa1ff7fe700 1 --2- 172.21.15.76:0/4222348355 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa2001a6f80 0x7fa2001a9370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:04.699 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.694+0000 7fa1ff7fe700 1 -- 172.21.15.76:0/4222348355 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1f000d650 con 0x7fa200107fa0 2024-06-02T04:51:04.700 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.694+0000 7fa1ff7fe700 1 --2- 172.21.15.76:0/4222348355 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa200107fa0 0x7fa2001a1a30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa1f0000c00 tx=0x7fa1f0003d10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:51:04.700 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.695+0000 7fa1fd7fa700 1 -- 172.21.15.76:0/4222348355 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f0005040 con 0x7fa200107fa0 2024-06-02T04:51:04.700 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.695+0000 7fa205d91700 1 -- 172.21.15.76:0/4222348355 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2001a9e90 con 0x7fa200107fa0 2024-06-02T04:51:04.700 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.695+0000 7fa205d91700 1 -- 172.21.15.76:0/4222348355 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2001aa200 con 0x7fa200107fa0 2024-06-02T04:51:04.700 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.695+0000 7fa1fd7fa700 1 -- 172.21.15.76:0/4222348355 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa1f0005630 con 0x7fa200107fa0 2024-06-02T04:51:04.701 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.695+0000 7fa1fd7fa700 1 -- 172.21.15.76:0/4222348355 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f0004b90 con 0x7fa200107fa0 2024-06-02T04:51:04.707 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.697+0000 7fa1fd7fa700 1 -- 172.21.15.76:0/4222348355 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fa1f0004cf0 con 0x7fa200107fa0 2024-06-02T04:51:04.707 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.699+0000 7fa1fd7fa700 1 --2- 172.21.15.76:0/4222348355 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fa1ec0a11a0 0x7fa1ec0a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:51:04.707 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.699+0000 7fa1fd7fa700 1 -- 172.21.15.76:0/4222348355 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7fa1f00ce6d0 con 0x7fa200107fa0 2024-06-02T04:51:04.708 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.699+0000 7fa1f7fff700 1 --2- 172.21.15.76:0/4222348355 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fa1ec0a11a0 0x7fa1ec0a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:51:04.708 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.700+0000 7fa211f4cb80 1 Processor -- start 2024-06-02T04:51:04.708 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.700+0000 7fa211f4cb80 1 -- start start 2024-06-02T04:51:04.708 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.700+0000 7fa211f4cb80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b9afb29a80 0x55b9afb29ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:51:04.708 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.700+0000 7fa211f4cb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b9afb2a3e0 0x55b9afb2acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:51:04.708 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.700+0000 7fa211f4cb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b9afb2b2d0 0x55b9afb2b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:51:04.708 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.700+0000 7fa211f4cb80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9afa810f0 con 0x55b9afb29a80 2024-06-02T04:51:04.708 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.700+0000 7fa211f4cb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9afa7eab0 con 0x55b9afb2b2d0 2024-06-02T04:51:04.708 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.700+0000 7fa211f4cb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9afa7a3a0 con 0x55b9afb2a3e0 2024-06-02T04:51:04.708 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.701+0000 7fa1ff7fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b9afb29a80 0x55b9afb29ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:51:04.709 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.701+0000 7fa1ff7fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b9afb29a80 0x55b9afb29ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:47872/0 (socket says 172.21.15.76:47872) 2024-06-02T04:51:04.709 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.701+0000 7fa1ff7fe700 1 -- 172.21.15.76:0/3530906702 learned_addr learned my addr 172.21.15.76:0/3530906702 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:51:04.709 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.701+0000 7fa1f7fff700 1 --2- 172.21.15.76:0/3530906702 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b9afb2a3e0 0x55b9afb2acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:51:04.709 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.701+0000 7fa1f7fff700 1 --2- 172.21.15.76:0/4222348355 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fa1ec0a11a0 0x7fa1ec0a3660 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fa1e8009c60 tx=0x7fa1e8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:51:04.709 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.701+0000 7fa1ff7fe700 1 -- 172.21.15.76:0/3530906702 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b9afb2a3e0 msgr2=0x55b9afb2acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:51:04.709 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.701+0000 7fa1ff7fe700 1 --2- 172.21.15.76:0/3530906702 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b9afb2a3e0 0x55b9afb2acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:04.709 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.701+0000 7fa1ff7fe700 1 -- 172.21.15.76:0/3530906702 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b9afb2b2d0 msgr2=0x55b9afb2b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:51:04.709 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.701+0000 7fa1fffff700 1 --2- 172.21.15.76:0/3530906702 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b9afb2b2d0 0x55b9afb2b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:51:04.709 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.701+0000 7fa1ff7fe700 1 --2- 172.21.15.76:0/3530906702 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b9afb2b2d0 0x55b9afb2b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:04.709 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.701+0000 7fa1ff7fe700 1 -- 172.21.15.76:0/3530906702 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b9af8fb350 con 0x55b9afb29a80 2024-06-02T04:51:04.710 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.701+0000 7fa1fffff700 1 --2- 172.21.15.76:0/3530906702 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b9afb2b2d0 0x55b9afb2b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:51:04.710 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.701+0000 7fa1ff7fe700 1 --2- 172.21.15.76:0/3530906702 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b9afb29a80 0x55b9afb29ea0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fa1f00a3730 tx=0x7fa1f000aee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94244ba9653988f server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:51:04.710 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.701+0000 7fa1f5ffb700 1 -- 172.21.15.76:0/3530906702 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f009b870 con 0x55b9afb29a80 2024-06-02T04:51:04.710 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.701+0000 7fa1f5ffb700 1 -- 172.21.15.76:0/3530906702 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa1f009f6a0 con 0x55b9afb29a80 2024-06-02T04:51:04.710 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.701+0000 7fa1f5ffb700 1 -- 172.21.15.76:0/3530906702 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f00bb0d0 con 0x55b9afb29a80 2024-06-02T04:51:04.710 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.702+0000 7fa211f4cb80 1 -- 172.21.15.76:0/3530906702 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b9afb29a80 msgr2=0x55b9afb29ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:51:04.710 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.702+0000 7fa211f4cb80 1 --2- 172.21.15.76:0/3530906702 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b9afb29a80 0x55b9afb29ea0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fa1f00a3730 tx=0x7fa1f000aee0 comp rx=0 tx=0).stop 2024-06-02T04:51:04.710 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.702+0000 7fa211f4cb80 1 -- 172.21.15.76:0/3530906702 shutdown_connections 2024-06-02T04:51:04.710 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.702+0000 7fa211f4cb80 1 --2- 172.21.15.76:0/3530906702 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b9afb2b2d0 0x55b9afb2b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:04.710 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.702+0000 7fa211f4cb80 1 --2- 172.21.15.76:0/3530906702 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b9afb29a80 0x55b9afb29ea0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:04.711 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.702+0000 7fa211f4cb80 1 --2- 172.21.15.76:0/3530906702 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b9afb2a3e0 0x55b9afb2acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:04.711 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.702+0000 7fa211f4cb80 1 -- 172.21.15.76:0/3530906702 >> 172.21.15.76:0/3530906702 conn(0x55b9afa881b0 msgr2=0x55b9afb26440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:51:04.711 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.703+0000 7fa211f4cb80 1 -- 172.21.15.76:0/3530906702 shutdown_connections 2024-06-02T04:51:04.711 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.703+0000 7fa211f4cb80 1 -- 172.21.15.76:0/3530906702 wait complete. 2024-06-02T04:51:04.711 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.703+0000 7fa211f4cb80 1 -- start start 2024-06-02T04:51:04.711 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.703+0000 7fa211f4cb80 1 Processor -- start 2024-06-02T04:51:04.711 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.704+0000 7fa211f4cb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b9afb29a80 0x55b9afb3be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:51:04.711 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.704+0000 7fa211f4cb80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b9afb2a3e0 0x55b9afb3c360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:51:04.711 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.704+0000 7fa211f4cb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b9afb2b2d0 0x55b9afb433a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:51:04.711 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.704+0000 7fa211f4cb80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9afa16500 con 0x55b9afb2a3e0 2024-06-02T04:51:04.711 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.704+0000 7fa211f4cb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9afa161a0 con 0x55b9afb2b2d0 2024-06-02T04:51:04.711 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.704+0000 7fa211f4cb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9af8fd640 con 0x55b9afb29a80 2024-06-02T04:51:04.712 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.704+0000 7fa211f4cb80 10 client.0 _ll_register_callbacks cb 0x55b9afa1fad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:51:04.712 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.704+0000 7fa1ff7fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b9afb29a80 0x55b9afb3be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:51:04.712 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.704+0000 7fa1f7fff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b9afb2a3e0 0x55b9afb3c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:51:04.712 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.704+0000 7fa1f7fff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b9afb2a3e0 0x55b9afb3c360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:47884/0 (socket says 172.21.15.76:47884) 2024-06-02T04:51:04.712 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.704+0000 7fa1f7fff700 1 -- 172.21.15.76:0/2015405271 learned_addr learned my addr 172.21.15.76:0/2015405271 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:51:04.712 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.704+0000 7fa1fffff700 1 --2- 172.21.15.76:0/2015405271 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b9afb2b2d0 0x55b9afb433a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:51:04.712 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.704+0000 7fa1fffff700 1 -- 172.21.15.76:0/2015405271 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b9afb29a80 msgr2=0x55b9afb3be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:51:04.712 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.704+0000 7fa1fffff700 1 --2- 172.21.15.76:0/2015405271 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b9afb29a80 0x55b9afb3be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:04.712 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.705+0000 7fa1fffff700 1 -- 172.21.15.76:0/2015405271 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b9afb2a3e0 msgr2=0x55b9afb3c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:51:04.712 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.705+0000 7fa1fffff700 1 --2- 172.21.15.76:0/2015405271 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b9afb2a3e0 0x55b9afb3c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:04.712 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.705+0000 7fa1fffff700 1 -- 172.21.15.76:0/2015405271 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2001aa200 con 0x55b9afb2b2d0 2024-06-02T04:51:04.712 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.705+0000 7fa1fffff700 1 --2- 172.21.15.76:0/2015405271 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b9afb2b2d0 0x55b9afb433a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x55b9afb2aab0 tx=0x7fa1f8004320 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c3fe027422b16b0f server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:51:04.712 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.705+0000 7fa1deffd700 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-06-02T04:51:04.713 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.705+0000 7fa1deffd700 1 -- 172.21.15.76:0/2015405271 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f8009e80 con 0x55b9afb2b2d0 2024-06-02T04:51:04.713 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.705+0000 7fa1deffd700 1 -- 172.21.15.76:0/2015405271 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7fa1f8004bb0 con 0x55b9afb2b2d0 2024-06-02T04:51:04.713 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.705+0000 7fa211f4cb80 1 -- 172.21.15.76:0/2015405271 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b9af9d3210 con 0x55b9afb2b2d0 2024-06-02T04:51:04.713 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.705+0000 7fa1deffd700 1 -- 172.21.15.76:0/2015405271 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa1f8004d70 con 0x55b9afb2b2d0 2024-06-02T04:51:04.713 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.705+0000 7fa211f4cb80 10 client.25412 fetch_fsmap learned FSMap version 29 2024-06-02T04:51:04.713 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.705+0000 7fa211f4cb80 1 -- 172.21.15.76:0/2015405271 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55b9af8a7b00 con 0x55b9afb2b2d0 2024-06-02T04:51:04.713 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.706+0000 7fa1deffd700 1 -- 172.21.15.76:0/2015405271 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b9af9d3210 con 0x55b9afb2b2d0 2024-06-02T04:51:04.713 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.706+0000 7fa1deffd700 1 -- 172.21.15.76:0/2015405271 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 29) v1 ==== 7482+0+0 (secure 0 0 0) 0x7fa1f8014070 con 0x55b9afb2b2d0 2024-06-02T04:51:04.715 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.707+0000 7fa211f4cb80 10 client.25412 fetch_fsmap finished waiting for FSMap version 29 2024-06-02T04:51:04.715 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.707+0000 7fa211f4cb80 10 client.25412 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T04:51:04.715 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.707+0000 7fa211f4cb80 20 client.25412 populate_metadata read hostname 'smithi076' 2024-06-02T04:51:04.715 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.707+0000 7fa211f4cb80 1 --2- 172.21.15.76:0/2015405271 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55b9afb376c0 0x55b9afb39ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:51:04.715 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.707+0000 7fa211f4cb80 4 client.25412 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T04:51:04.716 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.707+0000 7fa211f4cb80 1 -- 172.21.15.76:0/2015405271 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b9afaf97b0 con 0x55b9afb376c0 2024-06-02T04:51:04.716 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.707+0000 7fa1ff7fe700 1 --2- 172.21.15.76:0/2015405271 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55b9afb376c0 0x55b9afb39ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:51:04.716 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.708+0000 7fa1ff7fe700 1 --2- 172.21.15.76:0/2015405271 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55b9afb376c0 0x55b9afb39ae0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fcb5ee07a568bbab server_cookie=e95707127bca4455 in_seq=0 out_seq=0 2024-06-02T04:51:04.716 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.708+0000 7fa1deffd700 10 client.25412 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:51:04.716 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.708+0000 7fa1deffd700 1 -- 172.21.15.76:0/2015405271 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55b9afaf97b0 con 0x55b9afb376c0 2024-06-02T04:51:04.716 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.708+0000 7fa1deffd700 10 client.25412 handle_command_reply: tid=0 2024-06-02T04:51:04.716 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.709+0000 7fa211f4cb80 1 client.25412 shutdown 2024-06-02T04:51:04.716 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.709+0000 7fa211f4cb80 1 -- 172.21.15.76:0/2015405271 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b9afb2b2d0 msgr2=0x55b9afb433a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:51:04.716 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.709+0000 7fa211f4cb80 1 --2- 172.21.15.76:0/2015405271 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b9afb2b2d0 0x55b9afb433a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x55b9afb2aab0 tx=0x7fa1f8004320 comp rx=0 tx=0).stop 2024-06-02T04:51:04.716 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.709+0000 7fa211f4cb80 1 -- 172.21.15.76:0/2015405271 shutdown_connections 2024-06-02T04:51:04.716 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.709+0000 7fa211f4cb80 1 --2- 172.21.15.76:0/2015405271 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55b9afb376c0 0x55b9afb39ae0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:04.716 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.709+0000 7fa211f4cb80 1 --2- 172.21.15.76:0/2015405271 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b9afb2b2d0 0x55b9afb433a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:04.716 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.709+0000 7fa211f4cb80 1 --2- 172.21.15.76:0/2015405271 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b9afb29a80 0x55b9afb3be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:04.717 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.709+0000 7fa211f4cb80 1 --2- 172.21.15.76:0/2015405271 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b9afb2a3e0 0x55b9afb3c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:04.717 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.709+0000 7fa211f4cb80 1 -- 172.21.15.76:0/2015405271 >> 172.21.15.76:0/2015405271 conn(0x55b9afa881b0 msgr2=0x55b9afb24860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:51:04.717 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.709+0000 7fa1deffd700 0 client.25412 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:51:04.717 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.709+0000 7fa211f4cb80 1 -- 172.21.15.76:0/2015405271 shutdown_connections 2024-06-02T04:51:04.717 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.709+0000 7fa211f4cb80 1 -- 172.21.15.76:0/2015405271 wait complete. 2024-06-02T04:51:04.717 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.710+0000 7fa211f4cb80 20 client.25412 trim_cache size 0 max 16384 2024-06-02T04:51:04.739 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.736+0000 7fa211f4cb80 1 Processor -- start 2024-06-02T04:51:04.739 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.737+0000 7fa211f4cb80 1 -- start start 2024-06-02T04:51:04.739 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.737+0000 7fa211f4cb80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b9afb29a80 0x55b9afb33ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:51:04.740 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.737+0000 7fa211f4cb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b9afb2a3e0 0x55b9afb432c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:51:04.740 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.737+0000 7fa211f4cb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b9afb2b2d0 0x55b9afb2b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:51:04.740 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.737+0000 7fa211f4cb80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9afb2b180 con 0x55b9afb29a80 2024-06-02T04:51:04.740 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.737+0000 7fa211f4cb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9afb3cd50 con 0x55b9afb2b2d0 2024-06-02T04:51:04.740 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.737+0000 7fa211f4cb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9afb34980 con 0x55b9afb2a3e0 2024-06-02T04:51:04.740 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.737+0000 7fa1fffff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b9afb2b2d0 0x55b9afb2b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:51:04.740 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.737+0000 7fa1fffff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b9afb2b2d0 0x55b9afb2b6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:52282/0 (socket says 172.21.15.76:52282) 2024-06-02T04:51:04.740 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.737+0000 7fa1fffff700 1 -- 172.21.15.76:0/3894340112 learned_addr learned my addr 172.21.15.76:0/3894340112 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:51:04.740 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.737+0000 7fa1f7fff700 1 --2- 172.21.15.76:0/3894340112 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b9afb2a3e0 0x55b9afb432c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:51:04.741 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.737+0000 7fa1fffff700 1 -- 172.21.15.76:0/3894340112 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b9afb2a3e0 msgr2=0x55b9afb432c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:51:04.741 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.737+0000 7fa1fffff700 1 --2- 172.21.15.76:0/3894340112 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b9afb2a3e0 0x55b9afb432c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:04.741 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.737+0000 7fa1fffff700 1 -- 172.21.15.76:0/3894340112 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b9afb29a80 msgr2=0x55b9afb33ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:51:04.741 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.737+0000 7fa1fffff700 1 --2- 172.21.15.76:0/3894340112 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b9afb29a80 0x55b9afb33ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:04.741 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.737+0000 7fa1fffff700 1 -- 172.21.15.76:0/3894340112 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b9afa40500 con 0x55b9afb2b2d0 2024-06-02T04:51:04.741 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.738+0000 7fa1fffff700 1 --2- 172.21.15.76:0/3894340112 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b9afb2b2d0 0x55b9afb2b6b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa1f8005b40 tx=0x7fa1f8005b70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a24d07f4d5591dd8 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:51:04.741 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.738+0000 7fa1f67fc700 1 -- 172.21.15.76:0/3894340112 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f801eb10 con 0x55b9afb2b2d0 2024-06-02T04:51:04.741 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.738+0000 7fa1f67fc700 1 -- 172.21.15.76:0/3894340112 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa1f800f070 con 0x55b9afb2b2d0 2024-06-02T04:51:04.741 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.738+0000 7fa1f67fc700 1 -- 172.21.15.76:0/3894340112 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f8007aa0 con 0x55b9afb2b2d0 2024-06-02T04:51:04.742 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.739+0000 7fa211f4cb80 1 -- 172.21.15.76:0/3894340112 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b9afb2b2d0 msgr2=0x55b9afb2b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:51:04.742 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.739+0000 7fa211f4cb80 1 --2- 172.21.15.76:0/3894340112 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b9afb2b2d0 0x55b9afb2b6b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa1f8005b40 tx=0x7fa1f8005b70 comp rx=0 tx=0).stop 2024-06-02T04:51:04.742 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.739+0000 7fa211f4cb80 1 -- 172.21.15.76:0/3894340112 shutdown_connections 2024-06-02T04:51:04.742 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.739+0000 7fa211f4cb80 1 --2- 172.21.15.76:0/3894340112 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b9afb2b2d0 0x55b9afb2b6b0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:04.743 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.739+0000 7fa211f4cb80 1 --2- 172.21.15.76:0/3894340112 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b9afb29a80 0x55b9afb33ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:04.743 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.739+0000 7fa211f4cb80 1 --2- 172.21.15.76:0/3894340112 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b9afb2a3e0 0x55b9afb432c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:04.743 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.739+0000 7fa211f4cb80 1 -- 172.21.15.76:0/3894340112 >> 172.21.15.76:0/3894340112 conn(0x55b9afa881b0 msgr2=0x55b9afb31810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:51:04.743 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.742+0000 7fa211f4cb80 1 -- 172.21.15.76:0/3894340112 shutdown_connections 2024-06-02T04:51:04.744 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.742+0000 7fa211f4cb80 1 -- 172.21.15.76:0/3894340112 wait complete. 2024-06-02T04:51:04.744 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.743+0000 7fa211f4cb80 1 -- start start 2024-06-02T04:51:04.744 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.743+0000 7fa211f4cb80 1 Processor -- start 2024-06-02T04:51:04.745 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.743+0000 7fa211f4cb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b9afb29a80 0x55b9afb412b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:51:04.745 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.743+0000 7fa211f4cb80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b9afb2a3e0 0x55b9afba2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:51:04.745 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.743+0000 7fa211f4cb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b9afb2b2d0 0x55b9afba45a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:51:04.745 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.743+0000 7fa211f4cb80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9afba4c40 con 0x55b9afb2a3e0 2024-06-02T04:51:04.745 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.743+0000 7fa211f4cb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9afba4db0 con 0x55b9afb2b2d0 2024-06-02T04:51:04.745 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.743+0000 7fa211f4cb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9afba4f70 con 0x55b9afb29a80 2024-06-02T04:51:04.745 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.743+0000 7fa211f4cb80 10 client.0 _ll_register_callbacks cb 0x55b9afa1fad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:51:04.745 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.744+0000 7fa1ff7fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b9afb29a80 0x55b9afb412b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:51:04.746 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.744+0000 7fa1fffff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b9afb2b2d0 0x55b9afba45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:51:04.746 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.744+0000 7fa1fffff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b9afb2b2d0 0x55b9afba45a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:52298/0 (socket says 172.21.15.76:52298) 2024-06-02T04:51:04.746 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.744+0000 7fa1ff7fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b9afb29a80 0x55b9afb412b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:41804/0 (socket says 172.21.15.76:41804) 2024-06-02T04:51:04.746 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.744+0000 7fa1fffff700 1 -- 172.21.15.76:0/4241530665 learned_addr learned my addr 172.21.15.76:0/4241530665 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:51:04.747 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.744+0000 7fa1fffff700 1 -- 172.21.15.76:0/4241530665 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b9afb29a80 msgr2=0x55b9afb412b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:51:04.747 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.744+0000 7fa1fffff700 1 --2- 172.21.15.76:0/4241530665 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b9afb29a80 0x55b9afb412b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:04.747 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.744+0000 7fa1fffff700 1 -- 172.21.15.76:0/4241530665 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b9afb2a3e0 msgr2=0x55b9afba2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:51:04.747 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.744+0000 7fa1fffff700 1 --2- 172.21.15.76:0/4241530665 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b9afb2a3e0 0x55b9afba2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:04.747 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.744+0000 7fa1fffff700 1 -- 172.21.15.76:0/4241530665 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b9af8a7b00 con 0x55b9afb2b2d0 2024-06-02T04:51:04.747 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.744+0000 7fa1fffff700 1 --2- 172.21.15.76:0/4241530665 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b9afb2b2d0 0x55b9afba45a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa1f800c040 tx=0x7fa1f801e930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a65461e2c27deac6 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:51:04.749 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.748+0000 7fa1deffd700 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-06-02T04:51:04.749 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.748+0000 7fa1deffd700 1 -- 172.21.15.76:0/4241530665 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f801e640 con 0x55b9afb2b2d0 2024-06-02T04:51:04.749 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.748+0000 7fa1deffd700 1 -- 172.21.15.76:0/4241530665 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7fa1f801eb10 con 0x55b9afb2b2d0 2024-06-02T04:51:04.750 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.748+0000 7fa211f4cb80 1 -- 172.21.15.76:0/4241530665 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa1f009f6a0 con 0x55b9afb2b2d0 2024-06-02T04:51:04.750 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.748+0000 7fa1deffd700 1 -- 172.21.15.76:0/4241530665 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa1f801ecd0 con 0x55b9afb2b2d0 2024-06-02T04:51:04.750 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.748+0000 7fa211f4cb80 10 client.25418 fetch_fsmap learned FSMap version 29 2024-06-02T04:51:04.750 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.748+0000 7fa211f4cb80 1 -- 172.21.15.76:0/4241530665 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55b9af8ffc70 con 0x55b9afb2b2d0 2024-06-02T04:51:04.754 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.753+0000 7fa1deffd700 1 -- 172.21.15.76:0/4241530665 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa1f009f6a0 con 0x55b9afb2b2d0 2024-06-02T04:51:04.755 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.753+0000 7fa1deffd700 1 -- 172.21.15.76:0/4241530665 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 29) v1 ==== 7482+0+0 (secure 0 0 0) 0x7fa1f8014070 con 0x55b9afb2b2d0 2024-06-02T04:51:04.755 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.753+0000 7fa211f4cb80 10 client.25418 fetch_fsmap finished waiting for FSMap version 29 2024-06-02T04:51:04.755 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.753+0000 7fa211f4cb80 10 client.25418 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T04:51:04.755 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.753+0000 7fa211f4cb80 20 client.25418 populate_metadata read hostname 'smithi076' 2024-06-02T04:51:04.755 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.753+0000 7fa211f4cb80 1 --2- 172.21.15.76:0/4241530665 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55b9afba6700 0x55b9afba8b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:51:04.755 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.753+0000 7fa211f4cb80 4 client.25418 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T04:51:04.755 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.753+0000 7fa211f4cb80 1 -- 172.21.15.76:0/4241530665 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55b9afa72e60 con 0x55b9afba6700 2024-06-02T04:51:04.756 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.754+0000 7fa1ff7fe700 1 --2- 172.21.15.76:0/4241530665 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55b9afba6700 0x55b9afba8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:51:04.756 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.754+0000 7fa1ff7fe700 1 --2- 172.21.15.76:0/4241530665 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55b9afba6700 0x55b9afba8b20 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=607fce144b677902 server_cookie=c6013e29df2e9016 in_seq=0 out_seq=0 2024-06-02T04:51:04.756 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.754+0000 7fa1deffd700 10 client.25418 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:51:04.790 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.789+0000 7fa1deffd700 1 -- 172.21.15.76:0/4241530665 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55b9afa72e60 con 0x55b9afba6700 2024-06-02T04:51:04.791 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.789+0000 7fa1deffd700 10 client.25418 handle_command_reply: tid=0 2024-06-02T04:51:04.791 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.789+0000 7fa211f4cb80 1 client.25418 shutdown 2024-06-02T04:51:04.800 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.793+0000 7fa211f4cb80 1 -- 172.21.15.76:0/4241530665 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b9afb2b2d0 msgr2=0x55b9afba45a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:51:04.800 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.793+0000 7fa211f4cb80 1 --2- 172.21.15.76:0/4241530665 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b9afb2b2d0 0x55b9afba45a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa1f800c040 tx=0x7fa1f801e930 comp rx=0 tx=0).stop 2024-06-02T04:51:04.801 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.796+0000 7fa211f4cb80 1 -- 172.21.15.76:0/4241530665 shutdown_connections 2024-06-02T04:51:04.801 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.796+0000 7fa211f4cb80 1 --2- 172.21.15.76:0/4241530665 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55b9afba6700 0x55b9afba8b20 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:04.801 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.796+0000 7fa211f4cb80 1 --2- 172.21.15.76:0/4241530665 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b9afb2b2d0 0x55b9afba45a0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:04.801 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.796+0000 7fa211f4cb80 1 --2- 172.21.15.76:0/4241530665 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b9afb29a80 0x55b9afb412b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:04.801 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.796+0000 7fa211f4cb80 1 --2- 172.21.15.76:0/4241530665 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b9afb2a3e0 0x55b9afba2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:04.801 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.796+0000 7fa211f4cb80 1 -- 172.21.15.76:0/4241530665 >> 172.21.15.76:0/4241530665 conn(0x55b9afa881b0 msgr2=0x55b9afb327d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:51:04.801 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.799+0000 7fa1deffd700 0 client.25418 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:51:04.801 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.799+0000 7fa211f4cb80 1 -- 172.21.15.76:0/4241530665 shutdown_connections 2024-06-02T04:51:04.801 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.800+0000 7fa211f4cb80 1 -- 172.21.15.76:0/4241530665 wait complete. 2024-06-02T04:51:04.803 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.802+0000 7fa211f4cb80 20 client.25418 trim_cache size 0 max 16384 2024-06-02T04:51:04.804 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:{ 2024-06-02T04:51:04.804 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "message": "", 2024-06-02T04:51:04.804 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "return_code": 0 2024-06-02T04:51:04.804 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:} 2024-06-02T04:51:04.805 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.803+0000 7fa205d91700 1 -- 172.21.15.76:0/4222348355 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fa1ec0a11a0 msgr2=0x7fa1ec0a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:51:04.805 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.803+0000 7fa205d91700 1 --2- 172.21.15.76:0/4222348355 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fa1ec0a11a0 0x7fa1ec0a3660 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fa1e8009c60 tx=0x7fa1e8009260 comp rx=0 tx=0).stop 2024-06-02T04:51:04.805 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.803+0000 7fa205d91700 1 -- 172.21.15.76:0/4222348355 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa200107fa0 msgr2=0x7fa2001a1a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:51:04.805 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.803+0000 7fa205d91700 1 --2- 172.21.15.76:0/4222348355 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa200107fa0 0x7fa2001a1a30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa1f0000c00 tx=0x7fa1f0003d10 comp rx=0 tx=0).stop 2024-06-02T04:51:04.805 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.803+0000 7fa205d91700 1 -- 172.21.15.76:0/4222348355 shutdown_connections 2024-06-02T04:51:04.805 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.803+0000 7fa205d91700 1 --2- 172.21.15.76:0/4222348355 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa2001a6f80 0x7fa2001a9370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:04.805 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.803+0000 7fa205d91700 1 --2- 172.21.15.76:0/4222348355 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa200107fa0 0x7fa2001a1a30 secure :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa1f0000c00 tx=0x7fa1f0003d10 comp rx=0 tx=0).stop 2024-06-02T04:51:04.805 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.803+0000 7fa205d91700 1 --2- 172.21.15.76:0/4222348355 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fa1ec0a11a0 0x7fa1ec0a3660 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:04.805 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.803+0000 7fa205d91700 1 --2- 172.21.15.76:0/4222348355 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa200108940 0x7fa2001a1f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:04.806 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.803+0000 7fa205d91700 1 -- 172.21.15.76:0/4222348355 >> 172.21.15.76:0/4222348355 conn(0x7fa20006df30 msgr2=0x7fa20010c5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:51:04.806 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.803+0000 7fa205d91700 1 -- 172.21.15.76:0/4222348355 shutdown_connections 2024-06-02T04:51:04.806 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:04.804+0000 7fa205d91700 1 -- 172.21.15.76:0/4222348355 wait complete. 2024-06-02T04:51:05.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:51:05 smithi119 ceph-mon[46633]: pgmap v313: 129 pgs: 129 active+clean; 1.0 GiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 31 MiB/s wr, 292 op/s 2024-06-02T04:51:05.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:51:05 smithi192 ceph-mon[47933]: pgmap v313: 129 pgs: 129 active+clean; 1.0 GiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 31 MiB/s wr, 292 op/s 2024-06-02T04:51:05.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:51:05 smithi076 ceph-mon[42935]: pgmap v313: 129 pgs: 129 active+clean; 1.0 GiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 31 MiB/s wr, 292 op/s 2024-06-02T04:51:06.314 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 15.0 s, 937.6 tps, lat 106.237 ms stddev 148.249 2024-06-02T04:51:07.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:51:07 smithi119 ceph-mon[46633]: pgmap v314: 129 pgs: 129 active+clean; 1.0 GiB data, 939 MiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 32 MiB/s wr, 454 op/s 2024-06-02T04:51:07.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:51:07 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:51:07.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:51:07 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:51:07.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:51:07 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:51:07.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:51:07 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:51:07.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:51:07 smithi192 ceph-mon[47933]: pgmap v314: 129 pgs: 129 active+clean; 1.0 GiB data, 939 MiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 32 MiB/s wr, 454 op/s 2024-06-02T04:51:07.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:51:07 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:51:07.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:51:07 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:51:07.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:51:07 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:51:07.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:51:07 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:51:07.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:51:07 smithi076 ceph-mon[42935]: pgmap v314: 129 pgs: 129 active+clean; 1.0 GiB data, 939 MiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 32 MiB/s wr, 454 op/s 2024-06-02T04:51:07.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:51:07 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:51:07.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:51:07 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:51:07.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:51:07 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:51:07.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:51:07 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:51:09.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:51:09 smithi119 ceph-mon[46633]: pgmap v315: 129 pgs: 129 active+clean; 1.0 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 30 MiB/s wr, 627 op/s 2024-06-02T04:51:09.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:51:09 smithi192 ceph-mon[47933]: pgmap v315: 129 pgs: 129 active+clean; 1.0 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 30 MiB/s wr, 627 op/s 2024-06-02T04:51:09.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:51:09 smithi076 ceph-mon[42935]: pgmap v315: 129 pgs: 129 active+clean; 1.0 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 30 MiB/s wr, 627 op/s 2024-06-02T04:51:11.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 20.0 s, 914.0 tps, lat 109.665 ms stddev 153.634 2024-06-02T04:51:11.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:51:11 smithi119 ceph-mon[46633]: pgmap v316: 129 pgs: 129 active+clean; 1.1 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 25 MiB/s wr, 662 op/s 2024-06-02T04:51:11.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:51:11 smithi192 ceph-mon[47933]: pgmap v316: 129 pgs: 129 active+clean; 1.1 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 25 MiB/s wr, 662 op/s 2024-06-02T04:51:11.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:51:11 smithi076 ceph-mon[42935]: pgmap v316: 129 pgs: 129 active+clean; 1.1 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 25 MiB/s wr, 662 op/s 2024-06-02T04:51:13.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:51:13 smithi119 ceph-mon[46633]: pgmap v317: 129 pgs: 129 active+clean; 1.1 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 30 MiB/s wr, 942 op/s 2024-06-02T04:51:13.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:51:13 smithi192 ceph-mon[47933]: pgmap v317: 129 pgs: 129 active+clean; 1.1 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 30 MiB/s wr, 942 op/s 2024-06-02T04:51:13.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:51:13 smithi076 ceph-mon[42935]: pgmap v317: 129 pgs: 129 active+clean; 1.1 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 30 MiB/s wr, 942 op/s 2024-06-02T04:51:15.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:51:15 smithi119 ceph-mon[46633]: pgmap v318: 129 pgs: 129 active+clean; 1.1 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 22 MiB/s wr, 931 op/s 2024-06-02T04:51:15.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:51:15 smithi192 ceph-mon[47933]: pgmap v318: 129 pgs: 129 active+clean; 1.1 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 22 MiB/s wr, 931 op/s 2024-06-02T04:51:15.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:51:15 smithi076 ceph-mon[42935]: pgmap v318: 129 pgs: 129 active+clean; 1.1 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 22 MiB/s wr, 931 op/s 2024-06-02T04:51:16.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 25.0 s, 935.8 tps, lat 106.642 ms stddev 147.257 2024-06-02T04:51:17.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:51:17 smithi119 ceph-mon[46633]: pgmap v319: 129 pgs: 129 active+clean; 1.1 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 23 MiB/s wr, 1.12k op/s 2024-06-02T04:51:17.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:51:17 smithi192 ceph-mon[47933]: pgmap v319: 129 pgs: 129 active+clean; 1.1 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 23 MiB/s wr, 1.12k op/s 2024-06-02T04:51:17.736 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:51:17 smithi076 ceph-mon[42935]: pgmap v319: 129 pgs: 129 active+clean; 1.1 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 23 MiB/s wr, 1.12k op/s 2024-06-02T04:51:17.947 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.946+0000 7f474ba0c700 1 -- 172.21.15.76:0/4263230749 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4744102a30 msgr2=0x7f4744109350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:51:17.947 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.946+0000 7f474ba0c700 1 --2- 172.21.15.76:0/4263230749 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4744102a30 0x7f4744109350 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f473c00b0a0 tx=0x7f473c00b3b0 comp rx=0 tx=0).stop 2024-06-02T04:51:17.947 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.946+0000 7f474ba0c700 1 -- 172.21.15.76:0/4263230749 shutdown_connections 2024-06-02T04:51:17.947 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.946+0000 7f474ba0c700 1 --2- 172.21.15.76:0/4263230749 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4744102a30 0x7f4744109350 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:17.947 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.946+0000 7f474ba0c700 1 --2- 172.21.15.76:0/4263230749 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4744100f20 0x7f4744101340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:17.947 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.946+0000 7f474ba0c700 1 --2- 172.21.15.76:0/4263230749 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4744102070 0x7f47441024f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:17.947 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.946+0000 7f474ba0c700 1 -- 172.21.15.76:0/4263230749 >> 172.21.15.76:0/4263230749 conn(0x7f47440fc490 msgr2=0x7f47440fe8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:51:17.947 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.946+0000 7f474ba0c700 1 -- 172.21.15.76:0/4263230749 shutdown_connections 2024-06-02T04:51:17.947 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.946+0000 7f474ba0c700 1 -- 172.21.15.76:0/4263230749 wait complete. 2024-06-02T04:51:17.952 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.947+0000 7f474ba0c700 1 Processor -- start 2024-06-02T04:51:17.952 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.947+0000 7f474ba0c700 1 -- start start 2024-06-02T04:51:17.952 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.947+0000 7f474ba0c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4744100f20 0x7f4744074d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:51:17.952 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.947+0000 7f474ba0c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4744102070 0x7f4744073390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:51:17.952 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.947+0000 7f474ba0c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4744102a30 0x7f47440738d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:51:17.952 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.947+0000 7f474ba0c700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4744074070 con 0x7f4744102a30 2024-06-02T04:51:17.952 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.947+0000 7f474ba0c700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47440741e0 con 0x7f4744100f20 2024-06-02T04:51:17.952 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.947+0000 7f474ba0c700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47441a0f30 con 0x7f4744102070 2024-06-02T04:51:17.952 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.947+0000 7f4749fa9700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4744102a30 0x7f47440738d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:51:17.952 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.947+0000 7f4749fa9700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4744102a30 0x7f47440738d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:55920/0 (socket says 172.21.15.76:55920) 2024-06-02T04:51:17.952 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.947+0000 7f4749fa9700 1 -- 172.21.15.76:0/997020951 learned_addr learned my addr 172.21.15.76:0/997020951 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:51:17.953 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.947+0000 7f47497a8700 1 --2- 172.21.15.76:0/997020951 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4744100f20 0x7f4744074d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:51:17.953 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.947+0000 7f4748fa7700 1 --2- 172.21.15.76:0/997020951 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4744102070 0x7f4744073390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:51:17.953 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.948+0000 7f4749fa9700 1 -- 172.21.15.76:0/997020951 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4744102070 msgr2=0x7f4744073390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:51:17.953 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.948+0000 7f4749fa9700 1 --2- 172.21.15.76:0/997020951 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4744102070 0x7f4744073390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:17.953 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.948+0000 7f4749fa9700 1 -- 172.21.15.76:0/997020951 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4744100f20 msgr2=0x7f4744074d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:51:17.953 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.948+0000 7f4749fa9700 1 --2- 172.21.15.76:0/997020951 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4744100f20 0x7f4744074d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:17.953 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.948+0000 7f4749fa9700 1 -- 172.21.15.76:0/997020951 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f473c009d00 con 0x7f4744102a30 2024-06-02T04:51:17.953 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.948+0000 7f4749fa9700 1 --2- 172.21.15.76:0/997020951 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4744102a30 0x7f47440738d0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f473c007950 tx=0x7f473c007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:51:17.953 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.948+0000 7f473a7fc700 1 -- 172.21.15.76:0/997020951 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f473c00e040 con 0x7f4744102a30 2024-06-02T04:51:17.953 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.948+0000 7f473a7fc700 1 -- 172.21.15.76:0/997020951 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f473c004c50 con 0x7f4744102a30 2024-06-02T04:51:17.953 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.948+0000 7f474ba0c700 1 -- 172.21.15.76:0/997020951 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47441a1160 con 0x7f4744102a30 2024-06-02T04:51:17.953 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.948+0000 7f473a7fc700 1 -- 172.21.15.76:0/997020951 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f473c005040 con 0x7f4744102a30 2024-06-02T04:51:17.953 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.948+0000 7f474ba0c700 1 -- 172.21.15.76:0/997020951 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47441a1580 con 0x7f4744102a30 2024-06-02T04:51:17.954 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.950+0000 7f473a7fc700 1 -- 172.21.15.76:0/997020951 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f473c01d470 con 0x7f4744102a30 2024-06-02T04:51:17.954 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.951+0000 7f473a7fc700 1 --2- 172.21.15.76:0/997020951 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f47300a11a0 0x7f47300a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:51:17.954 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.951+0000 7f47497a8700 1 --2- 172.21.15.76:0/997020951 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f47300a11a0 0x7f47300a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:51:17.954 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.951+0000 7f473a7fc700 1 -- 172.21.15.76:0/997020951 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f473c0ce1a0 con 0x7f4744102a30 2024-06-02T04:51:17.954 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.951+0000 7f47497a8700 1 --2- 172.21.15.76:0/997020951 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f47300a11a0 0x7f47300a3660 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f4740009c60 tx=0x7f4740009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:51:17.959 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.952+0000 7f4757bc7b80 1 Processor -- start 2024-06-02T04:51:17.959 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.952+0000 7f4757bc7b80 1 -- start start 2024-06-02T04:51:17.959 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.953+0000 7f4757bc7b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562638bc9a80 0x562638bc9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:51:17.959 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.953+0000 7f4757bc7b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562638bca3e0 0x562638bcacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:51:17.959 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.953+0000 7f4757bc7b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562638bcb2d0 0x562638bcb750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:51:17.960 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.953+0000 7f4757bc7b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x562638b210f0 con 0x562638bc9a80 2024-06-02T04:51:17.960 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.953+0000 7f4757bc7b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x562638b1eab0 con 0x562638bca3e0 2024-06-02T04:51:17.960 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.953+0000 7f4757bc7b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x562638b1a3a0 con 0x562638bcb2d0 2024-06-02T04:51:17.960 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.953+0000 7f47497a8700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562638bc9a80 0x562638bc9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:51:17.960 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.953+0000 7f47497a8700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562638bc9a80 0x562638bc9ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:55928/0 (socket says 172.21.15.76:55928) 2024-06-02T04:51:17.960 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.953+0000 7f47497a8700 1 -- 172.21.15.76:0/1876280909 learned_addr learned my addr 172.21.15.76:0/1876280909 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:51:17.960 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.953+0000 7f4748fa7700 1 --2- 172.21.15.76:0/1876280909 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562638bca3e0 0x562638bcacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:51:17.960 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.953+0000 7f4749fa9700 1 --2- 172.21.15.76:0/1876280909 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562638bcb2d0 0x562638bcb750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:51:17.961 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.953+0000 7f47497a8700 1 -- 172.21.15.76:0/1876280909 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562638bcb2d0 msgr2=0x562638bcb750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:51:17.961 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.953+0000 7f47497a8700 1 --2- 172.21.15.76:0/1876280909 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562638bcb2d0 0x562638bcb750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:17.961 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.953+0000 7f47497a8700 1 -- 172.21.15.76:0/1876280909 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562638bca3e0 msgr2=0x562638bcacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:51:17.961 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.953+0000 7f47497a8700 1 --2- 172.21.15.76:0/1876280909 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562638bca3e0 0x562638bcacf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:17.961 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.953+0000 7f47497a8700 1 -- 172.21.15.76:0/1876280909 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56263899b350 con 0x562638bc9a80 2024-06-02T04:51:17.961 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.953+0000 7f4749fa9700 1 --2- 172.21.15.76:0/1876280909 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562638bcb2d0 0x562638bcb750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:51:17.961 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.953+0000 7f4748fa7700 1 --2- 172.21.15.76:0/1876280909 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562638bca3e0 0x562638bcacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:51:17.961 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.953+0000 7f47497a8700 1 --2- 172.21.15.76:0/1876280909 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562638bc9a80 0x562638bc9ea0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f474000e4e0 tx=0x7f4740014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a78693534a4cc805 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:51:17.961 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.953+0000 7f472f7fe700 1 -- 172.21.15.76:0/1876280909 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4740026430 con 0x562638bc9a80 2024-06-02T04:51:17.961 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.953+0000 7f472f7fe700 1 -- 172.21.15.76:0/1876280909 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4740021070 con 0x562638bc9a80 2024-06-02T04:51:17.961 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.953+0000 7f472f7fe700 1 -- 172.21.15.76:0/1876280909 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f474001d630 con 0x562638bc9a80 2024-06-02T04:51:17.961 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.954+0000 7f4757bc7b80 1 -- 172.21.15.76:0/1876280909 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562638bc9a80 msgr2=0x562638bc9ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:51:17.962 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.954+0000 7f4757bc7b80 1 --2- 172.21.15.76:0/1876280909 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562638bc9a80 0x562638bc9ea0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f474000e4e0 tx=0x7f4740014000 comp rx=0 tx=0).stop 2024-06-02T04:51:17.962 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.954+0000 7f4757bc7b80 1 -- 172.21.15.76:0/1876280909 shutdown_connections 2024-06-02T04:51:17.962 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.954+0000 7f4757bc7b80 1 --2- 172.21.15.76:0/1876280909 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562638bcb2d0 0x562638bcb750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:17.962 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.954+0000 7f4757bc7b80 1 --2- 172.21.15.76:0/1876280909 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562638bc9a80 0x562638bc9ea0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:17.962 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.954+0000 7f4757bc7b80 1 --2- 172.21.15.76:0/1876280909 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562638bca3e0 0x562638bcacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:17.962 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.954+0000 7f4757bc7b80 1 -- 172.21.15.76:0/1876280909 >> 172.21.15.76:0/1876280909 conn(0x562638b281b0 msgr2=0x562638bc6440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:51:17.962 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.954+0000 7f4757bc7b80 1 -- 172.21.15.76:0/1876280909 shutdown_connections 2024-06-02T04:51:17.962 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.954+0000 7f4757bc7b80 1 -- 172.21.15.76:0/1876280909 wait complete. 2024-06-02T04:51:17.962 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.955+0000 7f4757bc7b80 1 -- start start 2024-06-02T04:51:17.962 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.955+0000 7f4757bc7b80 1 Processor -- start 2024-06-02T04:51:17.963 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.955+0000 7f4757bc7b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562638bc9a80 0x562638bd38c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:51:17.963 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.955+0000 7f4757bc7b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562638bca3e0 0x562638bd3e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:51:17.963 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.955+0000 7f4757bc7b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562638bcb2d0 0x562638bdae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:51:17.963 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.955+0000 7f4757bc7b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x562638ab6500 con 0x562638bc9a80 2024-06-02T04:51:17.963 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.955+0000 7f4757bc7b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x562638ab61a0 con 0x562638bcb2d0 2024-06-02T04:51:17.963 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.955+0000 7f4757bc7b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x56263899d640 con 0x562638bca3e0 2024-06-02T04:51:17.963 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.955+0000 7f4757bc7b80 10 client.0 _ll_register_callbacks cb 0x562638abfad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:51:17.963 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.955+0000 7f47497a8700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562638bc9a80 0x562638bd38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:51:17.963 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.955+0000 7f47497a8700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562638bc9a80 0x562638bd38c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:55934/0 (socket says 172.21.15.76:55934) 2024-06-02T04:51:17.963 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.955+0000 7f47497a8700 1 -- 172.21.15.76:0/2710391028 learned_addr learned my addr 172.21.15.76:0/2710391028 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:51:17.964 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.956+0000 7f4748fa7700 1 --2- 172.21.15.76:0/2710391028 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562638bca3e0 0x562638bd3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:51:17.964 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.956+0000 7f4749fa9700 1 --2- 172.21.15.76:0/2710391028 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562638bcb2d0 0x562638bdae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:51:17.964 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.956+0000 7f47497a8700 1 -- 172.21.15.76:0/2710391028 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562638bca3e0 msgr2=0x562638bd3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:51:17.964 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.956+0000 7f47497a8700 1 --2- 172.21.15.76:0/2710391028 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562638bca3e0 0x562638bd3e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:17.964 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.956+0000 7f47497a8700 1 -- 172.21.15.76:0/2710391028 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562638bcb2d0 msgr2=0x562638bdae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:51:17.964 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.956+0000 7f47497a8700 1 --2- 172.21.15.76:0/2710391028 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562638bcb2d0 0x562638bdae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:17.964 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.956+0000 7f47497a8700 1 -- 172.21.15.76:0/2710391028 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4740017070 con 0x562638bc9a80 2024-06-02T04:51:17.964 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.956+0000 7f4749fa9700 1 --2- 172.21.15.76:0/2710391028 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562638bcb2d0 0x562638bdae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:51:17.965 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.956+0000 7f47497a8700 1 --2- 172.21.15.76:0/2710391028 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562638bc9a80 0x562638bd38c0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f474001d010 tx=0x7f474000eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7539ad28667e5b5 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:51:17.965 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.956+0000 7f472cff9700 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-06-02T04:51:17.965 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.956+0000 7f472cff9700 1 -- 172.21.15.76:0/2710391028 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4740005490 con 0x562638bc9a80 2024-06-02T04:51:17.965 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.956+0000 7f472cff9700 1 -- 172.21.15.76:0/2710391028 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f47400055f0 con 0x562638bc9a80 2024-06-02T04:51:17.965 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.956+0000 7f4757bc7b80 1 -- 172.21.15.76:0/2710391028 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562638a73210 con 0x562638bc9a80 2024-06-02T04:51:17.965 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.956+0000 7f472cff9700 1 -- 172.21.15.76:0/2710391028 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f474001c410 con 0x562638bc9a80 2024-06-02T04:51:17.965 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.956+0000 7f4757bc7b80 10 client.15900 fetch_fsmap learned FSMap version 29 2024-06-02T04:51:17.965 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.956+0000 7f4757bc7b80 1 -- 172.21.15.76:0/2710391028 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x562638947b00 con 0x562638bc9a80 2024-06-02T04:51:17.965 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.956+0000 7f472cff9700 1 -- 172.21.15.76:0/2710391028 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x562638a73210 con 0x562638bc9a80 2024-06-02T04:51:17.965 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.957+0000 7f472cff9700 1 -- 172.21.15.76:0/2710391028 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 29) v1 ==== 7482+0+0 (secure 0 0 0) 0x7f4740003bb0 con 0x562638bc9a80 2024-06-02T04:51:17.965 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.957+0000 7f4757bc7b80 10 client.15900 fetch_fsmap finished waiting for FSMap version 29 2024-06-02T04:51:17.966 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.957+0000 7f4757bc7b80 10 client.15900 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T04:51:17.966 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.957+0000 7f4757bc7b80 20 client.15900 populate_metadata read hostname 'smithi076' 2024-06-02T04:51:17.966 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.957+0000 7f4757bc7b80 1 --2- 172.21.15.76:0/2710391028 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x562638bdf640 0x562638be1a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:51:17.966 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.957+0000 7f4757bc7b80 4 client.15900 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T04:51:17.966 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.957+0000 7f4757bc7b80 1 -- 172.21.15.76:0/2710391028 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562638b997b0 con 0x562638bdf640 2024-06-02T04:51:17.966 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.957+0000 7f4748fa7700 1 --2- 172.21.15.76:0/2710391028 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x562638bdf640 0x562638be1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:51:17.966 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.957+0000 7f472cff9700 10 client.15900 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:51:17.966 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.957+0000 7f4748fa7700 1 --2- 172.21.15.76:0/2710391028 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x562638bdf640 0x562638be1a60 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f8ae666320d2547c server_cookie=e5af832fb4e0f7f7 in_seq=0 out_seq=0 2024-06-02T04:51:17.967 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.958+0000 7f472cff9700 1 -- 172.21.15.76:0/2710391028 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x562638b997b0 con 0x562638bdf640 2024-06-02T04:51:17.967 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.958+0000 7f472cff9700 10 client.15900 handle_command_reply: tid=0 2024-06-02T04:51:17.967 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.958+0000 7f4757bc7b80 1 client.15900 shutdown 2024-06-02T04:51:17.967 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.958+0000 7f4757bc7b80 1 -- 172.21.15.76:0/2710391028 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562638bc9a80 msgr2=0x562638bd38c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:51:17.967 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.958+0000 7f4757bc7b80 1 --2- 172.21.15.76:0/2710391028 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562638bc9a80 0x562638bd38c0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f474001d010 tx=0x7f474000eec0 comp rx=0 tx=0).stop 2024-06-02T04:51:17.967 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.958+0000 7f4757bc7b80 1 -- 172.21.15.76:0/2710391028 shutdown_connections 2024-06-02T04:51:17.967 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.958+0000 7f4757bc7b80 1 --2- 172.21.15.76:0/2710391028 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x562638bdf640 0x562638be1a60 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:17.967 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.958+0000 7f472cff9700 0 client.15900 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:51:17.967 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.958+0000 7f4757bc7b80 1 --2- 172.21.15.76:0/2710391028 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562638bcb2d0 0x562638bdae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:17.967 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.958+0000 7f4757bc7b80 1 --2- 172.21.15.76:0/2710391028 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562638bc9a80 0x562638bd38c0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:17.968 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.958+0000 7f4757bc7b80 1 --2- 172.21.15.76:0/2710391028 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562638bca3e0 0x562638bd3e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:17.968 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.958+0000 7f4757bc7b80 1 -- 172.21.15.76:0/2710391028 >> 172.21.15.76:0/2710391028 conn(0x562638b281b0 msgr2=0x562638bc4860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:51:17.968 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.958+0000 7f4757bc7b80 1 -- 172.21.15.76:0/2710391028 shutdown_connections 2024-06-02T04:51:17.968 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.958+0000 7f4757bc7b80 1 -- 172.21.15.76:0/2710391028 wait complete. 2024-06-02T04:51:17.968 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.958+0000 7f4757bc7b80 20 client.15900 trim_cache size 0 max 16384 2024-06-02T04:51:17.991 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.982+0000 7f4757bc7b80 1 Processor -- start 2024-06-02T04:51:17.991 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.982+0000 7f4757bc7b80 1 -- start start 2024-06-02T04:51:17.991 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.982+0000 7f4757bc7b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562638bc9a80 0x562638bc9e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:51:17.991 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.982+0000 7f4757bc7b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562638bca3e0 0x562638bdae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:51:17.991 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.982+0000 7f4757bc7b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562638bcb2d0 0x562638bcb6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:51:17.991 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.982+0000 7f4757bc7b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x562638bcb150 con 0x562638bcb2d0 2024-06-02T04:51:17.991 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.982+0000 7f4757bc7b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x562638bc5c10 con 0x562638bca3e0 2024-06-02T04:51:17.992 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.982+0000 7f4757bc7b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x562638be6c50 con 0x562638bc9a80 2024-06-02T04:51:17.992 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.982+0000 7f4748fa7700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562638bca3e0 0x562638bdae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:51:17.992 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.982+0000 7f47497a8700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562638bc9a80 0x562638bc9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:51:17.992 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.982+0000 7f4749fa9700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562638bcb2d0 0x562638bcb6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:51:17.992 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.982+0000 7f4748fa7700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562638bca3e0 0x562638bdae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:43300/0 (socket says 172.21.15.76:43300) 2024-06-02T04:51:17.992 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.982+0000 7f47497a8700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562638bc9a80 0x562638bc9e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:55476/0 (socket says 172.21.15.76:55476) 2024-06-02T04:51:17.992 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.982+0000 7f4748fa7700 1 -- 172.21.15.76:0/1494622171 learned_addr learned my addr 172.21.15.76:0/1494622171 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:51:17.992 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.983+0000 7f4748fa7700 1 -- 172.21.15.76:0/1494622171 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562638bc9a80 msgr2=0x562638bc9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:51:17.992 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.983+0000 7f4748fa7700 1 --2- 172.21.15.76:0/1494622171 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562638bc9a80 0x562638bc9e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:17.992 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.983+0000 7f4748fa7700 1 -- 172.21.15.76:0/1494622171 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562638bcb2d0 msgr2=0x562638bcb6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:51:17.992 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.983+0000 7f4748fa7700 1 --2- 172.21.15.76:0/1494622171 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562638bcb2d0 0x562638bcb6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:17.993 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.983+0000 7f4748fa7700 1 -- 172.21.15.76:0/1494622171 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562638ae0500 con 0x562638bca3e0 2024-06-02T04:51:17.993 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.983+0000 7f4749fa9700 1 --2- 172.21.15.76:0/1494622171 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562638bcb2d0 0x562638bcb6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T04:51:17.993 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.983+0000 7f4748fa7700 1 --2- 172.21.15.76:0/1494622171 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562638bca3e0 0x562638bdae00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4734009c40 tx=0x7f4734009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=69627567d88b9ac2 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:51:17.993 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.983+0000 7f472ffff700 1 -- 172.21.15.76:0/1494622171 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47340042f0 con 0x562638bca3e0 2024-06-02T04:51:17.993 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.983+0000 7f472ffff700 1 -- 172.21.15.76:0/1494622171 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4734018040 con 0x562638bca3e0 2024-06-02T04:51:17.993 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.983+0000 7f472ffff700 1 -- 172.21.15.76:0/1494622171 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4734005510 con 0x562638bca3e0 2024-06-02T04:51:17.993 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.984+0000 7f4757bc7b80 1 -- 172.21.15.76:0/1494622171 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562638bca3e0 msgr2=0x562638bdae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:51:17.993 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.984+0000 7f4757bc7b80 1 --2- 172.21.15.76:0/1494622171 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562638bca3e0 0x562638bdae00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4734009c40 tx=0x7f4734009260 comp rx=0 tx=0).stop 2024-06-02T04:51:17.993 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.984+0000 7f4757bc7b80 1 -- 172.21.15.76:0/1494622171 shutdown_connections 2024-06-02T04:51:17.993 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.984+0000 7f4757bc7b80 1 --2- 172.21.15.76:0/1494622171 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562638bcb2d0 0x562638bcb6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:17.994 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.984+0000 7f4757bc7b80 1 --2- 172.21.15.76:0/1494622171 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562638bc9a80 0x562638bc9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:17.994 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.984+0000 7f4757bc7b80 1 --2- 172.21.15.76:0/1494622171 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562638bca3e0 0x562638bdae00 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:17.994 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.984+0000 7f4757bc7b80 1 -- 172.21.15.76:0/1494622171 >> 172.21.15.76:0/1494622171 conn(0x562638b281b0 msgr2=0x562638bc0e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:51:17.994 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.984+0000 7f4757bc7b80 1 -- 172.21.15.76:0/1494622171 shutdown_connections 2024-06-02T04:51:17.994 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.984+0000 7f4757bc7b80 1 -- 172.21.15.76:0/1494622171 wait complete. 2024-06-02T04:51:17.994 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.984+0000 7f4757bc7b80 1 -- start start 2024-06-02T04:51:17.994 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.984+0000 7f4757bc7b80 1 Processor -- start 2024-06-02T04:51:17.994 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.985+0000 7f4757bc7b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562638bc9a80 0x562638bd8680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:51:17.994 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.985+0000 7f4757bc7b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562638bca3e0 0x562638bd8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:51:17.994 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.985+0000 7f4757bc7b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562638bcb2d0 0x562638bd9bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:51:17.994 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.985+0000 7f4757bc7b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x562638bda110 con 0x562638bc9a80 2024-06-02T04:51:17.995 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.985+0000 7f4757bc7b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x562638bda280 con 0x562638bcb2d0 2024-06-02T04:51:17.995 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.985+0000 7f4757bc7b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x562638bda440 con 0x562638bca3e0 2024-06-02T04:51:17.995 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.985+0000 7f4757bc7b80 10 client.0 _ll_register_callbacks cb 0x562638abfad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:51:17.995 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.985+0000 7f47497a8700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562638bc9a80 0x562638bd8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:51:17.995 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.985+0000 7f47497a8700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562638bc9a80 0x562638bd8680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:55944/0 (socket says 172.21.15.76:55944) 2024-06-02T04:51:17.995 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.985+0000 7f4748fa7700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562638bca3e0 0x562638bd8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:51:17.995 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.985+0000 7f47497a8700 1 -- 172.21.15.76:0/1694488708 learned_addr learned my addr 172.21.15.76:0/1694488708 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:51:17.995 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.985+0000 7f4749fa9700 1 --2- 172.21.15.76:0/1694488708 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562638bcb2d0 0x562638bd9bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:51:17.995 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.985+0000 7f47497a8700 1 -- 172.21.15.76:0/1694488708 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562638bca3e0 msgr2=0x562638bd8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:51:17.995 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.985+0000 7f47497a8700 1 --2- 172.21.15.76:0/1694488708 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562638bca3e0 0x562638bd8bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:17.996 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.985+0000 7f47497a8700 1 -- 172.21.15.76:0/1694488708 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562638bcb2d0 msgr2=0x562638bd9bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:51:17.996 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.985+0000 7f47497a8700 1 --2- 172.21.15.76:0/1694488708 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562638bcb2d0 0x562638bd9bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:17.996 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.985+0000 7f47497a8700 1 -- 172.21.15.76:0/1694488708 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47441a1580 con 0x562638bc9a80 2024-06-02T04:51:17.996 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.985+0000 7f47497a8700 1 --2- 172.21.15.76:0/1694488708 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562638bc9a80 0x562638bd8680 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f4740014040 tx=0x7f4740026430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6622db26dc39bda3 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:51:17.996 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.985+0000 7f472cff9700 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-06-02T04:51:17.996 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.986+0000 7f472cff9700 1 -- 172.21.15.76:0/1694488708 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47400092d0 con 0x562638bc9a80 2024-06-02T04:51:17.996 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.986+0000 7f472cff9700 1 -- 172.21.15.76:0/1694488708 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f47400056a0 con 0x562638bc9a80 2024-06-02T04:51:17.996 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.986+0000 7f4757bc7b80 1 -- 172.21.15.76:0/1694488708 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4740021070 con 0x562638bc9a80 2024-06-02T04:51:17.996 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.986+0000 7f472cff9700 1 -- 172.21.15.76:0/1694488708 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f47400253d0 con 0x562638bc9a80 2024-06-02T04:51:17.996 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.986+0000 7f4757bc7b80 10 client.15906 fetch_fsmap learned FSMap version 29 2024-06-02T04:51:17.996 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.986+0000 7f4757bc7b80 1 -- 172.21.15.76:0/1694488708 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x7f4734009ab0 con 0x562638bc9a80 2024-06-02T04:51:17.997 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.986+0000 7f472cff9700 1 -- 172.21.15.76:0/1694488708 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4740021070 con 0x562638bc9a80 2024-06-02T04:51:17.997 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.986+0000 7f472cff9700 1 -- 172.21.15.76:0/1694488708 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 29) v1 ==== 7482+0+0 (secure 0 0 0) 0x7f474000e8a0 con 0x562638bc9a80 2024-06-02T04:51:17.997 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.986+0000 7f4757bc7b80 10 client.15906 fetch_fsmap finished waiting for FSMap version 29 2024-06-02T04:51:17.997 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.986+0000 7f4757bc7b80 10 client.15906 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T04:51:17.997 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.986+0000 7f4757bc7b80 20 client.15906 populate_metadata read hostname 'smithi076' 2024-06-02T04:51:17.997 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.986+0000 7f4757bc7b80 1 --2- 172.21.15.76:0/1694488708 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x562638c363b0 0x562638c387d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:51:17.997 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.986+0000 7f4757bc7b80 4 client.15906 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T04:51:17.997 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.986+0000 7f4757bc7b80 1 -- 172.21.15.76:0/1694488708 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x562638b12e60 con 0x562638c363b0 2024-06-02T04:51:17.997 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.986+0000 7f4748fa7700 1 --2- 172.21.15.76:0/1694488708 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x562638c363b0 0x562638c387d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:51:17.997 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.987+0000 7f472cff9700 10 client.15906 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:51:17.998 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:17.987+0000 7f4748fa7700 1 --2- 172.21.15.76:0/1694488708 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x562638c363b0 0x562638c387d0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=712df26cba575533 server_cookie=b65e0d67580e9eac in_seq=0 out_seq=0 2024-06-02T04:51:18.033 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:18.032+0000 7f472cff9700 1 -- 172.21.15.76:0/1694488708 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x562638b12e60 con 0x562638c363b0 2024-06-02T04:51:18.034 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:18.032+0000 7f472cff9700 10 client.15906 handle_command_reply: tid=0 2024-06-02T04:51:18.034 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:18.032+0000 7f4757bc7b80 1 client.15906 shutdown 2024-06-02T04:51:18.034 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:18.033+0000 7f4757bc7b80 1 -- 172.21.15.76:0/1694488708 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562638bc9a80 msgr2=0x562638bd8680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:51:18.034 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:18.033+0000 7f4757bc7b80 1 --2- 172.21.15.76:0/1694488708 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562638bc9a80 0x562638bd8680 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f4740014040 tx=0x7f4740026430 comp rx=0 tx=0).stop 2024-06-02T04:51:18.034 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:18.033+0000 7f4757bc7b80 1 -- 172.21.15.76:0/1694488708 shutdown_connections 2024-06-02T04:51:18.034 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:18.033+0000 7f4757bc7b80 1 --2- 172.21.15.76:0/1694488708 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x562638c363b0 0x562638c387d0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:18.034 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:18.033+0000 7f4757bc7b80 1 --2- 172.21.15.76:0/1694488708 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562638bcb2d0 0x562638bd9bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:18.035 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:18.033+0000 7f4757bc7b80 1 --2- 172.21.15.76:0/1694488708 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562638bc9a80 0x562638bd8680 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:18.035 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:18.033+0000 7f4757bc7b80 1 --2- 172.21.15.76:0/1694488708 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562638bca3e0 0x562638bd8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:18.035 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:18.033+0000 7f4757bc7b80 1 -- 172.21.15.76:0/1694488708 >> 172.21.15.76:0/1694488708 conn(0x562638b281b0 msgr2=0x562638bd2cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:51:18.035 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:18.033+0000 7f472cff9700 0 client.15906 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:51:18.035 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:18.033+0000 7f4757bc7b80 1 -- 172.21.15.76:0/1694488708 shutdown_connections 2024-06-02T04:51:18.036 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:18.034+0000 7f4757bc7b80 1 -- 172.21.15.76:0/1694488708 wait complete. 2024-06-02T04:51:18.036 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:18.035+0000 7f4757bc7b80 20 client.15906 trim_cache size 0 max 16384 2024-06-02T04:51:18.036 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:{ 2024-06-02T04:51:18.036 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "message": "", 2024-06-02T04:51:18.037 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "return_code": 0 2024-06-02T04:51:18.037 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:} 2024-06-02T04:51:18.037 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:18.036+0000 7f474ba0c700 1 -- 172.21.15.76:0/997020951 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f47300a11a0 msgr2=0x7f47300a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:51:18.038 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:18.036+0000 7f474ba0c700 1 --2- 172.21.15.76:0/997020951 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f47300a11a0 0x7f47300a3660 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f4740009c60 tx=0x7f4740009260 comp rx=0 tx=0).stop 2024-06-02T04:51:18.038 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:18.036+0000 7f474ba0c700 1 -- 172.21.15.76:0/997020951 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4744102a30 msgr2=0x7f47440738d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:51:18.038 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:18.036+0000 7f474ba0c700 1 --2- 172.21.15.76:0/997020951 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4744102a30 0x7f47440738d0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f473c007950 tx=0x7f473c007870 comp rx=0 tx=0).stop 2024-06-02T04:51:18.038 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:18.036+0000 7f474ba0c700 1 -- 172.21.15.76:0/997020951 shutdown_connections 2024-06-02T04:51:18.038 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:18.036+0000 7f474ba0c700 1 --2- 172.21.15.76:0/997020951 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4744102a30 0x7f47440738d0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:18.038 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:18.036+0000 7f474ba0c700 1 --2- 172.21.15.76:0/997020951 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f47300a11a0 0x7f47300a3660 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:18.038 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:18.036+0000 7f474ba0c700 1 --2- 172.21.15.76:0/997020951 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4744100f20 0x7f4744074d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:18.038 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:18.036+0000 7f474ba0c700 1 --2- 172.21.15.76:0/997020951 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4744102070 0x7f4744073390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:18.038 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:18.036+0000 7f474ba0c700 1 -- 172.21.15.76:0/997020951 >> 172.21.15.76:0/997020951 conn(0x7f47440fc490 msgr2=0x7f47441054d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:51:18.038 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:18.036+0000 7f474ba0c700 1 -- 172.21.15.76:0/997020951 shutdown_connections 2024-06-02T04:51:18.038 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:18.036+0000 7f474ba0c700 1 -- 172.21.15.76:0/997020951 wait complete. 2024-06-02T04:51:19.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:51:19 smithi119 ceph-mon[46633]: pgmap v320: 129 pgs: 129 active+clean; 1.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 22 MiB/s wr, 1.19k op/s 2024-06-02T04:51:19.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:51:19 smithi192 ceph-mon[47933]: pgmap v320: 129 pgs: 129 active+clean; 1.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 22 MiB/s wr, 1.19k op/s 2024-06-02T04:51:19.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:51:19 smithi076 ceph-mon[42935]: pgmap v320: 129 pgs: 129 active+clean; 1.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 22 MiB/s wr, 1.19k op/s 2024-06-02T04:51:21.314 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 30.0 s, 924.2 tps, lat 108.644 ms stddev 158.157 2024-06-02T04:51:21.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:51:21 smithi192 ceph-mon[47933]: pgmap v321: 129 pgs: 129 active+clean; 1.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 20 MiB/s wr, 1.09k op/s 2024-06-02T04:51:21.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:51:21 smithi076 ceph-mon[42935]: pgmap v321: 129 pgs: 129 active+clean; 1.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 20 MiB/s wr, 1.09k op/s 2024-06-02T04:51:21.847 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:51:21 smithi119 ceph-mon[46633]: pgmap v321: 129 pgs: 129 active+clean; 1.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 20 MiB/s wr, 1.09k op/s 2024-06-02T04:51:23.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:51:23 smithi192 ceph-mon[47933]: pgmap v322: 129 pgs: 129 active+clean; 1.1 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 24 MiB/s wr, 1.27k op/s 2024-06-02T04:51:23.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:51:23 smithi076 ceph-mon[42935]: pgmap v322: 129 pgs: 129 active+clean; 1.1 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 24 MiB/s wr, 1.27k op/s 2024-06-02T04:51:23.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:51:23 smithi119 ceph-mon[46633]: pgmap v322: 129 pgs: 129 active+clean; 1.1 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 24 MiB/s wr, 1.27k op/s 2024-06-02T04:51:25.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:51:25 smithi192 ceph-mon[47933]: pgmap v323: 129 pgs: 129 active+clean; 1.1 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 18 MiB/s wr, 1.01k op/s 2024-06-02T04:51:25.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:51:25 smithi076 ceph-mon[42935]: pgmap v323: 129 pgs: 129 active+clean; 1.1 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 18 MiB/s wr, 1.01k op/s 2024-06-02T04:51:25.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:51:25 smithi119 ceph-mon[46633]: pgmap v323: 129 pgs: 129 active+clean; 1.1 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 18 MiB/s wr, 1.01k op/s 2024-06-02T04:51:26.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 35.0 s, 1050.2 tps, lat 94.841 ms stddev 104.190 2024-06-02T04:51:27.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:51:27 smithi192 ceph-mon[47933]: pgmap v324: 129 pgs: 129 active+clean; 1.2 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 20 MiB/s wr, 1.18k op/s 2024-06-02T04:51:27.744 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:51:27 smithi076 ceph-mon[42935]: pgmap v324: 129 pgs: 129 active+clean; 1.2 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 20 MiB/s wr, 1.18k op/s 2024-06-02T04:51:27.852 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:51:27 smithi119 ceph-mon[46633]: pgmap v324: 129 pgs: 129 active+clean; 1.2 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 20 MiB/s wr, 1.18k op/s 2024-06-02T04:51:29.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:51:29 smithi192 ceph-mon[47933]: pgmap v325: 129 pgs: 129 active+clean; 1.2 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 21 MiB/s wr, 1.21k op/s 2024-06-02T04:51:29.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:51:29 smithi076 ceph-mon[42935]: pgmap v325: 129 pgs: 129 active+clean; 1.2 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 21 MiB/s wr, 1.21k op/s 2024-06-02T04:51:29.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:51:29 smithi119 ceph-mon[46633]: pgmap v325: 129 pgs: 129 active+clean; 1.2 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 21 MiB/s wr, 1.21k op/s 2024-06-02T04:51:31.199 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.198+0000 7f71d1cfa700 1 -- 172.21.15.76:0/2059065252 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71cc101150 msgr2=0x7f71cc107a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:51:31.199 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.198+0000 7f71d1cfa700 1 --2- 172.21.15.76:0/2059065252 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71cc101150 0x7f71cc107a00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f71c400c210 tx=0x7f71c400c520 comp rx=0 tx=0).stop 2024-06-02T04:51:31.199 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.199+0000 7f71d1cfa700 1 -- 172.21.15.76:0/2059065252 shutdown_connections 2024-06-02T04:51:31.199 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.199+0000 7f71d1cfa700 1 --2- 172.21.15.76:0/2059065252 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71cc101150 0x7f71cc107a00 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:31.199 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.199+0000 7f71d1cfa700 1 --2- 172.21.15.76:0/2059065252 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f71cc0ff5c0 0x7f71cc0ff9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:31.199 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.199+0000 7f71d1cfa700 1 --2- 172.21.15.76:0/2059065252 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71cc1007b0 0x7f71cc100c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:31.199 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.199+0000 7f71d1cfa700 1 -- 172.21.15.76:0/2059065252 >> 172.21.15.76:0/2059065252 conn(0x7f71cc0fab30 msgr2=0x7f71cc0fcf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:51:31.201 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.199+0000 7f71d1cfa700 1 -- 172.21.15.76:0/2059065252 shutdown_connections 2024-06-02T04:51:31.201 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.199+0000 7f71d1cfa700 1 -- 172.21.15.76:0/2059065252 wait complete. 2024-06-02T04:51:31.201 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.200+0000 7f71d1cfa700 1 Processor -- start 2024-06-02T04:51:31.201 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.200+0000 7f71d1cfa700 1 -- start start 2024-06-02T04:51:31.201 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.200+0000 7f71d1cfa700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71cc0ff5c0 0x7f71cc194db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:51:31.201 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.200+0000 7f71d1cfa700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71cc1007b0 0x7f71cc1952f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:51:31.201 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.200+0000 7f71d1cfa700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f71cc101150 0x7f71cc1ad590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:51:31.201 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.200+0000 7f71d1cfa700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71cc195960 con 0x7f71cc101150 2024-06-02T04:51:31.201 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.200+0000 7f71d1cfa700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71cc1adad0 con 0x7f71cc1007b0 2024-06-02T04:51:31.201 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.200+0000 7f71d1cfa700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71cc1adc10 con 0x7f71cc0ff5c0 2024-06-02T04:51:31.201 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.200+0000 7f71cb7fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71cc0ff5c0 0x7f71cc194db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:51:31.202 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.200+0000 7f71c2ffd700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71cc1007b0 0x7f71cc1952f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:51:31.202 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.200+0000 7f71c2ffd700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71cc1007b0 0x7f71cc1952f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:48450/0 (socket says 172.21.15.76:48450) 2024-06-02T04:51:31.202 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.200+0000 7f71cb7fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71cc0ff5c0 0x7f71cc194db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:37762/0 (socket says 172.21.15.76:37762) 2024-06-02T04:51:31.202 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.200+0000 7f71c2ffd700 1 -- 172.21.15.76:0/3536576244 learned_addr learned my addr 172.21.15.76:0/3536576244 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:51:31.202 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.201+0000 7f71cbfff700 1 --2- 172.21.15.76:0/3536576244 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f71cc101150 0x7f71cc1ad590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:51:31.203 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.201+0000 7f71cb7fe700 1 -- 172.21.15.76:0/3536576244 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71cc1007b0 msgr2=0x7f71cc1952f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:51:31.203 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.201+0000 7f71cb7fe700 1 --2- 172.21.15.76:0/3536576244 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71cc1007b0 0x7f71cc1952f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:31.203 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.201+0000 7f71cb7fe700 1 -- 172.21.15.76:0/3536576244 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f71cc101150 msgr2=0x7f71cc1ad590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:51:31.203 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.201+0000 7f71cb7fe700 1 --2- 172.21.15.76:0/3536576244 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f71cc101150 0x7f71cc1ad590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:31.203 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.201+0000 7f71cb7fe700 1 -- 172.21.15.76:0/3536576244 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71c400ae10 con 0x7f71cc0ff5c0 2024-06-02T04:51:31.203 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.201+0000 7f71cb7fe700 1 --2- 172.21.15.76:0/3536576244 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71cc0ff5c0 0x7f71cc194db0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f71cc100610 tx=0x7f71bc00b730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:51:31.203 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.201+0000 7f71c97fa700 1 -- 172.21.15.76:0/3536576244 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71bc011830 con 0x7f71cc0ff5c0 2024-06-02T04:51:31.203 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.201+0000 7f71c97fa700 1 -- 172.21.15.76:0/3536576244 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f71bc00be30 con 0x7f71cc0ff5c0 2024-06-02T04:51:31.203 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.201+0000 7f71c97fa700 1 -- 172.21.15.76:0/3536576244 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71bc010cd0 con 0x7f71cc0ff5c0 2024-06-02T04:51:31.204 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.201+0000 7f71d1cfa700 1 -- 172.21.15.76:0/3536576244 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71cc1adea0 con 0x7f71cc0ff5c0 2024-06-02T04:51:31.204 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.202+0000 7f71d1cfa700 1 -- 172.21.15.76:0/3536576244 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71cc1ae2c0 con 0x7f71cc0ff5c0 2024-06-02T04:51:31.206 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.206+0000 7f71c97fa700 1 -- 172.21.15.76:0/3536576244 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f71bc01a410 con 0x7f71cc0ff5c0 2024-06-02T04:51:31.207 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.207+0000 7f71c97fa700 1 --2- 172.21.15.76:0/3536576244 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f71b80a11a0 0x7f71b80a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:51:31.207 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.207+0000 7f71c97fa700 1 -- 172.21.15.76:0/3536576244 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f71bc0cbfb0 con 0x7f71cc0ff5c0 2024-06-02T04:51:31.208 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.208+0000 7f71c2ffd700 1 --2- 172.21.15.76:0/3536576244 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f71b80a11a0 0x7f71b80a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:51:31.208 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.208+0000 7f71ddeb5b80 1 Processor -- start 2024-06-02T04:51:31.209 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.209+0000 7f71c2ffd700 1 --2- 172.21.15.76:0/3536576244 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f71b80a11a0 0x7f71b80a3660 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f71b400b3c0 tx=0x7f71b400d040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:51:31.211 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.210+0000 7f71ddeb5b80 1 -- start start 2024-06-02T04:51:31.211 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.210+0000 7f71ddeb5b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5598ca5c4a80 0x5598ca5c4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:51:31.211 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.210+0000 7f71ddeb5b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5598ca5c53e0 0x5598ca5c5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:51:31.211 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.210+0000 7f71ddeb5b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5598ca5c62d0 0x5598ca5c6750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:51:31.211 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.210+0000 7f71ddeb5b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598ca51c0f0 con 0x5598ca5c4a80 2024-06-02T04:51:31.211 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.210+0000 7f71ddeb5b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598ca519ab0 con 0x5598ca5c53e0 2024-06-02T04:51:31.212 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.210+0000 7f71ddeb5b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598ca5153a0 con 0x5598ca5c62d0 2024-06-02T04:51:31.212 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.210+0000 7f71cb7fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5598ca5c4a80 0x5598ca5c4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:51:31.212 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.210+0000 7f71c2ffd700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5598ca5c53e0 0x5598ca5c5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:51:31.212 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.210+0000 7f71cbfff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5598ca5c62d0 0x5598ca5c6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:51:31.212 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.210+0000 7f71c2ffd700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5598ca5c53e0 0x5598ca5c5cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:48452/0 (socket says 172.21.15.76:48452) 2024-06-02T04:51:31.212 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.210+0000 7f71cbfff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5598ca5c62d0 0x5598ca5c6750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:37772/0 (socket says 172.21.15.76:37772) 2024-06-02T04:51:31.212 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.210+0000 7f71c2ffd700 1 -- 172.21.15.76:0/3489862950 learned_addr learned my addr 172.21.15.76:0/3489862950 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:51:31.212 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.210+0000 7f71cb7fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5598ca5c4a80 0x5598ca5c4ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:60236/0 (socket says 172.21.15.76:60236) 2024-06-02T04:51:31.212 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.210+0000 7f71cb7fe700 1 -- 172.21.15.76:0/3489862950 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5598ca5c62d0 msgr2=0x5598ca5c6750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:51:31.212 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.210+0000 7f71cb7fe700 1 --2- 172.21.15.76:0/3489862950 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5598ca5c62d0 0x5598ca5c6750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:31.212 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.210+0000 7f71cb7fe700 1 -- 172.21.15.76:0/3489862950 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5598ca5c53e0 msgr2=0x5598ca5c5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:51:31.212 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.210+0000 7f71cb7fe700 1 --2- 172.21.15.76:0/3489862950 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5598ca5c53e0 0x5598ca5c5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:31.212 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.210+0000 7f71cb7fe700 1 -- 172.21.15.76:0/3489862950 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5598ca396350 con 0x5598ca5c4a80 2024-06-02T04:51:31.213 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.210+0000 7f71c2ffd700 1 --2- 172.21.15.76:0/3489862950 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5598ca5c53e0 0x5598ca5c5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T04:51:31.213 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.211+0000 7f71cb7fe700 1 --2- 172.21.15.76:0/3489862950 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5598ca5c4a80 0x5598ca5c4ea0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f71bc009fd0 tx=0x7f71bc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5757dda4b5d2e0e3 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:51:31.213 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.211+0000 7f71c1ffb700 1 -- 172.21.15.76:0/3489862950 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71bc010410 con 0x5598ca5c4a80 2024-06-02T04:51:31.213 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.211+0000 7f71c1ffb700 1 -- 172.21.15.76:0/3489862950 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f71bc099760 con 0x5598ca5c4a80 2024-06-02T04:51:31.213 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.211+0000 7f71c1ffb700 1 -- 172.21.15.76:0/3489862950 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71bc00fdc0 con 0x5598ca5c4a80 2024-06-02T04:51:31.214 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.212+0000 7f71ddeb5b80 1 -- 172.21.15.76:0/3489862950 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5598ca5c4a80 msgr2=0x5598ca5c4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:51:31.214 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.212+0000 7f71ddeb5b80 1 --2- 172.21.15.76:0/3489862950 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5598ca5c4a80 0x5598ca5c4ea0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f71bc009fd0 tx=0x7f71bc004750 comp rx=0 tx=0).stop 2024-06-02T04:51:31.214 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.212+0000 7f71ddeb5b80 1 -- 172.21.15.76:0/3489862950 shutdown_connections 2024-06-02T04:51:31.214 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.212+0000 7f71ddeb5b80 1 --2- 172.21.15.76:0/3489862950 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5598ca5c62d0 0x5598ca5c6750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:31.214 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.212+0000 7f71ddeb5b80 1 --2- 172.21.15.76:0/3489862950 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5598ca5c4a80 0x5598ca5c4ea0 secure :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f71bc009fd0 tx=0x7f71bc004750 comp rx=0 tx=0).stop 2024-06-02T04:51:31.214 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.212+0000 7f71ddeb5b80 1 --2- 172.21.15.76:0/3489862950 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5598ca5c53e0 0x5598ca5c5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:31.214 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.212+0000 7f71ddeb5b80 1 -- 172.21.15.76:0/3489862950 >> 172.21.15.76:0/3489862950 conn(0x5598ca5231b0 msgr2=0x5598ca5c1440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:51:31.214 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.213+0000 7f71ddeb5b80 1 -- 172.21.15.76:0/3489862950 shutdown_connections 2024-06-02T04:51:31.214 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.213+0000 7f71ddeb5b80 1 -- 172.21.15.76:0/3489862950 wait complete. 2024-06-02T04:51:31.214 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.214+0000 7f71ddeb5b80 1 -- start start 2024-06-02T04:51:31.215 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.214+0000 7f71ddeb5b80 1 Processor -- start 2024-06-02T04:51:31.215 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.214+0000 7f71ddeb5b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5598ca5c53e0 0x5598ca5ceb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:51:31.215 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.214+0000 7f71ddeb5b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5598ca5c62d0 0x5598ca5cf080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:51:31.216 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.214+0000 7f71ddeb5b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5598ca5d40b0 0x5598ca5d64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:51:31.216 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.214+0000 7f71ddeb5b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598ca4b1500 con 0x5598ca5c53e0 2024-06-02T04:51:31.216 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.214+0000 7f71ddeb5b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598ca4b11a0 con 0x5598ca5c62d0 2024-06-02T04:51:31.216 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.214+0000 7f71ddeb5b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598ca398640 con 0x5598ca5d40b0 2024-06-02T04:51:31.216 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.214+0000 7f71ddeb5b80 10 client.0 _ll_register_callbacks cb 0x5598ca4baad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:51:31.216 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.215+0000 7f71cbfff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5598ca5d40b0 0x5598ca5d64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:51:31.216 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.215+0000 7f71cb7fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5598ca5c53e0 0x5598ca5ceb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:51:31.216 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.215+0000 7f71cb7fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5598ca5c53e0 0x5598ca5ceb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:60242/0 (socket says 172.21.15.76:60242) 2024-06-02T04:51:31.216 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.215+0000 7f71cb7fe700 1 -- 172.21.15.76:0/3043369384 learned_addr learned my addr 172.21.15.76:0/3043369384 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:51:31.216 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.215+0000 7f71cbfff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5598ca5d40b0 0x5598ca5d64a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:37776/0 (socket says 172.21.15.76:37776) 2024-06-02T04:51:31.216 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.215+0000 7f71c2ffd700 1 --2- 172.21.15.76:0/3043369384 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5598ca5c62d0 0x5598ca5cf080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:51:31.217 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.215+0000 7f71cb7fe700 1 -- 172.21.15.76:0/3043369384 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5598ca5d40b0 msgr2=0x5598ca5d64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:51:31.217 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.215+0000 7f71cb7fe700 1 --2- 172.21.15.76:0/3043369384 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5598ca5d40b0 0x5598ca5d64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:31.217 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.215+0000 7f71cb7fe700 1 -- 172.21.15.76:0/3043369384 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5598ca5c62d0 msgr2=0x5598ca5cf080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:51:31.217 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.215+0000 7f71cb7fe700 1 --2- 172.21.15.76:0/3043369384 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5598ca5c62d0 0x5598ca5cf080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:31.217 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.215+0000 7f71cb7fe700 1 -- 172.21.15.76:0/3043369384 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71b4003880 con 0x5598ca5c53e0 2024-06-02T04:51:31.218 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.215+0000 7f71cb7fe700 1 --2- 172.21.15.76:0/3043369384 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5598ca5c53e0 0x5598ca5ceb40 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f71bc0a0fb0 tx=0x7f71bc0972c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=986f4658812c06fc server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:51:31.218 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.215+0000 7f71aaffd700 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-06-02T04:51:31.218 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.216+0000 7f71aaffd700 1 -- 172.21.15.76:0/3043369384 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71bc09ce90 con 0x5598ca5c53e0 2024-06-02T04:51:31.218 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.216+0000 7f71aaffd700 1 -- 172.21.15.76:0/3043369384 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f71bc079070 con 0x5598ca5c53e0 2024-06-02T04:51:31.218 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.216+0000 7f71ddeb5b80 1 -- 172.21.15.76:0/3043369384 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5598ca46e210 con 0x5598ca5c53e0 2024-06-02T04:51:31.218 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.216+0000 7f71aaffd700 1 -- 172.21.15.76:0/3043369384 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f71bc098550 con 0x5598ca5c53e0 2024-06-02T04:51:31.218 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.216+0000 7f71ddeb5b80 10 client.15915 fetch_fsmap learned FSMap version 29 2024-06-02T04:51:31.218 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.216+0000 7f71ddeb5b80 1 -- 172.21.15.76:0/3043369384 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x7f71cc1ae2c0 con 0x5598ca5c53e0 2024-06-02T04:51:31.219 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.216+0000 7f71aaffd700 1 -- 172.21.15.76:0/3043369384 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5598ca46e210 con 0x5598ca5c53e0 2024-06-02T04:51:31.219 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.217+0000 7f71aaffd700 1 -- 172.21.15.76:0/3043369384 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 29) v1 ==== 7482+0+0 (secure 0 0 0) 0x7f71bc0a1050 con 0x5598ca5c53e0 2024-06-02T04:51:31.219 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.217+0000 7f71ddeb5b80 10 client.15915 fetch_fsmap finished waiting for FSMap version 29 2024-06-02T04:51:31.219 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.217+0000 7f71ddeb5b80 10 client.15915 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T04:51:31.219 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.217+0000 7f71ddeb5b80 20 client.15915 populate_metadata read hostname 'smithi076' 2024-06-02T04:51:31.219 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.217+0000 7f71ddeb5b80 1 --2- 172.21.15.76:0/3043369384 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5598ca5da9d0 0x5598ca5dcdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:51:31.219 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.217+0000 7f71ddeb5b80 4 client.15915 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T04:51:31.219 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.217+0000 7f71ddeb5b80 1 -- 172.21.15.76:0/3043369384 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5598ca5947b0 con 0x5598ca5da9d0 2024-06-02T04:51:31.220 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.218+0000 7f71c2ffd700 1 --2- 172.21.15.76:0/3043369384 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5598ca5da9d0 0x5598ca5dcdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:51:31.220 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.219+0000 7f71c2ffd700 1 --2- 172.21.15.76:0/3043369384 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5598ca5da9d0 0x5598ca5dcdf0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf6af0120dc5ae63 server_cookie=386254ea9de1486b in_seq=0 out_seq=0 2024-06-02T04:51:31.220 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.219+0000 7f71aaffd700 10 client.15915 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:51:31.220 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.220+0000 7f71aaffd700 1 -- 172.21.15.76:0/3043369384 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5598ca5947b0 con 0x5598ca5da9d0 2024-06-02T04:51:31.220 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.220+0000 7f71aaffd700 10 client.15915 handle_command_reply: tid=0 2024-06-02T04:51:31.220 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.220+0000 7f71ddeb5b80 1 client.15915 shutdown 2024-06-02T04:51:31.221 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.221+0000 7f71ddeb5b80 1 -- 172.21.15.76:0/3043369384 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5598ca5c53e0 msgr2=0x5598ca5ceb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:51:31.221 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.221+0000 7f71ddeb5b80 1 --2- 172.21.15.76:0/3043369384 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5598ca5c53e0 0x5598ca5ceb40 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f71bc0a0fb0 tx=0x7f71bc0972c0 comp rx=0 tx=0).stop 2024-06-02T04:51:31.221 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.221+0000 7f71ddeb5b80 1 -- 172.21.15.76:0/3043369384 shutdown_connections 2024-06-02T04:51:31.222 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.221+0000 7f71ddeb5b80 1 --2- 172.21.15.76:0/3043369384 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5598ca5da9d0 0x5598ca5dcdf0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:31.222 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.221+0000 7f71ddeb5b80 1 --2- 172.21.15.76:0/3043369384 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5598ca5d40b0 0x5598ca5d64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:31.222 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.221+0000 7f71ddeb5b80 1 --2- 172.21.15.76:0/3043369384 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5598ca5c53e0 0x5598ca5ceb40 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:31.222 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.221+0000 7f71ddeb5b80 1 --2- 172.21.15.76:0/3043369384 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5598ca5c62d0 0x5598ca5cf080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:31.222 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.221+0000 7f71ddeb5b80 1 -- 172.21.15.76:0/3043369384 >> 172.21.15.76:0/3043369384 conn(0x5598ca5231b0 msgr2=0x5598ca5bf860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:51:31.222 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.221+0000 7f71aaffd700 0 client.15915 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:51:31.222 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.221+0000 7f71ddeb5b80 1 -- 172.21.15.76:0/3043369384 shutdown_connections 2024-06-02T04:51:31.222 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.221+0000 7f71ddeb5b80 1 -- 172.21.15.76:0/3043369384 wait complete. 2024-06-02T04:51:31.222 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.222+0000 7f71ddeb5b80 20 client.15915 trim_cache size 0 max 16384 2024-06-02T04:51:31.248 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.247+0000 7f71ddeb5b80 1 Processor -- start 2024-06-02T04:51:31.248 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.247+0000 7f71ddeb5b80 1 -- start start 2024-06-02T04:51:31.250 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.250+0000 7f71ddeb5b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5598ca5c53e0 0x5598ca5d6b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:51:31.250 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.250+0000 7f71ddeb5b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5598ca5c62d0 0x5598ca5d64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:51:31.250 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.250+0000 7f71ddeb5b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5598ca5d40b0 0x5598ca5c66b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:51:31.250 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.250+0000 7f71ddeb5b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598ca5c6150 con 0x5598ca5c62d0 2024-06-02T04:51:31.250 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.250+0000 7f71ddeb5b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598ca5d7630 con 0x5598ca5d40b0 2024-06-02T04:51:31.250 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.250+0000 7f71ddeb5b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598ca5c9da0 con 0x5598ca5c53e0 2024-06-02T04:51:31.253 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.250+0000 7f71cbfff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5598ca5d40b0 0x5598ca5c66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:51:31.253 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.250+0000 7f71cbfff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5598ca5d40b0 0x5598ca5c66b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:48470/0 (socket says 172.21.15.76:48470) 2024-06-02T04:51:31.253 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.250+0000 7f71cbfff700 1 -- 172.21.15.76:0/1383325778 learned_addr learned my addr 172.21.15.76:0/1383325778 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:51:31.253 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.250+0000 7f71c2ffd700 1 --2- 172.21.15.76:0/1383325778 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5598ca5c62d0 0x5598ca5d64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:51:31.254 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.250+0000 7f71cbfff700 1 -- 172.21.15.76:0/1383325778 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5598ca5c53e0 msgr2=0x5598ca5d6b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:51:31.254 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.250+0000 7f71cbfff700 1 --2- 172.21.15.76:0/1383325778 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5598ca5c53e0 0x5598ca5d6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:31.254 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.250+0000 7f71cbfff700 1 -- 172.21.15.76:0/1383325778 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5598ca5c62d0 msgr2=0x5598ca5d64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:51:31.254 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.250+0000 7f71cbfff700 1 --2- 172.21.15.76:0/1383325778 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5598ca5c62d0 0x5598ca5d64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:31.254 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.250+0000 7f71cbfff700 1 -- 172.21.15.76:0/1383325778 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5598ca342b00 con 0x5598ca5d40b0 2024-06-02T04:51:31.254 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.251+0000 7f71cbfff700 1 --2- 172.21.15.76:0/1383325778 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5598ca5d40b0 0x5598ca5c66b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f71c4015000 tx=0x7f71c400cc90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea6f7b5ad05cba5 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:51:31.254 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.252+0000 7f71c27fc700 1 -- 172.21.15.76:0/1383325778 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c4008a70 con 0x5598ca5d40b0 2024-06-02T04:51:31.254 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.252+0000 7f71c27fc700 1 -- 172.21.15.76:0/1383325778 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f71c4003a00 con 0x5598ca5d40b0 2024-06-02T04:51:31.254 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.252+0000 7f71c27fc700 1 -- 172.21.15.76:0/1383325778 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c4008550 con 0x5598ca5d40b0 2024-06-02T04:51:31.254 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.253+0000 7f71ddeb5b80 1 -- 172.21.15.76:0/1383325778 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5598ca5d40b0 msgr2=0x5598ca5c66b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:51:31.254 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.253+0000 7f71ddeb5b80 1 --2- 172.21.15.76:0/1383325778 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5598ca5d40b0 0x5598ca5c66b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f71c4015000 tx=0x7f71c400cc90 comp rx=0 tx=0).stop 2024-06-02T04:51:31.255 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.254+0000 7f71ddeb5b80 1 -- 172.21.15.76:0/1383325778 shutdown_connections 2024-06-02T04:51:31.255 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.254+0000 7f71ddeb5b80 1 --2- 172.21.15.76:0/1383325778 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5598ca5d40b0 0x5598ca5c66b0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:31.255 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.254+0000 7f71ddeb5b80 1 --2- 172.21.15.76:0/1383325778 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5598ca5c53e0 0x5598ca5d6b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:31.255 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.254+0000 7f71ddeb5b80 1 --2- 172.21.15.76:0/1383325778 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5598ca5c62d0 0x5598ca5d64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:31.255 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.254+0000 7f71ddeb5b80 1 -- 172.21.15.76:0/1383325778 >> 172.21.15.76:0/1383325778 conn(0x5598ca5231b0 msgr2=0x5598ca5cd540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:51:31.255 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.254+0000 7f71ddeb5b80 1 -- 172.21.15.76:0/1383325778 shutdown_connections 2024-06-02T04:51:31.256 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.254+0000 7f71ddeb5b80 1 -- 172.21.15.76:0/1383325778 wait complete. 2024-06-02T04:51:31.265 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.255+0000 7f71ddeb5b80 1 -- start start 2024-06-02T04:51:31.265 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.255+0000 7f71ddeb5b80 1 Processor -- start 2024-06-02T04:51:31.265 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.256+0000 7f71ddeb5b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5598ca5c53e0 0x5598ca5eb060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:51:31.265 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.256+0000 7f71ddeb5b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5598ca5c62d0 0x5598ca5e9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:51:31.265 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.256+0000 7f71ddeb5b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5598ca5d40b0 0x5598ca5ea210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:51:31.265 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.256+0000 7f71ddeb5b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598ca5ea900 con 0x5598ca5c62d0 2024-06-02T04:51:31.265 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.256+0000 7f71ddeb5b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598ca5eaa70 con 0x5598ca5d40b0 2024-06-02T04:51:31.266 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.256+0000 7f71ddeb5b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598ca640960 con 0x5598ca5c53e0 2024-06-02T04:51:31.266 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.256+0000 7f71ddeb5b80 10 client.0 _ll_register_callbacks cb 0x5598ca4baad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:51:31.266 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.256+0000 7f71c2ffd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5598ca5c62d0 0x5598ca5e9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:51:31.266 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.256+0000 7f71c2ffd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5598ca5c62d0 0x5598ca5e9cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:60262/0 (socket says 172.21.15.76:60262) 2024-06-02T04:51:31.266 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.256+0000 7f71c2ffd700 1 -- 172.21.15.76:0/1305477863 learned_addr learned my addr 172.21.15.76:0/1305477863 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:51:31.266 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.256+0000 7f71cbfff700 1 --2- 172.21.15.76:0/1305477863 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5598ca5d40b0 0x5598ca5ea210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:51:31.266 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.257+0000 7f71c2ffd700 1 -- 172.21.15.76:0/1305477863 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5598ca5c53e0 msgr2=0x5598ca5eb060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:51:31.266 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.257+0000 7f71c2ffd700 1 --2- 172.21.15.76:0/1305477863 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5598ca5c53e0 0x5598ca5eb060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:31.266 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.257+0000 7f71c2ffd700 1 -- 172.21.15.76:0/1305477863 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5598ca5d40b0 msgr2=0x5598ca5ea210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:51:31.266 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.257+0000 7f71c2ffd700 1 --2- 172.21.15.76:0/1305477863 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5598ca5d40b0 0x5598ca5ea210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:31.266 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.257+0000 7f71c2ffd700 1 -- 172.21.15.76:0/1305477863 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71cc108350 con 0x5598ca5c62d0 2024-06-02T04:51:31.270 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.257+0000 7f71cbfff700 1 --2- 172.21.15.76:0/1305477863 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5598ca5d40b0 0x5598ca5ea210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T04:51:31.270 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.257+0000 7f71c2ffd700 1 --2- 172.21.15.76:0/1305477863 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5598ca5c62d0 0x5598ca5e9cd0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f71b4003850 tx=0x7f71b4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=439dde63d4707f37 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:51:31.270 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.257+0000 7f71aaffd700 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-06-02T04:51:31.270 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.258+0000 7f71aaffd700 1 -- 172.21.15.76:0/1305477863 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b402c070 con 0x5598ca5c62d0 2024-06-02T04:51:31.270 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.258+0000 7f71aaffd700 1 -- 172.21.15.76:0/1305477863 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f71b402c3e0 con 0x5598ca5c62d0 2024-06-02T04:51:31.271 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.258+0000 7f71ddeb5b80 1 -- 172.21.15.76:0/1305477863 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f71bc099760 con 0x5598ca5c62d0 2024-06-02T04:51:31.271 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.264+0000 7f71aaffd700 1 -- 172.21.15.76:0/1305477863 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f71b4010040 con 0x5598ca5c62d0 2024-06-02T04:51:31.271 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.264+0000 7f71ddeb5b80 10 client.15921 fetch_fsmap learned FSMap version 29 2024-06-02T04:51:31.271 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.264+0000 7f71ddeb5b80 1 -- 172.21.15.76:0/1305477863 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x5598ca4db500 con 0x5598ca5c62d0 2024-06-02T04:51:31.271 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.265+0000 7f71aaffd700 1 -- 172.21.15.76:0/1305477863 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f71bc099760 con 0x5598ca5c62d0 2024-06-02T04:51:31.272 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.265+0000 7f71aaffd700 1 -- 172.21.15.76:0/1305477863 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 29) v1 ==== 7482+0+0 (secure 0 0 0) 0x7f71b4005020 con 0x5598ca5c62d0 2024-06-02T04:51:31.272 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.265+0000 7f71ddeb5b80 10 client.15921 fetch_fsmap finished waiting for FSMap version 29 2024-06-02T04:51:31.272 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.265+0000 7f71ddeb5b80 10 client.15921 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T04:51:31.272 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.265+0000 7f71ddeb5b80 20 client.15921 populate_metadata read hostname 'smithi076' 2024-06-02T04:51:31.272 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.265+0000 7f71ddeb5b80 1 --2- 172.21.15.76:0/1305477863 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5598ca6301d0 0x5598ca6325f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:51:31.272 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.265+0000 7f71ddeb5b80 4 client.15921 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T04:51:31.272 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.265+0000 7f71ddeb5b80 1 -- 172.21.15.76:0/1305477863 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5598ca50de60 con 0x5598ca6301d0 2024-06-02T04:51:31.272 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.269+0000 7f71cb7fe700 1 --2- 172.21.15.76:0/1305477863 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5598ca6301d0 0x5598ca6325f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:51:31.272 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.271+0000 7f71cb7fe700 1 --2- 172.21.15.76:0/1305477863 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5598ca6301d0 0x5598ca6325f0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b88aa5aacadd2eea server_cookie=4b5b5e07098816eb in_seq=0 out_seq=0 2024-06-02T04:51:31.272 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.271+0000 7f71aaffd700 10 client.15921 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:51:31.303 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.303+0000 7f71aaffd700 1 -- 172.21.15.76:0/1305477863 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5598ca50de60 con 0x5598ca6301d0 2024-06-02T04:51:31.303 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.303+0000 7f71aaffd700 10 client.15921 handle_command_reply: tid=0 2024-06-02T04:51:31.303 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.303+0000 7f71ddeb5b80 1 client.15921 shutdown 2024-06-02T04:51:31.304 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.303+0000 7f71ddeb5b80 1 -- 172.21.15.76:0/1305477863 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5598ca5c62d0 msgr2=0x5598ca5e9cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:51:31.304 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.303+0000 7f71ddeb5b80 1 --2- 172.21.15.76:0/1305477863 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5598ca5c62d0 0x5598ca5e9cd0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f71b4003850 tx=0x7f71b4004750 comp rx=0 tx=0).stop 2024-06-02T04:51:31.304 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.303+0000 7f71ddeb5b80 1 -- 172.21.15.76:0/1305477863 shutdown_connections 2024-06-02T04:51:31.304 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.303+0000 7f71ddeb5b80 1 --2- 172.21.15.76:0/1305477863 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5598ca6301d0 0x5598ca6325f0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:31.305 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.303+0000 7f71ddeb5b80 1 --2- 172.21.15.76:0/1305477863 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5598ca5d40b0 0x5598ca5ea210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:31.305 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.303+0000 7f71ddeb5b80 1 --2- 172.21.15.76:0/1305477863 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5598ca5c53e0 0x5598ca5eb060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:31.305 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.303+0000 7f71ddeb5b80 1 --2- 172.21.15.76:0/1305477863 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5598ca5c62d0 0x5598ca5e9cd0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:31.305 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.303+0000 7f71ddeb5b80 1 -- 172.21.15.76:0/1305477863 >> 172.21.15.76:0/1305477863 conn(0x5598ca5231b0 msgr2=0x5598ca5cdf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:51:31.305 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.304+0000 7f71aaffd700 0 client.15921 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:51:31.305 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.304+0000 7f71ddeb5b80 1 -- 172.21.15.76:0/1305477863 shutdown_connections 2024-06-02T04:51:31.305 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.304+0000 7f71ddeb5b80 1 -- 172.21.15.76:0/1305477863 wait complete. 2024-06-02T04:51:31.305 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.304+0000 7f71ddeb5b80 20 client.15921 trim_cache size 0 max 16384 2024-06-02T04:51:31.305 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:{ 2024-06-02T04:51:31.305 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "message": "", 2024-06-02T04:51:31.306 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "return_code": 0 2024-06-02T04:51:31.306 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:} 2024-06-02T04:51:31.307 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.306+0000 7f71d1cfa700 1 -- 172.21.15.76:0/3536576244 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f71b80a11a0 msgr2=0x7f71b80a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:51:31.308 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.306+0000 7f71d1cfa700 1 --2- 172.21.15.76:0/3536576244 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f71b80a11a0 0x7f71b80a3660 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f71b400b3c0 tx=0x7f71b400d040 comp rx=0 tx=0).stop 2024-06-02T04:51:31.308 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.306+0000 7f71d1cfa700 1 -- 172.21.15.76:0/3536576244 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71cc0ff5c0 msgr2=0x7f71cc194db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:51:31.308 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.306+0000 7f71d1cfa700 1 --2- 172.21.15.76:0/3536576244 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71cc0ff5c0 0x7f71cc194db0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f71cc100610 tx=0x7f71bc00b730 comp rx=0 tx=0).stop 2024-06-02T04:51:31.308 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.306+0000 7f71d1cfa700 1 -- 172.21.15.76:0/3536576244 shutdown_connections 2024-06-02T04:51:31.308 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.306+0000 7f71d1cfa700 1 --2- 172.21.15.76:0/3536576244 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f71cc101150 0x7f71cc1ad590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:31.308 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.306+0000 7f71d1cfa700 1 --2- 172.21.15.76:0/3536576244 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71cc0ff5c0 0x7f71cc194db0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:31.308 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.306+0000 7f71d1cfa700 1 --2- 172.21.15.76:0/3536576244 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f71b80a11a0 0x7f71b80a3660 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:31.308 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.306+0000 7f71d1cfa700 1 --2- 172.21.15.76:0/3536576244 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71cc1007b0 0x7f71cc1952f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:31.308 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.306+0000 7f71d1cfa700 1 -- 172.21.15.76:0/3536576244 >> 172.21.15.76:0/3536576244 conn(0x7f71cc0fab30 msgr2=0x7f71cc103b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:51:31.308 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.306+0000 7f71d1cfa700 1 -- 172.21.15.76:0/3536576244 shutdown_connections 2024-06-02T04:51:31.308 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:31.306+0000 7f71d1cfa700 1 -- 172.21.15.76:0/3536576244 wait complete. 2024-06-02T04:51:31.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 40.0 s, 818.0 tps, lat 112.292 ms stddev 118.991 2024-06-02T04:51:31.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:51:31 smithi192 ceph-mon[47933]: pgmap v326: 129 pgs: 129 active+clean; 1.2 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 19 MiB/s wr, 1.08k op/s 2024-06-02T04:51:31.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:51:31 smithi076 ceph-mon[42935]: pgmap v326: 129 pgs: 129 active+clean; 1.2 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 19 MiB/s wr, 1.08k op/s 2024-06-02T04:51:31.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:51:31 smithi119 ceph-mon[46633]: pgmap v326: 129 pgs: 129 active+clean; 1.2 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 19 MiB/s wr, 1.08k op/s 2024-06-02T04:51:33.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:51:33 smithi192 ceph-mon[47933]: pgmap v327: 129 pgs: 129 active+clean; 1.2 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 20 MiB/s wr, 1.27k op/s 2024-06-02T04:51:33.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:51:33 smithi076 ceph-mon[42935]: pgmap v327: 129 pgs: 129 active+clean; 1.2 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 20 MiB/s wr, 1.27k op/s 2024-06-02T04:51:33.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:51:33 smithi119 ceph-mon[46633]: pgmap v327: 129 pgs: 129 active+clean; 1.2 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 20 MiB/s wr, 1.27k op/s 2024-06-02T04:51:35.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:51:35 smithi192 ceph-mon[47933]: pgmap v328: 129 pgs: 129 active+clean; 1.2 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 16 MiB/s wr, 1.03k op/s 2024-06-02T04:51:35.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:51:35 smithi076 ceph-mon[42935]: pgmap v328: 129 pgs: 129 active+clean; 1.2 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 16 MiB/s wr, 1.03k op/s 2024-06-02T04:51:35.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:51:35 smithi119 ceph-mon[46633]: pgmap v328: 129 pgs: 129 active+clean; 1.2 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 16 MiB/s wr, 1.03k op/s 2024-06-02T04:51:36.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 45.0 s, 1020.7 tps, lat 106.202 ms stddev 154.613 2024-06-02T04:51:37.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:51:37 smithi192 ceph-mon[47933]: pgmap v329: 129 pgs: 129 active+clean; 1.2 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 18 MiB/s wr, 1.21k op/s 2024-06-02T04:51:37.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:51:37 smithi076 ceph-mon[42935]: pgmap v329: 129 pgs: 129 active+clean; 1.2 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 18 MiB/s wr, 1.21k op/s 2024-06-02T04:51:37.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:51:37 smithi119 ceph-mon[46633]: pgmap v329: 129 pgs: 129 active+clean; 1.2 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 18 MiB/s wr, 1.21k op/s 2024-06-02T04:51:39.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:51:39 smithi192 ceph-mon[47933]: pgmap v330: 129 pgs: 129 active+clean; 1.2 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 18 MiB/s wr, 1.20k op/s 2024-06-02T04:51:39.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:51:39 smithi076 ceph-mon[42935]: pgmap v330: 129 pgs: 129 active+clean; 1.2 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 18 MiB/s wr, 1.20k op/s 2024-06-02T04:51:39.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:51:39 smithi119 ceph-mon[46633]: pgmap v330: 129 pgs: 129 active+clean; 1.2 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 18 MiB/s wr, 1.20k op/s 2024-06-02T04:51:41.314 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 50.0 s, 983.2 tps, lat 86.394 ms stddev 119.811 2024-06-02T04:51:41.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:51:41 smithi192 ceph-mon[47933]: pgmap v331: 129 pgs: 129 active+clean; 1.2 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 17 MiB/s wr, 1.09k op/s 2024-06-02T04:51:41.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:51:41 smithi076 ceph-mon[42935]: pgmap v331: 129 pgs: 129 active+clean; 1.2 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 17 MiB/s wr, 1.09k op/s 2024-06-02T04:51:41.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:51:41 smithi119 ceph-mon[46633]: pgmap v331: 129 pgs: 129 active+clean; 1.2 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 17 MiB/s wr, 1.09k op/s 2024-06-02T04:51:43.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:51:43 smithi192 ceph-mon[47933]: pgmap v332: 129 pgs: 129 active+clean; 1.2 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 19 MiB/s wr, 1.26k op/s 2024-06-02T04:51:43.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:51:43 smithi076 ceph-mon[42935]: pgmap v332: 129 pgs: 129 active+clean; 1.2 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 19 MiB/s wr, 1.26k op/s 2024-06-02T04:51:43.847 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:51:43 smithi119 ceph-mon[46633]: pgmap v332: 129 pgs: 129 active+clean; 1.2 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 19 MiB/s wr, 1.26k op/s 2024-06-02T04:51:44.466 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.466+0000 7f8c7db64700 1 -- 172.21.15.76:0/987065917 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8c780ff770 msgr2=0x7f8c78101ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:51:44.467 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.466+0000 7f8c7db64700 1 --2- 172.21.15.76:0/987065917 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8c780ff770 0x7f8c78101ba0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c009990 tx=0x7f8c6c009ca0 comp rx=0 tx=0).stop 2024-06-02T04:51:44.467 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.467+0000 7f8c7db64700 1 -- 172.21.15.76:0/987065917 shutdown_connections 2024-06-02T04:51:44.467 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.467+0000 7f8c7db64700 1 --2- 172.21.15.76:0/987065917 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8c78104ab0 0x7f8c78104f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:44.467 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.467+0000 7f8c7db64700 1 --2- 172.21.15.76:0/987065917 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8c780ff770 0x7f8c78101ba0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:44.467 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.467+0000 7f8c7db64700 1 --2- 172.21.15.76:0/987065917 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c781020e0 0x7f8c78104570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:44.468 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.467+0000 7f8c7db64700 1 -- 172.21.15.76:0/987065917 >> 172.21.15.76:0/987065917 conn(0x7f8c780fb390 msgr2=0x7f8c780fd7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:51:44.468 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.467+0000 7f8c7db64700 1 -- 172.21.15.76:0/987065917 shutdown_connections 2024-06-02T04:51:44.468 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.467+0000 7f8c7db64700 1 -- 172.21.15.76:0/987065917 wait complete. 2024-06-02T04:51:44.469 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.468+0000 7f8c7db64700 1 Processor -- start 2024-06-02T04:51:44.469 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.468+0000 7f8c7db64700 1 -- start start 2024-06-02T04:51:44.469 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.468+0000 7f8c7db64700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c780ff770 0x7f8c7819d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:51:44.469 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.468+0000 7f8c7db64700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8c781020e0 0x7f8c7819d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:51:44.469 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.468+0000 7f8c7db64700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8c78104ab0 0x7f8c781a48a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:51:44.469 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.468+0000 7f8c7db64700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c781a4e70 con 0x7f8c78104ab0 2024-06-02T04:51:44.469 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.468+0000 7f8c7db64700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c781a4fb0 con 0x7f8c780ff770 2024-06-02T04:51:44.470 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.468+0000 7f8c7db64700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c781a5140 con 0x7f8c781020e0 2024-06-02T04:51:44.470 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.468+0000 7f8c76ffd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8c781020e0 0x7f8c7819d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:51:44.470 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.468+0000 7f8c777fe700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c780ff770 0x7f8c7819d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:51:44.470 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.468+0000 7f8c777fe700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c780ff770 0x7f8c7819d390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:42954/0 (socket says 172.21.15.76:42954) 2024-06-02T04:51:44.470 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.468+0000 7f8c76ffd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8c781020e0 0x7f8c7819d8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:45838/0 (socket says 172.21.15.76:45838) 2024-06-02T04:51:44.470 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.468+0000 7f8c777fe700 1 -- 172.21.15.76:0/3621661817 learned_addr learned my addr 172.21.15.76:0/3621661817 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:51:44.470 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.469+0000 7f8c77fff700 1 --2- 172.21.15.76:0/3621661817 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8c78104ab0 0x7f8c781a48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:51:44.470 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.469+0000 7f8c76ffd700 1 -- 172.21.15.76:0/3621661817 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c780ff770 msgr2=0x7f8c7819d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:51:44.470 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.469+0000 7f8c76ffd700 1 --2- 172.21.15.76:0/3621661817 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c780ff770 0x7f8c7819d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:44.470 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.469+0000 7f8c76ffd700 1 -- 172.21.15.76:0/3621661817 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8c78104ab0 msgr2=0x7f8c781a48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:51:44.470 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.469+0000 7f8c76ffd700 1 --2- 172.21.15.76:0/3621661817 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8c78104ab0 0x7f8c781a48a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:44.471 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.469+0000 7f8c76ffd700 1 -- 172.21.15.76:0/3621661817 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c6c0095f0 con 0x7f8c781020e0 2024-06-02T04:51:44.471 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.469+0000 7f8c76ffd700 1 --2- 172.21.15.76:0/3621661817 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8c781020e0 0x7f8c7819d8d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8c6800c970 tx=0x7f8c6800cc80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:51:44.471 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.469+0000 7f8c74ff9700 1 -- 172.21.15.76:0/3621661817 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c68004440 con 0x7f8c781020e0 2024-06-02T04:51:44.471 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.469+0000 7f8c74ff9700 1 -- 172.21.15.76:0/3621661817 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8c68003b10 con 0x7f8c781020e0 2024-06-02T04:51:44.471 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.469+0000 7f8c74ff9700 1 -- 172.21.15.76:0/3621661817 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c68007aa0 con 0x7f8c781020e0 2024-06-02T04:51:44.471 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.471+0000 7f8c7db64700 1 -- 172.21.15.76:0/3621661817 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c781a5420 con 0x7f8c781020e0 2024-06-02T04:51:44.472 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.471+0000 7f8c7db64700 1 -- 172.21.15.76:0/3621661817 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c781a58b0 con 0x7f8c781020e0 2024-06-02T04:51:44.476 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.474+0000 7f8c74ff9700 1 -- 172.21.15.76:0/3621661817 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f8c68003c80 con 0x7f8c781020e0 2024-06-02T04:51:44.476 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.475+0000 7f8c74ff9700 1 --2- 172.21.15.76:0/3621661817 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f8c600a11a0 0x7f8c600a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:51:44.476 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.475+0000 7f8c777fe700 1 --2- 172.21.15.76:0/3621661817 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f8c600a11a0 0x7f8c600a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:51:44.476 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.475+0000 7f8c74ff9700 1 -- 172.21.15.76:0/3621661817 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f8c680cc800 con 0x7f8c781020e0 2024-06-02T04:51:44.476 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.476+0000 7f8c777fe700 1 --2- 172.21.15.76:0/3621661817 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f8c600a11a0 0x7f8c600a3660 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c00b2e0 tx=0x7f8c6c00b610 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:51:44.476 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.476+0000 7f8c89d1fb80 1 Processor -- start 2024-06-02T04:51:44.478 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.477+0000 7f8c89d1fb80 1 -- start start 2024-06-02T04:51:44.478 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.477+0000 7f8c89d1fb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555afa306a80 0x555afa306ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:51:44.478 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.477+0000 7f8c89d1fb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555afa3073e0 0x555afa307cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:51:44.478 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.477+0000 7f8c89d1fb80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555afa3082d0 0x555afa308750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:51:44.478 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.477+0000 7f8c89d1fb80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x555afa25e0f0 con 0x555afa3082d0 2024-06-02T04:51:44.478 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.477+0000 7f8c89d1fb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x555afa25bab0 con 0x555afa3073e0 2024-06-02T04:51:44.478 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.477+0000 7f8c89d1fb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x555afa2573a0 con 0x555afa306a80 2024-06-02T04:51:44.478 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.477+0000 7f8c77fff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555afa3082d0 0x555afa308750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:51:44.478 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.477+0000 7f8c77fff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555afa3082d0 0x555afa308750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:35454/0 (socket says 172.21.15.76:35454) 2024-06-02T04:51:44.478 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.477+0000 7f8c77fff700 1 -- 172.21.15.76:0/2807518338 learned_addr learned my addr 172.21.15.76:0/2807518338 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:51:44.478 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.477+0000 7f8c77fff700 1 -- 172.21.15.76:0/2807518338 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555afa306a80 msgr2=0x555afa306ea0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-02T04:51:44.479 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.477+0000 7f8c77fff700 1 --2- 172.21.15.76:0/2807518338 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555afa306a80 0x555afa306ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:44.479 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.477+0000 7f8c77fff700 1 -- 172.21.15.76:0/2807518338 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555afa3073e0 msgr2=0x555afa307cf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-02T04:51:44.479 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.477+0000 7f8c77fff700 1 --2- 172.21.15.76:0/2807518338 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555afa3073e0 0x555afa307cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:44.479 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.477+0000 7f8c77fff700 1 -- 172.21.15.76:0/2807518338 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555afa0d8350 con 0x555afa3082d0 2024-06-02T04:51:44.479 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.478+0000 7f8c77fff700 1 --2- 172.21.15.76:0/2807518338 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555afa3082d0 0x555afa308750 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f8c70011680 tx=0x7f8c70009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84e270a9491d5fb3 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:51:44.479 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.478+0000 7f8c5dffb700 1 -- 172.21.15.76:0/2807518338 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c7000e040 con 0x555afa3082d0 2024-06-02T04:51:44.480 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.478+0000 7f8c5dffb700 1 -- 172.21.15.76:0/2807518338 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8c7000f040 con 0x555afa3082d0 2024-06-02T04:51:44.480 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.478+0000 7f8c5dffb700 1 -- 172.21.15.76:0/2807518338 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c70004790 con 0x555afa3082d0 2024-06-02T04:51:44.480 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.479+0000 7f8c89d1fb80 1 -- 172.21.15.76:0/2807518338 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555afa3082d0 msgr2=0x555afa308750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:51:44.480 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.479+0000 7f8c89d1fb80 1 --2- 172.21.15.76:0/2807518338 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555afa3082d0 0x555afa308750 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f8c70011680 tx=0x7f8c70009920 comp rx=0 tx=0).stop 2024-06-02T04:51:44.480 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.479+0000 7f8c89d1fb80 1 -- 172.21.15.76:0/2807518338 shutdown_connections 2024-06-02T04:51:44.480 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.479+0000 7f8c89d1fb80 1 --2- 172.21.15.76:0/2807518338 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555afa3082d0 0x555afa308750 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:44.480 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.479+0000 7f8c89d1fb80 1 --2- 172.21.15.76:0/2807518338 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555afa306a80 0x555afa306ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:44.480 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.479+0000 7f8c89d1fb80 1 --2- 172.21.15.76:0/2807518338 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555afa3073e0 0x555afa307cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:44.480 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.479+0000 7f8c89d1fb80 1 -- 172.21.15.76:0/2807518338 >> 172.21.15.76:0/2807518338 conn(0x555afa2651b0 msgr2=0x555afa303440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:51:44.481 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.480+0000 7f8c89d1fb80 1 -- 172.21.15.76:0/2807518338 shutdown_connections 2024-06-02T04:51:44.481 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.480+0000 7f8c89d1fb80 1 -- 172.21.15.76:0/2807518338 wait complete. 2024-06-02T04:51:44.481 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.481+0000 7f8c89d1fb80 1 -- start start 2024-06-02T04:51:44.482 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.481+0000 7f8c89d1fb80 1 Processor -- start 2024-06-02T04:51:44.483 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.481+0000 7f8c89d1fb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555afa306a80 0x555afa310960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:51:44.483 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.482+0000 7f8c89d1fb80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555afa3073e0 0x555afa310ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:51:44.483 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.482+0000 7f8c89d1fb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555afa3082d0 0x555afa317ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:51:44.483 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.482+0000 7f8c89d1fb80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x555afa1f3500 con 0x555afa3073e0 2024-06-02T04:51:44.483 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.482+0000 7f8c89d1fb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x555afa1f31a0 con 0x555afa3082d0 2024-06-02T04:51:44.483 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.482+0000 7f8c89d1fb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x555afa0da640 con 0x555afa306a80 2024-06-02T04:51:44.484 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.482+0000 7f8c89d1fb80 10 client.0 _ll_register_callbacks cb 0x555afa1fcad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:51:44.484 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.482+0000 7f8c76ffd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555afa3073e0 0x555afa310ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:51:44.484 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.482+0000 7f8c76ffd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555afa3073e0 0x555afa310ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:35460/0 (socket says 172.21.15.76:35460) 2024-06-02T04:51:44.484 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.482+0000 7f8c76ffd700 1 -- 172.21.15.76:0/3279331877 learned_addr learned my addr 172.21.15.76:0/3279331877 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:51:44.484 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.482+0000 7f8c77fff700 1 --2- 172.21.15.76:0/3279331877 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555afa3082d0 0x555afa317ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:51:44.484 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.482+0000 7f8c777fe700 1 --2- 172.21.15.76:0/3279331877 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555afa306a80 0x555afa310960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:51:44.484 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.482+0000 7f8c76ffd700 1 -- 172.21.15.76:0/3279331877 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555afa306a80 msgr2=0x555afa310960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:51:44.484 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.482+0000 7f8c76ffd700 1 --2- 172.21.15.76:0/3279331877 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555afa306a80 0x555afa310960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:44.484 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.482+0000 7f8c76ffd700 1 -- 172.21.15.76:0/3279331877 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555afa3082d0 msgr2=0x555afa317ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:51:44.484 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.482+0000 7f8c76ffd700 1 --2- 172.21.15.76:0/3279331877 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555afa3082d0 0x555afa317ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:44.484 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.482+0000 7f8c76ffd700 1 -- 172.21.15.76:0/3279331877 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c70011330 con 0x555afa3073e0 2024-06-02T04:51:44.484 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.482+0000 7f8c76ffd700 1 --2- 172.21.15.76:0/3279331877 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555afa3073e0 0x555afa310ea0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f8c68099840 tx=0x7f8c6800d620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10ff602a9807dedf server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:51:44.485 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.482+0000 7f8c56ffd700 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-06-02T04:51:44.485 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.483+0000 7f8c56ffd700 1 -- 172.21.15.76:0/3279331877 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c680b7ea0 con 0x555afa3073e0 2024-06-02T04:51:44.485 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.483+0000 7f8c56ffd700 1 -- 172.21.15.76:0/3279331877 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f8c680998b0 con 0x555afa3073e0 2024-06-02T04:51:44.485 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.483+0000 7f8c89d1fb80 1 -- 172.21.15.76:0/3279331877 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555afa1b0210 con 0x555afa3073e0 2024-06-02T04:51:44.485 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.483+0000 7f8c56ffd700 1 -- 172.21.15.76:0/3279331877 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8c6809d6e0 con 0x555afa3073e0 2024-06-02T04:51:44.485 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.483+0000 7f8c89d1fb80 10 client.15933 fetch_fsmap learned FSMap version 29 2024-06-02T04:51:44.485 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.483+0000 7f8c89d1fb80 1 -- 172.21.15.76:0/3279331877 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x555afa084b00 con 0x555afa3073e0 2024-06-02T04:51:44.486 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.483+0000 7f8c56ffd700 1 -- 172.21.15.76:0/3279331877 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x555afa1b0210 con 0x555afa3073e0 2024-06-02T04:51:44.486 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.483+0000 7f8c56ffd700 1 -- 172.21.15.76:0/3279331877 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 29) v1 ==== 7482+0+0 (secure 0 0 0) 0x7f8c68099ba0 con 0x555afa3073e0 2024-06-02T04:51:44.486 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.484+0000 7f8c89d1fb80 10 client.15933 fetch_fsmap finished waiting for FSMap version 29 2024-06-02T04:51:44.486 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.484+0000 7f8c89d1fb80 10 client.15933 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T04:51:44.486 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.484+0000 7f8c89d1fb80 20 client.15933 populate_metadata read hostname 'smithi076' 2024-06-02T04:51:44.486 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.484+0000 7f8c89d1fb80 1 --2- 172.21.15.76:0/3279331877 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x555afa32d6c0 0x555afa32fae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:51:44.487 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.484+0000 7f8c89d1fb80 4 client.15933 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T04:51:44.487 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.484+0000 7f8c89d1fb80 1 -- 172.21.15.76:0/3279331877 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555afa2d67b0 con 0x555afa32d6c0 2024-06-02T04:51:44.487 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.484+0000 7f8c777fe700 1 --2- 172.21.15.76:0/3279331877 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x555afa32d6c0 0x555afa32fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:51:44.487 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.485+0000 7f8c56ffd700 10 client.15933 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:51:44.487 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.485+0000 7f8c777fe700 1 --2- 172.21.15.76:0/3279331877 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x555afa32d6c0 0x555afa32fae0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=db235c59707defa4 server_cookie=95006a8648a402c3 in_seq=0 out_seq=0 2024-06-02T04:51:44.487 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.485+0000 7f8c56ffd700 1 -- 172.21.15.76:0/3279331877 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x555afa2d67b0 con 0x555afa32d6c0 2024-06-02T04:51:44.487 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.485+0000 7f8c56ffd700 10 client.15933 handle_command_reply: tid=0 2024-06-02T04:51:44.487 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.486+0000 7f8c89d1fb80 1 client.15933 shutdown 2024-06-02T04:51:44.488 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.486+0000 7f8c89d1fb80 1 -- 172.21.15.76:0/3279331877 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555afa3073e0 msgr2=0x555afa310ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:51:44.488 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.486+0000 7f8c89d1fb80 1 --2- 172.21.15.76:0/3279331877 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555afa3073e0 0x555afa310ea0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f8c68099840 tx=0x7f8c6800d620 comp rx=0 tx=0).stop 2024-06-02T04:51:44.488 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.486+0000 7f8c89d1fb80 1 -- 172.21.15.76:0/3279331877 shutdown_connections 2024-06-02T04:51:44.488 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.486+0000 7f8c89d1fb80 1 --2- 172.21.15.76:0/3279331877 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x555afa32d6c0 0x555afa32fae0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:44.488 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.486+0000 7f8c89d1fb80 1 --2- 172.21.15.76:0/3279331877 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555afa3082d0 0x555afa317ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:44.488 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.486+0000 7f8c89d1fb80 1 --2- 172.21.15.76:0/3279331877 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555afa306a80 0x555afa310960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:44.488 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.486+0000 7f8c56ffd700 0 client.15933 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:51:44.488 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.486+0000 7f8c89d1fb80 1 --2- 172.21.15.76:0/3279331877 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555afa3073e0 0x555afa310ea0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:44.488 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.486+0000 7f8c89d1fb80 1 -- 172.21.15.76:0/3279331877 >> 172.21.15.76:0/3279331877 conn(0x555afa2651b0 msgr2=0x555afa301860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:51:44.489 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.488+0000 7f8c89d1fb80 1 -- 172.21.15.76:0/3279331877 shutdown_connections 2024-06-02T04:51:44.489 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.489+0000 7f8c89d1fb80 1 -- 172.21.15.76:0/3279331877 wait complete. 2024-06-02T04:51:44.491 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.489+0000 7f8c89d1fb80 20 client.15933 trim_cache size 0 max 16384 2024-06-02T04:51:44.515 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.514+0000 7f8c89d1fb80 1 Processor -- start 2024-06-02T04:51:44.515 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.514+0000 7f8c89d1fb80 1 -- start start 2024-06-02T04:51:44.516 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.515+0000 7f8c89d1fb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555afa306a80 0x555afa3086b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:51:44.516 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.515+0000 7f8c89d1fb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555afa3073e0 0x555afa317ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:51:44.516 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.515+0000 7f8c89d1fb80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555afa3082d0 0x555afa334400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:51:44.516 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.515+0000 7f8c89d1fb80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x555afa3104d0 con 0x555afa3082d0 2024-06-02T04:51:44.516 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.515+0000 7f8c89d1fb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x555afa302bc0 con 0x555afa306a80 2024-06-02T04:51:44.516 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.515+0000 7f8c89d1fb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x555afa330140 con 0x555afa3073e0 2024-06-02T04:51:44.516 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.515+0000 7f8c76ffd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555afa3073e0 0x555afa317ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:51:44.516 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.515+0000 7f8c76ffd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555afa3073e0 0x555afa317ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:45846/0 (socket says 172.21.15.76:45846) 2024-06-02T04:51:44.516 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.515+0000 7f8c76ffd700 1 -- 172.21.15.76:0/1150803345 learned_addr learned my addr 172.21.15.76:0/1150803345 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:51:44.517 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.516+0000 7f8c76ffd700 1 -- 172.21.15.76:0/1150803345 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555afa306a80 msgr2=0x555afa3086b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-02T04:51:44.517 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.516+0000 7f8c76ffd700 1 --2- 172.21.15.76:0/1150803345 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555afa306a80 0x555afa3086b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:44.517 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.516+0000 7f8c76ffd700 1 -- 172.21.15.76:0/1150803345 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555afa3082d0 msgr2=0x555afa334400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:51:44.517 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.516+0000 7f8c76ffd700 1 --2- 172.21.15.76:0/1150803345 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555afa3082d0 0x555afa334400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:44.517 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.516+0000 7f8c76ffd700 1 -- 172.21.15.76:0/1150803345 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555afa21d500 con 0x555afa3073e0 2024-06-02T04:51:44.518 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.516+0000 7f8c76ffd700 1 --2- 172.21.15.76:0/1150803345 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555afa3073e0 0x555afa317ea0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8c6801c030 tx=0x7f8c68097e60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=382285a5e45f50dd server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:51:44.518 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.516+0000 7f8c5e7fc700 1 -- 172.21.15.76:0/1150803345 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c680b7ea0 con 0x555afa3073e0 2024-06-02T04:51:44.518 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.516+0000 7f8c5e7fc700 1 -- 172.21.15.76:0/1150803345 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8c68095bf0 con 0x555afa3073e0 2024-06-02T04:51:44.518 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.516+0000 7f8c5e7fc700 1 -- 172.21.15.76:0/1150803345 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c680a1d30 con 0x555afa3073e0 2024-06-02T04:51:44.518 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.517+0000 7f8c89d1fb80 1 -- 172.21.15.76:0/1150803345 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555afa3073e0 msgr2=0x555afa317ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:51:44.518 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.517+0000 7f8c89d1fb80 1 --2- 172.21.15.76:0/1150803345 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555afa3073e0 0x555afa317ea0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8c6801c030 tx=0x7f8c68097e60 comp rx=0 tx=0).stop 2024-06-02T04:51:44.518 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.517+0000 7f8c89d1fb80 1 -- 172.21.15.76:0/1150803345 shutdown_connections 2024-06-02T04:51:44.518 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.517+0000 7f8c89d1fb80 1 --2- 172.21.15.76:0/1150803345 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555afa3082d0 0x555afa334400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:44.518 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.517+0000 7f8c89d1fb80 1 --2- 172.21.15.76:0/1150803345 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555afa306a80 0x555afa3086b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:44.519 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.517+0000 7f8c89d1fb80 1 --2- 172.21.15.76:0/1150803345 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555afa3073e0 0x555afa317ea0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:44.519 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.517+0000 7f8c89d1fb80 1 -- 172.21.15.76:0/1150803345 >> 172.21.15.76:0/1150803345 conn(0x555afa2651b0 msgr2=0x555afa30e8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:51:44.519 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.517+0000 7f8c89d1fb80 1 -- 172.21.15.76:0/1150803345 shutdown_connections 2024-06-02T04:51:44.519 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.517+0000 7f8c89d1fb80 1 -- 172.21.15.76:0/1150803345 wait complete. 2024-06-02T04:51:44.519 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.518+0000 7f8c89d1fb80 1 -- start start 2024-06-02T04:51:44.519 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.518+0000 7f8c89d1fb80 1 Processor -- start 2024-06-02T04:51:44.520 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.518+0000 7f8c89d1fb80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555afa306a80 0x555afa315720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:51:44.520 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.518+0000 7f8c89d1fb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555afa3073e0 0x555afa315c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:51:44.520 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.518+0000 7f8c89d1fb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555afa3082d0 0x555afa316ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:51:44.520 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.518+0000 7f8c89d1fb80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x555afa317020 con 0x555afa306a80 2024-06-02T04:51:44.520 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.518+0000 7f8c89d1fb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x555afa317190 con 0x555afa3082d0 2024-06-02T04:51:44.520 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.518+0000 7f8c89d1fb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x555afa317300 con 0x555afa3073e0 2024-06-02T04:51:44.520 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.518+0000 7f8c89d1fb80 10 client.0 _ll_register_callbacks cb 0x555afa1fcad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:51:44.520 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.519+0000 7f8c77fff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555afa3082d0 0x555afa316ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:51:44.520 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.519+0000 7f8c77fff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555afa3082d0 0x555afa316ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:42980/0 (socket says 172.21.15.76:42980) 2024-06-02T04:51:44.520 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.519+0000 7f8c77fff700 1 -- 172.21.15.76:0/1033796663 learned_addr learned my addr 172.21.15.76:0/1033796663 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:51:44.521 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.520+0000 7f8c77fff700 1 -- 172.21.15.76:0/1033796663 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555afa3073e0 msgr2=0x555afa315c60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-02T04:51:44.521 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.520+0000 7f8c77fff700 1 --2- 172.21.15.76:0/1033796663 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555afa3073e0 0x555afa315c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:44.521 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.520+0000 7f8c77fff700 1 -- 172.21.15.76:0/1033796663 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555afa306a80 msgr2=0x555afa315720 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-02T04:51:44.521 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.520+0000 7f8c77fff700 1 --2- 172.21.15.76:0/1033796663 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555afa306a80 0x555afa315720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:44.521 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.520+0000 7f8c77fff700 1 -- 172.21.15.76:0/1033796663 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555afa084b00 con 0x555afa3082d0 2024-06-02T04:51:44.521 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.520+0000 7f8c77fff700 1 --2- 172.21.15.76:0/1033796663 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555afa3082d0 0x555afa316ae0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8c70012010 tx=0x7f8c700056e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9af54347cc55b54e server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:51:44.521 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.520+0000 7f8c56ffd700 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-06-02T04:51:44.522 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.521+0000 7f8c56ffd700 1 -- 172.21.15.76:0/1033796663 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c7000e050 con 0x555afa3082d0 2024-06-02T04:51:44.522 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.522+0000 7f8c56ffd700 1 -- 172.21.15.76:0/1033796663 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f8c70003fb0 con 0x555afa3082d0 2024-06-02T04:51:44.522 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.522+0000 7f8c89d1fb80 1 -- 172.21.15.76:0/1033796663 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8c7000f040 con 0x555afa3082d0 2024-06-02T04:51:44.522 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.522+0000 7f8c56ffd700 1 -- 172.21.15.76:0/1033796663 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8c70009ac0 con 0x555afa3082d0 2024-06-02T04:51:44.522 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.522+0000 7f8c89d1fb80 10 client.25463 fetch_fsmap learned FSMap version 29 2024-06-02T04:51:44.523 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.522+0000 7f8c89d1fb80 1 -- 172.21.15.76:0/1033796663 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x555afa0dcc70 con 0x555afa3082d0 2024-06-02T04:51:44.523 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.522+0000 7f8c56ffd700 1 -- 172.21.15.76:0/1033796663 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8c7000f040 con 0x555afa3082d0 2024-06-02T04:51:44.523 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.523+0000 7f8c56ffd700 1 -- 172.21.15.76:0/1033796663 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 29) v1 ==== 7482+0+0 (secure 0 0 0) 0x7f8c70027470 con 0x555afa3082d0 2024-06-02T04:51:44.524 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.523+0000 7f8c89d1fb80 10 client.25463 fetch_fsmap finished waiting for FSMap version 29 2024-06-02T04:51:44.524 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.523+0000 7f8c89d1fb80 10 client.25463 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T04:51:44.524 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.523+0000 7f8c89d1fb80 20 client.25463 populate_metadata read hostname 'smithi076' 2024-06-02T04:51:44.524 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.523+0000 7f8c89d1fb80 1 --2- 172.21.15.76:0/1033796663 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x555afa384420 0x555afa386840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:51:44.524 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.523+0000 7f8c89d1fb80 4 client.25463 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T04:51:44.524 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.523+0000 7f8c89d1fb80 1 -- 172.21.15.76:0/1033796663 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x555afa24fe60 con 0x555afa384420 2024-06-02T04:51:44.524 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.523+0000 7f8c777fe700 1 --2- 172.21.15.76:0/1033796663 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x555afa384420 0x555afa386840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:51:44.524 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.523+0000 7f8c777fe700 1 --2- 172.21.15.76:0/1033796663 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x555afa384420 0x555afa386840 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=202b43daf03b10f4 server_cookie=ae2b26aa6d452ca1 in_seq=0 out_seq=0 2024-06-02T04:51:44.524 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.523+0000 7f8c56ffd700 10 client.25463 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:51:44.543 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.542+0000 7f8c56ffd700 1 -- 172.21.15.76:0/1033796663 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x555afa24fe60 con 0x555afa384420 2024-06-02T04:51:44.543 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.542+0000 7f8c56ffd700 10 client.25463 handle_command_reply: tid=0 2024-06-02T04:51:44.543 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.542+0000 7f8c89d1fb80 1 client.25463 shutdown 2024-06-02T04:51:44.543 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.542+0000 7f8c89d1fb80 1 -- 172.21.15.76:0/1033796663 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555afa3082d0 msgr2=0x555afa316ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:51:44.543 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.542+0000 7f8c89d1fb80 1 --2- 172.21.15.76:0/1033796663 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555afa3082d0 0x555afa316ae0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8c70012010 tx=0x7f8c700056e0 comp rx=0 tx=0).stop 2024-06-02T04:51:44.543 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.542+0000 7f8c89d1fb80 1 -- 172.21.15.76:0/1033796663 shutdown_connections 2024-06-02T04:51:44.543 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.542+0000 7f8c89d1fb80 1 --2- 172.21.15.76:0/1033796663 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x555afa384420 0x555afa386840 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:44.543 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.542+0000 7f8c89d1fb80 1 --2- 172.21.15.76:0/1033796663 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555afa3082d0 0x555afa316ae0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:44.543 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.543+0000 7f8c89d1fb80 1 --2- 172.21.15.76:0/1033796663 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555afa306a80 0x555afa315720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:44.544 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.543+0000 7f8c89d1fb80 1 --2- 172.21.15.76:0/1033796663 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555afa3073e0 0x555afa315c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:44.544 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.543+0000 7f8c89d1fb80 1 -- 172.21.15.76:0/1033796663 >> 172.21.15.76:0/1033796663 conn(0x555afa2651b0 msgr2=0x555afa334400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:51:44.544 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.543+0000 7f8c56ffd700 0 client.25463 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:51:44.544 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.543+0000 7f8c89d1fb80 1 -- 172.21.15.76:0/1033796663 shutdown_connections 2024-06-02T04:51:44.544 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.543+0000 7f8c89d1fb80 1 -- 172.21.15.76:0/1033796663 wait complete. 2024-06-02T04:51:44.544 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.543+0000 7f8c89d1fb80 20 client.25463 trim_cache size 0 max 16384 2024-06-02T04:51:44.545 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:{ 2024-06-02T04:51:44.545 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "message": "", 2024-06-02T04:51:44.545 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "return_code": 0 2024-06-02T04:51:44.545 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:} 2024-06-02T04:51:44.545 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.543+0000 7f8c7db64700 1 -- 172.21.15.76:0/3621661817 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f8c600a11a0 msgr2=0x7f8c600a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:51:44.546 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.543+0000 7f8c7db64700 1 --2- 172.21.15.76:0/3621661817 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f8c600a11a0 0x7f8c600a3660 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c00b2e0 tx=0x7f8c6c00b610 comp rx=0 tx=0).stop 2024-06-02T04:51:44.546 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.543+0000 7f8c7db64700 1 -- 172.21.15.76:0/3621661817 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8c781020e0 msgr2=0x7f8c7819d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:51:44.546 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.543+0000 7f8c7db64700 1 --2- 172.21.15.76:0/3621661817 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8c781020e0 0x7f8c7819d8d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8c6800c970 tx=0x7f8c6800cc80 comp rx=0 tx=0).stop 2024-06-02T04:51:44.546 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.544+0000 7f8c7db64700 1 -- 172.21.15.76:0/3621661817 shutdown_connections 2024-06-02T04:51:44.546 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.544+0000 7f8c7db64700 1 --2- 172.21.15.76:0/3621661817 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8c78104ab0 0x7f8c781a48a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:44.546 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.544+0000 7f8c7db64700 1 --2- 172.21.15.76:0/3621661817 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f8c600a11a0 0x7f8c600a3660 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:44.546 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.544+0000 7f8c7db64700 1 --2- 172.21.15.76:0/3621661817 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c780ff770 0x7f8c7819d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:44.546 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.544+0000 7f8c7db64700 1 --2- 172.21.15.76:0/3621661817 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8c781020e0 0x7f8c7819d8d0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:44.546 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.544+0000 7f8c7db64700 1 -- 172.21.15.76:0/3621661817 >> 172.21.15.76:0/3621661817 conn(0x7f8c780fb390 msgr2=0x7f8c78102c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:51:44.546 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.544+0000 7f8c7db64700 1 -- 172.21.15.76:0/3621661817 shutdown_connections 2024-06-02T04:51:44.546 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:44.544+0000 7f8c7db64700 1 -- 172.21.15.76:0/3621661817 wait complete. 2024-06-02T04:51:45.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:51:45 smithi192 ceph-mon[47933]: pgmap v333: 129 pgs: 129 active+clean; 1.2 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 16 MiB/s wr, 1.02k op/s 2024-06-02T04:51:45.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:51:45 smithi076 ceph-mon[42935]: pgmap v333: 129 pgs: 129 active+clean; 1.2 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 16 MiB/s wr, 1.02k op/s 2024-06-02T04:51:45.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:51:45 smithi119 ceph-mon[46633]: pgmap v333: 129 pgs: 129 active+clean; 1.2 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 16 MiB/s wr, 1.02k op/s 2024-06-02T04:51:46.314 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 55.0 s, 938.2 tps, lat 122.349 ms stddev 503.900 2024-06-02T04:51:47.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:51:47 smithi192 ceph-mon[47933]: pgmap v334: 129 pgs: 129 active+clean; 1.2 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 18 MiB/s wr, 1.21k op/s 2024-06-02T04:51:47.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:51:47 smithi076 ceph-mon[42935]: pgmap v334: 129 pgs: 129 active+clean; 1.2 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 18 MiB/s wr, 1.21k op/s 2024-06-02T04:51:47.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:51:47 smithi119 ceph-mon[46633]: pgmap v334: 129 pgs: 129 active+clean; 1.2 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 18 MiB/s wr, 1.21k op/s 2024-06-02T04:51:49.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:51:49 smithi192 ceph-mon[47933]: pgmap v335: 129 pgs: 129 active+clean; 1.2 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 19 MiB/s wr, 1.22k op/s 2024-06-02T04:51:49.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:51:49 smithi076 ceph-mon[42935]: pgmap v335: 129 pgs: 129 active+clean; 1.2 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 19 MiB/s wr, 1.22k op/s 2024-06-02T04:51:49.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:51:49 smithi119 ceph-mon[46633]: pgmap v335: 129 pgs: 129 active+clean; 1.2 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 19 MiB/s wr, 1.22k op/s 2024-06-02T04:51:51.314 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 60.0 s, 900.2 tps, lat 110.955 ms stddev 134.980 2024-06-02T04:51:51.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:51:51 smithi192 ceph-mon[47933]: pgmap v336: 129 pgs: 129 active+clean; 1.2 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 17 MiB/s wr, 1.11k op/s 2024-06-02T04:51:51.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:51:51 smithi076 ceph-mon[42935]: pgmap v336: 129 pgs: 129 active+clean; 1.2 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 17 MiB/s wr, 1.11k op/s 2024-06-02T04:51:51.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:51:51 smithi119 ceph-mon[46633]: pgmap v336: 129 pgs: 129 active+clean; 1.2 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 17 MiB/s wr, 1.11k op/s 2024-06-02T04:51:53.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:51:53 smithi192 ceph-mon[47933]: pgmap v337: 129 pgs: 129 active+clean; 1.3 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 18 MiB/s wr, 1.25k op/s 2024-06-02T04:51:53.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:51:53 smithi076 ceph-mon[42935]: pgmap v337: 129 pgs: 129 active+clean; 1.3 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 18 MiB/s wr, 1.25k op/s 2024-06-02T04:51:53.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:51:53 smithi119 ceph-mon[46633]: pgmap v337: 129 pgs: 129 active+clean; 1.3 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 18 MiB/s wr, 1.25k op/s 2024-06-02T04:51:54.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:51:54 smithi192 ceph-mon[47933]: pgmap v338: 129 pgs: 129 active+clean; 1.3 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 15 MiB/s wr, 1.02k op/s 2024-06-02T04:51:54.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:51:54 smithi076 ceph-mon[42935]: pgmap v338: 129 pgs: 129 active+clean; 1.3 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 15 MiB/s wr, 1.02k op/s 2024-06-02T04:51:54.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:51:54 smithi119 ceph-mon[46633]: pgmap v338: 129 pgs: 129 active+clean; 1.3 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 15 MiB/s wr, 1.02k op/s 2024-06-02T04:51:56.314 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 65.0 s, 997.0 tps, lat 100.129 ms stddev 120.317 2024-06-02T04:51:57.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:51:57 smithi119 ceph-mon[46633]: pgmap v339: 129 pgs: 129 active+clean; 1.3 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 17 MiB/s wr, 1.22k op/s 2024-06-02T04:51:57.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:51:57 smithi192 ceph-mon[47933]: pgmap v339: 129 pgs: 129 active+clean; 1.3 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 17 MiB/s wr, 1.22k op/s 2024-06-02T04:51:57.711 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.711+0000 7fb10706b700 1 -- 172.21.15.76:0/377449574 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1000ff580 msgr2=0x7fb1000ff9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:51:57.711 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.711+0000 7fb10706b700 1 --2- 172.21.15.76:0/377449574 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1000ff580 0x7fb1000ff9a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb0f4009920 tx=0x7fb0f4009c30 comp rx=0 tx=0).stop 2024-06-02T04:51:57.712 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.711+0000 7fb10706b700 1 -- 172.21.15.76:0/377449574 shutdown_connections 2024-06-02T04:51:57.712 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.711+0000 7fb10706b700 1 --2- 172.21.15.76:0/377449574 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb100101110 0x7fb1001079c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:57.712 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.711+0000 7fb10706b700 1 --2- 172.21.15.76:0/377449574 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1000ff580 0x7fb1000ff9a0 secure :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb0f4009920 tx=0x7fb0f4009c30 comp rx=0 tx=0).stop 2024-06-02T04:51:57.712 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.711+0000 7fb10706b700 1 --2- 172.21.15.76:0/377449574 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb100100770 0x7fb100100bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:57.713 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.711+0000 7fb10706b700 1 -- 172.21.15.76:0/377449574 >> 172.21.15.76:0/377449574 conn(0x7fb1000faaf0 msgr2=0x7fb1000fcf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:51:57.713 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.712+0000 7fb10706b700 1 -- 172.21.15.76:0/377449574 shutdown_connections 2024-06-02T04:51:57.713 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.712+0000 7fb10706b700 1 -- 172.21.15.76:0/377449574 wait complete. 2024-06-02T04:51:57.715 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.713+0000 7fb10706b700 1 Processor -- start 2024-06-02T04:51:57.715 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.713+0000 7fb10706b700 1 -- start start 2024-06-02T04:51:57.715 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.713+0000 7fb10706b700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb100100770 0x7fb1001970a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:51:57.715 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.713+0000 7fb10706b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb100101110 0x7fb1001975e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:51:57.715 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.713+0000 7fb10706b700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb10019c5f0 0x7fb10019e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:51:57.716 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.713+0000 7fb10706b700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb10019efb0 con 0x7fb10019c5f0 2024-06-02T04:51:57.716 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.713+0000 7fb10706b700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb10006a9c0 con 0x7fb100100770 2024-06-02T04:51:57.716 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.713+0000 7fb10706b700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb10006ab50 con 0x7fb100101110 2024-06-02T04:51:57.716 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.713+0000 7fb104e07700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb100100770 0x7fb1001970a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:51:57.716 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.713+0000 7fb104e07700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb100100770 0x7fb1001970a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:52434/0 (socket says 172.21.15.76:52434) 2024-06-02T04:51:57.717 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.713+0000 7fb104e07700 1 -- 172.21.15.76:0/325942608 learned_addr learned my addr 172.21.15.76:0/325942608 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:51:57.717 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.713+0000 7fb105608700 1 --2- 172.21.15.76:0/325942608 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb10019c5f0 0x7fb10019e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:51:57.717 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.714+0000 7fb0fffff700 1 --2- 172.21.15.76:0/325942608 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb100101110 0x7fb1001975e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:51:57.717 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.714+0000 7fb105608700 1 -- 172.21.15.76:0/325942608 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb100101110 msgr2=0x7fb1001975e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:51:57.717 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.714+0000 7fb105608700 1 --2- 172.21.15.76:0/325942608 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb100101110 0x7fb1001975e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:57.717 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.714+0000 7fb105608700 1 -- 172.21.15.76:0/325942608 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb100100770 msgr2=0x7fb1001970a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:51:57.718 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.714+0000 7fb105608700 1 --2- 172.21.15.76:0/325942608 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb100100770 0x7fb1001970a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:57.718 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.714+0000 7fb105608700 1 -- 172.21.15.76:0/325942608 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0f4009520 con 0x7fb10019c5f0 2024-06-02T04:51:57.718 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.714+0000 7fb0fffff700 1 --2- 172.21.15.76:0/325942608 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb100101110 0x7fb1001975e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:51:57.718 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.714+0000 7fb105608700 1 --2- 172.21.15.76:0/325942608 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb10019c5f0 0x7fb10019e9e0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fb0f8008560 tx=0x7fb0f8009d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:51:57.719 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.716+0000 7fb0fdffb700 1 -- 172.21.15.76:0/325942608 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f8003e30 con 0x7fb10019c5f0 2024-06-02T04:51:57.719 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.716+0000 7fb0fdffb700 1 -- 172.21.15.76:0/325942608 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb0f8007d40 con 0x7fb10019c5f0 2024-06-02T04:51:57.719 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.716+0000 7fb0fdffb700 1 -- 172.21.15.76:0/325942608 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f8013550 con 0x7fb10019c5f0 2024-06-02T04:51:57.720 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.716+0000 7fb10706b700 1 -- 172.21.15.76:0/325942608 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb100103a00 con 0x7fb10019c5f0 2024-06-02T04:51:57.720 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.716+0000 7fb10706b700 1 -- 172.21.15.76:0/325942608 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb100103ec0 con 0x7fb10019c5f0 2024-06-02T04:51:57.721 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.720+0000 7fb0fdffb700 1 -- 172.21.15.76:0/325942608 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fb0f8019070 con 0x7fb10019c5f0 2024-06-02T04:51:57.721 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.720+0000 7fb113226b80 1 Processor -- start 2024-06-02T04:51:57.721 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.720+0000 7fb113226b80 1 -- start start 2024-06-02T04:51:57.724 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.721+0000 7fb0fdffb700 1 --2- 172.21.15.76:0/325942608 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fb0f00a1270 0x7fb0f00a3730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:51:57.724 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.721+0000 7fb0fdffb700 1 -- 172.21.15.76:0/325942608 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7fb0f80d0280 con 0x7fb10019c5f0 2024-06-02T04:51:57.724 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.722+0000 7fb113226b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cd47d23290 0x55cd47d236b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:51:57.724 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.722+0000 7fb113226b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cd47d23bf0 0x55cd47d24500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:51:57.724 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.722+0000 7fb113226b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cd47d24ae0 0x55cd47d24f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:51:57.725 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.722+0000 7fb113226b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd47c720f0 con 0x55cd47d24ae0 2024-06-02T04:51:57.725 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.722+0000 7fb113226b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd47c6fab0 con 0x55cd47d23290 2024-06-02T04:51:57.725 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.722+0000 7fb113226b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd47c6b3a0 con 0x55cd47d23bf0 2024-06-02T04:51:57.725 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.722+0000 7fb0fffff700 1 --2- 172.21.15.76:0/325942608 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fb0f00a1270 0x7fb0f00a3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:51:57.725 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.722+0000 7fb0fffff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cd47d23bf0 0x55cd47d24500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:51:57.726 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.722+0000 7fb0fffff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cd47d23bf0 0x55cd47d24500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:52950/0 (socket says 172.21.15.76:52950) 2024-06-02T04:51:57.726 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.722+0000 7fb0fffff700 1 -- 172.21.15.76:0/1739663954 learned_addr learned my addr 172.21.15.76:0/1739663954 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:51:57.726 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.722+0000 7fb0fffff700 1 -- 172.21.15.76:0/1739663954 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cd47d23290 msgr2=0x55cd47d236b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:51:57.726 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.722+0000 7fb104e07700 1 --2- 172.21.15.76:0/1739663954 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cd47d23290 0x55cd47d236b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:51:57.727 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.723+0000 7fb0fffff700 1 --2- 172.21.15.76:0/1739663954 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cd47d23290 0x55cd47d236b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:57.727 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.723+0000 7fb0fffff700 1 -- 172.21.15.76:0/1739663954 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cd47d24ae0 msgr2=0x55cd47d24f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:51:57.727 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.723+0000 7fb0fffff700 1 --2- 172.21.15.76:0/1739663954 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cd47d24ae0 0x55cd47d24f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:57.727 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.723+0000 7fb0fffff700 1 -- 172.21.15.76:0/1739663954 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cd47aec350 con 0x55cd47d23bf0 2024-06-02T04:51:57.728 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.723+0000 7fb0fffff700 1 --2- 172.21.15.76:0/1739663954 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cd47d23bf0 0x55cd47d24500 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb0ec014d40 tx=0x7fb0ec011660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1060fb6ddcb24a40 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:51:57.728 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.723+0000 7fb0eaffd700 1 -- 172.21.15.76:0/1739663954 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0ec00b490 con 0x55cd47d23bf0 2024-06-02T04:51:57.728 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.723+0000 7fb0fffff700 1 --2- 172.21.15.76:0/325942608 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fb0f00a1270 0x7fb0f00a3730 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fb0ec011a60 tx=0x7fb0ec00f000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:51:57.728 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.723+0000 7fb0eaffd700 1 -- 172.21.15.76:0/1739663954 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb0ec01a040 con 0x55cd47d23bf0 2024-06-02T04:51:57.728 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.723+0000 7fb0eaffd700 1 -- 172.21.15.76:0/1739663954 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0ec0038e0 con 0x55cd47d23bf0 2024-06-02T04:51:57.733 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.724+0000 7fb113226b80 1 -- 172.21.15.76:0/1739663954 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cd47d23bf0 msgr2=0x55cd47d24500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:51:57.733 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.724+0000 7fb113226b80 1 --2- 172.21.15.76:0/1739663954 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cd47d23bf0 0x55cd47d24500 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb0ec014d40 tx=0x7fb0ec011660 comp rx=0 tx=0).stop 2024-06-02T04:51:57.733 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.724+0000 7fb113226b80 1 -- 172.21.15.76:0/1739663954 shutdown_connections 2024-06-02T04:51:57.733 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.724+0000 7fb113226b80 1 --2- 172.21.15.76:0/1739663954 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cd47d24ae0 0x55cd47d24f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:57.733 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.724+0000 7fb113226b80 1 --2- 172.21.15.76:0/1739663954 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cd47d23290 0x55cd47d236b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:57.734 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.724+0000 7fb113226b80 1 --2- 172.21.15.76:0/1739663954 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cd47d23bf0 0x55cd47d24500 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:57.734 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.724+0000 7fb113226b80 1 -- 172.21.15.76:0/1739663954 >> 172.21.15.76:0/1739663954 conn(0x55cd47c791b0 msgr2=0x55cd47d17440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:51:57.734 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.725+0000 7fb113226b80 1 -- 172.21.15.76:0/1739663954 shutdown_connections 2024-06-02T04:51:57.735 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.725+0000 7fb113226b80 1 -- 172.21.15.76:0/1739663954 wait complete. 2024-06-02T04:51:57.735 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.725+0000 7fb113226b80 1 -- start start 2024-06-02T04:51:57.735 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.725+0000 7fb113226b80 1 Processor -- start 2024-06-02T04:51:57.735 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.726+0000 7fb113226b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cd47d23290 0x55cd47d2d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:51:57.735 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.726+0000 7fb113226b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cd47d23bf0 0x55cd47d2d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:51:57.735 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.726+0000 7fb113226b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cd47d24ae0 0x55cd47d34710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:51:57.736 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.726+0000 7fb113226b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd47c07500 con 0x55cd47d24ae0 2024-06-02T04:51:57.736 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.726+0000 7fb113226b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd47c071a0 con 0x55cd47d23290 2024-06-02T04:51:57.736 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.726+0000 7fb113226b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd47aee640 con 0x55cd47d23bf0 2024-06-02T04:51:57.736 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.726+0000 7fb113226b80 10 client.0 _ll_register_callbacks cb 0x55cd47c10ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:51:57.736 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.726+0000 7fb0fffff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cd47d23bf0 0x55cd47d2d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:51:57.737 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.726+0000 7fb0fffff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cd47d23bf0 0x55cd47d2d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:52956/0 (socket says 172.21.15.76:52956) 2024-06-02T04:51:57.737 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.726+0000 7fb0fffff700 1 -- 172.21.15.76:0/4069011117 learned_addr learned my addr 172.21.15.76:0/4069011117 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:51:57.737 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.726+0000 7fb104e07700 1 --2- 172.21.15.76:0/4069011117 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cd47d23290 0x55cd47d2d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:51:57.737 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.726+0000 7fb0fffff700 1 -- 172.21.15.76:0/4069011117 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cd47d23290 msgr2=0x55cd47d2d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:51:57.737 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.726+0000 7fb0fffff700 1 --2- 172.21.15.76:0/4069011117 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cd47d23290 0x55cd47d2d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:57.737 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.726+0000 7fb0fffff700 1 -- 172.21.15.76:0/4069011117 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cd47d24ae0 msgr2=0x55cd47d34710 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-02T04:51:57.738 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.726+0000 7fb0fffff700 1 --2- 172.21.15.76:0/4069011117 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cd47d24ae0 0x55cd47d34710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:57.738 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.726+0000 7fb0fffff700 1 -- 172.21.15.76:0/4069011117 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0ec014920 con 0x55cd47d23bf0 2024-06-02T04:51:57.738 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.727+0000 7fb0fffff700 1 --2- 172.21.15.76:0/4069011117 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cd47d23bf0 0x55cd47d2d6d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb0ec011270 tx=0x7fb0ec0047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd0751d4e30075a8 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:51:57.738 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.727+0000 7fb0dffff700 10 client.0 ms_handle_connect on v2:172.21.15.192:3300/0 2024-06-02T04:51:57.738 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.727+0000 7fb0dffff700 1 -- 172.21.15.76:0/4069011117 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0ec00e660 con 0x55cd47d23bf0 2024-06-02T04:51:57.739 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.727+0000 7fb113226b80 1 -- 172.21.15.76:0/4069011117 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cd47bc4210 con 0x55cd47d23bf0 2024-06-02T04:51:57.739 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.727+0000 7fb0dffff700 1 -- 172.21.15.76:0/4069011117 <== mon.1 v2:172.21.15.192:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7fb0ec00e7c0 con 0x55cd47d23bf0 2024-06-02T04:51:57.739 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.727+0000 7fb0dffff700 1 -- 172.21.15.76:0/4069011117 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb0ec00e980 con 0x55cd47d23bf0 2024-06-02T04:51:57.739 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.727+0000 7fb113226b80 10 client.25411 fetch_fsmap learned FSMap version 29 2024-06-02T04:51:57.740 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.727+0000 7fb113226b80 1 -- 172.21.15.76:0/4069011117 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55cd47a98b00 con 0x55cd47d23bf0 2024-06-02T04:51:57.740 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.727+0000 7fb0dffff700 1 -- 172.21.15.76:0/4069011117 <== mon.1 v2:172.21.15.192:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55cd47bc4210 con 0x55cd47d23bf0 2024-06-02T04:51:57.740 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.728+0000 7fb0dffff700 1 -- 172.21.15.76:0/4069011117 <== mon.1 v2:172.21.15.192:3300/0 5 ==== fsmap(e 29) v1 ==== 7482+0+0 (secure 0 0 0) 0x7fb0ec01fac0 con 0x55cd47d23bf0 2024-06-02T04:51:57.740 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.728+0000 7fb113226b80 10 client.25411 fetch_fsmap finished waiting for FSMap version 29 2024-06-02T04:51:57.740 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.728+0000 7fb113226b80 10 client.25411 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T04:51:57.741 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.728+0000 7fb113226b80 20 client.25411 populate_metadata read hostname 'smithi076' 2024-06-02T04:51:57.741 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.728+0000 7fb113226b80 1 --2- 172.21.15.76:0/4069011117 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55cd47d1ea70 0x55cd47d20e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:51:57.741 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.728+0000 7fb113226b80 4 client.25411 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T04:51:57.741 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.728+0000 7fb113226b80 1 -- 172.21.15.76:0/4069011117 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cd47cea7b0 con 0x55cd47d1ea70 2024-06-02T04:51:57.741 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.728+0000 7fb104e07700 1 --2- 172.21.15.76:0/4069011117 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55cd47d1ea70 0x55cd47d20e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:51:57.741 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.728+0000 7fb104e07700 1 --2- 172.21.15.76:0/4069011117 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55cd47d1ea70 0x55cd47d20e90 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=51535d6caae8e0e1 server_cookie=7ae8d1cd2aaa9439 in_seq=0 out_seq=0 2024-06-02T04:51:57.742 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.728+0000 7fb0dffff700 10 client.25411 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:51:57.742 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.729+0000 7fb0dffff700 1 -- 172.21.15.76:0/4069011117 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55cd47cea7b0 con 0x55cd47d1ea70 2024-06-02T04:51:57.742 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.729+0000 7fb0dffff700 10 client.25411 handle_command_reply: tid=0 2024-06-02T04:51:57.742 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.729+0000 7fb113226b80 1 client.25411 shutdown 2024-06-02T04:51:57.742 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.730+0000 7fb113226b80 1 -- 172.21.15.76:0/4069011117 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cd47d23bf0 msgr2=0x55cd47d2d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:51:57.743 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.730+0000 7fb113226b80 1 --2- 172.21.15.76:0/4069011117 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cd47d23bf0 0x55cd47d2d6d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb0ec011270 tx=0x7fb0ec0047c0 comp rx=0 tx=0).stop 2024-06-02T04:51:57.743 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.730+0000 7fb113226b80 1 -- 172.21.15.76:0/4069011117 shutdown_connections 2024-06-02T04:51:57.743 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.730+0000 7fb113226b80 1 --2- 172.21.15.76:0/4069011117 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55cd47d1ea70 0x55cd47d20e90 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:57.743 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.730+0000 7fb113226b80 1 --2- 172.21.15.76:0/4069011117 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cd47d24ae0 0x55cd47d34710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:57.743 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.730+0000 7fb113226b80 1 --2- 172.21.15.76:0/4069011117 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cd47d23290 0x55cd47d2d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:57.743 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.730+0000 7fb0dffff700 0 client.25411 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:51:57.744 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.730+0000 7fb113226b80 1 --2- 172.21.15.76:0/4069011117 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cd47d23bf0 0x55cd47d2d6d0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:57.744 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.730+0000 7fb113226b80 1 -- 172.21.15.76:0/4069011117 >> 172.21.15.76:0/4069011117 conn(0x55cd47c791b0 msgr2=0x55cd47d15860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:51:57.744 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.730+0000 7fb113226b80 1 -- 172.21.15.76:0/4069011117 shutdown_connections 2024-06-02T04:51:57.745 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.730+0000 7fb113226b80 1 -- 172.21.15.76:0/4069011117 wait complete. 2024-06-02T04:51:57.745 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.730+0000 7fb113226b80 20 client.25411 trim_cache size 0 max 16384 2024-06-02T04:51:57.746 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:51:57 smithi076 ceph-mon[42935]: pgmap v339: 129 pgs: 129 active+clean; 1.3 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 17 MiB/s wr, 1.22k op/s 2024-06-02T04:51:57.752 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.751+0000 7fb113226b80 1 Processor -- start 2024-06-02T04:51:57.752 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.751+0000 7fb113226b80 1 -- start start 2024-06-02T04:51:57.752 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.751+0000 7fb113226b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cd47d23290 0x55cd47d23670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:51:57.753 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.751+0000 7fb113226b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cd47d23bf0 0x55cd47d2bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:51:57.753 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.751+0000 7fb113226b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cd47d24ae0 0x55cd47d2c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:51:57.753 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.751+0000 7fb113226b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd47d1be70 con 0x55cd47d24ae0 2024-06-02T04:51:57.753 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.751+0000 7fb113226b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd47d10570 con 0x55cd47d23290 2024-06-02T04:51:57.753 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.751+0000 7fb113226b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd47d242f0 con 0x55cd47d23bf0 2024-06-02T04:51:57.753 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.751+0000 7fb0fffff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cd47d23bf0 0x55cd47d2bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:51:57.754 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.751+0000 7fb104e07700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cd47d23290 0x55cd47d23670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:51:57.754 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.751+0000 7fb0fffff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cd47d23bf0 0x55cd47d2bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:52960/0 (socket says 172.21.15.76:52960) 2024-06-02T04:51:57.754 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.751+0000 7fb0fffff700 1 -- 172.21.15.76:0/1689467887 learned_addr learned my addr 172.21.15.76:0/1689467887 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:51:57.754 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.751+0000 7fb105608700 1 --2- 172.21.15.76:0/1689467887 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cd47d24ae0 0x55cd47d2c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:51:57.757 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.752+0000 7fb0fffff700 1 -- 172.21.15.76:0/1689467887 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cd47d23290 msgr2=0x55cd47d23670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:51:57.757 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.752+0000 7fb0fffff700 1 --2- 172.21.15.76:0/1689467887 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cd47d23290 0x55cd47d23670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:57.757 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.752+0000 7fb0fffff700 1 -- 172.21.15.76:0/1689467887 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cd47d24ae0 msgr2=0x55cd47d2c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:51:57.758 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.752+0000 7fb0fffff700 1 --2- 172.21.15.76:0/1689467887 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cd47d24ae0 0x55cd47d2c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:57.758 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.752+0000 7fb0fffff700 1 -- 172.21.15.76:0/1689467887 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb100073040 con 0x55cd47d23bf0 2024-06-02T04:51:57.758 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.752+0000 7fb0fffff700 1 --2- 172.21.15.76:0/1689467887 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cd47d23bf0 0x55cd47d2bd20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb0ec0112a0 tx=0x7fb0ec0147e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f9e474d7a3d820e7 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:51:57.758 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.752+0000 7fb0eb7fe700 1 -- 172.21.15.76:0/1689467887 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0ec00ba70 con 0x55cd47d23bf0 2024-06-02T04:51:57.758 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.752+0000 7fb0eb7fe700 1 -- 172.21.15.76:0/1689467887 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb0ec04a450 con 0x55cd47d23bf0 2024-06-02T04:51:57.758 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.752+0000 7fb0eb7fe700 1 -- 172.21.15.76:0/1689467887 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0ec04a610 con 0x55cd47d23bf0 2024-06-02T04:51:57.758 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.753+0000 7fb113226b80 1 -- 172.21.15.76:0/1689467887 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cd47d23bf0 msgr2=0x55cd47d2bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:51:57.758 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.753+0000 7fb113226b80 1 --2- 172.21.15.76:0/1689467887 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cd47d23bf0 0x55cd47d2bd20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb0ec0112a0 tx=0x7fb0ec0147e0 comp rx=0 tx=0).stop 2024-06-02T04:51:57.758 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.753+0000 7fb113226b80 1 -- 172.21.15.76:0/1689467887 shutdown_connections 2024-06-02T04:51:57.758 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.753+0000 7fb113226b80 1 --2- 172.21.15.76:0/1689467887 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cd47d24ae0 0x55cd47d2c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:57.758 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.753+0000 7fb113226b80 1 --2- 172.21.15.76:0/1689467887 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cd47d23290 0x55cd47d23670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:57.759 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.753+0000 7fb113226b80 1 --2- 172.21.15.76:0/1689467887 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cd47d23bf0 0x55cd47d2bd20 secure :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb0ec0112a0 tx=0x7fb0ec0147e0 comp rx=0 tx=0).stop 2024-06-02T04:51:57.759 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.753+0000 7fb113226b80 1 -- 172.21.15.76:0/1689467887 >> 172.21.15.76:0/1689467887 conn(0x55cd47c791b0 msgr2=0x55cd47d11e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:51:57.759 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.753+0000 7fb113226b80 1 -- 172.21.15.76:0/1689467887 shutdown_connections 2024-06-02T04:51:57.759 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.753+0000 7fb113226b80 1 -- 172.21.15.76:0/1689467887 wait complete. 2024-06-02T04:51:57.759 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.754+0000 7fb113226b80 1 -- start start 2024-06-02T04:51:57.759 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.754+0000 7fb113226b80 1 Processor -- start 2024-06-02T04:51:57.760 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.754+0000 7fb113226b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cd47d23290 0x55cd47d308b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:51:57.760 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.754+0000 7fb113226b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cd47d24ae0 0x55cd47d30df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:51:57.760 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.754+0000 7fb113226b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cd47d31d60 0x55cd47d321e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:51:57.760 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.754+0000 7fb113226b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd47d32720 con 0x55cd47d24ae0 2024-06-02T04:51:57.760 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.754+0000 7fb113226b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd47d32890 con 0x55cd47d31d60 2024-06-02T04:51:57.760 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.754+0000 7fb113226b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd47d32a50 con 0x55cd47d23290 2024-06-02T04:51:57.760 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.754+0000 7fb113226b80 10 client.0 _ll_register_callbacks cb 0x55cd47c10ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:51:57.760 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.755+0000 7fb105608700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cd47d31d60 0x55cd47d321e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:51:57.760 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.755+0000 7fb105608700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cd47d31d60 0x55cd47d321e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:52464/0 (socket says 172.21.15.76:52464) 2024-06-02T04:51:57.760 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.755+0000 7fb105608700 1 -- 172.21.15.76:0/3877410008 learned_addr learned my addr 172.21.15.76:0/3877410008 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:51:57.761 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.755+0000 7fb104e07700 1 --2- 172.21.15.76:0/3877410008 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cd47d23290 0x55cd47d308b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:51:57.761 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.755+0000 7fb0fffff700 1 --2- 172.21.15.76:0/3877410008 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cd47d24ae0 0x55cd47d30df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:51:57.761 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.755+0000 7fb105608700 1 -- 172.21.15.76:0/3877410008 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cd47d23290 msgr2=0x55cd47d308b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:51:57.761 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.755+0000 7fb105608700 1 --2- 172.21.15.76:0/3877410008 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cd47d23290 0x55cd47d308b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:57.761 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.755+0000 7fb105608700 1 -- 172.21.15.76:0/3877410008 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cd47d24ae0 msgr2=0x55cd47d30df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:51:57.761 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.755+0000 7fb105608700 1 --2- 172.21.15.76:0/3877410008 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cd47d24ae0 0x55cd47d30df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:57.761 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.755+0000 7fb105608700 1 -- 172.21.15.76:0/3877410008 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cd47a98b00 con 0x55cd47d31d60 2024-06-02T04:51:57.761 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.756+0000 7fb105608700 1 --2- 172.21.15.76:0/3877410008 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cd47d31d60 0x55cd47d321e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb0f809d090 tx=0x7fb0f809d8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8eedafa17196c756 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:51:57.761 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.756+0000 7fb0dffff700 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-06-02T04:51:57.761 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.756+0000 7fb0dffff700 1 -- 172.21.15.76:0/3877410008 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f809ccf0 con 0x55cd47d31d60 2024-06-02T04:51:57.762 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.756+0000 7fb0dffff700 1 -- 172.21.15.76:0/3877410008 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7fb0f80d00b0 con 0x55cd47d31d60 2024-06-02T04:51:57.762 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.757+0000 7fb113226b80 1 -- 172.21.15.76:0/3877410008 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb0ec01a040 con 0x55cd47d31d60 2024-06-02T04:51:57.762 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.757+0000 7fb0dffff700 1 -- 172.21.15.76:0/3877410008 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb0f809da90 con 0x55cd47d31d60 2024-06-02T04:51:57.762 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.757+0000 7fb113226b80 10 client.25478 fetch_fsmap learned FSMap version 29 2024-06-02T04:51:57.762 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.757+0000 7fb113226b80 1 -- 172.21.15.76:0/3877410008 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55cd47c31500 con 0x55cd47d31d60 2024-06-02T04:51:57.763 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.758+0000 7fb0dffff700 1 -- 172.21.15.76:0/3877410008 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb0ec01a040 con 0x55cd47d31d60 2024-06-02T04:51:57.763 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.758+0000 7fb0dffff700 1 -- 172.21.15.76:0/3877410008 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 29) v1 ==== 7482+0+0 (secure 0 0 0) 0x7fb0f80a5380 con 0x55cd47d31d60 2024-06-02T04:51:57.763 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.759+0000 7fb113226b80 10 client.25478 fetch_fsmap finished waiting for FSMap version 29 2024-06-02T04:51:57.763 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.759+0000 7fb113226b80 10 client.25478 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T04:51:57.763 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.759+0000 7fb113226b80 20 client.25478 populate_metadata read hostname 'smithi076' 2024-06-02T04:51:57.763 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.759+0000 7fb113226b80 1 --2- 172.21.15.76:0/3877410008 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55cd47d875a0 0x55cd47d899e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:51:57.764 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.759+0000 7fb113226b80 4 client.25478 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T04:51:57.764 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.759+0000 7fb113226b80 1 -- 172.21.15.76:0/3877410008 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55cd47c63e60 con 0x55cd47d875a0 2024-06-02T04:51:57.764 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.759+0000 7fb104e07700 1 --2- 172.21.15.76:0/3877410008 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55cd47d875a0 0x55cd47d899e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:51:57.764 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.759+0000 7fb104e07700 1 --2- 172.21.15.76:0/3877410008 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55cd47d875a0 0x55cd47d899e0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=39d05fcdd742da26 server_cookie=f4e0957a356cb23b in_seq=0 out_seq=0 2024-06-02T04:51:57.764 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.760+0000 7fb0dffff700 10 client.25478 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:51:57.776 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.776+0000 7fb0dffff700 1 -- 172.21.15.76:0/3877410008 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55cd47c63e60 con 0x55cd47d875a0 2024-06-02T04:51:57.776 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.776+0000 7fb0dffff700 10 client.25478 handle_command_reply: tid=0 2024-06-02T04:51:57.776 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.776+0000 7fb113226b80 1 client.25478 shutdown 2024-06-02T04:51:57.778 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.776+0000 7fb113226b80 1 -- 172.21.15.76:0/3877410008 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cd47d31d60 msgr2=0x55cd47d321e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:51:57.779 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.776+0000 7fb113226b80 1 --2- 172.21.15.76:0/3877410008 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cd47d31d60 0x55cd47d321e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb0f809d090 tx=0x7fb0f809d8d0 comp rx=0 tx=0).stop 2024-06-02T04:51:57.779 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.776+0000 7fb113226b80 1 -- 172.21.15.76:0/3877410008 shutdown_connections 2024-06-02T04:51:57.779 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.776+0000 7fb113226b80 1 --2- 172.21.15.76:0/3877410008 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55cd47d875a0 0x55cd47d899e0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:57.779 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.776+0000 7fb113226b80 1 --2- 172.21.15.76:0/3877410008 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cd47d31d60 0x55cd47d321e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:57.779 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.776+0000 7fb0dffff700 0 client.25478 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:51:57.780 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.776+0000 7fb113226b80 1 --2- 172.21.15.76:0/3877410008 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cd47d23290 0x55cd47d308b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:57.780 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.777+0000 7fb113226b80 1 --2- 172.21.15.76:0/3877410008 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cd47d24ae0 0x55cd47d30df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:57.780 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.777+0000 7fb113226b80 1 -- 172.21.15.76:0/3877410008 >> 172.21.15.76:0/3877410008 conn(0x55cd47c791b0 msgr2=0x55cd47d1a810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:51:57.781 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.777+0000 7fb113226b80 1 -- 172.21.15.76:0/3877410008 shutdown_connections 2024-06-02T04:51:57.781 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.777+0000 7fb113226b80 1 -- 172.21.15.76:0/3877410008 wait complete. 2024-06-02T04:51:57.781 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.777+0000 7fb113226b80 20 client.25478 trim_cache size 0 max 16384 2024-06-02T04:51:57.782 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:{ 2024-06-02T04:51:57.782 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "message": "", 2024-06-02T04:51:57.782 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "return_code": 0 2024-06-02T04:51:57.782 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:} 2024-06-02T04:51:57.783 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.778+0000 7fb10706b700 1 -- 172.21.15.76:0/325942608 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fb0f00a1270 msgr2=0x7fb0f00a3730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:51:57.784 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.778+0000 7fb10706b700 1 --2- 172.21.15.76:0/325942608 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fb0f00a1270 0x7fb0f00a3730 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fb0ec011a60 tx=0x7fb0ec00f000 comp rx=0 tx=0).stop 2024-06-02T04:51:57.784 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.778+0000 7fb10706b700 1 -- 172.21.15.76:0/325942608 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb10019c5f0 msgr2=0x7fb10019e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:51:57.784 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.778+0000 7fb10706b700 1 --2- 172.21.15.76:0/325942608 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb10019c5f0 0x7fb10019e9e0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fb0f8008560 tx=0x7fb0f8009d60 comp rx=0 tx=0).stop 2024-06-02T04:51:57.784 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.779+0000 7fb10706b700 1 -- 172.21.15.76:0/325942608 shutdown_connections 2024-06-02T04:51:57.784 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.779+0000 7fb10706b700 1 --2- 172.21.15.76:0/325942608 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb10019c5f0 0x7fb10019e9e0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:57.785 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.779+0000 7fb10706b700 1 --2- 172.21.15.76:0/325942608 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fb0f00a1270 0x7fb0f00a3730 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:57.785 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.779+0000 7fb10706b700 1 --2- 172.21.15.76:0/325942608 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb100100770 0x7fb1001970a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:57.785 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.779+0000 7fb10706b700 1 --2- 172.21.15.76:0/325942608 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb100101110 0x7fb1001975e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:51:57.785 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.779+0000 7fb10706b700 1 -- 172.21.15.76:0/325942608 >> 172.21.15.76:0/325942608 conn(0x7fb1000faaf0 msgr2=0x7fb1000fcee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:51:57.785 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.779+0000 7fb10706b700 1 -- 172.21.15.76:0/325942608 shutdown_connections 2024-06-02T04:51:57.785 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:51:57.779+0000 7fb10706b700 1 -- 172.21.15.76:0/325942608 wait complete. 2024-06-02T04:51:59.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:51:59 smithi119 ceph-mon[46633]: pgmap v340: 129 pgs: 129 active+clean; 1.3 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 16 MiB/s wr, 1.16k op/s 2024-06-02T04:51:59.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:51:59 smithi192 ceph-mon[47933]: pgmap v340: 129 pgs: 129 active+clean; 1.3 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 16 MiB/s wr, 1.16k op/s 2024-06-02T04:51:59.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:51:59 smithi076 ceph-mon[42935]: pgmap v340: 129 pgs: 129 active+clean; 1.3 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 16 MiB/s wr, 1.16k op/s 2024-06-02T04:52:01.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:52:00 smithi076 ceph-mon[42935]: pgmap v341: 129 pgs: 129 active+clean; 1.3 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 14 MiB/s wr, 1.00k op/s 2024-06-02T04:52:01.314 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 70.0 s, 895.6 tps, lat 112.325 ms stddev 125.288 2024-06-02T04:52:01.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:52:00 smithi119 ceph-mon[46633]: pgmap v341: 129 pgs: 129 active+clean; 1.3 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 14 MiB/s wr, 1.00k op/s 2024-06-02T04:52:01.431 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:52:00 smithi192 ceph-mon[47933]: pgmap v341: 129 pgs: 129 active+clean; 1.3 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 14 MiB/s wr, 1.00k op/s 2024-06-02T04:52:03.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:52:03 smithi119 ceph-mon[46633]: pgmap v342: 129 pgs: 129 active+clean; 1.3 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 16 MiB/s wr, 1.19k op/s 2024-06-02T04:52:03.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:52:03 smithi192 ceph-mon[47933]: pgmap v342: 129 pgs: 129 active+clean; 1.3 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 16 MiB/s wr, 1.19k op/s 2024-06-02T04:52:03.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:52:03 smithi076 ceph-mon[42935]: pgmap v342: 129 pgs: 129 active+clean; 1.3 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 16 MiB/s wr, 1.19k op/s 2024-06-02T04:52:05.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:52:05 smithi119 ceph-mon[46633]: pgmap v343: 129 pgs: 129 active+clean; 1.3 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 12 MiB/s wr, 980 op/s 2024-06-02T04:52:05.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:52:05 smithi192 ceph-mon[47933]: pgmap v343: 129 pgs: 129 active+clean; 1.3 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 12 MiB/s wr, 980 op/s 2024-06-02T04:52:05.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:52:05 smithi076 ceph-mon[42935]: pgmap v343: 129 pgs: 129 active+clean; 1.3 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 12 MiB/s wr, 980 op/s 2024-06-02T04:52:06.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 75.0 s, 955.2 tps, lat 104.188 ms stddev 37.249 2024-06-02T04:52:07.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:52:07 smithi119 ceph-mon[46633]: pgmap v344: 129 pgs: 129 active+clean; 1.3 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 15 MiB/s wr, 1.20k op/s 2024-06-02T04:52:07.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:52:07 smithi192 ceph-mon[47933]: pgmap v344: 129 pgs: 129 active+clean; 1.3 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 15 MiB/s wr, 1.20k op/s 2024-06-02T04:52:07.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:52:07 smithi076 ceph-mon[42935]: pgmap v344: 129 pgs: 129 active+clean; 1.3 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 15 MiB/s wr, 1.20k op/s 2024-06-02T04:52:08.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:52:08 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:52:08.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:52:08 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:52:08.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:52:08 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:52:08.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:52:08 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:52:08.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:52:08 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:52:08.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:52:08 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:52:08.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:52:08 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:52:08.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:52:08 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:52:08.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:52:08 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:52:08.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:52:08 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:52:08.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:52:08 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:52:08.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:52:08 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:52:09.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:52:09 smithi119 ceph-mon[46633]: pgmap v345: 129 pgs: 129 active+clean; 1.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 13 MiB/s wr, 1.11k op/s 2024-06-02T04:52:09.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:52:09 smithi192 ceph-mon[47933]: pgmap v345: 129 pgs: 129 active+clean; 1.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 13 MiB/s wr, 1.11k op/s 2024-06-02T04:52:09.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:52:09 smithi076 ceph-mon[42935]: pgmap v345: 129 pgs: 129 active+clean; 1.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 13 MiB/s wr, 1.11k op/s 2024-06-02T04:52:10.939 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.939+0000 7f6725fb9700 1 -- 172.21.15.76:0/3354657111 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6720100040 msgr2=0x7f67201004c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:52:10.940 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.939+0000 7f6725fb9700 1 --2- 172.21.15.76:0/3354657111 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6720100040 0x7f67201004c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f67080098f0 tx=0x7f6708009c00 comp rx=0 tx=0).stop 2024-06-02T04:52:10.940 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.939+0000 7f6725fb9700 1 -- 172.21.15.76:0/3354657111 shutdown_connections 2024-06-02T04:52:10.940 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.939+0000 7f6725fb9700 1 --2- 172.21.15.76:0/3354657111 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6720100a00 0x7f67201082a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:10.940 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.939+0000 7f6725fb9700 1 --2- 172.21.15.76:0/3354657111 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6720101480 0x7f67201018a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:10.940 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.939+0000 7f6725fb9700 1 --2- 172.21.15.76:0/3354657111 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6720100040 0x7f67201004c0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:10.940 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.939+0000 7f6725fb9700 1 -- 172.21.15.76:0/3354657111 >> 172.21.15.76:0/3354657111 conn(0x7f67200faaf0 msgr2=0x7f67200fcf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:52:10.940 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.939+0000 7f6725fb9700 1 -- 172.21.15.76:0/3354657111 shutdown_connections 2024-06-02T04:52:10.940 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.939+0000 7f6725fb9700 1 -- 172.21.15.76:0/3354657111 wait complete. 2024-06-02T04:52:10.942 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.940+0000 7f6725fb9700 1 Processor -- start 2024-06-02T04:52:10.942 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.940+0000 7f6725fb9700 1 -- start start 2024-06-02T04:52:10.942 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.940+0000 7f6725fb9700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6720100040 0x7f67200ffab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:52:10.942 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.940+0000 7f6725fb9700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6720100a00 0x7f67201998b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:52:10.942 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.940+0000 7f6725fb9700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6720101480 0x7f6720199ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:52:10.942 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.940+0000 7f6725fb9700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f672019a690 con 0x7f6720101480 2024-06-02T04:52:10.942 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.940+0000 7f6725fb9700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f672019a800 con 0x7f6720100a00 2024-06-02T04:52:10.943 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.940+0000 7f6725fb9700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f672019a9c0 con 0x7f6720100040 2024-06-02T04:52:10.943 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.940+0000 7f671ffff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6720101480 0x7f6720199ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:52:10.943 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.940+0000 7f671ffff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6720101480 0x7f6720199ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:51766/0 (socket says 172.21.15.76:51766) 2024-06-02T04:52:10.943 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.940+0000 7f671ffff700 1 -- 172.21.15.76:0/1931351888 learned_addr learned my addr 172.21.15.76:0/1931351888 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:52:10.943 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.940+0000 7f671effd700 1 --2- 172.21.15.76:0/1931351888 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6720100a00 0x7f67201998b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:52:10.943 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.940+0000 7f671f7fe700 1 --2- 172.21.15.76:0/1931351888 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6720100040 0x7f67200ffab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:52:10.943 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.941+0000 7f671f7fe700 1 -- 172.21.15.76:0/1931351888 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6720100a00 msgr2=0x7f67201998b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:52:10.943 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.941+0000 7f671f7fe700 1 --2- 172.21.15.76:0/1931351888 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6720100a00 0x7f67201998b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:10.943 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.941+0000 7f671f7fe700 1 -- 172.21.15.76:0/1931351888 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6720101480 msgr2=0x7f6720199ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:52:10.943 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.941+0000 7f671f7fe700 1 --2- 172.21.15.76:0/1931351888 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6720101480 0x7f6720199ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:10.943 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.941+0000 7f671f7fe700 1 -- 172.21.15.76:0/1931351888 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6708009520 con 0x7f6720100040 2024-06-02T04:52:10.943 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.941+0000 7f671effd700 1 --2- 172.21.15.76:0/1931351888 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6720100a00 0x7f67201998b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T04:52:10.943 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.941+0000 7f671f7fe700 1 --2- 172.21.15.76:0/1931351888 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6720100040 0x7f67200ffab0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f671000e9f0 tx=0x7f671000ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:52:10.943 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.941+0000 7f671cff9700 1 -- 172.21.15.76:0/1931351888 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f671000c9c0 con 0x7f6720100040 2024-06-02T04:52:10.944 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.941+0000 7f6725fb9700 1 -- 172.21.15.76:0/1931351888 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f672019aca0 con 0x7f6720100040 2024-06-02T04:52:10.944 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.941+0000 7f6725fb9700 1 -- 172.21.15.76:0/1931351888 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f672019b1d0 con 0x7f6720100040 2024-06-02T04:52:10.944 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.941+0000 7f671cff9700 1 -- 172.21.15.76:0/1931351888 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6710010430 con 0x7f6720100040 2024-06-02T04:52:10.944 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.941+0000 7f671cff9700 1 -- 172.21.15.76:0/1931351888 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6710018680 con 0x7f6720100040 2024-06-02T04:52:10.944 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.944+0000 7f671cff9700 1 -- 172.21.15.76:0/1931351888 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f671000cb20 con 0x7f6720100040 2024-06-02T04:52:10.945 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.944+0000 7f671cff9700 1 --2- 172.21.15.76:0/1931351888 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f670c0a11a0 0x7f670c0a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:52:10.945 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.944+0000 7f671cff9700 1 -- 172.21.15.76:0/1931351888 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f6710014070 con 0x7f6720100040 2024-06-02T04:52:10.945 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.945+0000 7f671effd700 1 --2- 172.21.15.76:0/1931351888 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f670c0a11a0 0x7f670c0a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:52:10.946 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.946+0000 7f6732174b80 1 Processor -- start 2024-06-02T04:52:10.946 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.946+0000 7f6732174b80 1 -- start start 2024-06-02T04:52:10.947 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.947+0000 7f671effd700 1 --2- 172.21.15.76:0/1931351888 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f670c0a11a0 0x7f670c0a3660 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f6708005e90 tx=0x7f6708019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:52:10.947 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.947+0000 7f6732174b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560ed105aa80 0x560ed105aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:52:10.947 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.947+0000 7f6732174b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560ed105b3e0 0x560ed105bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:52:10.947 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.947+0000 7f6732174b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560ed105c2d0 0x560ed105c750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:52:10.948 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.947+0000 7f6732174b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ed0fb20f0 con 0x560ed105c2d0 2024-06-02T04:52:10.948 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.947+0000 7f6732174b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ed0fafab0 con 0x560ed105aa80 2024-06-02T04:52:10.948 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.947+0000 7f6732174b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ed0fab3a0 con 0x560ed105b3e0 2024-06-02T04:52:10.948 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.947+0000 7f671f7fe700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560ed105aa80 0x560ed105aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:52:10.948 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.947+0000 7f671effd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560ed105b3e0 0x560ed105bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:52:10.948 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.947+0000 7f671f7fe700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560ed105aa80 0x560ed105aea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:35562/0 (socket says 172.21.15.76:35562) 2024-06-02T04:52:10.948 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.947+0000 7f671f7fe700 1 -- 172.21.15.76:0/2105411007 learned_addr learned my addr 172.21.15.76:0/2105411007 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:52:10.949 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.947+0000 7f671f7fe700 1 -- 172.21.15.76:0/2105411007 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560ed105b3e0 msgr2=0x560ed105bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:52:10.949 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.947+0000 7f671f7fe700 1 --2- 172.21.15.76:0/2105411007 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560ed105b3e0 0x560ed105bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:10.949 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.947+0000 7f671f7fe700 1 -- 172.21.15.76:0/2105411007 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560ed105c2d0 msgr2=0x560ed105c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:52:10.950 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.947+0000 7f671f7fe700 1 --2- 172.21.15.76:0/2105411007 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560ed105c2d0 0x560ed105c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:10.950 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.947+0000 7f671f7fe700 1 -- 172.21.15.76:0/2105411007 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560ed0e2c350 con 0x560ed105aa80 2024-06-02T04:52:10.950 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.948+0000 7f671f7fe700 1 --2- 172.21.15.76:0/2105411007 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560ed105aa80 0x560ed105aea0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f67100967e0 tx=0x7f67100996d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a738499623efc013 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:52:10.950 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.948+0000 7f6715ffb700 1 -- 172.21.15.76:0/2105411007 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6710099d70 con 0x560ed105aa80 2024-06-02T04:52:10.950 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.948+0000 7f6715ffb700 1 -- 172.21.15.76:0/2105411007 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f671009dba0 con 0x560ed105aa80 2024-06-02T04:52:10.950 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.948+0000 7f6715ffb700 1 -- 172.21.15.76:0/2105411007 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67100994c0 con 0x560ed105aa80 2024-06-02T04:52:10.950 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.949+0000 7f6732174b80 1 -- 172.21.15.76:0/2105411007 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560ed105aa80 msgr2=0x560ed105aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:52:10.950 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.949+0000 7f6732174b80 1 --2- 172.21.15.76:0/2105411007 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560ed105aa80 0x560ed105aea0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f67100967e0 tx=0x7f67100996d0 comp rx=0 tx=0).stop 2024-06-02T04:52:10.950 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.949+0000 7f6732174b80 1 -- 172.21.15.76:0/2105411007 shutdown_connections 2024-06-02T04:52:10.950 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.949+0000 7f6732174b80 1 --2- 172.21.15.76:0/2105411007 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560ed105c2d0 0x560ed105c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:10.950 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.949+0000 7f6732174b80 1 --2- 172.21.15.76:0/2105411007 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560ed105aa80 0x560ed105aea0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:10.950 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.949+0000 7f6732174b80 1 --2- 172.21.15.76:0/2105411007 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560ed105b3e0 0x560ed105bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:10.951 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.949+0000 7f6732174b80 1 -- 172.21.15.76:0/2105411007 >> 172.21.15.76:0/2105411007 conn(0x560ed0fb91b0 msgr2=0x560ed1057440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:52:10.951 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.949+0000 7f6732174b80 1 -- 172.21.15.76:0/2105411007 shutdown_connections 2024-06-02T04:52:10.951 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.949+0000 7f6732174b80 1 -- 172.21.15.76:0/2105411007 wait complete. 2024-06-02T04:52:10.951 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.949+0000 7f6732174b80 1 -- start start 2024-06-02T04:52:10.951 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.949+0000 7f6732174b80 1 Processor -- start 2024-06-02T04:52:10.953 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.950+0000 7f6732174b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560ed105aa80 0x560ed10648a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:52:10.953 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.950+0000 7f6732174b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560ed105b3e0 0x560ed1064de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:52:10.954 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.950+0000 7f6732174b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560ed105c2d0 0x560ed106be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:52:10.954 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.950+0000 7f6732174b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ed0f47500 con 0x560ed105b3e0 2024-06-02T04:52:10.954 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.950+0000 7f6732174b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ed0f471a0 con 0x560ed105aa80 2024-06-02T04:52:10.954 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.950+0000 7f6732174b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ed0e2e640 con 0x560ed105c2d0 2024-06-02T04:52:10.954 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.950+0000 7f6732174b80 10 client.0 _ll_register_callbacks cb 0x560ed0f50ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:52:10.954 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.950+0000 7f671f7fe700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560ed105aa80 0x560ed10648a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:52:10.954 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.950+0000 7f671effd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560ed105b3e0 0x560ed1064de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:52:10.954 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.950+0000 7f671f7fe700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560ed105aa80 0x560ed10648a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:35576/0 (socket says 172.21.15.76:35576) 2024-06-02T04:52:10.954 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.950+0000 7f671f7fe700 1 -- 172.21.15.76:0/1591609957 learned_addr learned my addr 172.21.15.76:0/1591609957 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:52:10.954 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.950+0000 7f671ffff700 1 --2- 172.21.15.76:0/1591609957 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560ed105c2d0 0x560ed106be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:52:10.954 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.950+0000 7f671f7fe700 1 -- 172.21.15.76:0/1591609957 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560ed105c2d0 msgr2=0x560ed106be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:52:10.955 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.950+0000 7f671f7fe700 1 --2- 172.21.15.76:0/1591609957 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560ed105c2d0 0x560ed106be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:10.955 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.950+0000 7f671f7fe700 1 -- 172.21.15.76:0/1591609957 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560ed105b3e0 msgr2=0x560ed1064de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:52:10.955 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.950+0000 7f671f7fe700 1 --2- 172.21.15.76:0/1591609957 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560ed105b3e0 0x560ed1064de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:10.955 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.950+0000 7f671f7fe700 1 -- 172.21.15.76:0/1591609957 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f672019b1d0 con 0x560ed105aa80 2024-06-02T04:52:10.955 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.950+0000 7f671ffff700 1 --2- 172.21.15.76:0/1591609957 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560ed105c2d0 0x560ed106be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:52:10.955 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.950+0000 7f671f7fe700 1 --2- 172.21.15.76:0/1591609957 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560ed105aa80 0x560ed10648a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f671009a3d0 tx=0x7f671000c750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a8b679fca52e32bc server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:52:10.955 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.950+0000 7f66feffd700 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-06-02T04:52:10.955 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.950+0000 7f66feffd700 1 -- 172.21.15.76:0/1591609957 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6710078ea0 con 0x560ed105aa80 2024-06-02T04:52:10.955 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.951+0000 7f66feffd700 1 -- 172.21.15.76:0/1591609957 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f6710099d70 con 0x560ed105aa80 2024-06-02T04:52:10.955 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.951+0000 7f6732174b80 1 -- 172.21.15.76:0/1591609957 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560ed0f04210 con 0x560ed105aa80 2024-06-02T04:52:10.955 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.951+0000 7f66feffd700 1 -- 172.21.15.76:0/1591609957 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f67100a21f0 con 0x560ed105aa80 2024-06-02T04:52:10.955 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.951+0000 7f6732174b80 10 client.25490 fetch_fsmap learned FSMap version 29 2024-06-02T04:52:10.955 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.951+0000 7f6732174b80 1 -- 172.21.15.76:0/1591609957 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x560ed0dd8b00 con 0x560ed105aa80 2024-06-02T04:52:10.956 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.951+0000 7f66feffd700 1 -- 172.21.15.76:0/1591609957 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x560ed0f04210 con 0x560ed105aa80 2024-06-02T04:52:10.956 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.951+0000 7f66feffd700 1 -- 172.21.15.76:0/1591609957 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 29) v1 ==== 7482+0+0 (secure 0 0 0) 0x7f6710098ee0 con 0x560ed105aa80 2024-06-02T04:52:10.956 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.951+0000 7f6732174b80 10 client.25490 fetch_fsmap finished waiting for FSMap version 29 2024-06-02T04:52:10.956 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.951+0000 7f6732174b80 10 client.25490 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T04:52:10.956 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.951+0000 7f6732174b80 20 client.25490 populate_metadata read hostname 'smithi076' 2024-06-02T04:52:10.956 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.951+0000 7f6732174b80 1 --2- 172.21.15.76:0/1591609957 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x560ed1070490 0x560ed10728b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:52:10.956 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.951+0000 7f6732174b80 4 client.25490 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T04:52:10.956 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.951+0000 7f6732174b80 1 -- 172.21.15.76:0/1591609957 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560ed102a7b0 con 0x560ed1070490 2024-06-02T04:52:10.956 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.952+0000 7f671effd700 1 --2- 172.21.15.76:0/1591609957 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x560ed1070490 0x560ed10728b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:52:10.956 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.952+0000 7f66feffd700 10 client.25490 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:52:10.956 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.952+0000 7f671effd700 1 --2- 172.21.15.76:0/1591609957 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x560ed1070490 0x560ed10728b0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5c439e184573a1d2 server_cookie=e588d6375f319a1 in_seq=0 out_seq=0 2024-06-02T04:52:10.956 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.953+0000 7f66feffd700 1 -- 172.21.15.76:0/1591609957 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x560ed102a7b0 con 0x560ed1070490 2024-06-02T04:52:10.956 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.953+0000 7f66feffd700 10 client.25490 handle_command_reply: tid=0 2024-06-02T04:52:10.957 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.953+0000 7f6732174b80 1 client.25490 shutdown 2024-06-02T04:52:10.957 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.953+0000 7f6732174b80 1 -- 172.21.15.76:0/1591609957 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560ed105aa80 msgr2=0x560ed10648a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:52:10.957 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.953+0000 7f6732174b80 1 --2- 172.21.15.76:0/1591609957 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560ed105aa80 0x560ed10648a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f671009a3d0 tx=0x7f671000c750 comp rx=0 tx=0).stop 2024-06-02T04:52:10.957 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.953+0000 7f6732174b80 1 -- 172.21.15.76:0/1591609957 shutdown_connections 2024-06-02T04:52:10.957 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.953+0000 7f6732174b80 1 --2- 172.21.15.76:0/1591609957 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x560ed1070490 0x560ed10728b0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:10.957 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.953+0000 7f6732174b80 1 --2- 172.21.15.76:0/1591609957 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560ed105c2d0 0x560ed106be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:10.957 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.953+0000 7f6732174b80 1 --2- 172.21.15.76:0/1591609957 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560ed105aa80 0x560ed10648a0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:10.957 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.953+0000 7f6732174b80 1 --2- 172.21.15.76:0/1591609957 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560ed105b3e0 0x560ed1064de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:10.957 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.953+0000 7f66feffd700 0 client.25490 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:52:10.957 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.953+0000 7f6732174b80 1 -- 172.21.15.76:0/1591609957 >> 172.21.15.76:0/1591609957 conn(0x560ed0fb91b0 msgr2=0x560ed1055860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:52:10.957 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.953+0000 7f6732174b80 1 -- 172.21.15.76:0/1591609957 shutdown_connections 2024-06-02T04:52:10.957 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.953+0000 7f6732174b80 1 -- 172.21.15.76:0/1591609957 wait complete. 2024-06-02T04:52:10.957 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.953+0000 7f6732174b80 20 client.25490 trim_cache size 0 max 16384 2024-06-02T04:52:10.977 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.977+0000 7f6732174b80 1 Processor -- start 2024-06-02T04:52:10.979 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.977+0000 7f6732174b80 1 -- start start 2024-06-02T04:52:10.979 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.978+0000 7f6732174b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560ed105aa80 0x560ed106c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:52:10.979 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.978+0000 7f6732174b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560ed105b3e0 0x560ed106bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:52:10.979 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.978+0000 7f6732174b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560ed105c2d0 0x560ed105c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:52:10.979 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.978+0000 7f6732174b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ed10529f0 con 0x560ed105aa80 2024-06-02T04:52:10.979 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.978+0000 7f6732174b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ed1063360 con 0x560ed105c2d0 2024-06-02T04:52:10.979 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.978+0000 7f6732174b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ed1056bc0 con 0x560ed105b3e0 2024-06-02T04:52:10.979 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.978+0000 7f671f7fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560ed105aa80 0x560ed106c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:52:10.979 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.978+0000 7f671f7fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560ed105aa80 0x560ed106c4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:51802/0 (socket says 172.21.15.76:51802) 2024-06-02T04:52:10.979 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.978+0000 7f671f7fe700 1 -- 172.21.15.76:0/1695080733 learned_addr learned my addr 172.21.15.76:0/1695080733 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:52:10.979 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.978+0000 7f671effd700 1 --2- 172.21.15.76:0/1695080733 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560ed105b3e0 0x560ed106bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:52:10.979 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.978+0000 7f671ffff700 1 --2- 172.21.15.76:0/1695080733 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560ed105c2d0 0x560ed105c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:52:10.980 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.978+0000 7f671effd700 1 -- 172.21.15.76:0/1695080733 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560ed105c2d0 msgr2=0x560ed105c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:52:10.980 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.978+0000 7f671effd700 1 --2- 172.21.15.76:0/1695080733 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560ed105c2d0 0x560ed105c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:10.980 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.978+0000 7f671effd700 1 -- 172.21.15.76:0/1695080733 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560ed105aa80 msgr2=0x560ed106c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:52:10.980 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.978+0000 7f671effd700 1 --2- 172.21.15.76:0/1695080733 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560ed105aa80 0x560ed106c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:10.980 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.978+0000 7f671effd700 1 -- 172.21.15.76:0/1695080733 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560ed0f71500 con 0x560ed105b3e0 2024-06-02T04:52:10.980 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.978+0000 7f671f7fe700 1 --2- 172.21.15.76:0/1695080733 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560ed105aa80 0x560ed106c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T04:52:10.980 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.979+0000 7f671effd700 1 --2- 172.21.15.76:0/1695080733 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560ed105b3e0 0x560ed106bdb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6708009810 tx=0x7f6708023000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d848d121c814482c server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:52:10.981 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.979+0000 7f67167fc700 1 -- 172.21.15.76:0/1695080733 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67080052b0 con 0x560ed105b3e0 2024-06-02T04:52:10.981 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.979+0000 7f67167fc700 1 -- 172.21.15.76:0/1695080733 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f670801d040 con 0x560ed105b3e0 2024-06-02T04:52:10.981 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.979+0000 7f67167fc700 1 -- 172.21.15.76:0/1695080733 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6708003d70 con 0x560ed105b3e0 2024-06-02T04:52:10.981 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.980+0000 7f6732174b80 1 -- 172.21.15.76:0/1695080733 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560ed105b3e0 msgr2=0x560ed106bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:52:10.981 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.980+0000 7f6732174b80 1 --2- 172.21.15.76:0/1695080733 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560ed105b3e0 0x560ed106bdb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6708009810 tx=0x7f6708023000 comp rx=0 tx=0).stop 2024-06-02T04:52:10.981 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.980+0000 7f6732174b80 1 -- 172.21.15.76:0/1695080733 shutdown_connections 2024-06-02T04:52:10.981 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.980+0000 7f6732174b80 1 --2- 172.21.15.76:0/1695080733 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560ed105c2d0 0x560ed105c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:10.981 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.980+0000 7f6732174b80 1 --2- 172.21.15.76:0/1695080733 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560ed105aa80 0x560ed106c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:10.981 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.980+0000 7f6732174b80 1 --2- 172.21.15.76:0/1695080733 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560ed105b3e0 0x560ed106bdb0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:10.982 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.980+0000 7f6732174b80 1 -- 172.21.15.76:0/1695080733 >> 172.21.15.76:0/1695080733 conn(0x560ed0fb91b0 msgr2=0x560ed1062890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:52:10.982 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.980+0000 7f6732174b80 1 -- 172.21.15.76:0/1695080733 shutdown_connections 2024-06-02T04:52:10.983 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.980+0000 7f6732174b80 1 -- 172.21.15.76:0/1695080733 wait complete. 2024-06-02T04:52:10.983 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.981+0000 7f6732174b80 1 -- start start 2024-06-02T04:52:10.983 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.981+0000 7f6732174b80 1 Processor -- start 2024-06-02T04:52:10.983 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.981+0000 7f6732174b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560ed105aa80 0x560ed1067430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:52:10.984 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.981+0000 7f6732174b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560ed105b3e0 0x560ed1067970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:52:10.984 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.981+0000 7f6732174b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560ed105c2d0 0x560ed106a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:52:10.984 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.981+0000 7f6732174b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ed106adc0 con 0x560ed105aa80 2024-06-02T04:52:10.984 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.981+0000 7f6732174b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ed106af30 con 0x560ed105b3e0 2024-06-02T04:52:10.985 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.981+0000 7f6732174b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ed106b0f0 con 0x560ed105c2d0 2024-06-02T04:52:10.985 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.981+0000 7f6732174b80 10 client.0 _ll_register_callbacks cb 0x560ed0f50ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:52:10.985 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.982+0000 7f671f7fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560ed105aa80 0x560ed1067430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:52:10.985 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.982+0000 7f671f7fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560ed105aa80 0x560ed1067430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:51812/0 (socket says 172.21.15.76:51812) 2024-06-02T04:52:10.985 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.982+0000 7f671f7fe700 1 -- 172.21.15.76:0/152424659 learned_addr learned my addr 172.21.15.76:0/152424659 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:52:10.985 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.982+0000 7f671ffff700 1 --2- 172.21.15.76:0/152424659 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560ed105c2d0 0x560ed106a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:52:10.985 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.982+0000 7f671effd700 1 --2- 172.21.15.76:0/152424659 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560ed105b3e0 0x560ed1067970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:52:10.985 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.982+0000 7f671f7fe700 1 -- 172.21.15.76:0/152424659 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560ed105c2d0 msgr2=0x560ed106a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:52:10.985 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.982+0000 7f671f7fe700 1 --2- 172.21.15.76:0/152424659 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560ed105c2d0 0x560ed106a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:10.985 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.982+0000 7f671f7fe700 1 -- 172.21.15.76:0/152424659 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560ed105b3e0 msgr2=0x560ed1067970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:52:10.985 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.982+0000 7f671f7fe700 1 --2- 172.21.15.76:0/152424659 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560ed105b3e0 0x560ed1067970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:10.985 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.982+0000 7f671f7fe700 1 -- 172.21.15.76:0/152424659 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560ed0dd8b00 con 0x560ed105aa80 2024-06-02T04:52:10.986 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.982+0000 7f671ffff700 1 --2- 172.21.15.76:0/152424659 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560ed105c2d0 0x560ed106a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T04:52:10.986 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.982+0000 7f671effd700 1 --2- 172.21.15.76:0/152424659 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560ed105b3e0 0x560ed1067970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:52:10.986 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.982+0000 7f671f7fe700 1 --2- 172.21.15.76:0/152424659 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560ed105aa80 0x560ed1067430 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f6710000c00 tx=0x7f67100a2100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abbf0b50e80675c6 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:52:10.986 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.982+0000 7f66feffd700 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-06-02T04:52:10.986 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.983+0000 7f66feffd700 1 -- 172.21.15.76:0/152424659 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6710078ea0 con 0x560ed105aa80 2024-06-02T04:52:10.986 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.983+0000 7f66feffd700 1 -- 172.21.15.76:0/152424659 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f6710099d70 con 0x560ed105aa80 2024-06-02T04:52:10.986 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.983+0000 7f6732174b80 1 -- 172.21.15.76:0/152424659 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f671009dba0 con 0x560ed105aa80 2024-06-02T04:52:10.986 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.983+0000 7f66feffd700 1 -- 172.21.15.76:0/152424659 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6710098110 con 0x560ed105aa80 2024-06-02T04:52:10.986 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.983+0000 7f6732174b80 10 client.15960 fetch_fsmap learned FSMap version 29 2024-06-02T04:52:10.986 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.983+0000 7f6732174b80 1 -- 172.21.15.76:0/152424659 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x7f6720108c50 con 0x560ed105aa80 2024-06-02T04:52:10.987 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.983+0000 7f66feffd700 1 -- 172.21.15.76:0/152424659 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f671009dba0 con 0x560ed105aa80 2024-06-02T04:52:10.988 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.984+0000 7f66feffd700 1 -- 172.21.15.76:0/152424659 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 29) v1 ==== 7482+0+0 (secure 0 0 0) 0x7f6710098cd0 con 0x560ed105aa80 2024-06-02T04:52:10.988 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.984+0000 7f6732174b80 10 client.15960 fetch_fsmap finished waiting for FSMap version 29 2024-06-02T04:52:10.988 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.984+0000 7f6732174b80 10 client.15960 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T04:52:10.988 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.984+0000 7f6732174b80 20 client.15960 populate_metadata read hostname 'smithi076' 2024-06-02T04:52:10.988 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.984+0000 7f6732174b80 1 --2- 172.21.15.76:0/152424659 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x560ed10d7d40 0x560ed10da160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:52:10.988 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.984+0000 7f6732174b80 4 client.15960 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T04:52:10.988 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.984+0000 7f6732174b80 1 -- 172.21.15.76:0/152424659 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x560ed0fa3e60 con 0x560ed10d7d40 2024-06-02T04:52:10.988 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.985+0000 7f671effd700 1 --2- 172.21.15.76:0/152424659 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x560ed10d7d40 0x560ed10da160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:52:10.988 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.985+0000 7f671effd700 1 --2- 172.21.15.76:0/152424659 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x560ed10d7d40 0x560ed10da160 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6b63e8e8ab12031b server_cookie=56209c8395872fc in_seq=0 out_seq=0 2024-06-02T04:52:10.988 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:10.985+0000 7f66feffd700 10 client.15960 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:52:11.008 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:11.007+0000 7f66feffd700 1 -- 172.21.15.76:0/152424659 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x560ed0fa3e60 con 0x560ed10d7d40 2024-06-02T04:52:11.008 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:11.007+0000 7f66feffd700 10 client.15960 handle_command_reply: tid=0 2024-06-02T04:52:11.008 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:11.007+0000 7f6732174b80 1 client.15960 shutdown 2024-06-02T04:52:11.008 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:11.007+0000 7f6732174b80 1 -- 172.21.15.76:0/152424659 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560ed105aa80 msgr2=0x560ed1067430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:52:11.008 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:11.007+0000 7f6732174b80 1 --2- 172.21.15.76:0/152424659 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560ed105aa80 0x560ed1067430 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f6710000c00 tx=0x7f67100a2100 comp rx=0 tx=0).stop 2024-06-02T04:52:11.008 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:11.007+0000 7f6732174b80 1 -- 172.21.15.76:0/152424659 shutdown_connections 2024-06-02T04:52:11.008 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:11.007+0000 7f6732174b80 1 --2- 172.21.15.76:0/152424659 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x560ed10d7d40 0x560ed10da160 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:11.009 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:11.007+0000 7f6732174b80 1 --2- 172.21.15.76:0/152424659 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560ed105c2d0 0x560ed106a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:11.009 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:11.007+0000 7f6732174b80 1 --2- 172.21.15.76:0/152424659 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560ed105aa80 0x560ed1067430 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:11.009 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:11.007+0000 7f6732174b80 1 --2- 172.21.15.76:0/152424659 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560ed105b3e0 0x560ed1067970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:11.009 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:11.007+0000 7f6732174b80 1 -- 172.21.15.76:0/152424659 >> 172.21.15.76:0/152424659 conn(0x560ed0fb91b0 msgr2=0x560ed1063a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:52:11.009 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:11.007+0000 7f66feffd700 0 client.15960 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:52:11.009 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:11.007+0000 7f6732174b80 1 -- 172.21.15.76:0/152424659 shutdown_connections 2024-06-02T04:52:11.009 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:11.007+0000 7f6732174b80 1 -- 172.21.15.76:0/152424659 wait complete. 2024-06-02T04:52:11.009 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:11.008+0000 7f6732174b80 20 client.15960 trim_cache size 0 max 16384 2024-06-02T04:52:11.009 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:{ 2024-06-02T04:52:11.009 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "message": "", 2024-06-02T04:52:11.010 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "return_code": 0 2024-06-02T04:52:11.010 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:} 2024-06-02T04:52:11.010 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:11.008+0000 7f6725fb9700 1 -- 172.21.15.76:0/1931351888 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f670c0a11a0 msgr2=0x7f670c0a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:52:11.010 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:11.008+0000 7f6725fb9700 1 --2- 172.21.15.76:0/1931351888 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f670c0a11a0 0x7f670c0a3660 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f6708005e90 tx=0x7f6708019040 comp rx=0 tx=0).stop 2024-06-02T04:52:11.011 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:11.008+0000 7f6725fb9700 1 -- 172.21.15.76:0/1931351888 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6720100040 msgr2=0x7f67200ffab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:52:11.011 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:11.008+0000 7f6725fb9700 1 --2- 172.21.15.76:0/1931351888 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6720100040 0x7f67200ffab0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f671000e9f0 tx=0x7f671000ed00 comp rx=0 tx=0).stop 2024-06-02T04:52:11.011 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:11.008+0000 7f6725fb9700 1 -- 172.21.15.76:0/1931351888 shutdown_connections 2024-06-02T04:52:11.011 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:11.008+0000 7f6725fb9700 1 --2- 172.21.15.76:0/1931351888 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6720101480 0x7f6720199ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:11.011 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:11.008+0000 7f6725fb9700 1 --2- 172.21.15.76:0/1931351888 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6720100040 0x7f67200ffab0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:11.011 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:11.008+0000 7f6725fb9700 1 --2- 172.21.15.76:0/1931351888 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f670c0a11a0 0x7f670c0a3660 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:11.011 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:11.008+0000 7f6725fb9700 1 --2- 172.21.15.76:0/1931351888 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6720100a00 0x7f67201998b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:11.011 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:11.008+0000 7f6725fb9700 1 -- 172.21.15.76:0/1931351888 >> 172.21.15.76:0/1931351888 conn(0x7f67200faaf0 msgr2=0x7f6720104510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:52:11.011 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:11.009+0000 7f6725fb9700 1 -- 172.21.15.76:0/1931351888 shutdown_connections 2024-06-02T04:52:11.011 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:11.009+0000 7f6725fb9700 1 -- 172.21.15.76:0/1931351888 wait complete. 2024-06-02T04:52:11.316 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 80.0 s, 795.0 tps, lat 126.086 ms stddev 196.094 2024-06-02T04:52:11.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:52:11 smithi119 ceph-mon[46633]: pgmap v346: 129 pgs: 129 active+clean; 1.3 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 12 MiB/s wr, 997 op/s 2024-06-02T04:52:11.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:52:11 smithi192 ceph-mon[47933]: pgmap v346: 129 pgs: 129 active+clean; 1.3 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 12 MiB/s wr, 997 op/s 2024-06-02T04:52:11.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:52:11 smithi076 ceph-mon[42935]: pgmap v346: 129 pgs: 129 active+clean; 1.3 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 12 MiB/s wr, 997 op/s 2024-06-02T04:52:13.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:52:13 smithi119 ceph-mon[46633]: pgmap v347: 129 pgs: 129 active+clean; 1.3 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 17 MiB/s wr, 1.21k op/s 2024-06-02T04:52:13.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:52:13 smithi192 ceph-mon[47933]: pgmap v347: 129 pgs: 129 active+clean; 1.3 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 17 MiB/s wr, 1.21k op/s 2024-06-02T04:52:13.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:52:13 smithi076 ceph-mon[42935]: pgmap v347: 129 pgs: 129 active+clean; 1.3 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 17 MiB/s wr, 1.21k op/s 2024-06-02T04:52:15.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:52:15 smithi119 ceph-mon[46633]: pgmap v348: 129 pgs: 129 active+clean; 1.3 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 14 MiB/s wr, 975 op/s 2024-06-02T04:52:15.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:52:15 smithi192 ceph-mon[47933]: pgmap v348: 129 pgs: 129 active+clean; 1.3 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 14 MiB/s wr, 975 op/s 2024-06-02T04:52:15.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:52:15 smithi076 ceph-mon[42935]: pgmap v348: 129 pgs: 129 active+clean; 1.3 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 14 MiB/s wr, 975 op/s 2024-06-02T04:52:16.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 85.0 s, 795.7 tps, lat 114.761 ms stddev 209.829 2024-06-02T04:52:17.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:52:17 smithi119 ceph-mon[46633]: pgmap v349: 129 pgs: 129 active+clean; 1.3 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 20 MiB/s wr, 1.23k op/s 2024-06-02T04:52:17.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:52:17 smithi192 ceph-mon[47933]: pgmap v349: 129 pgs: 129 active+clean; 1.3 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 20 MiB/s wr, 1.23k op/s 2024-06-02T04:52:17.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:52:17 smithi076 ceph-mon[42935]: pgmap v349: 129 pgs: 129 active+clean; 1.3 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 20 MiB/s wr, 1.23k op/s 2024-06-02T04:52:19.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:52:19 smithi119 ceph-mon[46633]: pgmap v350: 129 pgs: 129 active+clean; 1.4 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 21 MiB/s wr, 1.11k op/s 2024-06-02T04:52:19.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:52:19 smithi192 ceph-mon[47933]: pgmap v350: 129 pgs: 129 active+clean; 1.4 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 21 MiB/s wr, 1.11k op/s 2024-06-02T04:52:19.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:52:19 smithi076 ceph-mon[42935]: pgmap v350: 129 pgs: 129 active+clean; 1.4 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 21 MiB/s wr, 1.11k op/s 2024-06-02T04:52:21.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 90.0 s, 850.3 tps, lat 127.872 ms stddev 233.811 2024-06-02T04:52:21.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:52:21 smithi119 ceph-mon[46633]: pgmap v351: 129 pgs: 129 active+clean; 1.4 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 20 MiB/s wr, 1.02k op/s 2024-06-02T04:52:21.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:52:21 smithi192 ceph-mon[47933]: pgmap v351: 129 pgs: 129 active+clean; 1.4 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 20 MiB/s wr, 1.02k op/s 2024-06-02T04:52:21.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:52:21 smithi076 ceph-mon[42935]: pgmap v351: 129 pgs: 129 active+clean; 1.4 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 20 MiB/s wr, 1.02k op/s 2024-06-02T04:52:23.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:52:23 smithi119 ceph-mon[46633]: pgmap v352: 129 pgs: 129 active+clean; 1.4 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 26 MiB/s wr, 1.16k op/s 2024-06-02T04:52:23.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:52:23 smithi192 ceph-mon[47933]: pgmap v352: 129 pgs: 129 active+clean; 1.4 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 26 MiB/s wr, 1.16k op/s 2024-06-02T04:52:23.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:52:23 smithi076 ceph-mon[42935]: pgmap v352: 129 pgs: 129 active+clean; 1.4 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 26 MiB/s wr, 1.16k op/s 2024-06-02T04:52:24.180 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.179+0000 7f0285fd6700 1 -- 172.21.15.76:0/1506458802 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f028010b9e0 msgr2=0x7f028010ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:52:24.180 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.179+0000 7f0285fd6700 1 --2- 172.21.15.76:0/1506458802 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f028010b9e0 0x7f028010ddd0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f02740098f0 tx=0x7f0274009c00 comp rx=0 tx=0).stop 2024-06-02T04:52:24.180 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.179+0000 7f0285fd6700 1 -- 172.21.15.76:0/1506458802 shutdown_connections 2024-06-02T04:52:24.180 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.179+0000 7f0285fd6700 1 --2- 172.21.15.76:0/1506458802 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f028010e310 0x7f0280110740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:24.180 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.179+0000 7f0285fd6700 1 --2- 172.21.15.76:0/1506458802 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f02801090b0 0x7f028010b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:24.180 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.179+0000 7f0285fd6700 1 --2- 172.21.15.76:0/1506458802 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f028010b9e0 0x7f028010ddd0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:24.181 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.179+0000 7f0285fd6700 1 -- 172.21.15.76:0/1506458802 >> 172.21.15.76:0/1506458802 conn(0x7f028006df30 msgr2=0x7f0280070370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:52:24.181 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.180+0000 7f0285fd6700 1 -- 172.21.15.76:0/1506458802 shutdown_connections 2024-06-02T04:52:24.181 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.180+0000 7f0285fd6700 1 -- 172.21.15.76:0/1506458802 wait complete. 2024-06-02T04:52:24.181 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.180+0000 7f0285fd6700 1 Processor -- start 2024-06-02T04:52:24.182 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.182+0000 7f0285fd6700 1 -- start start 2024-06-02T04:52:24.182 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.182+0000 7f0285fd6700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f028010b9e0 0x7f02801a8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:52:24.182 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.182+0000 7f0285fd6700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f028010e310 0x7f02801aa9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:52:24.182 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.182+0000 7f0285fd6700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f02801aaff0 0x7f02801ad4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:52:24.182 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.182+0000 7f0285fd6700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02801adc80 con 0x7f02801aaff0 2024-06-02T04:52:24.183 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.182+0000 7f0285fd6700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02801addf0 con 0x7f028010b9e0 2024-06-02T04:52:24.183 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.182+0000 7f0285fd6700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02801adfb0 con 0x7f028010e310 2024-06-02T04:52:24.183 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.183+0000 7f027effd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f028010e310 0x7f02801aa9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:52:24.183 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.183+0000 7f027effd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f028010e310 0x7f02801aa9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:36348/0 (socket says 172.21.15.76:36348) 2024-06-02T04:52:24.183 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.183+0000 7f027effd700 1 -- 172.21.15.76:0/1509999797 learned_addr learned my addr 172.21.15.76:0/1509999797 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:52:24.184 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.183+0000 7f027ffff700 1 --2- 172.21.15.76:0/1509999797 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f02801aaff0 0x7f02801ad4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:52:24.184 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.183+0000 7f027f7fe700 1 --2- 172.21.15.76:0/1509999797 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f028010b9e0 0x7f02801a8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:52:24.184 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.183+0000 7f027effd700 1 -- 172.21.15.76:0/1509999797 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f028010b9e0 msgr2=0x7f02801a8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:52:24.184 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.183+0000 7f027effd700 1 --2- 172.21.15.76:0/1509999797 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f028010b9e0 0x7f02801a8460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:24.184 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.183+0000 7f027effd700 1 -- 172.21.15.76:0/1509999797 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f02801aaff0 msgr2=0x7f02801ad4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:52:24.184 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.183+0000 7f027effd700 1 --2- 172.21.15.76:0/1509999797 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f02801aaff0 0x7f02801ad4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:24.184 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.183+0000 7f027effd700 1 -- 172.21.15.76:0/1509999797 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0274009520 con 0x7f028010e310 2024-06-02T04:52:24.185 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.184+0000 7f027effd700 1 --2- 172.21.15.76:0/1509999797 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f028010e310 0x7f02801aa9f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f027400b840 tx=0x7f027400b870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:52:24.185 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.184+0000 7f027cff9700 1 -- 172.21.15.76:0/1509999797 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f027401c070 con 0x7f028010e310 2024-06-02T04:52:24.185 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.184+0000 7f027cff9700 1 -- 172.21.15.76:0/1509999797 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f027400f7d0 con 0x7f028010e310 2024-06-02T04:52:24.185 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.184+0000 7f0285fd6700 1 -- 172.21.15.76:0/1509999797 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02801ae230 con 0x7f028010e310 2024-06-02T04:52:24.185 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.184+0000 7f027cff9700 1 -- 172.21.15.76:0/1509999797 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0274017400 con 0x7f028010e310 2024-06-02T04:52:24.185 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.184+0000 7f0285fd6700 1 -- 172.21.15.76:0/1509999797 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02801ae730 con 0x7f028010e310 2024-06-02T04:52:24.188 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.187+0000 7f027cff9700 1 -- 172.21.15.76:0/1509999797 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f0274020070 con 0x7f028010e310 2024-06-02T04:52:24.188 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.188+0000 7f027cff9700 1 --2- 172.21.15.76:0/1509999797 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f02680a1220 0x7f02680a36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:52:24.189 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.188+0000 7f027cff9700 1 -- 172.21.15.76:0/1509999797 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f02740cdd50 con 0x7f028010e310 2024-06-02T04:52:24.190 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.189+0000 7f0292191b80 1 Processor -- start 2024-06-02T04:52:24.190 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.189+0000 7f0292191b80 1 -- start start 2024-06-02T04:52:24.190 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.189+0000 7f0292191b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bb0aa8ca90 0x55bb0aa8ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:52:24.190 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.189+0000 7f0292191b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bb0aa8d3f0 0x55bb0aa8dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:52:24.190 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.189+0000 7f0292191b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bb0aa8e2e0 0x55bb0aa8e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:52:24.190 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.189+0000 7f0292191b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb0a9d30f0 con 0x55bb0aa8e2e0 2024-06-02T04:52:24.190 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.189+0000 7f0292191b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb0a9d0ab0 con 0x55bb0aa8d3f0 2024-06-02T04:52:24.190 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.189+0000 7f0292191b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb0a9cc3a0 con 0x55bb0aa8ca90 2024-06-02T04:52:24.190 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.190+0000 7f027ffff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bb0aa8e2e0 0x55bb0aa8e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:52:24.190 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.190+0000 7f027ffff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bb0aa8e2e0 0x55bb0aa8e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:58924/0 (socket says 172.21.15.76:58924) 2024-06-02T04:52:24.191 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.190+0000 7f027ffff700 1 -- 172.21.15.76:0/4119652623 learned_addr learned my addr 172.21.15.76:0/4119652623 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:52:24.191 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.190+0000 7f027ffff700 1 -- 172.21.15.76:0/4119652623 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bb0aa8ca90 msgr2=0x55bb0aa8ceb0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-02T04:52:24.191 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.190+0000 7f027ffff700 1 --2- 172.21.15.76:0/4119652623 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bb0aa8ca90 0x55bb0aa8ceb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:24.191 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.190+0000 7f027ffff700 1 -- 172.21.15.76:0/4119652623 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bb0aa8d3f0 msgr2=0x55bb0aa8dd00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-02T04:52:24.191 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.190+0000 7f027ffff700 1 --2- 172.21.15.76:0/4119652623 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bb0aa8d3f0 0x55bb0aa8dd00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:24.191 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.190+0000 7f027ffff700 1 -- 172.21.15.76:0/4119652623 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bb0a84d350 con 0x55bb0aa8e2e0 2024-06-02T04:52:24.192 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.190+0000 7f027f7fe700 1 --2- 172.21.15.76:0/1509999797 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f02680a1220 0x7f02680a36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:52:24.192 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.191+0000 7f027ffff700 1 --2- 172.21.15.76:0/4119652623 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bb0aa8e2e0 0x55bb0aa8e760 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f027800a430 tx=0x7f0278009650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6ecb0fcfeff68f5 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:52:24.192 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.191+0000 7f027f7fe700 1 --2- 172.21.15.76:0/1509999797 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f02680a1220 0x7f02680a36e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f0270005950 tx=0x7f027000b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:52:24.192 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.192+0000 7f0265ffb700 1 -- 172.21.15.76:0/4119652623 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0278010040 con 0x55bb0aa8e2e0 2024-06-02T04:52:24.192 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.192+0000 7f0265ffb700 1 -- 172.21.15.76:0/4119652623 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0278013a20 con 0x55bb0aa8e2e0 2024-06-02T04:52:24.193 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.192+0000 7f0265ffb700 1 -- 172.21.15.76:0/4119652623 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0278014ad0 con 0x55bb0aa8e2e0 2024-06-02T04:52:24.193 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.193+0000 7f0292191b80 1 -- 172.21.15.76:0/4119652623 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bb0aa8e2e0 msgr2=0x55bb0aa8e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:52:24.193 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.193+0000 7f0292191b80 1 --2- 172.21.15.76:0/4119652623 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bb0aa8e2e0 0x55bb0aa8e760 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f027800a430 tx=0x7f0278009650 comp rx=0 tx=0).stop 2024-06-02T04:52:24.194 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.193+0000 7f0292191b80 1 -- 172.21.15.76:0/4119652623 shutdown_connections 2024-06-02T04:52:24.194 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.193+0000 7f0292191b80 1 --2- 172.21.15.76:0/4119652623 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bb0aa8e2e0 0x55bb0aa8e760 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:24.194 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.193+0000 7f0292191b80 1 --2- 172.21.15.76:0/4119652623 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bb0aa8ca90 0x55bb0aa8ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:24.194 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.193+0000 7f0292191b80 1 --2- 172.21.15.76:0/4119652623 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bb0aa8d3f0 0x55bb0aa8dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:24.194 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.193+0000 7f0292191b80 1 -- 172.21.15.76:0/4119652623 >> 172.21.15.76:0/4119652623 conn(0x55bb0a9da1b0 msgr2=0x55bb0aa78440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:52:24.194 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.193+0000 7f0292191b80 1 -- 172.21.15.76:0/4119652623 shutdown_connections 2024-06-02T04:52:24.194 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.193+0000 7f0292191b80 1 -- 172.21.15.76:0/4119652623 wait complete. 2024-06-02T04:52:24.194 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.194+0000 7f0292191b80 1 -- start start 2024-06-02T04:52:24.196 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.194+0000 7f0292191b80 1 Processor -- start 2024-06-02T04:52:24.196 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.194+0000 7f0292191b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bb0aa8ca90 0x55bb0aa969c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:52:24.196 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.194+0000 7f0292191b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bb0aa8d3f0 0x55bb0aa96f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:52:24.196 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.194+0000 7f0292191b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bb0aa8e2e0 0x55bb0aa9df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:52:24.196 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.194+0000 7f0292191b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb0a968500 con 0x55bb0aa8ca90 2024-06-02T04:52:24.196 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.194+0000 7f0292191b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb0a9681a0 con 0x55bb0aa8e2e0 2024-06-02T04:52:24.196 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.194+0000 7f0292191b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb0a84f640 con 0x55bb0aa8d3f0 2024-06-02T04:52:24.196 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.194+0000 7f0292191b80 10 client.0 _ll_register_callbacks cb 0x55bb0a971ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:52:24.196 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.194+0000 7f027ffff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bb0aa8e2e0 0x55bb0aa9df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:52:24.196 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.194+0000 7f027ffff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bb0aa8e2e0 0x55bb0aa9df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:42988/0 (socket says 172.21.15.76:42988) 2024-06-02T04:52:24.197 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.194+0000 7f027ffff700 1 -- 172.21.15.76:0/524612005 learned_addr learned my addr 172.21.15.76:0/524612005 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:52:24.197 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.195+0000 7f027ffff700 1 -- 172.21.15.76:0/524612005 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bb0aa8d3f0 msgr2=0x55bb0aa96f00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-02T04:52:24.197 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.195+0000 7f027ffff700 1 --2- 172.21.15.76:0/524612005 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bb0aa8d3f0 0x55bb0aa96f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:24.197 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.195+0000 7f027ffff700 1 -- 172.21.15.76:0/524612005 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bb0aa8ca90 msgr2=0x55bb0aa969c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-02T04:52:24.198 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.195+0000 7f027ffff700 1 --2- 172.21.15.76:0/524612005 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bb0aa8ca90 0x55bb0aa969c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:24.198 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.195+0000 7f027ffff700 1 -- 172.21.15.76:0/524612005 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0278009c60 con 0x55bb0aa8e2e0 2024-06-02T04:52:24.198 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.195+0000 7f027ffff700 1 --2- 172.21.15.76:0/524612005 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bb0aa8e2e0 0x55bb0aa9df40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f02780137c0 tx=0x7f02780138a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b92400a270be2192 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:52:24.198 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.195+0000 7f025effd700 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-06-02T04:52:24.198 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.195+0000 7f025effd700 1 -- 172.21.15.76:0/524612005 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0278010070 con 0x55bb0aa8e2e0 2024-06-02T04:52:24.198 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.195+0000 7f0292191b80 1 -- 172.21.15.76:0/524612005 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bb0a925210 con 0x55bb0aa8e2e0 2024-06-02T04:52:24.198 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.195+0000 7f025effd700 1 -- 172.21.15.76:0/524612005 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f0278006e40 con 0x55bb0aa8e2e0 2024-06-02T04:52:24.198 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.196+0000 7f025effd700 1 -- 172.21.15.76:0/524612005 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f027800ae80 con 0x55bb0aa8e2e0 2024-06-02T04:52:24.198 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.196+0000 7f0292191b80 10 client.25505 fetch_fsmap learned FSMap version 29 2024-06-02T04:52:24.198 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.196+0000 7f0292191b80 1 -- 172.21.15.76:0/524612005 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55bb0a7f9b00 con 0x55bb0aa8e2e0 2024-06-02T04:52:24.200 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.196+0000 7f025effd700 1 -- 172.21.15.76:0/524612005 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55bb0a925210 con 0x55bb0aa8e2e0 2024-06-02T04:52:24.200 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.196+0000 7f025effd700 1 -- 172.21.15.76:0/524612005 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 29) v1 ==== 7482+0+0 (secure 0 0 0) 0x7f0278008030 con 0x55bb0aa8e2e0 2024-06-02T04:52:24.200 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.196+0000 7f0292191b80 10 client.25505 fetch_fsmap finished waiting for FSMap version 29 2024-06-02T04:52:24.200 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.196+0000 7f0292191b80 10 client.25505 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T04:52:24.200 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.196+0000 7f0292191b80 20 client.25505 populate_metadata read hostname 'smithi076' 2024-06-02T04:52:24.200 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.196+0000 7f0292191b80 1 --2- 172.21.15.76:0/524612005 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55bb0aaa2750 0x55bb0aaa4b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:52:24.200 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.196+0000 7f0292191b80 4 client.25505 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T04:52:24.201 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.196+0000 7f0292191b80 1 -- 172.21.15.76:0/524612005 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bb0aa4b7b0 con 0x55bb0aaa2750 2024-06-02T04:52:24.201 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.197+0000 7f027f7fe700 1 --2- 172.21.15.76:0/524612005 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55bb0aaa2750 0x55bb0aaa4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:52:24.201 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.197+0000 7f025effd700 10 client.25505 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:52:24.201 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.197+0000 7f027f7fe700 1 --2- 172.21.15.76:0/524612005 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55bb0aaa2750 0x55bb0aaa4b70 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=209070f3d38de596 server_cookie=7505f7bf61825c23 in_seq=0 out_seq=0 2024-06-02T04:52:24.201 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.198+0000 7f025effd700 1 -- 172.21.15.76:0/524612005 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55bb0aa4b7b0 con 0x55bb0aaa2750 2024-06-02T04:52:24.201 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.198+0000 7f025effd700 10 client.25505 handle_command_reply: tid=0 2024-06-02T04:52:24.201 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.198+0000 7f0292191b80 1 client.25505 shutdown 2024-06-02T04:52:24.201 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.199+0000 7f0292191b80 1 -- 172.21.15.76:0/524612005 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bb0aa8e2e0 msgr2=0x55bb0aa9df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:52:24.202 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.199+0000 7f0292191b80 1 --2- 172.21.15.76:0/524612005 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bb0aa8e2e0 0x55bb0aa9df40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f02780137c0 tx=0x7f02780138a0 comp rx=0 tx=0).stop 2024-06-02T04:52:24.202 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.199+0000 7f0292191b80 1 -- 172.21.15.76:0/524612005 shutdown_connections 2024-06-02T04:52:24.202 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.199+0000 7f0292191b80 1 --2- 172.21.15.76:0/524612005 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55bb0aaa2750 0x55bb0aaa4b70 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:24.202 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.199+0000 7f0292191b80 1 --2- 172.21.15.76:0/524612005 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bb0aa8e2e0 0x55bb0aa9df40 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:24.202 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.199+0000 7f0292191b80 1 --2- 172.21.15.76:0/524612005 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bb0aa8ca90 0x55bb0aa969c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:24.202 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.199+0000 7f025effd700 0 client.25505 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:52:24.202 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.199+0000 7f0292191b80 1 --2- 172.21.15.76:0/524612005 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bb0aa8d3f0 0x55bb0aa96f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:24.202 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.199+0000 7f0292191b80 1 -- 172.21.15.76:0/524612005 >> 172.21.15.76:0/524612005 conn(0x55bb0a9da1b0 msgr2=0x55bb0aa76860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:52:24.202 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.199+0000 7f0292191b80 1 -- 172.21.15.76:0/524612005 shutdown_connections 2024-06-02T04:52:24.202 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.200+0000 7f0292191b80 1 -- 172.21.15.76:0/524612005 wait complete. 2024-06-02T04:52:24.202 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.200+0000 7f0292191b80 20 client.25505 trim_cache size 0 max 16384 2024-06-02T04:52:24.222 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.222+0000 7f0292191b80 1 Processor -- start 2024-06-02T04:52:24.223 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.222+0000 7f0292191b80 1 -- start start 2024-06-02T04:52:24.223 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.222+0000 7f0292191b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bb0aa8ca90 0x55bb0aa94900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:52:24.223 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.222+0000 7f0292191b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bb0aa8d3f0 0x55bb0aa9df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:52:24.223 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.222+0000 7f0292191b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bb0aa8e2e0 0x55bb0aaa9490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:52:24.223 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.222+0000 7f0292191b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb0aa8df10 con 0x55bb0aa8d3f0 2024-06-02T04:52:24.224 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.222+0000 7f0292191b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb0aa9fc50 con 0x55bb0aa8ca90 2024-06-02T04:52:24.224 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.222+0000 7f0292191b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb0aa8e110 con 0x55bb0aa8e2e0 2024-06-02T04:52:24.224 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.222+0000 7f027effd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bb0aa8d3f0 0x55bb0aa9df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:52:24.224 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.222+0000 7f027effd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bb0aa8d3f0 0x55bb0aa9df00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:58940/0 (socket says 172.21.15.76:58940) 2024-06-02T04:52:24.224 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.222+0000 7f027effd700 1 -- 172.21.15.76:0/1618663311 learned_addr learned my addr 172.21.15.76:0/1618663311 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:52:24.224 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.223+0000 7f027f7fe700 1 --2- 172.21.15.76:0/1618663311 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bb0aa8ca90 0x55bb0aa94900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:52:24.224 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.223+0000 7f027ffff700 1 --2- 172.21.15.76:0/1618663311 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bb0aa8e2e0 0x55bb0aaa9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:52:24.224 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.223+0000 7f027effd700 1 -- 172.21.15.76:0/1618663311 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bb0aa8e2e0 msgr2=0x55bb0aaa9490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:52:24.224 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.223+0000 7f027effd700 1 --2- 172.21.15.76:0/1618663311 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bb0aa8e2e0 0x55bb0aaa9490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:24.224 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.223+0000 7f027effd700 1 -- 172.21.15.76:0/1618663311 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bb0aa8ca90 msgr2=0x55bb0aa94900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:52:24.224 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.223+0000 7f027effd700 1 --2- 172.21.15.76:0/1618663311 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bb0aa8ca90 0x55bb0aa94900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:24.224 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.223+0000 7f027effd700 1 -- 172.21.15.76:0/1618663311 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bb0a992500 con 0x55bb0aa8d3f0 2024-06-02T04:52:24.225 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.223+0000 7f027effd700 1 --2- 172.21.15.76:0/1618663311 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bb0aa8d3f0 0x55bb0aa9df00 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f027400fa40 tx=0x7f027400f940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3593f14031387867 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:52:24.225 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.223+0000 7f02667fc700 1 -- 172.21.15.76:0/1618663311 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f027409bea0 con 0x55bb0aa8d3f0 2024-06-02T04:52:24.225 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.223+0000 7f02667fc700 1 -- 172.21.15.76:0/1618663311 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f027409a9d0 con 0x55bb0aa8d3f0 2024-06-02T04:52:24.225 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.223+0000 7f02667fc700 1 -- 172.21.15.76:0/1618663311 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02740a3280 con 0x55bb0aa8d3f0 2024-06-02T04:52:24.226 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.224+0000 7f0292191b80 1 -- 172.21.15.76:0/1618663311 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bb0aa8d3f0 msgr2=0x55bb0aa9df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:52:24.226 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.224+0000 7f0292191b80 1 --2- 172.21.15.76:0/1618663311 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bb0aa8d3f0 0x55bb0aa9df00 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f027400fa40 tx=0x7f027400f940 comp rx=0 tx=0).stop 2024-06-02T04:52:24.226 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.224+0000 7f0292191b80 1 -- 172.21.15.76:0/1618663311 shutdown_connections 2024-06-02T04:52:24.226 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.224+0000 7f0292191b80 1 --2- 172.21.15.76:0/1618663311 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bb0aa8e2e0 0x55bb0aaa9490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:24.226 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.224+0000 7f0292191b80 1 --2- 172.21.15.76:0/1618663311 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bb0aa8ca90 0x55bb0aa94900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:24.226 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.224+0000 7f0292191b80 1 --2- 172.21.15.76:0/1618663311 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bb0aa8d3f0 0x55bb0aa9df00 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:24.226 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.224+0000 7f0292191b80 1 -- 172.21.15.76:0/1618663311 >> 172.21.15.76:0/1618663311 conn(0x55bb0a9da1b0 msgr2=0x55bb0aa95ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:52:24.226 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.225+0000 7f0292191b80 1 -- 172.21.15.76:0/1618663311 shutdown_connections 2024-06-02T04:52:24.227 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.225+0000 7f0292191b80 1 -- 172.21.15.76:0/1618663311 wait complete. 2024-06-02T04:52:24.227 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.225+0000 7f0292191b80 1 -- start start 2024-06-02T04:52:24.227 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.225+0000 7f0292191b80 1 Processor -- start 2024-06-02T04:52:24.227 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.226+0000 7f0292191b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bb0aa8ca90 0x55bb0aa9b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:52:24.227 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.226+0000 7f0292191b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bb0aa8d3f0 0x55bb0aa9bf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:52:24.227 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.226+0000 7f0292191b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bb0aa8e2e0 0x55bb0aa9cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:52:24.227 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.226+0000 7f0292191b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb0aa9d470 con 0x55bb0aa8d3f0 2024-06-02T04:52:24.228 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.226+0000 7f0292191b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb0aa9d5e0 con 0x55bb0aa8e2e0 2024-06-02T04:52:24.228 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.226+0000 7f0292191b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb0aa9d7a0 con 0x55bb0aa8ca90 2024-06-02T04:52:24.228 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.226+0000 7f0292191b80 10 client.0 _ll_register_callbacks cb 0x55bb0a971ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:52:24.228 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.226+0000 7f027f7fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bb0aa8ca90 0x55bb0aa9b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:52:24.228 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.226+0000 7f027ffff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bb0aa8e2e0 0x55bb0aa9cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:52:24.228 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.226+0000 7f027f7fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bb0aa8ca90 0x55bb0aa9b9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:36372/0 (socket says 172.21.15.76:36372) 2024-06-02T04:52:24.228 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.226+0000 7f027f7fe700 1 -- 172.21.15.76:0/2886641124 learned_addr learned my addr 172.21.15.76:0/2886641124 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:52:24.229 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.227+0000 7f027effd700 1 --2- 172.21.15.76:0/2886641124 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bb0aa8d3f0 0x55bb0aa9bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:52:24.229 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.227+0000 7f027effd700 1 -- 172.21.15.76:0/2886641124 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bb0aa8ca90 msgr2=0x55bb0aa9b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:52:24.229 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.227+0000 7f027effd700 1 --2- 172.21.15.76:0/2886641124 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bb0aa8ca90 0x55bb0aa9b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:24.229 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.227+0000 7f027effd700 1 -- 172.21.15.76:0/2886641124 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bb0aa8e2e0 msgr2=0x55bb0aa9cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:52:24.229 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.227+0000 7f027effd700 1 --2- 172.21.15.76:0/2886641124 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bb0aa8e2e0 0x55bb0aa9cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:24.229 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.227+0000 7f027effd700 1 -- 172.21.15.76:0/2886641124 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02801ae730 con 0x55bb0aa8d3f0 2024-06-02T04:52:24.229 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.227+0000 7f027effd700 1 --2- 172.21.15.76:0/2886641124 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bb0aa8d3f0 0x55bb0aa9bf20 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f02740a2d50 tx=0x7f027409ae90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f44a7d6dbbbb5884 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:52:24.229 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.227+0000 7f025effd700 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-06-02T04:52:24.230 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.227+0000 7f025effd700 1 -- 172.21.15.76:0/2886641124 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f027409bea0 con 0x55bb0aa8d3f0 2024-06-02T04:52:24.230 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.227+0000 7f025effd700 1 -- 172.21.15.76:0/2886641124 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f02740a3280 con 0x55bb0aa8d3f0 2024-06-02T04:52:24.230 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.227+0000 7f0292191b80 1 -- 172.21.15.76:0/2886641124 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0278013a20 con 0x55bb0aa8d3f0 2024-06-02T04:52:24.230 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.228+0000 7f025effd700 1 -- 172.21.15.76:0/2886641124 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f027409fbe0 con 0x55bb0aa8d3f0 2024-06-02T04:52:24.230 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.228+0000 7f0292191b80 10 client.15972 fetch_fsmap learned FSMap version 29 2024-06-02T04:52:24.230 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.228+0000 7f0292191b80 1 -- 172.21.15.76:0/2886641124 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55bb0a851c70 con 0x55bb0aa8d3f0 2024-06-02T04:52:24.230 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.228+0000 7f025effd700 1 -- 172.21.15.76:0/2886641124 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f02740b9080 con 0x55bb0aa8d3f0 2024-06-02T04:52:24.230 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.228+0000 7f025effd700 1 -- 172.21.15.76:0/2886641124 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 29) v1 ==== 7482+0+0 (secure 0 0 0) 0x7f02740a2df0 con 0x55bb0aa8d3f0 2024-06-02T04:52:24.230 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.228+0000 7f0292191b80 10 client.15972 fetch_fsmap finished waiting for FSMap version 29 2024-06-02T04:52:24.231 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.228+0000 7f0292191b80 10 client.15972 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T04:52:24.231 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.228+0000 7f0292191b80 20 client.15972 populate_metadata read hostname 'smithi076' 2024-06-02T04:52:24.231 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.228+0000 7f0292191b80 1 --2- 172.21.15.76:0/2886641124 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55bb0aaf9500 0x55bb0aafb920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:52:24.231 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.228+0000 7f0292191b80 4 client.15972 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T04:52:24.231 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.228+0000 7f0292191b80 1 -- 172.21.15.76:0/2886641124 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55bb0a9c4e60 con 0x55bb0aaf9500 2024-06-02T04:52:24.231 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.229+0000 7f027f7fe700 1 --2- 172.21.15.76:0/2886641124 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55bb0aaf9500 0x55bb0aafb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:52:24.231 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.229+0000 7f025effd700 10 client.15972 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:52:24.231 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.229+0000 7f027f7fe700 1 --2- 172.21.15.76:0/2886641124 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55bb0aaf9500 0x55bb0aafb920 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fbbedd96f0942703 server_cookie=689fc1cf7e5ce80b in_seq=0 out_seq=0 2024-06-02T04:52:24.247 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.247+0000 7f025effd700 1 -- 172.21.15.76:0/2886641124 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55bb0a9c4e60 con 0x55bb0aaf9500 2024-06-02T04:52:24.247 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.247+0000 7f025effd700 10 client.15972 handle_command_reply: tid=0 2024-06-02T04:52:24.247 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.247+0000 7f0292191b80 1 client.15972 shutdown 2024-06-02T04:52:24.247 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.247+0000 7f0292191b80 1 -- 172.21.15.76:0/2886641124 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bb0aa8d3f0 msgr2=0x55bb0aa9bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:52:24.247 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.247+0000 7f0292191b80 1 --2- 172.21.15.76:0/2886641124 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bb0aa8d3f0 0x55bb0aa9bf20 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f02740a2d50 tx=0x7f027409ae90 comp rx=0 tx=0).stop 2024-06-02T04:52:24.248 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.247+0000 7f0292191b80 1 -- 172.21.15.76:0/2886641124 shutdown_connections 2024-06-02T04:52:24.248 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.247+0000 7f0292191b80 1 --2- 172.21.15.76:0/2886641124 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55bb0aaf9500 0x55bb0aafb920 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:24.248 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.247+0000 7f0292191b80 1 --2- 172.21.15.76:0/2886641124 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bb0aa8e2e0 0x55bb0aa9cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:24.248 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.247+0000 7f0292191b80 1 --2- 172.21.15.76:0/2886641124 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bb0aa8ca90 0x55bb0aa9b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:24.248 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.247+0000 7f025effd700 0 client.15972 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:52:24.248 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.247+0000 7f0292191b80 1 --2- 172.21.15.76:0/2886641124 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bb0aa8d3f0 0x55bb0aa9bf20 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:24.248 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.247+0000 7f0292191b80 1 -- 172.21.15.76:0/2886641124 >> 172.21.15.76:0/2886641124 conn(0x55bb0a9da1b0 msgr2=0x55bb0aa78020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:52:24.249 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.247+0000 7f0292191b80 1 -- 172.21.15.76:0/2886641124 shutdown_connections 2024-06-02T04:52:24.249 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.248+0000 7f0292191b80 1 -- 172.21.15.76:0/2886641124 wait complete. 2024-06-02T04:52:24.250 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.250+0000 7f0292191b80 20 client.15972 trim_cache size 0 max 16384 2024-06-02T04:52:24.250 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:{ 2024-06-02T04:52:24.250 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "message": "", 2024-06-02T04:52:24.250 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "return_code": 0 2024-06-02T04:52:24.250 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:} 2024-06-02T04:52:24.251 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.250+0000 7f0285fd6700 1 -- 172.21.15.76:0/1509999797 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f02680a1220 msgr2=0x7f02680a36e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:52:24.251 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.250+0000 7f0285fd6700 1 --2- 172.21.15.76:0/1509999797 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f02680a1220 0x7f02680a36e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f0270005950 tx=0x7f027000b390 comp rx=0 tx=0).stop 2024-06-02T04:52:24.251 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.250+0000 7f0285fd6700 1 -- 172.21.15.76:0/1509999797 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f028010e310 msgr2=0x7f02801aa9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:52:24.251 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.250+0000 7f0285fd6700 1 --2- 172.21.15.76:0/1509999797 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f028010e310 0x7f02801aa9f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f027400b840 tx=0x7f027400b870 comp rx=0 tx=0).stop 2024-06-02T04:52:24.252 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.250+0000 7f0285fd6700 1 -- 172.21.15.76:0/1509999797 shutdown_connections 2024-06-02T04:52:24.252 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.250+0000 7f0285fd6700 1 --2- 172.21.15.76:0/1509999797 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f02801aaff0 0x7f02801ad4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:24.252 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.250+0000 7f0285fd6700 1 --2- 172.21.15.76:0/1509999797 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f02680a1220 0x7f02680a36e0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:24.252 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.250+0000 7f0285fd6700 1 --2- 172.21.15.76:0/1509999797 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f028010b9e0 0x7f02801a8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:24.252 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.250+0000 7f0285fd6700 1 --2- 172.21.15.76:0/1509999797 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f028010e310 0x7f02801aa9f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:24.252 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.250+0000 7f0285fd6700 1 -- 172.21.15.76:0/1509999797 >> 172.21.15.76:0/1509999797 conn(0x7f028006df30 msgr2=0x7f0280109490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:52:24.252 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.250+0000 7f0285fd6700 1 -- 172.21.15.76:0/1509999797 shutdown_connections 2024-06-02T04:52:24.252 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:24.251+0000 7f0285fd6700 1 -- 172.21.15.76:0/1509999797 wait complete. 2024-06-02T04:52:25.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:52:25 smithi119 ceph-mon[46633]: pgmap v353: 129 pgs: 129 active+clean; 1.4 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 20 MiB/s wr, 899 op/s 2024-06-02T04:52:25.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:52:25 smithi192 ceph-mon[47933]: pgmap v353: 129 pgs: 129 active+clean; 1.4 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 20 MiB/s wr, 899 op/s 2024-06-02T04:52:25.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:52:25 smithi076 ceph-mon[42935]: pgmap v353: 129 pgs: 129 active+clean; 1.4 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 20 MiB/s wr, 899 op/s 2024-06-02T04:52:26.314 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 95.0 s, 1010.8 tps, lat 98.902 ms stddev 177.613 2024-06-02T04:52:27.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:52:27 smithi119 ceph-mon[46633]: pgmap v354: 129 pgs: 129 active+clean; 1.4 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 26 MiB/s wr, 1.09k op/s 2024-06-02T04:52:27.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:52:27 smithi192 ceph-mon[47933]: pgmap v354: 129 pgs: 129 active+clean; 1.4 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 26 MiB/s wr, 1.09k op/s 2024-06-02T04:52:27.735 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:52:27 smithi076 ceph-mon[42935]: pgmap v354: 129 pgs: 129 active+clean; 1.4 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 26 MiB/s wr, 1.09k op/s 2024-06-02T04:52:29.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:52:29 smithi119 ceph-mon[46633]: pgmap v355: 129 pgs: 129 active+clean; 1.4 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 22 MiB/s wr, 929 op/s 2024-06-02T04:52:29.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:52:29 smithi192 ceph-mon[47933]: pgmap v355: 129 pgs: 129 active+clean; 1.4 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 22 MiB/s wr, 929 op/s 2024-06-02T04:52:29.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:52:29 smithi076 ceph-mon[42935]: pgmap v355: 129 pgs: 129 active+clean; 1.4 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 22 MiB/s wr, 929 op/s 2024-06-02T04:52:31.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 100.0 s, 745.2 tps, lat 134.424 ms stddev 196.144 2024-06-02T04:52:31.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:52:31 smithi119 ceph-mon[46633]: pgmap v356: 129 pgs: 129 active+clean; 1.4 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 21 MiB/s wr, 882 op/s 2024-06-02T04:52:31.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:52:31 smithi192 ceph-mon[47933]: pgmap v356: 129 pgs: 129 active+clean; 1.4 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 21 MiB/s wr, 882 op/s 2024-06-02T04:52:31.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:52:31 smithi076 ceph-mon[42935]: pgmap v356: 129 pgs: 129 active+clean; 1.4 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 21 MiB/s wr, 882 op/s 2024-06-02T04:52:33.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:52:33 smithi192 ceph-mon[47933]: pgmap v357: 129 pgs: 129 active+clean; 1.5 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 24 MiB/s wr, 1.07k op/s 2024-06-02T04:52:33.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:52:33 smithi076 ceph-mon[42935]: pgmap v357: 129 pgs: 129 active+clean; 1.5 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 24 MiB/s wr, 1.07k op/s 2024-06-02T04:52:33.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:52:33 smithi119 ceph-mon[46633]: pgmap v357: 129 pgs: 129 active+clean; 1.5 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 24 MiB/s wr, 1.07k op/s 2024-06-02T04:52:35.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:52:35 smithi192 ceph-mon[47933]: pgmap v358: 129 pgs: 129 active+clean; 1.5 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 19 MiB/s wr, 897 op/s 2024-06-02T04:52:35.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:52:35 smithi076 ceph-mon[42935]: pgmap v358: 129 pgs: 129 active+clean; 1.5 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 19 MiB/s wr, 897 op/s 2024-06-02T04:52:35.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:52:35 smithi119 ceph-mon[46633]: pgmap v358: 129 pgs: 129 active+clean; 1.5 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 19 MiB/s wr, 897 op/s 2024-06-02T04:52:36.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 105.0 s, 913.8 tps, lat 108.982 ms stddev 131.906 2024-06-02T04:52:37.383 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.383+0000 7fa51f689700 1 -- 172.21.15.76:0/1126919584 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa51810d2e0 msgr2=0x7fa51810d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:52:37.383 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.383+0000 7fa51f689700 1 --2- 172.21.15.76:0/1126919584 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa51810d2e0 0x7fa51810d760 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fa5080098f0 tx=0x7fa508009c00 comp rx=0 tx=0).stop 2024-06-02T04:52:37.385 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.385+0000 7fa51f689700 1 -- 172.21.15.76:0/1126919584 shutdown_connections 2024-06-02T04:52:37.385 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.385+0000 7fa51f689700 1 --2- 172.21.15.76:0/1126919584 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa51810d2e0 0x7fa51810d760 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:37.385 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.385+0000 7fa51f689700 1 --2- 172.21.15.76:0/1126919584 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa518107fa0 0x7fa51810a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:37.386 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.385+0000 7fa51f689700 1 --2- 172.21.15.76:0/1126919584 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa51810a910 0x7fa51810cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:37.386 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.385+0000 7fa51f689700 1 -- 172.21.15.76:0/1126919584 >> 172.21.15.76:0/1126919584 conn(0x7fa51806df30 msgr2=0x7fa518070370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:52:37.394 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.388+0000 7fa51f689700 1 -- 172.21.15.76:0/1126919584 shutdown_connections 2024-06-02T04:52:37.394 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.388+0000 7fa51f689700 1 -- 172.21.15.76:0/1126919584 wait complete. 2024-06-02T04:52:37.394 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.389+0000 7fa51f689700 1 Processor -- start 2024-06-02T04:52:37.395 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.389+0000 7fa51f689700 1 -- start start 2024-06-02T04:52:37.395 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.389+0000 7fa51f689700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa518107fa0 0x7fa5181a5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:52:37.395 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.389+0000 7fa51f689700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa51810a910 0x7fa5181a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:52:37.395 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.389+0000 7fa51f689700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa51810d2e0 0x7fa518079200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:52:37.395 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.389+0000 7fa51f689700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5180797d0 con 0x7fa51810a910 2024-06-02T04:52:37.395 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.389+0000 7fa51f689700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa518079940 con 0x7fa51810d2e0 2024-06-02T04:52:37.395 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.389+0000 7fa51f689700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa518079b00 con 0x7fa518107fa0 2024-06-02T04:52:37.395 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.389+0000 7fa51cc24700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa51810a910 0x7fa5181a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:52:37.395 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.389+0000 7fa51cc24700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa51810a910 0x7fa5181a6100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:56872/0 (socket says 172.21.15.76:56872) 2024-06-02T04:52:37.395 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.389+0000 7fa51cc24700 1 -- 172.21.15.76:0/2195013870 learned_addr learned my addr 172.21.15.76:0/2195013870 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:52:37.395 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.389+0000 7fa51dc26700 1 --2- 172.21.15.76:0/2195013870 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa51810d2e0 0x7fa518079200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:52:37.396 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.390+0000 7fa51dc26700 1 -- 172.21.15.76:0/2195013870 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa518107fa0 msgr2=0x7fa5181a5bc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-02T04:52:37.396 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.390+0000 7fa51dc26700 1 --2- 172.21.15.76:0/2195013870 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa518107fa0 0x7fa5181a5bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:37.396 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.390+0000 7fa51dc26700 1 -- 172.21.15.76:0/2195013870 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa51810a910 msgr2=0x7fa5181a6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:52:37.396 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.390+0000 7fa51dc26700 1 --2- 172.21.15.76:0/2195013870 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa51810a910 0x7fa5181a6100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:37.396 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.390+0000 7fa51dc26700 1 -- 172.21.15.76:0/2195013870 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa510009d00 con 0x7fa51810d2e0 2024-06-02T04:52:37.396 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.390+0000 7fa51dc26700 1 --2- 172.21.15.76:0/2195013870 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa51810d2e0 0x7fa518079200 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa50800fb00 tx=0x7fa50800b790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:52:37.396 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.390+0000 7fa50e7fc700 1 -- 172.21.15.76:0/2195013870 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa50801c070 con 0x7fa51810d2e0 2024-06-02T04:52:37.396 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.390+0000 7fa50e7fc700 1 -- 172.21.15.76:0/2195013870 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa50800f7d0 con 0x7fa51810d2e0 2024-06-02T04:52:37.396 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.390+0000 7fa51f689700 1 -- 172.21.15.76:0/2195013870 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa508009520 con 0x7fa51810d2e0 2024-06-02T04:52:37.396 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.391+0000 7fa51f689700 1 -- 172.21.15.76:0/2195013870 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa518079fb0 con 0x7fa51810d2e0 2024-06-02T04:52:37.396 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.391+0000 7fa50e7fc700 1 -- 172.21.15.76:0/2195013870 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa508003a00 con 0x7fa51810d2e0 2024-06-02T04:52:37.397 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.394+0000 7fa50e7fc700 1 -- 172.21.15.76:0/2195013870 <== mon.2 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fa508020070 con 0x7fa51810d2e0 2024-06-02T04:52:37.397 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.395+0000 7fa50e7fc700 1 --2- 172.21.15.76:0/2195013870 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fa5040a11a0 0x7fa5040a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:52:37.397 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.395+0000 7fa51d425700 1 --2- 172.21.15.76:0/2195013870 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fa5040a11a0 0x7fa5040a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:52:37.397 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.395+0000 7fa50e7fc700 1 -- 172.21.15.76:0/2195013870 <== mon.2 v2:172.21.15.119:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7fa5080cd5b0 con 0x7fa51810d2e0 2024-06-02T04:52:37.397 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.396+0000 7fa51d425700 1 --2- 172.21.15.76:0/2195013870 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fa5040a11a0 0x7fa5040a3660 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fa510009fd0 tx=0x7fa51000b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:52:37.400 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.396+0000 7fa52b844b80 1 Processor -- start 2024-06-02T04:52:37.400 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.397+0000 7fa52b844b80 1 -- start start 2024-06-02T04:52:37.400 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.397+0000 7fa52b844b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564c9407fa80 0x564c9407fea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:52:37.400 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.397+0000 7fa52b844b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564c940803e0 0x564c94080cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:52:37.400 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.397+0000 7fa52b844b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564c940812d0 0x564c94081750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:52:37.400 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.397+0000 7fa52b844b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c93fd70f0 con 0x564c9407fa80 2024-06-02T04:52:37.400 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.397+0000 7fa52b844b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c93fd4ab0 con 0x564c940803e0 2024-06-02T04:52:37.400 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.397+0000 7fa52b844b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c93fd03a0 con 0x564c940812d0 2024-06-02T04:52:37.400 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.397+0000 7fa51d425700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564c9407fa80 0x564c9407fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:52:37.401 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.397+0000 7fa51d425700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564c9407fa80 0x564c9407fea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:56886/0 (socket says 172.21.15.76:56886) 2024-06-02T04:52:37.401 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.397+0000 7fa51d425700 1 -- 172.21.15.76:0/1717081313 learned_addr learned my addr 172.21.15.76:0/1717081313 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:52:37.401 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.397+0000 7fa51cc24700 1 --2- 172.21.15.76:0/1717081313 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564c940803e0 0x564c94080cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:52:37.401 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.397+0000 7fa51dc26700 1 --2- 172.21.15.76:0/1717081313 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564c940812d0 0x564c94081750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:52:37.401 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.398+0000 7fa51d425700 1 -- 172.21.15.76:0/1717081313 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564c940812d0 msgr2=0x564c94081750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:52:37.401 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.398+0000 7fa51d425700 1 --2- 172.21.15.76:0/1717081313 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564c940812d0 0x564c94081750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:37.401 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.398+0000 7fa51d425700 1 -- 172.21.15.76:0/1717081313 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564c940803e0 msgr2=0x564c94080cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:52:37.401 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.398+0000 7fa51d425700 1 --2- 172.21.15.76:0/1717081313 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564c940803e0 0x564c94080cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:37.401 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.398+0000 7fa51d425700 1 -- 172.21.15.76:0/1717081313 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564c93e51350 con 0x564c9407fa80 2024-06-02T04:52:37.401 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.398+0000 7fa51d425700 1 --2- 172.21.15.76:0/1717081313 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564c9407fa80 0x564c9407fea0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fa510003d20 tx=0x7fa510011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80b80e96e4ad8a94 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:52:37.401 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.400+0000 7fa5037fe700 1 -- 172.21.15.76:0/1717081313 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5100047b0 con 0x564c9407fa80 2024-06-02T04:52:37.401 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.400+0000 7fa5037fe700 1 -- 172.21.15.76:0/1717081313 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa51000f040 con 0x564c9407fa80 2024-06-02T04:52:37.402 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.400+0000 7fa5037fe700 1 -- 172.21.15.76:0/1717081313 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa510015650 con 0x564c9407fa80 2024-06-02T04:52:37.405 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.400+0000 7fa52b844b80 1 -- 172.21.15.76:0/1717081313 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564c9407fa80 msgr2=0x564c9407fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:52:37.405 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.400+0000 7fa52b844b80 1 --2- 172.21.15.76:0/1717081313 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564c9407fa80 0x564c9407fea0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fa510003d20 tx=0x7fa510011000 comp rx=0 tx=0).stop 2024-06-02T04:52:37.405 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.400+0000 7fa52b844b80 1 -- 172.21.15.76:0/1717081313 shutdown_connections 2024-06-02T04:52:37.405 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.400+0000 7fa52b844b80 1 --2- 172.21.15.76:0/1717081313 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564c940812d0 0x564c94081750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:37.405 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.400+0000 7fa52b844b80 1 --2- 172.21.15.76:0/1717081313 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564c9407fa80 0x564c9407fea0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:37.405 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.400+0000 7fa52b844b80 1 --2- 172.21.15.76:0/1717081313 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564c940803e0 0x564c94080cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:37.405 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.400+0000 7fa52b844b80 1 -- 172.21.15.76:0/1717081313 >> 172.21.15.76:0/1717081313 conn(0x564c93fde1b0 msgr2=0x564c9407c440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:52:37.405 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.401+0000 7fa52b844b80 1 -- 172.21.15.76:0/1717081313 shutdown_connections 2024-06-02T04:52:37.405 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.401+0000 7fa52b844b80 1 -- 172.21.15.76:0/1717081313 wait complete. 2024-06-02T04:52:37.406 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.401+0000 7fa52b844b80 1 -- start start 2024-06-02T04:52:37.406 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.401+0000 7fa52b844b80 1 Processor -- start 2024-06-02T04:52:37.406 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.402+0000 7fa52b844b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564c9407fa80 0x564c940898c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:52:37.406 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.402+0000 7fa52b844b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564c940803e0 0x564c94089e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:52:37.406 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.402+0000 7fa52b844b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564c940812d0 0x564c94090e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:52:37.406 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.402+0000 7fa52b844b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c93f6c500 con 0x564c940803e0 2024-06-02T04:52:37.406 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.402+0000 7fa52b844b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c93f6c1a0 con 0x564c9407fa80 2024-06-02T04:52:37.406 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.402+0000 7fa52b844b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c93e53640 con 0x564c940812d0 2024-06-02T04:52:37.406 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.402+0000 7fa52b844b80 10 client.0 _ll_register_callbacks cb 0x564c93f75ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:52:37.406 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.402+0000 7fa51d425700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564c9407fa80 0x564c940898c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:52:37.406 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.402+0000 7fa51dc26700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564c940812d0 0x564c94090e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:52:37.406 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.402+0000 7fa51d425700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564c9407fa80 0x564c940898c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:57290/0 (socket says 172.21.15.76:57290) 2024-06-02T04:52:37.407 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.402+0000 7fa51d425700 1 -- 172.21.15.76:0/2020285048 learned_addr learned my addr 172.21.15.76:0/2020285048 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:52:37.407 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.402+0000 7fa51cc24700 1 --2- 172.21.15.76:0/2020285048 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564c940803e0 0x564c94089e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:52:37.407 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.402+0000 7fa51d425700 1 -- 172.21.15.76:0/2020285048 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564c940812d0 msgr2=0x564c94090e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:52:37.407 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.402+0000 7fa51d425700 1 --2- 172.21.15.76:0/2020285048 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564c940812d0 0x564c94090e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:37.407 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.402+0000 7fa51d425700 1 -- 172.21.15.76:0/2020285048 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564c940803e0 msgr2=0x564c94089e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:52:37.407 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.402+0000 7fa51d425700 1 --2- 172.21.15.76:0/2020285048 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564c940803e0 0x564c94089e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:37.407 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.402+0000 7fa51d425700 1 -- 172.21.15.76:0/2020285048 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa510003a00 con 0x564c9407fa80 2024-06-02T04:52:37.407 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.402+0000 7fa51d425700 1 --2- 172.21.15.76:0/2020285048 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564c9407fa80 0x564c940898c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa510009750 tx=0x7fa510009c40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d805b41e5cd51a64 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:52:37.407 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.403+0000 7fa500ff9700 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-06-02T04:52:37.407 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.403+0000 7fa500ff9700 1 -- 172.21.15.76:0/2020285048 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa510009020 con 0x564c9407fa80 2024-06-02T04:52:37.407 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.403+0000 7fa500ff9700 1 -- 172.21.15.76:0/2020285048 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7fa510009180 con 0x564c9407fa80 2024-06-02T04:52:37.407 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.403+0000 7fa52b844b80 1 -- 172.21.15.76:0/2020285048 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564c93f29210 con 0x564c9407fa80 2024-06-02T04:52:37.407 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.403+0000 7fa500ff9700 1 -- 172.21.15.76:0/2020285048 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa510009340 con 0x564c9407fa80 2024-06-02T04:52:37.408 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.404+0000 7fa52b844b80 10 client.25523 fetch_fsmap learned FSMap version 29 2024-06-02T04:52:37.408 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.404+0000 7fa52b844b80 1 -- 172.21.15.76:0/2020285048 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x564c93dfdb00 con 0x564c9407fa80 2024-06-02T04:52:37.408 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.404+0000 7fa500ff9700 1 -- 172.21.15.76:0/2020285048 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x564c93f29210 con 0x564c9407fa80 2024-06-02T04:52:37.408 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.404+0000 7fa500ff9700 1 -- 172.21.15.76:0/2020285048 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 29) v1 ==== 7482+0+0 (secure 0 0 0) 0x7fa510004040 con 0x564c9407fa80 2024-06-02T04:52:37.408 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.404+0000 7fa52b844b80 10 client.25523 fetch_fsmap finished waiting for FSMap version 29 2024-06-02T04:52:37.408 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.404+0000 7fa52b844b80 10 client.25523 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T04:52:37.408 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.404+0000 7fa52b844b80 20 client.25523 populate_metadata read hostname 'smithi076' 2024-06-02T04:52:37.408 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.404+0000 7fa52b844b80 1 --2- 172.21.15.76:0/2020285048 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x564c94095520 0x564c94097940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:52:37.408 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.404+0000 7fa52b844b80 4 client.25523 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T04:52:37.408 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.404+0000 7fa52b844b80 1 -- 172.21.15.76:0/2020285048 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564c9404f7b0 con 0x564c94095520 2024-06-02T04:52:37.408 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.405+0000 7fa51cc24700 1 --2- 172.21.15.76:0/2020285048 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x564c94095520 0x564c94097940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:52:37.410 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.406+0000 7fa500ff9700 10 client.25523 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:52:37.410 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.406+0000 7fa51cc24700 1 --2- 172.21.15.76:0/2020285048 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x564c94095520 0x564c94097940 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d7354ad57ab64f74 server_cookie=a1d0560a6242b00f in_seq=0 out_seq=0 2024-06-02T04:52:37.410 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.406+0000 7fa500ff9700 1 -- 172.21.15.76:0/2020285048 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x564c9404f7b0 con 0x564c94095520 2024-06-02T04:52:37.410 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.406+0000 7fa500ff9700 10 client.25523 handle_command_reply: tid=0 2024-06-02T04:52:37.410 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.406+0000 7fa52b844b80 1 client.25523 shutdown 2024-06-02T04:52:37.410 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.406+0000 7fa52b844b80 1 -- 172.21.15.76:0/2020285048 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564c9407fa80 msgr2=0x564c940898c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:52:37.410 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.406+0000 7fa52b844b80 1 --2- 172.21.15.76:0/2020285048 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564c9407fa80 0x564c940898c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa510009750 tx=0x7fa510009c40 comp rx=0 tx=0).stop 2024-06-02T04:52:37.410 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.407+0000 7fa52b844b80 1 -- 172.21.15.76:0/2020285048 shutdown_connections 2024-06-02T04:52:37.410 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.407+0000 7fa52b844b80 1 --2- 172.21.15.76:0/2020285048 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x564c94095520 0x564c94097940 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:37.411 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.407+0000 7fa52b844b80 1 --2- 172.21.15.76:0/2020285048 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564c940812d0 0x564c94090e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:37.411 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.407+0000 7fa52b844b80 1 --2- 172.21.15.76:0/2020285048 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564c9407fa80 0x564c940898c0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:37.411 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.407+0000 7fa52b844b80 1 --2- 172.21.15.76:0/2020285048 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564c940803e0 0x564c94089e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:37.411 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.407+0000 7fa52b844b80 1 -- 172.21.15.76:0/2020285048 >> 172.21.15.76:0/2020285048 conn(0x564c93fde1b0 msgr2=0x564c9407a860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:52:37.411 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.407+0000 7fa500ff9700 0 client.25523 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:52:37.411 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.407+0000 7fa52b844b80 1 -- 172.21.15.76:0/2020285048 shutdown_connections 2024-06-02T04:52:37.411 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.407+0000 7fa52b844b80 1 -- 172.21.15.76:0/2020285048 wait complete. 2024-06-02T04:52:37.411 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.407+0000 7fa52b844b80 20 client.25523 trim_cache size 0 max 16384 2024-06-02T04:52:37.430 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.428+0000 7fa52b844b80 1 Processor -- start 2024-06-02T04:52:37.430 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.429+0000 7fa52b844b80 1 -- start start 2024-06-02T04:52:37.430 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.429+0000 7fa52b844b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564c9407fa80 0x564c940816b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:52:37.430 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.429+0000 7fa52b844b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564c940803e0 0x564c94090dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:52:37.430 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.429+0000 7fa52b844b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564c940812d0 0x564c9407c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:52:37.430 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.429+0000 7fa52b844b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c9408a910 con 0x564c940812d0 2024-06-02T04:52:37.431 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.429+0000 7fa52b844b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c94075330 con 0x564c940803e0 2024-06-02T04:52:37.431 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.429+0000 7fa52b844b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c94088390 con 0x564c9407fa80 2024-06-02T04:52:37.431 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.429+0000 7fa51dc26700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564c940812d0 0x564c9407c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:52:37.431 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.429+0000 7fa51dc26700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564c940812d0 0x564c9407c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:56904/0 (socket says 172.21.15.76:56904) 2024-06-02T04:52:37.431 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.429+0000 7fa51dc26700 1 -- 172.21.15.76:0/758130895 learned_addr learned my addr 172.21.15.76:0/758130895 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:52:37.431 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.429+0000 7fa51cc24700 1 --2- 172.21.15.76:0/758130895 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564c940803e0 0x564c94090dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:52:37.431 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.429+0000 7fa51d425700 1 --2- 172.21.15.76:0/758130895 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564c9407fa80 0x564c940816b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:52:37.431 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.429+0000 7fa51dc26700 1 -- 172.21.15.76:0/758130895 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564c9407fa80 msgr2=0x564c940816b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:52:37.431 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.429+0000 7fa51dc26700 1 --2- 172.21.15.76:0/758130895 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564c9407fa80 0x564c940816b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:37.431 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.429+0000 7fa51dc26700 1 -- 172.21.15.76:0/758130895 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564c940803e0 msgr2=0x564c94090dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:52:37.431 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.429+0000 7fa51dc26700 1 --2- 172.21.15.76:0/758130895 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564c940803e0 0x564c94090dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:37.431 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.429+0000 7fa51dc26700 1 -- 172.21.15.76:0/758130895 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564c93f96500 con 0x564c940812d0 2024-06-02T04:52:37.431 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.430+0000 7fa51dc26700 1 --2- 172.21.15.76:0/758130895 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564c940812d0 0x564c9407c020 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fa50809a680 tx=0x7fa5080058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=326c3983f4b7e32d server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:52:37.432 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.430+0000 7fa503fff700 1 -- 172.21.15.76:0/758130895 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa50809a6f0 con 0x564c940812d0 2024-06-02T04:52:37.432 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.430+0000 7fa503fff700 1 -- 172.21.15.76:0/758130895 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa50809e520 con 0x564c940812d0 2024-06-02T04:52:37.432 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.430+0000 7fa503fff700 1 -- 172.21.15.76:0/758130895 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5080cd2b0 con 0x564c940812d0 2024-06-02T04:52:37.435 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.430+0000 7fa52b844b80 1 -- 172.21.15.76:0/758130895 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564c940812d0 msgr2=0x564c9407c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:52:37.435 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.430+0000 7fa52b844b80 1 --2- 172.21.15.76:0/758130895 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564c940812d0 0x564c9407c020 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fa50809a680 tx=0x7fa5080058d0 comp rx=0 tx=0).stop 2024-06-02T04:52:37.435 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.431+0000 7fa52b844b80 1 -- 172.21.15.76:0/758130895 shutdown_connections 2024-06-02T04:52:37.435 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.431+0000 7fa52b844b80 1 --2- 172.21.15.76:0/758130895 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564c940812d0 0x564c9407c020 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:37.435 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.431+0000 7fa52b844b80 1 --2- 172.21.15.76:0/758130895 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564c9407fa80 0x564c940816b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:37.435 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.431+0000 7fa52b844b80 1 --2- 172.21.15.76:0/758130895 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564c940803e0 0x564c94090dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:37.435 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.431+0000 7fa52b844b80 1 -- 172.21.15.76:0/758130895 >> 172.21.15.76:0/758130895 conn(0x564c93fde1b0 msgr2=0x564c9409c260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:52:37.435 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.431+0000 7fa52b844b80 1 -- 172.21.15.76:0/758130895 shutdown_connections 2024-06-02T04:52:37.436 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.431+0000 7fa52b844b80 1 -- 172.21.15.76:0/758130895 wait complete. 2024-06-02T04:52:37.436 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.431+0000 7fa52b844b80 1 -- start start 2024-06-02T04:52:37.436 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.431+0000 7fa52b844b80 1 Processor -- start 2024-06-02T04:52:37.436 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.432+0000 7fa52b844b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564c9407fa80 0x564c94090c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:52:37.436 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.432+0000 7fa52b844b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564c940803e0 0x564c9408d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:52:37.436 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.432+0000 7fa52b844b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564c940812d0 0x564c9408dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:52:37.436 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.432+0000 7fa52b844b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c9408e2d0 con 0x564c9407fa80 2024-06-02T04:52:37.436 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.432+0000 7fa52b844b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c940e99c0 con 0x564c940803e0 2024-06-02T04:52:37.436 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.432+0000 7fa52b844b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c940e9b30 con 0x564c940812d0 2024-06-02T04:52:37.436 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.432+0000 7fa52b844b80 10 client.0 _ll_register_callbacks cb 0x564c93f75ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:52:37.436 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.432+0000 7fa51dc26700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564c940812d0 0x564c9408dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:52:37.436 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.432+0000 7fa51d425700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564c9407fa80 0x564c94090c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:52:37.437 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.432+0000 7fa51dc26700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564c940812d0 0x564c9408dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:56062/0 (socket says 172.21.15.76:56062) 2024-06-02T04:52:37.437 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.432+0000 7fa51dc26700 1 -- 172.21.15.76:0/3444583959 learned_addr learned my addr 172.21.15.76:0/3444583959 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:52:37.437 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.432+0000 7fa51cc24700 1 --2- 172.21.15.76:0/3444583959 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564c940803e0 0x564c9408d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:52:37.437 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.432+0000 7fa51dc26700 1 -- 172.21.15.76:0/3444583959 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564c940803e0 msgr2=0x564c9408d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:52:37.437 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.432+0000 7fa51dc26700 1 --2- 172.21.15.76:0/3444583959 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564c940803e0 0x564c9408d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:37.437 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.432+0000 7fa51dc26700 1 -- 172.21.15.76:0/3444583959 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564c9407fa80 msgr2=0x564c94090c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:52:37.437 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.432+0000 7fa51dc26700 1 --2- 172.21.15.76:0/3444583959 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564c9407fa80 0x564c94090c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:37.437 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.432+0000 7fa51dc26700 1 -- 172.21.15.76:0/3444583959 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa518079fb0 con 0x564c940812d0 2024-06-02T04:52:37.437 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.432+0000 7fa51cc24700 1 --2- 172.21.15.76:0/3444583959 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564c940803e0 0x564c9408d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T04:52:37.437 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.432+0000 7fa51d425700 1 --2- 172.21.15.76:0/3444583959 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564c9407fa80 0x564c94090c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T04:52:37.437 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.432+0000 7fa51dc26700 1 --2- 172.21.15.76:0/3444583959 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564c940812d0 0x564c9408dc30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa5080b0040 tx=0x7fa50809aeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fdb091b72f9edbe7 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:52:37.437 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.432+0000 7fa500ff9700 10 client.0 ms_handle_connect on v2:172.21.15.192:3300/0 2024-06-02T04:52:37.438 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.432+0000 7fa500ff9700 1 -- 172.21.15.76:0/3444583959 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa508080070 con 0x564c940812d0 2024-06-02T04:52:37.438 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.433+0000 7fa500ff9700 1 -- 172.21.15.76:0/3444583959 <== mon.1 v2:172.21.15.192:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7fa50809a6f0 con 0x564c940812d0 2024-06-02T04:52:37.438 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.433+0000 7fa52b844b80 1 -- 172.21.15.76:0/3444583959 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa51000f040 con 0x564c940812d0 2024-06-02T04:52:37.438 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.433+0000 7fa500ff9700 1 -- 172.21.15.76:0/3444583959 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa5080ba0b0 con 0x564c940812d0 2024-06-02T04:52:37.438 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.433+0000 7fa52b844b80 10 client.25462 fetch_fsmap learned FSMap version 29 2024-06-02T04:52:37.438 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.433+0000 7fa52b844b80 1 -- 172.21.15.76:0/3444583959 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x564c93e55c70 con 0x564c940812d0 2024-06-02T04:52:37.438 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.433+0000 7fa500ff9700 1 -- 172.21.15.76:0/3444583959 <== mon.1 v2:172.21.15.192:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa51000f040 con 0x564c940812d0 2024-06-02T04:52:37.438 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.433+0000 7fa500ff9700 1 -- 172.21.15.76:0/3444583959 <== mon.1 v2:172.21.15.192:3300/0 5 ==== fsmap(e 29) v1 ==== 7482+0+0 (secure 0 0 0) 0x7fa508083070 con 0x564c940812d0 2024-06-02T04:52:37.438 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.433+0000 7fa52b844b80 10 client.25462 fetch_fsmap finished waiting for FSMap version 29 2024-06-02T04:52:37.439 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.433+0000 7fa52b844b80 10 client.25462 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T04:52:37.439 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.433+0000 7fa52b844b80 20 client.25462 populate_metadata read hostname 'smithi076' 2024-06-02T04:52:37.439 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.433+0000 7fa52b844b80 1 --2- 172.21.15.76:0/3444583959 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x564c940eb110 0x564c940ed530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:52:37.439 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.433+0000 7fa52b844b80 4 client.25462 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T04:52:37.439 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.433+0000 7fa52b844b80 1 -- 172.21.15.76:0/3444583959 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x564c93fc8e60 con 0x564c940eb110 2024-06-02T04:52:37.439 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.433+0000 7fa51d425700 1 --2- 172.21.15.76:0/3444583959 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x564c940eb110 0x564c940ed530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:52:37.439 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.434+0000 7fa500ff9700 10 client.25462 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:52:37.439 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.434+0000 7fa51d425700 1 --2- 172.21.15.76:0/3444583959 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x564c940eb110 0x564c940ed530 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d3016963b75a0bd6 server_cookie=e1b0ccbfb5e4e77e in_seq=0 out_seq=0 2024-06-02T04:52:37.449 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.448+0000 7fa500ff9700 1 -- 172.21.15.76:0/3444583959 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x564c93fc8e60 con 0x564c940eb110 2024-06-02T04:52:37.449 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.448+0000 7fa500ff9700 10 client.25462 handle_command_reply: tid=0 2024-06-02T04:52:37.449 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.448+0000 7fa52b844b80 1 client.25462 shutdown 2024-06-02T04:52:37.450 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.448+0000 7fa52b844b80 1 -- 172.21.15.76:0/3444583959 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564c940812d0 msgr2=0x564c9408dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:52:37.450 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.448+0000 7fa52b844b80 1 --2- 172.21.15.76:0/3444583959 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564c940812d0 0x564c9408dc30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa5080b0040 tx=0x7fa50809aeb0 comp rx=0 tx=0).stop 2024-06-02T04:52:37.450 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.448+0000 7fa52b844b80 1 -- 172.21.15.76:0/3444583959 shutdown_connections 2024-06-02T04:52:37.450 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.448+0000 7fa52b844b80 1 --2- 172.21.15.76:0/3444583959 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x564c940eb110 0x564c940ed530 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:37.450 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.448+0000 7fa52b844b80 1 --2- 172.21.15.76:0/3444583959 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564c940812d0 0x564c9408dc30 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:37.450 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.448+0000 7fa500ff9700 0 client.25462 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:52:37.450 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.448+0000 7fa52b844b80 1 --2- 172.21.15.76:0/3444583959 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564c9407fa80 0x564c94090c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:37.450 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.448+0000 7fa52b844b80 1 --2- 172.21.15.76:0/3444583959 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564c940803e0 0x564c9408d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:37.450 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.448+0000 7fa52b844b80 1 -- 172.21.15.76:0/3444583959 >> 172.21.15.76:0/3444583959 conn(0x564c93fde1b0 msgr2=0x564c94088a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:52:37.450 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.449+0000 7fa52b844b80 1 -- 172.21.15.76:0/3444583959 shutdown_connections 2024-06-02T04:52:37.450 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.449+0000 7fa52b844b80 1 -- 172.21.15.76:0/3444583959 wait complete. 2024-06-02T04:52:37.450 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.449+0000 7fa52b844b80 20 client.25462 trim_cache size 0 max 16384 2024-06-02T04:52:37.451 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:{ 2024-06-02T04:52:37.451 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "message": "", 2024-06-02T04:52:37.451 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "return_code": 0 2024-06-02T04:52:37.451 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:} 2024-06-02T04:52:37.452 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.449+0000 7fa51f689700 1 -- 172.21.15.76:0/2195013870 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fa5040a11a0 msgr2=0x7fa5040a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:52:37.452 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.449+0000 7fa51f689700 1 --2- 172.21.15.76:0/2195013870 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fa5040a11a0 0x7fa5040a3660 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fa510009fd0 tx=0x7fa51000b040 comp rx=0 tx=0).stop 2024-06-02T04:52:37.452 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.449+0000 7fa51f689700 1 -- 172.21.15.76:0/2195013870 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa51810d2e0 msgr2=0x7fa518079200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:52:37.452 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.449+0000 7fa51f689700 1 --2- 172.21.15.76:0/2195013870 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa51810d2e0 0x7fa518079200 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa50800fb00 tx=0x7fa50800b790 comp rx=0 tx=0).stop 2024-06-02T04:52:37.453 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.449+0000 7fa51f689700 1 -- 172.21.15.76:0/2195013870 shutdown_connections 2024-06-02T04:52:37.453 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.449+0000 7fa51f689700 1 --2- 172.21.15.76:0/2195013870 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fa5040a11a0 0x7fa5040a3660 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:37.453 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.449+0000 7fa51f689700 1 --2- 172.21.15.76:0/2195013870 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa51810d2e0 0x7fa518079200 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:37.453 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.449+0000 7fa51f689700 1 --2- 172.21.15.76:0/2195013870 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa518107fa0 0x7fa5181a5bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:37.453 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.449+0000 7fa51f689700 1 --2- 172.21.15.76:0/2195013870 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa51810a910 0x7fa5181a6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:37.453 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.449+0000 7fa51f689700 1 -- 172.21.15.76:0/2195013870 >> 172.21.15.76:0/2195013870 conn(0x7fa51806df30 msgr2=0x7fa51810ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:52:37.453 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.449+0000 7fa51f689700 1 -- 172.21.15.76:0/2195013870 shutdown_connections 2024-06-02T04:52:37.453 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:37.449+0000 7fa51f689700 1 -- 172.21.15.76:0/2195013870 wait complete. 2024-06-02T04:52:37.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:52:37 smithi192 ceph-mon[47933]: pgmap v359: 129 pgs: 129 active+clean; 1.5 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 21 MiB/s wr, 1.09k op/s 2024-06-02T04:52:37.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:52:37 smithi076 ceph-mon[42935]: pgmap v359: 129 pgs: 129 active+clean; 1.5 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 21 MiB/s wr, 1.09k op/s 2024-06-02T04:52:37.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:52:37 smithi119 ceph-mon[46633]: pgmap v359: 129 pgs: 129 active+clean; 1.5 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 21 MiB/s wr, 1.09k op/s 2024-06-02T04:52:39.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:52:39 smithi192 ceph-mon[47933]: pgmap v360: 129 pgs: 129 active+clean; 1.5 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 20 MiB/s wr, 1.04k op/s 2024-06-02T04:52:39.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:52:39 smithi076 ceph-mon[42935]: pgmap v360: 129 pgs: 129 active+clean; 1.5 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 20 MiB/s wr, 1.04k op/s 2024-06-02T04:52:39.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:52:39 smithi119 ceph-mon[46633]: pgmap v360: 129 pgs: 129 active+clean; 1.5 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 20 MiB/s wr, 1.04k op/s 2024-06-02T04:52:41.314 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 110.0 s, 872.6 tps, lat 114.660 ms stddev 162.192 2024-06-02T04:52:41.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:52:41 smithi192 ceph-mon[47933]: pgmap v361: 129 pgs: 129 active+clean; 1.5 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 18 MiB/s wr, 974 op/s 2024-06-02T04:52:41.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:52:41 smithi076 ceph-mon[42935]: pgmap v361: 129 pgs: 129 active+clean; 1.5 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 18 MiB/s wr, 974 op/s 2024-06-02T04:52:41.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:52:41 smithi119 ceph-mon[46633]: pgmap v361: 129 pgs: 129 active+clean; 1.5 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 18 MiB/s wr, 974 op/s 2024-06-02T04:52:43.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:52:43 smithi192 ceph-mon[47933]: pgmap v362: 129 pgs: 129 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 19 MiB/s wr, 1.13k op/s 2024-06-02T04:52:43.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:52:43 smithi192 ceph-mon[47933]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-06-02T04:52:43.735 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:52:43 smithi076 ceph-mon[42935]: pgmap v362: 129 pgs: 129 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 19 MiB/s wr, 1.13k op/s 2024-06-02T04:52:43.735 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:52:43 smithi076 ceph-mon[42935]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-06-02T04:52:43.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:52:43 smithi119 ceph-mon[46633]: pgmap v362: 129 pgs: 129 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 19 MiB/s wr, 1.13k op/s 2024-06-02T04:52:43.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:52:43 smithi119 ceph-mon[46633]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-06-02T04:52:45.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:52:45 smithi192 ceph-mon[47933]: pgmap v363: 129 pgs: 129 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 16 MiB/s wr, 918 op/s 2024-06-02T04:52:45.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:52:45 smithi076 ceph-mon[42935]: pgmap v363: 129 pgs: 129 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 16 MiB/s wr, 918 op/s 2024-06-02T04:52:45.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:52:45 smithi119 ceph-mon[46633]: pgmap v363: 129 pgs: 129 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 16 MiB/s wr, 918 op/s 2024-06-02T04:52:46.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 115.0 s, 1081.8 tps, lat 92.351 ms stddev 28.793 2024-06-02T04:52:47.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:52:47 smithi192 ceph-mon[47933]: pgmap v364: 129 pgs: 129 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 19 MiB/s wr, 1.17k op/s 2024-06-02T04:52:47.735 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:52:47 smithi076 ceph-mon[42935]: pgmap v364: 129 pgs: 129 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 19 MiB/s wr, 1.17k op/s 2024-06-02T04:52:47.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:52:47 smithi119 ceph-mon[46633]: pgmap v364: 129 pgs: 129 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 19 MiB/s wr, 1.17k op/s 2024-06-02T04:52:49.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:52:49 smithi192 ceph-mon[47933]: pgmap v365: 129 pgs: 129 active+clean; 1.5 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 19 MiB/s wr, 1.09k op/s 2024-06-02T04:52:49.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:52:49 smithi076 ceph-mon[42935]: pgmap v365: 129 pgs: 129 active+clean; 1.5 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 19 MiB/s wr, 1.09k op/s 2024-06-02T04:52:49.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:52:49 smithi119 ceph-mon[46633]: pgmap v365: 129 pgs: 129 active+clean; 1.5 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 19 MiB/s wr, 1.09k op/s 2024-06-02T04:52:50.616 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.615+0000 7f4b0e223700 1 -- 172.21.15.76:0/4278552335 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4b080ff770 msgr2=0x7f4b08101ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:52:50.617 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.615+0000 7f4b0e223700 1 --2- 172.21.15.76:0/4278552335 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4b080ff770 0x7f4b08101ba0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4afc009990 tx=0x7f4afc009ca0 comp rx=0 tx=0).stop 2024-06-02T04:52:50.617 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.616+0000 7f4b0e223700 1 -- 172.21.15.76:0/4278552335 shutdown_connections 2024-06-02T04:52:50.617 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.616+0000 7f4b0e223700 1 --2- 172.21.15.76:0/4278552335 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4b08104ab0 0x7f4b08104f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:50.617 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.616+0000 7f4b0e223700 1 --2- 172.21.15.76:0/4278552335 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4b080ff770 0x7f4b08101ba0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:50.617 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.616+0000 7f4b0e223700 1 --2- 172.21.15.76:0/4278552335 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4b081020e0 0x7f4b08104570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:50.617 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.616+0000 7f4b0e223700 1 -- 172.21.15.76:0/4278552335 >> 172.21.15.76:0/4278552335 conn(0x7f4b080fb390 msgr2=0x7f4b080fd7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:52:50.620 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.620+0000 7f4b0e223700 1 -- 172.21.15.76:0/4278552335 shutdown_connections 2024-06-02T04:52:50.621 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.621+0000 7f4b0e223700 1 -- 172.21.15.76:0/4278552335 wait complete. 2024-06-02T04:52:50.624 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.622+0000 7f4b0e223700 1 Processor -- start 2024-06-02T04:52:50.624 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.622+0000 7f4b0e223700 1 -- start start 2024-06-02T04:52:50.624 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.622+0000 7f4b0e223700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4b080ff770 0x7f4b0810da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:52:50.624 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.622+0000 7f4b0e223700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4b081020e0 0x7f4b0810dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:52:50.624 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.622+0000 7f4b0e223700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4b08104ab0 0x7f4b0810ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:52:50.624 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.622+0000 7f4b0e223700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b0810f510 con 0x7f4b080ff770 2024-06-02T04:52:50.624 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.622+0000 7f4b0e223700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b0810f680 con 0x7f4b08104ab0 2024-06-02T04:52:50.624 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.622+0000 7f4b0e223700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b0810f840 con 0x7f4b081020e0 2024-06-02T04:52:50.624 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.622+0000 7f4b07fff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4b08104ab0 0x7f4b0810ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:52:50.624 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.622+0000 7f4b077fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4b080ff770 0x7f4b0810da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:52:50.625 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.622+0000 7f4b077fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4b080ff770 0x7f4b0810da60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:55354/0 (socket says 172.21.15.76:55354) 2024-06-02T04:52:50.625 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.622+0000 7f4b077fe700 1 -- 172.21.15.76:0/2897322187 learned_addr learned my addr 172.21.15.76:0/2897322187 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:52:50.625 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.622+0000 7f4b06ffd700 1 --2- 172.21.15.76:0/2897322187 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4b081020e0 0x7f4b0810dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:52:50.625 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.623+0000 7f4b06ffd700 1 -- 172.21.15.76:0/2897322187 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4b08104ab0 msgr2=0x7f4b0810ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:52:50.625 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.623+0000 7f4b06ffd700 1 --2- 172.21.15.76:0/2897322187 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4b08104ab0 0x7f4b0810ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:50.625 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.623+0000 7f4b06ffd700 1 -- 172.21.15.76:0/2897322187 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4b080ff770 msgr2=0x7f4b0810da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:52:50.625 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.623+0000 7f4b06ffd700 1 --2- 172.21.15.76:0/2897322187 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4b080ff770 0x7f4b0810da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:50.625 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.623+0000 7f4b06ffd700 1 -- 172.21.15.76:0/2897322187 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4afc0095f0 con 0x7f4b081020e0 2024-06-02T04:52:50.625 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.623+0000 7f4b07fff700 1 --2- 172.21.15.76:0/2897322187 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4b08104ab0 0x7f4b0810ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:52:50.626 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.625+0000 7f4b06ffd700 1 --2- 172.21.15.76:0/2897322187 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4b081020e0 0x7f4b0810dfa0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4b00007ec0 tx=0x7f4b0000d3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:52:50.626 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.625+0000 7f4b04ff9700 1 -- 172.21.15.76:0/2897322187 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b00004db0 con 0x7f4b081020e0 2024-06-02T04:52:50.626 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.625+0000 7f4b04ff9700 1 -- 172.21.15.76:0/2897322187 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4b0000f040 con 0x7f4b081020e0 2024-06-02T04:52:50.626 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.625+0000 7f4b04ff9700 1 -- 172.21.15.76:0/2897322187 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b000058e0 con 0x7f4b081020e0 2024-06-02T04:52:50.629 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.627+0000 7f4b0e223700 1 -- 172.21.15.76:0/2897322187 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b0810fac0 con 0x7f4b081020e0 2024-06-02T04:52:50.630 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.627+0000 7f4b0e223700 1 -- 172.21.15.76:0/2897322187 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b0810ff50 con 0x7f4b081020e0 2024-06-02T04:52:50.630 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.630+0000 7f4b04ff9700 1 -- 172.21.15.76:0/2897322187 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f4b0000db70 con 0x7f4b081020e0 2024-06-02T04:52:50.631 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.631+0000 7f4b04ff9700 1 --2- 172.21.15.76:0/2897322187 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f4af00a11f0 0x7f4af00a36b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:52:50.631 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.631+0000 7f4b04ff9700 1 -- 172.21.15.76:0/2897322187 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f4b000cc5f0 con 0x7f4b081020e0 2024-06-02T04:52:50.632 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.632+0000 7f4b077fe700 1 --2- 172.21.15.76:0/2897322187 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f4af00a11f0 0x7f4af00a36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:52:50.632 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.632+0000 7f4b077fe700 1 --2- 172.21.15.76:0/2897322187 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f4af00a11f0 0x7f4af00a36b0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f4afc006010 tx=0x7f4afc003750 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:52:50.635 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.635+0000 7f4b1a3deb80 1 Processor -- start 2024-06-02T04:52:50.635 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.635+0000 7f4b1a3deb80 1 -- start start 2024-06-02T04:52:50.635 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.635+0000 7f4b1a3deb80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557c8bae9a80 0x557c8bae9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:52:50.635 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.635+0000 7f4b1a3deb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557c8baea3e0 0x557c8baeacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:52:50.636 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.635+0000 7f4b1a3deb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557c8baeb2d0 0x557c8baeb750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:52:50.636 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.635+0000 7f4b1a3deb80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c8ba410f0 con 0x557c8bae9a80 2024-06-02T04:52:50.636 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.635+0000 7f4b1a3deb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c8ba3eab0 con 0x557c8baea3e0 2024-06-02T04:52:50.636 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.635+0000 7f4b1a3deb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c8ba3a3a0 con 0x557c8baeb2d0 2024-06-02T04:52:50.636 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.635+0000 7f4b07fff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557c8baeb2d0 0x557c8baeb750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:52:50.636 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.635+0000 7f4b07fff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557c8baeb2d0 0x557c8baeb750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:38888/0 (socket says 172.21.15.76:38888) 2024-06-02T04:52:50.636 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.635+0000 7f4b07fff700 1 -- 172.21.15.76:0/3144472439 learned_addr learned my addr 172.21.15.76:0/3144472439 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:52:50.636 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.635+0000 7f4b06ffd700 1 --2- 172.21.15.76:0/3144472439 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557c8baea3e0 0x557c8baeacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:52:50.636 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.635+0000 7f4b077fe700 1 --2- 172.21.15.76:0/3144472439 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557c8bae9a80 0x557c8bae9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:52:50.637 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.635+0000 7f4b07fff700 1 -- 172.21.15.76:0/3144472439 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557c8baea3e0 msgr2=0x557c8baeacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:52:50.637 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.635+0000 7f4b07fff700 1 --2- 172.21.15.76:0/3144472439 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557c8baea3e0 0x557c8baeacf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:50.637 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.635+0000 7f4b07fff700 1 -- 172.21.15.76:0/3144472439 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557c8bae9a80 msgr2=0x557c8bae9ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:52:50.637 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.635+0000 7f4b07fff700 1 --2- 172.21.15.76:0/3144472439 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557c8bae9a80 0x557c8bae9ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:50.637 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.636+0000 7f4b07fff700 1 -- 172.21.15.76:0/3144472439 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557c8b8bb350 con 0x557c8baeb2d0 2024-06-02T04:52:50.637 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.636+0000 7f4b07fff700 1 --2- 172.21.15.76:0/3144472439 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557c8baeb2d0 0x557c8baeb750 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4af8009c60 tx=0x7f4af8009f70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c214c40b3a55a3bf server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:52:50.637 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.636+0000 7f4aedffb700 1 -- 172.21.15.76:0/3144472439 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af800eb00 con 0x557c8baeb2d0 2024-06-02T04:52:50.637 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.636+0000 7f4aedffb700 1 -- 172.21.15.76:0/3144472439 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4af800ec60 con 0x557c8baeb2d0 2024-06-02T04:52:50.637 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.636+0000 7f4aedffb700 1 -- 172.21.15.76:0/3144472439 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af8010630 con 0x557c8baeb2d0 2024-06-02T04:52:50.638 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.637+0000 7f4b1a3deb80 1 -- 172.21.15.76:0/3144472439 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557c8baeb2d0 msgr2=0x557c8baeb750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:52:50.638 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.637+0000 7f4b1a3deb80 1 --2- 172.21.15.76:0/3144472439 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557c8baeb2d0 0x557c8baeb750 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4af8009c60 tx=0x7f4af8009f70 comp rx=0 tx=0).stop 2024-06-02T04:52:50.639 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.637+0000 7f4b1a3deb80 1 -- 172.21.15.76:0/3144472439 shutdown_connections 2024-06-02T04:52:50.639 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.637+0000 7f4b1a3deb80 1 --2- 172.21.15.76:0/3144472439 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557c8baeb2d0 0x557c8baeb750 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:50.639 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.637+0000 7f4b1a3deb80 1 --2- 172.21.15.76:0/3144472439 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557c8bae9a80 0x557c8bae9ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:50.639 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.637+0000 7f4b1a3deb80 1 --2- 172.21.15.76:0/3144472439 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557c8baea3e0 0x557c8baeacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:50.639 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.637+0000 7f4b1a3deb80 1 -- 172.21.15.76:0/3144472439 >> 172.21.15.76:0/3144472439 conn(0x557c8ba481b0 msgr2=0x557c8bae6440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:52:50.639 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.637+0000 7f4b1a3deb80 1 -- 172.21.15.76:0/3144472439 shutdown_connections 2024-06-02T04:52:50.639 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.637+0000 7f4b1a3deb80 1 -- 172.21.15.76:0/3144472439 wait complete. 2024-06-02T04:52:50.639 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.638+0000 7f4b1a3deb80 1 -- start start 2024-06-02T04:52:50.639 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.638+0000 7f4b1a3deb80 1 Processor -- start 2024-06-02T04:52:50.640 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.638+0000 7f4b1a3deb80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557c8bae9a80 0x557c8baf38e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:52:50.641 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.638+0000 7f4b1a3deb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557c8baea3e0 0x557c8baf3e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:52:50.641 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.638+0000 7f4b1a3deb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557c8baeb2d0 0x557c8bafae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:52:50.641 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.638+0000 7f4b1a3deb80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c8b9d6500 con 0x557c8bae9a80 2024-06-02T04:52:50.641 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.638+0000 7f4b1a3deb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c8b9d61a0 con 0x557c8baeb2d0 2024-06-02T04:52:50.641 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.638+0000 7f4b1a3deb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c8b8bd640 con 0x557c8baea3e0 2024-06-02T04:52:50.641 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.638+0000 7f4b1a3deb80 10 client.0 _ll_register_callbacks cb 0x557c8b9dfad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:52:50.641 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.639+0000 7f4b077fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557c8bae9a80 0x557c8baf38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:52:50.641 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.639+0000 7f4b077fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557c8bae9a80 0x557c8baf38e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:55370/0 (socket says 172.21.15.76:55370) 2024-06-02T04:52:50.641 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.639+0000 7f4b077fe700 1 -- 172.21.15.76:0/1869094680 learned_addr learned my addr 172.21.15.76:0/1869094680 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:52:50.641 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.639+0000 7f4b06ffd700 1 --2- 172.21.15.76:0/1869094680 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557c8baea3e0 0x557c8baf3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:52:50.641 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.639+0000 7f4b07fff700 1 --2- 172.21.15.76:0/1869094680 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557c8baeb2d0 0x557c8bafae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:52:50.641 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.639+0000 7f4b077fe700 1 -- 172.21.15.76:0/1869094680 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557c8baea3e0 msgr2=0x557c8baf3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:52:50.641 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.639+0000 7f4b077fe700 1 --2- 172.21.15.76:0/1869094680 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557c8baea3e0 0x557c8baf3e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:50.642 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.639+0000 7f4b077fe700 1 -- 172.21.15.76:0/1869094680 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557c8baeb2d0 msgr2=0x557c8bafae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:52:50.642 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.639+0000 7f4b077fe700 1 --2- 172.21.15.76:0/1869094680 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557c8baeb2d0 0x557c8bafae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:50.642 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.639+0000 7f4b077fe700 1 -- 172.21.15.76:0/1869094680 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4af80098c0 con 0x557c8bae9a80 2024-06-02T04:52:50.642 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.639+0000 7f4b06ffd700 1 --2- 172.21.15.76:0/1869094680 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557c8baea3e0 0x557c8baf3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T04:52:50.642 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.639+0000 7f4b07fff700 1 --2- 172.21.15.76:0/1869094680 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557c8baeb2d0 0x557c8bafae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T04:52:50.642 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.639+0000 7f4b077fe700 1 --2- 172.21.15.76:0/1869094680 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557c8bae9a80 0x557c8baf38e0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f4afc003b00 tx=0x7f4afc03c050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b951d9d6f424c86e server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:52:50.642 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.639+0000 7f4ae6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-06-02T04:52:50.642 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.640+0000 7f4ae6ffd700 1 -- 172.21.15.76:0/1869094680 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4afc04d040 con 0x557c8bae9a80 2024-06-02T04:52:50.642 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.640+0000 7f4ae6ffd700 1 -- 172.21.15.76:0/1869094680 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f4afc00bd00 con 0x557c8bae9a80 2024-06-02T04:52:50.642 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.640+0000 7f4b1a3deb80 1 -- 172.21.15.76:0/1869094680 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557c8b993210 con 0x557c8bae9a80 2024-06-02T04:52:50.642 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.640+0000 7f4ae6ffd700 1 -- 172.21.15.76:0/1869094680 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4afc052480 con 0x557c8bae9a80 2024-06-02T04:52:50.642 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.640+0000 7f4b1a3deb80 10 client.16002 fetch_fsmap learned FSMap version 30 2024-06-02T04:52:50.643 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.640+0000 7f4b1a3deb80 1 -- 172.21.15.76:0/1869094680 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x557c8b867b00 con 0x557c8bae9a80 2024-06-02T04:52:50.643 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.640+0000 7f4ae6ffd700 1 -- 172.21.15.76:0/1869094680 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x557c8b993210 con 0x557c8bae9a80 2024-06-02T04:52:50.644 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.641+0000 7f4ae6ffd700 1 -- 172.21.15.76:0/1869094680 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 30) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f4afc05a070 con 0x557c8bae9a80 2024-06-02T04:52:50.645 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.641+0000 7f4b1a3deb80 10 client.16002 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T04:52:50.645 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.641+0000 7f4b1a3deb80 10 client.16002 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T04:52:50.645 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.641+0000 7f4b1a3deb80 20 client.16002 populate_metadata read hostname 'smithi076' 2024-06-02T04:52:50.645 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.641+0000 7f4b1a3deb80 1 --2- 172.21.15.76:0/1869094680 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x557c8baff6f0 0x557c8bb01b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:52:50.645 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.641+0000 7f4b1a3deb80 4 client.16002 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T04:52:50.645 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.641+0000 7f4b1a3deb80 1 -- 172.21.15.76:0/1869094680 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557c8bab97b0 con 0x557c8baff6f0 2024-06-02T04:52:50.645 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.641+0000 7f4b06ffd700 1 --2- 172.21.15.76:0/1869094680 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x557c8baff6f0 0x557c8bb01b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:52:50.645 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.641+0000 7f4b06ffd700 1 --2- 172.21.15.76:0/1869094680 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x557c8baff6f0 0x557c8bb01b10 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d23ae66ce8fd060 server_cookie=83cd6416b398c4be in_seq=0 out_seq=0 2024-06-02T04:52:50.646 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.641+0000 7f4ae6ffd700 10 client.16002 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:52:50.646 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.642+0000 7f4ae6ffd700 1 -- 172.21.15.76:0/1869094680 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x557c8bab97b0 con 0x557c8baff6f0 2024-06-02T04:52:50.646 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.642+0000 7f4ae6ffd700 10 client.16002 handle_command_reply: tid=0 2024-06-02T04:52:50.646 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.642+0000 7f4b1a3deb80 1 client.16002 shutdown 2024-06-02T04:52:50.646 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.642+0000 7f4b1a3deb80 1 -- 172.21.15.76:0/1869094680 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557c8bae9a80 msgr2=0x557c8baf38e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:52:50.646 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.642+0000 7f4b1a3deb80 1 --2- 172.21.15.76:0/1869094680 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557c8bae9a80 0x557c8baf38e0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f4afc003b00 tx=0x7f4afc03c050 comp rx=0 tx=0).stop 2024-06-02T04:52:50.646 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.643+0000 7f4b1a3deb80 1 -- 172.21.15.76:0/1869094680 shutdown_connections 2024-06-02T04:52:50.646 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.643+0000 7f4b1a3deb80 1 --2- 172.21.15.76:0/1869094680 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x557c8baff6f0 0x557c8bb01b10 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:50.646 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.643+0000 7f4b1a3deb80 1 --2- 172.21.15.76:0/1869094680 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557c8baeb2d0 0x557c8bafae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:50.646 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.643+0000 7f4b1a3deb80 1 --2- 172.21.15.76:0/1869094680 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557c8bae9a80 0x557c8baf38e0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:50.646 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.643+0000 7f4b1a3deb80 1 --2- 172.21.15.76:0/1869094680 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557c8baea3e0 0x557c8baf3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:50.646 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.643+0000 7f4b1a3deb80 1 -- 172.21.15.76:0/1869094680 >> 172.21.15.76:0/1869094680 conn(0x557c8ba481b0 msgr2=0x557c8bae4860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:52:50.646 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.643+0000 7f4ae6ffd700 0 client.16002 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:52:50.647 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.643+0000 7f4b1a3deb80 1 -- 172.21.15.76:0/1869094680 shutdown_connections 2024-06-02T04:52:50.647 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.643+0000 7f4b1a3deb80 1 -- 172.21.15.76:0/1869094680 wait complete. 2024-06-02T04:52:50.647 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.644+0000 7f4b1a3deb80 20 client.16002 trim_cache size 0 max 16384 2024-06-02T04:52:50.665 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.664+0000 7f4b1a3deb80 1 Processor -- start 2024-06-02T04:52:50.665 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.664+0000 7f4b1a3deb80 1 -- start start 2024-06-02T04:52:50.665 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.664+0000 7f4b1a3deb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557c8bae9a80 0x557c8baeb6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:52:50.665 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.664+0000 7f4b1a3deb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557c8baea3e0 0x557c8bafae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:52:50.665 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.664+0000 7f4b1a3deb80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557c8baeb2d0 0x557c8baee510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:52:50.665 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.664+0000 7f4b1a3deb80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c8badf330 con 0x557c8baeb2d0 2024-06-02T04:52:50.665 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.664+0000 7f4b1a3deb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c8baf23e0 con 0x557c8bae9a80 2024-06-02T04:52:50.665 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.664+0000 7f4b1a3deb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c8bafbfe0 con 0x557c8baea3e0 2024-06-02T04:52:50.665 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.664+0000 7f4b07fff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557c8baeb2d0 0x557c8baee510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:52:50.665 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.664+0000 7f4b06ffd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557c8baea3e0 0x557c8bafae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:52:50.665 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.664+0000 7f4b077fe700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557c8bae9a80 0x557c8baeb6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:52:50.665 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.664+0000 7f4b06ffd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557c8baea3e0 0x557c8bafae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:38908/0 (socket says 172.21.15.76:38908) 2024-06-02T04:52:50.666 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.664+0000 7f4b06ffd700 1 -- 172.21.15.76:0/1994537796 learned_addr learned my addr 172.21.15.76:0/1994537796 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:52:50.667 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.665+0000 7f4b06ffd700 1 -- 172.21.15.76:0/1994537796 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557c8bae9a80 msgr2=0x557c8baeb6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:52:50.667 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.665+0000 7f4b06ffd700 1 --2- 172.21.15.76:0/1994537796 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557c8bae9a80 0x557c8baeb6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:50.667 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.665+0000 7f4b06ffd700 1 -- 172.21.15.76:0/1994537796 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557c8baeb2d0 msgr2=0x557c8baee510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:52:50.667 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.665+0000 7f4b06ffd700 1 --2- 172.21.15.76:0/1994537796 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557c8baeb2d0 0x557c8baee510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:50.667 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.665+0000 7f4b06ffd700 1 -- 172.21.15.76:0/1994537796 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557c8ba00500 con 0x557c8baea3e0 2024-06-02T04:52:50.667 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.665+0000 7f4b06ffd700 1 --2- 172.21.15.76:0/1994537796 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557c8baea3e0 0x557c8bafae20 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4b00096120 tx=0x7f4b0000b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=26b70a395b24ca7c server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:52:50.668 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.665+0000 7f4aee7fc700 1 -- 172.21.15.76:0/1994537796 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b00099700 con 0x557c8baea3e0 2024-06-02T04:52:50.668 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.665+0000 7f4aee7fc700 1 -- 172.21.15.76:0/1994537796 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4b0009d530 con 0x557c8baea3e0 2024-06-02T04:52:50.668 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.665+0000 7f4aee7fc700 1 -- 172.21.15.76:0/1994537796 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b000978d0 con 0x557c8baea3e0 2024-06-02T04:52:50.668 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.666+0000 7f4b1a3deb80 1 -- 172.21.15.76:0/1994537796 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557c8baea3e0 msgr2=0x557c8bafae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:52:50.668 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.666+0000 7f4b1a3deb80 1 --2- 172.21.15.76:0/1994537796 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557c8baea3e0 0x557c8bafae20 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4b00096120 tx=0x7f4b0000b040 comp rx=0 tx=0).stop 2024-06-02T04:52:50.668 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.666+0000 7f4b1a3deb80 1 -- 172.21.15.76:0/1994537796 shutdown_connections 2024-06-02T04:52:50.668 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.666+0000 7f4b1a3deb80 1 --2- 172.21.15.76:0/1994537796 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557c8baeb2d0 0x557c8baee510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:50.668 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.666+0000 7f4b1a3deb80 1 --2- 172.21.15.76:0/1994537796 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557c8bae9a80 0x557c8baeb6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:50.668 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.666+0000 7f4b1a3deb80 1 --2- 172.21.15.76:0/1994537796 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557c8baea3e0 0x557c8bafae20 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:50.668 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.666+0000 7f4b1a3deb80 1 -- 172.21.15.76:0/1994537796 >> 172.21.15.76:0/1994537796 conn(0x557c8ba481b0 msgr2=0x557c8baf1840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:52:50.668 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.667+0000 7f4b1a3deb80 1 -- 172.21.15.76:0/1994537796 shutdown_connections 2024-06-02T04:52:50.670 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.667+0000 7f4b1a3deb80 1 -- 172.21.15.76:0/1994537796 wait complete. 2024-06-02T04:52:50.670 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.667+0000 7f4b1a3deb80 1 -- start start 2024-06-02T04:52:50.670 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.668+0000 7f4b1a3deb80 1 Processor -- start 2024-06-02T04:52:50.670 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.668+0000 7f4b1a3deb80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557c8bae9a80 0x557c8baf80a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:52:50.671 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.668+0000 7f4b1a3deb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557c8baea3e0 0x557c8baf85e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:52:50.671 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.668+0000 7f4b1a3deb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557c8baeb2d0 0x557c8baf9410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:52:50.671 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.668+0000 7f4b1a3deb80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c8baf9950 con 0x557c8bae9a80 2024-06-02T04:52:50.671 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.668+0000 7f4b1a3deb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c8baf9ac0 con 0x557c8baeb2d0 2024-06-02T04:52:50.671 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.668+0000 7f4b1a3deb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c8baf9c80 con 0x557c8baea3e0 2024-06-02T04:52:50.671 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.668+0000 7f4b1a3deb80 10 client.0 _ll_register_callbacks cb 0x557c8b9dfad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:52:50.672 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.668+0000 7f4b06ffd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557c8baea3e0 0x557c8baf85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:52:50.672 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.668+0000 7f4b077fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557c8bae9a80 0x557c8baf80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:52:50.672 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.668+0000 7f4b06ffd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557c8baea3e0 0x557c8baf85e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:38910/0 (socket says 172.21.15.76:38910) 2024-06-02T04:52:50.672 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.668+0000 7f4b06ffd700 1 -- 172.21.15.76:0/1428276160 learned_addr learned my addr 172.21.15.76:0/1428276160 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:52:50.672 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.668+0000 7f4b07fff700 1 --2- 172.21.15.76:0/1428276160 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557c8baeb2d0 0x557c8baf9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:52:50.672 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.669+0000 7f4b06ffd700 1 -- 172.21.15.76:0/1428276160 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557c8baeb2d0 msgr2=0x557c8baf9410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:52:50.673 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.669+0000 7f4b06ffd700 1 --2- 172.21.15.76:0/1428276160 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557c8baeb2d0 0x557c8baf9410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:50.673 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.669+0000 7f4b06ffd700 1 -- 172.21.15.76:0/1428276160 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557c8bae9a80 msgr2=0x557c8baf80a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:52:50.673 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.669+0000 7f4b06ffd700 1 --2- 172.21.15.76:0/1428276160 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557c8bae9a80 0x557c8baf80a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:50.673 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.669+0000 7f4b06ffd700 1 -- 172.21.15.76:0/1428276160 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b0810ff50 con 0x557c8baea3e0 2024-06-02T04:52:50.673 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.669+0000 7f4b06ffd700 1 --2- 172.21.15.76:0/1428276160 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557c8baea3e0 0x557c8baf85e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4b000ca120 tx=0x7f4b0009d0b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb8b7e4597f42665 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:52:50.673 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.669+0000 7f4ae6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.192:3300/0 2024-06-02T04:52:50.673 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.669+0000 7f4ae6ffd700 1 -- 172.21.15.76:0/1428276160 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b000a1b80 con 0x557c8baea3e0 2024-06-02T04:52:50.674 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.669+0000 7f4ae6ffd700 1 -- 172.21.15.76:0/1428276160 <== mon.1 v2:172.21.15.192:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f4b000978b0 con 0x557c8baea3e0 2024-06-02T04:52:50.674 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.669+0000 7f4b1a3deb80 1 -- 172.21.15.76:0/1428276160 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4af800ec60 con 0x557c8baea3e0 2024-06-02T04:52:50.674 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.669+0000 7f4ae6ffd700 1 -- 172.21.15.76:0/1428276160 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4b00099700 con 0x557c8baea3e0 2024-06-02T04:52:50.674 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.669+0000 7f4b1a3deb80 10 client.25480 fetch_fsmap learned FSMap version 30 2024-06-02T04:52:50.674 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.669+0000 7f4b1a3deb80 1 -- 172.21.15.76:0/1428276160 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x557c8b8bfc70 con 0x557c8baea3e0 2024-06-02T04:52:50.674 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.669+0000 7f4ae6ffd700 1 -- 172.21.15.76:0/1428276160 <== mon.1 v2:172.21.15.192:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4af800ec60 con 0x557c8baea3e0 2024-06-02T04:52:50.676 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.670+0000 7f4ae6ffd700 1 -- 172.21.15.76:0/1428276160 <== mon.1 v2:172.21.15.192:3300/0 5 ==== fsmap(e 30) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f4b000b3050 con 0x557c8baea3e0 2024-06-02T04:52:50.676 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.670+0000 7f4b1a3deb80 10 client.25480 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T04:52:50.676 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.670+0000 7f4b1a3deb80 10 client.25480 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T04:52:50.676 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.670+0000 7f4b1a3deb80 20 client.25480 populate_metadata read hostname 'smithi076' 2024-06-02T04:52:50.676 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.670+0000 7f4b1a3deb80 1 --2- 172.21.15.76:0/1428276160 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x557c8bb55be0 0x557c8bb57fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:52:50.676 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.670+0000 7f4b1a3deb80 4 client.25480 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T04:52:50.677 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.670+0000 7f4b1a3deb80 1 -- 172.21.15.76:0/1428276160 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x557c8ba32e60 con 0x557c8bb55be0 2024-06-02T04:52:50.677 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.670+0000 7f4b077fe700 1 --2- 172.21.15.76:0/1428276160 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x557c8bb55be0 0x557c8bb57fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:52:50.677 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.671+0000 7f4b077fe700 1 --2- 172.21.15.76:0/1428276160 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x557c8bb55be0 0x557c8bb57fd0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e22f4d7a9655cf0e server_cookie=d80db9f17a21c26a in_seq=0 out_seq=0 2024-06-02T04:52:50.677 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.671+0000 7f4ae6ffd700 10 client.25480 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:52:50.689 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.688+0000 7f4ae6ffd700 1 -- 172.21.15.76:0/1428276160 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x557c8ba32e60 con 0x557c8bb55be0 2024-06-02T04:52:50.689 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.688+0000 7f4ae6ffd700 10 client.25480 handle_command_reply: tid=0 2024-06-02T04:52:50.689 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.688+0000 7f4b1a3deb80 1 client.25480 shutdown 2024-06-02T04:52:50.689 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.689+0000 7f4b1a3deb80 1 -- 172.21.15.76:0/1428276160 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557c8baea3e0 msgr2=0x557c8baf85e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:52:50.689 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.689+0000 7f4b1a3deb80 1 --2- 172.21.15.76:0/1428276160 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557c8baea3e0 0x557c8baf85e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4b000ca120 tx=0x7f4b0009d0b0 comp rx=0 tx=0).stop 2024-06-02T04:52:50.690 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.689+0000 7f4b1a3deb80 1 -- 172.21.15.76:0/1428276160 shutdown_connections 2024-06-02T04:52:50.690 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.689+0000 7f4b1a3deb80 1 --2- 172.21.15.76:0/1428276160 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x557c8bb55be0 0x557c8bb57fd0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:50.690 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.689+0000 7f4b1a3deb80 1 --2- 172.21.15.76:0/1428276160 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557c8baeb2d0 0x557c8baf9410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:50.690 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.689+0000 7f4b1a3deb80 1 --2- 172.21.15.76:0/1428276160 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557c8bae9a80 0x557c8baf80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:50.690 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.689+0000 7f4b1a3deb80 1 --2- 172.21.15.76:0/1428276160 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557c8baea3e0 0x557c8baf85e0 secure :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4b000ca120 tx=0x7f4b0009d0b0 comp rx=0 tx=0).stop 2024-06-02T04:52:50.690 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.689+0000 7f4b1a3deb80 1 -- 172.21.15.76:0/1428276160 >> 172.21.15.76:0/1428276160 conn(0x557c8ba481b0 msgr2=0x557c8bb06470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:52:50.691 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.689+0000 7f4ae6ffd700 0 client.25480 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:52:50.691 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.689+0000 7f4b1a3deb80 1 -- 172.21.15.76:0/1428276160 shutdown_connections 2024-06-02T04:52:50.691 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.689+0000 7f4b1a3deb80 1 -- 172.21.15.76:0/1428276160 wait complete. 2024-06-02T04:52:50.691 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.689+0000 7f4b1a3deb80 20 client.25480 trim_cache size 0 max 16384 2024-06-02T04:52:50.691 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:{ 2024-06-02T04:52:50.691 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "message": "", 2024-06-02T04:52:50.691 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "return_code": 0 2024-06-02T04:52:50.691 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:} 2024-06-02T04:52:50.692 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.690+0000 7f4b0e223700 1 -- 172.21.15.76:0/2897322187 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f4af00a11f0 msgr2=0x7f4af00a36b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:52:50.692 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.690+0000 7f4b0e223700 1 --2- 172.21.15.76:0/2897322187 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f4af00a11f0 0x7f4af00a36b0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f4afc006010 tx=0x7f4afc003750 comp rx=0 tx=0).stop 2024-06-02T04:52:50.692 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.690+0000 7f4b0e223700 1 -- 172.21.15.76:0/2897322187 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4b081020e0 msgr2=0x7f4b0810dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:52:50.692 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.690+0000 7f4b0e223700 1 --2- 172.21.15.76:0/2897322187 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4b081020e0 0x7f4b0810dfa0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4b00007ec0 tx=0x7f4b0000d3b0 comp rx=0 tx=0).stop 2024-06-02T04:52:50.692 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.690+0000 7f4b0e223700 1 -- 172.21.15.76:0/2897322187 shutdown_connections 2024-06-02T04:52:50.692 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.690+0000 7f4b0e223700 1 --2- 172.21.15.76:0/2897322187 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f4af00a11f0 0x7f4af00a36b0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:50.692 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.690+0000 7f4b0e223700 1 --2- 172.21.15.76:0/2897322187 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4b08104ab0 0x7f4b0810ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:50.693 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.690+0000 7f4b0e223700 1 --2- 172.21.15.76:0/2897322187 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4b080ff770 0x7f4b0810da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:50.693 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.690+0000 7f4b0e223700 1 --2- 172.21.15.76:0/2897322187 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4b081020e0 0x7f4b0810dfa0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:52:50.693 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.690+0000 7f4b0e223700 1 -- 172.21.15.76:0/2897322187 >> 172.21.15.76:0/2897322187 conn(0x7f4b080fb390 msgr2=0x7f4b080fb770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:52:50.693 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.690+0000 7f4b0e223700 1 -- 172.21.15.76:0/2897322187 shutdown_connections 2024-06-02T04:52:50.693 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:52:50.690+0000 7f4b0e223700 1 -- 172.21.15.76:0/2897322187 wait complete. 2024-06-02T04:52:51.314 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 120.0 s, 943.8 tps, lat 106.074 ms stddev 31.361 2024-06-02T04:52:51.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:52:51 smithi192 ceph-mon[47933]: pgmap v366: 129 pgs: 129 active+clean; 1.5 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 15 MiB/s wr, 1.01k op/s 2024-06-02T04:52:51.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:52:51 smithi076 ceph-mon[42935]: pgmap v366: 129 pgs: 129 active+clean; 1.5 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 15 MiB/s wr, 1.01k op/s 2024-06-02T04:52:51.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:52:51 smithi119 ceph-mon[46633]: pgmap v366: 129 pgs: 129 active+clean; 1.5 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 15 MiB/s wr, 1.01k op/s 2024-06-02T04:52:53.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:52:53 smithi192 ceph-mon[47933]: pgmap v367: 129 pgs: 129 active+clean; 1.5 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 16 MiB/s wr, 1.16k op/s 2024-06-02T04:52:53.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:52:53 smithi076 ceph-mon[42935]: pgmap v367: 129 pgs: 129 active+clean; 1.5 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 16 MiB/s wr, 1.16k op/s 2024-06-02T04:52:53.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:52:53 smithi119 ceph-mon[46633]: pgmap v367: 129 pgs: 129 active+clean; 1.5 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 16 MiB/s wr, 1.16k op/s 2024-06-02T04:52:55.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:52:55 smithi192 ceph-mon[47933]: pgmap v368: 129 pgs: 129 active+clean; 1.5 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 12 MiB/s wr, 951 op/s 2024-06-02T04:52:55.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:52:55 smithi076 ceph-mon[42935]: pgmap v368: 129 pgs: 129 active+clean; 1.5 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 12 MiB/s wr, 951 op/s 2024-06-02T04:52:55.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:52:55 smithi119 ceph-mon[46633]: pgmap v368: 129 pgs: 129 active+clean; 1.5 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 12 MiB/s wr, 951 op/s 2024-06-02T04:52:56.314 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 125.0 s, 952.6 tps, lat 104.699 ms stddev 32.656 2024-06-02T04:52:57.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:52:57 smithi192 ceph-mon[47933]: pgmap v369: 129 pgs: 129 active+clean; 1.5 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 15 MiB/s wr, 1.17k op/s 2024-06-02T04:52:57.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:52:57 smithi076 ceph-mon[42935]: pgmap v369: 129 pgs: 129 active+clean; 1.5 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 15 MiB/s wr, 1.17k op/s 2024-06-02T04:52:57.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:52:57 smithi119 ceph-mon[46633]: pgmap v369: 129 pgs: 129 active+clean; 1.5 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 15 MiB/s wr, 1.17k op/s 2024-06-02T04:52:58.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:52:58 smithi192 ceph-mon[47933]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-06-02T04:52:58.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:52:58 smithi076 ceph-mon[42935]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-06-02T04:52:58.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:52:58 smithi119 ceph-mon[46633]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-06-02T04:52:59.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:52:59 smithi192 ceph-mon[47933]: pgmap v370: 129 pgs: 129 active+clean; 1.5 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 13 MiB/s wr, 1.02k op/s 2024-06-02T04:52:59.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:52:59 smithi076 ceph-mon[42935]: pgmap v370: 129 pgs: 129 active+clean; 1.5 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 13 MiB/s wr, 1.02k op/s 2024-06-02T04:52:59.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:52:59 smithi119 ceph-mon[46633]: pgmap v370: 129 pgs: 129 active+clean; 1.5 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 13 MiB/s wr, 1.02k op/s 2024-06-02T04:53:01.314 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 130.0 s, 1032.2 tps, lat 97.552 ms stddev 32.186 2024-06-02T04:53:01.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:53:01 smithi076 ceph-mon[42935]: pgmap v371: 129 pgs: 129 active+clean; 1.5 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 12 MiB/s wr, 973 op/s 2024-06-02T04:53:01.847 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:53:01 smithi119 ceph-mon[46633]: pgmap v371: 129 pgs: 129 active+clean; 1.5 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 12 MiB/s wr, 973 op/s 2024-06-02T04:53:01.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:53:01 smithi192 ceph-mon[47933]: pgmap v371: 129 pgs: 129 active+clean; 1.5 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 12 MiB/s wr, 973 op/s 2024-06-02T04:53:03.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:53:03 smithi076 ceph-mon[42935]: pgmap v372: 129 pgs: 129 active+clean; 1.5 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 13 MiB/s wr, 1.12k op/s 2024-06-02T04:53:03.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:53:03 smithi119 ceph-mon[46633]: pgmap v372: 129 pgs: 129 active+clean; 1.5 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 13 MiB/s wr, 1.12k op/s 2024-06-02T04:53:03.872 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.871+0000 7f17032e0700 1 -- 172.21.15.76:0/3518889842 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16fc0ffe10 msgr2=0x7f16fc100230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:53:03.872 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.871+0000 7f17032e0700 1 --2- 172.21.15.76:0/3518889842 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16fc0ffe10 0x7f16fc100230 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f16f8009990 tx=0x7f16f8009ca0 comp rx=0 tx=0).stop 2024-06-02T04:53:03.873 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.872+0000 7f17032e0700 1 -- 172.21.15.76:0/3518889842 shutdown_connections 2024-06-02T04:53:03.873 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.872+0000 7f17032e0700 1 --2- 172.21.15.76:0/3518889842 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f16fc101920 0x7f16fc108240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:03.873 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.872+0000 7f17032e0700 1 --2- 172.21.15.76:0/3518889842 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16fc0ffe10 0x7f16fc100230 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:03.873 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.872+0000 7f17032e0700 1 --2- 172.21.15.76:0/3518889842 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f16fc100f60 0x7f16fc1013e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:03.873 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.872+0000 7f17032e0700 1 -- 172.21.15.76:0/3518889842 >> 172.21.15.76:0/3518889842 conn(0x7f16fc0fb380 msgr2=0x7f16fc0fd7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:53:03.873 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.872+0000 7f17032e0700 1 -- 172.21.15.76:0/3518889842 shutdown_connections 2024-06-02T04:53:03.873 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.872+0000 7f17032e0700 1 -- 172.21.15.76:0/3518889842 wait complete. 2024-06-02T04:53:03.875 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.873+0000 7f17032e0700 1 Processor -- start 2024-06-02T04:53:03.875 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.873+0000 7f17032e0700 1 -- start start 2024-06-02T04:53:03.875 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.873+0000 7f17032e0700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f16fc0ffe10 0x7f16fc196f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:53:03.875 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.873+0000 7f17032e0700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16fc100f60 0x7f16fc197460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:53:03.875 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.873+0000 7f17032e0700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f16fc101920 0x7f16fc19e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:53:03.875 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.873+0000 7f17032e0700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16fc19ea00 con 0x7f16fc101920 2024-06-02T04:53:03.875 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.873+0000 7f17032e0700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16fc19eb40 con 0x7f16fc0ffe10 2024-06-02T04:53:03.875 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.873+0000 7f17032e0700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16fc108910 con 0x7f16fc100f60 2024-06-02T04:53:03.876 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.873+0000 7f170087b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16fc100f60 0x7f16fc197460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:53:03.876 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.873+0000 7f170187d700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f16fc101920 0x7f16fc19e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:53:03.876 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.873+0000 7f170087b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16fc100f60 0x7f16fc197460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:49312/0 (socket says 172.21.15.76:49312) 2024-06-02T04:53:03.876 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.873+0000 7f170087b700 1 -- 172.21.15.76:0/4144139347 learned_addr learned my addr 172.21.15.76:0/4144139347 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:53:03.876 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.873+0000 7f170107c700 1 --2- 172.21.15.76:0/4144139347 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f16fc0ffe10 0x7f16fc196f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:53:03.876 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.874+0000 7f170087b700 1 -- 172.21.15.76:0/4144139347 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f16fc0ffe10 msgr2=0x7f16fc196f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:53:03.876 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.874+0000 7f170087b700 1 --2- 172.21.15.76:0/4144139347 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f16fc0ffe10 0x7f16fc196f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:03.876 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.874+0000 7f170087b700 1 -- 172.21.15.76:0/4144139347 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f16fc101920 msgr2=0x7f16fc19e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:53:03.876 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.874+0000 7f170087b700 1 --2- 172.21.15.76:0/4144139347 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f16fc101920 0x7f16fc19e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:03.876 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.874+0000 7f170087b700 1 -- 172.21.15.76:0/4144139347 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16f80095f0 con 0x7f16fc100f60 2024-06-02T04:53:03.876 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.874+0000 7f170187d700 1 --2- 172.21.15.76:0/4144139347 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f16fc101920 0x7f16fc19e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:53:03.876 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.874+0000 7f170087b700 1 --2- 172.21.15.76:0/4144139347 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16fc100f60 0x7f16fc197460 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f16ec00b530 tx=0x7f16ec00b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:53:03.877 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.874+0000 7f16f27fc700 1 -- 172.21.15.76:0/4144139347 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16ec011830 con 0x7f16fc100f60 2024-06-02T04:53:03.877 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.874+0000 7f17032e0700 1 -- 172.21.15.76:0/4144139347 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16fc108bf0 con 0x7f16fc100f60 2024-06-02T04:53:03.877 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.874+0000 7f16f27fc700 1 -- 172.21.15.76:0/4144139347 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f16ec011e20 con 0x7f16fc100f60 2024-06-02T04:53:03.877 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.874+0000 7f16f27fc700 1 -- 172.21.15.76:0/4144139347 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16ec010dd0 con 0x7f16fc100f60 2024-06-02T04:53:03.877 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.874+0000 7f17032e0700 1 -- 172.21.15.76:0/4144139347 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16fc1091d0 con 0x7f16fc100f60 2024-06-02T04:53:03.878 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.877+0000 7f16f27fc700 1 -- 172.21.15.76:0/4144139347 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f16ec01a400 con 0x7f16fc100f60 2024-06-02T04:53:03.878 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.878+0000 7f16f27fc700 1 --2- 172.21.15.76:0/4144139347 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f16e80a1270 0x7f16e80a3730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:53:03.879 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.878+0000 7f16f27fc700 1 -- 172.21.15.76:0/4144139347 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f16ec0cd620 con 0x7f16fc100f60 2024-06-02T04:53:03.879 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.879+0000 7f170f49bb80 1 Processor -- start 2024-06-02T04:53:03.879 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.879+0000 7f170f49bb80 1 -- start start 2024-06-02T04:53:03.879 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.879+0000 7f170f49bb80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560e10365a80 0x560e10365ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:53:03.880 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.879+0000 7f170f49bb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560e103663e0 0x560e10366cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:53:03.880 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.879+0000 7f170f49bb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560e103672d0 0x560e10367750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:53:03.880 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.879+0000 7f170f49bb80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e102bd0f0 con 0x560e10365a80 2024-06-02T04:53:03.880 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.879+0000 7f170f49bb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e102baab0 con 0x560e103663e0 2024-06-02T04:53:03.880 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.879+0000 7f170f49bb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e102b63a0 con 0x560e103672d0 2024-06-02T04:53:03.881 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.879+0000 7f170187d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560e103672d0 0x560e10367750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:53:03.881 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.879+0000 7f170187d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560e103672d0 0x560e10367750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:49320/0 (socket says 172.21.15.76:49320) 2024-06-02T04:53:03.881 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.879+0000 7f170187d700 1 -- 172.21.15.76:0/3773894299 learned_addr learned my addr 172.21.15.76:0/3773894299 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:53:03.881 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.879+0000 7f170087b700 1 --2- 172.21.15.76:0/3773894299 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560e103663e0 0x560e10366cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:53:03.881 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.880+0000 7f170107c700 1 --2- 172.21.15.76:0/4144139347 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f16e80a1270 0x7f16e80a3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:53:03.881 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.880+0000 7f170087b700 1 -- 172.21.15.76:0/3773894299 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560e103672d0 msgr2=0x560e10367750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:53:03.881 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.880+0000 7f170087b700 1 --2- 172.21.15.76:0/3773894299 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560e103672d0 0x560e10367750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:03.881 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.880+0000 7f170087b700 1 -- 172.21.15.76:0/3773894299 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560e10365a80 msgr2=0x560e10365ea0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-02T04:53:03.881 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.880+0000 7f170087b700 1 --2- 172.21.15.76:0/3773894299 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560e10365a80 0x560e10365ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:03.881 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.880+0000 7f170087b700 1 -- 172.21.15.76:0/3773894299 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560e10137350 con 0x560e103663e0 2024-06-02T04:53:03.882 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.880+0000 7f170087b700 1 --2- 172.21.15.76:0/3773894299 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560e103663e0 0x560e10366cf0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f16ec096bd0 tx=0x7f16ec09a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d4ca4b7f0738df5 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:53:03.882 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.880+0000 7f170107c700 1 --2- 172.21.15.76:0/4144139347 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f16e80a1270 0x7f16e80a3730 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f16f8003780 tx=0x7f16f8005c40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:53:03.882 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.882+0000 7f16e77fe700 1 -- 172.21.15.76:0/3773894299 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16ec09add0 con 0x560e103663e0 2024-06-02T04:53:03.882 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.882+0000 7f16e77fe700 1 -- 172.21.15.76:0/3773894299 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f16ec09a6d0 con 0x560e103663e0 2024-06-02T04:53:03.883 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.882+0000 7f16e77fe700 1 -- 172.21.15.76:0/3773894299 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16ec09e170 con 0x560e103663e0 2024-06-02T04:53:03.884 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.883+0000 7f170f49bb80 1 -- 172.21.15.76:0/3773894299 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560e103663e0 msgr2=0x560e10366cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:53:03.884 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.883+0000 7f170f49bb80 1 --2- 172.21.15.76:0/3773894299 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560e103663e0 0x560e10366cf0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f16ec096bd0 tx=0x7f16ec09a210 comp rx=0 tx=0).stop 2024-06-02T04:53:03.884 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.883+0000 7f170f49bb80 1 -- 172.21.15.76:0/3773894299 shutdown_connections 2024-06-02T04:53:03.884 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.883+0000 7f170f49bb80 1 --2- 172.21.15.76:0/3773894299 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560e103672d0 0x560e10367750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:03.884 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.883+0000 7f170f49bb80 1 --2- 172.21.15.76:0/3773894299 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560e10365a80 0x560e10365ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:03.884 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.883+0000 7f170f49bb80 1 --2- 172.21.15.76:0/3773894299 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560e103663e0 0x560e10366cf0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:03.884 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.883+0000 7f170f49bb80 1 -- 172.21.15.76:0/3773894299 >> 172.21.15.76:0/3773894299 conn(0x560e102c41b0 msgr2=0x560e10362440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:53:03.884 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.883+0000 7f170f49bb80 1 -- 172.21.15.76:0/3773894299 shutdown_connections 2024-06-02T04:53:03.884 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.883+0000 7f170f49bb80 1 -- 172.21.15.76:0/3773894299 wait complete. 2024-06-02T04:53:03.885 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.883+0000 7f170f49bb80 1 -- start start 2024-06-02T04:53:03.885 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.883+0000 7f170f49bb80 1 Processor -- start 2024-06-02T04:53:03.886 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.884+0000 7f170f49bb80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560e10365a80 0x560e1036f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:53:03.886 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.884+0000 7f170f49bb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560e103663e0 0x560e1036fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:53:03.887 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.884+0000 7f170f49bb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560e103672d0 0x560e10376df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:53:03.887 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.884+0000 7f170f49bb80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e10252500 con 0x560e10365a80 2024-06-02T04:53:03.887 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.884+0000 7f170f49bb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e102521a0 con 0x560e103672d0 2024-06-02T04:53:03.887 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.884+0000 7f170f49bb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e10139640 con 0x560e103663e0 2024-06-02T04:53:03.887 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.884+0000 7f170f49bb80 10 client.0 _ll_register_callbacks cb 0x560e1025bad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:53:03.887 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.884+0000 7f170087b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560e103663e0 0x560e1036fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:53:03.887 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.884+0000 7f170087b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560e103663e0 0x560e1036fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:49328/0 (socket says 172.21.15.76:49328) 2024-06-02T04:53:03.887 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.884+0000 7f170087b700 1 -- 172.21.15.76:0/2932309955 learned_addr learned my addr 172.21.15.76:0/2932309955 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:53:03.887 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.885+0000 7f170187d700 1 --2- 172.21.15.76:0/2932309955 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560e103672d0 0x560e10376df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:53:03.887 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.885+0000 7f170107c700 1 --2- 172.21.15.76:0/2932309955 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560e10365a80 0x560e1036f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:53:03.888 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.885+0000 7f170187d700 1 -- 172.21.15.76:0/2932309955 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560e103663e0 msgr2=0x560e1036fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:53:03.888 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.885+0000 7f170187d700 1 --2- 172.21.15.76:0/2932309955 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560e103663e0 0x560e1036fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:03.888 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.885+0000 7f170187d700 1 -- 172.21.15.76:0/2932309955 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560e10365a80 msgr2=0x560e1036f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:53:03.888 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.885+0000 7f170187d700 1 --2- 172.21.15.76:0/2932309955 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560e10365a80 0x560e1036f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:03.888 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.885+0000 7f170187d700 1 -- 172.21.15.76:0/2932309955 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16fc1091d0 con 0x560e103672d0 2024-06-02T04:53:03.888 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.885+0000 7f170187d700 1 --2- 172.21.15.76:0/2932309955 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560e103672d0 0x560e10376df0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f16f400ce60 tx=0x7f16f400ce90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=903ff2de6bc66f53 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:53:03.888 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.885+0000 7f16e4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-06-02T04:53:03.888 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.886+0000 7f16e4ff9700 1 -- 172.21.15.76:0/2932309955 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f401a070 con 0x560e103672d0 2024-06-02T04:53:03.888 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.886+0000 7f16e4ff9700 1 -- 172.21.15.76:0/2932309955 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f16f4006e40 con 0x560e103672d0 2024-06-02T04:53:03.888 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.886+0000 7f170f49bb80 1 -- 172.21.15.76:0/2932309955 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560e1020f210 con 0x560e103672d0 2024-06-02T04:53:03.888 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.886+0000 7f16e4ff9700 1 -- 172.21.15.76:0/2932309955 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f16f4011050 con 0x560e103672d0 2024-06-02T04:53:03.889 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.888+0000 7f170f49bb80 10 client.25553 fetch_fsmap learned FSMap version 31 2024-06-02T04:53:03.889 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.888+0000 7f170f49bb80 1 -- 172.21.15.76:0/2932309955 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x560e100e3b00 con 0x560e103672d0 2024-06-02T04:53:03.889 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.888+0000 7f16e4ff9700 1 -- 172.21.15.76:0/2932309955 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x560e1020f210 con 0x560e103672d0 2024-06-02T04:53:03.889 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.888+0000 7f16e4ff9700 1 -- 172.21.15.76:0/2932309955 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 31) v1 ==== 7474+0+0 (secure 0 0 0) 0x7f16f401d020 con 0x560e103672d0 2024-06-02T04:53:03.890 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.888+0000 7f170f49bb80 10 client.25553 fetch_fsmap finished waiting for FSMap version 31 2024-06-02T04:53:03.890 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.888+0000 7f170f49bb80 10 client.25553 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T04:53:03.890 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.888+0000 7f170f49bb80 20 client.25553 populate_metadata read hostname 'smithi076' 2024-06-02T04:53:03.890 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.888+0000 7f170f49bb80 1 --2- 172.21.15.76:0/2932309955 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x560e1038c740 0x560e1038eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:53:03.890 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.888+0000 7f170f49bb80 4 client.25553 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T04:53:03.890 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.888+0000 7f170f49bb80 1 -- 172.21.15.76:0/2932309955 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560e103357b0 con 0x560e1038c740 2024-06-02T04:53:03.891 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.890+0000 7f170107c700 1 --2- 172.21.15.76:0/2932309955 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x560e1038c740 0x560e1038eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:53:03.891 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.890+0000 7f170107c700 1 --2- 172.21.15.76:0/2932309955 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x560e1038c740 0x560e1038eb60 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9c952306940b212f server_cookie=4c315a76c7901e81 in_seq=0 out_seq=0 2024-06-02T04:53:03.891 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.890+0000 7f16e4ff9700 10 client.25553 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:53:03.892 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.891+0000 7f16e4ff9700 1 -- 172.21.15.76:0/2932309955 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x560e103357b0 con 0x560e1038c740 2024-06-02T04:53:03.892 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.891+0000 7f16e4ff9700 10 client.25553 handle_command_reply: tid=0 2024-06-02T04:53:03.892 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.891+0000 7f170f49bb80 1 client.25553 shutdown 2024-06-02T04:53:03.892 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.891+0000 7f170f49bb80 1 -- 172.21.15.76:0/2932309955 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560e103672d0 msgr2=0x560e10376df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:53:03.892 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.891+0000 7f170f49bb80 1 --2- 172.21.15.76:0/2932309955 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560e103672d0 0x560e10376df0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f16f400ce60 tx=0x7f16f400ce90 comp rx=0 tx=0).stop 2024-06-02T04:53:03.893 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.892+0000 7f170f49bb80 1 -- 172.21.15.76:0/2932309955 shutdown_connections 2024-06-02T04:53:03.893 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.892+0000 7f170f49bb80 1 --2- 172.21.15.76:0/2932309955 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x560e1038c740 0x560e1038eb60 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:03.893 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.892+0000 7f170f49bb80 1 --2- 172.21.15.76:0/2932309955 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560e103672d0 0x560e10376df0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:03.893 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.892+0000 7f170f49bb80 1 --2- 172.21.15.76:0/2932309955 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560e10365a80 0x560e1036f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:03.893 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.892+0000 7f170f49bb80 1 --2- 172.21.15.76:0/2932309955 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560e103663e0 0x560e1036fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:03.893 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.892+0000 7f170f49bb80 1 -- 172.21.15.76:0/2932309955 >> 172.21.15.76:0/2932309955 conn(0x560e102c41b0 msgr2=0x560e10360860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:53:03.893 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.892+0000 7f16e4ff9700 0 client.25553 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:53:03.893 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.892+0000 7f170f49bb80 1 -- 172.21.15.76:0/2932309955 shutdown_connections 2024-06-02T04:53:03.894 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.892+0000 7f170f49bb80 1 -- 172.21.15.76:0/2932309955 wait complete. 2024-06-02T04:53:03.894 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.892+0000 7f170f49bb80 20 client.25553 trim_cache size 0 max 16384 2024-06-02T04:53:03.915 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.914+0000 7f170f49bb80 1 Processor -- start 2024-06-02T04:53:03.915 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.914+0000 7f170f49bb80 1 -- start start 2024-06-02T04:53:03.915 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.914+0000 7f170f49bb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560e10365a80 0x560e103676b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:53:03.916 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.914+0000 7f170f49bb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560e103663e0 0x560e10376d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:53:03.916 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.914+0000 7f170f49bb80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560e103672d0 0x560e1036d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:53:03.916 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.914+0000 7f170f49bb80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e1036e330 con 0x560e103672d0 2024-06-02T04:53:03.916 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.914+0000 7f170f49bb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e1036f3e0 con 0x560e10365a80 2024-06-02T04:53:03.916 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.914+0000 7f170f49bb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e10361930 con 0x560e103663e0 2024-06-02T04:53:03.916 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.915+0000 7f170087b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560e103663e0 0x560e10376d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:53:03.916 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.915+0000 7f170107c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560e10365a80 0x560e103676b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:53:03.916 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.915+0000 7f170087b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560e103663e0 0x560e10376d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:49340/0 (socket says 172.21.15.76:49340) 2024-06-02T04:53:03.916 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.915+0000 7f170087b700 1 -- 172.21.15.76:0/3747367285 learned_addr learned my addr 172.21.15.76:0/3747367285 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:53:03.916 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.915+0000 7f170187d700 1 --2- 172.21.15.76:0/3747367285 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560e103672d0 0x560e1036d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:53:03.918 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.915+0000 7f170087b700 1 -- 172.21.15.76:0/3747367285 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560e10365a80 msgr2=0x560e103676b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:53:03.918 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.915+0000 7f170087b700 1 --2- 172.21.15.76:0/3747367285 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560e10365a80 0x560e103676b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:03.918 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.915+0000 7f170087b700 1 -- 172.21.15.76:0/3747367285 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560e103672d0 msgr2=0x560e1036d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:53:03.918 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.915+0000 7f170087b700 1 --2- 172.21.15.76:0/3747367285 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560e103672d0 0x560e1036d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:03.918 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.915+0000 7f170087b700 1 -- 172.21.15.76:0/3747367285 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560e1027c500 con 0x560e103663e0 2024-06-02T04:53:03.918 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.915+0000 7f170087b700 1 --2- 172.21.15.76:0/3747367285 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560e103663e0 0x560e10376d10 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f16ec00b500 tx=0x7f16ec0093a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5aba331d01fc010b server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:53:03.918 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.916+0000 7f16e7fff700 1 -- 172.21.15.76:0/3747367285 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16ec09e500 con 0x560e103663e0 2024-06-02T04:53:03.918 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.916+0000 7f16e7fff700 1 -- 172.21.15.76:0/3747367285 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f16ec0a2b50 con 0x560e103663e0 2024-06-02T04:53:03.918 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.916+0000 7f16e7fff700 1 -- 172.21.15.76:0/3747367285 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16ec099e20 con 0x560e103663e0 2024-06-02T04:53:03.919 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.916+0000 7f170f49bb80 1 -- 172.21.15.76:0/3747367285 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560e103663e0 msgr2=0x560e10376d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:53:03.919 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.916+0000 7f170f49bb80 1 --2- 172.21.15.76:0/3747367285 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560e103663e0 0x560e10376d10 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f16ec00b500 tx=0x7f16ec0093a0 comp rx=0 tx=0).stop 2024-06-02T04:53:03.919 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.917+0000 7f170f49bb80 1 -- 172.21.15.76:0/3747367285 shutdown_connections 2024-06-02T04:53:03.919 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.917+0000 7f170f49bb80 1 --2- 172.21.15.76:0/3747367285 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560e103672d0 0x560e1036d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:03.919 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.917+0000 7f170f49bb80 1 --2- 172.21.15.76:0/3747367285 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560e10365a80 0x560e103676b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:03.919 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.917+0000 7f170f49bb80 1 --2- 172.21.15.76:0/3747367285 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560e103663e0 0x560e10376d10 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:03.919 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.917+0000 7f170f49bb80 1 -- 172.21.15.76:0/3747367285 >> 172.21.15.76:0/3747367285 conn(0x560e102c41b0 msgr2=0x560e1036e540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:53:03.919 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.917+0000 7f170f49bb80 1 -- 172.21.15.76:0/3747367285 shutdown_connections 2024-06-02T04:53:03.919 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.917+0000 7f170f49bb80 1 -- 172.21.15.76:0/3747367285 wait complete. 2024-06-02T04:53:03.919 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.917+0000 7f170f49bb80 1 -- start start 2024-06-02T04:53:03.919 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.917+0000 7f170f49bb80 1 Processor -- start 2024-06-02T04:53:03.920 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.918+0000 7f170f49bb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560e10365a80 0x560e103742a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:53:03.920 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.918+0000 7f170f49bb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560e103663e0 0x560e103747e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:53:03.921 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.918+0000 7f170f49bb80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560e103672d0 0x560e10375750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:53:03.921 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.918+0000 7f170f49bb80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e10375c90 con 0x560e103672d0 2024-06-02T04:53:03.921 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.918+0000 7f170f49bb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e10375e00 con 0x560e103663e0 2024-06-02T04:53:03.921 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.918+0000 7f170f49bb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e10375f70 con 0x560e10365a80 2024-06-02T04:53:03.921 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.918+0000 7f170f49bb80 10 client.0 _ll_register_callbacks cb 0x560e1025bad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:53:03.921 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.918+0000 7f170087b700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560e103663e0 0x560e103747e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:53:03.921 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.918+0000 7f170087b700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560e103663e0 0x560e103747e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:59226/0 (socket says 172.21.15.76:59226) 2024-06-02T04:53:03.921 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.918+0000 7f170087b700 1 -- 172.21.15.76:0/1595860861 learned_addr learned my addr 172.21.15.76:0/1595860861 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:53:03.921 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.918+0000 7f170107c700 1 --2- 172.21.15.76:0/1595860861 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560e10365a80 0x560e103742a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:53:03.921 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.919+0000 7f170187d700 1 --2- 172.21.15.76:0/1595860861 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560e103672d0 0x560e10375750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:53:03.921 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.919+0000 7f170107c700 1 -- 172.21.15.76:0/1595860861 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560e103663e0 msgr2=0x560e103747e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:53:03.922 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.919+0000 7f170107c700 1 --2- 172.21.15.76:0/1595860861 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560e103663e0 0x560e103747e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:03.922 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.919+0000 7f170107c700 1 -- 172.21.15.76:0/1595860861 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560e103672d0 msgr2=0x560e10375750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:53:03.922 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.919+0000 7f170107c700 1 --2- 172.21.15.76:0/1595860861 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560e103672d0 0x560e10375750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:03.922 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.919+0000 7f170107c700 1 -- 172.21.15.76:0/1595860861 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560e10137350 con 0x560e10365a80 2024-06-02T04:53:03.922 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.919+0000 7f170107c700 1 --2- 172.21.15.76:0/1595860861 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560e10365a80 0x560e103742a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f16f80098e0 tx=0x7f16f801a050 comp rx=0 tx=0).ready entity=mon.1 client_cookie=46cec5f14710d9e4 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:53:03.922 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.919+0000 7f16e4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.192:3300/0 2024-06-02T04:53:03.922 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.919+0000 7f16e4ff9700 1 -- 172.21.15.76:0/1595860861 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f802d040 con 0x560e10365a80 2024-06-02T04:53:03.922 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.919+0000 7f16e4ff9700 1 -- 172.21.15.76:0/1595860861 <== mon.1 v2:172.21.15.192:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f16f80325a0 con 0x560e10365a80 2024-06-02T04:53:03.922 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.919+0000 7f170f49bb80 1 -- 172.21.15.76:0/1595860861 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f16ec09a6d0 con 0x560e10365a80 2024-06-02T04:53:03.922 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.919+0000 7f16e4ff9700 1 -- 172.21.15.76:0/1595860861 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f16f8032760 con 0x560e10365a80 2024-06-02T04:53:03.922 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.919+0000 7f170f49bb80 10 client.25498 fetch_fsmap learned FSMap version 31 2024-06-02T04:53:03.922 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.919+0000 7f170f49bb80 1 -- 172.21.15.76:0/1595860861 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x560e1013bc70 con 0x560e10365a80 2024-06-02T04:53:03.923 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.921+0000 7f16e4ff9700 1 -- 172.21.15.76:0/1595860861 <== mon.1 v2:172.21.15.192:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f16ec09a6d0 con 0x560e10365a80 2024-06-02T04:53:03.923 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.921+0000 7f16e4ff9700 1 -- 172.21.15.76:0/1595860861 <== mon.1 v2:172.21.15.192:3300/0 5 ==== fsmap(e 31) v1 ==== 7474+0+0 (secure 0 0 0) 0x7f16f8003820 con 0x560e10365a80 2024-06-02T04:53:03.923 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.921+0000 7f170f49bb80 10 client.25498 fetch_fsmap finished waiting for FSMap version 31 2024-06-02T04:53:03.923 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.921+0000 7f170f49bb80 10 client.25498 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T04:53:03.924 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.921+0000 7f170f49bb80 20 client.25498 populate_metadata read hostname 'smithi076' 2024-06-02T04:53:03.924 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.921+0000 7f170f49bb80 1 --2- 172.21.15.76:0/1595860861 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x560e103f4300 0x560e103f6720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:53:03.924 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.921+0000 7f170f49bb80 4 client.25498 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T04:53:03.924 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.921+0000 7f170f49bb80 1 -- 172.21.15.76:0/1595860861 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x560e102aee60 con 0x560e103f4300 2024-06-02T04:53:03.924 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.921+0000 7f170087b700 1 --2- 172.21.15.76:0/1595860861 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x560e103f4300 0x560e103f6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:53:03.924 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.922+0000 7f170087b700 1 --2- 172.21.15.76:0/1595860861 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x560e103f4300 0x560e103f6720 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b97ed2f384c4960 server_cookie=94547f6d9da441d8 in_seq=0 out_seq=0 2024-06-02T04:53:03.924 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.922+0000 7f16e4ff9700 10 client.25498 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:53:03.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:53:03 smithi192 ceph-mon[47933]: pgmap v372: 129 pgs: 129 active+clean; 1.5 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 13 MiB/s wr, 1.12k op/s 2024-06-02T04:53:03.944 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.943+0000 7f16e4ff9700 1 -- 172.21.15.76:0/1595860861 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x560e102aee60 con 0x560e103f4300 2024-06-02T04:53:03.944 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.943+0000 7f16e4ff9700 10 client.25498 handle_command_reply: tid=0 2024-06-02T04:53:03.944 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.943+0000 7f170f49bb80 1 client.25498 shutdown 2024-06-02T04:53:03.944 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.943+0000 7f170f49bb80 1 -- 172.21.15.76:0/1595860861 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560e10365a80 msgr2=0x560e103742a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:53:03.944 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.943+0000 7f170f49bb80 1 --2- 172.21.15.76:0/1595860861 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560e10365a80 0x560e103742a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f16f80098e0 tx=0x7f16f801a050 comp rx=0 tx=0).stop 2024-06-02T04:53:03.944 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.943+0000 7f170f49bb80 1 -- 172.21.15.76:0/1595860861 shutdown_connections 2024-06-02T04:53:03.944 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.943+0000 7f170f49bb80 1 --2- 172.21.15.76:0/1595860861 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x560e103f4300 0x560e103f6720 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:03.944 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.943+0000 7f170f49bb80 1 --2- 172.21.15.76:0/1595860861 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560e103672d0 0x560e10375750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:03.945 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.943+0000 7f16e4ff9700 0 client.25498 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:53:03.945 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.943+0000 7f170f49bb80 1 --2- 172.21.15.76:0/1595860861 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560e10365a80 0x560e103742a0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:03.945 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.943+0000 7f170f49bb80 1 --2- 172.21.15.76:0/1595860861 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560e103663e0 0x560e103747e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:03.945 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.943+0000 7f170f49bb80 1 -- 172.21.15.76:0/1595860861 >> 172.21.15.76:0/1595860861 conn(0x560e102c41b0 msgr2=0x560e1036d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:53:03.945 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.943+0000 7f170f49bb80 1 -- 172.21.15.76:0/1595860861 shutdown_connections 2024-06-02T04:53:03.945 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.944+0000 7f170f49bb80 1 -- 172.21.15.76:0/1595860861 wait complete. 2024-06-02T04:53:03.945 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.944+0000 7f170f49bb80 20 client.25498 trim_cache size 0 max 16384 2024-06-02T04:53:03.945 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:{ 2024-06-02T04:53:03.945 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "message": "", 2024-06-02T04:53:03.946 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "return_code": 0 2024-06-02T04:53:03.946 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:} 2024-06-02T04:53:03.946 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.944+0000 7f17032e0700 1 -- 172.21.15.76:0/4144139347 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f16e80a1270 msgr2=0x7f16e80a3730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:53:03.946 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.944+0000 7f17032e0700 1 --2- 172.21.15.76:0/4144139347 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f16e80a1270 0x7f16e80a3730 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f16f8003780 tx=0x7f16f8005c40 comp rx=0 tx=0).stop 2024-06-02T04:53:03.946 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.944+0000 7f17032e0700 1 -- 172.21.15.76:0/4144139347 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16fc100f60 msgr2=0x7f16fc197460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:53:03.946 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.944+0000 7f17032e0700 1 --2- 172.21.15.76:0/4144139347 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16fc100f60 0x7f16fc197460 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f16ec00b530 tx=0x7f16ec00b8f0 comp rx=0 tx=0).stop 2024-06-02T04:53:03.947 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.944+0000 7f17032e0700 1 -- 172.21.15.76:0/4144139347 shutdown_connections 2024-06-02T04:53:03.947 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.944+0000 7f17032e0700 1 --2- 172.21.15.76:0/4144139347 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f16fc101920 0x7f16fc19e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:03.947 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.944+0000 7f17032e0700 1 --2- 172.21.15.76:0/4144139347 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f16e80a1270 0x7f16e80a3730 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:03.947 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.944+0000 7f17032e0700 1 --2- 172.21.15.76:0/4144139347 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f16fc0ffe10 0x7f16fc196f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:03.947 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.944+0000 7f17032e0700 1 --2- 172.21.15.76:0/4144139347 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16fc100f60 0x7f16fc197460 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:03.947 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.944+0000 7f17032e0700 1 -- 172.21.15.76:0/4144139347 >> 172.21.15.76:0/4144139347 conn(0x7f16fc0fb380 msgr2=0x7f16fc104410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:53:03.947 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.945+0000 7f17032e0700 1 -- 172.21.15.76:0/4144139347 shutdown_connections 2024-06-02T04:53:03.947 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:03.945+0000 7f17032e0700 1 -- 172.21.15.76:0/4144139347 wait complete. 2024-06-02T04:53:04.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:53:04 smithi119 ceph-mon[46633]: pgmap v373: 129 pgs: 129 active+clean; 1.5 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 12 MiB/s wr, 970 op/s 2024-06-02T04:53:04.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:53:04 smithi192 ceph-mon[47933]: pgmap v373: 129 pgs: 129 active+clean; 1.5 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 12 MiB/s wr, 970 op/s 2024-06-02T04:53:04.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:53:04 smithi076 ceph-mon[42935]: pgmap v373: 129 pgs: 129 active+clean; 1.5 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 12 MiB/s wr, 970 op/s 2024-06-02T04:53:06.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 135.0 s, 1027.8 tps, lat 96.427 ms stddev 33.057 2024-06-02T04:53:07.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:53:07 smithi119 ceph-mon[46633]: pgmap v374: 129 pgs: 129 active+clean; 1.5 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 14 MiB/s wr, 1.20k op/s 2024-06-02T04:53:07.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:53:07 smithi192 ceph-mon[47933]: pgmap v374: 129 pgs: 129 active+clean; 1.5 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 14 MiB/s wr, 1.20k op/s 2024-06-02T04:53:07.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:53:07 smithi076 ceph-mon[42935]: pgmap v374: 129 pgs: 129 active+clean; 1.5 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 14 MiB/s wr, 1.20k op/s 2024-06-02T04:53:08.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:53:08 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:53:08.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:53:08 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:53:08.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:53:08 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:53:09.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:53:09 smithi119 ceph-mon[46633]: pgmap v375: 129 pgs: 129 active+clean; 1.5 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 13 MiB/s wr, 1.11k op/s 2024-06-02T04:53:09.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:53:09 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:53:09.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:53:09 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:53:09.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:53:09 smithi192 ceph-mon[47933]: pgmap v375: 129 pgs: 129 active+clean; 1.5 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 13 MiB/s wr, 1.11k op/s 2024-06-02T04:53:09.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:53:09 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:53:09.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:53:09 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:53:09.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:53:09 smithi076 ceph-mon[42935]: pgmap v375: 129 pgs: 129 active+clean; 1.5 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 13 MiB/s wr, 1.11k op/s 2024-06-02T04:53:09.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:53:09 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:53:09.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:53:09 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:53:10.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:53:10 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:53:10.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:53:10 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:53:10.597 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:53:10 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:53:10.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:53:10 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:53:10.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:53:10 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:53:10.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:53:10 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:53:10.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:53:10 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:53:10.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:53:10 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:53:10.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:53:10 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:53:11.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 140.0 s, 851.8 tps, lat 118.192 ms stddev 46.307 2024-06-02T04:53:11.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:53:11 smithi119 ceph-mon[46633]: pgmap v376: 129 pgs: 129 active+clean; 1.5 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 12 MiB/s wr, 1.03k op/s 2024-06-02T04:53:11.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:53:11 smithi192 ceph-mon[47933]: pgmap v376: 129 pgs: 129 active+clean; 1.5 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 12 MiB/s wr, 1.03k op/s 2024-06-02T04:53:11.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:53:11 smithi076 ceph-mon[42935]: pgmap v376: 129 pgs: 129 active+clean; 1.5 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 12 MiB/s wr, 1.03k op/s 2024-06-02T04:53:13.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:53:13 smithi119 ceph-mon[46633]: pgmap v377: 129 pgs: 129 active+clean; 1.5 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 13 MiB/s wr, 1.17k op/s 2024-06-02T04:53:13.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:53:13 smithi192 ceph-mon[47933]: pgmap v377: 129 pgs: 129 active+clean; 1.5 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 13 MiB/s wr, 1.17k op/s 2024-06-02T04:53:13.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:53:13 smithi076 ceph-mon[42935]: pgmap v377: 129 pgs: 129 active+clean; 1.5 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 13 MiB/s wr, 1.17k op/s 2024-06-02T04:53:15.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:53:15 smithi119 ceph-mon[46633]: pgmap v378: 129 pgs: 129 active+clean; 1.5 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 11 MiB/s wr, 954 op/s 2024-06-02T04:53:15.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:53:15 smithi192 ceph-mon[47933]: pgmap v378: 129 pgs: 129 active+clean; 1.5 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 11 MiB/s wr, 954 op/s 2024-06-02T04:53:15.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:53:15 smithi076 ceph-mon[42935]: pgmap v378: 129 pgs: 129 active+clean; 1.5 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 11 MiB/s wr, 954 op/s 2024-06-02T04:53:16.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 145.0 s, 913.9 tps, lat 108.741 ms stddev 35.475 2024-06-02T04:53:17.114 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.113+0000 7f3fa5ffe700 1 -- 172.21.15.76:0/538834883 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3fa0107fa0 msgr2=0x7f3fa0108400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:53:17.114 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.113+0000 7f3fa5ffe700 1 --2- 172.21.15.76:0/538834883 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3fa0107fa0 0x7f3fa0108400 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3f94009990 tx=0x7f3f94009ca0 comp rx=0 tx=0).stop 2024-06-02T04:53:17.114 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.113+0000 7f3fa5ffe700 1 -- 172.21.15.76:0/538834883 shutdown_connections 2024-06-02T04:53:17.114 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.113+0000 7f3fa5ffe700 1 --2- 172.21.15.76:0/538834883 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3fa0108940 0x7f3fa0110200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:17.114 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.113+0000 7f3fa5ffe700 1 --2- 172.21.15.76:0/538834883 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3fa0109350 0x7f3fa0109770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:17.114 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.113+0000 7f3fa5ffe700 1 --2- 172.21.15.76:0/538834883 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3fa0107fa0 0x7f3fa0108400 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:17.115 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.113+0000 7f3fa5ffe700 1 -- 172.21.15.76:0/538834883 >> 172.21.15.76:0/538834883 conn(0x7f3fa006df30 msgr2=0x7f3fa0070370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:53:17.115 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.113+0000 7f3fa5ffe700 1 -- 172.21.15.76:0/538834883 shutdown_connections 2024-06-02T04:53:17.115 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.113+0000 7f3fa5ffe700 1 -- 172.21.15.76:0/538834883 wait complete. 2024-06-02T04:53:17.116 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.114+0000 7f3fa5ffe700 1 Processor -- start 2024-06-02T04:53:17.116 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.114+0000 7f3fa5ffe700 1 -- start start 2024-06-02T04:53:17.116 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.114+0000 7f3fa5ffe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3fa0107fa0 0x7f3fa0074d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:53:17.116 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.114+0000 7f3fa5ffe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3fa0108940 0x7f3fa007d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:53:17.116 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.114+0000 7f3fa5ffe700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3fa0109350 0x7f3fa007fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:53:17.117 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.114+0000 7f3fa5ffe700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa0080370 con 0x7f3fa0107fa0 2024-06-02T04:53:17.117 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.114+0000 7f3fa5ffe700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa00804e0 con 0x7f3fa0109350 2024-06-02T04:53:17.117 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.114+0000 7f3fa5ffe700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa00806a0 con 0x7f3fa0108940 2024-06-02T04:53:17.117 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.115+0000 7f3f9ffff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3fa0109350 0x7f3fa007fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:53:17.117 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.115+0000 7f3f9ffff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3fa0109350 0x7f3fa007fbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:42270/0 (socket says 172.21.15.76:42270) 2024-06-02T04:53:17.117 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.115+0000 7f3f9ffff700 1 -- 172.21.15.76:0/1827813015 learned_addr learned my addr 172.21.15.76:0/1827813015 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:53:17.117 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.115+0000 7f3f9f7fe700 1 --2- 172.21.15.76:0/1827813015 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3fa0107fa0 0x7f3fa0074d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:53:17.117 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.115+0000 7f3f9effd700 1 --2- 172.21.15.76:0/1827813015 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3fa0108940 0x7f3fa007d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:53:17.117 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.115+0000 7f3f9ffff700 1 -- 172.21.15.76:0/1827813015 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3fa0108940 msgr2=0x7f3fa007d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:53:17.117 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.115+0000 7f3f9ffff700 1 --2- 172.21.15.76:0/1827813015 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3fa0108940 0x7f3fa007d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:17.117 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.115+0000 7f3f9ffff700 1 -- 172.21.15.76:0/1827813015 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3fa0107fa0 msgr2=0x7f3fa0074d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:53:17.117 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.115+0000 7f3f9ffff700 1 --2- 172.21.15.76:0/1827813015 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3fa0107fa0 0x7f3fa0074d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:17.118 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.115+0000 7f3f9ffff700 1 -- 172.21.15.76:0/1827813015 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f940095f0 con 0x7f3fa0109350 2024-06-02T04:53:17.118 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.115+0000 7f3f9ffff700 1 --2- 172.21.15.76:0/1827813015 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3fa0109350 0x7f3fa007fbd0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3f9800ef30 tx=0x7f3f9800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:53:17.118 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.115+0000 7f3f9cff9700 1 -- 172.21.15.76:0/1827813015 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f98018070 con 0x7f3fa0109350 2024-06-02T04:53:17.118 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.116+0000 7f3f9cff9700 1 -- 172.21.15.76:0/1827813015 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3f9800f040 con 0x7f3fa0109350 2024-06-02T04:53:17.118 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.116+0000 7f3f9cff9700 1 -- 172.21.15.76:0/1827813015 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f9800cc70 con 0x7f3fa0109350 2024-06-02T04:53:17.118 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.116+0000 7f3fa5ffe700 1 -- 172.21.15.76:0/1827813015 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fa0080920 con 0x7f3fa0109350 2024-06-02T04:53:17.118 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.116+0000 7f3fa5ffe700 1 -- 172.21.15.76:0/1827813015 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fa0080db0 con 0x7f3fa0109350 2024-06-02T04:53:17.121 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.120+0000 7f3fb21b9b80 1 Processor -- start 2024-06-02T04:53:17.122 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.121+0000 7f3f9cff9700 1 -- 172.21.15.76:0/1827813015 <== mon.2 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f3f98007500 con 0x7f3fa0109350 2024-06-02T04:53:17.122 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.122+0000 7f3fb21b9b80 1 -- start start 2024-06-02T04:53:17.122 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.122+0000 7f3fb21b9b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5614c8ab4a80 0x5614c8ab4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:53:17.122 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.122+0000 7f3fb21b9b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5614c8ab53e0 0x5614c8ab5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:53:17.122 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.122+0000 7f3fb21b9b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5614c8ab62d0 0x5614c8ab6750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:53:17.123 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.122+0000 7f3fb21b9b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614c8a0c0f0 con 0x5614c8ab62d0 2024-06-02T04:53:17.124 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.122+0000 7f3fb21b9b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614c8a09ab0 con 0x5614c8ab4a80 2024-06-02T04:53:17.124 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.122+0000 7f3fb21b9b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614c8a053a0 con 0x5614c8ab53e0 2024-06-02T04:53:17.124 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.122+0000 7f3f9effd700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5614c8ab4a80 0x5614c8ab4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:53:17.124 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.122+0000 7f3f9effd700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5614c8ab4a80 0x5614c8ab4ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:42282/0 (socket says 172.21.15.76:42282) 2024-06-02T04:53:17.124 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.122+0000 7f3f9effd700 1 -- 172.21.15.76:0/4003991978 learned_addr learned my addr 172.21.15.76:0/4003991978 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:53:17.124 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.122+0000 7f3f9f7fe700 1 --2- 172.21.15.76:0/4003991978 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5614c8ab53e0 0x5614c8ab5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:53:17.124 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.124+0000 7f3f9f7fe700 1 -- 172.21.15.76:0/4003991978 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5614c8ab4a80 msgr2=0x5614c8ab4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:53:17.125 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.124+0000 7f3f9f7fe700 1 --2- 172.21.15.76:0/4003991978 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5614c8ab4a80 0x5614c8ab4ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:17.125 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.124+0000 7f3f9f7fe700 1 -- 172.21.15.76:0/4003991978 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5614c8ab62d0 msgr2=0x5614c8ab6750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:53:17.125 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.124+0000 7f3f9f7fe700 1 --2- 172.21.15.76:0/4003991978 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5614c8ab62d0 0x5614c8ab6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:17.125 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.124+0000 7f3f9f7fe700 1 -- 172.21.15.76:0/4003991978 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5614c8886350 con 0x5614c8ab53e0 2024-06-02T04:53:17.125 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.124+0000 7f3f9effd700 1 --2- 172.21.15.76:0/4003991978 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5614c8ab4a80 0x5614c8ab4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T04:53:17.125 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.124+0000 7f3f9f7fe700 1 --2- 172.21.15.76:0/4003991978 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5614c8ab53e0 0x5614c8ab5cf0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3f90009c80 tx=0x7f3f90009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=15259acfdb178778 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:53:17.125 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.124+0000 7f3f85ffb700 1 -- 172.21.15.76:0/4003991978 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f90011cb0 con 0x5614c8ab53e0 2024-06-02T04:53:17.125 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.124+0000 7f3f85ffb700 1 -- 172.21.15.76:0/4003991978 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3f90011e10 con 0x5614c8ab53e0 2024-06-02T04:53:17.125 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.124+0000 7f3f85ffb700 1 -- 172.21.15.76:0/4003991978 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f90019420 con 0x5614c8ab53e0 2024-06-02T04:53:17.126 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.125+0000 7f3f9cff9700 1 --2- 172.21.15.76:0/1827813015 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f3f880a11a0 0x7f3f880a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:53:17.126 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.125+0000 7f3fb21b9b80 1 -- 172.21.15.76:0/4003991978 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5614c8ab53e0 msgr2=0x5614c8ab5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:53:17.126 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.125+0000 7f3fb21b9b80 1 --2- 172.21.15.76:0/4003991978 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5614c8ab53e0 0x5614c8ab5cf0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3f90009c80 tx=0x7f3f90009f90 comp rx=0 tx=0).stop 2024-06-02T04:53:17.126 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.125+0000 7f3f9cff9700 1 -- 172.21.15.76:0/1827813015 <== mon.2 v2:172.21.15.119:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f3f980cbeb0 con 0x7f3fa0109350 2024-06-02T04:53:17.126 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.125+0000 7f3f9effd700 1 --2- 172.21.15.76:0/1827813015 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f3f880a11a0 0x7f3f880a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:53:17.126 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.125+0000 7f3fb21b9b80 1 -- 172.21.15.76:0/4003991978 shutdown_connections 2024-06-02T04:53:17.127 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.125+0000 7f3fb21b9b80 1 --2- 172.21.15.76:0/4003991978 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5614c8ab62d0 0x5614c8ab6750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:17.127 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.125+0000 7f3fb21b9b80 1 --2- 172.21.15.76:0/4003991978 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5614c8ab4a80 0x5614c8ab4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:17.127 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.125+0000 7f3fb21b9b80 1 --2- 172.21.15.76:0/4003991978 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5614c8ab53e0 0x5614c8ab5cf0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:17.127 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.125+0000 7f3fb21b9b80 1 -- 172.21.15.76:0/4003991978 >> 172.21.15.76:0/4003991978 conn(0x5614c8a131b0 msgr2=0x5614c8ab1440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:53:17.127 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.126+0000 7f3fb21b9b80 1 -- 172.21.15.76:0/4003991978 shutdown_connections 2024-06-02T04:53:17.127 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.126+0000 7f3fb21b9b80 1 -- 172.21.15.76:0/4003991978 wait complete. 2024-06-02T04:53:17.129 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.126+0000 7f3fb21b9b80 1 -- start start 2024-06-02T04:53:17.129 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.126+0000 7f3f9effd700 1 --2- 172.21.15.76:0/1827813015 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f3f880a11a0 0x7f3f880a3660 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x5614c8ab5ab0 tx=0x7f3f9401a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:53:17.130 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.126+0000 7f3fb21b9b80 1 Processor -- start 2024-06-02T04:53:17.130 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.127+0000 7f3fb21b9b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5614c8ab4a80 0x5614c8abe880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:53:17.130 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.127+0000 7f3fb21b9b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5614c8ab53e0 0x5614c8abedc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:53:17.130 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.127+0000 7f3fb21b9b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5614c8ab62d0 0x5614c8ac5e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:53:17.130 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.127+0000 7f3fb21b9b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614c89a1500 con 0x5614c8ab4a80 2024-06-02T04:53:17.130 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.127+0000 7f3fb21b9b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614c89a11a0 con 0x5614c8ab62d0 2024-06-02T04:53:17.130 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.127+0000 7f3fb21b9b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614c8888640 con 0x5614c8ab53e0 2024-06-02T04:53:17.130 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.127+0000 7f3fb21b9b80 10 client.0 _ll_register_callbacks cb 0x5614c89aaad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:53:17.130 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.127+0000 7f3f9effd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5614c8ab53e0 0x5614c8abedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:53:17.130 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.127+0000 7f3f9effd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5614c8ab53e0 0x5614c8abedc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:44688/0 (socket says 172.21.15.76:44688) 2024-06-02T04:53:17.131 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.127+0000 7f3f9effd700 1 -- 172.21.15.76:0/2869472870 learned_addr learned my addr 172.21.15.76:0/2869472870 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:53:17.131 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.127+0000 7f3f9f7fe700 1 --2- 172.21.15.76:0/2869472870 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5614c8ab4a80 0x5614c8abe880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:53:17.131 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.127+0000 7f3f9effd700 1 -- 172.21.15.76:0/2869472870 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5614c8ab62d0 msgr2=0x5614c8ac5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:53:17.131 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.127+0000 7f3f9ffff700 1 --2- 172.21.15.76:0/2869472870 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5614c8ab62d0 0x5614c8ac5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:53:17.131 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.128+0000 7f3f9effd700 1 --2- 172.21.15.76:0/2869472870 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5614c8ab62d0 0x5614c8ac5e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:17.131 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.128+0000 7f3f9effd700 1 -- 172.21.15.76:0/2869472870 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5614c8ab4a80 msgr2=0x5614c8abe880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:53:17.131 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.128+0000 7f3f9effd700 1 --2- 172.21.15.76:0/2869472870 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5614c8ab4a80 0x5614c8abe880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:17.131 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.128+0000 7f3f9effd700 1 -- 172.21.15.76:0/2869472870 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fa0110b00 con 0x5614c8ab53e0 2024-06-02T04:53:17.131 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.128+0000 7f3f9ffff700 1 --2- 172.21.15.76:0/2869472870 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5614c8ab62d0 0x5614c8ac5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:53:17.132 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.128+0000 7f3f9effd700 1 --2- 172.21.15.76:0/2869472870 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5614c8ab53e0 0x5614c8abedc0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3f94015000 tx=0x7f3f9400b610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5fbefe78696ea124 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:53:17.132 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.128+0000 7f3f7effd700 10 client.0 ms_handle_connect on v2:172.21.15.192:3300/0 2024-06-02T04:53:17.132 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.128+0000 7f3f7effd700 1 -- 172.21.15.76:0/2869472870 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f9402c070 con 0x5614c8ab53e0 2024-06-02T04:53:17.132 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.128+0000 7f3fb21b9b80 1 -- 172.21.15.76:0/2869472870 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5614c895e210 con 0x5614c8ab53e0 2024-06-02T04:53:17.132 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.128+0000 7f3f7effd700 1 -- 172.21.15.76:0/2869472870 <== mon.1 v2:172.21.15.192:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f3f94025420 con 0x5614c8ab53e0 2024-06-02T04:53:17.132 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.129+0000 7f3f7effd700 1 -- 172.21.15.76:0/2869472870 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3f940255e0 con 0x5614c8ab53e0 2024-06-02T04:53:17.133 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.129+0000 7f3fb21b9b80 10 client.25510 fetch_fsmap learned FSMap version 31 2024-06-02T04:53:17.133 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.129+0000 7f3fb21b9b80 1 -- 172.21.15.76:0/2869472870 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x7f3f900098e0 con 0x5614c8ab53e0 2024-06-02T04:53:17.133 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.129+0000 7f3f7effd700 1 -- 172.21.15.76:0/2869472870 <== mon.1 v2:172.21.15.192:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5614c895e210 con 0x5614c8ab53e0 2024-06-02T04:53:17.133 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.129+0000 7f3f7effd700 1 -- 172.21.15.76:0/2869472870 <== mon.1 v2:172.21.15.192:3300/0 5 ==== fsmap(e 31) v1 ==== 7474+0+0 (secure 0 0 0) 0x7f3f9400f7b0 con 0x5614c8ab53e0 2024-06-02T04:53:17.133 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.129+0000 7f3fb21b9b80 10 client.25510 fetch_fsmap finished waiting for FSMap version 31 2024-06-02T04:53:17.133 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.129+0000 7f3fb21b9b80 10 client.25510 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T04:53:17.133 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.129+0000 7f3fb21b9b80 20 client.25510 populate_metadata read hostname 'smithi076' 2024-06-02T04:53:17.133 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.129+0000 7f3fb21b9b80 1 --2- 172.21.15.76:0/2869472870 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5614c8aca6b0 0x5614c8accad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:53:17.133 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.129+0000 7f3fb21b9b80 4 client.25510 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T04:53:17.133 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.129+0000 7f3fb21b9b80 1 -- 172.21.15.76:0/2869472870 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5614c8a847b0 con 0x5614c8aca6b0 2024-06-02T04:53:17.134 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.130+0000 7f3f9f7fe700 1 --2- 172.21.15.76:0/2869472870 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5614c8aca6b0 0x5614c8accad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:53:17.134 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.131+0000 7f3f7effd700 10 client.25510 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:53:17.134 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.131+0000 7f3f9f7fe700 1 --2- 172.21.15.76:0/2869472870 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5614c8aca6b0 0x5614c8accad0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9bea5d25ff6bca75 server_cookie=31a9ff1558ac72f5 in_seq=0 out_seq=0 2024-06-02T04:53:17.134 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.131+0000 7f3f7effd700 1 -- 172.21.15.76:0/2869472870 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5614c8a847b0 con 0x5614c8aca6b0 2024-06-02T04:53:17.135 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.131+0000 7f3f7effd700 10 client.25510 handle_command_reply: tid=0 2024-06-02T04:53:17.135 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.131+0000 7f3fb21b9b80 1 client.25510 shutdown 2024-06-02T04:53:17.135 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.134+0000 7f3fb21b9b80 1 -- 172.21.15.76:0/2869472870 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5614c8ab53e0 msgr2=0x5614c8abedc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:53:17.135 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.134+0000 7f3fb21b9b80 1 --2- 172.21.15.76:0/2869472870 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5614c8ab53e0 0x5614c8abedc0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3f94015000 tx=0x7f3f9400b610 comp rx=0 tx=0).stop 2024-06-02T04:53:17.137 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.135+0000 7f3fb21b9b80 1 -- 172.21.15.76:0/2869472870 shutdown_connections 2024-06-02T04:53:17.137 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.135+0000 7f3fb21b9b80 1 --2- 172.21.15.76:0/2869472870 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5614c8aca6b0 0x5614c8accad0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:17.137 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.135+0000 7f3fb21b9b80 1 --2- 172.21.15.76:0/2869472870 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5614c8ab62d0 0x5614c8ac5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:17.137 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.135+0000 7f3fb21b9b80 1 --2- 172.21.15.76:0/2869472870 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5614c8ab4a80 0x5614c8abe880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:17.137 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.135+0000 7f3fb21b9b80 1 --2- 172.21.15.76:0/2869472870 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5614c8ab53e0 0x5614c8abedc0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:17.137 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.135+0000 7f3fb21b9b80 1 -- 172.21.15.76:0/2869472870 >> 172.21.15.76:0/2869472870 conn(0x5614c8a131b0 msgr2=0x5614c8aaf860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:53:17.137 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.135+0000 7f3f7effd700 0 client.25510 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:53:17.138 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.135+0000 7f3fb21b9b80 1 -- 172.21.15.76:0/2869472870 shutdown_connections 2024-06-02T04:53:17.138 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.135+0000 7f3fb21b9b80 1 -- 172.21.15.76:0/2869472870 wait complete. 2024-06-02T04:53:17.138 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.137+0000 7f3fb21b9b80 20 client.25510 trim_cache size 0 max 16384 2024-06-02T04:53:17.159 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.159+0000 7f3fb21b9b80 1 Processor -- start 2024-06-02T04:53:17.160 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.159+0000 7f3fb21b9b80 1 -- start start 2024-06-02T04:53:17.160 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.159+0000 7f3fb21b9b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5614c8ab4a80 0x5614c8ab4e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:53:17.160 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.159+0000 7f3fb21b9b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5614c8ab53e0 0x5614c8ac5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:53:17.160 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.159+0000 7f3fb21b9b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5614c8ab62d0 0x5614c8ab66b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:53:17.160 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.159+0000 7f3fb21b9b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614c8ac6f80 con 0x5614c8ab53e0 2024-06-02T04:53:17.160 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.159+0000 7f3fb21b9b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614c8abe3f0 con 0x5614c8ab62d0 2024-06-02T04:53:17.161 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.159+0000 7f3fb21b9b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614c8abd390 con 0x5614c8ab4a80 2024-06-02T04:53:17.161 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.159+0000 7f3f9effd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5614c8ab53e0 0x5614c8ac5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:53:17.161 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.159+0000 7f3f9f7fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5614c8ab4a80 0x5614c8ab4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:53:17.161 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.159+0000 7f3f9effd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5614c8ab53e0 0x5614c8ac5dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:60414/0 (socket says 172.21.15.76:60414) 2024-06-02T04:53:17.161 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.159+0000 7f3f9effd700 1 -- 172.21.15.76:0/1954647079 learned_addr learned my addr 172.21.15.76:0/1954647079 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:53:17.161 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.159+0000 7f3f9f7fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5614c8ab4a80 0x5614c8ab4e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:44704/0 (socket says 172.21.15.76:44704) 2024-06-02T04:53:17.161 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.159+0000 7f3f9ffff700 1 --2- 172.21.15.76:0/1954647079 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5614c8ab62d0 0x5614c8ab66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:53:17.161 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.159+0000 7f3f9effd700 1 -- 172.21.15.76:0/1954647079 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5614c8ab4a80 msgr2=0x5614c8ab4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:53:17.161 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.159+0000 7f3f9effd700 1 --2- 172.21.15.76:0/1954647079 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5614c8ab4a80 0x5614c8ab4e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:17.161 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.159+0000 7f3f9effd700 1 -- 172.21.15.76:0/1954647079 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5614c8ab62d0 msgr2=0x5614c8ab66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:53:17.162 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.159+0000 7f3f9effd700 1 --2- 172.21.15.76:0/1954647079 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5614c8ab62d0 0x5614c8ab66b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:17.162 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.159+0000 7f3f9effd700 1 -- 172.21.15.76:0/1954647079 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5614c8832b00 con 0x5614c8ab53e0 2024-06-02T04:53:17.162 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.160+0000 7f3f9effd700 1 --2- 172.21.15.76:0/1954647079 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5614c8ab53e0 0x5614c8ac5dc0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f3f94005b40 tx=0x7f3f9400bd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63c108f69d646952 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:53:17.165 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.160+0000 7f3f867fc700 1 -- 172.21.15.76:0/1954647079 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f9402c070 con 0x5614c8ab53e0 2024-06-02T04:53:17.165 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.160+0000 7f3f867fc700 1 -- 172.21.15.76:0/1954647079 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3f9401e050 con 0x5614c8ab53e0 2024-06-02T04:53:17.165 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.160+0000 7f3f867fc700 1 -- 172.21.15.76:0/1954647079 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f94040990 con 0x5614c8ab53e0 2024-06-02T04:53:17.165 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.161+0000 7f3fb21b9b80 1 -- 172.21.15.76:0/1954647079 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5614c8ab53e0 msgr2=0x5614c8ac5dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:53:17.165 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.161+0000 7f3fb21b9b80 1 --2- 172.21.15.76:0/1954647079 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5614c8ab53e0 0x5614c8ac5dc0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f3f94005b40 tx=0x7f3f9400bd80 comp rx=0 tx=0).stop 2024-06-02T04:53:17.166 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.161+0000 7f3fb21b9b80 1 -- 172.21.15.76:0/1954647079 shutdown_connections 2024-06-02T04:53:17.166 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.161+0000 7f3fb21b9b80 1 --2- 172.21.15.76:0/1954647079 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5614c8ab62d0 0x5614c8ab66b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:17.166 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.161+0000 7f3fb21b9b80 1 --2- 172.21.15.76:0/1954647079 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5614c8ab4a80 0x5614c8ab4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:17.166 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.161+0000 7f3fb21b9b80 1 --2- 172.21.15.76:0/1954647079 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5614c8ab53e0 0x5614c8ac5dc0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:17.166 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.161+0000 7f3fb21b9b80 1 -- 172.21.15.76:0/1954647079 >> 172.21.15.76:0/1954647079 conn(0x5614c8a131b0 msgr2=0x5614c8abc7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:53:17.166 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.161+0000 7f3fb21b9b80 1 -- 172.21.15.76:0/1954647079 shutdown_connections 2024-06-02T04:53:17.166 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.161+0000 7f3fb21b9b80 1 -- 172.21.15.76:0/1954647079 wait complete. 2024-06-02T04:53:17.166 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.162+0000 7f3fb21b9b80 1 -- start start 2024-06-02T04:53:17.166 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.162+0000 7f3fb21b9b80 1 Processor -- start 2024-06-02T04:53:17.166 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.162+0000 7f3fb21b9b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5614c8ab4a80 0x5614c8ac1030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:53:17.166 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.162+0000 7f3fb21b9b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5614c8ab53e0 0x5614c8ac1570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:53:17.166 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.162+0000 7f3fb21b9b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5614c8ab62d0 0x5614c8b2fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:53:17.167 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.162+0000 7f3fb21b9b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614c8b300e0 con 0x5614c8ab4a80 2024-06-02T04:53:17.167 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.162+0000 7f3fb21b9b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614c8b30220 con 0x5614c8ab53e0 2024-06-02T04:53:17.167 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.162+0000 7f3fb21b9b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614c8b30390 con 0x5614c8ab62d0 2024-06-02T04:53:17.167 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.162+0000 7f3fb21b9b80 10 client.0 _ll_register_callbacks cb 0x5614c89aaad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:53:17.167 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.162+0000 7f3f9f7fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5614c8ab4a80 0x5614c8ac1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:53:17.167 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.162+0000 7f3f9f7fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5614c8ab4a80 0x5614c8ac1030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:60424/0 (socket says 172.21.15.76:60424) 2024-06-02T04:53:17.167 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.162+0000 7f3f9f7fe700 1 -- 172.21.15.76:0/1323146961 learned_addr learned my addr 172.21.15.76:0/1323146961 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:53:17.167 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.162+0000 7f3f9effd700 1 --2- 172.21.15.76:0/1323146961 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5614c8ab53e0 0x5614c8ac1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:53:17.167 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.163+0000 7f3f9ffff700 1 --2- 172.21.15.76:0/1323146961 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5614c8ab62d0 0x5614c8b2fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:53:17.167 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.163+0000 7f3f9f7fe700 1 -- 172.21.15.76:0/1323146961 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5614c8ab62d0 msgr2=0x5614c8b2fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:53:17.167 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.163+0000 7f3f9f7fe700 1 --2- 172.21.15.76:0/1323146961 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5614c8ab62d0 0x5614c8b2fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:17.167 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.163+0000 7f3f9f7fe700 1 -- 172.21.15.76:0/1323146961 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5614c8ab53e0 msgr2=0x5614c8ac1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:53:17.168 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.163+0000 7f3f9f7fe700 1 --2- 172.21.15.76:0/1323146961 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5614c8ab53e0 0x5614c8ac1570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:17.168 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.163+0000 7f3f9f7fe700 1 -- 172.21.15.76:0/1323146961 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f900098e0 con 0x5614c8ab4a80 2024-06-02T04:53:17.168 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.163+0000 7f3f9effd700 1 --2- 172.21.15.76:0/1323146961 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5614c8ab53e0 0x5614c8ac1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T04:53:17.168 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.163+0000 7f3f9f7fe700 1 --2- 172.21.15.76:0/1323146961 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5614c8ab4a80 0x5614c8ac1030 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f3f90011720 tx=0x7f3f90009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ebf2f6eb88bf177 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:53:17.168 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.163+0000 7f3f7effd700 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-06-02T04:53:17.168 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.163+0000 7f3f7effd700 1 -- 172.21.15.76:0/1323146961 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f900050b0 con 0x5614c8ab4a80 2024-06-02T04:53:17.168 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.163+0000 7f3f7effd700 1 -- 172.21.15.76:0/1323146961 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f3f9002a070 con 0x5614c8ab4a80 2024-06-02T04:53:17.168 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.163+0000 7f3fb21b9b80 1 -- 172.21.15.76:0/1323146961 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3f90011e10 con 0x5614c8ab4a80 2024-06-02T04:53:17.168 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.164+0000 7f3f7effd700 1 -- 172.21.15.76:0/1323146961 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3f90005210 con 0x5614c8ab4a80 2024-06-02T04:53:17.168 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.164+0000 7f3fb21b9b80 10 client.16035 fetch_fsmap learned FSMap version 31 2024-06-02T04:53:17.168 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.164+0000 7f3fb21b9b80 1 -- 172.21.15.76:0/1323146961 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x5614c89cb500 con 0x5614c8ab4a80 2024-06-02T04:53:17.168 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.164+0000 7f3f7effd700 1 -- 172.21.15.76:0/1323146961 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3f90011e10 con 0x5614c8ab4a80 2024-06-02T04:53:17.168 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.164+0000 7f3f7effd700 1 -- 172.21.15.76:0/1323146961 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 31) v1 ==== 7474+0+0 (secure 0 0 0) 0x7f3f900037a0 con 0x5614c8ab4a80 2024-06-02T04:53:17.169 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.165+0000 7f3fb21b9b80 10 client.16035 fetch_fsmap finished waiting for FSMap version 31 2024-06-02T04:53:17.169 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.165+0000 7f3fb21b9b80 10 client.16035 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T04:53:17.169 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.165+0000 7f3fb21b9b80 20 client.16035 populate_metadata read hostname 'smithi076' 2024-06-02T04:53:17.169 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.165+0000 7f3fb21b9b80 1 --2- 172.21.15.76:0/1323146961 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5614c8b31cf0 0x5614c8b34110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:53:17.169 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.165+0000 7f3fb21b9b80 4 client.16035 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T04:53:17.169 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.165+0000 7f3fb21b9b80 1 -- 172.21.15.76:0/1323146961 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5614c89fde60 con 0x5614c8b31cf0 2024-06-02T04:53:17.169 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.165+0000 7f3f9effd700 1 --2- 172.21.15.76:0/1323146961 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5614c8b31cf0 0x5614c8b34110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:53:17.170 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.166+0000 7f3f7effd700 10 client.16035 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:53:17.170 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.166+0000 7f3f9effd700 1 --2- 172.21.15.76:0/1323146961 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5614c8b31cf0 0x5614c8b34110 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=334cd938275f2a1b server_cookie=ff189b7754aeeed8 in_seq=0 out_seq=0 2024-06-02T04:53:17.190 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.189+0000 7f3f7effd700 1 -- 172.21.15.76:0/1323146961 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5614c89fde60 con 0x5614c8b31cf0 2024-06-02T04:53:17.190 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.189+0000 7f3f7effd700 10 client.16035 handle_command_reply: tid=0 2024-06-02T04:53:17.190 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.189+0000 7f3fb21b9b80 1 client.16035 shutdown 2024-06-02T04:53:17.190 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.190+0000 7f3fb21b9b80 1 -- 172.21.15.76:0/1323146961 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5614c8ab4a80 msgr2=0x5614c8ac1030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:53:17.190 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.190+0000 7f3fb21b9b80 1 --2- 172.21.15.76:0/1323146961 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5614c8ab4a80 0x5614c8ac1030 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f3f90011720 tx=0x7f3f90009f90 comp rx=0 tx=0).stop 2024-06-02T04:53:17.190 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.190+0000 7f3fb21b9b80 1 -- 172.21.15.76:0/1323146961 shutdown_connections 2024-06-02T04:53:17.191 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.190+0000 7f3fb21b9b80 1 --2- 172.21.15.76:0/1323146961 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5614c8b31cf0 0x5614c8b34110 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:17.191 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.190+0000 7f3fb21b9b80 1 --2- 172.21.15.76:0/1323146961 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5614c8ab62d0 0x5614c8b2fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:17.191 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.190+0000 7f3fb21b9b80 1 --2- 172.21.15.76:0/1323146961 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5614c8ab4a80 0x5614c8ac1030 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:17.191 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.190+0000 7f3f7effd700 0 client.16035 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:53:17.191 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.190+0000 7f3fb21b9b80 1 --2- 172.21.15.76:0/1323146961 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5614c8ab53e0 0x5614c8ac1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:17.191 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.190+0000 7f3fb21b9b80 1 -- 172.21.15.76:0/1323146961 >> 172.21.15.76:0/1323146961 conn(0x5614c8a131b0 msgr2=0x5614c8ab1020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:53:17.192 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.190+0000 7f3fb21b9b80 1 -- 172.21.15.76:0/1323146961 shutdown_connections 2024-06-02T04:53:17.192 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.190+0000 7f3fb21b9b80 1 -- 172.21.15.76:0/1323146961 wait complete. 2024-06-02T04:53:17.193 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.190+0000 7f3fb21b9b80 20 client.16035 trim_cache size 0 max 16384 2024-06-02T04:53:17.193 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:{ 2024-06-02T04:53:17.193 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "message": "", 2024-06-02T04:53:17.193 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "return_code": 0 2024-06-02T04:53:17.193 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:} 2024-06-02T04:53:17.194 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.191+0000 7f3fa5ffe700 1 -- 172.21.15.76:0/1827813015 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f3f880a11a0 msgr2=0x7f3f880a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:53:17.195 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.191+0000 7f3fa5ffe700 1 --2- 172.21.15.76:0/1827813015 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f3f880a11a0 0x7f3f880a3660 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x5614c8ab5ab0 tx=0x7f3f9401a040 comp rx=0 tx=0).stop 2024-06-02T04:53:17.195 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.191+0000 7f3fa5ffe700 1 -- 172.21.15.76:0/1827813015 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3fa0109350 msgr2=0x7f3fa007fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:53:17.195 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.191+0000 7f3fa5ffe700 1 --2- 172.21.15.76:0/1827813015 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3fa0109350 0x7f3fa007fbd0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3f9800ef30 tx=0x7f3f9800c3a0 comp rx=0 tx=0).stop 2024-06-02T04:53:17.195 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.191+0000 7f3fa5ffe700 1 -- 172.21.15.76:0/1827813015 shutdown_connections 2024-06-02T04:53:17.195 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.191+0000 7f3fa5ffe700 1 --2- 172.21.15.76:0/1827813015 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f3f880a11a0 0x7f3f880a3660 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:17.195 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.191+0000 7f3fa5ffe700 1 --2- 172.21.15.76:0/1827813015 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3fa0109350 0x7f3fa007fbd0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:17.195 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.191+0000 7f3fa5ffe700 1 --2- 172.21.15.76:0/1827813015 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3fa0107fa0 0x7f3fa0074d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:17.195 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.191+0000 7f3fa5ffe700 1 --2- 172.21.15.76:0/1827813015 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3fa0108940 0x7f3fa007d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:17.196 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.191+0000 7f3fa5ffe700 1 -- 172.21.15.76:0/1827813015 >> 172.21.15.76:0/1827813015 conn(0x7f3fa006df30 msgr2=0x7f3fa0070440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:53:17.196 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.191+0000 7f3fa5ffe700 1 -- 172.21.15.76:0/1827813015 shutdown_connections 2024-06-02T04:53:17.196 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:17.191+0000 7f3fa5ffe700 1 -- 172.21.15.76:0/1827813015 wait complete. 2024-06-02T04:53:17.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:53:17 smithi119 ceph-mon[46633]: pgmap v379: 129 pgs: 129 active+clean; 1.5 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 12 MiB/s wr, 1.12k op/s 2024-06-02T04:53:17.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:53:17 smithi192 ceph-mon[47933]: pgmap v379: 129 pgs: 129 active+clean; 1.5 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 12 MiB/s wr, 1.12k op/s 2024-06-02T04:53:17.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:53:17 smithi076 ceph-mon[42935]: pgmap v379: 129 pgs: 129 active+clean; 1.5 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 12 MiB/s wr, 1.12k op/s 2024-06-02T04:53:19.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:53:19 smithi119 ceph-mon[46633]: pgmap v380: 129 pgs: 129 active+clean; 1.5 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 11 MiB/s wr, 993 op/s 2024-06-02T04:53:19.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:53:19 smithi192 ceph-mon[47933]: pgmap v380: 129 pgs: 129 active+clean; 1.5 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 11 MiB/s wr, 993 op/s 2024-06-02T04:53:19.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:53:19 smithi076 ceph-mon[42935]: pgmap v380: 129 pgs: 129 active+clean; 1.5 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 11 MiB/s wr, 993 op/s 2024-06-02T04:53:21.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 150.0 s, 997.6 tps, lat 100.391 ms stddev 34.310 2024-06-02T04:53:21.683 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:53:21 smithi192 ceph-mon[47933]: pgmap v381: 129 pgs: 129 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 9.9 MiB/s wr, 913 op/s 2024-06-02T04:53:21.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:53:21 smithi076 ceph-mon[42935]: pgmap v381: 129 pgs: 129 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 9.9 MiB/s wr, 913 op/s 2024-06-02T04:53:21.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:53:21 smithi119 ceph-mon[46633]: pgmap v381: 129 pgs: 129 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 9.9 MiB/s wr, 913 op/s 2024-06-02T04:53:23.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:53:23 smithi192 ceph-mon[47933]: pgmap v382: 129 pgs: 129 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 11 MiB/s wr, 1.09k op/s 2024-06-02T04:53:23.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:53:23 smithi076 ceph-mon[42935]: pgmap v382: 129 pgs: 129 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 11 MiB/s wr, 1.09k op/s 2024-06-02T04:53:23.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:53:23 smithi119 ceph-mon[46633]: pgmap v382: 129 pgs: 129 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 11 MiB/s wr, 1.09k op/s 2024-06-02T04:53:25.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:53:25 smithi192 ceph-mon[47933]: pgmap v383: 129 pgs: 129 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 10 MiB/s wr, 914 op/s 2024-06-02T04:53:25.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:53:25 smithi076 ceph-mon[42935]: pgmap v383: 129 pgs: 129 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 10 MiB/s wr, 914 op/s 2024-06-02T04:53:25.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:53:25 smithi119 ceph-mon[46633]: pgmap v383: 129 pgs: 129 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 10 MiB/s wr, 914 op/s 2024-06-02T04:53:26.314 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 155.0 s, 952.2 tps, lat 105.524 ms stddev 35.582 2024-06-02T04:53:27.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:53:27 smithi192 ceph-mon[47933]: pgmap v384: 129 pgs: 129 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 11 MiB/s wr, 1.09k op/s 2024-06-02T04:53:27.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:53:27 smithi076 ceph-mon[42935]: pgmap v384: 129 pgs: 129 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 11 MiB/s wr, 1.09k op/s 2024-06-02T04:53:27.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:53:27 smithi119 ceph-mon[46633]: pgmap v384: 129 pgs: 129 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 11 MiB/s wr, 1.09k op/s 2024-06-02T04:53:29.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:53:29 smithi192 ceph-mon[47933]: pgmap v385: 129 pgs: 129 active+clean; 1.5 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 11 MiB/s wr, 1.03k op/s 2024-06-02T04:53:29.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:53:29 smithi076 ceph-mon[42935]: pgmap v385: 129 pgs: 129 active+clean; 1.5 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 11 MiB/s wr, 1.03k op/s 2024-06-02T04:53:29.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:53:29 smithi119 ceph-mon[46633]: pgmap v385: 129 pgs: 129 active+clean; 1.5 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 11 MiB/s wr, 1.03k op/s 2024-06-02T04:53:30.368 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.367+0000 7f71c1300700 1 -- 172.21.15.76:0/86338229 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71bc10a910 msgr2=0x7f71bc10cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:53:30.368 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.367+0000 7f71c1300700 1 --2- 172.21.15.76:0/86338229 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71bc10a910 0x7f71bc10cda0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f71ac009990 tx=0x7f71ac009ca0 comp rx=0 tx=0).stop 2024-06-02T04:53:30.368 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.367+0000 7f71c1300700 1 -- 172.21.15.76:0/86338229 shutdown_connections 2024-06-02T04:53:30.369 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.367+0000 7f71c1300700 1 --2- 172.21.15.76:0/86338229 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71bc10d2e0 0x7f71bc10d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:30.369 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.367+0000 7f71c1300700 1 --2- 172.21.15.76:0/86338229 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f71bc107fa0 0x7f71bc10a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:30.369 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.367+0000 7f71c1300700 1 --2- 172.21.15.76:0/86338229 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71bc10a910 0x7f71bc10cda0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:30.369 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.367+0000 7f71c1300700 1 -- 172.21.15.76:0/86338229 >> 172.21.15.76:0/86338229 conn(0x7f71bc06df30 msgr2=0x7f71bc070370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:53:30.369 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.367+0000 7f71c1300700 1 -- 172.21.15.76:0/86338229 shutdown_connections 2024-06-02T04:53:30.369 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.367+0000 7f71c1300700 1 -- 172.21.15.76:0/86338229 wait complete. 2024-06-02T04:53:30.369 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.368+0000 7f71c1300700 1 Processor -- start 2024-06-02T04:53:30.370 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.368+0000 7f71c1300700 1 -- start start 2024-06-02T04:53:30.370 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.368+0000 7f71c1300700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71bc107fa0 0x7f71bc1a5d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:53:30.371 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.368+0000 7f71c1300700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f71bc10a910 0x7f71bc1a6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:53:30.371 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.368+0000 7f71c1300700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71bc10d2e0 0x7f71bc1ad220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:53:30.371 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.368+0000 7f71c1300700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71bc1ad7f0 con 0x7f71bc10a910 2024-06-02T04:53:30.371 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.368+0000 7f71c1300700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71bc1ad960 con 0x7f71bc107fa0 2024-06-02T04:53:30.371 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.368+0000 7f71c1300700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71bc1adb20 con 0x7f71bc10d2e0 2024-06-02T04:53:30.371 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.369+0000 7f71ba7fc700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f71bc10a910 0x7f71bc1a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:53:30.371 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.369+0000 7f71ba7fc700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f71bc10a910 0x7f71bc1a6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:34990/0 (socket says 172.21.15.76:34990) 2024-06-02T04:53:30.371 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.369+0000 7f71ba7fc700 1 -- 172.21.15.76:0/3833774438 learned_addr learned my addr 172.21.15.76:0/3833774438 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:53:30.371 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.369+0000 7f71baffd700 1 --2- 172.21.15.76:0/3833774438 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71bc107fa0 0x7f71bc1a5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:53:30.371 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.369+0000 7f71bb7fe700 1 --2- 172.21.15.76:0/3833774438 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71bc10d2e0 0x7f71bc1ad220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:53:30.371 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.369+0000 7f71baffd700 1 -- 172.21.15.76:0/3833774438 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71bc10d2e0 msgr2=0x7f71bc1ad220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:53:30.371 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.369+0000 7f71baffd700 1 --2- 172.21.15.76:0/3833774438 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71bc10d2e0 0x7f71bc1ad220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:30.372 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.369+0000 7f71baffd700 1 -- 172.21.15.76:0/3833774438 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f71bc10a910 msgr2=0x7f71bc1a6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:53:30.372 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.369+0000 7f71baffd700 1 --2- 172.21.15.76:0/3833774438 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f71bc10a910 0x7f71bc1a6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:30.372 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.369+0000 7f71baffd700 1 -- 172.21.15.76:0/3833774438 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71ac0095f0 con 0x7f71bc107fa0 2024-06-02T04:53:30.372 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.369+0000 7f71bb7fe700 1 --2- 172.21.15.76:0/3833774438 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71bc10d2e0 0x7f71bc1ad220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T04:53:30.372 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.369+0000 7f71baffd700 1 --2- 172.21.15.76:0/3833774438 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71bc107fa0 0x7f71bc1a5d20 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f71b400bd70 tx=0x7f71b400bda0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:53:30.372 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.372+0000 7f71a3fff700 1 -- 172.21.15.76:0/3833774438 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b400cc10 con 0x7f71bc107fa0 2024-06-02T04:53:30.372 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.372+0000 7f71a3fff700 1 -- 172.21.15.76:0/3833774438 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f71b400cd70 con 0x7f71bc107fa0 2024-06-02T04:53:30.373 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.372+0000 7f71a3fff700 1 -- 172.21.15.76:0/3833774438 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b40125c0 con 0x7f71bc107fa0 2024-06-02T04:53:30.373 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.372+0000 7f71c1300700 1 -- 172.21.15.76:0/3833774438 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71bc1ade00 con 0x7f71bc107fa0 2024-06-02T04:53:30.374 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.372+0000 7f71c1300700 1 -- 172.21.15.76:0/3833774438 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71bc1ae1d0 con 0x7f71bc107fa0 2024-06-02T04:53:30.376 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.375+0000 7f71a3fff700 1 -- 172.21.15.76:0/3833774438 <== mon.2 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f71b4014440 con 0x7f71bc107fa0 2024-06-02T04:53:30.379 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.377+0000 7f71cd4bbb80 1 Processor -- start 2024-06-02T04:53:30.379 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.377+0000 7f71a3fff700 1 --2- 172.21.15.76:0/3833774438 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f71a40a12f0 0x7f71a40a37b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:53:30.379 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.378+0000 7f71a3fff700 1 -- 172.21.15.76:0/3833774438 <== mon.2 v2:172.21.15.119:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f71b4006e40 con 0x7f71bc107fa0 2024-06-02T04:53:30.380 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.379+0000 7f71cd4bbb80 1 -- start start 2024-06-02T04:53:30.380 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.379+0000 7f71cd4bbb80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561c59489a80 0x561c59489ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:53:30.380 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.379+0000 7f71cd4bbb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561c5948a3e0 0x561c5948acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:53:30.380 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.379+0000 7f71cd4bbb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561c5948b2d0 0x561c5948b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:53:30.380 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.379+0000 7f71cd4bbb80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c593e10f0 con 0x561c59489a80 2024-06-02T04:53:30.380 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.379+0000 7f71cd4bbb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c593deab0 con 0x561c5948a3e0 2024-06-02T04:53:30.380 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.379+0000 7f71cd4bbb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c593da3a0 con 0x561c5948b2d0 2024-06-02T04:53:30.381 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.381+0000 7f71ba7fc700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561c5948a3e0 0x561c5948acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:53:30.381 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.381+0000 7f71baffd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561c59489a80 0x561c59489ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:53:30.381 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.381+0000 7f71baffd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561c59489a80 0x561c59489ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:35006/0 (socket says 172.21.15.76:35006) 2024-06-02T04:53:30.381 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.381+0000 7f71baffd700 1 -- 172.21.15.76:0/3696761977 learned_addr learned my addr 172.21.15.76:0/3696761977 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:53:30.382 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.381+0000 7f71baffd700 1 -- 172.21.15.76:0/3696761977 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561c5948b2d0 msgr2=0x561c5948b750 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-02T04:53:30.382 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.381+0000 7f71baffd700 1 --2- 172.21.15.76:0/3696761977 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561c5948b2d0 0x561c5948b750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:30.382 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.381+0000 7f71baffd700 1 -- 172.21.15.76:0/3696761977 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561c5948a3e0 msgr2=0x561c5948acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:53:30.382 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.381+0000 7f71baffd700 1 --2- 172.21.15.76:0/3696761977 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561c5948a3e0 0x561c5948acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:30.382 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.381+0000 7f71baffd700 1 -- 172.21.15.76:0/3696761977 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561c5925b350 con 0x561c59489a80 2024-06-02T04:53:30.382 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.381+0000 7f71baffd700 1 --2- 172.21.15.76:0/3696761977 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561c59489a80 0x561c59489ea0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f71b4095a00 tx=0x7f71b4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92543622e40df0c2 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:53:30.383 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.381+0000 7f71bb7fe700 1 --2- 172.21.15.76:0/3833774438 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f71a40a12f0 0x7f71a40a37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:53:30.383 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.382+0000 7f71a17fa700 1 -- 172.21.15.76:0/3696761977 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b409d120 con 0x561c59489a80 2024-06-02T04:53:30.383 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.382+0000 7f71a17fa700 1 -- 172.21.15.76:0/3696761977 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f71b4099500 con 0x561c59489a80 2024-06-02T04:53:30.383 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.382+0000 7f71a17fa700 1 -- 172.21.15.76:0/3696761977 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b4099760 con 0x561c59489a80 2024-06-02T04:53:30.384 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.383+0000 7f71cd4bbb80 1 -- 172.21.15.76:0/3696761977 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561c59489a80 msgr2=0x561c59489ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:53:30.384 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.383+0000 7f71bb7fe700 1 --2- 172.21.15.76:0/3833774438 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f71a40a12f0 0x7f71a40a37b0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x561c5948aab0 tx=0x7f71b00090e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:53:30.384 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.383+0000 7f71cd4bbb80 1 --2- 172.21.15.76:0/3696761977 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561c59489a80 0x561c59489ea0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f71b4095a00 tx=0x7f71b4004ad0 comp rx=0 tx=0).stop 2024-06-02T04:53:30.384 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.383+0000 7f71cd4bbb80 1 -- 172.21.15.76:0/3696761977 shutdown_connections 2024-06-02T04:53:30.384 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.383+0000 7f71cd4bbb80 1 --2- 172.21.15.76:0/3696761977 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561c5948b2d0 0x561c5948b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:30.384 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.383+0000 7f71cd4bbb80 1 --2- 172.21.15.76:0/3696761977 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561c59489a80 0x561c59489ea0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:30.384 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.383+0000 7f71cd4bbb80 1 --2- 172.21.15.76:0/3696761977 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561c5948a3e0 0x561c5948acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:30.384 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.383+0000 7f71cd4bbb80 1 -- 172.21.15.76:0/3696761977 >> 172.21.15.76:0/3696761977 conn(0x561c593e81b0 msgr2=0x561c59486440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:53:30.384 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.383+0000 7f71cd4bbb80 1 -- 172.21.15.76:0/3696761977 shutdown_connections 2024-06-02T04:53:30.384 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.383+0000 7f71cd4bbb80 1 -- 172.21.15.76:0/3696761977 wait complete. 2024-06-02T04:53:30.385 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.383+0000 7f71cd4bbb80 1 -- start start 2024-06-02T04:53:30.386 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.384+0000 7f71cd4bbb80 1 Processor -- start 2024-06-02T04:53:30.386 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.384+0000 7f71cd4bbb80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561c59489a80 0x561c594a47b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:53:30.386 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.384+0000 7f71cd4bbb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561c5948a3e0 0x561c594a4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:53:30.386 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.384+0000 7f71cd4bbb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561c5948b2d0 0x561c594abd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:53:30.386 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.384+0000 7f71cd4bbb80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c59376500 con 0x561c59489a80 2024-06-02T04:53:30.386 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.384+0000 7f71cd4bbb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c593761a0 con 0x561c5948b2d0 2024-06-02T04:53:30.386 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.384+0000 7f71cd4bbb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c5925d640 con 0x561c5948a3e0 2024-06-02T04:53:30.386 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.384+0000 7f71cd4bbb80 10 client.0 _ll_register_callbacks cb 0x561c5937fad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:53:30.386 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.385+0000 7f71ba7fc700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561c5948a3e0 0x561c594a4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:53:30.386 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.385+0000 7f71ba7fc700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561c5948a3e0 0x561c594a4cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:33964/0 (socket says 172.21.15.76:33964) 2024-06-02T04:53:30.386 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.385+0000 7f71ba7fc700 1 -- 172.21.15.76:0/3097996518 learned_addr learned my addr 172.21.15.76:0/3097996518 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:53:30.387 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.385+0000 7f71baffd700 1 --2- 172.21.15.76:0/3097996518 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561c59489a80 0x561c594a47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:53:30.387 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.385+0000 7f71bb7fe700 1 --2- 172.21.15.76:0/3097996518 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561c5948b2d0 0x561c594abd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:53:30.387 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.385+0000 7f71ba7fc700 1 -- 172.21.15.76:0/3097996518 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561c5948b2d0 msgr2=0x561c594abd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:53:30.387 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.385+0000 7f71ba7fc700 1 --2- 172.21.15.76:0/3097996518 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561c5948b2d0 0x561c594abd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:30.387 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.385+0000 7f71ba7fc700 1 -- 172.21.15.76:0/3097996518 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561c59489a80 msgr2=0x561c594a47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:53:30.387 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.385+0000 7f71ba7fc700 1 --2- 172.21.15.76:0/3097996518 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561c59489a80 0x561c594a47b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:30.387 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.385+0000 7f71ba7fc700 1 -- 172.21.15.76:0/3097996518 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71bc1ae1d0 con 0x561c5948a3e0 2024-06-02T04:53:30.388 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.388+0000 7f71ba7fc700 1 --2- 172.21.15.76:0/3097996518 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561c5948a3e0 0x561c594a4cf0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f71ac005270 tx=0x7f71ac0052a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1f404a47ee98b285 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:53:30.388 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.388+0000 7f719eff5700 10 client.0 ms_handle_connect on v2:172.21.15.192:3300/0 2024-06-02T04:53:30.388 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.388+0000 7f719eff5700 1 -- 172.21.15.76:0/3097996518 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71ac01d040 con 0x561c5948a3e0 2024-06-02T04:53:30.389 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.388+0000 7f719eff5700 1 -- 172.21.15.76:0/3097996518 <== mon.1 v2:172.21.15.192:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f71ac004700 con 0x561c5948a3e0 2024-06-02T04:53:30.389 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.388+0000 7f71cd4bbb80 1 -- 172.21.15.76:0/3097996518 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561c59333210 con 0x561c5948a3e0 2024-06-02T04:53:30.392 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.392+0000 7f719eff5700 1 -- 172.21.15.76:0/3097996518 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f71ac00bd80 con 0x561c5948a3e0 2024-06-02T04:53:30.393 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.392+0000 7f71cd4bbb80 10 client.25525 fetch_fsmap learned FSMap version 31 2024-06-02T04:53:30.393 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.392+0000 7f71cd4bbb80 1 -- 172.21.15.76:0/3097996518 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x561c59207b00 con 0x561c5948a3e0 2024-06-02T04:53:30.393 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.393+0000 7f719eff5700 1 -- 172.21.15.76:0/3097996518 <== mon.1 v2:172.21.15.192:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x561c59333210 con 0x561c5948a3e0 2024-06-02T04:53:30.393 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.393+0000 7f719eff5700 1 -- 172.21.15.76:0/3097996518 <== mon.1 v2:172.21.15.192:3300/0 5 ==== fsmap(e 31) v1 ==== 7474+0+0 (secure 0 0 0) 0x7f71ac003c70 con 0x561c5948a3e0 2024-06-02T04:53:30.393 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.393+0000 7f71cd4bbb80 10 client.25525 fetch_fsmap finished waiting for FSMap version 31 2024-06-02T04:53:30.394 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.393+0000 7f71cd4bbb80 10 client.25525 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T04:53:30.394 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.393+0000 7f71cd4bbb80 20 client.25525 populate_metadata read hostname 'smithi076' 2024-06-02T04:53:30.394 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.393+0000 7f71cd4bbb80 1 --2- 172.21.15.76:0/3097996518 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x561c59495e70 0x561c59498290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:53:30.394 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.393+0000 7f71cd4bbb80 4 client.25525 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T04:53:30.394 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.393+0000 7f71cd4bbb80 1 -- 172.21.15.76:0/3097996518 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561c594597b0 con 0x561c59495e70 2024-06-02T04:53:30.395 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.393+0000 7f71baffd700 1 --2- 172.21.15.76:0/3097996518 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x561c59495e70 0x561c59498290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:53:30.395 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.394+0000 7f719eff5700 10 client.25525 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:53:30.395 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.394+0000 7f71baffd700 1 --2- 172.21.15.76:0/3097996518 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x561c59495e70 0x561c59498290 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e2d858f448124d5a server_cookie=8b6f4b37c1ab7f1c in_seq=0 out_seq=0 2024-06-02T04:53:30.395 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.394+0000 7f719eff5700 1 -- 172.21.15.76:0/3097996518 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x561c594597b0 con 0x561c59495e70 2024-06-02T04:53:30.395 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.394+0000 7f719eff5700 10 client.25525 handle_command_reply: tid=0 2024-06-02T04:53:30.395 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.395+0000 7f71cd4bbb80 1 client.25525 shutdown 2024-06-02T04:53:30.395 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.395+0000 7f71cd4bbb80 1 -- 172.21.15.76:0/3097996518 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561c5948a3e0 msgr2=0x561c594a4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:53:30.395 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.395+0000 7f71cd4bbb80 1 --2- 172.21.15.76:0/3097996518 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561c5948a3e0 0x561c594a4cf0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f71ac005270 tx=0x7f71ac0052a0 comp rx=0 tx=0).stop 2024-06-02T04:53:30.396 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.395+0000 7f71cd4bbb80 1 -- 172.21.15.76:0/3097996518 shutdown_connections 2024-06-02T04:53:30.396 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.395+0000 7f71cd4bbb80 1 --2- 172.21.15.76:0/3097996518 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x561c59495e70 0x561c59498290 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:30.396 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.395+0000 7f71cd4bbb80 1 --2- 172.21.15.76:0/3097996518 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561c5948b2d0 0x561c594abd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:30.396 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.395+0000 7f71cd4bbb80 1 --2- 172.21.15.76:0/3097996518 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561c59489a80 0x561c594a47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:30.396 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.395+0000 7f71cd4bbb80 1 --2- 172.21.15.76:0/3097996518 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561c5948a3e0 0x561c594a4cf0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:30.396 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.395+0000 7f719eff5700 0 client.25525 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:53:30.396 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.395+0000 7f71cd4bbb80 1 -- 172.21.15.76:0/3097996518 >> 172.21.15.76:0/3097996518 conn(0x561c593e81b0 msgr2=0x561c59484860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:53:30.397 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.395+0000 7f71cd4bbb80 1 -- 172.21.15.76:0/3097996518 shutdown_connections 2024-06-02T04:53:30.397 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.395+0000 7f71cd4bbb80 1 -- 172.21.15.76:0/3097996518 wait complete. 2024-06-02T04:53:30.399 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.399+0000 7f71cd4bbb80 20 client.25525 trim_cache size 0 max 16384 2024-06-02T04:53:30.420 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.419+0000 7f71cd4bbb80 1 Processor -- start 2024-06-02T04:53:30.420 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.420+0000 7f71cd4bbb80 1 -- start start 2024-06-02T04:53:30.421 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.420+0000 7f71cd4bbb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561c59489a80 0x561c5948b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:53:30.421 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.420+0000 7f71cd4bbb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561c5948a3e0 0x561c594abcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:53:30.421 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.420+0000 7f71cd4bbb80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561c5948b2d0 0x561c5948e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:53:30.421 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.420+0000 7f71cd4bbb80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c59485930 con 0x561c5948b2d0 2024-06-02T04:53:30.421 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.420+0000 7f71cd4bbb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c59489520 con 0x561c5948a3e0 2024-06-02T04:53:30.421 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.420+0000 7f71cd4bbb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c594a5430 con 0x561c59489a80 2024-06-02T04:53:30.421 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.420+0000 7f71bb7fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561c5948b2d0 0x561c5948e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:53:30.421 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.420+0000 7f71ba7fc700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561c5948a3e0 0x561c594abcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:53:30.421 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.420+0000 7f71bb7fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561c5948b2d0 0x561c5948e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:35030/0 (socket says 172.21.15.76:35030) 2024-06-02T04:53:30.421 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.420+0000 7f71baffd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561c59489a80 0x561c5948b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:53:30.422 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.420+0000 7f71ba7fc700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561c5948a3e0 0x561c594abcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:48702/0 (socket says 172.21.15.76:48702) 2024-06-02T04:53:30.422 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.420+0000 7f71bb7fe700 1 -- 172.21.15.76:0/4027960112 learned_addr learned my addr 172.21.15.76:0/4027960112 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:53:30.422 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.420+0000 7f71ba7fc700 1 -- 172.21.15.76:0/4027960112 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561c59489a80 msgr2=0x561c5948b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:53:30.422 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.420+0000 7f71ba7fc700 1 --2- 172.21.15.76:0/4027960112 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561c59489a80 0x561c5948b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:30.422 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.420+0000 7f71ba7fc700 1 -- 172.21.15.76:0/4027960112 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561c5948b2d0 msgr2=0x561c5948e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:53:30.422 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.420+0000 7f71ba7fc700 1 --2- 172.21.15.76:0/4027960112 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561c5948b2d0 0x561c5948e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:30.422 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.420+0000 7f71ba7fc700 1 -- 172.21.15.76:0/4027960112 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561c593a0500 con 0x561c5948a3e0 2024-06-02T04:53:30.422 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.421+0000 7f71ba7fc700 1 --2- 172.21.15.76:0/4027960112 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561c5948a3e0 0x561c594abcf0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f71ac003680 tx=0x7f71ac009ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c06824cee917cd8 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:53:30.423 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.421+0000 7f71a1ffb700 1 -- 172.21.15.76:0/4027960112 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71ac01d040 con 0x561c5948a3e0 2024-06-02T04:53:30.424 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.421+0000 7f71a1ffb700 1 -- 172.21.15.76:0/4027960112 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f71ac01e040 con 0x561c5948a3e0 2024-06-02T04:53:30.424 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.421+0000 7f71a1ffb700 1 -- 172.21.15.76:0/4027960112 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71ac0237b0 con 0x561c5948a3e0 2024-06-02T04:53:30.424 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.422+0000 7f71cd4bbb80 1 -- 172.21.15.76:0/4027960112 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561c5948a3e0 msgr2=0x561c594abcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:53:30.424 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.422+0000 7f71cd4bbb80 1 --2- 172.21.15.76:0/4027960112 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561c5948a3e0 0x561c594abcf0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f71ac003680 tx=0x7f71ac009ca0 comp rx=0 tx=0).stop 2024-06-02T04:53:30.424 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.422+0000 7f71cd4bbb80 1 -- 172.21.15.76:0/4027960112 shutdown_connections 2024-06-02T04:53:30.424 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.422+0000 7f71cd4bbb80 1 --2- 172.21.15.76:0/4027960112 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561c5948b2d0 0x561c5948e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:30.424 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.422+0000 7f71cd4bbb80 1 --2- 172.21.15.76:0/4027960112 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561c59489a80 0x561c5948b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:30.424 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.422+0000 7f71cd4bbb80 1 --2- 172.21.15.76:0/4027960112 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561c5948a3e0 0x561c594abcf0 secure :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f71ac003680 tx=0x7f71ac009ca0 comp rx=0 tx=0).stop 2024-06-02T04:53:30.424 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.422+0000 7f71cd4bbb80 1 -- 172.21.15.76:0/4027960112 >> 172.21.15.76:0/4027960112 conn(0x561c593e81b0 msgr2=0x561c59491830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:53:30.424 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.422+0000 7f71cd4bbb80 1 -- 172.21.15.76:0/4027960112 shutdown_connections 2024-06-02T04:53:30.424 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.422+0000 7f71cd4bbb80 1 -- 172.21.15.76:0/4027960112 wait complete. 2024-06-02T04:53:30.425 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.423+0000 7f71cd4bbb80 1 -- start start 2024-06-02T04:53:30.425 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.423+0000 7f71cd4bbb80 1 Processor -- start 2024-06-02T04:53:30.425 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.423+0000 7f71cd4bbb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561c59489a80 0x561c594a9080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:53:30.425 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.423+0000 7f71cd4bbb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561c5948b2d0 0x561c594a95c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:53:30.426 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.423+0000 7f71cd4bbb80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561c594aa4e0 0x561c594aa960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:53:30.426 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.423+0000 7f71cd4bbb80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c594aaea0 con 0x561c594aa4e0 2024-06-02T04:53:30.426 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.423+0000 7f71cd4bbb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c594ab010 con 0x561c5948b2d0 2024-06-02T04:53:30.426 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.423+0000 7f71cd4bbb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c594ab1d0 con 0x561c59489a80 2024-06-02T04:53:30.426 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.423+0000 7f71cd4bbb80 10 client.0 _ll_register_callbacks cb 0x561c5937fad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:53:30.426 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.423+0000 7f71baffd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561c59489a80 0x561c594a9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:53:30.426 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.423+0000 7f71ba7fc700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561c5948b2d0 0x561c594a95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:53:30.426 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.423+0000 7f71ba7fc700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561c5948b2d0 0x561c594a95c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:48716/0 (socket says 172.21.15.76:48716) 2024-06-02T04:53:30.426 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.423+0000 7f71baffd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561c59489a80 0x561c594a9080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:33984/0 (socket says 172.21.15.76:33984) 2024-06-02T04:53:30.426 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.423+0000 7f71ba7fc700 1 -- 172.21.15.76:0/368636070 learned_addr learned my addr 172.21.15.76:0/368636070 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:53:30.427 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.424+0000 7f71ba7fc700 1 -- 172.21.15.76:0/368636070 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561c59489a80 msgr2=0x561c594a9080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:53:30.428 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.424+0000 7f71ba7fc700 1 --2- 172.21.15.76:0/368636070 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561c59489a80 0x561c594a9080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:30.428 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.424+0000 7f71ba7fc700 1 -- 172.21.15.76:0/368636070 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561c594aa4e0 msgr2=0x561c594aa960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:53:30.428 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.424+0000 7f71ba7fc700 1 --2- 172.21.15.76:0/368636070 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561c594aa4e0 0x561c594aa960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:30.428 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.424+0000 7f71ba7fc700 1 -- 172.21.15.76:0/368636070 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561c59207b00 con 0x561c5948b2d0 2024-06-02T04:53:30.428 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.424+0000 7f71ba7fc700 1 --2- 172.21.15.76:0/368636070 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561c5948b2d0 0x561c594a95c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f71ac037040 tx=0x7f71ac005f00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e1b2361b6f3d146 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:53:30.428 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.424+0000 7f719eff5700 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-06-02T04:53:30.428 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.425+0000 7f719eff5700 1 -- 172.21.15.76:0/368636070 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71ac01d040 con 0x561c5948b2d0 2024-06-02T04:53:30.428 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.425+0000 7f71cd4bbb80 1 -- 172.21.15.76:0/368636070 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f71b4099500 con 0x561c5948b2d0 2024-06-02T04:53:30.428 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.425+0000 7f719eff5700 1 -- 172.21.15.76:0/368636070 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f71ac000e40 con 0x561c5948b2d0 2024-06-02T04:53:30.428 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.425+0000 7f719eff5700 1 -- 172.21.15.76:0/368636070 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f71ac00b5f0 con 0x561c5948b2d0 2024-06-02T04:53:30.428 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.425+0000 7f71cd4bbb80 10 client.25586 fetch_fsmap learned FSMap version 31 2024-06-02T04:53:30.428 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.426+0000 7f71cd4bbb80 1 -- 172.21.15.76:0/368636070 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x561c5925fc70 con 0x561c5948b2d0 2024-06-02T04:53:30.428 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.426+0000 7f719eff5700 1 -- 172.21.15.76:0/368636070 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f71ac047080 con 0x561c5948b2d0 2024-06-02T04:53:30.429 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.426+0000 7f719eff5700 1 -- 172.21.15.76:0/368636070 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 31) v1 ==== 7474+0+0 (secure 0 0 0) 0x7f71ac02c070 con 0x561c5948b2d0 2024-06-02T04:53:30.429 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.427+0000 7f71cd4bbb80 10 client.25586 fetch_fsmap finished waiting for FSMap version 31 2024-06-02T04:53:30.429 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.427+0000 7f71cd4bbb80 10 client.25586 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T04:53:30.429 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.427+0000 7f71cd4bbb80 20 client.25586 populate_metadata read hostname 'smithi076' 2024-06-02T04:53:30.429 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.427+0000 7f71cd4bbb80 1 --2- 172.21.15.76:0/368636070 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x561c595180c0 0x561c5951a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:53:30.429 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.427+0000 7f71cd4bbb80 4 client.25586 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T04:53:30.429 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.427+0000 7f71cd4bbb80 1 -- 172.21.15.76:0/368636070 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x561c593d2e60 con 0x561c595180c0 2024-06-02T04:53:30.429 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.427+0000 7f71baffd700 1 --2- 172.21.15.76:0/368636070 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x561c595180c0 0x561c5951a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:53:30.429 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.429+0000 7f71baffd700 1 --2- 172.21.15.76:0/368636070 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x561c595180c0 0x561c5951a4b0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f6e1ee08fa2138fa server_cookie=886af6d32b3ba977 in_seq=0 out_seq=0 2024-06-02T04:53:30.429 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.429+0000 7f719eff5700 10 client.25586 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:53:30.450 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.449+0000 7f719eff5700 1 -- 172.21.15.76:0/368636070 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x561c593d2e60 con 0x561c595180c0 2024-06-02T04:53:30.450 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.449+0000 7f719eff5700 10 client.25586 handle_command_reply: tid=0 2024-06-02T04:53:30.450 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.449+0000 7f71cd4bbb80 1 client.25586 shutdown 2024-06-02T04:53:30.450 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.449+0000 7f71cd4bbb80 1 -- 172.21.15.76:0/368636070 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561c5948b2d0 msgr2=0x561c594a95c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:53:30.450 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.449+0000 7f71cd4bbb80 1 --2- 172.21.15.76:0/368636070 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561c5948b2d0 0x561c594a95c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f71ac037040 tx=0x7f71ac005f00 comp rx=0 tx=0).stop 2024-06-02T04:53:30.450 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.449+0000 7f71cd4bbb80 1 -- 172.21.15.76:0/368636070 shutdown_connections 2024-06-02T04:53:30.450 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.449+0000 7f71cd4bbb80 1 --2- 172.21.15.76:0/368636070 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x561c595180c0 0x561c5951a4b0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:30.450 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.449+0000 7f71cd4bbb80 1 --2- 172.21.15.76:0/368636070 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561c594aa4e0 0x561c594aa960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:30.450 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.449+0000 7f71cd4bbb80 1 --2- 172.21.15.76:0/368636070 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561c59489a80 0x561c594a9080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:30.451 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.449+0000 7f71cd4bbb80 1 --2- 172.21.15.76:0/368636070 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561c5948b2d0 0x561c594a95c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:30.451 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.449+0000 7f71cd4bbb80 1 -- 172.21.15.76:0/368636070 >> 172.21.15.76:0/368636070 conn(0x561c593e81b0 msgr2=0x561c5948e510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:53:30.451 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.449+0000 7f719eff5700 0 client.25586 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:53:30.451 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.449+0000 7f71cd4bbb80 1 -- 172.21.15.76:0/368636070 shutdown_connections 2024-06-02T04:53:30.451 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.449+0000 7f71cd4bbb80 1 -- 172.21.15.76:0/368636070 wait complete. 2024-06-02T04:53:30.451 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.451+0000 7f71cd4bbb80 20 client.25586 trim_cache size 0 max 16384 2024-06-02T04:53:30.451 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:{ 2024-06-02T04:53:30.452 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "message": "", 2024-06-02T04:53:30.452 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "return_code": 0 2024-06-02T04:53:30.452 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:} 2024-06-02T04:53:30.452 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.451+0000 7f71c1300700 1 -- 172.21.15.76:0/3833774438 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f71a40a12f0 msgr2=0x7f71a40a37b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:53:30.452 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.451+0000 7f71c1300700 1 --2- 172.21.15.76:0/3833774438 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f71a40a12f0 0x7f71a40a37b0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x561c5948aab0 tx=0x7f71b00090e0 comp rx=0 tx=0).stop 2024-06-02T04:53:30.452 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.451+0000 7f71c1300700 1 -- 172.21.15.76:0/3833774438 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71bc107fa0 msgr2=0x7f71bc1a5d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:53:30.452 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.451+0000 7f71c1300700 1 --2- 172.21.15.76:0/3833774438 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71bc107fa0 0x7f71bc1a5d20 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f71b400bd70 tx=0x7f71b400bda0 comp rx=0 tx=0).stop 2024-06-02T04:53:30.452 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.451+0000 7f71c1300700 1 -- 172.21.15.76:0/3833774438 shutdown_connections 2024-06-02T04:53:30.453 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.451+0000 7f71c1300700 1 --2- 172.21.15.76:0/3833774438 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71bc10d2e0 0x7f71bc1ad220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:30.453 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.451+0000 7f71c1300700 1 --2- 172.21.15.76:0/3833774438 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f71a40a12f0 0x7f71a40a37b0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:30.453 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.451+0000 7f71c1300700 1 --2- 172.21.15.76:0/3833774438 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71bc107fa0 0x7f71bc1a5d20 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:30.453 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.451+0000 7f71c1300700 1 --2- 172.21.15.76:0/3833774438 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f71bc10a910 0x7f71bc1a6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:30.453 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.451+0000 7f71c1300700 1 -- 172.21.15.76:0/3833774438 >> 172.21.15.76:0/3833774438 conn(0x7f71bc06df30 msgr2=0x7f71bc1083c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:53:30.454 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.454+0000 7f71c1300700 1 -- 172.21.15.76:0/3833774438 shutdown_connections 2024-06-02T04:53:30.454 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:30.454+0000 7f71c1300700 1 -- 172.21.15.76:0/3833774438 wait complete. 2024-06-02T04:53:31.314 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 160.0 s, 907.6 tps, lat 109.581 ms stddev 35.612 2024-06-02T04:53:31.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:53:31 smithi192 ceph-mon[47933]: pgmap v386: 129 pgs: 129 active+clean; 1.5 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 9.9 MiB/s wr, 950 op/s 2024-06-02T04:53:31.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:53:31 smithi076 ceph-mon[42935]: pgmap v386: 129 pgs: 129 active+clean; 1.5 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 9.9 MiB/s wr, 950 op/s 2024-06-02T04:53:31.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:53:31 smithi119 ceph-mon[46633]: pgmap v386: 129 pgs: 129 active+clean; 1.5 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 9.9 MiB/s wr, 950 op/s 2024-06-02T04:53:33.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:53:33 smithi192 ceph-mon[47933]: pgmap v387: 129 pgs: 129 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 12 MiB/s wr, 1.14k op/s 2024-06-02T04:53:33.737 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:53:33 smithi076 ceph-mon[42935]: pgmap v387: 129 pgs: 129 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 12 MiB/s wr, 1.14k op/s 2024-06-02T04:53:33.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:53:33 smithi119 ceph-mon[46633]: pgmap v387: 129 pgs: 129 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 12 MiB/s wr, 1.14k op/s 2024-06-02T04:53:35.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:53:35 smithi192 ceph-mon[47933]: pgmap v388: 129 pgs: 129 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 10 MiB/s wr, 922 op/s 2024-06-02T04:53:35.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:53:35 smithi076 ceph-mon[42935]: pgmap v388: 129 pgs: 129 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 10 MiB/s wr, 922 op/s 2024-06-02T04:53:35.847 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:53:35 smithi119 ceph-mon[46633]: pgmap v388: 129 pgs: 129 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 10 MiB/s wr, 922 op/s 2024-06-02T04:53:36.314 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 165.0 s, 928.6 tps, lat 107.727 ms stddev 34.955 2024-06-02T04:53:37.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:53:37 smithi192 ceph-mon[47933]: pgmap v389: 129 pgs: 129 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 11 MiB/s wr, 1.07k op/s 2024-06-02T04:53:37.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:53:37 smithi076 ceph-mon[42935]: pgmap v389: 129 pgs: 129 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 11 MiB/s wr, 1.07k op/s 2024-06-02T04:53:37.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:53:37 smithi119 ceph-mon[46633]: pgmap v389: 129 pgs: 129 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 11 MiB/s wr, 1.07k op/s 2024-06-02T04:53:38.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:53:38 smithi192 ceph-mon[47933]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-06-02T04:53:38.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:53:38 smithi076 ceph-mon[42935]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-06-02T04:53:38.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:53:38 smithi119 ceph-mon[46633]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-06-02T04:53:39.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:53:39 smithi192 ceph-mon[47933]: pgmap v390: 129 pgs: 129 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 11 MiB/s wr, 1.00k op/s 2024-06-02T04:53:39.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:53:39 smithi076 ceph-mon[42935]: pgmap v390: 129 pgs: 129 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 11 MiB/s wr, 1.00k op/s 2024-06-02T04:53:39.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:53:39 smithi119 ceph-mon[46633]: pgmap v390: 129 pgs: 129 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 11 MiB/s wr, 1.00k op/s 2024-06-02T04:53:41.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 170.0 s, 976.0 tps, lat 102.877 ms stddev 34.903 2024-06-02T04:53:41.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:53:41 smithi192 ceph-mon[47933]: pgmap v391: 129 pgs: 129 active+clean; 1.5 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 12 MiB/s wr, 1.02k op/s 2024-06-02T04:53:41.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:53:41 smithi076 ceph-mon[42935]: pgmap v391: 129 pgs: 129 active+clean; 1.5 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 12 MiB/s wr, 1.02k op/s 2024-06-02T04:53:41.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:53:41 smithi119 ceph-mon[46633]: pgmap v391: 129 pgs: 129 active+clean; 1.5 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 12 MiB/s wr, 1.02k op/s 2024-06-02T04:53:43.619 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.618+0000 7f58eefbb700 1 -- 172.21.15.76:0/3113126156 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f58e8108730 msgr2=0x7f58e8108b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:53:43.620 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.618+0000 7f58eefbb700 1 --2- 172.21.15.76:0/3113126156 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f58e8108730 0x7f58e8108b90 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f58d40099c0 tx=0x7f58d4009cd0 comp rx=0 tx=0).stop 2024-06-02T04:53:43.620 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.619+0000 7f58eefbb700 1 -- 172.21.15.76:0/3113126156 shutdown_connections 2024-06-02T04:53:43.620 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.619+0000 7f58eefbb700 1 --2- 172.21.15.76:0/3113126156 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f58e81090d0 0x7f58e810f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:43.620 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.619+0000 7f58eefbb700 1 --2- 172.21.15.76:0/3113126156 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f58e8107540 0x7f58e8107960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:43.620 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.619+0000 7f58eefbb700 1 --2- 172.21.15.76:0/3113126156 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f58e8108730 0x7f58e8108b90 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:43.620 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.619+0000 7f58eefbb700 1 -- 172.21.15.76:0/3113126156 >> 172.21.15.76:0/3113126156 conn(0x7f58e80764d0 msgr2=0x7f58e8078910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:53:43.620 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.619+0000 7f58eefbb700 1 -- 172.21.15.76:0/3113126156 shutdown_connections 2024-06-02T04:53:43.622 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.619+0000 7f58eefbb700 1 -- 172.21.15.76:0/3113126156 wait complete. 2024-06-02T04:53:43.622 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.620+0000 7f58eefbb700 1 Processor -- start 2024-06-02T04:53:43.622 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.620+0000 7f58eefbb700 1 -- start start 2024-06-02T04:53:43.622 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.620+0000 7f58eefbb700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f58e8107540 0x7f58e806f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:53:43.622 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.620+0000 7f58eefbb700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f58e8108730 0x7f58e806fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:53:43.622 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.620+0000 7f58eefbb700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f58e81090d0 0x7f58e807d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:53:43.622 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.620+0000 7f58eefbb700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58e8072ec0 con 0x7f58e8107540 2024-06-02T04:53:43.623 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.620+0000 7f58eefbb700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58e8073030 con 0x7f58e8108730 2024-06-02T04:53:43.623 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.620+0000 7f58eefbb700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58e807dd10 con 0x7f58e81090d0 2024-06-02T04:53:43.623 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.620+0000 7f58e7fff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f58e8108730 0x7f58e806fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:53:43.623 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.620+0000 7f58e7fff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f58e8108730 0x7f58e806fe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:40190/0 (socket says 172.21.15.76:40190) 2024-06-02T04:53:43.623 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.620+0000 7f58e7fff700 1 -- 172.21.15.76:0/200408972 learned_addr learned my addr 172.21.15.76:0/200408972 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:53:43.623 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.620+0000 7f58ed558700 1 --2- 172.21.15.76:0/200408972 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f58e81090d0 0x7f58e807d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:53:43.623 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.620+0000 7f58ecd57700 1 --2- 172.21.15.76:0/200408972 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f58e8107540 0x7f58e806f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:53:43.623 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.621+0000 7f58e7fff700 1 -- 172.21.15.76:0/200408972 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f58e81090d0 msgr2=0x7f58e807d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:53:43.623 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.621+0000 7f58e7fff700 1 --2- 172.21.15.76:0/200408972 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f58e81090d0 0x7f58e807d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:43.623 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.621+0000 7f58e7fff700 1 -- 172.21.15.76:0/200408972 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f58e8107540 msgr2=0x7f58e806f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:53:43.624 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.621+0000 7f58e7fff700 1 --2- 172.21.15.76:0/200408972 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f58e8107540 0x7f58e806f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:43.624 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.621+0000 7f58e7fff700 1 -- 172.21.15.76:0/200408972 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58d40095f0 con 0x7f58e8108730 2024-06-02T04:53:43.624 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.621+0000 7f58e7fff700 1 --2- 172.21.15.76:0/200408972 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f58e8108730 0x7f58e806fe30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f58d40098e0 tx=0x7f58d40057b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:53:43.624 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.621+0000 7f58e5ffb700 1 -- 172.21.15.76:0/200408972 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d401d070 con 0x7f58e8108730 2024-06-02T04:53:43.624 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.621+0000 7f58eefbb700 1 -- 172.21.15.76:0/200408972 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58e807df60 con 0x7f58e8108730 2024-06-02T04:53:43.624 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.621+0000 7f58eefbb700 1 -- 172.21.15.76:0/200408972 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58e807e400 con 0x7f58e8108730 2024-06-02T04:53:43.624 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.621+0000 7f58e5ffb700 1 -- 172.21.15.76:0/200408972 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f58d40040d0 con 0x7f58e8108730 2024-06-02T04:53:43.625 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.621+0000 7f58e5ffb700 1 -- 172.21.15.76:0/200408972 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d4022e30 con 0x7f58e8108730 2024-06-02T04:53:43.626 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.625+0000 7f58e5ffb700 1 -- 172.21.15.76:0/200408972 <== mon.2 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f58d400f460 con 0x7f58e8108730 2024-06-02T04:53:43.626 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.626+0000 7f58fb176b80 1 Processor -- start 2024-06-02T04:53:43.626 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.626+0000 7f58e5ffb700 1 --2- 172.21.15.76:0/200408972 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f58d80a1220 0x7f58d80a36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:53:43.626 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.626+0000 7f58e5ffb700 1 -- 172.21.15.76:0/200408972 <== mon.2 v2:172.21.15.119:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f58d40ced80 con 0x7f58e8108730 2024-06-02T04:53:43.627 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.626+0000 7f58ed558700 1 --2- 172.21.15.76:0/200408972 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f58d80a1220 0x7f58d80a36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:53:43.627 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.626+0000 7f58fb176b80 1 -- start start 2024-06-02T04:53:43.627 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.626+0000 7f58fb176b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559991983a80 0x559991983ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:53:43.627 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.626+0000 7f58fb176b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5599919843e0 0x559991984cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:53:43.627 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.626+0000 7f58fb176b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5599919852d0 0x559991985750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:53:43.627 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.626+0000 7f58fb176b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599918db0f0 con 0x5599919843e0 2024-06-02T04:53:43.627 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.626+0000 7f58fb176b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599918d8ab0 con 0x559991983a80 2024-06-02T04:53:43.628 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.626+0000 7f58fb176b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599918d43a0 con 0x5599919852d0 2024-06-02T04:53:43.628 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.627+0000 7f58ecd57700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559991983a80 0x559991983ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:53:43.628 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.627+0000 7f58ecd57700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559991983a80 0x559991983ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:40192/0 (socket says 172.21.15.76:40192) 2024-06-02T04:53:43.628 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.627+0000 7f58ecd57700 1 -- 172.21.15.76:0/945953347 learned_addr learned my addr 172.21.15.76:0/945953347 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:53:43.628 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.627+0000 7f58ed558700 1 --2- 172.21.15.76:0/945953347 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5599919852d0 0x559991985750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:53:43.628 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.627+0000 7f58e7fff700 1 --2- 172.21.15.76:0/945953347 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5599919843e0 0x559991984cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:53:43.628 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.627+0000 7f58ed558700 1 --2- 172.21.15.76:0/200408972 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f58d80a1220 0x7f58d80a36e0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f58e0009fd0 tx=0x7f58e000d040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:53:43.628 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.627+0000 7f58ed558700 1 -- 172.21.15.76:0/945953347 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559991983a80 msgr2=0x559991983ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:53:43.628 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.627+0000 7f58ed558700 1 --2- 172.21.15.76:0/945953347 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559991983a80 0x559991983ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:43.629 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.627+0000 7f58ed558700 1 -- 172.21.15.76:0/945953347 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5599919843e0 msgr2=0x559991984cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:53:43.629 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.627+0000 7f58ed558700 1 --2- 172.21.15.76:0/945953347 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5599919843e0 0x559991984cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:43.629 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.627+0000 7f58ed558700 1 -- 172.21.15.76:0/945953347 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559991755350 con 0x5599919852d0 2024-06-02T04:53:43.629 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.627+0000 7f58ed558700 1 --2- 172.21.15.76:0/945953347 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5599919852d0 0x559991985750 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f58e000bb70 tx=0x7f58e0019000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a759ec4f63edb655 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:53:43.629 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.628+0000 7f58d2ffd700 1 -- 172.21.15.76:0/945953347 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58e0010040 con 0x5599919852d0 2024-06-02T04:53:43.629 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.628+0000 7f58d2ffd700 1 -- 172.21.15.76:0/945953347 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f58e00218d0 con 0x5599919852d0 2024-06-02T04:53:43.629 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.628+0000 7f58d2ffd700 1 -- 172.21.15.76:0/945953347 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58e001f7e0 con 0x5599919852d0 2024-06-02T04:53:43.629 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.629+0000 7f58fb176b80 1 -- 172.21.15.76:0/945953347 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5599919852d0 msgr2=0x559991985750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:53:43.629 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.629+0000 7f58fb176b80 1 --2- 172.21.15.76:0/945953347 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5599919852d0 0x559991985750 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f58e000bb70 tx=0x7f58e0019000 comp rx=0 tx=0).stop 2024-06-02T04:53:43.630 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.630+0000 7f58fb176b80 1 -- 172.21.15.76:0/945953347 shutdown_connections 2024-06-02T04:53:43.630 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.630+0000 7f58fb176b80 1 --2- 172.21.15.76:0/945953347 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5599919852d0 0x559991985750 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:43.630 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.630+0000 7f58fb176b80 1 --2- 172.21.15.76:0/945953347 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559991983a80 0x559991983ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:43.630 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.630+0000 7f58fb176b80 1 --2- 172.21.15.76:0/945953347 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5599919843e0 0x559991984cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:43.631 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.630+0000 7f58fb176b80 1 -- 172.21.15.76:0/945953347 >> 172.21.15.76:0/945953347 conn(0x5599918e21b0 msgr2=0x559991980440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:53:43.634 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.634+0000 7f58fb176b80 1 -- 172.21.15.76:0/945953347 shutdown_connections 2024-06-02T04:53:43.634 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.634+0000 7f58fb176b80 1 -- 172.21.15.76:0/945953347 wait complete. 2024-06-02T04:53:43.634 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.634+0000 7f58fb176b80 1 -- start start 2024-06-02T04:53:43.634 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.634+0000 7f58fb176b80 1 Processor -- start 2024-06-02T04:53:43.636 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.635+0000 7f58fb176b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559991983a80 0x55999198d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:53:43.636 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.635+0000 7f58fb176b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5599919843e0 0x55999198de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:53:43.637 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.635+0000 7f58fb176b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5599919852d0 0x559991994df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:53:43.637 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.636+0000 7f58fb176b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x559991870500 con 0x5599919843e0 2024-06-02T04:53:43.637 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.636+0000 7f58fb176b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599918701a0 con 0x559991983a80 2024-06-02T04:53:43.637 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.636+0000 7f58fb176b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x559991757640 con 0x5599919852d0 2024-06-02T04:53:43.637 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.636+0000 7f58fb176b80 10 client.0 _ll_register_callbacks cb 0x559991879ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:53:43.637 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.636+0000 7f58ecd57700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559991983a80 0x55999198d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:53:43.637 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.636+0000 7f58ecd57700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559991983a80 0x55999198d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:40196/0 (socket says 172.21.15.76:40196) 2024-06-02T04:53:43.637 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.636+0000 7f58ecd57700 1 -- 172.21.15.76:0/2067877640 learned_addr learned my addr 172.21.15.76:0/2067877640 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:53:43.640 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.636+0000 7f58ecd57700 1 -- 172.21.15.76:0/2067877640 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5599919852d0 msgr2=0x559991994df0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-02T04:53:43.640 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.636+0000 7f58ecd57700 1 --2- 172.21.15.76:0/2067877640 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5599919852d0 0x559991994df0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:43.640 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.636+0000 7f58ecd57700 1 -- 172.21.15.76:0/2067877640 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5599919843e0 msgr2=0x55999198de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:53:43.640 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.636+0000 7f58ecd57700 1 --2- 172.21.15.76:0/2067877640 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5599919843e0 0x55999198de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:43.640 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.636+0000 7f58ecd57700 1 -- 172.21.15.76:0/2067877640 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58e00173f0 con 0x559991983a80 2024-06-02T04:53:43.640 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.637+0000 7f58ecd57700 1 --2- 172.21.15.76:0/2067877640 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559991983a80 0x55999198d8c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f58dc010500 tx=0x7f58dc0108c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a002809188ad8c2 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:53:43.640 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.637+0000 7f58c7fff700 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-06-02T04:53:43.640 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.637+0000 7f58c7fff700 1 -- 172.21.15.76:0/2067877640 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58dc014700 con 0x559991983a80 2024-06-02T04:53:43.640 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.637+0000 7f58c7fff700 1 -- 172.21.15.76:0/2067877640 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f58dc014860 con 0x559991983a80 2024-06-02T04:53:43.640 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.637+0000 7f58fb176b80 1 -- 172.21.15.76:0/2067877640 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55999182d210 con 0x559991983a80 2024-06-02T04:53:43.641 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.638+0000 7f58c7fff700 1 -- 172.21.15.76:0/2067877640 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f58dc014a20 con 0x559991983a80 2024-06-02T04:53:43.641 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.638+0000 7f58fb176b80 10 client.25598 fetch_fsmap learned FSMap version 32 2024-06-02T04:53:43.641 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.638+0000 7f58fb176b80 1 -- 172.21.15.76:0/2067877640 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x559991701b00 con 0x559991983a80 2024-06-02T04:53:43.641 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.638+0000 7f58c7fff700 1 -- 172.21.15.76:0/2067877640 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55999182d210 con 0x559991983a80 2024-06-02T04:53:43.641 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.639+0000 7f58c7fff700 1 -- 172.21.15.76:0/2067877640 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 32) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f58dc013b90 con 0x559991983a80 2024-06-02T04:53:43.641 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.639+0000 7f58fb176b80 10 client.25598 fetch_fsmap finished waiting for FSMap version 32 2024-06-02T04:53:43.641 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.639+0000 7f58fb176b80 10 client.25598 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T04:53:43.641 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.639+0000 7f58fb176b80 20 client.25598 populate_metadata read hostname 'smithi076' 2024-06-02T04:53:43.641 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.639+0000 7f58fb176b80 1 --2- 172.21.15.76:0/2067877640 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x559991999710 0x55999199bb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:53:43.641 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.639+0000 7f58fb176b80 4 client.25598 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T04:53:43.641 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.639+0000 7f58fb176b80 1 -- 172.21.15.76:0/2067877640 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5599919537b0 con 0x559991999710 2024-06-02T04:53:43.641 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.639+0000 7f58e7fff700 1 --2- 172.21.15.76:0/2067877640 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x559991999710 0x55999199bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:53:43.641 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.640+0000 7f58e7fff700 1 --2- 172.21.15.76:0/2067877640 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x559991999710 0x55999199bb30 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=60583c348051efbf server_cookie=3e80fe13934e7132 in_seq=0 out_seq=0 2024-06-02T04:53:43.642 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.640+0000 7f58c7fff700 10 client.25598 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:53:43.642 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.640+0000 7f58c7fff700 1 -- 172.21.15.76:0/2067877640 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5599919537b0 con 0x559991999710 2024-06-02T04:53:43.643 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.640+0000 7f58c7fff700 10 client.25598 handle_command_reply: tid=0 2024-06-02T04:53:43.643 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.640+0000 7f58fb176b80 1 client.25598 shutdown 2024-06-02T04:53:43.643 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.640+0000 7f58fb176b80 1 -- 172.21.15.76:0/2067877640 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559991983a80 msgr2=0x55999198d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:53:43.643 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.640+0000 7f58fb176b80 1 --2- 172.21.15.76:0/2067877640 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559991983a80 0x55999198d8c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f58dc010500 tx=0x7f58dc0108c0 comp rx=0 tx=0).stop 2024-06-02T04:53:43.643 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.641+0000 7f58fb176b80 1 -- 172.21.15.76:0/2067877640 shutdown_connections 2024-06-02T04:53:43.643 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.641+0000 7f58fb176b80 1 --2- 172.21.15.76:0/2067877640 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x559991999710 0x55999199bb30 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:43.643 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.641+0000 7f58fb176b80 1 --2- 172.21.15.76:0/2067877640 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5599919852d0 0x559991994df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:43.643 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.641+0000 7f58fb176b80 1 --2- 172.21.15.76:0/2067877640 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559991983a80 0x55999198d8c0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:43.643 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.641+0000 7f58fb176b80 1 --2- 172.21.15.76:0/2067877640 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5599919843e0 0x55999198de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:43.643 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.641+0000 7f58fb176b80 1 -- 172.21.15.76:0/2067877640 >> 172.21.15.76:0/2067877640 conn(0x5599918e21b0 msgr2=0x55999197e860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:53:43.644 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.641+0000 7f58c7fff700 0 client.25598 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:53:43.644 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.641+0000 7f58fb176b80 1 -- 172.21.15.76:0/2067877640 shutdown_connections 2024-06-02T04:53:43.644 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.641+0000 7f58fb176b80 1 -- 172.21.15.76:0/2067877640 wait complete. 2024-06-02T04:53:43.644 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.641+0000 7f58fb176b80 20 client.25598 trim_cache size 0 max 16384 2024-06-02T04:53:43.665 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.665+0000 7f58fb176b80 1 Processor -- start 2024-06-02T04:53:43.667 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.665+0000 7f58fb176b80 1 -- start start 2024-06-02T04:53:43.667 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.665+0000 7f58fb176b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559991983a80 0x55999198c570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:53:43.667 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.665+0000 7f58fb176b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5599919843e0 0x5599919856d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:53:43.667 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.665+0000 7f58fb176b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5599919852d0 0x559991994d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:53:43.667 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.665+0000 7f58fb176b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55999182d210 con 0x5599919843e0 2024-06-02T04:53:43.667 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.665+0000 7f58fb176b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x559991979330 con 0x5599919852d0 2024-06-02T04:53:43.667 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.665+0000 7f58fb176b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55999198c330 con 0x559991983a80 2024-06-02T04:53:43.667 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.665+0000 7f58ed558700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5599919852d0 0x559991994d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:53:43.667 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.665+0000 7f58e7fff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5599919843e0 0x5599919856d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:53:43.667 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.665+0000 7f58e7fff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5599919843e0 0x5599919856d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:34116/0 (socket says 172.21.15.76:34116) 2024-06-02T04:53:43.668 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.666+0000 7f58e7fff700 1 -- 172.21.15.76:0/2357990941 learned_addr learned my addr 172.21.15.76:0/2357990941 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:53:43.668 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.666+0000 7f58e7fff700 1 -- 172.21.15.76:0/2357990941 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559991983a80 msgr2=0x55999198c570 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-02T04:53:43.668 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.666+0000 7f58e7fff700 1 --2- 172.21.15.76:0/2357990941 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559991983a80 0x55999198c570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:43.668 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.666+0000 7f58e7fff700 1 -- 172.21.15.76:0/2357990941 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5599919852d0 msgr2=0x559991994d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:53:43.668 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.666+0000 7f58e7fff700 1 --2- 172.21.15.76:0/2357990941 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5599919852d0 0x559991994d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:43.668 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.666+0000 7f58e7fff700 1 -- 172.21.15.76:0/2357990941 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55999189a500 con 0x5599919843e0 2024-06-02T04:53:43.668 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.666+0000 7f58e7fff700 1 --2- 172.21.15.76:0/2357990941 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5599919843e0 0x5599919856d0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f58d4098930 tx=0x7f58d4009cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a9856f0c487e89a server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:53:43.668 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.668+0000 7f58d37fe700 1 -- 172.21.15.76:0/2357990941 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d409fcf0 con 0x5599919843e0 2024-06-02T04:53:43.668 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.668+0000 7f58d37fe700 1 -- 172.21.15.76:0/2357990941 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f58d40a42b0 con 0x5599919843e0 2024-06-02T04:53:43.669 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.668+0000 7f58d37fe700 1 -- 172.21.15.76:0/2357990941 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d40a3e20 con 0x5599919843e0 2024-06-02T04:53:43.669 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.669+0000 7f58fb176b80 1 -- 172.21.15.76:0/2357990941 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5599919843e0 msgr2=0x5599919856d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:53:43.669 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.669+0000 7f58fb176b80 1 --2- 172.21.15.76:0/2357990941 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5599919843e0 0x5599919856d0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f58d4098930 tx=0x7f58d4009cd0 comp rx=0 tx=0).stop 2024-06-02T04:53:43.669 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.669+0000 7f58fb176b80 1 -- 172.21.15.76:0/2357990941 shutdown_connections 2024-06-02T04:53:43.670 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.669+0000 7f58fb176b80 1 --2- 172.21.15.76:0/2357990941 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5599919852d0 0x559991994d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:43.670 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.669+0000 7f58fb176b80 1 --2- 172.21.15.76:0/2357990941 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559991983a80 0x55999198c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:43.670 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.669+0000 7f58fb176b80 1 --2- 172.21.15.76:0/2357990941 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5599919843e0 0x5599919856d0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:43.670 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.669+0000 7f58fb176b80 1 -- 172.21.15.76:0/2357990941 >> 172.21.15.76:0/2357990941 conn(0x5599918e21b0 msgr2=0x55999198b8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:53:43.670 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.669+0000 7f58fb176b80 1 -- 172.21.15.76:0/2357990941 shutdown_connections 2024-06-02T04:53:43.671 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.669+0000 7f58fb176b80 1 -- 172.21.15.76:0/2357990941 wait complete. 2024-06-02T04:53:43.671 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.669+0000 7f58fb176b80 1 -- start start 2024-06-02T04:53:43.671 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.670+0000 7f58fb176b80 1 Processor -- start 2024-06-02T04:53:43.671 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.670+0000 7f58fb176b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559991983a80 0x559991991fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:53:43.671 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.670+0000 7f58fb176b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5599919843e0 0x5599919924f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:53:43.671 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.670+0000 7f58fb176b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5599919852d0 0x5599919edbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:53:43.671 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.670+0000 7f58fb176b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x559991992ad0 con 0x5599919843e0 2024-06-02T04:53:43.671 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.670+0000 7f58fb176b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599919ee110 con 0x5599919852d0 2024-06-02T04:53:43.672 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.670+0000 7f58fb176b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599919ee250 con 0x559991983a80 2024-06-02T04:53:43.672 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.670+0000 7f58fb176b80 10 client.0 _ll_register_callbacks cb 0x559991879ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:53:43.672 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.671+0000 7f58ed558700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5599919852d0 0x5599919edbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:53:43.672 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.671+0000 7f58ed558700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5599919852d0 0x5599919edbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:40210/0 (socket says 172.21.15.76:40210) 2024-06-02T04:53:43.672 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.671+0000 7f58ed558700 1 -- 172.21.15.76:0/3784920113 learned_addr learned my addr 172.21.15.76:0/3784920113 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:53:43.672 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.671+0000 7f58e7fff700 1 --2- 172.21.15.76:0/3784920113 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5599919843e0 0x5599919924f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:53:43.673 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.671+0000 7f58ed558700 1 -- 172.21.15.76:0/3784920113 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559991983a80 msgr2=0x559991991fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:53:43.673 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.671+0000 7f58ed558700 1 --2- 172.21.15.76:0/3784920113 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559991983a80 0x559991991fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:43.673 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.671+0000 7f58ed558700 1 -- 172.21.15.76:0/3784920113 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5599919843e0 msgr2=0x5599919924f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:53:43.673 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.671+0000 7f58ed558700 1 --2- 172.21.15.76:0/3784920113 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5599919843e0 0x5599919924f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:43.673 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.671+0000 7f58ed558700 1 -- 172.21.15.76:0/3784920113 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58e807e400 con 0x5599919852d0 2024-06-02T04:53:43.673 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.671+0000 7f58ed558700 1 --2- 172.21.15.76:0/3784920113 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5599919852d0 0x5599919edbd0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f58e0025000 tx=0x7f58e0003d80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a0dd0b9f9cdaaccd server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:53:43.673 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.671+0000 7f58c7fff700 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-06-02T04:53:43.674 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.672+0000 7f58c7fff700 1 -- 172.21.15.76:0/3784920113 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58e0010040 con 0x5599919852d0 2024-06-02T04:53:43.674 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.672+0000 7f58c7fff700 1 -- 172.21.15.76:0/3784920113 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f58e0031070 con 0x5599919852d0 2024-06-02T04:53:43.674 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.673+0000 7f58fb176b80 1 -- 172.21.15.76:0/3784920113 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f58e00218d0 con 0x5599919852d0 2024-06-02T04:53:43.674 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.673+0000 7f58c7fff700 1 -- 172.21.15.76:0/3784920113 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f58e000bba0 con 0x5599919852d0 2024-06-02T04:53:43.674 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.673+0000 7f58fb176b80 10 client.25604 fetch_fsmap learned FSMap version 32 2024-06-02T04:53:43.674 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.673+0000 7f58fb176b80 1 -- 172.21.15.76:0/3784920113 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x559991759c70 con 0x5599919852d0 2024-06-02T04:53:43.674 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.674+0000 7f58c7fff700 1 -- 172.21.15.76:0/3784920113 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f58e00218d0 con 0x5599919852d0 2024-06-02T04:53:43.675 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.674+0000 7f58c7fff700 1 -- 172.21.15.76:0/3784920113 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 32) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f58e0013050 con 0x5599919852d0 2024-06-02T04:53:43.677 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.676+0000 7f58fb176b80 10 client.25604 fetch_fsmap finished waiting for FSMap version 32 2024-06-02T04:53:43.677 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.676+0000 7f58fb176b80 10 client.25604 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T04:53:43.677 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.676+0000 7f58fb176b80 20 client.25604 populate_metadata read hostname 'smithi076' 2024-06-02T04:53:43.677 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.677+0000 7f58fb176b80 1 --2- 172.21.15.76:0/3784920113 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5599919efae0 0x5599919f1f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:53:43.678 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.677+0000 7f58fb176b80 4 client.25604 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T04:53:43.678 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.677+0000 7f58fb176b80 1 -- 172.21.15.76:0/3784920113 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5599918cce60 con 0x5599919efae0 2024-06-02T04:53:43.678 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.677+0000 7f58ecd57700 1 --2- 172.21.15.76:0/3784920113 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5599919efae0 0x5599919f1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:53:43.678 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.677+0000 7f58c7fff700 10 client.25604 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:53:43.678 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.677+0000 7f58ecd57700 1 --2- 172.21.15.76:0/3784920113 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5599919efae0 0x5599919f1f00 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9ab2c93934a90159 server_cookie=564aeb2cc801611f in_seq=0 out_seq=0 2024-06-02T04:53:43.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:53:43 smithi192 ceph-mon[47933]: pgmap v392: 129 pgs: 129 active+clean; 1.5 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 14 MiB/s wr, 1.12k op/s 2024-06-02T04:53:43.698 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.698+0000 7f58c7fff700 1 -- 172.21.15.76:0/3784920113 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5599918cce60 con 0x5599919efae0 2024-06-02T04:53:43.699 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.698+0000 7f58c7fff700 10 client.25604 handle_command_reply: tid=0 2024-06-02T04:53:43.699 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.698+0000 7f58fb176b80 1 client.25604 shutdown 2024-06-02T04:53:43.699 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.698+0000 7f58fb176b80 1 -- 172.21.15.76:0/3784920113 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5599919852d0 msgr2=0x5599919edbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:53:43.699 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.698+0000 7f58fb176b80 1 --2- 172.21.15.76:0/3784920113 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5599919852d0 0x5599919edbd0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f58e0025000 tx=0x7f58e0003d80 comp rx=0 tx=0).stop 2024-06-02T04:53:43.699 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.698+0000 7f58fb176b80 1 -- 172.21.15.76:0/3784920113 shutdown_connections 2024-06-02T04:53:43.699 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.698+0000 7f58fb176b80 1 --2- 172.21.15.76:0/3784920113 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5599919efae0 0x5599919f1f00 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:43.699 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.698+0000 7f58fb176b80 1 --2- 172.21.15.76:0/3784920113 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5599919852d0 0x5599919edbd0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:43.699 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.698+0000 7f58fb176b80 1 --2- 172.21.15.76:0/3784920113 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559991983a80 0x559991991fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:43.699 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.698+0000 7f58c7fff700 0 client.25604 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:53:43.699 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.698+0000 7f58fb176b80 1 --2- 172.21.15.76:0/3784920113 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5599919843e0 0x5599919924f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:43.699 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.698+0000 7f58fb176b80 1 -- 172.21.15.76:0/3784920113 >> 172.21.15.76:0/3784920113 conn(0x5599918e21b0 msgr2=0x5599919a0470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:53:43.699 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.698+0000 7f58fb176b80 1 -- 172.21.15.76:0/3784920113 shutdown_connections 2024-06-02T04:53:43.700 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.698+0000 7f58fb176b80 1 -- 172.21.15.76:0/3784920113 wait complete. 2024-06-02T04:53:43.700 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.699+0000 7f58fb176b80 20 client.25604 trim_cache size 0 max 16384 2024-06-02T04:53:43.700 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:{ 2024-06-02T04:53:43.700 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "message": "", 2024-06-02T04:53:43.700 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "return_code": 0 2024-06-02T04:53:43.701 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:} 2024-06-02T04:53:43.701 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.699+0000 7f58eefbb700 1 -- 172.21.15.76:0/200408972 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f58d80a1220 msgr2=0x7f58d80a36e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:53:43.701 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.699+0000 7f58eefbb700 1 --2- 172.21.15.76:0/200408972 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f58d80a1220 0x7f58d80a36e0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f58e0009fd0 tx=0x7f58e000d040 comp rx=0 tx=0).stop 2024-06-02T04:53:43.701 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.699+0000 7f58eefbb700 1 -- 172.21.15.76:0/200408972 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f58e8108730 msgr2=0x7f58e806fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:53:43.702 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.699+0000 7f58eefbb700 1 --2- 172.21.15.76:0/200408972 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f58e8108730 0x7f58e806fe30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f58d40098e0 tx=0x7f58d40057b0 comp rx=0 tx=0).stop 2024-06-02T04:53:43.702 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.700+0000 7f58eefbb700 1 -- 172.21.15.76:0/200408972 shutdown_connections 2024-06-02T04:53:43.702 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.700+0000 7f58eefbb700 1 --2- 172.21.15.76:0/200408972 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f58e81090d0 0x7f58e807d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:43.702 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.700+0000 7f58eefbb700 1 --2- 172.21.15.76:0/200408972 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f58e8107540 0x7f58e806f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:43.702 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.700+0000 7f58eefbb700 1 --2- 172.21.15.76:0/200408972 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f58d80a1220 0x7f58d80a36e0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:43.702 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.700+0000 7f58eefbb700 1 --2- 172.21.15.76:0/200408972 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f58e8108730 0x7f58e806fe30 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:43.702 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.700+0000 7f58eefbb700 1 -- 172.21.15.76:0/200408972 >> 172.21.15.76:0/200408972 conn(0x7f58e80764d0 msgr2=0x7f58e810bb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:53:43.702 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.700+0000 7f58eefbb700 1 -- 172.21.15.76:0/200408972 shutdown_connections 2024-06-02T04:53:43.702 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:43.701+0000 7f58eefbb700 1 -- 172.21.15.76:0/200408972 wait complete. 2024-06-02T04:53:43.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:53:43 smithi076 ceph-mon[42935]: pgmap v392: 129 pgs: 129 active+clean; 1.5 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 14 MiB/s wr, 1.12k op/s 2024-06-02T04:53:43.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:53:43 smithi119 ceph-mon[46633]: pgmap v392: 129 pgs: 129 active+clean; 1.5 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 14 MiB/s wr, 1.12k op/s 2024-06-02T04:53:45.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:53:45 smithi192 ceph-mon[47933]: pgmap v393: 129 pgs: 129 active+clean; 1.5 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 13 MiB/s wr, 940 op/s 2024-06-02T04:53:45.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:53:45 smithi076 ceph-mon[42935]: pgmap v393: 129 pgs: 129 active+clean; 1.5 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 13 MiB/s wr, 940 op/s 2024-06-02T04:53:45.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:53:45 smithi119 ceph-mon[46633]: pgmap v393: 129 pgs: 129 active+clean; 1.5 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 13 MiB/s wr, 940 op/s 2024-06-02T04:53:46.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 175.0 s, 1042.4 tps, lat 95.726 ms stddev 32.513 2024-06-02T04:53:47.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:53:47 smithi076 ceph-mon[42935]: pgmap v394: 129 pgs: 129 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 16 MiB/s wr, 1.14k op/s 2024-06-02T04:53:47.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:53:47 smithi119 ceph-mon[46633]: pgmap v394: 129 pgs: 129 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 16 MiB/s wr, 1.14k op/s 2024-06-02T04:53:47.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:53:47 smithi192 ceph-mon[47933]: pgmap v394: 129 pgs: 129 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 16 MiB/s wr, 1.14k op/s 2024-06-02T04:53:49.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:53:49 smithi076 ceph-mon[42935]: pgmap v395: 129 pgs: 129 active+clean; 1.5 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 16 MiB/s wr, 1.06k op/s 2024-06-02T04:53:49.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:53:49 smithi119 ceph-mon[46633]: pgmap v395: 129 pgs: 129 active+clean; 1.5 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 16 MiB/s wr, 1.06k op/s 2024-06-02T04:53:49.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:53:49 smithi192 ceph-mon[47933]: pgmap v395: 129 pgs: 129 active+clean; 1.5 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 16 MiB/s wr, 1.06k op/s 2024-06-02T04:53:51.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 180.0 s, 976.4 tps, lat 102.476 ms stddev 82.428 2024-06-02T04:53:51.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:53:51 smithi076 ceph-mon[42935]: pgmap v396: 129 pgs: 129 active+clean; 1.5 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 17 MiB/s wr, 1.13k op/s 2024-06-02T04:53:51.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:53:51 smithi119 ceph-mon[46633]: pgmap v396: 129 pgs: 129 active+clean; 1.5 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 17 MiB/s wr, 1.13k op/s 2024-06-02T04:53:51.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:53:51 smithi192 ceph-mon[47933]: pgmap v396: 129 pgs: 129 active+clean; 1.5 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 17 MiB/s wr, 1.13k op/s 2024-06-02T04:53:52.735 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:53:52 smithi076 ceph-mon[42935]: pgmap v397: 129 pgs: 129 active+clean; 1.5 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 17 MiB/s wr, 1.10k op/s 2024-06-02T04:53:52.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:53:52 smithi119 ceph-mon[46633]: pgmap v397: 129 pgs: 129 active+clean; 1.5 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 17 MiB/s wr, 1.10k op/s 2024-06-02T04:53:52.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:53:52 smithi192 ceph-mon[47933]: pgmap v397: 129 pgs: 129 active+clean; 1.5 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 17 MiB/s wr, 1.10k op/s 2024-06-02T04:53:55.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:53:55 smithi119 ceph-mon[46633]: pgmap v398: 129 pgs: 129 active+clean; 1.5 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 15 MiB/s wr, 1.00k op/s 2024-06-02T04:53:55.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:53:55 smithi192 ceph-mon[47933]: pgmap v398: 129 pgs: 129 active+clean; 1.5 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 15 MiB/s wr, 1.00k op/s 2024-06-02T04:53:55.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:53:55 smithi076 ceph-mon[42935]: pgmap v398: 129 pgs: 129 active+clean; 1.5 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 15 MiB/s wr, 1.00k op/s 2024-06-02T04:53:56.314 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 185.0 s, 994.0 tps, lat 100.613 ms stddev 35.216 2024-06-02T04:53:56.883 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.881+0000 7fe6e204b700 1 -- 172.21.15.76:0/3445708283 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe6dc0ff930 msgr2=0x7fe6dc109500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:53:56.883 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.881+0000 7fe6e204b700 1 --2- 172.21.15.76:0/3445708283 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe6dc0ff930 0x7fe6dc109500 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe6d4009f90 tx=0x7fe6d400b330 comp rx=0 tx=0).stop 2024-06-02T04:53:56.883 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.882+0000 7fe6e204b700 1 -- 172.21.15.76:0/3445708283 shutdown_connections 2024-06-02T04:53:56.883 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.882+0000 7fe6e204b700 1 --2- 172.21.15.76:0/3445708283 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe6dc0ff930 0x7fe6dc109500 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:56.883 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.882+0000 7fe6e204b700 1 --2- 172.21.15.76:0/3445708283 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe6dc102520 0x7fe6dc102940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:56.883 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.882+0000 7fe6e204b700 1 --2- 172.21.15.76:0/3445708283 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe6dc0fef90 0x7fe6dc0ff3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:56.883 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.882+0000 7fe6e204b700 1 -- 172.21.15.76:0/3445708283 >> 172.21.15.76:0/3445708283 conn(0x7fe6dc0faaf0 msgr2=0x7fe6dc0fcf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:53:56.883 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.882+0000 7fe6e204b700 1 -- 172.21.15.76:0/3445708283 shutdown_connections 2024-06-02T04:53:56.884 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.882+0000 7fe6e204b700 1 -- 172.21.15.76:0/3445708283 wait complete. 2024-06-02T04:53:56.884 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.882+0000 7fe6e204b700 1 Processor -- start 2024-06-02T04:53:56.884 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.883+0000 7fe6e204b700 1 -- start start 2024-06-02T04:53:56.885 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.883+0000 7fe6e204b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe6dc0fef90 0x7fe6dc196ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:53:56.885 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.883+0000 7fe6e204b700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe6dc0ff930 0x7fe6dc197410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:53:56.885 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.883+0000 7fe6e204b700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe6dc102520 0x7fe6dc19e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:53:56.885 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.883+0000 7fe6e204b700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6dc19ea00 con 0x7fe6dc102520 2024-06-02T04:53:56.885 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.883+0000 7fe6e204b700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6dc19eb40 con 0x7fe6dc0ff930 2024-06-02T04:53:56.886 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.883+0000 7fe6e204b700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6dc19ecd0 con 0x7fe6dc0fef90 2024-06-02T04:53:56.886 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.883+0000 7fe6daffd700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe6dc0ff930 0x7fe6dc197410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:53:56.886 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.883+0000 7fe6daffd700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe6dc0ff930 0x7fe6dc197410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:53724/0 (socket says 172.21.15.76:53724) 2024-06-02T04:53:56.886 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.883+0000 7fe6daffd700 1 -- 172.21.15.76:0/2312995541 learned_addr learned my addr 172.21.15.76:0/2312995541 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:53:56.886 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.884+0000 7fe6daffd700 1 -- 172.21.15.76:0/2312995541 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe6dc0fef90 msgr2=0x7fe6dc196ed0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-06-02T04:53:56.886 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.884+0000 7fe6daffd700 1 --2- 172.21.15.76:0/2312995541 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe6dc0fef90 0x7fe6dc196ed0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:56.886 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.884+0000 7fe6daffd700 1 -- 172.21.15.76:0/2312995541 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe6dc102520 msgr2=0x7fe6dc19e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:53:56.886 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.884+0000 7fe6daffd700 1 --2- 172.21.15.76:0/2312995541 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe6dc102520 0x7fe6dc19e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:56.886 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.884+0000 7fe6daffd700 1 -- 172.21.15.76:0/2312995541 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6d4009c40 con 0x7fe6dc0ff930 2024-06-02T04:53:56.887 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.884+0000 7fe6daffd700 1 --2- 172.21.15.76:0/2312995541 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe6dc0ff930 0x7fe6dc197410 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe6d000bfa0 tx=0x7fe6d000dc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:53:56.887 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.885+0000 7fe6d8ff9700 1 -- 172.21.15.76:0/2312995541 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d0009a90 con 0x7fe6dc0ff930 2024-06-02T04:53:56.887 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.885+0000 7fe6d8ff9700 1 -- 172.21.15.76:0/2312995541 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe6d000dea0 con 0x7fe6dc0ff930 2024-06-02T04:53:56.887 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.885+0000 7fe6e204b700 1 -- 172.21.15.76:0/2312995541 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6dc06aa20 con 0x7fe6dc0ff930 2024-06-02T04:53:56.887 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.885+0000 7fe6d8ff9700 1 -- 172.21.15.76:0/2312995541 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d0020630 con 0x7fe6dc0ff930 2024-06-02T04:53:56.887 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.885+0000 7fe6e204b700 1 -- 172.21.15.76:0/2312995541 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6dc06af80 con 0x7fe6dc0ff930 2024-06-02T04:53:56.889 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.887+0000 7fe6d8ff9700 1 -- 172.21.15.76:0/2312995541 <== mon.2 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fe6d0009bf0 con 0x7fe6dc0ff930 2024-06-02T04:53:56.890 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.889+0000 7fe6d8ff9700 1 --2- 172.21.15.76:0/2312995541 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fe6c40a11f0 0x7fe6c40a36b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:53:56.890 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.890+0000 7fe6d8ff9700 1 -- 172.21.15.76:0/2312995541 <== mon.2 v2:172.21.15.119:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7fe6d00dd700 con 0x7fe6dc0ff930 2024-06-02T04:53:56.890 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.890+0000 7fe6db7fe700 1 --2- 172.21.15.76:0/2312995541 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fe6c40a11f0 0x7fe6c40a36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:53:56.891 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.890+0000 7fe6db7fe700 1 --2- 172.21.15.76:0/2312995541 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fe6c40a11f0 0x7fe6c40a36b0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fe6cc005e50 tx=0x7fe6cc005de0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:53:56.891 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.891+0000 7fe6ee206b80 1 Processor -- start 2024-06-02T04:53:56.892 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.891+0000 7fe6ee206b80 1 -- start start 2024-06-02T04:53:56.892 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.892+0000 7fe6ee206b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562dcd1ab9b0 0x562dcd1abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:53:56.892 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.892+0000 7fe6ee206b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562dcd1ac310 0x562dcd1acc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:53:56.892 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.892+0000 7fe6ee206b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562dcd1ad200 0x562dcd1ad680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:53:56.892 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.892+0000 7fe6ee206b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x562dcd1030f0 con 0x562dcd1ad200 2024-06-02T04:53:56.892 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.892+0000 7fe6ee206b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x562dcd100ab0 con 0x562dcd1ac310 2024-06-02T04:53:56.892 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.892+0000 7fe6ee206b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x562dcd0fc3a0 con 0x562dcd1ab9b0 2024-06-02T04:53:56.893 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.892+0000 7fe6db7fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562dcd1ab9b0 0x562dcd1abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:53:56.894 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.892+0000 7fe6db7fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562dcd1ab9b0 0x562dcd1abdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:49066/0 (socket says 172.21.15.76:49066) 2024-06-02T04:53:56.894 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.892+0000 7fe6db7fe700 1 -- 172.21.15.76:0/4136652670 learned_addr learned my addr 172.21.15.76:0/4136652670 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:53:56.894 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.892+0000 7fe6dbfff700 1 --2- 172.21.15.76:0/4136652670 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562dcd1ad200 0x562dcd1ad680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:53:56.894 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.893+0000 7fe6db7fe700 1 -- 172.21.15.76:0/4136652670 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562dcd1ac310 msgr2=0x562dcd1acc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:53:56.894 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.893+0000 7fe6db7fe700 1 --2- 172.21.15.76:0/4136652670 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562dcd1ac310 0x562dcd1acc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:56.894 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.893+0000 7fe6db7fe700 1 -- 172.21.15.76:0/4136652670 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562dcd1ad200 msgr2=0x562dcd1ad680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:53:56.894 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.893+0000 7fe6db7fe700 1 --2- 172.21.15.76:0/4136652670 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562dcd1ad200 0x562dcd1ad680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:56.894 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.893+0000 7fe6db7fe700 1 -- 172.21.15.76:0/4136652670 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562dccf7d350 con 0x562dcd1ab9b0 2024-06-02T04:53:56.894 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.893+0000 7fe6db7fe700 1 --2- 172.21.15.76:0/4136652670 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562dcd1ab9b0 0x562dcd1abdd0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe6cc00dbf0 tx=0x7fe6cc010000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e921b543a383b148 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:53:56.894 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.893+0000 7fe6c1ffb700 1 -- 172.21.15.76:0/4136652670 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6cc010bb0 con 0x562dcd1ab9b0 2024-06-02T04:53:56.894 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.893+0000 7fe6c1ffb700 1 -- 172.21.15.76:0/4136652670 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe6cc010d10 con 0x562dcd1ab9b0 2024-06-02T04:53:56.894 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.893+0000 7fe6c1ffb700 1 -- 172.21.15.76:0/4136652670 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6cc00f620 con 0x562dcd1ab9b0 2024-06-02T04:53:56.895 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.894+0000 7fe6ee206b80 1 -- 172.21.15.76:0/4136652670 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562dcd1ab9b0 msgr2=0x562dcd1abdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:53:56.895 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.894+0000 7fe6ee206b80 1 --2- 172.21.15.76:0/4136652670 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562dcd1ab9b0 0x562dcd1abdd0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe6cc00dbf0 tx=0x7fe6cc010000 comp rx=0 tx=0).stop 2024-06-02T04:53:56.895 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.895+0000 7fe6ee206b80 1 -- 172.21.15.76:0/4136652670 shutdown_connections 2024-06-02T04:53:56.895 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.895+0000 7fe6ee206b80 1 --2- 172.21.15.76:0/4136652670 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562dcd1ad200 0x562dcd1ad680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:56.895 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.895+0000 7fe6ee206b80 1 --2- 172.21.15.76:0/4136652670 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562dcd1ab9b0 0x562dcd1abdd0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:56.895 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.895+0000 7fe6ee206b80 1 --2- 172.21.15.76:0/4136652670 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562dcd1ac310 0x562dcd1acc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:56.896 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.895+0000 7fe6ee206b80 1 -- 172.21.15.76:0/4136652670 >> 172.21.15.76:0/4136652670 conn(0x562dcd10a1b0 msgr2=0x562dcd1a8440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:53:56.896 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.895+0000 7fe6ee206b80 1 -- 172.21.15.76:0/4136652670 shutdown_connections 2024-06-02T04:53:56.896 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.895+0000 7fe6ee206b80 1 -- 172.21.15.76:0/4136652670 wait complete. 2024-06-02T04:53:56.896 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.896+0000 7fe6ee206b80 1 -- start start 2024-06-02T04:53:56.897 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.896+0000 7fe6ee206b80 1 Processor -- start 2024-06-02T04:53:56.897 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.896+0000 7fe6ee206b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562dcd1ab9b0 0x562dcd1b5970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:53:56.897 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.896+0000 7fe6ee206b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562dcd1ac310 0x562dcd1b5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:53:56.897 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.896+0000 7fe6ee206b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562dcd1ad200 0x562dcd1bcef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:53:56.897 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.897+0000 7fe6ee206b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x562dcd098500 con 0x562dcd1ad200 2024-06-02T04:53:56.897 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.897+0000 7fe6ee206b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x562dcd0981a0 con 0x562dcd1ac310 2024-06-02T04:53:56.897 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.897+0000 7fe6ee206b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x562dccf7f640 con 0x562dcd1ab9b0 2024-06-02T04:53:56.897 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.897+0000 7fe6ee206b80 10 client.0 _ll_register_callbacks cb 0x562dcd0a1ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:53:56.899 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.897+0000 7fe6dbfff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562dcd1ad200 0x562dcd1bcef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:53:56.899 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.897+0000 7fe6dbfff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562dcd1ad200 0x562dcd1bcef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:50432/0 (socket says 172.21.15.76:50432) 2024-06-02T04:53:56.899 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.897+0000 7fe6dbfff700 1 -- 172.21.15.76:0/981465740 learned_addr learned my addr 172.21.15.76:0/981465740 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:53:56.899 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.897+0000 7fe6db7fe700 1 --2- 172.21.15.76:0/981465740 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562dcd1ab9b0 0x562dcd1b5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:53:56.899 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.897+0000 7fe6daffd700 1 --2- 172.21.15.76:0/981465740 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562dcd1ac310 0x562dcd1b5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:53:56.899 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.898+0000 7fe6daffd700 1 -- 172.21.15.76:0/981465740 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562dcd1ab9b0 msgr2=0x562dcd1b5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:53:56.899 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.898+0000 7fe6daffd700 1 --2- 172.21.15.76:0/981465740 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562dcd1ab9b0 0x562dcd1b5970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:56.899 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.898+0000 7fe6daffd700 1 -- 172.21.15.76:0/981465740 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562dcd1ad200 msgr2=0x562dcd1bcef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:53:56.899 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.898+0000 7fe6daffd700 1 --2- 172.21.15.76:0/981465740 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562dcd1ad200 0x562dcd1bcef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:56.900 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.898+0000 7fe6daffd700 1 -- 172.21.15.76:0/981465740 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6cc00d8a0 con 0x562dcd1ac310 2024-06-02T04:53:56.900 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.898+0000 7fe6daffd700 1 --2- 172.21.15.76:0/981465740 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562dcd1ac310 0x562dcd1b5eb0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x562dcd1ac710 tx=0x7fe6d00aaf10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dea14742e2195738 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:53:56.900 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.898+0000 7fe6baffd700 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-06-02T04:53:56.900 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.898+0000 7fe6baffd700 1 -- 172.21.15.76:0/981465740 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d00ae640 con 0x562dcd1ac310 2024-06-02T04:53:56.900 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.898+0000 7fe6baffd700 1 -- 172.21.15.76:0/981465740 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7fe6d00b2c90 con 0x562dcd1ac310 2024-06-02T04:53:56.900 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.898+0000 7fe6ee206b80 1 -- 172.21.15.76:0/981465740 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562dcd055210 con 0x562dcd1ac310 2024-06-02T04:53:56.900 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.898+0000 7fe6baffd700 1 -- 172.21.15.76:0/981465740 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe6d00dd480 con 0x562dcd1ac310 2024-06-02T04:53:56.900 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.898+0000 7fe6ee206b80 10 client.25613 fetch_fsmap learned FSMap version 32 2024-06-02T04:53:56.900 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.898+0000 7fe6ee206b80 1 -- 172.21.15.76:0/981465740 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x562dccf29b00 con 0x562dcd1ac310 2024-06-02T04:53:56.901 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.899+0000 7fe6baffd700 1 -- 172.21.15.76:0/981465740 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe6d00c8030 con 0x562dcd1ac310 2024-06-02T04:53:56.901 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.900+0000 7fe6baffd700 1 -- 172.21.15.76:0/981465740 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 32) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fe6d00a9e20 con 0x562dcd1ac310 2024-06-02T04:53:56.901 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.900+0000 7fe6ee206b80 10 client.25613 fetch_fsmap finished waiting for FSMap version 32 2024-06-02T04:53:56.901 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.900+0000 7fe6ee206b80 10 client.25613 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T04:53:56.901 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.900+0000 7fe6ee206b80 20 client.25613 populate_metadata read hostname 'smithi076' 2024-06-02T04:53:56.901 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.900+0000 7fe6ee206b80 1 --2- 172.21.15.76:0/981465740 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x562dcd1d27d0 0x562dcd1d4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:53:56.901 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.900+0000 7fe6ee206b80 4 client.25613 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T04:53:56.901 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.900+0000 7fe6ee206b80 1 -- 172.21.15.76:0/981465740 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562dcd17b7b0 con 0x562dcd1d27d0 2024-06-02T04:53:56.901 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.900+0000 7fe6db7fe700 1 --2- 172.21.15.76:0/981465740 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x562dcd1d27d0 0x562dcd1d4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:53:56.902 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.901+0000 7fe6db7fe700 1 --2- 172.21.15.76:0/981465740 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x562dcd1d27d0 0x562dcd1d4bc0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4577a6bc4ee9b432 server_cookie=3b51f2dc14f7c963 in_seq=0 out_seq=0 2024-06-02T04:53:56.902 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.901+0000 7fe6baffd700 10 client.25613 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:53:56.902 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.902+0000 7fe6baffd700 1 -- 172.21.15.76:0/981465740 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x562dcd17b7b0 con 0x562dcd1d27d0 2024-06-02T04:53:56.902 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.902+0000 7fe6baffd700 10 client.25613 handle_command_reply: tid=0 2024-06-02T04:53:56.902 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.902+0000 7fe6ee206b80 1 client.25613 shutdown 2024-06-02T04:53:56.904 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.903+0000 7fe6ee206b80 1 -- 172.21.15.76:0/981465740 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562dcd1ac310 msgr2=0x562dcd1b5eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:53:56.904 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.903+0000 7fe6ee206b80 1 --2- 172.21.15.76:0/981465740 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562dcd1ac310 0x562dcd1b5eb0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x562dcd1ac710 tx=0x7fe6d00aaf10 comp rx=0 tx=0).stop 2024-06-02T04:53:56.907 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.907+0000 7fe6ee206b80 1 -- 172.21.15.76:0/981465740 shutdown_connections 2024-06-02T04:53:56.907 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.907+0000 7fe6ee206b80 1 --2- 172.21.15.76:0/981465740 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x562dcd1d27d0 0x562dcd1d4bc0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:56.907 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.907+0000 7fe6ee206b80 1 --2- 172.21.15.76:0/981465740 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562dcd1ad200 0x562dcd1bcef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:56.907 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.907+0000 7fe6ee206b80 1 --2- 172.21.15.76:0/981465740 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562dcd1ab9b0 0x562dcd1b5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:56.907 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.907+0000 7fe6ee206b80 1 --2- 172.21.15.76:0/981465740 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562dcd1ac310 0x562dcd1b5eb0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:56.908 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.907+0000 7fe6ee206b80 1 -- 172.21.15.76:0/981465740 >> 172.21.15.76:0/981465740 conn(0x562dcd10a1b0 msgr2=0x562dcd1a6860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:53:56.908 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.907+0000 7fe6baffd700 0 client.25613 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:53:56.908 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.907+0000 7fe6ee206b80 1 -- 172.21.15.76:0/981465740 shutdown_connections 2024-06-02T04:53:56.908 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.907+0000 7fe6ee206b80 1 -- 172.21.15.76:0/981465740 wait complete. 2024-06-02T04:53:56.908 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.907+0000 7fe6ee206b80 20 client.25613 trim_cache size 0 max 16384 2024-06-02T04:53:56.932 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.932+0000 7fe6ee206b80 1 Processor -- start 2024-06-02T04:53:56.933 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.932+0000 7fe6ee206b80 1 -- start start 2024-06-02T04:53:56.933 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.932+0000 7fe6ee206b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562dcd1ab9b0 0x562dcd1b5970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:53:56.933 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.932+0000 7fe6ee206b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562dcd1ac310 0x562dcd1bceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:53:56.933 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.932+0000 7fe6ee206b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562dcd1ad200 0x562dcd1b5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:53:56.933 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.932+0000 7fe6ee206b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x562dcd1cfc90 con 0x562dcd1ad200 2024-06-02T04:53:56.933 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.932+0000 7fe6ee206b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x562dcd1ae2c0 con 0x562dcd1ab9b0 2024-06-02T04:53:56.934 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.932+0000 7fe6ee206b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x562dcd1ac740 con 0x562dcd1ac310 2024-06-02T04:53:56.934 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.932+0000 7fe6db7fe700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562dcd1ab9b0 0x562dcd1b5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:53:56.934 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.932+0000 7fe6db7fe700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562dcd1ab9b0 0x562dcd1b5970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:53746/0 (socket says 172.21.15.76:53746) 2024-06-02T04:53:56.934 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.932+0000 7fe6db7fe700 1 -- 172.21.15.76:0/2400053937 learned_addr learned my addr 172.21.15.76:0/2400053937 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:53:56.934 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.933+0000 7fe6dbfff700 1 --2- 172.21.15.76:0/2400053937 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562dcd1ad200 0x562dcd1b5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:53:56.934 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.933+0000 7fe6daffd700 1 --2- 172.21.15.76:0/2400053937 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562dcd1ac310 0x562dcd1bceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:53:56.934 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.933+0000 7fe6db7fe700 1 -- 172.21.15.76:0/2400053937 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562dcd1ac310 msgr2=0x562dcd1bceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:53:56.934 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.933+0000 7fe6db7fe700 1 --2- 172.21.15.76:0/2400053937 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562dcd1ac310 0x562dcd1bceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:56.935 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.933+0000 7fe6db7fe700 1 -- 172.21.15.76:0/2400053937 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562dcd1ad200 msgr2=0x562dcd1b5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:53:56.935 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.933+0000 7fe6db7fe700 1 --2- 172.21.15.76:0/2400053937 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562dcd1ad200 0x562dcd1b5eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:56.935 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.933+0000 7fe6db7fe700 1 -- 172.21.15.76:0/2400053937 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562dcd0c2500 con 0x562dcd1ab9b0 2024-06-02T04:53:56.936 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.933+0000 7fe6db7fe700 1 --2- 172.21.15.76:0/2400053937 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562dcd1ab9b0 0x562dcd1b5970 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe6cc00dbf0 tx=0x7fe6cc00dfb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6921f53ec45193a6 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:53:56.936 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.934+0000 7fe6c27fc700 1 -- 172.21.15.76:0/2400053937 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6cc030d70 con 0x562dcd1ab9b0 2024-06-02T04:53:56.936 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.934+0000 7fe6c27fc700 1 -- 172.21.15.76:0/2400053937 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe6cc010e80 con 0x562dcd1ab9b0 2024-06-02T04:53:56.936 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.934+0000 7fe6c27fc700 1 -- 172.21.15.76:0/2400053937 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6cc01d7c0 con 0x562dcd1ab9b0 2024-06-02T04:53:56.936 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.935+0000 7fe6ee206b80 1 -- 172.21.15.76:0/2400053937 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562dcd1ab9b0 msgr2=0x562dcd1b5970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:53:56.936 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.935+0000 7fe6ee206b80 1 --2- 172.21.15.76:0/2400053937 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562dcd1ab9b0 0x562dcd1b5970 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe6cc00dbf0 tx=0x7fe6cc00dfb0 comp rx=0 tx=0).stop 2024-06-02T04:53:56.936 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.935+0000 7fe6ee206b80 1 -- 172.21.15.76:0/2400053937 shutdown_connections 2024-06-02T04:53:56.936 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.935+0000 7fe6ee206b80 1 --2- 172.21.15.76:0/2400053937 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562dcd1ad200 0x562dcd1b5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:56.936 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.935+0000 7fe6ee206b80 1 --2- 172.21.15.76:0/2400053937 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562dcd1ab9b0 0x562dcd1b5970 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:56.936 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.935+0000 7fe6ee206b80 1 --2- 172.21.15.76:0/2400053937 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562dcd1ac310 0x562dcd1bceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:56.936 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.935+0000 7fe6ee206b80 1 -- 172.21.15.76:0/2400053937 >> 172.21.15.76:0/2400053937 conn(0x562dcd10a1b0 msgr2=0x562dcd1d9520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:53:56.936 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.935+0000 7fe6ee206b80 1 -- 172.21.15.76:0/2400053937 shutdown_connections 2024-06-02T04:53:56.938 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.935+0000 7fe6ee206b80 1 -- 172.21.15.76:0/2400053937 wait complete. 2024-06-02T04:53:56.938 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.935+0000 7fe6ee206b80 1 -- start start 2024-06-02T04:53:56.938 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.936+0000 7fe6ee206b80 1 Processor -- start 2024-06-02T04:53:56.938 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.936+0000 7fe6ee206b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562dcd1ab9b0 0x562dcd1bab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:53:56.938 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.936+0000 7fe6ee206b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562dcd1ac310 0x562dcd1bb0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:53:56.938 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.936+0000 7fe6ee206b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562dcd1ad200 0x562dcd1bc090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:53:56.938 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.936+0000 7fe6ee206b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x562dcd1bc5d0 con 0x562dcd1ac310 2024-06-02T04:53:56.938 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.936+0000 7fe6ee206b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x562dcd1bc740 con 0x562dcd1ad200 2024-06-02T04:53:56.938 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.936+0000 7fe6ee206b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x562dcd1bc900 con 0x562dcd1ab9b0 2024-06-02T04:53:56.938 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.936+0000 7fe6ee206b80 10 client.0 _ll_register_callbacks cb 0x562dcd0a1ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:53:56.938 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.937+0000 7fe6db7fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562dcd1ab9b0 0x562dcd1bab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:53:56.939 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.937+0000 7fe6dbfff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562dcd1ad200 0x562dcd1bc090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:53:56.939 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.937+0000 7fe6daffd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562dcd1ac310 0x562dcd1bb0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:53:56.939 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.937+0000 7fe6dbfff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562dcd1ad200 0x562dcd1bc090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:53750/0 (socket says 172.21.15.76:53750) 2024-06-02T04:53:56.939 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.937+0000 7fe6daffd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562dcd1ac310 0x562dcd1bb0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:50444/0 (socket says 172.21.15.76:50444) 2024-06-02T04:53:56.939 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.937+0000 7fe6dbfff700 1 -- 172.21.15.76:0/2570428642 learned_addr learned my addr 172.21.15.76:0/2570428642 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:53:56.939 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.937+0000 7fe6dbfff700 1 -- 172.21.15.76:0/2570428642 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562dcd1ab9b0 msgr2=0x562dcd1bab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:53:56.939 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.937+0000 7fe6dbfff700 1 --2- 172.21.15.76:0/2570428642 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562dcd1ab9b0 0x562dcd1bab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:56.939 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.937+0000 7fe6dbfff700 1 -- 172.21.15.76:0/2570428642 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562dcd1ac310 msgr2=0x562dcd1bb0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:53:56.939 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.937+0000 7fe6dbfff700 1 --2- 172.21.15.76:0/2570428642 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562dcd1ac310 0x562dcd1bb0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:56.939 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.937+0000 7fe6dbfff700 1 -- 172.21.15.76:0/2570428642 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562dccf7d350 con 0x562dcd1ad200 2024-06-02T04:53:56.939 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.937+0000 7fe6dbfff700 1 --2- 172.21.15.76:0/2570428642 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562dcd1ad200 0x562dcd1bc090 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe6d4007d50 tx=0x7fe6d4007d80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8aa09e45c36daa54 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:53:56.939 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.937+0000 7fe6baffd700 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-06-02T04:53:56.940 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.938+0000 7fe6baffd700 1 -- 172.21.15.76:0/2570428642 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d400e040 con 0x562dcd1ad200 2024-06-02T04:53:56.940 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.938+0000 7fe6baffd700 1 -- 172.21.15.76:0/2570428642 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7fe6d4003a00 con 0x562dcd1ad200 2024-06-02T04:53:56.941 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.938+0000 7fe6ee206b80 1 -- 172.21.15.76:0/2570428642 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562dcd0f4e60 con 0x562dcd1ad200 2024-06-02T04:53:56.941 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.938+0000 7fe6baffd700 1 -- 172.21.15.76:0/2570428642 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe6d4003bc0 con 0x562dcd1ad200 2024-06-02T04:53:56.941 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.938+0000 7fe6ee206b80 10 client.25619 fetch_fsmap learned FSMap version 32 2024-06-02T04:53:56.941 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.938+0000 7fe6ee206b80 1 -- 172.21.15.76:0/2570428642 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x562dccf81c70 con 0x562dcd1ad200 2024-06-02T04:53:56.941 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.938+0000 7fe6baffd700 1 -- 172.21.15.76:0/2570428642 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x562dcd0f4e60 con 0x562dcd1ad200 2024-06-02T04:53:56.941 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.938+0000 7fe6baffd700 1 -- 172.21.15.76:0/2570428642 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 32) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fe6d400b050 con 0x562dcd1ad200 2024-06-02T04:53:56.941 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.938+0000 7fe6ee206b80 10 client.25619 fetch_fsmap finished waiting for FSMap version 32 2024-06-02T04:53:56.941 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.938+0000 7fe6ee206b80 10 client.25619 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T04:53:56.941 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.938+0000 7fe6ee206b80 20 client.25619 populate_metadata read hostname 'smithi076' 2024-06-02T04:53:56.941 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.938+0000 7fe6ee206b80 1 --2- 172.21.15.76:0/2570428642 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x562dcd229bf0 0x562dcd22c010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:53:56.941 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.938+0000 7fe6ee206b80 4 client.25619 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T04:53:56.941 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.938+0000 7fe6ee206b80 1 -- 172.21.15.76:0/2570428642 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x562dccf4ac90 con 0x562dcd229bf0 2024-06-02T04:53:56.942 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.939+0000 7fe6db7fe700 1 --2- 172.21.15.76:0/2570428642 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x562dcd229bf0 0x562dcd22c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:53:56.942 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.939+0000 7fe6baffd700 10 client.25619 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:53:56.942 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.939+0000 7fe6db7fe700 1 --2- 172.21.15.76:0/2570428642 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x562dcd229bf0 0x562dcd22c010 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7fec03b440203b23 server_cookie=70ccc52864167328 in_seq=0 out_seq=0 2024-06-02T04:53:56.953 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.952+0000 7fe6baffd700 1 -- 172.21.15.76:0/2570428642 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x562dccf4ac90 con 0x562dcd229bf0 2024-06-02T04:53:56.953 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.952+0000 7fe6baffd700 10 client.25619 handle_command_reply: tid=0 2024-06-02T04:53:56.953 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.952+0000 7fe6ee206b80 1 client.25619 shutdown 2024-06-02T04:53:56.955 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.954+0000 7fe6ee206b80 1 -- 172.21.15.76:0/2570428642 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562dcd1ad200 msgr2=0x562dcd1bc090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:53:56.955 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.954+0000 7fe6ee206b80 1 --2- 172.21.15.76:0/2570428642 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562dcd1ad200 0x562dcd1bc090 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe6d4007d50 tx=0x7fe6d4007d80 comp rx=0 tx=0).stop 2024-06-02T04:53:56.955 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.954+0000 7fe6ee206b80 1 -- 172.21.15.76:0/2570428642 shutdown_connections 2024-06-02T04:53:56.955 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.954+0000 7fe6ee206b80 1 --2- 172.21.15.76:0/2570428642 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x562dcd229bf0 0x562dcd22c010 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:56.955 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.954+0000 7fe6ee206b80 1 --2- 172.21.15.76:0/2570428642 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562dcd1ad200 0x562dcd1bc090 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:56.955 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.954+0000 7fe6ee206b80 1 --2- 172.21.15.76:0/2570428642 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562dcd1ab9b0 0x562dcd1bab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:56.956 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.954+0000 7fe6ee206b80 1 --2- 172.21.15.76:0/2570428642 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562dcd1ac310 0x562dcd1bb0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:56.956 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.954+0000 7fe6ee206b80 1 -- 172.21.15.76:0/2570428642 >> 172.21.15.76:0/2570428642 conn(0x562dcd10a1b0 msgr2=0x562dcd1b5910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:53:56.956 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.954+0000 7fe6baffd700 0 client.25619 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:53:56.956 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.954+0000 7fe6ee206b80 1 -- 172.21.15.76:0/2570428642 shutdown_connections 2024-06-02T04:53:56.956 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.955+0000 7fe6ee206b80 1 -- 172.21.15.76:0/2570428642 wait complete. 2024-06-02T04:53:56.956 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.955+0000 7fe6ee206b80 20 client.25619 trim_cache size 0 max 16384 2024-06-02T04:53:56.957 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:{ 2024-06-02T04:53:56.957 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "message": "", 2024-06-02T04:53:56.957 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "return_code": 0 2024-06-02T04:53:56.957 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:} 2024-06-02T04:53:56.958 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.955+0000 7fe6e204b700 1 -- 172.21.15.76:0/2312995541 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fe6c40a11f0 msgr2=0x7fe6c40a36b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:53:56.958 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.955+0000 7fe6e204b700 1 --2- 172.21.15.76:0/2312995541 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fe6c40a11f0 0x7fe6c40a36b0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fe6cc005e50 tx=0x7fe6cc005de0 comp rx=0 tx=0).stop 2024-06-02T04:53:56.958 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.955+0000 7fe6e204b700 1 -- 172.21.15.76:0/2312995541 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe6dc0ff930 msgr2=0x7fe6dc197410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:53:56.958 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.955+0000 7fe6e204b700 1 --2- 172.21.15.76:0/2312995541 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe6dc0ff930 0x7fe6dc197410 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe6d000bfa0 tx=0x7fe6d000dc60 comp rx=0 tx=0).stop 2024-06-02T04:53:56.958 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.955+0000 7fe6e204b700 1 -- 172.21.15.76:0/2312995541 shutdown_connections 2024-06-02T04:53:56.958 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.955+0000 7fe6e204b700 1 --2- 172.21.15.76:0/2312995541 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe6dc102520 0x7fe6dc19e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:56.958 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.955+0000 7fe6e204b700 1 --2- 172.21.15.76:0/2312995541 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe6dc0fef90 0x7fe6dc196ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:56.958 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.955+0000 7fe6e204b700 1 --2- 172.21.15.76:0/2312995541 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fe6c40a11f0 0x7fe6c40a36b0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:56.958 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.955+0000 7fe6e204b700 1 --2- 172.21.15.76:0/2312995541 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe6dc0ff930 0x7fe6dc197410 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:53:56.959 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.955+0000 7fe6e204b700 1 -- 172.21.15.76:0/2312995541 >> 172.21.15.76:0/2312995541 conn(0x7fe6dc0faaf0 msgr2=0x7fe6dc105620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:53:56.959 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.955+0000 7fe6e204b700 1 -- 172.21.15.76:0/2312995541 shutdown_connections 2024-06-02T04:53:56.959 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:53:56.956+0000 7fe6e204b700 1 -- 172.21.15.76:0/2312995541 wait complete. 2024-06-02T04:53:57.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:53:57 smithi119 ceph-mon[46633]: pgmap v399: 129 pgs: 129 active+clean; 1.5 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 16 MiB/s wr, 1.09k op/s 2024-06-02T04:53:57.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:53:57 smithi192 ceph-mon[47933]: pgmap v399: 129 pgs: 129 active+clean; 1.5 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 16 MiB/s wr, 1.09k op/s 2024-06-02T04:53:57.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:53:57 smithi076 ceph-mon[42935]: pgmap v399: 129 pgs: 129 active+clean; 1.5 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 16 MiB/s wr, 1.09k op/s 2024-06-02T04:53:59.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:53:59 smithi119 ceph-mon[46633]: pgmap v400: 129 pgs: 129 active+clean; 1.5 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 14 MiB/s wr, 1.02k op/s 2024-06-02T04:53:59.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:53:59 smithi192 ceph-mon[47933]: pgmap v400: 129 pgs: 129 active+clean; 1.5 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 14 MiB/s wr, 1.02k op/s 2024-06-02T04:53:59.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:53:59 smithi076 ceph-mon[42935]: pgmap v400: 129 pgs: 129 active+clean; 1.5 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 14 MiB/s wr, 1.02k op/s 2024-06-02T04:54:01.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 190.0 s, 937.4 tps, lat 106.925 ms stddev 34.868 2024-06-02T04:54:01.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:54:01 smithi119 ceph-mon[46633]: pgmap v401: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 15 MiB/s wr, 1.08k op/s 2024-06-02T04:54:01.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:54:01 smithi192 ceph-mon[47933]: pgmap v401: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 15 MiB/s wr, 1.08k op/s 2024-06-02T04:54:01.735 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:54:01 smithi076 ceph-mon[42935]: pgmap v401: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 15 MiB/s wr, 1.08k op/s 2024-06-02T04:54:03.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:54:03 smithi192 ceph-mon[47933]: pgmap v402: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 15 MiB/s wr, 1.04k op/s 2024-06-02T04:54:03.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:54:03 smithi076 ceph-mon[42935]: pgmap v402: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 15 MiB/s wr, 1.04k op/s 2024-06-02T04:54:03.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:54:03 smithi119 ceph-mon[46633]: pgmap v402: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 15 MiB/s wr, 1.04k op/s 2024-06-02T04:54:05.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:54:05 smithi192 ceph-mon[47933]: pgmap v403: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 13 MiB/s wr, 950 op/s 2024-06-02T04:54:05.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:54:05 smithi076 ceph-mon[42935]: pgmap v403: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 13 MiB/s wr, 950 op/s 2024-06-02T04:54:05.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:54:05 smithi119 ceph-mon[46633]: pgmap v403: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 13 MiB/s wr, 950 op/s 2024-06-02T04:54:06.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 195.0 s, 980.8 tps, lat 101.175 ms stddev 46.334 2024-06-02T04:54:07.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:54:07 smithi192 ceph-mon[47933]: pgmap v404: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 14 MiB/s wr, 1.07k op/s 2024-06-02T04:54:07.736 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:54:07 smithi076 ceph-mon[42935]: pgmap v404: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 14 MiB/s wr, 1.07k op/s 2024-06-02T04:54:07.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:54:07 smithi119 ceph-mon[46633]: pgmap v404: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 14 MiB/s wr, 1.07k op/s 2024-06-02T04:54:09.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:54:09 smithi192 ceph-mon[47933]: pgmap v405: 129 pgs: 129 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 14 MiB/s wr, 1.06k op/s 2024-06-02T04:54:09.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:54:09 smithi076 ceph-mon[42935]: pgmap v405: 129 pgs: 129 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 14 MiB/s wr, 1.06k op/s 2024-06-02T04:54:09.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:54:09 smithi119 ceph-mon[46633]: pgmap v405: 129 pgs: 129 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 14 MiB/s wr, 1.06k op/s 2024-06-02T04:54:10.126 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.125+0000 7f8c4820c700 1 -- 172.21.15.76:0/274746609 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c40101330 msgr2=0x7f8c40101750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:54:10.126 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.125+0000 7f8c4820c700 1 --2- 172.21.15.76:0/274746609 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c40101330 0x7f8c40101750 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c009990 tx=0x7f8c3c009ca0 comp rx=0 tx=0).stop 2024-06-02T04:54:10.128 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.126+0000 7f8c4820c700 1 -- 172.21.15.76:0/274746609 shutdown_connections 2024-06-02T04:54:10.128 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.126+0000 7f8c4820c700 1 --2- 172.21.15.76:0/274746609 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8c40100940 0x7f8c40108270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:10.129 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.126+0000 7f8c4820c700 1 --2- 172.21.15.76:0/274746609 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c40101330 0x7f8c40101750 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:10.129 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.126+0000 7f8c4820c700 1 --2- 172.21.15.76:0/274746609 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8c400fff80 0x7f8c40100400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:10.129 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.126+0000 7f8c4820c700 1 -- 172.21.15.76:0/274746609 >> 172.21.15.76:0/274746609 conn(0x7f8c400faaf0 msgr2=0x7f8c400fcf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:54:10.129 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.128+0000 7f8c4820c700 1 -- 172.21.15.76:0/274746609 shutdown_connections 2024-06-02T04:54:10.129 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.128+0000 7f8c4820c700 1 -- 172.21.15.76:0/274746609 wait complete. 2024-06-02T04:54:10.130 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.129+0000 7f8c4820c700 1 Processor -- start 2024-06-02T04:54:10.130 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.129+0000 7f8c4820c700 1 -- start start 2024-06-02T04:54:10.130 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.129+0000 7f8c4820c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c400fff80 0x7f8c40199010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:54:10.130 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.129+0000 7f8c4820c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8c40100940 0x7f8c40199550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:54:10.130 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.129+0000 7f8c4820c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8c40101330 0x7f8c401a0570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:54:10.130 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.129+0000 7f8c4820c700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c401a0b40 con 0x7f8c40100940 2024-06-02T04:54:10.130 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.129+0000 7f8c4820c700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c401a0c80 con 0x7f8c400fff80 2024-06-02T04:54:10.131 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.129+0000 7f8c4820c700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c401a0e10 con 0x7f8c40101330 2024-06-02T04:54:10.131 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.129+0000 7f8c467a9700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8c40101330 0x7f8c401a0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:54:10.131 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.130+0000 7f8c467a9700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8c40101330 0x7f8c401a0570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:40732/0 (socket says 172.21.15.76:40732) 2024-06-02T04:54:10.131 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.130+0000 7f8c467a9700 1 -- 172.21.15.76:0/3020543364 learned_addr learned my addr 172.21.15.76:0/3020543364 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:54:10.132 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.130+0000 7f8c45fa8700 1 --2- 172.21.15.76:0/3020543364 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c400fff80 0x7f8c40199010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:54:10.132 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.130+0000 7f8c457a7700 1 --2- 172.21.15.76:0/3020543364 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8c40100940 0x7f8c40199550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:54:10.132 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.130+0000 7f8c467a9700 1 -- 172.21.15.76:0/3020543364 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c400fff80 msgr2=0x7f8c40199010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:54:10.132 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.130+0000 7f8c467a9700 1 --2- 172.21.15.76:0/3020543364 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c400fff80 0x7f8c40199010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:10.132 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.130+0000 7f8c467a9700 1 -- 172.21.15.76:0/3020543364 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8c40100940 msgr2=0x7f8c40199550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:54:10.132 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.130+0000 7f8c467a9700 1 --2- 172.21.15.76:0/3020543364 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8c40100940 0x7f8c40199550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:10.132 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.130+0000 7f8c467a9700 1 -- 172.21.15.76:0/3020543364 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c3c0095f0 con 0x7f8c40101330 2024-06-02T04:54:10.132 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.131+0000 7f8c467a9700 1 --2- 172.21.15.76:0/3020543364 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8c40101330 0x7f8c401a0570 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8c38007ee0 tx=0x7f8c3800d3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:54:10.132 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.131+0000 7f8c36ffd700 1 -- 172.21.15.76:0/3020543364 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c38017070 con 0x7f8c40101330 2024-06-02T04:54:10.132 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.131+0000 7f8c36ffd700 1 -- 172.21.15.76:0/3020543364 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8c3800f040 con 0x7f8c40101330 2024-06-02T04:54:10.132 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.131+0000 7f8c36ffd700 1 -- 172.21.15.76:0/3020543364 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c38005710 con 0x7f8c40101330 2024-06-02T04:54:10.133 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.132+0000 7f8c4820c700 1 -- 172.21.15.76:0/3020543364 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c401a10f0 con 0x7f8c40101330 2024-06-02T04:54:10.133 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.132+0000 7f8c4820c700 1 -- 172.21.15.76:0/3020543364 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c401a1580 con 0x7f8c40101330 2024-06-02T04:54:10.136 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.135+0000 7f8c36ffd700 1 -- 172.21.15.76:0/3020543364 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f8c38005870 con 0x7f8c40101330 2024-06-02T04:54:10.136 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.136+0000 7f8c36ffd700 1 --2- 172.21.15.76:0/3020543364 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f8c2c0a12f0 0x7f8c2c0a37b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:54:10.137 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.136+0000 7f8c36ffd700 1 -- 172.21.15.76:0/3020543364 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f8c380cbab0 con 0x7f8c40101330 2024-06-02T04:54:10.138 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.136+0000 7f8c543c7b80 1 Processor -- start 2024-06-02T04:54:10.138 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.137+0000 7f8c543c7b80 1 -- start start 2024-06-02T04:54:10.138 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.137+0000 7f8c543c7b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c248146a80 0x55c248146ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:54:10.138 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.137+0000 7f8c543c7b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c2481473e0 0x55c248147cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:54:10.138 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.137+0000 7f8c543c7b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c2481482d0 0x55c248148750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:54:10.138 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.137+0000 7f8c543c7b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c24809e0f0 con 0x55c2481482d0 2024-06-02T04:54:10.139 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.137+0000 7f8c543c7b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c24809bab0 con 0x55c2481473e0 2024-06-02T04:54:10.139 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.137+0000 7f8c543c7b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2480973a0 con 0x55c248146a80 2024-06-02T04:54:10.139 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.137+0000 7f8c45fa8700 1 --2- 172.21.15.76:0/3020543364 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f8c2c0a12f0 0x7f8c2c0a37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:54:10.139 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.137+0000 7f8c457a7700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c2481473e0 0x55c248147cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:54:10.139 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.137+0000 7f8c457a7700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c2481473e0 0x55c248147cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:57376/0 (socket says 172.21.15.76:57376) 2024-06-02T04:54:10.139 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.137+0000 7f8c457a7700 1 -- 172.21.15.76:0/3142288403 learned_addr learned my addr 172.21.15.76:0/3142288403 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:54:10.139 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.137+0000 7f8c467a9700 1 --2- 172.21.15.76:0/3142288403 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c2481482d0 0x55c248148750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:54:10.139 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.137+0000 7f8c45fa8700 1 --2- 172.21.15.76:0/3142288403 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c248146a80 0x55c248146ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:54:10.139 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.138+0000 7f8c457a7700 1 -- 172.21.15.76:0/3142288403 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c248146a80 msgr2=0x55c248146ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:54:10.139 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.138+0000 7f8c457a7700 1 --2- 172.21.15.76:0/3142288403 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c248146a80 0x55c248146ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:10.139 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.138+0000 7f8c457a7700 1 -- 172.21.15.76:0/3142288403 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c2481482d0 msgr2=0x55c248148750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:54:10.139 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.138+0000 7f8c457a7700 1 --2- 172.21.15.76:0/3142288403 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c2481482d0 0x55c248148750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:10.139 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.138+0000 7f8c457a7700 1 -- 172.21.15.76:0/3142288403 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c247f18350 con 0x55c2481473e0 2024-06-02T04:54:10.141 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.138+0000 7f8c457a7700 1 --2- 172.21.15.76:0/3142288403 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c2481473e0 0x55c248147cf0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8c30009cb0 tx=0x7f8c300113e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8c227bcda7544d30 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:54:10.141 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.138+0000 7f8c2bfff700 1 -- 172.21.15.76:0/3142288403 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c300097b0 con 0x55c2481473e0 2024-06-02T04:54:10.141 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.138+0000 7f8c45fa8700 1 --2- 172.21.15.76:0/3020543364 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f8c2c0a12f0 0x7f8c2c0a37b0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c006010 tx=0x7f8c3c00b610 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:54:10.141 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.138+0000 7f8c2bfff700 1 -- 172.21.15.76:0/3142288403 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8c30011c60 con 0x55c2481473e0 2024-06-02T04:54:10.141 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.138+0000 7f8c2bfff700 1 -- 172.21.15.76:0/3142288403 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c3000f6a0 con 0x55c2481473e0 2024-06-02T04:54:10.141 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.139+0000 7f8c543c7b80 1 -- 172.21.15.76:0/3142288403 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c2481473e0 msgr2=0x55c248147cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:54:10.142 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.139+0000 7f8c543c7b80 1 --2- 172.21.15.76:0/3142288403 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c2481473e0 0x55c248147cf0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8c30009cb0 tx=0x7f8c300113e0 comp rx=0 tx=0).stop 2024-06-02T04:54:10.142 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.139+0000 7f8c543c7b80 1 -- 172.21.15.76:0/3142288403 shutdown_connections 2024-06-02T04:54:10.142 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.139+0000 7f8c543c7b80 1 --2- 172.21.15.76:0/3142288403 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c2481482d0 0x55c248148750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:10.142 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.139+0000 7f8c543c7b80 1 --2- 172.21.15.76:0/3142288403 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c248146a80 0x55c248146ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:10.142 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.139+0000 7f8c543c7b80 1 --2- 172.21.15.76:0/3142288403 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c2481473e0 0x55c248147cf0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:10.142 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.139+0000 7f8c543c7b80 1 -- 172.21.15.76:0/3142288403 >> 172.21.15.76:0/3142288403 conn(0x55c2480a51b0 msgr2=0x55c248143440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:54:10.142 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.139+0000 7f8c543c7b80 1 -- 172.21.15.76:0/3142288403 shutdown_connections 2024-06-02T04:54:10.142 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.139+0000 7f8c543c7b80 1 -- 172.21.15.76:0/3142288403 wait complete. 2024-06-02T04:54:10.142 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.139+0000 7f8c543c7b80 1 -- start start 2024-06-02T04:54:10.142 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.140+0000 7f8c543c7b80 1 Processor -- start 2024-06-02T04:54:10.142 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.140+0000 7f8c543c7b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c248146a80 0x55c2481590a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:54:10.142 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.140+0000 7f8c543c7b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c2481473e0 0x55c2481595e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:54:10.143 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.140+0000 7f8c543c7b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c2481482d0 0x55c248160620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:54:10.143 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.140+0000 7f8c543c7b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c248033500 con 0x55c2481473e0 2024-06-02T04:54:10.143 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.140+0000 7f8c543c7b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2480331a0 con 0x55c2481482d0 2024-06-02T04:54:10.143 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.140+0000 7f8c543c7b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c247f1a640 con 0x55c248146a80 2024-06-02T04:54:10.143 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.140+0000 7f8c543c7b80 10 client.0 _ll_register_callbacks cb 0x55c24803cad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:54:10.143 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.140+0000 7f8c457a7700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c2481473e0 0x55c2481595e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:54:10.143 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.141+0000 7f8c45fa8700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c248146a80 0x55c2481590a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:54:10.143 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.141+0000 7f8c457a7700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c2481473e0 0x55c2481595e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:56888/0 (socket says 172.21.15.76:56888) 2024-06-02T04:54:10.143 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.141+0000 7f8c457a7700 1 -- 172.21.15.76:0/2338279545 learned_addr learned my addr 172.21.15.76:0/2338279545 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:54:10.143 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.141+0000 7f8c467a9700 1 --2- 172.21.15.76:0/2338279545 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c2481482d0 0x55c248160620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:54:10.145 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.141+0000 7f8c467a9700 1 -- 172.21.15.76:0/2338279545 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c248146a80 msgr2=0x55c2481590a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:54:10.145 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.141+0000 7f8c467a9700 1 --2- 172.21.15.76:0/2338279545 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c248146a80 0x55c2481590a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:10.145 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.141+0000 7f8c467a9700 1 -- 172.21.15.76:0/2338279545 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c2481473e0 msgr2=0x55c2481595e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:54:10.145 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.141+0000 7f8c467a9700 1 --2- 172.21.15.76:0/2338279545 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c2481473e0 0x55c2481595e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:10.145 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.141+0000 7f8c467a9700 1 -- 172.21.15.76:0/2338279545 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c30009910 con 0x55c2481482d0 2024-06-02T04:54:10.145 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.141+0000 7f8c467a9700 1 --2- 172.21.15.76:0/2338279545 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c2481482d0 0x55c248160620 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8c380c9210 tx=0x7f8c38098540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42ccbd0e93ee5ccf server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:54:10.145 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.141+0000 7f8c297fa700 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-06-02T04:54:10.145 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.141+0000 7f8c297fa700 1 -- 172.21.15.76:0/2338279545 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c38098250 con 0x55c2481482d0 2024-06-02T04:54:10.145 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.141+0000 7f8c543c7b80 1 -- 172.21.15.76:0/2338279545 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c247ff0210 con 0x55c2481482d0 2024-06-02T04:54:10.146 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.141+0000 7f8c297fa700 1 -- 172.21.15.76:0/2338279545 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f8c380112b0 con 0x55c2481482d0 2024-06-02T04:54:10.146 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.142+0000 7f8c457a7700 1 --2- 172.21.15.76:0/2338279545 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c2481473e0 0x55c2481595e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:54:10.146 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.143+0000 7f8c297fa700 1 -- 172.21.15.76:0/2338279545 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8c38099260 con 0x55c2481482d0 2024-06-02T04:54:10.146 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.143+0000 7f8c543c7b80 10 client.25631 fetch_fsmap learned FSMap version 32 2024-06-02T04:54:10.146 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.143+0000 7f8c543c7b80 1 -- 172.21.15.76:0/2338279545 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x55c247ec4b00 con 0x55c2481482d0 2024-06-02T04:54:10.146 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.143+0000 7f8c297fa700 1 -- 172.21.15.76:0/2338279545 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55c247ff0210 con 0x55c2481482d0 2024-06-02T04:54:10.146 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.144+0000 7f8c297fa700 1 -- 172.21.15.76:0/2338279545 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 32) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f8c380b1210 con 0x55c2481482d0 2024-06-02T04:54:10.146 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.144+0000 7f8c543c7b80 10 client.25631 fetch_fsmap finished waiting for FSMap version 32 2024-06-02T04:54:10.146 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.144+0000 7f8c543c7b80 10 client.25631 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T04:54:10.146 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.144+0000 7f8c543c7b80 20 client.25631 populate_metadata read hostname 'smithi076' 2024-06-02T04:54:10.147 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.144+0000 7f8c543c7b80 1 --2- 172.21.15.76:0/2338279545 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55c248164ed0 0x55c2481672f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:54:10.147 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.144+0000 7f8c543c7b80 4 client.25631 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T04:54:10.147 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.144+0000 7f8c543c7b80 1 -- 172.21.15.76:0/2338279545 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c2481167b0 con 0x55c248164ed0 2024-06-02T04:54:10.148 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.144+0000 7f8c45fa8700 1 --2- 172.21.15.76:0/2338279545 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55c248164ed0 0x55c2481672f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:54:10.148 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.146+0000 7f8c45fa8700 1 --2- 172.21.15.76:0/2338279545 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55c248164ed0 0x55c2481672f0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7a633a5ca78e3bab server_cookie=9904766383e18bc3 in_seq=0 out_seq=0 2024-06-02T04:54:10.148 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.146+0000 7f8c297fa700 10 client.25631 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:54:10.148 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.147+0000 7f8c297fa700 1 -- 172.21.15.76:0/2338279545 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55c2481167b0 con 0x55c248164ed0 2024-06-02T04:54:10.148 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.147+0000 7f8c297fa700 10 client.25631 handle_command_reply: tid=0 2024-06-02T04:54:10.148 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.147+0000 7f8c543c7b80 1 client.25631 shutdown 2024-06-02T04:54:10.154 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.154+0000 7f8c543c7b80 1 -- 172.21.15.76:0/2338279545 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c2481482d0 msgr2=0x55c248160620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:54:10.155 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.154+0000 7f8c543c7b80 1 --2- 172.21.15.76:0/2338279545 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c2481482d0 0x55c248160620 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8c380c9210 tx=0x7f8c38098540 comp rx=0 tx=0).stop 2024-06-02T04:54:10.155 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.154+0000 7f8c543c7b80 1 -- 172.21.15.76:0/2338279545 shutdown_connections 2024-06-02T04:54:10.155 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.154+0000 7f8c543c7b80 1 --2- 172.21.15.76:0/2338279545 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55c248164ed0 0x55c2481672f0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:10.155 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.154+0000 7f8c543c7b80 1 --2- 172.21.15.76:0/2338279545 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c2481482d0 0x55c248160620 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:10.155 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.154+0000 7f8c543c7b80 1 --2- 172.21.15.76:0/2338279545 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c248146a80 0x55c2481590a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:10.155 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.154+0000 7f8c543c7b80 1 --2- 172.21.15.76:0/2338279545 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c2481473e0 0x55c2481595e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:10.155 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.154+0000 7f8c543c7b80 1 -- 172.21.15.76:0/2338279545 >> 172.21.15.76:0/2338279545 conn(0x55c2480a51b0 msgr2=0x55c248141860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:54:10.155 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.154+0000 7f8c297fa700 0 client.25631 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:54:10.155 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.154+0000 7f8c543c7b80 1 -- 172.21.15.76:0/2338279545 shutdown_connections 2024-06-02T04:54:10.155 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.154+0000 7f8c543c7b80 1 -- 172.21.15.76:0/2338279545 wait complete. 2024-06-02T04:54:10.156 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.155+0000 7f8c543c7b80 20 client.25631 trim_cache size 0 max 16384 2024-06-02T04:54:10.183 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.183+0000 7f8c543c7b80 1 Processor -- start 2024-06-02T04:54:10.184 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.183+0000 7f8c543c7b80 1 -- start start 2024-06-02T04:54:10.184 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.183+0000 7f8c543c7b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c248146a80 0x55c24814fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:54:10.184 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.183+0000 7f8c543c7b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c2481473e0 0x55c2481605e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:54:10.184 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.183+0000 7f8c543c7b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c2481482d0 0x55c2481486b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:54:10.184 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.183+0000 7f8c543c7b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c248146720 con 0x55c2481473e0 2024-06-02T04:54:10.184 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.183+0000 7f8c543c7b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c24813c7c0 con 0x55c2481482d0 2024-06-02T04:54:10.184 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.183+0000 7f8c543c7b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c24813e9b0 con 0x55c248146a80 2024-06-02T04:54:10.185 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.183+0000 7f8c467a9700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c2481482d0 0x55c2481486b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:54:10.185 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.183+0000 7f8c467a9700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c2481482d0 0x55c2481486b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:57392/0 (socket says 172.21.15.76:57392) 2024-06-02T04:54:10.185 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.183+0000 7f8c467a9700 1 -- 172.21.15.76:0/3061726445 learned_addr learned my addr 172.21.15.76:0/3061726445 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:54:10.185 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.184+0000 7f8c467a9700 1 -- 172.21.15.76:0/3061726445 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c248146a80 msgr2=0x55c24814fda0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-02T04:54:10.185 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.184+0000 7f8c467a9700 1 --2- 172.21.15.76:0/3061726445 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c248146a80 0x55c24814fda0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:10.185 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.184+0000 7f8c467a9700 1 -- 172.21.15.76:0/3061726445 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c2481473e0 msgr2=0x55c2481605e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:54:10.185 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.184+0000 7f8c467a9700 1 --2- 172.21.15.76:0/3061726445 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c2481473e0 0x55c2481605e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:10.185 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.184+0000 7f8c467a9700 1 -- 172.21.15.76:0/3061726445 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c24805d500 con 0x55c2481482d0 2024-06-02T04:54:10.186 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.184+0000 7f8c467a9700 1 --2- 172.21.15.76:0/3061726445 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c2481482d0 0x55c2481486b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8c38098af0 tx=0x7f8c380c9240 comp rx=0 tx=0).ready entity=mon.2 client_cookie=11e4c166bb17f0c8 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:54:10.186 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.184+0000 7f8c34ff9700 1 -- 172.21.15.76:0/3061726445 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c380112b0 con 0x55c2481482d0 2024-06-02T04:54:10.186 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.184+0000 7f8c34ff9700 1 -- 172.21.15.76:0/3061726445 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8c38099260 con 0x55c2481482d0 2024-06-02T04:54:10.186 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.184+0000 7f8c34ff9700 1 -- 172.21.15.76:0/3061726445 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c38098050 con 0x55c2481482d0 2024-06-02T04:54:10.186 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.185+0000 7f8c543c7b80 1 -- 172.21.15.76:0/3061726445 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c2481482d0 msgr2=0x55c2481486b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:54:10.187 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.185+0000 7f8c543c7b80 1 --2- 172.21.15.76:0/3061726445 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c2481482d0 0x55c2481486b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8c38098af0 tx=0x7f8c380c9240 comp rx=0 tx=0).stop 2024-06-02T04:54:10.187 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.185+0000 7f8c543c7b80 1 -- 172.21.15.76:0/3061726445 shutdown_connections 2024-06-02T04:54:10.187 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.185+0000 7f8c543c7b80 1 --2- 172.21.15.76:0/3061726445 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c2481482d0 0x55c2481486b0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:10.187 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.185+0000 7f8c543c7b80 1 --2- 172.21.15.76:0/3061726445 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c248146a80 0x55c24814fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:10.187 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.185+0000 7f8c543c7b80 1 --2- 172.21.15.76:0/3061726445 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c2481473e0 0x55c2481605e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:10.187 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.186+0000 7f8c543c7b80 1 -- 172.21.15.76:0/3061726445 >> 172.21.15.76:0/3061726445 conn(0x55c2480a51b0 msgr2=0x55c24814e830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:54:10.187 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.186+0000 7f8c543c7b80 1 -- 172.21.15.76:0/3061726445 shutdown_connections 2024-06-02T04:54:10.190 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.187+0000 7f8c543c7b80 1 -- 172.21.15.76:0/3061726445 wait complete. 2024-06-02T04:54:10.190 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.187+0000 7f8c543c7b80 1 -- start start 2024-06-02T04:54:10.190 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.187+0000 7f8c543c7b80 1 Processor -- start 2024-06-02T04:54:10.190 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.188+0000 7f8c543c7b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c248146a80 0x55c24815bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:54:10.190 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.188+0000 7f8c543c7b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c2481473e0 0x55c24815c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:54:10.190 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.188+0000 7f8c543c7b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c2481482d0 0x55c24815f000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:54:10.190 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.188+0000 7f8c543c7b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c24815f540 con 0x55c2481482d0 2024-06-02T04:54:10.190 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.188+0000 7f8c543c7b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c24815f6b0 con 0x55c248146a80 2024-06-02T04:54:10.190 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.188+0000 7f8c543c7b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c24815f870 con 0x55c2481473e0 2024-06-02T04:54:10.190 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.188+0000 7f8c543c7b80 10 client.0 _ll_register_callbacks cb 0x55c24803cad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:54:10.191 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.188+0000 7f8c45fa8700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c248146a80 0x55c24815bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:54:10.191 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.188+0000 7f8c45fa8700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c248146a80 0x55c24815bbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:57396/0 (socket says 172.21.15.76:57396) 2024-06-02T04:54:10.191 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.188+0000 7f8c45fa8700 1 -- 172.21.15.76:0/2987633921 learned_addr learned my addr 172.21.15.76:0/2987633921 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:54:10.191 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.188+0000 7f8c467a9700 1 --2- 172.21.15.76:0/2987633921 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c2481482d0 0x55c24815f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:54:10.191 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.188+0000 7f8c45fa8700 1 -- 172.21.15.76:0/2987633921 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c2481473e0 msgr2=0x55c24815c120 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-02T04:54:10.191 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.188+0000 7f8c45fa8700 1 --2- 172.21.15.76:0/2987633921 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c2481473e0 0x55c24815c120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:10.191 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.188+0000 7f8c45fa8700 1 -- 172.21.15.76:0/2987633921 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c2481482d0 msgr2=0x55c24815f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:54:10.191 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.188+0000 7f8c45fa8700 1 --2- 172.21.15.76:0/2987633921 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c2481482d0 0x55c24815f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:10.191 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.188+0000 7f8c45fa8700 1 -- 172.21.15.76:0/2987633921 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c247ec4b00 con 0x55c248146a80 2024-06-02T04:54:10.191 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.189+0000 7f8c45fa8700 1 --2- 172.21.15.76:0/2987633921 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c248146a80 0x55c24815bbe0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c009990 tx=0x7f8c3c009310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=88443033c862a0b4 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:54:10.191 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.189+0000 7f8c297fa700 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-06-02T04:54:10.191 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.189+0000 7f8c297fa700 1 -- 172.21.15.76:0/2987633921 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c3c02f040 con 0x55c248146a80 2024-06-02T04:54:10.191 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.189+0000 7f8c297fa700 1 -- 172.21.15.76:0/2987633921 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f8c3c01e070 con 0x55c248146a80 2024-06-02T04:54:10.192 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.189+0000 7f8c543c7b80 1 -- 172.21.15.76:0/2987633921 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8c30011c60 con 0x55c248146a80 2024-06-02T04:54:10.192 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.189+0000 7f8c297fa700 1 -- 172.21.15.76:0/2987633921 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8c3c01d030 con 0x55c248146a80 2024-06-02T04:54:10.192 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.189+0000 7f8c543c7b80 10 client.25637 fetch_fsmap learned FSMap version 32 2024-06-02T04:54:10.192 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.189+0000 7f8c543c7b80 1 -- 172.21.15.76:0/2987633921 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x55c247f1cc70 con 0x55c248146a80 2024-06-02T04:54:10.192 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.190+0000 7f8c297fa700 1 -- 172.21.15.76:0/2987633921 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8c30011c60 con 0x55c248146a80 2024-06-02T04:54:10.192 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.190+0000 7f8c297fa700 1 -- 172.21.15.76:0/2987633921 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 32) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f8c3c00f570 con 0x55c248146a80 2024-06-02T04:54:10.193 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.190+0000 7f8c543c7b80 10 client.25637 fetch_fsmap finished waiting for FSMap version 32 2024-06-02T04:54:10.193 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.190+0000 7f8c543c7b80 10 client.25637 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T04:54:10.193 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.190+0000 7f8c543c7b80 20 client.25637 populate_metadata read hostname 'smithi076' 2024-06-02T04:54:10.193 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.190+0000 7f8c543c7b80 1 --2- 172.21.15.76:0/2987633921 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55c2481ccb10 0x55c2481cef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:54:10.193 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.190+0000 7f8c543c7b80 4 client.25637 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T04:54:10.193 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.190+0000 7f8c543c7b80 1 -- 172.21.15.76:0/2987633921 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55c24808fe60 con 0x55c2481ccb10 2024-06-02T04:54:10.193 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.190+0000 7f8c457a7700 1 --2- 172.21.15.76:0/2987633921 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55c2481ccb10 0x55c2481cef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:54:10.193 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.191+0000 7f8c297fa700 10 client.25637 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:54:10.193 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.191+0000 7f8c457a7700 1 --2- 172.21.15.76:0/2987633921 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55c2481ccb10 0x55c2481cef30 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=80b5538afe2c96bf server_cookie=6b957d1c983d7656 in_seq=0 out_seq=0 2024-06-02T04:54:10.223 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.223+0000 7f8c297fa700 1 -- 172.21.15.76:0/2987633921 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55c24808fe60 con 0x55c2481ccb10 2024-06-02T04:54:10.223 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.223+0000 7f8c297fa700 10 client.25637 handle_command_reply: tid=0 2024-06-02T04:54:10.223 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.223+0000 7f8c543c7b80 1 client.25637 shutdown 2024-06-02T04:54:10.224 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.224+0000 7f8c543c7b80 1 -- 172.21.15.76:0/2987633921 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c248146a80 msgr2=0x55c24815bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:54:10.224 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.224+0000 7f8c543c7b80 1 --2- 172.21.15.76:0/2987633921 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c248146a80 0x55c24815bbe0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c009990 tx=0x7f8c3c009310 comp rx=0 tx=0).stop 2024-06-02T04:54:10.225 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.224+0000 7f8c543c7b80 1 -- 172.21.15.76:0/2987633921 shutdown_connections 2024-06-02T04:54:10.225 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.224+0000 7f8c543c7b80 1 --2- 172.21.15.76:0/2987633921 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55c2481ccb10 0x55c2481cef30 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:10.225 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.224+0000 7f8c543c7b80 1 --2- 172.21.15.76:0/2987633921 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c2481482d0 0x55c24815f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:10.225 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.224+0000 7f8c543c7b80 1 --2- 172.21.15.76:0/2987633921 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c248146a80 0x55c24815bbe0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:10.225 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.224+0000 7f8c543c7b80 1 --2- 172.21.15.76:0/2987633921 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c2481473e0 0x55c24815c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:10.225 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.224+0000 7f8c543c7b80 1 -- 172.21.15.76:0/2987633921 >> 172.21.15.76:0/2987633921 conn(0x55c2480a51b0 msgr2=0x55c248143020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:54:10.225 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.224+0000 7f8c297fa700 0 client.25637 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:54:10.225 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.225+0000 7f8c543c7b80 1 -- 172.21.15.76:0/2987633921 shutdown_connections 2024-06-02T04:54:10.226 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.225+0000 7f8c543c7b80 1 -- 172.21.15.76:0/2987633921 wait complete. 2024-06-02T04:54:10.226 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.225+0000 7f8c543c7b80 20 client.25637 trim_cache size 0 max 16384 2024-06-02T04:54:10.226 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:{ 2024-06-02T04:54:10.226 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "message": "", 2024-06-02T04:54:10.226 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "return_code": 0 2024-06-02T04:54:10.226 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:} 2024-06-02T04:54:10.233 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.226+0000 7f8c4820c700 1 -- 172.21.15.76:0/3020543364 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f8c2c0a12f0 msgr2=0x7f8c2c0a37b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:54:10.233 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.226+0000 7f8c4820c700 1 --2- 172.21.15.76:0/3020543364 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f8c2c0a12f0 0x7f8c2c0a37b0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c006010 tx=0x7f8c3c00b610 comp rx=0 tx=0).stop 2024-06-02T04:54:10.233 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.226+0000 7f8c4820c700 1 -- 172.21.15.76:0/3020543364 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8c40101330 msgr2=0x7f8c401a0570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:54:10.233 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.226+0000 7f8c4820c700 1 --2- 172.21.15.76:0/3020543364 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8c40101330 0x7f8c401a0570 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8c38007ee0 tx=0x7f8c3800d3b0 comp rx=0 tx=0).stop 2024-06-02T04:54:10.233 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.226+0000 7f8c4820c700 1 -- 172.21.15.76:0/3020543364 shutdown_connections 2024-06-02T04:54:10.233 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.226+0000 7f8c4820c700 1 --2- 172.21.15.76:0/3020543364 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8c40101330 0x7f8c401a0570 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:10.233 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.226+0000 7f8c4820c700 1 --2- 172.21.15.76:0/3020543364 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f8c2c0a12f0 0x7f8c2c0a37b0 secure :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c006010 tx=0x7f8c3c00b610 comp rx=0 tx=0).stop 2024-06-02T04:54:10.233 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.226+0000 7f8c4820c700 1 --2- 172.21.15.76:0/3020543364 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c400fff80 0x7f8c40199010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:10.233 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.226+0000 7f8c4820c700 1 --2- 172.21.15.76:0/3020543364 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8c40100940 0x7f8c40199550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:10.234 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.226+0000 7f8c4820c700 1 -- 172.21.15.76:0/3020543364 >> 172.21.15.76:0/3020543364 conn(0x7f8c400faaf0 msgr2=0x7f8c400fef20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:54:10.234 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.233+0000 7f8c4820c700 1 -- 172.21.15.76:0/3020543364 shutdown_connections 2024-06-02T04:54:10.234 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:10.233+0000 7f8c4820c700 1 -- 172.21.15.76:0/3020543364 wait complete. 2024-06-02T04:54:10.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:54:10 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:54:10.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:54:10 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:54:10.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:54:10 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:54:10.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:54:10 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:54:10.683 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:54:10 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:54:10.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:54:10 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:54:10.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:54:10 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:54:10.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:54:10 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:54:10.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:54:10 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:54:10.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:54:10 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:54:10.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:54:10 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:54:10.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:54:10 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:54:10.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:54:10 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:54:10.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:54:10 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:54:10.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:54:10 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:54:11.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 200.0 s, 854.8 tps, lat 118.085 ms stddev 49.612 2024-06-02T04:54:11.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:54:11 smithi192 ceph-mon[47933]: pgmap v406: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 14 MiB/s wr, 1.02k op/s 2024-06-02T04:54:11.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:54:11 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:54:11.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:54:11 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:54:11.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:54:11 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:54:11.735 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:54:11 smithi076 ceph-mon[42935]: pgmap v406: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 14 MiB/s wr, 1.02k op/s 2024-06-02T04:54:11.735 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:54:11 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:54:11.735 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:54:11 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:54:11.735 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:54:11 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:54:11.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:54:11 smithi119 ceph-mon[46633]: pgmap v406: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 14 MiB/s wr, 1.02k op/s 2024-06-02T04:54:11.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:54:11 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:54:11.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:54:11 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:54:11.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:54:11 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:54:13.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:54:13 smithi192 ceph-mon[47933]: pgmap v407: 129 pgs: 129 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 14 MiB/s wr, 1.05k op/s 2024-06-02T04:54:13.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:54:13 smithi076 ceph-mon[42935]: pgmap v407: 129 pgs: 129 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 14 MiB/s wr, 1.05k op/s 2024-06-02T04:54:13.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:54:13 smithi119 ceph-mon[46633]: pgmap v407: 129 pgs: 129 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 14 MiB/s wr, 1.05k op/s 2024-06-02T04:54:15.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:54:15 smithi192 ceph-mon[47933]: pgmap v408: 129 pgs: 129 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 12 MiB/s wr, 937 op/s 2024-06-02T04:54:15.738 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:54:15 smithi076 ceph-mon[42935]: pgmap v408: 129 pgs: 129 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 12 MiB/s wr, 937 op/s 2024-06-02T04:54:15.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:54:15 smithi119 ceph-mon[46633]: pgmap v408: 129 pgs: 129 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 12 MiB/s wr, 937 op/s 2024-06-02T04:54:16.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 205.0 s, 999.6 tps, lat 99.320 ms stddev 32.400 2024-06-02T04:54:17.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:54:17 smithi192 ceph-mon[47933]: pgmap v409: 129 pgs: 129 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 14 MiB/s wr, 1.07k op/s 2024-06-02T04:54:17.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:54:17 smithi076 ceph-mon[42935]: pgmap v409: 129 pgs: 129 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 14 MiB/s wr, 1.07k op/s 2024-06-02T04:54:17.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:54:17 smithi119 ceph-mon[46633]: pgmap v409: 129 pgs: 129 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 14 MiB/s wr, 1.07k op/s 2024-06-02T04:54:19.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:54:19 smithi192 ceph-mon[47933]: pgmap v410: 129 pgs: 129 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 13 MiB/s wr, 983 op/s 2024-06-02T04:54:19.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:54:19 smithi076 ceph-mon[42935]: pgmap v410: 129 pgs: 129 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 13 MiB/s wr, 983 op/s 2024-06-02T04:54:19.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:54:19 smithi119 ceph-mon[46633]: pgmap v410: 129 pgs: 129 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 13 MiB/s wr, 983 op/s 2024-06-02T04:54:21.319 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 210.0 s, 931.3 tps, lat 107.517 ms stddev 36.865 2024-06-02T04:54:21.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:54:21 smithi192 ceph-mon[47933]: pgmap v411: 129 pgs: 129 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 11 MiB/s wr, 877 op/s 2024-06-02T04:54:21.735 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:54:21 smithi076 ceph-mon[42935]: pgmap v411: 129 pgs: 129 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 11 MiB/s wr, 877 op/s 2024-06-02T04:54:21.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:54:21 smithi119 ceph-mon[46633]: pgmap v411: 129 pgs: 129 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 11 MiB/s wr, 877 op/s 2024-06-02T04:54:23.412 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.411+0000 7f7435c5b700 1 -- 172.21.15.76:0/3109140632 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7430104cd0 msgr2=0x7f743010b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:54:23.412 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.411+0000 7f7435c5b700 1 --2- 172.21.15.76:0/3109140632 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7430104cd0 0x7f743010b580 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f742800b0d0 tx=0x7f742800b3e0 comp rx=0 tx=0).stop 2024-06-02T04:54:23.413 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.412+0000 7f7435c5b700 1 -- 172.21.15.76:0/3109140632 shutdown_connections 2024-06-02T04:54:23.413 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.412+0000 7f7435c5b700 1 --2- 172.21.15.76:0/3109140632 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7430104cd0 0x7f743010b580 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:23.413 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.412+0000 7f7435c5b700 1 --2- 172.21.15.76:0/3109140632 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7430103140 0x7f7430103560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:23.413 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.412+0000 7f7435c5b700 1 --2- 172.21.15.76:0/3109140632 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7430104330 0x7f7430104790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:23.413 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.412+0000 7f7435c5b700 1 -- 172.21.15.76:0/3109140632 >> 172.21.15.76:0/3109140632 conn(0x7f74300fe6b0 msgr2=0x7f7430100af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:54:23.416 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.416+0000 7f7435c5b700 1 -- 172.21.15.76:0/3109140632 shutdown_connections 2024-06-02T04:54:23.420 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.419+0000 7f7435c5b700 1 -- 172.21.15.76:0/3109140632 wait complete. 2024-06-02T04:54:23.420 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.420+0000 7f7435c5b700 1 Processor -- start 2024-06-02T04:54:23.420 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.420+0000 7f7435c5b700 1 -- start start 2024-06-02T04:54:23.421 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.420+0000 7f7435c5b700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7430103140 0x7f7430194ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:54:23.421 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.420+0000 7f7435c5b700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7430104330 0x7f74301951e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:54:23.421 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.420+0000 7f7435c5b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7430104cd0 0x7f743019c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:54:23.421 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.420+0000 7f7435c5b700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74301ad890 con 0x7f7430103140 2024-06-02T04:54:23.421 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.420+0000 7f7435c5b700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f743006a9c0 con 0x7f7430104330 2024-06-02T04:54:23.421 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.420+0000 7f7435c5b700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f743006ab80 con 0x7f7430104cd0 2024-06-02T04:54:23.421 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.420+0000 7f742ffff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7430104cd0 0x7f743019c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:54:23.421 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.421+0000 7f742ffff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7430104cd0 0x7f743019c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:41028/0 (socket says 172.21.15.76:41028) 2024-06-02T04:54:23.422 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.421+0000 7f742ffff700 1 -- 172.21.15.76:0/3560419243 learned_addr learned my addr 172.21.15.76:0/3560419243 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:54:23.422 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.421+0000 7f742effd700 1 --2- 172.21.15.76:0/3560419243 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7430104330 0x7f74301951e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:54:23.424 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.421+0000 7f742f7fe700 1 --2- 172.21.15.76:0/3560419243 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7430103140 0x7f7430194ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:54:23.424 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.421+0000 7f742ffff700 1 -- 172.21.15.76:0/3560419243 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7430104330 msgr2=0x7f74301951e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:54:23.424 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.421+0000 7f742ffff700 1 --2- 172.21.15.76:0/3560419243 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7430104330 0x7f74301951e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:23.424 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.421+0000 7f742ffff700 1 -- 172.21.15.76:0/3560419243 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7430103140 msgr2=0x7f7430194ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:54:23.424 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.421+0000 7f742ffff700 1 --2- 172.21.15.76:0/3560419243 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7430103140 0x7f7430194ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:23.424 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.421+0000 7f742ffff700 1 -- 172.21.15.76:0/3560419243 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7428009d00 con 0x7f7430104cd0 2024-06-02T04:54:23.424 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.422+0000 7f742ffff700 1 --2- 172.21.15.76:0/3560419243 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7430104cd0 0x7f743019c200 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7428006070 tx=0x7f742800ccc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:54:23.424 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.422+0000 7f742cff9700 1 -- 172.21.15.76:0/3560419243 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f742800e040 con 0x7f7430104cd0 2024-06-02T04:54:23.424 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.422+0000 7f742cff9700 1 -- 172.21.15.76:0/3560419243 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7428009470 con 0x7f7430104cd0 2024-06-02T04:54:23.424 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.422+0000 7f742cff9700 1 -- 172.21.15.76:0/3560419243 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f742801c660 con 0x7f7430104cd0 2024-06-02T04:54:23.425 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.423+0000 7f742effd700 1 --2- 172.21.15.76:0/3560419243 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7430104330 0x7f74301951e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:54:23.425 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.423+0000 7f7435c5b700 1 -- 172.21.15.76:0/3560419243 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f743006ae00 con 0x7f7430104cd0 2024-06-02T04:54:23.425 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.424+0000 7f7435c5b700 1 -- 172.21.15.76:0/3560419243 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f743006b230 con 0x7f7430104cd0 2024-06-02T04:54:23.427 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.427+0000 7f742cff9700 1 -- 172.21.15.76:0/3560419243 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f7428005040 con 0x7f7430104cd0 2024-06-02T04:54:23.428 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.427+0000 7f742cff9700 1 --2- 172.21.15.76:0/3560419243 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f74180a1270 0x7f74180a3730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:54:23.428 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.428+0000 7f742cff9700 1 -- 172.21.15.76:0/3560419243 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f74280cd1c0 con 0x7f7430104cd0 2024-06-02T04:54:23.429 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.429+0000 7f742f7fe700 1 --2- 172.21.15.76:0/3560419243 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f74180a1270 0x7f74180a3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:54:23.429 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.429+0000 7f742f7fe700 1 --2- 172.21.15.76:0/3560419243 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f74180a1270 0x7f74180a3730 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f7430104190 tx=0x7f7420009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:54:23.430 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.430+0000 7f7441e16b80 1 Processor -- start 2024-06-02T04:54:23.432 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.430+0000 7f7441e16b80 1 -- start start 2024-06-02T04:54:23.432 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.430+0000 7f7441e16b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555ba4129a80 0x555ba4129ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:54:23.432 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.430+0000 7f7441e16b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555ba412a3e0 0x555ba412acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:54:23.432 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.430+0000 7f7441e16b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555ba412b2d0 0x555ba412b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:54:23.432 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.430+0000 7f7441e16b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ba40810f0 con 0x555ba4129a80 2024-06-02T04:54:23.432 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.430+0000 7f7441e16b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ba407eab0 con 0x555ba412b2d0 2024-06-02T04:54:23.432 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.430+0000 7f7441e16b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ba407a3a0 con 0x555ba412a3e0 2024-06-02T04:54:23.432 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.431+0000 7f742effd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555ba412a3e0 0x555ba412acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:54:23.432 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.431+0000 7f742f7fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555ba4129a80 0x555ba4129ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:54:23.432 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.431+0000 7f742effd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555ba412a3e0 0x555ba412acf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:41042/0 (socket says 172.21.15.76:41042) 2024-06-02T04:54:23.432 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.431+0000 7f742effd700 1 -- 172.21.15.76:0/1205375282 learned_addr learned my addr 172.21.15.76:0/1205375282 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:54:23.432 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.431+0000 7f742ffff700 1 --2- 172.21.15.76:0/1205375282 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555ba412b2d0 0x555ba412b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:54:23.433 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.431+0000 7f742effd700 1 -- 172.21.15.76:0/1205375282 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555ba412b2d0 msgr2=0x555ba412b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:54:23.433 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.431+0000 7f742effd700 1 --2- 172.21.15.76:0/1205375282 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555ba412b2d0 0x555ba412b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:23.433 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.431+0000 7f742effd700 1 -- 172.21.15.76:0/1205375282 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555ba4129a80 msgr2=0x555ba4129ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:54:23.433 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.431+0000 7f742effd700 1 --2- 172.21.15.76:0/1205375282 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555ba4129a80 0x555ba4129ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:23.433 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.431+0000 7f742effd700 1 -- 172.21.15.76:0/1205375282 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555ba3efb350 con 0x555ba412a3e0 2024-06-02T04:54:23.433 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.431+0000 7f742ffff700 1 --2- 172.21.15.76:0/1205375282 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555ba412b2d0 0x555ba412b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:54:23.433 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.431+0000 7f742effd700 1 --2- 172.21.15.76:0/1205375282 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555ba412a3e0 0x555ba412acf0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7424009de0 tx=0x7f74240116c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d0468c9e4e770df server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:54:23.433 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.431+0000 7f7415ffb700 1 -- 172.21.15.76:0/1205375282 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7424011e20 con 0x555ba412a3e0 2024-06-02T04:54:23.433 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.431+0000 7f7415ffb700 1 -- 172.21.15.76:0/1205375282 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f74240128e0 con 0x555ba412a3e0 2024-06-02T04:54:23.433 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.431+0000 7f7415ffb700 1 -- 172.21.15.76:0/1205375282 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f742400f7b0 con 0x555ba412a3e0 2024-06-02T04:54:23.435 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.432+0000 7f7441e16b80 1 -- 172.21.15.76:0/1205375282 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555ba412a3e0 msgr2=0x555ba412acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:54:23.435 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.432+0000 7f7441e16b80 1 --2- 172.21.15.76:0/1205375282 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555ba412a3e0 0x555ba412acf0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7424009de0 tx=0x7f74240116c0 comp rx=0 tx=0).stop 2024-06-02T04:54:23.435 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.432+0000 7f7441e16b80 1 -- 172.21.15.76:0/1205375282 shutdown_connections 2024-06-02T04:54:23.435 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.432+0000 7f7441e16b80 1 --2- 172.21.15.76:0/1205375282 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555ba412b2d0 0x555ba412b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:23.435 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.432+0000 7f7441e16b80 1 --2- 172.21.15.76:0/1205375282 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555ba4129a80 0x555ba4129ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:23.435 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.432+0000 7f7441e16b80 1 --2- 172.21.15.76:0/1205375282 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555ba412a3e0 0x555ba412acf0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:23.435 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.432+0000 7f7441e16b80 1 -- 172.21.15.76:0/1205375282 >> 172.21.15.76:0/1205375282 conn(0x555ba40881b0 msgr2=0x555ba4126440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:54:23.435 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.433+0000 7f7441e16b80 1 -- 172.21.15.76:0/1205375282 shutdown_connections 2024-06-02T04:54:23.435 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.433+0000 7f7441e16b80 1 -- 172.21.15.76:0/1205375282 wait complete. 2024-06-02T04:54:23.435 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.433+0000 7f7441e16b80 1 -- start start 2024-06-02T04:54:23.436 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.433+0000 7f7441e16b80 1 Processor -- start 2024-06-02T04:54:23.436 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.434+0000 7f7441e16b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555ba4129a80 0x555ba4133890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:54:23.436 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.434+0000 7f7441e16b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555ba412a3e0 0x555ba4133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:54:23.436 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.434+0000 7f7441e16b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555ba412b2d0 0x555ba413ae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:54:23.436 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.434+0000 7f7441e16b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ba4016500 con 0x555ba412a3e0 2024-06-02T04:54:23.436 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.434+0000 7f7441e16b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ba40161a0 con 0x555ba412b2d0 2024-06-02T04:54:23.436 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.434+0000 7f7441e16b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ba3efd640 con 0x555ba4129a80 2024-06-02T04:54:23.436 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.434+0000 7f7441e16b80 10 client.0 _ll_register_callbacks cb 0x555ba401fad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:54:23.436 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.434+0000 7f742f7fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555ba4129a80 0x555ba4133890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:54:23.436 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.434+0000 7f742ffff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555ba412b2d0 0x555ba413ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:54:23.436 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.434+0000 7f742f7fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555ba4129a80 0x555ba4133890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:41054/0 (socket says 172.21.15.76:41054) 2024-06-02T04:54:23.436 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.434+0000 7f742ffff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555ba412b2d0 0x555ba413ae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:60714/0 (socket says 172.21.15.76:60714) 2024-06-02T04:54:23.436 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.434+0000 7f742f7fe700 1 -- 172.21.15.76:0/2120552496 learned_addr learned my addr 172.21.15.76:0/2120552496 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:54:23.437 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.434+0000 7f742effd700 1 --2- 172.21.15.76:0/2120552496 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555ba412a3e0 0x555ba4133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:54:23.437 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.434+0000 7f742f7fe700 1 -- 172.21.15.76:0/2120552496 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555ba412b2d0 msgr2=0x555ba413ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:54:23.437 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.434+0000 7f742f7fe700 1 --2- 172.21.15.76:0/2120552496 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555ba412b2d0 0x555ba413ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:23.437 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.434+0000 7f742f7fe700 1 -- 172.21.15.76:0/2120552496 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555ba412a3e0 msgr2=0x555ba4133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:54:23.437 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.434+0000 7f742f7fe700 1 --2- 172.21.15.76:0/2120552496 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555ba412a3e0 0x555ba4133dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:23.437 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.434+0000 7f742f7fe700 1 -- 172.21.15.76:0/2120552496 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7424009a10 con 0x555ba4129a80 2024-06-02T04:54:23.438 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.435+0000 7f742f7fe700 1 --2- 172.21.15.76:0/2120552496 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555ba4129a80 0x555ba4133890 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f742001dc00 tx=0x7f74200047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e58f98b956ac8e15 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:54:23.439 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.435+0000 7f740effd700 10 client.0 ms_handle_connect on v2:172.21.15.192:3300/0 2024-06-02T04:54:23.439 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.435+0000 7f740effd700 1 -- 172.21.15.76:0/2120552496 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7420022070 con 0x555ba4129a80 2024-06-02T04:54:23.439 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.435+0000 7f740effd700 1 -- 172.21.15.76:0/2120552496 <== mon.1 v2:172.21.15.192:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f742001c740 con 0x555ba4129a80 2024-06-02T04:54:23.439 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.435+0000 7f7441e16b80 1 -- 172.21.15.76:0/2120552496 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555ba3fd3210 con 0x555ba4129a80 2024-06-02T04:54:23.439 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.435+0000 7f740effd700 1 -- 172.21.15.76:0/2120552496 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f742001c900 con 0x555ba4129a80 2024-06-02T04:54:23.439 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.435+0000 7f7441e16b80 10 client.25576 fetch_fsmap learned FSMap version 32 2024-06-02T04:54:23.439 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.435+0000 7f7441e16b80 1 -- 172.21.15.76:0/2120552496 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x555ba3ea7b00 con 0x555ba4129a80 2024-06-02T04:54:23.439 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.435+0000 7f740effd700 1 -- 172.21.15.76:0/2120552496 <== mon.1 v2:172.21.15.192:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x555ba3fd3210 con 0x555ba4129a80 2024-06-02T04:54:23.439 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.436+0000 7f740effd700 1 -- 172.21.15.76:0/2120552496 <== mon.1 v2:172.21.15.192:3300/0 5 ==== fsmap(e 32) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f7420026b60 con 0x555ba4129a80 2024-06-02T04:54:23.439 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.436+0000 7f7441e16b80 10 client.25576 fetch_fsmap finished waiting for FSMap version 32 2024-06-02T04:54:23.439 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.436+0000 7f7441e16b80 10 client.25576 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T04:54:23.440 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.436+0000 7f7441e16b80 20 client.25576 populate_metadata read hostname 'smithi076' 2024-06-02T04:54:23.440 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.436+0000 7f7441e16b80 1 --2- 172.21.15.76:0/2120552496 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x555ba413f640 0x555ba4141a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:54:23.440 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.436+0000 7f7441e16b80 4 client.25576 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T04:54:23.440 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.436+0000 7f7441e16b80 1 -- 172.21.15.76:0/2120552496 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555ba40f97b0 con 0x555ba413f640 2024-06-02T04:54:23.440 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.436+0000 7f742effd700 1 --2- 172.21.15.76:0/2120552496 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x555ba413f640 0x555ba4141a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:54:23.440 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.436+0000 7f742effd700 1 --2- 172.21.15.76:0/2120552496 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x555ba413f640 0x555ba4141a60 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a7cc6f0d1dee7a11 server_cookie=669ae6aa6cd19e47 in_seq=0 out_seq=0 2024-06-02T04:54:23.440 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.437+0000 7f740effd700 10 client.25576 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:54:23.440 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.437+0000 7f740effd700 1 -- 172.21.15.76:0/2120552496 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x555ba40f97b0 con 0x555ba413f640 2024-06-02T04:54:23.440 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.437+0000 7f740effd700 10 client.25576 handle_command_reply: tid=0 2024-06-02T04:54:23.440 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.437+0000 7f7441e16b80 1 client.25576 shutdown 2024-06-02T04:54:23.449 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.448+0000 7f7441e16b80 1 -- 172.21.15.76:0/2120552496 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555ba4129a80 msgr2=0x555ba4133890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:54:23.449 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.448+0000 7f7441e16b80 1 --2- 172.21.15.76:0/2120552496 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555ba4129a80 0x555ba4133890 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f742001dc00 tx=0x7f74200047c0 comp rx=0 tx=0).stop 2024-06-02T04:54:23.449 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.448+0000 7f7441e16b80 1 -- 172.21.15.76:0/2120552496 shutdown_connections 2024-06-02T04:54:23.449 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.448+0000 7f7441e16b80 1 --2- 172.21.15.76:0/2120552496 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x555ba413f640 0x555ba4141a60 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:23.449 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.448+0000 7f7441e16b80 1 --2- 172.21.15.76:0/2120552496 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555ba412b2d0 0x555ba413ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:23.449 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.448+0000 7f7441e16b80 1 --2- 172.21.15.76:0/2120552496 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555ba4129a80 0x555ba4133890 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:23.449 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.448+0000 7f7441e16b80 1 --2- 172.21.15.76:0/2120552496 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555ba412a3e0 0x555ba4133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:23.450 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.448+0000 7f7441e16b80 1 -- 172.21.15.76:0/2120552496 >> 172.21.15.76:0/2120552496 conn(0x555ba40881b0 msgr2=0x555ba4124860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:54:23.450 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.449+0000 7f740effd700 0 client.25576 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:54:23.450 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.450+0000 7f7441e16b80 1 -- 172.21.15.76:0/2120552496 shutdown_connections 2024-06-02T04:54:23.450 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.450+0000 7f7441e16b80 1 -- 172.21.15.76:0/2120552496 wait complete. 2024-06-02T04:54:23.451 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.451+0000 7f7441e16b80 20 client.25576 trim_cache size 0 max 16384 2024-06-02T04:54:23.476 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.475+0000 7f7441e16b80 1 Processor -- start 2024-06-02T04:54:23.477 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.477+0000 7f7441e16b80 1 -- start start 2024-06-02T04:54:23.478 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.477+0000 7f7441e16b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555ba4129a80 0x555ba412b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:54:23.478 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.477+0000 7f7441e16b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555ba412a3e0 0x555ba413add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:54:23.478 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.477+0000 7f7441e16b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555ba412b2d0 0x555ba4131800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:54:23.478 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.477+0000 7f7441e16b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ba4125930 con 0x555ba412a3e0 2024-06-02T04:54:23.478 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.477+0000 7f7441e16b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ba413bf90 con 0x555ba412b2d0 2024-06-02T04:54:23.478 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.477+0000 7f7441e16b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ba4134a80 con 0x555ba4129a80 2024-06-02T04:54:23.479 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.477+0000 7f742f7fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555ba4129a80 0x555ba412b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:54:23.479 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.477+0000 7f742f7fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555ba4129a80 0x555ba412b6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:41064/0 (socket says 172.21.15.76:41064) 2024-06-02T04:54:23.479 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.478+0000 7f742ffff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555ba412b2d0 0x555ba4131800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:54:23.480 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.478+0000 7f742f7fe700 1 -- 172.21.15.76:0/755977298 learned_addr learned my addr 172.21.15.76:0/755977298 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:54:23.480 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.478+0000 7f742effd700 1 --2- 172.21.15.76:0/755977298 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555ba412a3e0 0x555ba413add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:54:23.480 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.478+0000 7f742ffff700 1 -- 172.21.15.76:0/755977298 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555ba4129a80 msgr2=0x555ba412b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:54:23.480 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.478+0000 7f742ffff700 1 --2- 172.21.15.76:0/755977298 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555ba4129a80 0x555ba412b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:23.480 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.478+0000 7f742ffff700 1 -- 172.21.15.76:0/755977298 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555ba412a3e0 msgr2=0x555ba413add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:54:23.480 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.478+0000 7f742ffff700 1 --2- 172.21.15.76:0/755977298 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555ba412a3e0 0x555ba413add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:23.480 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.478+0000 7f742ffff700 1 -- 172.21.15.76:0/755977298 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555ba4040500 con 0x555ba412b2d0 2024-06-02T04:54:23.480 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.478+0000 7f742f7fe700 1 --2- 172.21.15.76:0/755977298 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555ba4129a80 0x555ba412b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T04:54:23.480 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.478+0000 7f742ffff700 1 --2- 172.21.15.76:0/755977298 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555ba412b2d0 0x555ba4131800 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x555ba412aab0 tx=0x7f7428009040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2dc95addc5b44eca server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:54:23.480 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.478+0000 7f74167fc700 1 -- 172.21.15.76:0/755977298 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7428099c60 con 0x555ba412b2d0 2024-06-02T04:54:23.480 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.478+0000 7f74167fc700 1 -- 172.21.15.76:0/755977298 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f74280af070 con 0x555ba412b2d0 2024-06-02T04:54:23.480 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.478+0000 7f74167fc700 1 -- 172.21.15.76:0/755977298 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74280caa30 con 0x555ba412b2d0 2024-06-02T04:54:23.480 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.479+0000 7f7441e16b80 1 -- 172.21.15.76:0/755977298 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555ba412b2d0 msgr2=0x555ba4131800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:54:23.481 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.479+0000 7f7441e16b80 1 --2- 172.21.15.76:0/755977298 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555ba412b2d0 0x555ba4131800 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x555ba412aab0 tx=0x7f7428009040 comp rx=0 tx=0).stop 2024-06-02T04:54:23.482 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.479+0000 7f7441e16b80 1 -- 172.21.15.76:0/755977298 shutdown_connections 2024-06-02T04:54:23.482 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.479+0000 7f7441e16b80 1 --2- 172.21.15.76:0/755977298 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555ba412b2d0 0x555ba4131800 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:23.482 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.479+0000 7f7441e16b80 1 --2- 172.21.15.76:0/755977298 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555ba4129a80 0x555ba412b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:23.482 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.479+0000 7f7441e16b80 1 --2- 172.21.15.76:0/755977298 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555ba412a3e0 0x555ba413add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:23.482 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.479+0000 7f7441e16b80 1 -- 172.21.15.76:0/755977298 >> 172.21.15.76:0/755977298 conn(0x555ba40881b0 msgr2=0x555ba4132da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:54:23.482 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.480+0000 7f7441e16b80 1 -- 172.21.15.76:0/755977298 shutdown_connections 2024-06-02T04:54:23.483 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.480+0000 7f7441e16b80 1 -- 172.21.15.76:0/755977298 wait complete. 2024-06-02T04:54:23.483 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.480+0000 7f7441e16b80 1 -- start start 2024-06-02T04:54:23.483 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.480+0000 7f7441e16b80 1 Processor -- start 2024-06-02T04:54:23.483 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.480+0000 7f7441e16b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555ba4129a80 0x555ba4137b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:54:23.483 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.480+0000 7f7441e16b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555ba412a3e0 0x555ba41380b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:54:23.483 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.480+0000 7f7441e16b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555ba412b2d0 0x555ba4193b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:54:23.483 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.480+0000 7f7441e16b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ba4138680 con 0x555ba412a3e0 2024-06-02T04:54:23.483 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.480+0000 7f7441e16b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ba41387f0 con 0x555ba412b2d0 2024-06-02T04:54:23.483 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.480+0000 7f7441e16b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ba41940e0 con 0x555ba4129a80 2024-06-02T04:54:23.483 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.480+0000 7f7441e16b80 10 client.0 _ll_register_callbacks cb 0x555ba401fad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:54:23.483 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.481+0000 7f742ffff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555ba412b2d0 0x555ba4193b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:54:23.483 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.481+0000 7f742ffff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555ba412b2d0 0x555ba4193b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:60736/0 (socket says 172.21.15.76:60736) 2024-06-02T04:54:23.483 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.481+0000 7f742effd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555ba412a3e0 0x555ba41380b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:54:23.484 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.481+0000 7f742ffff700 1 -- 172.21.15.76:0/106072897 learned_addr learned my addr 172.21.15.76:0/106072897 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:54:23.484 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.481+0000 7f742f7fe700 1 --2- 172.21.15.76:0/106072897 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555ba4129a80 0x555ba4137b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:54:23.484 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.481+0000 7f742ffff700 1 -- 172.21.15.76:0/106072897 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555ba4129a80 msgr2=0x555ba4137b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:54:23.484 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.481+0000 7f742ffff700 1 --2- 172.21.15.76:0/106072897 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555ba4129a80 0x555ba4137b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:23.484 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.481+0000 7f742ffff700 1 -- 172.21.15.76:0/106072897 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555ba412a3e0 msgr2=0x555ba41380b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:54:23.484 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.481+0000 7f742ffff700 1 --2- 172.21.15.76:0/106072897 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555ba412a3e0 0x555ba41380b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:23.484 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.481+0000 7f742ffff700 1 -- 172.21.15.76:0/106072897 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555ba3ea7b00 con 0x555ba412b2d0 2024-06-02T04:54:23.484 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.481+0000 7f742ffff700 1 --2- 172.21.15.76:0/106072897 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555ba412b2d0 0x555ba4193b20 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7428009fd0 tx=0x7f7428099f00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3dedf665abe02e4f server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:54:23.484 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.481+0000 7f740effd700 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-06-02T04:54:23.484 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.481+0000 7f740effd700 1 -- 172.21.15.76:0/106072897 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f742809a300 con 0x555ba412b2d0 2024-06-02T04:54:23.484 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.481+0000 7f740effd700 1 -- 172.21.15.76:0/106072897 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f742809aa00 con 0x555ba412b2d0 2024-06-02T04:54:23.484 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.481+0000 7f7441e16b80 1 -- 172.21.15.76:0/106072897 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f74240128e0 con 0x555ba412b2d0 2024-06-02T04:54:23.484 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.482+0000 7f740effd700 1 -- 172.21.15.76:0/106072897 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f74280caa30 con 0x555ba412b2d0 2024-06-02T04:54:23.484 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.482+0000 7f7441e16b80 10 client.25652 fetch_fsmap learned FSMap version 32 2024-06-02T04:54:23.485 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.482+0000 7f7441e16b80 1 -- 172.21.15.76:0/106072897 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x7f743006b230 con 0x555ba412b2d0 2024-06-02T04:54:23.485 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.482+0000 7f740effd700 1 -- 172.21.15.76:0/106072897 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f74240128e0 con 0x555ba412b2d0 2024-06-02T04:54:23.485 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.483+0000 7f740effd700 1 -- 172.21.15.76:0/106072897 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 32) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f7428081070 con 0x555ba412b2d0 2024-06-02T04:54:23.486 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.483+0000 7f7441e16b80 10 client.25652 fetch_fsmap finished waiting for FSMap version 32 2024-06-02T04:54:23.486 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.483+0000 7f7441e16b80 10 client.25652 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T04:54:23.486 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.483+0000 7f7441e16b80 20 client.25652 populate_metadata read hostname 'smithi076' 2024-06-02T04:54:23.486 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.483+0000 7f7441e16b80 1 --2- 172.21.15.76:0/106072897 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x555ba41955f0 0x555ba4197a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:54:23.486 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.483+0000 7f7441e16b80 4 client.25652 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T04:54:23.486 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.483+0000 7f7441e16b80 1 -- 172.21.15.76:0/106072897 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x555ba4072e60 con 0x555ba41955f0 2024-06-02T04:54:23.486 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.483+0000 7f742f7fe700 1 --2- 172.21.15.76:0/106072897 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x555ba41955f0 0x555ba4197a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:54:23.486 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.483+0000 7f740effd700 10 client.25652 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:54:23.486 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.483+0000 7f742f7fe700 1 --2- 172.21.15.76:0/106072897 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x555ba41955f0 0x555ba4197a10 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=49641158ebcee09b server_cookie=9f7c2da62543d4c4 in_seq=0 out_seq=0 2024-06-02T04:54:23.499 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.499+0000 7f740effd700 1 -- 172.21.15.76:0/106072897 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x555ba4072e60 con 0x555ba41955f0 2024-06-02T04:54:23.499 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.499+0000 7f740effd700 10 client.25652 handle_command_reply: tid=0 2024-06-02T04:54:23.499 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.499+0000 7f7441e16b80 1 client.25652 shutdown 2024-06-02T04:54:23.500 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.499+0000 7f7441e16b80 1 -- 172.21.15.76:0/106072897 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555ba412b2d0 msgr2=0x555ba4193b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:54:23.500 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.499+0000 7f7441e16b80 1 --2- 172.21.15.76:0/106072897 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555ba412b2d0 0x555ba4193b20 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7428009fd0 tx=0x7f7428099f00 comp rx=0 tx=0).stop 2024-06-02T04:54:23.501 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.501+0000 7f7441e16b80 1 -- 172.21.15.76:0/106072897 shutdown_connections 2024-06-02T04:54:23.501 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.501+0000 7f7441e16b80 1 --2- 172.21.15.76:0/106072897 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x555ba41955f0 0x555ba4197a10 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:23.501 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.501+0000 7f7441e16b80 1 --2- 172.21.15.76:0/106072897 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555ba412b2d0 0x555ba4193b20 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:23.501 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.501+0000 7f7441e16b80 1 --2- 172.21.15.76:0/106072897 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555ba4129a80 0x555ba4137b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:23.502 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.501+0000 7f7441e16b80 1 --2- 172.21.15.76:0/106072897 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555ba412a3e0 0x555ba41380b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:23.502 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.501+0000 7f7441e16b80 1 -- 172.21.15.76:0/106072897 >> 172.21.15.76:0/106072897 conn(0x555ba40881b0 msgr2=0x555ba4132ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:54:23.502 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.501+0000 7f740effd700 0 client.25652 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:54:23.502 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.501+0000 7f7441e16b80 1 -- 172.21.15.76:0/106072897 shutdown_connections 2024-06-02T04:54:23.502 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.501+0000 7f7441e16b80 1 -- 172.21.15.76:0/106072897 wait complete. 2024-06-02T04:54:23.502 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.501+0000 7f7441e16b80 20 client.25652 trim_cache size 0 max 16384 2024-06-02T04:54:23.503 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:{ 2024-06-02T04:54:23.503 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "message": "", 2024-06-02T04:54:23.503 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "return_code": 0 2024-06-02T04:54:23.503 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:} 2024-06-02T04:54:23.504 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.503+0000 7f7435c5b700 1 -- 172.21.15.76:0/3560419243 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f74180a1270 msgr2=0x7f74180a3730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:54:23.504 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.503+0000 7f7435c5b700 1 --2- 172.21.15.76:0/3560419243 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f74180a1270 0x7f74180a3730 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f7430104190 tx=0x7f7420009260 comp rx=0 tx=0).stop 2024-06-02T04:54:23.504 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.503+0000 7f7435c5b700 1 -- 172.21.15.76:0/3560419243 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7430104cd0 msgr2=0x7f743019c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:54:23.504 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.503+0000 7f7435c5b700 1 --2- 172.21.15.76:0/3560419243 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7430104cd0 0x7f743019c200 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7428006070 tx=0x7f742800ccc0 comp rx=0 tx=0).stop 2024-06-02T04:54:23.504 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.503+0000 7f7435c5b700 1 -- 172.21.15.76:0/3560419243 shutdown_connections 2024-06-02T04:54:23.504 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.503+0000 7f7435c5b700 1 --2- 172.21.15.76:0/3560419243 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7430104cd0 0x7f743019c200 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:23.504 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.503+0000 7f7435c5b700 1 --2- 172.21.15.76:0/3560419243 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7430103140 0x7f7430194ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:23.504 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.503+0000 7f7435c5b700 1 --2- 172.21.15.76:0/3560419243 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f74180a1270 0x7f74180a3730 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:23.504 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.503+0000 7f7435c5b700 1 --2- 172.21.15.76:0/3560419243 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7430104330 0x7f74301951e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:23.504 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.503+0000 7f7435c5b700 1 -- 172.21.15.76:0/3560419243 >> 172.21.15.76:0/3560419243 conn(0x7f74300fe6b0 msgr2=0x7f74300774f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:54:23.504 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.503+0000 7f7435c5b700 1 -- 172.21.15.76:0/3560419243 shutdown_connections 2024-06-02T04:54:23.504 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:23.503+0000 7f7435c5b700 1 -- 172.21.15.76:0/3560419243 wait complete. 2024-06-02T04:54:23.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:54:23 smithi192 ceph-mon[47933]: pgmap v412: 129 pgs: 129 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 13 MiB/s wr, 1.04k op/s 2024-06-02T04:54:23.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:54:23 smithi076 ceph-mon[42935]: pgmap v412: 129 pgs: 129 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 13 MiB/s wr, 1.04k op/s 2024-06-02T04:54:23.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:54:23 smithi119 ceph-mon[46633]: pgmap v412: 129 pgs: 129 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 13 MiB/s wr, 1.04k op/s 2024-06-02T04:54:25.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:54:25 smithi192 ceph-mon[47933]: pgmap v413: 129 pgs: 129 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 11 MiB/s wr, 884 op/s 2024-06-02T04:54:25.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:54:25 smithi076 ceph-mon[42935]: pgmap v413: 129 pgs: 129 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 11 MiB/s wr, 884 op/s 2024-06-02T04:54:25.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:54:25 smithi119 ceph-mon[46633]: pgmap v413: 129 pgs: 129 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 11 MiB/s wr, 884 op/s 2024-06-02T04:54:26.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 215.0 s, 903.1 tps, lat 110.575 ms stddev 38.550 2024-06-02T04:54:27.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:54:27 smithi192 ceph-mon[47933]: pgmap v414: 129 pgs: 129 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 12 MiB/s wr, 997 op/s 2024-06-02T04:54:27.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:54:27 smithi076 ceph-mon[42935]: pgmap v414: 129 pgs: 129 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 12 MiB/s wr, 997 op/s 2024-06-02T04:54:27.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:54:27 smithi119 ceph-mon[46633]: pgmap v414: 129 pgs: 129 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 12 MiB/s wr, 997 op/s 2024-06-02T04:54:29.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:54:29 smithi192 ceph-mon[47933]: pgmap v415: 129 pgs: 129 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 10 MiB/s wr, 897 op/s 2024-06-02T04:54:29.736 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:54:29 smithi076 ceph-mon[42935]: pgmap v415: 129 pgs: 129 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 10 MiB/s wr, 897 op/s 2024-06-02T04:54:29.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:54:29 smithi119 ceph-mon[46633]: pgmap v415: 129 pgs: 129 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 10 MiB/s wr, 897 op/s 2024-06-02T04:54:31.316 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 220.0 s, 922.8 tps, lat 108.505 ms stddev 35.318 2024-06-02T04:54:31.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:54:31 smithi076 ceph-mon[42935]: pgmap v416: 129 pgs: 129 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 10 MiB/s wr, 864 op/s 2024-06-02T04:54:31.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:54:31 smithi119 ceph-mon[46633]: pgmap v416: 129 pgs: 129 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 10 MiB/s wr, 864 op/s 2024-06-02T04:54:31.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:54:31 smithi192 ceph-mon[47933]: pgmap v416: 129 pgs: 129 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 10 MiB/s wr, 864 op/s 2024-06-02T04:54:33.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:54:33 smithi076 ceph-mon[42935]: pgmap v417: 129 pgs: 129 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 12 MiB/s wr, 1.03k op/s 2024-06-02T04:54:33.847 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:54:33 smithi119 ceph-mon[46633]: pgmap v417: 129 pgs: 129 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 12 MiB/s wr, 1.03k op/s 2024-06-02T04:54:33.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:54:33 smithi192 ceph-mon[47933]: pgmap v417: 129 pgs: 129 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 12 MiB/s wr, 1.03k op/s 2024-06-02T04:54:35.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:54:35 smithi076 ceph-mon[42935]: pgmap v418: 129 pgs: 129 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 9.4 MiB/s wr, 839 op/s 2024-06-02T04:54:35.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:54:35 smithi119 ceph-mon[46633]: pgmap v418: 129 pgs: 129 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 9.4 MiB/s wr, 839 op/s 2024-06-02T04:54:35.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:54:35 smithi192 ceph-mon[47933]: pgmap v418: 129 pgs: 129 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 9.4 MiB/s wr, 839 op/s 2024-06-02T04:54:36.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 225.0 s, 888.2 tps, lat 112.676 ms stddev 39.063 2024-06-02T04:54:36.672 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.671+0000 7f5b0e259700 1 -- 172.21.15.76:0/4235551737 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b08103140 msgr2=0x7f5b08103560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:54:36.672 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.671+0000 7f5b0e259700 1 --2- 172.21.15.76:0/4235551737 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b08103140 0x7f5b08103560 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5af80098f0 tx=0x7f5af8009c00 comp rx=0 tx=0).stop 2024-06-02T04:54:36.672 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.672+0000 7f5b0e259700 1 -- 172.21.15.76:0/4235551737 shutdown_connections 2024-06-02T04:54:36.673 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.672+0000 7f5b0e259700 1 --2- 172.21.15.76:0/4235551737 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5b08104cd0 0x7f5b0810b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:36.673 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.672+0000 7f5b0e259700 1 --2- 172.21.15.76:0/4235551737 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b08103140 0x7f5b08103560 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:36.673 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.672+0000 7f5b0e259700 1 --2- 172.21.15.76:0/4235551737 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5b08104330 0x7f5b08104790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:36.673 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.672+0000 7f5b0e259700 1 -- 172.21.15.76:0/4235551737 >> 172.21.15.76:0/4235551737 conn(0x7f5b080fe6b0 msgr2=0x7f5b08100af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:54:36.673 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.673+0000 7f5b0e259700 1 -- 172.21.15.76:0/4235551737 shutdown_connections 2024-06-02T04:54:36.674 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.673+0000 7f5b0e259700 1 -- 172.21.15.76:0/4235551737 wait complete. 2024-06-02T04:54:36.674 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.673+0000 7f5b0e259700 1 Processor -- start 2024-06-02T04:54:36.674 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.674+0000 7f5b0e259700 1 -- start start 2024-06-02T04:54:36.675 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.674+0000 7f5b0e259700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5b08103140 0x7f5b081071c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:54:36.675 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.674+0000 7f5b0e259700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b08104330 0x7f5b08107700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:54:36.675 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.674+0000 7f5b0e259700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5b08104cd0 0x7f5b0810a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:54:36.675 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.674+0000 7f5b0e259700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0810acd0 con 0x7f5b08103140 2024-06-02T04:54:36.675 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.674+0000 7f5b0e259700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0810ae40 con 0x7f5b08104cd0 2024-06-02T04:54:36.675 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.674+0000 7f5b0e259700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0810b000 con 0x7f5b08104330 2024-06-02T04:54:36.675 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.674+0000 7f5b077fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5b08103140 0x7f5b081071c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:54:36.676 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.674+0000 7f5b077fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5b08103140 0x7f5b081071c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:43044/0 (socket says 172.21.15.76:43044) 2024-06-02T04:54:36.676 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.674+0000 7f5b077fe700 1 -- 172.21.15.76:0/3383441682 learned_addr learned my addr 172.21.15.76:0/3383441682 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:54:36.676 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.674+0000 7f5b07fff700 1 --2- 172.21.15.76:0/3383441682 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5b08104cd0 0x7f5b0810a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:54:36.676 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.674+0000 7f5b06ffd700 1 --2- 172.21.15.76:0/3383441682 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b08104330 0x7f5b08107700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:54:36.676 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.675+0000 7f5b077fe700 1 -- 172.21.15.76:0/3383441682 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b08104330 msgr2=0x7f5b08107700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:54:36.676 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.675+0000 7f5b077fe700 1 --2- 172.21.15.76:0/3383441682 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b08104330 0x7f5b08107700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:36.676 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.675+0000 7f5b077fe700 1 -- 172.21.15.76:0/3383441682 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5b08104cd0 msgr2=0x7f5b0810a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:54:36.676 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.675+0000 7f5b077fe700 1 --2- 172.21.15.76:0/3383441682 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5b08104cd0 0x7f5b0810a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:36.676 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.675+0000 7f5b077fe700 1 -- 172.21.15.76:0/3383441682 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5af8009520 con 0x7f5b08103140 2024-06-02T04:54:36.676 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.675+0000 7f5b06ffd700 1 --2- 172.21.15.76:0/3383441682 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b08104330 0x7f5b08107700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:54:36.676 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.675+0000 7f5b07fff700 1 --2- 172.21.15.76:0/3383441682 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5b08104cd0 0x7f5b0810a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T04:54:36.678 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.677+0000 7f5b077fe700 1 --2- 172.21.15.76:0/3383441682 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5b08103140 0x7f5b081071c0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f5af8009230 tx=0x7f5af800b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:54:36.678 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.677+0000 7f5b04ff9700 1 -- 172.21.15.76:0/3383441682 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af801c070 con 0x7f5b08103140 2024-06-02T04:54:36.678 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.677+0000 7f5b04ff9700 1 -- 172.21.15.76:0/3383441682 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5af800f840 con 0x7f5b08103140 2024-06-02T04:54:36.678 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.677+0000 7f5b04ff9700 1 -- 172.21.15.76:0/3383441682 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af8003a00 con 0x7f5b08103140 2024-06-02T04:54:36.678 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.677+0000 7f5b0e259700 1 -- 172.21.15.76:0/3383441682 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b0810b220 con 0x7f5b08103140 2024-06-02T04:54:36.678 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.678+0000 7f5b0e259700 1 -- 172.21.15.76:0/3383441682 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b0810b6d0 con 0x7f5b08103140 2024-06-02T04:54:36.682 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.682+0000 7f5b1a414b80 1 Processor -- start 2024-06-02T04:54:36.682 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.682+0000 7f5b1a414b80 1 -- start start 2024-06-02T04:54:36.683 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.683+0000 7f5b1a414b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5629d4248a80 0x5629d4248ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:54:36.683 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.683+0000 7f5b1a414b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5629d42493e0 0x5629d4249cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:54:36.683 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.683+0000 7f5b1a414b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5629d424a2d0 0x5629d424a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:54:36.683 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.683+0000 7f5b1a414b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629d41a00f0 con 0x5629d4248a80 2024-06-02T04:54:36.683 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.683+0000 7f5b1a414b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629d419dab0 con 0x5629d42493e0 2024-06-02T04:54:36.684 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.683+0000 7f5b1a414b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629d41993a0 con 0x5629d424a2d0 2024-06-02T04:54:36.684 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.683+0000 7f5b06ffd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5629d424a2d0 0x5629d424a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:54:36.684 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.683+0000 7f5b06ffd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5629d424a2d0 0x5629d424a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:49446/0 (socket says 172.21.15.76:49446) 2024-06-02T04:54:36.684 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.683+0000 7f5b06ffd700 1 -- 172.21.15.76:0/1423235259 learned_addr learned my addr 172.21.15.76:0/1423235259 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:54:36.684 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.683+0000 7f5b06ffd700 1 -- 172.21.15.76:0/1423235259 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5629d42493e0 msgr2=0x5629d4249cf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-02T04:54:36.684 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.683+0000 7f5b06ffd700 1 --2- 172.21.15.76:0/1423235259 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5629d42493e0 0x5629d4249cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:36.684 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.683+0000 7f5b06ffd700 1 -- 172.21.15.76:0/1423235259 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5629d4248a80 msgr2=0x5629d4248ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:54:36.685 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.683+0000 7f5b06ffd700 1 --2- 172.21.15.76:0/1423235259 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5629d4248a80 0x5629d4248ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:36.685 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.683+0000 7f5b06ffd700 1 -- 172.21.15.76:0/1423235259 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5629d401a350 con 0x5629d424a2d0 2024-06-02T04:54:36.685 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.683+0000 7f5b06ffd700 1 --2- 172.21.15.76:0/1423235259 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5629d424a2d0 0x5629d424a750 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5afc0078a0 tx=0x7f5afc007bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c0a2ec9b0e3f757 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:54:36.685 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.685+0000 7f5aedffb700 1 -- 172.21.15.76:0/1423235259 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5afc0125f0 con 0x5629d424a2d0 2024-06-02T04:54:36.685 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.685+0000 7f5aedffb700 1 -- 172.21.15.76:0/1423235259 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5afc012be0 con 0x5629d424a2d0 2024-06-02T04:54:36.685 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.685+0000 7f5aedffb700 1 -- 172.21.15.76:0/1423235259 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5afc013ca0 con 0x5629d424a2d0 2024-06-02T04:54:36.686 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.685+0000 7f5b1a414b80 1 -- 172.21.15.76:0/1423235259 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5629d424a2d0 msgr2=0x5629d424a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:54:36.686 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.685+0000 7f5b1a414b80 1 --2- 172.21.15.76:0/1423235259 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5629d424a2d0 0x5629d424a750 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5afc0078a0 tx=0x7f5afc007bb0 comp rx=0 tx=0).stop 2024-06-02T04:54:36.686 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.686+0000 7f5b1a414b80 1 -- 172.21.15.76:0/1423235259 shutdown_connections 2024-06-02T04:54:36.686 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.686+0000 7f5b1a414b80 1 --2- 172.21.15.76:0/1423235259 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5629d424a2d0 0x5629d424a750 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:36.686 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.686+0000 7f5b1a414b80 1 --2- 172.21.15.76:0/1423235259 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5629d4248a80 0x5629d4248ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:36.686 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.686+0000 7f5b1a414b80 1 --2- 172.21.15.76:0/1423235259 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5629d42493e0 0x5629d4249cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:36.686 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.686+0000 7f5b1a414b80 1 -- 172.21.15.76:0/1423235259 >> 172.21.15.76:0/1423235259 conn(0x5629d41a71b0 msgr2=0x5629d4245440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:54:36.688 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.688+0000 7f5b04ff9700 1 -- 172.21.15.76:0/3383441682 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f5af8020030 con 0x7f5b08103140 2024-06-02T04:54:36.689 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.688+0000 7f5b04ff9700 1 --2- 172.21.15.76:0/3383441682 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f5af00a10b0 0x7f5af00a3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:54:36.689 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.689+0000 7f5b04ff9700 1 -- 172.21.15.76:0/3383441682 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f5af80cdd00 con 0x7f5b08103140 2024-06-02T04:54:36.689 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.689+0000 7f5b06ffd700 1 --2- 172.21.15.76:0/3383441682 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f5af00a10b0 0x7f5af00a3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:54:36.690 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.689+0000 7f5b06ffd700 1 --2- 172.21.15.76:0/3383441682 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f5af00a10b0 0x7f5af00a3570 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f5afc007870 tx=0x7f5afc012d50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:54:36.691 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.691+0000 7f5b1a414b80 1 -- 172.21.15.76:0/1423235259 shutdown_connections 2024-06-02T04:54:36.691 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.691+0000 7f5b1a414b80 1 -- 172.21.15.76:0/1423235259 wait complete. 2024-06-02T04:54:36.691 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.691+0000 7f5b1a414b80 1 -- start start 2024-06-02T04:54:36.692 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.692+0000 7f5b1a414b80 1 Processor -- start 2024-06-02T04:54:36.692 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.692+0000 7f5b1a414b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5629d4248a80 0x5629d4252a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:54:36.692 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.692+0000 7f5b1a414b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5629d424a2d0 0x5629d4252fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:54:36.692 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.692+0000 7f5b1a414b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5629d4257f80 0x5629d425a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:54:36.692 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.692+0000 7f5b1a414b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629d4135500 con 0x5629d4257f80 2024-06-02T04:54:36.693 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.692+0000 7f5b1a414b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629d41351a0 con 0x5629d4248a80 2024-06-02T04:54:36.693 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.692+0000 7f5b1a414b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629d401c640 con 0x5629d424a2d0 2024-06-02T04:54:36.693 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.692+0000 7f5b1a414b80 10 client.0 _ll_register_callbacks cb 0x5629d413ead0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:54:36.694 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.692+0000 7f5b06ffd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5629d424a2d0 0x5629d4252fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:54:36.694 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.692+0000 7f5b06ffd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5629d424a2d0 0x5629d4252fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:49462/0 (socket says 172.21.15.76:49462) 2024-06-02T04:54:36.694 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.692+0000 7f5b06ffd700 1 -- 172.21.15.76:0/286720399 learned_addr learned my addr 172.21.15.76:0/286720399 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:54:36.694 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.692+0000 7f5b077fe700 1 --2- 172.21.15.76:0/286720399 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5629d4248a80 0x5629d4252a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:54:36.694 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.693+0000 7f5b07fff700 1 --2- 172.21.15.76:0/286720399 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5629d4257f80 0x5629d425a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:54:36.694 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.693+0000 7f5b077fe700 1 -- 172.21.15.76:0/286720399 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5629d424a2d0 msgr2=0x5629d4252fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:54:36.694 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.693+0000 7f5b077fe700 1 --2- 172.21.15.76:0/286720399 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5629d424a2d0 0x5629d4252fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:36.694 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.693+0000 7f5b077fe700 1 -- 172.21.15.76:0/286720399 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5629d4257f80 msgr2=0x5629d425a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:54:36.694 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.693+0000 7f5b077fe700 1 --2- 172.21.15.76:0/286720399 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5629d4257f80 0x5629d425a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:36.694 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.693+0000 7f5b077fe700 1 -- 172.21.15.76:0/286720399 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5afc00e040 con 0x5629d4248a80 2024-06-02T04:54:36.694 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.693+0000 7f5b077fe700 1 --2- 172.21.15.76:0/286720399 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5629d4248a80 0x5629d4252a60 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x5629d4249850 tx=0x7f5af809aa60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=82e298dcc9bb5709 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:54:36.695 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.693+0000 7f5ae6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-06-02T04:54:36.695 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.693+0000 7f5ae6ffd700 1 -- 172.21.15.76:0/286720399 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af809aea0 con 0x5629d4248a80 2024-06-02T04:54:36.695 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.693+0000 7f5ae6ffd700 1 -- 172.21.15.76:0/286720399 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f5af809ecd0 con 0x5629d4248a80 2024-06-02T04:54:36.695 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.694+0000 7f5b1a414b80 1 -- 172.21.15.76:0/286720399 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5629d40f2210 con 0x5629d4248a80 2024-06-02T04:54:36.695 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.694+0000 7f5ae6ffd700 1 -- 172.21.15.76:0/286720399 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5af80a3290 con 0x5629d4248a80 2024-06-02T04:54:36.695 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.694+0000 7f5b1a414b80 10 client.25661 fetch_fsmap learned FSMap version 32 2024-06-02T04:54:36.695 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.694+0000 7f5b1a414b80 1 -- 172.21.15.76:0/286720399 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x5629d3fc6b00 con 0x5629d4248a80 2024-06-02T04:54:36.695 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.694+0000 7f5ae6ffd700 1 -- 172.21.15.76:0/286720399 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5629d40f2210 con 0x5629d4248a80 2024-06-02T04:54:36.696 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.694+0000 7f5ae6ffd700 1 -- 172.21.15.76:0/286720399 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 32) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f5af809a390 con 0x5629d4248a80 2024-06-02T04:54:36.696 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.694+0000 7f5b1a414b80 10 client.25661 fetch_fsmap finished waiting for FSMap version 32 2024-06-02T04:54:36.696 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.694+0000 7f5b1a414b80 10 client.25661 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T04:54:36.696 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.694+0000 7f5b1a414b80 20 client.25661 populate_metadata read hostname 'smithi076' 2024-06-02T04:54:36.696 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.694+0000 7f5b1a414b80 1 --2- 172.21.15.76:0/286720399 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5629d425e840 0x5629d4260c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:54:36.696 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.694+0000 7f5b1a414b80 4 client.25661 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T04:54:36.696 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.694+0000 7f5b1a414b80 1 -- 172.21.15.76:0/286720399 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5629d42187b0 con 0x5629d425e840 2024-06-02T04:54:36.697 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.695+0000 7f5b06ffd700 1 --2- 172.21.15.76:0/286720399 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5629d425e840 0x5629d4260c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:54:36.697 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.696+0000 7f5b06ffd700 1 --2- 172.21.15.76:0/286720399 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5629d425e840 0x5629d4260c30 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f3926a7054eadaa server_cookie=fbf8ea3935d2f5b8 in_seq=0 out_seq=0 2024-06-02T04:54:36.700 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.699+0000 7f5ae6ffd700 10 client.25661 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:54:36.700 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.699+0000 7f5ae6ffd700 1 -- 172.21.15.76:0/286720399 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5629d42187b0 con 0x5629d425e840 2024-06-02T04:54:36.700 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.699+0000 7f5ae6ffd700 10 client.25661 handle_command_reply: tid=0 2024-06-02T04:54:36.700 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.699+0000 7f5b1a414b80 1 client.25661 shutdown 2024-06-02T04:54:36.700 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.699+0000 7f5b1a414b80 1 -- 172.21.15.76:0/286720399 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5629d4248a80 msgr2=0x5629d4252a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:54:36.700 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.699+0000 7f5b1a414b80 1 --2- 172.21.15.76:0/286720399 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5629d4248a80 0x5629d4252a60 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x5629d4249850 tx=0x7f5af809aa60 comp rx=0 tx=0).stop 2024-06-02T04:54:36.700 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.699+0000 7f5b1a414b80 1 -- 172.21.15.76:0/286720399 shutdown_connections 2024-06-02T04:54:36.701 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.699+0000 7f5b1a414b80 1 --2- 172.21.15.76:0/286720399 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5629d425e840 0x5629d4260c30 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:36.701 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.699+0000 7f5b1a414b80 1 --2- 172.21.15.76:0/286720399 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5629d4257f80 0x5629d425a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:36.701 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.699+0000 7f5b1a414b80 1 --2- 172.21.15.76:0/286720399 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5629d4248a80 0x5629d4252a60 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:36.701 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.699+0000 7f5b1a414b80 1 --2- 172.21.15.76:0/286720399 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5629d424a2d0 0x5629d4252fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:36.701 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.699+0000 7f5b1a414b80 1 -- 172.21.15.76:0/286720399 >> 172.21.15.76:0/286720399 conn(0x5629d41a71b0 msgr2=0x5629d4243860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:54:36.701 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.699+0000 7f5ae6ffd700 0 client.25661 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:54:36.701 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.700+0000 7f5b1a414b80 1 -- 172.21.15.76:0/286720399 shutdown_connections 2024-06-02T04:54:36.701 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.700+0000 7f5b1a414b80 1 -- 172.21.15.76:0/286720399 wait complete. 2024-06-02T04:54:36.701 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.700+0000 7f5b1a414b80 20 client.25661 trim_cache size 0 max 16384 2024-06-02T04:54:36.724 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.723+0000 7f5b1a414b80 1 Processor -- start 2024-06-02T04:54:36.725 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.723+0000 7f5b1a414b80 1 -- start start 2024-06-02T04:54:36.727 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.724+0000 7f5b1a414b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5629d4248a80 0x5629d42515c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:54:36.728 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.724+0000 7f5b1a414b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5629d424a2d0 0x5629d4250970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:54:36.728 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.724+0000 7f5b1a414b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5629d4257f80 0x5629d424a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:54:36.728 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.724+0000 7f5b1a414b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629d4249880 con 0x5629d424a2d0 2024-06-02T04:54:36.728 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.724+0000 7f5b1a414b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629d423bab0 con 0x5629d4248a80 2024-06-02T04:54:36.728 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.724+0000 7f5b1a414b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629d4253c00 con 0x5629d4257f80 2024-06-02T04:54:36.728 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.725+0000 7f5b06ffd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5629d424a2d0 0x5629d4250970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:54:36.728 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.725+0000 7f5b06ffd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5629d424a2d0 0x5629d4250970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:43064/0 (socket says 172.21.15.76:43064) 2024-06-02T04:54:36.729 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.725+0000 7f5b06ffd700 1 -- 172.21.15.76:0/2051003305 learned_addr learned my addr 172.21.15.76:0/2051003305 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:54:36.729 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.725+0000 7f5b06ffd700 1 -- 172.21.15.76:0/2051003305 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5629d4257f80 msgr2=0x5629d424a6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-02T04:54:36.729 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.725+0000 7f5b06ffd700 1 --2- 172.21.15.76:0/2051003305 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5629d4257f80 0x5629d424a6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:36.729 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.725+0000 7f5b06ffd700 1 -- 172.21.15.76:0/2051003305 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5629d4248a80 msgr2=0x5629d42515c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:54:36.729 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.725+0000 7f5b077fe700 1 --2- 172.21.15.76:0/2051003305 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5629d4248a80 0x5629d42515c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:54:36.729 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.725+0000 7f5b06ffd700 1 --2- 172.21.15.76:0/2051003305 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5629d4248a80 0x5629d42515c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:36.729 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.725+0000 7f5b06ffd700 1 -- 172.21.15.76:0/2051003305 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5629d415f500 con 0x5629d424a2d0 2024-06-02T04:54:36.729 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.729+0000 7f5b06ffd700 1 --2- 172.21.15.76:0/2051003305 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5629d424a2d0 0x5629d4250970 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f5afc013040 tx=0x7f5afc01f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=458062d249af5497 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:54:36.730 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.730+0000 7f5aee7fc700 1 -- 172.21.15.76:0/2051003305 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5afc031070 con 0x5629d424a2d0 2024-06-02T04:54:36.730 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.730+0000 7f5aee7fc700 1 -- 172.21.15.76:0/2051003305 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5afc021070 con 0x5629d424a2d0 2024-06-02T04:54:36.730 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.730+0000 7f5aee7fc700 1 -- 172.21.15.76:0/2051003305 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5afc014cc0 con 0x5629d424a2d0 2024-06-02T04:54:36.731 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.730+0000 7f5b1a414b80 1 -- 172.21.15.76:0/2051003305 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5629d424a2d0 msgr2=0x5629d4250970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:54:36.731 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.730+0000 7f5b1a414b80 1 --2- 172.21.15.76:0/2051003305 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5629d424a2d0 0x5629d4250970 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f5afc013040 tx=0x7f5afc01f000 comp rx=0 tx=0).stop 2024-06-02T04:54:36.731 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.731+0000 7f5b1a414b80 1 -- 172.21.15.76:0/2051003305 shutdown_connections 2024-06-02T04:54:36.731 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.731+0000 7f5b1a414b80 1 --2- 172.21.15.76:0/2051003305 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5629d4257f80 0x5629d424a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:36.731 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.731+0000 7f5b1a414b80 1 --2- 172.21.15.76:0/2051003305 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5629d4248a80 0x5629d42515c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:36.732 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.731+0000 7f5b1a414b80 1 --2- 172.21.15.76:0/2051003305 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5629d424a2d0 0x5629d4250970 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:36.732 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.731+0000 7f5b1a414b80 1 -- 172.21.15.76:0/2051003305 >> 172.21.15.76:0/2051003305 conn(0x5629d41a71b0 msgr2=0x5629d4251f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:54:36.732 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.731+0000 7f5b1a414b80 1 -- 172.21.15.76:0/2051003305 shutdown_connections 2024-06-02T04:54:36.734 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.731+0000 7f5b1a414b80 1 -- 172.21.15.76:0/2051003305 wait complete. 2024-06-02T04:54:36.735 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.731+0000 7f5b1a414b80 1 -- start start 2024-06-02T04:54:36.735 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.732+0000 7f5b1a414b80 1 Processor -- start 2024-06-02T04:54:36.735 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.732+0000 7f5b1a414b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5629d4248a80 0x5629d426dd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:54:36.735 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.732+0000 7f5b1a414b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5629d424a2d0 0x5629d426e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:54:36.735 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.732+0000 7f5b1a414b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5629d4257f80 0x5629d426e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:54:36.735 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.732+0000 7f5b1a414b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629d426efc0 con 0x5629d4248a80 2024-06-02T04:54:36.735 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.732+0000 7f5b1a414b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629d426f130 con 0x5629d424a2d0 2024-06-02T04:54:36.735 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.732+0000 7f5b1a414b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629d426f2f0 con 0x5629d4257f80 2024-06-02T04:54:36.735 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.732+0000 7f5b1a414b80 10 client.0 _ll_register_callbacks cb 0x5629d413ead0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:54:36.735 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.733+0000 7f5b06ffd700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5629d424a2d0 0x5629d426e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:54:36.735 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.733+0000 7f5b07fff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5629d4257f80 0x5629d426e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:54:36.736 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.733+0000 7f5b07fff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5629d4257f80 0x5629d426e8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:49476/0 (socket says 172.21.15.76:49476) 2024-06-02T04:54:36.736 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.733+0000 7f5b07fff700 1 -- 172.21.15.76:0/1784101582 learned_addr learned my addr 172.21.15.76:0/1784101582 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:54:36.736 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.733+0000 7f5b06ffd700 1 -- 172.21.15.76:0/1784101582 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5629d4257f80 msgr2=0x5629d426e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:54:36.736 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.733+0000 7f5b06ffd700 1 --2- 172.21.15.76:0/1784101582 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5629d4257f80 0x5629d426e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:36.736 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.733+0000 7f5b06ffd700 1 -- 172.21.15.76:0/1784101582 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5629d4248a80 msgr2=0x5629d426dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:54:36.736 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.733+0000 7f5b06ffd700 1 --2- 172.21.15.76:0/1784101582 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5629d4248a80 0x5629d426dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:36.736 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.733+0000 7f5b06ffd700 1 -- 172.21.15.76:0/1784101582 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5629d401a350 con 0x5629d424a2d0 2024-06-02T04:54:36.736 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.733+0000 7f5b06ffd700 1 --2- 172.21.15.76:0/1784101582 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5629d424a2d0 0x5629d426e2a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5afc0077c0 tx=0x7f5afc012f00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0a58c06c685d801 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:54:36.736 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.734+0000 7f5ae6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-06-02T04:54:36.736 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.734+0000 7f5ae6ffd700 1 -- 172.21.15.76:0/1784101582 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5afc031040 con 0x5629d424a2d0 2024-06-02T04:54:36.736 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.734+0000 7f5ae6ffd700 1 -- 172.21.15.76:0/1784101582 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f5afc023070 con 0x5629d424a2d0 2024-06-02T04:54:36.736 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.734+0000 7f5b1a414b80 1 -- 172.21.15.76:0/1784101582 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5afc012be0 con 0x5629d424a2d0 2024-06-02T04:54:36.736 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.734+0000 7f5ae6ffd700 1 -- 172.21.15.76:0/1784101582 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5afc004040 con 0x5629d424a2d0 2024-06-02T04:54:36.737 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.735+0000 7f5b1a414b80 10 client.25664 fetch_fsmap learned FSMap version 32 2024-06-02T04:54:36.738 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.735+0000 7f5b1a414b80 1 -- 172.21.15.76:0/1784101582 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x5629d401ec70 con 0x5629d424a2d0 2024-06-02T04:54:36.738 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.736+0000 7f5ae6ffd700 1 -- 172.21.15.76:0/1784101582 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5afc012be0 con 0x5629d424a2d0 2024-06-02T04:54:36.738 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.736+0000 7f5ae6ffd700 1 -- 172.21.15.76:0/1784101582 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 32) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f5afc03a020 con 0x5629d424a2d0 2024-06-02T04:54:36.738 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.736+0000 7f5b1a414b80 10 client.25664 fetch_fsmap finished waiting for FSMap version 32 2024-06-02T04:54:36.738 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.736+0000 7f5b1a414b80 10 client.25664 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T04:54:36.738 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.736+0000 7f5b1a414b80 20 client.25664 populate_metadata read hostname 'smithi076' 2024-06-02T04:54:36.738 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.736+0000 7f5b1a414b80 1 --2- 172.21.15.76:0/1784101582 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5629d42b4b60 0x5629d42b6f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:54:36.738 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.736+0000 7f5b1a414b80 4 client.25664 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T04:54:36.738 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.736+0000 7f5b1a414b80 1 -- 172.21.15.76:0/1784101582 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5629d4191e60 con 0x5629d42b4b60 2024-06-02T04:54:36.738 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.736+0000 7f5b077fe700 1 --2- 172.21.15.76:0/1784101582 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5629d42b4b60 0x5629d42b6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:54:36.738 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.737+0000 7f5b077fe700 1 --2- 172.21.15.76:0/1784101582 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5629d42b4b60 0x5629d42b6f80 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dbcfd936e63f60dc server_cookie=bc2717f26490d1c9 in_seq=0 out_seq=0 2024-06-02T04:54:36.739 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.737+0000 7f5ae6ffd700 10 client.25664 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:54:36.759 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.758+0000 7f5ae6ffd700 1 -- 172.21.15.76:0/1784101582 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5629d4191e60 con 0x5629d42b4b60 2024-06-02T04:54:36.759 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.758+0000 7f5ae6ffd700 10 client.25664 handle_command_reply: tid=0 2024-06-02T04:54:36.759 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.758+0000 7f5b1a414b80 1 client.25664 shutdown 2024-06-02T04:54:36.759 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.758+0000 7f5b1a414b80 1 -- 172.21.15.76:0/1784101582 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5629d424a2d0 msgr2=0x5629d426e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:54:36.759 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.758+0000 7f5b1a414b80 1 --2- 172.21.15.76:0/1784101582 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5629d424a2d0 0x5629d426e2a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5afc0077c0 tx=0x7f5afc012f00 comp rx=0 tx=0).stop 2024-06-02T04:54:36.760 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.759+0000 7f5b1a414b80 1 -- 172.21.15.76:0/1784101582 shutdown_connections 2024-06-02T04:54:36.760 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.759+0000 7f5b1a414b80 1 --2- 172.21.15.76:0/1784101582 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5629d42b4b60 0x5629d42b6f80 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:36.760 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.759+0000 7f5b1a414b80 1 --2- 172.21.15.76:0/1784101582 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5629d4257f80 0x5629d426e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:36.760 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.759+0000 7f5b1a414b80 1 --2- 172.21.15.76:0/1784101582 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5629d4248a80 0x5629d426dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:36.760 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.759+0000 7f5ae6ffd700 0 client.25664 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:54:36.760 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.759+0000 7f5b1a414b80 1 --2- 172.21.15.76:0/1784101582 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5629d424a2d0 0x5629d426e2a0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:36.760 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.759+0000 7f5b1a414b80 1 -- 172.21.15.76:0/1784101582 >> 172.21.15.76:0/1784101582 conn(0x5629d41a71b0 msgr2=0x5629d424d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:54:36.760 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.759+0000 7f5b1a414b80 1 -- 172.21.15.76:0/1784101582 shutdown_connections 2024-06-02T04:54:36.760 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.759+0000 7f5b1a414b80 1 -- 172.21.15.76:0/1784101582 wait complete. 2024-06-02T04:54:36.762 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.762+0000 7f5b1a414b80 20 client.25664 trim_cache size 0 max 16384 2024-06-02T04:54:36.763 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:{ 2024-06-02T04:54:36.763 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "message": "", 2024-06-02T04:54:36.763 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "return_code": 0 2024-06-02T04:54:36.763 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:} 2024-06-02T04:54:36.764 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.764+0000 7f5b0e259700 1 -- 172.21.15.76:0/3383441682 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f5af00a10b0 msgr2=0x7f5af00a3570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:54:36.765 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.764+0000 7f5b0e259700 1 --2- 172.21.15.76:0/3383441682 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f5af00a10b0 0x7f5af00a3570 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f5afc007870 tx=0x7f5afc012d50 comp rx=0 tx=0).stop 2024-06-02T04:54:36.765 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.764+0000 7f5b0e259700 1 -- 172.21.15.76:0/3383441682 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5b08103140 msgr2=0x7f5b081071c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:54:36.765 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.764+0000 7f5b0e259700 1 --2- 172.21.15.76:0/3383441682 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5b08103140 0x7f5b081071c0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f5af8009230 tx=0x7f5af800b790 comp rx=0 tx=0).stop 2024-06-02T04:54:36.765 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.764+0000 7f5b0e259700 1 -- 172.21.15.76:0/3383441682 shutdown_connections 2024-06-02T04:54:36.765 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.764+0000 7f5b0e259700 1 --2- 172.21.15.76:0/3383441682 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f5af00a10b0 0x7f5af00a3570 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:36.765 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.764+0000 7f5b0e259700 1 --2- 172.21.15.76:0/3383441682 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5b08104cd0 0x7f5b0810a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:36.765 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.764+0000 7f5b0e259700 1 --2- 172.21.15.76:0/3383441682 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5b08103140 0x7f5b081071c0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:36.765 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.764+0000 7f5b0e259700 1 --2- 172.21.15.76:0/3383441682 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b08104330 0x7f5b08107700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:36.766 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.764+0000 7f5b0e259700 1 -- 172.21.15.76:0/3383441682 >> 172.21.15.76:0/3383441682 conn(0x7f5b080fe6b0 msgr2=0x7f5b08077680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:54:36.772 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.769+0000 7f5b0e259700 1 -- 172.21.15.76:0/3383441682 shutdown_connections 2024-06-02T04:54:36.772 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:36.770+0000 7f5b0e259700 1 -- 172.21.15.76:0/3383441682 wait complete. 2024-06-02T04:54:37.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:54:37 smithi076 ceph-mon[42935]: pgmap v419: 129 pgs: 129 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 11 MiB/s wr, 947 op/s 2024-06-02T04:54:37.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:54:37 smithi119 ceph-mon[46633]: pgmap v419: 129 pgs: 129 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 11 MiB/s wr, 947 op/s 2024-06-02T04:54:37.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:54:37 smithi192 ceph-mon[47933]: pgmap v419: 129 pgs: 129 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 11 MiB/s wr, 947 op/s 2024-06-02T04:54:39.737 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:54:39 smithi076 ceph-mon[42935]: pgmap v420: 129 pgs: 129 active+clean; 1.5 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 10 MiB/s wr, 898 op/s 2024-06-02T04:54:39.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:54:39 smithi119 ceph-mon[46633]: pgmap v420: 129 pgs: 129 active+clean; 1.5 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 10 MiB/s wr, 898 op/s 2024-06-02T04:54:39.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:54:39 smithi192 ceph-mon[47933]: pgmap v420: 129 pgs: 129 active+clean; 1.5 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 10 MiB/s wr, 898 op/s 2024-06-02T04:54:40.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:54:40 smithi119 ceph-mon[46633]: pgmap v421: 129 pgs: 129 active+clean; 1.5 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 10 MiB/s wr, 917 op/s 2024-06-02T04:54:40.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:54:40 smithi192 ceph-mon[47933]: pgmap v421: 129 pgs: 129 active+clean; 1.5 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 10 MiB/s wr, 917 op/s 2024-06-02T04:54:40.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:54:40 smithi076 ceph-mon[42935]: pgmap v421: 129 pgs: 129 active+clean; 1.5 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 10 MiB/s wr, 917 op/s 2024-06-02T04:54:41.316 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 230.0 s, 852.2 tps, lat 113.994 ms stddev 37.899 2024-06-02T04:54:43.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:54:43 smithi192 ceph-mon[47933]: pgmap v422: 129 pgs: 129 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 11 MiB/s wr, 994 op/s 2024-06-02T04:54:43.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:54:43 smithi076 ceph-mon[42935]: pgmap v422: 129 pgs: 129 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 11 MiB/s wr, 994 op/s 2024-06-02T04:54:43.847 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:54:43 smithi119 ceph-mon[46633]: pgmap v422: 129 pgs: 129 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 11 MiB/s wr, 994 op/s 2024-06-02T04:54:45.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:54:45 smithi192 ceph-mon[47933]: pgmap v423: 129 pgs: 129 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 9.4 MiB/s wr, 839 op/s 2024-06-02T04:54:45.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:54:45 smithi076 ceph-mon[42935]: pgmap v423: 129 pgs: 129 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 9.4 MiB/s wr, 839 op/s 2024-06-02T04:54:45.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:54:45 smithi119 ceph-mon[46633]: pgmap v423: 129 pgs: 129 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 9.4 MiB/s wr, 839 op/s 2024-06-02T04:54:46.316 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 235.0 s, 888.5 tps, lat 115.742 ms stddev 106.701 2024-06-02T04:54:47.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:54:47 smithi192 ceph-mon[47933]: pgmap v424: 129 pgs: 129 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 11 MiB/s wr, 942 op/s 2024-06-02T04:54:47.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:54:47 smithi076 ceph-mon[42935]: pgmap v424: 129 pgs: 129 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 11 MiB/s wr, 942 op/s 2024-06-02T04:54:47.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:54:47 smithi119 ceph-mon[46633]: pgmap v424: 129 pgs: 129 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 11 MiB/s wr, 942 op/s 2024-06-02T04:54:49.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:54:49 smithi192 ceph-mon[47933]: pgmap v425: 129 pgs: 129 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 9.9 MiB/s wr, 876 op/s 2024-06-02T04:54:49.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:54:49 smithi076 ceph-mon[42935]: pgmap v425: 129 pgs: 129 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 9.9 MiB/s wr, 876 op/s 2024-06-02T04:54:49.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:54:49 smithi119 ceph-mon[46633]: pgmap v425: 129 pgs: 129 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 9.9 MiB/s wr, 876 op/s 2024-06-02T04:54:49.956 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.954+0000 7fd544065700 1 -- 172.21.15.76:0/2358768060 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd53c0736a0 msgr2=0x7fd53c078220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:54:49.956 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.954+0000 7fd544065700 1 --2- 172.21.15.76:0/2358768060 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd53c0736a0 0x7fd53c078220 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fd52c009990 tx=0x7fd52c009ca0 comp rx=0 tx=0).stop 2024-06-02T04:54:49.956 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.955+0000 7fd544065700 1 -- 172.21.15.76:0/2358768060 shutdown_connections 2024-06-02T04:54:49.956 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.955+0000 7fd544065700 1 --2- 172.21.15.76:0/2358768060 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd53c072b80 0x7fd53c07b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:49.956 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.955+0000 7fd544065700 1 --2- 172.21.15.76:0/2358768060 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd53c0731f0 0x7fd53c075cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:49.957 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.955+0000 7fd544065700 1 --2- 172.21.15.76:0/2358768060 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd53c0736a0 0x7fd53c078220 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:49.957 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.955+0000 7fd544065700 1 -- 172.21.15.76:0/2358768060 >> 172.21.15.76:0/2358768060 conn(0x7fd53c06df30 msgr2=0x7fd53c070370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:54:49.957 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.957+0000 7fd544065700 1 -- 172.21.15.76:0/2358768060 shutdown_connections 2024-06-02T04:54:49.960 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.959+0000 7fd544065700 1 -- 172.21.15.76:0/2358768060 wait complete. 2024-06-02T04:54:49.960 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.960+0000 7fd544065700 1 Processor -- start 2024-06-02T04:54:49.961 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.960+0000 7fd544065700 1 -- start start 2024-06-02T04:54:49.961 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.960+0000 7fd544065700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd53c072b80 0x7fd53c07e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:54:49.961 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.960+0000 7fd544065700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd53c0731f0 0x7fd53c07cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:54:49.961 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.960+0000 7fd544065700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd53c0736a0 0x7fd53c07d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:54:49.961 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.961+0000 7fd544065700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd53c1b44e0 con 0x7fd53c0736a0 2024-06-02T04:54:49.961 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.961+0000 7fd544065700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd53c1b4650 con 0x7fd53c072b80 2024-06-02T04:54:49.961 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.961+0000 7fd544065700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd53c1b4810 con 0x7fd53c0731f0 2024-06-02T04:54:49.962 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.961+0000 7fd542602700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd53c0736a0 0x7fd53c07d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:54:49.963 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.961+0000 7fd542602700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd53c0736a0 0x7fd53c07d050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:41942/0 (socket says 172.21.15.76:41942) 2024-06-02T04:54:49.963 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.961+0000 7fd542602700 1 -- 172.21.15.76:0/3110507278 learned_addr learned my addr 172.21.15.76:0/3110507278 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:54:49.963 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.962+0000 7fd542602700 1 -- 172.21.15.76:0/3110507278 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd53c0731f0 msgr2=0x7fd53c07cb10 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-06-02T04:54:49.963 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.962+0000 7fd542602700 1 --2- 172.21.15.76:0/3110507278 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd53c0731f0 0x7fd53c07cb10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:49.963 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.962+0000 7fd542602700 1 -- 172.21.15.76:0/3110507278 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd53c072b80 msgr2=0x7fd53c07e480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-02T04:54:49.963 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.962+0000 7fd542602700 1 --2- 172.21.15.76:0/3110507278 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd53c072b80 0x7fd53c07e480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:49.963 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.962+0000 7fd542602700 1 -- 172.21.15.76:0/3110507278 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd52c0095f0 con 0x7fd53c0736a0 2024-06-02T04:54:49.963 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.962+0000 7fd542602700 1 --2- 172.21.15.76:0/3110507278 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd53c0736a0 0x7fd53c07d050 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fd53400ef30 tx=0x7fd53400c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:54:49.965 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.963+0000 7fd532ffd700 1 -- 172.21.15.76:0/3110507278 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd534018070 con 0x7fd53c0736a0 2024-06-02T04:54:49.965 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.963+0000 7fd532ffd700 1 -- 172.21.15.76:0/3110507278 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd53400f040 con 0x7fd53c0736a0 2024-06-02T04:54:49.965 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.963+0000 7fd532ffd700 1 -- 172.21.15.76:0/3110507278 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd534003d30 con 0x7fd53c0736a0 2024-06-02T04:54:49.965 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.965+0000 7fd544065700 1 -- 172.21.15.76:0/3110507278 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd53c1b4a30 con 0x7fd53c0736a0 2024-06-02T04:54:49.966 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.965+0000 7fd544065700 1 -- 172.21.15.76:0/3110507278 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd53c1b4ec0 con 0x7fd53c0736a0 2024-06-02T04:54:49.971 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.970+0000 7fd532ffd700 1 -- 172.21.15.76:0/3110507278 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fd53400caa0 con 0x7fd53c0736a0 2024-06-02T04:54:49.973 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.973+0000 7fd550220b80 1 Processor -- start 2024-06-02T04:54:49.974 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.973+0000 7fd532ffd700 1 --2- 172.21.15.76:0/3110507278 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fd5280a11a0 0x7fd5280a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:54:49.974 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.973+0000 7fd532ffd700 1 -- 172.21.15.76:0/3110507278 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7fd5340cf170 con 0x7fd53c0736a0 2024-06-02T04:54:49.974 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.974+0000 7fd541600700 1 --2- 172.21.15.76:0/3110507278 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fd5280a11a0 0x7fd5280a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:54:49.974 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.974+0000 7fd550220b80 1 -- start start 2024-06-02T04:54:49.975 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.974+0000 7fd550220b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55805e8cea80 0x55805e8ceea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:54:49.979 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.974+0000 7fd550220b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55805e8cf3e0 0x55805e8cfcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:54:49.979 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.974+0000 7fd550220b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55805e8d02d0 0x55805e8d0750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:54:49.980 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.974+0000 7fd550220b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55805e8260f0 con 0x55805e8d02d0 2024-06-02T04:54:49.980 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.974+0000 7fd550220b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55805e823ab0 con 0x55805e8cf3e0 2024-06-02T04:54:49.980 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.974+0000 7fd550220b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55805e81f3a0 con 0x55805e8cea80 2024-06-02T04:54:49.985 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.974+0000 7fd541600700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55805e8cf3e0 0x55805e8cfcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:54:49.985 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.975+0000 7fd541600700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55805e8cf3e0 0x55805e8cfcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:38982/0 (socket says 172.21.15.76:38982) 2024-06-02T04:54:49.985 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.975+0000 7fd541600700 1 -- 172.21.15.76:0/3940937197 learned_addr learned my addr 172.21.15.76:0/3940937197 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:54:49.985 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.975+0000 7fd541e01700 1 --2- 172.21.15.76:0/3940937197 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55805e8cea80 0x55805e8ceea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:54:49.985 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.975+0000 7fd542602700 1 --2- 172.21.15.76:0/3940937197 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55805e8d02d0 0x55805e8d0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:54:49.985 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.975+0000 7fd541e01700 1 -- 172.21.15.76:0/3940937197 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55805e8cf3e0 msgr2=0x55805e8cfcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:54:49.985 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.975+0000 7fd541e01700 1 --2- 172.21.15.76:0/3940937197 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55805e8cf3e0 0x55805e8cfcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:49.985 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.975+0000 7fd541e01700 1 -- 172.21.15.76:0/3940937197 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55805e8d02d0 msgr2=0x55805e8d0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:54:49.986 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.975+0000 7fd541e01700 1 --2- 172.21.15.76:0/3940937197 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55805e8d02d0 0x55805e8d0750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:49.986 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.975+0000 7fd541e01700 1 -- 172.21.15.76:0/3940937197 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55805e6a0350 con 0x55805e8cea80 2024-06-02T04:54:49.986 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.975+0000 7fd542602700 1 --2- 172.21.15.76:0/3940937197 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55805e8d02d0 0x55805e8d0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T04:54:49.986 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.975+0000 7fd541e01700 1 --2- 172.21.15.76:0/3940937197 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55805e8cea80 0x55805e8ceea0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd538009740 tx=0x7fd538009a50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d2d796c3447b07c6 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:54:49.986 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.976+0000 7fd527fff700 1 -- 172.21.15.76:0/3940937197 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd538011830 con 0x55805e8cea80 2024-06-02T04:54:49.986 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.976+0000 7fd527fff700 1 -- 172.21.15.76:0/3940937197 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd538011e20 con 0x55805e8cea80 2024-06-02T04:54:49.986 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.976+0000 7fd527fff700 1 -- 172.21.15.76:0/3940937197 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd538010da0 con 0x55805e8cea80 2024-06-02T04:54:49.986 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.977+0000 7fd550220b80 1 -- 172.21.15.76:0/3940937197 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55805e8cea80 msgr2=0x55805e8ceea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:54:49.986 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.977+0000 7fd550220b80 1 --2- 172.21.15.76:0/3940937197 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55805e8cea80 0x55805e8ceea0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd538009740 tx=0x7fd538009a50 comp rx=0 tx=0).stop 2024-06-02T04:54:49.986 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.977+0000 7fd550220b80 1 -- 172.21.15.76:0/3940937197 shutdown_connections 2024-06-02T04:54:49.986 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.977+0000 7fd550220b80 1 --2- 172.21.15.76:0/3940937197 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55805e8d02d0 0x55805e8d0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:49.987 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.977+0000 7fd550220b80 1 --2- 172.21.15.76:0/3940937197 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55805e8cea80 0x55805e8ceea0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:49.987 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.977+0000 7fd550220b80 1 --2- 172.21.15.76:0/3940937197 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55805e8cf3e0 0x55805e8cfcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:49.987 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.977+0000 7fd550220b80 1 -- 172.21.15.76:0/3940937197 >> 172.21.15.76:0/3940937197 conn(0x55805e82d1b0 msgr2=0x55805e8cb440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:54:49.987 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.978+0000 7fd541600700 1 --2- 172.21.15.76:0/3110507278 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fd5280a11a0 0x7fd5280a3660 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fd52c000c00 tx=0x7fd52c005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:54:49.987 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.978+0000 7fd550220b80 1 -- 172.21.15.76:0/3940937197 shutdown_connections 2024-06-02T04:54:49.987 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.978+0000 7fd550220b80 1 -- 172.21.15.76:0/3940937197 wait complete. 2024-06-02T04:54:49.987 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.979+0000 7fd550220b80 1 -- start start 2024-06-02T04:54:49.987 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.979+0000 7fd550220b80 1 Processor -- start 2024-06-02T04:54:49.987 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.979+0000 7fd550220b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55805e8cea80 0x55805e8d89b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:54:49.987 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.979+0000 7fd550220b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55805e8d02d0 0x55805e8d8ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:54:49.987 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.979+0000 7fd550220b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55805e8ddf20 0x55805e8e0310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:54:49.987 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.979+0000 7fd550220b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55805e7bb500 con 0x55805e8cea80 2024-06-02T04:54:49.987 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.979+0000 7fd550220b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55805e7bb1a0 con 0x55805e8ddf20 2024-06-02T04:54:49.988 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.979+0000 7fd550220b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55805e6a2640 con 0x55805e8d02d0 2024-06-02T04:54:49.988 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.979+0000 7fd550220b80 10 client.0 _ll_register_callbacks cb 0x55805e7c4ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:54:49.988 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.980+0000 7fd541600700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55805e8d02d0 0x55805e8d8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:54:49.988 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.980+0000 7fd541600700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55805e8d02d0 0x55805e8d8ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:51776/0 (socket says 172.21.15.76:51776) 2024-06-02T04:54:49.988 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.980+0000 7fd541600700 1 -- 172.21.15.76:0/2577708122 learned_addr learned my addr 172.21.15.76:0/2577708122 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:54:49.988 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.980+0000 7fd541e01700 1 --2- 172.21.15.76:0/2577708122 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55805e8cea80 0x55805e8d89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:54:49.988 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.980+0000 7fd542602700 1 --2- 172.21.15.76:0/2577708122 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55805e8ddf20 0x55805e8e0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:54:49.988 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.980+0000 7fd541600700 1 -- 172.21.15.76:0/2577708122 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55805e8ddf20 msgr2=0x55805e8e0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:54:49.988 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.980+0000 7fd541600700 1 --2- 172.21.15.76:0/2577708122 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55805e8ddf20 0x55805e8e0310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:49.988 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.980+0000 7fd541600700 1 -- 172.21.15.76:0/2577708122 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55805e8cea80 msgr2=0x55805e8d89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:54:49.988 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.980+0000 7fd541600700 1 --2- 172.21.15.76:0/2577708122 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55805e8cea80 0x55805e8d89b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:49.988 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.980+0000 7fd541600700 1 -- 172.21.15.76:0/2577708122 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd53c1b4ec0 con 0x55805e8d02d0 2024-06-02T04:54:49.989 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.980+0000 7fd541600700 1 --2- 172.21.15.76:0/2577708122 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55805e8d02d0 0x55805e8d8ef0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd52c00b670 tx=0x7fd52c009ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=58ba9c7d2406d664 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:54:49.989 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.980+0000 7fd5257fa700 10 client.0 ms_handle_connect on v2:172.21.15.192:3300/0 2024-06-02T04:54:49.989 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.981+0000 7fd5257fa700 1 -- 172.21.15.76:0/2577708122 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd52c01d070 con 0x55805e8d02d0 2024-06-02T04:54:49.989 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.981+0000 7fd5257fa700 1 -- 172.21.15.76:0/2577708122 <== mon.1 v2:172.21.15.192:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7fd52c0041c0 con 0x55805e8d02d0 2024-06-02T04:54:49.989 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.981+0000 7fd550220b80 1 -- 172.21.15.76:0/2577708122 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55805e778210 con 0x55805e8d02d0 2024-06-02T04:54:49.989 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.981+0000 7fd5257fa700 1 -- 172.21.15.76:0/2577708122 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd52c00bc80 con 0x55805e8d02d0 2024-06-02T04:54:49.989 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.981+0000 7fd550220b80 10 client.25606 fetch_fsmap learned FSMap version 32 2024-06-02T04:54:49.989 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.981+0000 7fd550220b80 1 -- 172.21.15.76:0/2577708122 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x7fd538009370 con 0x55805e8d02d0 2024-06-02T04:54:49.989 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.981+0000 7fd5257fa700 1 -- 172.21.15.76:0/2577708122 <== mon.1 v2:172.21.15.192:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55805e778210 con 0x55805e8d02d0 2024-06-02T04:54:49.989 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.982+0000 7fd5257fa700 1 -- 172.21.15.76:0/2577708122 <== mon.1 v2:172.21.15.192:3300/0 5 ==== fsmap(e 32) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fd52c02e410 con 0x55805e8d02d0 2024-06-02T04:54:49.989 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.982+0000 7fd550220b80 10 client.25606 fetch_fsmap finished waiting for FSMap version 32 2024-06-02T04:54:49.990 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.982+0000 7fd550220b80 10 client.25606 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T04:54:49.990 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.982+0000 7fd550220b80 20 client.25606 populate_metadata read hostname 'smithi076' 2024-06-02T04:54:49.990 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.982+0000 7fd550220b80 1 --2- 172.21.15.76:0/2577708122 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55805e8e4c00 0x55805e8e7020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:54:49.990 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.982+0000 7fd550220b80 4 client.25606 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T04:54:49.990 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.982+0000 7fd550220b80 1 -- 172.21.15.76:0/2577708122 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55805e89e7b0 con 0x55805e8e4c00 2024-06-02T04:54:49.990 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.982+0000 7fd541e01700 1 --2- 172.21.15.76:0/2577708122 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55805e8e4c00 0x55805e8e7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:54:49.990 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.982+0000 7fd541e01700 1 --2- 172.21.15.76:0/2577708122 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55805e8e4c00 0x55805e8e7020 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d1b146e154874944 server_cookie=209dbde325c4b15f in_seq=0 out_seq=0 2024-06-02T04:54:49.990 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.982+0000 7fd5257fa700 10 client.25606 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:54:49.990 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.983+0000 7fd5257fa700 1 -- 172.21.15.76:0/2577708122 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55805e89e7b0 con 0x55805e8e4c00 2024-06-02T04:54:49.990 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.983+0000 7fd5257fa700 10 client.25606 handle_command_reply: tid=0 2024-06-02T04:54:49.990 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.983+0000 7fd550220b80 1 client.25606 shutdown 2024-06-02T04:54:49.991 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.983+0000 7fd550220b80 1 -- 172.21.15.76:0/2577708122 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55805e8d02d0 msgr2=0x55805e8d8ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:54:49.991 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.983+0000 7fd550220b80 1 --2- 172.21.15.76:0/2577708122 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55805e8d02d0 0x55805e8d8ef0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd52c00b670 tx=0x7fd52c009ca0 comp rx=0 tx=0).stop 2024-06-02T04:54:49.991 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.984+0000 7fd550220b80 1 -- 172.21.15.76:0/2577708122 shutdown_connections 2024-06-02T04:54:49.991 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.984+0000 7fd550220b80 1 --2- 172.21.15.76:0/2577708122 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55805e8e4c00 0x55805e8e7020 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:49.991 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.984+0000 7fd550220b80 1 --2- 172.21.15.76:0/2577708122 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55805e8ddf20 0x55805e8e0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:49.991 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.984+0000 7fd550220b80 1 --2- 172.21.15.76:0/2577708122 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55805e8cea80 0x55805e8d89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:49.991 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.984+0000 7fd550220b80 1 --2- 172.21.15.76:0/2577708122 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55805e8d02d0 0x55805e8d8ef0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:49.991 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.984+0000 7fd550220b80 1 -- 172.21.15.76:0/2577708122 >> 172.21.15.76:0/2577708122 conn(0x55805e82d1b0 msgr2=0x55805e8c9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:54:49.991 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.984+0000 7fd5257fa700 0 client.25606 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:54:49.991 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.984+0000 7fd550220b80 1 -- 172.21.15.76:0/2577708122 shutdown_connections 2024-06-02T04:54:49.991 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.984+0000 7fd550220b80 1 -- 172.21.15.76:0/2577708122 wait complete. 2024-06-02T04:54:49.992 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:49.984+0000 7fd550220b80 20 client.25606 trim_cache size 0 max 16384 2024-06-02T04:54:50.010 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:50.008+0000 7fd550220b80 1 Processor -- start 2024-06-02T04:54:50.013 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:50.011+0000 7fd550220b80 1 -- start start 2024-06-02T04:54:50.013 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:50.011+0000 7fd550220b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55805e8cea80 0x55805e8d06b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:54:50.013 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:50.011+0000 7fd550220b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55805e8d02d0 0x55805e8d6920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:54:50.013 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:50.011+0000 7fd550220b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55805e8ddf20 0x55805e8d7b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:54:50.013 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:50.011+0000 7fd550220b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55805e8d6e60 con 0x55805e8cea80 2024-06-02T04:54:50.013 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:50.011+0000 7fd550220b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55805e8cf9f0 con 0x55805e8d02d0 2024-06-02T04:54:50.013 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:50.011+0000 7fd550220b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55805e8cf7c0 con 0x55805e8ddf20 2024-06-02T04:54:50.013 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:50.011+0000 7fd541600700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55805e8d02d0 0x55805e8d6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:54:50.013 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:50.011+0000 7fd541600700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55805e8d02d0 0x55805e8d6920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:39002/0 (socket says 172.21.15.76:39002) 2024-06-02T04:54:50.013 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:50.012+0000 7fd541600700 1 -- 172.21.15.76:0/1057658890 learned_addr learned my addr 172.21.15.76:0/1057658890 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:54:50.013 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:50.012+0000 7fd541e01700 1 --2- 172.21.15.76:0/1057658890 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55805e8cea80 0x55805e8d06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:54:50.014 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:50.012+0000 7fd541600700 1 -- 172.21.15.76:0/1057658890 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55805e8ddf20 msgr2=0x55805e8d7b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:54:50.014 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:50.012+0000 7fd541600700 1 --2- 172.21.15.76:0/1057658890 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55805e8ddf20 0x55805e8d7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:50.014 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:50.012+0000 7fd541600700 1 -- 172.21.15.76:0/1057658890 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55805e8cea80 msgr2=0x55805e8d06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:54:50.014 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:50.012+0000 7fd541600700 1 --2- 172.21.15.76:0/1057658890 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55805e8cea80 0x55805e8d06b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:50.014 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:50.012+0000 7fd541600700 1 -- 172.21.15.76:0/1057658890 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55805e64cb00 con 0x55805e8d02d0 2024-06-02T04:54:50.015 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:50.012+0000 7fd541600700 1 --2- 172.21.15.76:0/1057658890 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55805e8d02d0 0x55805e8d6920 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd52c005850 tx=0x7fd52c009930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e7f167e913f80467 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:54:50.015 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:50.012+0000 7fd530ff9700 1 -- 172.21.15.76:0/1057658890 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd52c01d040 con 0x55805e8d02d0 2024-06-02T04:54:50.015 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:50.012+0000 7fd530ff9700 1 -- 172.21.15.76:0/1057658890 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd52c02eae0 con 0x55805e8d02d0 2024-06-02T04:54:50.015 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:50.012+0000 7fd530ff9700 1 -- 172.21.15.76:0/1057658890 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd52c0045f0 con 0x55805e8d02d0 2024-06-02T04:54:50.017 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:50.013+0000 7fd550220b80 1 -- 172.21.15.76:0/1057658890 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55805e8d02d0 msgr2=0x55805e8d6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:54:50.017 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:50.013+0000 7fd550220b80 1 --2- 172.21.15.76:0/1057658890 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55805e8d02d0 0x55805e8d6920 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd52c005850 tx=0x7fd52c009930 comp rx=0 tx=0).stop 2024-06-02T04:54:50.017 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:50.014+0000 7fd550220b80 1 -- 172.21.15.76:0/1057658890 shutdown_connections 2024-06-02T04:54:50.018 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:50.014+0000 7fd550220b80 1 --2- 172.21.15.76:0/1057658890 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55805e8ddf20 0x55805e8d7b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:50.018 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:50.014+0000 7fd550220b80 1 --2- 172.21.15.76:0/1057658890 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55805e8cea80 0x55805e8d06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:50.018 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:50.014+0000 7fd550220b80 1 --2- 172.21.15.76:0/1057658890 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55805e8d02d0 0x55805e8d6920 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:50.018 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:50.014+0000 7fd550220b80 1 -- 172.21.15.76:0/1057658890 >> 172.21.15.76:0/1057658890 conn(0x55805e82d1b0 msgr2=0x55805e8c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:54:50.018 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:50.014+0000 7fd550220b80 1 -- 172.21.15.76:0/1057658890 shutdown_connections 2024-06-02T04:54:50.018 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:50.014+0000 7fd550220b80 1 -- 172.21.15.76:0/1057658890 wait complete. 2024-06-02T04:54:50.018 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:50.014+0000 7fd550220b80 1 -- start start 2024-06-02T04:54:50.018 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:50.014+0000 7fd550220b80 1 Processor -- start 2024-06-02T04:54:50.018 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:50.015+0000 7fd550220b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55805e8cea80 0x55805e8f5260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:54:50.018 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:50.015+0000 7fd550220b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55805e8d02d0 0x55805e8f38c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:54:50.018 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:50.015+0000 7fd550220b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55805e8ddf20 0x55805e8f3e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:54:50.019 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:50.015+0000 7fd550220b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55805e8f44e0 con 0x55805e8cea80 2024-06-02T04:54:50.019 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:50.015+0000 7fd550220b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55805e8f4650 con 0x55805e8d02d0 2024-06-02T04:54:50.019 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:50.015+0000 7fd550220b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55805e939b80 con 0x55805e8ddf20 2024-06-02T04:54:50.019 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:50.015+0000 7fd550220b80 10 client.0 _ll_register_callbacks cb 0x55805e7c4ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:54:50.019 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:50.015+0000 7fd541600700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55805e8d02d0 0x55805e8f38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:54:50.019 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:50.015+0000 7fd541600700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55805e8d02d0 0x55805e8f38c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:39004/0 (socket says 172.21.15.76:39004) 2024-06-02T04:54:50.019 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:50.015+0000 7fd541600700 1 -- 172.21.15.76:0/1706901584 learned_addr learned my addr 172.21.15.76:0/1706901584 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:54:50.019 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:50.015+0000 7fd541e01700 1 --2- 172.21.15.76:0/1706901584 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55805e8cea80 0x55805e8f5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:54:50.019 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:50.015+0000 7fd542602700 1 --2- 172.21.15.76:0/1706901584 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55805e8ddf20 0x55805e8f3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:54:50.019 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:50.015+0000 7fd541600700 1 -- 172.21.15.76:0/1706901584 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55805e8ddf20 msgr2=0x55805e8f3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:54:50.019 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:50.015+0000 7fd541600700 1 --2- 172.21.15.76:0/1706901584 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55805e8ddf20 0x55805e8f3e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:50.020 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:50.015+0000 7fd541600700 1 -- 172.21.15.76:0/1706901584 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55805e8cea80 msgr2=0x55805e8f5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:54:50.020 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:50.015+0000 7fd541600700 1 --2- 172.21.15.76:0/1706901584 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55805e8cea80 0x55805e8f5260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:50.020 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:50.015+0000 7fd541600700 1 -- 172.21.15.76:0/1706901584 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd538009370 con 0x55805e8d02d0 2024-06-02T04:54:50.020 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:50.016+0000 7fd541600700 1 --2- 172.21.15.76:0/1706901584 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55805e8d02d0 0x55805e8f38c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd52c02eab0 tx=0x7fd52c040760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=12fa3af70881c584 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:54:50.020 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:50.016+0000 7fd5257fa700 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-06-02T04:54:50.020 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:50.016+0000 7fd541e01700 1 --2- 172.21.15.76:0/1706901584 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55805e8cea80 0x55805e8f5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:54:50.020 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:50.016+0000 7fd5257fa700 1 -- 172.21.15.76:0/1706901584 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd52c01d040 con 0x55805e8d02d0 2024-06-02T04:54:50.020 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:50.016+0000 7fd5257fa700 1 -- 172.21.15.76:0/1706901584 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7fd52c040c10 con 0x55805e8d02d0 2024-06-02T04:54:50.020 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:50.016+0000 7fd550220b80 1 -- 172.21.15.76:0/1706901584 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd538011e20 con 0x55805e8d02d0 2024-06-02T04:54:50.020 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:50.016+0000 7fd5257fa700 1 -- 172.21.15.76:0/1706901584 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd52c040dd0 con 0x55805e8d02d0 2024-06-02T04:54:50.020 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:50.016+0000 7fd550220b80 10 client.25676 fetch_fsmap learned FSMap version 32 2024-06-02T04:54:50.020 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:50.016+0000 7fd550220b80 1 -- 172.21.15.76:0/1706901584 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x55805e7e5500 con 0x55805e8d02d0 2024-06-02T04:54:50.020 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:50.016+0000 7fd5257fa700 1 -- 172.21.15.76:0/1706901584 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd538011e20 con 0x55805e8d02d0 2024-06-02T04:54:50.021 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:50.017+0000 7fd5257fa700 1 -- 172.21.15.76:0/1706901584 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 32) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fd52c051070 con 0x55805e8d02d0 2024-06-02T04:54:50.021 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:50.017+0000 7fd550220b80 10 client.25676 fetch_fsmap finished waiting for FSMap version 32 2024-06-02T04:54:50.021 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:50.017+0000 7fd550220b80 10 client.25676 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T04:54:50.021 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:50.017+0000 7fd550220b80 20 client.25676 populate_metadata read hostname 'smithi076' 2024-06-02T04:54:50.021 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:50.017+0000 7fd550220b80 1 --2- 172.21.15.76:0/1706901584 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55805e93af50 0x55805e93d340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:54:50.021 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:50.017+0000 7fd550220b80 4 client.25676 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T04:54:50.021 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:50.017+0000 7fd550220b80 1 -- 172.21.15.76:0/1706901584 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55805e817e60 con 0x55805e93af50 2024-06-02T04:54:50.021 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:50.017+0000 7fd541e01700 1 --2- 172.21.15.76:0/1706901584 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55805e93af50 0x55805e93d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:54:50.021 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:50.017+0000 7fd5257fa700 10 client.25676 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:54:50.022 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:50.017+0000 7fd541e01700 1 --2- 172.21.15.76:0/1706901584 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55805e93af50 0x55805e93d340 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d630af48d3c8724c server_cookie=f7ec42389031de46 in_seq=0 out_seq=0 2024-06-02T04:54:50.035 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:50.034+0000 7fd5257fa700 1 -- 172.21.15.76:0/1706901584 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55805e817e60 con 0x55805e93af50 2024-06-02T04:54:50.035 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:50.034+0000 7fd5257fa700 10 client.25676 handle_command_reply: tid=0 2024-06-02T04:54:50.035 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:50.034+0000 7fd550220b80 1 client.25676 shutdown 2024-06-02T04:54:50.036 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:50.036+0000 7fd550220b80 1 -- 172.21.15.76:0/1706901584 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55805e8d02d0 msgr2=0x55805e8f38c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:54:50.036 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:50.036+0000 7fd550220b80 1 --2- 172.21.15.76:0/1706901584 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55805e8d02d0 0x55805e8f38c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd52c02eab0 tx=0x7fd52c040760 comp rx=0 tx=0).stop 2024-06-02T04:54:50.037 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:50.037+0000 7fd550220b80 1 -- 172.21.15.76:0/1706901584 shutdown_connections 2024-06-02T04:54:50.037 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:50.037+0000 7fd550220b80 1 --2- 172.21.15.76:0/1706901584 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55805e93af50 0x55805e93d340 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:50.037 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:50.037+0000 7fd550220b80 1 --2- 172.21.15.76:0/1706901584 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55805e8ddf20 0x55805e8f3e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:50.037 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:50.037+0000 7fd550220b80 1 --2- 172.21.15.76:0/1706901584 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55805e8cea80 0x55805e8f5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:50.037 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:50.037+0000 7fd550220b80 1 --2- 172.21.15.76:0/1706901584 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55805e8d02d0 0x55805e8f38c0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:50.037 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:50.037+0000 7fd550220b80 1 -- 172.21.15.76:0/1706901584 >> 172.21.15.76:0/1706901584 conn(0x55805e82d1b0 msgr2=0x55805e8eb980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:54:50.037 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:50.037+0000 7fd5257fa700 0 client.25676 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:54:50.037 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:50.037+0000 7fd550220b80 1 -- 172.21.15.76:0/1706901584 shutdown_connections 2024-06-02T04:54:50.038 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:50.037+0000 7fd550220b80 1 -- 172.21.15.76:0/1706901584 wait complete. 2024-06-02T04:54:50.038 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:50.038+0000 7fd550220b80 20 client.25676 trim_cache size 0 max 16384 2024-06-02T04:54:50.039 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:{ 2024-06-02T04:54:50.039 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "message": "", 2024-06-02T04:54:50.039 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "return_code": 0 2024-06-02T04:54:50.039 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:} 2024-06-02T04:54:50.039 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:50.039+0000 7fd544065700 1 -- 172.21.15.76:0/3110507278 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fd5280a11a0 msgr2=0x7fd5280a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:54:50.039 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:50.039+0000 7fd544065700 1 --2- 172.21.15.76:0/3110507278 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fd5280a11a0 0x7fd5280a3660 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fd52c000c00 tx=0x7fd52c005fb0 comp rx=0 tx=0).stop 2024-06-02T04:54:50.039 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:50.039+0000 7fd544065700 1 -- 172.21.15.76:0/3110507278 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd53c0736a0 msgr2=0x7fd53c07d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:54:50.039 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:50.039+0000 7fd544065700 1 --2- 172.21.15.76:0/3110507278 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd53c0736a0 0x7fd53c07d050 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fd53400ef30 tx=0x7fd53400c450 comp rx=0 tx=0).stop 2024-06-02T04:54:50.040 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:50.039+0000 7fd544065700 1 -- 172.21.15.76:0/3110507278 shutdown_connections 2024-06-02T04:54:50.040 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:50.039+0000 7fd544065700 1 --2- 172.21.15.76:0/3110507278 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd53c0736a0 0x7fd53c07d050 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:50.040 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:50.039+0000 7fd544065700 1 --2- 172.21.15.76:0/3110507278 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fd5280a11a0 0x7fd5280a3660 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:50.040 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:50.039+0000 7fd544065700 1 --2- 172.21.15.76:0/3110507278 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd53c072b80 0x7fd53c07e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:50.040 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:50.039+0000 7fd544065700 1 --2- 172.21.15.76:0/3110507278 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd53c0731f0 0x7fd53c07cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:54:50.040 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:50.040+0000 7fd544065700 1 -- 172.21.15.76:0/3110507278 >> 172.21.15.76:0/3110507278 conn(0x7fd53c06df30 msgr2=0x7fd53c081d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:54:50.040 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:50.040+0000 7fd544065700 1 -- 172.21.15.76:0/3110507278 shutdown_connections 2024-06-02T04:54:50.041 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:54:50.040+0000 7fd544065700 1 -- 172.21.15.76:0/3110507278 wait complete. 2024-06-02T04:54:51.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 240.0 s, 905.4 tps, lat 110.172 ms stddev 35.438 2024-06-02T04:54:51.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:54:51 smithi192 ceph-mon[47933]: pgmap v426: 129 pgs: 129 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 9.9 MiB/s wr, 916 op/s 2024-06-02T04:54:51.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:54:51 smithi076 ceph-mon[42935]: pgmap v426: 129 pgs: 129 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 9.9 MiB/s wr, 916 op/s 2024-06-02T04:54:51.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:54:51 smithi119 ceph-mon[46633]: pgmap v426: 129 pgs: 129 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 9.9 MiB/s wr, 916 op/s 2024-06-02T04:54:53.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:54:53 smithi192 ceph-mon[47933]: pgmap v427: 129 pgs: 129 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 11 MiB/s wr, 914 op/s 2024-06-02T04:54:53.737 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:54:53 smithi076 ceph-mon[42935]: pgmap v427: 129 pgs: 129 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 11 MiB/s wr, 914 op/s 2024-06-02T04:54:53.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:54:53 smithi119 ceph-mon[46633]: pgmap v427: 129 pgs: 129 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 11 MiB/s wr, 914 op/s 2024-06-02T04:54:55.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:54:55 smithi192 ceph-mon[47933]: pgmap v428: 129 pgs: 129 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 9.0 MiB/s wr, 808 op/s 2024-06-02T04:54:55.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:54:55 smithi076 ceph-mon[42935]: pgmap v428: 129 pgs: 129 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 9.0 MiB/s wr, 808 op/s 2024-06-02T04:54:55.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:54:55 smithi119 ceph-mon[46633]: pgmap v428: 129 pgs: 129 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 9.0 MiB/s wr, 808 op/s 2024-06-02T04:54:56.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 245.0 s, 855.8 tps, lat 117.432 ms stddev 37.361 2024-06-02T04:54:57.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:54:57 smithi192 ceph-mon[47933]: pgmap v429: 129 pgs: 129 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 9.6 MiB/s wr, 879 op/s 2024-06-02T04:54:57.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:54:57 smithi076 ceph-mon[42935]: pgmap v429: 129 pgs: 129 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 9.6 MiB/s wr, 879 op/s 2024-06-02T04:54:57.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:54:57 smithi119 ceph-mon[46633]: pgmap v429: 129 pgs: 129 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 9.6 MiB/s wr, 879 op/s 2024-06-02T04:54:59.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:54:59 smithi192 ceph-mon[47933]: pgmap v430: 129 pgs: 129 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 9.1 MiB/s wr, 839 op/s 2024-06-02T04:54:59.735 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:54:59 smithi076 ceph-mon[42935]: pgmap v430: 129 pgs: 129 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 9.1 MiB/s wr, 839 op/s 2024-06-02T04:54:59.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:54:59 smithi119 ceph-mon[46633]: pgmap v430: 129 pgs: 129 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 9.1 MiB/s wr, 839 op/s 2024-06-02T04:55:01.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 250.0 s, 967.6 tps, lat 103.174 ms stddev 37.387 2024-06-02T04:55:01.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:55:01 smithi192 ceph-mon[47933]: pgmap v431: 129 pgs: 129 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.4 MiB/s wr, 798 op/s 2024-06-02T04:55:01.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:55:01 smithi076 ceph-mon[42935]: pgmap v431: 129 pgs: 129 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.4 MiB/s wr, 798 op/s 2024-06-02T04:55:01.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:55:01 smithi119 ceph-mon[46633]: pgmap v431: 129 pgs: 129 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.4 MiB/s wr, 798 op/s 2024-06-02T04:55:03.230 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.229+0000 7f161e02b700 1 -- 172.21.15.76:0/3778379774 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1618100ff0 msgr2=0x7f1618101450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:55:03.230 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.229+0000 7f161e02b700 1 --2- 172.21.15.76:0/3778379774 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1618100ff0 0x7f1618101450 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f160c0099c0 tx=0x7f160c009cd0 comp rx=0 tx=0).stop 2024-06-02T04:55:03.233 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.230+0000 7f161e02b700 1 -- 172.21.15.76:0/3778379774 shutdown_connections 2024-06-02T04:55:03.233 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.230+0000 7f161e02b700 1 --2- 172.21.15.76:0/3778379774 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1618101990 0x7f1618108240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:03.233 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.230+0000 7f161e02b700 1 --2- 172.21.15.76:0/3778379774 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f16180ffe00 0x7f1618100220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:03.233 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.230+0000 7f161e02b700 1 --2- 172.21.15.76:0/3778379774 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1618100ff0 0x7f1618101450 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:03.233 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.230+0000 7f161e02b700 1 -- 172.21.15.76:0/3778379774 >> 172.21.15.76:0/3778379774 conn(0x7f16180fb390 msgr2=0x7f16180fd7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:55:03.233 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.231+0000 7f161e02b700 1 -- 172.21.15.76:0/3778379774 shutdown_connections 2024-06-02T04:55:03.234 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.231+0000 7f161e02b700 1 -- 172.21.15.76:0/3778379774 wait complete. 2024-06-02T04:55:03.234 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.231+0000 7f161e02b700 1 Processor -- start 2024-06-02T04:55:03.234 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.231+0000 7f161e02b700 1 -- start start 2024-06-02T04:55:03.234 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.231+0000 7f161e02b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16180ffe00 0x7f161810edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:55:03.234 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.231+0000 7f161e02b700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1618100ff0 0x7f161810f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:55:03.234 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.231+0000 7f161e02b700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1618101990 0x7f1618110300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:55:03.234 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.231+0000 7f161e02b700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16181108d0 con 0x7f1618101990 2024-06-02T04:55:03.234 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.231+0000 7f161e02b700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1618110a40 con 0x7f1618100ff0 2024-06-02T04:55:03.234 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.231+0000 7f161e02b700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1618110c00 con 0x7f16180ffe00 2024-06-02T04:55:03.234 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.232+0000 7f1616ffd700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1618100ff0 0x7f161810f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:55:03.234 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.232+0000 7f16177fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16180ffe00 0x7f161810edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:55:03.235 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.232+0000 7f16177fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16180ffe00 0x7f161810edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:38300/0 (socket says 172.21.15.76:38300) 2024-06-02T04:55:03.235 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.232+0000 7f1616ffd700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1618100ff0 0x7f161810f310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:47062/0 (socket says 172.21.15.76:47062) 2024-06-02T04:55:03.235 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.232+0000 7f16177fe700 1 -- 172.21.15.76:0/1043774862 learned_addr learned my addr 172.21.15.76:0/1043774862 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:55:03.235 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.232+0000 7f16177fe700 1 -- 172.21.15.76:0/1043774862 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1618100ff0 msgr2=0x7f161810f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:55:03.235 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.232+0000 7f16177fe700 1 --2- 172.21.15.76:0/1043774862 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1618100ff0 0x7f161810f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:03.235 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.232+0000 7f16177fe700 1 -- 172.21.15.76:0/1043774862 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1618101990 msgr2=0x7f1618110300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:55:03.235 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.232+0000 7f16177fe700 1 --2- 172.21.15.76:0/1043774862 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1618101990 0x7f1618110300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:03.235 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.232+0000 7f16177fe700 1 -- 172.21.15.76:0/1043774862 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f160c0095f0 con 0x7f16180ffe00 2024-06-02T04:55:03.235 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.232+0000 7f16177fe700 1 --2- 172.21.15.76:0/1043774862 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16180ffe00 0x7f161810edd0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f160800e970 tx=0x7f160800ec80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:55:03.235 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.232+0000 7f1614ff9700 1 -- 172.21.15.76:0/1043774862 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1608009790 con 0x7f16180ffe00 2024-06-02T04:55:03.235 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.233+0000 7f161e02b700 1 -- 172.21.15.76:0/1043774862 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1618110e80 con 0x7f16180ffe00 2024-06-02T04:55:03.235 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.233+0000 7f161e02b700 1 -- 172.21.15.76:0/1043774862 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16181113e0 con 0x7f16180ffe00 2024-06-02T04:55:03.236 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.233+0000 7f1614ff9700 1 -- 172.21.15.76:0/1043774862 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f160800eec0 con 0x7f16180ffe00 2024-06-02T04:55:03.236 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.233+0000 7f1614ff9700 1 -- 172.21.15.76:0/1043774862 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1608003c10 con 0x7f16180ffe00 2024-06-02T04:55:03.237 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.237+0000 7f162a1e6b80 1 Processor -- start 2024-06-02T04:55:03.240 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.238+0000 7f162a1e6b80 1 -- start start 2024-06-02T04:55:03.240 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.239+0000 7f162a1e6b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c090259a80 0x55c090259ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:55:03.240 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.239+0000 7f162a1e6b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c09025a3e0 0x55c09025acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:55:03.240 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.239+0000 7f162a1e6b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c09025b2d0 0x55c09025b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:55:03.240 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.239+0000 7f162a1e6b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0901b10f0 con 0x55c09025a3e0 2024-06-02T04:55:03.240 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.239+0000 7f162a1e6b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0901aeab0 con 0x55c09025b2d0 2024-06-02T04:55:03.240 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.239+0000 7f162a1e6b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0901aa3a0 con 0x55c090259a80 2024-06-02T04:55:03.240 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.239+0000 7f1617fff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c090259a80 0x55c090259ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:55:03.241 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.239+0000 7f1617fff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c090259a80 0x55c090259ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:38304/0 (socket says 172.21.15.76:38304) 2024-06-02T04:55:03.241 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.239+0000 7f1617fff700 1 -- 172.21.15.76:0/3199559036 learned_addr learned my addr 172.21.15.76:0/3199559036 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:55:03.241 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.239+0000 7f1616ffd700 1 --2- 172.21.15.76:0/3199559036 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c09025b2d0 0x55c09025b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:55:03.241 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.239+0000 7f1617fff700 1 -- 172.21.15.76:0/3199559036 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c09025b2d0 msgr2=0x55c09025b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:55:03.241 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.239+0000 7f1617fff700 1 --2- 172.21.15.76:0/3199559036 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c09025b2d0 0x55c09025b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:03.241 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.239+0000 7f1617fff700 1 -- 172.21.15.76:0/3199559036 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c09025a3e0 msgr2=0x55c09025acf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-02T04:55:03.241 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.239+0000 7f1617fff700 1 --2- 172.21.15.76:0/3199559036 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c09025a3e0 0x55c09025acf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:03.241 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.239+0000 7f1617fff700 1 -- 172.21.15.76:0/3199559036 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c09002b350 con 0x55c090259a80 2024-06-02T04:55:03.242 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.239+0000 7f1614ff9700 1 -- 172.21.15.76:0/1043774862 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f1608018430 con 0x7f16180ffe00 2024-06-02T04:55:03.242 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.239+0000 7f1617fff700 1 --2- 172.21.15.76:0/3199559036 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c090259a80 0x55c090259ea0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1610009d00 tx=0x7f161000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=678f244daef5d95f server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:55:03.242 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.239+0000 7f15fdffb700 1 -- 172.21.15.76:0/3199559036 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f161000e070 con 0x55c090259a80 2024-06-02T04:55:03.242 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.239+0000 7f15fdffb700 1 -- 172.21.15.76:0/3199559036 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1610009830 con 0x55c090259a80 2024-06-02T04:55:03.243 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.240+0000 7f15fdffb700 1 -- 172.21.15.76:0/3199559036 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1610011390 con 0x55c090259a80 2024-06-02T04:55:03.243 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.240+0000 7f1614ff9700 1 --2- 172.21.15.76:0/1043774862 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f16000a11d0 0x7f16000a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:55:03.243 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.240+0000 7f1614ff9700 1 -- 172.21.15.76:0/1043774862 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f1608014070 con 0x7f16180ffe00 2024-06-02T04:55:03.243 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.241+0000 7f16177fe700 1 --2- 172.21.15.76:0/1043774862 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f16000a11d0 0x7f16000a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:55:03.243 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.241+0000 7f162a1e6b80 1 -- 172.21.15.76:0/3199559036 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c090259a80 msgr2=0x55c090259ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:55:03.243 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.241+0000 7f162a1e6b80 1 --2- 172.21.15.76:0/3199559036 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c090259a80 0x55c090259ea0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1610009d00 tx=0x7f161000b330 comp rx=0 tx=0).stop 2024-06-02T04:55:03.243 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.241+0000 7f16177fe700 1 --2- 172.21.15.76:0/1043774862 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f16000a11d0 0x7f16000a3690 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f160800c5b0 tx=0x7f16080047c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:55:03.243 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.241+0000 7f162a1e6b80 1 -- 172.21.15.76:0/3199559036 shutdown_connections 2024-06-02T04:55:03.243 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.241+0000 7f162a1e6b80 1 --2- 172.21.15.76:0/3199559036 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c09025b2d0 0x55c09025b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:03.243 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.241+0000 7f162a1e6b80 1 --2- 172.21.15.76:0/3199559036 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c090259a80 0x55c090259ea0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:03.243 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.241+0000 7f162a1e6b80 1 --2- 172.21.15.76:0/3199559036 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c09025a3e0 0x55c09025acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:03.244 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.241+0000 7f162a1e6b80 1 -- 172.21.15.76:0/3199559036 >> 172.21.15.76:0/3199559036 conn(0x55c0901b81b0 msgr2=0x55c090256440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:55:03.244 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.242+0000 7f162a1e6b80 1 -- 172.21.15.76:0/3199559036 shutdown_connections 2024-06-02T04:55:03.244 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.242+0000 7f162a1e6b80 1 -- 172.21.15.76:0/3199559036 wait complete. 2024-06-02T04:55:03.245 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.242+0000 7f162a1e6b80 1 -- start start 2024-06-02T04:55:03.245 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.243+0000 7f162a1e6b80 1 Processor -- start 2024-06-02T04:55:03.245 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.243+0000 7f162a1e6b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c090259a80 0x55c090263840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:55:03.245 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.243+0000 7f162a1e6b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c09025a3e0 0x55c090263d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:55:03.245 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.243+0000 7f162a1e6b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c09025b2d0 0x55c09026adc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:55:03.246 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.243+0000 7f162a1e6b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c090146500 con 0x55c090259a80 2024-06-02T04:55:03.246 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.243+0000 7f162a1e6b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0901461a0 con 0x55c09025b2d0 2024-06-02T04:55:03.246 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.243+0000 7f162a1e6b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c09002d640 con 0x55c09025a3e0 2024-06-02T04:55:03.246 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.243+0000 7f162a1e6b80 10 client.0 _ll_register_callbacks cb 0x55c09014fad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:55:03.246 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.243+0000 7f1617fff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c09025b2d0 0x55c09026adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:55:03.246 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.244+0000 7f1617fff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c09025b2d0 0x55c09026adc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:47082/0 (socket says 172.21.15.76:47082) 2024-06-02T04:55:03.246 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.244+0000 7f1617fff700 1 -- 172.21.15.76:0/3795890542 learned_addr learned my addr 172.21.15.76:0/3795890542 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:55:03.246 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.244+0000 7f1616ffd700 1 --2- 172.21.15.76:0/3795890542 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c09025a3e0 0x55c090263d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:55:03.246 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.244+0000 7f1617fff700 1 -- 172.21.15.76:0/3795890542 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c09025a3e0 msgr2=0x55c090263d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:55:03.246 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.244+0000 7f1617fff700 1 --2- 172.21.15.76:0/3795890542 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c09025a3e0 0x55c090263d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:03.246 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.244+0000 7f1617fff700 1 -- 172.21.15.76:0/3795890542 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c090259a80 msgr2=0x55c090263840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:55:03.246 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.244+0000 7f1617fff700 1 --2- 172.21.15.76:0/3795890542 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c090259a80 0x55c090263840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:03.246 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.244+0000 7f1617fff700 1 -- 172.21.15.76:0/3795890542 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16100099b0 con 0x55c09025b2d0 2024-06-02T04:55:03.247 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.244+0000 7f1616ffd700 1 --2- 172.21.15.76:0/3795890542 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c09025a3e0 0x55c090263d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T04:55:03.247 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.244+0000 7f1617fff700 1 --2- 172.21.15.76:0/3795890542 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c09025b2d0 0x55c09026adc0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1610004c90 tx=0x7f161000bf70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d4d5a254d7f081d server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:55:03.247 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.244+0000 7f15f6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-06-02T04:55:03.249 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.246+0000 7f15f6ffd700 1 -- 172.21.15.76:0/3795890542 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f161000e050 con 0x55c09025b2d0 2024-06-02T04:55:03.249 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.246+0000 7f15f6ffd700 1 -- 172.21.15.76:0/3795890542 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f1610011a80 con 0x55c09025b2d0 2024-06-02T04:55:03.249 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.248+0000 7f162a1e6b80 1 -- 172.21.15.76:0/3795890542 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c0902297b0 con 0x55c09025b2d0 2024-06-02T04:55:03.249 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.248+0000 7f15f6ffd700 1 -- 172.21.15.76:0/3795890542 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1610011c40 con 0x55c09025b2d0 2024-06-02T04:55:03.249 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.248+0000 7f162a1e6b80 10 client.25688 fetch_fsmap learned FSMap version 32 2024-06-02T04:55:03.249 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.248+0000 7f162a1e6b80 1 -- 172.21.15.76:0/3795890542 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x55c08ffd7b00 con 0x55c09025b2d0 2024-06-02T04:55:03.249 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.249+0000 7f15f6ffd700 1 -- 172.21.15.76:0/3795890542 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55c0902297b0 con 0x55c09025b2d0 2024-06-02T04:55:03.251 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.249+0000 7f15f6ffd700 1 -- 172.21.15.76:0/3795890542 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 32) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f16100243c0 con 0x55c09025b2d0 2024-06-02T04:55:03.251 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.249+0000 7f162a1e6b80 10 client.25688 fetch_fsmap finished waiting for FSMap version 32 2024-06-02T04:55:03.252 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.249+0000 7f162a1e6b80 10 client.25688 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T04:55:03.252 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.249+0000 7f162a1e6b80 20 client.25688 populate_metadata read hostname 'smithi076' 2024-06-02T04:55:03.252 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.249+0000 7f162a1e6b80 1 --2- 172.21.15.76:0/3795890542 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55c09026f5c0 0x55c0902719e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:55:03.252 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.249+0000 7f162a1e6b80 4 client.25688 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T04:55:03.252 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.249+0000 7f162a1e6b80 1 -- 172.21.15.76:0/3795890542 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c0901a2e60 con 0x55c09026f5c0 2024-06-02T04:55:03.252 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.249+0000 7f1616ffd700 1 --2- 172.21.15.76:0/3795890542 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55c09026f5c0 0x55c0902719e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:55:03.252 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.250+0000 7f15f6ffd700 10 client.25688 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:55:03.252 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.250+0000 7f1616ffd700 1 --2- 172.21.15.76:0/3795890542 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55c09026f5c0 0x55c0902719e0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=32712e617f7403b9 server_cookie=796cc2cac11ff47a in_seq=0 out_seq=0 2024-06-02T04:55:03.252 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.250+0000 7f15f6ffd700 1 -- 172.21.15.76:0/3795890542 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55c0901a2e60 con 0x55c09026f5c0 2024-06-02T04:55:03.252 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.250+0000 7f15f6ffd700 10 client.25688 handle_command_reply: tid=0 2024-06-02T04:55:03.252 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.250+0000 7f162a1e6b80 1 client.25688 shutdown 2024-06-02T04:55:03.252 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.251+0000 7f162a1e6b80 1 -- 172.21.15.76:0/3795890542 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c09025b2d0 msgr2=0x55c09026adc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:55:03.252 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.251+0000 7f162a1e6b80 1 --2- 172.21.15.76:0/3795890542 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c09025b2d0 0x55c09026adc0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1610004c90 tx=0x7f161000bf70 comp rx=0 tx=0).stop 2024-06-02T04:55:03.253 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.251+0000 7f162a1e6b80 1 -- 172.21.15.76:0/3795890542 shutdown_connections 2024-06-02T04:55:03.253 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.251+0000 7f162a1e6b80 1 --2- 172.21.15.76:0/3795890542 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55c09026f5c0 0x55c0902719e0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:03.253 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.251+0000 7f162a1e6b80 1 --2- 172.21.15.76:0/3795890542 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c09025b2d0 0x55c09026adc0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:03.253 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.251+0000 7f15f6ffd700 0 client.25688 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:55:03.253 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.251+0000 7f162a1e6b80 1 --2- 172.21.15.76:0/3795890542 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c090259a80 0x55c090263840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:03.253 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.251+0000 7f162a1e6b80 1 --2- 172.21.15.76:0/3795890542 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c09025a3e0 0x55c090263d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:03.253 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.251+0000 7f162a1e6b80 1 -- 172.21.15.76:0/3795890542 >> 172.21.15.76:0/3795890542 conn(0x55c0901b81b0 msgr2=0x55c090254860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:55:03.254 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.253+0000 7f162a1e6b80 1 -- 172.21.15.76:0/3795890542 shutdown_connections 2024-06-02T04:55:03.254 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.253+0000 7f162a1e6b80 1 -- 172.21.15.76:0/3795890542 wait complete. 2024-06-02T04:55:03.254 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.253+0000 7f162a1e6b80 20 client.25688 trim_cache size 0 max 16384 2024-06-02T04:55:03.278 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.278+0000 7f162a1e6b80 1 Processor -- start 2024-06-02T04:55:03.281 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.280+0000 7f162a1e6b80 1 -- start start 2024-06-02T04:55:03.281 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.280+0000 7f162a1e6b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c090259a80 0x55c0902719b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:55:03.281 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.280+0000 7f162a1e6b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c09025a3e0 0x55c09025b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:55:03.281 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.280+0000 7f162a1e6b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c09025b2d0 0x55c09026ace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:55:03.281 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.280+0000 7f162a1e6b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c09025b150 con 0x55c09025a3e0 2024-06-02T04:55:03.281 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.280+0000 7f162a1e6b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c09026bf40 con 0x55c09025b2d0 2024-06-02T04:55:03.281 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.280+0000 7f162a1e6b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c090264a30 con 0x55c090259a80 2024-06-02T04:55:03.282 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.280+0000 7f1617fff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c09025b2d0 0x55c09026ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:55:03.282 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.280+0000 7f1617fff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c09025b2d0 0x55c09026ace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:47092/0 (socket says 172.21.15.76:47092) 2024-06-02T04:55:03.282 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.280+0000 7f1617fff700 1 -- 172.21.15.76:0/479097059 learned_addr learned my addr 172.21.15.76:0/479097059 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:55:03.282 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.280+0000 7f1617fff700 1 --2- 172.21.15.76:0/479097059 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c090259a80 0x55c0902719b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:55:03.282 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.280+0000 7f1617fff700 1 -- 172.21.15.76:0/479097059 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c090259a80 msgr2=0x55c0902719b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:55:03.282 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.280+0000 7f1617fff700 1 --2- 172.21.15.76:0/479097059 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c090259a80 0x55c0902719b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:03.282 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.280+0000 7f1617fff700 1 -- 172.21.15.76:0/479097059 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c09025a3e0 msgr2=0x55c09025b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:55:03.282 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.280+0000 7f1617fff700 1 --2- 172.21.15.76:0/479097059 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c09025a3e0 0x55c09025b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:03.282 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.280+0000 7f1617fff700 1 -- 172.21.15.76:0/479097059 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c090170500 con 0x55c09025b2d0 2024-06-02T04:55:03.282 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.281+0000 7f1617fff700 1 --2- 172.21.15.76:0/479097059 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c09025b2d0 0x55c09026ace0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1610012890 tx=0x7f1610009690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b5eb38d3f415b12 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:55:03.283 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.281+0000 7f15fe7fc700 1 -- 172.21.15.76:0/479097059 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1610035020 con 0x55c09025b2d0 2024-06-02T04:55:03.283 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.281+0000 7f15fe7fc700 1 -- 172.21.15.76:0/479097059 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1610012970 con 0x55c09025b2d0 2024-06-02T04:55:03.283 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.281+0000 7f15fe7fc700 1 -- 172.21.15.76:0/479097059 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f161000e040 con 0x55c09025b2d0 2024-06-02T04:55:03.283 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.282+0000 7f162a1e6b80 1 -- 172.21.15.76:0/479097059 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c09025b2d0 msgr2=0x55c09026ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:55:03.283 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.282+0000 7f162a1e6b80 1 --2- 172.21.15.76:0/479097059 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c09025b2d0 0x55c09026ace0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1610012890 tx=0x7f1610009690 comp rx=0 tx=0).stop 2024-06-02T04:55:03.284 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.283+0000 7f162a1e6b80 1 -- 172.21.15.76:0/479097059 shutdown_connections 2024-06-02T04:55:03.284 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.283+0000 7f162a1e6b80 1 --2- 172.21.15.76:0/479097059 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c09025b2d0 0x55c09026ace0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:03.284 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.283+0000 7f162a1e6b80 1 --2- 172.21.15.76:0/479097059 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c090259a80 0x55c0902719b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:03.284 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.283+0000 7f162a1e6b80 1 --2- 172.21.15.76:0/479097059 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c09025a3e0 0x55c09025b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:03.284 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.283+0000 7f162a1e6b80 1 -- 172.21.15.76:0/479097059 >> 172.21.15.76:0/479097059 conn(0x55c0901b81b0 msgr2=0x55c090262d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:55:03.284 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.284+0000 7f162a1e6b80 1 -- 172.21.15.76:0/479097059 shutdown_connections 2024-06-02T04:55:03.285 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.284+0000 7f162a1e6b80 1 -- 172.21.15.76:0/479097059 wait complete. 2024-06-02T04:55:03.285 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.284+0000 7f162a1e6b80 1 -- start start 2024-06-02T04:55:03.285 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.284+0000 7f162a1e6b80 1 Processor -- start 2024-06-02T04:55:03.285 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.285+0000 7f162a1e6b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c090259a80 0x55c090265f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:55:03.286 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.285+0000 7f162a1e6b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c09025a3e0 0x55c090266490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:55:03.286 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.285+0000 7f162a1e6b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c09025b2d0 0x55c0902d4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:55:03.286 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.285+0000 7f162a1e6b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c09026ae60 con 0x55c090259a80 2024-06-02T04:55:03.286 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.285+0000 7f162a1e6b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c09026afd0 con 0x55c09025a3e0 2024-06-02T04:55:03.286 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.285+0000 7f162a1e6b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0902d4ff0 con 0x55c09025b2d0 2024-06-02T04:55:03.286 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.285+0000 7f162a1e6b80 10 client.0 _ll_register_callbacks cb 0x55c09014fad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:55:03.286 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.285+0000 7f1617fff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c090259a80 0x55c090265f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:55:03.286 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.285+0000 7f1617fff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c090259a80 0x55c090265f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:36498/0 (socket says 172.21.15.76:36498) 2024-06-02T04:55:03.286 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.285+0000 7f1617fff700 1 -- 172.21.15.76:0/203486781 learned_addr learned my addr 172.21.15.76:0/203486781 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:55:03.286 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.285+0000 7f1617fff700 1 --2- 172.21.15.76:0/203486781 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c09025b2d0 0x55c0902d4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:55:03.286 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.285+0000 7f1616ffd700 1 --2- 172.21.15.76:0/203486781 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c09025a3e0 0x55c090266490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:55:03.287 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.285+0000 7f1616ffd700 1 -- 172.21.15.76:0/203486781 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c09025b2d0 msgr2=0x55c0902d4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:55:03.288 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.285+0000 7f1616ffd700 1 --2- 172.21.15.76:0/203486781 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c09025b2d0 0x55c0902d4ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:03.288 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.285+0000 7f1616ffd700 1 -- 172.21.15.76:0/203486781 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c090259a80 msgr2=0x55c090265f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:55:03.288 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.285+0000 7f1616ffd700 1 --2- 172.21.15.76:0/203486781 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c090259a80 0x55c090265f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:03.288 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.285+0000 7f1616ffd700 1 -- 172.21.15.76:0/203486781 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c08ffd7b00 con 0x55c09025a3e0 2024-06-02T04:55:03.288 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.285+0000 7f1617fff700 1 --2- 172.21.15.76:0/203486781 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c09025b2d0 0x55c0902d4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T04:55:03.288 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.286+0000 7f1616ffd700 1 --2- 172.21.15.76:0/203486781 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c09025a3e0 0x55c090266490 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f160c0098e0 tx=0x7f160c0058e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f1469397dbf13b90 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:55:03.288 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.286+0000 7f15f6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-06-02T04:55:03.288 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.286+0000 7f15f6ffd700 1 -- 172.21.15.76:0/203486781 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f160c026040 con 0x55c09025a3e0 2024-06-02T04:55:03.288 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.286+0000 7f15f6ffd700 1 -- 172.21.15.76:0/203486781 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f160c02c410 con 0x55c09025a3e0 2024-06-02T04:55:03.288 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.286+0000 7f162a1e6b80 1 -- 172.21.15.76:0/203486781 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c090103210 con 0x55c09025a3e0 2024-06-02T04:55:03.288 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.286+0000 7f15f6ffd700 1 -- 172.21.15.76:0/203486781 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f160c02c5d0 con 0x55c09025a3e0 2024-06-02T04:55:03.288 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.286+0000 7f162a1e6b80 10 client.25694 fetch_fsmap learned FSMap version 32 2024-06-02T04:55:03.288 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.286+0000 7f162a1e6b80 1 -- 172.21.15.76:0/203486781 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x55c09002fc70 con 0x55c09025a3e0 2024-06-02T04:55:03.289 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.286+0000 7f15f6ffd700 1 -- 172.21.15.76:0/203486781 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55c090103210 con 0x55c09025a3e0 2024-06-02T04:55:03.289 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.287+0000 7f15f6ffd700 1 -- 172.21.15.76:0/203486781 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 32) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f160c0099f0 con 0x55c09025a3e0 2024-06-02T04:55:03.289 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.287+0000 7f162a1e6b80 10 client.25694 fetch_fsmap finished waiting for FSMap version 32 2024-06-02T04:55:03.289 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.287+0000 7f162a1e6b80 10 client.25694 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T04:55:03.289 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.287+0000 7f162a1e6b80 20 client.25694 populate_metadata read hostname 'smithi076' 2024-06-02T04:55:03.289 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.287+0000 7f162a1e6b80 1 --2- 172.21.15.76:0/203486781 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55c0902d69b0 0x55c0902d8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:55:03.289 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.287+0000 7f162a1e6b80 4 client.25694 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T04:55:03.289 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.287+0000 7f162a1e6b80 1 -- 172.21.15.76:0/203486781 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55c08fff8c90 con 0x55c0902d69b0 2024-06-02T04:55:03.289 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.287+0000 7f1617fff700 1 --2- 172.21.15.76:0/203486781 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55c0902d69b0 0x55c0902d8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:55:03.290 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.288+0000 7f1617fff700 1 --2- 172.21.15.76:0/203486781 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55c0902d69b0 0x55c0902d8dd0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1cc9b32688fadbcf server_cookie=882440f9e7be55c in_seq=0 out_seq=0 2024-06-02T04:55:03.290 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.288+0000 7f15f6ffd700 10 client.25694 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:55:03.308 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.308+0000 7f15f6ffd700 1 -- 172.21.15.76:0/203486781 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55c08fff8c90 con 0x55c0902d69b0 2024-06-02T04:55:03.308 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.308+0000 7f15f6ffd700 10 client.25694 handle_command_reply: tid=0 2024-06-02T04:55:03.309 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.308+0000 7f162a1e6b80 1 client.25694 shutdown 2024-06-02T04:55:03.309 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.308+0000 7f162a1e6b80 1 -- 172.21.15.76:0/203486781 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c09025a3e0 msgr2=0x55c090266490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:55:03.309 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.308+0000 7f162a1e6b80 1 --2- 172.21.15.76:0/203486781 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c09025a3e0 0x55c090266490 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f160c0098e0 tx=0x7f160c0058e0 comp rx=0 tx=0).stop 2024-06-02T04:55:03.309 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.309+0000 7f162a1e6b80 1 -- 172.21.15.76:0/203486781 shutdown_connections 2024-06-02T04:55:03.310 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.309+0000 7f162a1e6b80 1 --2- 172.21.15.76:0/203486781 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55c0902d69b0 0x55c0902d8dd0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:03.310 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.309+0000 7f162a1e6b80 1 --2- 172.21.15.76:0/203486781 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c09025b2d0 0x55c0902d4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:03.310 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.309+0000 7f162a1e6b80 1 --2- 172.21.15.76:0/203486781 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c090259a80 0x55c090265f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:03.310 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.309+0000 7f162a1e6b80 1 --2- 172.21.15.76:0/203486781 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c09025a3e0 0x55c090266490 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:03.310 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.309+0000 7f162a1e6b80 1 -- 172.21.15.76:0/203486781 >> 172.21.15.76:0/203486781 conn(0x55c0901b81b0 msgr2=0x55c090256020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:55:03.310 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.309+0000 7f15f6ffd700 0 client.25694 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:55:03.310 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.309+0000 7f162a1e6b80 1 -- 172.21.15.76:0/203486781 shutdown_connections 2024-06-02T04:55:03.310 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.309+0000 7f162a1e6b80 1 -- 172.21.15.76:0/203486781 wait complete. 2024-06-02T04:55:03.311 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:{ 2024-06-02T04:55:03.311 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "message": "", 2024-06-02T04:55:03.311 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "return_code": 0 2024-06-02T04:55:03.311 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:} 2024-06-02T04:55:03.312 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.309+0000 7f162a1e6b80 20 client.25694 trim_cache size 0 max 16384 2024-06-02T04:55:03.314 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.312+0000 7f161e02b700 1 -- 172.21.15.76:0/1043774862 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f16000a11d0 msgr2=0x7f16000a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:55:03.314 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.312+0000 7f161e02b700 1 --2- 172.21.15.76:0/1043774862 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f16000a11d0 0x7f16000a3690 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f160800c5b0 tx=0x7f16080047c0 comp rx=0 tx=0).stop 2024-06-02T04:55:03.314 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.312+0000 7f161e02b700 1 -- 172.21.15.76:0/1043774862 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16180ffe00 msgr2=0x7f161810edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:55:03.315 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.312+0000 7f161e02b700 1 --2- 172.21.15.76:0/1043774862 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16180ffe00 0x7f161810edd0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f160800e970 tx=0x7f160800ec80 comp rx=0 tx=0).stop 2024-06-02T04:55:03.315 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.312+0000 7f161e02b700 1 -- 172.21.15.76:0/1043774862 shutdown_connections 2024-06-02T04:55:03.315 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.312+0000 7f161e02b700 1 --2- 172.21.15.76:0/1043774862 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1618101990 0x7f1618110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:03.315 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.312+0000 7f161e02b700 1 --2- 172.21.15.76:0/1043774862 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16180ffe00 0x7f161810edd0 secure :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f160800e970 tx=0x7f160800ec80 comp rx=0 tx=0).stop 2024-06-02T04:55:03.315 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.312+0000 7f161e02b700 1 --2- 172.21.15.76:0/1043774862 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f16000a11d0 0x7f16000a3690 secure :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f160800c5b0 tx=0x7f16080047c0 comp rx=0 tx=0).stop 2024-06-02T04:55:03.315 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.312+0000 7f161e02b700 1 --2- 172.21.15.76:0/1043774862 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1618100ff0 0x7f161810f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:03.315 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.312+0000 7f161e02b700 1 -- 172.21.15.76:0/1043774862 >> 172.21.15.76:0/1043774862 conn(0x7f16180fb390 msgr2=0x7f1618104360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:55:03.315 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.314+0000 7f161e02b700 1 -- 172.21.15.76:0/1043774862 shutdown_connections 2024-06-02T04:55:03.315 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:03.314+0000 7f161e02b700 1 -- 172.21.15.76:0/1043774862 wait complete. 2024-06-02T04:55:03.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:55:03 smithi192 ceph-mon[47933]: pgmap v432: 129 pgs: 129 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 9.4 MiB/s wr, 884 op/s 2024-06-02T04:55:03.737 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:55:03 smithi076 ceph-mon[42935]: pgmap v432: 129 pgs: 129 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 9.4 MiB/s wr, 884 op/s 2024-06-02T04:55:03.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:55:03 smithi119 ceph-mon[46633]: pgmap v432: 129 pgs: 129 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 9.4 MiB/s wr, 884 op/s 2024-06-02T04:55:05.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:55:05 smithi192 ceph-mon[47933]: pgmap v433: 129 pgs: 129 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 9.0 MiB/s wr, 854 op/s 2024-06-02T04:55:05.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:55:05 smithi076 ceph-mon[42935]: pgmap v433: 129 pgs: 129 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 9.0 MiB/s wr, 854 op/s 2024-06-02T04:55:05.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:55:05 smithi119 ceph-mon[46633]: pgmap v433: 129 pgs: 129 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 9.0 MiB/s wr, 854 op/s 2024-06-02T04:55:06.318 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 255.0 s, 832.0 tps, lat 119.941 ms stddev 39.859 2024-06-02T04:55:07.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:55:07 smithi192 ceph-mon[47933]: pgmap v434: 129 pgs: 129 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 10 MiB/s wr, 963 op/s 2024-06-02T04:55:07.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:55:07 smithi076 ceph-mon[42935]: pgmap v434: 129 pgs: 129 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 10 MiB/s wr, 963 op/s 2024-06-02T04:55:07.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:55:07 smithi119 ceph-mon[46633]: pgmap v434: 129 pgs: 129 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 10 MiB/s wr, 963 op/s 2024-06-02T04:55:09.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:55:09 smithi076 ceph-mon[42935]: pgmap v435: 129 pgs: 129 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 9.5 MiB/s wr, 914 op/s 2024-06-02T04:55:09.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:55:09 smithi119 ceph-mon[46633]: pgmap v435: 129 pgs: 129 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 9.5 MiB/s wr, 914 op/s 2024-06-02T04:55:09.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:55:09 smithi192 ceph-mon[47933]: pgmap v435: 129 pgs: 129 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 9.5 MiB/s wr, 914 op/s 2024-06-02T04:55:11.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 260.0 s, 766.6 tps, lat 129.373 ms stddev 55.507 2024-06-02T04:55:11.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:55:11 smithi076 ceph-mon[42935]: pgmap v436: 129 pgs: 129 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 9.5 MiB/s wr, 937 op/s 2024-06-02T04:55:11.735 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:55:11 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:55:11.735 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:55:11 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:55:11.735 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:55:11 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:55:11.735 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:55:11 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:55:11.847 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:55:11 smithi119 ceph-mon[46633]: pgmap v436: 129 pgs: 129 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 9.5 MiB/s wr, 937 op/s 2024-06-02T04:55:11.847 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:55:11 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:55:11.847 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:55:11 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:55:11.847 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:55:11 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:55:11.847 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:55:11 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:55:11.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:55:11 smithi192 ceph-mon[47933]: pgmap v436: 129 pgs: 129 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 9.5 MiB/s wr, 937 op/s 2024-06-02T04:55:11.933 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:55:11 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:55:11.933 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:55:11 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:55:11.933 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:55:11 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:55:11.933 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:55:11 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:55:13.736 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:55:13 smithi076 ceph-mon[42935]: pgmap v437: 129 pgs: 129 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 10 MiB/s wr, 993 op/s 2024-06-02T04:55:13.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:55:13 smithi119 ceph-mon[46633]: pgmap v437: 129 pgs: 129 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 10 MiB/s wr, 993 op/s 2024-06-02T04:55:13.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:55:13 smithi192 ceph-mon[47933]: pgmap v437: 129 pgs: 129 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 10 MiB/s wr, 993 op/s 2024-06-02T04:55:15.738 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:55:15 smithi076 ceph-mon[42935]: pgmap v438: 129 pgs: 129 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 8.1 MiB/s wr, 792 op/s 2024-06-02T04:55:15.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:55:15 smithi119 ceph-mon[46633]: pgmap v438: 129 pgs: 129 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 8.1 MiB/s wr, 792 op/s 2024-06-02T04:55:15.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:55:15 smithi192 ceph-mon[47933]: pgmap v438: 129 pgs: 129 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 8.1 MiB/s wr, 792 op/s 2024-06-02T04:55:16.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 265.0 s, 795.4 tps, lat 126.677 ms stddev 46.135 2024-06-02T04:55:16.485 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.484+0000 7f2f46095700 1 -- 172.21.15.76:0/1243318500 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2f40108730 msgr2=0x7f2f40108b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:55:16.485 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.484+0000 7f2f46095700 1 --2- 172.21.15.76:0/1243318500 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2f40108730 0x7f2f40108b90 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f2f340099c0 tx=0x7f2f34009cd0 comp rx=0 tx=0).stop 2024-06-02T04:55:16.485 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.484+0000 7f2f46095700 1 -- 172.21.15.76:0/1243318500 shutdown_connections 2024-06-02T04:55:16.485 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.484+0000 7f2f46095700 1 --2- 172.21.15.76:0/1243318500 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f401090d0 0x7f2f4010f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:16.485 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.484+0000 7f2f46095700 1 --2- 172.21.15.76:0/1243318500 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2f40107540 0x7f2f40107960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:16.485 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.484+0000 7f2f46095700 1 --2- 172.21.15.76:0/1243318500 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2f40108730 0x7f2f40108b90 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:16.485 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.484+0000 7f2f46095700 1 -- 172.21.15.76:0/1243318500 >> 172.21.15.76:0/1243318500 conn(0x7f2f400764d0 msgr2=0x7f2f40078910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:55:16.485 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.484+0000 7f2f46095700 1 -- 172.21.15.76:0/1243318500 shutdown_connections 2024-06-02T04:55:16.486 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.484+0000 7f2f46095700 1 -- 172.21.15.76:0/1243318500 wait complete. 2024-06-02T04:55:16.487 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.485+0000 7f2f46095700 1 Processor -- start 2024-06-02T04:55:16.487 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.485+0000 7f2f46095700 1 -- start start 2024-06-02T04:55:16.487 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.485+0000 7f2f46095700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2f40107540 0x7f2f4019d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:55:16.487 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.486+0000 7f2f46095700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f40108730 0x7f2f4019d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:55:16.487 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.486+0000 7f2f46095700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2f401090d0 0x7f2f401a49c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:55:16.488 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.486+0000 7f2f46095700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f401a4f90 con 0x7f2f40107540 2024-06-02T04:55:16.488 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.486+0000 7f2f46095700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f401a50d0 con 0x7f2f401090d0 2024-06-02T04:55:16.488 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.486+0000 7f2f46095700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f401a5260 con 0x7f2f40108730 2024-06-02T04:55:16.488 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.486+0000 7f2f3f7fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2f40107540 0x7f2f4019d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:55:16.488 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.486+0000 7f2f3f7fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2f40107540 0x7f2f4019d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:38970/0 (socket says 172.21.15.76:38970) 2024-06-02T04:55:16.488 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.486+0000 7f2f3f7fe700 1 -- 172.21.15.76:0/2732318133 learned_addr learned my addr 172.21.15.76:0/2732318133 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:55:16.488 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.486+0000 7f2f3effd700 1 --2- 172.21.15.76:0/2732318133 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f40108730 0x7f2f4019d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:55:16.488 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.486+0000 7f2f3ffff700 1 --2- 172.21.15.76:0/2732318133 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2f401090d0 0x7f2f401a49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:55:16.488 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.486+0000 7f2f3f7fe700 1 -- 172.21.15.76:0/2732318133 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f40108730 msgr2=0x7f2f4019d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:55:16.488 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.486+0000 7f2f3f7fe700 1 --2- 172.21.15.76:0/2732318133 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f40108730 0x7f2f4019d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:16.488 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.486+0000 7f2f3f7fe700 1 -- 172.21.15.76:0/2732318133 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2f401090d0 msgr2=0x7f2f401a49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:55:16.488 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.486+0000 7f2f3f7fe700 1 --2- 172.21.15.76:0/2732318133 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2f401090d0 0x7f2f401a49c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:16.488 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.486+0000 7f2f3f7fe700 1 -- 172.21.15.76:0/2732318133 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f340095f0 con 0x7f2f40107540 2024-06-02T04:55:16.489 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.486+0000 7f2f3ffff700 1 --2- 172.21.15.76:0/2732318133 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2f401090d0 0x7f2f401a49c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T04:55:16.489 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.487+0000 7f2f3f7fe700 1 --2- 172.21.15.76:0/2732318133 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2f40107540 0x7f2f4019d460 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f2f3000b550 tx=0x7f2f3000b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:55:16.489 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.488+0000 7f2f3cff9700 1 -- 172.21.15.76:0/2732318133 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f30011830 con 0x7f2f40107540 2024-06-02T04:55:16.490 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.488+0000 7f2f3cff9700 1 -- 172.21.15.76:0/2732318133 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2f30011e20 con 0x7f2f40107540 2024-06-02T04:55:16.490 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.488+0000 7f2f3cff9700 1 -- 172.21.15.76:0/2732318133 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f30010d30 con 0x7f2f40107540 2024-06-02T04:55:16.490 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.488+0000 7f2f46095700 1 -- 172.21.15.76:0/2732318133 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f401a5540 con 0x7f2f40107540 2024-06-02T04:55:16.490 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.489+0000 7f2f46095700 1 -- 172.21.15.76:0/2732318133 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f401a5a00 con 0x7f2f40107540 2024-06-02T04:55:16.494 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.493+0000 7f2f52250b80 1 Processor -- start 2024-06-02T04:55:16.494 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.493+0000 7f2f52250b80 1 -- start start 2024-06-02T04:55:16.494 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.493+0000 7f2f52250b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55aec7ad3a80 0x55aec7ad3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:55:16.494 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.493+0000 7f2f52250b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55aec7ad43e0 0x55aec7ad4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:55:16.494 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.493+0000 7f2f52250b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55aec7ad52d0 0x55aec7ad5750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:55:16.494 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.493+0000 7f2f52250b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aec7a2b0f0 con 0x55aec7ad52d0 2024-06-02T04:55:16.494 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.493+0000 7f2f52250b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aec7a28ab0 con 0x55aec7ad43e0 2024-06-02T04:55:16.494 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.493+0000 7f2f52250b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aec7a243a0 con 0x55aec7ad3a80 2024-06-02T04:55:16.495 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.493+0000 7f2f3effd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55aec7ad52d0 0x55aec7ad5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:55:16.495 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.493+0000 7f2f3effd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55aec7ad52d0 0x55aec7ad5750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:38982/0 (socket says 172.21.15.76:38982) 2024-06-02T04:55:16.495 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.493+0000 7f2f3effd700 1 -- 172.21.15.76:0/1352797377 learned_addr learned my addr 172.21.15.76:0/1352797377 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:55:16.495 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.493+0000 7f2f3ffff700 1 --2- 172.21.15.76:0/1352797377 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55aec7ad3a80 0x55aec7ad3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:55:16.496 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.494+0000 7f2f3effd700 1 -- 172.21.15.76:0/1352797377 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55aec7ad3a80 msgr2=0x55aec7ad3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:55:16.496 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.494+0000 7f2f3effd700 1 --2- 172.21.15.76:0/1352797377 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55aec7ad3a80 0x55aec7ad3ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:16.496 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.494+0000 7f2f3effd700 1 -- 172.21.15.76:0/1352797377 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55aec7ad43e0 msgr2=0x55aec7ad4cf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-02T04:55:16.496 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.494+0000 7f2f3effd700 1 --2- 172.21.15.76:0/1352797377 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55aec7ad43e0 0x55aec7ad4cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:16.496 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.494+0000 7f2f3effd700 1 -- 172.21.15.76:0/1352797377 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55aec78a5350 con 0x55aec7ad52d0 2024-06-02T04:55:16.496 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.494+0000 7f2f3effd700 1 --2- 172.21.15.76:0/1352797377 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55aec7ad52d0 0x55aec7ad5750 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f2f3400b580 tx=0x7f2f34005c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7616fad5e53e08a server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:55:16.496 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.494+0000 7f2f3cff9700 1 -- 172.21.15.76:0/2732318133 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f2f30011990 con 0x7f2f40107540 2024-06-02T04:55:16.496 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.495+0000 7f2f3cff9700 1 --2- 172.21.15.76:0/2732318133 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f2f280a11a0 0x7f2f280a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:55:16.497 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.495+0000 7f2f3cff9700 1 -- 172.21.15.76:0/2732318133 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f2f300cc5d0 con 0x7f2f40107540 2024-06-02T04:55:16.498 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.495+0000 7f2f25ffb700 1 -- 172.21.15.76:0/1352797377 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f3401d030 con 0x55aec7ad52d0 2024-06-02T04:55:16.498 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.495+0000 7f2f25ffb700 1 -- 172.21.15.76:0/1352797377 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2f3401e040 con 0x55aec7ad52d0 2024-06-02T04:55:16.498 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.495+0000 7f2f25ffb700 1 -- 172.21.15.76:0/1352797377 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f34003b90 con 0x55aec7ad52d0 2024-06-02T04:55:16.499 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.495+0000 7f2f3ffff700 1 --2- 172.21.15.76:0/2732318133 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f2f280a11a0 0x7f2f280a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:55:16.499 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.496+0000 7f2f52250b80 1 -- 172.21.15.76:0/1352797377 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55aec7ad52d0 msgr2=0x55aec7ad5750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:55:16.499 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.496+0000 7f2f52250b80 1 --2- 172.21.15.76:0/1352797377 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55aec7ad52d0 0x55aec7ad5750 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f2f3400b580 tx=0x7f2f34005c70 comp rx=0 tx=0).stop 2024-06-02T04:55:16.499 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.496+0000 7f2f3ffff700 1 --2- 172.21.15.76:0/2732318133 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f2f280a11a0 0x7f2f280a3660 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f2f38003b10 tx=0x7f2f3800b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:55:16.502 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.498+0000 7f2f52250b80 1 -- 172.21.15.76:0/1352797377 shutdown_connections 2024-06-02T04:55:16.502 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.498+0000 7f2f52250b80 1 --2- 172.21.15.76:0/1352797377 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55aec7ad52d0 0x55aec7ad5750 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:16.503 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.498+0000 7f2f52250b80 1 --2- 172.21.15.76:0/1352797377 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55aec7ad3a80 0x55aec7ad3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:16.503 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.498+0000 7f2f52250b80 1 --2- 172.21.15.76:0/1352797377 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55aec7ad43e0 0x55aec7ad4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:16.503 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.498+0000 7f2f52250b80 1 -- 172.21.15.76:0/1352797377 >> 172.21.15.76:0/1352797377 conn(0x55aec7a321b0 msgr2=0x55aec7ad0440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:55:16.503 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.498+0000 7f2f52250b80 1 -- 172.21.15.76:0/1352797377 shutdown_connections 2024-06-02T04:55:16.503 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.498+0000 7f2f52250b80 1 -- 172.21.15.76:0/1352797377 wait complete. 2024-06-02T04:55:16.503 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.498+0000 7f2f52250b80 1 -- start start 2024-06-02T04:55:16.503 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.499+0000 7f2f52250b80 1 Processor -- start 2024-06-02T04:55:16.503 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.499+0000 7f2f52250b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55aec7ad3a80 0x55aec7add8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:55:16.503 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.499+0000 7f2f52250b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55aec7ad43e0 0x55aec7addde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:55:16.503 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.499+0000 7f2f52250b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55aec7ad52d0 0x55aec7ae4e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:55:16.503 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.499+0000 7f2f52250b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aec79c0500 con 0x55aec7ad52d0 2024-06-02T04:55:16.503 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.499+0000 7f2f52250b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aec79c01a0 con 0x55aec7ad43e0 2024-06-02T04:55:16.504 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.499+0000 7f2f52250b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aec78a7640 con 0x55aec7ad3a80 2024-06-02T04:55:16.504 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.499+0000 7f2f52250b80 10 client.0 _ll_register_callbacks cb 0x55aec79c9ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:55:16.504 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.500+0000 7f2f3effd700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55aec7ad43e0 0x55aec7addde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:55:16.504 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.500+0000 7f2f3effd700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55aec7ad43e0 0x55aec7addde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:45194/0 (socket says 172.21.15.76:45194) 2024-06-02T04:55:16.504 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.500+0000 7f2f3effd700 1 -- 172.21.15.76:0/765851963 learned_addr learned my addr 172.21.15.76:0/765851963 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:55:16.504 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.500+0000 7f2f3effd700 1 -- 172.21.15.76:0/765851963 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55aec7ad3a80 msgr2=0x55aec7add8a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-02T04:55:16.504 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.500+0000 7f2f3effd700 1 --2- 172.21.15.76:0/765851963 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55aec7ad3a80 0x55aec7add8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:16.504 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.500+0000 7f2f3effd700 1 -- 172.21.15.76:0/765851963 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55aec7ad52d0 msgr2=0x55aec7ae4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:55:16.504 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.500+0000 7f2f3effd700 1 --2- 172.21.15.76:0/765851963 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55aec7ad52d0 0x55aec7ae4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:16.504 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.500+0000 7f2f3effd700 1 -- 172.21.15.76:0/765851963 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f401102d0 con 0x55aec7ad43e0 2024-06-02T04:55:16.504 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.500+0000 7f2f3effd700 1 --2- 172.21.15.76:0/765851963 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55aec7ad43e0 0x55aec7addde0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2f34005e20 tx=0x7f2f34004c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d4a93d4293482759 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:55:16.504 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.500+0000 7f2f1effd700 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-06-02T04:55:16.505 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.501+0000 7f2f1effd700 1 -- 172.21.15.76:0/765851963 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f3401d040 con 0x55aec7ad43e0 2024-06-02T04:55:16.505 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.501+0000 7f2f1effd700 1 -- 172.21.15.76:0/765851963 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f2f34005460 con 0x55aec7ad43e0 2024-06-02T04:55:16.505 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.501+0000 7f2f52250b80 1 -- 172.21.15.76:0/765851963 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55aec797d210 con 0x55aec7ad43e0 2024-06-02T04:55:16.505 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.501+0000 7f2f1effd700 1 -- 172.21.15.76:0/765851963 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2f34005620 con 0x55aec7ad43e0 2024-06-02T04:55:16.505 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.501+0000 7f2f52250b80 10 client.25700 fetch_fsmap learned FSMap version 32 2024-06-02T04:55:16.505 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.501+0000 7f2f52250b80 1 -- 172.21.15.76:0/765851963 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x55aec7851b00 con 0x55aec7ad43e0 2024-06-02T04:55:16.505 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.501+0000 7f2f1effd700 1 -- 172.21.15.76:0/765851963 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55aec797d210 con 0x55aec7ad43e0 2024-06-02T04:55:16.505 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.501+0000 7f2f1effd700 1 -- 172.21.15.76:0/765851963 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 32) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f2f34023460 con 0x55aec7ad43e0 2024-06-02T04:55:16.505 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.501+0000 7f2f52250b80 10 client.25700 fetch_fsmap finished waiting for FSMap version 32 2024-06-02T04:55:16.505 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.501+0000 7f2f52250b80 10 client.25700 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T04:55:16.505 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.501+0000 7f2f52250b80 20 client.25700 populate_metadata read hostname 'smithi076' 2024-06-02T04:55:16.505 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.501+0000 7f2f52250b80 1 --2- 172.21.15.76:0/765851963 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55aec7ae91a0 0x55aec7aeb5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:55:16.506 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.501+0000 7f2f52250b80 4 client.25700 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T04:55:16.506 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.502+0000 7f2f52250b80 1 -- 172.21.15.76:0/765851963 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55aec7aa37b0 con 0x55aec7ae91a0 2024-06-02T04:55:16.506 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.502+0000 7f2f3f7fe700 1 --2- 172.21.15.76:0/765851963 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55aec7ae91a0 0x55aec7aeb5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:55:16.507 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.502+0000 7f2f3f7fe700 1 --2- 172.21.15.76:0/765851963 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55aec7ae91a0 0x55aec7aeb5e0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6f38620080744ff9 server_cookie=ea045a4f5f7c8ba9 in_seq=0 out_seq=0 2024-06-02T04:55:16.507 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.502+0000 7f2f1effd700 10 client.25700 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:55:16.507 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.503+0000 7f2f1effd700 1 -- 172.21.15.76:0/765851963 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55aec7aa37b0 con 0x55aec7ae91a0 2024-06-02T04:55:16.507 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.503+0000 7f2f1effd700 10 client.25700 handle_command_reply: tid=0 2024-06-02T04:55:16.507 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.504+0000 7f2f52250b80 1 client.25700 shutdown 2024-06-02T04:55:16.507 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.504+0000 7f2f52250b80 1 -- 172.21.15.76:0/765851963 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55aec7ad43e0 msgr2=0x55aec7addde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:55:16.508 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.504+0000 7f2f52250b80 1 --2- 172.21.15.76:0/765851963 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55aec7ad43e0 0x55aec7addde0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2f34005e20 tx=0x7f2f34004c00 comp rx=0 tx=0).stop 2024-06-02T04:55:16.508 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.504+0000 7f2f52250b80 1 -- 172.21.15.76:0/765851963 shutdown_connections 2024-06-02T04:55:16.508 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.504+0000 7f2f52250b80 1 --2- 172.21.15.76:0/765851963 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55aec7ae91a0 0x55aec7aeb5e0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:16.508 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.504+0000 7f2f52250b80 1 --2- 172.21.15.76:0/765851963 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55aec7ad52d0 0x55aec7ae4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:16.508 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.504+0000 7f2f52250b80 1 --2- 172.21.15.76:0/765851963 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55aec7ad3a80 0x55aec7add8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:16.508 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.504+0000 7f2f52250b80 1 --2- 172.21.15.76:0/765851963 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55aec7ad43e0 0x55aec7addde0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:16.508 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.504+0000 7f2f52250b80 1 -- 172.21.15.76:0/765851963 >> 172.21.15.76:0/765851963 conn(0x55aec7a321b0 msgr2=0x55aec7ace860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:55:16.508 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.504+0000 7f2f1effd700 0 client.25700 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:55:16.508 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.504+0000 7f2f52250b80 1 -- 172.21.15.76:0/765851963 shutdown_connections 2024-06-02T04:55:16.508 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.504+0000 7f2f52250b80 1 -- 172.21.15.76:0/765851963 wait complete. 2024-06-02T04:55:16.508 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.505+0000 7f2f52250b80 20 client.25700 trim_cache size 0 max 16384 2024-06-02T04:55:16.530 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.529+0000 7f2f52250b80 1 Processor -- start 2024-06-02T04:55:16.530 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.529+0000 7f2f52250b80 1 -- start start 2024-06-02T04:55:16.530 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.529+0000 7f2f52250b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55aec7ad3a80 0x55aec7aeb590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:55:16.530 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.529+0000 7f2f52250b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55aec7ad43e0 0x55aec7ae4de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:55:16.530 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.529+0000 7f2f52250b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55aec7ad52d0 0x55aec7ad56b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:55:16.530 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.529+0000 7f2f52250b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aec7adc0e0 con 0x55aec7ad3a80 2024-06-02T04:55:16.530 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.529+0000 7f2f52250b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aec7ad3520 con 0x55aec7ad43e0 2024-06-02T04:55:16.530 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.529+0000 7f2f52250b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aec7aebc60 con 0x55aec7ad52d0 2024-06-02T04:55:16.532 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.529+0000 7f2f3effd700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55aec7ad43e0 0x55aec7ae4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:55:16.532 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.530+0000 7f2f3effd700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55aec7ad43e0 0x55aec7ae4de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:45198/0 (socket says 172.21.15.76:45198) 2024-06-02T04:55:16.532 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.530+0000 7f2f3effd700 1 -- 172.21.15.76:0/3747580216 learned_addr learned my addr 172.21.15.76:0/3747580216 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:55:16.532 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.530+0000 7f2f3ffff700 1 --2- 172.21.15.76:0/3747580216 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55aec7ad52d0 0x55aec7ad56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:55:16.532 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.530+0000 7f2f3effd700 1 -- 172.21.15.76:0/3747580216 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55aec7ad52d0 msgr2=0x55aec7ad56b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:55:16.532 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.530+0000 7f2f3effd700 1 --2- 172.21.15.76:0/3747580216 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55aec7ad52d0 0x55aec7ad56b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:16.533 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.530+0000 7f2f3effd700 1 -- 172.21.15.76:0/3747580216 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55aec7ad3a80 msgr2=0x55aec7aeb590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:55:16.533 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.530+0000 7f2f3effd700 1 --2- 172.21.15.76:0/3747580216 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55aec7ad3a80 0x55aec7aeb590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:16.533 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.530+0000 7f2f3effd700 1 -- 172.21.15.76:0/3747580216 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55aec79ea500 con 0x55aec7ad43e0 2024-06-02T04:55:16.533 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.530+0000 7f2f3effd700 1 --2- 172.21.15.76:0/3747580216 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55aec7ad43e0 0x55aec7ae4de0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2f340094e0 tx=0x7f2f34009290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b2a42baa25cf6192 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:55:16.533 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.530+0000 7f2f267fc700 1 -- 172.21.15.76:0/3747580216 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f34023460 con 0x55aec7ad43e0 2024-06-02T04:55:16.533 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.530+0000 7f2f267fc700 1 -- 172.21.15.76:0/3747580216 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2f340235c0 con 0x55aec7ad43e0 2024-06-02T04:55:16.533 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.530+0000 7f2f267fc700 1 -- 172.21.15.76:0/3747580216 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f340054c0 con 0x55aec7ad43e0 2024-06-02T04:55:16.533 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.531+0000 7f2f52250b80 1 -- 172.21.15.76:0/3747580216 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55aec7ad43e0 msgr2=0x55aec7ae4de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:55:16.533 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.531+0000 7f2f52250b80 1 --2- 172.21.15.76:0/3747580216 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55aec7ad43e0 0x55aec7ae4de0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2f340094e0 tx=0x7f2f34009290 comp rx=0 tx=0).stop 2024-06-02T04:55:16.533 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.531+0000 7f2f52250b80 1 -- 172.21.15.76:0/3747580216 shutdown_connections 2024-06-02T04:55:16.534 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.531+0000 7f2f52250b80 1 --2- 172.21.15.76:0/3747580216 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55aec7ad52d0 0x55aec7ad56b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:16.534 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.531+0000 7f2f52250b80 1 --2- 172.21.15.76:0/3747580216 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55aec7ad3a80 0x55aec7aeb590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:16.534 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.531+0000 7f2f52250b80 1 --2- 172.21.15.76:0/3747580216 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55aec7ad43e0 0x55aec7ae4de0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:16.534 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.531+0000 7f2f52250b80 1 -- 172.21.15.76:0/3747580216 >> 172.21.15.76:0/3747580216 conn(0x55aec7a321b0 msgr2=0x55aec7adb8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:55:16.534 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.532+0000 7f2f52250b80 1 -- 172.21.15.76:0/3747580216 shutdown_connections 2024-06-02T04:55:16.534 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.532+0000 7f2f52250b80 1 -- 172.21.15.76:0/3747580216 wait complete. 2024-06-02T04:55:16.536 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.532+0000 7f2f52250b80 1 -- start start 2024-06-02T04:55:16.536 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.532+0000 7f2f52250b80 1 Processor -- start 2024-06-02T04:55:16.536 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.532+0000 7f2f52250b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55aec7ad3a80 0x55aec7ae21c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:55:16.536 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.532+0000 7f2f52250b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55aec7ad43e0 0x55aec7ae2700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:55:16.536 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.532+0000 7f2f52250b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55aec7ad52d0 0x55aec7ae36e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:55:16.537 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.532+0000 7f2f52250b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aec7ae3c20 con 0x55aec7ad3a80 2024-06-02T04:55:16.537 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.532+0000 7f2f52250b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aec7ae3d90 con 0x55aec7ad52d0 2024-06-02T04:55:16.537 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.532+0000 7f2f52250b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aec7ae3f50 con 0x55aec7ad43e0 2024-06-02T04:55:16.537 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.532+0000 7f2f52250b80 10 client.0 _ll_register_callbacks cb 0x55aec79c9ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:55:16.537 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.533+0000 7f2f3f7fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55aec7ad3a80 0x55aec7ae21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:55:16.537 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.533+0000 7f2f3ffff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55aec7ad52d0 0x55aec7ae36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:55:16.537 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.533+0000 7f2f3ffff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55aec7ad52d0 0x55aec7ae36e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:45200/0 (socket says 172.21.15.76:45200) 2024-06-02T04:55:16.537 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.533+0000 7f2f3f7fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55aec7ad3a80 0x55aec7ae21c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:39018/0 (socket says 172.21.15.76:39018) 2024-06-02T04:55:16.537 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.533+0000 7f2f3ffff700 1 -- 172.21.15.76:0/2637823708 learned_addr learned my addr 172.21.15.76:0/2637823708 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:55:16.537 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.533+0000 7f2f3effd700 1 --2- 172.21.15.76:0/2637823708 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55aec7ad43e0 0x55aec7ae2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:55:16.537 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.533+0000 7f2f3ffff700 1 -- 172.21.15.76:0/2637823708 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55aec7ad43e0 msgr2=0x55aec7ae2700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:55:16.538 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.533+0000 7f2f3ffff700 1 --2- 172.21.15.76:0/2637823708 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55aec7ad43e0 0x55aec7ae2700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:16.538 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.533+0000 7f2f3ffff700 1 -- 172.21.15.76:0/2637823708 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55aec7ad3a80 msgr2=0x55aec7ae21c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:55:16.538 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.533+0000 7f2f3ffff700 1 --2- 172.21.15.76:0/2637823708 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55aec7ad3a80 0x55aec7ae21c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:16.538 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.533+0000 7f2f3ffff700 1 -- 172.21.15.76:0/2637823708 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55aec7851b00 con 0x55aec7ad52d0 2024-06-02T04:55:16.538 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.533+0000 7f2f3ffff700 1 --2- 172.21.15.76:0/2637823708 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55aec7ad52d0 0x55aec7ae36e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2f38007580 tx=0x7f2f38009920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8b20aeb1f10c748 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:55:16.538 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.533+0000 7f2f1effd700 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-06-02T04:55:16.538 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.533+0000 7f2f1effd700 1 -- 172.21.15.76:0/2637823708 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f38004bb0 con 0x55aec7ad52d0 2024-06-02T04:55:16.538 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.534+0000 7f2f52250b80 1 -- 172.21.15.76:0/2637823708 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2f3401e040 con 0x55aec7ad52d0 2024-06-02T04:55:16.538 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.534+0000 7f2f1effd700 1 -- 172.21.15.76:0/2637823708 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f2f38004d10 con 0x55aec7ad52d0 2024-06-02T04:55:16.538 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.534+0000 7f2f1effd700 1 -- 172.21.15.76:0/2637823708 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2f3800e4f0 con 0x55aec7ad52d0 2024-06-02T04:55:16.538 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.534+0000 7f2f52250b80 10 client.25706 fetch_fsmap learned FSMap version 32 2024-06-02T04:55:16.538 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.534+0000 7f2f52250b80 1 -- 172.21.15.76:0/2637823708 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x55aec78a9c70 con 0x55aec7ad52d0 2024-06-02T04:55:16.539 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.534+0000 7f2f1effd700 1 -- 172.21.15.76:0/2637823708 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2f3401e040 con 0x55aec7ad52d0 2024-06-02T04:55:16.539 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.534+0000 7f2f1effd700 1 -- 172.21.15.76:0/2637823708 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 32) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f2f3802a030 con 0x55aec7ad52d0 2024-06-02T04:55:16.539 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.534+0000 7f2f52250b80 10 client.25706 fetch_fsmap finished waiting for FSMap version 32 2024-06-02T04:55:16.539 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.534+0000 7f2f52250b80 10 client.25706 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T04:55:16.539 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.534+0000 7f2f52250b80 20 client.25706 populate_metadata read hostname 'smithi076' 2024-06-02T04:55:16.539 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.534+0000 7f2f52250b80 1 --2- 172.21.15.76:0/2637823708 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55aec7b3fd90 0x55aec7b421b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:55:16.539 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.534+0000 7f2f52250b80 4 client.25706 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T04:55:16.539 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.534+0000 7f2f52250b80 1 -- 172.21.15.76:0/2637823708 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55aec7a1ce60 con 0x55aec7b3fd90 2024-06-02T04:55:16.539 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.534+0000 7f2f3f7fe700 1 --2- 172.21.15.76:0/2637823708 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55aec7b3fd90 0x55aec7b421b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:55:16.539 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.535+0000 7f2f1effd700 10 client.25706 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:55:16.539 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.535+0000 7f2f3f7fe700 1 --2- 172.21.15.76:0/2637823708 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55aec7b3fd90 0x55aec7b421b0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5fef6a843eb800ce server_cookie=8dbad74e14318378 in_seq=0 out_seq=0 2024-06-02T04:55:16.597 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.596+0000 7f2f1effd700 1 -- 172.21.15.76:0/2637823708 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55aec7a1ce60 con 0x55aec7b3fd90 2024-06-02T04:55:16.597 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.596+0000 7f2f1effd700 10 client.25706 handle_command_reply: tid=0 2024-06-02T04:55:16.597 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.596+0000 7f2f52250b80 1 client.25706 shutdown 2024-06-02T04:55:16.600 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.600+0000 7f2f52250b80 1 -- 172.21.15.76:0/2637823708 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55aec7ad52d0 msgr2=0x55aec7ae36e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:55:16.600 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.600+0000 7f2f52250b80 1 --2- 172.21.15.76:0/2637823708 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55aec7ad52d0 0x55aec7ae36e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2f38007580 tx=0x7f2f38009920 comp rx=0 tx=0).stop 2024-06-02T04:55:16.601 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.600+0000 7f2f52250b80 1 -- 172.21.15.76:0/2637823708 shutdown_connections 2024-06-02T04:55:16.601 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.600+0000 7f2f52250b80 1 --2- 172.21.15.76:0/2637823708 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55aec7b3fd90 0x55aec7b421b0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:16.601 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.600+0000 7f2f52250b80 1 --2- 172.21.15.76:0/2637823708 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55aec7ad52d0 0x55aec7ae36e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:16.601 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.600+0000 7f2f52250b80 1 --2- 172.21.15.76:0/2637823708 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55aec7ad3a80 0x55aec7ae21c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:16.601 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.600+0000 7f2f52250b80 1 --2- 172.21.15.76:0/2637823708 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55aec7ad43e0 0x55aec7ae2700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:16.601 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.600+0000 7f2f52250b80 1 -- 172.21.15.76:0/2637823708 >> 172.21.15.76:0/2637823708 conn(0x55aec7a321b0 msgr2=0x55aec7aeff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:55:16.601 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.600+0000 7f2f1effd700 0 client.25706 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:55:16.601 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.600+0000 7f2f52250b80 1 -- 172.21.15.76:0/2637823708 shutdown_connections 2024-06-02T04:55:16.601 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.600+0000 7f2f52250b80 1 -- 172.21.15.76:0/2637823708 wait complete. 2024-06-02T04:55:16.602 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.601+0000 7f2f52250b80 20 client.25706 trim_cache size 0 max 16384 2024-06-02T04:55:16.602 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:{ 2024-06-02T04:55:16.602 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "message": "", 2024-06-02T04:55:16.602 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "return_code": 0 2024-06-02T04:55:16.602 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:} 2024-06-02T04:55:16.603 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.601+0000 7f2f46095700 1 -- 172.21.15.76:0/2732318133 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f2f280a11a0 msgr2=0x7f2f280a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:55:16.603 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.601+0000 7f2f46095700 1 --2- 172.21.15.76:0/2732318133 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f2f280a11a0 0x7f2f280a3660 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f2f38003b10 tx=0x7f2f3800b040 comp rx=0 tx=0).stop 2024-06-02T04:55:16.603 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.601+0000 7f2f46095700 1 -- 172.21.15.76:0/2732318133 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2f40107540 msgr2=0x7f2f4019d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:55:16.603 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.601+0000 7f2f46095700 1 --2- 172.21.15.76:0/2732318133 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2f40107540 0x7f2f4019d460 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f2f3000b550 tx=0x7f2f3000b860 comp rx=0 tx=0).stop 2024-06-02T04:55:16.603 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.601+0000 7f2f46095700 1 -- 172.21.15.76:0/2732318133 shutdown_connections 2024-06-02T04:55:16.603 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.601+0000 7f2f46095700 1 --2- 172.21.15.76:0/2732318133 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f2f280a11a0 0x7f2f280a3660 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:16.604 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.601+0000 7f2f46095700 1 --2- 172.21.15.76:0/2732318133 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2f401090d0 0x7f2f401a49c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:16.604 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.601+0000 7f2f46095700 1 --2- 172.21.15.76:0/2732318133 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2f40107540 0x7f2f4019d460 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:16.604 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.601+0000 7f2f46095700 1 --2- 172.21.15.76:0/2732318133 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f40108730 0x7f2f4019d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:16.604 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.601+0000 7f2f46095700 1 -- 172.21.15.76:0/2732318133 >> 172.21.15.76:0/2732318133 conn(0x7f2f400764d0 msgr2=0x7f2f4010bb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:55:16.604 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.602+0000 7f2f46095700 1 -- 172.21.15.76:0/2732318133 shutdown_connections 2024-06-02T04:55:16.604 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:16.602+0000 7f2f46095700 1 -- 172.21.15.76:0/2732318133 wait complete. 2024-06-02T04:55:17.735 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:55:17 smithi076 ceph-mon[42935]: pgmap v439: 129 pgs: 129 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 8.3 MiB/s wr, 834 op/s 2024-06-02T04:55:17.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:55:17 smithi119 ceph-mon[46633]: pgmap v439: 129 pgs: 129 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 8.3 MiB/s wr, 834 op/s 2024-06-02T04:55:17.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:55:17 smithi192 ceph-mon[47933]: pgmap v439: 129 pgs: 129 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 8.3 MiB/s wr, 834 op/s 2024-06-02T04:55:19.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:55:19 smithi076 ceph-mon[42935]: pgmap v440: 129 pgs: 129 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 7.9 MiB/s wr, 780 op/s 2024-06-02T04:55:19.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:55:19 smithi119 ceph-mon[46633]: pgmap v440: 129 pgs: 129 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 7.9 MiB/s wr, 780 op/s 2024-06-02T04:55:19.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:55:19 smithi192 ceph-mon[47933]: pgmap v440: 129 pgs: 129 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 7.9 MiB/s wr, 780 op/s 2024-06-02T04:55:21.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 270.0 s, 899.1 tps, lat 111.566 ms stddev 37.024 2024-06-02T04:55:21.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:55:21 smithi076 ceph-mon[42935]: pgmap v441: 129 pgs: 129 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 8.6 MiB/s wr, 850 op/s 2024-06-02T04:55:21.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:55:21 smithi119 ceph-mon[46633]: pgmap v441: 129 pgs: 129 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 8.6 MiB/s wr, 850 op/s 2024-06-02T04:55:21.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:55:21 smithi192 ceph-mon[47933]: pgmap v441: 129 pgs: 129 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 8.6 MiB/s wr, 850 op/s 2024-06-02T04:55:23.735 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:55:23 smithi076 ceph-mon[42935]: pgmap v442: 129 pgs: 129 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 8.7 MiB/s wr, 818 op/s 2024-06-02T04:55:23.735 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:55:23 smithi076 ceph-mon[42935]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-06-02T04:55:23.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:55:23 smithi119 ceph-mon[46633]: pgmap v442: 129 pgs: 129 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 8.7 MiB/s wr, 818 op/s 2024-06-02T04:55:23.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:55:23 smithi119 ceph-mon[46633]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-06-02T04:55:23.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:55:23 smithi192 ceph-mon[47933]: pgmap v442: 129 pgs: 129 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 8.7 MiB/s wr, 818 op/s 2024-06-02T04:55:23.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:55:23 smithi192 ceph-mon[47933]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-06-02T04:55:25.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:55:25 smithi076 ceph-mon[42935]: pgmap v443: 129 pgs: 129 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 8.9 MiB/s wr, 772 op/s 2024-06-02T04:55:25.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:55:25 smithi119 ceph-mon[46633]: pgmap v443: 129 pgs: 129 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 8.9 MiB/s wr, 772 op/s 2024-06-02T04:55:25.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:55:25 smithi192 ceph-mon[47933]: pgmap v443: 129 pgs: 129 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 8.9 MiB/s wr, 772 op/s 2024-06-02T04:55:26.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 275.0 s, 968.3 tps, lat 103.217 ms stddev 37.492 2024-06-02T04:55:27.735 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:55:27 smithi076 ceph-mon[42935]: pgmap v444: 129 pgs: 129 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 11 MiB/s wr, 894 op/s 2024-06-02T04:55:27.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:55:27 smithi119 ceph-mon[46633]: pgmap v444: 129 pgs: 129 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 11 MiB/s wr, 894 op/s 2024-06-02T04:55:27.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:55:27 smithi192 ceph-mon[47933]: pgmap v444: 129 pgs: 129 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 11 MiB/s wr, 894 op/s 2024-06-02T04:55:28.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:55:28 smithi119 ceph-mon[46633]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-06-02T04:55:28.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:55:28 smithi119 ceph-mon[46633]: pgmap v445: 129 pgs: 129 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 12 MiB/s wr, 886 op/s 2024-06-02T04:55:28.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:55:28 smithi192 ceph-mon[47933]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-06-02T04:55:28.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:55:28 smithi192 ceph-mon[47933]: pgmap v445: 129 pgs: 129 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 12 MiB/s wr, 886 op/s 2024-06-02T04:55:28.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:55:28 smithi076 ceph-mon[42935]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-06-02T04:55:28.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:55:28 smithi076 ceph-mon[42935]: pgmap v445: 129 pgs: 129 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 12 MiB/s wr, 886 op/s 2024-06-02T04:55:29.778 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.775+0000 7fcb7fc38700 1 -- 172.21.15.76:0/2143381326 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcb780ff770 msgr2=0x7fcb780ffb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:55:29.778 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.775+0000 7fcb7fc38700 1 --2- 172.21.15.76:0/2143381326 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcb780ff770 0x7fcb780ffb90 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fcb70009990 tx=0x7fcb70009ca0 comp rx=0 tx=0).stop 2024-06-02T04:55:29.778 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.775+0000 7fcb7fc38700 1 -- 172.21.15.76:0/2143381326 shutdown_connections 2024-06-02T04:55:29.778 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.775+0000 7fcb7fc38700 1 --2- 172.21.15.76:0/2143381326 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcb78100a90 0x7fcb78100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:29.778 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.775+0000 7fcb7fc38700 1 --2- 172.21.15.76:0/2143381326 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcb780ff770 0x7fcb780ffb90 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:29.778 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.775+0000 7fcb7fc38700 1 --2- 172.21.15.76:0/2143381326 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcb781000d0 0x7fcb78100550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:29.778 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.775+0000 7fcb7fc38700 1 -- 172.21.15.76:0/2143381326 >> 172.21.15.76:0/2143381326 conn(0x7fcb780fb390 msgr2=0x7fcb780fd7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:55:29.779 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.775+0000 7fcb7fc38700 1 -- 172.21.15.76:0/2143381326 shutdown_connections 2024-06-02T04:55:29.779 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.776+0000 7fcb7fc38700 1 -- 172.21.15.76:0/2143381326 wait complete. 2024-06-02T04:55:29.779 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.776+0000 7fcb7fc38700 1 Processor -- start 2024-06-02T04:55:29.779 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.776+0000 7fcb7fc38700 1 -- start start 2024-06-02T04:55:29.779 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.776+0000 7fcb7fc38700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcb780ff770 0x7fcb78194bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:55:29.779 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.776+0000 7fcb7fc38700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcb781000d0 0x7fcb78195100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:55:29.779 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.776+0000 7fcb7fc38700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcb78100a90 0x7fcb7819c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:55:29.779 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.776+0000 7fcb7fc38700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb7819c6f0 con 0x7fcb780ff770 2024-06-02T04:55:29.779 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.776+0000 7fcb7fc38700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb7819c830 con 0x7fcb781000d0 2024-06-02T04:55:29.779 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.776+0000 7fcb7fc38700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb7819c9c0 con 0x7fcb78100a90 2024-06-02T04:55:29.779 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.777+0000 7fcb7d1d3700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcb781000d0 0x7fcb78195100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:55:29.780 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.777+0000 7fcb7d9d4700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcb780ff770 0x7fcb78194bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:55:29.780 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.777+0000 7fcb7d1d3700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcb781000d0 0x7fcb78195100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:42242/0 (socket says 172.21.15.76:42242) 2024-06-02T04:55:29.780 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.777+0000 7fcb7d1d3700 1 -- 172.21.15.76:0/3668584112 learned_addr learned my addr 172.21.15.76:0/3668584112 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:55:29.780 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.777+0000 7fcb7e1d5700 1 --2- 172.21.15.76:0/3668584112 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcb78100a90 0x7fcb7819c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:55:29.780 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.777+0000 7fcb7d1d3700 1 -- 172.21.15.76:0/3668584112 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcb78100a90 msgr2=0x7fcb7819c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:55:29.780 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.777+0000 7fcb7d1d3700 1 --2- 172.21.15.76:0/3668584112 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcb78100a90 0x7fcb7819c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:29.780 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.777+0000 7fcb7d1d3700 1 -- 172.21.15.76:0/3668584112 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcb780ff770 msgr2=0x7fcb78194bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:55:29.780 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.777+0000 7fcb7d1d3700 1 --2- 172.21.15.76:0/3668584112 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcb780ff770 0x7fcb78194bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:29.780 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.777+0000 7fcb7d1d3700 1 -- 172.21.15.76:0/3668584112 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb700095f0 con 0x7fcb781000d0 2024-06-02T04:55:29.780 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.777+0000 7fcb7d1d3700 1 --2- 172.21.15.76:0/3668584112 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcb781000d0 0x7fcb78195100 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fcb6800d950 tx=0x7fcb6800dc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:55:29.780 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.777+0000 7fcb6effd700 1 -- 172.21.15.76:0/3668584112 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb6800f890 con 0x7fcb781000d0 2024-06-02T04:55:29.781 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.777+0000 7fcb6effd700 1 -- 172.21.15.76:0/3668584112 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcb6800fe80 con 0x7fcb781000d0 2024-06-02T04:55:29.781 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.777+0000 7fcb6effd700 1 -- 172.21.15.76:0/3668584112 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb6800e3b0 con 0x7fcb781000d0 2024-06-02T04:55:29.781 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.777+0000 7fcb7fc38700 1 -- 172.21.15.76:0/3668584112 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb7819cca0 con 0x7fcb781000d0 2024-06-02T04:55:29.782 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.778+0000 7fcb7fc38700 1 -- 172.21.15.76:0/3668584112 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb7819d1b0 con 0x7fcb781000d0 2024-06-02T04:55:29.782 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.780+0000 7fcb6effd700 1 -- 172.21.15.76:0/3668584112 <== mon.2 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fcb6800f9f0 con 0x7fcb781000d0 2024-06-02T04:55:29.782 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.781+0000 7fcb6effd700 1 --2- 172.21.15.76:0/3668584112 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fcb640a9a00 0x7fcb640abec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:55:29.783 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.781+0000 7fcb6effd700 1 -- 172.21.15.76:0/3668584112 <== mon.2 v2:172.21.15.119:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7fcb680cc930 con 0x7fcb781000d0 2024-06-02T04:55:29.783 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.781+0000 7fcb7d9d4700 1 --2- 172.21.15.76:0/3668584112 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fcb640a9a00 0x7fcb640abec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:55:29.784 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.783+0000 7fcb8bdf3b80 1 Processor -- start 2024-06-02T04:55:29.784 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.783+0000 7fcb8bdf3b80 1 -- start start 2024-06-02T04:55:29.785 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.783+0000 7fcb7d9d4700 1 --2- 172.21.15.76:0/3668584112 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fcb640a9a00 0x7fcb640abec0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fcb70003780 tx=0x7fcb700058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:55:29.785 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.784+0000 7fcb8bdf3b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564ecd222a80 0x564ecd222ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:55:29.785 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.784+0000 7fcb8bdf3b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564ecd2233e0 0x564ecd223cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:55:29.785 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.784+0000 7fcb8bdf3b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564ecd2242d0 0x564ecd224750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:55:29.785 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.784+0000 7fcb8bdf3b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ecd17a0f0 con 0x564ecd2242d0 2024-06-02T04:55:29.785 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.784+0000 7fcb8bdf3b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ecd177ab0 con 0x564ecd2233e0 2024-06-02T04:55:29.786 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.784+0000 7fcb8bdf3b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ecd1733a0 con 0x564ecd222a80 2024-06-02T04:55:29.786 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.784+0000 7fcb7d1d3700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564ecd2233e0 0x564ecd223cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:55:29.786 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.784+0000 7fcb7d1d3700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564ecd2233e0 0x564ecd223cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:42250/0 (socket says 172.21.15.76:42250) 2024-06-02T04:55:29.786 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.784+0000 7fcb7d1d3700 1 -- 172.21.15.76:0/1147055910 learned_addr learned my addr 172.21.15.76:0/1147055910 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:55:29.786 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.784+0000 7fcb7d9d4700 1 --2- 172.21.15.76:0/1147055910 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564ecd222a80 0x564ecd222ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:55:29.786 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.784+0000 7fcb7d9d4700 1 -- 172.21.15.76:0/1147055910 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564ecd2233e0 msgr2=0x564ecd223cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:55:29.787 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.784+0000 7fcb7d9d4700 1 --2- 172.21.15.76:0/1147055910 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564ecd2233e0 0x564ecd223cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:29.787 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.784+0000 7fcb7d9d4700 1 -- 172.21.15.76:0/1147055910 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564ecd2242d0 msgr2=0x564ecd224750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:55:29.787 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.784+0000 7fcb7d9d4700 1 --2- 172.21.15.76:0/1147055910 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564ecd2242d0 0x564ecd224750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:29.787 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.785+0000 7fcb7d9d4700 1 -- 172.21.15.76:0/1147055910 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564eccff4350 con 0x564ecd222a80 2024-06-02T04:55:29.789 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.785+0000 7fcb7d9d4700 1 --2- 172.21.15.76:0/1147055910 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564ecd222a80 0x564ecd222ea0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fcb70006010 tx=0x7fcb70020000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=409142cbff2cfbcc server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:55:29.789 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.785+0000 7fcb63fff700 1 -- 172.21.15.76:0/1147055910 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb700056a0 con 0x564ecd222a80 2024-06-02T04:55:29.789 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.786+0000 7fcb63fff700 1 -- 172.21.15.76:0/1147055910 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcb7001e040 con 0x564ecd222a80 2024-06-02T04:55:29.789 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.786+0000 7fcb63fff700 1 -- 172.21.15.76:0/1147055910 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb70003a80 con 0x564ecd222a80 2024-06-02T04:55:29.789 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.787+0000 7fcb8bdf3b80 1 -- 172.21.15.76:0/1147055910 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564ecd222a80 msgr2=0x564ecd222ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:55:29.790 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.787+0000 7fcb8bdf3b80 1 --2- 172.21.15.76:0/1147055910 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564ecd222a80 0x564ecd222ea0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fcb70006010 tx=0x7fcb70020000 comp rx=0 tx=0).stop 2024-06-02T04:55:29.790 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.787+0000 7fcb8bdf3b80 1 -- 172.21.15.76:0/1147055910 shutdown_connections 2024-06-02T04:55:29.790 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.787+0000 7fcb8bdf3b80 1 --2- 172.21.15.76:0/1147055910 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564ecd2242d0 0x564ecd224750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:29.790 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.787+0000 7fcb8bdf3b80 1 --2- 172.21.15.76:0/1147055910 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564ecd222a80 0x564ecd222ea0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:29.790 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.787+0000 7fcb8bdf3b80 1 --2- 172.21.15.76:0/1147055910 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564ecd2233e0 0x564ecd223cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:29.790 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.787+0000 7fcb8bdf3b80 1 -- 172.21.15.76:0/1147055910 >> 172.21.15.76:0/1147055910 conn(0x564ecd1811b0 msgr2=0x564ecd21f440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:55:29.790 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.789+0000 7fcb8bdf3b80 1 -- 172.21.15.76:0/1147055910 shutdown_connections 2024-06-02T04:55:29.791 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.789+0000 7fcb8bdf3b80 1 -- 172.21.15.76:0/1147055910 wait complete. 2024-06-02T04:55:29.791 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.789+0000 7fcb8bdf3b80 1 -- start start 2024-06-02T04:55:29.791 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.789+0000 7fcb8bdf3b80 1 Processor -- start 2024-06-02T04:55:29.791 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.790+0000 7fcb8bdf3b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564ecd222a80 0x564ecd22c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:55:29.791 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.790+0000 7fcb8bdf3b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564ecd2233e0 0x564ecd22ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:55:29.791 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.790+0000 7fcb8bdf3b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564ecd2242d0 0x564ecd233e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:55:29.791 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.790+0000 7fcb8bdf3b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ecd10f500 con 0x564ecd2233e0 2024-06-02T04:55:29.791 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.790+0000 7fcb8bdf3b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ecd10f1a0 con 0x564ecd222a80 2024-06-02T04:55:29.792 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.790+0000 7fcb8bdf3b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x564eccff6640 con 0x564ecd2242d0 2024-06-02T04:55:29.792 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.790+0000 7fcb8bdf3b80 10 client.0 _ll_register_callbacks cb 0x564ecd118ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:55:29.792 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.790+0000 7fcb7e1d5700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564ecd2242d0 0x564ecd233e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:55:29.792 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.790+0000 7fcb7e1d5700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564ecd2242d0 0x564ecd233e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:60280/0 (socket says 172.21.15.76:60280) 2024-06-02T04:55:29.792 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.790+0000 7fcb7e1d5700 1 -- 172.21.15.76:0/1397623466 learned_addr learned my addr 172.21.15.76:0/1397623466 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:55:29.792 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.791+0000 7fcb7d9d4700 1 --2- 172.21.15.76:0/1397623466 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564ecd222a80 0x564ecd22c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:55:29.794 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.791+0000 7fcb7e1d5700 1 -- 172.21.15.76:0/1397623466 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564ecd222a80 msgr2=0x564ecd22c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:55:29.794 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.791+0000 7fcb7e1d5700 1 --2- 172.21.15.76:0/1397623466 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564ecd222a80 0x564ecd22c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:29.794 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.791+0000 7fcb7e1d5700 1 -- 172.21.15.76:0/1397623466 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564ecd2233e0 msgr2=0x564ecd22ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:55:29.794 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.791+0000 7fcb7e1d5700 1 --2- 172.21.15.76:0/1397623466 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564ecd2233e0 0x564ecd22ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:29.794 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.791+0000 7fcb7e1d5700 1 -- 172.21.15.76:0/1397623466 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb7810bf00 con 0x564ecd2242d0 2024-06-02T04:55:29.794 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.791+0000 7fcb7e1d5700 1 --2- 172.21.15.76:0/1397623466 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564ecd2242d0 0x564ecd233e40 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fcb74009f60 tx=0x7fcb74009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9030e47cb31020ef server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:55:29.794 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.791+0000 7fcb617fa700 10 client.0 ms_handle_connect on v2:172.21.15.192:3300/0 2024-06-02T04:55:29.794 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.791+0000 7fcb617fa700 1 -- 172.21.15.76:0/1397623466 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb74019070 con 0x564ecd2242d0 2024-06-02T04:55:29.795 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.791+0000 7fcb617fa700 1 -- 172.21.15.76:0/1397623466 <== mon.1 v2:172.21.15.192:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7fcb74004bb0 con 0x564ecd2242d0 2024-06-02T04:55:29.795 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.792+0000 7fcb8bdf3b80 1 -- 172.21.15.76:0/1397623466 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564ecd0cc210 con 0x564ecd2242d0 2024-06-02T04:55:29.795 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.792+0000 7fcb617fa700 1 -- 172.21.15.76:0/1397623466 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcb74003a90 con 0x564ecd2242d0 2024-06-02T04:55:29.795 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.792+0000 7fcb8bdf3b80 10 client.25651 fetch_fsmap learned FSMap version 34 2024-06-02T04:55:29.795 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.792+0000 7fcb8bdf3b80 1 -- 172.21.15.76:0/1397623466 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x564eccfa0b00 con 0x564ecd2242d0 2024-06-02T04:55:29.795 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.792+0000 7fcb617fa700 1 -- 172.21.15.76:0/1397623466 <== mon.1 v2:172.21.15.192:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x564ecd0cc210 con 0x564ecd2242d0 2024-06-02T04:55:29.795 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.793+0000 7fcb617fa700 1 -- 172.21.15.76:0/1397623466 <== mon.1 v2:172.21.15.192:3300/0 5 ==== fsmap(e 34) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fcb7401c020 con 0x564ecd2242d0 2024-06-02T04:55:29.795 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.793+0000 7fcb8bdf3b80 10 client.25651 fetch_fsmap finished waiting for FSMap version 34 2024-06-02T04:55:29.795 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.793+0000 7fcb8bdf3b80 10 client.25651 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T04:55:29.795 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.793+0000 7fcb8bdf3b80 20 client.25651 populate_metadata read hostname 'smithi076' 2024-06-02T04:55:29.795 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.793+0000 7fcb8bdf3b80 1 --2- 172.21.15.76:0/1397623466 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x564ecd249840 0x564ecd24bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:55:29.795 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.793+0000 7fcb8bdf3b80 4 client.25651 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T04:55:29.796 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.793+0000 7fcb8bdf3b80 1 -- 172.21.15.76:0/1397623466 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564ecd1f27b0 con 0x564ecd249840 2024-06-02T04:55:29.796 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.794+0000 7fcb7d9d4700 1 --2- 172.21.15.76:0/1397623466 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x564ecd249840 0x564ecd24bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:55:29.796 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.794+0000 7fcb7d9d4700 1 --2- 172.21.15.76:0/1397623466 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x564ecd249840 0x564ecd24bc60 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b56d8b838011a78 server_cookie=d2654810252a6ced in_seq=0 out_seq=0 2024-06-02T04:55:29.796 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.794+0000 7fcb617fa700 10 client.25651 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:55:29.797 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.795+0000 7fcb617fa700 1 -- 172.21.15.76:0/1397623466 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x564ecd1f27b0 con 0x564ecd249840 2024-06-02T04:55:29.797 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.795+0000 7fcb617fa700 10 client.25651 handle_command_reply: tid=0 2024-06-02T04:55:29.797 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.797+0000 7fcb8bdf3b80 1 client.25651 shutdown 2024-06-02T04:55:29.797 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.797+0000 7fcb8bdf3b80 1 -- 172.21.15.76:0/1397623466 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564ecd2242d0 msgr2=0x564ecd233e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:55:29.797 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.797+0000 7fcb8bdf3b80 1 --2- 172.21.15.76:0/1397623466 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564ecd2242d0 0x564ecd233e40 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fcb74009f60 tx=0x7fcb74009f90 comp rx=0 tx=0).stop 2024-06-02T04:55:29.798 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.797+0000 7fcb8bdf3b80 1 -- 172.21.15.76:0/1397623466 shutdown_connections 2024-06-02T04:55:29.798 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.797+0000 7fcb8bdf3b80 1 --2- 172.21.15.76:0/1397623466 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x564ecd249840 0x564ecd24bc60 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:29.798 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.797+0000 7fcb8bdf3b80 1 --2- 172.21.15.76:0/1397623466 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564ecd2242d0 0x564ecd233e40 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:29.798 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.797+0000 7fcb8bdf3b80 1 --2- 172.21.15.76:0/1397623466 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564ecd222a80 0x564ecd22c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:29.798 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.797+0000 7fcb8bdf3b80 1 --2- 172.21.15.76:0/1397623466 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564ecd2233e0 0x564ecd22ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:29.799 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.797+0000 7fcb8bdf3b80 1 -- 172.21.15.76:0/1397623466 >> 172.21.15.76:0/1397623466 conn(0x564ecd1811b0 msgr2=0x564ecd21d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:55:29.799 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.797+0000 7fcb617fa700 0 client.25651 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:55:29.799 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.797+0000 7fcb8bdf3b80 1 -- 172.21.15.76:0/1397623466 shutdown_connections 2024-06-02T04:55:29.799 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.797+0000 7fcb8bdf3b80 1 -- 172.21.15.76:0/1397623466 wait complete. 2024-06-02T04:55:29.799 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.798+0000 7fcb8bdf3b80 20 client.25651 trim_cache size 0 max 16384 2024-06-02T04:55:29.824 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.824+0000 7fcb8bdf3b80 1 Processor -- start 2024-06-02T04:55:29.825 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.824+0000 7fcb8bdf3b80 1 -- start start 2024-06-02T04:55:29.825 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.824+0000 7fcb8bdf3b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564ecd222a80 0x564ecd245500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:55:29.825 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.824+0000 7fcb8bdf3b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564ecd2233e0 0x564ecd233e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:55:29.825 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.824+0000 7fcb8bdf3b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564ecd2242d0 0x564ecd22bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:55:29.825 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.824+0000 7fcb8bdf3b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ecd2187c0 con 0x564ecd222a80 2024-06-02T04:55:29.825 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.824+0000 7fcb8bdf3b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ecd21a9b0 con 0x564ecd2233e0 2024-06-02T04:55:29.825 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.824+0000 7fcb8bdf3b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ecd245fd0 con 0x564ecd2242d0 2024-06-02T04:55:29.825 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.824+0000 7fcb7d1d3700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564ecd2233e0 0x564ecd233e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:55:29.825 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.824+0000 7fcb7d1d3700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564ecd2233e0 0x564ecd233e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:42272/0 (socket says 172.21.15.76:42272) 2024-06-02T04:55:29.825 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.824+0000 7fcb7d1d3700 1 -- 172.21.15.76:0/1623056460 learned_addr learned my addr 172.21.15.76:0/1623056460 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:55:29.825 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.824+0000 7fcb7e1d5700 1 --2- 172.21.15.76:0/1623056460 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564ecd2242d0 0x564ecd22bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:55:29.826 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.825+0000 7fcb7e1d5700 1 -- 172.21.15.76:0/1623056460 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564ecd2233e0 msgr2=0x564ecd233e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:55:29.826 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.825+0000 7fcb7e1d5700 1 --2- 172.21.15.76:0/1623056460 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564ecd2233e0 0x564ecd233e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:29.826 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.825+0000 7fcb7e1d5700 1 -- 172.21.15.76:0/1623056460 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564ecd222a80 msgr2=0x564ecd245500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:55:29.826 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.825+0000 7fcb7e1d5700 1 --2- 172.21.15.76:0/1623056460 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564ecd222a80 0x564ecd245500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:29.827 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.825+0000 7fcb7e1d5700 1 -- 172.21.15.76:0/1623056460 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564ecd139500 con 0x564ecd2242d0 2024-06-02T04:55:29.827 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.825+0000 7fcb7e1d5700 1 --2- 172.21.15.76:0/1623056460 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564ecd2242d0 0x564ecd22bdd0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fcb74002230 tx=0x7fcb74004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=10ee1340b8abe529 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:55:29.827 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.825+0000 7fcb6cda5700 1 -- 172.21.15.76:0/1623056460 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb74019070 con 0x564ecd2242d0 2024-06-02T04:55:29.827 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.825+0000 7fcb6cda5700 1 -- 172.21.15.76:0/1623056460 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcb7401a040 con 0x564ecd2242d0 2024-06-02T04:55:29.827 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.825+0000 7fcb6cda5700 1 -- 172.21.15.76:0/1623056460 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb74013c50 con 0x564ecd2242d0 2024-06-02T04:55:29.828 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.826+0000 7fcb8bdf3b80 1 -- 172.21.15.76:0/1623056460 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564ecd2242d0 msgr2=0x564ecd22bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:55:29.828 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.826+0000 7fcb8bdf3b80 1 --2- 172.21.15.76:0/1623056460 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564ecd2242d0 0x564ecd22bdd0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fcb74002230 tx=0x7fcb74004730 comp rx=0 tx=0).stop 2024-06-02T04:55:29.828 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.826+0000 7fcb8bdf3b80 1 -- 172.21.15.76:0/1623056460 shutdown_connections 2024-06-02T04:55:29.828 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.826+0000 7fcb8bdf3b80 1 --2- 172.21.15.76:0/1623056460 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564ecd2242d0 0x564ecd22bdd0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:29.828 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.826+0000 7fcb8bdf3b80 1 --2- 172.21.15.76:0/1623056460 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564ecd222a80 0x564ecd245500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:29.828 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.826+0000 7fcb8bdf3b80 1 --2- 172.21.15.76:0/1623056460 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564ecd2233e0 0x564ecd233e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:29.828 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.826+0000 7fcb8bdf3b80 1 -- 172.21.15.76:0/1623056460 >> 172.21.15.76:0/1623056460 conn(0x564ecd1811b0 msgr2=0x564ecd22a890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:55:29.828 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.827+0000 7fcb8bdf3b80 1 -- 172.21.15.76:0/1623056460 shutdown_connections 2024-06-02T04:55:29.828 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.827+0000 7fcb8bdf3b80 1 -- 172.21.15.76:0/1623056460 wait complete. 2024-06-02T04:55:29.828 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.827+0000 7fcb8bdf3b80 1 -- start start 2024-06-02T04:55:29.828 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.827+0000 7fcb8bdf3b80 1 Processor -- start 2024-06-02T04:55:29.829 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.828+0000 7fcb8bdf3b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564ecd222a80 0x564ecd231630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:55:29.829 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.828+0000 7fcb8bdf3b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564ecd2233e0 0x564ecd231b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:55:29.829 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.828+0000 7fcb8bdf3b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564ecd2242d0 0x564ecd232b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:55:29.829 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.828+0000 7fcb8bdf3b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ecd2330c0 con 0x564ecd2242d0 2024-06-02T04:55:29.829 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.828+0000 7fcb8bdf3b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ecd233230 con 0x564ecd2233e0 2024-06-02T04:55:29.830 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.828+0000 7fcb8bdf3b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ecd2333a0 con 0x564ecd222a80 2024-06-02T04:55:29.830 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.828+0000 7fcb8bdf3b80 10 client.0 _ll_register_callbacks cb 0x564ecd118ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:55:29.830 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.828+0000 7fcb7d9d4700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564ecd222a80 0x564ecd231630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:55:29.830 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.828+0000 7fcb7d9d4700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564ecd222a80 0x564ecd231630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:60290/0 (socket says 172.21.15.76:60290) 2024-06-02T04:55:29.830 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.828+0000 7fcb7d9d4700 1 -- 172.21.15.76:0/1810278976 learned_addr learned my addr 172.21.15.76:0/1810278976 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:55:29.830 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.828+0000 7fcb7d1d3700 1 --2- 172.21.15.76:0/1810278976 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564ecd2233e0 0x564ecd231b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:55:29.830 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.828+0000 7fcb7d9d4700 1 -- 172.21.15.76:0/1810278976 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564ecd2233e0 msgr2=0x564ecd231b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:55:29.830 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.828+0000 7fcb7d9d4700 1 --2- 172.21.15.76:0/1810278976 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564ecd2233e0 0x564ecd231b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:29.830 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.828+0000 7fcb7d9d4700 1 -- 172.21.15.76:0/1810278976 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564ecd2242d0 msgr2=0x564ecd232b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:55:29.830 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.828+0000 7fcb7d9d4700 1 --2- 172.21.15.76:0/1810278976 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564ecd2242d0 0x564ecd232b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:29.830 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.828+0000 7fcb7d9d4700 1 -- 172.21.15.76:0/1810278976 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564eccfa0b00 con 0x564ecd222a80 2024-06-02T04:55:29.831 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.828+0000 7fcb7d9d4700 1 --2- 172.21.15.76:0/1810278976 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564ecd222a80 0x564ecd231630 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fcb70009990 tx=0x7fcb70009ee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=953507fb446c65cb server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:55:29.831 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.828+0000 7fcb617fa700 10 client.0 ms_handle_connect on v2:172.21.15.192:3300/0 2024-06-02T04:55:29.832 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.829+0000 7fcb617fa700 1 -- 172.21.15.76:0/1810278976 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb70004700 con 0x564ecd222a80 2024-06-02T04:55:29.832 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.829+0000 7fcb617fa700 1 -- 172.21.15.76:0/1810278976 <== mon.1 v2:172.21.15.192:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7fcb70004860 con 0x564ecd222a80 2024-06-02T04:55:29.832 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.830+0000 7fcb8bdf3b80 1 -- 172.21.15.76:0/1810278976 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcb7001e040 con 0x564ecd222a80 2024-06-02T04:55:29.832 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.830+0000 7fcb617fa700 1 -- 172.21.15.76:0/1810278976 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcb70004a20 con 0x564ecd222a80 2024-06-02T04:55:29.832 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.831+0000 7fcb8bdf3b80 10 client.25657 fetch_fsmap learned FSMap version 34 2024-06-02T04:55:29.832 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.831+0000 7fcb8bdf3b80 1 -- 172.21.15.76:0/1810278976 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x564eccff8c70 con 0x564ecd222a80 2024-06-02T04:55:29.832 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.831+0000 7fcb617fa700 1 -- 172.21.15.76:0/1810278976 <== mon.1 v2:172.21.15.192:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcb7001e040 con 0x564ecd222a80 2024-06-02T04:55:29.832 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.831+0000 7fcb617fa700 1 -- 172.21.15.76:0/1810278976 <== mon.1 v2:172.21.15.192:3300/0 5 ==== fsmap(e 34) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fcb70047050 con 0x564ecd222a80 2024-06-02T04:55:29.832 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.831+0000 7fcb8bdf3b80 10 client.25657 fetch_fsmap finished waiting for FSMap version 34 2024-06-02T04:55:29.832 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.831+0000 7fcb8bdf3b80 10 client.25657 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T04:55:29.832 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.831+0000 7fcb8bdf3b80 20 client.25657 populate_metadata read hostname 'smithi076' 2024-06-02T04:55:29.832 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.831+0000 7fcb8bdf3b80 1 --2- 172.21.15.76:0/1810278976 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x564ecd2b1370 0x564ecd2b3790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:55:29.832 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.831+0000 7fcb8bdf3b80 4 client.25657 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T04:55:29.833 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.831+0000 7fcb8bdf3b80 1 -- 172.21.15.76:0/1810278976 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x564ecd16be60 con 0x564ecd2b1370 2024-06-02T04:55:29.833 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.831+0000 7fcb7d1d3700 1 --2- 172.21.15.76:0/1810278976 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x564ecd2b1370 0x564ecd2b3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:55:29.833 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.832+0000 7fcb617fa700 10 client.25657 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:55:29.833 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.832+0000 7fcb7d1d3700 1 --2- 172.21.15.76:0/1810278976 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x564ecd2b1370 0x564ecd2b3790 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d2a46e67080a0754 server_cookie=ea4514c0919a4395 in_seq=0 out_seq=0 2024-06-02T04:55:29.849 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.848+0000 7fcb617fa700 1 -- 172.21.15.76:0/1810278976 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x564ecd16be60 con 0x564ecd2b1370 2024-06-02T04:55:29.849 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.848+0000 7fcb617fa700 10 client.25657 handle_command_reply: tid=0 2024-06-02T04:55:29.849 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.848+0000 7fcb8bdf3b80 1 client.25657 shutdown 2024-06-02T04:55:29.849 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.848+0000 7fcb8bdf3b80 1 -- 172.21.15.76:0/1810278976 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564ecd222a80 msgr2=0x564ecd231630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:55:29.849 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.848+0000 7fcb8bdf3b80 1 --2- 172.21.15.76:0/1810278976 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564ecd222a80 0x564ecd231630 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fcb70009990 tx=0x7fcb70009ee0 comp rx=0 tx=0).stop 2024-06-02T04:55:29.849 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.849+0000 7fcb8bdf3b80 1 -- 172.21.15.76:0/1810278976 shutdown_connections 2024-06-02T04:55:29.850 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.849+0000 7fcb8bdf3b80 1 --2- 172.21.15.76:0/1810278976 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x564ecd2b1370 0x564ecd2b3790 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:29.850 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.849+0000 7fcb8bdf3b80 1 --2- 172.21.15.76:0/1810278976 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564ecd2242d0 0x564ecd232b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:29.850 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.849+0000 7fcb8bdf3b80 1 --2- 172.21.15.76:0/1810278976 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564ecd222a80 0x564ecd231630 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:29.850 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.849+0000 7fcb8bdf3b80 1 --2- 172.21.15.76:0/1810278976 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564ecd2233e0 0x564ecd231b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:29.850 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.849+0000 7fcb8bdf3b80 1 -- 172.21.15.76:0/1810278976 >> 172.21.15.76:0/1810278976 conn(0x564ecd1811b0 msgr2=0x564ecd22a820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:55:29.850 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.849+0000 7fcb617fa700 0 client.25657 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:55:29.850 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.849+0000 7fcb8bdf3b80 1 -- 172.21.15.76:0/1810278976 shutdown_connections 2024-06-02T04:55:29.850 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.849+0000 7fcb8bdf3b80 1 -- 172.21.15.76:0/1810278976 wait complete. 2024-06-02T04:55:29.851 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.850+0000 7fcb8bdf3b80 20 client.25657 trim_cache size 0 max 16384 2024-06-02T04:55:29.851 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:{ 2024-06-02T04:55:29.851 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "message": "", 2024-06-02T04:55:29.851 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "return_code": 0 2024-06-02T04:55:29.851 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:} 2024-06-02T04:55:29.852 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.850+0000 7fcb7fc38700 1 -- 172.21.15.76:0/3668584112 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fcb640a9a00 msgr2=0x7fcb640abec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:55:29.852 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.850+0000 7fcb7fc38700 1 --2- 172.21.15.76:0/3668584112 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fcb640a9a00 0x7fcb640abec0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fcb70003780 tx=0x7fcb700058e0 comp rx=0 tx=0).stop 2024-06-02T04:55:29.852 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.850+0000 7fcb7fc38700 1 -- 172.21.15.76:0/3668584112 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcb781000d0 msgr2=0x7fcb78195100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:55:29.852 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.850+0000 7fcb7fc38700 1 --2- 172.21.15.76:0/3668584112 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcb781000d0 0x7fcb78195100 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fcb6800d950 tx=0x7fcb6800dc60 comp rx=0 tx=0).stop 2024-06-02T04:55:29.852 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.850+0000 7fcb7fc38700 1 -- 172.21.15.76:0/3668584112 shutdown_connections 2024-06-02T04:55:29.852 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.850+0000 7fcb7fc38700 1 --2- 172.21.15.76:0/3668584112 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcb78100a90 0x7fcb7819c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:29.852 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.850+0000 7fcb7fc38700 1 --2- 172.21.15.76:0/3668584112 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcb780ff770 0x7fcb78194bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:29.852 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.850+0000 7fcb7fc38700 1 --2- 172.21.15.76:0/3668584112 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fcb640a9a00 0x7fcb640abec0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:29.852 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.850+0000 7fcb7fc38700 1 --2- 172.21.15.76:0/3668584112 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcb781000d0 0x7fcb78195100 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:29.852 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.851+0000 7fcb7fc38700 1 -- 172.21.15.76:0/3668584112 >> 172.21.15.76:0/3668584112 conn(0x7fcb780fb390 msgr2=0x7fcb780fcb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:55:29.853 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.851+0000 7fcb7fc38700 1 -- 172.21.15.76:0/3668584112 shutdown_connections 2024-06-02T04:55:29.853 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:29.851+0000 7fcb7fc38700 1 -- 172.21.15.76:0/3668584112 wait complete. 2024-06-02T04:55:31.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 280.0 s, 927.6 tps, lat 107.738 ms stddev 38.752 2024-06-02T04:55:31.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:55:31 smithi192 ceph-mon[47933]: pgmap v446: 129 pgs: 129 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 14 MiB/s wr, 961 op/s 2024-06-02T04:55:31.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:55:31 smithi076 ceph-mon[42935]: pgmap v446: 129 pgs: 129 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 14 MiB/s wr, 961 op/s 2024-06-02T04:55:31.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:55:31 smithi119 ceph-mon[46633]: pgmap v446: 129 pgs: 129 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 14 MiB/s wr, 961 op/s 2024-06-02T04:55:33.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:55:33 smithi192 ceph-mon[47933]: pgmap v447: 129 pgs: 129 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 14 MiB/s wr, 935 op/s 2024-06-02T04:55:33.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:55:33 smithi076 ceph-mon[42935]: pgmap v447: 129 pgs: 129 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 14 MiB/s wr, 935 op/s 2024-06-02T04:55:33.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:55:33 smithi119 ceph-mon[46633]: pgmap v447: 129 pgs: 129 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 14 MiB/s wr, 935 op/s 2024-06-02T04:55:35.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:55:35 smithi192 ceph-mon[47933]: pgmap v448: 129 pgs: 129 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 14 MiB/s wr, 885 op/s 2024-06-02T04:55:35.736 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:55:35 smithi076 ceph-mon[42935]: pgmap v448: 129 pgs: 129 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 14 MiB/s wr, 885 op/s 2024-06-02T04:55:35.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:55:35 smithi119 ceph-mon[46633]: pgmap v448: 129 pgs: 129 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 14 MiB/s wr, 885 op/s 2024-06-02T04:55:36.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 285.0 s, 933.2 tps, lat 106.965 ms stddev 39.757 2024-06-02T04:55:37.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:55:37 smithi192 ceph-mon[47933]: pgmap v449: 129 pgs: 129 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 15 MiB/s wr, 985 op/s 2024-06-02T04:55:37.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:55:37 smithi076 ceph-mon[42935]: pgmap v449: 129 pgs: 129 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 15 MiB/s wr, 985 op/s 2024-06-02T04:55:37.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:55:37 smithi119 ceph-mon[46633]: pgmap v449: 129 pgs: 129 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 15 MiB/s wr, 985 op/s 2024-06-02T04:55:39.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:55:39 smithi192 ceph-mon[47933]: pgmap v450: 129 pgs: 129 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 14 MiB/s wr, 937 op/s 2024-06-02T04:55:39.735 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:55:39 smithi076 ceph-mon[42935]: pgmap v450: 129 pgs: 129 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 14 MiB/s wr, 937 op/s 2024-06-02T04:55:39.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:55:39 smithi119 ceph-mon[46633]: pgmap v450: 129 pgs: 129 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 14 MiB/s wr, 937 op/s 2024-06-02T04:55:41.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 290.0 s, 963.2 tps, lat 104.157 ms stddev 39.662 2024-06-02T04:55:41.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:55:41 smithi192 ceph-mon[47933]: pgmap v451: 129 pgs: 129 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 14 MiB/s wr, 964 op/s 2024-06-02T04:55:41.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:55:41 smithi076 ceph-mon[42935]: pgmap v451: 129 pgs: 129 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 14 MiB/s wr, 964 op/s 2024-06-02T04:55:41.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:55:41 smithi119 ceph-mon[46633]: pgmap v451: 129 pgs: 129 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 14 MiB/s wr, 964 op/s 2024-06-02T04:55:43.320 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.307+0000 7f3461481700 1 -- 172.21.15.76:0/152302968 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f345c0ff770 msgr2=0x7f345c101ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:55:43.320 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.307+0000 7f3461481700 1 --2- 172.21.15.76:0/152302968 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f345c0ff770 0x7f345c101ba0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f344c009990 tx=0x7f344c009ca0 comp rx=0 tx=0).stop 2024-06-02T04:55:43.320 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.307+0000 7f3461481700 1 -- 172.21.15.76:0/152302968 shutdown_connections 2024-06-02T04:55:43.320 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.307+0000 7f3461481700 1 --2- 172.21.15.76:0/152302968 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f345c104ab0 0x7f345c104f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:43.320 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.307+0000 7f3461481700 1 --2- 172.21.15.76:0/152302968 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f345c0ff770 0x7f345c101ba0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:43.321 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.307+0000 7f3461481700 1 --2- 172.21.15.76:0/152302968 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f345c1020e0 0x7f345c104570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:43.321 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.307+0000 7f3461481700 1 -- 172.21.15.76:0/152302968 >> 172.21.15.76:0/152302968 conn(0x7f345c0fb390 msgr2=0x7f345c0fd7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:55:43.321 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.307+0000 7f3461481700 1 -- 172.21.15.76:0/152302968 shutdown_connections 2024-06-02T04:55:43.321 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.308+0000 7f3461481700 1 -- 172.21.15.76:0/152302968 wait complete. 2024-06-02T04:55:43.321 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.308+0000 7f3461481700 1 Processor -- start 2024-06-02T04:55:43.321 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.311+0000 7f3461481700 1 -- start start 2024-06-02T04:55:43.321 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.311+0000 7f3461481700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f345c0ff770 0x7f345c19d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:55:43.321 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.311+0000 7f3461481700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f345c1020e0 0x7f345c19d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:55:43.321 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.311+0000 7f3461481700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f345c104ab0 0x7f345c1a4920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:55:43.321 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.311+0000 7f3461481700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f345c1a4ef0 con 0x7f345c1020e0 2024-06-02T04:55:43.322 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.311+0000 7f3461481700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f345c1a5030 con 0x7f345c0ff770 2024-06-02T04:55:43.322 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.311+0000 7f3461481700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f345c1a51c0 con 0x7f345c104ab0 2024-06-02T04:55:43.322 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.311+0000 7f345b7fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f345c104ab0 0x7f345c1a4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:55:43.322 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.311+0000 7f345b7fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f345c104ab0 0x7f345c1a4920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:37238/0 (socket says 172.21.15.76:37238) 2024-06-02T04:55:43.322 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.311+0000 7f345b7fe700 1 -- 172.21.15.76:0/1445831821 learned_addr learned my addr 172.21.15.76:0/1445831821 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:55:43.322 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.311+0000 7f345a7fc700 1 --2- 172.21.15.76:0/1445831821 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f345c1020e0 0x7f345c19d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:55:43.322 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.311+0000 7f345b7fe700 1 -- 172.21.15.76:0/1445831821 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f345c0ff770 msgr2=0x7f345c19d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:55:43.322 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.311+0000 7f345b7fe700 1 --2- 172.21.15.76:0/1445831821 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f345c0ff770 0x7f345c19d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:43.322 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.311+0000 7f345b7fe700 1 -- 172.21.15.76:0/1445831821 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f345c1020e0 msgr2=0x7f345c19d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:55:43.323 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.311+0000 7f345b7fe700 1 --2- 172.21.15.76:0/1445831821 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f345c1020e0 0x7f345c19d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:43.323 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.311+0000 7f345b7fe700 1 -- 172.21.15.76:0/1445831821 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3454009c40 con 0x7f345c104ab0 2024-06-02T04:55:43.323 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.312+0000 7f345b7fe700 1 --2- 172.21.15.76:0/1445831821 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f345c104ab0 0x7f345c1a4920 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f345400c370 tx=0x7f345400c730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:55:43.323 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.312+0000 7f3443fff700 1 -- 172.21.15.76:0/1445831821 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3454017070 con 0x7f345c104ab0 2024-06-02T04:55:43.323 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.312+0000 7f3443fff700 1 -- 172.21.15.76:0/1445831821 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f345400f040 con 0x7f345c104ab0 2024-06-02T04:55:43.323 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.312+0000 7f3443fff700 1 -- 172.21.15.76:0/1445831821 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f345400e050 con 0x7f345c104ab0 2024-06-02T04:55:43.323 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.313+0000 7f3461481700 1 -- 172.21.15.76:0/1445831821 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f344c0095f0 con 0x7f345c104ab0 2024-06-02T04:55:43.323 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.313+0000 7f3461481700 1 -- 172.21.15.76:0/1445831821 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f345c1a5740 con 0x7f345c104ab0 2024-06-02T04:55:43.323 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.318+0000 7f346d63cb80 1 Processor -- start 2024-06-02T04:55:43.323 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.318+0000 7f346d63cb80 1 -- start start 2024-06-02T04:55:43.326 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.318+0000 7f346d63cb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5559c77d5a80 0x5559c77d5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:55:43.326 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.318+0000 7f346d63cb80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5559c77d63e0 0x5559c77d6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:55:43.326 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.318+0000 7f346d63cb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5559c77d72d0 0x5559c77d7750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:55:43.327 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.318+0000 7f346d63cb80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559c772d0f0 con 0x5559c77d63e0 2024-06-02T04:55:43.327 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.318+0000 7f346d63cb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559c772aab0 con 0x5559c77d5a80 2024-06-02T04:55:43.327 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.318+0000 7f346d63cb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559c77263a0 con 0x5559c77d72d0 2024-06-02T04:55:43.327 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.319+0000 7f345affd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5559c77d63e0 0x5559c77d6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:55:43.327 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.319+0000 7f345affd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5559c77d63e0 0x5559c77d6cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:46316/0 (socket says 172.21.15.76:46316) 2024-06-02T04:55:43.327 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.319+0000 7f345affd700 1 -- 172.21.15.76:0/2630963450 learned_addr learned my addr 172.21.15.76:0/2630963450 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:55:43.327 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.320+0000 7f345affd700 1 -- 172.21.15.76:0/2630963450 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5559c77d72d0 msgr2=0x5559c77d7750 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-02T04:55:43.327 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.320+0000 7f345affd700 1 --2- 172.21.15.76:0/2630963450 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5559c77d72d0 0x5559c77d7750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:43.327 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.320+0000 7f345affd700 1 -- 172.21.15.76:0/2630963450 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5559c77d5a80 msgr2=0x5559c77d5ea0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-02T04:55:43.327 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.320+0000 7f345affd700 1 --2- 172.21.15.76:0/2630963450 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5559c77d5a80 0x5559c77d5ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:43.327 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.320+0000 7f345affd700 1 -- 172.21.15.76:0/2630963450 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5559c75a7350 con 0x5559c77d63e0 2024-06-02T04:55:43.327 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.320+0000 7f345affd700 1 --2- 172.21.15.76:0/2630963450 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5559c77d63e0 0x5559c77d6cf0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f344c003f60 tx=0x7f344c009530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b06af6c3bb3983d server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:55:43.328 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.320+0000 7f34417fa700 1 -- 172.21.15.76:0/2630963450 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f344c004200 con 0x5559c77d63e0 2024-06-02T04:55:43.328 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.321+0000 7f34417fa700 1 -- 172.21.15.76:0/2630963450 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f344c02e070 con 0x5559c77d63e0 2024-06-02T04:55:43.328 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.321+0000 7f34417fa700 1 -- 172.21.15.76:0/2630963450 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f344c00bde0 con 0x5559c77d63e0 2024-06-02T04:55:43.328 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.321+0000 7f3443fff700 1 -- 172.21.15.76:0/1445831821 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f3454003a00 con 0x7f345c104ab0 2024-06-02T04:55:43.328 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.321+0000 7f346d63cb80 1 -- 172.21.15.76:0/2630963450 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5559c77d63e0 msgr2=0x5559c77d6cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:55:43.328 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.321+0000 7f346d63cb80 1 --2- 172.21.15.76:0/2630963450 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5559c77d63e0 0x5559c77d6cf0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f344c003f60 tx=0x7f344c009530 comp rx=0 tx=0).stop 2024-06-02T04:55:43.328 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.322+0000 7f3443fff700 1 --2- 172.21.15.76:0/1445831821 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f34440a1320 0x7f34440a37e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:55:43.328 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.322+0000 7f3443fff700 1 -- 172.21.15.76:0/1445831821 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f34540cc060 con 0x7f345c104ab0 2024-06-02T04:55:43.328 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.323+0000 7f346d63cb80 1 -- 172.21.15.76:0/2630963450 shutdown_connections 2024-06-02T04:55:43.328 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.323+0000 7f346d63cb80 1 --2- 172.21.15.76:0/2630963450 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5559c77d72d0 0x5559c77d7750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:43.328 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.323+0000 7f346d63cb80 1 --2- 172.21.15.76:0/2630963450 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5559c77d5a80 0x5559c77d5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:43.328 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.323+0000 7f346d63cb80 1 --2- 172.21.15.76:0/2630963450 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5559c77d63e0 0x5559c77d6cf0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:43.329 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.323+0000 7f346d63cb80 1 -- 172.21.15.76:0/2630963450 >> 172.21.15.76:0/2630963450 conn(0x5559c77341b0 msgr2=0x5559c77d2440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:55:43.329 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.323+0000 7f346d63cb80 1 -- 172.21.15.76:0/2630963450 shutdown_connections 2024-06-02T04:55:43.329 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.323+0000 7f346d63cb80 1 -- 172.21.15.76:0/2630963450 wait complete. 2024-06-02T04:55:43.329 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.323+0000 7f346d63cb80 1 -- start start 2024-06-02T04:55:43.329 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.323+0000 7f346d63cb80 1 Processor -- start 2024-06-02T04:55:43.329 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.324+0000 7f346d63cb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5559c77d5a80 0x5559c77df8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:55:43.329 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.324+0000 7f346d63cb80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5559c77d63e0 0x5559c77dfe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:55:43.329 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.324+0000 7f346d63cb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5559c77d72d0 0x5559c77e6e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:55:43.329 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.324+0000 7f346d63cb80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559c76c2500 con 0x5559c77d63e0 2024-06-02T04:55:43.329 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.324+0000 7f346d63cb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559c76c21a0 con 0x5559c77d5a80 2024-06-02T04:55:43.329 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.324+0000 7f346d63cb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559c75a9640 con 0x5559c77d72d0 2024-06-02T04:55:43.329 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.324+0000 7f346d63cb80 10 client.0 _ll_register_callbacks cb 0x5559c76cbad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:55:43.329 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.324+0000 7f345affd700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5559c77d5a80 0x5559c77df8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:55:43.330 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.324+0000 7f345b7fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5559c77d72d0 0x5559c77e6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:55:43.330 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.324+0000 7f345b7fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5559c77d72d0 0x5559c77e6e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:37254/0 (socket says 172.21.15.76:37254) 2024-06-02T04:55:43.330 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.324+0000 7f345affd700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5559c77d5a80 0x5559c77df8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:37410/0 (socket says 172.21.15.76:37410) 2024-06-02T04:55:43.330 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.324+0000 7f345b7fe700 1 -- 172.21.15.76:0/3426703068 learned_addr learned my addr 172.21.15.76:0/3426703068 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:55:43.330 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.325+0000 7f345a7fc700 1 --2- 172.21.15.76:0/1445831821 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f34440a1320 0x7f34440a37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:55:43.330 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.325+0000 7f345b7fe700 1 -- 172.21.15.76:0/3426703068 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5559c77d5a80 msgr2=0x5559c77df8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:55:43.330 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.325+0000 7f345b7fe700 1 --2- 172.21.15.76:0/3426703068 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5559c77d5a80 0x5559c77df8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:43.330 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.325+0000 7f345b7fe700 1 -- 172.21.15.76:0/3426703068 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5559c77d63e0 msgr2=0x5559c77dfe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:55:43.330 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.325+0000 7f345b7fe700 1 --2- 172.21.15.76:0/3426703068 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5559c77d63e0 0x5559c77dfe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:43.330 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.325+0000 7f345b7fe700 1 -- 172.21.15.76:0/3426703068 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f345c105a60 con 0x5559c77d72d0 2024-06-02T04:55:43.330 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.325+0000 7f345affd700 1 --2- 172.21.15.76:0/3426703068 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5559c77d5a80 0x5559c77df8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-06-02T04:55:43.331 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.325+0000 7f345b7fe700 1 --2- 172.21.15.76:0/3426703068 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5559c77d72d0 0x5559c77e6e40 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3454095b80 tx=0x7f3454099810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a2c6c80545d3149a server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:55:43.331 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.326+0000 7f343eff5700 10 client.0 ms_handle_connect on v2:172.21.15.192:3300/0 2024-06-02T04:55:43.331 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.326+0000 7f343eff5700 1 -- 172.21.15.76:0/3426703068 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34540a1590 con 0x5559c77d72d0 2024-06-02T04:55:43.331 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.326+0000 7f343eff5700 1 -- 172.21.15.76:0/3426703068 <== mon.1 v2:172.21.15.192:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f3454099370 con 0x5559c77d72d0 2024-06-02T04:55:43.331 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.326+0000 7f346d63cb80 1 -- 172.21.15.76:0/3426703068 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5559c767f210 con 0x5559c77d72d0 2024-06-02T04:55:43.331 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.326+0000 7f345a7fc700 1 --2- 172.21.15.76:0/1445831821 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f34440a1320 0x7f34440a37e0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x5559c77d6ab0 tx=0x7f3450009610 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:55:43.331 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.326+0000 7f343eff5700 1 -- 172.21.15.76:0/3426703068 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3454099530 con 0x5559c77d72d0 2024-06-02T04:55:43.332 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.327+0000 7f346d63cb80 10 client.25666 fetch_fsmap learned FSMap version 34 2024-06-02T04:55:43.332 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.327+0000 7f346d63cb80 1 -- 172.21.15.76:0/3426703068 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x5559c7553b00 con 0x5559c77d72d0 2024-06-02T04:55:43.332 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.327+0000 7f343eff5700 1 -- 172.21.15.76:0/3426703068 <== mon.1 v2:172.21.15.192:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5559c767f210 con 0x5559c77d72d0 2024-06-02T04:55:43.332 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.332+0000 7f343eff5700 1 -- 172.21.15.76:0/3426703068 <== mon.1 v2:172.21.15.192:3300/0 5 ==== fsmap(e 34) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f34540a1100 con 0x5559c77d72d0 2024-06-02T04:55:43.333 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.333+0000 7f346d63cb80 10 client.25666 fetch_fsmap finished waiting for FSMap version 34 2024-06-02T04:55:43.333 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.333+0000 7f346d63cb80 10 client.25666 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T04:55:43.333 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.333+0000 7f346d63cb80 20 client.25666 populate_metadata read hostname 'smithi076' 2024-06-02T04:55:43.333 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.333+0000 7f346d63cb80 1 --2- 172.21.15.76:0/3426703068 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5559c77eb6d0 0x5559c77edaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:55:43.333 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.333+0000 7f346d63cb80 4 client.25666 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T04:55:43.333 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.333+0000 7f346d63cb80 1 -- 172.21.15.76:0/3426703068 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5559c77a57b0 con 0x5559c77eb6d0 2024-06-02T04:55:43.334 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.333+0000 7f345affd700 1 --2- 172.21.15.76:0/3426703068 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5559c77eb6d0 0x5559c77edaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:55:43.334 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.333+0000 7f343eff5700 10 client.25666 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:55:43.334 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.333+0000 7f345affd700 1 --2- 172.21.15.76:0/3426703068 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5559c77eb6d0 0x5559c77edaf0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c1debafe04155ec6 server_cookie=49119e8723383992 in_seq=0 out_seq=0 2024-06-02T04:55:43.335 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.334+0000 7f343eff5700 1 -- 172.21.15.76:0/3426703068 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5559c77a57b0 con 0x5559c77eb6d0 2024-06-02T04:55:43.335 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.334+0000 7f343eff5700 10 client.25666 handle_command_reply: tid=0 2024-06-02T04:55:43.335 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.334+0000 7f346d63cb80 1 client.25666 shutdown 2024-06-02T04:55:43.335 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.334+0000 7f346d63cb80 1 -- 172.21.15.76:0/3426703068 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5559c77d72d0 msgr2=0x5559c77e6e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:55:43.335 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.334+0000 7f346d63cb80 1 --2- 172.21.15.76:0/3426703068 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5559c77d72d0 0x5559c77e6e40 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3454095b80 tx=0x7f3454099810 comp rx=0 tx=0).stop 2024-06-02T04:55:43.335 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.334+0000 7f346d63cb80 1 -- 172.21.15.76:0/3426703068 shutdown_connections 2024-06-02T04:55:43.336 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.334+0000 7f346d63cb80 1 --2- 172.21.15.76:0/3426703068 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5559c77eb6d0 0x5559c77edaf0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:43.336 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.334+0000 7f346d63cb80 1 --2- 172.21.15.76:0/3426703068 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5559c77d72d0 0x5559c77e6e40 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:43.336 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.334+0000 7f343eff5700 0 client.25666 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:55:43.336 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.334+0000 7f346d63cb80 1 --2- 172.21.15.76:0/3426703068 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5559c77d5a80 0x5559c77df8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:43.336 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.334+0000 7f346d63cb80 1 --2- 172.21.15.76:0/3426703068 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5559c77d63e0 0x5559c77dfe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:43.336 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.334+0000 7f346d63cb80 1 -- 172.21.15.76:0/3426703068 >> 172.21.15.76:0/3426703068 conn(0x5559c77341b0 msgr2=0x5559c77d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:55:43.336 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.335+0000 7f346d63cb80 1 -- 172.21.15.76:0/3426703068 shutdown_connections 2024-06-02T04:55:43.336 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.335+0000 7f346d63cb80 1 -- 172.21.15.76:0/3426703068 wait complete. 2024-06-02T04:55:43.336 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.336+0000 7f346d63cb80 20 client.25666 trim_cache size 0 max 16384 2024-06-02T04:55:43.359 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.359+0000 7f346d63cb80 1 Processor -- start 2024-06-02T04:55:43.360 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.359+0000 7f346d63cb80 1 -- start start 2024-06-02T04:55:43.361 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.359+0000 7f346d63cb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5559c77d5a80 0x5559c77e74f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:55:43.361 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.359+0000 7f346d63cb80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5559c77d63e0 0x5559c77e6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:55:43.361 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.359+0000 7f346d63cb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5559c77d72d0 0x5559c77d76b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:55:43.361 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.359+0000 7f346d63cb80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559c77d67c0 con 0x5559c77d63e0 2024-06-02T04:55:43.361 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.359+0000 7f346d63cb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559c77e7fc0 con 0x5559c77d72d0 2024-06-02T04:55:43.361 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.359+0000 7f346d63cb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559c77e08f0 con 0x5559c77d5a80 2024-06-02T04:55:43.361 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.360+0000 7f345affd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5559c77d5a80 0x5559c77e74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:55:43.361 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.360+0000 7f345b7fe700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5559c77d72d0 0x5559c77d76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:55:43.362 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.360+0000 7f345b7fe700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5559c77d72d0 0x5559c77d76b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:37426/0 (socket says 172.21.15.76:37426) 2024-06-02T04:55:43.362 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.360+0000 7f345b7fe700 1 -- 172.21.15.76:0/3068258115 learned_addr learned my addr 172.21.15.76:0/3068258115 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:55:43.362 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.360+0000 7f345affd700 1 -- 172.21.15.76:0/3068258115 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5559c77d72d0 msgr2=0x5559c77d76b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:55:43.362 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.360+0000 7f345affd700 1 --2- 172.21.15.76:0/3068258115 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5559c77d72d0 0x5559c77d76b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:43.362 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.360+0000 7f345affd700 1 -- 172.21.15.76:0/3068258115 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5559c77d63e0 msgr2=0x5559c77e6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:55:43.362 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.360+0000 7f345affd700 1 --2- 172.21.15.76:0/3068258115 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5559c77d63e0 0x5559c77e6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:43.362 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.360+0000 7f345affd700 1 -- 172.21.15.76:0/3068258115 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5559c76ec500 con 0x5559c77d5a80 2024-06-02T04:55:43.362 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.360+0000 7f345b7fe700 1 --2- 172.21.15.76:0/3068258115 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5559c77d72d0 0x5559c77d76b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T04:55:43.362 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.360+0000 7f345affd700 1 --2- 172.21.15.76:0/3068258115 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5559c77d5a80 0x5559c77e74f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f344c00b2e0 tx=0x7f344c000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c1c7c309bc8f9481 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:55:43.362 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.360+0000 7f3441ffb700 1 -- 172.21.15.76:0/3068258115 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f344c003680 con 0x5559c77d5a80 2024-06-02T04:55:43.362 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.360+0000 7f3441ffb700 1 -- 172.21.15.76:0/3068258115 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f344c003c70 con 0x5559c77d5a80 2024-06-02T04:55:43.362 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.360+0000 7f3441ffb700 1 -- 172.21.15.76:0/3068258115 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f344c03f0d0 con 0x5559c77d5a80 2024-06-02T04:55:43.363 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.361+0000 7f346d63cb80 1 -- 172.21.15.76:0/3068258115 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5559c77d5a80 msgr2=0x5559c77e74f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:55:43.364 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.361+0000 7f346d63cb80 1 --2- 172.21.15.76:0/3068258115 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5559c77d5a80 0x5559c77e74f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f344c00b2e0 tx=0x7f344c000bc0 comp rx=0 tx=0).stop 2024-06-02T04:55:43.364 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.362+0000 7f346d63cb80 1 -- 172.21.15.76:0/3068258115 shutdown_connections 2024-06-02T04:55:43.364 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.362+0000 7f346d63cb80 1 --2- 172.21.15.76:0/3068258115 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5559c77d72d0 0x5559c77d76b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:43.364 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.362+0000 7f346d63cb80 1 --2- 172.21.15.76:0/3068258115 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5559c77d5a80 0x5559c77e74f0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:43.364 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.362+0000 7f346d63cb80 1 --2- 172.21.15.76:0/3068258115 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5559c77d63e0 0x5559c77e6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:43.364 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.362+0000 7f346d63cb80 1 -- 172.21.15.76:0/3068258115 >> 172.21.15.76:0/3068258115 conn(0x5559c77341b0 msgr2=0x5559c77dd8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:55:43.364 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.362+0000 7f346d63cb80 1 -- 172.21.15.76:0/3068258115 shutdown_connections 2024-06-02T04:55:43.364 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.362+0000 7f346d63cb80 1 -- 172.21.15.76:0/3068258115 wait complete. 2024-06-02T04:55:43.364 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.362+0000 7f346d63cb80 1 -- start start 2024-06-02T04:55:43.364 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.362+0000 7f346d63cb80 1 Processor -- start 2024-06-02T04:55:43.365 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.363+0000 7f346d63cb80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5559c77d5a80 0x5559c77e3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:55:43.365 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.363+0000 7f346d63cb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5559c77d63e0 0x5559c77e4520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:55:43.365 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.363+0000 7f346d63cb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5559c77d72d0 0x5559c77e5350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:55:43.365 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.363+0000 7f346d63cb80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559c77e5890 con 0x5559c77d5a80 2024-06-02T04:55:43.365 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.363+0000 7f346d63cb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559c77e5a00 con 0x5559c77d72d0 2024-06-02T04:55:43.365 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.363+0000 7f346d63cb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559c77e5b70 con 0x5559c77d63e0 2024-06-02T04:55:43.365 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.363+0000 7f346d63cb80 10 client.0 _ll_register_callbacks cb 0x5559c76cbad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:55:43.365 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.363+0000 7f345a7fc700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5559c77d63e0 0x5559c77e4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:55:43.365 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.363+0000 7f345a7fc700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5559c77d63e0 0x5559c77e4520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:37266/0 (socket says 172.21.15.76:37266) 2024-06-02T04:55:43.365 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.363+0000 7f345a7fc700 1 -- 172.21.15.76:0/585968966 learned_addr learned my addr 172.21.15.76:0/585968966 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:55:43.365 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.363+0000 7f345b7fe700 1 --2- 172.21.15.76:0/585968966 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5559c77d72d0 0x5559c77e5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:55:43.367 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.363+0000 7f345affd700 1 --2- 172.21.15.76:0/585968966 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5559c77d5a80 0x5559c77e3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:55:43.367 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.364+0000 7f345b7fe700 1 -- 172.21.15.76:0/585968966 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5559c77d63e0 msgr2=0x5559c77e4520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:55:43.367 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.364+0000 7f345b7fe700 1 --2- 172.21.15.76:0/585968966 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5559c77d63e0 0x5559c77e4520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:43.367 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.364+0000 7f345b7fe700 1 -- 172.21.15.76:0/585968966 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5559c77d5a80 msgr2=0x5559c77e3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:55:43.368 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.364+0000 7f345b7fe700 1 --2- 172.21.15.76:0/585968966 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5559c77d5a80 0x5559c77e3fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:43.368 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.364+0000 7f345b7fe700 1 -- 172.21.15.76:0/585968966 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5559c7553b00 con 0x5559c77d72d0 2024-06-02T04:55:43.368 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.364+0000 7f345b7fe700 1 --2- 172.21.15.76:0/585968966 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5559c77d72d0 0x5559c77e5350 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f345409d0e0 tx=0x7f3454099930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=adddd136c4301cc9 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:55:43.368 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.364+0000 7f343eff5700 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-06-02T04:55:43.368 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.365+0000 7f343eff5700 1 -- 172.21.15.76:0/585968966 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3454098600 con 0x5559c77d72d0 2024-06-02T04:55:43.368 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.365+0000 7f343eff5700 1 -- 172.21.15.76:0/585968966 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f3454098760 con 0x5559c77d72d0 2024-06-02T04:55:43.368 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.365+0000 7f346d63cb80 1 -- 172.21.15.76:0/585968966 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f344c02e070 con 0x5559c77d72d0 2024-06-02T04:55:43.368 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.365+0000 7f343eff5700 1 -- 172.21.15.76:0/585968966 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3454004bd0 con 0x5559c77d72d0 2024-06-02T04:55:43.368 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.366+0000 7f346d63cb80 10 client.25733 fetch_fsmap learned FSMap version 34 2024-06-02T04:55:43.368 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.366+0000 7f346d63cb80 1 -- 172.21.15.76:0/585968966 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x7f344c037040 con 0x5559c77d72d0 2024-06-02T04:55:43.368 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.366+0000 7f343eff5700 1 -- 172.21.15.76:0/585968966 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f344c02e070 con 0x5559c77d72d0 2024-06-02T04:55:43.368 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.366+0000 7f343eff5700 1 -- 172.21.15.76:0/585968966 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 34) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f3454098070 con 0x5559c77d72d0 2024-06-02T04:55:43.369 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.366+0000 7f346d63cb80 10 client.25733 fetch_fsmap finished waiting for FSMap version 34 2024-06-02T04:55:43.369 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.366+0000 7f346d63cb80 10 client.25733 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T04:55:43.369 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.366+0000 7f346d63cb80 20 client.25733 populate_metadata read hostname 'smithi076' 2024-06-02T04:55:43.369 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.366+0000 7f346d63cb80 1 --2- 172.21.15.76:0/585968966 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5559c7852bd0 0x5559c7854fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:55:43.369 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.366+0000 7f346d63cb80 4 client.25733 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T04:55:43.369 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.366+0000 7f346d63cb80 1 -- 172.21.15.76:0/585968966 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5559c771ee60 con 0x5559c7852bd0 2024-06-02T04:55:43.369 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.366+0000 7f345affd700 1 --2- 172.21.15.76:0/585968966 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5559c7852bd0 0x5559c7854fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:55:43.369 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.367+0000 7f345affd700 1 --2- 172.21.15.76:0/585968966 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5559c7852bd0 0x5559c7854fc0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d00beb23bcc888a7 server_cookie=f1987edcdf038cd6 in_seq=0 out_seq=0 2024-06-02T04:55:43.369 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.367+0000 7f343eff5700 10 client.25733 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:55:43.388 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.387+0000 7f343eff5700 1 -- 172.21.15.76:0/585968966 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5559c771ee60 con 0x5559c7852bd0 2024-06-02T04:55:43.388 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.387+0000 7f343eff5700 10 client.25733 handle_command_reply: tid=0 2024-06-02T04:55:43.388 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.388+0000 7f346d63cb80 1 client.25733 shutdown 2024-06-02T04:55:43.389 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.388+0000 7f346d63cb80 1 -- 172.21.15.76:0/585968966 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5559c77d72d0 msgr2=0x5559c77e5350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:55:43.389 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.388+0000 7f346d63cb80 1 --2- 172.21.15.76:0/585968966 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5559c77d72d0 0x5559c77e5350 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f345409d0e0 tx=0x7f3454099930 comp rx=0 tx=0).stop 2024-06-02T04:55:43.390 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.388+0000 7f346d63cb80 1 -- 172.21.15.76:0/585968966 shutdown_connections 2024-06-02T04:55:43.390 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.388+0000 7f346d63cb80 1 --2- 172.21.15.76:0/585968966 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5559c7852bd0 0x5559c7854fc0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:43.390 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.388+0000 7f346d63cb80 1 --2- 172.21.15.76:0/585968966 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5559c77d72d0 0x5559c77e5350 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:43.390 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.388+0000 7f346d63cb80 1 --2- 172.21.15.76:0/585968966 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5559c77d5a80 0x5559c77e3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:43.390 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.388+0000 7f346d63cb80 1 --2- 172.21.15.76:0/585968966 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5559c77d63e0 0x5559c77e4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:43.390 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.388+0000 7f346d63cb80 1 -- 172.21.15.76:0/585968966 >> 172.21.15.76:0/585968966 conn(0x5559c77341b0 msgr2=0x5559c77d2020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:55:43.390 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.388+0000 7f343eff5700 0 client.25733 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:55:43.390 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.389+0000 7f346d63cb80 1 -- 172.21.15.76:0/585968966 shutdown_connections 2024-06-02T04:55:43.390 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.389+0000 7f346d63cb80 1 -- 172.21.15.76:0/585968966 wait complete. 2024-06-02T04:55:43.391 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.389+0000 7f346d63cb80 20 client.25733 trim_cache size 0 max 16384 2024-06-02T04:55:43.391 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:{ 2024-06-02T04:55:43.391 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "message": "", 2024-06-02T04:55:43.391 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "return_code": 0 2024-06-02T04:55:43.391 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:} 2024-06-02T04:55:43.392 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.389+0000 7f3461481700 1 -- 172.21.15.76:0/1445831821 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f34440a1320 msgr2=0x7f34440a37e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:55:43.392 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.389+0000 7f3461481700 1 --2- 172.21.15.76:0/1445831821 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f34440a1320 0x7f34440a37e0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x5559c77d6ab0 tx=0x7f3450009610 comp rx=0 tx=0).stop 2024-06-02T04:55:43.392 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.389+0000 7f3461481700 1 -- 172.21.15.76:0/1445831821 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f345c104ab0 msgr2=0x7f345c1a4920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:55:43.392 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.389+0000 7f3461481700 1 --2- 172.21.15.76:0/1445831821 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f345c104ab0 0x7f345c1a4920 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f345400c370 tx=0x7f345400c730 comp rx=0 tx=0).stop 2024-06-02T04:55:43.392 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.390+0000 7f3461481700 1 -- 172.21.15.76:0/1445831821 shutdown_connections 2024-06-02T04:55:43.392 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.390+0000 7f3461481700 1 --2- 172.21.15.76:0/1445831821 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f345c104ab0 0x7f345c1a4920 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:43.392 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.390+0000 7f3461481700 1 --2- 172.21.15.76:0/1445831821 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f34440a1320 0x7f34440a37e0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:43.392 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.390+0000 7f3461481700 1 --2- 172.21.15.76:0/1445831821 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f345c0ff770 0x7f345c19d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:43.392 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.390+0000 7f3461481700 1 --2- 172.21.15.76:0/1445831821 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f345c1020e0 0x7f345c19d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:43.392 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.390+0000 7f3461481700 1 -- 172.21.15.76:0/1445831821 >> 172.21.15.76:0/1445831821 conn(0x7f345c0fb390 msgr2=0x7f345c102c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:55:43.393 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.390+0000 7f3461481700 1 -- 172.21.15.76:0/1445831821 shutdown_connections 2024-06-02T04:55:43.393 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:43.390+0000 7f3461481700 1 -- 172.21.15.76:0/1445831821 wait complete. 2024-06-02T04:55:43.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:55:43 smithi192 ceph-mon[47933]: pgmap v452: 129 pgs: 129 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 14 MiB/s wr, 948 op/s 2024-06-02T04:55:43.749 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:55:43 smithi076 ceph-mon[42935]: pgmap v452: 129 pgs: 129 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 14 MiB/s wr, 948 op/s 2024-06-02T04:55:43.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:55:43 smithi119 ceph-mon[46633]: pgmap v452: 129 pgs: 129 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 14 MiB/s wr, 948 op/s 2024-06-02T04:55:45.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:55:45 smithi192 ceph-mon[47933]: pgmap v453: 129 pgs: 129 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 12 MiB/s wr, 862 op/s 2024-06-02T04:55:45.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:55:45 smithi076 ceph-mon[42935]: pgmap v453: 129 pgs: 129 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 12 MiB/s wr, 862 op/s 2024-06-02T04:55:45.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:55:45 smithi119 ceph-mon[46633]: pgmap v453: 129 pgs: 129 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 12 MiB/s wr, 862 op/s 2024-06-02T04:55:46.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 295.0 s, 901.0 tps, lat 110.763 ms stddev 40.798 2024-06-02T04:55:47.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:55:47 smithi192 ceph-mon[47933]: pgmap v454: 129 pgs: 129 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 14 MiB/s wr, 965 op/s 2024-06-02T04:55:47.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:55:47 smithi119 ceph-mon[46633]: pgmap v454: 129 pgs: 129 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 14 MiB/s wr, 965 op/s 2024-06-02T04:55:48.072 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:55:47 smithi076 ceph-mon[42935]: pgmap v454: 129 pgs: 129 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 14 MiB/s wr, 965 op/s 2024-06-02T04:55:49.736 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:55:49 smithi076 ceph-mon[42935]: pgmap v455: 129 pgs: 129 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 13 MiB/s wr, 912 op/s 2024-06-02T04:55:49.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:55:49 smithi119 ceph-mon[46633]: pgmap v455: 129 pgs: 129 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 13 MiB/s wr, 912 op/s 2024-06-02T04:55:49.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:55:49 smithi192 ceph-mon[47933]: pgmap v455: 129 pgs: 129 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 13 MiB/s wr, 912 op/s 2024-06-02T04:55:51.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 300.0 s, 872.2 tps, lat 114.736 ms stddev 45.161 2024-06-02T04:55:51.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:55:51 smithi076 ceph-mon[42935]: pgmap v456: 129 pgs: 129 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 13 MiB/s wr, 955 op/s 2024-06-02T04:55:51.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:55:51 smithi119 ceph-mon[46633]: pgmap v456: 129 pgs: 129 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 13 MiB/s wr, 955 op/s 2024-06-02T04:55:51.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:55:51 smithi192 ceph-mon[47933]: pgmap v456: 129 pgs: 129 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 13 MiB/s wr, 955 op/s 2024-06-02T04:55:53.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:55:53 smithi076 ceph-mon[42935]: pgmap v457: 129 pgs: 129 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 13 MiB/s wr, 930 op/s 2024-06-02T04:55:53.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:55:53 smithi119 ceph-mon[46633]: pgmap v457: 129 pgs: 129 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 13 MiB/s wr, 930 op/s 2024-06-02T04:55:53.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:55:53 smithi192 ceph-mon[47933]: pgmap v457: 129 pgs: 129 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 13 MiB/s wr, 930 op/s 2024-06-02T04:55:55.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:55:55 smithi076 ceph-mon[42935]: pgmap v458: 129 pgs: 129 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 11 MiB/s wr, 841 op/s 2024-06-02T04:55:55.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:55:55 smithi119 ceph-mon[46633]: pgmap v458: 129 pgs: 129 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 11 MiB/s wr, 841 op/s 2024-06-02T04:55:55.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:55:55 smithi192 ceph-mon[47933]: pgmap v458: 129 pgs: 129 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 11 MiB/s wr, 841 op/s 2024-06-02T04:55:56.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 305.0 s, 914.0 tps, lat 109.390 ms stddev 46.410 2024-06-02T04:55:57.735 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:55:57 smithi076 ceph-mon[42935]: pgmap v459: 129 pgs: 129 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 13 MiB/s wr, 954 op/s 2024-06-02T04:55:57.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:55:57 smithi119 ceph-mon[46633]: pgmap v459: 129 pgs: 129 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 13 MiB/s wr, 954 op/s 2024-06-02T04:55:57.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:55:57 smithi192 ceph-mon[47933]: pgmap v459: 129 pgs: 129 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 13 MiB/s wr, 954 op/s 2024-06-02T04:55:59.036 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.030+0000 7f704a5eb700 1 -- 172.21.15.76:0/3900588523 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70441008e0 msgr2=0x7f7044105180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:55:59.036 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.030+0000 7f704a5eb700 1 --2- 172.21.15.76:0/3900588523 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70441008e0 0x7f7044105180 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f70340098f0 tx=0x7f7034009c00 comp rx=0 tx=0).stop 2024-06-02T04:55:59.036 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.030+0000 7f704a5eb700 1 -- 172.21.15.76:0/3900588523 shutdown_connections 2024-06-02T04:55:59.036 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.030+0000 7f704a5eb700 1 --2- 172.21.15.76:0/3900588523 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70441008e0 0x7f7044105180 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:59.037 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.030+0000 7f704a5eb700 1 --2- 172.21.15.76:0/3900588523 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f70440ff1c0 0x7f70440ff5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:59.037 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.030+0000 7f704a5eb700 1 --2- 172.21.15.76:0/3900588523 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f70440fff20 0x7f70441003a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:59.037 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.030+0000 7f704a5eb700 1 -- 172.21.15.76:0/3900588523 >> 172.21.15.76:0/3900588523 conn(0x7f70440faaf0 msgr2=0x7f70440fcf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:55:59.037 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.030+0000 7f704a5eb700 1 -- 172.21.15.76:0/3900588523 shutdown_connections 2024-06-02T04:55:59.037 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.030+0000 7f704a5eb700 1 -- 172.21.15.76:0/3900588523 wait complete. 2024-06-02T04:55:59.037 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.031+0000 7f704a5eb700 1 Processor -- start 2024-06-02T04:55:59.037 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.033+0000 7f704a5eb700 1 -- start start 2024-06-02T04:55:59.037 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.034+0000 7f704a5eb700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f70440ff1c0 0x7f704410b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:55:59.038 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.034+0000 7f704a5eb700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70440fff20 0x7f704410baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:55:59.038 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.034+0000 7f704a5eb700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f70441008e0 0x7f70441ad510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:55:59.038 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.034+0000 7f704a5eb700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f704410c0c0 con 0x7f70440ff1c0 2024-06-02T04:55:59.038 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.034+0000 7f704a5eb700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f704410c200 con 0x7f70440fff20 2024-06-02T04:55:59.038 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.034+0000 7f704a5eb700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f704406a9f0 con 0x7f70441008e0 2024-06-02T04:55:59.038 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.034+0000 7f70437fe700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70440fff20 0x7f704410baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:55:59.038 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.034+0000 7f70437fe700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70440fff20 0x7f704410baf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:38814/0 (socket says 172.21.15.76:38814) 2024-06-02T04:55:59.038 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.034+0000 7f70437fe700 1 -- 172.21.15.76:0/773105357 learned_addr learned my addr 172.21.15.76:0/773105357 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:55:59.039 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.034+0000 7f7048b88700 1 --2- 172.21.15.76:0/773105357 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f70441008e0 0x7f70441ad510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:55:59.039 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.034+0000 7f7043fff700 1 --2- 172.21.15.76:0/773105357 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f70440ff1c0 0x7f704410b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:55:59.039 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.035+0000 7f70437fe700 1 -- 172.21.15.76:0/773105357 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f70441008e0 msgr2=0x7f70441ad510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:55:59.039 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.035+0000 7f70437fe700 1 --2- 172.21.15.76:0/773105357 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f70441008e0 0x7f70441ad510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:59.039 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.035+0000 7f70437fe700 1 -- 172.21.15.76:0/773105357 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f70440ff1c0 msgr2=0x7f704410b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:55:59.039 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.035+0000 7f70437fe700 1 --2- 172.21.15.76:0/773105357 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f70440ff1c0 0x7f704410b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:59.039 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.035+0000 7f70437fe700 1 -- 172.21.15.76:0/773105357 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7034009520 con 0x7f70440fff20 2024-06-02T04:55:59.040 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.035+0000 7f7043fff700 1 --2- 172.21.15.76:0/773105357 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f70440ff1c0 0x7f704410b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:55:59.040 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.035+0000 7f70437fe700 1 --2- 172.21.15.76:0/773105357 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70440fff20 0x7f704410baf0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f703000e9c0 tx=0x7f703000ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:55:59.041 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.035+0000 7f70417fa700 1 -- 172.21.15.76:0/773105357 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f703000cbd0 con 0x7f70440fff20 2024-06-02T04:55:59.041 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.035+0000 7f70417fa700 1 -- 172.21.15.76:0/773105357 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f703000eeb0 con 0x7f70440fff20 2024-06-02T04:55:59.041 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.035+0000 7f70417fa700 1 -- 172.21.15.76:0/773105357 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7030005440 con 0x7f70440fff20 2024-06-02T04:55:59.041 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.036+0000 7f704a5eb700 1 -- 172.21.15.76:0/773105357 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f704406ac70 con 0x7f70440fff20 2024-06-02T04:55:59.041 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.036+0000 7f704a5eb700 1 -- 172.21.15.76:0/773105357 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f704406b130 con 0x7f70440fff20 2024-06-02T04:55:59.042 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.040+0000 7f70417fa700 1 -- 172.21.15.76:0/773105357 <== mon.2 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f70300055a0 con 0x7f70440fff20 2024-06-02T04:55:59.042 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.041+0000 7f70417fa700 1 --2- 172.21.15.76:0/773105357 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f70280a1320 0x7f70280a37e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:55:59.042 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.041+0000 7f70417fa700 1 -- 172.21.15.76:0/773105357 <== mon.2 v2:172.21.15.119:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f7030014070 con 0x7f70440fff20 2024-06-02T04:55:59.042 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.041+0000 7f7043fff700 1 --2- 172.21.15.76:0/773105357 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f70280a1320 0x7f70280a37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:55:59.043 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.043+0000 7f7043fff700 1 --2- 172.21.15.76:0/773105357 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f70280a1320 0x7f70280a37e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f703c009fc0 tx=0x7f703c009550 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:55:59.061 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.060+0000 7f70567a6b80 1 Processor -- start 2024-06-02T04:55:59.061 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.060+0000 7f70567a6b80 1 -- start start 2024-06-02T04:55:59.063 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.060+0000 7f70567a6b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c50eaf1a80 0x55c50eaf1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:55:59.063 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.060+0000 7f70567a6b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c50eaf23e0 0x55c50eaf2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:55:59.063 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.060+0000 7f70567a6b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c50eaf32d0 0x55c50eaf3750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:55:59.063 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.060+0000 7f70567a6b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c50ea490f0 con 0x55c50eaf23e0 2024-06-02T04:55:59.064 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.060+0000 7f70567a6b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c50ea46ab0 con 0x55c50eaf32d0 2024-06-02T04:55:59.064 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.060+0000 7f70567a6b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c50ea423a0 con 0x55c50eaf1a80 2024-06-02T04:55:59.064 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.061+0000 7f7048b88700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c50eaf32d0 0x55c50eaf3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:55:59.064 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.061+0000 7f7048b88700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c50eaf32d0 0x55c50eaf3750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:38818/0 (socket says 172.21.15.76:38818) 2024-06-02T04:55:59.064 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.061+0000 7f7048b88700 1 -- 172.21.15.76:0/1167750100 learned_addr learned my addr 172.21.15.76:0/1167750100 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:55:59.064 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.061+0000 7f7043fff700 1 --2- 172.21.15.76:0/1167750100 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c50eaf1a80 0x55c50eaf1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:55:59.064 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.061+0000 7f70437fe700 1 --2- 172.21.15.76:0/1167750100 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c50eaf23e0 0x55c50eaf2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:55:59.065 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.061+0000 7f7048b88700 1 -- 172.21.15.76:0/1167750100 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c50eaf1a80 msgr2=0x55c50eaf1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:55:59.065 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.061+0000 7f7048b88700 1 --2- 172.21.15.76:0/1167750100 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c50eaf1a80 0x55c50eaf1ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:59.065 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.061+0000 7f7048b88700 1 -- 172.21.15.76:0/1167750100 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c50eaf23e0 msgr2=0x55c50eaf2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:55:59.065 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.061+0000 7f7048b88700 1 --2- 172.21.15.76:0/1167750100 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c50eaf23e0 0x55c50eaf2cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:59.065 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.061+0000 7f7048b88700 1 -- 172.21.15.76:0/1167750100 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c50e8c3350 con 0x55c50eaf32d0 2024-06-02T04:55:59.065 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.061+0000 7f7048b88700 1 --2- 172.21.15.76:0/1167750100 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c50eaf32d0 0x55c50eaf3750 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f70340098f0 tx=0x7f7034009f50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca4492398ea91116 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:55:59.065 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.061+0000 7f703a7fc700 1 -- 172.21.15.76:0/1167750100 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f703400f460 con 0x55c50eaf32d0 2024-06-02T04:55:59.071 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.063+0000 7f703a7fc700 1 -- 172.21.15.76:0/1167750100 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f703401d040 con 0x55c50eaf32d0 2024-06-02T04:55:59.071 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.063+0000 7f703a7fc700 1 -- 172.21.15.76:0/1167750100 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70340052a0 con 0x55c50eaf32d0 2024-06-02T04:55:59.071 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.064+0000 7f70567a6b80 1 -- 172.21.15.76:0/1167750100 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c50eaf32d0 msgr2=0x55c50eaf3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:55:59.071 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.064+0000 7f70567a6b80 1 --2- 172.21.15.76:0/1167750100 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c50eaf32d0 0x55c50eaf3750 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f70340098f0 tx=0x7f7034009f50 comp rx=0 tx=0).stop 2024-06-02T04:55:59.072 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.064+0000 7f70567a6b80 1 -- 172.21.15.76:0/1167750100 shutdown_connections 2024-06-02T04:55:59.072 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.064+0000 7f70567a6b80 1 --2- 172.21.15.76:0/1167750100 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c50eaf32d0 0x55c50eaf3750 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:59.072 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.064+0000 7f70567a6b80 1 --2- 172.21.15.76:0/1167750100 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c50eaf1a80 0x55c50eaf1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:59.072 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.064+0000 7f70567a6b80 1 --2- 172.21.15.76:0/1167750100 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c50eaf23e0 0x55c50eaf2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:59.072 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.064+0000 7f70567a6b80 1 -- 172.21.15.76:0/1167750100 >> 172.21.15.76:0/1167750100 conn(0x55c50ea501b0 msgr2=0x55c50eaee440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:55:59.072 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.069+0000 7f70567a6b80 1 -- 172.21.15.76:0/1167750100 shutdown_connections 2024-06-02T04:55:59.072 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.069+0000 7f70567a6b80 1 -- 172.21.15.76:0/1167750100 wait complete. 2024-06-02T04:55:59.073 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.070+0000 7f70567a6b80 1 -- start start 2024-06-02T04:55:59.073 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.070+0000 7f70567a6b80 1 Processor -- start 2024-06-02T04:55:59.073 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.070+0000 7f70567a6b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c50eaf1a80 0x55c50eafb840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:55:59.073 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.070+0000 7f70567a6b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c50eaf23e0 0x55c50eafbd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:55:59.073 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.070+0000 7f70567a6b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c50eaf32d0 0x55c50eb02dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:55:59.073 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.070+0000 7f70567a6b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c50e9de500 con 0x55c50eaf23e0 2024-06-02T04:55:59.073 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.070+0000 7f70567a6b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c50e9de1a0 con 0x55c50eaf1a80 2024-06-02T04:55:59.074 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.070+0000 7f70567a6b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c50e8c5640 con 0x55c50eaf32d0 2024-06-02T04:55:59.074 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.070+0000 7f70567a6b80 10 client.0 _ll_register_callbacks cb 0x55c50e9e7ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:55:59.074 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.071+0000 7f7043fff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c50eaf1a80 0x55c50eafb840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:55:59.074 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.071+0000 7f7043fff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c50eaf1a80 0x55c50eafb840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:38832/0 (socket says 172.21.15.76:38832) 2024-06-02T04:55:59.075 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.071+0000 7f7043fff700 1 -- 172.21.15.76:0/2645736613 learned_addr learned my addr 172.21.15.76:0/2645736613 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:55:59.075 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.071+0000 7f70437fe700 1 --2- 172.21.15.76:0/2645736613 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c50eaf23e0 0x55c50eafbd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:55:59.075 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.071+0000 7f7048b88700 1 --2- 172.21.15.76:0/2645736613 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c50eaf32d0 0x55c50eb02dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:55:59.075 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.071+0000 7f70437fe700 1 -- 172.21.15.76:0/2645736613 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c50eaf32d0 msgr2=0x55c50eb02dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:55:59.075 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.071+0000 7f70437fe700 1 --2- 172.21.15.76:0/2645736613 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c50eaf32d0 0x55c50eb02dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:59.075 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.071+0000 7f70437fe700 1 -- 172.21.15.76:0/2645736613 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c50eaf1a80 msgr2=0x55c50eafb840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:55:59.075 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.071+0000 7f70437fe700 1 --2- 172.21.15.76:0/2645736613 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c50eaf1a80 0x55c50eafb840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:59.075 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.071+0000 7f70437fe700 1 -- 172.21.15.76:0/2645736613 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7044105bb0 con 0x55c50eaf23e0 2024-06-02T04:55:59.075 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.072+0000 7f70437fe700 1 --2- 172.21.15.76:0/2645736613 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c50eaf23e0 0x55c50eafbd80 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f7030099e20 tx=0x7f7030099920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f97a4749afd78d2 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:55:59.076 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.073+0000 7f70277fe700 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-06-02T04:55:59.076 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.073+0000 7f70277fe700 1 -- 172.21.15.76:0/2645736613 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f703009aea0 con 0x55c50eaf23e0 2024-06-02T04:55:59.076 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.073+0000 7f70277fe700 1 -- 172.21.15.76:0/2645736613 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f703009dcc0 con 0x55c50eaf23e0 2024-06-02T04:55:59.076 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.073+0000 7f70567a6b80 1 -- 172.21.15.76:0/2645736613 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c50e99b210 con 0x55c50eaf23e0 2024-06-02T04:55:59.077 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.073+0000 7f70277fe700 1 -- 172.21.15.76:0/2645736613 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f70300b8250 con 0x55c50eaf23e0 2024-06-02T04:55:59.077 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.074+0000 7f70567a6b80 10 client.16182 fetch_fsmap learned FSMap version 34 2024-06-02T04:55:59.077 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.074+0000 7f70567a6b80 1 -- 172.21.15.76:0/2645736613 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55c50e86fb00 con 0x55c50eaf23e0 2024-06-02T04:55:59.077 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.074+0000 7f70277fe700 1 -- 172.21.15.76:0/2645736613 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55c50e99b210 con 0x55c50eaf23e0 2024-06-02T04:55:59.077 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.074+0000 7f70277fe700 1 -- 172.21.15.76:0/2645736613 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 34) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f7030099490 con 0x55c50eaf23e0 2024-06-02T04:55:59.077 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.074+0000 7f70567a6b80 10 client.16182 fetch_fsmap finished waiting for FSMap version 34 2024-06-02T04:55:59.077 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.074+0000 7f70567a6b80 10 client.16182 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T04:55:59.077 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.074+0000 7f70567a6b80 20 client.16182 populate_metadata read hostname 'smithi076' 2024-06-02T04:55:59.077 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.074+0000 7f70567a6b80 1 --2- 172.21.15.76:0/2645736613 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55c50eb295e0 0x55c50eb2ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:55:59.077 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.074+0000 7f70567a6b80 4 client.16182 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T04:55:59.077 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.074+0000 7f70567a6b80 1 -- 172.21.15.76:0/2645736613 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c50eac17b0 con 0x55c50eb295e0 2024-06-02T04:55:59.078 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.074+0000 7f7043fff700 1 --2- 172.21.15.76:0/2645736613 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55c50eb295e0 0x55c50eb2ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:55:59.078 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.076+0000 7f70277fe700 10 client.16182 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:55:59.078 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.076+0000 7f7043fff700 1 --2- 172.21.15.76:0/2645736613 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55c50eb295e0 0x55c50eb2ba00 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc277c2417f35e3e server_cookie=59fa496b15ec5cd2 in_seq=0 out_seq=0 2024-06-02T04:55:59.079 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.076+0000 7f70277fe700 1 -- 172.21.15.76:0/2645736613 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55c50eac17b0 con 0x55c50eb295e0 2024-06-02T04:55:59.079 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.076+0000 7f70277fe700 10 client.16182 handle_command_reply: tid=0 2024-06-02T04:55:59.079 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.076+0000 7f70567a6b80 1 client.16182 shutdown 2024-06-02T04:55:59.079 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.077+0000 7f70567a6b80 1 -- 172.21.15.76:0/2645736613 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c50eaf23e0 msgr2=0x55c50eafbd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:55:59.079 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.077+0000 7f70567a6b80 1 --2- 172.21.15.76:0/2645736613 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c50eaf23e0 0x55c50eafbd80 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f7030099e20 tx=0x7f7030099920 comp rx=0 tx=0).stop 2024-06-02T04:55:59.079 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.077+0000 7f70567a6b80 1 -- 172.21.15.76:0/2645736613 shutdown_connections 2024-06-02T04:55:59.079 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.077+0000 7f70567a6b80 1 --2- 172.21.15.76:0/2645736613 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55c50eb295e0 0x55c50eb2ba00 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:59.079 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.077+0000 7f70567a6b80 1 --2- 172.21.15.76:0/2645736613 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c50eaf32d0 0x55c50eb02dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:59.080 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.077+0000 7f70567a6b80 1 --2- 172.21.15.76:0/2645736613 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c50eaf1a80 0x55c50eafb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:59.080 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.077+0000 7f70567a6b80 1 --2- 172.21.15.76:0/2645736613 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c50eaf23e0 0x55c50eafbd80 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:59.080 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.077+0000 7f70567a6b80 1 -- 172.21.15.76:0/2645736613 >> 172.21.15.76:0/2645736613 conn(0x55c50ea501b0 msgr2=0x55c50eaec860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:55:59.080 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.077+0000 7f70277fe700 0 client.16182 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:55:59.080 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.078+0000 7f70567a6b80 1 -- 172.21.15.76:0/2645736613 shutdown_connections 2024-06-02T04:55:59.080 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.078+0000 7f70567a6b80 1 -- 172.21.15.76:0/2645736613 wait complete. 2024-06-02T04:55:59.080 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.078+0000 7f70567a6b80 20 client.16182 trim_cache size 0 max 16384 2024-06-02T04:55:59.110 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.109+0000 7f70567a6b80 1 Processor -- start 2024-06-02T04:55:59.110 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.110+0000 7f70567a6b80 1 -- start start 2024-06-02T04:55:59.111 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.110+0000 7f70567a6b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c50eaf1a80 0x55c50eaf36b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:55:59.111 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.110+0000 7f70567a6b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c50eaf23e0 0x55c50eb02d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:55:59.111 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.110+0000 7f70567a6b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c50eaf32d0 0x55c50eaf9860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:55:59.111 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.110+0000 7f70567a6b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c50eae7330 con 0x55c50eaf23e0 2024-06-02T04:55:59.111 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.110+0000 7f70567a6b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c50eafc740 con 0x55c50eaf32d0 2024-06-02T04:55:59.111 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.110+0000 7f70567a6b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c50eb26ae0 con 0x55c50eaf1a80 2024-06-02T04:55:59.113 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.110+0000 7f7048b88700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c50eaf32d0 0x55c50eaf9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:55:59.113 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.110+0000 7f7048b88700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c50eaf32d0 0x55c50eaf9860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:38836/0 (socket says 172.21.15.76:38836) 2024-06-02T04:55:59.113 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.110+0000 7f7048b88700 1 -- 172.21.15.76:0/2857412599 learned_addr learned my addr 172.21.15.76:0/2857412599 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:55:59.113 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.111+0000 7f7048b88700 1 -- 172.21.15.76:0/2857412599 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c50eaf1a80 msgr2=0x55c50eaf36b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-02T04:55:59.113 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.111+0000 7f7048b88700 1 --2- 172.21.15.76:0/2857412599 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c50eaf1a80 0x55c50eaf36b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:59.113 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.111+0000 7f7048b88700 1 -- 172.21.15.76:0/2857412599 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c50eaf23e0 msgr2=0x55c50eb02d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:55:59.113 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.111+0000 7f7048b88700 1 --2- 172.21.15.76:0/2857412599 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c50eaf23e0 0x55c50eb02d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:59.113 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.111+0000 7f7048b88700 1 -- 172.21.15.76:0/2857412599 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c50ea08500 con 0x55c50eaf32d0 2024-06-02T04:55:59.113 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.111+0000 7f7048b88700 1 --2- 172.21.15.76:0/2857412599 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c50eaf32d0 0x55c50eaf9860 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x55c50eaf2ab0 tx=0x7f703400f460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7365cd3a73740106 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:55:59.113 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.111+0000 7f703affd700 1 -- 172.21.15.76:0/2857412599 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70340050c0 con 0x55c50eaf32d0 2024-06-02T04:55:59.114 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.111+0000 7f703affd700 1 -- 172.21.15.76:0/2857412599 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f70340056b0 con 0x55c50eaf32d0 2024-06-02T04:55:59.114 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.111+0000 7f703affd700 1 -- 172.21.15.76:0/2857412599 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7034003680 con 0x55c50eaf32d0 2024-06-02T04:55:59.114 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.113+0000 7f70567a6b80 1 -- 172.21.15.76:0/2857412599 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c50eaf32d0 msgr2=0x55c50eaf9860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:55:59.114 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.113+0000 7f70567a6b80 1 --2- 172.21.15.76:0/2857412599 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c50eaf32d0 0x55c50eaf9860 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x55c50eaf2ab0 tx=0x7f703400f460 comp rx=0 tx=0).stop 2024-06-02T04:55:59.114 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.114+0000 7f70567a6b80 1 -- 172.21.15.76:0/2857412599 shutdown_connections 2024-06-02T04:55:59.115 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.114+0000 7f70567a6b80 1 --2- 172.21.15.76:0/2857412599 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c50eaf32d0 0x55c50eaf9860 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:59.115 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.114+0000 7f70567a6b80 1 --2- 172.21.15.76:0/2857412599 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c50eaf1a80 0x55c50eaf36b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:59.115 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.114+0000 7f70567a6b80 1 --2- 172.21.15.76:0/2857412599 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c50eaf23e0 0x55c50eb02d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:59.115 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.114+0000 7f70567a6b80 1 -- 172.21.15.76:0/2857412599 >> 172.21.15.76:0/2857412599 conn(0x55c50ea501b0 msgr2=0x55c50eafad50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:55:59.118 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.117+0000 7f70567a6b80 1 -- 172.21.15.76:0/2857412599 shutdown_connections 2024-06-02T04:55:59.122 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.119+0000 7f70567a6b80 1 -- 172.21.15.76:0/2857412599 wait complete. 2024-06-02T04:55:59.123 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.119+0000 7f70567a6b80 1 -- start start 2024-06-02T04:55:59.123 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.119+0000 7f70567a6b80 1 Processor -- start 2024-06-02T04:55:59.123 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.120+0000 7f70567a6b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c50eaf23e0 0x55c50eb00520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:55:59.123 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.120+0000 7f70567a6b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c50eaf32d0 0x55c50eb00a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:55:59.123 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.120+0000 7f70567a6b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c50eb01a70 0x55c50eb01ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:55:59.123 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.120+0000 7f70567a6b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c50eb02430 con 0x55c50eaf32d0 2024-06-02T04:55:59.123 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.120+0000 7f70567a6b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c50eb025a0 con 0x55c50eb01a70 2024-06-02T04:55:59.123 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.120+0000 7f70567a6b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c50eb02760 con 0x55c50eaf23e0 2024-06-02T04:55:59.123 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.120+0000 7f70567a6b80 10 client.0 _ll_register_callbacks cb 0x55c50e9e7ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:55:59.124 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.121+0000 7f7048b88700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c50eb01a70 0x55c50eb01ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:55:59.124 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.121+0000 7f7043fff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c50eaf23e0 0x55c50eb00520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:55:59.124 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.121+0000 7f7048b88700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c50eb01a70 0x55c50eb01ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:38850/0 (socket says 172.21.15.76:38850) 2024-06-02T04:55:59.124 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.121+0000 7f7048b88700 1 -- 172.21.15.76:0/2051897135 learned_addr learned my addr 172.21.15.76:0/2051897135 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:55:59.124 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.121+0000 7f7048b88700 1 -- 172.21.15.76:0/2051897135 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c50eaf23e0 msgr2=0x55c50eb00520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:55:59.124 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.121+0000 7f7048b88700 1 --2- 172.21.15.76:0/2051897135 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c50eaf23e0 0x55c50eb00520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:59.124 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.121+0000 7f7048b88700 1 -- 172.21.15.76:0/2051897135 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c50eaf32d0 msgr2=0x55c50eb00a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:55:59.125 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.121+0000 7f7048b88700 1 --2- 172.21.15.76:0/2051897135 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c50eaf32d0 0x55c50eb00a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:59.125 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.121+0000 7f7048b88700 1 -- 172.21.15.76:0/2051897135 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c50e8c3350 con 0x55c50eb01a70 2024-06-02T04:55:59.125 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.121+0000 7f7048b88700 1 --2- 172.21.15.76:0/2051897135 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c50eb01a70 0x55c50eb01ef0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f70340098f0 tx=0x7f703400f830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d00bc8d62b4a175 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:55:59.125 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.121+0000 7f70277fe700 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-06-02T04:55:59.125 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.122+0000 7f70277fe700 1 -- 172.21.15.76:0/2051897135 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70340054c0 con 0x55c50eb01a70 2024-06-02T04:55:59.125 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.122+0000 7f70277fe700 1 -- 172.21.15.76:0/2051897135 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f70340038b0 con 0x55c50eb01a70 2024-06-02T04:55:59.125 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.122+0000 7f70567a6b80 1 -- 172.21.15.76:0/2051897135 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f703401d040 con 0x55c50eb01a70 2024-06-02T04:55:59.125 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.122+0000 7f70277fe700 1 -- 172.21.15.76:0/2051897135 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7034003a90 con 0x55c50eb01a70 2024-06-02T04:55:59.127 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.127+0000 7f70567a6b80 10 client.25751 fetch_fsmap learned FSMap version 34 2024-06-02T04:55:59.127 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.127+0000 7f70567a6b80 1 -- 172.21.15.76:0/2051897135 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55c50e8c7c70 con 0x55c50eb01a70 2024-06-02T04:55:59.128 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.128+0000 7f70277fe700 1 -- 172.21.15.76:0/2051897135 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f703401d040 con 0x55c50eb01a70 2024-06-02T04:55:59.128 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.128+0000 7f70277fe700 1 -- 172.21.15.76:0/2051897135 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 34) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f703403b050 con 0x55c50eb01a70 2024-06-02T04:55:59.128 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.128+0000 7f70567a6b80 10 client.25751 fetch_fsmap finished waiting for FSMap version 34 2024-06-02T04:55:59.128 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.128+0000 7f70567a6b80 10 client.25751 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T04:55:59.128 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.128+0000 7f70567a6b80 20 client.25751 populate_metadata read hostname 'smithi076' 2024-06-02T04:55:59.129 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.128+0000 7f70567a6b80 1 --2- 172.21.15.76:0/2051897135 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55c50eb80390 0x55c50eb827b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:55:59.129 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.128+0000 7f70567a6b80 4 client.25751 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T04:55:59.129 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.128+0000 7f70567a6b80 1 -- 172.21.15.76:0/2051897135 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55c50ea3ae60 con 0x55c50eb80390 2024-06-02T04:55:59.129 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.129+0000 7f7043fff700 1 --2- 172.21.15.76:0/2051897135 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55c50eb80390 0x55c50eb827b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:55:59.130 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.130+0000 7f7043fff700 1 --2- 172.21.15.76:0/2051897135 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55c50eb80390 0x55c50eb827b0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d80516bf0c39632 server_cookie=8f654dc84a187417 in_seq=0 out_seq=0 2024-06-02T04:55:59.134 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.133+0000 7f70277fe700 10 client.25751 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:55:59.153 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.152+0000 7f70277fe700 1 -- 172.21.15.76:0/2051897135 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55c50ea3ae60 con 0x55c50eb80390 2024-06-02T04:55:59.153 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.152+0000 7f70277fe700 10 client.25751 handle_command_reply: tid=0 2024-06-02T04:55:59.154 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.152+0000 7f70567a6b80 1 client.25751 shutdown 2024-06-02T04:55:59.154 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.153+0000 7f70567a6b80 1 -- 172.21.15.76:0/2051897135 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c50eb01a70 msgr2=0x55c50eb01ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:55:59.154 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.153+0000 7f70567a6b80 1 --2- 172.21.15.76:0/2051897135 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c50eb01a70 0x55c50eb01ef0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f70340098f0 tx=0x7f703400f830 comp rx=0 tx=0).stop 2024-06-02T04:55:59.156 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.155+0000 7f70567a6b80 1 -- 172.21.15.76:0/2051897135 shutdown_connections 2024-06-02T04:55:59.156 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.155+0000 7f70567a6b80 1 --2- 172.21.15.76:0/2051897135 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55c50eb80390 0x55c50eb827b0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:59.156 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.155+0000 7f70567a6b80 1 --2- 172.21.15.76:0/2051897135 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c50eb01a70 0x55c50eb01ef0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:59.156 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.155+0000 7f70567a6b80 1 --2- 172.21.15.76:0/2051897135 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c50eaf23e0 0x55c50eb00520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:59.156 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.155+0000 7f70567a6b80 1 --2- 172.21.15.76:0/2051897135 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c50eaf32d0 0x55c50eb00a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:59.156 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.155+0000 7f70567a6b80 1 -- 172.21.15.76:0/2051897135 >> 172.21.15.76:0/2051897135 conn(0x55c50ea501b0 msgr2=0x55c50eaf6510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:55:59.157 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.155+0000 7f70277fe700 0 client.25751 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:55:59.157 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.155+0000 7f70567a6b80 1 -- 172.21.15.76:0/2051897135 shutdown_connections 2024-06-02T04:55:59.157 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.156+0000 7f70567a6b80 1 -- 172.21.15.76:0/2051897135 wait complete. 2024-06-02T04:55:59.158 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.157+0000 7f70567a6b80 20 client.25751 trim_cache size 0 max 16384 2024-06-02T04:55:59.158 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:{ 2024-06-02T04:55:59.158 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "message": "", 2024-06-02T04:55:59.158 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "return_code": 0 2024-06-02T04:55:59.159 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:} 2024-06-02T04:55:59.159 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.159+0000 7f704a5eb700 1 -- 172.21.15.76:0/773105357 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f70280a1320 msgr2=0x7f70280a37e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:55:59.159 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.159+0000 7f704a5eb700 1 --2- 172.21.15.76:0/773105357 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f70280a1320 0x7f70280a37e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f703c009fc0 tx=0x7f703c009550 comp rx=0 tx=0).stop 2024-06-02T04:55:59.159 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.159+0000 7f704a5eb700 1 -- 172.21.15.76:0/773105357 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70440fff20 msgr2=0x7f704410baf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:55:59.159 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.159+0000 7f704a5eb700 1 --2- 172.21.15.76:0/773105357 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70440fff20 0x7f704410baf0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f703000e9c0 tx=0x7f703000ecd0 comp rx=0 tx=0).stop 2024-06-02T04:55:59.160 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.159+0000 7f704a5eb700 1 -- 172.21.15.76:0/773105357 shutdown_connections 2024-06-02T04:55:59.160 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.159+0000 7f704a5eb700 1 --2- 172.21.15.76:0/773105357 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f70441008e0 0x7f70441ad510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:59.160 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.159+0000 7f704a5eb700 1 --2- 172.21.15.76:0/773105357 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f70440ff1c0 0x7f704410b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:59.160 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.159+0000 7f704a5eb700 1 --2- 172.21.15.76:0/773105357 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f70280a1320 0x7f70280a37e0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:59.161 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.159+0000 7f704a5eb700 1 --2- 172.21.15.76:0/773105357 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70440fff20 0x7f704410baf0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:55:59.161 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.159+0000 7f704a5eb700 1 -- 172.21.15.76:0/773105357 >> 172.21.15.76:0/773105357 conn(0x7f70440faaf0 msgr2=0x7f7044101160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:55:59.161 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.159+0000 7f704a5eb700 1 -- 172.21.15.76:0/773105357 shutdown_connections 2024-06-02T04:55:59.161 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:55:59.160+0000 7f704a5eb700 1 -- 172.21.15.76:0/773105357 wait complete. 2024-06-02T04:55:59.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:55:59 smithi076 ceph-mon[42935]: pgmap v460: 129 pgs: 129 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 11 MiB/s wr, 892 op/s 2024-06-02T04:55:59.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:55:59 smithi119 ceph-mon[46633]: pgmap v460: 129 pgs: 129 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 11 MiB/s wr, 892 op/s 2024-06-02T04:55:59.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:55:59 smithi192 ceph-mon[47933]: pgmap v460: 129 pgs: 129 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 11 MiB/s wr, 892 op/s 2024-06-02T04:56:01.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 310.0 s, 859.0 tps, lat 116.176 ms stddev 45.964 2024-06-02T04:56:01.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:56:01 smithi076 ceph-mon[42935]: pgmap v461: 129 pgs: 129 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 12 MiB/s wr, 950 op/s 2024-06-02T04:56:01.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:56:01 smithi119 ceph-mon[46633]: pgmap v461: 129 pgs: 129 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 12 MiB/s wr, 950 op/s 2024-06-02T04:56:01.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:56:01 smithi192 ceph-mon[47933]: pgmap v461: 129 pgs: 129 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 12 MiB/s wr, 950 op/s 2024-06-02T04:56:03.735 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:56:03 smithi076 ceph-mon[42935]: pgmap v462: 129 pgs: 129 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 11 MiB/s wr, 912 op/s 2024-06-02T04:56:03.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:56:03 smithi119 ceph-mon[46633]: pgmap v462: 129 pgs: 129 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 11 MiB/s wr, 912 op/s 2024-06-02T04:56:03.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:56:03 smithi192 ceph-mon[47933]: pgmap v462: 129 pgs: 129 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 11 MiB/s wr, 912 op/s 2024-06-02T04:56:05.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:56:05 smithi076 ceph-mon[42935]: pgmap v463: 129 pgs: 129 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 11 MiB/s wr, 856 op/s 2024-06-02T04:56:05.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:56:05 smithi119 ceph-mon[46633]: pgmap v463: 129 pgs: 129 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 11 MiB/s wr, 856 op/s 2024-06-02T04:56:05.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:56:05 smithi192 ceph-mon[47933]: pgmap v463: 129 pgs: 129 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 11 MiB/s wr, 856 op/s 2024-06-02T04:56:06.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 315.0 s, 902.6 tps, lat 111.010 ms stddev 42.518 2024-06-02T04:56:07.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:56:07 smithi076 ceph-mon[42935]: pgmap v464: 129 pgs: 129 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 12 MiB/s wr, 928 op/s 2024-06-02T04:56:07.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:56:07 smithi119 ceph-mon[46633]: pgmap v464: 129 pgs: 129 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 12 MiB/s wr, 928 op/s 2024-06-02T04:56:07.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:56:07 smithi192 ceph-mon[47933]: pgmap v464: 129 pgs: 129 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 12 MiB/s wr, 928 op/s 2024-06-02T04:56:09.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:56:09 smithi119 ceph-mon[46633]: pgmap v465: 129 pgs: 129 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 11 MiB/s wr, 871 op/s 2024-06-02T04:56:09.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:56:09 smithi192 ceph-mon[47933]: pgmap v465: 129 pgs: 129 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 11 MiB/s wr, 871 op/s 2024-06-02T04:56:09.986 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:56:09 smithi076 ceph-mon[42935]: pgmap v465: 129 pgs: 129 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 11 MiB/s wr, 871 op/s 2024-06-02T04:56:10.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:56:10 smithi119 ceph-mon[46633]: pgmap v466: 129 pgs: 129 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 11 MiB/s wr, 916 op/s 2024-06-02T04:56:10.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:56:10 smithi192 ceph-mon[47933]: pgmap v466: 129 pgs: 129 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 11 MiB/s wr, 916 op/s 2024-06-02T04:56:10.985 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:56:10 smithi076 ceph-mon[42935]: pgmap v466: 129 pgs: 129 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 11 MiB/s wr, 916 op/s 2024-06-02T04:56:11.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 320.0 s, 776.0 tps, lat 128.948 ms stddev 121.202 2024-06-02T04:56:11.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:56:11 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:56:11.985 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:56:11 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:56:12.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:56:11 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:56:12.350 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.349+0000 7faef3650700 1 -- 172.21.15.76:0/2689164198 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faeec101950 msgr2=0x7faeec108270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:56:12.350 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.349+0000 7faef3650700 1 --2- 172.21.15.76:0/2689164198 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faeec101950 0x7faeec108270 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7faee400d290 tx=0x7faee400d5a0 comp rx=0 tx=0).stop 2024-06-02T04:56:12.351 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.351+0000 7faef3650700 1 -- 172.21.15.76:0/2689164198 shutdown_connections 2024-06-02T04:56:12.351 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.351+0000 7faef3650700 1 --2- 172.21.15.76:0/2689164198 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faeec101950 0x7faeec108270 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:12.351 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.351+0000 7faef3650700 1 --2- 172.21.15.76:0/2689164198 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7faeec0ffe40 0x7faeec100260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:12.351 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.351+0000 7faef3650700 1 --2- 172.21.15.76:0/2689164198 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faeec100f90 0x7faeec101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:12.351 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.351+0000 7faef3650700 1 -- 172.21.15.76:0/2689164198 >> 172.21.15.76:0/2689164198 conn(0x7faeec0fb3b0 msgr2=0x7faeec0fd7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:56:12.357 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.357+0000 7faef3650700 1 -- 172.21.15.76:0/2689164198 shutdown_connections 2024-06-02T04:56:12.358 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.357+0000 7faef3650700 1 -- 172.21.15.76:0/2689164198 wait complete. 2024-06-02T04:56:12.358 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.358+0000 7faef3650700 1 Processor -- start 2024-06-02T04:56:12.360 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.358+0000 7faef3650700 1 -- start start 2024-06-02T04:56:12.360 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.358+0000 7faef3650700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faeec0ffe40 0x7faeec19d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:56:12.360 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.358+0000 7faef3650700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faeec100f90 0x7faeec19da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:56:12.360 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.358+0000 7faef3650700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7faeec101950 0x7faeec1a4a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:56:12.360 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.358+0000 7faef3650700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeec1a5020 con 0x7faeec101950 2024-06-02T04:56:12.360 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.358+0000 7faef3650700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeec06a9c0 con 0x7faeec0ffe40 2024-06-02T04:56:12.361 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.358+0000 7faef3650700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeec06ab50 con 0x7faeec100f90 2024-06-02T04:56:12.361 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.359+0000 7faef0beb700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faeec100f90 0x7faeec19da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:56:12.361 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.359+0000 7faef0beb700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faeec100f90 0x7faeec19da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:38860/0 (socket says 172.21.15.76:38860) 2024-06-02T04:56:12.361 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.359+0000 7faef0beb700 1 -- 172.21.15.76:0/1999432466 learned_addr learned my addr 172.21.15.76:0/1999432466 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:56:12.361 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.359+0000 7faef13ec700 1 --2- 172.21.15.76:0/1999432466 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faeec0ffe40 0x7faeec19d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:56:12.361 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.359+0000 7faef1bed700 1 --2- 172.21.15.76:0/1999432466 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7faeec101950 0x7faeec1a4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:56:12.361 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.359+0000 7faef13ec700 1 -- 172.21.15.76:0/1999432466 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faeec100f90 msgr2=0x7faeec19da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:56:12.361 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.359+0000 7faef13ec700 1 --2- 172.21.15.76:0/1999432466 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faeec100f90 0x7faeec19da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:12.361 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.359+0000 7faef13ec700 1 -- 172.21.15.76:0/1999432466 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7faeec101950 msgr2=0x7faeec1a4a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:56:12.361 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.359+0000 7faef13ec700 1 --2- 172.21.15.76:0/1999432466 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7faeec101950 0x7faeec1a4a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:12.361 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.359+0000 7faef13ec700 1 -- 172.21.15.76:0/1999432466 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faee4009c40 con 0x7faeec0ffe40 2024-06-02T04:56:12.361 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.359+0000 7faef13ec700 1 --2- 172.21.15.76:0/1999432466 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faeec0ffe40 0x7faeec19d4f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7faee8009950 tx=0x7faee8009c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:56:12.363 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.362+0000 7faee27fc700 1 -- 172.21.15.76:0/1999432466 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee800e700 con 0x7faeec0ffe40 2024-06-02T04:56:12.363 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.362+0000 7faee27fc700 1 -- 172.21.15.76:0/1999432466 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7faee800ecf0 con 0x7faeec0ffe40 2024-06-02T04:56:12.363 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.362+0000 7faee27fc700 1 -- 172.21.15.76:0/1999432466 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee8017d10 con 0x7faeec0ffe40 2024-06-02T04:56:12.363 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.363+0000 7faef3650700 1 -- 172.21.15.76:0/1999432466 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faeec06ae30 con 0x7faeec0ffe40 2024-06-02T04:56:12.363 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.363+0000 7faef3650700 1 -- 172.21.15.76:0/1999432466 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faeec06b2f0 con 0x7faeec0ffe40 2024-06-02T04:56:12.369 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.368+0000 7faeff80bb80 1 Processor -- start 2024-06-02T04:56:12.370 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.369+0000 7faee27fc700 1 -- 172.21.15.76:0/1999432466 <== mon.2 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7faee8021440 con 0x7faeec0ffe40 2024-06-02T04:56:12.370 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.369+0000 7faee27fc700 1 --2- 172.21.15.76:0/1999432466 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7faed80a1270 0x7faed80a3730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:56:12.370 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.370+0000 7faee27fc700 1 -- 172.21.15.76:0/1999432466 <== mon.2 v2:172.21.15.119:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7faee80cc590 con 0x7faeec0ffe40 2024-06-02T04:56:12.372 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.370+0000 7faeff80bb80 1 -- start start 2024-06-02T04:56:12.372 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.370+0000 7faeff80bb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e664ba6a80 0x55e664ba6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:56:12.372 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.370+0000 7faeff80bb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e664ba73e0 0x55e664ba7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:56:12.372 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.370+0000 7faeff80bb80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e664ba82d0 0x55e664ba8750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:56:12.372 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.370+0000 7faeff80bb80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e664afe0f0 con 0x55e664ba82d0 2024-06-02T04:56:12.372 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.370+0000 7faeff80bb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e664afbab0 con 0x55e664ba6a80 2024-06-02T04:56:12.372 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.370+0000 7faeff80bb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e664af73a0 con 0x55e664ba73e0 2024-06-02T04:56:12.372 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.371+0000 7faef13ec700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e664ba6a80 0x55e664ba6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:56:12.372 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.371+0000 7faef13ec700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e664ba6a80 0x55e664ba6ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:43086/0 (socket says 172.21.15.76:43086) 2024-06-02T04:56:12.373 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.371+0000 7faef13ec700 1 -- 172.21.15.76:0/1842702534 learned_addr learned my addr 172.21.15.76:0/1842702534 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:56:12.373 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.371+0000 7faef0beb700 1 --2- 172.21.15.76:0/1842702534 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e664ba73e0 0x55e664ba7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:56:12.373 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.371+0000 7faef13ec700 1 -- 172.21.15.76:0/1842702534 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e664ba73e0 msgr2=0x55e664ba7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:56:12.373 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.371+0000 7faef13ec700 1 --2- 172.21.15.76:0/1842702534 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e664ba73e0 0x55e664ba7cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:12.373 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.371+0000 7faef13ec700 1 -- 172.21.15.76:0/1842702534 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e664ba82d0 msgr2=0x55e664ba8750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:56:12.373 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.371+0000 7faef13ec700 1 --2- 172.21.15.76:0/1842702534 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e664ba82d0 0x55e664ba8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:12.373 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.371+0000 7faef13ec700 1 -- 172.21.15.76:0/1842702534 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e664978350 con 0x55e664ba6a80 2024-06-02T04:56:12.373 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.371+0000 7faef13ec700 1 --2- 172.21.15.76:0/1842702534 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e664ba6a80 0x55e664ba6ea0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7faee8096ad0 tx=0x7faee80962d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5557d9a11fc3a9ad server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:56:12.373 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.371+0000 7faed77fe700 1 -- 172.21.15.76:0/1842702534 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee8099f30 con 0x55e664ba6a80 2024-06-02T04:56:12.373 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.371+0000 7faed77fe700 1 -- 172.21.15.76:0/1842702534 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7faee8017410 con 0x55e664ba6a80 2024-06-02T04:56:12.373 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.371+0000 7faed77fe700 1 -- 172.21.15.76:0/1842702534 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee80a2a50 con 0x55e664ba6a80 2024-06-02T04:56:12.374 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.373+0000 7faeff80bb80 1 -- 172.21.15.76:0/1842702534 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e664ba6a80 msgr2=0x55e664ba6ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:56:12.374 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.373+0000 7faeff80bb80 1 --2- 172.21.15.76:0/1842702534 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e664ba6a80 0x55e664ba6ea0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7faee8096ad0 tx=0x7faee80962d0 comp rx=0 tx=0).stop 2024-06-02T04:56:12.374 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.373+0000 7faeff80bb80 1 -- 172.21.15.76:0/1842702534 shutdown_connections 2024-06-02T04:56:12.374 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.373+0000 7faeff80bb80 1 --2- 172.21.15.76:0/1842702534 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e664ba82d0 0x55e664ba8750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:12.374 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.373+0000 7faeff80bb80 1 --2- 172.21.15.76:0/1842702534 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e664ba6a80 0x55e664ba6ea0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:12.374 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.373+0000 7faeff80bb80 1 --2- 172.21.15.76:0/1842702534 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e664ba73e0 0x55e664ba7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:12.374 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.373+0000 7faeff80bb80 1 -- 172.21.15.76:0/1842702534 >> 172.21.15.76:0/1842702534 conn(0x55e664b051b0 msgr2=0x55e664ba3440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:56:12.377 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.376+0000 7faef1bed700 1 --2- 172.21.15.76:0/1999432466 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7faed80a1270 0x7faed80a3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:56:12.377 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.376+0000 7faef1bed700 1 --2- 172.21.15.76:0/1999432466 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7faed80a1270 0x7faed80a3730 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7faee400d970 tx=0x7faee400d5a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:56:12.378 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.377+0000 7faeff80bb80 1 -- 172.21.15.76:0/1842702534 shutdown_connections 2024-06-02T04:56:12.378 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.377+0000 7faeff80bb80 1 -- 172.21.15.76:0/1842702534 wait complete. 2024-06-02T04:56:12.378 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.378+0000 7faeff80bb80 1 -- start start 2024-06-02T04:56:12.378 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.378+0000 7faeff80bb80 1 Processor -- start 2024-06-02T04:56:12.381 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.378+0000 7faeff80bb80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e664ba6a80 0x55e664bc18a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:56:12.382 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.378+0000 7faeff80bb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e664ba73e0 0x55e664bc1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:56:12.382 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.378+0000 7faeff80bb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e664ba82d0 0x55e664bc8e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:56:12.382 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.378+0000 7faeff80bb80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e664a93500 con 0x55e664ba6a80 2024-06-02T04:56:12.382 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.378+0000 7faeff80bb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e664a931a0 con 0x55e664ba82d0 2024-06-02T04:56:12.382 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.378+0000 7faeff80bb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e66497a640 con 0x55e664ba73e0 2024-06-02T04:56:12.382 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.378+0000 7faeff80bb80 10 client.0 _ll_register_callbacks cb 0x55e664a9cad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:56:12.382 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.379+0000 7faef1bed700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e664ba82d0 0x55e664bc8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:56:12.382 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.379+0000 7faef1bed700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e664ba82d0 0x55e664bc8e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:43094/0 (socket says 172.21.15.76:43094) 2024-06-02T04:56:12.382 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.379+0000 7faef1bed700 1 -- 172.21.15.76:0/2913321309 learned_addr learned my addr 172.21.15.76:0/2913321309 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:56:12.382 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.379+0000 7faef0beb700 1 --2- 172.21.15.76:0/2913321309 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e664ba73e0 0x55e664bc1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:56:12.382 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.379+0000 7faef13ec700 1 --2- 172.21.15.76:0/2913321309 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e664ba6a80 0x55e664bc18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:56:12.383 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.379+0000 7faef1bed700 1 -- 172.21.15.76:0/2913321309 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e664ba73e0 msgr2=0x55e664bc1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:56:12.383 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.379+0000 7faef1bed700 1 --2- 172.21.15.76:0/2913321309 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e664ba73e0 0x55e664bc1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:12.383 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.379+0000 7faef1bed700 1 -- 172.21.15.76:0/2913321309 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e664ba6a80 msgr2=0x55e664bc18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:56:12.383 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.379+0000 7faef1bed700 1 --2- 172.21.15.76:0/2913321309 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e664ba6a80 0x55e664bc18a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:12.383 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.379+0000 7faef1bed700 1 -- 172.21.15.76:0/2913321309 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faeec06b2f0 con 0x55e664ba82d0 2024-06-02T04:56:12.383 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.379+0000 7faef13ec700 1 --2- 172.21.15.76:0/2913321309 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e664ba6a80 0x55e664bc18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:56:12.383 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.379+0000 7faef1bed700 1 --2- 172.21.15.76:0/2913321309 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e664ba82d0 0x55e664bc8e20 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7faee4007fd0 tx=0x7faee4007c70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3bfccf1db510f981 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:56:12.383 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.379+0000 7faed4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-06-02T04:56:12.383 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.379+0000 7faed4ff9700 1 -- 172.21.15.76:0/2913321309 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee40050e0 con 0x55e664ba82d0 2024-06-02T04:56:12.383 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.379+0000 7faed4ff9700 1 -- 172.21.15.76:0/2913321309 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7faee4005240 con 0x55e664ba82d0 2024-06-02T04:56:12.383 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.379+0000 7faeff80bb80 1 -- 172.21.15.76:0/2913321309 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e664a50210 con 0x55e664ba82d0 2024-06-02T04:56:12.383 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.379+0000 7faed4ff9700 1 -- 172.21.15.76:0/2913321309 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7faee4005400 con 0x55e664ba82d0 2024-06-02T04:56:12.383 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.379+0000 7faeff80bb80 10 client.25763 fetch_fsmap learned FSMap version 34 2024-06-02T04:56:12.384 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.380+0000 7faeff80bb80 1 -- 172.21.15.76:0/2913321309 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55e664924b00 con 0x55e664ba82d0 2024-06-02T04:56:12.384 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.380+0000 7faed4ff9700 1 -- 172.21.15.76:0/2913321309 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7faee4037080 con 0x55e664ba82d0 2024-06-02T04:56:12.384 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.380+0000 7faed4ff9700 1 -- 172.21.15.76:0/2913321309 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 34) v1 ==== 7478+0+0 (secure 0 0 0) 0x7faee4023a80 con 0x55e664ba82d0 2024-06-02T04:56:12.384 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.380+0000 7faeff80bb80 10 client.25763 fetch_fsmap finished waiting for FSMap version 34 2024-06-02T04:56:12.384 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.380+0000 7faeff80bb80 10 client.25763 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T04:56:12.384 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.380+0000 7faeff80bb80 20 client.25763 populate_metadata read hostname 'smithi076' 2024-06-02T04:56:12.384 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.380+0000 7faeff80bb80 1 --2- 172.21.15.76:0/2913321309 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55e664bcd7c0 0x55e664bcfbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:56:12.384 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.380+0000 7faeff80bb80 4 client.25763 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T04:56:12.384 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.380+0000 7faeff80bb80 1 -- 172.21.15.76:0/2913321309 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e664b767b0 con 0x55e664bcd7c0 2024-06-02T04:56:12.384 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.380+0000 7faef13ec700 1 --2- 172.21.15.76:0/2913321309 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55e664bcd7c0 0x55e664bcfbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:56:12.384 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.381+0000 7faed4ff9700 10 client.25763 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:56:12.384 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.381+0000 7faef13ec700 1 --2- 172.21.15.76:0/2913321309 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55e664bcd7c0 0x55e664bcfbe0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d1b25936e138567c server_cookie=6651c0bae9431841 in_seq=0 out_seq=0 2024-06-02T04:56:12.384 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.381+0000 7faed4ff9700 1 -- 172.21.15.76:0/2913321309 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55e664b767b0 con 0x55e664bcd7c0 2024-06-02T04:56:12.385 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.381+0000 7faed4ff9700 10 client.25763 handle_command_reply: tid=0 2024-06-02T04:56:12.385 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.381+0000 7faeff80bb80 1 client.25763 shutdown 2024-06-02T04:56:12.386 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.385+0000 7faeff80bb80 1 -- 172.21.15.76:0/2913321309 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e664ba82d0 msgr2=0x55e664bc8e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:56:12.386 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.385+0000 7faeff80bb80 1 --2- 172.21.15.76:0/2913321309 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e664ba82d0 0x55e664bc8e20 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7faee4007fd0 tx=0x7faee4007c70 comp rx=0 tx=0).stop 2024-06-02T04:56:12.386 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.385+0000 7faeff80bb80 1 -- 172.21.15.76:0/2913321309 shutdown_connections 2024-06-02T04:56:12.386 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.385+0000 7faeff80bb80 1 --2- 172.21.15.76:0/2913321309 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55e664bcd7c0 0x55e664bcfbe0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:12.386 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.385+0000 7faeff80bb80 1 --2- 172.21.15.76:0/2913321309 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e664ba82d0 0x55e664bc8e20 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:12.386 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.385+0000 7faeff80bb80 1 --2- 172.21.15.76:0/2913321309 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e664ba6a80 0x55e664bc18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:12.387 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.385+0000 7faeff80bb80 1 --2- 172.21.15.76:0/2913321309 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e664ba73e0 0x55e664bc1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:12.387 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.385+0000 7faeff80bb80 1 -- 172.21.15.76:0/2913321309 >> 172.21.15.76:0/2913321309 conn(0x55e664b051b0 msgr2=0x55e664ba1860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:56:12.387 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.385+0000 7faed4ff9700 0 client.25763 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:56:12.387 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.386+0000 7faeff80bb80 1 -- 172.21.15.76:0/2913321309 shutdown_connections 2024-06-02T04:56:12.387 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.386+0000 7faeff80bb80 1 -- 172.21.15.76:0/2913321309 wait complete. 2024-06-02T04:56:12.387 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.387+0000 7faeff80bb80 20 client.25763 trim_cache size 0 max 16384 2024-06-02T04:56:12.412 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.411+0000 7faeff80bb80 1 Processor -- start 2024-06-02T04:56:12.412 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.411+0000 7faeff80bb80 1 -- start start 2024-06-02T04:56:12.412 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.411+0000 7faeff80bb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e664ba6a80 0x55e664bcfbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:56:12.412 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.411+0000 7faeff80bb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e664ba73e0 0x55e664bc0db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:56:12.412 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.411+0000 7faeff80bb80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e664ba82d0 0x55e664ba86b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:56:12.412 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.411+0000 7faeff80bb80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e664bc03a0 con 0x55e664ba82d0 2024-06-02T04:56:12.412 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.411+0000 7faeff80bb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e664bc9fa0 con 0x55e664ba6a80 2024-06-02T04:56:12.412 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.411+0000 7faeff80bb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e664bc1410 con 0x55e664ba73e0 2024-06-02T04:56:12.413 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.412+0000 7faef13ec700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e664ba6a80 0x55e664bcfbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:56:12.413 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.412+0000 7faef0beb700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e664ba73e0 0x55e664bc0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:56:12.413 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.412+0000 7faef13ec700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e664ba6a80 0x55e664bcfbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:43110/0 (socket says 172.21.15.76:43110) 2024-06-02T04:56:12.413 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.412+0000 7faef13ec700 1 -- 172.21.15.76:0/643726227 learned_addr learned my addr 172.21.15.76:0/643726227 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:56:12.413 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.412+0000 7faef13ec700 1 -- 172.21.15.76:0/643726227 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e664ba73e0 msgr2=0x55e664bc0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:56:12.414 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.412+0000 7faef13ec700 1 --2- 172.21.15.76:0/643726227 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e664ba73e0 0x55e664bc0db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:12.414 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.412+0000 7faef13ec700 1 -- 172.21.15.76:0/643726227 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e664ba82d0 msgr2=0x55e664ba86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:56:12.414 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.412+0000 7faef13ec700 1 --2- 172.21.15.76:0/643726227 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e664ba82d0 0x55e664ba86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:12.414 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.412+0000 7faef13ec700 1 -- 172.21.15.76:0/643726227 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e664abd500 con 0x55e664ba6a80 2024-06-02T04:56:12.414 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.412+0000 7faef13ec700 1 --2- 172.21.15.76:0/643726227 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e664ba6a80 0x55e664bcfbb0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7faee8097040 tx=0x7faee8023040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8a50d267573deee server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:56:12.414 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.413+0000 7faed7fff700 1 -- 172.21.15.76:0/643726227 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee807f070 con 0x55e664ba6a80 2024-06-02T04:56:12.414 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.413+0000 7faed7fff700 1 -- 172.21.15.76:0/643726227 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7faee809a650 con 0x55e664ba6a80 2024-06-02T04:56:12.414 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.413+0000 7faed7fff700 1 -- 172.21.15.76:0/643726227 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee8098710 con 0x55e664ba6a80 2024-06-02T04:56:12.415 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.414+0000 7faeff80bb80 1 -- 172.21.15.76:0/643726227 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e664ba6a80 msgr2=0x55e664bcfbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:56:12.415 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.414+0000 7faeff80bb80 1 --2- 172.21.15.76:0/643726227 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e664ba6a80 0x55e664bcfbb0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7faee8097040 tx=0x7faee8023040 comp rx=0 tx=0).stop 2024-06-02T04:56:12.415 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.414+0000 7faeff80bb80 1 -- 172.21.15.76:0/643726227 shutdown_connections 2024-06-02T04:56:12.415 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.414+0000 7faeff80bb80 1 --2- 172.21.15.76:0/643726227 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e664ba82d0 0x55e664ba86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:12.415 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.414+0000 7faeff80bb80 1 --2- 172.21.15.76:0/643726227 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e664ba6a80 0x55e664bcfbb0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:12.415 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.414+0000 7faeff80bb80 1 --2- 172.21.15.76:0/643726227 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e664ba73e0 0x55e664bc0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:12.415 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.414+0000 7faeff80bb80 1 -- 172.21.15.76:0/643726227 >> 172.21.15.76:0/643726227 conn(0x55e664b051b0 msgr2=0x55e664bae7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:56:12.415 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.414+0000 7faeff80bb80 1 -- 172.21.15.76:0/643726227 shutdown_connections 2024-06-02T04:56:12.415 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.414+0000 7faeff80bb80 1 -- 172.21.15.76:0/643726227 wait complete. 2024-06-02T04:56:12.416 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.414+0000 7faeff80bb80 1 -- start start 2024-06-02T04:56:12.416 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.414+0000 7faeff80bb80 1 Processor -- start 2024-06-02T04:56:12.416 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.415+0000 7faeff80bb80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e664ba6a80 0x55e664bc5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:56:12.417 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.415+0000 7faeff80bb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e664ba73e0 0x55e664bc6400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:56:12.417 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.415+0000 7faeff80bb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e664ba82d0 0x55e664c21c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:56:12.417 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.415+0000 7faeff80bb80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e664c221a0 con 0x55e664ba6a80 2024-06-02T04:56:12.417 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.415+0000 7faeff80bb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e664c222e0 con 0x55e664ba73e0 2024-06-02T04:56:12.417 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.415+0000 7faeff80bb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e664c22470 con 0x55e664ba82d0 2024-06-02T04:56:12.417 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.415+0000 7faeff80bb80 10 client.0 _ll_register_callbacks cb 0x55e664a9cad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:56:12.417 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.415+0000 7faef13ec700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e664ba6a80 0x55e664bc5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:56:12.417 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.415+0000 7faef13ec700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e664ba6a80 0x55e664bc5ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:50256/0 (socket says 172.21.15.76:50256) 2024-06-02T04:56:12.417 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.415+0000 7faef13ec700 1 -- 172.21.15.76:0/3937869668 learned_addr learned my addr 172.21.15.76:0/3937869668 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:56:12.417 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.415+0000 7faef0beb700 1 --2- 172.21.15.76:0/3937869668 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e664ba73e0 0x55e664bc6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:56:12.417 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.415+0000 7faef1bed700 1 --2- 172.21.15.76:0/3937869668 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e664ba82d0 0x55e664c21c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:56:12.423 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.416+0000 7faef13ec700 1 -- 172.21.15.76:0/3937869668 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e664ba82d0 msgr2=0x55e664c21c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:56:12.423 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.416+0000 7faef13ec700 1 --2- 172.21.15.76:0/3937869668 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e664ba82d0 0x55e664c21c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:12.423 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.416+0000 7faef13ec700 1 -- 172.21.15.76:0/3937869668 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e664ba73e0 msgr2=0x55e664bc6400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:56:12.423 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.416+0000 7faef13ec700 1 --2- 172.21.15.76:0/3937869668 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e664ba73e0 0x55e664bc6400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:12.423 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.416+0000 7faef13ec700 1 -- 172.21.15.76:0/3937869668 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e664978350 con 0x55e664ba6a80 2024-06-02T04:56:12.423 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.416+0000 7faef13ec700 1 --2- 172.21.15.76:0/3937869668 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e664ba6a80 0x55e664bc5ec0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7faee80a4040 tx=0x7faee809a460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b1d2e88a541a732 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:56:12.423 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.417+0000 7faed4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-06-02T04:56:12.423 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.417+0000 7faed4ff9700 1 -- 172.21.15.76:0/3937869668 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee807f070 con 0x55e664ba6a80 2024-06-02T04:56:12.423 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.417+0000 7faed4ff9700 1 -- 172.21.15.76:0/3937869668 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7faee809acd0 con 0x55e664ba6a80 2024-06-02T04:56:12.423 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.417+0000 7faeff80bb80 1 -- 172.21.15.76:0/3937869668 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7faee8017410 con 0x55e664ba6a80 2024-06-02T04:56:12.424 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.417+0000 7faed4ff9700 1 -- 172.21.15.76:0/3937869668 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7faee809e170 con 0x55e664ba6a80 2024-06-02T04:56:12.424 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.417+0000 7faeff80bb80 10 client.16191 fetch_fsmap learned FSMap version 34 2024-06-02T04:56:12.424 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.417+0000 7faeff80bb80 1 -- 172.21.15.76:0/3937869668 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55e66497cc70 con 0x55e664ba6a80 2024-06-02T04:56:12.424 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.418+0000 7faed4ff9700 1 -- 172.21.15.76:0/3937869668 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7faee8089070 con 0x55e664ba6a80 2024-06-02T04:56:12.424 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.418+0000 7faed4ff9700 1 -- 172.21.15.76:0/3937869668 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 34) v1 ==== 7478+0+0 (secure 0 0 0) 0x7faee800e860 con 0x55e664ba6a80 2024-06-02T04:56:12.424 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.418+0000 7faeff80bb80 10 client.16191 fetch_fsmap finished waiting for FSMap version 34 2024-06-02T04:56:12.424 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.418+0000 7faeff80bb80 10 client.16191 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T04:56:12.424 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.418+0000 7faeff80bb80 20 client.16191 populate_metadata read hostname 'smithi076' 2024-06-02T04:56:12.424 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.418+0000 7faeff80bb80 1 --2- 172.21.15.76:0/3937869668 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55e664c23a70 0x55e664c25eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:56:12.424 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.418+0000 7faeff80bb80 4 client.16191 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T04:56:12.425 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.418+0000 7faeff80bb80 1 -- 172.21.15.76:0/3937869668 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55e664aefe60 con 0x55e664c23a70 2024-06-02T04:56:12.425 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.423+0000 7faef0beb700 1 --2- 172.21.15.76:0/3937869668 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55e664c23a70 0x55e664c25eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:56:12.425 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.423+0000 7faef0beb700 1 --2- 172.21.15.76:0/3937869668 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55e664c23a70 0x55e664c25eb0 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d56456a0075855a0 server_cookie=8d9256384e6e3298 in_seq=0 out_seq=0 2024-06-02T04:56:12.425 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.424+0000 7faed4ff9700 10 client.16191 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:56:12.452 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.451+0000 7faed4ff9700 1 -- 172.21.15.76:0/3937869668 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55e664aefe60 con 0x55e664c23a70 2024-06-02T04:56:12.453 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.451+0000 7faed4ff9700 10 client.16191 handle_command_reply: tid=0 2024-06-02T04:56:12.453 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.451+0000 7faeff80bb80 1 client.16191 shutdown 2024-06-02T04:56:12.453 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.452+0000 7faeff80bb80 1 -- 172.21.15.76:0/3937869668 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e664ba6a80 msgr2=0x55e664bc5ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:56:12.453 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.452+0000 7faeff80bb80 1 --2- 172.21.15.76:0/3937869668 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e664ba6a80 0x55e664bc5ec0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7faee80a4040 tx=0x7faee809a460 comp rx=0 tx=0).stop 2024-06-02T04:56:12.453 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.452+0000 7faeff80bb80 1 -- 172.21.15.76:0/3937869668 shutdown_connections 2024-06-02T04:56:12.453 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.452+0000 7faeff80bb80 1 --2- 172.21.15.76:0/3937869668 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55e664c23a70 0x55e664c25eb0 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:12.453 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.452+0000 7faeff80bb80 1 --2- 172.21.15.76:0/3937869668 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e664ba82d0 0x55e664c21c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:12.453 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.452+0000 7faeff80bb80 1 --2- 172.21.15.76:0/3937869668 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e664ba6a80 0x55e664bc5ec0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:12.453 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.452+0000 7faeff80bb80 1 --2- 172.21.15.76:0/3937869668 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e664ba73e0 0x55e664bc6400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:12.453 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.452+0000 7faeff80bb80 1 -- 172.21.15.76:0/3937869668 >> 172.21.15.76:0/3937869668 conn(0x55e664b051b0 msgr2=0x55e664baaf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:56:12.454 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.452+0000 7faed4ff9700 0 client.16191 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:56:12.454 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.453+0000 7faeff80bb80 1 -- 172.21.15.76:0/3937869668 shutdown_connections 2024-06-02T04:56:12.454 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.453+0000 7faeff80bb80 1 -- 172.21.15.76:0/3937869668 wait complete. 2024-06-02T04:56:12.454 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.453+0000 7faeff80bb80 20 client.16191 trim_cache size 0 max 16384 2024-06-02T04:56:12.455 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:{ 2024-06-02T04:56:12.455 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "message": "", 2024-06-02T04:56:12.455 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "return_code": 0 2024-06-02T04:56:12.455 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:} 2024-06-02T04:56:12.456 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.455+0000 7faef3650700 1 -- 172.21.15.76:0/1999432466 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7faed80a1270 msgr2=0x7faed80a3730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:56:12.456 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.455+0000 7faef3650700 1 --2- 172.21.15.76:0/1999432466 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7faed80a1270 0x7faed80a3730 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7faee400d970 tx=0x7faee400d5a0 comp rx=0 tx=0).stop 2024-06-02T04:56:12.456 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.455+0000 7faef3650700 1 -- 172.21.15.76:0/1999432466 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faeec0ffe40 msgr2=0x7faeec19d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:56:12.456 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.455+0000 7faef3650700 1 --2- 172.21.15.76:0/1999432466 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faeec0ffe40 0x7faeec19d4f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7faee8009950 tx=0x7faee8009c60 comp rx=0 tx=0).stop 2024-06-02T04:56:12.457 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.456+0000 7faef3650700 1 -- 172.21.15.76:0/1999432466 shutdown_connections 2024-06-02T04:56:12.457 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.456+0000 7faef3650700 1 --2- 172.21.15.76:0/1999432466 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7faeec101950 0x7faeec1a4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:12.457 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.456+0000 7faef3650700 1 --2- 172.21.15.76:0/1999432466 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7faed80a1270 0x7faed80a3730 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:12.457 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.456+0000 7faef3650700 1 --2- 172.21.15.76:0/1999432466 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faeec0ffe40 0x7faeec19d4f0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:12.457 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.456+0000 7faef3650700 1 --2- 172.21.15.76:0/1999432466 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faeec100f90 0x7faeec19da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:12.457 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.456+0000 7faef3650700 1 -- 172.21.15.76:0/1999432466 >> 172.21.15.76:0/1999432466 conn(0x7faeec0fb3b0 msgr2=0x7faeec1043f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:56:12.458 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.457+0000 7faef3650700 1 -- 172.21.15.76:0/1999432466 shutdown_connections 2024-06-02T04:56:12.458 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:12.457+0000 7faef3650700 1 -- 172.21.15.76:0/1999432466 wait complete. 2024-06-02T04:56:12.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:56:12 smithi192 ceph-mon[47933]: pgmap v467: 129 pgs: 129 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 11 MiB/s wr, 865 op/s 2024-06-02T04:56:12.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:56:12 smithi076 ceph-mon[42935]: pgmap v467: 129 pgs: 129 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 11 MiB/s wr, 865 op/s 2024-06-02T04:56:13.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:56:12 smithi119 ceph-mon[46633]: pgmap v467: 129 pgs: 129 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 11 MiB/s wr, 865 op/s 2024-06-02T04:56:13.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:56:13 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:56:13.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:56:13 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:56:13.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:56:13 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:56:13.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:56:13 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:56:13.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:56:13 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:56:13.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:56:13 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:56:14.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:56:13 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:56:14.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:56:13 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:56:14.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:56:13 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:56:14.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:56:14 smithi192 ceph-mon[47933]: pgmap v468: 129 pgs: 129 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 9.6 MiB/s wr, 799 op/s 2024-06-02T04:56:14.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:56:14 smithi076 ceph-mon[42935]: pgmap v468: 129 pgs: 129 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 9.6 MiB/s wr, 799 op/s 2024-06-02T04:56:15.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:56:14 smithi119 ceph-mon[46633]: pgmap v468: 129 pgs: 129 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 9.6 MiB/s wr, 799 op/s 2024-06-02T04:56:16.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 325.0 s, 764.0 tps, lat 130.655 ms stddev 49.571 2024-06-02T04:56:17.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:56:17 smithi192 ceph-mon[47933]: pgmap v469: 129 pgs: 129 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 9.8 MiB/s wr, 831 op/s 2024-06-02T04:56:17.735 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:56:17 smithi076 ceph-mon[42935]: pgmap v469: 129 pgs: 129 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 9.8 MiB/s wr, 831 op/s 2024-06-02T04:56:17.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:56:17 smithi119 ceph-mon[46633]: pgmap v469: 129 pgs: 129 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 9.8 MiB/s wr, 831 op/s 2024-06-02T04:56:19.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:56:19 smithi192 ceph-mon[47933]: pgmap v470: 129 pgs: 129 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 9.8 MiB/s wr, 795 op/s 2024-06-02T04:56:19.735 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:56:19 smithi076 ceph-mon[42935]: pgmap v470: 129 pgs: 129 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 9.8 MiB/s wr, 795 op/s 2024-06-02T04:56:19.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:56:19 smithi119 ceph-mon[46633]: pgmap v470: 129 pgs: 129 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 9.8 MiB/s wr, 795 op/s 2024-06-02T04:56:21.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 330.0 s, 943.0 tps, lat 106.369 ms stddev 38.050 2024-06-02T04:56:21.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:56:21 smithi192 ceph-mon[47933]: pgmap v471: 129 pgs: 129 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 10 MiB/s wr, 830 op/s 2024-06-02T04:56:21.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:56:21 smithi076 ceph-mon[42935]: pgmap v471: 129 pgs: 129 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 10 MiB/s wr, 830 op/s 2024-06-02T04:56:21.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:56:21 smithi119 ceph-mon[46633]: pgmap v471: 129 pgs: 129 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 10 MiB/s wr, 830 op/s 2024-06-02T04:56:23.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:56:23 smithi192 ceph-mon[47933]: pgmap v472: 129 pgs: 129 active+clean; 1.5 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 10 MiB/s wr, 810 op/s 2024-06-02T04:56:23.736 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:56:23 smithi076 ceph-mon[42935]: pgmap v472: 129 pgs: 129 active+clean; 1.5 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 10 MiB/s wr, 810 op/s 2024-06-02T04:56:23.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:56:23 smithi119 ceph-mon[46633]: pgmap v472: 129 pgs: 129 active+clean; 1.5 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 10 MiB/s wr, 810 op/s 2024-06-02T04:56:25.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:56:25 smithi076 ceph-mon[42935]: pgmap v473: 129 pgs: 129 active+clean; 1.5 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 9.1 MiB/s wr, 770 op/s 2024-06-02T04:56:25.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:56:25 smithi119 ceph-mon[46633]: pgmap v473: 129 pgs: 129 active+clean; 1.5 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 9.1 MiB/s wr, 770 op/s 2024-06-02T04:56:25.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:56:25 smithi192 ceph-mon[47933]: pgmap v473: 129 pgs: 129 active+clean; 1.5 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 9.1 MiB/s wr, 770 op/s 2024-06-02T04:56:25.981 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:25.980+0000 7efc1c2a4700 1 -- 172.21.15.76:0/3178739412 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efc14104330 msgr2=0x7efc14104790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:56:25.981 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:25.980+0000 7efc1c2a4700 1 --2- 172.21.15.76:0/3178739412 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efc14104330 0x7efc14104790 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7efc04009990 tx=0x7efc04009ca0 comp rx=0 tx=0).stop 2024-06-02T04:56:25.982 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:25.982+0000 7efc1c2a4700 1 -- 172.21.15.76:0/3178739412 shutdown_connections 2024-06-02T04:56:25.982 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:25.982+0000 7efc1c2a4700 1 --2- 172.21.15.76:0/3178739412 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efc14104cd0 0x7efc1410b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:25.983 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:25.982+0000 7efc1c2a4700 1 --2- 172.21.15.76:0/3178739412 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efc14103140 0x7efc14103560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:25.983 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:25.982+0000 7efc1c2a4700 1 --2- 172.21.15.76:0/3178739412 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efc14104330 0x7efc14104790 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:25.983 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:25.982+0000 7efc1c2a4700 1 -- 172.21.15.76:0/3178739412 >> 172.21.15.76:0/3178739412 conn(0x7efc140fe6b0 msgr2=0x7efc14100af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:56:25.984 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:25.982+0000 7efc1c2a4700 1 -- 172.21.15.76:0/3178739412 shutdown_connections 2024-06-02T04:56:25.984 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:25.982+0000 7efc1c2a4700 1 -- 172.21.15.76:0/3178739412 wait complete. 2024-06-02T04:56:25.984 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:25.983+0000 7efc1c2a4700 1 Processor -- start 2024-06-02T04:56:25.985 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:25.983+0000 7efc1c2a4700 1 -- start start 2024-06-02T04:56:25.985 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:25.984+0000 7efc1c2a4700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efc14103140 0x7efc1406f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:56:25.985 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:25.984+0000 7efc1c2a4700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efc14104330 0x7efc1406fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:56:25.985 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:25.984+0000 7efc1c2a4700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efc14104cd0 0x7efc141a91b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:56:25.985 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:25.984+0000 7efc1c2a4700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc14072e50 con 0x7efc14104330 2024-06-02T04:56:25.986 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:25.984+0000 7efc1c2a4700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc14072fc0 con 0x7efc14103140 2024-06-02T04:56:25.986 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:25.984+0000 7efc1c2a4700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc141a96f0 con 0x7efc14104cd0 2024-06-02T04:56:25.987 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:25.984+0000 7efc1983f700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efc14104330 0x7efc1406fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:56:25.987 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:25.984+0000 7efc1983f700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efc14104330 0x7efc1406fe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:52730/0 (socket says 172.21.15.76:52730) 2024-06-02T04:56:25.988 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:25.984+0000 7efc1983f700 1 -- 172.21.15.76:0/47797086 learned_addr learned my addr 172.21.15.76:0/47797086 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:56:25.988 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:25.984+0000 7efc1a040700 1 --2- 172.21.15.76:0/47797086 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efc14103140 0x7efc1406f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:56:25.988 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:25.985+0000 7efc1a040700 1 -- 172.21.15.76:0/47797086 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efc14104cd0 msgr2=0x7efc141a91b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-06-02T04:56:25.988 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:25.985+0000 7efc1a040700 1 --2- 172.21.15.76:0/47797086 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efc14104cd0 0x7efc141a91b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:25.988 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:25.985+0000 7efc1a040700 1 -- 172.21.15.76:0/47797086 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efc14104330 msgr2=0x7efc1406fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:56:25.988 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:25.985+0000 7efc1a040700 1 --2- 172.21.15.76:0/47797086 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efc14104330 0x7efc1406fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:25.989 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:25.985+0000 7efc1a040700 1 -- 172.21.15.76:0/47797086 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc040095f0 con 0x7efc14103140 2024-06-02T04:56:25.989 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:25.985+0000 7efc1a040700 1 --2- 172.21.15.76:0/47797086 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efc14103140 0x7efc1406f8d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7efc1000e9c0 tx=0x7efc1000ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:56:25.989 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:25.986+0000 7efc0b7fe700 1 -- 172.21.15.76:0/47797086 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc1000cbd0 con 0x7efc14103140 2024-06-02T04:56:25.989 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:25.986+0000 7efc0b7fe700 1 -- 172.21.15.76:0/47797086 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efc1000eeb0 con 0x7efc14103140 2024-06-02T04:56:25.990 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:25.986+0000 7efc0b7fe700 1 -- 172.21.15.76:0/47797086 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc10003c70 con 0x7efc14103140 2024-06-02T04:56:25.990 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:25.986+0000 7efc1c2a4700 1 -- 172.21.15.76:0/47797086 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc141a9950 con 0x7efc14103140 2024-06-02T04:56:25.990 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:25.986+0000 7efc1c2a4700 1 -- 172.21.15.76:0/47797086 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc141a9de0 con 0x7efc14103140 2024-06-02T04:56:25.993 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:25.992+0000 7efc0b7fe700 1 -- 172.21.15.76:0/47797086 <== mon.2 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7efc10018430 con 0x7efc14103140 2024-06-02T04:56:25.996 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:25.993+0000 7efc2845fb80 1 Processor -- start 2024-06-02T04:56:25.996 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:25.993+0000 7efc2845fb80 1 -- start start 2024-06-02T04:56:25.997 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:25.994+0000 7efc2845fb80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564c315e2a80 0x564c315e2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:56:25.997 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:25.994+0000 7efc2845fb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564c315e33e0 0x564c315e3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:56:25.997 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:25.994+0000 7efc2845fb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564c315e42d0 0x564c315e4750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:56:25.997 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:25.994+0000 7efc2845fb80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c3153a0f0 con 0x564c315e2a80 2024-06-02T04:56:25.997 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:25.994+0000 7efc2845fb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c31537ab0 con 0x564c315e33e0 2024-06-02T04:56:25.997 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:25.994+0000 7efc2845fb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c315333a0 con 0x564c315e42d0 2024-06-02T04:56:25.997 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:25.994+0000 7efc0b7fe700 1 --2- 172.21.15.76:0/47797086 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7efc000a11f0 0x7efc000a36b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:56:25.997 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:25.994+0000 7efc1a040700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564c315e33e0 0x564c315e3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:56:25.997 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:25.994+0000 7efc1a040700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564c315e33e0 0x564c315e3cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:37524/0 (socket says 172.21.15.76:37524) 2024-06-02T04:56:25.997 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:25.994+0000 7efc1a040700 1 -- 172.21.15.76:0/3741313043 learned_addr learned my addr 172.21.15.76:0/3741313043 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:56:25.997 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:25.995+0000 7efc0b7fe700 1 -- 172.21.15.76:0/47797086 <== mon.2 v2:172.21.15.119:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7efc10014070 con 0x7efc14103140 2024-06-02T04:56:25.997 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:25.995+0000 7efc1a841700 1 --2- 172.21.15.76:0/47797086 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7efc000a11f0 0x7efc000a36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:56:25.997 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:25.995+0000 7efc1a040700 1 -- 172.21.15.76:0/3741313043 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564c315e42d0 msgr2=0x564c315e4750 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-02T04:56:25.998 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:25.995+0000 7efc1a040700 1 --2- 172.21.15.76:0/3741313043 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564c315e42d0 0x564c315e4750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:25.998 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:25.995+0000 7efc1a040700 1 -- 172.21.15.76:0/3741313043 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564c315e2a80 msgr2=0x564c315e2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:56:25.998 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:25.995+0000 7efc1a040700 1 --2- 172.21.15.76:0/3741313043 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564c315e2a80 0x564c315e2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:25.998 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:25.995+0000 7efc1a040700 1 -- 172.21.15.76:0/3741313043 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564c313b4350 con 0x564c315e33e0 2024-06-02T04:56:25.998 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:25.996+0000 7efc1a040700 1 --2- 172.21.15.76:0/3741313043 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564c315e33e0 0x564c315e3cf0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7efc10009f90 tx=0x7efc1006dff0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9d0c4f2ab215151 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:56:25.998 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:25.996+0000 7efc08da5700 1 -- 172.21.15.76:0/3741313043 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc1009ae10 con 0x564c315e33e0 2024-06-02T04:56:25.998 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:25.996+0000 7efc08da5700 1 -- 172.21.15.76:0/3741313043 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efc1009ec40 con 0x564c315e33e0 2024-06-02T04:56:25.998 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:25.996+0000 7efc08da5700 1 -- 172.21.15.76:0/3741313043 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc1000cd30 con 0x564c315e33e0 2024-06-02T04:56:25.999 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:25.997+0000 7efc2845fb80 1 -- 172.21.15.76:0/3741313043 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564c315e33e0 msgr2=0x564c315e3cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:56:25.999 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:25.997+0000 7efc2845fb80 1 --2- 172.21.15.76:0/3741313043 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564c315e33e0 0x564c315e3cf0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7efc10009f90 tx=0x7efc1006dff0 comp rx=0 tx=0).stop 2024-06-02T04:56:25.999 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:25.997+0000 7efc1a841700 1 --2- 172.21.15.76:0/47797086 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7efc000a11f0 0x7efc000a36b0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7efc0c009c60 tx=0x7efc0c0091e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:56:25.999 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:25.997+0000 7efc2845fb80 1 -- 172.21.15.76:0/3741313043 shutdown_connections 2024-06-02T04:56:25.999 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:25.997+0000 7efc2845fb80 1 --2- 172.21.15.76:0/3741313043 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564c315e42d0 0x564c315e4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:25.999 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:25.997+0000 7efc2845fb80 1 --2- 172.21.15.76:0/3741313043 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564c315e2a80 0x564c315e2ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:25.999 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:25.997+0000 7efc2845fb80 1 --2- 172.21.15.76:0/3741313043 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564c315e33e0 0x564c315e3cf0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:26.000 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:25.997+0000 7efc2845fb80 1 -- 172.21.15.76:0/3741313043 >> 172.21.15.76:0/3741313043 conn(0x564c315411b0 msgr2=0x564c315df440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:56:26.000 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:25.998+0000 7efc2845fb80 1 -- 172.21.15.76:0/3741313043 shutdown_connections 2024-06-02T04:56:26.000 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:25.998+0000 7efc2845fb80 1 -- 172.21.15.76:0/3741313043 wait complete. 2024-06-02T04:56:26.003 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:25.998+0000 7efc2845fb80 1 -- start start 2024-06-02T04:56:26.003 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:25.998+0000 7efc2845fb80 1 Processor -- start 2024-06-02T04:56:26.003 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:25.999+0000 7efc2845fb80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564c315e2a80 0x564c315ec8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:56:26.003 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:25.999+0000 7efc2845fb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564c315e33e0 0x564c315ece30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:56:26.003 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:25.999+0000 7efc2845fb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564c315e42d0 0x564c315f3e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:56:26.003 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:25.999+0000 7efc2845fb80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c314cf500 con 0x564c315e2a80 2024-06-02T04:56:26.003 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:25.999+0000 7efc2845fb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c314cf1a0 con 0x564c315e42d0 2024-06-02T04:56:26.003 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:25.999+0000 7efc2845fb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c313b6640 con 0x564c315e33e0 2024-06-02T04:56:26.003 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:25.999+0000 7efc2845fb80 10 client.0 _ll_register_callbacks cb 0x564c314d8ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:56:26.003 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.001+0000 7efc1a841700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564c315e42d0 0x564c315f3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:56:26.003 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.001+0000 7efc1a841700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564c315e42d0 0x564c315f3e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:37532/0 (socket says 172.21.15.76:37532) 2024-06-02T04:56:26.004 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.001+0000 7efc1a841700 1 -- 172.21.15.76:0/475090680 learned_addr learned my addr 172.21.15.76:0/475090680 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:56:26.004 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.001+0000 7efc1a040700 1 --2- 172.21.15.76:0/475090680 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564c315e2a80 0x564c315ec8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:56:26.004 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.002+0000 7efc1983f700 1 --2- 172.21.15.76:0/475090680 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564c315e33e0 0x564c315ece30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:56:26.004 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.002+0000 7efc1a040700 1 -- 172.21.15.76:0/475090680 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564c315e33e0 msgr2=0x564c315ece30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:56:26.004 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.002+0000 7efc1a040700 1 --2- 172.21.15.76:0/475090680 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564c315e33e0 0x564c315ece30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:26.004 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.002+0000 7efc1a040700 1 -- 172.21.15.76:0/475090680 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564c315e42d0 msgr2=0x564c315f3e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:56:26.004 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.002+0000 7efc1a040700 1 --2- 172.21.15.76:0/475090680 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564c315e42d0 0x564c315f3e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:26.004 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.002+0000 7efc1a040700 1 -- 172.21.15.76:0/475090680 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc141a9de0 con 0x564c315e2a80 2024-06-02T04:56:26.004 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.002+0000 7efc1a040700 1 --2- 172.21.15.76:0/475090680 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564c315e2a80 0x564c315ec8f0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7efc1009ada0 tx=0x7efc1001f650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa18c8ac59dd0308 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:56:26.004 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.002+0000 7efbfdffb700 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-06-02T04:56:26.005 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.003+0000 7efbfdffb700 1 -- 172.21.15.76:0/475090680 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc1009ae10 con 0x564c315e2a80 2024-06-02T04:56:26.005 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.003+0000 7efbfdffb700 1 -- 172.21.15.76:0/475090680 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7efc1001e2b0 con 0x564c315e2a80 2024-06-02T04:56:26.005 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.003+0000 7efc2845fb80 1 -- 172.21.15.76:0/475090680 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564c3148c210 con 0x564c315e2a80 2024-06-02T04:56:26.005 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.003+0000 7efbfdffb700 1 -- 172.21.15.76:0/475090680 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7efc1001e470 con 0x564c315e2a80 2024-06-02T04:56:26.005 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.003+0000 7efc2845fb80 10 client.16197 fetch_fsmap learned FSMap version 34 2024-06-02T04:56:26.005 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.003+0000 7efc2845fb80 1 -- 172.21.15.76:0/475090680 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x564c31360b00 con 0x564c315e2a80 2024-06-02T04:56:26.006 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.004+0000 7efbfdffb700 1 -- 172.21.15.76:0/475090680 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x564c3148c210 con 0x564c315e2a80 2024-06-02T04:56:26.006 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.004+0000 7efbfdffb700 1 -- 172.21.15.76:0/475090680 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 34) v1 ==== 7478+0+0 (secure 0 0 0) 0x7efc1009a300 con 0x564c315e2a80 2024-06-02T04:56:26.006 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.004+0000 7efc2845fb80 10 client.16197 fetch_fsmap finished waiting for FSMap version 34 2024-06-02T04:56:26.006 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.004+0000 7efc2845fb80 10 client.16197 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T04:56:26.006 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.004+0000 7efc2845fb80 20 client.16197 populate_metadata read hostname 'smithi076' 2024-06-02T04:56:26.006 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.004+0000 7efc2845fb80 1 --2- 172.21.15.76:0/475090680 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x564c315f83a0 0x564c315fa7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:56:26.006 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.004+0000 7efc2845fb80 4 client.16197 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T04:56:26.006 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.004+0000 7efc2845fb80 1 -- 172.21.15.76:0/475090680 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564c315b27b0 con 0x564c315f83a0 2024-06-02T04:56:26.007 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.005+0000 7efc1983f700 1 --2- 172.21.15.76:0/475090680 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x564c315f83a0 0x564c315fa7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:56:26.007 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.006+0000 7efc1983f700 1 --2- 172.21.15.76:0/475090680 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x564c315f83a0 0x564c315fa7c0 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9111cf750c51372b server_cookie=62d84feac36dc6eb in_seq=0 out_seq=0 2024-06-02T04:56:26.008 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.008+0000 7efbfdffb700 10 client.16197 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:56:26.008 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.008+0000 7efbfdffb700 1 -- 172.21.15.76:0/475090680 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x564c315b27b0 con 0x564c315f83a0 2024-06-02T04:56:26.008 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.008+0000 7efbfdffb700 10 client.16197 handle_command_reply: tid=0 2024-06-02T04:56:26.008 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.008+0000 7efc2845fb80 1 client.16197 shutdown 2024-06-02T04:56:26.009 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.008+0000 7efc2845fb80 1 -- 172.21.15.76:0/475090680 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564c315e2a80 msgr2=0x564c315ec8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:56:26.009 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.008+0000 7efc2845fb80 1 --2- 172.21.15.76:0/475090680 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564c315e2a80 0x564c315ec8f0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7efc1009ada0 tx=0x7efc1001f650 comp rx=0 tx=0).stop 2024-06-02T04:56:26.009 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.008+0000 7efc2845fb80 1 -- 172.21.15.76:0/475090680 shutdown_connections 2024-06-02T04:56:26.009 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.008+0000 7efc2845fb80 1 --2- 172.21.15.76:0/475090680 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x564c315f83a0 0x564c315fa7c0 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:26.009 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.008+0000 7efc2845fb80 1 --2- 172.21.15.76:0/475090680 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564c315e42d0 0x564c315f3e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:26.009 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.008+0000 7efc2845fb80 1 --2- 172.21.15.76:0/475090680 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564c315e2a80 0x564c315ec8f0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:26.009 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.008+0000 7efc2845fb80 1 --2- 172.21.15.76:0/475090680 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564c315e33e0 0x564c315ece30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:26.009 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.008+0000 7efc2845fb80 1 -- 172.21.15.76:0/475090680 >> 172.21.15.76:0/475090680 conn(0x564c315411b0 msgr2=0x564c315dd860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:56:26.009 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.008+0000 7efbfdffb700 0 client.16197 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:56:26.009 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.009+0000 7efc2845fb80 1 -- 172.21.15.76:0/475090680 shutdown_connections 2024-06-02T04:56:26.010 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.009+0000 7efc2845fb80 1 -- 172.21.15.76:0/475090680 wait complete. 2024-06-02T04:56:26.011 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.010+0000 7efc2845fb80 20 client.16197 trim_cache size 0 max 16384 2024-06-02T04:56:26.033 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.033+0000 7efc2845fb80 1 Processor -- start 2024-06-02T04:56:26.034 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.034+0000 7efc2845fb80 1 -- start start 2024-06-02T04:56:26.034 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.034+0000 7efc2845fb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564c315e2a80 0x564c315e46b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:56:26.034 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.034+0000 7efc2845fb80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564c315e33e0 0x564c315f3e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:56:26.035 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.034+0000 7efc2845fb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564c315e42d0 0x564c315eb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:56:26.035 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.034+0000 7efc2845fb80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c315ea4b0 con 0x564c315e33e0 2024-06-02T04:56:26.035 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.034+0000 7efc2845fb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c315e7da0 con 0x564c315e2a80 2024-06-02T04:56:26.035 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.034+0000 7efc2845fb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c315f80c0 con 0x564c315e42d0 2024-06-02T04:56:26.035 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.035+0000 7efc1983f700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564c315e33e0 0x564c315f3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:56:26.035 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.035+0000 7efc1983f700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564c315e33e0 0x564c315f3e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:52754/0 (socket says 172.21.15.76:52754) 2024-06-02T04:56:26.035 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.035+0000 7efc1983f700 1 -- 172.21.15.76:0/142681963 learned_addr learned my addr 172.21.15.76:0/142681963 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:56:26.036 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.035+0000 7efc1983f700 1 -- 172.21.15.76:0/142681963 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564c315e42d0 msgr2=0x564c315eb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:56:26.036 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.035+0000 7efc1983f700 1 --2- 172.21.15.76:0/142681963 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564c315e42d0 0x564c315eb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:26.036 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.035+0000 7efc1983f700 1 -- 172.21.15.76:0/142681963 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564c315e2a80 msgr2=0x564c315e46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:56:26.036 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.035+0000 7efc1983f700 1 --2- 172.21.15.76:0/142681963 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564c315e2a80 0x564c315e46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:26.036 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.035+0000 7efc1983f700 1 -- 172.21.15.76:0/142681963 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564c314f9500 con 0x564c315e33e0 2024-06-02T04:56:26.036 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.035+0000 7efc1983f700 1 --2- 172.21.15.76:0/142681963 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564c315e33e0 0x564c315f3e00 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7efc04000c00 tx=0x7efc04005fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb2d5d4a31dd98c2 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:56:26.037 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.036+0000 7efc095a6700 1 -- 172.21.15.76:0/142681963 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc0401d070 con 0x564c315e33e0 2024-06-02T04:56:26.037 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.036+0000 7efc095a6700 1 -- 172.21.15.76:0/142681963 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efc0401e040 con 0x564c315e33e0 2024-06-02T04:56:26.037 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.036+0000 7efc095a6700 1 -- 172.21.15.76:0/142681963 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc040270e0 con 0x564c315e33e0 2024-06-02T04:56:26.038 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.037+0000 7efc2845fb80 1 -- 172.21.15.76:0/142681963 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564c315e33e0 msgr2=0x564c315f3e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:56:26.038 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.037+0000 7efc2845fb80 1 --2- 172.21.15.76:0/142681963 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564c315e33e0 0x564c315f3e00 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7efc04000c00 tx=0x7efc04005fb0 comp rx=0 tx=0).stop 2024-06-02T04:56:26.040 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.039+0000 7efc2845fb80 1 -- 172.21.15.76:0/142681963 shutdown_connections 2024-06-02T04:56:26.040 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.039+0000 7efc2845fb80 1 --2- 172.21.15.76:0/142681963 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564c315e42d0 0x564c315eb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:26.040 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.039+0000 7efc2845fb80 1 --2- 172.21.15.76:0/142681963 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564c315e2a80 0x564c315e46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:26.040 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.039+0000 7efc2845fb80 1 --2- 172.21.15.76:0/142681963 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564c315e33e0 0x564c315f3e00 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:26.040 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.039+0000 7efc2845fb80 1 -- 172.21.15.76:0/142681963 >> 172.21.15.76:0/142681963 conn(0x564c315411b0 msgr2=0x564c315ebe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:56:26.040 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.040+0000 7efc2845fb80 1 -- 172.21.15.76:0/142681963 shutdown_connections 2024-06-02T04:56:26.041 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.040+0000 7efc2845fb80 1 -- 172.21.15.76:0/142681963 wait complete. 2024-06-02T04:56:26.041 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.040+0000 7efc2845fb80 1 -- start start 2024-06-02T04:56:26.041 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.040+0000 7efc2845fb80 1 Processor -- start 2024-06-02T04:56:26.042 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.041+0000 7efc2845fb80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564c315e2a80 0x564c315f1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:56:26.042 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.041+0000 7efc2845fb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564c315e33e0 0x564c315f1f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:56:26.042 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.041+0000 7efc2845fb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564c315e42d0 0x564c315f2e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:56:26.042 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.041+0000 7efc2845fb80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c315f33b0 con 0x564c315e2a80 2024-06-02T04:56:26.042 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.041+0000 7efc2845fb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c315f3520 con 0x564c315e33e0 2024-06-02T04:56:26.042 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.041+0000 7efc2845fb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c315f36e0 con 0x564c315e42d0 2024-06-02T04:56:26.042 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.041+0000 7efc2845fb80 10 client.0 _ll_register_callbacks cb 0x564c314d8ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:56:26.042 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.041+0000 7efc1a040700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564c315e2a80 0x564c315f1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:56:26.042 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.041+0000 7efc1a040700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564c315e2a80 0x564c315f1a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:52768/0 (socket says 172.21.15.76:52768) 2024-06-02T04:56:26.042 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.041+0000 7efc1a841700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564c315e42d0 0x564c315f2e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:56:26.042 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.041+0000 7efc1a040700 1 -- 172.21.15.76:0/2293473005 learned_addr learned my addr 172.21.15.76:0/2293473005 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:56:26.042 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.041+0000 7efc1983f700 1 --2- 172.21.15.76:0/2293473005 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564c315e33e0 0x564c315f1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:56:26.043 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.042+0000 7efc1983f700 1 -- 172.21.15.76:0/2293473005 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564c315e42d0 msgr2=0x564c315f2e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:56:26.043 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.042+0000 7efc1983f700 1 --2- 172.21.15.76:0/2293473005 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564c315e42d0 0x564c315f2e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:26.043 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.042+0000 7efc1983f700 1 -- 172.21.15.76:0/2293473005 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564c315e2a80 msgr2=0x564c315f1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:56:26.043 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.042+0000 7efc1983f700 1 --2- 172.21.15.76:0/2293473005 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564c315e2a80 0x564c315f1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:26.044 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.042+0000 7efc1983f700 1 -- 172.21.15.76:0/2293473005 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc1410bed0 con 0x564c315e33e0 2024-06-02T04:56:26.044 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.042+0000 7efc1a040700 1 --2- 172.21.15.76:0/2293473005 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564c315e2a80 0x564c315f1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T04:56:26.044 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.042+0000 7efc1983f700 1 --2- 172.21.15.76:0/2293473005 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564c315e33e0 0x564c315f1f50 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x564c315f5540 tx=0x7efc040056a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72421d9b5c44dee5 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:56:26.044 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.042+0000 7efbfdffb700 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-06-02T04:56:26.044 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.042+0000 7efbfdffb700 1 -- 172.21.15.76:0/2293473005 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc0401d070 con 0x564c315e33e0 2024-06-02T04:56:26.044 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.042+0000 7efbfdffb700 1 -- 172.21.15.76:0/2293473005 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7efc0400bb90 con 0x564c315e33e0 2024-06-02T04:56:26.044 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.042+0000 7efc2845fb80 1 -- 172.21.15.76:0/2293473005 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7efc1009ec40 con 0x564c315e33e0 2024-06-02T04:56:26.045 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.044+0000 7efbfdffb700 1 -- 172.21.15.76:0/2293473005 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7efc0400bd90 con 0x564c315e33e0 2024-06-02T04:56:26.045 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.044+0000 7efc2845fb80 10 client.25784 fetch_fsmap learned FSMap version 34 2024-06-02T04:56:26.045 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.044+0000 7efc2845fb80 1 -- 172.21.15.76:0/2293473005 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x564c313b8c70 con 0x564c315e33e0 2024-06-02T04:56:26.045 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.044+0000 7efbfdffb700 1 -- 172.21.15.76:0/2293473005 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efc1009ec40 con 0x564c315e33e0 2024-06-02T04:56:26.046 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.045+0000 7efbfdffb700 1 -- 172.21.15.76:0/2293473005 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 34) v1 ==== 7478+0+0 (secure 0 0 0) 0x7efc0403a070 con 0x564c315e33e0 2024-06-02T04:56:26.046 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.046+0000 7efc2845fb80 10 client.25784 fetch_fsmap finished waiting for FSMap version 34 2024-06-02T04:56:26.046 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.046+0000 7efc2845fb80 10 client.25784 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T04:56:26.046 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.046+0000 7efc2845fb80 20 client.25784 populate_metadata read hostname 'smithi076' 2024-06-02T04:56:26.046 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.046+0000 7efc2845fb80 1 --2- 172.21.15.76:0/2293473005 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x564c31657870 0x564c31659c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:56:26.046 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.046+0000 7efc2845fb80 4 client.25784 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T04:56:26.046 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.046+0000 7efc2845fb80 1 -- 172.21.15.76:0/2293473005 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x564c3152be60 con 0x564c31657870 2024-06-02T04:56:26.047 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.046+0000 7efc1a040700 1 --2- 172.21.15.76:0/2293473005 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x564c31657870 0x564c31659c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:56:26.047 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.046+0000 7efc1a040700 1 --2- 172.21.15.76:0/2293473005 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x564c31657870 0x564c31659c60 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a800d80f7ed11c80 server_cookie=4520547686925b42 in_seq=0 out_seq=0 2024-06-02T04:56:26.047 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.046+0000 7efbfdffb700 10 client.25784 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:56:26.071 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.070+0000 7efbfdffb700 1 -- 172.21.15.76:0/2293473005 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x564c3152be60 con 0x564c31657870 2024-06-02T04:56:26.071 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.070+0000 7efbfdffb700 10 client.25784 handle_command_reply: tid=0 2024-06-02T04:56:26.071 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.070+0000 7efc2845fb80 1 client.25784 shutdown 2024-06-02T04:56:26.071 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.070+0000 7efc2845fb80 1 -- 172.21.15.76:0/2293473005 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564c315e33e0 msgr2=0x564c315f1f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:56:26.071 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.070+0000 7efc2845fb80 1 --2- 172.21.15.76:0/2293473005 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564c315e33e0 0x564c315f1f50 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x564c315f5540 tx=0x7efc040056a0 comp rx=0 tx=0).stop 2024-06-02T04:56:26.071 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.070+0000 7efc2845fb80 1 -- 172.21.15.76:0/2293473005 shutdown_connections 2024-06-02T04:56:26.071 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.070+0000 7efc2845fb80 1 --2- 172.21.15.76:0/2293473005 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x564c31657870 0x564c31659c60 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:26.071 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.070+0000 7efc2845fb80 1 --2- 172.21.15.76:0/2293473005 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564c315e42d0 0x564c315f2e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:26.072 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.070+0000 7efc2845fb80 1 --2- 172.21.15.76:0/2293473005 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564c315e2a80 0x564c315f1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:26.072 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.070+0000 7efc2845fb80 1 --2- 172.21.15.76:0/2293473005 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564c315e33e0 0x564c315f1f50 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:26.072 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.070+0000 7efc2845fb80 1 -- 172.21.15.76:0/2293473005 >> 172.21.15.76:0/2293473005 conn(0x564c315411b0 msgr2=0x564c315eb5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:56:26.072 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.070+0000 7efbfdffb700 0 client.25784 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:56:26.072 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.072+0000 7efc2845fb80 1 -- 172.21.15.76:0/2293473005 shutdown_connections 2024-06-02T04:56:26.072 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.072+0000 7efc2845fb80 1 -- 172.21.15.76:0/2293473005 wait complete. 2024-06-02T04:56:26.073 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.072+0000 7efc2845fb80 20 client.25784 trim_cache size 0 max 16384 2024-06-02T04:56:26.073 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:{ 2024-06-02T04:56:26.073 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "message": "", 2024-06-02T04:56:26.073 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "return_code": 0 2024-06-02T04:56:26.073 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:} 2024-06-02T04:56:26.073 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.072+0000 7efc1c2a4700 1 -- 172.21.15.76:0/47797086 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7efc000a11f0 msgr2=0x7efc000a36b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:56:26.074 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.072+0000 7efc1c2a4700 1 --2- 172.21.15.76:0/47797086 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7efc000a11f0 0x7efc000a36b0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7efc0c009c60 tx=0x7efc0c0091e0 comp rx=0 tx=0).stop 2024-06-02T04:56:26.074 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.072+0000 7efc1c2a4700 1 -- 172.21.15.76:0/47797086 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efc14103140 msgr2=0x7efc1406f8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:56:26.074 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.072+0000 7efc1c2a4700 1 --2- 172.21.15.76:0/47797086 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efc14103140 0x7efc1406f8d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7efc1000e9c0 tx=0x7efc1000ecd0 comp rx=0 tx=0).stop 2024-06-02T04:56:26.074 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.073+0000 7efc1c2a4700 1 -- 172.21.15.76:0/47797086 shutdown_connections 2024-06-02T04:56:26.074 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.073+0000 7efc1c2a4700 1 --2- 172.21.15.76:0/47797086 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efc14104cd0 0x7efc141a91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:26.074 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.073+0000 7efc1c2a4700 1 --2- 172.21.15.76:0/47797086 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7efc000a11f0 0x7efc000a36b0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:26.074 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.073+0000 7efc1c2a4700 1 --2- 172.21.15.76:0/47797086 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efc14103140 0x7efc1406f8d0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:26.074 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.073+0000 7efc1c2a4700 1 --2- 172.21.15.76:0/47797086 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efc14104330 0x7efc1406fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:26.074 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.073+0000 7efc1c2a4700 1 -- 172.21.15.76:0/47797086 >> 172.21.15.76:0/47797086 conn(0x7efc140fe6b0 msgr2=0x7efc141076d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:56:26.075 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.075+0000 7efc1c2a4700 1 -- 172.21.15.76:0/47797086 shutdown_connections 2024-06-02T04:56:26.075 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:26.075+0000 7efc1c2a4700 1 -- 172.21.15.76:0/47797086 wait complete. 2024-06-02T04:56:26.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 335.0 s, 890.8 tps, lat 112.052 ms stddev 40.320 2024-06-02T04:56:27.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:56:27 smithi076 ceph-mon[42935]: pgmap v474: 129 pgs: 129 active+clean; 1.5 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 10 MiB/s wr, 849 op/s 2024-06-02T04:56:27.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:56:27 smithi119 ceph-mon[46633]: pgmap v474: 129 pgs: 129 active+clean; 1.5 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 10 MiB/s wr, 849 op/s 2024-06-02T04:56:27.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:56:27 smithi192 ceph-mon[47933]: pgmap v474: 129 pgs: 129 active+clean; 1.5 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 10 MiB/s wr, 849 op/s 2024-06-02T04:56:29.735 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:56:29 smithi076 ceph-mon[42935]: pgmap v475: 129 pgs: 129 active+clean; 1.5 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 10 MiB/s wr, 854 op/s 2024-06-02T04:56:29.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:56:29 smithi119 ceph-mon[46633]: pgmap v475: 129 pgs: 129 active+clean; 1.5 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 10 MiB/s wr, 854 op/s 2024-06-02T04:56:29.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:56:29 smithi192 ceph-mon[47933]: pgmap v475: 129 pgs: 129 active+clean; 1.5 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 10 MiB/s wr, 854 op/s 2024-06-02T04:56:31.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 340.0 s, 781.4 tps, lat 127.002 ms stddev 49.646 2024-06-02T04:56:31.736 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:56:31 smithi076 ceph-mon[42935]: pgmap v476: 129 pgs: 129 active+clean; 1.5 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 9.7 MiB/s wr, 884 op/s 2024-06-02T04:56:31.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:56:31 smithi119 ceph-mon[46633]: pgmap v476: 129 pgs: 129 active+clean; 1.5 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 9.7 MiB/s wr, 884 op/s 2024-06-02T04:56:31.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:56:31 smithi192 ceph-mon[47933]: pgmap v476: 129 pgs: 129 active+clean; 1.5 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 9.7 MiB/s wr, 884 op/s 2024-06-02T04:56:33.735 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:56:33 smithi076 ceph-mon[42935]: pgmap v477: 129 pgs: 129 active+clean; 1.5 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 9.9 MiB/s wr, 875 op/s 2024-06-02T04:56:33.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:56:33 smithi119 ceph-mon[46633]: pgmap v477: 129 pgs: 129 active+clean; 1.5 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 9.9 MiB/s wr, 875 op/s 2024-06-02T04:56:33.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:56:33 smithi192 ceph-mon[47933]: pgmap v477: 129 pgs: 129 active+clean; 1.5 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 9.9 MiB/s wr, 875 op/s 2024-06-02T04:56:35.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:56:35 smithi076 ceph-mon[42935]: pgmap v478: 129 pgs: 129 active+clean; 1.5 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 9.2 MiB/s wr, 813 op/s 2024-06-02T04:56:35.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:56:35 smithi119 ceph-mon[46633]: pgmap v478: 129 pgs: 129 active+clean; 1.5 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 9.2 MiB/s wr, 813 op/s 2024-06-02T04:56:35.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:56:35 smithi192 ceph-mon[47933]: pgmap v478: 129 pgs: 129 active+clean; 1.5 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 9.2 MiB/s wr, 813 op/s 2024-06-02T04:56:36.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 345.0 s, 823.2 tps, lat 121.814 ms stddev 53.558 2024-06-02T04:56:37.735 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:56:37 smithi076 ceph-mon[42935]: pgmap v479: 129 pgs: 129 active+clean; 1.5 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 9.3 MiB/s wr, 838 op/s 2024-06-02T04:56:37.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:56:37 smithi119 ceph-mon[46633]: pgmap v479: 129 pgs: 129 active+clean; 1.5 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 9.3 MiB/s wr, 838 op/s 2024-06-02T04:56:37.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:56:37 smithi192 ceph-mon[47933]: pgmap v479: 129 pgs: 129 active+clean; 1.5 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 9.3 MiB/s wr, 838 op/s 2024-06-02T04:56:39.299 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.298+0000 7fad8f1b1700 1 -- 172.21.15.76:0/821856741 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fad881090d0 msgr2=0x7fad8810f980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:56:39.299 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.298+0000 7fad8f1b1700 1 --2- 172.21.15.76:0/821856741 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fad881090d0 0x7fad8810f980 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fad8000b0d0 tx=0x7fad8000b3e0 comp rx=0 tx=0).stop 2024-06-02T04:56:39.303 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.303+0000 7fad8f1b1700 1 -- 172.21.15.76:0/821856741 shutdown_connections 2024-06-02T04:56:39.303 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.303+0000 7fad8f1b1700 1 --2- 172.21.15.76:0/821856741 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fad881090d0 0x7fad8810f980 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:39.304 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.303+0000 7fad8f1b1700 1 --2- 172.21.15.76:0/821856741 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fad88107540 0x7fad88107960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:39.304 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.303+0000 7fad8f1b1700 1 --2- 172.21.15.76:0/821856741 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fad88108730 0x7fad88108b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:39.304 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.303+0000 7fad8f1b1700 1 -- 172.21.15.76:0/821856741 >> 172.21.15.76:0/821856741 conn(0x7fad880764e0 msgr2=0x7fad88078920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:56:39.304 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.304+0000 7fad8f1b1700 1 -- 172.21.15.76:0/821856741 shutdown_connections 2024-06-02T04:56:39.305 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.304+0000 7fad8f1b1700 1 -- 172.21.15.76:0/821856741 wait complete. 2024-06-02T04:56:39.306 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.304+0000 7fad8f1b1700 1 Processor -- start 2024-06-02T04:56:39.306 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.305+0000 7fad8f1b1700 1 -- start start 2024-06-02T04:56:39.306 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.305+0000 7fad8f1b1700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fad88107540 0x7fad8806f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:56:39.306 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.305+0000 7fad8f1b1700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fad88108730 0x7fad8806fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:56:39.306 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.305+0000 7fad8f1b1700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fad881090d0 0x7fad8819c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:56:39.306 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.305+0000 7fad8f1b1700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad88070590 con 0x7fad88108730 2024-06-02T04:56:39.306 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.305+0000 7fad8f1b1700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad8819c9d0 con 0x7fad881090d0 2024-06-02T04:56:39.306 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.305+0000 7fad8f1b1700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad8819cb90 con 0x7fad88107540 2024-06-02T04:56:39.306 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.305+0000 7fad8d74e700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fad881090d0 0x7fad8819c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:56:39.306 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.305+0000 7fad87fff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fad88108730 0x7fad8806fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:56:39.306 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.305+0000 7fad87fff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fad88108730 0x7fad8806fee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:32972/0 (socket says 172.21.15.76:32972) 2024-06-02T04:56:39.307 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.305+0000 7fad87fff700 1 -- 172.21.15.76:0/627554262 learned_addr learned my addr 172.21.15.76:0/627554262 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:56:39.307 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.305+0000 7fad8cf4d700 1 --2- 172.21.15.76:0/627554262 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fad88107540 0x7fad8806f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:56:39.307 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.305+0000 7fad87fff700 1 -- 172.21.15.76:0/627554262 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fad88107540 msgr2=0x7fad8806f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:56:39.307 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.305+0000 7fad87fff700 1 --2- 172.21.15.76:0/627554262 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fad88107540 0x7fad8806f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:39.307 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.305+0000 7fad87fff700 1 -- 172.21.15.76:0/627554262 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fad881090d0 msgr2=0x7fad8819c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:56:39.308 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.305+0000 7fad87fff700 1 --2- 172.21.15.76:0/627554262 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fad881090d0 0x7fad8819c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:39.308 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.305+0000 7fad87fff700 1 -- 172.21.15.76:0/627554262 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad80009d00 con 0x7fad88108730 2024-06-02T04:56:39.308 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.306+0000 7fad87fff700 1 --2- 172.21.15.76:0/627554262 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fad88108730 0x7fad8806fee0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fad7c00d950 tx=0x7fad7c00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:56:39.308 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.306+0000 7fad85ffb700 1 -- 172.21.15.76:0/627554262 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad7c00f890 con 0x7fad88108730 2024-06-02T04:56:39.308 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.306+0000 7fad85ffb700 1 -- 172.21.15.76:0/627554262 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fad7c00fe80 con 0x7fad88108730 2024-06-02T04:56:39.308 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.306+0000 7fad85ffb700 1 -- 172.21.15.76:0/627554262 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad7c00e3b0 con 0x7fad88108730 2024-06-02T04:56:39.308 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.306+0000 7fad8f1b1700 1 -- 172.21.15.76:0/627554262 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad8819ce70 con 0x7fad88108730 2024-06-02T04:56:39.308 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.306+0000 7fad8f1b1700 1 -- 172.21.15.76:0/627554262 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad8819d330 con 0x7fad88108730 2024-06-02T04:56:39.313 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.312+0000 7fad9b36cb80 1 Processor -- start 2024-06-02T04:56:39.314 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.312+0000 7fad85ffb700 1 -- 172.21.15.76:0/627554262 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fad7c010460 con 0x7fad88108730 2024-06-02T04:56:39.314 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.313+0000 7fad85ffb700 1 --2- 172.21.15.76:0/627554262 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fad780a11a0 0x7fad780a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:56:39.314 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.313+0000 7fad9b36cb80 1 -- start start 2024-06-02T04:56:39.314 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.313+0000 7fad8d74e700 1 --2- 172.21.15.76:0/627554262 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fad780a11a0 0x7fad780a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:56:39.314 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.313+0000 7fad9b36cb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56386c2b8a80 0x56386c2b8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:56:39.314 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.313+0000 7fad9b36cb80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56386c2b93e0 0x56386c2b9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:56:39.314 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.313+0000 7fad9b36cb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56386c2ba2d0 0x56386c2ba750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:56:39.314 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.313+0000 7fad9b36cb80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x56386c2100f0 con 0x56386c2b93e0 2024-06-02T04:56:39.315 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.313+0000 7fad9b36cb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x56386c20dab0 con 0x56386c2ba2d0 2024-06-02T04:56:39.315 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.313+0000 7fad9b36cb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x56386c2093a0 con 0x56386c2b8a80 2024-06-02T04:56:39.315 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.314+0000 7fad8cf4d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56386c2b8a80 0x56386c2b8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:56:39.315 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.314+0000 7fad8d74e700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56386c2ba2d0 0x56386c2ba750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:56:39.316 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.314+0000 7fad8cf4d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56386c2b8a80 0x56386c2b8ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:36508/0 (socket says 172.21.15.76:36508) 2024-06-02T04:56:39.316 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.314+0000 7fad8cf4d700 1 -- 172.21.15.76:0/3993498571 learned_addr learned my addr 172.21.15.76:0/3993498571 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:56:39.316 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.314+0000 7fad8cf4d700 1 -- 172.21.15.76:0/3993498571 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56386c2ba2d0 msgr2=0x56386c2ba750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:56:39.316 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.314+0000 7fad8cf4d700 1 --2- 172.21.15.76:0/3993498571 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56386c2ba2d0 0x56386c2ba750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:39.316 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.314+0000 7fad8cf4d700 1 -- 172.21.15.76:0/3993498571 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56386c2b93e0 msgr2=0x56386c2b9cf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-02T04:56:39.316 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.314+0000 7fad8cf4d700 1 --2- 172.21.15.76:0/3993498571 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56386c2b93e0 0x56386c2b9cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:39.316 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.314+0000 7fad8cf4d700 1 -- 172.21.15.76:0/3993498571 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56386c08a350 con 0x56386c2b8a80 2024-06-02T04:56:39.316 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.314+0000 7fad85ffb700 1 -- 172.21.15.76:0/627554262 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7fad7c010760 con 0x7fad88108730 2024-06-02T04:56:39.316 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.315+0000 7fad8cf4d700 1 --2- 172.21.15.76:0/3993498571 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56386c2b8a80 0x56386c2b8ea0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fad74009cf0 tx=0x7fad74011440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f4719e4accdbef8e server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:56:39.319 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.315+0000 7fad72ffd700 1 -- 172.21.15.76:0/3993498571 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad74011e30 con 0x56386c2b8a80 2024-06-02T04:56:39.319 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.315+0000 7fad72ffd700 1 -- 172.21.15.76:0/3993498571 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fad74004cc0 con 0x56386c2b8a80 2024-06-02T04:56:39.319 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.315+0000 7fad72ffd700 1 -- 172.21.15.76:0/3993498571 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad74019430 con 0x56386c2b8a80 2024-06-02T04:56:39.319 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.316+0000 7fad9b36cb80 1 -- 172.21.15.76:0/3993498571 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56386c2b8a80 msgr2=0x56386c2b8ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:56:39.319 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.316+0000 7fad9b36cb80 1 --2- 172.21.15.76:0/3993498571 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56386c2b8a80 0x56386c2b8ea0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fad74009cf0 tx=0x7fad74011440 comp rx=0 tx=0).stop 2024-06-02T04:56:39.319 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.317+0000 7fad9b36cb80 1 -- 172.21.15.76:0/3993498571 shutdown_connections 2024-06-02T04:56:39.319 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.317+0000 7fad9b36cb80 1 --2- 172.21.15.76:0/3993498571 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56386c2ba2d0 0x56386c2ba750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:39.319 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.317+0000 7fad9b36cb80 1 --2- 172.21.15.76:0/3993498571 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56386c2b8a80 0x56386c2b8ea0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:39.320 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.317+0000 7fad9b36cb80 1 --2- 172.21.15.76:0/3993498571 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56386c2b93e0 0x56386c2b9cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:39.320 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.317+0000 7fad9b36cb80 1 -- 172.21.15.76:0/3993498571 >> 172.21.15.76:0/3993498571 conn(0x56386c2171b0 msgr2=0x56386c2b5440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:56:39.320 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.317+0000 7fad8d74e700 1 --2- 172.21.15.76:0/627554262 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fad780a11a0 0x7fad780a3660 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fad80009610 tx=0x7fad80007b90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:56:39.320 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.317+0000 7fad9b36cb80 1 -- 172.21.15.76:0/3993498571 shutdown_connections 2024-06-02T04:56:39.320 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.317+0000 7fad9b36cb80 1 -- 172.21.15.76:0/3993498571 wait complete. 2024-06-02T04:56:39.320 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.317+0000 7fad9b36cb80 1 -- start start 2024-06-02T04:56:39.320 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.317+0000 7fad9b36cb80 1 Processor -- start 2024-06-02T04:56:39.320 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.318+0000 7fad9b36cb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56386c2b8a80 0x56386c2c2890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:56:39.320 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.318+0000 7fad9b36cb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56386c2b93e0 0x56386c2c2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:56:39.320 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.318+0000 7fad9b36cb80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56386c2ba2d0 0x56386c2c9e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:56:39.320 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.318+0000 7fad9b36cb80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x56386c1a5500 con 0x56386c2ba2d0 2024-06-02T04:56:39.320 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.318+0000 7fad9b36cb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x56386c1a51a0 con 0x56386c2b93e0 2024-06-02T04:56:39.321 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.318+0000 7fad9b36cb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x56386c08c640 con 0x56386c2b8a80 2024-06-02T04:56:39.321 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.318+0000 7fad9b36cb80 10 client.0 _ll_register_callbacks cb 0x56386c1aead0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:56:39.321 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.318+0000 7fad8cf4d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56386c2b8a80 0x56386c2c2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:56:39.321 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.318+0000 7fad8cf4d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56386c2b8a80 0x56386c2c2890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:36522/0 (socket says 172.21.15.76:36522) 2024-06-02T04:56:39.321 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.318+0000 7fad8cf4d700 1 -- 172.21.15.76:0/4022408489 learned_addr learned my addr 172.21.15.76:0/4022408489 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:56:39.321 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.318+0000 7fad87fff700 1 --2- 172.21.15.76:0/4022408489 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56386c2b93e0 0x56386c2c2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:56:39.321 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.319+0000 7fad8d74e700 1 --2- 172.21.15.76:0/4022408489 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56386c2ba2d0 0x56386c2c9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:56:39.322 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.319+0000 7fad87fff700 1 -- 172.21.15.76:0/4022408489 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56386c2b8a80 msgr2=0x56386c2c2890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:56:39.322 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.319+0000 7fad87fff700 1 --2- 172.21.15.76:0/4022408489 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56386c2b8a80 0x56386c2c2890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:39.322 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.319+0000 7fad87fff700 1 -- 172.21.15.76:0/4022408489 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56386c2ba2d0 msgr2=0x56386c2c9e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:56:39.322 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.319+0000 7fad87fff700 1 --2- 172.21.15.76:0/4022408489 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56386c2ba2d0 0x56386c2c9e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:39.322 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.319+0000 7fad87fff700 1 -- 172.21.15.76:0/4022408489 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad74009920 con 0x56386c2b93e0 2024-06-02T04:56:39.322 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.319+0000 7fad8cf4d700 1 --2- 172.21.15.76:0/4022408489 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56386c2b8a80 0x56386c2c2890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:56:39.323 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.319+0000 7fad87fff700 1 --2- 172.21.15.76:0/4022408489 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56386c2b93e0 0x56386c2c2dd0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fad8819d4c0 tx=0x7fad7c098bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e783896b3b6b617 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:56:39.323 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.319+0000 7fad67fff700 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-06-02T04:56:39.323 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.319+0000 7fad67fff700 1 -- 172.21.15.76:0/4022408489 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad7c098630 con 0x56386c2b93e0 2024-06-02T04:56:39.323 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.319+0000 7fad67fff700 1 -- 172.21.15.76:0/4022408489 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7fad7c09cd70 con 0x56386c2b93e0 2024-06-02T04:56:39.323 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.319+0000 7fad9b36cb80 1 -- 172.21.15.76:0/4022408489 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56386c162210 con 0x56386c2b93e0 2024-06-02T04:56:39.323 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.320+0000 7fad67fff700 1 -- 172.21.15.76:0/4022408489 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fad7c0a13c0 con 0x56386c2b93e0 2024-06-02T04:56:39.323 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.320+0000 7fad9b36cb80 10 client.25796 fetch_fsmap learned FSMap version 34 2024-06-02T04:56:39.323 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.320+0000 7fad9b36cb80 1 -- 172.21.15.76:0/4022408489 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x56386c036b00 con 0x56386c2b93e0 2024-06-02T04:56:39.323 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.320+0000 7fad67fff700 1 -- 172.21.15.76:0/4022408489 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56386c162210 con 0x56386c2b93e0 2024-06-02T04:56:39.324 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.322+0000 7fad67fff700 1 -- 172.21.15.76:0/4022408489 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 34) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fad7c0cbd20 con 0x56386c2b93e0 2024-06-02T04:56:39.324 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.323+0000 7fad9b36cb80 10 client.25796 fetch_fsmap finished waiting for FSMap version 34 2024-06-02T04:56:39.324 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.323+0000 7fad9b36cb80 10 client.25796 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T04:56:39.324 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.323+0000 7fad9b36cb80 20 client.25796 populate_metadata read hostname 'smithi076' 2024-06-02T04:56:39.324 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.323+0000 7fad9b36cb80 1 --2- 172.21.15.76:0/4022408489 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x56386c2ce670 0x56386c2d0a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:56:39.324 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.323+0000 7fad9b36cb80 4 client.25796 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T04:56:39.324 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.323+0000 7fad9b36cb80 1 -- 172.21.15.76:0/4022408489 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56386c2887b0 con 0x56386c2ce670 2024-06-02T04:56:39.325 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.324+0000 7fad8cf4d700 1 --2- 172.21.15.76:0/4022408489 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x56386c2ce670 0x56386c2d0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:56:39.325 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.324+0000 7fad67fff700 10 client.25796 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:56:39.325 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.324+0000 7fad8cf4d700 1 --2- 172.21.15.76:0/4022408489 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x56386c2ce670 0x56386c2d0a90 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9eecc37c987be7b2 server_cookie=5787810da436d86e in_seq=0 out_seq=0 2024-06-02T04:56:39.327 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.327+0000 7fad67fff700 1 -- 172.21.15.76:0/4022408489 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56386c2887b0 con 0x56386c2ce670 2024-06-02T04:56:39.328 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.327+0000 7fad67fff700 10 client.25796 handle_command_reply: tid=0 2024-06-02T04:56:39.328 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.327+0000 7fad9b36cb80 1 client.25796 shutdown 2024-06-02T04:56:39.328 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.327+0000 7fad9b36cb80 1 -- 172.21.15.76:0/4022408489 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56386c2b93e0 msgr2=0x56386c2c2dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:56:39.328 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.327+0000 7fad9b36cb80 1 --2- 172.21.15.76:0/4022408489 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56386c2b93e0 0x56386c2c2dd0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fad8819d4c0 tx=0x7fad7c098bb0 comp rx=0 tx=0).stop 2024-06-02T04:56:39.328 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.327+0000 7fad9b36cb80 1 -- 172.21.15.76:0/4022408489 shutdown_connections 2024-06-02T04:56:39.328 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.327+0000 7fad9b36cb80 1 --2- 172.21.15.76:0/4022408489 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x56386c2ce670 0x56386c2d0a90 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:39.328 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.327+0000 7fad9b36cb80 1 --2- 172.21.15.76:0/4022408489 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56386c2ba2d0 0x56386c2c9e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:39.328 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.327+0000 7fad9b36cb80 1 --2- 172.21.15.76:0/4022408489 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56386c2b8a80 0x56386c2c2890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:39.328 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.327+0000 7fad9b36cb80 1 --2- 172.21.15.76:0/4022408489 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56386c2b93e0 0x56386c2c2dd0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:39.328 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.327+0000 7fad9b36cb80 1 -- 172.21.15.76:0/4022408489 >> 172.21.15.76:0/4022408489 conn(0x56386c2171b0 msgr2=0x56386c2b3860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:56:39.329 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.327+0000 7fad67fff700 0 client.25796 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:56:39.329 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.327+0000 7fad9b36cb80 1 -- 172.21.15.76:0/4022408489 shutdown_connections 2024-06-02T04:56:39.329 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.327+0000 7fad9b36cb80 1 -- 172.21.15.76:0/4022408489 wait complete. 2024-06-02T04:56:39.329 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.328+0000 7fad9b36cb80 20 client.25796 trim_cache size 0 max 16384 2024-06-02T04:56:39.359 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.353+0000 7fad9b36cb80 1 Processor -- start 2024-06-02T04:56:39.359 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.357+0000 7fad9b36cb80 1 -- start start 2024-06-02T04:56:39.359 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.358+0000 7fad9b36cb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56386c2b8a80 0x56386c2c1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:56:39.359 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.358+0000 7fad9b36cb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56386c2b93e0 0x56386c2c9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:56:39.359 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.358+0000 7fad9b36cb80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56386c2ba2d0 0x56386c2ba6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:56:39.359 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.358+0000 7fad9b36cb80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x56386c2ae330 con 0x56386c2ba2d0 2024-06-02T04:56:39.359 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.358+0000 7fad9b36cb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x56386c2c3790 con 0x56386c2b93e0 2024-06-02T04:56:39.359 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.358+0000 7fad9b36cb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x56386c2caf90 con 0x56386c2b8a80 2024-06-02T04:56:39.359 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.358+0000 7fad8d74e700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56386c2ba2d0 0x56386c2ba6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:56:39.360 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.358+0000 7fad8d74e700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56386c2ba2d0 0x56386c2ba6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:32982/0 (socket says 172.21.15.76:32982) 2024-06-02T04:56:39.360 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.358+0000 7fad8d74e700 1 -- 172.21.15.76:0/637199027 learned_addr learned my addr 172.21.15.76:0/637199027 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:56:39.360 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.358+0000 7fad87fff700 1 --2- 172.21.15.76:0/637199027 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56386c2b93e0 0x56386c2c9dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:56:39.360 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.358+0000 7fad8cf4d700 1 --2- 172.21.15.76:0/637199027 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56386c2b8a80 0x56386c2c1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:56:39.360 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.358+0000 7fad8d74e700 1 -- 172.21.15.76:0/637199027 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56386c2b8a80 msgr2=0x56386c2c1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:56:39.360 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.358+0000 7fad8d74e700 1 --2- 172.21.15.76:0/637199027 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56386c2b8a80 0x56386c2c1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:39.360 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.358+0000 7fad8d74e700 1 -- 172.21.15.76:0/637199027 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56386c2b93e0 msgr2=0x56386c2c9dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:56:39.360 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.358+0000 7fad8d74e700 1 --2- 172.21.15.76:0/637199027 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56386c2b93e0 0x56386c2c9dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:39.360 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.358+0000 7fad8d74e700 1 -- 172.21.15.76:0/637199027 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56386c1cf500 con 0x56386c2ba2d0 2024-06-02T04:56:39.361 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.359+0000 7fad8d74e700 1 --2- 172.21.15.76:0/637199027 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56386c2ba2d0 0x56386c2ba6b0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fad80009cd0 tx=0x7fad80023000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=639b46693febc3c4 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:56:39.361 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.359+0000 7fad737fe700 1 -- 172.21.15.76:0/637199027 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad8000e040 con 0x56386c2ba2d0 2024-06-02T04:56:39.361 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.359+0000 7fad737fe700 1 -- 172.21.15.76:0/637199027 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fad8000ce90 con 0x56386c2ba2d0 2024-06-02T04:56:39.361 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.359+0000 7fad737fe700 1 -- 172.21.15.76:0/637199027 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad80005ae0 con 0x56386c2ba2d0 2024-06-02T04:56:39.361 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.360+0000 7fad9b36cb80 1 -- 172.21.15.76:0/637199027 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56386c2ba2d0 msgr2=0x56386c2ba6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:56:39.361 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.360+0000 7fad9b36cb80 1 --2- 172.21.15.76:0/637199027 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56386c2ba2d0 0x56386c2ba6b0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fad80009cd0 tx=0x7fad80023000 comp rx=0 tx=0).stop 2024-06-02T04:56:39.363 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.362+0000 7fad9b36cb80 1 -- 172.21.15.76:0/637199027 shutdown_connections 2024-06-02T04:56:39.363 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.362+0000 7fad9b36cb80 1 --2- 172.21.15.76:0/637199027 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56386c2ba2d0 0x56386c2ba6b0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:39.363 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.362+0000 7fad9b36cb80 1 --2- 172.21.15.76:0/637199027 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56386c2b8a80 0x56386c2c1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:39.363 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.362+0000 7fad9b36cb80 1 --2- 172.21.15.76:0/637199027 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56386c2b93e0 0x56386c2c9dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:39.363 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.362+0000 7fad9b36cb80 1 -- 172.21.15.76:0/637199027 >> 172.21.15.76:0/637199027 conn(0x56386c2171b0 msgr2=0x56386c2c15d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:56:39.363 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.362+0000 7fad9b36cb80 1 -- 172.21.15.76:0/637199027 shutdown_connections 2024-06-02T04:56:39.363 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.362+0000 7fad9b36cb80 1 -- 172.21.15.76:0/637199027 wait complete. 2024-06-02T04:56:39.364 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.363+0000 7fad9b36cb80 1 -- start start 2024-06-02T04:56:39.364 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.363+0000 7fad9b36cb80 1 Processor -- start 2024-06-02T04:56:39.364 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.363+0000 7fad9b36cb80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56386c2b8a80 0x56386c2c6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:56:39.365 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.363+0000 7fad9b36cb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56386c2b93e0 0x56386c2c74f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:56:39.365 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.363+0000 7fad9b36cb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56386c2ba2d0 0x56386c322b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:56:39.365 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.363+0000 7fad9b36cb80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x56386c323090 con 0x56386c2b8a80 2024-06-02T04:56:39.365 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.363+0000 7fad9b36cb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x56386c3231d0 con 0x56386c2b93e0 2024-06-02T04:56:39.365 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.363+0000 7fad9b36cb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x56386c323310 con 0x56386c2ba2d0 2024-06-02T04:56:39.365 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.363+0000 7fad9b36cb80 10 client.0 _ll_register_callbacks cb 0x56386c1aead0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:56:39.365 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.364+0000 7fad8d74e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56386c2ba2d0 0x56386c322b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:56:39.365 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.364+0000 7fad8d74e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56386c2ba2d0 0x56386c322b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:36534/0 (socket says 172.21.15.76:36534) 2024-06-02T04:56:39.365 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.364+0000 7fad8d74e700 1 -- 172.21.15.76:0/640484378 learned_addr learned my addr 172.21.15.76:0/640484378 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:56:39.365 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.364+0000 7fad87fff700 1 --2- 172.21.15.76:0/640484378 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56386c2b93e0 0x56386c2c74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:56:39.365 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.364+0000 7fad8cf4d700 1 --2- 172.21.15.76:0/640484378 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56386c2b8a80 0x56386c2c6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:56:39.366 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.364+0000 7fad8d74e700 1 -- 172.21.15.76:0/640484378 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56386c2b93e0 msgr2=0x56386c2c74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:56:39.366 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.364+0000 7fad8d74e700 1 --2- 172.21.15.76:0/640484378 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56386c2b93e0 0x56386c2c74f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:39.366 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.364+0000 7fad8d74e700 1 -- 172.21.15.76:0/640484378 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56386c2b8a80 msgr2=0x56386c2c6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:56:39.367 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.364+0000 7fad8d74e700 1 --2- 172.21.15.76:0/640484378 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56386c2b8a80 0x56386c2c6fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:39.367 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.364+0000 7fad8d74e700 1 -- 172.21.15.76:0/640484378 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad881102d0 con 0x56386c2ba2d0 2024-06-02T04:56:39.367 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.364+0000 7fad8cf4d700 1 --2- 172.21.15.76:0/640484378 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56386c2b8a80 0x56386c2c6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:56:39.367 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.365+0000 7fad8d74e700 1 --2- 172.21.15.76:0/640484378 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56386c2ba2d0 0x56386c322b50 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fad8000b770 tx=0x7fad80005ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=499adbe8854cdcce server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:56:39.367 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.365+0000 7fad67fff700 10 client.0 ms_handle_connect on v2:172.21.15.192:3300/0 2024-06-02T04:56:39.367 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.365+0000 7fad67fff700 1 -- 172.21.15.76:0/640484378 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad80005040 con 0x56386c2ba2d0 2024-06-02T04:56:39.367 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.365+0000 7fad67fff700 1 -- 172.21.15.76:0/640484378 <== mon.1 v2:172.21.15.192:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7fad800051a0 con 0x56386c2ba2d0 2024-06-02T04:56:39.367 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.365+0000 7fad9b36cb80 1 -- 172.21.15.76:0/640484378 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fad74004cc0 con 0x56386c2ba2d0 2024-06-02T04:56:39.367 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.365+0000 7fad67fff700 1 -- 172.21.15.76:0/640484378 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fad80005360 con 0x56386c2ba2d0 2024-06-02T04:56:39.367 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.365+0000 7fad9b36cb80 10 client.25729 fetch_fsmap learned FSMap version 34 2024-06-02T04:56:39.367 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.365+0000 7fad9b36cb80 1 -- 172.21.15.76:0/640484378 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x56386c08ec70 con 0x56386c2ba2d0 2024-06-02T04:56:39.368 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.366+0000 7fad67fff700 1 -- 172.21.15.76:0/640484378 <== mon.1 v2:172.21.15.192:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fad74004cc0 con 0x56386c2ba2d0 2024-06-02T04:56:39.368 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.367+0000 7fad67fff700 1 -- 172.21.15.76:0/640484378 <== mon.1 v2:172.21.15.192:3300/0 5 ==== fsmap(e 34) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fad80041070 con 0x56386c2ba2d0 2024-06-02T04:56:39.368 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.367+0000 7fad9b36cb80 10 client.25729 fetch_fsmap finished waiting for FSMap version 34 2024-06-02T04:56:39.368 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.367+0000 7fad9b36cb80 10 client.25729 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T04:56:39.368 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.367+0000 7fad9b36cb80 20 client.25729 populate_metadata read hostname 'smithi076' 2024-06-02T04:56:39.369 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.367+0000 7fad9b36cb80 1 --2- 172.21.15.76:0/640484378 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x56386c3247b0 0x56386c326ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:56:39.369 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.367+0000 7fad9b36cb80 4 client.25729 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T04:56:39.369 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.367+0000 7fad9b36cb80 1 -- 172.21.15.76:0/640484378 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x56386c201e60 con 0x56386c3247b0 2024-06-02T04:56:39.369 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.367+0000 7fad8cf4d700 1 --2- 172.21.15.76:0/640484378 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x56386c3247b0 0x56386c326ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:56:39.369 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.368+0000 7fad8cf4d700 1 --2- 172.21.15.76:0/640484378 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x56386c3247b0 0x56386c326ba0 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4d4376e25b579ad3 server_cookie=126614978e0bcee in_seq=0 out_seq=0 2024-06-02T04:56:39.369 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.368+0000 7fad67fff700 10 client.25729 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:56:39.386 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.386+0000 7fad67fff700 1 -- 172.21.15.76:0/640484378 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x56386c201e60 con 0x56386c3247b0 2024-06-02T04:56:39.387 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.386+0000 7fad67fff700 10 client.25729 handle_command_reply: tid=0 2024-06-02T04:56:39.387 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.386+0000 7fad9b36cb80 1 client.25729 shutdown 2024-06-02T04:56:39.387 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.386+0000 7fad9b36cb80 1 -- 172.21.15.76:0/640484378 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56386c2ba2d0 msgr2=0x56386c322b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:56:39.387 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.386+0000 7fad9b36cb80 1 --2- 172.21.15.76:0/640484378 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56386c2ba2d0 0x56386c322b50 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fad8000b770 tx=0x7fad80005ad0 comp rx=0 tx=0).stop 2024-06-02T04:56:39.388 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.388+0000 7fad9b36cb80 1 -- 172.21.15.76:0/640484378 shutdown_connections 2024-06-02T04:56:39.389 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.388+0000 7fad9b36cb80 1 --2- 172.21.15.76:0/640484378 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x56386c3247b0 0x56386c326ba0 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:39.389 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.388+0000 7fad9b36cb80 1 --2- 172.21.15.76:0/640484378 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56386c2ba2d0 0x56386c322b50 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:39.389 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.388+0000 7fad9b36cb80 1 --2- 172.21.15.76:0/640484378 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56386c2b8a80 0x56386c2c6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:39.389 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.388+0000 7fad9b36cb80 1 --2- 172.21.15.76:0/640484378 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56386c2b93e0 0x56386c2c74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:39.389 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.388+0000 7fad67fff700 0 client.25729 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:56:39.389 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.388+0000 7fad9b36cb80 1 -- 172.21.15.76:0/640484378 >> 172.21.15.76:0/640484378 conn(0x56386c2171b0 msgr2=0x56386c2b5020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:56:39.389 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.388+0000 7fad9b36cb80 1 -- 172.21.15.76:0/640484378 shutdown_connections 2024-06-02T04:56:39.389 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.388+0000 7fad9b36cb80 1 -- 172.21.15.76:0/640484378 wait complete. 2024-06-02T04:56:39.390 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.389+0000 7fad9b36cb80 20 client.25729 trim_cache size 0 max 16384 2024-06-02T04:56:39.390 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:{ 2024-06-02T04:56:39.390 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "message": "", 2024-06-02T04:56:39.390 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "return_code": 0 2024-06-02T04:56:39.390 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:} 2024-06-02T04:56:39.391 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.389+0000 7fad8f1b1700 1 -- 172.21.15.76:0/627554262 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fad780a11a0 msgr2=0x7fad780a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:56:39.391 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.389+0000 7fad8f1b1700 1 --2- 172.21.15.76:0/627554262 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fad780a11a0 0x7fad780a3660 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fad80009610 tx=0x7fad80007b90 comp rx=0 tx=0).stop 2024-06-02T04:56:39.391 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.389+0000 7fad8f1b1700 1 -- 172.21.15.76:0/627554262 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fad88108730 msgr2=0x7fad8806fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:56:39.391 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.389+0000 7fad8f1b1700 1 --2- 172.21.15.76:0/627554262 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fad88108730 0x7fad8806fee0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fad7c00d950 tx=0x7fad7c00dc60 comp rx=0 tx=0).stop 2024-06-02T04:56:39.391 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.389+0000 7fad8f1b1700 1 -- 172.21.15.76:0/627554262 shutdown_connections 2024-06-02T04:56:39.391 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.389+0000 7fad8f1b1700 1 --2- 172.21.15.76:0/627554262 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fad780a11a0 0x7fad780a3660 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:39.391 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.389+0000 7fad8f1b1700 1 --2- 172.21.15.76:0/627554262 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fad881090d0 0x7fad8819c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:39.391 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.389+0000 7fad8f1b1700 1 --2- 172.21.15.76:0/627554262 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fad88107540 0x7fad8806f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:39.391 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.389+0000 7fad8f1b1700 1 --2- 172.21.15.76:0/627554262 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fad88108730 0x7fad8806fee0 secure :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fad7c00d950 tx=0x7fad7c00dc60 comp rx=0 tx=0).stop 2024-06-02T04:56:39.391 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.389+0000 7fad8f1b1700 1 -- 172.21.15.76:0/627554262 >> 172.21.15.76:0/627554262 conn(0x7fad880764e0 msgr2=0x7fad8810bb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:56:39.392 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.392+0000 7fad8f1b1700 1 -- 172.21.15.76:0/627554262 shutdown_connections 2024-06-02T04:56:39.392 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:39.392+0000 7fad8f1b1700 1 -- 172.21.15.76:0/627554262 wait complete. 2024-06-02T04:56:39.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:56:39 smithi076 ceph-mon[42935]: pgmap v480: 129 pgs: 129 active+clean; 1.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 8.6 MiB/s wr, 782 op/s 2024-06-02T04:56:39.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:56:39 smithi119 ceph-mon[46633]: pgmap v480: 129 pgs: 129 active+clean; 1.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 8.6 MiB/s wr, 782 op/s 2024-06-02T04:56:39.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:56:39 smithi192 ceph-mon[47933]: pgmap v480: 129 pgs: 129 active+clean; 1.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 8.6 MiB/s wr, 782 op/s 2024-06-02T04:56:41.317 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 350.0 s, 759.5 tps, lat 132.214 ms stddev 48.829 2024-06-02T04:56:41.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:56:41 smithi119 ceph-mon[46633]: pgmap v481: 129 pgs: 129 active+clean; 1.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 8.6 MiB/s wr, 799 op/s 2024-06-02T04:56:41.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:56:41 smithi192 ceph-mon[47933]: pgmap v481: 129 pgs: 129 active+clean; 1.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 8.6 MiB/s wr, 799 op/s 2024-06-02T04:56:41.985 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:56:41 smithi076 ceph-mon[42935]: pgmap v481: 129 pgs: 129 active+clean; 1.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 8.6 MiB/s wr, 799 op/s 2024-06-02T04:56:43.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:56:43 smithi119 ceph-mon[46633]: pgmap v482: 129 pgs: 129 active+clean; 1.5 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 8.5 MiB/s wr, 763 op/s 2024-06-02T04:56:43.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:56:43 smithi192 ceph-mon[47933]: pgmap v482: 129 pgs: 129 active+clean; 1.5 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 8.5 MiB/s wr, 763 op/s 2024-06-02T04:56:43.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:56:43 smithi076 ceph-mon[42935]: pgmap v482: 129 pgs: 129 active+clean; 1.5 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 8.5 MiB/s wr, 763 op/s 2024-06-02T04:56:45.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:56:45 smithi119 ceph-mon[46633]: pgmap v483: 129 pgs: 129 active+clean; 1.5 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 6.9 MiB/s wr, 682 op/s 2024-06-02T04:56:45.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:56:45 smithi192 ceph-mon[47933]: pgmap v483: 129 pgs: 129 active+clean; 1.5 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 6.9 MiB/s wr, 682 op/s 2024-06-02T04:56:45.985 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:56:45 smithi076 ceph-mon[42935]: pgmap v483: 129 pgs: 129 active+clean; 1.5 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 6.9 MiB/s wr, 682 op/s 2024-06-02T04:56:46.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 355.0 s, 775.2 tps, lat 129.193 ms stddev 42.407 2024-06-02T04:56:47.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:56:47 smithi119 ceph-mon[46633]: pgmap v484: 129 pgs: 129 active+clean; 1.5 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 7.4 MiB/s wr, 730 op/s 2024-06-02T04:56:47.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:56:47 smithi192 ceph-mon[47933]: pgmap v484: 129 pgs: 129 active+clean; 1.5 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 7.4 MiB/s wr, 730 op/s 2024-06-02T04:56:47.987 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:56:47 smithi076 ceph-mon[42935]: pgmap v484: 129 pgs: 129 active+clean; 1.5 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 7.4 MiB/s wr, 730 op/s 2024-06-02T04:56:49.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:56:49 smithi119 ceph-mon[46633]: pgmap v485: 129 pgs: 129 active+clean; 1.5 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 7.3 MiB/s wr, 711 op/s 2024-06-02T04:56:49.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:56:49 smithi192 ceph-mon[47933]: pgmap v485: 129 pgs: 129 active+clean; 1.5 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 7.3 MiB/s wr, 711 op/s 2024-06-02T04:56:49.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:56:49 smithi076 ceph-mon[42935]: pgmap v485: 129 pgs: 129 active+clean; 1.5 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 7.3 MiB/s wr, 711 op/s 2024-06-02T04:56:50.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:56:50 smithi119 ceph-mon[46633]: pgmap v486: 129 pgs: 129 active+clean; 1.5 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 8.6 MiB/s wr, 800 op/s 2024-06-02T04:56:50.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:56:50 smithi192 ceph-mon[47933]: pgmap v486: 129 pgs: 129 active+clean; 1.5 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 8.6 MiB/s wr, 800 op/s 2024-06-02T04:56:50.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:56:50 smithi076 ceph-mon[42935]: pgmap v486: 129 pgs: 129 active+clean; 1.5 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 8.6 MiB/s wr, 800 op/s 2024-06-02T04:56:51.319 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 360.0 s, 822.9 tps, lat 120.857 ms stddev 42.310 2024-06-02T04:56:52.580 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.579+0000 7f474bdf0700 1 -- 172.21.15.76:0/108743075 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4744107540 msgr2=0x7f4744107960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:56:52.581 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.579+0000 7f474bdf0700 1 --2- 172.21.15.76:0/108743075 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4744107540 0x7f4744107960 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4740009990 tx=0x7f4740009ca0 comp rx=0 tx=0).stop 2024-06-02T04:56:52.581 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.579+0000 7f474bdf0700 1 -- 172.21.15.76:0/108743075 shutdown_connections 2024-06-02T04:56:52.581 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.579+0000 7f474bdf0700 1 --2- 172.21.15.76:0/108743075 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f47441090d0 0x7f474410f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:52.581 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.579+0000 7f474bdf0700 1 --2- 172.21.15.76:0/108743075 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4744107540 0x7f4744107960 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:52.581 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.579+0000 7f474bdf0700 1 --2- 172.21.15.76:0/108743075 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4744108730 0x7f4744108b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:52.581 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.579+0000 7f474bdf0700 1 -- 172.21.15.76:0/108743075 >> 172.21.15.76:0/108743075 conn(0x7f47440764d0 msgr2=0x7f4744078910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:56:52.581 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.580+0000 7f474bdf0700 1 -- 172.21.15.76:0/108743075 shutdown_connections 2024-06-02T04:56:52.581 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.580+0000 7f474bdf0700 1 -- 172.21.15.76:0/108743075 wait complete. 2024-06-02T04:56:52.586 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.580+0000 7f474bdf0700 1 Processor -- start 2024-06-02T04:56:52.586 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.580+0000 7f474bdf0700 1 -- start start 2024-06-02T04:56:52.586 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.581+0000 7f474bdf0700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4744107540 0x7f474407e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:56:52.586 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.581+0000 7f474bdf0700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4744108730 0x7f474407ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:56:52.586 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.581+0000 7f474bdf0700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f47441090d0 0x7f474419c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:56:52.587 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.581+0000 7f474bdf0700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f474407f260 con 0x7f4744107540 2024-06-02T04:56:52.587 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.581+0000 7f474bdf0700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f474407f3d0 con 0x7f4744108730 2024-06-02T04:56:52.587 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.581+0000 7f474bdf0700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f474419cb10 con 0x7f47441090d0 2024-06-02T04:56:52.587 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.581+0000 7f474938b700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4744108730 0x7f474407ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:56:52.587 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.581+0000 7f474938b700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4744108730 0x7f474407ec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:52804/0 (socket says 172.21.15.76:52804) 2024-06-02T04:56:52.587 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.581+0000 7f474938b700 1 -- 172.21.15.76:0/1429795569 learned_addr learned my addr 172.21.15.76:0/1429795569 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:56:52.587 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.581+0000 7f474a38d700 1 --2- 172.21.15.76:0/1429795569 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f47441090d0 0x7f474419c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:56:52.587 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.581+0000 7f474a38d700 1 -- 172.21.15.76:0/1429795569 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4744108730 msgr2=0x7f474407ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:56:52.587 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.581+0000 7f474a38d700 1 --2- 172.21.15.76:0/1429795569 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4744108730 0x7f474407ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:52.587 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.581+0000 7f474a38d700 1 -- 172.21.15.76:0/1429795569 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4744107540 msgr2=0x7f474407e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:56:52.587 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.581+0000 7f474a38d700 1 --2- 172.21.15.76:0/1429795569 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4744107540 0x7f474407e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:52.587 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.581+0000 7f474a38d700 1 -- 172.21.15.76:0/1429795569 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47400095f0 con 0x7f47441090d0 2024-06-02T04:56:52.588 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.581+0000 7f474938b700 1 --2- 172.21.15.76:0/1429795569 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4744108730 0x7f474407ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T04:56:52.588 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.585+0000 7f474a38d700 1 --2- 172.21.15.76:0/1429795569 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f47441090d0 0x7f474419c550 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f473c00efc0 tx=0x7f473c00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:56:52.588 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.585+0000 7f473affd700 1 -- 172.21.15.76:0/1429795569 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f473c018070 con 0x7f47441090d0 2024-06-02T04:56:52.588 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.585+0000 7f474bdf0700 1 -- 172.21.15.76:0/1429795569 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f474419cd90 con 0x7f47441090d0 2024-06-02T04:56:52.588 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.585+0000 7f473affd700 1 -- 172.21.15.76:0/1429795569 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f473c00f040 con 0x7f47441090d0 2024-06-02T04:56:52.588 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.585+0000 7f473affd700 1 -- 172.21.15.76:0/1429795569 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f473c00cc50 con 0x7f47441090d0 2024-06-02T04:56:52.590 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.585+0000 7f474bdf0700 1 -- 172.21.15.76:0/1429795569 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f474419d2a0 con 0x7f47441090d0 2024-06-02T04:56:52.590 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.589+0000 7f4757fabb80 1 Processor -- start 2024-06-02T04:56:52.592 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.592+0000 7f473affd700 1 -- 172.21.15.76:0/1429795569 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f473c003a00 con 0x7f47441090d0 2024-06-02T04:56:52.592 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.592+0000 7f4757fabb80 1 -- start start 2024-06-02T04:56:52.594 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.593+0000 7f473affd700 1 --2- 172.21.15.76:0/1429795569 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f47300a11a0 0x7f47300a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:56:52.595 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.593+0000 7f473affd700 1 -- 172.21.15.76:0/1429795569 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f473c0cbf70 con 0x7f47441090d0 2024-06-02T04:56:52.595 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.593+0000 7f474938b700 1 --2- 172.21.15.76:0/1429795569 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f47300a11a0 0x7f47300a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:56:52.595 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.593+0000 7f4757fabb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564dee702a80 0x564dee702ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:56:52.595 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.593+0000 7f4757fabb80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564dee7033e0 0x564dee703cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:56:52.595 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.593+0000 7f4757fabb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564dee7042d0 0x564dee704750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:56:52.595 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.593+0000 7f4757fabb80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x564dee65a0f0 con 0x564dee7033e0 2024-06-02T04:56:52.595 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.593+0000 7f4757fabb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x564dee657ab0 con 0x564dee7042d0 2024-06-02T04:56:52.595 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.593+0000 7f4757fabb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x564dee6533a0 con 0x564dee702a80 2024-06-02T04:56:52.595 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.593+0000 7f4749b8c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564dee702a80 0x564dee702ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:56:52.595 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.593+0000 7f4749b8c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564dee702a80 0x564dee702ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:42664/0 (socket says 172.21.15.76:42664) 2024-06-02T04:56:52.595 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.593+0000 7f4749b8c700 1 -- 172.21.15.76:0/257369101 learned_addr learned my addr 172.21.15.76:0/257369101 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:56:52.596 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.594+0000 7f474a38d700 1 --2- 172.21.15.76:0/257369101 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564dee7042d0 0x564dee704750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:56:52.596 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.594+0000 7f474938b700 1 --2- 172.21.15.76:0/257369101 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564dee7033e0 0x564dee703cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:56:52.596 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.594+0000 7f474a38d700 1 -- 172.21.15.76:0/257369101 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564dee702a80 msgr2=0x564dee702ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:56:52.596 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.594+0000 7f474a38d700 1 --2- 172.21.15.76:0/257369101 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564dee702a80 0x564dee702ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:52.596 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.594+0000 7f474a38d700 1 -- 172.21.15.76:0/257369101 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564dee7033e0 msgr2=0x564dee703cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:56:52.596 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.594+0000 7f474a38d700 1 --2- 172.21.15.76:0/257369101 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564dee7033e0 0x564dee703cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:52.596 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.594+0000 7f474a38d700 1 -- 172.21.15.76:0/257369101 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564dee4d4350 con 0x564dee7042d0 2024-06-02T04:56:52.596 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.594+0000 7f474a38d700 1 --2- 172.21.15.76:0/257369101 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564dee7042d0 0x564dee704750 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f473c0c96d0 tx=0x7f473c098e70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a39fec61a232edb6 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:56:52.596 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.594+0000 7f472ffff700 1 -- 172.21.15.76:0/257369101 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f473c0092e0 con 0x564dee7042d0 2024-06-02T04:56:52.596 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.594+0000 7f472ffff700 1 -- 172.21.15.76:0/257369101 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f473c099720 con 0x564dee7042d0 2024-06-02T04:56:52.596 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.594+0000 7f472ffff700 1 -- 172.21.15.76:0/257369101 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f473c0994e0 con 0x564dee7042d0 2024-06-02T04:56:52.597 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.595+0000 7f4757fabb80 1 -- 172.21.15.76:0/257369101 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564dee7042d0 msgr2=0x564dee704750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:56:52.597 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.595+0000 7f474938b700 1 --2- 172.21.15.76:0/1429795569 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f47300a11a0 0x7f47300a3660 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f474407f7f0 tx=0x7f473400e4b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:56:52.597 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.595+0000 7f4757fabb80 1 --2- 172.21.15.76:0/257369101 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564dee7042d0 0x564dee704750 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f473c0c96d0 tx=0x7f473c098e70 comp rx=0 tx=0).stop 2024-06-02T04:56:52.600 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.599+0000 7f4757fabb80 1 -- 172.21.15.76:0/257369101 shutdown_connections 2024-06-02T04:56:52.600 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.599+0000 7f4757fabb80 1 --2- 172.21.15.76:0/257369101 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564dee7042d0 0x564dee704750 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:52.600 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.599+0000 7f4757fabb80 1 --2- 172.21.15.76:0/257369101 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564dee702a80 0x564dee702ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:52.600 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.599+0000 7f4757fabb80 1 --2- 172.21.15.76:0/257369101 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564dee7033e0 0x564dee703cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:52.600 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.599+0000 7f4757fabb80 1 -- 172.21.15.76:0/257369101 >> 172.21.15.76:0/257369101 conn(0x564dee6611b0 msgr2=0x564dee6ff440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:56:52.600 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.600+0000 7f4757fabb80 1 -- 172.21.15.76:0/257369101 shutdown_connections 2024-06-02T04:56:52.600 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.600+0000 7f4757fabb80 1 -- 172.21.15.76:0/257369101 wait complete. 2024-06-02T04:56:52.601 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.600+0000 7f4757fabb80 1 -- start start 2024-06-02T04:56:52.601 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.600+0000 7f4757fabb80 1 Processor -- start 2024-06-02T04:56:52.603 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.601+0000 7f4757fabb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564dee702a80 0x564dee70c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:56:52.603 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.601+0000 7f4757fabb80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564dee7033e0 0x564dee70ce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:56:52.603 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.601+0000 7f4757fabb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564dee7042d0 0x564dee713e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:56:52.603 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.601+0000 7f4757fabb80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x564dee5ef500 con 0x564dee7033e0 2024-06-02T04:56:52.603 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.601+0000 7f4757fabb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x564dee5ef1a0 con 0x564dee7042d0 2024-06-02T04:56:52.604 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.601+0000 7f4757fabb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x564dee4d6640 con 0x564dee702a80 2024-06-02T04:56:52.604 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.601+0000 7f4757fabb80 10 client.0 _ll_register_callbacks cb 0x564dee5f8ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:56:52.604 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.601+0000 7f474a38d700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564dee7042d0 0x564dee713e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:56:52.604 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.601+0000 7f474a38d700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564dee7042d0 0x564dee713e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:52826/0 (socket says 172.21.15.76:52826) 2024-06-02T04:56:52.604 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.601+0000 7f474a38d700 1 -- 172.21.15.76:0/1468241341 learned_addr learned my addr 172.21.15.76:0/1468241341 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:56:52.604 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.601+0000 7f4749b8c700 1 --2- 172.21.15.76:0/1468241341 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564dee702a80 0x564dee70c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:56:52.604 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.601+0000 7f474a38d700 1 -- 172.21.15.76:0/1468241341 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564dee702a80 msgr2=0x564dee70c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:56:52.604 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.601+0000 7f474a38d700 1 --2- 172.21.15.76:0/1468241341 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564dee702a80 0x564dee70c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:52.604 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.601+0000 7f474a38d700 1 -- 172.21.15.76:0/1468241341 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564dee7033e0 msgr2=0x564dee70ce10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-02T04:56:52.604 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.601+0000 7f474a38d700 1 --2- 172.21.15.76:0/1468241341 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564dee7033e0 0x564dee70ce10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:52.604 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.601+0000 7f474a38d700 1 -- 172.21.15.76:0/1468241341 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f474419d2a0 con 0x564dee7042d0 2024-06-02T04:56:52.604 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.601+0000 7f4749b8c700 1 --2- 172.21.15.76:0/1468241341 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564dee702a80 0x564dee70c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:56:52.604 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.602+0000 7f474a38d700 1 --2- 172.21.15.76:0/1468241341 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564dee7042d0 0x564dee713e50 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f473c00ef90 tx=0x7f473c009390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=36dbd9eb5c113c25 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:56:52.605 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.602+0000 7f472d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-06-02T04:56:52.605 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.602+0000 7f472d7fa700 1 -- 172.21.15.76:0/1468241341 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f473c0a14a0 con 0x564dee7042d0 2024-06-02T04:56:52.605 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.602+0000 7f4757fabb80 1 -- 172.21.15.76:0/1468241341 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564dee5ac210 con 0x564dee7042d0 2024-06-02T04:56:52.605 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.602+0000 7f472d7fa700 1 -- 172.21.15.76:0/1468241341 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f473c0b1bd0 con 0x564dee7042d0 2024-06-02T04:56:52.605 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.602+0000 7f472d7fa700 1 -- 172.21.15.76:0/1468241341 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f473c0b1d90 con 0x564dee7042d0 2024-06-02T04:56:52.605 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.602+0000 7f4757fabb80 10 client.25814 fetch_fsmap learned FSMap version 34 2024-06-02T04:56:52.605 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.602+0000 7f4757fabb80 1 -- 172.21.15.76:0/1468241341 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x564dee480b00 con 0x564dee7042d0 2024-06-02T04:56:52.605 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.602+0000 7f472d7fa700 1 -- 172.21.15.76:0/1468241341 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f473c0a5020 con 0x564dee7042d0 2024-06-02T04:56:52.606 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.603+0000 7f472d7fa700 1 -- 172.21.15.76:0/1468241341 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 34) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f473c0c9c20 con 0x564dee7042d0 2024-06-02T04:56:52.606 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.603+0000 7f4757fabb80 10 client.25814 fetch_fsmap finished waiting for FSMap version 34 2024-06-02T04:56:52.607 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.603+0000 7f4757fabb80 10 client.25814 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T04:56:52.607 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.603+0000 7f4757fabb80 20 client.25814 populate_metadata read hostname 'smithi076' 2024-06-02T04:56:52.607 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.603+0000 7f4757fabb80 1 --2- 172.21.15.76:0/1468241341 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x564dee729380 0x564dee72b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:56:52.607 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.603+0000 7f4757fabb80 4 client.25814 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T04:56:52.607 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.603+0000 7f4757fabb80 1 -- 172.21.15.76:0/1468241341 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564dee6d27b0 con 0x564dee729380 2024-06-02T04:56:52.607 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.603+0000 7f4749b8c700 1 --2- 172.21.15.76:0/1468241341 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x564dee729380 0x564dee72b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:56:52.607 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.604+0000 7f472d7fa700 10 client.25814 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:56:52.607 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.604+0000 7f4749b8c700 1 --2- 172.21.15.76:0/1468241341 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x564dee729380 0x564dee72b7a0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=606b40824104d6b9 server_cookie=df4ec8aa5d78b655 in_seq=0 out_seq=0 2024-06-02T04:56:52.607 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.604+0000 7f472d7fa700 1 -- 172.21.15.76:0/1468241341 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x564dee6d27b0 con 0x564dee729380 2024-06-02T04:56:52.607 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.605+0000 7f472d7fa700 10 client.25814 handle_command_reply: tid=0 2024-06-02T04:56:52.607 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.605+0000 7f4757fabb80 1 client.25814 shutdown 2024-06-02T04:56:52.607 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.605+0000 7f4757fabb80 1 -- 172.21.15.76:0/1468241341 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564dee7042d0 msgr2=0x564dee713e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:56:52.608 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.605+0000 7f4757fabb80 1 --2- 172.21.15.76:0/1468241341 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564dee7042d0 0x564dee713e50 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f473c00ef90 tx=0x7f473c009390 comp rx=0 tx=0).stop 2024-06-02T04:56:52.608 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.606+0000 7f4757fabb80 1 -- 172.21.15.76:0/1468241341 shutdown_connections 2024-06-02T04:56:52.608 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.606+0000 7f4757fabb80 1 --2- 172.21.15.76:0/1468241341 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x564dee729380 0x564dee72b7a0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:52.608 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.606+0000 7f4757fabb80 1 --2- 172.21.15.76:0/1468241341 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564dee7042d0 0x564dee713e50 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:52.608 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.606+0000 7f4757fabb80 1 --2- 172.21.15.76:0/1468241341 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564dee702a80 0x564dee70c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:52.608 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.606+0000 7f4757fabb80 1 --2- 172.21.15.76:0/1468241341 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564dee7033e0 0x564dee70ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:52.608 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.606+0000 7f4757fabb80 1 -- 172.21.15.76:0/1468241341 >> 172.21.15.76:0/1468241341 conn(0x564dee6611b0 msgr2=0x564dee6fd860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:56:52.608 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.606+0000 7f472d7fa700 0 client.25814 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:56:52.609 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.606+0000 7f4757fabb80 1 -- 172.21.15.76:0/1468241341 shutdown_connections 2024-06-02T04:56:52.609 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.607+0000 7f4757fabb80 1 -- 172.21.15.76:0/1468241341 wait complete. 2024-06-02T04:56:52.609 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.607+0000 7f4757fabb80 20 client.25814 trim_cache size 0 max 16384 2024-06-02T04:56:52.634 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.632+0000 7f4757fabb80 1 Processor -- start 2024-06-02T04:56:52.634 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.632+0000 7f4757fabb80 1 -- start start 2024-06-02T04:56:52.634 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.632+0000 7f4757fabb80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564dee702a80 0x564dee72b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:56:52.634 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.632+0000 7f4757fabb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564dee7033e0 0x564dee713e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:56:52.634 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.632+0000 7f4757fabb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564dee7042d0 0x564dee7046d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:56:52.634 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.632+0000 7f4757fabb80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x564dee6fe930 con 0x564dee702a80 2024-06-02T04:56:52.634 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.632+0000 7f4757fabb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x564dee70dac0 con 0x564dee7033e0 2024-06-02T04:56:52.634 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.632+0000 7f4757fabb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x564dee72be00 con 0x564dee7042d0 2024-06-02T04:56:52.635 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.633+0000 7f474a38d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564dee7042d0 0x564dee7046d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:56:52.635 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.633+0000 7f474a38d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564dee7042d0 0x564dee7046d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:42684/0 (socket says 172.21.15.76:42684) 2024-06-02T04:56:52.635 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.633+0000 7f474a38d700 1 -- 172.21.15.76:0/4231228757 learned_addr learned my addr 172.21.15.76:0/4231228757 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:56:52.635 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.633+0000 7f474938b700 1 --2- 172.21.15.76:0/4231228757 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564dee7033e0 0x564dee713e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:56:52.635 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.633+0000 7f474a38d700 1 -- 172.21.15.76:0/4231228757 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564dee7033e0 msgr2=0x564dee713e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:56:52.635 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.633+0000 7f474a38d700 1 --2- 172.21.15.76:0/4231228757 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564dee7033e0 0x564dee713e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:52.635 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.633+0000 7f474a38d700 1 -- 172.21.15.76:0/4231228757 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564dee702a80 msgr2=0x564dee72b7a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-02T04:56:52.635 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.633+0000 7f474a38d700 1 --2- 172.21.15.76:0/4231228757 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564dee702a80 0x564dee72b7a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:52.635 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.633+0000 7f474a38d700 1 -- 172.21.15.76:0/4231228757 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564dee619500 con 0x564dee7042d0 2024-06-02T04:56:52.635 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.633+0000 7f474a38d700 1 --2- 172.21.15.76:0/4231228757 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564dee7042d0 0x564dee7046d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f473c095a90 tx=0x7f473c095430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d8e3ad7b3399c72a server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:56:52.638 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.638+0000 7f4738ff9700 1 -- 172.21.15.76:0/4231228757 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f473c097430 con 0x564dee7042d0 2024-06-02T04:56:52.638 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.638+0000 7f4738ff9700 1 -- 172.21.15.76:0/4231228757 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f473c0a5070 con 0x564dee7042d0 2024-06-02T04:56:52.638 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.638+0000 7f4738ff9700 1 -- 172.21.15.76:0/4231228757 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f473c0c9b90 con 0x564dee7042d0 2024-06-02T04:56:52.639 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.639+0000 7f4757fabb80 1 -- 172.21.15.76:0/4231228757 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564dee7042d0 msgr2=0x564dee7046d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:56:52.639 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.639+0000 7f4757fabb80 1 --2- 172.21.15.76:0/4231228757 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564dee7042d0 0x564dee7046d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f473c095a90 tx=0x7f473c095430 comp rx=0 tx=0).stop 2024-06-02T04:56:52.639 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.639+0000 7f4757fabb80 1 -- 172.21.15.76:0/4231228757 shutdown_connections 2024-06-02T04:56:52.640 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.639+0000 7f4757fabb80 1 --2- 172.21.15.76:0/4231228757 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564dee7042d0 0x564dee7046d0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:52.640 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.639+0000 7f4757fabb80 1 --2- 172.21.15.76:0/4231228757 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564dee702a80 0x564dee72b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:52.640 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.639+0000 7f4757fabb80 1 --2- 172.21.15.76:0/4231228757 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564dee7033e0 0x564dee713e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:52.640 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.639+0000 7f4757fabb80 1 -- 172.21.15.76:0/4231228757 >> 172.21.15.76:0/4231228757 conn(0x564dee6611b0 msgr2=0x564dee7300c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:56:52.640 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.639+0000 7f4757fabb80 1 -- 172.21.15.76:0/4231228757 shutdown_connections 2024-06-02T04:56:52.640 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.639+0000 7f4757fabb80 1 -- 172.21.15.76:0/4231228757 wait complete. 2024-06-02T04:56:52.640 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.639+0000 7f4757fabb80 1 -- start start 2024-06-02T04:56:52.640 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.639+0000 7f4757fabb80 1 Processor -- start 2024-06-02T04:56:52.641 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.640+0000 7f4757fabb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564dee702a80 0x564dee711450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:56:52.641 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.640+0000 7f4757fabb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564dee7033e0 0x564dee711990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:56:52.641 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.640+0000 7f4757fabb80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564dee7042d0 0x564dee712950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:56:52.641 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.640+0000 7f4757fabb80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x564dee712e90 con 0x564dee7042d0 2024-06-02T04:56:52.642 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.640+0000 7f4757fabb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x564dee713000 con 0x564dee7033e0 2024-06-02T04:56:52.642 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.640+0000 7f4757fabb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x564dee7131c0 con 0x564dee702a80 2024-06-02T04:56:52.642 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.640+0000 7f4757fabb80 10 client.0 _ll_register_callbacks cb 0x564dee5f8ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:56:52.642 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.640+0000 7f4749b8c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564dee702a80 0x564dee711450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:56:52.642 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.640+0000 7f4749b8c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564dee702a80 0x564dee711450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:42694/0 (socket says 172.21.15.76:42694) 2024-06-02T04:56:52.642 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.640+0000 7f4749b8c700 1 -- 172.21.15.76:0/362994276 learned_addr learned my addr 172.21.15.76:0/362994276 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:56:52.642 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.640+0000 7f474938b700 1 --2- 172.21.15.76:0/362994276 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564dee7033e0 0x564dee711990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:56:52.642 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.641+0000 7f4749b8c700 1 -- 172.21.15.76:0/362994276 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564dee7033e0 msgr2=0x564dee711990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:56:52.642 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.641+0000 7f4749b8c700 1 --2- 172.21.15.76:0/362994276 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564dee7033e0 0x564dee711990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:52.642 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.641+0000 7f4749b8c700 1 -- 172.21.15.76:0/362994276 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564dee7042d0 msgr2=0x564dee712950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:56:52.642 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.641+0000 7f4749b8c700 1 --2- 172.21.15.76:0/362994276 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564dee7042d0 0x564dee712950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:52.642 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.641+0000 7f4749b8c700 1 -- 172.21.15.76:0/362994276 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564dee480b00 con 0x564dee702a80 2024-06-02T04:56:52.643 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.641+0000 7f4749b8c700 1 --2- 172.21.15.76:0/362994276 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564dee702a80 0x564dee711450 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4740009990 tx=0x7f4740005c50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bef2dc6ff903d96e server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:56:52.643 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.641+0000 7f472d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.192:3300/0 2024-06-02T04:56:52.643 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.641+0000 7f472d7fa700 1 -- 172.21.15.76:0/362994276 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4740025440 con 0x564dee702a80 2024-06-02T04:56:52.643 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.641+0000 7f472d7fa700 1 -- 172.21.15.76:0/362994276 <== mon.1 v2:172.21.15.192:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f47400255a0 con 0x564dee702a80 2024-06-02T04:56:52.643 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.641+0000 7f4757fabb80 1 -- 172.21.15.76:0/362994276 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f473c099720 con 0x564dee702a80 2024-06-02T04:56:52.647 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.646+0000 7f472d7fa700 1 -- 172.21.15.76:0/362994276 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4740025760 con 0x564dee702a80 2024-06-02T04:56:52.647 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.647+0000 7f4757fabb80 10 client.25747 fetch_fsmap learned FSMap version 34 2024-06-02T04:56:52.647 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.647+0000 7f4757fabb80 1 -- 172.21.15.76:0/362994276 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x564dee4d8c70 con 0x564dee702a80 2024-06-02T04:56:52.649 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.647+0000 7f472d7fa700 1 -- 172.21.15.76:0/362994276 <== mon.1 v2:172.21.15.192:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f473c099720 con 0x564dee702a80 2024-06-02T04:56:52.649 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.647+0000 7f472d7fa700 1 -- 172.21.15.76:0/362994276 <== mon.1 v2:172.21.15.192:3300/0 5 ==== fsmap(e 34) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f4740023040 con 0x564dee702a80 2024-06-02T04:56:52.649 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.647+0000 7f4757fabb80 10 client.25747 fetch_fsmap finished waiting for FSMap version 34 2024-06-02T04:56:52.649 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.647+0000 7f4757fabb80 10 client.25747 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T04:56:52.649 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.647+0000 7f4757fabb80 20 client.25747 populate_metadata read hostname 'smithi076' 2024-06-02T04:56:52.649 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.647+0000 7f4757fabb80 1 --2- 172.21.15.76:0/362994276 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x564dee71ace0 0x564dee71d100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:56:52.649 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.647+0000 7f4757fabb80 4 client.25747 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T04:56:52.649 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.647+0000 7f4757fabb80 1 -- 172.21.15.76:0/362994276 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x564dee64be60 con 0x564dee71ace0 2024-06-02T04:56:52.649 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.647+0000 7f474938b700 1 --2- 172.21.15.76:0/362994276 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x564dee71ace0 0x564dee71d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:56:52.649 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.648+0000 7f472d7fa700 10 client.25747 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:56:52.649 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.648+0000 7f474938b700 1 --2- 172.21.15.76:0/362994276 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x564dee71ace0 0x564dee71d100 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=841264eb96f884f server_cookie=e6ce0d70a87432e7 in_seq=0 out_seq=0 2024-06-02T04:56:52.674 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.673+0000 7f472d7fa700 1 -- 172.21.15.76:0/362994276 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x564dee64be60 con 0x564dee71ace0 2024-06-02T04:56:52.674 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.673+0000 7f472d7fa700 10 client.25747 handle_command_reply: tid=0 2024-06-02T04:56:52.674 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.673+0000 7f4757fabb80 1 client.25747 shutdown 2024-06-02T04:56:52.674 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.673+0000 7f4757fabb80 1 -- 172.21.15.76:0/362994276 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564dee702a80 msgr2=0x564dee711450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:56:52.674 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.673+0000 7f4757fabb80 1 --2- 172.21.15.76:0/362994276 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564dee702a80 0x564dee711450 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4740009990 tx=0x7f4740005c50 comp rx=0 tx=0).stop 2024-06-02T04:56:52.674 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.674+0000 7f4757fabb80 1 -- 172.21.15.76:0/362994276 shutdown_connections 2024-06-02T04:56:52.675 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.674+0000 7f4757fabb80 1 --2- 172.21.15.76:0/362994276 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x564dee71ace0 0x564dee71d100 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:52.675 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.674+0000 7f4757fabb80 1 --2- 172.21.15.76:0/362994276 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564dee7042d0 0x564dee712950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:52.675 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.674+0000 7f4757fabb80 1 --2- 172.21.15.76:0/362994276 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564dee702a80 0x564dee711450 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:52.675 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.674+0000 7f4757fabb80 1 --2- 172.21.15.76:0/362994276 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564dee7033e0 0x564dee711990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:52.675 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.674+0000 7f4757fabb80 1 -- 172.21.15.76:0/362994276 >> 172.21.15.76:0/362994276 conn(0x564dee6611b0 msgr2=0x564dee6ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:56:52.675 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.674+0000 7f472d7fa700 0 client.25747 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:56:52.678 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.677+0000 7f4757fabb80 1 -- 172.21.15.76:0/362994276 shutdown_connections 2024-06-02T04:56:52.678 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.677+0000 7f4757fabb80 1 -- 172.21.15.76:0/362994276 wait complete. 2024-06-02T04:56:52.678 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.678+0000 7f4757fabb80 20 client.25747 trim_cache size 0 max 16384 2024-06-02T04:56:52.678 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:{ 2024-06-02T04:56:52.678 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "message": "", 2024-06-02T04:56:52.678 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "return_code": 0 2024-06-02T04:56:52.679 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:} 2024-06-02T04:56:52.679 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.679+0000 7f474bdf0700 1 -- 172.21.15.76:0/1429795569 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f47300a11a0 msgr2=0x7f47300a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:56:52.679 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.679+0000 7f474bdf0700 1 --2- 172.21.15.76:0/1429795569 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f47300a11a0 0x7f47300a3660 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f474407f7f0 tx=0x7f473400e4b0 comp rx=0 tx=0).stop 2024-06-02T04:56:52.679 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.679+0000 7f474bdf0700 1 -- 172.21.15.76:0/1429795569 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f47441090d0 msgr2=0x7f474419c550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:56:52.679 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.679+0000 7f474bdf0700 1 --2- 172.21.15.76:0/1429795569 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f47441090d0 0x7f474419c550 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f473c00efc0 tx=0x7f473c00c3a0 comp rx=0 tx=0).stop 2024-06-02T04:56:52.680 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.680+0000 7f474bdf0700 1 -- 172.21.15.76:0/1429795569 shutdown_connections 2024-06-02T04:56:52.680 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.680+0000 7f474bdf0700 1 --2- 172.21.15.76:0/1429795569 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f47441090d0 0x7f474419c550 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:52.680 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.680+0000 7f474bdf0700 1 --2- 172.21.15.76:0/1429795569 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4744107540 0x7f474407e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:52.680 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.680+0000 7f474bdf0700 1 --2- 172.21.15.76:0/1429795569 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f47300a11a0 0x7f47300a3660 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:52.680 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.680+0000 7f474bdf0700 1 --2- 172.21.15.76:0/1429795569 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4744108730 0x7f474407ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:56:52.680 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.680+0000 7f474bdf0700 1 -- 172.21.15.76:0/1429795569 >> 172.21.15.76:0/1429795569 conn(0x7f47440764d0 msgr2=0x7f474410bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:56:52.686 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.686+0000 7f474bdf0700 1 -- 172.21.15.76:0/1429795569 shutdown_connections 2024-06-02T04:56:52.686 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:56:52.686+0000 7f474bdf0700 1 -- 172.21.15.76:0/1429795569 wait complete. 2024-06-02T04:56:53.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:56:53 smithi076 ceph-mon[42935]: pgmap v487: 129 pgs: 129 active+clean; 1.5 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 8.2 MiB/s wr, 781 op/s 2024-06-02T04:56:53.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:56:53 smithi119 ceph-mon[46633]: pgmap v487: 129 pgs: 129 active+clean; 1.5 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 8.2 MiB/s wr, 781 op/s 2024-06-02T04:56:53.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:56:53 smithi192 ceph-mon[47933]: pgmap v487: 129 pgs: 129 active+clean; 1.5 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 8.2 MiB/s wr, 781 op/s 2024-06-02T04:56:55.735 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:56:55 smithi076 ceph-mon[42935]: pgmap v488: 129 pgs: 129 active+clean; 1.5 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 7.7 MiB/s wr, 742 op/s 2024-06-02T04:56:55.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:56:55 smithi119 ceph-mon[46633]: pgmap v488: 129 pgs: 129 active+clean; 1.5 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 7.7 MiB/s wr, 742 op/s 2024-06-02T04:56:55.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:56:55 smithi192 ceph-mon[47933]: pgmap v488: 129 pgs: 129 active+clean; 1.5 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 7.7 MiB/s wr, 742 op/s 2024-06-02T04:56:56.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 365.0 s, 777.9 tps, lat 128.752 ms stddev 46.593 2024-06-02T04:56:57.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:56:57 smithi076 ceph-mon[42935]: pgmap v489: 129 pgs: 129 active+clean; 1.5 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 8.6 MiB/s wr, 806 op/s 2024-06-02T04:56:57.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:56:57 smithi119 ceph-mon[46633]: pgmap v489: 129 pgs: 129 active+clean; 1.5 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 8.6 MiB/s wr, 806 op/s 2024-06-02T04:56:57.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:56:57 smithi192 ceph-mon[47933]: pgmap v489: 129 pgs: 129 active+clean; 1.5 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 8.6 MiB/s wr, 806 op/s 2024-06-02T04:56:59.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:56:59 smithi076 ceph-mon[42935]: pgmap v490: 129 pgs: 129 active+clean; 1.5 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 8.3 MiB/s wr, 785 op/s 2024-06-02T04:56:59.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:56:59 smithi119 ceph-mon[46633]: pgmap v490: 129 pgs: 129 active+clean; 1.5 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 8.3 MiB/s wr, 785 op/s 2024-06-02T04:56:59.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:56:59 smithi192 ceph-mon[47933]: pgmap v490: 129 pgs: 129 active+clean; 1.5 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 8.3 MiB/s wr, 785 op/s 2024-06-02T04:57:01.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 370.0 s, 861.0 tps, lat 116.429 ms stddev 44.085 2024-06-02T04:57:01.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:57:01 smithi076 ceph-mon[42935]: pgmap v491: 129 pgs: 129 active+clean; 1.5 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 8.9 MiB/s wr, 841 op/s 2024-06-02T04:57:01.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:57:01 smithi119 ceph-mon[46633]: pgmap v491: 129 pgs: 129 active+clean; 1.5 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 8.9 MiB/s wr, 841 op/s 2024-06-02T04:57:01.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:57:01 smithi192 ceph-mon[47933]: pgmap v491: 129 pgs: 129 active+clean; 1.5 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 8.9 MiB/s wr, 841 op/s 2024-06-02T04:57:03.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:57:03 smithi076 ceph-mon[42935]: pgmap v492: 129 pgs: 129 active+clean; 1.5 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 7.6 MiB/s wr, 771 op/s 2024-06-02T04:57:03.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:57:03 smithi119 ceph-mon[46633]: pgmap v492: 129 pgs: 129 active+clean; 1.5 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 7.6 MiB/s wr, 771 op/s 2024-06-02T04:57:03.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:57:03 smithi192 ceph-mon[47933]: pgmap v492: 129 pgs: 129 active+clean; 1.5 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 7.6 MiB/s wr, 771 op/s 2024-06-02T04:57:05.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:57:05 smithi076 ceph-mon[42935]: pgmap v493: 129 pgs: 129 active+clean; 1.5 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 7.1 MiB/s wr, 720 op/s 2024-06-02T04:57:05.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:57:05 smithi119 ceph-mon[46633]: pgmap v493: 129 pgs: 129 active+clean; 1.5 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 7.1 MiB/s wr, 720 op/s 2024-06-02T04:57:05.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:57:05 smithi192 ceph-mon[47933]: pgmap v493: 129 pgs: 129 active+clean; 1.5 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 7.1 MiB/s wr, 720 op/s 2024-06-02T04:57:05.957 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.956+0000 7f67f539e700 1 -- 172.21.15.76:0/3472010666 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f67f0100e80 msgr2=0x7f67f0101300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:57:05.957 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.956+0000 7f67f539e700 1 --2- 172.21.15.76:0/3472010666 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f67f0100e80 0x7f67f0101300 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f67e00099c0 tx=0x7f67e0009cd0 comp rx=0 tx=0).stop 2024-06-02T04:57:05.957 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.956+0000 7f67f539e700 1 -- 172.21.15.76:0/3472010666 shutdown_connections 2024-06-02T04:57:05.957 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.956+0000 7f67f539e700 1 --2- 172.21.15.76:0/3472010666 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f67f0101840 0x7f67f01080d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:05.957 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.956+0000 7f67f539e700 1 --2- 172.21.15.76:0/3472010666 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f67f0100170 0x7f67f0100590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:05.958 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.956+0000 7f67f539e700 1 --2- 172.21.15.76:0/3472010666 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f67f0100e80 0x7f67f0101300 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:05.958 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.956+0000 7f67f539e700 1 -- 172.21.15.76:0/3472010666 >> 172.21.15.76:0/3472010666 conn(0x7f67f00fa940 msgr2=0x7f67f00fcd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:57:05.958 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.956+0000 7f67f539e700 1 -- 172.21.15.76:0/3472010666 shutdown_connections 2024-06-02T04:57:05.958 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.956+0000 7f67f539e700 1 -- 172.21.15.76:0/3472010666 wait complete. 2024-06-02T04:57:05.959 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.957+0000 7f67f539e700 1 Processor -- start 2024-06-02T04:57:05.959 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.957+0000 7f67f539e700 1 -- start start 2024-06-02T04:57:05.960 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.958+0000 7f67f539e700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f67f0100170 0x7f67f01a1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:57:05.960 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.958+0000 7f67f539e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f67f0100e80 0x7f67f01a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:57:05.960 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.958+0000 7f67f539e700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f67f0101840 0x7f67f01a8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:57:05.960 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.958+0000 7f67f539e700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67f01a9160 con 0x7f67f0101840 2024-06-02T04:57:05.960 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.958+0000 7f67f539e700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67f01a92a0 con 0x7f67f0100170 2024-06-02T04:57:05.960 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.958+0000 7f67f539e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67f01a9430 con 0x7f67f0100e80 2024-06-02T04:57:05.960 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.958+0000 7f67ef7fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f67f0100e80 0x7f67f01a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:57:05.960 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.958+0000 7f67ef7fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f67f0100e80 0x7f67f01a1b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:37508/0 (socket says 172.21.15.76:37508) 2024-06-02T04:57:05.960 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.958+0000 7f67ef7fe700 1 -- 172.21.15.76:0/1461804856 learned_addr learned my addr 172.21.15.76:0/1461804856 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:57:05.960 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.958+0000 7f67effff700 1 --2- 172.21.15.76:0/1461804856 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f67f0100170 0x7f67f01a1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:57:05.961 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.958+0000 7f67f4b9d700 1 --2- 172.21.15.76:0/1461804856 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f67f0101840 0x7f67f01a8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:57:05.961 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.958+0000 7f67ef7fe700 1 -- 172.21.15.76:0/1461804856 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f67f0100170 msgr2=0x7f67f01a1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:57:05.961 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.958+0000 7f67ef7fe700 1 --2- 172.21.15.76:0/1461804856 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f67f0100170 0x7f67f01a1630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:05.961 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.958+0000 7f67ef7fe700 1 -- 172.21.15.76:0/1461804856 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f67f0101840 msgr2=0x7f67f01a8b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:57:05.961 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.958+0000 7f67ef7fe700 1 --2- 172.21.15.76:0/1461804856 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f67f0101840 0x7f67f01a8b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:05.961 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.958+0000 7f67ef7fe700 1 -- 172.21.15.76:0/1461804856 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67e00095f0 con 0x7f67f0100e80 2024-06-02T04:57:05.961 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.959+0000 7f67ef7fe700 1 --2- 172.21.15.76:0/1461804856 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f67f0100e80 0x7f67f01a1b70 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f67e0003760 tx=0x7f67e0004020 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:57:05.961 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.959+0000 7f67ed7fa700 1 -- 172.21.15.76:0/1461804856 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e00046c0 con 0x7f67f0100e80 2024-06-02T04:57:05.961 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.959+0000 7f67ed7fa700 1 -- 172.21.15.76:0/1461804856 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f67e0009e60 con 0x7f67f0100e80 2024-06-02T04:57:05.961 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.959+0000 7f67ed7fa700 1 -- 172.21.15.76:0/1461804856 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e0015450 con 0x7f67f0100e80 2024-06-02T04:57:05.962 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.960+0000 7f67f539e700 1 -- 172.21.15.76:0/1461804856 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67f01a96b0 con 0x7f67f0100e80 2024-06-02T04:57:05.962 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.960+0000 7f67f539e700 1 -- 172.21.15.76:0/1461804856 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67f01a9ae0 con 0x7f67f0100e80 2024-06-02T04:57:05.966 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.964+0000 7f68027bbb80 1 Processor -- start 2024-06-02T04:57:05.967 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.966+0000 7f67ed7fa700 1 -- 172.21.15.76:0/1461804856 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f67e0020460 con 0x7f67f0100e80 2024-06-02T04:57:05.967 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.966+0000 7f67ed7fa700 1 --2- 172.21.15.76:0/1461804856 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f67d80a1220 0x7f67d80a36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:57:05.967 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.967+0000 7f67ed7fa700 1 -- 172.21.15.76:0/1461804856 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f67e00cdb80 con 0x7f67f0100e80 2024-06-02T04:57:05.968 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.967+0000 7f68027bbb80 1 -- start start 2024-06-02T04:57:05.968 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.967+0000 7f68027bbb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557be795e9e0 0x557be795ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:57:05.968 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.967+0000 7f68027bbb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557be795f340 0x557be795d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:57:05.968 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.967+0000 7f68027bbb80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557be795dce0 0x557be795e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:57:05.968 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.967+0000 7f68027bbb80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x557be78ac0f0 con 0x557be795dce0 2024-06-02T04:57:05.968 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.967+0000 7f68027bbb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x557be78a9ab0 con 0x557be795f340 2024-06-02T04:57:05.968 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.967+0000 7f68027bbb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x557be78a53a0 con 0x557be795e9e0 2024-06-02T04:57:05.969 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.968+0000 7f67effff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557be795e9e0 0x557be795ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:57:05.969 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.968+0000 7f67effff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557be795e9e0 0x557be795ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:37520/0 (socket says 172.21.15.76:37520) 2024-06-02T04:57:05.969 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.968+0000 7f67effff700 1 -- 172.21.15.76:0/344013881 learned_addr learned my addr 172.21.15.76:0/344013881 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:57:05.973 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.968+0000 7f67f4b9d700 1 --2- 172.21.15.76:0/344013881 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557be795dce0 0x557be795e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:57:05.973 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.969+0000 7f67f4b9d700 1 -- 172.21.15.76:0/344013881 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557be795e9e0 msgr2=0x557be795ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:57:05.973 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.969+0000 7f67f4b9d700 1 --2- 172.21.15.76:0/344013881 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557be795e9e0 0x557be795ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:05.973 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.969+0000 7f67f4b9d700 1 -- 172.21.15.76:0/344013881 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557be795f340 msgr2=0x557be795d750 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-02T04:57:05.974 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.969+0000 7f67f4b9d700 1 --2- 172.21.15.76:0/344013881 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557be795f340 0x557be795d750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:05.974 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.969+0000 7f67f4b9d700 1 -- 172.21.15.76:0/344013881 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557be7726350 con 0x557be795dce0 2024-06-02T04:57:05.974 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.969+0000 7f67f4b9d700 1 --2- 172.21.15.76:0/344013881 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557be795dce0 0x557be795e160 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f67e8012560 tx=0x7f67e8012870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb4b2274165d6714 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:57:05.974 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.970+0000 7f67d67fc700 1 -- 172.21.15.76:0/344013881 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e800e040 con 0x557be795dce0 2024-06-02T04:57:05.974 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.970+0000 7f67d67fc700 1 -- 172.21.15.76:0/344013881 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f67e8012e70 con 0x557be795dce0 2024-06-02T04:57:05.974 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.970+0000 7f67d67fc700 1 -- 172.21.15.76:0/344013881 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e8016850 con 0x557be795dce0 2024-06-02T04:57:05.974 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.971+0000 7f68027bbb80 1 -- 172.21.15.76:0/344013881 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557be795dce0 msgr2=0x557be795e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:57:05.974 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.971+0000 7f68027bbb80 1 --2- 172.21.15.76:0/344013881 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557be795dce0 0x557be795e160 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f67e8012560 tx=0x7f67e8012870 comp rx=0 tx=0).stop 2024-06-02T04:57:05.974 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.971+0000 7f68027bbb80 1 -- 172.21.15.76:0/344013881 shutdown_connections 2024-06-02T04:57:05.974 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.971+0000 7f68027bbb80 1 --2- 172.21.15.76:0/344013881 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557be795dce0 0x557be795e160 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:05.974 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.971+0000 7f68027bbb80 1 --2- 172.21.15.76:0/344013881 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557be795e9e0 0x557be795ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:05.974 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.971+0000 7f68027bbb80 1 --2- 172.21.15.76:0/344013881 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557be795f340 0x557be795d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:05.974 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.971+0000 7f68027bbb80 1 -- 172.21.15.76:0/344013881 >> 172.21.15.76:0/344013881 conn(0x557be78b31b0 msgr2=0x557be794fa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:57:05.975 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.973+0000 7f68027bbb80 1 -- 172.21.15.76:0/344013881 shutdown_connections 2024-06-02T04:57:05.976 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.973+0000 7f68027bbb80 1 -- 172.21.15.76:0/344013881 wait complete. 2024-06-02T04:57:05.976 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.973+0000 7f68027bbb80 1 -- start start 2024-06-02T04:57:05.976 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.974+0000 7f68027bbb80 1 Processor -- start 2024-06-02T04:57:05.976 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.974+0000 7f67f4b9d700 1 --2- 172.21.15.76:0/1461804856 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f67d80a1220 0x7f67d80a36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:57:05.977 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.974+0000 7f68027bbb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557be795dce0 0x557be7956fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:57:05.977 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.974+0000 7f68027bbb80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557be7957500 0x557be795c530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:57:05.977 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.974+0000 7f68027bbb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557be7957980 0x557be795cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:57:05.977 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.974+0000 7f68027bbb80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x557be7841500 con 0x557be7957500 2024-06-02T04:57:05.977 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.974+0000 7f68027bbb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x557be78411a0 con 0x557be795dce0 2024-06-02T04:57:05.977 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.974+0000 7f68027bbb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x557be7728640 con 0x557be7957980 2024-06-02T04:57:05.977 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.974+0000 7f68027bbb80 10 client.0 _ll_register_callbacks cb 0x557be784aad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:57:05.977 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.974+0000 7f67effff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557be795dce0 0x557be7956fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:57:05.977 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.974+0000 7f67effff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557be795dce0 0x557be7956fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:51330/0 (socket says 172.21.15.76:51330) 2024-06-02T04:57:05.977 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.974+0000 7f67effff700 1 -- 172.21.15.76:0/1796403577 learned_addr learned my addr 172.21.15.76:0/1796403577 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:57:05.977 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.974+0000 7f67f4b9d700 1 --2- 172.21.15.76:0/1796403577 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557be7957980 0x557be795cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:57:05.977 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.974+0000 7f67ef7fe700 1 --2- 172.21.15.76:0/1796403577 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557be7957500 0x557be795c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:57:05.977 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.975+0000 7f67effff700 1 -- 172.21.15.76:0/1796403577 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557be7957980 msgr2=0x557be795cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:57:05.977 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.975+0000 7f67f4b9d700 1 --2- 172.21.15.76:0/1461804856 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f67d80a1220 0x7f67d80a36e0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f67e8009fd0 tx=0x7f67e8009920 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:57:05.978 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.975+0000 7f67effff700 1 --2- 172.21.15.76:0/1796403577 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557be7957980 0x557be795cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:05.978 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.975+0000 7f67effff700 1 -- 172.21.15.76:0/1796403577 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557be7957500 msgr2=0x557be795c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:57:05.978 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.975+0000 7f67effff700 1 --2- 172.21.15.76:0/1796403577 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557be7957500 0x557be795c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:05.978 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.975+0000 7f67effff700 1 -- 172.21.15.76:0/1796403577 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67e8012240 con 0x557be795dce0 2024-06-02T04:57:05.978 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.975+0000 7f67effff700 1 --2- 172.21.15.76:0/1796403577 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557be795dce0 0x557be7956fc0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f67e40136c0 tx=0x7f67e40139d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d3592f28baed0622 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:57:05.978 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.975+0000 7f67cf7fe700 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-06-02T04:57:05.978 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.975+0000 7f67cf7fe700 1 -- 172.21.15.76:0/1796403577 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e4004020 con 0x557be795dce0 2024-06-02T04:57:05.978 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.975+0000 7f67cf7fe700 1 -- 172.21.15.76:0/1796403577 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f67e4004180 con 0x557be795dce0 2024-06-02T04:57:05.978 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.975+0000 7f68027bbb80 1 -- 172.21.15.76:0/1796403577 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557be77fe210 con 0x557be795dce0 2024-06-02T04:57:05.978 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.975+0000 7f67cf7fe700 1 -- 172.21.15.76:0/1796403577 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f67e4004340 con 0x557be795dce0 2024-06-02T04:57:05.978 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.976+0000 7f68027bbb80 10 client.25823 fetch_fsmap learned FSMap version 34 2024-06-02T04:57:05.978 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.976+0000 7f68027bbb80 1 -- 172.21.15.76:0/1796403577 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x557be76d2b00 con 0x557be795dce0 2024-06-02T04:57:05.978 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.976+0000 7f67cf7fe700 1 -- 172.21.15.76:0/1796403577 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x557be77fe210 con 0x557be795dce0 2024-06-02T04:57:05.979 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.976+0000 7f67cf7fe700 1 -- 172.21.15.76:0/1796403577 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 34) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f67e400e700 con 0x557be795dce0 2024-06-02T04:57:05.979 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.976+0000 7f68027bbb80 10 client.25823 fetch_fsmap finished waiting for FSMap version 34 2024-06-02T04:57:05.980 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.976+0000 7f68027bbb80 10 client.25823 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T04:57:05.980 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.976+0000 7f68027bbb80 20 client.25823 populate_metadata read hostname 'smithi076' 2024-06-02T04:57:05.980 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.976+0000 7f68027bbb80 1 --2- 172.21.15.76:0/1796403577 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x557be797c380 0x557be797e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:57:05.980 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.976+0000 7f68027bbb80 4 client.25823 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T04:57:05.980 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.976+0000 7f68027bbb80 1 -- 172.21.15.76:0/1796403577 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557be79247b0 con 0x557be797c380 2024-06-02T04:57:05.980 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.976+0000 7f67ef7fe700 1 --2- 172.21.15.76:0/1796403577 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x557be797c380 0x557be797e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:57:05.980 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.977+0000 7f67cf7fe700 10 client.25823 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:57:05.980 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.977+0000 7f67ef7fe700 1 --2- 172.21.15.76:0/1796403577 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x557be797c380 0x557be797e7a0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fc07a55dc3d8bbd4 server_cookie=e6cf4cd2cc3fab3c in_seq=0 out_seq=0 2024-06-02T04:57:05.980 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.977+0000 7f67cf7fe700 1 -- 172.21.15.76:0/1796403577 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x557be79247b0 con 0x557be797c380 2024-06-02T04:57:05.980 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.977+0000 7f67cf7fe700 10 client.25823 handle_command_reply: tid=0 2024-06-02T04:57:05.980 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.978+0000 7f68027bbb80 1 client.25823 shutdown 2024-06-02T04:57:05.981 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.980+0000 7f68027bbb80 1 -- 172.21.15.76:0/1796403577 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557be795dce0 msgr2=0x557be7956fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:57:05.981 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.980+0000 7f68027bbb80 1 --2- 172.21.15.76:0/1796403577 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557be795dce0 0x557be7956fc0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f67e40136c0 tx=0x7f67e40139d0 comp rx=0 tx=0).stop 2024-06-02T04:57:05.983 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.982+0000 7f68027bbb80 1 -- 172.21.15.76:0/1796403577 shutdown_connections 2024-06-02T04:57:05.983 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.982+0000 7f68027bbb80 1 --2- 172.21.15.76:0/1796403577 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x557be797c380 0x557be797e7a0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:05.983 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.982+0000 7f68027bbb80 1 --2- 172.21.15.76:0/1796403577 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557be7957980 0x557be795cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:05.983 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.982+0000 7f68027bbb80 1 --2- 172.21.15.76:0/1796403577 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557be795dce0 0x557be7956fc0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:05.983 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.982+0000 7f68027bbb80 1 --2- 172.21.15.76:0/1796403577 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557be7957500 0x557be795c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:05.984 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.982+0000 7f68027bbb80 1 -- 172.21.15.76:0/1796403577 >> 172.21.15.76:0/1796403577 conn(0x557be78b31b0 msgr2=0x557be794f890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:57:05.984 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.982+0000 7f67cf7fe700 0 client.25823 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:57:05.984 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.982+0000 7f68027bbb80 1 -- 172.21.15.76:0/1796403577 shutdown_connections 2024-06-02T04:57:05.984 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.984+0000 7f68027bbb80 1 -- 172.21.15.76:0/1796403577 wait complete. 2024-06-02T04:57:05.985 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:05.984+0000 7f68027bbb80 20 client.25823 trim_cache size 0 max 16384 2024-06-02T04:57:06.009 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:06.009+0000 7f68027bbb80 1 Processor -- start 2024-06-02T04:57:06.009 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:06.009+0000 7f68027bbb80 1 -- start start 2024-06-02T04:57:06.010 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:06.009+0000 7f68027bbb80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557be7957500 0x557be79564f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:57:06.010 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:06.009+0000 7f68027bbb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557be7957980 0x557be7983100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:57:06.010 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:06.009+0000 7f68027bbb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557be795dce0 0x557be798c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:57:06.010 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:06.009+0000 7f68027bbb80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x557be77fe210 con 0x557be7957500 2024-06-02T04:57:06.010 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:06.009+0000 7f68027bbb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x557be7978c10 con 0x557be7957980 2024-06-02T04:57:06.010 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:06.009+0000 7f68027bbb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x557be7957ec0 con 0x557be795dce0 2024-06-02T04:57:06.011 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:06.009+0000 7f67effff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557be7957500 0x557be79564f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:57:06.011 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:06.009+0000 7f67ef7fe700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557be7957980 0x557be7983100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:57:06.011 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:06.009+0000 7f67effff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557be7957500 0x557be79564f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:53578/0 (socket says 172.21.15.76:53578) 2024-06-02T04:57:06.011 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:06.009+0000 7f67effff700 1 -- 172.21.15.76:0/600729863 learned_addr learned my addr 172.21.15.76:0/600729863 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:57:06.011 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:06.009+0000 7f67ef7fe700 1 --2- 172.21.15.76:0/600729863 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557be7957980 0x557be7983100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:51336/0 (socket says 172.21.15.76:51336) 2024-06-02T04:57:06.011 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:06.009+0000 7f67f4b9d700 1 --2- 172.21.15.76:0/600729863 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557be795dce0 0x557be798c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:57:06.011 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:06.010+0000 7f67ef7fe700 1 -- 172.21.15.76:0/600729863 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557be795dce0 msgr2=0x557be798c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:57:06.011 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:06.010+0000 7f67ef7fe700 1 --2- 172.21.15.76:0/600729863 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557be795dce0 0x557be798c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:06.012 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:06.010+0000 7f67ef7fe700 1 -- 172.21.15.76:0/600729863 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557be7957500 msgr2=0x557be79564f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:57:06.012 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:06.010+0000 7f67ef7fe700 1 --2- 172.21.15.76:0/600729863 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557be7957500 0x557be79564f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:06.012 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:06.010+0000 7f67ef7fe700 1 -- 172.21.15.76:0/600729863 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557be786b500 con 0x557be7957980 2024-06-02T04:57:06.012 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:06.010+0000 7f67ef7fe700 1 --2- 172.21.15.76:0/600729863 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557be7957980 0x557be7983100 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x557be795f740 tx=0x7f67e0009310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=62541c09f6aaa459 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:57:06.012 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:06.010+0000 7f67d6ffd700 1 -- 172.21.15.76:0/600729863 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e009b3c0 con 0x557be7957980 2024-06-02T04:57:06.012 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:06.010+0000 7f67d6ffd700 1 -- 172.21.15.76:0/600729863 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f67e009acc0 con 0x557be7957980 2024-06-02T04:57:06.012 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:06.010+0000 7f67d6ffd700 1 -- 172.21.15.76:0/600729863 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e009af20 con 0x557be7957980 2024-06-02T04:57:06.012 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:06.011+0000 7f68027bbb80 1 -- 172.21.15.76:0/600729863 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557be7957980 msgr2=0x557be7983100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:57:06.013 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:06.011+0000 7f68027bbb80 1 --2- 172.21.15.76:0/600729863 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557be7957980 0x557be7983100 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x557be795f740 tx=0x7f67e0009310 comp rx=0 tx=0).stop 2024-06-02T04:57:06.013 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:06.011+0000 7f68027bbb80 1 -- 172.21.15.76:0/600729863 shutdown_connections 2024-06-02T04:57:06.013 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:06.011+0000 7f68027bbb80 1 --2- 172.21.15.76:0/600729863 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557be795dce0 0x557be798c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:06.013 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:06.011+0000 7f68027bbb80 1 --2- 172.21.15.76:0/600729863 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557be7957500 0x557be79564f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:06.013 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:06.011+0000 7f68027bbb80 1 --2- 172.21.15.76:0/600729863 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557be7957980 0x557be7983100 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:06.013 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:06.011+0000 7f68027bbb80 1 -- 172.21.15.76:0/600729863 >> 172.21.15.76:0/600729863 conn(0x557be78b31b0 msgr2=0x557be7956d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:57:06.013 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:06.013+0000 7f68027bbb80 1 -- 172.21.15.76:0/600729863 shutdown_connections 2024-06-02T04:57:06.015 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:06.014+0000 7f68027bbb80 1 -- 172.21.15.76:0/600729863 wait complete. 2024-06-02T04:57:06.016 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:06.015+0000 7f68027bbb80 1 -- start start 2024-06-02T04:57:06.016 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:06.015+0000 7f68027bbb80 1 Processor -- start 2024-06-02T04:57:06.016 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:06.016+0000 7f68027bbb80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557be7957500 0x557be798c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:57:06.016 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:06.016+0000 7f68027bbb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557be7957980 0x557be7989460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:57:06.016 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:06.016+0000 7f68027bbb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557be795dce0 0x557be79899a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:57:06.016 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:06.016+0000 7f68027bbb80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x557be7989ee0 con 0x557be7957500 2024-06-02T04:57:06.017 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:06.016+0000 7f68027bbb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x557be798a050 con 0x557be7957980 2024-06-02T04:57:06.017 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:06.016+0000 7f68027bbb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x557be79d1300 con 0x557be795dce0 2024-06-02T04:57:06.017 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:06.016+0000 7f68027bbb80 10 client.0 _ll_register_callbacks cb 0x557be784aad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:57:06.017 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:06.016+0000 7f67f4b9d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557be795dce0 0x557be79899a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:57:06.017 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:06.016+0000 7f67f4b9d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557be795dce0 0x557be79899a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:37538/0 (socket says 172.21.15.76:37538) 2024-06-02T04:57:06.017 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:06.016+0000 7f67f4b9d700 1 -- 172.21.15.76:0/2422876845 learned_addr learned my addr 172.21.15.76:0/2422876845 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:57:06.017 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:06.016+0000 7f67f4b9d700 1 -- 172.21.15.76:0/2422876845 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557be7957980 msgr2=0x557be7989460 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-02T04:57:06.017 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:06.016+0000 7f67f4b9d700 1 --2- 172.21.15.76:0/2422876845 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557be7957980 0x557be7989460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:06.018 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:06.016+0000 7f67f4b9d700 1 -- 172.21.15.76:0/2422876845 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557be7957500 msgr2=0x557be798c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:57:06.018 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:06.016+0000 7f67f4b9d700 1 --2- 172.21.15.76:0/2422876845 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557be7957500 0x557be798c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:06.018 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:06.016+0000 7f67f4b9d700 1 -- 172.21.15.76:0/2422876845 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67f01a9ae0 con 0x557be795dce0 2024-06-02T04:57:06.018 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:06.017+0000 7f67f4b9d700 1 --2- 172.21.15.76:0/2422876845 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557be795dce0 0x557be79899a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f67e8012560 tx=0x7f67e8004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=afeca63ff37d9025 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:57:06.019 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:06.019+0000 7f67cf7fe700 10 client.0 ms_handle_connect on v2:172.21.15.192:3300/0 2024-06-02T04:57:06.019 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:06.019+0000 7f67cf7fe700 1 -- 172.21.15.76:0/2422876845 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e800e040 con 0x557be795dce0 2024-06-02T04:57:06.019 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:06.019+0000 7f67cf7fe700 1 -- 172.21.15.76:0/2422876845 <== mon.1 v2:172.21.15.192:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f67e8004e40 con 0x557be795dce0 2024-06-02T04:57:06.020 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:06.019+0000 7f68027bbb80 1 -- 172.21.15.76:0/2422876845 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f67e8012e70 con 0x557be795dce0 2024-06-02T04:57:06.020 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:06.019+0000 7f67cf7fe700 1 -- 172.21.15.76:0/2422876845 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f67e8005440 con 0x557be795dce0 2024-06-02T04:57:06.028 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:06.027+0000 7f68027bbb80 10 client.25765 fetch_fsmap learned FSMap version 34 2024-06-02T04:57:06.028 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:06.027+0000 7f68027bbb80 1 -- 172.21.15.76:0/2422876845 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x557be772ac70 con 0x557be795dce0 2024-06-02T04:57:06.032 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:06.032+0000 7f67cf7fe700 1 -- 172.21.15.76:0/2422876845 <== mon.1 v2:172.21.15.192:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f67e803f030 con 0x557be795dce0 2024-06-02T04:57:06.033 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:06.032+0000 7f67cf7fe700 1 -- 172.21.15.76:0/2422876845 <== mon.1 v2:172.21.15.192:3300/0 5 ==== fsmap(e 34) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f67e8036020 con 0x557be795dce0 2024-06-02T04:57:06.033 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:06.032+0000 7f68027bbb80 10 client.25765 fetch_fsmap finished waiting for FSMap version 34 2024-06-02T04:57:06.033 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:06.032+0000 7f68027bbb80 10 client.25765 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T04:57:06.033 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:06.032+0000 7f68027bbb80 20 client.25765 populate_metadata read hostname 'smithi076' 2024-06-02T04:57:06.033 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:06.032+0000 7f68027bbb80 1 --2- 172.21.15.76:0/2422876845 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x557be79d2da0 0x557be79d51c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:57:06.033 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:06.032+0000 7f68027bbb80 4 client.25765 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T04:57:06.033 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:06.032+0000 7f68027bbb80 1 -- 172.21.15.76:0/2422876845 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x557be789de60 con 0x557be79d2da0 2024-06-02T04:57:06.034 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:06.032+0000 7f67effff700 1 --2- 172.21.15.76:0/2422876845 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x557be79d2da0 0x557be79d51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:57:06.039 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:06.039+0000 7f67cf7fe700 10 client.25765 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:57:06.039 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:06.039+0000 7f67effff700 1 --2- 172.21.15.76:0/2422876845 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x557be79d2da0 0x557be79d51c0 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2134dbada5b1ee03 server_cookie=8a27f0c45fc27f8f in_seq=0 out_seq=0 2024-06-02T04:57:06.060 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:06.059+0000 7f67cf7fe700 1 -- 172.21.15.76:0/2422876845 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x557be789de60 con 0x557be79d2da0 2024-06-02T04:57:06.060 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:06.060+0000 7f67cf7fe700 10 client.25765 handle_command_reply: tid=0 2024-06-02T04:57:06.060 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:06.060+0000 7f68027bbb80 1 client.25765 shutdown 2024-06-02T04:57:06.063 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:06.063+0000 7f68027bbb80 1 -- 172.21.15.76:0/2422876845 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557be795dce0 msgr2=0x557be79899a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:57:06.064 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:06.063+0000 7f68027bbb80 1 --2- 172.21.15.76:0/2422876845 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557be795dce0 0x557be79899a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f67e8012560 tx=0x7f67e8004ad0 comp rx=0 tx=0).stop 2024-06-02T04:57:06.067 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:06.067+0000 7f68027bbb80 1 -- 172.21.15.76:0/2422876845 shutdown_connections 2024-06-02T04:57:06.067 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:06.067+0000 7f68027bbb80 1 --2- 172.21.15.76:0/2422876845 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x557be79d2da0 0x557be79d51c0 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:06.067 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:06.067+0000 7f68027bbb80 1 --2- 172.21.15.76:0/2422876845 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557be795dce0 0x557be79899a0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:06.067 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:06.067+0000 7f68027bbb80 1 --2- 172.21.15.76:0/2422876845 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557be7957500 0x557be798c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:06.068 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:06.067+0000 7f68027bbb80 1 --2- 172.21.15.76:0/2422876845 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557be7957980 0x557be7989460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:06.068 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:06.067+0000 7f68027bbb80 1 -- 172.21.15.76:0/2422876845 >> 172.21.15.76:0/2422876845 conn(0x557be78b31b0 msgr2=0x557be79564f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:57:06.068 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:06.067+0000 7f67cf7fe700 0 client.25765 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:57:06.068 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:06.067+0000 7f68027bbb80 1 -- 172.21.15.76:0/2422876845 shutdown_connections 2024-06-02T04:57:06.069 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:06.067+0000 7f68027bbb80 1 -- 172.21.15.76:0/2422876845 wait complete. 2024-06-02T04:57:06.069 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:06.068+0000 7f68027bbb80 20 client.25765 trim_cache size 0 max 16384 2024-06-02T04:57:06.069 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:{ 2024-06-02T04:57:06.069 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "message": "", 2024-06-02T04:57:06.069 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "return_code": 0 2024-06-02T04:57:06.069 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:} 2024-06-02T04:57:06.070 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:06.068+0000 7f67f539e700 1 -- 172.21.15.76:0/1461804856 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f67d80a1220 msgr2=0x7f67d80a36e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:57:06.070 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:06.068+0000 7f67f539e700 1 --2- 172.21.15.76:0/1461804856 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f67d80a1220 0x7f67d80a36e0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f67e8009fd0 tx=0x7f67e8009920 comp rx=0 tx=0).stop 2024-06-02T04:57:06.070 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:06.068+0000 7f67f539e700 1 -- 172.21.15.76:0/1461804856 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f67f0100e80 msgr2=0x7f67f01a1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:57:06.070 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:06.068+0000 7f67f539e700 1 --2- 172.21.15.76:0/1461804856 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f67f0100e80 0x7f67f01a1b70 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f67e0003760 tx=0x7f67e0004020 comp rx=0 tx=0).stop 2024-06-02T04:57:06.070 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:06.069+0000 7f67f539e700 1 -- 172.21.15.76:0/1461804856 shutdown_connections 2024-06-02T04:57:06.070 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:06.069+0000 7f67f539e700 1 --2- 172.21.15.76:0/1461804856 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f67f0101840 0x7f67f01a8b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:06.070 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:06.069+0000 7f67f539e700 1 --2- 172.21.15.76:0/1461804856 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f67d80a1220 0x7f67d80a36e0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:06.071 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:06.069+0000 7f67f539e700 1 --2- 172.21.15.76:0/1461804856 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f67f0100170 0x7f67f01a1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:06.071 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:06.069+0000 7f67f539e700 1 --2- 172.21.15.76:0/1461804856 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f67f0100e80 0x7f67f01a1b70 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:06.071 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:06.069+0000 7f67f539e700 1 -- 172.21.15.76:0/1461804856 >> 172.21.15.76:0/1461804856 conn(0x7f67f00fa940 msgr2=0x7f67f0106640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:57:06.072 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:06.071+0000 7f67f539e700 1 -- 172.21.15.76:0/1461804856 shutdown_connections 2024-06-02T04:57:06.072 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:06.072+0000 7f67f539e700 1 -- 172.21.15.76:0/1461804856 wait complete. 2024-06-02T04:57:06.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 375.0 s, 736.7 tps, lat 134.954 ms stddev 46.256 2024-06-02T04:57:07.848 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:57:07 smithi119 ceph-mon[46633]: pgmap v494: 129 pgs: 129 active+clean; 1.5 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 7.8 MiB/s wr, 775 op/s 2024-06-02T04:57:07.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:57:07 smithi192 ceph-mon[47933]: pgmap v494: 129 pgs: 129 active+clean; 1.5 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 7.8 MiB/s wr, 775 op/s 2024-06-02T04:57:07.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:57:07 smithi076 ceph-mon[42935]: pgmap v494: 129 pgs: 129 active+clean; 1.5 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 7.8 MiB/s wr, 775 op/s 2024-06-02T04:57:09.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:57:09 smithi119 ceph-mon[46633]: pgmap v495: 129 pgs: 129 active+clean; 1.5 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 7.6 MiB/s wr, 764 op/s 2024-06-02T04:57:09.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:57:09 smithi192 ceph-mon[47933]: pgmap v495: 129 pgs: 129 active+clean; 1.5 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 7.6 MiB/s wr, 764 op/s 2024-06-02T04:57:09.985 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:57:09 smithi076 ceph-mon[42935]: pgmap v495: 129 pgs: 129 active+clean; 1.5 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 7.6 MiB/s wr, 764 op/s 2024-06-02T04:57:11.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 380.0 s, 683.9 tps, lat 146.776 ms stddev 54.406 2024-06-02T04:57:11.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:57:11 smithi119 ceph-mon[46633]: pgmap v496: 129 pgs: 129 active+clean; 1.5 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 7.9 MiB/s wr, 808 op/s 2024-06-02T04:57:11.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:57:11 smithi192 ceph-mon[47933]: pgmap v496: 129 pgs: 129 active+clean; 1.5 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 7.9 MiB/s wr, 808 op/s 2024-06-02T04:57:11.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:57:11 smithi076 ceph-mon[42935]: pgmap v496: 129 pgs: 129 active+clean; 1.5 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 7.9 MiB/s wr, 808 op/s 2024-06-02T04:57:13.849 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:57:13 smithi119 ceph-mon[46633]: pgmap v497: 129 pgs: 129 active+clean; 1.5 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 6.9 MiB/s wr, 745 op/s 2024-06-02T04:57:13.850 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:57:13 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:57:13.850 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:57:13 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:57:13.850 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:57:13 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:57:13.850 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:57:13 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:57:13.850 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:57:13 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:57:13.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:57:13 smithi192 ceph-mon[47933]: pgmap v497: 129 pgs: 129 active+clean; 1.5 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 6.9 MiB/s wr, 745 op/s 2024-06-02T04:57:13.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:57:13 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:57:13.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:57:13 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:57:13.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:57:13 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:57:13.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:57:13 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:57:13.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:57:13 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:57:13.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:57:13 smithi076 ceph-mon[42935]: pgmap v497: 129 pgs: 129 active+clean; 1.5 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 6.9 MiB/s wr, 745 op/s 2024-06-02T04:57:13.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:57:13 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:57:13.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:57:13 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:57:13.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:57:13 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:57:13.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:57:13 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:57:13.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:57:13 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:57:14.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:57:14 smithi119 ceph-mon[46633]: Adjusting osd_memory_target on smithi119 to 182.4M 2024-06-02T04:57:14.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:57:14 smithi119 ceph-mon[46633]: Unable to set osd_memory_target on smithi119 to 191358361: error parsing value: Value '191358361' is below minimum 939524096 2024-06-02T04:57:14.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:57:14 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:57:14.847 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:57:14 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:57:14.847 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:57:14 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:57:14.847 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:57:14 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:57:14.847 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:57:14 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:57:14.847 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:57:14 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:57:14.847 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:57:14 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:57:14.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:57:14 smithi192 ceph-mon[47933]: Adjusting osd_memory_target on smithi119 to 182.4M 2024-06-02T04:57:14.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:57:14 smithi192 ceph-mon[47933]: Unable to set osd_memory_target on smithi119 to 191358361: error parsing value: Value '191358361' is below minimum 939524096 2024-06-02T04:57:14.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:57:14 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:57:14.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:57:14 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:57:14.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:57:14 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:57:14.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:57:14 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:57:14.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:57:14 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:57:14.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:57:14 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:57:14.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:57:14 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:57:14.986 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:57:14 smithi076 ceph-mon[42935]: Adjusting osd_memory_target on smithi119 to 182.4M 2024-06-02T04:57:14.986 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:57:14 smithi076 ceph-mon[42935]: Unable to set osd_memory_target on smithi119 to 191358361: error parsing value: Value '191358361' is below minimum 939524096 2024-06-02T04:57:14.986 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:57:14 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:57:14.986 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:57:14 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:57:14.986 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:57:14 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:57:14.986 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:57:14 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:57:14.986 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:57:14 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:57:14.986 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:57:14 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:57:14.987 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:57:14 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:57:15.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:57:15 smithi119 ceph-mon[46633]: Adjusting osd_memory_target on smithi076 to 182.5M 2024-06-02T04:57:15.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:57:15 smithi119 ceph-mon[46633]: Unable to set osd_memory_target on smithi076 to 191374848: error parsing value: Value '191374848' is below minimum 939524096 2024-06-02T04:57:15.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:57:15 smithi119 ceph-mon[46633]: pgmap v498: 129 pgs: 129 active+clean; 1.5 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 7.1 MiB/s wr, 729 op/s 2024-06-02T04:57:15.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:57:15 smithi192 ceph-mon[47933]: Adjusting osd_memory_target on smithi076 to 182.5M 2024-06-02T04:57:15.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:57:15 smithi192 ceph-mon[47933]: Unable to set osd_memory_target on smithi076 to 191374848: error parsing value: Value '191374848' is below minimum 939524096 2024-06-02T04:57:15.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:57:15 smithi192 ceph-mon[47933]: pgmap v498: 129 pgs: 129 active+clean; 1.5 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 7.1 MiB/s wr, 729 op/s 2024-06-02T04:57:15.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:57:15 smithi076 ceph-mon[42935]: Adjusting osd_memory_target on smithi076 to 182.5M 2024-06-02T04:57:15.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:57:15 smithi076 ceph-mon[42935]: Unable to set osd_memory_target on smithi076 to 191374848: error parsing value: Value '191374848' is below minimum 939524096 2024-06-02T04:57:15.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:57:15 smithi076 ceph-mon[42935]: pgmap v498: 129 pgs: 129 active+clean; 1.5 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 7.1 MiB/s wr, 729 op/s 2024-06-02T04:57:16.316 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 385.0 s, 810.6 tps, lat 123.193 ms stddev 48.262 2024-06-02T04:57:17.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:57:17 smithi119 ceph-mon[46633]: pgmap v499: 129 pgs: 129 active+clean; 1.5 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 7.8 MiB/s wr, 782 op/s 2024-06-02T04:57:17.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:57:17 smithi192 ceph-mon[47933]: pgmap v499: 129 pgs: 129 active+clean; 1.5 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 7.8 MiB/s wr, 782 op/s 2024-06-02T04:57:17.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:57:17 smithi076 ceph-mon[42935]: pgmap v499: 129 pgs: 129 active+clean; 1.5 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 7.8 MiB/s wr, 782 op/s 2024-06-02T04:57:18.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:57:18 smithi119 ceph-mon[46633]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-06-02T04:57:18.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:57:18 smithi192 ceph-mon[47933]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-06-02T04:57:18.987 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:57:18 smithi076 ceph-mon[42935]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-06-02T04:57:19.302 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.302+0000 7fa4be155700 1 -- 172.21.15.76:0/3420697271 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa4b80ffe40 msgr2=0x7fa4b8100260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:57:19.302 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.302+0000 7fa4be155700 1 --2- 172.21.15.76:0/3420697271 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa4b80ffe40 0x7fa4b8100260 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa4a8009990 tx=0x7fa4a8009ca0 comp rx=0 tx=0).stop 2024-06-02T04:57:19.303 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.302+0000 7fa4be155700 1 -- 172.21.15.76:0/3420697271 shutdown_connections 2024-06-02T04:57:19.303 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.302+0000 7fa4be155700 1 --2- 172.21.15.76:0/3420697271 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa4b8101950 0x7fa4b8108270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:19.303 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.302+0000 7fa4be155700 1 --2- 172.21.15.76:0/3420697271 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa4b80ffe40 0x7fa4b8100260 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:19.303 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.302+0000 7fa4be155700 1 --2- 172.21.15.76:0/3420697271 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa4b8100f90 0x7fa4b8101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:19.303 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.302+0000 7fa4be155700 1 -- 172.21.15.76:0/3420697271 >> 172.21.15.76:0/3420697271 conn(0x7fa4b80fb3b0 msgr2=0x7fa4b80fd7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:57:19.304 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.302+0000 7fa4be155700 1 -- 172.21.15.76:0/3420697271 shutdown_connections 2024-06-02T04:57:19.304 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.302+0000 7fa4be155700 1 -- 172.21.15.76:0/3420697271 wait complete. 2024-06-02T04:57:19.305 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.303+0000 7fa4be155700 1 Processor -- start 2024-06-02T04:57:19.305 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.303+0000 7fa4be155700 1 -- start start 2024-06-02T04:57:19.305 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.303+0000 7fa4be155700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa4b80ffe40 0x7fa4b819d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:57:19.305 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.303+0000 7fa4be155700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa4b8100f90 0x7fa4b819d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:57:19.305 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.303+0000 7fa4be155700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa4b8101950 0x7fa4b81a4930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:57:19.305 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.303+0000 7fa4be155700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b81a4f00 con 0x7fa4b80ffe40 2024-06-02T04:57:19.305 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.303+0000 7fa4be155700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b81a5040 con 0x7fa4b8101950 2024-06-02T04:57:19.305 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.303+0000 7fa4be155700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b81a51d0 con 0x7fa4b8100f90 2024-06-02T04:57:19.306 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.304+0000 7fa4b6ffd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa4b8100f90 0x7fa4b819d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:57:19.306 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.304+0000 7fa4b6ffd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa4b8100f90 0x7fa4b819d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:39988/0 (socket says 172.21.15.76:39988) 2024-06-02T04:57:19.306 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.304+0000 7fa4b6ffd700 1 -- 172.21.15.76:0/588340405 learned_addr learned my addr 172.21.15.76:0/588340405 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:57:19.306 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.304+0000 7fa4b77fe700 1 --2- 172.21.15.76:0/588340405 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa4b80ffe40 0x7fa4b819d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:57:19.306 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.304+0000 7fa4b7fff700 1 --2- 172.21.15.76:0/588340405 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa4b8101950 0x7fa4b81a4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:57:19.306 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.304+0000 7fa4b6ffd700 1 -- 172.21.15.76:0/588340405 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa4b8101950 msgr2=0x7fa4b81a4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:57:19.306 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.304+0000 7fa4b6ffd700 1 --2- 172.21.15.76:0/588340405 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa4b8101950 0x7fa4b81a4930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:19.306 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.304+0000 7fa4b6ffd700 1 -- 172.21.15.76:0/588340405 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa4b80ffe40 msgr2=0x7fa4b819d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:57:19.306 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.304+0000 7fa4b6ffd700 1 --2- 172.21.15.76:0/588340405 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa4b80ffe40 0x7fa4b819d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:19.306 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.304+0000 7fa4b6ffd700 1 -- 172.21.15.76:0/588340405 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4a80095f0 con 0x7fa4b8100f90 2024-06-02T04:57:19.306 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.304+0000 7fa4b6ffd700 1 --2- 172.21.15.76:0/588340405 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa4b8100f90 0x7fa4b819d910 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa4ac00abb0 tx=0x7fa4ac00aec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:57:19.307 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.305+0000 7fa4b4ff9700 1 -- 172.21.15.76:0/588340405 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4ac010070 con 0x7fa4b8100f90 2024-06-02T04:57:19.307 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.305+0000 7fa4b4ff9700 1 -- 172.21.15.76:0/588340405 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa4ac007d50 con 0x7fa4b8100f90 2024-06-02T04:57:19.307 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.305+0000 7fa4b4ff9700 1 -- 172.21.15.76:0/588340405 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4ac014c60 con 0x7fa4b8100f90 2024-06-02T04:57:19.307 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.305+0000 7fa4be155700 1 -- 172.21.15.76:0/588340405 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4b81a54b0 con 0x7fa4b8100f90 2024-06-02T04:57:19.307 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.305+0000 7fa4be155700 1 -- 172.21.15.76:0/588340405 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4b81a5970 con 0x7fa4b8100f90 2024-06-02T04:57:19.308 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.308+0000 7fa4b4ff9700 1 -- 172.21.15.76:0/588340405 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fa4ac0078c0 con 0x7fa4b8100f90 2024-06-02T04:57:19.309 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.308+0000 7fa4b4ff9700 1 --2- 172.21.15.76:0/588340405 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fa4a00a11f0 0x7fa4a00a36b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:57:19.309 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.309+0000 7fa4b4ff9700 1 -- 172.21.15.76:0/588340405 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7fa4ac0cbd60 con 0x7fa4b8100f90 2024-06-02T04:57:19.309 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.309+0000 7fa4b77fe700 1 --2- 172.21.15.76:0/588340405 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fa4a00a11f0 0x7fa4a00a36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:57:19.310 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.309+0000 7fa4ca310b80 1 Processor -- start 2024-06-02T04:57:19.310 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.309+0000 7fa4b77fe700 1 --2- 172.21.15.76:0/588340405 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fa4a00a11f0 0x7fa4a00a36b0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fa4a80098e0 tx=0x7fa4a80036b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:57:19.310 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.309+0000 7fa4ca310b80 1 -- start start 2024-06-02T04:57:19.312 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.310+0000 7fa4ca310b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d26296ea80 0x55d26296eea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:57:19.312 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.310+0000 7fa4ca310b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d26296f3e0 0x55d26296fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:57:19.312 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.310+0000 7fa4ca310b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2629702d0 0x55d262970750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:57:19.312 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.310+0000 7fa4ca310b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2628c60f0 con 0x55d2629702d0 2024-06-02T04:57:19.312 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.310+0000 7fa4ca310b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2628c3ab0 con 0x55d26296f3e0 2024-06-02T04:57:19.312 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.310+0000 7fa4ca310b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2628bf3a0 con 0x55d26296ea80 2024-06-02T04:57:19.312 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.310+0000 7fa4b7fff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2629702d0 0x55d262970750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:57:19.312 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.310+0000 7fa4b7fff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2629702d0 0x55d262970750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:33624/0 (socket says 172.21.15.76:33624) 2024-06-02T04:57:19.312 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.310+0000 7fa4b7fff700 1 -- 172.21.15.76:0/203203400 learned_addr learned my addr 172.21.15.76:0/203203400 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:57:19.312 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.310+0000 7fa4b77fe700 1 --2- 172.21.15.76:0/203203400 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d26296ea80 0x55d26296eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:57:19.312 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.310+0000 7fa4b6ffd700 1 --2- 172.21.15.76:0/203203400 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d26296f3e0 0x55d26296fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:57:19.313 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.311+0000 7fa4b77fe700 1 -- 172.21.15.76:0/203203400 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d26296f3e0 msgr2=0x55d26296fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:57:19.313 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.311+0000 7fa4b77fe700 1 --2- 172.21.15.76:0/203203400 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d26296f3e0 0x55d26296fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:19.313 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.311+0000 7fa4b77fe700 1 -- 172.21.15.76:0/203203400 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2629702d0 msgr2=0x55d262970750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:57:19.313 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.311+0000 7fa4b77fe700 1 --2- 172.21.15.76:0/203203400 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2629702d0 0x55d262970750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:19.313 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.311+0000 7fa4b77fe700 1 -- 172.21.15.76:0/203203400 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d262740350 con 0x55d26296ea80 2024-06-02T04:57:19.313 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.311+0000 7fa4b7fff700 1 --2- 172.21.15.76:0/203203400 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2629702d0 0x55d262970750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T04:57:19.313 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.311+0000 7fa4b77fe700 1 --2- 172.21.15.76:0/203203400 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d26296ea80 0x55d26296eea0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa4a800b5c0 tx=0x7fa4a8020000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bfc02af9c38d2c25 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:57:19.313 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.311+0000 7fa49dffb700 1 -- 172.21.15.76:0/203203400 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4a802b070 con 0x55d26296ea80 2024-06-02T04:57:19.313 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.311+0000 7fa49dffb700 1 -- 172.21.15.76:0/203203400 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa4a801e040 con 0x55d26296ea80 2024-06-02T04:57:19.313 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.311+0000 7fa49dffb700 1 -- 172.21.15.76:0/203203400 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4a8004e00 con 0x55d26296ea80 2024-06-02T04:57:19.315 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.312+0000 7fa4ca310b80 1 -- 172.21.15.76:0/203203400 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d26296ea80 msgr2=0x55d26296eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:57:19.315 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.312+0000 7fa4ca310b80 1 --2- 172.21.15.76:0/203203400 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d26296ea80 0x55d26296eea0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa4a800b5c0 tx=0x7fa4a8020000 comp rx=0 tx=0).stop 2024-06-02T04:57:19.316 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.312+0000 7fa4ca310b80 1 -- 172.21.15.76:0/203203400 shutdown_connections 2024-06-02T04:57:19.316 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.312+0000 7fa4ca310b80 1 --2- 172.21.15.76:0/203203400 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2629702d0 0x55d262970750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:19.316 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.312+0000 7fa4ca310b80 1 --2- 172.21.15.76:0/203203400 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d26296ea80 0x55d26296eea0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:19.316 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.312+0000 7fa4ca310b80 1 --2- 172.21.15.76:0/203203400 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d26296f3e0 0x55d26296fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:19.316 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.312+0000 7fa4ca310b80 1 -- 172.21.15.76:0/203203400 >> 172.21.15.76:0/203203400 conn(0x55d2628cd1b0 msgr2=0x55d26296b440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:57:19.316 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.312+0000 7fa4ca310b80 1 -- 172.21.15.76:0/203203400 shutdown_connections 2024-06-02T04:57:19.316 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.312+0000 7fa4ca310b80 1 -- 172.21.15.76:0/203203400 wait complete. 2024-06-02T04:57:19.316 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.313+0000 7fa4ca310b80 1 -- start start 2024-06-02T04:57:19.316 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.313+0000 7fa4ca310b80 1 Processor -- start 2024-06-02T04:57:19.316 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.313+0000 7fa4ca310b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d26296ea80 0x55d262978810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:57:19.316 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.313+0000 7fa4ca310b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d26296f3e0 0x55d262978d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:57:19.316 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.313+0000 7fa4ca310b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2629702d0 0x55d26297fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:57:19.317 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.313+0000 7fa4ca310b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d26285b500 con 0x55d2629702d0 2024-06-02T04:57:19.317 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.313+0000 7fa4ca310b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d26285b1a0 con 0x55d26296ea80 2024-06-02T04:57:19.317 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.313+0000 7fa4ca310b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d262742640 con 0x55d26296f3e0 2024-06-02T04:57:19.317 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.313+0000 7fa4ca310b80 10 client.0 _ll_register_callbacks cb 0x55d262864ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:57:19.317 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.314+0000 7fa4b7fff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2629702d0 0x55d26297fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:57:19.317 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.314+0000 7fa4b6ffd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d26296f3e0 0x55d262978d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:57:19.317 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.314+0000 7fa4b7fff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2629702d0 0x55d26297fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:33634/0 (socket says 172.21.15.76:33634) 2024-06-02T04:57:19.317 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.314+0000 7fa4b7fff700 1 -- 172.21.15.76:0/2183809564 learned_addr learned my addr 172.21.15.76:0/2183809564 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:57:19.317 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.314+0000 7fa4b6ffd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d26296f3e0 0x55d262978d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:40008/0 (socket says 172.21.15.76:40008) 2024-06-02T04:57:19.317 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.314+0000 7fa4b77fe700 1 --2- 172.21.15.76:0/2183809564 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d26296ea80 0x55d262978810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:57:19.317 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.314+0000 7fa4b77fe700 1 -- 172.21.15.76:0/2183809564 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d26296f3e0 msgr2=0x55d262978d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:57:19.317 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.314+0000 7fa4b77fe700 1 --2- 172.21.15.76:0/2183809564 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d26296f3e0 0x55d262978d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:19.318 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.314+0000 7fa4b77fe700 1 -- 172.21.15.76:0/2183809564 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2629702d0 msgr2=0x55d26297fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:57:19.318 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.314+0000 7fa4b77fe700 1 --2- 172.21.15.76:0/2183809564 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2629702d0 0x55d26297fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:19.318 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.314+0000 7fa4b77fe700 1 -- 172.21.15.76:0/2183809564 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4b0003bf0 con 0x55d26296ea80 2024-06-02T04:57:19.318 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.314+0000 7fa4b7fff700 1 --2- 172.21.15.76:0/2183809564 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2629702d0 0x55d26297fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T04:57:19.318 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.314+0000 7fa4b77fe700 1 --2- 172.21.15.76:0/2183809564 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d26296ea80 0x55d262978810 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa4a8005cd0 tx=0x7fa4a800beb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd6b4302244e75b6 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:57:19.318 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.314+0000 7fa496ffd700 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-06-02T04:57:19.318 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.315+0000 7fa496ffd700 1 -- 172.21.15.76:0/2183809564 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4a802b070 con 0x55d26296ea80 2024-06-02T04:57:19.318 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.315+0000 7fa496ffd700 1 -- 172.21.15.76:0/2183809564 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7fa4a800f540 con 0x55d26296ea80 2024-06-02T04:57:19.318 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.315+0000 7fa4ca310b80 1 -- 172.21.15.76:0/2183809564 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d262818210 con 0x55d26296ea80 2024-06-02T04:57:19.318 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.315+0000 7fa496ffd700 1 -- 172.21.15.76:0/2183809564 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa4a800f720 con 0x55d26296ea80 2024-06-02T04:57:19.318 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.315+0000 7fa4ca310b80 10 client.25838 fetch_fsmap learned FSMap version 35 2024-06-02T04:57:19.318 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.315+0000 7fa4ca310b80 1 -- 172.21.15.76:0/2183809564 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x7fa4b8108ba0 con 0x55d26296ea80 2024-06-02T04:57:19.320 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.315+0000 7fa496ffd700 1 -- 172.21.15.76:0/2183809564 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55d262818210 con 0x55d26296ea80 2024-06-02T04:57:19.320 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.316+0000 7fa496ffd700 1 -- 172.21.15.76:0/2183809564 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 35) v1 ==== 7474+0+0 (secure 0 0 0) 0x7fa4a8041870 con 0x55d26296ea80 2024-06-02T04:57:19.320 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.316+0000 7fa4ca310b80 10 client.25838 fetch_fsmap finished waiting for FSMap version 35 2024-06-02T04:57:19.320 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.316+0000 7fa4ca310b80 10 client.25838 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T04:57:19.320 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.316+0000 7fa4ca310b80 20 client.25838 populate_metadata read hostname 'smithi076' 2024-06-02T04:57:19.321 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.316+0000 7fa4ca310b80 1 --2- 172.21.15.76:0/2183809564 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55d262995130 0x55d262997520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:57:19.321 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.316+0000 7fa4ca310b80 4 client.25838 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T04:57:19.321 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.316+0000 7fa4ca310b80 1 -- 172.21.15.76:0/2183809564 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d26293e7b0 con 0x55d262995130 2024-06-02T04:57:19.321 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.317+0000 7fa4b6ffd700 1 --2- 172.21.15.76:0/2183809564 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55d262995130 0x55d262997520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:57:19.321 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.317+0000 7fa496ffd700 10 client.25838 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:57:19.321 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.317+0000 7fa4b6ffd700 1 --2- 172.21.15.76:0/2183809564 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55d262995130 0x55d262997520 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=12c607fac3541477 server_cookie=754a1ed2d534a28c in_seq=0 out_seq=0 2024-06-02T04:57:19.321 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.318+0000 7fa496ffd700 1 -- 172.21.15.76:0/2183809564 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55d26293e7b0 con 0x55d262995130 2024-06-02T04:57:19.321 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.318+0000 7fa496ffd700 10 client.25838 handle_command_reply: tid=0 2024-06-02T04:57:19.321 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.318+0000 7fa4ca310b80 1 client.25838 shutdown 2024-06-02T04:57:19.321 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.318+0000 7fa4ca310b80 1 -- 172.21.15.76:0/2183809564 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d26296ea80 msgr2=0x55d262978810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:57:19.321 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.318+0000 7fa4ca310b80 1 --2- 172.21.15.76:0/2183809564 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d26296ea80 0x55d262978810 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa4a8005cd0 tx=0x7fa4a800beb0 comp rx=0 tx=0).stop 2024-06-02T04:57:19.321 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.318+0000 7fa4ca310b80 1 -- 172.21.15.76:0/2183809564 shutdown_connections 2024-06-02T04:57:19.321 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.318+0000 7fa4ca310b80 1 --2- 172.21.15.76:0/2183809564 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55d262995130 0x55d262997520 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:19.322 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.318+0000 7fa4ca310b80 1 --2- 172.21.15.76:0/2183809564 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2629702d0 0x55d26297fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:19.322 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.318+0000 7fa4ca310b80 1 --2- 172.21.15.76:0/2183809564 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d26296ea80 0x55d262978810 secure :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa4a8005cd0 tx=0x7fa4a800beb0 comp rx=0 tx=0).stop 2024-06-02T04:57:19.322 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.318+0000 7fa4ca310b80 1 --2- 172.21.15.76:0/2183809564 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d26296f3e0 0x55d262978d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:19.322 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.318+0000 7fa4ca310b80 1 -- 172.21.15.76:0/2183809564 >> 172.21.15.76:0/2183809564 conn(0x55d2628cd1b0 msgr2=0x55d262969860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:57:19.322 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.318+0000 7fa496ffd700 0 client.25838 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:57:19.322 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.319+0000 7fa4ca310b80 1 -- 172.21.15.76:0/2183809564 shutdown_connections 2024-06-02T04:57:19.322 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.319+0000 7fa4ca310b80 1 -- 172.21.15.76:0/2183809564 wait complete. 2024-06-02T04:57:19.322 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.319+0000 7fa4ca310b80 20 client.25838 trim_cache size 0 max 16384 2024-06-02T04:57:19.344 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.343+0000 7fa4ca310b80 1 Processor -- start 2024-06-02T04:57:19.344 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.343+0000 7fa4ca310b80 1 -- start start 2024-06-02T04:57:19.345 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.344+0000 7fa4ca310b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d26296f3e0 0x55d262991450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:57:19.345 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.344+0000 7fa4ca310b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d2629702d0 0x55d26297fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:57:19.345 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.344+0000 7fa4ca310b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2629706b0 0x55d26296b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:57:19.345 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.344+0000 7fa4ca310b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d262964370 con 0x55d2629706b0 2024-06-02T04:57:19.345 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.344+0000 7fa4ca310b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d262977300 con 0x55d26296f3e0 2024-06-02T04:57:19.345 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.344+0000 7fa4ca310b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d262979840 con 0x55d2629702d0 2024-06-02T04:57:19.345 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.344+0000 7fa4b6ffd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d2629702d0 0x55d26297fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:57:19.345 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.344+0000 7fa4b7fff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2629706b0 0x55d26296b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:57:19.345 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.344+0000 7fa4b7fff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2629706b0 0x55d26296b020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:33640/0 (socket says 172.21.15.76:33640) 2024-06-02T04:57:19.345 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.344+0000 7fa4b7fff700 1 -- 172.21.15.76:0/3618903163 learned_addr learned my addr 172.21.15.76:0/3618903163 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:57:19.345 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.344+0000 7fa4b77fe700 1 --2- 172.21.15.76:0/3618903163 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d26296f3e0 0x55d262991450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:57:19.346 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.345+0000 7fa4b7fff700 1 -- 172.21.15.76:0/3618903163 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d2629702d0 msgr2=0x55d26297fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:57:19.346 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.345+0000 7fa4b7fff700 1 --2- 172.21.15.76:0/3618903163 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d2629702d0 0x55d26297fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:19.346 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.345+0000 7fa4b7fff700 1 -- 172.21.15.76:0/3618903163 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d26296f3e0 msgr2=0x55d262991450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:57:19.346 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.345+0000 7fa4b7fff700 1 --2- 172.21.15.76:0/3618903163 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d26296f3e0 0x55d262991450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:19.347 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.345+0000 7fa4b7fff700 1 -- 172.21.15.76:0/3618903163 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d2626ecb00 con 0x55d2629706b0 2024-06-02T04:57:19.347 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.345+0000 7fa4b7fff700 1 --2- 172.21.15.76:0/3618903163 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2629706b0 0x55d26296b020 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fa4b0007700 tx=0x7fa4b0007730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b39d4bf96973416 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:57:19.347 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.345+0000 7fa49e7fc700 1 -- 172.21.15.76:0/3618903163 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b0020470 con 0x55d2629706b0 2024-06-02T04:57:19.347 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.345+0000 7fa49e7fc700 1 -- 172.21.15.76:0/3618903163 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa4b000f040 con 0x55d2629706b0 2024-06-02T04:57:19.347 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.346+0000 7fa49e7fc700 1 -- 172.21.15.76:0/3618903163 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b00178d0 con 0x55d2629706b0 2024-06-02T04:57:19.347 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.346+0000 7fa4ca310b80 1 -- 172.21.15.76:0/3618903163 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2629706b0 msgr2=0x55d26296b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:57:19.347 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.346+0000 7fa4ca310b80 1 --2- 172.21.15.76:0/3618903163 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2629706b0 0x55d26296b020 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fa4b0007700 tx=0x7fa4b0007730 comp rx=0 tx=0).stop 2024-06-02T04:57:19.350 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.350+0000 7fa4ca310b80 1 -- 172.21.15.76:0/3618903163 shutdown_connections 2024-06-02T04:57:19.350 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.350+0000 7fa4ca310b80 1 --2- 172.21.15.76:0/3618903163 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2629706b0 0x55d26296b020 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:19.350 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.350+0000 7fa4ca310b80 1 --2- 172.21.15.76:0/3618903163 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d26296f3e0 0x55d262991450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:19.350 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.350+0000 7fa4ca310b80 1 --2- 172.21.15.76:0/3618903163 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d2629702d0 0x55d26297fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:19.350 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.350+0000 7fa4ca310b80 1 -- 172.21.15.76:0/3618903163 >> 172.21.15.76:0/3618903163 conn(0x55d2628cd1b0 msgr2=0x55d262977d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:57:19.353 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.352+0000 7fa4ca310b80 1 -- 172.21.15.76:0/3618903163 shutdown_connections 2024-06-02T04:57:19.353 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.353+0000 7fa4ca310b80 1 -- 172.21.15.76:0/3618903163 wait complete. 2024-06-02T04:57:19.354 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.353+0000 7fa4ca310b80 1 -- start start 2024-06-02T04:57:19.354 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.353+0000 7fa4ca310b80 1 Processor -- start 2024-06-02T04:57:19.355 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.353+0000 7fa4ca310b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d26296f3e0 0x55d26297d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:57:19.355 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.353+0000 7fa4ca310b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2629702d0 0x55d26297dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:57:19.355 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.353+0000 7fa4ca310b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d2629706b0 0x55d26297ea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:57:19.355 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.353+0000 7fa4ca310b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d26297ef70 con 0x55d2629702d0 2024-06-02T04:57:19.356 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.353+0000 7fa4ca310b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d26297f0e0 con 0x55d2629706b0 2024-06-02T04:57:19.356 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.353+0000 7fa4ca310b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d26297f2a0 con 0x55d26296f3e0 2024-06-02T04:57:19.356 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.354+0000 7fa4ca310b80 10 client.0 _ll_register_callbacks cb 0x55d262864ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:57:19.356 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.354+0000 7fa4b6ffd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2629702d0 0x55d26297dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:57:19.356 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.354+0000 7fa4b7fff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d2629706b0 0x55d26297ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:57:19.356 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.354+0000 7fa4b7fff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d2629706b0 0x55d26297ea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:56088/0 (socket says 172.21.15.76:56088) 2024-06-02T04:57:19.356 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.354+0000 7fa4b6ffd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2629702d0 0x55d26297dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:33648/0 (socket says 172.21.15.76:33648) 2024-06-02T04:57:19.356 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.354+0000 7fa4b7fff700 1 -- 172.21.15.76:0/1965348322 learned_addr learned my addr 172.21.15.76:0/1965348322 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:57:19.356 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.354+0000 7fa4b77fe700 1 --2- 172.21.15.76:0/1965348322 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d26296f3e0 0x55d26297d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:57:19.356 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.354+0000 7fa4b7fff700 1 -- 172.21.15.76:0/1965348322 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d26296f3e0 msgr2=0x55d26297d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:57:19.356 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.354+0000 7fa4b7fff700 1 --2- 172.21.15.76:0/1965348322 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d26296f3e0 0x55d26297d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:19.356 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.354+0000 7fa4b7fff700 1 -- 172.21.15.76:0/1965348322 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2629702d0 msgr2=0x55d26297dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:57:19.357 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.354+0000 7fa4b7fff700 1 --2- 172.21.15.76:0/1965348322 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2629702d0 0x55d26297dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:19.357 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.354+0000 7fa4b7fff700 1 -- 172.21.15.76:0/1965348322 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4b00073e0 con 0x55d2629706b0 2024-06-02T04:57:19.357 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.354+0000 7fa4b6ffd700 1 --2- 172.21.15.76:0/1965348322 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2629702d0 0x55d26297dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T04:57:19.357 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.354+0000 7fa4b7fff700 1 --2- 172.21.15.76:0/1965348322 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d2629706b0 0x55d26297ea30 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa4b0017d60 tx=0x7fa4b0017d90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1061d015c9c1bad1 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:57:19.357 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.354+0000 7fa496ffd700 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-06-02T04:57:19.357 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.355+0000 7fa496ffd700 1 -- 172.21.15.76:0/1965348322 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b0004cd0 con 0x55d2629706b0 2024-06-02T04:57:19.357 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.355+0000 7fa496ffd700 1 -- 172.21.15.76:0/1965348322 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7fa4b0004e30 con 0x55d2629706b0 2024-06-02T04:57:19.357 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.355+0000 7fa4ca310b80 1 -- 172.21.15.76:0/1965348322 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa4a801e040 con 0x55d2629706b0 2024-06-02T04:57:19.358 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.355+0000 7fa496ffd700 1 -- 172.21.15.76:0/1965348322 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa4b0005020 con 0x55d2629706b0 2024-06-02T04:57:19.358 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.355+0000 7fa4ca310b80 10 client.25844 fetch_fsmap learned FSMap version 35 2024-06-02T04:57:19.358 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.355+0000 7fa4ca310b80 1 -- 172.21.15.76:0/1965348322 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x55d262885500 con 0x55d2629706b0 2024-06-02T04:57:19.358 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.355+0000 7fa496ffd700 1 -- 172.21.15.76:0/1965348322 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa4a801e040 con 0x55d2629706b0 2024-06-02T04:57:19.359 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.356+0000 7fa496ffd700 1 -- 172.21.15.76:0/1965348322 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 35) v1 ==== 7474+0+0 (secure 0 0 0) 0x7fa4b00327f0 con 0x55d2629706b0 2024-06-02T04:57:19.359 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.358+0000 7fa4ca310b80 10 client.25844 fetch_fsmap finished waiting for FSMap version 35 2024-06-02T04:57:19.359 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.358+0000 7fa4ca310b80 10 client.25844 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T04:57:19.359 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.358+0000 7fa4ca310b80 20 client.25844 populate_metadata read hostname 'smithi076' 2024-06-02T04:57:19.359 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.358+0000 7fa4ca310b80 1 --2- 172.21.15.76:0/1965348322 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55d2629ebef0 0x55d2629ee310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:57:19.359 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.358+0000 7fa4ca310b80 4 client.25844 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T04:57:19.359 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.358+0000 7fa4ca310b80 1 -- 172.21.15.76:0/1965348322 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55d2628b7e60 con 0x55d2629ebef0 2024-06-02T04:57:19.359 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.358+0000 7fa4b77fe700 1 --2- 172.21.15.76:0/1965348322 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55d2629ebef0 0x55d2629ee310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:57:19.360 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.358+0000 7fa496ffd700 10 client.25844 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:57:19.360 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.359+0000 7fa4b77fe700 1 --2- 172.21.15.76:0/1965348322 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55d2629ebef0 0x55d2629ee310 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=448081850f6dcc4f server_cookie=abc9fa6f838c3022 in_seq=0 out_seq=0 2024-06-02T04:57:19.393 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.392+0000 7fa496ffd700 1 -- 172.21.15.76:0/1965348322 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55d2628b7e60 con 0x55d2629ebef0 2024-06-02T04:57:19.393 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.392+0000 7fa496ffd700 10 client.25844 handle_command_reply: tid=0 2024-06-02T04:57:19.393 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.392+0000 7fa4ca310b80 1 client.25844 shutdown 2024-06-02T04:57:19.394 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.393+0000 7fa4ca310b80 1 -- 172.21.15.76:0/1965348322 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d2629706b0 msgr2=0x55d26297ea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:57:19.394 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.393+0000 7fa4ca310b80 1 --2- 172.21.15.76:0/1965348322 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d2629706b0 0x55d26297ea30 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa4b0017d60 tx=0x7fa4b0017d90 comp rx=0 tx=0).stop 2024-06-02T04:57:19.394 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.394+0000 7fa4ca310b80 1 -- 172.21.15.76:0/1965348322 shutdown_connections 2024-06-02T04:57:19.394 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.394+0000 7fa4ca310b80 1 --2- 172.21.15.76:0/1965348322 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55d2629ebef0 0x55d2629ee310 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:19.394 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.394+0000 7fa4ca310b80 1 --2- 172.21.15.76:0/1965348322 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d2629706b0 0x55d26297ea30 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:19.394 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.394+0000 7fa4ca310b80 1 --2- 172.21.15.76:0/1965348322 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d26296f3e0 0x55d26297d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:19.394 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.394+0000 7fa4ca310b80 1 --2- 172.21.15.76:0/1965348322 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2629702d0 0x55d26297dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:19.395 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.394+0000 7fa4ca310b80 1 -- 172.21.15.76:0/1965348322 >> 172.21.15.76:0/1965348322 conn(0x55d2628cd1b0 msgr2=0x55d26296b020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:57:19.395 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.394+0000 7fa496ffd700 0 client.25844 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:57:19.395 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.394+0000 7fa4ca310b80 1 -- 172.21.15.76:0/1965348322 shutdown_connections 2024-06-02T04:57:19.395 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.394+0000 7fa4ca310b80 1 -- 172.21.15.76:0/1965348322 wait complete. 2024-06-02T04:57:19.398 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.397+0000 7fa4ca310b80 20 client.25844 trim_cache size 0 max 16384 2024-06-02T04:57:19.398 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:{ 2024-06-02T04:57:19.398 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "message": "", 2024-06-02T04:57:19.398 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "return_code": 0 2024-06-02T04:57:19.399 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:} 2024-06-02T04:57:19.399 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.398+0000 7fa4be155700 1 -- 172.21.15.76:0/588340405 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fa4a00a11f0 msgr2=0x7fa4a00a36b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:57:19.399 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.398+0000 7fa4be155700 1 --2- 172.21.15.76:0/588340405 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fa4a00a11f0 0x7fa4a00a36b0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fa4a80098e0 tx=0x7fa4a80036b0 comp rx=0 tx=0).stop 2024-06-02T04:57:19.399 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.399+0000 7fa4be155700 1 -- 172.21.15.76:0/588340405 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa4b8100f90 msgr2=0x7fa4b819d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:57:19.399 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.399+0000 7fa4be155700 1 --2- 172.21.15.76:0/588340405 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa4b8100f90 0x7fa4b819d910 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa4ac00abb0 tx=0x7fa4ac00aec0 comp rx=0 tx=0).stop 2024-06-02T04:57:19.401 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.401+0000 7fa4be155700 1 -- 172.21.15.76:0/588340405 shutdown_connections 2024-06-02T04:57:19.401 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.401+0000 7fa4be155700 1 --2- 172.21.15.76:0/588340405 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fa4a00a11f0 0x7fa4a00a36b0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:19.401 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.401+0000 7fa4be155700 1 --2- 172.21.15.76:0/588340405 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa4b8101950 0x7fa4b81a4930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:19.401 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.401+0000 7fa4be155700 1 --2- 172.21.15.76:0/588340405 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa4b80ffe40 0x7fa4b819d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:19.401 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.401+0000 7fa4be155700 1 --2- 172.21.15.76:0/588340405 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa4b8100f90 0x7fa4b819d910 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:19.401 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.401+0000 7fa4be155700 1 -- 172.21.15.76:0/588340405 >> 172.21.15.76:0/588340405 conn(0x7fa4b80fb3b0 msgr2=0x7fa4b810bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:57:19.407 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.406+0000 7fa4be155700 1 -- 172.21.15.76:0/588340405 shutdown_connections 2024-06-02T04:57:19.407 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:19.406+0000 7fa4be155700 1 -- 172.21.15.76:0/588340405 wait complete. 2024-06-02T04:57:19.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:57:19 smithi119 ceph-mon[46633]: pgmap v500: 129 pgs: 129 active+clean; 1.5 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 8.0 MiB/s wr, 782 op/s 2024-06-02T04:57:19.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:57:19 smithi192 ceph-mon[47933]: pgmap v500: 129 pgs: 129 active+clean; 1.5 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 8.0 MiB/s wr, 782 op/s 2024-06-02T04:57:19.985 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:57:19 smithi076 ceph-mon[42935]: pgmap v500: 129 pgs: 129 active+clean; 1.5 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 8.0 MiB/s wr, 782 op/s 2024-06-02T04:57:20.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:57:20 smithi119 ceph-mon[46633]: pgmap v501: 129 pgs: 129 active+clean; 1.5 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 7.9 MiB/s wr, 801 op/s 2024-06-02T04:57:20.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:57:20 smithi192 ceph-mon[47933]: pgmap v501: 129 pgs: 129 active+clean; 1.5 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 7.9 MiB/s wr, 801 op/s 2024-06-02T04:57:20.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:57:20 smithi076 ceph-mon[42935]: pgmap v501: 129 pgs: 129 active+clean; 1.5 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 7.9 MiB/s wr, 801 op/s 2024-06-02T04:57:21.316 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 390.0 s, 774.2 tps, lat 129.216 ms stddev 51.026 2024-06-02T04:57:23.733 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:57:23 smithi076 ceph-mon[42935]: pgmap v502: 129 pgs: 129 active+clean; 1.5 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 9.0 MiB/s wr, 795 op/s 2024-06-02T04:57:23.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:57:23 smithi119 ceph-mon[46633]: pgmap v502: 129 pgs: 129 active+clean; 1.5 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 9.0 MiB/s wr, 795 op/s 2024-06-02T04:57:23.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:57:23 smithi192 ceph-mon[47933]: pgmap v502: 129 pgs: 129 active+clean; 1.5 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 9.0 MiB/s wr, 795 op/s 2024-06-02T04:57:25.739 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:57:25 smithi076 ceph-mon[42935]: pgmap v503: 129 pgs: 129 active+clean; 1.5 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 9.4 MiB/s wr, 772 op/s 2024-06-02T04:57:25.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:57:25 smithi119 ceph-mon[46633]: pgmap v503: 129 pgs: 129 active+clean; 1.5 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 9.4 MiB/s wr, 772 op/s 2024-06-02T04:57:25.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:57:25 smithi192 ceph-mon[47933]: pgmap v503: 129 pgs: 129 active+clean; 1.5 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 9.4 MiB/s wr, 772 op/s 2024-06-02T04:57:26.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 395.0 s, 914.1 tps, lat 109.741 ms stddev 40.260 2024-06-02T04:57:27.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:57:27 smithi076 ceph-mon[42935]: pgmap v504: 129 pgs: 129 active+clean; 1.5 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 12 MiB/s wr, 843 op/s 2024-06-02T04:57:27.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:57:27 smithi119 ceph-mon[46633]: pgmap v504: 129 pgs: 129 active+clean; 1.5 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 12 MiB/s wr, 843 op/s 2024-06-02T04:57:27.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:57:27 smithi192 ceph-mon[47933]: pgmap v504: 129 pgs: 129 active+clean; 1.5 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 12 MiB/s wr, 843 op/s 2024-06-02T04:57:29.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:57:29 smithi119 ceph-mon[46633]: pgmap v505: 129 pgs: 129 active+clean; 1.5 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 13 MiB/s wr, 849 op/s 2024-06-02T04:57:29.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:57:29 smithi192 ceph-mon[47933]: pgmap v505: 129 pgs: 129 active+clean; 1.5 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 13 MiB/s wr, 849 op/s 2024-06-02T04:57:29.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:57:29 smithi076 ceph-mon[42935]: pgmap v505: 129 pgs: 129 active+clean; 1.5 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 13 MiB/s wr, 849 op/s 2024-06-02T04:57:31.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 400.0 s, 625.6 tps, lat 159.241 ms stddev 235.970 2024-06-02T04:57:31.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:57:31 smithi119 ceph-mon[46633]: pgmap v506: 129 pgs: 129 active+clean; 1.5 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 14 MiB/s wr, 918 op/s 2024-06-02T04:57:31.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:57:31 smithi192 ceph-mon[47933]: pgmap v506: 129 pgs: 129 active+clean; 1.5 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 14 MiB/s wr, 918 op/s 2024-06-02T04:57:31.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:57:31 smithi076 ceph-mon[42935]: pgmap v506: 129 pgs: 129 active+clean; 1.5 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 14 MiB/s wr, 918 op/s 2024-06-02T04:57:32.582 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.581+0000 7f91875e1700 1 -- 172.21.15.76:0/2615990593 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f91801020e0 msgr2=0x7f9180104570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:57:32.582 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.581+0000 7f91875e1700 1 --2- 172.21.15.76:0/2615990593 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f91801020e0 0x7f9180104570 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9170009990 tx=0x7f9170009ca0 comp rx=0 tx=0).stop 2024-06-02T04:57:32.584 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.582+0000 7f91875e1700 1 -- 172.21.15.76:0/2615990593 shutdown_connections 2024-06-02T04:57:32.584 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.582+0000 7f91875e1700 1 --2- 172.21.15.76:0/2615990593 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9180104ab0 0x7f9180104f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:32.584 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.582+0000 7f91875e1700 1 --2- 172.21.15.76:0/2615990593 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f91800ff770 0x7f9180101ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:32.584 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.582+0000 7f91875e1700 1 --2- 172.21.15.76:0/2615990593 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f91801020e0 0x7f9180104570 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:32.584 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.582+0000 7f91875e1700 1 -- 172.21.15.76:0/2615990593 >> 172.21.15.76:0/2615990593 conn(0x7f91800fb390 msgr2=0x7f91800fd7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:57:32.585 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.584+0000 7f91875e1700 1 -- 172.21.15.76:0/2615990593 shutdown_connections 2024-06-02T04:57:32.585 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.584+0000 7f91875e1700 1 -- 172.21.15.76:0/2615990593 wait complete. 2024-06-02T04:57:32.586 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.585+0000 7f91875e1700 1 Processor -- start 2024-06-02T04:57:32.586 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.585+0000 7f91875e1700 1 -- start start 2024-06-02T04:57:32.586 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.586+0000 7f91875e1700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f91800ff770 0x7f918010acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:57:32.587 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.586+0000 7f91875e1700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f91801020e0 0x7f918010b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:57:32.587 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.586+0000 7f91875e1700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9180104ab0 0x7f91801ad590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:57:32.587 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.586+0000 7f91875e1700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f918010b800 con 0x7f91800ff770 2024-06-02T04:57:32.587 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.586+0000 7f91875e1700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f918010b940 con 0x7f91801020e0 2024-06-02T04:57:32.587 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.586+0000 7f91875e1700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f918006a9c0 con 0x7f9180104ab0 2024-06-02T04:57:32.587 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.586+0000 7f918537d700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f91800ff770 0x7f918010acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:57:32.587 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.586+0000 7f918537d700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f91800ff770 0x7f918010acf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:42552/0 (socket says 172.21.15.76:42552) 2024-06-02T04:57:32.587 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.586+0000 7f918537d700 1 -- 172.21.15.76:0/701986236 learned_addr learned my addr 172.21.15.76:0/701986236 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:57:32.588 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.586+0000 7f9184b7c700 1 --2- 172.21.15.76:0/701986236 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f91801020e0 0x7f918010b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:57:32.588 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.586+0000 7f9185b7e700 1 --2- 172.21.15.76:0/701986236 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9180104ab0 0x7f91801ad590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:57:32.588 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.586+0000 7f918537d700 1 -- 172.21.15.76:0/701986236 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9180104ab0 msgr2=0x7f91801ad590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:57:32.588 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.586+0000 7f918537d700 1 --2- 172.21.15.76:0/701986236 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9180104ab0 0x7f91801ad590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:32.589 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.586+0000 7f918537d700 1 -- 172.21.15.76:0/701986236 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f91801020e0 msgr2=0x7f918010b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:57:32.589 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.586+0000 7f918537d700 1 --2- 172.21.15.76:0/701986236 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f91801020e0 0x7f918010b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:32.589 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.586+0000 7f918537d700 1 -- 172.21.15.76:0/701986236 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91700095f0 con 0x7f91800ff770 2024-06-02T04:57:32.589 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.587+0000 7f918537d700 1 --2- 172.21.15.76:0/701986236 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f91800ff770 0x7f918010acf0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f917c00b530 tx=0x7f917c00b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:57:32.589 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.587+0000 7f91767fc700 1 -- 172.21.15.76:0/701986236 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f917c011830 con 0x7f91800ff770 2024-06-02T04:57:32.589 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.587+0000 7f91767fc700 1 -- 172.21.15.76:0/701986236 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f917c011e20 con 0x7f91800ff770 2024-06-02T04:57:32.589 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.587+0000 7f91767fc700 1 -- 172.21.15.76:0/701986236 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f917c010dd0 con 0x7f91800ff770 2024-06-02T04:57:32.589 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.588+0000 7f91875e1700 1 -- 172.21.15.76:0/701986236 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f918006aca0 con 0x7f91800ff770 2024-06-02T04:57:32.589 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.588+0000 7f91875e1700 1 -- 172.21.15.76:0/701986236 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f918006b160 con 0x7f91800ff770 2024-06-02T04:57:32.591 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.591+0000 7f91767fc700 1 -- 172.21.15.76:0/701986236 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f917c011990 con 0x7f91800ff770 2024-06-02T04:57:32.593 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.592+0000 7f91767fc700 1 --2- 172.21.15.76:0/701986236 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f916c0a1120 0x7f916c0a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:57:32.593 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.592+0000 7f919379cb80 1 Processor -- start 2024-06-02T04:57:32.593 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.592+0000 7f91767fc700 1 -- 172.21.15.76:0/701986236 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f917c0cc6d0 con 0x7f91800ff770 2024-06-02T04:57:32.593 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.592+0000 7f919379cb80 1 -- start start 2024-06-02T04:57:32.594 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.593+0000 7f919379cb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562df327aa80 0x562df327aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:57:32.594 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.593+0000 7f919379cb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562df327b3e0 0x562df327bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:57:32.594 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.593+0000 7f919379cb80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562df327c2d0 0x562df327c750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:57:32.594 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.593+0000 7f919379cb80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x562df31d20f0 con 0x562df327c2d0 2024-06-02T04:57:32.594 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.593+0000 7f919379cb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x562df31cfab0 con 0x562df327aa80 2024-06-02T04:57:32.594 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.593+0000 7f919379cb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x562df31cb3a0 con 0x562df327b3e0 2024-06-02T04:57:32.594 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.593+0000 7f9185b7e700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562df327c2d0 0x562df327c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:57:32.594 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.593+0000 7f9185b7e700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562df327c2d0 0x562df327c750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:42560/0 (socket says 172.21.15.76:42560) 2024-06-02T04:57:32.594 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.593+0000 7f918537d700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562df327aa80 0x562df327aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:57:32.594 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.593+0000 7f9185b7e700 1 -- 172.21.15.76:0/2139336165 learned_addr learned my addr 172.21.15.76:0/2139336165 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:57:32.595 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.593+0000 7f9184b7c700 1 --2- 172.21.15.76:0/2139336165 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562df327b3e0 0x562df327bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:57:32.595 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.593+0000 7f9184b7c700 1 --2- 172.21.15.76:0/701986236 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f916c0a1120 0x7f916c0a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:57:32.596 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.593+0000 7f918537d700 1 -- 172.21.15.76:0/2139336165 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562df327b3e0 msgr2=0x562df327bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:57:32.596 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.593+0000 7f918537d700 1 --2- 172.21.15.76:0/2139336165 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562df327b3e0 0x562df327bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:32.596 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.593+0000 7f918537d700 1 -- 172.21.15.76:0/2139336165 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562df327c2d0 msgr2=0x562df327c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:57:32.596 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.593+0000 7f918537d700 1 --2- 172.21.15.76:0/2139336165 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562df327c2d0 0x562df327c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:32.596 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.593+0000 7f918537d700 1 -- 172.21.15.76:0/2139336165 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562df304c350 con 0x562df327aa80 2024-06-02T04:57:32.596 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.594+0000 7f918537d700 1 --2- 172.21.15.76:0/2139336165 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562df327aa80 0x562df327aea0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f917c0c9e90 tx=0x7f917c004860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a66d2b1ff8abca8 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:57:32.596 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.594+0000 7f9184b7c700 1 --2- 172.21.15.76:0/701986236 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f916c0a1120 0x7f916c0a35e0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f917000b5c0 tx=0x7f9170003750 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:57:32.597 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.594+0000 7f916b7fe700 1 -- 172.21.15.76:0/2139336165 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f917c099140 con 0x562df327aa80 2024-06-02T04:57:32.597 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.594+0000 7f916b7fe700 1 -- 172.21.15.76:0/2139336165 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f917c010510 con 0x562df327aa80 2024-06-02T04:57:32.597 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.594+0000 7f916b7fe700 1 -- 172.21.15.76:0/2139336165 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f917c0a1c60 con 0x562df327aa80 2024-06-02T04:57:32.597 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.595+0000 7f919379cb80 1 -- 172.21.15.76:0/2139336165 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562df327aa80 msgr2=0x562df327aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:57:32.597 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.595+0000 7f919379cb80 1 --2- 172.21.15.76:0/2139336165 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562df327aa80 0x562df327aea0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f917c0c9e90 tx=0x7f917c004860 comp rx=0 tx=0).stop 2024-06-02T04:57:32.597 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.595+0000 7f919379cb80 1 -- 172.21.15.76:0/2139336165 shutdown_connections 2024-06-02T04:57:32.597 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.595+0000 7f919379cb80 1 --2- 172.21.15.76:0/2139336165 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562df327c2d0 0x562df327c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:32.597 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.595+0000 7f919379cb80 1 --2- 172.21.15.76:0/2139336165 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562df327aa80 0x562df327aea0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:32.597 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.595+0000 7f919379cb80 1 --2- 172.21.15.76:0/2139336165 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562df327b3e0 0x562df327bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:32.597 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.595+0000 7f919379cb80 1 -- 172.21.15.76:0/2139336165 >> 172.21.15.76:0/2139336165 conn(0x562df31d91b0 msgr2=0x562df3277440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:57:32.598 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.596+0000 7f919379cb80 1 -- 172.21.15.76:0/2139336165 shutdown_connections 2024-06-02T04:57:32.598 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.596+0000 7f919379cb80 1 -- 172.21.15.76:0/2139336165 wait complete. 2024-06-02T04:57:32.598 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.597+0000 7f919379cb80 1 -- start start 2024-06-02T04:57:32.598 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.597+0000 7f919379cb80 1 Processor -- start 2024-06-02T04:57:32.599 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.598+0000 7f919379cb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562df327aa80 0x562df3284930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:57:32.599 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.598+0000 7f919379cb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562df327b3e0 0x562df3284e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:57:32.599 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.598+0000 7f919379cb80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562df327c2d0 0x562df328beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:57:32.599 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.598+0000 7f919379cb80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x562df3167500 con 0x562df327c2d0 2024-06-02T04:57:32.599 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.598+0000 7f919379cb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x562df31671a0 con 0x562df327b3e0 2024-06-02T04:57:32.599 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.598+0000 7f919379cb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x562df304e640 con 0x562df327aa80 2024-06-02T04:57:32.599 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.598+0000 7f919379cb80 10 client.0 _ll_register_callbacks cb 0x562df3170ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:57:32.599 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.598+0000 7f9185b7e700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562df327c2d0 0x562df328beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:57:32.599 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.598+0000 7f9185b7e700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562df327c2d0 0x562df328beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:42570/0 (socket says 172.21.15.76:42570) 2024-06-02T04:57:32.599 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.598+0000 7f9185b7e700 1 -- 172.21.15.76:0/1941823297 learned_addr learned my addr 172.21.15.76:0/1941823297 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:57:32.599 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.598+0000 7f918537d700 1 --2- 172.21.15.76:0/1941823297 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562df327aa80 0x562df3284930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:57:32.600 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.598+0000 7f9185b7e700 1 -- 172.21.15.76:0/1941823297 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562df327aa80 msgr2=0x562df3284930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:57:32.600 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.598+0000 7f9185b7e700 1 --2- 172.21.15.76:0/1941823297 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562df327aa80 0x562df3284930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:32.600 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.598+0000 7f9185b7e700 1 -- 172.21.15.76:0/1941823297 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562df327b3e0 msgr2=0x562df3284e70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-02T04:57:32.600 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.598+0000 7f9185b7e700 1 --2- 172.21.15.76:0/1941823297 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562df327b3e0 0x562df3284e70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:32.600 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.598+0000 7f9185b7e700 1 -- 172.21.15.76:0/1941823297 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f918006b160 con 0x562df327c2d0 2024-06-02T04:57:32.601 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.599+0000 7f9185b7e700 1 --2- 172.21.15.76:0/1941823297 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562df327c2d0 0x562df328beb0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f917800f6d0 tx=0x7f917800fa90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec6b7709d4fe4b89 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:57:32.602 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.599+0000 7f9168ff9700 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-06-02T04:57:32.602 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.599+0000 7f9168ff9700 1 -- 172.21.15.76:0/1941823297 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9178011830 con 0x562df327c2d0 2024-06-02T04:57:32.602 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.599+0000 7f9168ff9700 1 -- 172.21.15.76:0/1941823297 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f917800d040 con 0x562df327c2d0 2024-06-02T04:57:32.602 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.599+0000 7f919379cb80 1 -- 172.21.15.76:0/1941823297 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562df3124210 con 0x562df327c2d0 2024-06-02T04:57:32.602 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.599+0000 7f9168ff9700 1 -- 172.21.15.76:0/1941823297 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9178011990 con 0x562df327c2d0 2024-06-02T04:57:32.602 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.600+0000 7f919379cb80 10 client.16263 fetch_fsmap learned FSMap version 35 2024-06-02T04:57:32.602 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.600+0000 7f919379cb80 1 -- 172.21.15.76:0/1941823297 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x562df2ff8b00 con 0x562df327c2d0 2024-06-02T04:57:32.602 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.600+0000 7f9168ff9700 1 -- 172.21.15.76:0/1941823297 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x562df3124210 con 0x562df327c2d0 2024-06-02T04:57:32.602 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.600+0000 7f9168ff9700 1 -- 172.21.15.76:0/1941823297 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 35) v1 ==== 7474+0+0 (secure 0 0 0) 0x7f917801cc60 con 0x562df327c2d0 2024-06-02T04:57:32.602 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.600+0000 7f919379cb80 10 client.16263 fetch_fsmap finished waiting for FSMap version 35 2024-06-02T04:57:32.602 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.600+0000 7f919379cb80 10 client.16263 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T04:57:32.603 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.600+0000 7f919379cb80 20 client.16263 populate_metadata read hostname 'smithi076' 2024-06-02T04:57:32.603 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.600+0000 7f919379cb80 1 --2- 172.21.15.76:0/1941823297 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x562df32907c0 0x562df3292be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:57:32.603 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.600+0000 7f919379cb80 4 client.16263 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T04:57:32.603 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.600+0000 7f919379cb80 1 -- 172.21.15.76:0/1941823297 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562df324a7b0 con 0x562df32907c0 2024-06-02T04:57:32.603 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.601+0000 7f918537d700 1 --2- 172.21.15.76:0/1941823297 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x562df32907c0 0x562df3292be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:57:32.603 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.601+0000 7f9168ff9700 10 client.16263 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:57:32.603 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.601+0000 7f918537d700 1 --2- 172.21.15.76:0/1941823297 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x562df32907c0 0x562df3292be0 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=80cec99b8cf3291e server_cookie=ecd96476b54372d6 in_seq=0 out_seq=0 2024-06-02T04:57:32.604 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.602+0000 7f9168ff9700 1 -- 172.21.15.76:0/1941823297 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x562df324a7b0 con 0x562df32907c0 2024-06-02T04:57:32.604 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.602+0000 7f9168ff9700 10 client.16263 handle_command_reply: tid=0 2024-06-02T04:57:32.604 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.602+0000 7f919379cb80 1 client.16263 shutdown 2024-06-02T04:57:32.604 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.602+0000 7f919379cb80 1 -- 172.21.15.76:0/1941823297 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562df327c2d0 msgr2=0x562df328beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:57:32.604 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.602+0000 7f919379cb80 1 --2- 172.21.15.76:0/1941823297 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562df327c2d0 0x562df328beb0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f917800f6d0 tx=0x7f917800fa90 comp rx=0 tx=0).stop 2024-06-02T04:57:32.604 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.602+0000 7f919379cb80 1 -- 172.21.15.76:0/1941823297 shutdown_connections 2024-06-02T04:57:32.604 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.602+0000 7f919379cb80 1 --2- 172.21.15.76:0/1941823297 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x562df32907c0 0x562df3292be0 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:32.605 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.602+0000 7f919379cb80 1 --2- 172.21.15.76:0/1941823297 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562df327c2d0 0x562df328beb0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:32.605 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.602+0000 7f919379cb80 1 --2- 172.21.15.76:0/1941823297 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562df327aa80 0x562df3284930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:32.605 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.602+0000 7f919379cb80 1 --2- 172.21.15.76:0/1941823297 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562df327b3e0 0x562df3284e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:32.605 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.602+0000 7f919379cb80 1 -- 172.21.15.76:0/1941823297 >> 172.21.15.76:0/1941823297 conn(0x562df31d91b0 msgr2=0x562df3275860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:57:32.605 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.602+0000 7f9168ff9700 0 client.16263 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:57:32.605 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.602+0000 7f919379cb80 1 -- 172.21.15.76:0/1941823297 shutdown_connections 2024-06-02T04:57:32.605 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.602+0000 7f919379cb80 1 -- 172.21.15.76:0/1941823297 wait complete. 2024-06-02T04:57:32.605 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.603+0000 7f919379cb80 20 client.16263 trim_cache size 0 max 16384 2024-06-02T04:57:32.626 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.626+0000 7f919379cb80 1 Processor -- start 2024-06-02T04:57:32.627 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.626+0000 7f919379cb80 1 -- start start 2024-06-02T04:57:32.627 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.626+0000 7f919379cb80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562df327aa80 0x562df327ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:57:32.627 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.626+0000 7f919379cb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562df327b3e0 0x562df3283e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:57:32.627 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.626+0000 7f919379cb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562df327c2d0 0x562df327c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:57:32.627 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.626+0000 7f919379cb80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x562df32707c0 con 0x562df327aa80 2024-06-02T04:57:32.627 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.626+0000 7f919379cb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x562df327c140 con 0x562df327c2d0 2024-06-02T04:57:32.627 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.626+0000 7f919379cb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x562df32844a0 con 0x562df327b3e0 2024-06-02T04:57:32.631 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.627+0000 7f9185b7e700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562df327c2d0 0x562df327c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:57:32.631 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.627+0000 7f918537d700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562df327aa80 0x562df327ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:57:32.631 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.627+0000 7f9185b7e700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562df327c2d0 0x562df327c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:36058/0 (socket says 172.21.15.76:36058) 2024-06-02T04:57:32.631 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.627+0000 7f9185b7e700 1 -- 172.21.15.76:0/3621236057 learned_addr learned my addr 172.21.15.76:0/3621236057 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:57:32.631 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.627+0000 7f918537d700 1 -- 172.21.15.76:0/3621236057 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562df327b3e0 msgr2=0x562df3283e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:57:32.631 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.627+0000 7f918537d700 1 --2- 172.21.15.76:0/3621236057 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562df327b3e0 0x562df3283e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:32.631 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.627+0000 7f918537d700 1 -- 172.21.15.76:0/3621236057 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562df327c2d0 msgr2=0x562df327c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:57:32.631 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.627+0000 7f918537d700 1 --2- 172.21.15.76:0/3621236057 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562df327c2d0 0x562df327c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:32.631 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.627+0000 7f918537d700 1 -- 172.21.15.76:0/3621236057 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562df3191500 con 0x562df327aa80 2024-06-02T04:57:32.631 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.627+0000 7f9185b7e700 1 --2- 172.21.15.76:0/3621236057 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562df327c2d0 0x562df327c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T04:57:32.631 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.627+0000 7f918537d700 1 --2- 172.21.15.76:0/3621236057 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562df327aa80 0x562df327ae60 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f917c00b500 tx=0x7f917c011f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=732d0c2a5841022c server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:57:32.632 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.627+0000 7f916bfff700 1 -- 172.21.15.76:0/3621236057 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f917c011cc0 con 0x562df327aa80 2024-06-02T04:57:32.632 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.628+0000 7f916bfff700 1 -- 172.21.15.76:0/3621236057 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f917c099ee0 con 0x562df327aa80 2024-06-02T04:57:32.632 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.628+0000 7f916bfff700 1 -- 172.21.15.76:0/3621236057 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f917c0b90b0 con 0x562df327aa80 2024-06-02T04:57:32.632 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.629+0000 7f919379cb80 1 -- 172.21.15.76:0/3621236057 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562df327aa80 msgr2=0x562df327ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:57:32.632 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.629+0000 7f919379cb80 1 --2- 172.21.15.76:0/3621236057 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562df327aa80 0x562df327ae60 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f917c00b500 tx=0x7f917c011f90 comp rx=0 tx=0).stop 2024-06-02T04:57:32.632 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.630+0000 7f919379cb80 1 -- 172.21.15.76:0/3621236057 shutdown_connections 2024-06-02T04:57:32.632 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.630+0000 7f919379cb80 1 --2- 172.21.15.76:0/3621236057 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562df327c2d0 0x562df327c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:32.632 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.630+0000 7f919379cb80 1 --2- 172.21.15.76:0/3621236057 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562df327aa80 0x562df327ae60 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:32.632 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.630+0000 7f919379cb80 1 --2- 172.21.15.76:0/3621236057 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562df327b3e0 0x562df3283e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:32.632 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.630+0000 7f919379cb80 1 -- 172.21.15.76:0/3621236057 >> 172.21.15.76:0/3621236057 conn(0x562df31d91b0 msgr2=0x562df3282930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:57:32.634 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.631+0000 7f919379cb80 1 -- 172.21.15.76:0/3621236057 shutdown_connections 2024-06-02T04:57:32.634 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.631+0000 7f919379cb80 1 -- 172.21.15.76:0/3621236057 wait complete. 2024-06-02T04:57:32.634 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.631+0000 7f919379cb80 1 -- start start 2024-06-02T04:57:32.634 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.631+0000 7f919379cb80 1 Processor -- start 2024-06-02T04:57:32.634 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.632+0000 7f919379cb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562df327aa80 0x562df3289050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:57:32.634 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.632+0000 7f919379cb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562df327b3e0 0x562df3289590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:57:32.635 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.632+0000 7f919379cb80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562df327c2d0 0x562df32e4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:57:32.635 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.632+0000 7f919379cb80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x562df328c170 con 0x562df327c2d0 2024-06-02T04:57:32.635 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.632+0000 7f919379cb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x562df328c2e0 con 0x562df327b3e0 2024-06-02T04:57:32.635 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.632+0000 7f919379cb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x562df32e51e0 con 0x562df327aa80 2024-06-02T04:57:32.635 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.632+0000 7f919379cb80 10 client.0 _ll_register_callbacks cb 0x562df3170ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:57:32.635 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.632+0000 7f9184b7c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562df327b3e0 0x562df3289590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:57:32.635 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.632+0000 7f9184b7c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562df327b3e0 0x562df3289590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:36064/0 (socket says 172.21.15.76:36064) 2024-06-02T04:57:32.635 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.632+0000 7f9184b7c700 1 -- 172.21.15.76:0/3374417124 learned_addr learned my addr 172.21.15.76:0/3374417124 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:57:32.635 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.632+0000 7f918537d700 1 --2- 172.21.15.76:0/3374417124 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562df327aa80 0x562df3289050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:57:32.635 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.633+0000 7f9184b7c700 1 -- 172.21.15.76:0/3374417124 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562df327aa80 msgr2=0x562df3289050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:57:32.635 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.633+0000 7f9184b7c700 1 --2- 172.21.15.76:0/3374417124 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562df327aa80 0x562df3289050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:32.635 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.633+0000 7f9184b7c700 1 -- 172.21.15.76:0/3374417124 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562df327c2d0 msgr2=0x562df32e4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:57:32.635 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.633+0000 7f9184b7c700 1 --2- 172.21.15.76:0/3374417124 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562df327c2d0 0x562df32e4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:32.636 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.633+0000 7f9184b7c700 1 -- 172.21.15.76:0/3374417124 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562df2ff8b00 con 0x562df327b3e0 2024-06-02T04:57:32.636 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.633+0000 7f9184b7c700 1 --2- 172.21.15.76:0/3374417124 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562df327b3e0 0x562df3289590 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f91700098e0 tx=0x7f9170005c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=60c006dabb057625 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:57:32.636 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.633+0000 7f9168ff9700 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-06-02T04:57:32.636 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.633+0000 7f9168ff9700 1 -- 172.21.15.76:0/3374417124 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f917000bd90 con 0x562df327b3e0 2024-06-02T04:57:32.636 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.633+0000 7f9168ff9700 1 -- 172.21.15.76:0/3374417124 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f9170003850 con 0x562df327b3e0 2024-06-02T04:57:32.636 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.636+0000 7f919379cb80 1 -- 172.21.15.76:0/3374417124 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f917c010510 con 0x562df327b3e0 2024-06-02T04:57:32.638 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.637+0000 7f9168ff9700 1 -- 172.21.15.76:0/3374417124 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9170003a10 con 0x562df327b3e0 2024-06-02T04:57:32.638 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.637+0000 7f919379cb80 10 client.25859 fetch_fsmap learned FSMap version 35 2024-06-02T04:57:32.638 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.637+0000 7f919379cb80 1 -- 172.21.15.76:0/3374417124 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x562df304c350 con 0x562df327b3e0 2024-06-02T04:57:32.638 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.638+0000 7f9168ff9700 1 -- 172.21.15.76:0/3374417124 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f917c010510 con 0x562df327b3e0 2024-06-02T04:57:32.638 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.638+0000 7f9168ff9700 1 -- 172.21.15.76:0/3374417124 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 35) v1 ==== 7474+0+0 (secure 0 0 0) 0x7f91700294f0 con 0x562df327b3e0 2024-06-02T04:57:32.639 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.638+0000 7f919379cb80 10 client.25859 fetch_fsmap finished waiting for FSMap version 35 2024-06-02T04:57:32.639 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.638+0000 7f919379cb80 10 client.25859 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T04:57:32.639 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.638+0000 7f919379cb80 20 client.25859 populate_metadata read hostname 'smithi076' 2024-06-02T04:57:32.639 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.638+0000 7f919379cb80 1 --2- 172.21.15.76:0/3374417124 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x562df32e6c30 0x562df32e9050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:57:32.640 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.638+0000 7f919379cb80 4 client.25859 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T04:57:32.640 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.638+0000 7f919379cb80 1 -- 172.21.15.76:0/3374417124 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x562df31c3e60 con 0x562df32e6c30 2024-06-02T04:57:32.640 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.639+0000 7f918537d700 1 --2- 172.21.15.76:0/3374417124 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x562df32e6c30 0x562df32e9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:57:32.640 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.639+0000 7f9168ff9700 10 client.25859 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:57:32.640 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.639+0000 7f918537d700 1 --2- 172.21.15.76:0/3374417124 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x562df32e6c30 0x562df32e9050 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc38d46c7d23bb1f server_cookie=5b64671acbca0326 in_seq=0 out_seq=0 2024-06-02T04:57:32.719 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.718+0000 7f9168ff9700 1 -- 172.21.15.76:0/3374417124 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x562df31c3e60 con 0x562df32e6c30 2024-06-02T04:57:32.719 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.718+0000 7f9168ff9700 10 client.25859 handle_command_reply: tid=0 2024-06-02T04:57:32.719 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.718+0000 7f919379cb80 1 client.25859 shutdown 2024-06-02T04:57:32.720 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.719+0000 7f919379cb80 1 -- 172.21.15.76:0/3374417124 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562df327b3e0 msgr2=0x562df3289590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:57:32.720 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.719+0000 7f919379cb80 1 --2- 172.21.15.76:0/3374417124 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562df327b3e0 0x562df3289590 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f91700098e0 tx=0x7f9170005c20 comp rx=0 tx=0).stop 2024-06-02T04:57:32.724 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.724+0000 7f919379cb80 1 -- 172.21.15.76:0/3374417124 shutdown_connections 2024-06-02T04:57:32.724 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.724+0000 7f919379cb80 1 --2- 172.21.15.76:0/3374417124 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x562df32e6c30 0x562df32e9050 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:32.724 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.724+0000 7f919379cb80 1 --2- 172.21.15.76:0/3374417124 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562df327c2d0 0x562df32e4ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:32.724 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.724+0000 7f919379cb80 1 --2- 172.21.15.76:0/3374417124 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562df327aa80 0x562df3289050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:32.724 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.724+0000 7f919379cb80 1 --2- 172.21.15.76:0/3374417124 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562df327b3e0 0x562df3289590 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:32.724 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.724+0000 7f919379cb80 1 -- 172.21.15.76:0/3374417124 >> 172.21.15.76:0/3374417124 conn(0x562df31d91b0 msgr2=0x562df3297540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:57:32.729 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.729+0000 7f9168ff9700 0 client.25859 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:57:32.729 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.729+0000 7f919379cb80 1 -- 172.21.15.76:0/3374417124 shutdown_connections 2024-06-02T04:57:32.731 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.731+0000 7f919379cb80 1 -- 172.21.15.76:0/3374417124 wait complete. 2024-06-02T04:57:32.731 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.731+0000 7f919379cb80 20 client.25859 trim_cache size 0 max 16384 2024-06-02T04:57:32.732 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:{ 2024-06-02T04:57:32.732 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "message": "", 2024-06-02T04:57:32.732 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "return_code": 0 2024-06-02T04:57:32.732 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:} 2024-06-02T04:57:32.732 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.732+0000 7f91875e1700 1 -- 172.21.15.76:0/701986236 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f916c0a1120 msgr2=0x7f916c0a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:57:32.733 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.732+0000 7f91875e1700 1 --2- 172.21.15.76:0/701986236 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f916c0a1120 0x7f916c0a35e0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f917000b5c0 tx=0x7f9170003750 comp rx=0 tx=0).stop 2024-06-02T04:57:32.733 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.732+0000 7f91875e1700 1 -- 172.21.15.76:0/701986236 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f91800ff770 msgr2=0x7f918010acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:57:32.733 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.732+0000 7f91875e1700 1 --2- 172.21.15.76:0/701986236 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f91800ff770 0x7f918010acf0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f917c00b530 tx=0x7f917c00b840 comp rx=0 tx=0).stop 2024-06-02T04:57:32.733 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.732+0000 7f91875e1700 1 -- 172.21.15.76:0/701986236 shutdown_connections 2024-06-02T04:57:32.733 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.732+0000 7f91875e1700 1 --2- 172.21.15.76:0/701986236 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9180104ab0 0x7f91801ad590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:32.733 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.732+0000 7f91875e1700 1 --2- 172.21.15.76:0/701986236 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f91800ff770 0x7f918010acf0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:32.733 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.732+0000 7f91875e1700 1 --2- 172.21.15.76:0/701986236 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f916c0a1120 0x7f916c0a35e0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:32.733 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.732+0000 7f91875e1700 1 --2- 172.21.15.76:0/701986236 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f91801020e0 0x7f918010b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:32.733 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.732+0000 7f91875e1700 1 -- 172.21.15.76:0/701986236 >> 172.21.15.76:0/701986236 conn(0x7f91800fb390 msgr2=0x7f9180100290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:57:32.734 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.733+0000 7f91875e1700 1 -- 172.21.15.76:0/701986236 shutdown_connections 2024-06-02T04:57:32.734 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:32.733+0000 7f91875e1700 1 -- 172.21.15.76:0/701986236 wait complete. 2024-06-02T04:57:33.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:57:33 smithi119 ceph-mon[46633]: pgmap v507: 129 pgs: 129 active+clean; 1.5 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 16 MiB/s wr, 919 op/s 2024-06-02T04:57:33.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:57:33 smithi192 ceph-mon[47933]: pgmap v507: 129 pgs: 129 active+clean; 1.5 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 16 MiB/s wr, 919 op/s 2024-06-02T04:57:33.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:57:33 smithi076 ceph-mon[42935]: pgmap v507: 129 pgs: 129 active+clean; 1.5 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 16 MiB/s wr, 919 op/s 2024-06-02T04:57:35.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:57:35 smithi119 ceph-mon[46633]: pgmap v508: 129 pgs: 129 active+clean; 1.5 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 14 MiB/s wr, 843 op/s 2024-06-02T04:57:35.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:57:35 smithi192 ceph-mon[47933]: pgmap v508: 129 pgs: 129 active+clean; 1.5 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 14 MiB/s wr, 843 op/s 2024-06-02T04:57:35.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:57:35 smithi076 ceph-mon[42935]: pgmap v508: 129 pgs: 129 active+clean; 1.5 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 14 MiB/s wr, 843 op/s 2024-06-02T04:57:36.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 405.0 s, 961.6 tps, lat 104.110 ms stddev 67.338 2024-06-02T04:57:37.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:57:37 smithi119 ceph-mon[46633]: pgmap v509: 129 pgs: 129 active+clean; 1.5 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 15 MiB/s wr, 903 op/s 2024-06-02T04:57:37.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:57:37 smithi192 ceph-mon[47933]: pgmap v509: 129 pgs: 129 active+clean; 1.5 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 15 MiB/s wr, 903 op/s 2024-06-02T04:57:37.986 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:57:37 smithi076 ceph-mon[42935]: pgmap v509: 129 pgs: 129 active+clean; 1.5 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 15 MiB/s wr, 903 op/s 2024-06-02T04:57:39.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:57:39 smithi119 ceph-mon[46633]: pgmap v510: 129 pgs: 129 active+clean; 1.5 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 15 MiB/s wr, 869 op/s 2024-06-02T04:57:39.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:57:39 smithi192 ceph-mon[47933]: pgmap v510: 129 pgs: 129 active+clean; 1.5 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 15 MiB/s wr, 869 op/s 2024-06-02T04:57:39.985 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:57:39 smithi076 ceph-mon[42935]: pgmap v510: 129 pgs: 129 active+clean; 1.5 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 15 MiB/s wr, 869 op/s 2024-06-02T04:57:41.316 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 410.0 s, 899.4 tps, lat 111.163 ms stddev 52.703 2024-06-02T04:57:41.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:57:41 smithi119 ceph-mon[46633]: pgmap v511: 129 pgs: 129 active+clean; 1.5 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 15 MiB/s wr, 897 op/s 2024-06-02T04:57:41.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:57:41 smithi192 ceph-mon[47933]: pgmap v511: 129 pgs: 129 active+clean; 1.5 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 15 MiB/s wr, 897 op/s 2024-06-02T04:57:41.987 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:57:41 smithi076 ceph-mon[42935]: pgmap v511: 129 pgs: 129 active+clean; 1.5 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 15 MiB/s wr, 897 op/s 2024-06-02T04:57:43.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:57:43 smithi119 ceph-mon[46633]: pgmap v512: 129 pgs: 129 active+clean; 1.5 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 14 MiB/s wr, 835 op/s 2024-06-02T04:57:43.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:57:43 smithi119 ceph-mon[46633]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-06-02T04:57:43.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:57:43 smithi192 ceph-mon[47933]: pgmap v512: 129 pgs: 129 active+clean; 1.5 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 14 MiB/s wr, 835 op/s 2024-06-02T04:57:43.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:57:43 smithi192 ceph-mon[47933]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-06-02T04:57:43.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:57:43 smithi076 ceph-mon[42935]: pgmap v512: 129 pgs: 129 active+clean; 1.5 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 14 MiB/s wr, 835 op/s 2024-06-02T04:57:43.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:57:43 smithi076 ceph-mon[42935]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-06-02T04:57:44.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:57:44 smithi192 ceph-mon[47933]: pgmap v513: 129 pgs: 129 active+clean; 1.5 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 13 MiB/s wr, 788 op/s 2024-06-02T04:57:44.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:57:44 smithi076 ceph-mon[42935]: pgmap v513: 129 pgs: 129 active+clean; 1.5 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 13 MiB/s wr, 788 op/s 2024-06-02T04:57:45.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:57:44 smithi119 ceph-mon[46633]: pgmap v513: 129 pgs: 129 active+clean; 1.5 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 13 MiB/s wr, 788 op/s 2024-06-02T04:57:45.946 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.945+0000 7fba79c25700 1 -- 172.21.15.76:0/2692780618 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba74100770 msgr2=0x7fba74100bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:57:45.946 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.945+0000 7fba79c25700 1 --2- 172.21.15.76:0/2692780618 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba74100770 0x7fba74100bd0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fba6400bab0 tx=0x7fba6400bdc0 comp rx=0 tx=0).stop 2024-06-02T04:57:45.946 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.945+0000 7fba79c25700 1 -- 172.21.15.76:0/2692780618 shutdown_connections 2024-06-02T04:57:45.946 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.945+0000 7fba79c25700 1 --2- 172.21.15.76:0/2692780618 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fba74101110 0x7fba741079c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:45.946 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.945+0000 7fba79c25700 1 --2- 172.21.15.76:0/2692780618 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba740ff580 0x7fba740ff9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:45.946 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.945+0000 7fba79c25700 1 --2- 172.21.15.76:0/2692780618 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba74100770 0x7fba74100bd0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:45.946 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.945+0000 7fba79c25700 1 -- 172.21.15.76:0/2692780618 >> 172.21.15.76:0/2692780618 conn(0x7fba740faaf0 msgr2=0x7fba740fcf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:57:45.946 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.945+0000 7fba79c25700 1 -- 172.21.15.76:0/2692780618 shutdown_connections 2024-06-02T04:57:45.946 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.945+0000 7fba79c25700 1 -- 172.21.15.76:0/2692780618 wait complete. 2024-06-02T04:57:45.948 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.946+0000 7fba79c25700 1 Processor -- start 2024-06-02T04:57:45.948 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.946+0000 7fba79c25700 1 -- start start 2024-06-02T04:57:45.948 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.946+0000 7fba79c25700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fba740ff580 0x7fba74194c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:57:45.948 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.946+0000 7fba79c25700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba74100770 0x7fba74195180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:57:45.948 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.946+0000 7fba79c25700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba74101110 0x7fba7419c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:57:45.948 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.946+0000 7fba79c25700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba7419c770 con 0x7fba740ff580 2024-06-02T04:57:45.949 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.946+0000 7fba79c25700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba7419c8b0 con 0x7fba74101110 2024-06-02T04:57:45.949 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.946+0000 7fba79c25700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba7419ca40 con 0x7fba74100770 2024-06-02T04:57:45.949 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.947+0000 7fba72ffd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba74100770 0x7fba74195180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:57:45.949 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.947+0000 7fba72ffd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba74100770 0x7fba74195180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:47884/0 (socket says 172.21.15.76:47884) 2024-06-02T04:57:45.949 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.947+0000 7fba72ffd700 1 -- 172.21.15.76:0/376225038 learned_addr learned my addr 172.21.15.76:0/376225038 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:57:45.949 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.947+0000 7fba737fe700 1 --2- 172.21.15.76:0/376225038 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fba740ff580 0x7fba74194c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:57:45.949 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.947+0000 7fba73fff700 1 --2- 172.21.15.76:0/376225038 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba74101110 0x7fba7419c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:57:45.949 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.947+0000 7fba72ffd700 1 -- 172.21.15.76:0/376225038 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba74101110 msgr2=0x7fba7419c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:57:45.949 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.947+0000 7fba72ffd700 1 --2- 172.21.15.76:0/376225038 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba74101110 0x7fba7419c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:45.949 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.947+0000 7fba72ffd700 1 -- 172.21.15.76:0/376225038 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fba740ff580 msgr2=0x7fba74194c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:57:45.949 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.947+0000 7fba72ffd700 1 --2- 172.21.15.76:0/376225038 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fba740ff580 0x7fba74194c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:45.949 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.947+0000 7fba72ffd700 1 -- 172.21.15.76:0/376225038 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba6400b730 con 0x7fba74100770 2024-06-02T04:57:45.949 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.947+0000 7fba72ffd700 1 --2- 172.21.15.76:0/376225038 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba74100770 0x7fba74195180 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fba640148d0 tx=0x7fba6400da40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:57:45.949 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.948+0000 7fba70ff9700 1 -- 172.21.15.76:0/376225038 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba64010050 con 0x7fba74100770 2024-06-02T04:57:45.950 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.948+0000 7fba79c25700 1 -- 172.21.15.76:0/376225038 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba7419ccc0 con 0x7fba74100770 2024-06-02T04:57:45.950 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.948+0000 7fba79c25700 1 -- 172.21.15.76:0/376225038 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba7419d190 con 0x7fba74100770 2024-06-02T04:57:45.950 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.948+0000 7fba70ff9700 1 -- 172.21.15.76:0/376225038 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fba64005450 con 0x7fba74100770 2024-06-02T04:57:45.950 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.948+0000 7fba70ff9700 1 -- 172.21.15.76:0/376225038 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba64027670 con 0x7fba74100770 2024-06-02T04:57:45.952 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.951+0000 7fba70ff9700 1 -- 172.21.15.76:0/376225038 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fba640277d0 con 0x7fba74100770 2024-06-02T04:57:45.952 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.951+0000 7fba70ff9700 1 --2- 172.21.15.76:0/376225038 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fba600a11a0 0x7fba600a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:57:45.952 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.952+0000 7fba70ff9700 1 -- 172.21.15.76:0/376225038 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7fba640d1610 con 0x7fba74100770 2024-06-02T04:57:45.952 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.952+0000 7fba85de0b80 1 Processor -- start 2024-06-02T04:57:45.953 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.952+0000 7fba85de0b80 1 -- start start 2024-06-02T04:57:45.953 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.952+0000 7fba737fe700 1 --2- 172.21.15.76:0/376225038 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fba600a11a0 0x7fba600a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:57:45.953 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.952+0000 7fba85de0b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557f31893a80 0x557f31893ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:57:45.953 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.952+0000 7fba85de0b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557f318943e0 0x557f31894cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:57:45.953 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.952+0000 7fba85de0b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557f318952d0 0x557f31895750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:57:45.953 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.952+0000 7fba85de0b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f317eb0f0 con 0x557f318952d0 2024-06-02T04:57:45.953 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.952+0000 7fba85de0b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f317e8ab0 con 0x557f318943e0 2024-06-02T04:57:45.953 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.952+0000 7fba85de0b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f317e43a0 con 0x557f31893a80 2024-06-02T04:57:45.954 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.953+0000 7fba73fff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557f318952d0 0x557f31895750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:57:45.954 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.953+0000 7fba73fff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557f318952d0 0x557f31895750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:52378/0 (socket says 172.21.15.76:52378) 2024-06-02T04:57:45.954 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.953+0000 7fba73fff700 1 -- 172.21.15.76:0/2724227289 learned_addr learned my addr 172.21.15.76:0/2724227289 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:57:45.954 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.953+0000 7fba737fe700 1 --2- 172.21.15.76:0/2724227289 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557f31893a80 0x557f31893ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:57:45.954 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.953+0000 7fba737fe700 1 --2- 172.21.15.76:0/376225038 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fba600a11a0 0x7fba600a3660 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fba741005d0 tx=0x7fba5c01daa0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:57:45.955 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.953+0000 7fba73fff700 1 -- 172.21.15.76:0/2724227289 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557f31893a80 msgr2=0x557f31893ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:57:45.955 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.953+0000 7fba73fff700 1 --2- 172.21.15.76:0/2724227289 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557f31893a80 0x557f31893ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:45.955 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.953+0000 7fba73fff700 1 -- 172.21.15.76:0/2724227289 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557f318943e0 msgr2=0x557f31894cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:57:45.955 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.953+0000 7fba73fff700 1 --2- 172.21.15.76:0/2724227289 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557f318943e0 0x557f31894cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:45.955 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.953+0000 7fba73fff700 1 -- 172.21.15.76:0/2724227289 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557f31665350 con 0x557f318952d0 2024-06-02T04:57:45.955 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.953+0000 7fba73fff700 1 --2- 172.21.15.76:0/2724227289 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557f318952d0 0x557f31895750 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fba6c00a430 tx=0x7fba6c009650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c24c27d922827f3 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:57:45.955 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.954+0000 7fba69ffb700 1 -- 172.21.15.76:0/2724227289 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba6c010040 con 0x557f318952d0 2024-06-02T04:57:45.955 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.954+0000 7fba69ffb700 1 -- 172.21.15.76:0/2724227289 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fba6c014ab0 con 0x557f318952d0 2024-06-02T04:57:45.955 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.954+0000 7fba69ffb700 1 -- 172.21.15.76:0/2724227289 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba6c0138f0 con 0x557f318952d0 2024-06-02T04:57:45.956 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.955+0000 7fba85de0b80 1 -- 172.21.15.76:0/2724227289 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557f318952d0 msgr2=0x557f31895750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:57:45.956 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.955+0000 7fba85de0b80 1 --2- 172.21.15.76:0/2724227289 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557f318952d0 0x557f31895750 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fba6c00a430 tx=0x7fba6c009650 comp rx=0 tx=0).stop 2024-06-02T04:57:45.956 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.955+0000 7fba85de0b80 1 -- 172.21.15.76:0/2724227289 shutdown_connections 2024-06-02T04:57:45.956 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.955+0000 7fba85de0b80 1 --2- 172.21.15.76:0/2724227289 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557f318952d0 0x557f31895750 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:45.956 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.955+0000 7fba85de0b80 1 --2- 172.21.15.76:0/2724227289 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557f31893a80 0x557f31893ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:45.956 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.955+0000 7fba85de0b80 1 --2- 172.21.15.76:0/2724227289 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557f318943e0 0x557f31894cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:45.956 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.955+0000 7fba85de0b80 1 -- 172.21.15.76:0/2724227289 >> 172.21.15.76:0/2724227289 conn(0x557f317f21b0 msgr2=0x557f31890440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:57:45.956 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.955+0000 7fba85de0b80 1 -- 172.21.15.76:0/2724227289 shutdown_connections 2024-06-02T04:57:45.957 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.955+0000 7fba85de0b80 1 -- 172.21.15.76:0/2724227289 wait complete. 2024-06-02T04:57:45.957 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.956+0000 7fba85de0b80 1 -- start start 2024-06-02T04:57:45.957 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.956+0000 7fba85de0b80 1 Processor -- start 2024-06-02T04:57:45.958 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.957+0000 7fba85de0b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557f31893a80 0x557f318b71a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:57:45.958 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.957+0000 7fba85de0b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557f318943e0 0x557f318b76e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:57:45.958 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.957+0000 7fba85de0b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557f318952d0 0x557f318be720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:57:45.958 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.957+0000 7fba85de0b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f31780500 con 0x557f318943e0 2024-06-02T04:57:45.958 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.957+0000 7fba85de0b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f317801a0 con 0x557f31893a80 2024-06-02T04:57:45.958 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.957+0000 7fba85de0b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f31667640 con 0x557f318952d0 2024-06-02T04:57:45.958 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.957+0000 7fba85de0b80 10 client.0 _ll_register_callbacks cb 0x557f31789ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:57:45.958 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.957+0000 7fba72ffd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557f318943e0 0x557f318b76e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:57:45.958 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.957+0000 7fba72ffd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557f318943e0 0x557f318b76e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:52384/0 (socket says 172.21.15.76:52384) 2024-06-02T04:57:45.958 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.957+0000 7fba72ffd700 1 -- 172.21.15.76:0/318063046 learned_addr learned my addr 172.21.15.76:0/318063046 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:57:45.959 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.957+0000 7fba737fe700 1 --2- 172.21.15.76:0/318063046 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557f31893a80 0x557f318b71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:57:45.959 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.957+0000 7fba73fff700 1 --2- 172.21.15.76:0/318063046 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557f318952d0 0x557f318be720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:57:45.960 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.958+0000 7fba72ffd700 1 -- 172.21.15.76:0/318063046 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557f318952d0 msgr2=0x557f318be720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:57:45.960 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.958+0000 7fba72ffd700 1 --2- 172.21.15.76:0/318063046 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557f318952d0 0x557f318be720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:45.960 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.958+0000 7fba72ffd700 1 -- 172.21.15.76:0/318063046 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557f31893a80 msgr2=0x557f318b71a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:57:45.960 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.958+0000 7fba72ffd700 1 --2- 172.21.15.76:0/318063046 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557f31893a80 0x557f318b71a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:45.960 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.958+0000 7fba72ffd700 1 -- 172.21.15.76:0/318063046 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba6c009c60 con 0x557f318943e0 2024-06-02T04:57:45.960 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.958+0000 7fba72ffd700 1 --2- 172.21.15.76:0/318063046 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557f318943e0 0x557f318b76e0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fba6409acb0 tx=0x7fba640058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9292b9c173a3a36 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:57:45.960 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.958+0000 7fba52ffd700 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-06-02T04:57:45.960 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.959+0000 7fba52ffd700 1 -- 172.21.15.76:0/318063046 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba6409e7b0 con 0x557f318943e0 2024-06-02T04:57:45.960 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.959+0000 7fba52ffd700 1 -- 172.21.15.76:0/318063046 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7fba640a25e0 con 0x557f318943e0 2024-06-02T04:57:45.960 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.959+0000 7fba85de0b80 1 -- 172.21.15.76:0/318063046 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557f3173d210 con 0x557f318943e0 2024-06-02T04:57:45.960 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.959+0000 7fba52ffd700 1 -- 172.21.15.76:0/318063046 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fba640a6ba0 con 0x557f318943e0 2024-06-02T04:57:45.960 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.959+0000 7fba85de0b80 10 client.16275 fetch_fsmap learned FSMap version 36 2024-06-02T04:57:45.961 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.959+0000 7fba85de0b80 1 -- 172.21.15.76:0/318063046 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x557f31611b00 con 0x557f318943e0 2024-06-02T04:57:45.961 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.960+0000 7fba52ffd700 1 -- 172.21.15.76:0/318063046 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x557f3173d210 con 0x557f318943e0 2024-06-02T04:57:45.961 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.960+0000 7fba52ffd700 1 -- 172.21.15.76:0/318063046 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fba640a6710 con 0x557f318943e0 2024-06-02T04:57:45.961 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.961+0000 7fba85de0b80 10 client.16275 fetch_fsmap finished waiting for FSMap version 36 2024-06-02T04:57:45.962 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.961+0000 7fba85de0b80 10 client.16275 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T04:57:45.962 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.961+0000 7fba85de0b80 20 client.16275 populate_metadata read hostname 'smithi076' 2024-06-02T04:57:45.962 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.961+0000 7fba85de0b80 1 --2- 172.21.15.76:0/318063046 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x557f318c2e00 0x557f318c5220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:57:45.962 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.961+0000 7fba85de0b80 4 client.16275 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T04:57:45.962 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.961+0000 7fba85de0b80 1 -- 172.21.15.76:0/318063046 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557f318637b0 con 0x557f318c2e00 2024-06-02T04:57:45.962 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.961+0000 7fba737fe700 1 --2- 172.21.15.76:0/318063046 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x557f318c2e00 0x557f318c5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:57:45.962 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.962+0000 7fba737fe700 1 --2- 172.21.15.76:0/318063046 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x557f318c2e00 0x557f318c5220 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3a23bcf11807c37 server_cookie=482c55de0cc2bccd in_seq=0 out_seq=0 2024-06-02T04:57:45.963 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.962+0000 7fba52ffd700 10 client.16275 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:57:45.963 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.962+0000 7fba52ffd700 1 -- 172.21.15.76:0/318063046 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x557f318637b0 con 0x557f318c2e00 2024-06-02T04:57:45.963 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.962+0000 7fba52ffd700 10 client.16275 handle_command_reply: tid=0 2024-06-02T04:57:45.963 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.962+0000 7fba85de0b80 1 client.16275 shutdown 2024-06-02T04:57:45.963 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.963+0000 7fba85de0b80 1 -- 172.21.15.76:0/318063046 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557f318943e0 msgr2=0x557f318b76e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:57:45.963 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.963+0000 7fba85de0b80 1 --2- 172.21.15.76:0/318063046 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557f318943e0 0x557f318b76e0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fba6409acb0 tx=0x7fba640058a0 comp rx=0 tx=0).stop 2024-06-02T04:57:45.964 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.963+0000 7fba85de0b80 1 -- 172.21.15.76:0/318063046 shutdown_connections 2024-06-02T04:57:45.964 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.963+0000 7fba85de0b80 1 --2- 172.21.15.76:0/318063046 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x557f318c2e00 0x557f318c5220 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:45.964 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.963+0000 7fba85de0b80 1 --2- 172.21.15.76:0/318063046 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557f318952d0 0x557f318be720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:45.964 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.963+0000 7fba52ffd700 0 client.16275 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:57:45.964 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.963+0000 7fba85de0b80 1 --2- 172.21.15.76:0/318063046 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557f31893a80 0x557f318b71a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:45.964 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.963+0000 7fba85de0b80 1 --2- 172.21.15.76:0/318063046 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557f318943e0 0x557f318b76e0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:45.964 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.963+0000 7fba85de0b80 1 -- 172.21.15.76:0/318063046 >> 172.21.15.76:0/318063046 conn(0x557f317f21b0 msgr2=0x557f3188e860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:57:45.965 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.963+0000 7fba85de0b80 1 -- 172.21.15.76:0/318063046 shutdown_connections 2024-06-02T04:57:45.965 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.963+0000 7fba85de0b80 1 -- 172.21.15.76:0/318063046 wait complete. 2024-06-02T04:57:45.965 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.963+0000 7fba85de0b80 20 client.16275 trim_cache size 0 max 16384 2024-06-02T04:57:45.990 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.985+0000 7fba85de0b80 1 Processor -- start 2024-06-02T04:57:45.990 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.985+0000 7fba85de0b80 1 -- start start 2024-06-02T04:57:45.990 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.985+0000 7fba85de0b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557f31893a80 0x557f318bedd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:57:45.990 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.985+0000 7fba85de0b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557f318943e0 0x557f318956b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:57:45.990 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.985+0000 7fba85de0b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557f318952d0 0x557f318be640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:57:45.991 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.985+0000 7fba85de0b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f318b80e0 con 0x557f31893a80 2024-06-02T04:57:45.991 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.985+0000 7fba85de0b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f318b6d10 con 0x557f318943e0 2024-06-02T04:57:45.991 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.985+0000 7fba85de0b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f318ad3a0 con 0x557f318952d0 2024-06-02T04:57:45.991 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.986+0000 7fba73fff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557f318952d0 0x557f318be640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:57:45.991 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.986+0000 7fba72ffd700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557f318943e0 0x557f318956b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:57:45.991 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.986+0000 7fba73fff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557f318952d0 0x557f318be640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:47910/0 (socket says 172.21.15.76:47910) 2024-06-02T04:57:45.991 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.986+0000 7fba73fff700 1 -- 172.21.15.76:0/2232320278 learned_addr learned my addr 172.21.15.76:0/2232320278 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:57:45.991 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.986+0000 7fba72ffd700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557f318943e0 0x557f318956b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:56548/0 (socket says 172.21.15.76:56548) 2024-06-02T04:57:45.991 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.986+0000 7fba72ffd700 1 -- 172.21.15.76:0/2232320278 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557f318952d0 msgr2=0x557f318be640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:57:45.991 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.986+0000 7fba72ffd700 1 --2- 172.21.15.76:0/2232320278 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557f318952d0 0x557f318be640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:45.991 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.986+0000 7fba72ffd700 1 -- 172.21.15.76:0/2232320278 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557f31893a80 msgr2=0x557f318bedd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-02T04:57:45.991 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.986+0000 7fba72ffd700 1 --2- 172.21.15.76:0/2232320278 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557f31893a80 0x557f318bedd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:45.992 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.986+0000 7fba72ffd700 1 -- 172.21.15.76:0/2232320278 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557f317aa500 con 0x557f318943e0 2024-06-02T04:57:45.992 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.986+0000 7fba73fff700 1 --2- 172.21.15.76:0/2232320278 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557f318952d0 0x557f318be640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T04:57:45.992 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.986+0000 7fba72ffd700 1 --2- 172.21.15.76:0/2232320278 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557f318943e0 0x557f318956b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fba64004cb0 tx=0x7fba6409a4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d5a228a1bbae1074 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:57:45.992 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.986+0000 7fba6a7fc700 1 -- 172.21.15.76:0/2232320278 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba640a25e0 con 0x557f318943e0 2024-06-02T04:57:45.992 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.986+0000 7fba6a7fc700 1 -- 172.21.15.76:0/2232320278 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fba6409e7b0 con 0x557f318943e0 2024-06-02T04:57:45.992 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.986+0000 7fba6a7fc700 1 -- 172.21.15.76:0/2232320278 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba640a22b0 con 0x557f318943e0 2024-06-02T04:57:45.992 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.987+0000 7fba85de0b80 1 -- 172.21.15.76:0/2232320278 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557f318943e0 msgr2=0x557f318956b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:57:45.992 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.987+0000 7fba85de0b80 1 --2- 172.21.15.76:0/2232320278 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557f318943e0 0x557f318956b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fba64004cb0 tx=0x7fba6409a4d0 comp rx=0 tx=0).stop 2024-06-02T04:57:45.992 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.987+0000 7fba85de0b80 1 -- 172.21.15.76:0/2232320278 shutdown_connections 2024-06-02T04:57:45.992 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.987+0000 7fba85de0b80 1 --2- 172.21.15.76:0/2232320278 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557f318952d0 0x557f318be640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:45.992 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.987+0000 7fba85de0b80 1 --2- 172.21.15.76:0/2232320278 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557f31893a80 0x557f318bedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:45.992 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.987+0000 7fba85de0b80 1 --2- 172.21.15.76:0/2232320278 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557f318943e0 0x557f318956b0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:45.992 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.987+0000 7fba85de0b80 1 -- 172.21.15.76:0/2232320278 >> 172.21.15.76:0/2232320278 conn(0x557f317f21b0 msgr2=0x557f3189b860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:57:45.994 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.990+0000 7fba85de0b80 1 -- 172.21.15.76:0/2232320278 shutdown_connections 2024-06-02T04:57:45.994 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.990+0000 7fba85de0b80 1 -- 172.21.15.76:0/2232320278 wait complete. 2024-06-02T04:57:45.994 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.990+0000 7fba85de0b80 1 -- start start 2024-06-02T04:57:45.994 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.991+0000 7fba85de0b80 1 Processor -- start 2024-06-02T04:57:45.994 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.991+0000 7fba85de0b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557f318943e0 0x557f318bbf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:57:45.994 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.991+0000 7fba85de0b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557f318952d0 0x557f318bc470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:57:45.994 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.991+0000 7fba85de0b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557f318bd480 0x557f318bd900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:57:45.995 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.991+0000 7fba85de0b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f318bde40 con 0x557f318bd480 2024-06-02T04:57:45.995 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.991+0000 7fba85de0b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f318bdfb0 con 0x557f318952d0 2024-06-02T04:57:45.995 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.991+0000 7fba85de0b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f318be170 con 0x557f318943e0 2024-06-02T04:57:45.995 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.991+0000 7fba85de0b80 10 client.0 _ll_register_callbacks cb 0x557f31789ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:57:45.995 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.991+0000 7fba72ffd700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557f318952d0 0x557f318bc470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:57:45.995 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.991+0000 7fba72ffd700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557f318952d0 0x557f318bc470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:56558/0 (socket says 172.21.15.76:56558) 2024-06-02T04:57:45.995 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.991+0000 7fba72ffd700 1 -- 172.21.15.76:0/740115054 learned_addr learned my addr 172.21.15.76:0/740115054 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:57:45.995 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.991+0000 7fba737fe700 1 --2- 172.21.15.76:0/740115054 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557f318943e0 0x557f318bbf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:57:45.995 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.991+0000 7fba73fff700 1 --2- 172.21.15.76:0/740115054 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557f318bd480 0x557f318bd900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:57:45.995 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.991+0000 7fba72ffd700 1 -- 172.21.15.76:0/740115054 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557f318943e0 msgr2=0x557f318bbf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:57:45.995 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.991+0000 7fba72ffd700 1 --2- 172.21.15.76:0/740115054 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557f318943e0 0x557f318bbf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:45.995 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.991+0000 7fba72ffd700 1 -- 172.21.15.76:0/740115054 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557f318bd480 msgr2=0x557f318bd900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:57:45.995 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.991+0000 7fba72ffd700 1 --2- 172.21.15.76:0/740115054 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557f318bd480 0x557f318bd900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:45.996 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.991+0000 7fba72ffd700 1 -- 172.21.15.76:0/740115054 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557f31665350 con 0x557f318952d0 2024-06-02T04:57:45.996 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.992+0000 7fba73fff700 1 --2- 172.21.15.76:0/740115054 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557f318bd480 0x557f318bd900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:57:45.996 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.992+0000 7fba72ffd700 1 --2- 172.21.15.76:0/740115054 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557f318952d0 0x557f318bc470 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fba6400bfd0 tx=0x7fba640a6c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f2bc6cc616248e5b server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:57:45.996 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.992+0000 7fba52ffd700 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-06-02T04:57:45.996 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.992+0000 7fba52ffd700 1 -- 172.21.15.76:0/740115054 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba640a25e0 con 0x557f318952d0 2024-06-02T04:57:45.996 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.992+0000 7fba52ffd700 1 -- 172.21.15.76:0/740115054 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7fba640a2290 con 0x557f318952d0 2024-06-02T04:57:45.996 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.992+0000 7fba85de0b80 1 -- 172.21.15.76:0/740115054 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fba6c014ab0 con 0x557f318952d0 2024-06-02T04:57:45.997 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.992+0000 7fba52ffd700 1 -- 172.21.15.76:0/740115054 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fba6406a070 con 0x557f318952d0 2024-06-02T04:57:45.997 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.992+0000 7fba85de0b80 10 client.25874 fetch_fsmap learned FSMap version 36 2024-06-02T04:57:45.997 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.992+0000 7fba85de0b80 1 -- 172.21.15.76:0/740115054 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x557f31611b00 con 0x557f318952d0 2024-06-02T04:57:45.997 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.993+0000 7fba52ffd700 1 -- 172.21.15.76:0/740115054 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fba64083020 con 0x557f318952d0 2024-06-02T04:57:45.997 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.993+0000 7fba52ffd700 1 -- 172.21.15.76:0/740115054 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fba64089110 con 0x557f318952d0 2024-06-02T04:57:45.997 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.993+0000 7fba85de0b80 10 client.25874 fetch_fsmap finished waiting for FSMap version 36 2024-06-02T04:57:45.997 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.993+0000 7fba85de0b80 10 client.25874 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T04:57:45.997 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.993+0000 7fba85de0b80 20 client.25874 populate_metadata read hostname 'smithi076' 2024-06-02T04:57:45.997 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.993+0000 7fba85de0b80 1 --2- 172.21.15.76:0/740115054 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x557f318b3ce0 0x557f318b40c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:57:45.997 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.993+0000 7fba85de0b80 4 client.25874 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T04:57:45.997 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.993+0000 7fba85de0b80 1 -- 172.21.15.76:0/740115054 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x557f317dce60 con 0x557f318b3ce0 2024-06-02T04:57:45.997 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.995+0000 7fba737fe700 1 --2- 172.21.15.76:0/740115054 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x557f318b3ce0 0x557f318b40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:57:45.998 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.995+0000 7fba52ffd700 10 client.25874 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:57:45.998 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:45.995+0000 7fba737fe700 1 --2- 172.21.15.76:0/740115054 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x557f318b3ce0 0x557f318b40c0 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a8c7809360795f74 server_cookie=50f01c1e43cd15f0 in_seq=0 out_seq=0 2024-06-02T04:57:46.015 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:46.014+0000 7fba52ffd700 1 -- 172.21.15.76:0/740115054 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x557f317dce60 con 0x557f318b3ce0 2024-06-02T04:57:46.015 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:46.014+0000 7fba52ffd700 10 client.25874 handle_command_reply: tid=0 2024-06-02T04:57:46.015 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:46.014+0000 7fba85de0b80 1 client.25874 shutdown 2024-06-02T04:57:46.016 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:46.014+0000 7fba85de0b80 1 -- 172.21.15.76:0/740115054 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557f318952d0 msgr2=0x557f318bc470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:57:46.016 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:46.014+0000 7fba85de0b80 1 --2- 172.21.15.76:0/740115054 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557f318952d0 0x557f318bc470 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fba6400bfd0 tx=0x7fba640a6c10 comp rx=0 tx=0).stop 2024-06-02T04:57:46.016 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:46.014+0000 7fba85de0b80 1 -- 172.21.15.76:0/740115054 shutdown_connections 2024-06-02T04:57:46.016 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:46.014+0000 7fba85de0b80 1 --2- 172.21.15.76:0/740115054 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x557f318b3ce0 0x557f318b40c0 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:46.016 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:46.014+0000 7fba85de0b80 1 --2- 172.21.15.76:0/740115054 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557f318bd480 0x557f318bd900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:46.016 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:46.014+0000 7fba85de0b80 1 --2- 172.21.15.76:0/740115054 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557f318943e0 0x557f318bbf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:46.016 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:46.014+0000 7fba85de0b80 1 --2- 172.21.15.76:0/740115054 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557f318952d0 0x557f318bc470 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:46.016 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:46.015+0000 7fba85de0b80 1 -- 172.21.15.76:0/740115054 >> 172.21.15.76:0/740115054 conn(0x557f317f21b0 msgr2=0x557f3189b450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:57:46.016 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:46.015+0000 7fba52ffd700 0 client.25874 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:57:46.016 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:46.015+0000 7fba85de0b80 1 -- 172.21.15.76:0/740115054 shutdown_connections 2024-06-02T04:57:46.016 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:46.015+0000 7fba85de0b80 1 -- 172.21.15.76:0/740115054 wait complete. 2024-06-02T04:57:46.017 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:46.015+0000 7fba85de0b80 20 client.25874 trim_cache size 0 max 16384 2024-06-02T04:57:46.017 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:{ 2024-06-02T04:57:46.017 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "message": "", 2024-06-02T04:57:46.017 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "return_code": 0 2024-06-02T04:57:46.017 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:} 2024-06-02T04:57:46.018 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:46.016+0000 7fba79c25700 1 -- 172.21.15.76:0/376225038 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fba600a11a0 msgr2=0x7fba600a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:57:46.018 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:46.016+0000 7fba79c25700 1 --2- 172.21.15.76:0/376225038 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fba600a11a0 0x7fba600a3660 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fba741005d0 tx=0x7fba5c01daa0 comp rx=0 tx=0).stop 2024-06-02T04:57:46.018 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:46.016+0000 7fba79c25700 1 -- 172.21.15.76:0/376225038 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba74100770 msgr2=0x7fba74195180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:57:46.018 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:46.016+0000 7fba79c25700 1 --2- 172.21.15.76:0/376225038 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba74100770 0x7fba74195180 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fba640148d0 tx=0x7fba6400da40 comp rx=0 tx=0).stop 2024-06-02T04:57:46.018 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:46.016+0000 7fba79c25700 1 -- 172.21.15.76:0/376225038 shutdown_connections 2024-06-02T04:57:46.018 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:46.016+0000 7fba79c25700 1 --2- 172.21.15.76:0/376225038 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fba600a11a0 0x7fba600a3660 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:46.018 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:46.016+0000 7fba79c25700 1 --2- 172.21.15.76:0/376225038 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba74101110 0x7fba7419c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:46.019 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:46.016+0000 7fba79c25700 1 --2- 172.21.15.76:0/376225038 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fba740ff580 0x7fba74194c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:46.019 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:46.016+0000 7fba79c25700 1 --2- 172.21.15.76:0/376225038 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba74100770 0x7fba74195180 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:46.019 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:46.016+0000 7fba79c25700 1 -- 172.21.15.76:0/376225038 >> 172.21.15.76:0/376225038 conn(0x7fba740faaf0 msgr2=0x7fba74103b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:57:46.019 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:46.017+0000 7fba79c25700 1 -- 172.21.15.76:0/376225038 shutdown_connections 2024-06-02T04:57:46.019 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:46.017+0000 7fba79c25700 1 -- 172.21.15.76:0/376225038 wait complete. 2024-06-02T04:57:46.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 415.0 s, 774.4 tps, lat 129.612 ms stddev 73.188 2024-06-02T04:57:47.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:57:47 smithi119 ceph-mon[46633]: pgmap v514: 129 pgs: 129 active+clean; 1.5 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 13 MiB/s wr, 851 op/s 2024-06-02T04:57:47.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:57:47 smithi192 ceph-mon[47933]: pgmap v514: 129 pgs: 129 active+clean; 1.5 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 13 MiB/s wr, 851 op/s 2024-06-02T04:57:47.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:57:47 smithi076 ceph-mon[42935]: pgmap v514: 129 pgs: 129 active+clean; 1.5 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 13 MiB/s wr, 851 op/s 2024-06-02T04:57:49.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:57:49 smithi119 ceph-mon[46633]: pgmap v515: 129 pgs: 129 active+clean; 1.5 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 14 MiB/s wr, 857 op/s 2024-06-02T04:57:49.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:57:49 smithi192 ceph-mon[47933]: pgmap v515: 129 pgs: 129 active+clean; 1.5 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 14 MiB/s wr, 857 op/s 2024-06-02T04:57:49.985 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:57:49 smithi076 ceph-mon[42935]: pgmap v515: 129 pgs: 129 active+clean; 1.5 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 14 MiB/s wr, 857 op/s 2024-06-02T04:57:51.316 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 420.0 s, 692.6 tps, lat 89.359 ms stddev 55.765 2024-06-02T04:57:51.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:57:51 smithi119 ceph-mon[46633]: pgmap v516: 129 pgs: 129 active+clean; 1.5 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 14 MiB/s wr, 927 op/s 2024-06-02T04:57:51.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:57:51 smithi192 ceph-mon[47933]: pgmap v516: 129 pgs: 129 active+clean; 1.5 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 14 MiB/s wr, 927 op/s 2024-06-02T04:57:51.985 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:57:51 smithi076 ceph-mon[42935]: pgmap v516: 129 pgs: 129 active+clean; 1.5 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 14 MiB/s wr, 927 op/s 2024-06-02T04:57:53.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:57:53 smithi119 ceph-mon[46633]: pgmap v517: 129 pgs: 129 active+clean; 1.5 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 14 MiB/s wr, 935 op/s 2024-06-02T04:57:53.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:57:53 smithi192 ceph-mon[47933]: pgmap v517: 129 pgs: 129 active+clean; 1.5 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 14 MiB/s wr, 935 op/s 2024-06-02T04:57:53.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:57:53 smithi076 ceph-mon[42935]: pgmap v517: 129 pgs: 129 active+clean; 1.5 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 14 MiB/s wr, 935 op/s 2024-06-02T04:57:55.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:57:55 smithi119 ceph-mon[46633]: pgmap v518: 129 pgs: 129 active+clean; 1.5 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 12 MiB/s wr, 871 op/s 2024-06-02T04:57:55.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:57:55 smithi192 ceph-mon[47933]: pgmap v518: 129 pgs: 129 active+clean; 1.5 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 12 MiB/s wr, 871 op/s 2024-06-02T04:57:55.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:57:55 smithi076 ceph-mon[42935]: pgmap v518: 129 pgs: 129 active+clean; 1.5 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 12 MiB/s wr, 871 op/s 2024-06-02T04:57:56.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 425.0 s, 642.4 tps, lat 214.560 ms stddev 945.391 2024-06-02T04:57:57.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:57:57 smithi119 ceph-mon[46633]: pgmap v519: 129 pgs: 129 active+clean; 1.5 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 13 MiB/s wr, 922 op/s 2024-06-02T04:57:57.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:57:57 smithi192 ceph-mon[47933]: pgmap v519: 129 pgs: 129 active+clean; 1.5 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 13 MiB/s wr, 922 op/s 2024-06-02T04:57:57.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:57:57 smithi076 ceph-mon[42935]: pgmap v519: 129 pgs: 129 active+clean; 1.5 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 13 MiB/s wr, 922 op/s 2024-06-02T04:57:59.210 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.209+0000 7f86de4f3700 1 -- 172.21.15.76:0/3107668633 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86d80ffe40 msgr2=0x7f86d8100260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:57:59.210 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.209+0000 7f86de4f3700 1 --2- 172.21.15.76:0/3107668633 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86d80ffe40 0x7f86d8100260 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f86c80098f0 tx=0x7f86c8009c00 comp rx=0 tx=0).stop 2024-06-02T04:57:59.211 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.210+0000 7f86de4f3700 1 -- 172.21.15.76:0/3107668633 shutdown_connections 2024-06-02T04:57:59.211 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.210+0000 7f86de4f3700 1 --2- 172.21.15.76:0/3107668633 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f86d8101950 0x7f86d8108270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:59.211 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.210+0000 7f86de4f3700 1 --2- 172.21.15.76:0/3107668633 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86d80ffe40 0x7f86d8100260 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:59.211 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.210+0000 7f86de4f3700 1 --2- 172.21.15.76:0/3107668633 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f86d8100f90 0x7f86d8101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:59.211 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.210+0000 7f86de4f3700 1 -- 172.21.15.76:0/3107668633 >> 172.21.15.76:0/3107668633 conn(0x7f86d80fb3b0 msgr2=0x7f86d80fd7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:57:59.211 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.210+0000 7f86de4f3700 1 -- 172.21.15.76:0/3107668633 shutdown_connections 2024-06-02T04:57:59.211 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.210+0000 7f86de4f3700 1 -- 172.21.15.76:0/3107668633 wait complete. 2024-06-02T04:57:59.212 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.211+0000 7f86de4f3700 1 Processor -- start 2024-06-02T04:57:59.212 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.211+0000 7f86de4f3700 1 -- start start 2024-06-02T04:57:59.213 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.211+0000 7f86de4f3700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f86d80ffe40 0x7f86d8069c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:57:59.213 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.211+0000 7f86de4f3700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86d8100f90 0x7f86d819df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:57:59.213 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.211+0000 7f86de4f3700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f86d8101950 0x7f86d81a04c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:57:59.213 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.211+0000 7f86de4f3700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86d81a0b20 con 0x7f86d8101950 2024-06-02T04:57:59.213 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.211+0000 7f86de4f3700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86d81a0c90 con 0x7f86d8100f90 2024-06-02T04:57:59.213 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.211+0000 7f86de4f3700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86d81a0e50 con 0x7f86d80ffe40 2024-06-02T04:57:59.214 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.212+0000 7f86d7fff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f86d80ffe40 0x7f86d8069c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:57:59.214 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.212+0000 7f86d7fff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f86d80ffe40 0x7f86d8069c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:38872/0 (socket says 172.21.15.76:38872) 2024-06-02T04:57:59.214 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.212+0000 7f86d7fff700 1 -- 172.21.15.76:0/1435637683 learned_addr learned my addr 172.21.15.76:0/1435637683 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:57:59.214 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.212+0000 7f86d77fe700 1 --2- 172.21.15.76:0/1435637683 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86d8100f90 0x7f86d819df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:57:59.214 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.212+0000 7f86dca90700 1 --2- 172.21.15.76:0/1435637683 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f86d8101950 0x7f86d81a04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:57:59.215 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.212+0000 7f86dca90700 1 -- 172.21.15.76:0/1435637683 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f86d80ffe40 msgr2=0x7f86d8069c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:57:59.215 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.212+0000 7f86dca90700 1 --2- 172.21.15.76:0/1435637683 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f86d80ffe40 0x7f86d8069c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:59.215 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.212+0000 7f86dca90700 1 -- 172.21.15.76:0/1435637683 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86d8100f90 msgr2=0x7f86d819df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:57:59.215 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.212+0000 7f86dca90700 1 --2- 172.21.15.76:0/1435637683 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86d8100f90 0x7f86d819df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:59.215 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.212+0000 7f86dca90700 1 -- 172.21.15.76:0/1435637683 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86c8009520 con 0x7f86d8101950 2024-06-02T04:57:59.215 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.213+0000 7f86dca90700 1 --2- 172.21.15.76:0/1435637683 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f86d8101950 0x7f86d81a04c0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f86d000efc0 tx=0x7f86d000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:57:59.215 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.213+0000 7f86d57fa700 1 -- 172.21.15.76:0/1435637683 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d0018070 con 0x7f86d8101950 2024-06-02T04:57:59.215 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.213+0000 7f86de4f3700 1 -- 172.21.15.76:0/1435637683 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86d81a10d0 con 0x7f86d8101950 2024-06-02T04:57:59.215 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.213+0000 7f86de4f3700 1 -- 172.21.15.76:0/1435637683 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86d81a15e0 con 0x7f86d8101950 2024-06-02T04:57:59.215 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.213+0000 7f86d57fa700 1 -- 172.21.15.76:0/1435637683 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f86d000f040 con 0x7f86d8101950 2024-06-02T04:57:59.216 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.213+0000 7f86d57fa700 1 -- 172.21.15.76:0/1435637683 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d000cbb0 con 0x7f86d8101950 2024-06-02T04:57:59.220 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.219+0000 7f86ea6aeb80 1 Processor -- start 2024-06-02T04:57:59.221 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.220+0000 7f86d57fa700 1 -- 172.21.15.76:0/1435637683 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f86d0004000 con 0x7f86d8101950 2024-06-02T04:57:59.221 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.220+0000 7f86ea6aeb80 1 -- start start 2024-06-02T04:57:59.222 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.221+0000 7f86ea6aeb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55590478ca80 0x55590478cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:57:59.222 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.221+0000 7f86ea6aeb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55590478d3e0 0x55590478dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:57:59.222 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.221+0000 7f86ea6aeb80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55590478e2d0 0x55590478e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:57:59.222 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.221+0000 7f86ea6aeb80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559046e40f0 con 0x55590478e2d0 2024-06-02T04:57:59.222 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.221+0000 7f86ea6aeb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559046e1ab0 con 0x55590478d3e0 2024-06-02T04:57:59.222 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.221+0000 7f86ea6aeb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559046dd3a0 con 0x55590478ca80 2024-06-02T04:57:59.222 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.221+0000 7f86d77fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55590478ca80 0x55590478cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:57:59.222 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.221+0000 7f86d77fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55590478ca80 0x55590478cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:38888/0 (socket says 172.21.15.76:38888) 2024-06-02T04:57:59.222 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.221+0000 7f86d77fe700 1 -- 172.21.15.76:0/3738592933 learned_addr learned my addr 172.21.15.76:0/3738592933 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:57:59.222 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.221+0000 7f86d7fff700 1 --2- 172.21.15.76:0/3738592933 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55590478d3e0 0x55590478dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:57:59.223 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.221+0000 7f86d57fa700 1 --2- 172.21.15.76:0/1435637683 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f86c00a11a0 0x7f86c00a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:57:59.223 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.222+0000 7f86d7fff700 1 -- 172.21.15.76:0/3738592933 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55590478ca80 msgr2=0x55590478cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:57:59.223 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.222+0000 7f86d7fff700 1 --2- 172.21.15.76:0/3738592933 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55590478ca80 0x55590478cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:59.223 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.222+0000 7f86d7fff700 1 -- 172.21.15.76:0/3738592933 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55590478e2d0 msgr2=0x55590478e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:57:59.223 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.222+0000 7f86d7fff700 1 --2- 172.21.15.76:0/3738592933 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55590478e2d0 0x55590478e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:59.223 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.222+0000 7f86d7fff700 1 -- 172.21.15.76:0/3738592933 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55590455e350 con 0x55590478d3e0 2024-06-02T04:57:59.224 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.222+0000 7f86d57fa700 1 -- 172.21.15.76:0/1435637683 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f86d00cc610 con 0x7f86d8101950 2024-06-02T04:57:59.224 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.222+0000 7f86d7fff700 1 --2- 172.21.15.76:0/3738592933 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55590478d3e0 0x55590478dcf0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f86c80098c0 tx=0x7f86c8005e20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=63a7a42817779a07 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:57:59.224 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.223+0000 7f86dca90700 1 --2- 172.21.15.76:0/1435637683 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f86c00a11a0 0x7f86c00a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:57:59.225 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.225+0000 7f86be7fc700 1 -- 172.21.15.76:0/3738592933 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c800f660 con 0x55590478d3e0 2024-06-02T04:57:59.225 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.225+0000 7f86be7fc700 1 -- 172.21.15.76:0/3738592933 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f86c801d040 con 0x55590478d3e0 2024-06-02T04:57:59.225 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.225+0000 7f86be7fc700 1 -- 172.21.15.76:0/3738592933 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c80052a0 con 0x55590478d3e0 2024-06-02T04:57:59.226 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.226+0000 7f86ea6aeb80 1 -- 172.21.15.76:0/3738592933 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55590478d3e0 msgr2=0x55590478dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:57:59.226 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.226+0000 7f86ea6aeb80 1 --2- 172.21.15.76:0/3738592933 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55590478d3e0 0x55590478dcf0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f86c80098c0 tx=0x7f86c8005e20 comp rx=0 tx=0).stop 2024-06-02T04:57:59.227 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.227+0000 7f86ea6aeb80 1 -- 172.21.15.76:0/3738592933 shutdown_connections 2024-06-02T04:57:59.227 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.227+0000 7f86ea6aeb80 1 --2- 172.21.15.76:0/3738592933 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55590478e2d0 0x55590478e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:59.227 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.227+0000 7f86ea6aeb80 1 --2- 172.21.15.76:0/3738592933 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55590478ca80 0x55590478cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:59.227 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.227+0000 7f86ea6aeb80 1 --2- 172.21.15.76:0/3738592933 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55590478d3e0 0x55590478dcf0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:59.227 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.227+0000 7f86ea6aeb80 1 -- 172.21.15.76:0/3738592933 >> 172.21.15.76:0/3738592933 conn(0x5559046eb1b0 msgr2=0x555904789440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:57:59.228 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.227+0000 7f86ea6aeb80 1 -- 172.21.15.76:0/3738592933 shutdown_connections 2024-06-02T04:57:59.228 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.227+0000 7f86ea6aeb80 1 -- 172.21.15.76:0/3738592933 wait complete. 2024-06-02T04:57:59.228 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.227+0000 7f86ea6aeb80 1 -- start start 2024-06-02T04:57:59.228 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.228+0000 7f86ea6aeb80 1 Processor -- start 2024-06-02T04:57:59.229 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.228+0000 7f86ea6aeb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55590478ca80 0x55590479f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:57:59.229 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.228+0000 7f86ea6aeb80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55590478d3e0 0x55590479f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:57:59.229 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.228+0000 7f86ea6aeb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55590478e2d0 0x5559047a6600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:57:59.229 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.228+0000 7f86ea6aeb80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x555904679500 con 0x55590478d3e0 2024-06-02T04:57:59.229 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.228+0000 7f86ea6aeb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559046791a0 con 0x55590478ca80 2024-06-02T04:57:59.229 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.228+0000 7f86ea6aeb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x555904560640 con 0x55590478e2d0 2024-06-02T04:57:59.229 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.228+0000 7f86ea6aeb80 10 client.0 _ll_register_callbacks cb 0x555904682ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:57:59.229 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.228+0000 7f86d77fe700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55590478ca80 0x55590479f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:57:59.230 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.228+0000 7f86d77fe700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55590478ca80 0x55590479f080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:47248/0 (socket says 172.21.15.76:47248) 2024-06-02T04:57:59.230 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.228+0000 7f86d77fe700 1 -- 172.21.15.76:0/1852482633 learned_addr learned my addr 172.21.15.76:0/1852482633 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:57:59.230 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.228+0000 7f86d77fe700 1 --2- 172.21.15.76:0/1852482633 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55590478e2d0 0x5559047a6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:57:59.232 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.229+0000 7f86d77fe700 1 -- 172.21.15.76:0/1852482633 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55590478ca80 msgr2=0x55590479f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:57:59.232 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.229+0000 7f86d77fe700 1 --2- 172.21.15.76:0/1852482633 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55590478ca80 0x55590479f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:59.232 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.229+0000 7f86d77fe700 1 -- 172.21.15.76:0/1852482633 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55590478d3e0 msgr2=0x55590479f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:57:59.232 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.229+0000 7f86d77fe700 1 --2- 172.21.15.76:0/1852482633 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55590478d3e0 0x55590479f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:59.232 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.229+0000 7f86d77fe700 1 -- 172.21.15.76:0/1852482633 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86d8108ba0 con 0x55590478e2d0 2024-06-02T04:57:59.232 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.229+0000 7f86d77fe700 1 --2- 172.21.15.76:0/1852482633 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55590478e2d0 0x5559047a6600 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f86cc004790 tx=0x7f86cc0058e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=705ad7cff6b38d9e server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:57:59.232 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.229+0000 7f86b77fe700 10 client.0 ms_handle_connect on v2:172.21.15.192:3300/0 2024-06-02T04:57:59.233 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.229+0000 7f86dca90700 1 --2- 172.21.15.76:0/1435637683 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f86c00a11a0 0x7f86c00a3660 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f86d000c7a0 tx=0x7f86d0009ef0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:57:59.233 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.229+0000 7f86b77fe700 1 -- 172.21.15.76:0/1852482633 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86cc016030 con 0x55590478e2d0 2024-06-02T04:57:59.233 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.229+0000 7f86b77fe700 1 -- 172.21.15.76:0/1852482633 <== mon.1 v2:172.21.15.192:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f86cc00fdf0 con 0x55590478e2d0 2024-06-02T04:57:59.233 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.229+0000 7f86ea6aeb80 1 -- 172.21.15.76:0/1852482633 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555904636210 con 0x55590478e2d0 2024-06-02T04:57:59.233 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.229+0000 7f86b77fe700 1 -- 172.21.15.76:0/1852482633 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f86cc011560 con 0x55590478e2d0 2024-06-02T04:57:59.233 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.230+0000 7f86ea6aeb80 10 client.25822 fetch_fsmap learned FSMap version 36 2024-06-02T04:57:59.233 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.230+0000 7f86ea6aeb80 1 -- 172.21.15.76:0/1852482633 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55590450ab00 con 0x55590478e2d0 2024-06-02T04:57:59.233 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.230+0000 7f86b77fe700 1 -- 172.21.15.76:0/1852482633 <== mon.1 v2:172.21.15.192:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f86cc029080 con 0x55590478e2d0 2024-06-02T04:57:59.233 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.230+0000 7f86b77fe700 1 -- 172.21.15.76:0/1852482633 <== mon.1 v2:172.21.15.192:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f86cc003aa0 con 0x55590478e2d0 2024-06-02T04:57:59.233 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.230+0000 7f86ea6aeb80 10 client.25822 fetch_fsmap finished waiting for FSMap version 36 2024-06-02T04:57:59.233 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.230+0000 7f86ea6aeb80 10 client.25822 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T04:57:59.233 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.230+0000 7f86ea6aeb80 20 client.25822 populate_metadata read hostname 'smithi076' 2024-06-02T04:57:59.234 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.230+0000 7f86ea6aeb80 1 --2- 172.21.15.76:0/1852482633 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5559047bbfb0 0x5559047be3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:57:59.234 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.230+0000 7f86ea6aeb80 4 client.25822 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T04:57:59.234 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.230+0000 7f86ea6aeb80 1 -- 172.21.15.76:0/1852482633 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55590475c7b0 con 0x5559047bbfb0 2024-06-02T04:57:59.234 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.230+0000 7f86d7fff700 1 --2- 172.21.15.76:0/1852482633 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5559047bbfb0 0x5559047be3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:57:59.234 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.231+0000 7f86b77fe700 10 client.25822 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:57:59.234 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.231+0000 7f86d7fff700 1 --2- 172.21.15.76:0/1852482633 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5559047bbfb0 0x5559047be3d0 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5cb60354f052db44 server_cookie=f6d16732005a39c3 in_seq=0 out_seq=0 2024-06-02T04:57:59.234 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.231+0000 7f86b77fe700 1 -- 172.21.15.76:0/1852482633 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55590475c7b0 con 0x5559047bbfb0 2024-06-02T04:57:59.234 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.231+0000 7f86b77fe700 10 client.25822 handle_command_reply: tid=0 2024-06-02T04:57:59.234 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.231+0000 7f86ea6aeb80 1 client.25822 shutdown 2024-06-02T04:57:59.235 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.233+0000 7f86ea6aeb80 1 -- 172.21.15.76:0/1852482633 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55590478e2d0 msgr2=0x5559047a6600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:57:59.235 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.233+0000 7f86ea6aeb80 1 --2- 172.21.15.76:0/1852482633 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55590478e2d0 0x5559047a6600 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f86cc004790 tx=0x7f86cc0058e0 comp rx=0 tx=0).stop 2024-06-02T04:57:59.235 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.234+0000 7f86ea6aeb80 1 -- 172.21.15.76:0/1852482633 shutdown_connections 2024-06-02T04:57:59.235 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.234+0000 7f86ea6aeb80 1 --2- 172.21.15.76:0/1852482633 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5559047bbfb0 0x5559047be3d0 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:59.235 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.234+0000 7f86ea6aeb80 1 --2- 172.21.15.76:0/1852482633 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55590478e2d0 0x5559047a6600 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:59.235 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.234+0000 7f86ea6aeb80 1 --2- 172.21.15.76:0/1852482633 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55590478ca80 0x55590479f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:59.235 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.234+0000 7f86ea6aeb80 1 --2- 172.21.15.76:0/1852482633 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55590478d3e0 0x55590479f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:59.235 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.234+0000 7f86ea6aeb80 1 -- 172.21.15.76:0/1852482633 >> 172.21.15.76:0/1852482633 conn(0x5559046eb1b0 msgr2=0x555904787860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:57:59.236 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.234+0000 7f86b77fe700 0 client.25822 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:57:59.236 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.234+0000 7f86ea6aeb80 1 -- 172.21.15.76:0/1852482633 shutdown_connections 2024-06-02T04:57:59.236 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.234+0000 7f86ea6aeb80 1 -- 172.21.15.76:0/1852482633 wait complete. 2024-06-02T04:57:59.236 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.236+0000 7f86ea6aeb80 20 client.25822 trim_cache size 0 max 16384 2024-06-02T04:57:59.256 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.255+0000 7f86ea6aeb80 1 Processor -- start 2024-06-02T04:57:59.256 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.256+0000 7f86ea6aeb80 1 -- start start 2024-06-02T04:57:59.256 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.256+0000 7f86ea6aeb80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55590478ca80 0x5559047be3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:57:59.257 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.256+0000 7f86ea6aeb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55590478d3e0 0x5559047a6520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:57:59.257 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.256+0000 7f86ea6aeb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55590478e2d0 0x55590478e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:57:59.257 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.256+0000 7f86ea6aeb80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559047b8790 con 0x55590478ca80 2024-06-02T04:57:59.257 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.256+0000 7f86ea6aeb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559047c35e0 con 0x55590478e2d0 2024-06-02T04:57:59.257 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.256+0000 7f86ea6aeb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55590478d7c0 con 0x55590478d3e0 2024-06-02T04:57:59.257 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.256+0000 7f86d7fff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55590478d3e0 0x5559047a6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:57:59.257 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.256+0000 7f86d7fff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55590478d3e0 0x5559047a6520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:38894/0 (socket says 172.21.15.76:38894) 2024-06-02T04:57:59.257 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.256+0000 7f86d7fff700 1 -- 172.21.15.76:0/1029570748 learned_addr learned my addr 172.21.15.76:0/1029570748 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:57:59.259 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.256+0000 7f86d7fff700 1 -- 172.21.15.76:0/1029570748 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55590478e2d0 msgr2=0x55590478e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:57:59.259 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.256+0000 7f86d7fff700 1 --2- 172.21.15.76:0/1029570748 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55590478e2d0 0x55590478e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:59.259 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.256+0000 7f86d7fff700 1 -- 172.21.15.76:0/1029570748 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55590478ca80 msgr2=0x5559047be3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:57:59.259 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.256+0000 7f86d7fff700 1 --2- 172.21.15.76:0/1029570748 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55590478ca80 0x5559047be3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:59.259 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.256+0000 7f86d7fff700 1 -- 172.21.15.76:0/1029570748 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5559046a3500 con 0x55590478d3e0 2024-06-02T04:57:59.259 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.256+0000 7f86d7fff700 1 --2- 172.21.15.76:0/1029570748 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55590478d3e0 0x5559047a6520 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f86c80098c0 tx=0x7f86c80058e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=996179ad37735d87 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:57:59.259 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.257+0000 7f86beffd700 1 -- 172.21.15.76:0/1029570748 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c800b8e0 con 0x55590478d3e0 2024-06-02T04:57:59.259 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.257+0000 7f86beffd700 1 -- 172.21.15.76:0/1029570748 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f86c800f460 con 0x55590478d3e0 2024-06-02T04:57:59.259 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.257+0000 7f86beffd700 1 -- 172.21.15.76:0/1029570748 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c80050c0 con 0x55590478d3e0 2024-06-02T04:57:59.260 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.258+0000 7f86ea6aeb80 1 -- 172.21.15.76:0/1029570748 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55590478d3e0 msgr2=0x5559047a6520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:57:59.260 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.258+0000 7f86ea6aeb80 1 --2- 172.21.15.76:0/1029570748 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55590478d3e0 0x5559047a6520 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f86c80098c0 tx=0x7f86c80058e0 comp rx=0 tx=0).stop 2024-06-02T04:57:59.260 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.258+0000 7f86ea6aeb80 1 -- 172.21.15.76:0/1029570748 shutdown_connections 2024-06-02T04:57:59.260 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.258+0000 7f86ea6aeb80 1 --2- 172.21.15.76:0/1029570748 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55590478e2d0 0x55590478e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:59.260 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.258+0000 7f86ea6aeb80 1 --2- 172.21.15.76:0/1029570748 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55590478ca80 0x5559047be3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:59.260 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.258+0000 7f86ea6aeb80 1 --2- 172.21.15.76:0/1029570748 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55590478d3e0 0x5559047a6520 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:59.260 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.258+0000 7f86ea6aeb80 1 -- 172.21.15.76:0/1029570748 >> 172.21.15.76:0/1029570748 conn(0x5559046eb1b0 msgr2=0x555904794810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:57:59.260 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.258+0000 7f86ea6aeb80 1 -- 172.21.15.76:0/1029570748 shutdown_connections 2024-06-02T04:57:59.260 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.258+0000 7f86ea6aeb80 1 -- 172.21.15.76:0/1029570748 wait complete. 2024-06-02T04:57:59.260 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.258+0000 7f86ea6aeb80 1 -- start start 2024-06-02T04:57:59.260 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.259+0000 7f86ea6aeb80 1 Processor -- start 2024-06-02T04:57:59.263 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.259+0000 7f86ea6aeb80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55590478ca80 0x5559047a35f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:57:59.263 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.259+0000 7f86ea6aeb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55590478d3e0 0x5559047a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:57:59.263 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.259+0000 7f86ea6aeb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55590478e2d0 0x555904810490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:57:59.263 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.259+0000 7f86ea6aeb80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559048109d0 con 0x55590478ca80 2024-06-02T04:57:59.263 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.259+0000 7f86ea6aeb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x555904810b10 con 0x55590478d3e0 2024-06-02T04:57:59.263 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.259+0000 7f86ea6aeb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x555904795220 con 0x55590478e2d0 2024-06-02T04:57:59.263 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.259+0000 7f86ea6aeb80 10 client.0 _ll_register_callbacks cb 0x555904682ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:57:59.263 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.259+0000 7f86d7fff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55590478d3e0 0x5559047a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:57:59.263 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.259+0000 7f86d7fff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55590478d3e0 0x5559047a3b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:47260/0 (socket says 172.21.15.76:47260) 2024-06-02T04:57:59.264 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.259+0000 7f86d7fff700 1 -- 172.21.15.76:0/1021953347 learned_addr learned my addr 172.21.15.76:0/1021953347 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:57:59.264 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.259+0000 7f86d7fff700 1 -- 172.21.15.76:0/1021953347 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55590478e2d0 msgr2=0x555904810490 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-02T04:57:59.264 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.259+0000 7f86d7fff700 1 --2- 172.21.15.76:0/1021953347 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55590478e2d0 0x555904810490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:59.264 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.259+0000 7f86d7fff700 1 -- 172.21.15.76:0/1021953347 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55590478ca80 msgr2=0x5559047a35f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:57:59.264 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.259+0000 7f86d7fff700 1 --2- 172.21.15.76:0/1021953347 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55590478ca80 0x5559047a35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:59.264 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.259+0000 7f86d7fff700 1 -- 172.21.15.76:0/1021953347 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55590455e350 con 0x55590478d3e0 2024-06-02T04:57:59.264 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.260+0000 7f86d7fff700 1 --2- 172.21.15.76:0/1021953347 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55590478d3e0 0x5559047a3b30 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f86c800fae0 tx=0x7f86c800fbc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed83559adcc8d592 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:57:59.265 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.260+0000 7f86b77fe700 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-06-02T04:57:59.265 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.260+0000 7f86b77fe700 1 -- 172.21.15.76:0/1021953347 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c80052c0 con 0x55590478d3e0 2024-06-02T04:57:59.265 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.260+0000 7f86b77fe700 1 -- 172.21.15.76:0/1021953347 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f86c800f690 con 0x55590478d3e0 2024-06-02T04:57:59.265 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.260+0000 7f86ea6aeb80 1 -- 172.21.15.76:0/1021953347 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f86c801d040 con 0x55590478d3e0 2024-06-02T04:57:59.265 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.260+0000 7f86b77fe700 1 -- 172.21.15.76:0/1021953347 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f86c800b8f0 con 0x55590478d3e0 2024-06-02T04:57:59.265 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.261+0000 7f86ea6aeb80 10 client.25889 fetch_fsmap learned FSMap version 36 2024-06-02T04:57:59.265 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.261+0000 7f86ea6aeb80 1 -- 172.21.15.76:0/1021953347 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x555904562c70 con 0x55590478d3e0 2024-06-02T04:57:59.265 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.261+0000 7f86b77fe700 1 -- 172.21.15.76:0/1021953347 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f86c801d040 con 0x55590478d3e0 2024-06-02T04:57:59.265 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.261+0000 7f86b77fe700 1 -- 172.21.15.76:0/1021953347 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f86c8009c70 con 0x55590478d3e0 2024-06-02T04:57:59.265 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.261+0000 7f86ea6aeb80 10 client.25889 fetch_fsmap finished waiting for FSMap version 36 2024-06-02T04:57:59.265 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.261+0000 7f86ea6aeb80 10 client.25889 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T04:57:59.266 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.261+0000 7f86ea6aeb80 20 client.25889 populate_metadata read hostname 'smithi076' 2024-06-02T04:57:59.266 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.261+0000 7f86ea6aeb80 1 --2- 172.21.15.76:0/1021953347 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5559047967a0 0x555904798bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:57:59.266 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.261+0000 7f86ea6aeb80 4 client.25889 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T04:57:59.266 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.261+0000 7f86ea6aeb80 1 -- 172.21.15.76:0/1021953347 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5559046d5e60 con 0x5559047967a0 2024-06-02T04:57:59.266 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.262+0000 7f86d77fe700 1 --2- 172.21.15.76:0/1021953347 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5559047967a0 0x555904798bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:57:59.266 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.262+0000 7f86b77fe700 10 client.25889 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:57:59.266 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.262+0000 7f86d77fe700 1 --2- 172.21.15.76:0/1021953347 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5559047967a0 0x555904798bc0 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f38f78e052579e5d server_cookie=fc05821c2b300663 in_seq=0 out_seq=0 2024-06-02T04:57:59.291 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.289+0000 7f86b77fe700 1 -- 172.21.15.76:0/1021953347 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5559046d5e60 con 0x5559047967a0 2024-06-02T04:57:59.291 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.290+0000 7f86b77fe700 10 client.25889 handle_command_reply: tid=0 2024-06-02T04:57:59.291 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.290+0000 7f86ea6aeb80 1 client.25889 shutdown 2024-06-02T04:57:59.291 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.290+0000 7f86ea6aeb80 1 -- 172.21.15.76:0/1021953347 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55590478d3e0 msgr2=0x5559047a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:57:59.291 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.290+0000 7f86ea6aeb80 1 --2- 172.21.15.76:0/1021953347 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55590478d3e0 0x5559047a3b30 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f86c800fae0 tx=0x7f86c800fbc0 comp rx=0 tx=0).stop 2024-06-02T04:57:59.291 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.290+0000 7f86ea6aeb80 1 -- 172.21.15.76:0/1021953347 shutdown_connections 2024-06-02T04:57:59.291 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.290+0000 7f86ea6aeb80 1 --2- 172.21.15.76:0/1021953347 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5559047967a0 0x555904798bc0 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:59.291 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.290+0000 7f86ea6aeb80 1 --2- 172.21.15.76:0/1021953347 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55590478e2d0 0x555904810490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:59.291 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.290+0000 7f86ea6aeb80 1 --2- 172.21.15.76:0/1021953347 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55590478ca80 0x5559047a35f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:59.291 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.290+0000 7f86ea6aeb80 1 --2- 172.21.15.76:0/1021953347 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55590478d3e0 0x5559047a3b30 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:59.292 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.290+0000 7f86ea6aeb80 1 -- 172.21.15.76:0/1021953347 >> 172.21.15.76:0/1021953347 conn(0x5559046eb1b0 msgr2=0x55590479e260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:57:59.292 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.290+0000 7f86b77fe700 0 client.25889 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:57:59.292 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.290+0000 7f86ea6aeb80 1 -- 172.21.15.76:0/1021953347 shutdown_connections 2024-06-02T04:57:59.292 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.290+0000 7f86ea6aeb80 1 -- 172.21.15.76:0/1021953347 wait complete. 2024-06-02T04:57:59.292 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.290+0000 7f86ea6aeb80 20 client.25889 trim_cache size 0 max 16384 2024-06-02T04:57:59.292 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:{ 2024-06-02T04:57:59.292 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "message": "", 2024-06-02T04:57:59.292 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "return_code": 0 2024-06-02T04:57:59.292 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:} 2024-06-02T04:57:59.293 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.291+0000 7f86de4f3700 1 -- 172.21.15.76:0/1435637683 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f86c00a11a0 msgr2=0x7f86c00a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:57:59.293 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.291+0000 7f86de4f3700 1 --2- 172.21.15.76:0/1435637683 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f86c00a11a0 0x7f86c00a3660 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f86d000c7a0 tx=0x7f86d0009ef0 comp rx=0 tx=0).stop 2024-06-02T04:57:59.293 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.291+0000 7f86de4f3700 1 -- 172.21.15.76:0/1435637683 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f86d8101950 msgr2=0x7f86d81a04c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:57:59.293 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.291+0000 7f86de4f3700 1 --2- 172.21.15.76:0/1435637683 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f86d8101950 0x7f86d81a04c0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f86d000efc0 tx=0x7f86d000c3a0 comp rx=0 tx=0).stop 2024-06-02T04:57:59.294 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.291+0000 7f86de4f3700 1 -- 172.21.15.76:0/1435637683 shutdown_connections 2024-06-02T04:57:59.294 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.291+0000 7f86de4f3700 1 --2- 172.21.15.76:0/1435637683 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f86d8101950 0x7f86d81a04c0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:59.294 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.291+0000 7f86de4f3700 1 --2- 172.21.15.76:0/1435637683 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f86d80ffe40 0x7f86d8069c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:59.294 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.291+0000 7f86de4f3700 1 --2- 172.21.15.76:0/1435637683 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f86c00a11a0 0x7f86c00a3660 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:59.294 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.291+0000 7f86de4f3700 1 --2- 172.21.15.76:0/1435637683 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86d8100f90 0x7f86d819df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:57:59.295 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.291+0000 7f86de4f3700 1 -- 172.21.15.76:0/1435637683 >> 172.21.15.76:0/1435637683 conn(0x7f86d80fb3b0 msgr2=0x7f86d81044e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:57:59.295 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.291+0000 7f86de4f3700 1 -- 172.21.15.76:0/1435637683 shutdown_connections 2024-06-02T04:57:59.295 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:57:59.291+0000 7f86de4f3700 1 -- 172.21.15.76:0/1435637683 wait complete. 2024-06-02T04:57:59.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:57:59 smithi119 ceph-mon[46633]: pgmap v520: 129 pgs: 129 active+clean; 1.5 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 13 MiB/s wr, 906 op/s 2024-06-02T04:57:59.933 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:57:59 smithi192 ceph-mon[47933]: pgmap v520: 129 pgs: 129 active+clean; 1.5 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 13 MiB/s wr, 906 op/s 2024-06-02T04:57:59.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:57:59 smithi076 ceph-mon[42935]: pgmap v520: 129 pgs: 129 active+clean; 1.5 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 13 MiB/s wr, 906 op/s 2024-06-02T04:58:01.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 430.0 s, 863.0 tps, lat 115.491 ms stddev 44.910 2024-06-02T04:58:01.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:58:01 smithi119 ceph-mon[46633]: pgmap v521: 129 pgs: 129 active+clean; 1.5 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 13 MiB/s wr, 929 op/s 2024-06-02T04:58:01.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:58:01 smithi192 ceph-mon[47933]: pgmap v521: 129 pgs: 129 active+clean; 1.5 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 13 MiB/s wr, 929 op/s 2024-06-02T04:58:01.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:58:01 smithi076 ceph-mon[42935]: pgmap v521: 129 pgs: 129 active+clean; 1.5 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 13 MiB/s wr, 929 op/s 2024-06-02T04:58:03.848 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:58:03 smithi119 ceph-mon[46633]: pgmap v522: 129 pgs: 129 active+clean; 1.5 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 12 MiB/s wr, 870 op/s 2024-06-02T04:58:03.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:58:03 smithi192 ceph-mon[47933]: pgmap v522: 129 pgs: 129 active+clean; 1.5 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 12 MiB/s wr, 870 op/s 2024-06-02T04:58:03.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:58:03 smithi076 ceph-mon[42935]: pgmap v522: 129 pgs: 129 active+clean; 1.5 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 12 MiB/s wr, 870 op/s 2024-06-02T04:58:05.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:58:05 smithi119 ceph-mon[46633]: pgmap v523: 129 pgs: 129 active+clean; 1.5 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 11 MiB/s wr, 795 op/s 2024-06-02T04:58:05.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:58:05 smithi192 ceph-mon[47933]: pgmap v523: 129 pgs: 129 active+clean; 1.5 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 11 MiB/s wr, 795 op/s 2024-06-02T04:58:05.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:58:05 smithi076 ceph-mon[42935]: pgmap v523: 129 pgs: 129 active+clean; 1.5 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 11 MiB/s wr, 795 op/s 2024-06-02T04:58:06.319 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 435.0 s, 758.7 tps, lat 131.359 ms stddev 54.810 2024-06-02T04:58:07.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:58:07 smithi119 ceph-mon[46633]: pgmap v524: 129 pgs: 129 active+clean; 1.5 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 12 MiB/s wr, 856 op/s 2024-06-02T04:58:07.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:58:07 smithi192 ceph-mon[47933]: pgmap v524: 129 pgs: 129 active+clean; 1.5 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 12 MiB/s wr, 856 op/s 2024-06-02T04:58:07.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:58:07 smithi076 ceph-mon[42935]: pgmap v524: 129 pgs: 129 active+clean; 1.5 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 12 MiB/s wr, 856 op/s 2024-06-02T04:58:08.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:58:08 smithi119 ceph-mon[46633]: pgmap v525: 129 pgs: 129 active+clean; 1.5 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 12 MiB/s wr, 834 op/s 2024-06-02T04:58:08.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:58:08 smithi192 ceph-mon[47933]: pgmap v525: 129 pgs: 129 active+clean; 1.5 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 12 MiB/s wr, 834 op/s 2024-06-02T04:58:08.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:58:08 smithi076 ceph-mon[42935]: pgmap v525: 129 pgs: 129 active+clean; 1.5 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 12 MiB/s wr, 834 op/s 2024-06-02T04:58:11.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 440.0 s, 688.7 tps, lat 145.725 ms stddev 60.551 2024-06-02T04:58:11.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:58:11 smithi119 ceph-mon[46633]: pgmap v526: 129 pgs: 129 active+clean; 1.5 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 12 MiB/s wr, 891 op/s 2024-06-02T04:58:11.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:58:11 smithi192 ceph-mon[47933]: pgmap v526: 129 pgs: 129 active+clean; 1.5 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 12 MiB/s wr, 891 op/s 2024-06-02T04:58:11.985 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:58:11 smithi076 ceph-mon[42935]: pgmap v526: 129 pgs: 129 active+clean; 1.5 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 12 MiB/s wr, 891 op/s 2024-06-02T04:58:12.482 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.479+0000 7f1a6e4cf700 1 -- 172.21.15.76:0/4215272453 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1a680ffd60 msgr2=0x7f1a68100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:58:12.482 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.479+0000 7f1a6e4cf700 1 --2- 172.21.15.76:0/4215272453 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1a680ffd60 0x7f1a68100180 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1a58009990 tx=0x7f1a58009ca0 comp rx=0 tx=0).stop 2024-06-02T04:58:12.482 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.479+0000 7f1a6e4cf700 1 -- 172.21.15.76:0/4215272453 shutdown_connections 2024-06-02T04:58:12.483 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.479+0000 7f1a6e4cf700 1 --2- 172.21.15.76:0/4215272453 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1a681018f0 0x7f1a681081a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:12.483 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.479+0000 7f1a6e4cf700 1 --2- 172.21.15.76:0/4215272453 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1a680ffd60 0x7f1a68100180 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:12.483 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.479+0000 7f1a6e4cf700 1 --2- 172.21.15.76:0/4215272453 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1a68100f50 0x7f1a681013b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:12.483 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.479+0000 7f1a6e4cf700 1 -- 172.21.15.76:0/4215272453 >> 172.21.15.76:0/4215272453 conn(0x7f1a680fb2f0 msgr2=0x7f1a680fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:58:12.483 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.480+0000 7f1a6e4cf700 1 -- 172.21.15.76:0/4215272453 shutdown_connections 2024-06-02T04:58:12.483 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.480+0000 7f1a6e4cf700 1 -- 172.21.15.76:0/4215272453 wait complete. 2024-06-02T04:58:12.483 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.480+0000 7f1a6e4cf700 1 Processor -- start 2024-06-02T04:58:12.483 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.480+0000 7f1a6e4cf700 1 -- start start 2024-06-02T04:58:12.483 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.481+0000 7f1a6e4cf700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1a680ffd60 0x7f1a6810a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:58:12.483 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.481+0000 7f1a6e4cf700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1a68100f50 0x7f1a68108b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:58:12.483 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.481+0000 7f1a6e4cf700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1a681018f0 0x7f1a68109060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:58:12.484 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.481+0000 7f1a6e4cf700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a68109760 con 0x7f1a680ffd60 2024-06-02T04:58:12.484 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.481+0000 7f1a6e4cf700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a681098d0 con 0x7f1a681018f0 2024-06-02T04:58:12.484 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.481+0000 7f1a6e4cf700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a681a0e20 con 0x7f1a68100f50 2024-06-02T04:58:12.484 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.481+0000 7f1a5ffff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1a68100f50 0x7f1a68108b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:58:12.484 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.481+0000 7f1a5ffff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1a68100f50 0x7f1a68108b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:35674/0 (socket says 172.21.15.76:35674) 2024-06-02T04:58:12.484 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.481+0000 7f1a5ffff700 1 -- 172.21.15.76:0/3601876652 learned_addr learned my addr 172.21.15.76:0/3601876652 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:58:12.484 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.481+0000 7f1a6ca6c700 1 --2- 172.21.15.76:0/3601876652 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1a681018f0 0x7f1a68109060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:58:12.484 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.481+0000 7f1a67fff700 1 --2- 172.21.15.76:0/3601876652 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1a680ffd60 0x7f1a6810a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:58:12.484 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.481+0000 7f1a5ffff700 1 -- 172.21.15.76:0/3601876652 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1a681018f0 msgr2=0x7f1a68109060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:58:12.484 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.481+0000 7f1a5ffff700 1 --2- 172.21.15.76:0/3601876652 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1a681018f0 0x7f1a68109060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:12.484 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.481+0000 7f1a5ffff700 1 -- 172.21.15.76:0/3601876652 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1a680ffd60 msgr2=0x7f1a6810a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:58:12.485 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.482+0000 7f1a5ffff700 1 --2- 172.21.15.76:0/3601876652 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1a680ffd60 0x7f1a6810a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:12.485 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.482+0000 7f1a5ffff700 1 -- 172.21.15.76:0/3601876652 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a580095f0 con 0x7f1a68100f50 2024-06-02T04:58:12.485 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.482+0000 7f1a5ffff700 1 --2- 172.21.15.76:0/3601876652 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1a68100f50 0x7f1a68108b20 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1a5000e9a0 tx=0x7f1a5000ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:58:12.486 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.482+0000 7f1a67fff700 1 --2- 172.21.15.76:0/3601876652 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1a680ffd60 0x7f1a6810a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:58:12.486 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.482+0000 7f1a65ffb700 1 -- 172.21.15.76:0/3601876652 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a50009790 con 0x7f1a68100f50 2024-06-02T04:58:12.486 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.482+0000 7f1a6e4cf700 1 -- 172.21.15.76:0/3601876652 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a681a1080 con 0x7f1a68100f50 2024-06-02T04:58:12.486 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.482+0000 7f1a65ffb700 1 -- 172.21.15.76:0/3601876652 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1a5000cbd0 con 0x7f1a68100f50 2024-06-02T04:58:12.486 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.482+0000 7f1a65ffb700 1 -- 172.21.15.76:0/3601876652 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a50018680 con 0x7f1a68100f50 2024-06-02T04:58:12.486 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.482+0000 7f1a6e4cf700 1 -- 172.21.15.76:0/3601876652 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a681a15e0 con 0x7f1a68100f50 2024-06-02T04:58:12.490 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.485+0000 7f1a65ffb700 1 -- 172.21.15.76:0/3601876652 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f1a50010430 con 0x7f1a68100f50 2024-06-02T04:58:12.490 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.487+0000 7f1a7a68ab80 1 Processor -- start 2024-06-02T04:58:12.490 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.487+0000 7f1a7a68ab80 1 -- start start 2024-06-02T04:58:12.490 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.487+0000 7f1a7a68ab80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5577289df290 0x5577289df6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:58:12.490 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.487+0000 7f1a7a68ab80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5577289dfbf0 0x5577289e0500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:58:12.491 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.487+0000 7f1a7a68ab80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5577289e0ae0 0x5577289e0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:58:12.491 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.487+0000 7f1a7a68ab80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55772892e0f0 con 0x5577289df290 2024-06-02T04:58:12.491 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.487+0000 7f1a7a68ab80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55772892bab0 con 0x5577289dfbf0 2024-06-02T04:58:12.491 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.487+0000 7f1a65ffb700 1 --2- 172.21.15.76:0/3601876652 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f1a540a1210 0x7f1a540a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:58:12.491 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.488+0000 7f1a65ffb700 1 -- 172.21.15.76:0/3601876652 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f1a50014070 con 0x7f1a68100f50 2024-06-02T04:58:12.491 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.488+0000 7f1a5ffff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5577289e0ae0 0x5577289e0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:58:12.491 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.488+0000 7f1a5ffff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5577289e0ae0 0x5577289e0f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:35682/0 (socket says 172.21.15.76:35682) 2024-06-02T04:58:12.491 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.488+0000 7f1a5ffff700 1 -- 172.21.15.76:0/561709095 learned_addr learned my addr 172.21.15.76:0/561709095 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:58:12.491 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.488+0000 7f1a6ca6c700 1 --2- 172.21.15.76:0/3601876652 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f1a540a1210 0x7f1a540a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:58:12.491 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.487+0000 7f1a7a68ab80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x5577289273a0 con 0x5577289e0ae0 2024-06-02T04:58:12.491 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.489+0000 7f1a6ca6c700 1 --2- 172.21.15.76:0/3601876652 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f1a540a1210 0x7f1a540a36d0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f1a60009ec0 tx=0x7f1a60009920 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:58:12.492 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.489+0000 7f1a5ffff700 1 -- 172.21.15.76:0/561709095 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5577289dfbf0 msgr2=0x5577289e0500 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-02T04:58:12.492 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.489+0000 7f1a5ffff700 1 --2- 172.21.15.76:0/561709095 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5577289dfbf0 0x5577289e0500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:12.492 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.489+0000 7f1a5ffff700 1 -- 172.21.15.76:0/561709095 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5577289df290 msgr2=0x5577289df6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:58:12.492 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.489+0000 7f1a5ffff700 1 --2- 172.21.15.76:0/561709095 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5577289df290 0x5577289df6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:12.492 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.489+0000 7f1a5ffff700 1 -- 172.21.15.76:0/561709095 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5577287a8350 con 0x5577289e0ae0 2024-06-02T04:58:12.492 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.489+0000 7f1a5ffff700 1 --2- 172.21.15.76:0/561709095 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5577289e0ae0 0x5577289e0f60 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1a50096b00 tx=0x7f1a50099c50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=59ffd1a1ec39e1be server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:58:12.492 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.489+0000 7f1a5e7fc700 1 -- 172.21.15.76:0/561709095 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a5009a090 con 0x5577289e0ae0 2024-06-02T04:58:12.492 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.489+0000 7f1a5e7fc700 1 -- 172.21.15.76:0/561709095 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1a5009dec0 con 0x5577289e0ae0 2024-06-02T04:58:12.492 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.489+0000 7f1a5e7fc700 1 -- 172.21.15.76:0/561709095 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a50086e00 con 0x5577289e0ae0 2024-06-02T04:58:12.493 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.490+0000 7f1a7a68ab80 1 -- 172.21.15.76:0/561709095 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5577289e0ae0 msgr2=0x5577289e0f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:58:12.493 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.490+0000 7f1a7a68ab80 1 --2- 172.21.15.76:0/561709095 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5577289e0ae0 0x5577289e0f60 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1a50096b00 tx=0x7f1a50099c50 comp rx=0 tx=0).stop 2024-06-02T04:58:12.493 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.493+0000 7f1a7a68ab80 1 -- 172.21.15.76:0/561709095 shutdown_connections 2024-06-02T04:58:12.494 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.493+0000 7f1a7a68ab80 1 --2- 172.21.15.76:0/561709095 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5577289e0ae0 0x5577289e0f60 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:12.494 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.493+0000 7f1a7a68ab80 1 --2- 172.21.15.76:0/561709095 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5577289df290 0x5577289df6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:12.494 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.493+0000 7f1a7a68ab80 1 --2- 172.21.15.76:0/561709095 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5577289dfbf0 0x5577289e0500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:12.494 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.493+0000 7f1a7a68ab80 1 -- 172.21.15.76:0/561709095 >> 172.21.15.76:0/561709095 conn(0x5577289351b0 msgr2=0x5577289d3440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:58:12.495 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.495+0000 7f1a7a68ab80 1 -- 172.21.15.76:0/561709095 shutdown_connections 2024-06-02T04:58:12.496 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.495+0000 7f1a7a68ab80 1 -- 172.21.15.76:0/561709095 wait complete. 2024-06-02T04:58:12.496 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.495+0000 7f1a7a68ab80 1 -- start start 2024-06-02T04:58:12.496 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.496+0000 7f1a7a68ab80 1 Processor -- start 2024-06-02T04:58:12.498 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.496+0000 7f1a7a68ab80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5577289df290 0x5577289d7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:58:12.498 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.496+0000 7f1a7a68ab80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5577289dfbf0 0x5577289d8510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:58:12.498 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.496+0000 7f1a7a68ab80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5577289e0ae0 0x5577289dd540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:58:12.498 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.496+0000 7f1a7a68ab80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5577288c3500 con 0x5577289e0ae0 2024-06-02T04:58:12.498 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.496+0000 7f1a7a68ab80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5577288c31a0 con 0x5577289df290 2024-06-02T04:58:12.498 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.496+0000 7f1a7a68ab80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x5577287aa640 con 0x5577289dfbf0 2024-06-02T04:58:12.498 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.496+0000 7f1a7a68ab80 10 client.0 _ll_register_callbacks cb 0x5577288ccad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:58:12.498 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.497+0000 7f1a67fff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5577289df290 0x5577289d7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:58:12.499 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.497+0000 7f1a67fff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5577289df290 0x5577289d7fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:33080/0 (socket says 172.21.15.76:33080) 2024-06-02T04:58:12.499 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.497+0000 7f1a67fff700 1 -- 172.21.15.76:0/324919241 learned_addr learned my addr 172.21.15.76:0/324919241 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:58:12.499 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.497+0000 7f1a67fff700 1 -- 172.21.15.76:0/324919241 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5577289dfbf0 msgr2=0x5577289d8510 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-02T04:58:12.499 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.497+0000 7f1a67fff700 1 --2- 172.21.15.76:0/324919241 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5577289dfbf0 0x5577289d8510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:12.499 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.497+0000 7f1a67fff700 1 -- 172.21.15.76:0/324919241 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5577289e0ae0 msgr2=0x5577289dd540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:58:12.499 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.497+0000 7f1a67fff700 1 --2- 172.21.15.76:0/324919241 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5577289e0ae0 0x5577289dd540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:12.499 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.497+0000 7f1a67fff700 1 -- 172.21.15.76:0/324919241 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a681a15e0 con 0x5577289df290 2024-06-02T04:58:12.500 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.498+0000 7f1a67fff700 1 --2- 172.21.15.76:0/324919241 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5577289df290 0x5577289d7fd0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1a58005b40 tx=0x7f1a58005320 comp rx=0 tx=0).ready entity=mon.2 client_cookie=39b634eaebc04b6d server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:58:12.500 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.498+0000 7f1a477fe700 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-06-02T04:58:12.500 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.498+0000 7f1a477fe700 1 -- 172.21.15.76:0/324919241 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a58003a90 con 0x5577289df290 2024-06-02T04:58:12.500 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.498+0000 7f1a477fe700 1 -- 172.21.15.76:0/324919241 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f1a58003bf0 con 0x5577289df290 2024-06-02T04:58:12.500 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.498+0000 7f1a7a68ab80 1 -- 172.21.15.76:0/324919241 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557728880210 con 0x5577289df290 2024-06-02T04:58:12.500 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.499+0000 7f1a477fe700 1 -- 172.21.15.76:0/324919241 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1a5800b710 con 0x5577289df290 2024-06-02T04:58:12.500 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.499+0000 7f1a7a68ab80 10 client.25898 fetch_fsmap learned FSMap version 36 2024-06-02T04:58:12.500 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.499+0000 7f1a7a68ab80 1 -- 172.21.15.76:0/324919241 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x557728754b00 con 0x5577289df290 2024-06-02T04:58:12.501 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.500+0000 7f1a477fe700 1 -- 172.21.15.76:0/324919241 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x557728880210 con 0x5577289df290 2024-06-02T04:58:12.501 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.500+0000 7f1a477fe700 1 -- 172.21.15.76:0/324919241 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f1a5802a070 con 0x5577289df290 2024-06-02T04:58:12.501 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.501+0000 7f1a7a68ab80 10 client.25898 fetch_fsmap finished waiting for FSMap version 36 2024-06-02T04:58:12.502 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.501+0000 7f1a7a68ab80 10 client.25898 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T04:58:12.502 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.501+0000 7f1a7a68ab80 20 client.25898 populate_metadata read hostname 'smithi076' 2024-06-02T04:58:12.502 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.501+0000 7f1a7a68ab80 1 --2- 172.21.15.76:0/324919241 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x557728a0e670 0x557728a10a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:58:12.502 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.501+0000 7f1a7a68ab80 4 client.25898 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T04:58:12.502 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.501+0000 7f1a7a68ab80 1 -- 172.21.15.76:0/324919241 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5577289a67b0 con 0x557728a0e670 2024-06-02T04:58:12.502 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.501+0000 7f1a5ffff700 1 --2- 172.21.15.76:0/324919241 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x557728a0e670 0x557728a10a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:58:12.503 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.502+0000 7f1a5ffff700 1 --2- 172.21.15.76:0/324919241 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x557728a0e670 0x557728a10a90 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=331b8d9b5f6e392c server_cookie=18d5ec9ea5ec1e17 in_seq=0 out_seq=0 2024-06-02T04:58:12.503 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.502+0000 7f1a477fe700 10 client.25898 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:58:12.503 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.502+0000 7f1a477fe700 1 -- 172.21.15.76:0/324919241 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5577289a67b0 con 0x557728a0e670 2024-06-02T04:58:12.503 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.502+0000 7f1a477fe700 10 client.25898 handle_command_reply: tid=0 2024-06-02T04:58:12.503 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.502+0000 7f1a7a68ab80 1 client.25898 shutdown 2024-06-02T04:58:12.504 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.503+0000 7f1a7a68ab80 1 -- 172.21.15.76:0/324919241 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5577289df290 msgr2=0x5577289d7fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:58:12.504 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.503+0000 7f1a7a68ab80 1 --2- 172.21.15.76:0/324919241 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5577289df290 0x5577289d7fd0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1a58005b40 tx=0x7f1a58005320 comp rx=0 tx=0).stop 2024-06-02T04:58:12.504 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.503+0000 7f1a7a68ab80 1 -- 172.21.15.76:0/324919241 shutdown_connections 2024-06-02T04:58:12.504 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.503+0000 7f1a7a68ab80 1 --2- 172.21.15.76:0/324919241 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x557728a0e670 0x557728a10a90 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:12.505 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.503+0000 7f1a7a68ab80 1 --2- 172.21.15.76:0/324919241 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5577289e0ae0 0x5577289dd540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:12.505 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.503+0000 7f1a7a68ab80 1 --2- 172.21.15.76:0/324919241 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5577289df290 0x5577289d7fd0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:12.505 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.503+0000 7f1a7a68ab80 1 --2- 172.21.15.76:0/324919241 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5577289dfbf0 0x5577289d8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:12.505 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.503+0000 7f1a7a68ab80 1 -- 172.21.15.76:0/324919241 >> 172.21.15.76:0/324919241 conn(0x5577289351b0 msgr2=0x5577289d1860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:58:12.505 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.503+0000 7f1a477fe700 0 client.25898 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:58:12.505 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.504+0000 7f1a7a68ab80 1 -- 172.21.15.76:0/324919241 shutdown_connections 2024-06-02T04:58:12.505 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.504+0000 7f1a7a68ab80 1 -- 172.21.15.76:0/324919241 wait complete. 2024-06-02T04:58:12.506 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.504+0000 7f1a7a68ab80 20 client.25898 trim_cache size 0 max 16384 2024-06-02T04:58:12.530 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.529+0000 7f1a7a68ab80 1 Processor -- start 2024-06-02T04:58:12.530 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.529+0000 7f1a7a68ab80 1 -- start start 2024-06-02T04:58:12.530 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.529+0000 7f1a7a68ab80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5577289df290 0x5577289ddbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:58:12.530 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.529+0000 7f1a7a68ab80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5577289dfbf0 0x5577289e0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:58:12.530 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.529+0000 7f1a7a68ab80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5577289e0ae0 0x5577289d74e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:58:12.530 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.529+0000 7f1a7a68ab80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5577289d6520 con 0x5577289dfbf0 2024-06-02T04:58:12.530 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.529+0000 7f1a7a68ab80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5577289de6c0 con 0x5577289df290 2024-06-02T04:58:12.530 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.529+0000 7f1a7a68ab80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x5577289d9210 con 0x5577289e0ae0 2024-06-02T04:58:12.531 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.530+0000 7f1a67fff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5577289df290 0x5577289ddbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:58:12.532 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.530+0000 7f1a67fff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5577289df290 0x5577289ddbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:33096/0 (socket says 172.21.15.76:33096) 2024-06-02T04:58:12.532 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.530+0000 7f1a67fff700 1 -- 172.21.15.76:0/439581626 learned_addr learned my addr 172.21.15.76:0/439581626 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:58:12.532 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.530+0000 7f1a6ca6c700 1 --2- 172.21.15.76:0/439581626 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5577289e0ae0 0x5577289d74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:58:12.532 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.530+0000 7f1a5ffff700 1 --2- 172.21.15.76:0/439581626 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5577289dfbf0 0x5577289e0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:58:12.532 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.530+0000 7f1a67fff700 1 -- 172.21.15.76:0/439581626 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5577289e0ae0 msgr2=0x5577289d74e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:58:12.532 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.530+0000 7f1a67fff700 1 --2- 172.21.15.76:0/439581626 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5577289e0ae0 0x5577289d74e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:12.532 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.530+0000 7f1a67fff700 1 -- 172.21.15.76:0/439581626 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5577289dfbf0 msgr2=0x5577289e0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:58:12.532 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.530+0000 7f1a67fff700 1 --2- 172.21.15.76:0/439581626 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5577289dfbf0 0x5577289e0ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:12.532 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.530+0000 7f1a67fff700 1 -- 172.21.15.76:0/439581626 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5577288ed500 con 0x5577289df290 2024-06-02T04:58:12.532 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.530+0000 7f1a5ffff700 1 --2- 172.21.15.76:0/439581626 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5577289dfbf0 0x5577289e0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:58:12.532 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.530+0000 7f1a67fff700 1 --2- 172.21.15.76:0/439581626 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5577289df290 0x5577289ddbf0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1a58005f50 tx=0x7f1a58005a00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=70ee7e2faf848450 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:58:12.532 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.531+0000 7f1a5effd700 1 -- 172.21.15.76:0/439581626 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a58004bb0 con 0x5577289df290 2024-06-02T04:58:12.540 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.540+0000 7f1a5effd700 1 -- 172.21.15.76:0/439581626 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1a5801e040 con 0x5577289df290 2024-06-02T04:58:12.541 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.540+0000 7f1a5effd700 1 -- 172.21.15.76:0/439581626 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a5800b950 con 0x5577289df290 2024-06-02T04:58:12.542 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.541+0000 7f1a7a68ab80 1 -- 172.21.15.76:0/439581626 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5577289df290 msgr2=0x5577289ddbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:58:12.542 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.541+0000 7f1a7a68ab80 1 --2- 172.21.15.76:0/439581626 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5577289df290 0x5577289ddbf0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1a58005f50 tx=0x7f1a58005a00 comp rx=0 tx=0).stop 2024-06-02T04:58:12.542 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.541+0000 7f1a7a68ab80 1 -- 172.21.15.76:0/439581626 shutdown_connections 2024-06-02T04:58:12.542 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.541+0000 7f1a7a68ab80 1 --2- 172.21.15.76:0/439581626 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5577289e0ae0 0x5577289d74e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:12.542 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.541+0000 7f1a7a68ab80 1 --2- 172.21.15.76:0/439581626 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5577289df290 0x5577289ddbf0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:12.542 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.541+0000 7f1a7a68ab80 1 --2- 172.21.15.76:0/439581626 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5577289dfbf0 0x5577289e0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:12.542 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.541+0000 7f1a7a68ab80 1 -- 172.21.15.76:0/439581626 >> 172.21.15.76:0/439581626 conn(0x5577289351b0 msgr2=0x5577289e70e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:58:12.542 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.541+0000 7f1a7a68ab80 1 -- 172.21.15.76:0/439581626 shutdown_connections 2024-06-02T04:58:12.542 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.541+0000 7f1a7a68ab80 1 -- 172.21.15.76:0/439581626 wait complete. 2024-06-02T04:58:12.542 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.541+0000 7f1a7a68ab80 1 -- start start 2024-06-02T04:58:12.544 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.542+0000 7f1a7a68ab80 1 Processor -- start 2024-06-02T04:58:12.544 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.542+0000 7f1a7a68ab80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5577289df290 0x557728a1d970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:58:12.544 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.542+0000 7f1a7a68ab80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5577289dfbf0 0x557728a1deb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:58:12.544 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.542+0000 7f1a7a68ab80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5577289e0ae0 0x557728a1e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:58:12.544 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.542+0000 7f1a7a68ab80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x557728a635f0 con 0x5577289df290 2024-06-02T04:58:12.544 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.542+0000 7f1a7a68ab80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x557728a63730 con 0x5577289dfbf0 2024-06-02T04:58:12.544 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.542+0000 7f1a7a68ab80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x557728a638c0 con 0x5577289e0ae0 2024-06-02T04:58:12.544 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.542+0000 7f1a7a68ab80 10 client.0 _ll_register_callbacks cb 0x5577288ccad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:58:12.544 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.542+0000 7f1a67fff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5577289df290 0x557728a1d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:58:12.545 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.542+0000 7f1a67fff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5577289df290 0x557728a1d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:59458/0 (socket says 172.21.15.76:59458) 2024-06-02T04:58:12.545 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.542+0000 7f1a67fff700 1 -- 172.21.15.76:0/3363543695 learned_addr learned my addr 172.21.15.76:0/3363543695 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:58:12.545 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.542+0000 7f1a6ca6c700 1 --2- 172.21.15.76:0/3363543695 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5577289e0ae0 0x557728a1e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:58:12.545 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.542+0000 7f1a5ffff700 1 --2- 172.21.15.76:0/3363543695 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5577289dfbf0 0x557728a1deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:58:12.545 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.543+0000 7f1a67fff700 1 -- 172.21.15.76:0/3363543695 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5577289e0ae0 msgr2=0x557728a1e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:58:12.545 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.543+0000 7f1a67fff700 1 --2- 172.21.15.76:0/3363543695 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5577289e0ae0 0x557728a1e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:12.545 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.543+0000 7f1a67fff700 1 -- 172.21.15.76:0/3363543695 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5577289dfbf0 msgr2=0x557728a1deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:58:12.545 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.543+0000 7f1a67fff700 1 --2- 172.21.15.76:0/3363543695 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5577289dfbf0 0x557728a1deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:12.545 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.543+0000 7f1a67fff700 1 -- 172.21.15.76:0/3363543695 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557728754b00 con 0x5577289df290 2024-06-02T04:58:12.545 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.543+0000 7f1a67fff700 1 --2- 172.21.15.76:0/3363543695 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5577289df290 0x557728a1d970 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f1a58005b40 tx=0x7f1a58005bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17af62df184b0b68 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:58:12.545 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.543+0000 7f1a477fe700 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-06-02T04:58:12.545 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.543+0000 7f1a477fe700 1 -- 172.21.15.76:0/3363543695 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a5803b070 con 0x5577289df290 2024-06-02T04:58:12.545 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.543+0000 7f1a477fe700 1 -- 172.21.15.76:0/3363543695 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f1a58000e40 con 0x5577289df290 2024-06-02T04:58:12.546 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.544+0000 7f1a7a68ab80 1 -- 172.21.15.76:0/3363543695 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1a5009dec0 con 0x5577289df290 2024-06-02T04:58:12.548 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.548+0000 7f1a477fe700 1 -- 172.21.15.76:0/3363543695 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1a58003b60 con 0x5577289df290 2024-06-02T04:58:12.548 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.548+0000 7f1a7a68ab80 10 client.16293 fetch_fsmap learned FSMap version 36 2024-06-02T04:58:12.548 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.548+0000 7f1a7a68ab80 1 -- 172.21.15.76:0/3363543695 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x5577287acc70 con 0x5577289df290 2024-06-02T04:58:12.549 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.548+0000 7f1a477fe700 1 -- 172.21.15.76:0/3363543695 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1a5009dec0 con 0x5577289df290 2024-06-02T04:58:12.549 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.548+0000 7f1a477fe700 1 -- 172.21.15.76:0/3363543695 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f1a5802a070 con 0x5577289df290 2024-06-02T04:58:12.549 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.548+0000 7f1a7a68ab80 10 client.16293 fetch_fsmap finished waiting for FSMap version 36 2024-06-02T04:58:12.549 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.548+0000 7f1a7a68ab80 10 client.16293 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T04:58:12.550 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.548+0000 7f1a7a68ab80 20 client.16293 populate_metadata read hostname 'smithi076' 2024-06-02T04:58:12.550 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.548+0000 7f1a7a68ab80 1 --2- 172.21.15.76:0/3363543695 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x557728a64ec0 0x557728a672e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:58:12.550 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.548+0000 7f1a7a68ab80 4 client.16293 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T04:58:12.550 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.548+0000 7f1a7a68ab80 1 -- 172.21.15.76:0/3363543695 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55772891fe60 con 0x557728a64ec0 2024-06-02T04:58:12.551 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.550+0000 7f1a5ffff700 1 --2- 172.21.15.76:0/3363543695 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x557728a64ec0 0x557728a672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:58:12.551 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.551+0000 7f1a5ffff700 1 --2- 172.21.15.76:0/3363543695 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x557728a64ec0 0x557728a672e0 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=def9aadcb69df017 server_cookie=91195208664e7056 in_seq=0 out_seq=0 2024-06-02T04:58:12.551 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.551+0000 7f1a477fe700 10 client.16293 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:58:12.578 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.577+0000 7f1a477fe700 1 -- 172.21.15.76:0/3363543695 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55772891fe60 con 0x557728a64ec0 2024-06-02T04:58:12.578 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.577+0000 7f1a477fe700 10 client.16293 handle_command_reply: tid=0 2024-06-02T04:58:12.578 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.577+0000 7f1a7a68ab80 1 client.16293 shutdown 2024-06-02T04:58:12.580 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.578+0000 7f1a7a68ab80 1 -- 172.21.15.76:0/3363543695 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5577289df290 msgr2=0x557728a1d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:58:12.580 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.578+0000 7f1a7a68ab80 1 --2- 172.21.15.76:0/3363543695 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5577289df290 0x557728a1d970 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f1a58005b40 tx=0x7f1a58005bc0 comp rx=0 tx=0).stop 2024-06-02T04:58:12.581 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.580+0000 7f1a7a68ab80 1 -- 172.21.15.76:0/3363543695 shutdown_connections 2024-06-02T04:58:12.581 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.580+0000 7f1a7a68ab80 1 --2- 172.21.15.76:0/3363543695 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x557728a64ec0 0x557728a672e0 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:12.581 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.580+0000 7f1a7a68ab80 1 --2- 172.21.15.76:0/3363543695 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5577289e0ae0 0x557728a1e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:12.581 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.580+0000 7f1a7a68ab80 1 --2- 172.21.15.76:0/3363543695 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5577289df290 0x557728a1d970 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:12.581 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.580+0000 7f1a7a68ab80 1 --2- 172.21.15.76:0/3363543695 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5577289dfbf0 0x557728a1deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:12.581 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.580+0000 7f1a7a68ab80 1 -- 172.21.15.76:0/3363543695 >> 172.21.15.76:0/3363543695 conn(0x5577289351b0 msgr2=0x5577289e6f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:58:12.581 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.580+0000 7f1a477fe700 0 client.16293 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:58:12.586 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.581+0000 7f1a7a68ab80 1 -- 172.21.15.76:0/3363543695 shutdown_connections 2024-06-02T04:58:12.586 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.586+0000 7f1a7a68ab80 1 -- 172.21.15.76:0/3363543695 wait complete. 2024-06-02T04:58:12.588 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.588+0000 7f1a7a68ab80 20 client.16293 trim_cache size 0 max 16384 2024-06-02T04:58:12.589 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:{ 2024-06-02T04:58:12.589 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "message": "", 2024-06-02T04:58:12.589 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "return_code": 0 2024-06-02T04:58:12.589 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:} 2024-06-02T04:58:12.595 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.594+0000 7f1a6e4cf700 1 -- 172.21.15.76:0/3601876652 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f1a540a1210 msgr2=0x7f1a540a36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:58:12.595 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.594+0000 7f1a6e4cf700 1 --2- 172.21.15.76:0/3601876652 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f1a540a1210 0x7f1a540a36d0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f1a60009ec0 tx=0x7f1a60009920 comp rx=0 tx=0).stop 2024-06-02T04:58:12.595 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.594+0000 7f1a6e4cf700 1 -- 172.21.15.76:0/3601876652 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1a68100f50 msgr2=0x7f1a68108b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:58:12.595 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.594+0000 7f1a6e4cf700 1 --2- 172.21.15.76:0/3601876652 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1a68100f50 0x7f1a68108b20 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1a5000e9a0 tx=0x7f1a5000ecb0 comp rx=0 tx=0).stop 2024-06-02T04:58:12.595 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.594+0000 7f1a6e4cf700 1 -- 172.21.15.76:0/3601876652 shutdown_connections 2024-06-02T04:58:12.595 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.594+0000 7f1a6e4cf700 1 --2- 172.21.15.76:0/3601876652 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f1a540a1210 0x7f1a540a36d0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:12.595 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.594+0000 7f1a6e4cf700 1 --2- 172.21.15.76:0/3601876652 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1a681018f0 0x7f1a68109060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:12.596 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.594+0000 7f1a6e4cf700 1 --2- 172.21.15.76:0/3601876652 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1a680ffd60 0x7f1a6810a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:12.596 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.594+0000 7f1a6e4cf700 1 --2- 172.21.15.76:0/3601876652 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1a68100f50 0x7f1a68108b20 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:12.596 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.594+0000 7f1a6e4cf700 1 -- 172.21.15.76:0/3601876652 >> 172.21.15.76:0/3601876652 conn(0x7f1a680fb2f0 msgr2=0x7f1a68104410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:58:12.596 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.594+0000 7f1a6e4cf700 1 -- 172.21.15.76:0/3601876652 shutdown_connections 2024-06-02T04:58:12.596 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:12.594+0000 7f1a6e4cf700 1 -- 172.21.15.76:0/3601876652 wait complete. 2024-06-02T04:58:13.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:58:13 smithi119 ceph-mon[46633]: pgmap v527: 129 pgs: 129 active+clean; 1.5 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 12 MiB/s wr, 859 op/s 2024-06-02T04:58:13.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:58:13 smithi192 ceph-mon[47933]: pgmap v527: 129 pgs: 129 active+clean; 1.5 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 12 MiB/s wr, 859 op/s 2024-06-02T04:58:13.986 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:58:13 smithi076 ceph-mon[42935]: pgmap v527: 129 pgs: 129 active+clean; 1.5 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 12 MiB/s wr, 859 op/s 2024-06-02T04:58:14.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:58:14 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:58:14.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:58:14 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:58:14.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:58:14 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:58:14.847 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:58:14 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:58:14.847 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:58:14 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:58:14.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:58:14 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:58:14.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:58:14 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:58:14.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:58:14 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:58:14.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:58:14 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:58:14.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:58:14 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:58:14.987 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:58:14 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:58:14.987 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:58:14 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:58:14.987 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:58:14 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:58:14.987 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:58:14 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:58:14.987 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:58:14 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:58:15.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:58:15 smithi119 ceph-mon[46633]: pgmap v528: 129 pgs: 129 active+clean; 1.5 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 11 MiB/s wr, 791 op/s 2024-06-02T04:58:15.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:58:15 smithi119 ceph-mon[46633]: Adjusting osd_memory_target on smithi192 to 182.4M 2024-06-02T04:58:15.847 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:58:15 smithi119 ceph-mon[46633]: Unable to set osd_memory_target on smithi192 to 191356928: error parsing value: Value '191356928' is below minimum 939524096 2024-06-02T04:58:15.847 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:58:15 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:58:15.847 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:58:15 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:58:15.847 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:58:15 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:58:15.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:58:15 smithi192 ceph-mon[47933]: pgmap v528: 129 pgs: 129 active+clean; 1.5 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 11 MiB/s wr, 791 op/s 2024-06-02T04:58:15.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:58:15 smithi192 ceph-mon[47933]: Adjusting osd_memory_target on smithi192 to 182.4M 2024-06-02T04:58:15.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:58:15 smithi192 ceph-mon[47933]: Unable to set osd_memory_target on smithi192 to 191356928: error parsing value: Value '191356928' is below minimum 939524096 2024-06-02T04:58:15.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:58:15 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:58:15.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:58:15 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:58:15.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:58:15 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:58:15.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:58:15 smithi076 ceph-mon[42935]: pgmap v528: 129 pgs: 129 active+clean; 1.5 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 11 MiB/s wr, 791 op/s 2024-06-02T04:58:15.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:58:15 smithi076 ceph-mon[42935]: Adjusting osd_memory_target on smithi192 to 182.4M 2024-06-02T04:58:15.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:58:15 smithi076 ceph-mon[42935]: Unable to set osd_memory_target on smithi192 to 191356928: error parsing value: Value '191356928' is below minimum 939524096 2024-06-02T04:58:15.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:58:15 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:58:15.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:58:15 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:58:15.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:58:15 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:58:16.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 445.0 s, 648.6 tps, lat 154.119 ms stddev 57.259 2024-06-02T04:58:17.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:58:17 smithi119 ceph-mon[46633]: pgmap v529: 129 pgs: 129 active+clean; 1.5 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 10 MiB/s wr, 836 op/s 2024-06-02T04:58:17.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:58:17 smithi192 ceph-mon[47933]: pgmap v529: 129 pgs: 129 active+clean; 1.5 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 10 MiB/s wr, 836 op/s 2024-06-02T04:58:17.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:58:17 smithi076 ceph-mon[42935]: pgmap v529: 129 pgs: 129 active+clean; 1.5 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 10 MiB/s wr, 836 op/s 2024-06-02T04:58:19.847 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:58:19 smithi119 ceph-mon[46633]: pgmap v530: 129 pgs: 129 active+clean; 1.5 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 11 MiB/s wr, 838 op/s 2024-06-02T04:58:19.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:58:19 smithi192 ceph-mon[47933]: pgmap v530: 129 pgs: 129 active+clean; 1.5 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 11 MiB/s wr, 838 op/s 2024-06-02T04:58:19.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:58:19 smithi076 ceph-mon[42935]: pgmap v530: 129 pgs: 129 active+clean; 1.5 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 11 MiB/s wr, 838 op/s 2024-06-02T04:58:20.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:58:20 smithi192 ceph-mon[47933]: pgmap v531: 129 pgs: 129 active+clean; 1.5 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 10 MiB/s wr, 860 op/s 2024-06-02T04:58:20.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:58:20 smithi076 ceph-mon[42935]: pgmap v531: 129 pgs: 129 active+clean; 1.5 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 10 MiB/s wr, 860 op/s 2024-06-02T04:58:21.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:58:20 smithi119 ceph-mon[46633]: pgmap v531: 129 pgs: 129 active+clean; 1.5 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 10 MiB/s wr, 860 op/s 2024-06-02T04:58:21.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 450.0 s, 705.0 tps, lat 142.080 ms stddev 64.180 2024-06-02T04:58:23.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:58:23 smithi119 ceph-mon[46633]: pgmap v532: 129 pgs: 129 active+clean; 1.5 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 10 MiB/s wr, 828 op/s 2024-06-02T04:58:23.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:58:23 smithi192 ceph-mon[47933]: pgmap v532: 129 pgs: 129 active+clean; 1.5 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 10 MiB/s wr, 828 op/s 2024-06-02T04:58:23.985 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:58:23 smithi076 ceph-mon[42935]: pgmap v532: 129 pgs: 129 active+clean; 1.5 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 10 MiB/s wr, 828 op/s 2024-06-02T04:58:25.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:58:25 smithi119 ceph-mon[46633]: pgmap v533: 129 pgs: 129 active+clean; 1.5 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 9.0 MiB/s wr, 762 op/s 2024-06-02T04:58:25.915 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.912+0000 7fd34a818700 1 -- 172.21.15.76:0/867609602 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd344107540 msgr2=0x7fd344107960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:58:25.915 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.912+0000 7fd34a818700 1 --2- 172.21.15.76:0/867609602 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd344107540 0x7fd344107960 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd338009990 tx=0x7fd338009ca0 comp rx=0 tx=0).stop 2024-06-02T04:58:25.915 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.914+0000 7fd34a818700 1 -- 172.21.15.76:0/867609602 shutdown_connections 2024-06-02T04:58:25.916 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.914+0000 7fd34a818700 1 --2- 172.21.15.76:0/867609602 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd3441090d0 0x7fd34410f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:25.916 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.914+0000 7fd34a818700 1 --2- 172.21.15.76:0/867609602 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd344107540 0x7fd344107960 secure :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd338009990 tx=0x7fd338009ca0 comp rx=0 tx=0).stop 2024-06-02T04:58:25.916 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.914+0000 7fd34a818700 1 --2- 172.21.15.76:0/867609602 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd344108730 0x7fd344108b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:25.916 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.914+0000 7fd34a818700 1 -- 172.21.15.76:0/867609602 >> 172.21.15.76:0/867609602 conn(0x7fd3440764d0 msgr2=0x7fd344078910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:58:25.916 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.915+0000 7fd34a818700 1 -- 172.21.15.76:0/867609602 shutdown_connections 2024-06-02T04:58:25.917 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.915+0000 7fd34a818700 1 -- 172.21.15.76:0/867609602 wait complete. 2024-06-02T04:58:25.917 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.916+0000 7fd34a818700 1 Processor -- start 2024-06-02T04:58:25.917 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.916+0000 7fd34a818700 1 -- start start 2024-06-02T04:58:25.917 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.916+0000 7fd34a818700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd344108730 0x7fd34406fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:58:25.917 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.916+0000 7fd34a818700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd3441090d0 0x7fd344070140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:58:25.917 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.916+0000 7fd34a818700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd3441ab4e0 0x7fd3441ad8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:58:25.917 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.916+0000 7fd34a818700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3441ade10 con 0x7fd344108730 2024-06-02T04:58:25.917 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.916+0000 7fd34a818700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3441adf50 con 0x7fd3441090d0 2024-06-02T04:58:25.917 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.916+0000 7fd34a818700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3441ae090 con 0x7fd3441ab4e0 2024-06-02T04:58:25.918 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.917+0000 7fd343fff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd344108730 0x7fd34406fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:58:25.919 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.917+0000 7fd348db5700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd3441ab4e0 0x7fd3441ad8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:58:25.919 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.917+0000 7fd343fff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd344108730 0x7fd34406fc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:54498/0 (socket says 172.21.15.76:54498) 2024-06-02T04:58:25.919 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.917+0000 7fd343fff700 1 -- 172.21.15.76:0/2368909030 learned_addr learned my addr 172.21.15.76:0/2368909030 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:58:25.919 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.917+0000 7fd343fff700 1 -- 172.21.15.76:0/2368909030 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd3441ab4e0 msgr2=0x7fd3441ad8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:58:25.919 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.917+0000 7fd343fff700 1 --2- 172.21.15.76:0/2368909030 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd3441ab4e0 0x7fd3441ad8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:25.919 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.917+0000 7fd343fff700 1 -- 172.21.15.76:0/2368909030 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd3441090d0 msgr2=0x7fd344070140 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-02T04:58:25.919 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.917+0000 7fd343fff700 1 --2- 172.21.15.76:0/2368909030 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd3441090d0 0x7fd344070140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:25.919 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.917+0000 7fd343fff700 1 -- 172.21.15.76:0/2368909030 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd334009520 con 0x7fd344108730 2024-06-02T04:58:25.919 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.917+0000 7fd343fff700 1 --2- 172.21.15.76:0/2368909030 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd344108730 0x7fd34406fc00 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fd3380098e0 tx=0x7fd33800b9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:58:25.920 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.918+0000 7fd3417fa700 1 -- 172.21.15.76:0/2368909030 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd33801d070 con 0x7fd344108730 2024-06-02T04:58:25.920 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.918+0000 7fd3417fa700 1 -- 172.21.15.76:0/2368909030 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd338003d20 con 0x7fd344108730 2024-06-02T04:58:25.920 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.918+0000 7fd3417fa700 1 -- 172.21.15.76:0/2368909030 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd33800fd80 con 0x7fd344108730 2024-06-02T04:58:25.920 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.918+0000 7fd34a818700 1 -- 172.21.15.76:0/2368909030 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3380095f0 con 0x7fd344108730 2024-06-02T04:58:25.920 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.918+0000 7fd34a818700 1 -- 172.21.15.76:0/2368909030 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3441ae550 con 0x7fd344108730 2024-06-02T04:58:25.926 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.925+0000 7fd3569d3b80 1 Processor -- start 2024-06-02T04:58:25.926 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.926+0000 7fd3569d3b80 1 -- start start 2024-06-02T04:58:25.927 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.926+0000 7fd3569d3b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557fa6ffda80 0x557fa6ffdea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:58:25.927 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.926+0000 7fd3569d3b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557fa6ffe3e0 0x557fa6ffecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:58:25.927 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.926+0000 7fd3569d3b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557fa6fff2d0 0x557fa6fff750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:58:25.927 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.926+0000 7fd3569d3b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x557fa6f550f0 con 0x557fa6fff2d0 2024-06-02T04:58:25.927 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.926+0000 7fd3569d3b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x557fa6f52ab0 con 0x557fa6ffe3e0 2024-06-02T04:58:25.927 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.926+0000 7fd3569d3b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x557fa6f4e3a0 con 0x557fa6ffda80 2024-06-02T04:58:25.927 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.926+0000 7fd348db5700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557fa6ffda80 0x557fa6ffdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:58:25.927 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.926+0000 7fd3437fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557fa6fff2d0 0x557fa6fff750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:58:25.928 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.926+0000 7fd3437fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557fa6fff2d0 0x557fa6fff750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:54508/0 (socket says 172.21.15.76:54508) 2024-06-02T04:58:25.928 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.926+0000 7fd3437fe700 1 -- 172.21.15.76:0/3832427004 learned_addr learned my addr 172.21.15.76:0/3832427004 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:58:25.929 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.927+0000 7fd3437fe700 1 -- 172.21.15.76:0/3832427004 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557fa6ffda80 msgr2=0x557fa6ffdea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:58:25.929 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.927+0000 7fd3437fe700 1 --2- 172.21.15.76:0/3832427004 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557fa6ffda80 0x557fa6ffdea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:25.929 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.927+0000 7fd3437fe700 1 -- 172.21.15.76:0/3832427004 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557fa6ffe3e0 msgr2=0x557fa6ffecf0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-02T04:58:25.929 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.927+0000 7fd3437fe700 1 --2- 172.21.15.76:0/3832427004 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557fa6ffe3e0 0x557fa6ffecf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:25.929 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.927+0000 7fd3437fe700 1 -- 172.21.15.76:0/3832427004 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557fa6dcf350 con 0x557fa6fff2d0 2024-06-02T04:58:25.929 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.927+0000 7fd3437fe700 1 --2- 172.21.15.76:0/3832427004 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557fa6fff2d0 0x557fa6fff750 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fd334009d30 tx=0x7fd33400e630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=322eebcf843c0f41 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:58:25.929 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.928+0000 7fd32a7fc700 1 -- 172.21.15.76:0/3832427004 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd33400ee40 con 0x557fa6fff2d0 2024-06-02T04:58:25.929 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.928+0000 7fd32a7fc700 1 -- 172.21.15.76:0/3832427004 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd334009e80 con 0x557fa6fff2d0 2024-06-02T04:58:25.929 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.928+0000 7fd32a7fc700 1 -- 172.21.15.76:0/3832427004 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd334010430 con 0x557fa6fff2d0 2024-06-02T04:58:25.930 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.929+0000 7fd3417fa700 1 -- 172.21.15.76:0/2368909030 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fd33800f460 con 0x7fd344108730 2024-06-02T04:58:25.930 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.929+0000 7fd3569d3b80 1 -- 172.21.15.76:0/3832427004 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557fa6fff2d0 msgr2=0x557fa6fff750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:58:25.930 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.929+0000 7fd3569d3b80 1 --2- 172.21.15.76:0/3832427004 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557fa6fff2d0 0x557fa6fff750 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fd334009d30 tx=0x7fd33400e630 comp rx=0 tx=0).stop 2024-06-02T04:58:25.931 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.929+0000 7fd3417fa700 1 --2- 172.21.15.76:0/2368909030 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fd32c0a12f0 0x7fd32c0a37b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:58:25.931 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.930+0000 7fd3417fa700 1 -- 172.21.15.76:0/2368909030 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7fd3380cdad0 con 0x7fd344108730 2024-06-02T04:58:25.931 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.930+0000 7fd3569d3b80 1 -- 172.21.15.76:0/3832427004 shutdown_connections 2024-06-02T04:58:25.931 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.930+0000 7fd3569d3b80 1 --2- 172.21.15.76:0/3832427004 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557fa6fff2d0 0x557fa6fff750 secure :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fd334009d30 tx=0x7fd33400e630 comp rx=0 tx=0).stop 2024-06-02T04:58:25.931 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.930+0000 7fd3569d3b80 1 --2- 172.21.15.76:0/3832427004 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557fa6ffda80 0x557fa6ffdea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:25.931 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.930+0000 7fd3569d3b80 1 --2- 172.21.15.76:0/3832427004 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557fa6ffe3e0 0x557fa6ffecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:25.931 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.930+0000 7fd3569d3b80 1 -- 172.21.15.76:0/3832427004 >> 172.21.15.76:0/3832427004 conn(0x557fa6f5c1b0 msgr2=0x557fa6ffa440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:58:25.932 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.930+0000 7fd348db5700 1 --2- 172.21.15.76:0/2368909030 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fd32c0a12f0 0x7fd32c0a37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:58:25.932 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.931+0000 7fd348db5700 1 --2- 172.21.15.76:0/2368909030 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fd32c0a12f0 0x7fd32c0a37b0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fd33c009520 tx=0x7fd33c00b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:58:25.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:58:25 smithi192 ceph-mon[47933]: pgmap v533: 129 pgs: 129 active+clean; 1.5 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 9.0 MiB/s wr, 762 op/s 2024-06-02T04:58:25.934 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.934+0000 7fd3569d3b80 1 -- 172.21.15.76:0/3832427004 shutdown_connections 2024-06-02T04:58:25.934 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.934+0000 7fd3569d3b80 1 -- 172.21.15.76:0/3832427004 wait complete. 2024-06-02T04:58:25.935 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.934+0000 7fd3569d3b80 1 -- start start 2024-06-02T04:58:25.935 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.935+0000 7fd3569d3b80 1 Processor -- start 2024-06-02T04:58:25.936 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.935+0000 7fd3569d3b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557fa6ffda80 0x557fa7018c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:58:25.937 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.935+0000 7fd3569d3b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557fa6ffe3e0 0x557fa7019140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:58:25.937 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.935+0000 7fd3569d3b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557fa701e120 0x557fa7020510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:58:25.937 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.935+0000 7fd3569d3b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x557fa6eea500 con 0x557fa701e120 2024-06-02T04:58:25.937 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.935+0000 7fd3569d3b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x557fa6eea1a0 con 0x557fa6ffe3e0 2024-06-02T04:58:25.937 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.935+0000 7fd3569d3b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x557fa6dd1640 con 0x557fa6ffda80 2024-06-02T04:58:25.937 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.935+0000 7fd3569d3b80 10 client.0 _ll_register_callbacks cb 0x557fa6ef3ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:58:25.937 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.935+0000 7fd3437fe700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557fa6ffe3e0 0x557fa7019140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:58:25.937 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.935+0000 7fd3437fe700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557fa6ffe3e0 0x557fa7019140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:38964/0 (socket says 172.21.15.76:38964) 2024-06-02T04:58:25.937 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.935+0000 7fd3437fe700 1 -- 172.21.15.76:0/3940004035 learned_addr learned my addr 172.21.15.76:0/3940004035 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:58:25.937 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.936+0000 7fd343fff700 1 --2- 172.21.15.76:0/3940004035 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557fa6ffda80 0x557fa7018c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:58:25.938 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.936+0000 7fd348db5700 1 --2- 172.21.15.76:0/3940004035 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557fa701e120 0x557fa7020510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:58:25.938 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.936+0000 7fd3437fe700 1 -- 172.21.15.76:0/3940004035 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557fa6ffda80 msgr2=0x557fa7018c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:58:25.938 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.936+0000 7fd3437fe700 1 --2- 172.21.15.76:0/3940004035 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557fa6ffda80 0x557fa7018c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:25.938 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.936+0000 7fd3437fe700 1 -- 172.21.15.76:0/3940004035 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557fa701e120 msgr2=0x557fa7020510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:58:25.938 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.936+0000 7fd3437fe700 1 --2- 172.21.15.76:0/3940004035 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557fa701e120 0x557fa7020510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:25.938 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.936+0000 7fd3437fe700 1 -- 172.21.15.76:0/3940004035 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3340099e0 con 0x557fa6ffe3e0 2024-06-02T04:58:25.938 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.936+0000 7fd3437fe700 1 --2- 172.21.15.76:0/3940004035 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557fa6ffe3e0 0x557fa7019140 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x557fa6ffeab0 tx=0x7fd33400eee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8957bb6e984811dd server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:58:25.938 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.936+0000 7fd3237fe700 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-06-02T04:58:25.940 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.938+0000 7fd3237fe700 1 -- 172.21.15.76:0/3940004035 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd334005230 con 0x557fa6ffe3e0 2024-06-02T04:58:25.940 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.938+0000 7fd3237fe700 1 -- 172.21.15.76:0/3940004035 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7fd334014070 con 0x557fa6ffe3e0 2024-06-02T04:58:25.941 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.938+0000 7fd3569d3b80 1 -- 172.21.15.76:0/3940004035 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557fa6fcd7b0 con 0x557fa6ffe3e0 2024-06-02T04:58:25.941 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.938+0000 7fd3237fe700 1 -- 172.21.15.76:0/3940004035 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd334005390 con 0x557fa6ffe3e0 2024-06-02T04:58:25.941 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.938+0000 7fd3569d3b80 10 client.25910 fetch_fsmap learned FSMap version 36 2024-06-02T04:58:25.941 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.938+0000 7fd3569d3b80 1 -- 172.21.15.76:0/3940004035 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x557fa6d7bb00 con 0x557fa6ffe3e0 2024-06-02T04:58:25.941 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.939+0000 7fd3237fe700 1 -- 172.21.15.76:0/3940004035 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x557fa6fcd7b0 con 0x557fa6ffe3e0 2024-06-02T04:58:25.941 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.939+0000 7fd3237fe700 1 -- 172.21.15.76:0/3940004035 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fd334003e00 con 0x557fa6ffe3e0 2024-06-02T04:58:25.941 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.939+0000 7fd3569d3b80 10 client.25910 fetch_fsmap finished waiting for FSMap version 36 2024-06-02T04:58:25.941 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.939+0000 7fd3569d3b80 10 client.25910 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T04:58:25.942 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.939+0000 7fd3569d3b80 20 client.25910 populate_metadata read hostname 'smithi076' 2024-06-02T04:58:25.942 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.939+0000 7fd3569d3b80 1 --2- 172.21.15.76:0/3940004035 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x557fa7024c40 0x557fa7027060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:58:25.942 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.939+0000 7fd3569d3b80 4 client.25910 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T04:58:25.942 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.939+0000 7fd3569d3b80 1 -- 172.21.15.76:0/3940004035 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557fa6f46e60 con 0x557fa7024c40 2024-06-02T04:58:25.942 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.939+0000 7fd343fff700 1 --2- 172.21.15.76:0/3940004035 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x557fa7024c40 0x557fa7027060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:58:25.942 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.940+0000 7fd343fff700 1 --2- 172.21.15.76:0/3940004035 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x557fa7024c40 0x557fa7027060 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=33acfa2bf4058d06 server_cookie=21ef5ee1ccbf77ca in_seq=0 out_seq=0 2024-06-02T04:58:25.942 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.940+0000 7fd3237fe700 10 client.25910 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:58:25.944 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.941+0000 7fd3237fe700 1 -- 172.21.15.76:0/3940004035 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x557fa6f46e60 con 0x557fa7024c40 2024-06-02T04:58:25.944 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.941+0000 7fd3237fe700 10 client.25910 handle_command_reply: tid=0 2024-06-02T04:58:25.944 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.941+0000 7fd3569d3b80 1 client.25910 shutdown 2024-06-02T04:58:25.944 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.941+0000 7fd3569d3b80 1 -- 172.21.15.76:0/3940004035 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557fa6ffe3e0 msgr2=0x557fa7019140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:58:25.944 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.941+0000 7fd3569d3b80 1 --2- 172.21.15.76:0/3940004035 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557fa6ffe3e0 0x557fa7019140 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x557fa6ffeab0 tx=0x7fd33400eee0 comp rx=0 tx=0).stop 2024-06-02T04:58:25.944 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.942+0000 7fd3569d3b80 1 -- 172.21.15.76:0/3940004035 shutdown_connections 2024-06-02T04:58:25.945 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.942+0000 7fd3569d3b80 1 --2- 172.21.15.76:0/3940004035 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x557fa7024c40 0x557fa7027060 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:25.945 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.942+0000 7fd3569d3b80 1 --2- 172.21.15.76:0/3940004035 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557fa701e120 0x557fa7020510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:25.945 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.942+0000 7fd3569d3b80 1 --2- 172.21.15.76:0/3940004035 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557fa6ffda80 0x557fa7018c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:25.945 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.942+0000 7fd3569d3b80 1 --2- 172.21.15.76:0/3940004035 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557fa6ffe3e0 0x557fa7019140 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:25.945 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.942+0000 7fd3569d3b80 1 -- 172.21.15.76:0/3940004035 >> 172.21.15.76:0/3940004035 conn(0x557fa6f5c1b0 msgr2=0x557fa6ff8190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:58:25.945 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.942+0000 7fd3237fe700 0 client.25910 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:58:25.945 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.942+0000 7fd3569d3b80 1 -- 172.21.15.76:0/3940004035 shutdown_connections 2024-06-02T04:58:25.946 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.942+0000 7fd3569d3b80 1 -- 172.21.15.76:0/3940004035 wait complete. 2024-06-02T04:58:25.946 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.943+0000 7fd3569d3b80 20 client.25910 trim_cache size 0 max 16384 2024-06-02T04:58:25.966 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.965+0000 7fd3569d3b80 1 Processor -- start 2024-06-02T04:58:25.966 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.965+0000 7fd3569d3b80 1 -- start start 2024-06-02T04:58:25.966 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.965+0000 7fd3569d3b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557fa6ffda80 0x557fa7027030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:58:25.966 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.965+0000 7fd3569d3b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557fa6ffe3e0 0x557fa6fff6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:58:25.966 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.965+0000 7fd3569d3b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557fa701e120 0x557fa7020510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:58:25.966 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.965+0000 7fd3569d3b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x557fa7002dc0 con 0x557fa6ffe3e0 2024-06-02T04:58:25.966 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.965+0000 7fd3569d3b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x557fa6ffe7c0 con 0x557fa701e120 2024-06-02T04:58:25.966 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.965+0000 7fd3569d3b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x557fa70216a0 con 0x557fa6ffda80 2024-06-02T04:58:25.966 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.965+0000 7fd348db5700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557fa701e120 0x557fa7020510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:58:25.967 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.965+0000 7fd348db5700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557fa701e120 0x557fa7020510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:38966/0 (socket says 172.21.15.76:38966) 2024-06-02T04:58:25.967 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.965+0000 7fd348db5700 1 -- 172.21.15.76:0/2252903634 learned_addr learned my addr 172.21.15.76:0/2252903634 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:58:25.968 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.965+0000 7fd343fff700 1 --2- 172.21.15.76:0/2252903634 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557fa6ffda80 0x557fa7027030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:58:25.968 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.966+0000 7fd343fff700 1 -- 172.21.15.76:0/2252903634 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557fa701e120 msgr2=0x557fa7020510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:58:25.968 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.966+0000 7fd343fff700 1 --2- 172.21.15.76:0/2252903634 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557fa701e120 0x557fa7020510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:25.968 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.966+0000 7fd343fff700 1 -- 172.21.15.76:0/2252903634 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557fa6ffe3e0 msgr2=0x557fa6fff6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:58:25.968 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.966+0000 7fd343fff700 1 --2- 172.21.15.76:0/2252903634 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557fa6ffe3e0 0x557fa6fff6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:25.968 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.966+0000 7fd343fff700 1 -- 172.21.15.76:0/2252903634 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557fa6f14500 con 0x557fa6ffda80 2024-06-02T04:58:25.968 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.966+0000 7fd343fff700 1 --2- 172.21.15.76:0/2252903634 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557fa6ffda80 0x557fa7027030 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd3380cb200 tx=0x7fd338009310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=408c604e7ddd4b00 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:58:25.968 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.966+0000 7fd32affd700 1 -- 172.21.15.76:0/2252903634 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd33809b310 con 0x557fa6ffda80 2024-06-02T04:58:25.969 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.967+0000 7fd32affd700 1 -- 172.21.15.76:0/2252903634 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd33809ac10 con 0x557fa6ffda80 2024-06-02T04:58:25.969 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.967+0000 7fd32affd700 1 -- 172.21.15.76:0/2252903634 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd33809a100 con 0x557fa6ffda80 2024-06-02T04:58:25.969 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.967+0000 7fd3569d3b80 1 -- 172.21.15.76:0/2252903634 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557fa6ffda80 msgr2=0x557fa7027030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:58:25.969 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.967+0000 7fd3569d3b80 1 --2- 172.21.15.76:0/2252903634 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557fa6ffda80 0x557fa7027030 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd3380cb200 tx=0x7fd338009310 comp rx=0 tx=0).stop 2024-06-02T04:58:25.970 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.970+0000 7fd3569d3b80 1 -- 172.21.15.76:0/2252903634 shutdown_connections 2024-06-02T04:58:25.971 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.970+0000 7fd3569d3b80 1 --2- 172.21.15.76:0/2252903634 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557fa701e120 0x557fa7020510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:25.971 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.970+0000 7fd3569d3b80 1 --2- 172.21.15.76:0/2252903634 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557fa6ffda80 0x557fa7027030 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:25.971 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.970+0000 7fd3569d3b80 1 --2- 172.21.15.76:0/2252903634 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557fa6ffe3e0 0x557fa6fff6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:25.971 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.970+0000 7fd3569d3b80 1 -- 172.21.15.76:0/2252903634 >> 172.21.15.76:0/2252903634 conn(0x557fa6f5c1b0 msgr2=0x557fa70175b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:58:25.971 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.970+0000 7fd3569d3b80 1 -- 172.21.15.76:0/2252903634 shutdown_connections 2024-06-02T04:58:25.971 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.970+0000 7fd3569d3b80 1 -- 172.21.15.76:0/2252903634 wait complete. 2024-06-02T04:58:25.972 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.970+0000 7fd3569d3b80 1 -- start start 2024-06-02T04:58:25.972 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.971+0000 7fd3569d3b80 1 Processor -- start 2024-06-02T04:58:25.972 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.971+0000 7fd3569d3b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557fa6ffda80 0x557fa7035320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:58:25.972 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.971+0000 7fd3569d3b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557fa6ffe3e0 0x557fa7033f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:58:25.972 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.971+0000 7fd3569d3b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557fa701e120 0x557fa7034460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:58:25.972 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.971+0000 7fd3569d3b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x557fa7034b70 con 0x557fa6ffda80 2024-06-02T04:58:25.972 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.971+0000 7fd3569d3b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x557fa7034ce0 con 0x557fa701e120 2024-06-02T04:58:25.973 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.971+0000 7fd3569d3b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x557fa7079b80 con 0x557fa6ffe3e0 2024-06-02T04:58:25.973 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.971+0000 7fd3569d3b80 10 client.0 _ll_register_callbacks cb 0x557fa6ef3ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:58:25.973 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.972+0000 7fd348db5700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557fa701e120 0x557fa7034460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:58:25.973 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.972+0000 7fd348db5700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557fa701e120 0x557fa7034460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:38968/0 (socket says 172.21.15.76:38968) 2024-06-02T04:58:25.973 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.972+0000 7fd348db5700 1 -- 172.21.15.76:0/2096191538 learned_addr learned my addr 172.21.15.76:0/2096191538 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:58:25.973 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.972+0000 7fd3437fe700 1 --2- 172.21.15.76:0/2096191538 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557fa6ffe3e0 0x557fa7033f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:58:25.973 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.972+0000 7fd343fff700 1 --2- 172.21.15.76:0/2096191538 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557fa6ffda80 0x557fa7035320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:58:25.974 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.972+0000 7fd348db5700 1 -- 172.21.15.76:0/2096191538 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557fa6ffe3e0 msgr2=0x557fa7033f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:58:25.974 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.972+0000 7fd348db5700 1 --2- 172.21.15.76:0/2096191538 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557fa6ffe3e0 0x557fa7033f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:25.974 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.972+0000 7fd348db5700 1 -- 172.21.15.76:0/2096191538 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557fa6ffda80 msgr2=0x557fa7035320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:58:25.974 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.972+0000 7fd348db5700 1 --2- 172.21.15.76:0/2096191538 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557fa6ffda80 0x557fa7035320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:25.974 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.972+0000 7fd348db5700 1 -- 172.21.15.76:0/2096191538 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3441ae550 con 0x557fa701e120 2024-06-02T04:58:25.974 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.972+0000 7fd348db5700 1 --2- 172.21.15.76:0/2096191538 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557fa701e120 0x557fa7034460 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd33c016e00 tx=0x7fd33c004b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fc8ddc1818a5fdc7 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:58:25.975 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.973+0000 7fd3237fe700 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-06-02T04:58:25.975 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.973+0000 7fd3237fe700 1 -- 172.21.15.76:0/2096191538 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd33c00e040 con 0x557fa701e120 2024-06-02T04:58:25.975 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.973+0000 7fd3237fe700 1 -- 172.21.15.76:0/2096191538 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7fd33c02b070 con 0x557fa701e120 2024-06-02T04:58:25.975 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.973+0000 7fd3569d3b80 1 -- 172.21.15.76:0/2096191538 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557fa6ea7210 con 0x557fa701e120 2024-06-02T04:58:25.975 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.974+0000 7fd3237fe700 1 -- 172.21.15.76:0/2096191538 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd33c007ea0 con 0x557fa701e120 2024-06-02T04:58:25.975 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.974+0000 7fd3569d3b80 10 client.25916 fetch_fsmap learned FSMap version 36 2024-06-02T04:58:25.975 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.974+0000 7fd3569d3b80 1 -- 172.21.15.76:0/2096191538 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x557fa6dd3c70 con 0x557fa701e120 2024-06-02T04:58:25.976 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.975+0000 7fd3237fe700 1 -- 172.21.15.76:0/2096191538 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x557fa6ea7210 con 0x557fa701e120 2024-06-02T04:58:25.976 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.975+0000 7fd3237fe700 1 -- 172.21.15.76:0/2096191538 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fd33c025400 con 0x557fa701e120 2024-06-02T04:58:25.976 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.975+0000 7fd3569d3b80 10 client.25916 fetch_fsmap finished waiting for FSMap version 36 2024-06-02T04:58:25.976 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.975+0000 7fd3569d3b80 10 client.25916 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T04:58:25.976 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.975+0000 7fd3569d3b80 20 client.25916 populate_metadata read hostname 'smithi076' 2024-06-02T04:58:25.976 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.975+0000 7fd3569d3b80 1 --2- 172.21.15.76:0/2096191538 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x557fa707b5b0 0x557fa707d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:58:25.976 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.975+0000 7fd3569d3b80 4 client.25916 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T04:58:25.977 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.975+0000 7fd3569d3b80 1 -- 172.21.15.76:0/2096191538 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x557fa6d9cc90 con 0x557fa707b5b0 2024-06-02T04:58:25.977 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.975+0000 7fd343fff700 1 --2- 172.21.15.76:0/2096191538 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x557fa707b5b0 0x557fa707d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:58:25.977 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.976+0000 7fd343fff700 1 --2- 172.21.15.76:0/2096191538 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x557fa707b5b0 0x557fa707d9d0 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=82052250b60d6dae server_cookie=f535552dac04f6f5 in_seq=0 out_seq=0 2024-06-02T04:58:25.977 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:25.976+0000 7fd3237fe700 10 client.25916 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:58:25.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:58:25 smithi076 ceph-mon[42935]: pgmap v533: 129 pgs: 129 active+clean; 1.5 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 9.0 MiB/s wr, 762 op/s 2024-06-02T04:58:26.013 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:26.012+0000 7fd3237fe700 1 -- 172.21.15.76:0/2096191538 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x557fa6d9cc90 con 0x557fa707b5b0 2024-06-02T04:58:26.014 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:26.012+0000 7fd3237fe700 10 client.25916 handle_command_reply: tid=0 2024-06-02T04:58:26.014 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:26.012+0000 7fd3569d3b80 1 client.25916 shutdown 2024-06-02T04:58:26.014 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:26.012+0000 7fd3569d3b80 1 -- 172.21.15.76:0/2096191538 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557fa701e120 msgr2=0x557fa7034460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:58:26.014 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:26.012+0000 7fd3569d3b80 1 --2- 172.21.15.76:0/2096191538 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557fa701e120 0x557fa7034460 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd33c016e00 tx=0x7fd33c004b40 comp rx=0 tx=0).stop 2024-06-02T04:58:26.014 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:26.012+0000 7fd3569d3b80 1 -- 172.21.15.76:0/2096191538 shutdown_connections 2024-06-02T04:58:26.014 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:26.012+0000 7fd3569d3b80 1 --2- 172.21.15.76:0/2096191538 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x557fa707b5b0 0x557fa707d9d0 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:26.014 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:26.012+0000 7fd3569d3b80 1 --2- 172.21.15.76:0/2096191538 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557fa701e120 0x557fa7034460 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:26.014 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:26.012+0000 7fd3569d3b80 1 --2- 172.21.15.76:0/2096191538 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557fa6ffda80 0x557fa7035320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:26.014 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:26.012+0000 7fd3569d3b80 1 --2- 172.21.15.76:0/2096191538 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557fa6ffe3e0 0x557fa7033f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:26.014 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:26.012+0000 7fd3569d3b80 1 -- 172.21.15.76:0/2096191538 >> 172.21.15.76:0/2096191538 conn(0x557fa6f5c1b0 msgr2=0x557fa7018010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:58:26.015 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:26.012+0000 7fd3237fe700 0 client.25916 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:58:26.015 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:26.012+0000 7fd3569d3b80 1 -- 172.21.15.76:0/2096191538 shutdown_connections 2024-06-02T04:58:26.015 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:26.012+0000 7fd3569d3b80 1 -- 172.21.15.76:0/2096191538 wait complete. 2024-06-02T04:58:26.016 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:26.016+0000 7fd3569d3b80 20 client.25916 trim_cache size 0 max 16384 2024-06-02T04:58:26.019 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:{ 2024-06-02T04:58:26.019 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "message": "", 2024-06-02T04:58:26.019 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "return_code": 0 2024-06-02T04:58:26.019 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:} 2024-06-02T04:58:26.019 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:26.019+0000 7fd34a818700 1 -- 172.21.15.76:0/2368909030 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fd32c0a12f0 msgr2=0x7fd32c0a37b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:58:26.019 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:26.019+0000 7fd34a818700 1 --2- 172.21.15.76:0/2368909030 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fd32c0a12f0 0x7fd32c0a37b0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fd33c009520 tx=0x7fd33c00b040 comp rx=0 tx=0).stop 2024-06-02T04:58:26.020 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:26.019+0000 7fd34a818700 1 -- 172.21.15.76:0/2368909030 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd344108730 msgr2=0x7fd34406fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:58:26.020 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:26.019+0000 7fd34a818700 1 --2- 172.21.15.76:0/2368909030 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd344108730 0x7fd34406fc00 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fd3380098e0 tx=0x7fd33800b9e0 comp rx=0 tx=0).stop 2024-06-02T04:58:26.021 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:26.020+0000 7fd34a818700 1 -- 172.21.15.76:0/2368909030 shutdown_connections 2024-06-02T04:58:26.021 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:26.020+0000 7fd34a818700 1 --2- 172.21.15.76:0/2368909030 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd3441ab4e0 0x7fd3441ad8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:26.021 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:26.020+0000 7fd34a818700 1 --2- 172.21.15.76:0/2368909030 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd344108730 0x7fd34406fc00 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:26.021 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:26.020+0000 7fd34a818700 1 --2- 172.21.15.76:0/2368909030 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fd32c0a12f0 0x7fd32c0a37b0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:26.021 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:26.020+0000 7fd34a818700 1 --2- 172.21.15.76:0/2368909030 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd3441090d0 0x7fd344070140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:26.021 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:26.020+0000 7fd34a818700 1 -- 172.21.15.76:0/2368909030 >> 172.21.15.76:0/2368909030 conn(0x7fd3440764d0 msgr2=0x7fd34410bd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:58:26.026 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:26.026+0000 7fd34a818700 1 -- 172.21.15.76:0/2368909030 shutdown_connections 2024-06-02T04:58:26.032 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:26.032+0000 7fd34a818700 1 -- 172.21.15.76:0/2368909030 wait complete. 2024-06-02T04:58:26.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 455.0 s, 656.0 tps, lat 152.759 ms stddev 53.416 2024-06-02T04:58:27.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:58:27 smithi119 ceph-mon[46633]: pgmap v534: 129 pgs: 129 active+clean; 1.5 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 10 MiB/s wr, 833 op/s 2024-06-02T04:58:27.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:58:27 smithi192 ceph-mon[47933]: pgmap v534: 129 pgs: 129 active+clean; 1.5 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 10 MiB/s wr, 833 op/s 2024-06-02T04:58:27.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:58:27 smithi076 ceph-mon[42935]: pgmap v534: 129 pgs: 129 active+clean; 1.5 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 10 MiB/s wr, 833 op/s 2024-06-02T04:58:29.847 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:58:29 smithi119 ceph-mon[46633]: pgmap v535: 129 pgs: 129 active+clean; 1.5 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 9.8 MiB/s wr, 800 op/s 2024-06-02T04:58:29.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:58:29 smithi192 ceph-mon[47933]: pgmap v535: 129 pgs: 129 active+clean; 1.5 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 9.8 MiB/s wr, 800 op/s 2024-06-02T04:58:29.988 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:58:29 smithi076 ceph-mon[42935]: pgmap v535: 129 pgs: 129 active+clean; 1.5 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 9.8 MiB/s wr, 800 op/s 2024-06-02T04:58:31.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 460.0 s, 681.4 tps, lat 146.204 ms stddev 54.487 2024-06-02T04:58:31.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:58:31 smithi119 ceph-mon[46633]: pgmap v536: 129 pgs: 129 active+clean; 1.5 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 9.8 MiB/s wr, 824 op/s 2024-06-02T04:58:31.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:58:31 smithi192 ceph-mon[47933]: pgmap v536: 129 pgs: 129 active+clean; 1.5 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 9.8 MiB/s wr, 824 op/s 2024-06-02T04:58:31.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:58:31 smithi076 ceph-mon[42935]: pgmap v536: 129 pgs: 129 active+clean; 1.5 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 9.8 MiB/s wr, 824 op/s 2024-06-02T04:58:33.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:58:33 smithi119 ceph-mon[46633]: pgmap v537: 129 pgs: 129 active+clean; 1.5 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 9.9 MiB/s wr, 806 op/s 2024-06-02T04:58:33.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:58:33 smithi192 ceph-mon[47933]: pgmap v537: 129 pgs: 129 active+clean; 1.5 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 9.9 MiB/s wr, 806 op/s 2024-06-02T04:58:33.985 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:58:33 smithi076 ceph-mon[42935]: pgmap v537: 129 pgs: 129 active+clean; 1.5 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 9.9 MiB/s wr, 806 op/s 2024-06-02T04:58:35.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:58:35 smithi119 ceph-mon[46633]: pgmap v538: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 8.4 MiB/s wr, 737 op/s 2024-06-02T04:58:35.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:58:35 smithi192 ceph-mon[47933]: pgmap v538: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 8.4 MiB/s wr, 737 op/s 2024-06-02T04:58:35.985 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:58:35 smithi076 ceph-mon[42935]: pgmap v538: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 8.4 MiB/s wr, 737 op/s 2024-06-02T04:58:36.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 465.0 s, 678.0 tps, lat 148.016 ms stddev 52.227 2024-06-02T04:58:37.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:58:37 smithi119 ceph-mon[46633]: pgmap v539: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 9.0 MiB/s wr, 801 op/s 2024-06-02T04:58:37.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:58:37 smithi192 ceph-mon[47933]: pgmap v539: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 9.0 MiB/s wr, 801 op/s 2024-06-02T04:58:37.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:58:37 smithi076 ceph-mon[42935]: pgmap v539: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 9.0 MiB/s wr, 801 op/s 2024-06-02T04:58:39.288 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.287+0000 7fa540f90700 1 -- 172.21.15.76:0/113968074 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa53c102b30 msgr2=0x7fa53c1093e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:58:39.288 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.287+0000 7fa540f90700 1 --2- 172.21.15.76:0/113968074 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa53c102b30 0x7fa53c1093e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa53400b0a0 tx=0x7fa53400b3b0 comp rx=0 tx=0).stop 2024-06-02T04:58:39.289 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.288+0000 7fa540f90700 1 -- 172.21.15.76:0/113968074 shutdown_connections 2024-06-02T04:58:39.289 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.288+0000 7fa540f90700 1 --2- 172.21.15.76:0/113968074 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa53c102b30 0x7fa53c1093e0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:39.289 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.288+0000 7fa540f90700 1 --2- 172.21.15.76:0/113968074 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa53c0ff1c0 0x7fa53c0ff5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:39.289 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.288+0000 7fa540f90700 1 --2- 172.21.15.76:0/113968074 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa53c102190 0x7fa53c1025f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:39.289 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.288+0000 7fa540f90700 1 -- 172.21.15.76:0/113968074 >> 172.21.15.76:0/113968074 conn(0x7fa53c0faaf0 msgr2=0x7fa53c0fcf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:58:39.289 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.288+0000 7fa540f90700 1 -- 172.21.15.76:0/113968074 shutdown_connections 2024-06-02T04:58:39.289 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.288+0000 7fa540f90700 1 -- 172.21.15.76:0/113968074 wait complete. 2024-06-02T04:58:39.290 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.288+0000 7fa540f90700 1 Processor -- start 2024-06-02T04:58:39.290 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.289+0000 7fa540f90700 1 -- start start 2024-06-02T04:58:39.290 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.289+0000 7fa540f90700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa53c0ff1c0 0x7fa53c194d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:58:39.290 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.289+0000 7fa540f90700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa53c102190 0x7fa53c195250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:58:39.290 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.289+0000 7fa540f90700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa53c102b30 0x7fa53c19c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:58:39.290 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.289+0000 7fa540f90700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa53c19c8b0 con 0x7fa53c102b30 2024-06-02T04:58:39.290 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.289+0000 7fa540f90700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa53c19ca20 con 0x7fa53c0ff1c0 2024-06-02T04:58:39.290 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.289+0000 7fa540f90700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa53c19cb90 con 0x7fa53c102190 2024-06-02T04:58:39.290 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.289+0000 7fa539d9b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa53c102190 0x7fa53c195250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:58:39.290 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.289+0000 7fa539d9b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa53c102190 0x7fa53c195250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:38220/0 (socket says 172.21.15.76:38220) 2024-06-02T04:58:39.290 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.289+0000 7fa539d9b700 1 -- 172.21.15.76:0/3117820272 learned_addr learned my addr 172.21.15.76:0/3117820272 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:58:39.291 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.289+0000 7fa53ad9d700 1 --2- 172.21.15.76:0/3117820272 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa53c102b30 0x7fa53c19c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:58:39.291 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.289+0000 7fa53a59c700 1 --2- 172.21.15.76:0/3117820272 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa53c0ff1c0 0x7fa53c194d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:58:39.291 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.289+0000 7fa539d9b700 1 -- 172.21.15.76:0/3117820272 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa53c0ff1c0 msgr2=0x7fa53c194d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:58:39.292 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.289+0000 7fa539d9b700 1 --2- 172.21.15.76:0/3117820272 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa53c0ff1c0 0x7fa53c194d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:39.292 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.289+0000 7fa539d9b700 1 -- 172.21.15.76:0/3117820272 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa53c102b30 msgr2=0x7fa53c19c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:58:39.292 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.289+0000 7fa539d9b700 1 --2- 172.21.15.76:0/3117820272 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa53c102b30 0x7fa53c19c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:39.292 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.289+0000 7fa539d9b700 1 -- 172.21.15.76:0/3117820272 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa534009d00 con 0x7fa53c102190 2024-06-02T04:58:39.292 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.290+0000 7fa53a59c700 1 --2- 172.21.15.76:0/3117820272 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa53c0ff1c0 0x7fa53c194d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:58:39.292 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.290+0000 7fa539d9b700 1 --2- 172.21.15.76:0/3117820272 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa53c102190 0x7fa53c195250 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa53000e9a0 tx=0x7fa53000ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:58:39.292 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.290+0000 7fa52b7fe700 1 -- 172.21.15.76:0/3117820272 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa53000cbd0 con 0x7fa53c102190 2024-06-02T04:58:39.292 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.290+0000 7fa540f90700 1 -- 172.21.15.76:0/3117820272 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa53c19ce70 con 0x7fa53c102190 2024-06-02T04:58:39.292 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.290+0000 7fa52b7fe700 1 -- 172.21.15.76:0/3117820272 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa53000cd30 con 0x7fa53c102190 2024-06-02T04:58:39.292 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.290+0000 7fa52b7fe700 1 -- 172.21.15.76:0/3117820272 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa530018680 con 0x7fa53c102190 2024-06-02T04:58:39.292 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.290+0000 7fa540f90700 1 -- 172.21.15.76:0/3117820272 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa53c19d3d0 con 0x7fa53c102190 2024-06-02T04:58:39.299 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.295+0000 7fa52b7fe700 1 -- 172.21.15.76:0/3117820272 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fa5300187e0 con 0x7fa53c102190 2024-06-02T04:58:39.299 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.295+0000 7fa54d14bb80 1 Processor -- start 2024-06-02T04:58:39.299 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.295+0000 7fa54d14bb80 1 -- start start 2024-06-02T04:58:39.299 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.296+0000 7fa54d14bb80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563f66abda80 0x563f66abdea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:58:39.299 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.296+0000 7fa54d14bb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563f66abe3e0 0x563f66abecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:58:39.299 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.296+0000 7fa54d14bb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563f66abf2d0 0x563f66abf750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:58:39.299 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.296+0000 7fa54d14bb80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f66a150f0 con 0x563f66abda80 2024-06-02T04:58:39.299 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.296+0000 7fa54d14bb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f66a12ab0 con 0x563f66abe3e0 2024-06-02T04:58:39.299 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.296+0000 7fa54d14bb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f66a0e3a0 con 0x563f66abf2d0 2024-06-02T04:58:39.300 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.296+0000 7fa53a59c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563f66abe3e0 0x563f66abecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:58:39.300 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.296+0000 7fa53a59c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563f66abe3e0 0x563f66abecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:34410/0 (socket says 172.21.15.76:34410) 2024-06-02T04:58:39.300 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.296+0000 7fa53a59c700 1 -- 172.21.15.76:0/238871161 learned_addr learned my addr 172.21.15.76:0/238871161 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:58:39.300 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.296+0000 7fa539d9b700 1 --2- 172.21.15.76:0/238871161 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563f66abf2d0 0x563f66abf750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:58:39.300 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.296+0000 7fa53a59c700 1 -- 172.21.15.76:0/238871161 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563f66abf2d0 msgr2=0x563f66abf750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:58:39.300 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.296+0000 7fa53a59c700 1 --2- 172.21.15.76:0/238871161 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563f66abf2d0 0x563f66abf750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:39.300 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.296+0000 7fa52b7fe700 1 --2- 172.21.15.76:0/3117820272 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fa5240b2230 0x7fa5240b46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:58:39.300 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.296+0000 7fa53a59c700 1 -- 172.21.15.76:0/238871161 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563f66abda80 msgr2=0x563f66abdea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:58:39.300 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.296+0000 7fa53a59c700 1 --2- 172.21.15.76:0/238871161 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563f66abda80 0x563f66abdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:39.300 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.296+0000 7fa53a59c700 1 -- 172.21.15.76:0/238871161 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563f6688f350 con 0x563f66abe3e0 2024-06-02T04:58:39.300 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.297+0000 7fa52b7fe700 1 -- 172.21.15.76:0/3117820272 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7fa530014070 con 0x7fa53c102190 2024-06-02T04:58:39.300 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.297+0000 7fa53a59c700 1 --2- 172.21.15.76:0/238871161 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563f66abe3e0 0x563f66abecf0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa52c007870 tx=0x7fa52c007b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e916c4ba07440eb server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:58:39.300 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.297+0000 7fa528ff9700 1 -- 172.21.15.76:0/238871161 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa52c0125f0 con 0x563f66abe3e0 2024-06-02T04:58:39.301 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.297+0000 7fa528ff9700 1 -- 172.21.15.76:0/238871161 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa52c0074e0 con 0x563f66abe3e0 2024-06-02T04:58:39.301 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.297+0000 7fa528ff9700 1 -- 172.21.15.76:0/238871161 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa52c013bc0 con 0x563f66abe3e0 2024-06-02T04:58:39.301 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.297+0000 7fa53ad9d700 1 --2- 172.21.15.76:0/3117820272 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fa5240b2230 0x7fa5240b46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:58:39.301 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.298+0000 7fa53ad9d700 1 --2- 172.21.15.76:0/3117820272 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fa5240b2230 0x7fa5240b46f0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fa534009fd0 tx=0x7fa534006000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:58:39.301 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.298+0000 7fa54d14bb80 1 -- 172.21.15.76:0/238871161 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563f66abe3e0 msgr2=0x563f66abecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:58:39.301 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.298+0000 7fa54d14bb80 1 --2- 172.21.15.76:0/238871161 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563f66abe3e0 0x563f66abecf0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa52c007870 tx=0x7fa52c007b80 comp rx=0 tx=0).stop 2024-06-02T04:58:39.301 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.298+0000 7fa54d14bb80 1 -- 172.21.15.76:0/238871161 shutdown_connections 2024-06-02T04:58:39.301 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.298+0000 7fa54d14bb80 1 --2- 172.21.15.76:0/238871161 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563f66abf2d0 0x563f66abf750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:39.301 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.298+0000 7fa54d14bb80 1 --2- 172.21.15.76:0/238871161 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563f66abda80 0x563f66abdea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:39.301 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.298+0000 7fa54d14bb80 1 --2- 172.21.15.76:0/238871161 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563f66abe3e0 0x563f66abecf0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:39.301 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.298+0000 7fa54d14bb80 1 -- 172.21.15.76:0/238871161 >> 172.21.15.76:0/238871161 conn(0x563f66a1c1b0 msgr2=0x563f66aba440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:58:39.301 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.298+0000 7fa54d14bb80 1 -- 172.21.15.76:0/238871161 shutdown_connections 2024-06-02T04:58:39.302 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.298+0000 7fa54d14bb80 1 -- 172.21.15.76:0/238871161 wait complete. 2024-06-02T04:58:39.302 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.298+0000 7fa54d14bb80 1 -- start start 2024-06-02T04:58:39.302 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.298+0000 7fa54d14bb80 1 Processor -- start 2024-06-02T04:58:39.305 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.299+0000 7fa54d14bb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563f66abda80 0x563f66ac78a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:58:39.305 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.299+0000 7fa54d14bb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563f66abe3e0 0x563f66ac7de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:58:39.305 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.299+0000 7fa54d14bb80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563f66abf2d0 0x563f66acee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:58:39.305 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.299+0000 7fa54d14bb80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f669aa500 con 0x563f66abf2d0 2024-06-02T04:58:39.305 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.299+0000 7fa54d14bb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f669aa1a0 con 0x563f66abda80 2024-06-02T04:58:39.305 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.299+0000 7fa54d14bb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f66891640 con 0x563f66abe3e0 2024-06-02T04:58:39.305 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.299+0000 7fa54d14bb80 10 client.0 _ll_register_callbacks cb 0x563f669b3ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:58:39.305 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.299+0000 7fa539d9b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563f66abe3e0 0x563f66ac7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:58:39.305 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.299+0000 7fa539d9b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563f66abe3e0 0x563f66ac7de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:38238/0 (socket says 172.21.15.76:38238) 2024-06-02T04:58:39.306 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.299+0000 7fa539d9b700 1 -- 172.21.15.76:0/3173708159 learned_addr learned my addr 172.21.15.76:0/3173708159 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:58:39.306 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.299+0000 7fa53ad9d700 1 --2- 172.21.15.76:0/3173708159 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563f66abf2d0 0x563f66acee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:58:39.306 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.299+0000 7fa53a59c700 1 --2- 172.21.15.76:0/3173708159 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563f66abda80 0x563f66ac78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:58:39.306 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.299+0000 7fa539d9b700 1 -- 172.21.15.76:0/3173708159 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563f66abda80 msgr2=0x563f66ac78a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:58:39.306 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.299+0000 7fa539d9b700 1 --2- 172.21.15.76:0/3173708159 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563f66abda80 0x563f66ac78a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:39.306 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.299+0000 7fa539d9b700 1 -- 172.21.15.76:0/3173708159 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563f66abf2d0 msgr2=0x563f66acee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:58:39.306 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.300+0000 7fa539d9b700 1 --2- 172.21.15.76:0/3173708159 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563f66abf2d0 0x563f66acee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:39.306 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.300+0000 7fa539d9b700 1 -- 172.21.15.76:0/3173708159 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa52c00e040 con 0x563f66abe3e0 2024-06-02T04:58:39.306 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.300+0000 7fa539d9b700 1 --2- 172.21.15.76:0/3173708159 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563f66abe3e0 0x563f66ac7de0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa5300a23c0 tx=0x7fa53009a9b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9016b649c5daeebc server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:58:39.306 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.300+0000 7fa521ffb700 10 client.0 ms_handle_connect on v2:172.21.15.192:3300/0 2024-06-02T04:58:39.306 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.300+0000 7fa521ffb700 1 -- 172.21.15.76:0/3173708159 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa53009a240 con 0x563f66abe3e0 2024-06-02T04:58:39.306 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.300+0000 7fa521ffb700 1 -- 172.21.15.76:0/3173708159 <== mon.1 v2:172.21.15.192:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7fa53009ab70 con 0x563f66abe3e0 2024-06-02T04:58:39.307 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.300+0000 7fa54d14bb80 1 -- 172.21.15.76:0/3173708159 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563f66a8d7b0 con 0x563f66abe3e0 2024-06-02T04:58:39.307 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.300+0000 7fa521ffb700 1 -- 172.21.15.76:0/3173708159 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa530099fb0 con 0x563f66abe3e0 2024-06-02T04:58:39.307 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.300+0000 7fa54d14bb80 10 client.25867 fetch_fsmap learned FSMap version 36 2024-06-02T04:58:39.307 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.300+0000 7fa54d14bb80 1 -- 172.21.15.76:0/3173708159 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x563f6683bb00 con 0x563f66abe3e0 2024-06-02T04:58:39.307 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.300+0000 7fa521ffb700 1 -- 172.21.15.76:0/3173708159 <== mon.1 v2:172.21.15.192:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x563f66a8d7b0 con 0x563f66abe3e0 2024-06-02T04:58:39.307 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.301+0000 7fa521ffb700 1 -- 172.21.15.76:0/3173708159 <== mon.1 v2:172.21.15.192:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fa5300d0120 con 0x563f66abe3e0 2024-06-02T04:58:39.307 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.301+0000 7fa54d14bb80 10 client.25867 fetch_fsmap finished waiting for FSMap version 36 2024-06-02T04:58:39.307 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.301+0000 7fa54d14bb80 10 client.25867 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T04:58:39.307 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.301+0000 7fa54d14bb80 20 client.25867 populate_metadata read hostname 'smithi076' 2024-06-02T04:58:39.307 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.301+0000 7fa54d14bb80 1 --2- 172.21.15.76:0/3173708159 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x563f66ad3660 0x563f66ad5a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:58:39.307 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.301+0000 7fa54d14bb80 4 client.25867 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T04:58:39.307 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.301+0000 7fa54d14bb80 1 -- 172.21.15.76:0/3173708159 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563f66a06e60 con 0x563f66ad3660 2024-06-02T04:58:39.307 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.301+0000 7fa53a59c700 1 --2- 172.21.15.76:0/3173708159 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x563f66ad3660 0x563f66ad5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:58:39.308 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.302+0000 7fa53a59c700 1 --2- 172.21.15.76:0/3173708159 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x563f66ad3660 0x563f66ad5a80 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c35dd5337d3c5446 server_cookie=647c27de144bcf7d in_seq=0 out_seq=0 2024-06-02T04:58:39.308 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.302+0000 7fa521ffb700 10 client.25867 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:58:39.308 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.302+0000 7fa521ffb700 1 -- 172.21.15.76:0/3173708159 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x563f66a06e60 con 0x563f66ad3660 2024-06-02T04:58:39.308 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.302+0000 7fa521ffb700 10 client.25867 handle_command_reply: tid=0 2024-06-02T04:58:39.308 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.302+0000 7fa54d14bb80 1 client.25867 shutdown 2024-06-02T04:58:39.308 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.302+0000 7fa54d14bb80 1 -- 172.21.15.76:0/3173708159 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563f66abe3e0 msgr2=0x563f66ac7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:58:39.308 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.302+0000 7fa54d14bb80 1 --2- 172.21.15.76:0/3173708159 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563f66abe3e0 0x563f66ac7de0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa5300a23c0 tx=0x7fa53009a9b0 comp rx=0 tx=0).stop 2024-06-02T04:58:39.308 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.303+0000 7fa54d14bb80 1 -- 172.21.15.76:0/3173708159 shutdown_connections 2024-06-02T04:58:39.308 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.303+0000 7fa54d14bb80 1 --2- 172.21.15.76:0/3173708159 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x563f66ad3660 0x563f66ad5a80 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:39.308 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.303+0000 7fa54d14bb80 1 --2- 172.21.15.76:0/3173708159 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563f66abf2d0 0x563f66acee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:39.308 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.303+0000 7fa54d14bb80 1 --2- 172.21.15.76:0/3173708159 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563f66abda80 0x563f66ac78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:39.308 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.303+0000 7fa54d14bb80 1 --2- 172.21.15.76:0/3173708159 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563f66abe3e0 0x563f66ac7de0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:39.308 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.303+0000 7fa54d14bb80 1 -- 172.21.15.76:0/3173708159 >> 172.21.15.76:0/3173708159 conn(0x563f66a1c1b0 msgr2=0x563f66ab8860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:58:39.309 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.303+0000 7fa521ffb700 0 client.25867 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:58:39.309 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.303+0000 7fa54d14bb80 1 -- 172.21.15.76:0/3173708159 shutdown_connections 2024-06-02T04:58:39.309 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.304+0000 7fa54d14bb80 1 -- 172.21.15.76:0/3173708159 wait complete. 2024-06-02T04:58:39.309 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.304+0000 7fa54d14bb80 20 client.25867 trim_cache size 0 max 16384 2024-06-02T04:58:39.328 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.327+0000 7fa54d14bb80 1 Processor -- start 2024-06-02T04:58:39.328 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.327+0000 7fa54d14bb80 1 -- start start 2024-06-02T04:58:39.328 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.327+0000 7fa54d14bb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563f66abda80 0x563f66ac6e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:58:39.328 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.327+0000 7fa54d14bb80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563f66abe3e0 0x563f66acede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:58:39.328 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.327+0000 7fa54d14bb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563f66abf2d0 0x563f66abf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:58:39.328 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.327+0000 7fa54d14bb80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f66ac7410 con 0x563f66abe3e0 2024-06-02T04:58:39.328 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.327+0000 7fa54d14bb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f66ac8660 con 0x563f66abda80 2024-06-02T04:58:39.328 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.327+0000 7fa54d14bb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f66ac2e00 con 0x563f66abf2d0 2024-06-02T04:58:39.328 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.327+0000 7fa53ad9d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563f66abf2d0 0x563f66abf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:58:39.329 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.327+0000 7fa53ad9d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563f66abf2d0 0x563f66abf6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:38240/0 (socket says 172.21.15.76:38240) 2024-06-02T04:58:39.329 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.327+0000 7fa53ad9d700 1 -- 172.21.15.76:0/3699131213 learned_addr learned my addr 172.21.15.76:0/3699131213 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:58:39.329 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.327+0000 7fa539d9b700 1 --2- 172.21.15.76:0/3699131213 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563f66abe3e0 0x563f66acede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:58:39.329 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.328+0000 7fa53ad9d700 1 -- 172.21.15.76:0/3699131213 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563f66abda80 msgr2=0x563f66ac6e20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-02T04:58:39.329 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.328+0000 7fa53a59c700 1 --2- 172.21.15.76:0/3699131213 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563f66abda80 0x563f66ac6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:58:39.329 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.328+0000 7fa53ad9d700 1 --2- 172.21.15.76:0/3699131213 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563f66abda80 0x563f66ac6e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:39.330 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.328+0000 7fa53ad9d700 1 -- 172.21.15.76:0/3699131213 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563f66abe3e0 msgr2=0x563f66acede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:58:39.330 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.328+0000 7fa53ad9d700 1 --2- 172.21.15.76:0/3699131213 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563f66abe3e0 0x563f66acede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:39.330 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.328+0000 7fa53ad9d700 1 -- 172.21.15.76:0/3699131213 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563f669d4500 con 0x563f66abf2d0 2024-06-02T04:58:39.330 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.329+0000 7fa53ad9d700 1 --2- 172.21.15.76:0/3699131213 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563f66abf2d0 0x563f66abf6b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa53400b0a0 tx=0x7fa53401c000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7ac31ac1d318c83f server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:58:39.330 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.330+0000 7fa5297fa700 1 -- 172.21.15.76:0/3699131213 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa53400e040 con 0x563f66abf2d0 2024-06-02T04:58:39.331 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.330+0000 7fa5297fa700 1 -- 172.21.15.76:0/3699131213 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa534007e70 con 0x563f66abf2d0 2024-06-02T04:58:39.331 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.330+0000 7fa5297fa700 1 -- 172.21.15.76:0/3699131213 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa53401ce50 con 0x563f66abf2d0 2024-06-02T04:58:39.331 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.331+0000 7fa54d14bb80 1 -- 172.21.15.76:0/3699131213 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563f66abf2d0 msgr2=0x563f66abf6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:58:39.331 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.331+0000 7fa54d14bb80 1 --2- 172.21.15.76:0/3699131213 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563f66abf2d0 0x563f66abf6b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa53400b0a0 tx=0x7fa53401c000 comp rx=0 tx=0).stop 2024-06-02T04:58:39.334 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.334+0000 7fa54d14bb80 1 -- 172.21.15.76:0/3699131213 shutdown_connections 2024-06-02T04:58:39.334 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.334+0000 7fa54d14bb80 1 --2- 172.21.15.76:0/3699131213 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563f66abf2d0 0x563f66abf6b0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:39.334 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.334+0000 7fa54d14bb80 1 --2- 172.21.15.76:0/3699131213 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563f66abda80 0x563f66ac6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:39.334 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.334+0000 7fa54d14bb80 1 --2- 172.21.15.76:0/3699131213 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563f66abe3e0 0x563f66acede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:39.334 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.334+0000 7fa54d14bb80 1 -- 172.21.15.76:0/3699131213 >> 172.21.15.76:0/3699131213 conn(0x563f66a1c1b0 msgr2=0x563f66ac5890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:58:39.338 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.335+0000 7fa54d14bb80 1 -- 172.21.15.76:0/3699131213 shutdown_connections 2024-06-02T04:58:39.346 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.338+0000 7fa54d14bb80 1 -- 172.21.15.76:0/3699131213 wait complete. 2024-06-02T04:58:39.346 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.338+0000 7fa54d14bb80 1 -- start start 2024-06-02T04:58:39.346 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.338+0000 7fa54d14bb80 1 Processor -- start 2024-06-02T04:58:39.347 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.338+0000 7fa54d14bb80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563f66abda80 0x563f66acc420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:58:39.347 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.339+0000 7fa54d14bb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563f66abe3e0 0x563f66acc960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:58:39.347 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.339+0000 7fa54d14bb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563f66abf2d0 0x563f66acd970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:58:39.347 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.339+0000 7fa54d14bb80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f66acdeb0 con 0x563f66abda80 2024-06-02T04:58:39.347 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.339+0000 7fa54d14bb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f66ace020 con 0x563f66abe3e0 2024-06-02T04:58:39.347 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.339+0000 7fa54d14bb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f66ace1e0 con 0x563f66abf2d0 2024-06-02T04:58:39.347 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.339+0000 7fa54d14bb80 10 client.0 _ll_register_callbacks cb 0x563f669b3ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:58:39.347 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.339+0000 7fa539d9b700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563f66abe3e0 0x563f66acc960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:58:39.347 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.339+0000 7fa539d9b700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563f66abe3e0 0x563f66acc960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:34450/0 (socket says 172.21.15.76:34450) 2024-06-02T04:58:39.347 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.339+0000 7fa539d9b700 1 -- 172.21.15.76:0/675806453 learned_addr learned my addr 172.21.15.76:0/675806453 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:58:39.347 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.339+0000 7fa53ad9d700 1 --2- 172.21.15.76:0/675806453 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563f66abf2d0 0x563f66acd970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:58:39.347 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.339+0000 7fa539d9b700 1 -- 172.21.15.76:0/675806453 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563f66abf2d0 msgr2=0x563f66acd970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:58:39.348 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.339+0000 7fa539d9b700 1 --2- 172.21.15.76:0/675806453 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563f66abf2d0 0x563f66acd970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:39.348 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.339+0000 7fa539d9b700 1 -- 172.21.15.76:0/675806453 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563f66abda80 msgr2=0x563f66acc420 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-02T04:58:39.348 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.339+0000 7fa539d9b700 1 --2- 172.21.15.76:0/675806453 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563f66abda80 0x563f66acc420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:39.348 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.339+0000 7fa539d9b700 1 -- 172.21.15.76:0/675806453 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa53c109ce0 con 0x563f66abe3e0 2024-06-02T04:58:39.348 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.340+0000 7fa539d9b700 1 --2- 172.21.15.76:0/675806453 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563f66abe3e0 0x563f66acc960 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa53000cf50 tx=0x7fa5300cae40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=17db73963195c721 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:58:39.348 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.340+0000 7fa521ffb700 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-06-02T04:58:39.348 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.340+0000 7fa521ffb700 1 -- 172.21.15.76:0/675806453 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa53009a240 con 0x563f66abe3e0 2024-06-02T04:58:39.348 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.340+0000 7fa521ffb700 1 -- 172.21.15.76:0/675806453 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7fa53009ab70 con 0x563f66abe3e0 2024-06-02T04:58:39.348 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.340+0000 7fa54d14bb80 1 -- 172.21.15.76:0/675806453 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563f66967210 con 0x563f66abe3e0 2024-06-02T04:58:39.348 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.340+0000 7fa521ffb700 1 -- 172.21.15.76:0/675806453 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa530099fb0 con 0x563f66abe3e0 2024-06-02T04:58:39.348 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.340+0000 7fa54d14bb80 10 client.25931 fetch_fsmap learned FSMap version 36 2024-06-02T04:58:39.348 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.340+0000 7fa54d14bb80 1 -- 172.21.15.76:0/675806453 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x563f66893c70 con 0x563f66abe3e0 2024-06-02T04:58:39.348 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.340+0000 7fa521ffb700 1 -- 172.21.15.76:0/675806453 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x563f66967210 con 0x563f66abe3e0 2024-06-02T04:58:39.349 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.341+0000 7fa521ffb700 1 -- 172.21.15.76:0/675806453 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fa530096260 con 0x563f66abe3e0 2024-06-02T04:58:39.349 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.343+0000 7fa54d14bb80 10 client.25931 fetch_fsmap finished waiting for FSMap version 36 2024-06-02T04:58:39.349 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.343+0000 7fa54d14bb80 10 client.25931 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T04:58:39.349 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.343+0000 7fa54d14bb80 20 client.25931 populate_metadata read hostname 'smithi076' 2024-06-02T04:58:39.349 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.343+0000 7fa54d14bb80 1 --2- 172.21.15.76:0/675806453 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x563f66b4c210 0x563f66b4e630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:58:39.349 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.343+0000 7fa54d14bb80 4 client.25931 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T04:58:39.349 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.343+0000 7fa54d14bb80 1 -- 172.21.15.76:0/675806453 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x563f6685cc90 con 0x563f66b4c210 2024-06-02T04:58:39.349 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.346+0000 7fa53a59c700 1 --2- 172.21.15.76:0/675806453 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x563f66b4c210 0x563f66b4e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:58:39.350 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.347+0000 7fa53a59c700 1 --2- 172.21.15.76:0/675806453 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x563f66b4c210 0x563f66b4e630 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=14cdeac762aa4b29 server_cookie=95717262c0561e74 in_seq=0 out_seq=0 2024-06-02T04:58:39.350 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.347+0000 7fa521ffb700 10 client.25931 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:58:39.373 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.372+0000 7fa521ffb700 1 -- 172.21.15.76:0/675806453 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x563f6685cc90 con 0x563f66b4c210 2024-06-02T04:58:39.373 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.372+0000 7fa521ffb700 10 client.25931 handle_command_reply: tid=0 2024-06-02T04:58:39.374 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.374+0000 7fa54d14bb80 1 client.25931 shutdown 2024-06-02T04:58:39.374 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.374+0000 7fa54d14bb80 1 -- 172.21.15.76:0/675806453 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563f66abe3e0 msgr2=0x563f66acc960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:58:39.375 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.374+0000 7fa54d14bb80 1 --2- 172.21.15.76:0/675806453 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563f66abe3e0 0x563f66acc960 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa53000cf50 tx=0x7fa5300cae40 comp rx=0 tx=0).stop 2024-06-02T04:58:39.375 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.374+0000 7fa54d14bb80 1 -- 172.21.15.76:0/675806453 shutdown_connections 2024-06-02T04:58:39.375 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.374+0000 7fa54d14bb80 1 --2- 172.21.15.76:0/675806453 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x563f66b4c210 0x563f66b4e630 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:39.375 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.374+0000 7fa54d14bb80 1 --2- 172.21.15.76:0/675806453 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563f66abf2d0 0x563f66acd970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:39.375 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.374+0000 7fa54d14bb80 1 --2- 172.21.15.76:0/675806453 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563f66abda80 0x563f66acc420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:39.375 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.374+0000 7fa54d14bb80 1 --2- 172.21.15.76:0/675806453 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563f66abe3e0 0x563f66acc960 secure :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa53000cf50 tx=0x7fa5300cae40 comp rx=0 tx=0).stop 2024-06-02T04:58:39.375 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.374+0000 7fa54d14bb80 1 -- 172.21.15.76:0/675806453 >> 172.21.15.76:0/675806453 conn(0x563f66a1c1b0 msgr2=0x563f66acf4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:58:39.376 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.375+0000 7fa521ffb700 0 client.25931 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:58:39.376 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.375+0000 7fa54d14bb80 1 -- 172.21.15.76:0/675806453 shutdown_connections 2024-06-02T04:58:39.376 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.375+0000 7fa54d14bb80 1 -- 172.21.15.76:0/675806453 wait complete. 2024-06-02T04:58:39.376 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.375+0000 7fa54d14bb80 20 client.25931 trim_cache size 0 max 16384 2024-06-02T04:58:39.376 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:{ 2024-06-02T04:58:39.377 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "message": "", 2024-06-02T04:58:39.377 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "return_code": 0 2024-06-02T04:58:39.377 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:} 2024-06-02T04:58:39.381 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.380+0000 7fa540f90700 1 -- 172.21.15.76:0/3117820272 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fa5240b2230 msgr2=0x7fa5240b46f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:58:39.381 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.380+0000 7fa540f90700 1 --2- 172.21.15.76:0/3117820272 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fa5240b2230 0x7fa5240b46f0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fa534009fd0 tx=0x7fa534006000 comp rx=0 tx=0).stop 2024-06-02T04:58:39.381 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.380+0000 7fa540f90700 1 -- 172.21.15.76:0/3117820272 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa53c102190 msgr2=0x7fa53c195250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:58:39.381 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.380+0000 7fa540f90700 1 --2- 172.21.15.76:0/3117820272 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa53c102190 0x7fa53c195250 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa53000e9a0 tx=0x7fa53000ecb0 comp rx=0 tx=0).stop 2024-06-02T04:58:39.381 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.380+0000 7fa540f90700 1 -- 172.21.15.76:0/3117820272 shutdown_connections 2024-06-02T04:58:39.381 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.380+0000 7fa540f90700 1 --2- 172.21.15.76:0/3117820272 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa53c102b30 0x7fa53c19c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:39.381 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.380+0000 7fa540f90700 1 --2- 172.21.15.76:0/3117820272 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fa5240b2230 0x7fa5240b46f0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:39.381 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.380+0000 7fa540f90700 1 --2- 172.21.15.76:0/3117820272 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa53c0ff1c0 0x7fa53c194d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:39.382 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.380+0000 7fa540f90700 1 --2- 172.21.15.76:0/3117820272 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa53c102190 0x7fa53c195250 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:39.382 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.380+0000 7fa540f90700 1 -- 172.21.15.76:0/3117820272 >> 172.21.15.76:0/3117820272 conn(0x7fa53c0faaf0 msgr2=0x7fa53c107960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:58:39.382 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.380+0000 7fa540f90700 1 -- 172.21.15.76:0/3117820272 shutdown_connections 2024-06-02T04:58:39.382 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:39.381+0000 7fa540f90700 1 -- 172.21.15.76:0/3117820272 wait complete. 2024-06-02T04:58:39.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:58:39 smithi119 ceph-mon[46633]: pgmap v540: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 8.6 MiB/s wr, 772 op/s 2024-06-02T04:58:39.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:58:39 smithi192 ceph-mon[47933]: pgmap v540: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 8.6 MiB/s wr, 772 op/s 2024-06-02T04:58:39.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:58:39 smithi076 ceph-mon[42935]: pgmap v540: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 8.6 MiB/s wr, 772 op/s 2024-06-02T04:58:41.317 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 470.0 s, 661.1 tps, lat 150.388 ms stddev 49.057 2024-06-02T04:58:41.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:58:41 smithi119 ceph-mon[46633]: pgmap v541: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 9.4 MiB/s wr, 835 op/s 2024-06-02T04:58:41.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:58:41 smithi192 ceph-mon[47933]: pgmap v541: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 9.4 MiB/s wr, 835 op/s 2024-06-02T04:58:41.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:58:41 smithi076 ceph-mon[42935]: pgmap v541: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 9.4 MiB/s wr, 835 op/s 2024-06-02T04:58:42.933 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:58:42 smithi192 ceph-mon[47933]: pgmap v542: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 8.7 MiB/s wr, 804 op/s 2024-06-02T04:58:42.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:58:42 smithi076 ceph-mon[42935]: pgmap v542: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 8.7 MiB/s wr, 804 op/s 2024-06-02T04:58:43.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:58:42 smithi119 ceph-mon[46633]: pgmap v542: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 8.7 MiB/s wr, 804 op/s 2024-06-02T04:58:45.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:58:45 smithi119 ceph-mon[46633]: pgmap v543: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 8.1 MiB/s wr, 755 op/s 2024-06-02T04:58:45.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:58:45 smithi192 ceph-mon[47933]: pgmap v543: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 8.1 MiB/s wr, 755 op/s 2024-06-02T04:58:45.992 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:58:45 smithi076 ceph-mon[42935]: pgmap v543: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 8.1 MiB/s wr, 755 op/s 2024-06-02T04:58:46.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 475.0 s, 539.2 tps, lat 185.658 ms stddev 302.829 2024-06-02T04:58:47.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:58:47 smithi119 ceph-mon[46633]: pgmap v544: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 8.5 MiB/s wr, 804 op/s 2024-06-02T04:58:47.934 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:58:47 smithi192 ceph-mon[47933]: pgmap v544: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 8.5 MiB/s wr, 804 op/s 2024-06-02T04:58:47.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:58:47 smithi076 ceph-mon[42935]: pgmap v544: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 8.5 MiB/s wr, 804 op/s 2024-06-02T04:58:49.847 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:58:49 smithi119 ceph-mon[46633]: pgmap v545: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 8.9 MiB/s wr, 787 op/s 2024-06-02T04:58:49.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:58:49 smithi192 ceph-mon[47933]: pgmap v545: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 8.9 MiB/s wr, 787 op/s 2024-06-02T04:58:49.985 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:58:49 smithi076 ceph-mon[42935]: pgmap v545: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 8.9 MiB/s wr, 787 op/s 2024-06-02T04:58:51.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 480.0 s, 708.6 tps, lat 142.275 ms stddev 62.844 2024-06-02T04:58:51.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:58:51 smithi119 ceph-mon[46633]: pgmap v546: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 9.1 MiB/s wr, 825 op/s 2024-06-02T04:58:51.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:58:51 smithi192 ceph-mon[47933]: pgmap v546: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 9.1 MiB/s wr, 825 op/s 2024-06-02T04:58:51.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:58:51 smithi076 ceph-mon[42935]: pgmap v546: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 9.1 MiB/s wr, 825 op/s 2024-06-02T04:58:52.552 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.551+0000 7f2d0f429700 1 -- 172.21.15.76:0/932719036 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d08101150 msgr2=0x7f2d08107a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:58:52.552 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.551+0000 7f2d0f429700 1 --2- 172.21.15.76:0/932719036 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d08101150 0x7f2d08107a00 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2cf801a9a0 tx=0x7f2cf801acb0 comp rx=0 tx=0).stop 2024-06-02T04:58:52.552 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.552+0000 7f2d0f429700 1 -- 172.21.15.76:0/932719036 shutdown_connections 2024-06-02T04:58:52.552 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.552+0000 7f2d0f429700 1 --2- 172.21.15.76:0/932719036 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d08101150 0x7f2d08107a00 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:52.552 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.552+0000 7f2d0f429700 1 --2- 172.21.15.76:0/932719036 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d080ff5c0 0x7f2d080ff9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:52.553 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.552+0000 7f2d0f429700 1 --2- 172.21.15.76:0/932719036 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2d081007b0 0x7f2d08100c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:52.553 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.552+0000 7f2d0f429700 1 -- 172.21.15.76:0/932719036 >> 172.21.15.76:0/932719036 conn(0x7f2d080fab30 msgr2=0x7f2d080fcf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:58:52.554 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.554+0000 7f2d0f429700 1 -- 172.21.15.76:0/932719036 shutdown_connections 2024-06-02T04:58:52.558 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.558+0000 7f2d0f429700 1 -- 172.21.15.76:0/932719036 wait complete. 2024-06-02T04:58:52.559 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.558+0000 7f2d0f429700 1 Processor -- start 2024-06-02T04:58:52.559 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.558+0000 7f2d0f429700 1 -- start start 2024-06-02T04:58:52.559 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.558+0000 7f2d0f429700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d080ff5c0 0x7f2d08107820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:58:52.559 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.558+0000 7f2d0f429700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2d081007b0 0x7f2d081912d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:58:52.559 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.558+0000 7f2d0f429700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d08101150 0x7f2d08193820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:58:52.559 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.558+0000 7f2d0f429700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d08193fb0 con 0x7f2d081007b0 2024-06-02T04:58:52.559 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.558+0000 7f2d0f429700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d08194120 con 0x7f2d080ff5c0 2024-06-02T04:58:52.560 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.558+0000 7f2d0f429700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d081942e0 con 0x7f2d08101150 2024-06-02T04:58:52.560 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.559+0000 7f2d0d9c6700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d08101150 0x7f2d08193820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:58:52.560 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.559+0000 7f2d0d9c6700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d08101150 0x7f2d08193820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:44428/0 (socket says 172.21.15.76:44428) 2024-06-02T04:58:52.560 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.559+0000 7f2d0d9c6700 1 -- 172.21.15.76:0/291512928 learned_addr learned my addr 172.21.15.76:0/291512928 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:58:52.560 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.559+0000 7f2d0d9c6700 1 -- 172.21.15.76:0/291512928 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d080ff5c0 msgr2=0x7f2d08107820 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-02T04:58:52.561 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.559+0000 7f2d0d9c6700 1 --2- 172.21.15.76:0/291512928 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d080ff5c0 0x7f2d08107820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:52.561 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.559+0000 7f2d0d9c6700 1 -- 172.21.15.76:0/291512928 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2d081007b0 msgr2=0x7f2d081912d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-02T04:58:52.561 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.559+0000 7f2d0d9c6700 1 --2- 172.21.15.76:0/291512928 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2d081007b0 0x7f2d081912d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:52.561 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.559+0000 7f2d0d9c6700 1 -- 172.21.15.76:0/291512928 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cf801a600 con 0x7f2d08101150 2024-06-02T04:58:52.561 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.559+0000 7f2d0d9c6700 1 --2- 172.21.15.76:0/291512928 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d08101150 0x7f2d08193820 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2cf8005780 tx=0x7f2cf80057b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:58:52.561 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.560+0000 7f2cfe7fc700 1 -- 172.21.15.76:0/291512928 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf802d070 con 0x7f2d08101150 2024-06-02T04:58:52.561 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.560+0000 7f2cfe7fc700 1 -- 172.21.15.76:0/291512928 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2cf8031410 con 0x7f2d08101150 2024-06-02T04:58:52.561 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.560+0000 7f2cfe7fc700 1 -- 172.21.15.76:0/291512928 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf80283f0 con 0x7f2d08101150 2024-06-02T04:58:52.561 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.560+0000 7f2d0f429700 1 -- 172.21.15.76:0/291512928 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d08194560 con 0x7f2d08101150 2024-06-02T04:58:52.561 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.560+0000 7f2d0f429700 1 -- 172.21.15.76:0/291512928 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d08194a40 con 0x7f2d08101150 2024-06-02T04:58:52.566 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.564+0000 7f2d1b5e4b80 1 Processor -- start 2024-06-02T04:58:52.566 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.565+0000 7f2cfe7fc700 1 -- 172.21.15.76:0/291512928 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f2cf8031580 con 0x7f2d08101150 2024-06-02T04:58:52.567 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.566+0000 7f2cfe7fc700 1 --2- 172.21.15.76:0/291512928 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f2cf40a1220 0x7f2cf40a36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:58:52.568 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.567+0000 7f2cfe7fc700 1 -- 172.21.15.76:0/291512928 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f2cf80de660 con 0x7f2d08101150 2024-06-02T04:58:52.568 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.567+0000 7f2d1b5e4b80 1 -- start start 2024-06-02T04:58:52.568 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.567+0000 7f2d1b5e4b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b778856a80 0x55b778856ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:58:52.568 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.567+0000 7f2d1b5e4b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b7788573e0 0x55b778857cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:58:52.568 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.567+0000 7f2d1b5e4b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b7788582d0 0x55b778858750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:58:52.568 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.567+0000 7f2d1b5e4b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7787ae0f0 con 0x55b7788582d0 2024-06-02T04:58:52.568 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.567+0000 7f2d1b5e4b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7787abab0 con 0x55b778856a80 2024-06-02T04:58:52.568 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.567+0000 7f2d1b5e4b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7787a73a0 con 0x55b7788573e0 2024-06-02T04:58:52.569 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.568+0000 7f2d0c9c4700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b7788573e0 0x55b778857cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:58:52.569 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.568+0000 7f2d0c9c4700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b7788573e0 0x55b778857cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:44432/0 (socket says 172.21.15.76:44432) 2024-06-02T04:58:52.569 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.568+0000 7f2d0c9c4700 1 -- 172.21.15.76:0/4004962753 learned_addr learned my addr 172.21.15.76:0/4004962753 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:58:52.569 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.568+0000 7f2d0c9c4700 1 -- 172.21.15.76:0/4004962753 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b778856a80 msgr2=0x55b778856ea0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-02T04:58:52.569 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.568+0000 7f2d0c9c4700 1 --2- 172.21.15.76:0/4004962753 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b778856a80 0x55b778856ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:52.569 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.568+0000 7f2d0c9c4700 1 -- 172.21.15.76:0/4004962753 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b7788582d0 msgr2=0x55b778858750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:58:52.569 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.568+0000 7f2d0c9c4700 1 --2- 172.21.15.76:0/4004962753 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b7788582d0 0x55b778858750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:52.569 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.568+0000 7f2d0c9c4700 1 -- 172.21.15.76:0/4004962753 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b778628350 con 0x55b7788573e0 2024-06-02T04:58:52.569 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.568+0000 7f2d0c9c4700 1 --2- 172.21.15.76:0/4004962753 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b7788573e0 0x55b778857cf0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2d0400bd80 tx=0x7f2d0400d330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f5b011f49e191c53 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:58:52.570 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.569+0000 7f2d0c9c4700 1 --2- 172.21.15.76:0/291512928 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f2cf40a1220 0x7f2cf40a36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:58:52.570 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.570+0000 7f2d0c9c4700 1 --2- 172.21.15.76:0/291512928 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f2cf40a1220 0x7f2cf40a36e0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f2d04016000 tx=0x7f2d04014410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:58:52.572 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.571+0000 7f2cf37fe700 1 -- 172.21.15.76:0/4004962753 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d04010070 con 0x55b7788573e0 2024-06-02T04:58:52.573 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.571+0000 7f2cf37fe700 1 -- 172.21.15.76:0/4004962753 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2d04004d40 con 0x55b7788573e0 2024-06-02T04:58:52.573 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.571+0000 7f2cf37fe700 1 -- 172.21.15.76:0/4004962753 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d04006460 con 0x55b7788573e0 2024-06-02T04:58:52.573 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.572+0000 7f2d1b5e4b80 1 -- 172.21.15.76:0/4004962753 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b7788573e0 msgr2=0x55b778857cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:58:52.573 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.572+0000 7f2d1b5e4b80 1 --2- 172.21.15.76:0/4004962753 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b7788573e0 0x55b778857cf0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2d0400bd80 tx=0x7f2d0400d330 comp rx=0 tx=0).stop 2024-06-02T04:58:52.576 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.576+0000 7f2d1b5e4b80 1 -- 172.21.15.76:0/4004962753 shutdown_connections 2024-06-02T04:58:52.576 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.576+0000 7f2d1b5e4b80 1 --2- 172.21.15.76:0/4004962753 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b7788582d0 0x55b778858750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:52.576 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.576+0000 7f2d1b5e4b80 1 --2- 172.21.15.76:0/4004962753 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b778856a80 0x55b778856ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:52.576 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.576+0000 7f2d1b5e4b80 1 --2- 172.21.15.76:0/4004962753 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b7788573e0 0x55b778857cf0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:52.576 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.576+0000 7f2d1b5e4b80 1 -- 172.21.15.76:0/4004962753 >> 172.21.15.76:0/4004962753 conn(0x55b7787b51b0 msgr2=0x55b778853440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:58:52.581 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.581+0000 7f2d1b5e4b80 1 -- 172.21.15.76:0/4004962753 shutdown_connections 2024-06-02T04:58:52.582 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.581+0000 7f2d1b5e4b80 1 -- 172.21.15.76:0/4004962753 wait complete. 2024-06-02T04:58:52.583 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.581+0000 7f2d1b5e4b80 1 -- start start 2024-06-02T04:58:52.583 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.582+0000 7f2d1b5e4b80 1 Processor -- start 2024-06-02T04:58:52.583 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.582+0000 7f2d1b5e4b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b778856a80 0x55b778860970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:58:52.583 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.582+0000 7f2d1b5e4b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b7788573e0 0x55b778860eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:58:52.583 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.582+0000 7f2d1b5e4b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b7788582d0 0x55b778867ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:58:52.583 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.582+0000 7f2d1b5e4b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b778743500 con 0x55b7788582d0 2024-06-02T04:58:52.583 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.582+0000 7f2d1b5e4b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7787431a0 con 0x55b7788573e0 2024-06-02T04:58:52.583 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.582+0000 7f2d1b5e4b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b77862a640 con 0x55b778856a80 2024-06-02T04:58:52.584 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.582+0000 7f2d1b5e4b80 10 client.0 _ll_register_callbacks cb 0x55b77874cad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:58:52.584 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.582+0000 7f2d0d9c6700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b7788582d0 0x55b778867ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:58:52.584 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.582+0000 7f2d0c9c4700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b7788573e0 0x55b778860eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:58:52.584 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.582+0000 7f2d0c9c4700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b7788573e0 0x55b778860eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:58480/0 (socket says 172.21.15.76:58480) 2024-06-02T04:58:52.584 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.582+0000 7f2d0d9c6700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b7788582d0 0x55b778867ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:54036/0 (socket says 172.21.15.76:54036) 2024-06-02T04:58:52.584 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.582+0000 7f2d0c9c4700 1 -- 172.21.15.76:0/2346891060 learned_addr learned my addr 172.21.15.76:0/2346891060 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:58:52.585 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.583+0000 7f2d0d1c5700 1 --2- 172.21.15.76:0/2346891060 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b778856a80 0x55b778860970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:58:52.585 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.583+0000 7f2d0c9c4700 1 -- 172.21.15.76:0/2346891060 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b778856a80 msgr2=0x55b778860970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:58:52.585 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.583+0000 7f2d0c9c4700 1 --2- 172.21.15.76:0/2346891060 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b778856a80 0x55b778860970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:52.585 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.583+0000 7f2d0c9c4700 1 -- 172.21.15.76:0/2346891060 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b7788582d0 msgr2=0x55b778867ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:58:52.585 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.583+0000 7f2d0c9c4700 1 --2- 172.21.15.76:0/2346891060 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b7788582d0 0x55b778867ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:52.585 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.583+0000 7f2d0c9c4700 1 -- 172.21.15.76:0/2346891060 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d0400ba30 con 0x55b7788573e0 2024-06-02T04:58:52.585 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.583+0000 7f2d0d9c6700 1 --2- 172.21.15.76:0/2346891060 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b7788582d0 0x55b778867ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T04:58:52.585 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.583+0000 7f2d0c9c4700 1 --2- 172.21.15.76:0/2346891060 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b7788573e0 0x55b778860eb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f2d0400f010 tx=0x7f2d04006680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4609d2c045b079f0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:58:52.585 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.583+0000 7f2cf0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-06-02T04:58:52.585 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.583+0000 7f2cf0ff9700 1 -- 172.21.15.76:0/2346891060 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d04010040 con 0x55b7788573e0 2024-06-02T04:58:52.586 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.583+0000 7f2cf0ff9700 1 -- 172.21.15.76:0/2346891060 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f2d04014800 con 0x55b7788573e0 2024-06-02T04:58:52.586 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.583+0000 7f2d1b5e4b80 1 -- 172.21.15.76:0/2346891060 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b778700210 con 0x55b7788573e0 2024-06-02T04:58:52.586 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.583+0000 7f2cf0ff9700 1 -- 172.21.15.76:0/2346891060 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2d0400b8b0 con 0x55b7788573e0 2024-06-02T04:58:52.586 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.583+0000 7f2d1b5e4b80 10 client.25934 fetch_fsmap learned FSMap version 36 2024-06-02T04:58:52.586 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.583+0000 7f2d1b5e4b80 1 -- 172.21.15.76:0/2346891060 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55b7785d4b00 con 0x55b7788573e0 2024-06-02T04:58:52.586 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.584+0000 7f2cf0ff9700 1 -- 172.21.15.76:0/2346891060 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b778700210 con 0x55b7788573e0 2024-06-02T04:58:52.588 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.584+0000 7f2cf0ff9700 1 -- 172.21.15.76:0/2346891060 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f2d04013cb0 con 0x55b7788573e0 2024-06-02T04:58:52.588 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.585+0000 7f2d1b5e4b80 10 client.25934 fetch_fsmap finished waiting for FSMap version 36 2024-06-02T04:58:52.588 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.585+0000 7f2d1b5e4b80 10 client.25934 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T04:58:52.588 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.585+0000 7f2d1b5e4b80 20 client.25934 populate_metadata read hostname 'smithi076' 2024-06-02T04:58:52.588 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.585+0000 7f2d1b5e4b80 1 --2- 172.21.15.76:0/2346891060 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55b77886c750 0x55b77886eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:58:52.588 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.585+0000 7f2d1b5e4b80 4 client.25934 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T04:58:52.588 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.585+0000 7f2d1b5e4b80 1 -- 172.21.15.76:0/2346891060 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b7788267b0 con 0x55b77886c750 2024-06-02T04:58:52.588 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.585+0000 7f2d0d1c5700 1 --2- 172.21.15.76:0/2346891060 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55b77886c750 0x55b77886eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:58:52.588 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.586+0000 7f2cf0ff9700 10 client.25934 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:58:52.588 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.586+0000 7f2d0d1c5700 1 --2- 172.21.15.76:0/2346891060 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55b77886c750 0x55b77886eb70 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b79cbe8148ce1f77 server_cookie=e37deaf331a3bd2 in_seq=0 out_seq=0 2024-06-02T04:58:52.589 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.586+0000 7f2cf0ff9700 1 -- 172.21.15.76:0/2346891060 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55b7788267b0 con 0x55b77886c750 2024-06-02T04:58:52.589 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.586+0000 7f2cf0ff9700 10 client.25934 handle_command_reply: tid=0 2024-06-02T04:58:52.589 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.586+0000 7f2d1b5e4b80 1 client.25934 shutdown 2024-06-02T04:58:52.589 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.586+0000 7f2d1b5e4b80 1 -- 172.21.15.76:0/2346891060 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b7788573e0 msgr2=0x55b778860eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:58:52.589 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.586+0000 7f2d1b5e4b80 1 --2- 172.21.15.76:0/2346891060 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b7788573e0 0x55b778860eb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f2d0400f010 tx=0x7f2d04006680 comp rx=0 tx=0).stop 2024-06-02T04:58:52.589 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.587+0000 7f2d1b5e4b80 1 -- 172.21.15.76:0/2346891060 shutdown_connections 2024-06-02T04:58:52.589 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.587+0000 7f2d1b5e4b80 1 --2- 172.21.15.76:0/2346891060 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55b77886c750 0x55b77886eb70 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:52.589 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.587+0000 7f2d1b5e4b80 1 --2- 172.21.15.76:0/2346891060 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b7788582d0 0x55b778867ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:52.589 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.587+0000 7f2d1b5e4b80 1 --2- 172.21.15.76:0/2346891060 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b778856a80 0x55b778860970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:52.589 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.587+0000 7f2cf0ff9700 0 client.25934 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:58:52.589 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.587+0000 7f2d1b5e4b80 1 --2- 172.21.15.76:0/2346891060 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b7788573e0 0x55b778860eb0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:52.589 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.587+0000 7f2d1b5e4b80 1 -- 172.21.15.76:0/2346891060 >> 172.21.15.76:0/2346891060 conn(0x55b7787b51b0 msgr2=0x55b778851860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:58:52.590 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.588+0000 7f2d1b5e4b80 1 -- 172.21.15.76:0/2346891060 shutdown_connections 2024-06-02T04:58:52.594 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.591+0000 7f2d1b5e4b80 1 -- 172.21.15.76:0/2346891060 wait complete. 2024-06-02T04:58:52.597 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.597+0000 7f2d1b5e4b80 20 client.25934 trim_cache size 0 max 16384 2024-06-02T04:58:52.620 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.620+0000 7f2d1b5e4b80 1 Processor -- start 2024-06-02T04:58:52.621 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.620+0000 7f2d1b5e4b80 1 -- start start 2024-06-02T04:58:52.621 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.620+0000 7f2d1b5e4b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b778856a80 0x55b778856e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:58:52.621 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.620+0000 7f2d1b5e4b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b7788573e0 0x55b778867eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:58:52.621 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.620+0000 7f2d1b5e4b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b7788582d0 0x55b778858710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:58:52.621 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.620+0000 7f2d1b5e4b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b77884c7c0 con 0x55b7788582d0 2024-06-02T04:58:52.621 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.620+0000 7f2d1b5e4b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b77884e9b0 con 0x55b778856a80 2024-06-02T04:58:52.621 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.620+0000 7f2d1b5e4b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b778861870 con 0x55b7788573e0 2024-06-02T04:58:52.622 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.621+0000 7f2d0c9c4700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b7788573e0 0x55b778867eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:58:52.622 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.621+0000 7f2d0d1c5700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b778856a80 0x55b778856e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:58:52.623 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.621+0000 7f2d0c9c4700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b7788573e0 0x55b778867eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:44456/0 (socket says 172.21.15.76:44456) 2024-06-02T04:58:52.623 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.621+0000 7f2d0c9c4700 1 -- 172.21.15.76:0/30732914 learned_addr learned my addr 172.21.15.76:0/30732914 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:58:52.623 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.621+0000 7f2d0d9c6700 1 --2- 172.21.15.76:0/30732914 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b7788582d0 0x55b778858710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:58:52.623 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.621+0000 7f2d0c9c4700 1 -- 172.21.15.76:0/30732914 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b778856a80 msgr2=0x55b778856e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:58:52.623 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.621+0000 7f2d0c9c4700 1 --2- 172.21.15.76:0/30732914 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b778856a80 0x55b778856e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:52.623 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.621+0000 7f2d0c9c4700 1 -- 172.21.15.76:0/30732914 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b7788582d0 msgr2=0x55b778858710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:58:52.623 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.621+0000 7f2d0c9c4700 1 --2- 172.21.15.76:0/30732914 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b7788582d0 0x55b778858710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:52.623 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.621+0000 7f2d0c9c4700 1 -- 172.21.15.76:0/30732914 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b77876d500 con 0x55b7788573e0 2024-06-02T04:58:52.623 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.621+0000 7f2d0d9c6700 1 --2- 172.21.15.76:0/30732914 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b7788582d0 0x55b778858710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:58:52.623 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.621+0000 7f2d0c9c4700 1 --2- 172.21.15.76:0/30732914 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b7788573e0 0x55b778867eb0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2d04013650 tx=0x7f2d04003720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d07c1d23c6ed8e8 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:58:52.623 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.622+0000 7f2cf3fff700 1 -- 172.21.15.76:0/30732914 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d04010040 con 0x55b7788573e0 2024-06-02T04:58:52.623 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.622+0000 7f2cf3fff700 1 -- 172.21.15.76:0/30732914 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2d0400b8b0 con 0x55b7788573e0 2024-06-02T04:58:52.623 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.622+0000 7f2cf3fff700 1 -- 172.21.15.76:0/30732914 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d04028c20 con 0x55b7788573e0 2024-06-02T04:58:52.624 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.623+0000 7f2d1b5e4b80 1 -- 172.21.15.76:0/30732914 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b7788573e0 msgr2=0x55b778867eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:58:52.624 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.623+0000 7f2d1b5e4b80 1 --2- 172.21.15.76:0/30732914 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b7788573e0 0x55b778867eb0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2d04013650 tx=0x7f2d04003720 comp rx=0 tx=0).stop 2024-06-02T04:58:52.626 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.626+0000 7f2d1b5e4b80 1 -- 172.21.15.76:0/30732914 shutdown_connections 2024-06-02T04:58:52.627 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.626+0000 7f2d1b5e4b80 1 --2- 172.21.15.76:0/30732914 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b7788582d0 0x55b778858710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:52.627 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.626+0000 7f2d1b5e4b80 1 --2- 172.21.15.76:0/30732914 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b778856a80 0x55b778856e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:52.627 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.626+0000 7f2d1b5e4b80 1 --2- 172.21.15.76:0/30732914 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b7788573e0 0x55b778867eb0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:52.627 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.626+0000 7f2d1b5e4b80 1 -- 172.21.15.76:0/30732914 >> 172.21.15.76:0/30732914 conn(0x55b7787b51b0 msgr2=0x55b77885fe80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:58:52.627 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.626+0000 7f2d1b5e4b80 1 -- 172.21.15.76:0/30732914 shutdown_connections 2024-06-02T04:58:52.627 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.626+0000 7f2d1b5e4b80 1 -- 172.21.15.76:0/30732914 wait complete. 2024-06-02T04:58:52.628 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.626+0000 7f2d1b5e4b80 1 -- start start 2024-06-02T04:58:52.628 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.627+0000 7f2d1b5e4b80 1 Processor -- start 2024-06-02T04:58:52.628 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.627+0000 7f2d1b5e4b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b778856a80 0x55b778864b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:58:52.629 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.627+0000 7f2d1b5e4b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b7788573e0 0x55b778865050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:58:52.629 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.627+0000 7f2d1b5e4b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b7788582d0 0x55b7788c0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:58:52.629 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.627+0000 7f2d1b5e4b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b778868070 con 0x55b778856a80 2024-06-02T04:58:52.629 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.627+0000 7f2d1b5e4b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7788681e0 con 0x55b7788582d0 2024-06-02T04:58:52.629 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.627+0000 7f2d1b5e4b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7788c1130 con 0x55b7788573e0 2024-06-02T04:58:52.629 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.627+0000 7f2d1b5e4b80 10 client.0 _ll_register_callbacks cb 0x55b77874cad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:58:52.629 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.627+0000 7f2d0d1c5700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b778856a80 0x55b778864b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:58:52.629 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.627+0000 7f2d0d1c5700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b778856a80 0x55b778864b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:54058/0 (socket says 172.21.15.76:54058) 2024-06-02T04:58:52.629 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.627+0000 7f2d0d1c5700 1 -- 172.21.15.76:0/3402718666 learned_addr learned my addr 172.21.15.76:0/3402718666 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:58:52.629 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.627+0000 7f2d0c9c4700 1 --2- 172.21.15.76:0/3402718666 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b7788573e0 0x55b778865050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:58:52.629 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.628+0000 7f2d0d9c6700 1 --2- 172.21.15.76:0/3402718666 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b7788582d0 0x55b7788c0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:58:52.629 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.628+0000 7f2d0c9c4700 1 -- 172.21.15.76:0/3402718666 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b7788582d0 msgr2=0x55b7788c0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:58:52.630 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.628+0000 7f2d0c9c4700 1 --2- 172.21.15.76:0/3402718666 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b7788582d0 0x55b7788c0bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:52.630 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.628+0000 7f2d0c9c4700 1 -- 172.21.15.76:0/3402718666 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b778856a80 msgr2=0x55b778864b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:58:52.630 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.628+0000 7f2d0c9c4700 1 --2- 172.21.15.76:0/3402718666 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b778856a80 0x55b778864b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:52.630 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.628+0000 7f2d0c9c4700 1 -- 172.21.15.76:0/3402718666 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b7785d4b00 con 0x55b7788573e0 2024-06-02T04:58:52.630 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.628+0000 7f2d0d9c6700 1 --2- 172.21.15.76:0/3402718666 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b7788582d0 0x55b7788c0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:58:52.630 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.628+0000 7f2d0c9c4700 1 --2- 172.21.15.76:0/3402718666 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b7788573e0 0x55b778865050 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2d040036f0 tx=0x7f2d04006680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b03be46f1737970c server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:58:52.631 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.628+0000 7f2cf0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.192:3300/0 2024-06-02T04:58:52.631 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.628+0000 7f2cf0ff9700 1 -- 172.21.15.76:0/3402718666 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d04010040 con 0x55b7788573e0 2024-06-02T04:58:52.632 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.628+0000 7f2cf0ff9700 1 -- 172.21.15.76:0/3402718666 <== mon.1 v2:172.21.15.192:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f2d04006870 con 0x55b7788573e0 2024-06-02T04:58:52.632 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.628+0000 7f2d1b5e4b80 1 -- 172.21.15.76:0/3402718666 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b77879fe60 con 0x55b7788573e0 2024-06-02T04:58:52.632 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.629+0000 7f2cf0ff9700 1 -- 172.21.15.76:0/3402718666 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2d04013a90 con 0x55b7788573e0 2024-06-02T04:58:52.632 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.629+0000 7f2d1b5e4b80 10 client.25891 fetch_fsmap learned FSMap version 36 2024-06-02T04:58:52.632 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.629+0000 7f2d1b5e4b80 1 -- 172.21.15.76:0/3402718666 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55b77862cc70 con 0x55b7788573e0 2024-06-02T04:58:52.632 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.629+0000 7f2cf0ff9700 1 -- 172.21.15.76:0/3402718666 <== mon.1 v2:172.21.15.192:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b77879fe60 con 0x55b7788573e0 2024-06-02T04:58:52.632 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.630+0000 7f2cf0ff9700 1 -- 172.21.15.76:0/3402718666 <== mon.1 v2:172.21.15.192:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f2d0404c070 con 0x55b7788573e0 2024-06-02T04:58:52.632 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.630+0000 7f2d1b5e4b80 10 client.25891 fetch_fsmap finished waiting for FSMap version 36 2024-06-02T04:58:52.632 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.630+0000 7f2d1b5e4b80 10 client.25891 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T04:58:52.632 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.630+0000 7f2d1b5e4b80 20 client.25891 populate_metadata read hostname 'smithi076' 2024-06-02T04:58:52.632 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.630+0000 7f2d1b5e4b80 1 --2- 172.21.15.76:0/3402718666 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55b7788c2490 0x55b7788c4880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:58:52.632 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.630+0000 7f2d1b5e4b80 4 client.25891 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T04:58:52.632 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.630+0000 7f2d1b5e4b80 1 -- 172.21.15.76:0/3402718666 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55b7785f5c90 con 0x55b7788c2490 2024-06-02T04:58:52.633 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.630+0000 7f2d0d1c5700 1 --2- 172.21.15.76:0/3402718666 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55b7788c2490 0x55b7788c4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:58:52.633 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.631+0000 7f2d0d1c5700 1 --2- 172.21.15.76:0/3402718666 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55b7788c2490 0x55b7788c4880 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6607a624e83ca699 server_cookie=e12c7ad3d9b974be in_seq=0 out_seq=0 2024-06-02T04:58:52.633 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.631+0000 7f2cf0ff9700 10 client.25891 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:58:52.662 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.662+0000 7f2cf0ff9700 1 -- 172.21.15.76:0/3402718666 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55b7785f5c90 con 0x55b7788c2490 2024-06-02T04:58:52.663 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.662+0000 7f2cf0ff9700 10 client.25891 handle_command_reply: tid=0 2024-06-02T04:58:52.663 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.662+0000 7f2d1b5e4b80 1 client.25891 shutdown 2024-06-02T04:58:52.663 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.663+0000 7f2d1b5e4b80 1 -- 172.21.15.76:0/3402718666 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b7788573e0 msgr2=0x55b778865050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:58:52.663 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.663+0000 7f2d1b5e4b80 1 --2- 172.21.15.76:0/3402718666 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b7788573e0 0x55b778865050 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2d040036f0 tx=0x7f2d04006680 comp rx=0 tx=0).stop 2024-06-02T04:58:52.664 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.663+0000 7f2d1b5e4b80 1 -- 172.21.15.76:0/3402718666 shutdown_connections 2024-06-02T04:58:52.664 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.663+0000 7f2d1b5e4b80 1 --2- 172.21.15.76:0/3402718666 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55b7788c2490 0x55b7788c4880 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:52.664 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.663+0000 7f2d1b5e4b80 1 --2- 172.21.15.76:0/3402718666 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b7788582d0 0x55b7788c0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:52.664 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.663+0000 7f2cf0ff9700 0 client.25891 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:58:52.664 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.663+0000 7f2d1b5e4b80 1 --2- 172.21.15.76:0/3402718666 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b778856a80 0x55b778864b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:52.664 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.663+0000 7f2d1b5e4b80 1 --2- 172.21.15.76:0/3402718666 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b7788573e0 0x55b778865050 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:52.664 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.663+0000 7f2d1b5e4b80 1 -- 172.21.15.76:0/3402718666 >> 172.21.15.76:0/3402718666 conn(0x55b7787b51b0 msgr2=0x55b77885fe80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:58:52.664 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.663+0000 7f2d1b5e4b80 1 -- 172.21.15.76:0/3402718666 shutdown_connections 2024-06-02T04:58:52.664 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.663+0000 7f2d1b5e4b80 1 -- 172.21.15.76:0/3402718666 wait complete. 2024-06-02T04:58:52.665 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.665+0000 7f2d1b5e4b80 20 client.25891 trim_cache size 0 max 16384 2024-06-02T04:58:52.666 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:{ 2024-06-02T04:58:52.666 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "message": "", 2024-06-02T04:58:52.666 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "return_code": 0 2024-06-02T04:58:52.666 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:} 2024-06-02T04:58:52.667 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.666+0000 7f2d0f429700 1 -- 172.21.15.76:0/291512928 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f2cf40a1220 msgr2=0x7f2cf40a36e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:58:52.667 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.666+0000 7f2d0f429700 1 --2- 172.21.15.76:0/291512928 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f2cf40a1220 0x7f2cf40a36e0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f2d04016000 tx=0x7f2d04014410 comp rx=0 tx=0).stop 2024-06-02T04:58:52.667 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.666+0000 7f2d0f429700 1 -- 172.21.15.76:0/291512928 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d08101150 msgr2=0x7f2d08193820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:58:52.667 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.666+0000 7f2d0f429700 1 --2- 172.21.15.76:0/291512928 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d08101150 0x7f2d08193820 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2cf8005780 tx=0x7f2cf80057b0 comp rx=0 tx=0).stop 2024-06-02T04:58:52.667 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.667+0000 7f2d0f429700 1 -- 172.21.15.76:0/291512928 shutdown_connections 2024-06-02T04:58:52.667 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.667+0000 7f2d0f429700 1 --2- 172.21.15.76:0/291512928 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d08101150 0x7f2d08193820 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:52.667 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.667+0000 7f2d0f429700 1 --2- 172.21.15.76:0/291512928 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f2cf40a1220 0x7f2cf40a36e0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:52.667 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.667+0000 7f2d0f429700 1 --2- 172.21.15.76:0/291512928 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d080ff5c0 0x7f2d08107820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:52.668 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.667+0000 7f2d0f429700 1 --2- 172.21.15.76:0/291512928 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2d081007b0 0x7f2d081912d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:58:52.668 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.667+0000 7f2d0f429700 1 -- 172.21.15.76:0/291512928 >> 172.21.15.76:0/291512928 conn(0x7f2d080fab30 msgr2=0x7f2d080fc430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:58:52.668 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.668+0000 7f2d0f429700 1 -- 172.21.15.76:0/291512928 shutdown_connections 2024-06-02T04:58:52.669 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:58:52.668+0000 7f2d0f429700 1 -- 172.21.15.76:0/291512928 wait complete. 2024-06-02T04:58:53.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:58:53 smithi119 ceph-mon[46633]: pgmap v547: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 8.4 MiB/s wr, 786 op/s 2024-06-02T04:58:53.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:58:53 smithi192 ceph-mon[47933]: pgmap v547: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 8.4 MiB/s wr, 786 op/s 2024-06-02T04:58:53.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:58:53 smithi076 ceph-mon[42935]: pgmap v547: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 8.4 MiB/s wr, 786 op/s 2024-06-02T04:58:55.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:58:55 smithi119 ceph-mon[46633]: pgmap v548: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 8.4 MiB/s wr, 757 op/s 2024-06-02T04:58:55.933 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:58:55 smithi192 ceph-mon[47933]: pgmap v548: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 8.4 MiB/s wr, 757 op/s 2024-06-02T04:58:55.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:58:55 smithi076 ceph-mon[42935]: pgmap v548: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 8.4 MiB/s wr, 757 op/s 2024-06-02T04:58:56.324 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 485.0 s, 656.2 tps, lat 152.015 ms stddev 53.513 2024-06-02T04:58:57.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:58:57 smithi119 ceph-mon[46633]: pgmap v549: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 9.5 MiB/s wr, 832 op/s 2024-06-02T04:58:57.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:58:57 smithi192 ceph-mon[47933]: pgmap v549: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 9.5 MiB/s wr, 832 op/s 2024-06-02T04:58:57.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:58:57 smithi076 ceph-mon[42935]: pgmap v549: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 9.5 MiB/s wr, 832 op/s 2024-06-02T04:58:59.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:58:59 smithi119 ceph-mon[46633]: pgmap v550: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 9.0 MiB/s wr, 800 op/s 2024-06-02T04:58:59.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:58:59 smithi192 ceph-mon[47933]: pgmap v550: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 9.0 MiB/s wr, 800 op/s 2024-06-02T04:58:59.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:58:59 smithi076 ceph-mon[42935]: pgmap v550: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 9.0 MiB/s wr, 800 op/s 2024-06-02T04:59:01.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 490.0 s, 643.4 tps, lat 139.887 ms stddev 72.692 2024-06-02T04:59:01.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:59:01 smithi119 ceph-mon[46633]: pgmap v551: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 9.4 MiB/s wr, 839 op/s 2024-06-02T04:59:01.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:59:01 smithi192 ceph-mon[47933]: pgmap v551: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 9.4 MiB/s wr, 839 op/s 2024-06-02T04:59:01.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:59:01 smithi076 ceph-mon[42935]: pgmap v551: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 9.4 MiB/s wr, 839 op/s 2024-06-02T04:59:03.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:59:03 smithi119 ceph-mon[46633]: pgmap v552: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 12 MiB/s wr, 832 op/s 2024-06-02T04:59:03.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:59:03 smithi192 ceph-mon[47933]: pgmap v552: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 12 MiB/s wr, 832 op/s 2024-06-02T04:59:03.985 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:59:03 smithi076 ceph-mon[42935]: pgmap v552: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 12 MiB/s wr, 832 op/s 2024-06-02T04:59:05.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:59:05 smithi119 ceph-mon[46633]: pgmap v553: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 12 MiB/s wr, 776 op/s 2024-06-02T04:59:05.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:59:05 smithi192 ceph-mon[47933]: pgmap v553: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 12 MiB/s wr, 776 op/s 2024-06-02T04:59:05.954 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.953+0000 7f872be76700 1 -- 172.21.15.76:0/599250669 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8724100ff0 msgr2=0x7f8724101450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:59:05.954 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.953+0000 7f872be76700 1 --2- 172.21.15.76:0/599250669 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8724100ff0 0x7f8724101450 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f87140099c0 tx=0x7f8714009cd0 comp rx=0 tx=0).stop 2024-06-02T04:59:05.956 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.955+0000 7f872be76700 1 -- 172.21.15.76:0/599250669 shutdown_connections 2024-06-02T04:59:05.956 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.955+0000 7f872be76700 1 --2- 172.21.15.76:0/599250669 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8724101990 0x7f8724108240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:05.956 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.956+0000 7f872be76700 1 --2- 172.21.15.76:0/599250669 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f87240ffe00 0x7f8724100220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:05.956 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.956+0000 7f872be76700 1 --2- 172.21.15.76:0/599250669 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8724100ff0 0x7f8724101450 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:05.956 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.956+0000 7f872be76700 1 -- 172.21.15.76:0/599250669 >> 172.21.15.76:0/599250669 conn(0x7f87240fb390 msgr2=0x7f87240fd7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:59:05.957 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.956+0000 7f872be76700 1 -- 172.21.15.76:0/599250669 shutdown_connections 2024-06-02T04:59:05.957 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.956+0000 7f872be76700 1 -- 172.21.15.76:0/599250669 wait complete. 2024-06-02T04:59:05.957 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.957+0000 7f872be76700 1 Processor -- start 2024-06-02T04:59:05.961 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.960+0000 7f872be76700 1 -- start start 2024-06-02T04:59:05.961 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.960+0000 7f872be76700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f87240ffe00 0x7f8724196e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:59:05.961 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.960+0000 7f872be76700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8724100ff0 0x7f8724197390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:59:05.961 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.960+0000 7f872be76700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8724101990 0x7f872419e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:59:05.961 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.960+0000 7f872be76700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f872419e980 con 0x7f8724100ff0 2024-06-02T04:59:05.961 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.960+0000 7f872be76700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f872406a9c0 con 0x7f8724101990 2024-06-02T04:59:05.961 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.960+0000 7f872be76700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f872406ab50 con 0x7f87240ffe00 2024-06-02T04:59:05.961 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.960+0000 7f8729c12700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f87240ffe00 0x7f8724196e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:59:05.962 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.961+0000 7f872a413700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8724101990 0x7f872419e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:59:05.962 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.961+0000 7f872a413700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8724101990 0x7f872419e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:55428/0 (socket says 172.21.15.76:55428) 2024-06-02T04:59:05.962 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.961+0000 7f872a413700 1 -- 172.21.15.76:0/3346892444 learned_addr learned my addr 172.21.15.76:0/3346892444 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:59:05.962 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.961+0000 7f872a413700 1 -- 172.21.15.76:0/3346892444 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f87240ffe00 msgr2=0x7f8724196e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:59:05.962 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.961+0000 7f872a413700 1 --2- 172.21.15.76:0/3346892444 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f87240ffe00 0x7f8724196e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:05.962 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.961+0000 7f872a413700 1 -- 172.21.15.76:0/3346892444 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8724100ff0 msgr2=0x7f8724197390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:59:05.962 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.961+0000 7f872a413700 1 --2- 172.21.15.76:0/3346892444 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8724100ff0 0x7f8724197390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:05.962 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.961+0000 7f872a413700 1 -- 172.21.15.76:0/3346892444 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87140095f0 con 0x7f8724101990 2024-06-02T04:59:05.962 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.961+0000 7f872a413700 1 --2- 172.21.15.76:0/3346892444 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8724101990 0x7f872419e3b0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f871c00b970 tx=0x7f871c00bc80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:59:05.963 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.962+0000 7f871affd700 1 -- 172.21.15.76:0/3346892444 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f871c00c930 con 0x7f8724101990 2024-06-02T04:59:05.963 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.962+0000 7f871affd700 1 -- 172.21.15.76:0/3346892444 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f871c014440 con 0x7f8724101990 2024-06-02T04:59:05.964 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.962+0000 7f871affd700 1 -- 172.21.15.76:0/3346892444 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f871c0075d0 con 0x7f8724101990 2024-06-02T04:59:05.968 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.963+0000 7f872be76700 1 -- 172.21.15.76:0/3346892444 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f872406ae30 con 0x7f8724101990 2024-06-02T04:59:05.969 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.963+0000 7f872be76700 1 -- 172.21.15.76:0/3346892444 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f872406b2c0 con 0x7f8724101990 2024-06-02T04:59:05.969 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.968+0000 7f8738031b80 1 Processor -- start 2024-06-02T04:59:05.969 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.969+0000 7f8738031b80 1 -- start start 2024-06-02T04:59:05.969 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.969+0000 7f8738031b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562bf846a7b0 0x562bf846abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:59:05.969 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.969+0000 7f8738031b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562bf846b110 0x562bf8478b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:59:05.969 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.969+0000 7f8738031b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562bf84790a0 0x562bf847b490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:59:05.970 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.969+0000 7f8738031b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bf83c20f0 con 0x562bf84790a0 2024-06-02T04:59:05.970 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.969+0000 7f8738031b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bf83bfab0 con 0x562bf846a7b0 2024-06-02T04:59:05.970 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.969+0000 7f8738031b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bf83bb3a0 con 0x562bf846b110 2024-06-02T04:59:05.970 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.970+0000 7f8729c12700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562bf846b110 0x562bf8478b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:59:05.970 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.970+0000 7f8729c12700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562bf846b110 0x562bf8478b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:43668/0 (socket says 172.21.15.76:43668) 2024-06-02T04:59:05.971 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.970+0000 7f8729c12700 1 -- 172.21.15.76:0/106483911 learned_addr learned my addr 172.21.15.76:0/106483911 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:59:05.971 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.970+0000 7f8729c12700 1 -- 172.21.15.76:0/106483911 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562bf846a7b0 msgr2=0x562bf846abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:59:05.971 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.970+0000 7f8729c12700 1 --2- 172.21.15.76:0/106483911 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562bf846a7b0 0x562bf846abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:05.972 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.970+0000 7f8729c12700 1 -- 172.21.15.76:0/106483911 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562bf84790a0 msgr2=0x562bf847b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:59:05.972 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.970+0000 7f8729c12700 1 --2- 172.21.15.76:0/106483911 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562bf84790a0 0x562bf847b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:05.972 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.970+0000 7f8729c12700 1 -- 172.21.15.76:0/106483911 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562bf823c350 con 0x562bf846b110 2024-06-02T04:59:05.972 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.971+0000 7f8729c12700 1 --2- 172.21.15.76:0/106483911 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562bf846b110 0x562bf8478b60 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8720009d30 tx=0x7f8720011720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a699999cc20a1ac server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:59:05.972 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.971+0000 7f870ffff700 1 -- 172.21.15.76:0/106483911 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8720004220 con 0x562bf846b110 2024-06-02T04:59:05.972 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.971+0000 7f870ffff700 1 -- 172.21.15.76:0/106483911 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8720004380 con 0x562bf846b110 2024-06-02T04:59:05.972 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.971+0000 7f870ffff700 1 -- 172.21.15.76:0/106483911 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87200197a0 con 0x562bf846b110 2024-06-02T04:59:05.973 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.971+0000 7f871affd700 1 -- 172.21.15.76:0/3346892444 <== mon.2 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f871c0145b0 con 0x7f8724101990 2024-06-02T04:59:05.973 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.972+0000 7f871affd700 1 --2- 172.21.15.76:0/3346892444 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f87100a12f0 0x7f87100a37b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:59:05.973 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.972+0000 7f8738031b80 1 -- 172.21.15.76:0/106483911 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562bf846b110 msgr2=0x562bf8478b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:59:05.973 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.972+0000 7f8738031b80 1 --2- 172.21.15.76:0/106483911 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562bf846b110 0x562bf8478b60 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8720009d30 tx=0x7f8720011720 comp rx=0 tx=0).stop 2024-06-02T04:59:05.973 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.972+0000 7f871affd700 1 -- 172.21.15.76:0/3346892444 <== mon.2 v2:172.21.15.119:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f871c006e40 con 0x7f8724101990 2024-06-02T04:59:05.974 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.972+0000 7f8738031b80 1 -- 172.21.15.76:0/106483911 shutdown_connections 2024-06-02T04:59:05.974 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.972+0000 7f8738031b80 1 --2- 172.21.15.76:0/106483911 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562bf84790a0 0x562bf847b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:05.974 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.972+0000 7f8738031b80 1 --2- 172.21.15.76:0/106483911 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562bf846a7b0 0x562bf846abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:05.974 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.972+0000 7f8738031b80 1 --2- 172.21.15.76:0/106483911 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562bf846b110 0x562bf8478b60 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:05.974 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.972+0000 7f8738031b80 1 -- 172.21.15.76:0/106483911 >> 172.21.15.76:0/106483911 conn(0x562bf83c91b0 msgr2=0x562bf8467440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:59:05.974 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.972+0000 7f8729411700 1 --2- 172.21.15.76:0/3346892444 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f87100a12f0 0x7f87100a37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:59:05.974 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.973+0000 7f8729411700 1 --2- 172.21.15.76:0/3346892444 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f87100a12f0 0x7f87100a37b0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f8714005b40 tx=0x7f8714005ab0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:59:05.976 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.975+0000 7f8738031b80 1 -- 172.21.15.76:0/106483911 shutdown_connections 2024-06-02T04:59:05.976 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.975+0000 7f8738031b80 1 -- 172.21.15.76:0/106483911 wait complete. 2024-06-02T04:59:05.977 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.976+0000 7f8738031b80 1 -- start start 2024-06-02T04:59:05.977 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.976+0000 7f8738031b80 1 Processor -- start 2024-06-02T04:59:05.977 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.977+0000 7f8738031b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562bf846a7b0 0x562bf847d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:59:05.977 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.977+0000 7f8738031b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562bf846b110 0x562bf847d680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:59:05.977 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.977+0000 7f8738031b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562bf84790a0 0x562bf84846c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:59:05.978 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.977+0000 7f8738031b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bf8357500 con 0x562bf846a7b0 2024-06-02T04:59:05.978 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.977+0000 7f8738031b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bf83571a0 con 0x562bf84790a0 2024-06-02T04:59:05.978 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.977+0000 7f8738031b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bf823e640 con 0x562bf846b110 2024-06-02T04:59:05.978 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.977+0000 7f8738031b80 10 client.0 _ll_register_callbacks cb 0x562bf8360ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:59:05.979 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.977+0000 7f8729c12700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562bf846a7b0 0x562bf847d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:59:05.979 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.977+0000 7f8729c12700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562bf846a7b0 0x562bf847d140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:53594/0 (socket says 172.21.15.76:53594) 2024-06-02T04:59:05.979 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.977+0000 7f8729c12700 1 -- 172.21.15.76:0/2842600528 learned_addr learned my addr 172.21.15.76:0/2842600528 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:59:05.979 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.977+0000 7f8729c12700 1 -- 172.21.15.76:0/2842600528 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562bf846b110 msgr2=0x562bf847d680 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-02T04:59:05.979 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.977+0000 7f8729c12700 1 --2- 172.21.15.76:0/2842600528 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562bf846b110 0x562bf847d680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:05.979 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.977+0000 7f8729c12700 1 -- 172.21.15.76:0/2842600528 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562bf84790a0 msgr2=0x562bf84846c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-02T04:59:05.980 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.977+0000 7f8729c12700 1 --2- 172.21.15.76:0/2842600528 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562bf84790a0 0x562bf84846c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:05.980 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.978+0000 7f8729c12700 1 -- 172.21.15.76:0/2842600528 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8720009960 con 0x562bf846a7b0 2024-06-02T04:59:05.980 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.978+0000 7f8729c12700 1 --2- 172.21.15.76:0/2842600528 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562bf846a7b0 0x562bf847d140 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f8720009610 tx=0x7f8720003730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5835f0bc99c96d11 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:59:05.980 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.978+0000 7f870d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-06-02T04:59:05.980 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.978+0000 7f870d7fa700 1 -- 172.21.15.76:0/2842600528 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8720005240 con 0x562bf846a7b0 2024-06-02T04:59:05.980 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.978+0000 7f870d7fa700 1 -- 172.21.15.76:0/2842600528 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f87200053a0 con 0x562bf846a7b0 2024-06-02T04:59:05.980 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.978+0000 7f8738031b80 1 -- 172.21.15.76:0/2842600528 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562bf8314210 con 0x562bf846a7b0 2024-06-02T04:59:05.980 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.978+0000 7f870d7fa700 1 -- 172.21.15.76:0/2842600528 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8720005560 con 0x562bf846a7b0 2024-06-02T04:59:05.983 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.983+0000 7f8738031b80 10 client.16329 fetch_fsmap learned FSMap version 36 2024-06-02T04:59:05.983 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.983+0000 7f8738031b80 1 -- 172.21.15.76:0/2842600528 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x562bf81e8b00 con 0x562bf846a7b0 2024-06-02T04:59:05.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:59:05 smithi076 ceph-mon[42935]: pgmap v553: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 12 MiB/s wr, 776 op/s 2024-06-02T04:59:05.984 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.983+0000 7f870d7fa700 1 -- 172.21.15.76:0/2842600528 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x562bf8314210 con 0x562bf846a7b0 2024-06-02T04:59:05.984 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.983+0000 7f870d7fa700 1 -- 172.21.15.76:0/2842600528 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f8720021040 con 0x562bf846a7b0 2024-06-02T04:59:05.984 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.983+0000 7f8738031b80 10 client.16329 fetch_fsmap finished waiting for FSMap version 36 2024-06-02T04:59:05.985 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.983+0000 7f8738031b80 10 client.16329 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T04:59:05.985 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.983+0000 7f8738031b80 20 client.16329 populate_metadata read hostname 'smithi076' 2024-06-02T04:59:05.985 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.983+0000 7f8738031b80 1 --2- 172.21.15.76:0/2842600528 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x562bf8488f20 0x562bf848b340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:59:05.985 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.983+0000 7f8738031b80 4 client.16329 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T04:59:05.985 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.983+0000 7f8738031b80 1 -- 172.21.15.76:0/2842600528 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562bf843a7b0 con 0x562bf8488f20 2024-06-02T04:59:05.985 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.984+0000 7f8729411700 1 --2- 172.21.15.76:0/2842600528 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x562bf8488f20 0x562bf848b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:59:05.986 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.984+0000 7f8729411700 1 --2- 172.21.15.76:0/2842600528 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x562bf8488f20 0x562bf848b340 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5b0dfb0df984200b server_cookie=dc8167b7757e5437 in_seq=0 out_seq=0 2024-06-02T04:59:05.986 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.984+0000 7f870d7fa700 10 client.16329 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:59:05.987 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.985+0000 7f870d7fa700 1 -- 172.21.15.76:0/2842600528 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x562bf843a7b0 con 0x562bf8488f20 2024-06-02T04:59:05.987 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.985+0000 7f870d7fa700 10 client.16329 handle_command_reply: tid=0 2024-06-02T04:59:05.987 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.985+0000 7f8738031b80 1 client.16329 shutdown 2024-06-02T04:59:05.987 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.985+0000 7f8738031b80 1 -- 172.21.15.76:0/2842600528 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562bf846a7b0 msgr2=0x562bf847d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:59:05.987 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.985+0000 7f8738031b80 1 --2- 172.21.15.76:0/2842600528 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562bf846a7b0 0x562bf847d140 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f8720009610 tx=0x7f8720003730 comp rx=0 tx=0).stop 2024-06-02T04:59:05.987 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.985+0000 7f8738031b80 1 -- 172.21.15.76:0/2842600528 shutdown_connections 2024-06-02T04:59:05.987 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.985+0000 7f8738031b80 1 --2- 172.21.15.76:0/2842600528 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x562bf8488f20 0x562bf848b340 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:05.987 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.985+0000 7f8738031b80 1 --2- 172.21.15.76:0/2842600528 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562bf84790a0 0x562bf84846c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:05.987 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.985+0000 7f8738031b80 1 --2- 172.21.15.76:0/2842600528 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562bf846a7b0 0x562bf847d140 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:05.987 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.985+0000 7f8738031b80 1 --2- 172.21.15.76:0/2842600528 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562bf846b110 0x562bf847d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:05.988 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.985+0000 7f870d7fa700 0 client.16329 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:59:05.988 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.985+0000 7f8738031b80 1 -- 172.21.15.76:0/2842600528 >> 172.21.15.76:0/2842600528 conn(0x562bf83c91b0 msgr2=0x562bf8465860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:59:05.988 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.985+0000 7f8738031b80 1 -- 172.21.15.76:0/2842600528 shutdown_connections 2024-06-02T04:59:05.988 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.985+0000 7f8738031b80 1 -- 172.21.15.76:0/2842600528 wait complete. 2024-06-02T04:59:05.988 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:05.986+0000 7f8738031b80 20 client.16329 trim_cache size 0 max 16384 2024-06-02T04:59:06.010 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:06.010+0000 7f8738031b80 1 Processor -- start 2024-06-02T04:59:06.011 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:06.010+0000 7f8738031b80 1 -- start start 2024-06-02T04:59:06.011 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:06.010+0000 7f8738031b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562bf846a7b0 0x562bf848b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:59:06.011 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:06.010+0000 7f8738031b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562bf846b110 0x562bf8484d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:59:06.011 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:06.010+0000 7f8738031b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562bf84790a0 0x562bf8484680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:59:06.011 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:06.010+0000 7f8738031b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bf84629b0 con 0x562bf846b110 2024-06-02T04:59:06.011 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:06.010+0000 7f8738031b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bf846b4f0 con 0x562bf84790a0 2024-06-02T04:59:06.011 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:06.010+0000 7f8738031b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bf8485840 con 0x562bf846a7b0 2024-06-02T04:59:06.012 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:06.011+0000 7f8729411700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562bf846b110 0x562bf8484d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:59:06.012 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:06.011+0000 7f8729411700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562bf846b110 0x562bf8484d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:53606/0 (socket says 172.21.15.76:53606) 2024-06-02T04:59:06.012 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:06.011+0000 7f8729411700 1 -- 172.21.15.76:0/2834680409 learned_addr learned my addr 172.21.15.76:0/2834680409 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:59:06.012 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:06.011+0000 7f8729c12700 1 --2- 172.21.15.76:0/2834680409 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562bf846a7b0 0x562bf848b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:59:06.012 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:06.011+0000 7f8729411700 1 -- 172.21.15.76:0/2834680409 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562bf846a7b0 msgr2=0x562bf848b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:59:06.012 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:06.012+0000 7f8729411700 1 --2- 172.21.15.76:0/2834680409 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562bf846a7b0 0x562bf848b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:06.012 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:06.012+0000 7f8729411700 1 -- 172.21.15.76:0/2834680409 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562bf84790a0 msgr2=0x562bf8484680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:59:06.013 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:06.012+0000 7f8729411700 1 --2- 172.21.15.76:0/2834680409 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562bf84790a0 0x562bf8484680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:06.013 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:06.012+0000 7f8729411700 1 -- 172.21.15.76:0/2834680409 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562bf8381500 con 0x562bf846b110 2024-06-02T04:59:06.013 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:06.012+0000 7f8729411700 1 --2- 172.21.15.76:0/2834680409 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562bf846b110 0x562bf8484d70 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f87140099c0 tx=0x7f8714018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88d2fca9844a1d63 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:59:06.014 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:06.013+0000 7f8718ff9700 1 -- 172.21.15.76:0/2834680409 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8714029030 con 0x562bf846b110 2024-06-02T04:59:06.014 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:06.014+0000 7f8718ff9700 1 -- 172.21.15.76:0/2834680409 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f87140054e0 con 0x562bf846b110 2024-06-02T04:59:06.014 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:06.014+0000 7f8718ff9700 1 -- 172.21.15.76:0/2834680409 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f871402da90 con 0x562bf846b110 2024-06-02T04:59:06.015 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:06.015+0000 7f8738031b80 1 -- 172.21.15.76:0/2834680409 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562bf846b110 msgr2=0x562bf8484d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:59:06.015 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:06.015+0000 7f8738031b80 1 --2- 172.21.15.76:0/2834680409 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562bf846b110 0x562bf8484d70 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f87140099c0 tx=0x7f8714018000 comp rx=0 tx=0).stop 2024-06-02T04:59:06.015 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:06.015+0000 7f8738031b80 1 -- 172.21.15.76:0/2834680409 shutdown_connections 2024-06-02T04:59:06.015 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:06.015+0000 7f8738031b80 1 --2- 172.21.15.76:0/2834680409 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562bf84790a0 0x562bf8484680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:06.016 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:06.015+0000 7f8738031b80 1 --2- 172.21.15.76:0/2834680409 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562bf846a7b0 0x562bf848b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:06.016 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:06.015+0000 7f8738031b80 1 --2- 172.21.15.76:0/2834680409 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562bf846b110 0x562bf8484d70 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:06.016 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:06.015+0000 7f8738031b80 1 -- 172.21.15.76:0/2834680409 >> 172.21.15.76:0/2834680409 conn(0x562bf83c91b0 msgr2=0x562bf84788e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:59:06.016 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:06.016+0000 7f8738031b80 1 -- 172.21.15.76:0/2834680409 shutdown_connections 2024-06-02T04:59:06.016 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:06.016+0000 7f8738031b80 1 -- 172.21.15.76:0/2834680409 wait complete. 2024-06-02T04:59:06.016 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:06.016+0000 7f8738031b80 1 -- start start 2024-06-02T04:59:06.017 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:06.016+0000 7f8738031b80 1 Processor -- start 2024-06-02T04:59:06.017 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:06.016+0000 7f8738031b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562bf846a7b0 0x562bf847ff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:59:06.017 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:06.016+0000 7f8738031b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562bf846b110 0x562bf8480450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:59:06.017 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:06.016+0000 7f8738031b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562bf84790a0 0x562bf84832f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:59:06.017 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:06.016+0000 7f8738031b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bf8483830 con 0x562bf846a7b0 2024-06-02T04:59:06.017 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:06.016+0000 7f8738031b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bf84839a0 con 0x562bf84790a0 2024-06-02T04:59:06.017 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:06.016+0000 7f8738031b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bf8483b60 con 0x562bf846b110 2024-06-02T04:59:06.017 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:06.016+0000 7f8738031b80 10 client.0 _ll_register_callbacks cb 0x562bf8360ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:59:06.019 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:06.017+0000 7f8729c12700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562bf846a7b0 0x562bf847ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:59:06.019 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:06.017+0000 7f8729c12700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562bf846a7b0 0x562bf847ff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:53612/0 (socket says 172.21.15.76:53612) 2024-06-02T04:59:06.019 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:06.017+0000 7f8729c12700 1 -- 172.21.15.76:0/491261880 learned_addr learned my addr 172.21.15.76:0/491261880 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:59:06.019 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:06.017+0000 7f872a413700 1 --2- 172.21.15.76:0/491261880 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562bf84790a0 0x562bf84832f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:59:06.019 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:06.017+0000 7f8729c12700 1 -- 172.21.15.76:0/491261880 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562bf846b110 msgr2=0x562bf8480450 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-02T04:59:06.019 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:06.017+0000 7f8729c12700 1 --2- 172.21.15.76:0/491261880 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562bf846b110 0x562bf8480450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:06.019 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:06.017+0000 7f8729c12700 1 -- 172.21.15.76:0/491261880 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562bf84790a0 msgr2=0x562bf84832f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:59:06.020 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:06.017+0000 7f8729c12700 1 --2- 172.21.15.76:0/491261880 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562bf84790a0 0x562bf84832f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:06.020 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:06.017+0000 7f8729c12700 1 -- 172.21.15.76:0/491261880 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8724108b90 con 0x562bf846a7b0 2024-06-02T04:59:06.020 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:06.017+0000 7f8729c12700 1 --2- 172.21.15.76:0/491261880 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562bf846a7b0 0x562bf847ff10 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f8720009c50 tx=0x7f8720009d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4624a6f9080d8f server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:59:06.020 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:06.018+0000 7f870d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-06-02T04:59:06.020 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:06.018+0000 7f870d7fa700 1 -- 172.21.15.76:0/491261880 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8720022d50 con 0x562bf846a7b0 2024-06-02T04:59:06.020 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:06.018+0000 7f870d7fa700 1 -- 172.21.15.76:0/491261880 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f8720022eb0 con 0x562bf846a7b0 2024-06-02T04:59:06.020 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:06.018+0000 7f8738031b80 1 -- 172.21.15.76:0/491261880 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8720004380 con 0x562bf846a7b0 2024-06-02T04:59:06.020 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:06.018+0000 7f870d7fa700 1 -- 172.21.15.76:0/491261880 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8720022330 con 0x562bf846a7b0 2024-06-02T04:59:06.020 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:06.018+0000 7f8738031b80 10 client.16335 fetch_fsmap learned FSMap version 36 2024-06-02T04:59:06.020 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:06.018+0000 7f8738031b80 1 -- 172.21.15.76:0/491261880 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x562bf8240c70 con 0x562bf846a7b0 2024-06-02T04:59:06.020 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:06.019+0000 7f870d7fa700 1 -- 172.21.15.76:0/491261880 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8720004380 con 0x562bf846a7b0 2024-06-02T04:59:06.020 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:06.019+0000 7f870d7fa700 1 -- 172.21.15.76:0/491261880 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f8720021050 con 0x562bf846a7b0 2024-06-02T04:59:06.020 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:06.019+0000 7f8738031b80 10 client.16335 fetch_fsmap finished waiting for FSMap version 36 2024-06-02T04:59:06.020 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:06.019+0000 7f8738031b80 10 client.16335 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T04:59:06.021 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:06.019+0000 7f8738031b80 20 client.16335 populate_metadata read hostname 'smithi076' 2024-06-02T04:59:06.021 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:06.019+0000 7f8738031b80 1 --2- 172.21.15.76:0/491261880 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x562bf8470710 0x562bf8472b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:59:06.021 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:06.019+0000 7f8738031b80 4 client.16335 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T04:59:06.021 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:06.019+0000 7f8738031b80 1 -- 172.21.15.76:0/491261880 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x562bf83b3e60 con 0x562bf8470710 2024-06-02T04:59:06.021 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:06.019+0000 7f8729411700 1 --2- 172.21.15.76:0/491261880 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x562bf8470710 0x562bf8472b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:59:06.021 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:06.019+0000 7f870d7fa700 10 client.16335 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:59:06.021 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:06.019+0000 7f8729411700 1 --2- 172.21.15.76:0/491261880 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x562bf8470710 0x562bf8472b30 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e7c635fc6cef905e server_cookie=19c08d5c79ff8e4e in_seq=0 out_seq=0 2024-06-02T04:59:06.042 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:06.042+0000 7f870d7fa700 1 -- 172.21.15.76:0/491261880 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x562bf83b3e60 con 0x562bf8470710 2024-06-02T04:59:06.043 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:06.042+0000 7f870d7fa700 10 client.16335 handle_command_reply: tid=0 2024-06-02T04:59:06.043 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:06.042+0000 7f8738031b80 1 client.16335 shutdown 2024-06-02T04:59:06.043 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:06.042+0000 7f8738031b80 1 -- 172.21.15.76:0/491261880 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562bf846a7b0 msgr2=0x562bf847ff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:59:06.043 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:06.042+0000 7f8738031b80 1 --2- 172.21.15.76:0/491261880 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562bf846a7b0 0x562bf847ff10 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f8720009c50 tx=0x7f8720009d00 comp rx=0 tx=0).stop 2024-06-02T04:59:06.043 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:06.043+0000 7f8738031b80 1 -- 172.21.15.76:0/491261880 shutdown_connections 2024-06-02T04:59:06.043 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:06.043+0000 7f8738031b80 1 --2- 172.21.15.76:0/491261880 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x562bf8470710 0x562bf8472b30 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:06.043 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:06.043+0000 7f8738031b80 1 --2- 172.21.15.76:0/491261880 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562bf84790a0 0x562bf84832f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:06.043 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:06.043+0000 7f8738031b80 1 --2- 172.21.15.76:0/491261880 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562bf846a7b0 0x562bf847ff10 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:06.044 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:06.043+0000 7f8738031b80 1 --2- 172.21.15.76:0/491261880 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562bf846b110 0x562bf8480450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:06.044 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:06.043+0000 7f8738031b80 1 -- 172.21.15.76:0/491261880 >> 172.21.15.76:0/491261880 conn(0x562bf83c91b0 msgr2=0x562bf8475350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:59:06.045 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:06.045+0000 7f870d7fa700 0 client.16335 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:59:06.045 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:06.045+0000 7f8738031b80 1 -- 172.21.15.76:0/491261880 shutdown_connections 2024-06-02T04:59:06.045 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:06.045+0000 7f8738031b80 1 -- 172.21.15.76:0/491261880 wait complete. 2024-06-02T04:59:06.051 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:06.051+0000 7f8738031b80 20 client.16335 trim_cache size 0 max 16384 2024-06-02T04:59:06.055 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:{ 2024-06-02T04:59:06.056 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "message": "", 2024-06-02T04:59:06.056 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "return_code": 0 2024-06-02T04:59:06.056 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:} 2024-06-02T04:59:06.059 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:06.059+0000 7f872be76700 1 -- 172.21.15.76:0/3346892444 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f87100a12f0 msgr2=0x7f87100a37b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:59:06.059 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:06.059+0000 7f872be76700 1 --2- 172.21.15.76:0/3346892444 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f87100a12f0 0x7f87100a37b0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f8714005b40 tx=0x7f8714005ab0 comp rx=0 tx=0).stop 2024-06-02T04:59:06.059 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:06.059+0000 7f872be76700 1 -- 172.21.15.76:0/3346892444 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8724101990 msgr2=0x7f872419e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:59:06.059 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:06.059+0000 7f872be76700 1 --2- 172.21.15.76:0/3346892444 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8724101990 0x7f872419e3b0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f871c00b970 tx=0x7f871c00bc80 comp rx=0 tx=0).stop 2024-06-02T04:59:06.059 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:06.059+0000 7f872be76700 1 -- 172.21.15.76:0/3346892444 shutdown_connections 2024-06-02T04:59:06.060 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:06.059+0000 7f872be76700 1 --2- 172.21.15.76:0/3346892444 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f87100a12f0 0x7f87100a37b0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:06.060 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:06.059+0000 7f872be76700 1 --2- 172.21.15.76:0/3346892444 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8724101990 0x7f872419e3b0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:06.060 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:06.059+0000 7f872be76700 1 --2- 172.21.15.76:0/3346892444 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f87240ffe00 0x7f8724196e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:06.060 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:06.059+0000 7f872be76700 1 --2- 172.21.15.76:0/3346892444 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8724100ff0 0x7f8724197390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:06.060 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:06.059+0000 7f872be76700 1 -- 172.21.15.76:0/3346892444 >> 172.21.15.76:0/3346892444 conn(0x7f87240fb390 msgr2=0x7f87240682f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:59:06.064 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:06.063+0000 7f872be76700 1 -- 172.21.15.76:0/3346892444 shutdown_connections 2024-06-02T04:59:06.064 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:06.063+0000 7f872be76700 1 -- 172.21.15.76:0/3346892444 wait complete. 2024-06-02T04:59:06.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 495.0 s, 459.6 tps, lat 93.918 ms stddev 112.570 2024-06-02T04:59:06.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:59:06 smithi192 ceph-mon[47933]: pgmap v554: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 13 MiB/s wr, 840 op/s 2024-06-02T04:59:06.986 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:59:06 smithi076 ceph-mon[42935]: pgmap v554: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 13 MiB/s wr, 840 op/s 2024-06-02T04:59:07.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:59:06 smithi119 ceph-mon[46633]: pgmap v554: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 13 MiB/s wr, 840 op/s 2024-06-02T04:59:09.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:59:09 smithi119 ceph-mon[46633]: pgmap v555: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 13 MiB/s wr, 820 op/s 2024-06-02T04:59:09.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:59:09 smithi192 ceph-mon[47933]: pgmap v555: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 13 MiB/s wr, 820 op/s 2024-06-02T04:59:09.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:59:09 smithi076 ceph-mon[42935]: pgmap v555: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 13 MiB/s wr, 820 op/s 2024-06-02T04:59:11.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 500.0 s, 702.4 tps, lat 237.795 ms stddev 918.453 2024-06-02T04:59:11.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:59:11 smithi119 ceph-mon[46633]: pgmap v556: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 15 MiB/s wr, 899 op/s 2024-06-02T04:59:11.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:59:11 smithi192 ceph-mon[47933]: pgmap v556: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 15 MiB/s wr, 899 op/s 2024-06-02T04:59:11.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:59:11 smithi076 ceph-mon[42935]: pgmap v556: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 15 MiB/s wr, 899 op/s 2024-06-02T04:59:13.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:59:13 smithi119 ceph-mon[46633]: pgmap v557: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 16 MiB/s wr, 862 op/s 2024-06-02T04:59:13.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:59:13 smithi192 ceph-mon[47933]: pgmap v557: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 16 MiB/s wr, 862 op/s 2024-06-02T04:59:13.989 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:59:13 smithi076 ceph-mon[42935]: pgmap v557: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 16 MiB/s wr, 862 op/s 2024-06-02T04:59:15.847 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:59:15 smithi119 ceph-mon[46633]: pgmap v558: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 13 MiB/s wr, 797 op/s 2024-06-02T04:59:15.847 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:59:15 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:59:15.847 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:59:15 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:59:15.847 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:59:15 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:59:15.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:59:15 smithi192 ceph-mon[47933]: pgmap v558: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 13 MiB/s wr, 797 op/s 2024-06-02T04:59:15.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:59:15 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:59:15.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:59:15 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:59:15.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:59:15 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:59:15.995 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:59:15 smithi076 ceph-mon[42935]: pgmap v558: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 13 MiB/s wr, 797 op/s 2024-06-02T04:59:15.995 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:59:15 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:59:15.995 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:59:15 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:59:15.995 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:59:15 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:59:16.316 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 505.0 s, 737.3 tps, lat 132.986 ms stddev 69.799 2024-06-02T04:59:16.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:59:16 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:59:16.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:59:16 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:59:16.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:59:16 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T04:59:17.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:59:17 smithi192 ceph-mon[47933]: pgmap v559: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 14 MiB/s wr, 863 op/s 2024-06-02T04:59:17.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:59:17 smithi076 ceph-mon[42935]: pgmap v559: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 14 MiB/s wr, 863 op/s 2024-06-02T04:59:18.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:59:17 smithi119 ceph-mon[46633]: pgmap v559: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 14 MiB/s wr, 863 op/s 2024-06-02T04:59:18.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:59:18 smithi192 ceph-mon[47933]: pgmap v560: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 14 MiB/s wr, 818 op/s 2024-06-02T04:59:18.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:59:18 smithi076 ceph-mon[42935]: pgmap v560: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 14 MiB/s wr, 818 op/s 2024-06-02T04:59:19.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:59:18 smithi119 ceph-mon[46633]: pgmap v560: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 14 MiB/s wr, 818 op/s 2024-06-02T04:59:19.246 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.244+0000 7f714fb13700 1 -- 172.21.15.76:0/3564802939 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7148101990 msgr2=0x7f7148108240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:59:19.246 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.244+0000 7f714fb13700 1 --2- 172.21.15.76:0/3564802939 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7148101990 0x7f7148108240 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7144009990 tx=0x7f7144009ca0 comp rx=0 tx=0).stop 2024-06-02T04:59:19.249 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.248+0000 7f714fb13700 1 -- 172.21.15.76:0/3564802939 shutdown_connections 2024-06-02T04:59:19.249 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.248+0000 7f714fb13700 1 --2- 172.21.15.76:0/3564802939 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7148101990 0x7f7148108240 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:19.249 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.248+0000 7f714fb13700 1 --2- 172.21.15.76:0/3564802939 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71480ffe00 0x7f7148100220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:19.249 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.248+0000 7f714fb13700 1 --2- 172.21.15.76:0/3564802939 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7148100ff0 0x7f7148101450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:19.249 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.248+0000 7f714fb13700 1 -- 172.21.15.76:0/3564802939 >> 172.21.15.76:0/3564802939 conn(0x7f71480fb390 msgr2=0x7f71480fd7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:59:19.250 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.249+0000 7f714fb13700 1 -- 172.21.15.76:0/3564802939 shutdown_connections 2024-06-02T04:59:19.251 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.249+0000 7f714fb13700 1 -- 172.21.15.76:0/3564802939 wait complete. 2024-06-02T04:59:19.251 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.249+0000 7f714fb13700 1 Processor -- start 2024-06-02T04:59:19.251 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.250+0000 7f714fb13700 1 -- start start 2024-06-02T04:59:19.251 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.250+0000 7f714fb13700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71480ffe00 0x7f714806f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:59:19.251 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.250+0000 7f714fb13700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7148100ff0 0x7f714806fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:59:19.251 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.250+0000 7f714fb13700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7148101990 0x7f71481a6f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:59:19.251 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.250+0000 7f714fb13700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7148072e80 con 0x7f7148100ff0 2024-06-02T04:59:19.251 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.250+0000 7f714fb13700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7148072ff0 con 0x7f7148101990 2024-06-02T04:59:19.251 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.250+0000 7f714fb13700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71481088c0 con 0x7f71480ffe00 2024-06-02T04:59:19.252 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.250+0000 7f714e0b0700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7148101990 0x7f71481a6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:59:19.252 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.250+0000 7f714e0b0700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7148101990 0x7f71481a6f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:53836/0 (socket says 172.21.15.76:53836) 2024-06-02T04:59:19.252 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.250+0000 7f714e0b0700 1 -- 172.21.15.76:0/2090012351 learned_addr learned my addr 172.21.15.76:0/2090012351 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:59:19.252 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.251+0000 7f714d8af700 1 --2- 172.21.15.76:0/2090012351 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71480ffe00 0x7f714806f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:59:19.252 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.251+0000 7f714e0b0700 1 -- 172.21.15.76:0/2090012351 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71480ffe00 msgr2=0x7f714806f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:59:19.253 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.251+0000 7f714e0b0700 1 --2- 172.21.15.76:0/2090012351 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71480ffe00 0x7f714806f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:19.253 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.251+0000 7f714e0b0700 1 -- 172.21.15.76:0/2090012351 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7148100ff0 msgr2=0x7f714806fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:59:19.253 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.251+0000 7f714e0b0700 1 --2- 172.21.15.76:0/2090012351 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7148100ff0 0x7f714806fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:19.253 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.251+0000 7f714e0b0700 1 -- 172.21.15.76:0/2090012351 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71440095f0 con 0x7f7148101990 2024-06-02T04:59:19.255 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.255+0000 7f714e0b0700 1 --2- 172.21.15.76:0/2090012351 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7148101990 0x7f71481a6f60 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f7144003a80 tx=0x7f7144003b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:59:19.256 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.255+0000 7f713effd700 1 -- 172.21.15.76:0/2090012351 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f714401d070 con 0x7f7148101990 2024-06-02T04:59:19.256 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.255+0000 7f713effd700 1 -- 172.21.15.76:0/2090012351 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f714400bd50 con 0x7f7148101990 2024-06-02T04:59:19.256 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.255+0000 7f713effd700 1 -- 172.21.15.76:0/2090012351 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f714400fdf0 con 0x7f7148101990 2024-06-02T04:59:19.256 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.256+0000 7f714fb13700 1 -- 172.21.15.76:0/2090012351 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7148108ae0 con 0x7f7148101990 2024-06-02T04:59:19.261 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.256+0000 7f714fb13700 1 -- 172.21.15.76:0/2090012351 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7148108f10 con 0x7f7148101990 2024-06-02T04:59:19.269 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.262+0000 7f715bcceb80 1 Processor -- start 2024-06-02T04:59:19.269 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.263+0000 7f713effd700 1 -- 172.21.15.76:0/2090012351 <== mon.2 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f714400f460 con 0x7f7148101990 2024-06-02T04:59:19.269 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.263+0000 7f715bcceb80 1 -- start start 2024-06-02T04:59:19.269 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.263+0000 7f715bcceb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560d418a5290 0x560d418a56b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:59:19.269 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.263+0000 7f715bcceb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560d418a5bf0 0x560d418a6500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:59:19.269 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.263+0000 7f715bcceb80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560d418a6ae0 0x560d418a6f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:59:19.269 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.264+0000 7f715bcceb80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d417f40f0 con 0x560d418a6ae0 2024-06-02T04:59:19.269 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.264+0000 7f715bcceb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d417f1ab0 con 0x560d418a5290 2024-06-02T04:59:19.269 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.264+0000 7f715bcceb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d417ed3a0 con 0x560d418a5bf0 2024-06-02T04:59:19.269 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.264+0000 7f714d0ae700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560d418a5290 0x560d418a56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:59:19.270 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.264+0000 7f714d0ae700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560d418a5290 0x560d418a56b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:53840/0 (socket says 172.21.15.76:53840) 2024-06-02T04:59:19.270 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.264+0000 7f714d0ae700 1 -- 172.21.15.76:0/3830720003 learned_addr learned my addr 172.21.15.76:0/3830720003 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:59:19.270 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.265+0000 7f714d0ae700 1 -- 172.21.15.76:0/3830720003 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560d418a5bf0 msgr2=0x560d418a6500 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-02T04:59:19.270 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.265+0000 7f714d0ae700 1 --2- 172.21.15.76:0/3830720003 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560d418a5bf0 0x560d418a6500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:19.270 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.265+0000 7f714d0ae700 1 -- 172.21.15.76:0/3830720003 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560d418a6ae0 msgr2=0x560d418a6f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:59:19.270 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.265+0000 7f714d0ae700 1 --2- 172.21.15.76:0/3830720003 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560d418a6ae0 0x560d418a6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:19.270 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.265+0000 7f714d0ae700 1 -- 172.21.15.76:0/3830720003 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560d4166e350 con 0x560d418a5290 2024-06-02T04:59:19.270 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.265+0000 7f714d0ae700 1 --2- 172.21.15.76:0/3830720003 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560d418a5290 0x560d418a56b0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7138001820 tx=0x7f7138001b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b45e97c88b28de4 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:59:19.270 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.265+0000 7f7133fff700 1 -- 172.21.15.76:0/3830720003 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7138004c70 con 0x560d418a5290 2024-06-02T04:59:19.270 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.265+0000 7f7133fff700 1 -- 172.21.15.76:0/3830720003 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7138001d70 con 0x560d418a5290 2024-06-02T04:59:19.271 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.265+0000 7f7133fff700 1 -- 172.21.15.76:0/3830720003 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f713800e650 con 0x560d418a5290 2024-06-02T04:59:19.271 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.266+0000 7f715bcceb80 1 -- 172.21.15.76:0/3830720003 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560d418a5290 msgr2=0x560d418a56b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:59:19.271 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.266+0000 7f715bcceb80 1 --2- 172.21.15.76:0/3830720003 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560d418a5290 0x560d418a56b0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7138001820 tx=0x7f7138001b30 comp rx=0 tx=0).stop 2024-06-02T04:59:19.271 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.268+0000 7f715bcceb80 1 -- 172.21.15.76:0/3830720003 shutdown_connections 2024-06-02T04:59:19.271 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.268+0000 7f715bcceb80 1 --2- 172.21.15.76:0/3830720003 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560d418a6ae0 0x560d418a6f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:19.271 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.268+0000 7f715bcceb80 1 --2- 172.21.15.76:0/3830720003 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560d418a5290 0x560d418a56b0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:19.271 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.268+0000 7f715bcceb80 1 --2- 172.21.15.76:0/3830720003 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560d418a5bf0 0x560d418a6500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:19.271 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.268+0000 7f715bcceb80 1 -- 172.21.15.76:0/3830720003 >> 172.21.15.76:0/3830720003 conn(0x560d417fb1b0 msgr2=0x560d41899440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:59:19.276 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.269+0000 7f713effd700 1 --2- 172.21.15.76:0/2090012351 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f71340a12f0 0x7f71340a37b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:59:19.277 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.269+0000 7f713effd700 1 -- 172.21.15.76:0/2090012351 <== mon.2 v2:172.21.15.119:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f71440cdad0 con 0x7f7148101990 2024-06-02T04:59:19.277 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.270+0000 7f714d8af700 1 --2- 172.21.15.76:0/2090012351 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f71340a12f0 0x7f71340a37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:59:19.277 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.271+0000 7f714d8af700 1 --2- 172.21.15.76:0/2090012351 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f71340a12f0 0x7f71340a37b0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x560d418a6030 tx=0x7f71400094f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:59:19.277 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.272+0000 7f715bcceb80 1 -- 172.21.15.76:0/3830720003 shutdown_connections 2024-06-02T04:59:19.277 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.272+0000 7f715bcceb80 1 -- 172.21.15.76:0/3830720003 wait complete. 2024-06-02T04:59:19.277 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.272+0000 7f715bcceb80 1 -- start start 2024-06-02T04:59:19.277 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.272+0000 7f715bcceb80 1 Processor -- start 2024-06-02T04:59:19.277 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.273+0000 7f715bcceb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560d418a5290 0x560d418a4960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:59:19.278 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.273+0000 7f715bcceb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560d418a6ae0 0x560d418ab740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:59:19.278 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.273+0000 7f715bcceb80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560d418abcd0 0x560d418ae120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:59:19.278 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.273+0000 7f715bcceb80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d41789500 con 0x560d418abcd0 2024-06-02T04:59:19.278 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.273+0000 7f715bcceb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d417891a0 con 0x560d418a6ae0 2024-06-02T04:59:19.278 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.273+0000 7f715bcceb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d41670640 con 0x560d418a5290 2024-06-02T04:59:19.278 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.273+0000 7f715bcceb80 10 client.0 _ll_register_callbacks cb 0x560d41792ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:59:19.278 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.274+0000 7f714d8af700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560d418a5290 0x560d418a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:59:19.278 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.274+0000 7f714d8af700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560d418a5290 0x560d418a4960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:54608/0 (socket says 172.21.15.76:54608) 2024-06-02T04:59:19.278 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.274+0000 7f714d8af700 1 -- 172.21.15.76:0/1801647913 learned_addr learned my addr 172.21.15.76:0/1801647913 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:59:19.278 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.274+0000 7f714d0ae700 1 --2- 172.21.15.76:0/1801647913 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560d418a6ae0 0x560d418ab740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:59:19.278 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.274+0000 7f714e0b0700 1 --2- 172.21.15.76:0/1801647913 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560d418abcd0 0x560d418ae120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:59:19.278 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.274+0000 7f714d0ae700 1 -- 172.21.15.76:0/1801647913 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560d418a5290 msgr2=0x560d418a4960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:59:19.279 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.274+0000 7f714d0ae700 1 --2- 172.21.15.76:0/1801647913 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560d418a5290 0x560d418a4960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:19.279 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.274+0000 7f714d0ae700 1 -- 172.21.15.76:0/1801647913 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560d418abcd0 msgr2=0x560d418ae120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:59:19.279 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.274+0000 7f714d0ae700 1 --2- 172.21.15.76:0/1801647913 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560d418abcd0 0x560d418ae120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:19.279 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.274+0000 7f714d0ae700 1 -- 172.21.15.76:0/1801647913 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7138001500 con 0x560d418a6ae0 2024-06-02T04:59:19.279 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.275+0000 7f714d0ae700 1 --2- 172.21.15.76:0/1801647913 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560d418a6ae0 0x560d418ab740 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7138001820 tx=0x7f7138004d20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=13dab0d6a5b53785 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:59:19.280 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.277+0000 7f71317fa700 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-06-02T04:59:19.280 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.277+0000 7f71317fa700 1 -- 172.21.15.76:0/1801647913 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7138008e20 con 0x560d418a6ae0 2024-06-02T04:59:19.281 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.277+0000 7f71317fa700 1 -- 172.21.15.76:0/1801647913 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f713800e650 con 0x560d418a6ae0 2024-06-02T04:59:19.281 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.277+0000 7f715bcceb80 1 -- 172.21.15.76:0/1801647913 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560d41746210 con 0x560d418a6ae0 2024-06-02T04:59:19.281 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.277+0000 7f71317fa700 1 -- 172.21.15.76:0/1801647913 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f713800e850 con 0x560d418a6ae0 2024-06-02T04:59:19.281 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.277+0000 7f715bcceb80 10 client.25955 fetch_fsmap learned FSMap version 36 2024-06-02T04:59:19.281 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.277+0000 7f715bcceb80 1 -- 172.21.15.76:0/1801647913 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x560d4161ab00 con 0x560d418a6ae0 2024-06-02T04:59:19.281 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.277+0000 7f71317fa700 1 -- 172.21.15.76:0/1801647913 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x560d41746210 con 0x560d418a6ae0 2024-06-02T04:59:19.281 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.278+0000 7f71317fa700 1 -- 172.21.15.76:0/1801647913 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f7138025070 con 0x560d418a6ae0 2024-06-02T04:59:19.281 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.278+0000 7f715bcceb80 10 client.25955 fetch_fsmap finished waiting for FSMap version 36 2024-06-02T04:59:19.281 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.278+0000 7f715bcceb80 10 client.25955 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T04:59:19.281 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.278+0000 7f715bcceb80 20 client.25955 populate_metadata read hostname 'smithi076' 2024-06-02T04:59:19.281 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.278+0000 7f715bcceb80 1 --2- 172.21.15.76:0/1801647913 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x560d418d4ac0 0x560d418d6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:59:19.282 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.278+0000 7f715bcceb80 4 client.25955 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T04:59:19.282 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.278+0000 7f715bcceb80 1 -- 172.21.15.76:0/1801647913 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560d4186c7b0 con 0x560d418d4ac0 2024-06-02T04:59:19.282 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.278+0000 7f714d8af700 1 --2- 172.21.15.76:0/1801647913 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x560d418d4ac0 0x560d418d6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:59:19.282 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.279+0000 7f714d8af700 1 --2- 172.21.15.76:0/1801647913 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x560d418d4ac0 0x560d418d6ee0 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=633b838c23871d8 server_cookie=b422ade5d105bc73 in_seq=0 out_seq=0 2024-06-02T04:59:19.282 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.279+0000 7f71317fa700 10 client.25955 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:59:19.282 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.279+0000 7f71317fa700 1 -- 172.21.15.76:0/1801647913 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x560d4186c7b0 con 0x560d418d4ac0 2024-06-02T04:59:19.282 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.279+0000 7f71317fa700 10 client.25955 handle_command_reply: tid=0 2024-06-02T04:59:19.282 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.279+0000 7f715bcceb80 1 client.25955 shutdown 2024-06-02T04:59:19.285 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.284+0000 7f715bcceb80 1 -- 172.21.15.76:0/1801647913 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560d418a6ae0 msgr2=0x560d418ab740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:59:19.285 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.284+0000 7f715bcceb80 1 --2- 172.21.15.76:0/1801647913 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560d418a6ae0 0x560d418ab740 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7138001820 tx=0x7f7138004d20 comp rx=0 tx=0).stop 2024-06-02T04:59:19.285 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.284+0000 7f715bcceb80 1 -- 172.21.15.76:0/1801647913 shutdown_connections 2024-06-02T04:59:19.285 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.284+0000 7f715bcceb80 1 --2- 172.21.15.76:0/1801647913 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x560d418d4ac0 0x560d418d6ee0 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:19.285 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.284+0000 7f715bcceb80 1 --2- 172.21.15.76:0/1801647913 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560d418abcd0 0x560d418ae120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:19.285 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.284+0000 7f715bcceb80 1 --2- 172.21.15.76:0/1801647913 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560d418a5290 0x560d418a4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:19.285 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.284+0000 7f715bcceb80 1 --2- 172.21.15.76:0/1801647913 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560d418a6ae0 0x560d418ab740 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:19.285 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.284+0000 7f715bcceb80 1 -- 172.21.15.76:0/1801647913 >> 172.21.15.76:0/1801647913 conn(0x560d417fb1b0 msgr2=0x560d41897190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:59:19.286 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.284+0000 7f71317fa700 0 client.25955 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:59:19.286 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.284+0000 7f715bcceb80 1 -- 172.21.15.76:0/1801647913 shutdown_connections 2024-06-02T04:59:19.286 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.284+0000 7f715bcceb80 1 -- 172.21.15.76:0/1801647913 wait complete. 2024-06-02T04:59:19.287 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.286+0000 7f715bcceb80 20 client.25955 trim_cache size 0 max 16384 2024-06-02T04:59:19.316 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.316+0000 7f715bcceb80 1 Processor -- start 2024-06-02T04:59:19.319 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.318+0000 7f715bcceb80 1 -- start start 2024-06-02T04:59:19.319 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.318+0000 7f715bcceb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560d418a5290 0x560d418d0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:59:19.319 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.318+0000 7f715bcceb80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560d418a6ae0 0x560d418a6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:59:19.319 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.318+0000 7f715bcceb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560d418abcd0 0x560d418db800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:59:19.320 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.318+0000 7f715bcceb80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d418927c0 con 0x560d418a6ae0 2024-06-02T04:59:19.320 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.318+0000 7f715bcceb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d41892330 con 0x560d418abcd0 2024-06-02T04:59:19.320 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.318+0000 7f715bcceb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d418a3d40 con 0x560d418a5290 2024-06-02T04:59:19.320 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.319+0000 7f714d0ae700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560d418a6ae0 0x560d418a6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:59:19.320 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.319+0000 7f714d0ae700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560d418a6ae0 0x560d418a6ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:36852/0 (socket says 172.21.15.76:36852) 2024-06-02T04:59:19.320 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.319+0000 7f714d0ae700 1 -- 172.21.15.76:0/538464912 learned_addr learned my addr 172.21.15.76:0/538464912 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:59:19.320 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.319+0000 7f714d8af700 1 --2- 172.21.15.76:0/538464912 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560d418a5290 0x560d418d0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:59:19.321 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.319+0000 7f714d8af700 1 -- 172.21.15.76:0/538464912 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560d418abcd0 msgr2=0x560d418db800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:59:19.321 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.319+0000 7f714d8af700 1 --2- 172.21.15.76:0/538464912 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560d418abcd0 0x560d418db800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:19.322 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.319+0000 7f714d8af700 1 -- 172.21.15.76:0/538464912 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560d418a6ae0 msgr2=0x560d418a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:59:19.322 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.319+0000 7f714d8af700 1 --2- 172.21.15.76:0/538464912 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560d418a6ae0 0x560d418a6ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:19.322 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.319+0000 7f714d8af700 1 -- 172.21.15.76:0/538464912 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560d417b3500 con 0x560d418a5290 2024-06-02T04:59:19.322 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.319+0000 7f714d8af700 1 --2- 172.21.15.76:0/538464912 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560d418a5290 0x560d418d0a10 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7140009a10 tx=0x7f7140015000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=31fa1bd96e8d0fef server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:59:19.322 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.319+0000 7f713cda5700 1 -- 172.21.15.76:0/538464912 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f714001c040 con 0x560d418a5290 2024-06-02T04:59:19.322 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.320+0000 7f713cda5700 1 -- 172.21.15.76:0/538464912 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f714001d040 con 0x560d418a5290 2024-06-02T04:59:19.322 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.320+0000 7f713cda5700 1 -- 172.21.15.76:0/538464912 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7140011070 con 0x560d418a5290 2024-06-02T04:59:19.322 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.320+0000 7f715bcceb80 1 -- 172.21.15.76:0/538464912 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560d418a5290 msgr2=0x560d418d0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:59:19.322 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.320+0000 7f715bcceb80 1 --2- 172.21.15.76:0/538464912 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560d418a5290 0x560d418d0a10 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7140009a10 tx=0x7f7140015000 comp rx=0 tx=0).stop 2024-06-02T04:59:19.322 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.321+0000 7f715bcceb80 1 -- 172.21.15.76:0/538464912 shutdown_connections 2024-06-02T04:59:19.323 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.321+0000 7f715bcceb80 1 --2- 172.21.15.76:0/538464912 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560d418abcd0 0x560d418db800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:19.323 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.321+0000 7f715bcceb80 1 --2- 172.21.15.76:0/538464912 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560d418a5290 0x560d418d0a10 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:19.323 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.321+0000 7f715bcceb80 1 --2- 172.21.15.76:0/538464912 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560d418a6ae0 0x560d418a6ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:19.323 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.321+0000 7f715bcceb80 1 -- 172.21.15.76:0/538464912 >> 172.21.15.76:0/538464912 conn(0x560d417fb1b0 msgr2=0x560d418a62f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:59:19.323 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.321+0000 7f715bcceb80 1 -- 172.21.15.76:0/538464912 shutdown_connections 2024-06-02T04:59:19.323 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.321+0000 7f715bcceb80 1 -- 172.21.15.76:0/538464912 wait complete. 2024-06-02T04:59:19.325 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.321+0000 7f715bcceb80 1 -- start start 2024-06-02T04:59:19.325 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.321+0000 7f715bcceb80 1 Processor -- start 2024-06-02T04:59:19.325 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.322+0000 7f715bcceb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560d418a5290 0x560d418e3b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:59:19.325 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.322+0000 7f715bcceb80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560d418a6ae0 0x560d418e40d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:59:19.325 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.322+0000 7f715bcceb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560d418abcd0 0x560d418e4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:59:19.325 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.322+0000 7f715bcceb80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d41929a00 con 0x560d418a6ae0 2024-06-02T04:59:19.325 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.322+0000 7f715bcceb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d41929b40 con 0x560d418abcd0 2024-06-02T04:59:19.326 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.322+0000 7f715bcceb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d41929c80 con 0x560d418a5290 2024-06-02T04:59:19.326 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.322+0000 7f715bcceb80 10 client.0 _ll_register_callbacks cb 0x560d41792ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:59:19.326 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.322+0000 7f714d0ae700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560d418a6ae0 0x560d418e40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:59:19.326 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.322+0000 7f714d0ae700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560d418a6ae0 0x560d418e40d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:36866/0 (socket says 172.21.15.76:36866) 2024-06-02T04:59:19.326 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.322+0000 7f714d0ae700 1 -- 172.21.15.76:0/3793373086 learned_addr learned my addr 172.21.15.76:0/3793373086 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:59:19.326 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.323+0000 7f714d0ae700 1 -- 172.21.15.76:0/3793373086 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560d418a5290 msgr2=0x560d418e3b90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-02T04:59:19.326 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.323+0000 7f714d0ae700 1 --2- 172.21.15.76:0/3793373086 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560d418a5290 0x560d418e3b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:19.326 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.323+0000 7f714d0ae700 1 -- 172.21.15.76:0/3793373086 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560d418abcd0 msgr2=0x560d418e4610 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-02T04:59:19.326 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.323+0000 7f714d0ae700 1 --2- 172.21.15.76:0/3793373086 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560d418abcd0 0x560d418e4610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:19.326 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.323+0000 7f714d0ae700 1 -- 172.21.15.76:0/3793373086 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f714000c9f0 con 0x560d418a6ae0 2024-06-02T04:59:19.326 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.323+0000 7f714d0ae700 1 --2- 172.21.15.76:0/3793373086 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560d418a6ae0 0x560d418e40d0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f713800e440 tx=0x7f71380092f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc4568907094f994 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:59:19.326 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.323+0000 7f71317fa700 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-06-02T04:59:19.327 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.323+0000 7f71317fa700 1 -- 172.21.15.76:0/3793373086 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7138009e10 con 0x560d418a6ae0 2024-06-02T04:59:19.327 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.323+0000 7f71317fa700 1 -- 172.21.15.76:0/3793373086 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f7138000e40 con 0x560d418a6ae0 2024-06-02T04:59:19.327 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.323+0000 7f715bcceb80 1 -- 172.21.15.76:0/3793373086 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7138001d70 con 0x560d418a6ae0 2024-06-02T04:59:19.327 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.324+0000 7f71317fa700 1 -- 172.21.15.76:0/3793373086 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7138004d90 con 0x560d418a6ae0 2024-06-02T04:59:19.327 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.324+0000 7f715bcceb80 10 client.16344 fetch_fsmap learned FSMap version 36 2024-06-02T04:59:19.327 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.324+0000 7f715bcceb80 1 -- 172.21.15.76:0/3793373086 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x560d41672c70 con 0x560d418a6ae0 2024-06-02T04:59:19.327 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.324+0000 7f71317fa700 1 -- 172.21.15.76:0/3793373086 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7138001d70 con 0x560d418a6ae0 2024-06-02T04:59:19.327 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.324+0000 7f71317fa700 1 -- 172.21.15.76:0/3793373086 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f713800e0e0 con 0x560d418a6ae0 2024-06-02T04:59:19.327 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.324+0000 7f715bcceb80 10 client.16344 fetch_fsmap finished waiting for FSMap version 36 2024-06-02T04:59:19.327 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.324+0000 7f715bcceb80 10 client.16344 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T04:59:19.327 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.324+0000 7f715bcceb80 20 client.16344 populate_metadata read hostname 'smithi076' 2024-06-02T04:59:19.327 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.324+0000 7f715bcceb80 1 --2- 172.21.15.76:0/3793373086 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x560d4192b3a0 0x560d4192d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:59:19.327 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.324+0000 7f715bcceb80 4 client.16344 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T04:59:19.327 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.324+0000 7f715bcceb80 1 -- 172.21.15.76:0/3793373086 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x560d417e5e60 con 0x560d4192b3a0 2024-06-02T04:59:19.328 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.325+0000 7f714d8af700 1 --2- 172.21.15.76:0/3793373086 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x560d4192b3a0 0x560d4192d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:59:19.334 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.328+0000 7f71317fa700 10 client.16344 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:59:19.334 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.328+0000 7f714d8af700 1 --2- 172.21.15.76:0/3793373086 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x560d4192b3a0 0x560d4192d7c0 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e6ad362450c9d128 server_cookie=18a1229e934b783b in_seq=0 out_seq=0 2024-06-02T04:59:19.352 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.350+0000 7f71317fa700 1 -- 172.21.15.76:0/3793373086 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x560d417e5e60 con 0x560d4192b3a0 2024-06-02T04:59:19.352 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.350+0000 7f71317fa700 10 client.16344 handle_command_reply: tid=0 2024-06-02T04:59:19.352 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.352+0000 7f715bcceb80 1 client.16344 shutdown 2024-06-02T04:59:19.353 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.352+0000 7f715bcceb80 1 -- 172.21.15.76:0/3793373086 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560d418a6ae0 msgr2=0x560d418e40d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:59:19.353 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.352+0000 7f715bcceb80 1 --2- 172.21.15.76:0/3793373086 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560d418a6ae0 0x560d418e40d0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f713800e440 tx=0x7f71380092f0 comp rx=0 tx=0).stop 2024-06-02T04:59:19.353 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.352+0000 7f715bcceb80 1 -- 172.21.15.76:0/3793373086 shutdown_connections 2024-06-02T04:59:19.353 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.352+0000 7f715bcceb80 1 --2- 172.21.15.76:0/3793373086 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x560d4192b3a0 0x560d4192d7c0 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:19.353 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.352+0000 7f715bcceb80 1 --2- 172.21.15.76:0/3793373086 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560d418abcd0 0x560d418e4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:19.353 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.352+0000 7f715bcceb80 1 --2- 172.21.15.76:0/3793373086 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560d418a5290 0x560d418e3b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:19.353 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.352+0000 7f71317fa700 0 client.16344 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:59:19.353 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.352+0000 7f715bcceb80 1 --2- 172.21.15.76:0/3793373086 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560d418a6ae0 0x560d418e40d0 secure :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f713800e440 tx=0x7f71380092f0 comp rx=0 tx=0).stop 2024-06-02T04:59:19.354 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.352+0000 7f715bcceb80 1 -- 172.21.15.76:0/3793373086 >> 172.21.15.76:0/3793373086 conn(0x560d417fb1b0 msgr2=0x560d418db800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:59:19.358 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.358+0000 7f715bcceb80 1 -- 172.21.15.76:0/3793373086 shutdown_connections 2024-06-02T04:59:19.358 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.358+0000 7f715bcceb80 1 -- 172.21.15.76:0/3793373086 wait complete. 2024-06-02T04:59:19.359 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.359+0000 7f715bcceb80 20 client.16344 trim_cache size 0 max 16384 2024-06-02T04:59:19.359 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:{ 2024-06-02T04:59:19.360 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "message": "", 2024-06-02T04:59:19.360 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "return_code": 0 2024-06-02T04:59:19.360 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:} 2024-06-02T04:59:19.363 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.363+0000 7f714fb13700 1 -- 172.21.15.76:0/2090012351 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f71340a12f0 msgr2=0x7f71340a37b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:59:19.363 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.363+0000 7f714fb13700 1 --2- 172.21.15.76:0/2090012351 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f71340a12f0 0x7f71340a37b0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x560d418a6030 tx=0x7f71400094f0 comp rx=0 tx=0).stop 2024-06-02T04:59:19.363 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.363+0000 7f714fb13700 1 -- 172.21.15.76:0/2090012351 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7148101990 msgr2=0x7f71481a6f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:59:19.364 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.363+0000 7f714fb13700 1 --2- 172.21.15.76:0/2090012351 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7148101990 0x7f71481a6f60 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f7144003a80 tx=0x7f7144003b60 comp rx=0 tx=0).stop 2024-06-02T04:59:19.364 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.364+0000 7f714fb13700 1 -- 172.21.15.76:0/2090012351 shutdown_connections 2024-06-02T04:59:19.364 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.364+0000 7f714fb13700 1 --2- 172.21.15.76:0/2090012351 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f71340a12f0 0x7f71340a37b0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:19.364 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.364+0000 7f714fb13700 1 --2- 172.21.15.76:0/2090012351 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7148101990 0x7f71481a6f60 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:19.365 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.364+0000 7f714fb13700 1 --2- 172.21.15.76:0/2090012351 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71480ffe00 0x7f714806f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:19.365 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.364+0000 7f714fb13700 1 --2- 172.21.15.76:0/2090012351 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7148100ff0 0x7f714806fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:19.365 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.364+0000 7f714fb13700 1 -- 172.21.15.76:0/2090012351 >> 172.21.15.76:0/2090012351 conn(0x7f71480fb390 msgr2=0x7f7148104410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:59:19.365 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.364+0000 7f714fb13700 1 -- 172.21.15.76:0/2090012351 shutdown_connections 2024-06-02T04:59:19.365 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:19.364+0000 7f714fb13700 1 -- 172.21.15.76:0/2090012351 wait complete. 2024-06-02T04:59:21.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 510.0 s, 656.0 tps, lat 154.443 ms stddev 75.659 2024-06-02T04:59:21.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:59:21 smithi119 ceph-mon[46633]: pgmap v561: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 15 MiB/s wr, 872 op/s 2024-06-02T04:59:21.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:59:21 smithi192 ceph-mon[47933]: pgmap v561: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 15 MiB/s wr, 872 op/s 2024-06-02T04:59:21.991 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:59:21 smithi076 ceph-mon[42935]: pgmap v561: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 15 MiB/s wr, 872 op/s 2024-06-02T04:59:23.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:59:23 smithi119 ceph-mon[46633]: pgmap v562: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 15 MiB/s wr, 872 op/s 2024-06-02T04:59:23.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:59:23 smithi192 ceph-mon[47933]: pgmap v562: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 15 MiB/s wr, 872 op/s 2024-06-02T04:59:23.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:59:23 smithi076 ceph-mon[42935]: pgmap v562: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 15 MiB/s wr, 872 op/s 2024-06-02T04:59:25.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:59:25 smithi119 ceph-mon[46633]: pgmap v563: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 13 MiB/s wr, 803 op/s 2024-06-02T04:59:25.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:59:25 smithi192 ceph-mon[47933]: pgmap v563: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 13 MiB/s wr, 803 op/s 2024-06-02T04:59:25.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:59:25 smithi076 ceph-mon[42935]: pgmap v563: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 13 MiB/s wr, 803 op/s 2024-06-02T04:59:26.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 515.0 s, 719.6 tps, lat 138.969 ms stddev 54.788 2024-06-02T04:59:27.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:59:27 smithi119 ceph-mon[46633]: pgmap v564: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 14 MiB/s wr, 907 op/s 2024-06-02T04:59:27.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:59:27 smithi192 ceph-mon[47933]: pgmap v564: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 14 MiB/s wr, 907 op/s 2024-06-02T04:59:27.985 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:59:27 smithi076 ceph-mon[42935]: pgmap v564: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 14 MiB/s wr, 907 op/s 2024-06-02T04:59:29.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:59:29 smithi119 ceph-mon[46633]: pgmap v565: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 14 MiB/s wr, 892 op/s 2024-06-02T04:59:29.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:59:29 smithi192 ceph-mon[47933]: pgmap v565: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 14 MiB/s wr, 892 op/s 2024-06-02T04:59:29.991 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:59:29 smithi076 ceph-mon[42935]: pgmap v565: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 14 MiB/s wr, 892 op/s 2024-06-02T04:59:31.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 520.0 s, 707.4 tps, lat 141.314 ms stddev 83.319 2024-06-02T04:59:31.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:59:31 smithi119 ceph-mon[46633]: pgmap v566: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 15 MiB/s wr, 962 op/s 2024-06-02T04:59:31.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:59:31 smithi192 ceph-mon[47933]: pgmap v566: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 15 MiB/s wr, 962 op/s 2024-06-02T04:59:31.986 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:59:31 smithi076 ceph-mon[42935]: pgmap v566: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 15 MiB/s wr, 962 op/s 2024-06-02T04:59:32.540 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.539+0000 7f08f252a700 1 -- 172.21.15.76:0/3146332907 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08ec1090d0 msgr2=0x7f08ec10f980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:59:32.541 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.539+0000 7f08f252a700 1 --2- 172.21.15.76:0/3146332907 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08ec1090d0 0x7f08ec10f980 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f08e400b0a0 tx=0x7f08e400b3b0 comp rx=0 tx=0).stop 2024-06-02T04:59:32.541 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.539+0000 7f08f252a700 1 -- 172.21.15.76:0/3146332907 shutdown_connections 2024-06-02T04:59:32.541 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.539+0000 7f08f252a700 1 --2- 172.21.15.76:0/3146332907 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08ec1090d0 0x7f08ec10f980 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:32.541 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.539+0000 7f08f252a700 1 --2- 172.21.15.76:0/3146332907 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f08ec107540 0x7f08ec107960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:32.541 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.539+0000 7f08f252a700 1 --2- 172.21.15.76:0/3146332907 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f08ec108730 0x7f08ec108b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:32.541 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.539+0000 7f08f252a700 1 -- 172.21.15.76:0/3146332907 >> 172.21.15.76:0/3146332907 conn(0x7f08ec0764d0 msgr2=0x7f08ec078910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:59:32.544 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.542+0000 7f08f252a700 1 -- 172.21.15.76:0/3146332907 shutdown_connections 2024-06-02T04:59:32.552 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.551+0000 7f08f252a700 1 -- 172.21.15.76:0/3146332907 wait complete. 2024-06-02T04:59:32.553 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.552+0000 7f08f252a700 1 Processor -- start 2024-06-02T04:59:32.553 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.552+0000 7f08f252a700 1 -- start start 2024-06-02T04:59:32.555 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.552+0000 7f08f252a700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08ec107540 0x7f08ec07e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:59:32.555 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.552+0000 7f08f252a700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f08ec1090d0 0x7f08ec07ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:59:32.555 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.552+0000 7f08f252a700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f08ec1ab5c0 0x7f08ec1ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:59:32.555 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.552+0000 7f08f252a700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08ec07f370 con 0x7f08ec1ab5c0 2024-06-02T04:59:32.555 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.552+0000 7f08f252a700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08ec1adef0 con 0x7f08ec1090d0 2024-06-02T04:59:32.556 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.552+0000 7f08f252a700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08ec1ae030 con 0x7f08ec107540 2024-06-02T04:59:32.556 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.552+0000 7f08ebfff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08ec107540 0x7f08ec07e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:59:32.556 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.552+0000 7f08ebfff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08ec107540 0x7f08ec07e820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:47882/0 (socket says 172.21.15.76:47882) 2024-06-02T04:59:32.556 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.552+0000 7f08ebfff700 1 -- 172.21.15.76:0/2669510790 learned_addr learned my addr 172.21.15.76:0/2669510790 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:59:32.556 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.553+0000 7f08eb7fe700 1 --2- 172.21.15.76:0/2669510790 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f08ec1090d0 0x7f08ec07ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:59:32.556 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.553+0000 7f08f0ac7700 1 --2- 172.21.15.76:0/2669510790 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f08ec1ab5c0 0x7f08ec1ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:59:32.556 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.553+0000 7f08ebfff700 1 -- 172.21.15.76:0/2669510790 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f08ec1090d0 msgr2=0x7f08ec07ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:59:32.556 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.553+0000 7f08ebfff700 1 --2- 172.21.15.76:0/2669510790 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f08ec1090d0 0x7f08ec07ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:32.556 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.553+0000 7f08ebfff700 1 -- 172.21.15.76:0/2669510790 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f08ec1ab5c0 msgr2=0x7f08ec1ad9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:59:32.556 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.553+0000 7f08ebfff700 1 --2- 172.21.15.76:0/2669510790 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f08ec1ab5c0 0x7f08ec1ad9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:32.557 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.553+0000 7f08ebfff700 1 -- 172.21.15.76:0/2669510790 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08e4009d00 con 0x7f08ec107540 2024-06-02T04:59:32.557 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.553+0000 7f08f0ac7700 1 --2- 172.21.15.76:0/2669510790 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f08ec1ab5c0 0x7f08ec1ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:59:32.557 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.553+0000 7f08ebfff700 1 --2- 172.21.15.76:0/2669510790 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08ec107540 0x7f08ec07e820 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f08e000b550 tx=0x7f08e000b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:59:32.557 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.553+0000 7f08e97fa700 1 -- 172.21.15.76:0/2669510790 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e0011830 con 0x7f08ec107540 2024-06-02T04:59:32.557 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.553+0000 7f08f252a700 1 -- 172.21.15.76:0/2669510790 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08ec1ae290 con 0x7f08ec107540 2024-06-02T04:59:32.557 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.553+0000 7f08f252a700 1 -- 172.21.15.76:0/2669510790 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08ec1ae840 con 0x7f08ec107540 2024-06-02T04:59:32.557 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.554+0000 7f08e97fa700 1 -- 172.21.15.76:0/2669510790 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f08e0011e20 con 0x7f08ec107540 2024-06-02T04:59:32.557 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.554+0000 7f08e97fa700 1 -- 172.21.15.76:0/2669510790 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e0010dd0 con 0x7f08ec107540 2024-06-02T04:59:32.559 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.558+0000 7f08e97fa700 1 -- 172.21.15.76:0/2669510790 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f08e0010380 con 0x7f08ec107540 2024-06-02T04:59:32.560 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.558+0000 7f08fe6e5b80 1 Processor -- start 2024-06-02T04:59:32.560 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.558+0000 7f08fe6e5b80 1 -- start start 2024-06-02T04:59:32.560 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.558+0000 7f08e97fa700 1 --2- 172.21.15.76:0/2669510790 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f08d40a11a0 0x7f08d40a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:59:32.560 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.558+0000 7f08e97fa700 1 -- 172.21.15.76:0/2669510790 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f08e00cc690 con 0x7f08ec107540 2024-06-02T04:59:32.560 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.559+0000 7f08f0ac7700 1 --2- 172.21.15.76:0/2669510790 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f08d40a11a0 0x7f08d40a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:59:32.561 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.559+0000 7f08fe6e5b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559847f82a80 0x559847f82ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:59:32.561 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.559+0000 7f08fe6e5b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559847f833e0 0x559847f83cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:59:32.561 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.559+0000 7f08fe6e5b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559847f842d0 0x559847f84750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:59:32.562 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.559+0000 7f08fe6e5b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x559847eda0f0 con 0x559847f833e0 2024-06-02T04:59:32.562 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.559+0000 7f08fe6e5b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x559847ed7ab0 con 0x559847f842d0 2024-06-02T04:59:32.562 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.559+0000 7f08fe6e5b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x559847ed33a0 con 0x559847f82a80 2024-06-02T04:59:32.562 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.560+0000 7f08f0ac7700 1 --2- 172.21.15.76:0/2669510790 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f08d40a11a0 0x7f08d40a3660 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f08e40062a0 tx=0x7f08e4006230 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:59:32.562 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.560+0000 7f08f0ac7700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559847f842d0 0x559847f84750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:59:32.562 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.560+0000 7f08f0ac7700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559847f842d0 0x559847f84750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:34458/0 (socket says 172.21.15.76:34458) 2024-06-02T04:59:32.562 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.560+0000 7f08eb7fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559847f833e0 0x559847f83cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:59:32.562 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.560+0000 7f08f0ac7700 1 -- 172.21.15.76:0/359899799 learned_addr learned my addr 172.21.15.76:0/359899799 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:59:32.563 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.560+0000 7f08f0ac7700 1 -- 172.21.15.76:0/359899799 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559847f82a80 msgr2=0x559847f82ea0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-02T04:59:32.564 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.560+0000 7f08f0ac7700 1 --2- 172.21.15.76:0/359899799 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559847f82a80 0x559847f82ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:32.564 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.560+0000 7f08f0ac7700 1 -- 172.21.15.76:0/359899799 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559847f833e0 msgr2=0x559847f83cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:59:32.564 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.560+0000 7f08f0ac7700 1 --2- 172.21.15.76:0/359899799 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559847f833e0 0x559847f83cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:32.564 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.560+0000 7f08f0ac7700 1 -- 172.21.15.76:0/359899799 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559847d54350 con 0x559847f842d0 2024-06-02T04:59:32.564 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.560+0000 7f08f0ac7700 1 --2- 172.21.15.76:0/359899799 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559847f842d0 0x559847f84750 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f08e4015000 tx=0x7f08e401b000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=78c70eccc61ef264 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:59:32.564 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.561+0000 7f08d27fc700 1 -- 172.21.15.76:0/359899799 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e4007760 con 0x559847f842d0 2024-06-02T04:59:32.564 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.561+0000 7f08d27fc700 1 -- 172.21.15.76:0/359899799 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f08e40078c0 con 0x559847f842d0 2024-06-02T04:59:32.564 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.561+0000 7f08d27fc700 1 -- 172.21.15.76:0/359899799 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e401b7b0 con 0x559847f842d0 2024-06-02T04:59:32.564 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.561+0000 7f08fe6e5b80 1 -- 172.21.15.76:0/359899799 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559847f842d0 msgr2=0x559847f84750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:59:32.564 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.561+0000 7f08fe6e5b80 1 --2- 172.21.15.76:0/359899799 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559847f842d0 0x559847f84750 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f08e4015000 tx=0x7f08e401b000 comp rx=0 tx=0).stop 2024-06-02T04:59:32.564 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.562+0000 7f08fe6e5b80 1 -- 172.21.15.76:0/359899799 shutdown_connections 2024-06-02T04:59:32.565 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.562+0000 7f08fe6e5b80 1 --2- 172.21.15.76:0/359899799 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559847f842d0 0x559847f84750 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:32.565 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.562+0000 7f08fe6e5b80 1 --2- 172.21.15.76:0/359899799 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559847f82a80 0x559847f82ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:32.565 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.562+0000 7f08fe6e5b80 1 --2- 172.21.15.76:0/359899799 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559847f833e0 0x559847f83cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:32.565 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.562+0000 7f08fe6e5b80 1 -- 172.21.15.76:0/359899799 >> 172.21.15.76:0/359899799 conn(0x559847ee11b0 msgr2=0x559847f7f440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:59:32.565 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.562+0000 7f08fe6e5b80 1 -- 172.21.15.76:0/359899799 shutdown_connections 2024-06-02T04:59:32.566 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.562+0000 7f08fe6e5b80 1 -- 172.21.15.76:0/359899799 wait complete. 2024-06-02T04:59:32.566 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.562+0000 7f08fe6e5b80 1 -- start start 2024-06-02T04:59:32.566 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.563+0000 7f08fe6e5b80 1 Processor -- start 2024-06-02T04:59:32.566 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.563+0000 7f08fe6e5b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559847f82a80 0x559847f8c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:59:32.566 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.563+0000 7f08fe6e5b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559847f833e0 0x559847f8ce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:59:32.566 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.563+0000 7f08fe6e5b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559847f842d0 0x559847f93eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:59:32.566 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.563+0000 7f08fe6e5b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x559847e6f500 con 0x559847f842d0 2024-06-02T04:59:32.566 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.563+0000 7f08fe6e5b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x559847e6f1a0 con 0x559847f833e0 2024-06-02T04:59:32.567 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.563+0000 7f08fe6e5b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x559847d56640 con 0x559847f82a80 2024-06-02T04:59:32.567 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.563+0000 7f08fe6e5b80 10 client.0 _ll_register_callbacks cb 0x559847e78ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:59:32.567 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.563+0000 7f08eb7fe700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559847f833e0 0x559847f8ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:59:32.567 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.563+0000 7f08eb7fe700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559847f833e0 0x559847f8ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:34466/0 (socket says 172.21.15.76:34466) 2024-06-02T04:59:32.567 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.563+0000 7f08eb7fe700 1 -- 172.21.15.76:0/6116439 learned_addr learned my addr 172.21.15.76:0/6116439 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:59:32.568 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.565+0000 7f08f0ac7700 1 --2- 172.21.15.76:0/6116439 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559847f842d0 0x559847f93eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:59:32.568 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.565+0000 7f08ebfff700 1 --2- 172.21.15.76:0/6116439 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559847f82a80 0x559847f8c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:59:32.568 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.565+0000 7f08eb7fe700 1 -- 172.21.15.76:0/6116439 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559847f82a80 msgr2=0x559847f8c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:59:32.568 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.565+0000 7f08eb7fe700 1 --2- 172.21.15.76:0/6116439 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559847f82a80 0x559847f8c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:32.568 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.565+0000 7f08eb7fe700 1 -- 172.21.15.76:0/6116439 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559847f842d0 msgr2=0x559847f93eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:59:32.568 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.565+0000 7f08eb7fe700 1 --2- 172.21.15.76:0/6116439 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559847f842d0 0x559847f93eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:32.569 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.565+0000 7f08eb7fe700 1 -- 172.21.15.76:0/6116439 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08ec1102d0 con 0x559847f833e0 2024-06-02T04:59:32.569 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.566+0000 7f08eb7fe700 1 --2- 172.21.15.76:0/6116439 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559847f833e0 0x559847f8ce70 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f08dc010500 tx=0x7f08dc0108c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=69a1e9c1636d4b08 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:59:32.569 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.566+0000 7f08cb7fe700 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-06-02T04:59:32.569 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.566+0000 7f08cb7fe700 1 -- 172.21.15.76:0/6116439 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08dc014640 con 0x559847f833e0 2024-06-02T04:59:32.569 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.566+0000 7f08cb7fe700 1 -- 172.21.15.76:0/6116439 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f08dc0147a0 con 0x559847f833e0 2024-06-02T04:59:32.569 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.566+0000 7f08fe6e5b80 1 -- 172.21.15.76:0/6116439 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559847e2c210 con 0x559847f833e0 2024-06-02T04:59:32.569 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.566+0000 7f08cb7fe700 1 -- 172.21.15.76:0/6116439 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f08dc014960 con 0x559847f833e0 2024-06-02T04:59:32.570 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.569+0000 7f08fe6e5b80 10 client.25964 fetch_fsmap learned FSMap version 36 2024-06-02T04:59:32.570 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.569+0000 7f08fe6e5b80 1 -- 172.21.15.76:0/6116439 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x559847d00b00 con 0x559847f833e0 2024-06-02T04:59:32.571 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.569+0000 7f08cb7fe700 1 -- 172.21.15.76:0/6116439 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x559847e2c210 con 0x559847f833e0 2024-06-02T04:59:32.578 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.569+0000 7f08cb7fe700 1 -- 172.21.15.76:0/6116439 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f08dc01db70 con 0x559847f833e0 2024-06-02T04:59:32.578 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.569+0000 7f08fe6e5b80 10 client.25964 fetch_fsmap finished waiting for FSMap version 36 2024-06-02T04:59:32.578 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.569+0000 7f08fe6e5b80 10 client.25964 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T04:59:32.578 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.569+0000 7f08fe6e5b80 20 client.25964 populate_metadata read hostname 'smithi076' 2024-06-02T04:59:32.578 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.569+0000 7f08fe6e5b80 1 --2- 172.21.15.76:0/6116439 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x559847fa9880 0x559847fabca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:59:32.578 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.569+0000 7f08fe6e5b80 4 client.25964 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T04:59:32.578 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.569+0000 7f08fe6e5b80 1 -- 172.21.15.76:0/6116439 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559847f527b0 con 0x559847fa9880 2024-06-02T04:59:32.578 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.570+0000 7f08ebfff700 1 --2- 172.21.15.76:0/6116439 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x559847fa9880 0x559847fabca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:59:32.579 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.575+0000 7f08ebfff700 1 --2- 172.21.15.76:0/6116439 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x559847fa9880 0x559847fabca0 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f07387569faa2b48 server_cookie=561e5e5d6f127e76 in_seq=0 out_seq=0 2024-06-02T04:59:32.579 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.575+0000 7f08cb7fe700 10 client.25964 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:59:32.579 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.575+0000 7f08cb7fe700 1 -- 172.21.15.76:0/6116439 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x559847f527b0 con 0x559847fa9880 2024-06-02T04:59:32.579 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.575+0000 7f08cb7fe700 10 client.25964 handle_command_reply: tid=0 2024-06-02T04:59:32.579 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.575+0000 7f08fe6e5b80 1 client.25964 shutdown 2024-06-02T04:59:32.579 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.576+0000 7f08fe6e5b80 1 -- 172.21.15.76:0/6116439 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559847f833e0 msgr2=0x559847f8ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:59:32.579 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.576+0000 7f08fe6e5b80 1 --2- 172.21.15.76:0/6116439 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559847f833e0 0x559847f8ce70 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f08dc010500 tx=0x7f08dc0108c0 comp rx=0 tx=0).stop 2024-06-02T04:59:32.579 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.576+0000 7f08fe6e5b80 1 -- 172.21.15.76:0/6116439 shutdown_connections 2024-06-02T04:59:32.579 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.576+0000 7f08fe6e5b80 1 --2- 172.21.15.76:0/6116439 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x559847fa9880 0x559847fabca0 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:32.579 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.576+0000 7f08fe6e5b80 1 --2- 172.21.15.76:0/6116439 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559847f842d0 0x559847f93eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:32.579 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.576+0000 7f08fe6e5b80 1 --2- 172.21.15.76:0/6116439 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559847f82a80 0x559847f8c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:32.579 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.576+0000 7f08fe6e5b80 1 --2- 172.21.15.76:0/6116439 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559847f833e0 0x559847f8ce70 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:32.580 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.576+0000 7f08fe6e5b80 1 -- 172.21.15.76:0/6116439 >> 172.21.15.76:0/6116439 conn(0x559847ee11b0 msgr2=0x559847f7d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:59:32.580 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.576+0000 7f08cb7fe700 0 client.25964 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:59:32.580 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.577+0000 7f08fe6e5b80 1 -- 172.21.15.76:0/6116439 shutdown_connections 2024-06-02T04:59:32.580 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.577+0000 7f08fe6e5b80 1 -- 172.21.15.76:0/6116439 wait complete. 2024-06-02T04:59:32.580 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.577+0000 7f08fe6e5b80 20 client.25964 trim_cache size 0 max 16384 2024-06-02T04:59:32.602 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.601+0000 7f08fe6e5b80 1 Processor -- start 2024-06-02T04:59:32.603 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.601+0000 7f08fe6e5b80 1 -- start start 2024-06-02T04:59:32.603 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.601+0000 7f08fe6e5b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559847f82a80 0x559847fa5570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:59:32.603 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.601+0000 7f08fe6e5b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559847f833e0 0x559847f93e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:59:32.603 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.601+0000 7f08fe6e5b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559847f842d0 0x559847fb0600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:59:32.604 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.601+0000 7f08fe6e5b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x559847f8b330 con 0x559847f82a80 2024-06-02T04:59:32.604 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.601+0000 7f08fe6e5b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x559847f87e30 con 0x559847f833e0 2024-06-02T04:59:32.604 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.601+0000 7f08fe6e5b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x559847f78710 con 0x559847f842d0 2024-06-02T04:59:32.604 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.601+0000 7f08ebfff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559847f82a80 0x559847fa5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:59:32.604 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.601+0000 7f08ebfff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559847f82a80 0x559847fa5570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:34054/0 (socket says 172.21.15.76:34054) 2024-06-02T04:59:32.604 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.601+0000 7f08ebfff700 1 -- 172.21.15.76:0/3532597428 learned_addr learned my addr 172.21.15.76:0/3532597428 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:59:32.604 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.601+0000 7f08eb7fe700 1 --2- 172.21.15.76:0/3532597428 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559847f833e0 0x559847f93e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:59:32.604 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.601+0000 7f08f0ac7700 1 --2- 172.21.15.76:0/3532597428 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559847f842d0 0x559847fb0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:59:32.604 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.602+0000 7f08ebfff700 1 -- 172.21.15.76:0/3532597428 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559847f842d0 msgr2=0x559847fb0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:59:32.604 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.602+0000 7f08ebfff700 1 --2- 172.21.15.76:0/3532597428 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559847f842d0 0x559847fb0600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:32.604 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.602+0000 7f08ebfff700 1 -- 172.21.15.76:0/3532597428 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559847f833e0 msgr2=0x559847f93e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:59:32.605 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.602+0000 7f08ebfff700 1 --2- 172.21.15.76:0/3532597428 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559847f833e0 0x559847f93e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:32.605 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.602+0000 7f08ebfff700 1 -- 172.21.15.76:0/3532597428 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559847e99500 con 0x559847f82a80 2024-06-02T04:59:32.605 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.602+0000 7f08ebfff700 1 --2- 172.21.15.76:0/3532597428 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559847f82a80 0x559847fa5570 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f08e00ca1c0 tx=0x7f08e00b9040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c543de1ec053a19 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:59:32.607 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.602+0000 7f08d2ffd700 1 -- 172.21.15.76:0/3532597428 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e0099100 con 0x559847f82a80 2024-06-02T04:59:32.607 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.602+0000 7f08d2ffd700 1 -- 172.21.15.76:0/3532597428 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f08e0099ea0 con 0x559847f82a80 2024-06-02T04:59:32.607 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.602+0000 7f08d2ffd700 1 -- 172.21.15.76:0/3532597428 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e0097b40 con 0x559847f82a80 2024-06-02T04:59:32.608 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.603+0000 7f08fe6e5b80 1 -- 172.21.15.76:0/3532597428 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559847f82a80 msgr2=0x559847fa5570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:59:32.608 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.603+0000 7f08fe6e5b80 1 --2- 172.21.15.76:0/3532597428 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559847f82a80 0x559847fa5570 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f08e00ca1c0 tx=0x7f08e00b9040 comp rx=0 tx=0).stop 2024-06-02T04:59:32.608 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.603+0000 7f08fe6e5b80 1 -- 172.21.15.76:0/3532597428 shutdown_connections 2024-06-02T04:59:32.608 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.603+0000 7f08fe6e5b80 1 --2- 172.21.15.76:0/3532597428 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559847f842d0 0x559847fb0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:32.608 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.603+0000 7f08fe6e5b80 1 --2- 172.21.15.76:0/3532597428 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559847f82a80 0x559847fa5570 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:32.608 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.603+0000 7f08fe6e5b80 1 --2- 172.21.15.76:0/3532597428 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559847f833e0 0x559847f93e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:32.608 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.603+0000 7f08fe6e5b80 1 -- 172.21.15.76:0/3532597428 >> 172.21.15.76:0/3532597428 conn(0x559847ee11b0 msgr2=0x559847f8a8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:59:32.608 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.603+0000 7f08fe6e5b80 1 -- 172.21.15.76:0/3532597428 shutdown_connections 2024-06-02T04:59:32.608 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.603+0000 7f08fe6e5b80 1 -- 172.21.15.76:0/3532597428 wait complete. 2024-06-02T04:59:32.608 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.604+0000 7f08fe6e5b80 1 -- start start 2024-06-02T04:59:32.609 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.604+0000 7f08fe6e5b80 1 Processor -- start 2024-06-02T04:59:32.609 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.604+0000 7f08fe6e5b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559847f82a80 0x559847f919d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:59:32.609 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.604+0000 7f08fe6e5b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559847f833e0 0x559847f91f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:59:32.609 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.604+0000 7f08fe6e5b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559847f842d0 0x559847f92d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:59:32.609 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.604+0000 7f08fe6e5b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x559847f932d0 con 0x559847f833e0 2024-06-02T04:59:32.609 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.604+0000 7f08fe6e5b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x559847f93440 con 0x559847f842d0 2024-06-02T04:59:32.609 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.604+0000 7f08fe6e5b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x559847f935b0 con 0x559847f82a80 2024-06-02T04:59:32.609 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.604+0000 7f08fe6e5b80 10 client.0 _ll_register_callbacks cb 0x559847e78ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:59:32.609 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.604+0000 7f08eb7fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559847f833e0 0x559847f91f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:59:32.609 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.605+0000 7f08eb7fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559847f833e0 0x559847f91f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:34070/0 (socket says 172.21.15.76:34070) 2024-06-02T04:59:32.609 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.605+0000 7f08eb7fe700 1 -- 172.21.15.76:0/876798120 learned_addr learned my addr 172.21.15.76:0/876798120 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:59:32.609 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.605+0000 7f08ebfff700 1 --2- 172.21.15.76:0/876798120 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559847f82a80 0x559847f919d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:59:32.610 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.605+0000 7f08f0ac7700 1 --2- 172.21.15.76:0/876798120 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559847f842d0 0x559847f92d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:59:32.610 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.605+0000 7f08f0ac7700 1 -- 172.21.15.76:0/876798120 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559847f82a80 msgr2=0x559847f919d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:59:32.610 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.605+0000 7f08f0ac7700 1 --2- 172.21.15.76:0/876798120 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559847f82a80 0x559847f919d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:32.610 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.605+0000 7f08f0ac7700 1 -- 172.21.15.76:0/876798120 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559847f833e0 msgr2=0x559847f91f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:59:32.610 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.605+0000 7f08f0ac7700 1 --2- 172.21.15.76:0/876798120 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559847f833e0 0x559847f91f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:32.610 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.605+0000 7f08f0ac7700 1 -- 172.21.15.76:0/876798120 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08ec1ae840 con 0x559847f842d0 2024-06-02T04:59:32.610 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.605+0000 7f08ebfff700 1 --2- 172.21.15.76:0/876798120 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559847f82a80 0x559847f919d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T04:59:32.610 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.605+0000 7f08f0ac7700 1 --2- 172.21.15.76:0/876798120 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559847f842d0 0x559847f92d90 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f08e400b000 tx=0x7f08e401b7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df2caccedf5b563f server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:59:32.610 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.605+0000 7f08cb7fe700 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-06-02T04:59:32.610 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.605+0000 7f08cb7fe700 1 -- 172.21.15.76:0/876798120 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e401bda0 con 0x559847f842d0 2024-06-02T04:59:32.610 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.605+0000 7f08cb7fe700 1 -- 172.21.15.76:0/876798120 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f08e4022050 con 0x559847f842d0 2024-06-02T04:59:32.610 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.605+0000 7f08fe6e5b80 1 -- 172.21.15.76:0/876798120 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f08e40078c0 con 0x559847f842d0 2024-06-02T04:59:32.611 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.606+0000 7f08cb7fe700 1 -- 172.21.15.76:0/876798120 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f08e403b440 con 0x559847f842d0 2024-06-02T04:59:32.611 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.606+0000 7f08fe6e5b80 10 client.25970 fetch_fsmap learned FSMap version 36 2024-06-02T04:59:32.611 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.606+0000 7f08fe6e5b80 1 -- 172.21.15.76:0/876798120 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x559847d58c70 con 0x559847f842d0 2024-06-02T04:59:32.611 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.606+0000 7f08cb7fe700 1 -- 172.21.15.76:0/876798120 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f08e40078c0 con 0x559847f842d0 2024-06-02T04:59:32.611 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.606+0000 7f08cb7fe700 1 -- 172.21.15.76:0/876798120 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f08e4027420 con 0x559847f842d0 2024-06-02T04:59:32.612 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.606+0000 7f08fe6e5b80 10 client.25970 fetch_fsmap finished waiting for FSMap version 36 2024-06-02T04:59:32.612 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.606+0000 7f08fe6e5b80 10 client.25970 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T04:59:32.612 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.606+0000 7f08fe6e5b80 20 client.25970 populate_metadata read hostname 'smithi076' 2024-06-02T04:59:32.612 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.606+0000 7f08fe6e5b80 1 --2- 172.21.15.76:0/876798120 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x559848000440 0x559848002830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:59:32.612 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.606+0000 7f08fe6e5b80 4 client.25970 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T04:59:32.612 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.606+0000 7f08fe6e5b80 1 -- 172.21.15.76:0/876798120 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x559847ecbe60 con 0x559848000440 2024-06-02T04:59:32.612 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.606+0000 7f08ebfff700 1 --2- 172.21.15.76:0/876798120 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x559848000440 0x559848002830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:59:32.612 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.608+0000 7f08ebfff700 1 --2- 172.21.15.76:0/876798120 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x559848000440 0x559848002830 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ede94df428582ab4 server_cookie=ae7d036be8e60164 in_seq=0 out_seq=0 2024-06-02T04:59:32.614 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.611+0000 7f08cb7fe700 10 client.25970 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:59:32.641 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.639+0000 7f08cb7fe700 1 -- 172.21.15.76:0/876798120 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x559847ecbe60 con 0x559848000440 2024-06-02T04:59:32.641 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.639+0000 7f08cb7fe700 10 client.25970 handle_command_reply: tid=0 2024-06-02T04:59:32.641 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.639+0000 7f08fe6e5b80 1 client.25970 shutdown 2024-06-02T04:59:32.642 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.640+0000 7f08fe6e5b80 1 -- 172.21.15.76:0/876798120 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559847f842d0 msgr2=0x559847f92d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:59:32.642 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.640+0000 7f08fe6e5b80 1 --2- 172.21.15.76:0/876798120 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559847f842d0 0x559847f92d90 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f08e400b000 tx=0x7f08e401b7a0 comp rx=0 tx=0).stop 2024-06-02T04:59:32.642 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.640+0000 7f08fe6e5b80 1 -- 172.21.15.76:0/876798120 shutdown_connections 2024-06-02T04:59:32.642 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.640+0000 7f08fe6e5b80 1 --2- 172.21.15.76:0/876798120 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x559848000440 0x559848002830 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:32.642 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.640+0000 7f08fe6e5b80 1 --2- 172.21.15.76:0/876798120 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559847f842d0 0x559847f92d90 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:32.642 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.640+0000 7f08fe6e5b80 1 --2- 172.21.15.76:0/876798120 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559847f82a80 0x559847f919d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:32.642 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.640+0000 7f08fe6e5b80 1 --2- 172.21.15.76:0/876798120 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559847f833e0 0x559847f91f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:32.642 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.640+0000 7f08fe6e5b80 1 -- 172.21.15.76:0/876798120 >> 172.21.15.76:0/876798120 conn(0x559847ee11b0 msgr2=0x559847f8bb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:59:32.642 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.640+0000 7f08cb7fe700 0 client.25970 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:59:32.643 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.642+0000 7f08fe6e5b80 1 -- 172.21.15.76:0/876798120 shutdown_connections 2024-06-02T04:59:32.643 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.642+0000 7f08fe6e5b80 1 -- 172.21.15.76:0/876798120 wait complete. 2024-06-02T04:59:32.644 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:{ 2024-06-02T04:59:32.644 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "message": "", 2024-06-02T04:59:32.644 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "return_code": 0 2024-06-02T04:59:32.644 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:} 2024-06-02T04:59:32.645 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.642+0000 7f08fe6e5b80 20 client.25970 trim_cache size 0 max 16384 2024-06-02T04:59:32.645 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.643+0000 7f08f252a700 1 -- 172.21.15.76:0/2669510790 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f08d40a11a0 msgr2=0x7f08d40a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:59:32.645 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.643+0000 7f08f252a700 1 --2- 172.21.15.76:0/2669510790 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f08d40a11a0 0x7f08d40a3660 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f08e40062a0 tx=0x7f08e4006230 comp rx=0 tx=0).stop 2024-06-02T04:59:32.645 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.643+0000 7f08f252a700 1 -- 172.21.15.76:0/2669510790 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08ec107540 msgr2=0x7f08ec07e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:59:32.645 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.643+0000 7f08f252a700 1 --2- 172.21.15.76:0/2669510790 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08ec107540 0x7f08ec07e820 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f08e000b550 tx=0x7f08e000b910 comp rx=0 tx=0).stop 2024-06-02T04:59:32.645 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.644+0000 7f08f252a700 1 -- 172.21.15.76:0/2669510790 shutdown_connections 2024-06-02T04:59:32.645 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.644+0000 7f08f252a700 1 --2- 172.21.15.76:0/2669510790 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f08ec1ab5c0 0x7f08ec1ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:32.646 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.644+0000 7f08f252a700 1 --2- 172.21.15.76:0/2669510790 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08ec107540 0x7f08ec07e820 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:32.646 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.644+0000 7f08f252a700 1 --2- 172.21.15.76:0/2669510790 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f08d40a11a0 0x7f08d40a3660 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:32.646 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.644+0000 7f08f252a700 1 --2- 172.21.15.76:0/2669510790 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f08ec1090d0 0x7f08ec07ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:32.646 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.644+0000 7f08f252a700 1 -- 172.21.15.76:0/2669510790 >> 172.21.15.76:0/2669510790 conn(0x7f08ec0764d0 msgr2=0x7f08ec10bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:59:32.646 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.645+0000 7f08f252a700 1 -- 172.21.15.76:0/2669510790 shutdown_connections 2024-06-02T04:59:32.646 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:32.645+0000 7f08f252a700 1 -- 172.21.15.76:0/2669510790 wait complete. 2024-06-02T04:59:33.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:59:33 smithi119 ceph-mon[46633]: pgmap v567: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 13 MiB/s wr, 939 op/s 2024-06-02T04:59:33.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:59:33 smithi192 ceph-mon[47933]: pgmap v567: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 13 MiB/s wr, 939 op/s 2024-06-02T04:59:33.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:59:33 smithi076 ceph-mon[42935]: pgmap v567: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 13 MiB/s wr, 939 op/s 2024-06-02T04:59:35.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:59:35 smithi192 ceph-mon[47933]: pgmap v568: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 11 MiB/s wr, 813 op/s 2024-06-02T04:59:35.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:59:35 smithi076 ceph-mon[42935]: pgmap v568: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 11 MiB/s wr, 813 op/s 2024-06-02T04:59:36.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:59:35 smithi119 ceph-mon[46633]: pgmap v568: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 11 MiB/s wr, 813 op/s 2024-06-02T04:59:36.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 525.0 s, 755.4 tps, lat 129.563 ms stddev 52.817 2024-06-02T04:59:36.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:59:36 smithi192 ceph-mon[47933]: pgmap v569: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 13 MiB/s wr, 927 op/s 2024-06-02T04:59:36.989 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:59:36 smithi076 ceph-mon[42935]: pgmap v569: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 13 MiB/s wr, 927 op/s 2024-06-02T04:59:37.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:59:36 smithi119 ceph-mon[46633]: pgmap v569: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 13 MiB/s wr, 927 op/s 2024-06-02T04:59:39.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:59:39 smithi119 ceph-mon[46633]: pgmap v570: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 12 MiB/s wr, 866 op/s 2024-06-02T04:59:39.933 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:59:39 smithi192 ceph-mon[47933]: pgmap v570: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 12 MiB/s wr, 866 op/s 2024-06-02T04:59:39.987 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:59:39 smithi076 ceph-mon[42935]: pgmap v570: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 12 MiB/s wr, 866 op/s 2024-06-02T04:59:41.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 530.0 s, 625.4 tps, lat 162.992 ms stddev 172.019 2024-06-02T04:59:41.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:59:41 smithi119 ceph-mon[46633]: pgmap v571: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 12 MiB/s wr, 920 op/s 2024-06-02T04:59:41.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:59:41 smithi192 ceph-mon[47933]: pgmap v571: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 12 MiB/s wr, 920 op/s 2024-06-02T04:59:41.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:59:41 smithi076 ceph-mon[42935]: pgmap v571: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 12 MiB/s wr, 920 op/s 2024-06-02T04:59:43.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:59:43 smithi119 ceph-mon[46633]: pgmap v572: 129 pgs: 129 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 12 MiB/s wr, 888 op/s 2024-06-02T04:59:43.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:59:43 smithi192 ceph-mon[47933]: pgmap v572: 129 pgs: 129 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 12 MiB/s wr, 888 op/s 2024-06-02T04:59:43.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:59:43 smithi076 ceph-mon[42935]: pgmap v572: 129 pgs: 129 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 12 MiB/s wr, 888 op/s 2024-06-02T04:59:45.836 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.835+0000 7f382c9a1700 1 -- 172.21.15.76:0/2747213028 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3828104b10 msgr2=0x7f3828104f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:59:45.836 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.835+0000 7f382c9a1700 1 --2- 172.21.15.76:0/2747213028 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3828104b10 0x7f3828104f90 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f382000b0a0 tx=0x7f382000b3b0 comp rx=0 tx=0).stop 2024-06-02T04:59:45.836 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.835+0000 7f382c9a1700 1 -- 172.21.15.76:0/2747213028 shutdown_connections 2024-06-02T04:59:45.836 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.835+0000 7f382c9a1700 1 --2- 172.21.15.76:0/2747213028 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3828104b10 0x7f3828104f90 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:45.836 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.835+0000 7f382c9a1700 1 --2- 172.21.15.76:0/2747213028 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f38280ff7d0 0x7f3828101c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:45.836 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.835+0000 7f382c9a1700 1 --2- 172.21.15.76:0/2747213028 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3828102140 0x7f38281045d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:45.836 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.835+0000 7f382c9a1700 1 -- 172.21.15.76:0/2747213028 >> 172.21.15.76:0/2747213028 conn(0x7f38280fb390 msgr2=0x7f38280fd7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:59:45.836 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.835+0000 7f382c9a1700 1 -- 172.21.15.76:0/2747213028 shutdown_connections 2024-06-02T04:59:45.837 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.835+0000 7f382c9a1700 1 -- 172.21.15.76:0/2747213028 wait complete. 2024-06-02T04:59:45.838 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.836+0000 7f382c9a1700 1 Processor -- start 2024-06-02T04:59:45.838 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.836+0000 7f382c9a1700 1 -- start start 2024-06-02T04:59:45.838 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.836+0000 7f382c9a1700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f38280ff7d0 0x7f382819d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:59:45.838 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.836+0000 7f382c9a1700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3828102140 0x7f382819d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:59:45.838 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.836+0000 7f382c9a1700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3828104b10 0x7f38281a4890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:59:45.838 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.836+0000 7f382c9a1700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38281a4e60 con 0x7f3828104b10 2024-06-02T04:59:45.838 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.836+0000 7f382c9a1700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3828105df0 con 0x7f3828102140 2024-06-02T04:59:45.838 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.836+0000 7f382c9a1700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3828105f80 con 0x7f38280ff7d0 2024-06-02T04:59:45.838 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.837+0000 7f3825d9b700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3828102140 0x7f382819d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:59:45.839 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.837+0000 7f3825d9b700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3828102140 0x7f382819d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:46810/0 (socket says 172.21.15.76:46810) 2024-06-02T04:59:45.839 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.837+0000 7f3825d9b700 1 -- 172.21.15.76:0/392147511 learned_addr learned my addr 172.21.15.76:0/392147511 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:59:45.839 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.837+0000 7f382659c700 1 --2- 172.21.15.76:0/392147511 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f38280ff7d0 0x7f382819d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:59:45.839 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.837+0000 7f3826d9d700 1 --2- 172.21.15.76:0/392147511 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3828104b10 0x7f38281a4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:59:45.839 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.837+0000 7f3825d9b700 1 -- 172.21.15.76:0/392147511 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f38280ff7d0 msgr2=0x7f382819d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:59:45.839 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.837+0000 7f3825d9b700 1 --2- 172.21.15.76:0/392147511 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f38280ff7d0 0x7f382819d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:45.839 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.837+0000 7f3825d9b700 1 -- 172.21.15.76:0/392147511 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3828104b10 msgr2=0x7f38281a4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:59:45.839 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.837+0000 7f3825d9b700 1 --2- 172.21.15.76:0/392147511 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3828104b10 0x7f38281a4890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:45.839 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.837+0000 7f3825d9b700 1 -- 172.21.15.76:0/392147511 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3820009d00 con 0x7f3828102140 2024-06-02T04:59:45.839 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.837+0000 7f3826d9d700 1 --2- 172.21.15.76:0/392147511 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3828104b10 0x7f38281a4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:59:45.840 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.837+0000 7f3825d9b700 1 --2- 172.21.15.76:0/392147511 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3828102140 0x7f382819d870 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f381800e9a0 tx=0x7f381800ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:59:45.840 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.837+0000 7f38177fe700 1 -- 172.21.15.76:0/392147511 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3818009790 con 0x7f3828102140 2024-06-02T04:59:45.840 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.838+0000 7f38177fe700 1 -- 172.21.15.76:0/392147511 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f381800cbd0 con 0x7f3828102140 2024-06-02T04:59:45.840 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.838+0000 7f38177fe700 1 -- 172.21.15.76:0/392147511 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3818018680 con 0x7f3828102140 2024-06-02T04:59:45.842 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.838+0000 7f382c9a1700 1 -- 172.21.15.76:0/392147511 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3828106260 con 0x7f3828102140 2024-06-02T04:59:45.842 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.838+0000 7f382c9a1700 1 -- 172.21.15.76:0/392147511 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3828106720 con 0x7f3828102140 2024-06-02T04:59:45.842 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.842+0000 7f3838b5cb80 1 Processor -- start 2024-06-02T04:59:45.844 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.842+0000 7f38177fe700 1 -- 172.21.15.76:0/392147511 <== mon.2 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f381800cd40 con 0x7f3828102140 2024-06-02T04:59:45.844 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.843+0000 7f38177fe700 1 --2- 172.21.15.76:0/392147511 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f38100a1270 0x7f38100a3730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:59:45.844 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.843+0000 7f38177fe700 1 -- 172.21.15.76:0/392147511 <== mon.2 v2:172.21.15.119:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f3818014070 con 0x7f3828102140 2024-06-02T04:59:45.844 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.843+0000 7f3826d9d700 1 --2- 172.21.15.76:0/392147511 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f38100a1270 0x7f38100a3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:59:45.844 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.844+0000 7f3838b5cb80 1 -- start start 2024-06-02T04:59:45.845 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.844+0000 7f3826d9d700 1 --2- 172.21.15.76:0/392147511 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f38100a1270 0x7f38100a3730 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f3820009610 tx=0x7f3820007b60 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:59:45.845 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.844+0000 7f3838b5cb80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c3c3f88a80 0x55c3c3f88ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:59:45.845 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.844+0000 7f3838b5cb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c3c3f893e0 0x55c3c3f89cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:59:45.845 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.844+0000 7f3838b5cb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c3c3f8a2d0 0x55c3c3f8a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:59:45.845 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.844+0000 7f3838b5cb80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3c3ee00f0 con 0x55c3c3f88a80 2024-06-02T04:59:45.845 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.844+0000 7f3838b5cb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3c3eddab0 con 0x55c3c3f893e0 2024-06-02T04:59:45.845 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.844+0000 7f3838b5cb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3c3ed93a0 con 0x55c3c3f8a2d0 2024-06-02T04:59:45.846 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.844+0000 7f382659c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c3c3f88a80 0x55c3c3f88ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:59:45.846 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.844+0000 7f382659c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c3c3f88a80 0x55c3c3f88ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:42240/0 (socket says 172.21.15.76:42240) 2024-06-02T04:59:45.846 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.844+0000 7f382659c700 1 -- 172.21.15.76:0/335199967 learned_addr learned my addr 172.21.15.76:0/335199967 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:59:45.846 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.844+0000 7f3826d9d700 1 --2- 172.21.15.76:0/335199967 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c3c3f8a2d0 0x55c3c3f8a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:59:45.846 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.845+0000 7f382659c700 1 -- 172.21.15.76:0/335199967 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c3c3f8a2d0 msgr2=0x55c3c3f8a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:59:45.846 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.845+0000 7f382659c700 1 --2- 172.21.15.76:0/335199967 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c3c3f8a2d0 0x55c3c3f8a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:45.846 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.845+0000 7f382659c700 1 -- 172.21.15.76:0/335199967 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c3c3f893e0 msgr2=0x55c3c3f89cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:59:45.847 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.845+0000 7f3825d9b700 1 --2- 172.21.15.76:0/335199967 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c3c3f893e0 0x55c3c3f89cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:59:45.847 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.845+0000 7f382659c700 1 --2- 172.21.15.76:0/335199967 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c3c3f893e0 0x55c3c3f89cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:45.847 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.845+0000 7f382659c700 1 -- 172.21.15.76:0/335199967 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c3c3d5a350 con 0x55c3c3f88a80 2024-06-02T04:59:45.847 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.845+0000 7f382659c700 1 --2- 172.21.15.76:0/335199967 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c3c3f88a80 0x55c3c3f88ea0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f381c00bd70 tx=0x7f381c0106b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7befa2347347880c server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:59:45.847 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:59:45 smithi119 ceph-mon[46633]: pgmap v573: 129 pgs: 129 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 10 MiB/s wr, 770 op/s 2024-06-02T04:59:45.849 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.846+0000 7f3814ff9700 1 -- 172.21.15.76:0/335199967 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f381c010e10 con 0x55c3c3f88a80 2024-06-02T04:59:45.849 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.846+0000 7f3814ff9700 1 -- 172.21.15.76:0/335199967 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f381c015070 con 0x55c3c3f88a80 2024-06-02T04:59:45.849 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.846+0000 7f3814ff9700 1 -- 172.21.15.76:0/335199967 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f381c0116a0 con 0x55c3c3f88a80 2024-06-02T04:59:45.850 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.847+0000 7f3838b5cb80 1 -- 172.21.15.76:0/335199967 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c3c3f88a80 msgr2=0x55c3c3f88ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:59:45.850 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.847+0000 7f3838b5cb80 1 --2- 172.21.15.76:0/335199967 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c3c3f88a80 0x55c3c3f88ea0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f381c00bd70 tx=0x7f381c0106b0 comp rx=0 tx=0).stop 2024-06-02T04:59:45.850 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.847+0000 7f3838b5cb80 1 -- 172.21.15.76:0/335199967 shutdown_connections 2024-06-02T04:59:45.850 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.847+0000 7f3838b5cb80 1 --2- 172.21.15.76:0/335199967 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c3c3f8a2d0 0x55c3c3f8a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:45.850 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.847+0000 7f3838b5cb80 1 --2- 172.21.15.76:0/335199967 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c3c3f88a80 0x55c3c3f88ea0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:45.850 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.847+0000 7f3838b5cb80 1 --2- 172.21.15.76:0/335199967 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c3c3f893e0 0x55c3c3f89cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:45.850 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.847+0000 7f3838b5cb80 1 -- 172.21.15.76:0/335199967 >> 172.21.15.76:0/335199967 conn(0x55c3c3ee71b0 msgr2=0x55c3c3f85440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:59:45.850 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.847+0000 7f3838b5cb80 1 -- 172.21.15.76:0/335199967 shutdown_connections 2024-06-02T04:59:45.850 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.847+0000 7f3838b5cb80 1 -- 172.21.15.76:0/335199967 wait complete. 2024-06-02T04:59:45.850 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.847+0000 7f3838b5cb80 1 -- start start 2024-06-02T04:59:45.850 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.847+0000 7f3838b5cb80 1 Processor -- start 2024-06-02T04:59:45.850 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.847+0000 7f3838b5cb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c3c3f88a80 0x55c3c3fa3900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:59:45.851 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.847+0000 7f3838b5cb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c3c3f893e0 0x55c3c3fa3e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:59:45.851 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.847+0000 7f3838b5cb80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c3c3f8a2d0 0x55c3c3faae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:59:45.851 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.847+0000 7f3838b5cb80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3c3e75500 con 0x55c3c3f8a2d0 2024-06-02T04:59:45.851 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.847+0000 7f3838b5cb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3c3e751a0 con 0x55c3c3f893e0 2024-06-02T04:59:45.851 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.847+0000 7f3838b5cb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3c3d5c640 con 0x55c3c3f88a80 2024-06-02T04:59:45.851 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.848+0000 7f3838b5cb80 10 client.0 _ll_register_callbacks cb 0x55c3c3e7ead0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:59:45.851 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.848+0000 7f382659c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c3c3f88a80 0x55c3c3fa3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:59:45.851 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.848+0000 7f382659c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c3c3f88a80 0x55c3c3fa3900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:60304/0 (socket says 172.21.15.76:60304) 2024-06-02T04:59:45.851 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.848+0000 7f382659c700 1 -- 172.21.15.76:0/2763323751 learned_addr learned my addr 172.21.15.76:0/2763323751 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:59:45.851 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.848+0000 7f3826d9d700 1 --2- 172.21.15.76:0/2763323751 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c3c3f8a2d0 0x55c3c3faae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:59:45.851 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.848+0000 7f382659c700 1 -- 172.21.15.76:0/2763323751 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c3c3f893e0 msgr2=0x55c3c3fa3e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:59:45.851 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.848+0000 7f382659c700 1 --2- 172.21.15.76:0/2763323751 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c3c3f893e0 0x55c3c3fa3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:45.851 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.848+0000 7f382659c700 1 -- 172.21.15.76:0/2763323751 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c3c3f8a2d0 msgr2=0x55c3c3faae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:59:45.852 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.848+0000 7f382659c700 1 --2- 172.21.15.76:0/2763323751 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c3c3f8a2d0 0x55c3c3faae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:45.852 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.848+0000 7f382659c700 1 -- 172.21.15.76:0/2763323751 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f381c00b9a0 con 0x55c3c3f88a80 2024-06-02T04:59:45.852 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.848+0000 7f382659c700 1 --2- 172.21.15.76:0/2763323751 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c3c3f88a80 0x55c3c3fa3900 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f381c010e40 tx=0x7f381c010e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cfc69f7f330b7d53 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:59:45.852 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.848+0000 7f380dffb700 10 client.0 ms_handle_connect on v2:172.21.15.192:3300/0 2024-06-02T04:59:45.852 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.849+0000 7f380dffb700 1 -- 172.21.15.76:0/2763323751 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f381c020070 con 0x55c3c3f88a80 2024-06-02T04:59:45.852 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.849+0000 7f380dffb700 1 -- 172.21.15.76:0/2763323751 <== mon.1 v2:172.21.15.192:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f381c017070 con 0x55c3c3f88a80 2024-06-02T04:59:45.852 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.849+0000 7f3838b5cb80 1 -- 172.21.15.76:0/2763323751 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c3c3e32210 con 0x55c3c3f88a80 2024-06-02T04:59:45.852 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.849+0000 7f380dffb700 1 -- 172.21.15.76:0/2763323751 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f381c01c480 con 0x55c3c3f88a80 2024-06-02T04:59:45.852 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.849+0000 7f3838b5cb80 10 client.25936 fetch_fsmap learned FSMap version 36 2024-06-02T04:59:45.852 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.849+0000 7f3838b5cb80 1 -- 172.21.15.76:0/2763323751 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55c3c3d06b00 con 0x55c3c3f88a80 2024-06-02T04:59:45.853 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.849+0000 7f380dffb700 1 -- 172.21.15.76:0/2763323751 <== mon.1 v2:172.21.15.192:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55c3c3e32210 con 0x55c3c3f88a80 2024-06-02T04:59:45.853 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.849+0000 7f380dffb700 1 -- 172.21.15.76:0/2763323751 <== mon.1 v2:172.21.15.192:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f381c004750 con 0x55c3c3f88a80 2024-06-02T04:59:45.853 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.849+0000 7f3838b5cb80 10 client.25936 fetch_fsmap finished waiting for FSMap version 36 2024-06-02T04:59:45.853 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.849+0000 7f3838b5cb80 10 client.25936 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T04:59:45.853 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.849+0000 7f3838b5cb80 20 client.25936 populate_metadata read hostname 'smithi076' 2024-06-02T04:59:45.853 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.849+0000 7f3838b5cb80 1 --2- 172.21.15.76:0/2763323751 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55c3c3faf550 0x55c3c3fb1970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:59:45.853 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.849+0000 7f3838b5cb80 4 client.25936 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T04:59:45.853 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.849+0000 7f3838b5cb80 1 -- 172.21.15.76:0/2763323751 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c3c3f587b0 con 0x55c3c3faf550 2024-06-02T04:59:45.855 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.855+0000 7f3825d9b700 1 --2- 172.21.15.76:0/2763323751 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55c3c3faf550 0x55c3c3fb1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:59:45.860 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.860+0000 7f3825d9b700 1 --2- 172.21.15.76:0/2763323751 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55c3c3faf550 0x55c3c3fb1970 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=81f2847729e5803c server_cookie=5f2f4edcb9094b1e in_seq=0 out_seq=0 2024-06-02T04:59:45.860 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.860+0000 7f380dffb700 10 client.25936 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:59:45.861 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.860+0000 7f380dffb700 1 -- 172.21.15.76:0/2763323751 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55c3c3f587b0 con 0x55c3c3faf550 2024-06-02T04:59:45.861 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.860+0000 7f380dffb700 10 client.25936 handle_command_reply: tid=0 2024-06-02T04:59:45.861 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.860+0000 7f3838b5cb80 1 client.25936 shutdown 2024-06-02T04:59:45.861 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.860+0000 7f3838b5cb80 1 -- 172.21.15.76:0/2763323751 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c3c3f88a80 msgr2=0x55c3c3fa3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:59:45.861 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.860+0000 7f3838b5cb80 1 --2- 172.21.15.76:0/2763323751 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c3c3f88a80 0x55c3c3fa3900 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f381c010e40 tx=0x7f381c010e70 comp rx=0 tx=0).stop 2024-06-02T04:59:45.861 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.861+0000 7f3838b5cb80 1 -- 172.21.15.76:0/2763323751 shutdown_connections 2024-06-02T04:59:45.861 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.861+0000 7f3838b5cb80 1 --2- 172.21.15.76:0/2763323751 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55c3c3faf550 0x55c3c3fb1970 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:45.862 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.861+0000 7f3838b5cb80 1 --2- 172.21.15.76:0/2763323751 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c3c3f8a2d0 0x55c3c3faae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:45.862 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.861+0000 7f3838b5cb80 1 --2- 172.21.15.76:0/2763323751 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c3c3f88a80 0x55c3c3fa3900 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:45.862 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.861+0000 7f3838b5cb80 1 --2- 172.21.15.76:0/2763323751 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c3c3f893e0 0x55c3c3fa3e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:45.862 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.861+0000 7f380dffb700 0 client.25936 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:59:45.862 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.861+0000 7f3838b5cb80 1 -- 172.21.15.76:0/2763323751 >> 172.21.15.76:0/2763323751 conn(0x55c3c3ee71b0 msgr2=0x55c3c3f83860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:59:45.862 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.861+0000 7f3838b5cb80 1 -- 172.21.15.76:0/2763323751 shutdown_connections 2024-06-02T04:59:45.866 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.861+0000 7f3838b5cb80 1 -- 172.21.15.76:0/2763323751 wait complete. 2024-06-02T04:59:45.866 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.861+0000 7f3838b5cb80 20 client.25936 trim_cache size 0 max 16384 2024-06-02T04:59:45.884 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.881+0000 7f3838b5cb80 1 Processor -- start 2024-06-02T04:59:45.884 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.881+0000 7f3838b5cb80 1 -- start start 2024-06-02T04:59:45.884 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.881+0000 7f3838b5cb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c3c3f88a80 0x55c3c3fab530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:59:45.884 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.881+0000 7f3838b5cb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c3c3f893e0 0x55c3c3faae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:59:45.884 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.881+0000 7f3838b5cb80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c3c3f8a2d0 0x55c3c3f8a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:59:45.885 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.881+0000 7f3838b5cb80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3c3fac000 con 0x55c3c3f8a2d0 2024-06-02T04:59:45.885 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.881+0000 7f3838b5cb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3c3f89900 con 0x55c3c3f88a80 2024-06-02T04:59:45.885 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.881+0000 7f3838b5cb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3c3f84960 con 0x55c3c3f893e0 2024-06-02T04:59:45.885 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.881+0000 7f3826d9d700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c3c3f8a2d0 0x55c3c3f8a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:59:45.885 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.881+0000 7f3826d9d700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c3c3f8a2d0 0x55c3c3f8a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:42264/0 (socket says 172.21.15.76:42264) 2024-06-02T04:59:45.885 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.881+0000 7f3826d9d700 1 -- 172.21.15.76:0/2011605497 learned_addr learned my addr 172.21.15.76:0/2011605497 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:59:45.885 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.881+0000 7f3825d9b700 1 --2- 172.21.15.76:0/2011605497 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c3c3f893e0 0x55c3c3faae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:59:45.885 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.881+0000 7f382659c700 1 --2- 172.21.15.76:0/2011605497 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c3c3f88a80 0x55c3c3fab530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:59:45.885 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.881+0000 7f3825d9b700 1 -- 172.21.15.76:0/2011605497 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c3c3f88a80 msgr2=0x55c3c3fab530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:59:45.885 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.881+0000 7f3825d9b700 1 --2- 172.21.15.76:0/2011605497 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c3c3f88a80 0x55c3c3fab530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:45.885 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.881+0000 7f3825d9b700 1 -- 172.21.15.76:0/2011605497 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c3c3f8a2d0 msgr2=0x55c3c3f8a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:59:45.885 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.881+0000 7f3825d9b700 1 --2- 172.21.15.76:0/2011605497 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c3c3f8a2d0 0x55c3c3f8a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:45.885 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.881+0000 7f3825d9b700 1 -- 172.21.15.76:0/2011605497 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c3c3e9f500 con 0x55c3c3f893e0 2024-06-02T04:59:45.885 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.882+0000 7f3825d9b700 1 --2- 172.21.15.76:0/2011605497 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c3c3f893e0 0x55c3c3faae40 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f38180ca790 tx=0x7f38180ca660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b613b70e38621da6 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:59:45.886 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.882+0000 7f38157fa700 1 -- 172.21.15.76:0/2011605497 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38180b1070 con 0x55c3c3f893e0 2024-06-02T04:59:45.886 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.882+0000 7f38157fa700 1 -- 172.21.15.76:0/2011605497 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3818082070 con 0x55c3c3f893e0 2024-06-02T04:59:45.886 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.882+0000 7f38157fa700 1 -- 172.21.15.76:0/2011605497 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3818098510 con 0x55c3c3f893e0 2024-06-02T04:59:45.886 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.882+0000 7f3838b5cb80 1 -- 172.21.15.76:0/2011605497 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c3c3f893e0 msgr2=0x55c3c3faae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:59:45.886 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.882+0000 7f3838b5cb80 1 --2- 172.21.15.76:0/2011605497 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c3c3f893e0 0x55c3c3faae40 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f38180ca790 tx=0x7f38180ca660 comp rx=0 tx=0).stop 2024-06-02T04:59:45.886 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.882+0000 7f3838b5cb80 1 -- 172.21.15.76:0/2011605497 shutdown_connections 2024-06-02T04:59:45.886 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.882+0000 7f3838b5cb80 1 --2- 172.21.15.76:0/2011605497 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c3c3f8a2d0 0x55c3c3f8a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:45.886 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.883+0000 7f3838b5cb80 1 --2- 172.21.15.76:0/2011605497 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c3c3f88a80 0x55c3c3fab530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:45.886 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.883+0000 7f3838b5cb80 1 --2- 172.21.15.76:0/2011605497 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c3c3f893e0 0x55c3c3faae40 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:45.886 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.883+0000 7f3838b5cb80 1 -- 172.21.15.76:0/2011605497 >> 172.21.15.76:0/2011605497 conn(0x55c3c3ee71b0 msgr2=0x55c3c3fa2e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:59:45.887 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.886+0000 7f3838b5cb80 1 -- 172.21.15.76:0/2011605497 shutdown_connections 2024-06-02T04:59:45.887 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.886+0000 7f3838b5cb80 1 -- 172.21.15.76:0/2011605497 wait complete. 2024-06-02T04:59:45.887 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.887+0000 7f3838b5cb80 1 -- start start 2024-06-02T04:59:45.889 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.887+0000 7f3838b5cb80 1 Processor -- start 2024-06-02T04:59:45.889 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.887+0000 7f3838b5cb80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c3c3f88a80 0x55c3c3faac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:59:45.889 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.887+0000 7f3838b5cb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c3c3f893e0 0x55c3c3fa9220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:59:45.889 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.887+0000 7f3838b5cb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c3c3f8a2d0 0x55c3c3fa9760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:59:45.889 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.887+0000 7f3838b5cb80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3c3fa9d30 con 0x55c3c3f88a80 2024-06-02T04:59:45.889 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.887+0000 7f3838b5cb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3c3fa9e70 con 0x55c3c3f8a2d0 2024-06-02T04:59:45.890 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.887+0000 7f3838b5cb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3c3faa030 con 0x55c3c3f893e0 2024-06-02T04:59:45.890 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.887+0000 7f3838b5cb80 10 client.0 _ll_register_callbacks cb 0x55c3c3e7ead0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:59:45.890 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.888+0000 7f3825d9b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c3c3f893e0 0x55c3c3fa9220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:59:45.890 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.888+0000 7f3825d9b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c3c3f893e0 0x55c3c3fa9220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:60316/0 (socket says 172.21.15.76:60316) 2024-06-02T04:59:45.890 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.888+0000 7f3825d9b700 1 -- 172.21.15.76:0/3056232117 learned_addr learned my addr 172.21.15.76:0/3056232117 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:59:45.890 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.888+0000 7f3826d9d700 1 --2- 172.21.15.76:0/3056232117 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c3c3f8a2d0 0x55c3c3fa9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:59:45.890 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.888+0000 7f3825d9b700 1 -- 172.21.15.76:0/3056232117 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c3c3f8a2d0 msgr2=0x55c3c3fa9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:59:45.890 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.888+0000 7f3825d9b700 1 --2- 172.21.15.76:0/3056232117 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c3c3f8a2d0 0x55c3c3fa9760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:45.890 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.888+0000 7f3825d9b700 1 -- 172.21.15.76:0/3056232117 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c3c3f88a80 msgr2=0x55c3c3faac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:59:45.890 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.888+0000 7f3825d9b700 1 --2- 172.21.15.76:0/3056232117 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c3c3f88a80 0x55c3c3faac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:45.890 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.888+0000 7f3825d9b700 1 -- 172.21.15.76:0/3056232117 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3828106720 con 0x55c3c3f893e0 2024-06-02T04:59:45.890 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.888+0000 7f3825d9b700 1 --2- 172.21.15.76:0/3056232117 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c3c3f893e0 0x55c3c3fa9220 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3818012020 tx=0x7f3818098220 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8199d79eafd0bfcc server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:59:45.890 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.888+0000 7f380dffb700 10 client.0 ms_handle_connect on v2:172.21.15.192:3300/0 2024-06-02T04:59:45.891 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.888+0000 7f380dffb700 1 -- 172.21.15.76:0/3056232117 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38180b1070 con 0x55c3c3f893e0 2024-06-02T04:59:45.891 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.888+0000 7f380dffb700 1 -- 172.21.15.76:0/3056232117 <== mon.1 v2:172.21.15.192:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f38180a2560 con 0x55c3c3f893e0 2024-06-02T04:59:45.891 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.888+0000 7f3838b5cb80 1 -- 172.21.15.76:0/3056232117 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f381c015070 con 0x55c3c3f893e0 2024-06-02T04:59:45.891 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.888+0000 7f380dffb700 1 -- 172.21.15.76:0/3056232117 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f38180995d0 con 0x55c3c3f893e0 2024-06-02T04:59:45.891 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.888+0000 7f3838b5cb80 10 client.25942 fetch_fsmap learned FSMap version 36 2024-06-02T04:59:45.891 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.888+0000 7f3838b5cb80 1 -- 172.21.15.76:0/3056232117 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55c3c3d5ec70 con 0x55c3c3f893e0 2024-06-02T04:59:45.891 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.888+0000 7f380dffb700 1 -- 172.21.15.76:0/3056232117 <== mon.1 v2:172.21.15.192:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f381c015070 con 0x55c3c3f893e0 2024-06-02T04:59:45.892 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.891+0000 7f380dffb700 1 -- 172.21.15.76:0/3056232117 <== mon.1 v2:172.21.15.192:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f381807b070 con 0x55c3c3f893e0 2024-06-02T04:59:45.892 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.891+0000 7f3838b5cb80 10 client.25942 fetch_fsmap finished waiting for FSMap version 36 2024-06-02T04:59:45.892 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.891+0000 7f3838b5cb80 10 client.25942 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T04:59:45.892 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.891+0000 7f3838b5cb80 20 client.25942 populate_metadata read hostname 'smithi076' 2024-06-02T04:59:45.892 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.891+0000 7f3838b5cb80 1 --2- 172.21.15.76:0/3056232117 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55c3c3f97930 0x55c3c3f99d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:59:45.892 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.891+0000 7f3838b5cb80 4 client.25942 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T04:59:45.892 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.891+0000 7f3838b5cb80 1 -- 172.21.15.76:0/3056232117 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55c3c3ed1e60 con 0x55c3c3f97930 2024-06-02T04:59:45.893 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.892+0000 7f382659c700 1 --2- 172.21.15.76:0/3056232117 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55c3c3f97930 0x55c3c3f99d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:59:45.893 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.892+0000 7f382659c700 1 --2- 172.21.15.76:0/3056232117 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55c3c3f97930 0x55c3c3f99d50 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=11999a773071df1a server_cookie=2ecc90b6352fa9e9 in_seq=0 out_seq=0 2024-06-02T04:59:45.893 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.892+0000 7f380dffb700 10 client.25942 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:59:45.913 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.912+0000 7f380dffb700 1 -- 172.21.15.76:0/3056232117 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55c3c3ed1e60 con 0x55c3c3f97930 2024-06-02T04:59:45.913 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.912+0000 7f380dffb700 10 client.25942 handle_command_reply: tid=0 2024-06-02T04:59:45.913 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.912+0000 7f3838b5cb80 1 client.25942 shutdown 2024-06-02T04:59:45.913 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.912+0000 7f3838b5cb80 1 -- 172.21.15.76:0/3056232117 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c3c3f893e0 msgr2=0x55c3c3fa9220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:59:45.914 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.912+0000 7f3838b5cb80 1 --2- 172.21.15.76:0/3056232117 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c3c3f893e0 0x55c3c3fa9220 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3818012020 tx=0x7f3818098220 comp rx=0 tx=0).stop 2024-06-02T04:59:45.914 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.913+0000 7f3838b5cb80 1 -- 172.21.15.76:0/3056232117 shutdown_connections 2024-06-02T04:59:45.914 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.913+0000 7f3838b5cb80 1 --2- 172.21.15.76:0/3056232117 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55c3c3f97930 0x55c3c3f99d50 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:45.914 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.913+0000 7f3838b5cb80 1 --2- 172.21.15.76:0/3056232117 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c3c3f8a2d0 0x55c3c3fa9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:45.914 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.913+0000 7f3838b5cb80 1 --2- 172.21.15.76:0/3056232117 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c3c3f88a80 0x55c3c3faac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:45.914 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.913+0000 7f3838b5cb80 1 --2- 172.21.15.76:0/3056232117 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c3c3f893e0 0x55c3c3fa9220 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:45.914 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.913+0000 7f3838b5cb80 1 -- 172.21.15.76:0/3056232117 >> 172.21.15.76:0/3056232117 conn(0x55c3c3ee71b0 msgr2=0x55c3c3fa36b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:59:45.914 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.913+0000 7f380dffb700 0 client.25942 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:59:45.914 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.913+0000 7f3838b5cb80 1 -- 172.21.15.76:0/3056232117 shutdown_connections 2024-06-02T04:59:45.914 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.913+0000 7f3838b5cb80 1 -- 172.21.15.76:0/3056232117 wait complete. 2024-06-02T04:59:45.916 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.916+0000 7f3838b5cb80 20 client.25942 trim_cache size 0 max 16384 2024-06-02T04:59:45.917 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:{ 2024-06-02T04:59:45.917 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "message": "", 2024-06-02T04:59:45.917 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "return_code": 0 2024-06-02T04:59:45.917 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:} 2024-06-02T04:59:45.918 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.917+0000 7f382c9a1700 1 -- 172.21.15.76:0/392147511 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f38100a1270 msgr2=0x7f38100a3730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:59:45.918 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.917+0000 7f382c9a1700 1 --2- 172.21.15.76:0/392147511 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f38100a1270 0x7f38100a3730 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f3820009610 tx=0x7f3820007b60 comp rx=0 tx=0).stop 2024-06-02T04:59:45.918 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.917+0000 7f382c9a1700 1 -- 172.21.15.76:0/392147511 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3828102140 msgr2=0x7f382819d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:59:45.918 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.917+0000 7f382c9a1700 1 --2- 172.21.15.76:0/392147511 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3828102140 0x7f382819d870 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f381800e9a0 tx=0x7f381800ecb0 comp rx=0 tx=0).stop 2024-06-02T04:59:45.919 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.917+0000 7f382c9a1700 1 -- 172.21.15.76:0/392147511 shutdown_connections 2024-06-02T04:59:45.919 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.917+0000 7f382c9a1700 1 --2- 172.21.15.76:0/392147511 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3828104b10 0x7f38281a4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:45.919 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.917+0000 7f382c9a1700 1 --2- 172.21.15.76:0/392147511 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f38280ff7d0 0x7f382819d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:45.919 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.917+0000 7f382c9a1700 1 --2- 172.21.15.76:0/392147511 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f38100a1270 0x7f38100a3730 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:45.919 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.917+0000 7f382c9a1700 1 --2- 172.21.15.76:0/392147511 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3828102140 0x7f382819d870 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:45.919 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.917+0000 7f382c9a1700 1 -- 172.21.15.76:0/392147511 >> 172.21.15.76:0/392147511 conn(0x7f38280fb390 msgr2=0x7f3828100520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:59:45.919 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.917+0000 7f382c9a1700 1 -- 172.21.15.76:0/392147511 shutdown_connections 2024-06-02T04:59:45.919 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:45.917+0000 7f382c9a1700 1 -- 172.21.15.76:0/392147511 wait complete. 2024-06-02T04:59:45.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:59:45 smithi192 ceph-mon[47933]: pgmap v573: 129 pgs: 129 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 10 MiB/s wr, 770 op/s 2024-06-02T04:59:45.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:59:45 smithi076 ceph-mon[42935]: pgmap v573: 129 pgs: 129 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 10 MiB/s wr, 770 op/s 2024-06-02T04:59:46.316 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 535.0 s, 645.2 tps, lat 154.025 ms stddev 86.018 2024-06-02T04:59:47.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:59:47 smithi119 ceph-mon[46633]: pgmap v574: 129 pgs: 129 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 11 MiB/s wr, 867 op/s 2024-06-02T04:59:47.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:59:47 smithi192 ceph-mon[47933]: pgmap v574: 129 pgs: 129 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 11 MiB/s wr, 867 op/s 2024-06-02T04:59:47.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:59:47 smithi076 ceph-mon[42935]: pgmap v574: 129 pgs: 129 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 11 MiB/s wr, 867 op/s 2024-06-02T04:59:49.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:59:49 smithi119 ceph-mon[46633]: pgmap v575: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 11 MiB/s wr, 822 op/s 2024-06-02T04:59:49.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:59:49 smithi192 ceph-mon[47933]: pgmap v575: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 11 MiB/s wr, 822 op/s 2024-06-02T04:59:49.987 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:59:49 smithi076 ceph-mon[42935]: pgmap v575: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 11 MiB/s wr, 822 op/s 2024-06-02T04:59:51.317 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 540.0 s, 681.7 tps, lat 147.841 ms stddev 64.731 2024-06-02T04:59:51.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:59:51 smithi192 ceph-mon[47933]: pgmap v576: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 11 MiB/s wr, 844 op/s 2024-06-02T04:59:51.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:59:51 smithi076 ceph-mon[42935]: pgmap v576: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 11 MiB/s wr, 844 op/s 2024-06-02T04:59:52.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:59:51 smithi119 ceph-mon[46633]: pgmap v576: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 11 MiB/s wr, 844 op/s 2024-06-02T04:59:53.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:59:53 smithi192 ceph-mon[47933]: pgmap v577: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 11 MiB/s wr, 807 op/s 2024-06-02T04:59:53.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:59:53 smithi076 ceph-mon[42935]: pgmap v577: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 11 MiB/s wr, 807 op/s 2024-06-02T04:59:54.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:59:53 smithi119 ceph-mon[46633]: pgmap v577: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 11 MiB/s wr, 807 op/s 2024-06-02T04:59:55.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:59:55 smithi192 ceph-mon[47933]: pgmap v578: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 8.7 MiB/s wr, 692 op/s 2024-06-02T04:59:55.985 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:59:55 smithi076 ceph-mon[42935]: pgmap v578: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 8.7 MiB/s wr, 692 op/s 2024-06-02T04:59:56.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:59:55 smithi119 ceph-mon[46633]: pgmap v578: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 8.7 MiB/s wr, 692 op/s 2024-06-02T04:59:56.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 545.0 s, 531.2 tps, lat 155.424 ms stddev 65.192 2024-06-02T04:59:57.935 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:59:57 smithi192 ceph-mon[47933]: pgmap v579: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 10 MiB/s wr, 792 op/s 2024-06-02T04:59:57.985 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:59:57 smithi076 ceph-mon[42935]: pgmap v579: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 10 MiB/s wr, 792 op/s 2024-06-02T04:59:58.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:59:57 smithi119 ceph-mon[46633]: pgmap v579: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 10 MiB/s wr, 792 op/s 2024-06-02T04:59:58.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 04:59:58 smithi192 ceph-mon[47933]: pgmap v580: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 10 MiB/s wr, 764 op/s 2024-06-02T04:59:58.985 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 04:59:58 smithi076 ceph-mon[42935]: pgmap v580: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 10 MiB/s wr, 764 op/s 2024-06-02T04:59:59.092 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.091+0000 7f5a01d8d700 1 -- 172.21.15.76:0/1141991318 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f59fc109350 msgr2=0x7f59fc109770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:59:59.092 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.091+0000 7f5a01d8d700 1 --2- 172.21.15.76:0/1141991318 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f59fc109350 0x7f59fc109770 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f59f0009990 tx=0x7f59f0009ca0 comp rx=0 tx=0).stop 2024-06-02T04:59:59.092 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.092+0000 7f5a01d8d700 1 -- 172.21.15.76:0/1141991318 shutdown_connections 2024-06-02T04:59:59.092 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.092+0000 7f5a01d8d700 1 --2- 172.21.15.76:0/1141991318 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f59fc072970 0x7f59fc1084e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:59.093 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.092+0000 7f5a01d8d700 1 --2- 172.21.15.76:0/1141991318 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f59fc109350 0x7f59fc109770 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:59.093 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.092+0000 7f5a01d8d700 1 --2- 172.21.15.76:0/1141991318 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f59fc072510 0x7f59fc107fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:59.093 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.092+0000 7f5a01d8d700 1 -- 172.21.15.76:0/1141991318 >> 172.21.15.76:0/1141991318 conn(0x7f59fc06df30 msgr2=0x7f59fc070370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:59:59.095 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.094+0000 7f5a01d8d700 1 -- 172.21.15.76:0/1141991318 shutdown_connections 2024-06-02T04:59:59.095 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.095+0000 7f5a01d8d700 1 -- 172.21.15.76:0/1141991318 wait complete. 2024-06-02T04:59:59.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 04:59:58 smithi119 ceph-mon[46633]: pgmap v580: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 10 MiB/s wr, 764 op/s 2024-06-02T04:59:59.096 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.095+0000 7f5a01d8d700 1 Processor -- start 2024-06-02T04:59:59.096 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.096+0000 7f5a01d8d700 1 -- start start 2024-06-02T04:59:59.097 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.096+0000 7f5a01d8d700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f59fc072510 0x7f59fc19d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:59:59.097 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.096+0000 7f5a01d8d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f59fc072970 0x7f59fc19d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:59:59.097 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.096+0000 7f5a01d8d700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f59fc109350 0x7f59fc1a4940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:59:59.097 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.096+0000 7f5a01d8d700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59fc19e030 con 0x7f59fc072510 2024-06-02T04:59:59.097 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.096+0000 7f5a01d8d700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59fc1b60b0 con 0x7f59fc109350 2024-06-02T04:59:59.097 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.096+0000 7f5a01d8d700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59fc1b61f0 con 0x7f59fc072970 2024-06-02T04:59:59.098 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.096+0000 7f59faffd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f59fc072970 0x7f59fc19d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:59:59.098 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.096+0000 7f59fb7fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f59fc072510 0x7f59fc19d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:59:59.098 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.096+0000 7f59fb7fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f59fc072510 0x7f59fc19d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:33198/0 (socket says 172.21.15.76:33198) 2024-06-02T04:59:59.098 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.096+0000 7f59fb7fe700 1 -- 172.21.15.76:0/3679859164 learned_addr learned my addr 172.21.15.76:0/3679859164 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:59:59.098 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.096+0000 7f59fbfff700 1 --2- 172.21.15.76:0/3679859164 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f59fc109350 0x7f59fc1a4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:59:59.098 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.097+0000 7f59fbfff700 1 -- 172.21.15.76:0/3679859164 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f59fc072970 msgr2=0x7f59fc19d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:59:59.098 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.097+0000 7f59fbfff700 1 --2- 172.21.15.76:0/3679859164 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f59fc072970 0x7f59fc19d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:59.098 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.097+0000 7f59fbfff700 1 -- 172.21.15.76:0/3679859164 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f59fc072510 msgr2=0x7f59fc19d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:59:59.098 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.097+0000 7f59fbfff700 1 --2- 172.21.15.76:0/3679859164 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f59fc072510 0x7f59fc19d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:59.099 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.097+0000 7f59fbfff700 1 -- 172.21.15.76:0/3679859164 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59f00095f0 con 0x7f59fc109350 2024-06-02T04:59:59.099 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.097+0000 7f59fbfff700 1 --2- 172.21.15.76:0/3679859164 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f59fc109350 0x7f59fc1a4940 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f59f400ef90 tx=0x7f59f400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:59:59.102 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.102+0000 7f59f8ff9700 1 -- 172.21.15.76:0/3679859164 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59f4018070 con 0x7f59fc109350 2024-06-02T04:59:59.102 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.102+0000 7f59f8ff9700 1 -- 172.21.15.76:0/3679859164 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f59f400f040 con 0x7f59fc109350 2024-06-02T04:59:59.102 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.102+0000 7f59f8ff9700 1 -- 172.21.15.76:0/3679859164 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59f400cba0 con 0x7f59fc109350 2024-06-02T04:59:59.103 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.102+0000 7f5a01d8d700 1 -- 172.21.15.76:0/3679859164 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59fc1b6470 con 0x7f59fc109350 2024-06-02T04:59:59.103 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.102+0000 7f5a01d8d700 1 -- 172.21.15.76:0/3679859164 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59fc1b6930 con 0x7f59fc109350 2024-06-02T04:59:59.105 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.104+0000 7f59f8ff9700 1 -- 172.21.15.76:0/3679859164 <== mon.2 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f59f400cd00 con 0x7f59fc109350 2024-06-02T04:59:59.105 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.105+0000 7f59f8ff9700 1 --2- 172.21.15.76:0/3679859164 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f59e40a1220 0x7f59e40a36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:59:59.105 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.105+0000 7f59f8ff9700 1 -- 172.21.15.76:0/3679859164 <== mon.2 v2:172.21.15.119:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f59f40cc700 con 0x7f59fc109350 2024-06-02T04:59:59.106 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.105+0000 7f59fb7fe700 1 --2- 172.21.15.76:0/3679859164 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f59e40a1220 0x7f59e40a36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:59:59.106 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.106+0000 7f59fb7fe700 1 --2- 172.21.15.76:0/3679859164 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f59e40a1220 0x7f59e40a36e0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f59f000b2e0 tx=0x7f59f000b610 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:59:59.107 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.107+0000 7f5a0df48b80 1 Processor -- start 2024-06-02T04:59:59.109 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.107+0000 7f5a0df48b80 1 -- start start 2024-06-02T04:59:59.109 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.107+0000 7f5a0df48b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5603111faa80 0x5603111faea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:59:59.109 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.107+0000 7f5a0df48b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5603111fb3e0 0x5603111fbcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:59:59.109 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.107+0000 7f5a0df48b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5603111fc2d0 0x5603111fc750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:59:59.109 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.107+0000 7f5a0df48b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603111520f0 con 0x5603111fc2d0 2024-06-02T04:59:59.109 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.107+0000 7f5a0df48b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x56031114fab0 con 0x5603111fb3e0 2024-06-02T04:59:59.110 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.107+0000 7f5a0df48b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x56031114b3a0 con 0x5603111faa80 2024-06-02T04:59:59.110 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.108+0000 7f59fbfff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5603111fc2d0 0x5603111fc750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:59:59.110 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.108+0000 7f59fbfff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5603111fc2d0 0x5603111fc750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:33212/0 (socket says 172.21.15.76:33212) 2024-06-02T04:59:59.110 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.108+0000 7f59fbfff700 1 -- 172.21.15.76:0/2664712678 learned_addr learned my addr 172.21.15.76:0/2664712678 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:59:59.110 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.108+0000 7f59fb7fe700 1 --2- 172.21.15.76:0/2664712678 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5603111faa80 0x5603111faea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:59:59.110 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.108+0000 7f59fbfff700 1 -- 172.21.15.76:0/2664712678 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5603111faa80 msgr2=0x5603111faea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:59:59.110 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.108+0000 7f59fbfff700 1 --2- 172.21.15.76:0/2664712678 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5603111faa80 0x5603111faea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:59.110 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.108+0000 7f59fbfff700 1 -- 172.21.15.76:0/2664712678 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5603111fb3e0 msgr2=0x5603111fbcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:59:59.110 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.108+0000 7f59fbfff700 1 --2- 172.21.15.76:0/2664712678 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5603111fb3e0 0x5603111fbcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:59.110 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.108+0000 7f59fbfff700 1 -- 172.21.15.76:0/2664712678 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560310fcc350 con 0x5603111fc2d0 2024-06-02T04:59:59.110 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.108+0000 7f59fb7fe700 1 --2- 172.21.15.76:0/2664712678 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5603111faa80 0x5603111faea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:59:59.110 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.108+0000 7f59fbfff700 1 --2- 172.21.15.76:0/2664712678 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5603111fc2d0 0x5603111fc750 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f59f40997d0 tx=0x7f59f4099690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2d4007dad8b2166 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:59:59.110 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.109+0000 7f59e1ffb700 1 -- 172.21.15.76:0/2664712678 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59f40991a0 con 0x5603111fc2d0 2024-06-02T04:59:59.111 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.109+0000 7f59e1ffb700 1 -- 172.21.15.76:0/2664712678 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f59f401b320 con 0x5603111fc2d0 2024-06-02T04:59:59.111 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.109+0000 7f59e1ffb700 1 -- 172.21.15.76:0/2664712678 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59f40c9f70 con 0x5603111fc2d0 2024-06-02T04:59:59.111 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.110+0000 7f5a0df48b80 1 -- 172.21.15.76:0/2664712678 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5603111fc2d0 msgr2=0x5603111fc750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:59:59.111 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.110+0000 7f5a0df48b80 1 --2- 172.21.15.76:0/2664712678 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5603111fc2d0 0x5603111fc750 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f59f40997d0 tx=0x7f59f4099690 comp rx=0 tx=0).stop 2024-06-02T04:59:59.118 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.117+0000 7f5a0df48b80 1 -- 172.21.15.76:0/2664712678 shutdown_connections 2024-06-02T04:59:59.118 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.117+0000 7f5a0df48b80 1 --2- 172.21.15.76:0/2664712678 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5603111fc2d0 0x5603111fc750 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:59.118 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.117+0000 7f5a0df48b80 1 --2- 172.21.15.76:0/2664712678 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5603111faa80 0x5603111faea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:59.118 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.117+0000 7f5a0df48b80 1 --2- 172.21.15.76:0/2664712678 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5603111fb3e0 0x5603111fbcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:59.118 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.117+0000 7f5a0df48b80 1 -- 172.21.15.76:0/2664712678 >> 172.21.15.76:0/2664712678 conn(0x5603111591b0 msgr2=0x5603111f7440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:59:59.118 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.118+0000 7f5a0df48b80 1 -- 172.21.15.76:0/2664712678 shutdown_connections 2024-06-02T04:59:59.119 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.118+0000 7f5a0df48b80 1 -- 172.21.15.76:0/2664712678 wait complete. 2024-06-02T04:59:59.119 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.118+0000 7f5a0df48b80 1 -- start start 2024-06-02T04:59:59.119 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.119+0000 7f5a0df48b80 1 Processor -- start 2024-06-02T04:59:59.120 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.119+0000 7f5a0df48b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5603111faa80 0x560311204920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:59:59.120 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.119+0000 7f5a0df48b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5603111fb3e0 0x560311204e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:59:59.120 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.119+0000 7f5a0df48b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5603111fc2d0 0x56031120bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:59:59.120 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.119+0000 7f5a0df48b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603110e7500 con 0x5603111faa80 2024-06-02T04:59:59.120 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.119+0000 7f5a0df48b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603110e71a0 con 0x5603111fb3e0 2024-06-02T04:59:59.120 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.119+0000 7f5a0df48b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x560310fce640 con 0x5603111fc2d0 2024-06-02T04:59:59.120 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.119+0000 7f5a0df48b80 10 client.0 _ll_register_callbacks cb 0x5603110f0ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:59:59.120 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.119+0000 7f59faffd700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5603111fb3e0 0x560311204e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:59:59.121 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.119+0000 7f59faffd700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5603111fb3e0 0x560311204e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:60900/0 (socket says 172.21.15.76:60900) 2024-06-02T04:59:59.121 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.119+0000 7f59faffd700 1 -- 172.21.15.76:0/485057663 learned_addr learned my addr 172.21.15.76:0/485057663 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:59:59.121 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.119+0000 7f59fb7fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5603111faa80 0x560311204920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:59:59.121 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.120+0000 7f59fbfff700 1 --2- 172.21.15.76:0/485057663 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5603111fc2d0 0x56031120bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:59:59.121 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.120+0000 7f59fb7fe700 1 -- 172.21.15.76:0/485057663 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5603111fc2d0 msgr2=0x56031120bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:59:59.121 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.120+0000 7f59fb7fe700 1 --2- 172.21.15.76:0/485057663 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5603111fc2d0 0x56031120bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:59.122 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.120+0000 7f59fb7fe700 1 -- 172.21.15.76:0/485057663 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5603111fb3e0 msgr2=0x560311204e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:59:59.122 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.120+0000 7f59fb7fe700 1 --2- 172.21.15.76:0/485057663 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5603111fb3e0 0x560311204e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:59.122 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.120+0000 7f59fb7fe700 1 -- 172.21.15.76:0/485057663 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59fc1b6930 con 0x5603111faa80 2024-06-02T04:59:59.122 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.121+0000 7f59fb7fe700 1 --2- 172.21.15.76:0/485057663 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5603111faa80 0x560311204920 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f59f0005910 tx=0x7f59f001a050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfefcaa0b003c79c server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:59:59.122 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.121+0000 7f59daffd700 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-06-02T04:59:59.125 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.125+0000 7f59daffd700 1 -- 172.21.15.76:0/485057663 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59f000bd80 con 0x5603111faa80 2024-06-02T04:59:59.126 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.125+0000 7f59daffd700 1 -- 172.21.15.76:0/485057663 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f59f0004500 con 0x5603111faa80 2024-06-02T04:59:59.126 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.126+0000 7f5a0df48b80 1 -- 172.21.15.76:0/485057663 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5603110a4210 con 0x5603111faa80 2024-06-02T04:59:59.127 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.126+0000 7f59daffd700 1 -- 172.21.15.76:0/485057663 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f59f000bee0 con 0x5603111faa80 2024-06-02T04:59:59.127 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.126+0000 7f5a0df48b80 10 client.16383 fetch_fsmap learned FSMap version 36 2024-06-02T04:59:59.127 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.126+0000 7f5a0df48b80 1 -- 172.21.15.76:0/485057663 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x560310f78b00 con 0x5603111faa80 2024-06-02T04:59:59.128 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.127+0000 7f59daffd700 1 -- 172.21.15.76:0/485057663 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5603110a4210 con 0x5603111faa80 2024-06-02T04:59:59.128 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.128+0000 7f59daffd700 1 -- 172.21.15.76:0/485057663 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f59f000f7a0 con 0x5603111faa80 2024-06-02T04:59:59.129 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.128+0000 7f5a0df48b80 10 client.16383 fetch_fsmap finished waiting for FSMap version 36 2024-06-02T04:59:59.129 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.128+0000 7f5a0df48b80 10 client.16383 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T04:59:59.129 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.128+0000 7f5a0df48b80 20 client.16383 populate_metadata read hostname 'smithi076' 2024-06-02T04:59:59.129 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.128+0000 7f5a0df48b80 1 --2- 172.21.15.76:0/485057663 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x560311210620 0x560311212a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:59:59.129 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.128+0000 7f5a0df48b80 4 client.16383 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T04:59:59.129 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.128+0000 7f5a0df48b80 1 -- 172.21.15.76:0/485057663 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5603111ca7b0 con 0x560311210620 2024-06-02T04:59:59.129 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.129+0000 7f59faffd700 1 --2- 172.21.15.76:0/485057663 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x560311210620 0x560311212a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:59:59.130 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.130+0000 7f59faffd700 1 --2- 172.21.15.76:0/485057663 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x560311210620 0x560311212a40 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=566431763e474ef8 server_cookie=52cf334ef7279d60 in_seq=0 out_seq=0 2024-06-02T04:59:59.130 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.130+0000 7f59daffd700 10 client.16383 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:59:59.131 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.130+0000 7f59daffd700 1 -- 172.21.15.76:0/485057663 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5603111ca7b0 con 0x560311210620 2024-06-02T04:59:59.131 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.130+0000 7f59daffd700 10 client.16383 handle_command_reply: tid=0 2024-06-02T04:59:59.133 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.132+0000 7f5a0df48b80 1 client.16383 shutdown 2024-06-02T04:59:59.133 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.132+0000 7f5a0df48b80 1 -- 172.21.15.76:0/485057663 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5603111faa80 msgr2=0x560311204920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:59:59.133 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.132+0000 7f5a0df48b80 1 --2- 172.21.15.76:0/485057663 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5603111faa80 0x560311204920 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f59f0005910 tx=0x7f59f001a050 comp rx=0 tx=0).stop 2024-06-02T04:59:59.133 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.132+0000 7f5a0df48b80 1 -- 172.21.15.76:0/485057663 shutdown_connections 2024-06-02T04:59:59.133 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.132+0000 7f5a0df48b80 1 --2- 172.21.15.76:0/485057663 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x560311210620 0x560311212a40 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:59.133 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.132+0000 7f5a0df48b80 1 --2- 172.21.15.76:0/485057663 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5603111fc2d0 0x56031120bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:59.133 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.132+0000 7f5a0df48b80 1 --2- 172.21.15.76:0/485057663 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5603111faa80 0x560311204920 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:59.134 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.132+0000 7f5a0df48b80 1 --2- 172.21.15.76:0/485057663 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5603111fb3e0 0x560311204e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:59.134 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.132+0000 7f5a0df48b80 1 -- 172.21.15.76:0/485057663 >> 172.21.15.76:0/485057663 conn(0x5603111591b0 msgr2=0x5603111f5860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:59:59.134 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.132+0000 7f59daffd700 0 client.16383 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:59:59.134 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.132+0000 7f5a0df48b80 1 -- 172.21.15.76:0/485057663 shutdown_connections 2024-06-02T04:59:59.134 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.132+0000 7f5a0df48b80 1 -- 172.21.15.76:0/485057663 wait complete. 2024-06-02T04:59:59.134 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.132+0000 7f5a0df48b80 20 client.16383 trim_cache size 0 max 16384 2024-06-02T04:59:59.157 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.156+0000 7f5a0df48b80 1 Processor -- start 2024-06-02T04:59:59.157 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.157+0000 7f5a0df48b80 1 -- start start 2024-06-02T04:59:59.157 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.157+0000 7f5a0df48b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5603111faa80 0x560311203540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:59:59.157 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.157+0000 7f5a0df48b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5603111fb3e0 0x56031120be60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:59:59.158 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.157+0000 7f5a0df48b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5603111fc2d0 0x5603111fc710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:59:59.158 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.157+0000 7f5a0df48b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603111f6bc0 con 0x5603111fb3e0 2024-06-02T04:59:59.158 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.157+0000 7f5a0df48b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x560311205b10 con 0x5603111fc2d0 2024-06-02T04:59:59.158 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.157+0000 7f5a0df48b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x560311202510 con 0x5603111faa80 2024-06-02T04:59:59.166 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.157+0000 7f59fbfff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5603111fc2d0 0x5603111fc710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:59:59.166 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.157+0000 7f59fbfff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5603111fc2d0 0x5603111fc710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:60910/0 (socket says 172.21.15.76:60910) 2024-06-02T04:59:59.166 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.157+0000 7f59fbfff700 1 -- 172.21.15.76:0/2005399588 learned_addr learned my addr 172.21.15.76:0/2005399588 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:59:59.166 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.157+0000 7f59faffd700 1 --2- 172.21.15.76:0/2005399588 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5603111fb3e0 0x56031120be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:59:59.166 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.157+0000 7f59faffd700 1 -- 172.21.15.76:0/2005399588 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5603111faa80 msgr2=0x560311203540 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-02T04:59:59.167 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.158+0000 7f59faffd700 1 --2- 172.21.15.76:0/2005399588 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5603111faa80 0x560311203540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:59.167 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.158+0000 7f59faffd700 1 -- 172.21.15.76:0/2005399588 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5603111fc2d0 msgr2=0x5603111fc710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:59:59.167 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.158+0000 7f59faffd700 1 --2- 172.21.15.76:0/2005399588 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5603111fc2d0 0x5603111fc710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:59.167 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.158+0000 7f59faffd700 1 -- 172.21.15.76:0/2005399588 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560311111500 con 0x5603111fb3e0 2024-06-02T04:59:59.167 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.158+0000 7f59fbfff700 1 --2- 172.21.15.76:0/2005399588 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5603111fc2d0 0x5603111fc710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T04:59:59.167 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.158+0000 7f59faffd700 1 --2- 172.21.15.76:0/2005399588 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5603111fb3e0 0x56031120be60 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x5603111f0480 tx=0x7f59ec007d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3396b94a0a63259b server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:59:59.167 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.158+0000 7f59e27fc700 1 -- 172.21.15.76:0/2005399588 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59ec016040 con 0x5603111fb3e0 2024-06-02T04:59:59.167 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.158+0000 7f59e27fc700 1 -- 172.21.15.76:0/2005399588 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f59ec020070 con 0x5603111fb3e0 2024-06-02T04:59:59.167 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.158+0000 7f59e27fc700 1 -- 172.21.15.76:0/2005399588 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59ec011830 con 0x5603111fb3e0 2024-06-02T04:59:59.168 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.166+0000 7f5a0df48b80 1 -- 172.21.15.76:0/2005399588 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5603111fb3e0 msgr2=0x56031120be60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:59:59.168 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.166+0000 7f5a0df48b80 1 --2- 172.21.15.76:0/2005399588 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5603111fb3e0 0x56031120be60 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x5603111f0480 tx=0x7f59ec007d80 comp rx=0 tx=0).stop 2024-06-02T04:59:59.169 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.168+0000 7f5a0df48b80 1 -- 172.21.15.76:0/2005399588 shutdown_connections 2024-06-02T04:59:59.169 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.168+0000 7f5a0df48b80 1 --2- 172.21.15.76:0/2005399588 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5603111fc2d0 0x5603111fc710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:59.169 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.168+0000 7f5a0df48b80 1 --2- 172.21.15.76:0/2005399588 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5603111faa80 0x560311203540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:59.169 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.168+0000 7f5a0df48b80 1 --2- 172.21.15.76:0/2005399588 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5603111fb3e0 0x56031120be60 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:59.170 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.168+0000 7f5a0df48b80 1 -- 172.21.15.76:0/2005399588 >> 172.21.15.76:0/2005399588 conn(0x5603111591b0 msgr2=0x560311202890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:59:59.170 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.168+0000 7f5a0df48b80 1 -- 172.21.15.76:0/2005399588 shutdown_connections 2024-06-02T04:59:59.170 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.168+0000 7f5a0df48b80 1 -- 172.21.15.76:0/2005399588 wait complete. 2024-06-02T04:59:59.170 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.169+0000 7f5a0df48b80 1 -- start start 2024-06-02T04:59:59.170 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.169+0000 7f5a0df48b80 1 Processor -- start 2024-06-02T04:59:59.171 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.169+0000 7f5a0df48b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5603111faa80 0x5603112092c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:59:59.171 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.169+0000 7f5a0df48b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5603111fb3e0 0x560311209800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:59:59.171 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.169+0000 7f5a0df48b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5603111fc2d0 0x56031120a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:59:59.171 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.169+0000 7f5a0df48b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x56031120acb0 con 0x5603111faa80 2024-06-02T04:59:59.171 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.169+0000 7f5a0df48b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x56031120ae20 con 0x5603111fb3e0 2024-06-02T04:59:59.171 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.169+0000 7f5a0df48b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x56031120afe0 con 0x5603111fc2d0 2024-06-02T04:59:59.172 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.169+0000 7f5a0df48b80 10 client.0 _ll_register_callbacks cb 0x5603110f0ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:59:59.172 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.169+0000 7f59faffd700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5603111fb3e0 0x560311209800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:59:59.172 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.169+0000 7f59faffd700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5603111fb3e0 0x560311209800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:60914/0 (socket says 172.21.15.76:60914) 2024-06-02T04:59:59.172 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.169+0000 7f59faffd700 1 -- 172.21.15.76:0/2034785897 learned_addr learned my addr 172.21.15.76:0/2034785897 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T04:59:59.172 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.170+0000 7f59fbfff700 1 --2- 172.21.15.76:0/2034785897 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5603111fc2d0 0x56031120a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:59:59.172 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.170+0000 7f59fbfff700 1 -- 172.21.15.76:0/2034785897 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5603111fb3e0 msgr2=0x560311209800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:59:59.172 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.170+0000 7f59fbfff700 1 --2- 172.21.15.76:0/2034785897 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5603111fb3e0 0x560311209800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:59.172 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.170+0000 7f59fbfff700 1 -- 172.21.15.76:0/2034785897 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5603111faa80 msgr2=0x5603112092c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:59:59.172 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.170+0000 7f59fbfff700 1 --2- 172.21.15.76:0/2034785897 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5603111faa80 0x5603112092c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:59.172 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.170+0000 7f59fbfff700 1 -- 172.21.15.76:0/2034785897 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560310fcc350 con 0x5603111fc2d0 2024-06-02T04:59:59.172 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.170+0000 7f59fbfff700 1 --2- 172.21.15.76:0/2034785897 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5603111fc2d0 0x56031120a770 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f59f4097b90 tx=0x7f59f4004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7e67f0e63a536009 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:59:59.172 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.170+0000 7f59daffd700 10 client.0 ms_handle_connect on v2:172.21.15.192:3300/0 2024-06-02T04:59:59.172 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.170+0000 7f59daffd700 1 -- 172.21.15.76:0/2034785897 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59f4099840 con 0x5603111fc2d0 2024-06-02T04:59:59.173 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.171+0000 7f59daffd700 1 -- 172.21.15.76:0/2034785897 <== mon.1 v2:172.21.15.192:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f59f40a1c30 con 0x5603111fc2d0 2024-06-02T04:59:59.173 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.171+0000 7f5a0df48b80 1 -- 172.21.15.76:0/2034785897 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f59f401b320 con 0x5603111fc2d0 2024-06-02T04:59:59.173 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.171+0000 7f59daffd700 1 -- 172.21.15.76:0/2034785897 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f59f409d670 con 0x5603111fc2d0 2024-06-02T04:59:59.174 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.174+0000 7f5a0df48b80 10 client.25957 fetch_fsmap learned FSMap version 36 2024-06-02T04:59:59.174 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.174+0000 7f5a0df48b80 1 -- 172.21.15.76:0/2034785897 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x7f59ec007b60 con 0x5603111fc2d0 2024-06-02T04:59:59.175 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.174+0000 7f59daffd700 1 -- 172.21.15.76:0/2034785897 <== mon.1 v2:172.21.15.192:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f59f401b320 con 0x5603111fc2d0 2024-06-02T04:59:59.175 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.174+0000 7f59daffd700 1 -- 172.21.15.76:0/2034785897 <== mon.1 v2:172.21.15.192:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f59f40a17a0 con 0x5603111fc2d0 2024-06-02T04:59:59.175 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.174+0000 7f5a0df48b80 10 client.25957 fetch_fsmap finished waiting for FSMap version 36 2024-06-02T04:59:59.175 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.174+0000 7f5a0df48b80 10 client.25957 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T04:59:59.175 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.174+0000 7f5a0df48b80 20 client.25957 populate_metadata read hostname 'smithi076' 2024-06-02T04:59:59.175 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.174+0000 7f5a0df48b80 1 --2- 172.21.15.76:0/2034785897 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x560311266c40 0x560311269030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:59:59.175 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.174+0000 7f5a0df48b80 4 client.25957 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T04:59:59.175 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.174+0000 7f5a0df48b80 1 -- 172.21.15.76:0/2034785897 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x560311143e60 con 0x560311266c40 2024-06-02T04:59:59.177 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.177+0000 7f59fb7fe700 1 --2- 172.21.15.76:0/2034785897 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x560311266c40 0x560311269030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:59:59.182 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.181+0000 7f59daffd700 10 client.25957 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T04:59:59.182 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.181+0000 7f59fb7fe700 1 --2- 172.21.15.76:0/2034785897 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x560311266c40 0x560311269030 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5b63e5da8980a500 server_cookie=f596262cd2f3de0e in_seq=0 out_seq=0 2024-06-02T04:59:59.210 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.209+0000 7f59daffd700 1 -- 172.21.15.76:0/2034785897 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x560311143e60 con 0x560311266c40 2024-06-02T04:59:59.210 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.209+0000 7f59daffd700 10 client.25957 handle_command_reply: tid=0 2024-06-02T04:59:59.210 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.209+0000 7f5a0df48b80 1 client.25957 shutdown 2024-06-02T04:59:59.212 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.211+0000 7f5a0df48b80 1 -- 172.21.15.76:0/2034785897 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5603111fc2d0 msgr2=0x56031120a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:59:59.212 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.211+0000 7f5a0df48b80 1 --2- 172.21.15.76:0/2034785897 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5603111fc2d0 0x56031120a770 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f59f4097b90 tx=0x7f59f4004ad0 comp rx=0 tx=0).stop 2024-06-02T04:59:59.212 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.211+0000 7f5a0df48b80 1 -- 172.21.15.76:0/2034785897 shutdown_connections 2024-06-02T04:59:59.212 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.211+0000 7f5a0df48b80 1 --2- 172.21.15.76:0/2034785897 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x560311266c40 0x560311269030 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:59.212 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.211+0000 7f5a0df48b80 1 --2- 172.21.15.76:0/2034785897 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5603111fc2d0 0x56031120a770 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:59.212 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.211+0000 7f5a0df48b80 1 --2- 172.21.15.76:0/2034785897 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5603111faa80 0x5603112092c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:59.212 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.211+0000 7f5a0df48b80 1 --2- 172.21.15.76:0/2034785897 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5603111fb3e0 0x560311209800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:59.212 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.211+0000 7f5a0df48b80 1 -- 172.21.15.76:0/2034785897 >> 172.21.15.76:0/2034785897 conn(0x5603111591b0 msgr2=0x560311212630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:59:59.212 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.211+0000 7f59daffd700 0 client.25957 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T04:59:59.212 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.211+0000 7f5a0df48b80 1 -- 172.21.15.76:0/2034785897 shutdown_connections 2024-06-02T04:59:59.212 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.211+0000 7f5a0df48b80 1 -- 172.21.15.76:0/2034785897 wait complete. 2024-06-02T04:59:59.213 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.211+0000 7f5a0df48b80 20 client.25957 trim_cache size 0 max 16384 2024-06-02T04:59:59.213 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:{ 2024-06-02T04:59:59.213 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "message": "", 2024-06-02T04:59:59.213 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "return_code": 0 2024-06-02T04:59:59.213 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:} 2024-06-02T04:59:59.216 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.215+0000 7f5a01d8d700 1 -- 172.21.15.76:0/3679859164 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f59e40a1220 msgr2=0x7f59e40a36e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:59:59.216 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.215+0000 7f5a01d8d700 1 --2- 172.21.15.76:0/3679859164 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f59e40a1220 0x7f59e40a36e0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f59f000b2e0 tx=0x7f59f000b610 comp rx=0 tx=0).stop 2024-06-02T04:59:59.216 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.215+0000 7f5a01d8d700 1 -- 172.21.15.76:0/3679859164 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f59fc109350 msgr2=0x7f59fc1a4940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:59:59.216 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.215+0000 7f5a01d8d700 1 --2- 172.21.15.76:0/3679859164 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f59fc109350 0x7f59fc1a4940 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f59f400ef90 tx=0x7f59f400c3a0 comp rx=0 tx=0).stop 2024-06-02T04:59:59.216 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.215+0000 7f5a01d8d700 1 -- 172.21.15.76:0/3679859164 shutdown_connections 2024-06-02T04:59:59.216 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.215+0000 7f5a01d8d700 1 --2- 172.21.15.76:0/3679859164 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f59e40a1220 0x7f59e40a36e0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:59.216 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.215+0000 7f5a01d8d700 1 --2- 172.21.15.76:0/3679859164 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f59fc109350 0x7f59fc1a4940 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:59.216 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.215+0000 7f5a01d8d700 1 --2- 172.21.15.76:0/3679859164 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f59fc072510 0x7f59fc19d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:59.216 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.215+0000 7f5a01d8d700 1 --2- 172.21.15.76:0/3679859164 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f59fc072970 0x7f59fc19d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:59:59.217 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.215+0000 7f5a01d8d700 1 -- 172.21.15.76:0/3679859164 >> 172.21.15.76:0/3679859164 conn(0x7f59fc06df30 msgr2=0x7f59fc10d2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:59:59.217 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.216+0000 7f5a01d8d700 1 -- 172.21.15.76:0/3679859164 shutdown_connections 2024-06-02T04:59:59.217 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T04:59:59.216+0000 7f5a01d8d700 1 -- 172.21.15.76:0/3679859164 wait complete. 2024-06-02T05:00:00.349 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:00:00 smithi119 ceph-mon[46633]: Health detail: HEALTH_ERR 1 MDSs report damaged metadata 2024-06-02T05:00:00.349 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:00:00 smithi119 ceph-mon[46633]: [ERR] MDS_DAMAGE: 1 MDSs report damaged metadata 2024-06-02T05:00:00.350 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:00:00 smithi119 ceph-mon[46633]: mds.i(mds.1): Metadata damage detected 2024-06-02T05:00:00.431 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:00:00 smithi192 ceph-mon[47933]: Health detail: HEALTH_ERR 1 MDSs report damaged metadata 2024-06-02T05:00:00.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:00:00 smithi192 ceph-mon[47933]: [ERR] MDS_DAMAGE: 1 MDSs report damaged metadata 2024-06-02T05:00:00.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:00:00 smithi192 ceph-mon[47933]: mds.i(mds.1): Metadata damage detected 2024-06-02T05:00:00.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:00:00 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mon-a[42912]: 2024-06-02T04:59:59.999+0000 7f151640d700 -1 log_channel(cluster) log [ERR] : Health detail: HEALTH_ERR 1 MDSs report damaged metadata 2024-06-02T05:00:00.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:00:00 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mon-a[42912]: 2024-06-02T04:59:59.999+0000 7f151640d700 -1 log_channel(cluster) log [ERR] : [ERR] MDS_DAMAGE: 1 MDSs report damaged metadata 2024-06-02T05:00:00.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:00:00 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mon-a[42912]: 2024-06-02T04:59:59.999+0000 7f151640d700 -1 log_channel(cluster) log [ERR] : mds.i(mds.1): Metadata damage detected 2024-06-02T05:00:00.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:00:00 smithi076 ceph-mon[42935]: Health detail: HEALTH_ERR 1 MDSs report damaged metadata 2024-06-02T05:00:00.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:00:00 smithi076 ceph-mon[42935]: [ERR] MDS_DAMAGE: 1 MDSs report damaged metadata 2024-06-02T05:00:00.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:00:00 smithi076 ceph-mon[42935]: mds.i(mds.1): Metadata damage detected 2024-06-02T05:00:01.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 550.0 s, 542.6 tps, lat 121.806 ms stddev 194.819 2024-06-02T05:00:01.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:00:01 smithi119 ceph-mon[46633]: pgmap v581: 129 pgs: 129 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 11 MiB/s wr, 844 op/s 2024-06-02T05:00:01.433 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:00:01 smithi192 ceph-mon[47933]: pgmap v581: 129 pgs: 129 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 11 MiB/s wr, 844 op/s 2024-06-02T05:00:01.486 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:00:01 smithi076 ceph-mon[42935]: pgmap v581: 129 pgs: 129 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 11 MiB/s wr, 844 op/s 2024-06-02T05:00:03.847 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:00:03 smithi119 ceph-mon[46633]: pgmap v582: 129 pgs: 129 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 9.7 MiB/s wr, 843 op/s 2024-06-02T05:00:03.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:00:03 smithi192 ceph-mon[47933]: pgmap v582: 129 pgs: 129 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 9.7 MiB/s wr, 843 op/s 2024-06-02T05:00:03.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:00:03 smithi076 ceph-mon[42935]: pgmap v582: 129 pgs: 129 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 9.7 MiB/s wr, 843 op/s 2024-06-02T05:00:05.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:00:05 smithi119 ceph-mon[46633]: pgmap v583: 129 pgs: 129 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 8.8 MiB/s wr, 749 op/s 2024-06-02T05:00:05.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:00:05 smithi192 ceph-mon[47933]: pgmap v583: 129 pgs: 129 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 8.8 MiB/s wr, 749 op/s 2024-06-02T05:00:05.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:00:05 smithi076 ceph-mon[42935]: pgmap v583: 129 pgs: 129 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 8.8 MiB/s wr, 749 op/s 2024-06-02T05:00:06.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 555.0 s, 731.8 tps, lat 208.111 ms stddev 568.113 2024-06-02T05:00:07.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:00:07 smithi119 ceph-mon[46633]: pgmap v584: 129 pgs: 129 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 11 MiB/s wr, 878 op/s 2024-06-02T05:00:07.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:00:07 smithi192 ceph-mon[47933]: pgmap v584: 129 pgs: 129 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 11 MiB/s wr, 878 op/s 2024-06-02T05:00:07.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:00:07 smithi076 ceph-mon[42935]: pgmap v584: 129 pgs: 129 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 11 MiB/s wr, 878 op/s 2024-06-02T05:00:09.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:00:09 smithi119 ceph-mon[46633]: pgmap v585: 129 pgs: 129 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 11 MiB/s wr, 841 op/s 2024-06-02T05:00:09.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:00:09 smithi192 ceph-mon[47933]: pgmap v585: 129 pgs: 129 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 11 MiB/s wr, 841 op/s 2024-06-02T05:00:09.986 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:00:09 smithi076 ceph-mon[42935]: pgmap v585: 129 pgs: 129 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 11 MiB/s wr, 841 op/s 2024-06-02T05:00:11.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 560.0 s, 687.0 tps, lat 143.842 ms stddev 58.954 2024-06-02T05:00:11.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:00:11 smithi192 ceph-mon[47933]: pgmap v586: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 11 MiB/s wr, 886 op/s 2024-06-02T05:00:11.986 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:00:11 smithi076 ceph-mon[42935]: pgmap v586: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 11 MiB/s wr, 886 op/s 2024-06-02T05:00:12.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:00:11 smithi119 ceph-mon[46633]: pgmap v586: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 11 MiB/s wr, 886 op/s 2024-06-02T05:00:12.385 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.384+0000 7fde62b44700 1 -- 172.21.15.76:0/4034261390 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fde5c104cd0 msgr2=0x7fde5c10b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:00:12.385 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.384+0000 7fde62b44700 1 --2- 172.21.15.76:0/4034261390 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fde5c104cd0 0x7fde5c10b580 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fde54009fc0 tx=0x7fde5400b330 comp rx=0 tx=0).stop 2024-06-02T05:00:12.386 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.384+0000 7fde62b44700 1 -- 172.21.15.76:0/4034261390 shutdown_connections 2024-06-02T05:00:12.386 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.384+0000 7fde62b44700 1 --2- 172.21.15.76:0/4034261390 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fde5c104cd0 0x7fde5c10b580 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:12.386 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.384+0000 7fde62b44700 1 --2- 172.21.15.76:0/4034261390 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fde5c103140 0x7fde5c103560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:12.386 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.384+0000 7fde62b44700 1 --2- 172.21.15.76:0/4034261390 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fde5c104330 0x7fde5c104790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:12.386 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.384+0000 7fde62b44700 1 -- 172.21.15.76:0/4034261390 >> 172.21.15.76:0/4034261390 conn(0x7fde5c0fe6b0 msgr2=0x7fde5c100af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:00:12.386 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.384+0000 7fde62b44700 1 -- 172.21.15.76:0/4034261390 shutdown_connections 2024-06-02T05:00:12.386 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.384+0000 7fde62b44700 1 -- 172.21.15.76:0/4034261390 wait complete. 2024-06-02T05:00:12.386 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.385+0000 7fde62b44700 1 Processor -- start 2024-06-02T05:00:12.389 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.389+0000 7fde62b44700 1 -- start start 2024-06-02T05:00:12.391 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.389+0000 7fde62b44700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fde5c103140 0x7fde5c1990a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:00:12.391 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.389+0000 7fde62b44700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fde5c104330 0x7fde5c1995e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:00:12.391 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.389+0000 7fde62b44700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fde5c104cd0 0x7fde5c1a0600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:00:12.391 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.389+0000 7fde62b44700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde5c1a0bd0 con 0x7fde5c104cd0 2024-06-02T05:00:12.392 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.389+0000 7fde62b44700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde5c1a0d10 con 0x7fde5c104330 2024-06-02T05:00:12.392 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.389+0000 7fde62b44700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde5c1a0ea0 con 0x7fde5c103140 2024-06-02T05:00:12.392 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.389+0000 7fde5bfff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fde5c104330 0x7fde5c1995e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:00:12.392 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.389+0000 7fde5bfff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fde5c104330 0x7fde5c1995e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:38866/0 (socket says 172.21.15.76:38866) 2024-06-02T05:00:12.392 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.389+0000 7fde5bfff700 1 -- 172.21.15.76:0/2358525574 learned_addr learned my addr 172.21.15.76:0/2358525574 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:00:12.392 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.389+0000 7fde5bfff700 1 -- 172.21.15.76:0/2358525574 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fde5c103140 msgr2=0x7fde5c1990a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-02T05:00:12.392 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.389+0000 7fde5bfff700 1 --2- 172.21.15.76:0/2358525574 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fde5c103140 0x7fde5c1990a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:12.392 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.389+0000 7fde5bfff700 1 -- 172.21.15.76:0/2358525574 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fde5c104cd0 msgr2=0x7fde5c1a0600 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-02T05:00:12.392 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.389+0000 7fde5bfff700 1 --2- 172.21.15.76:0/2358525574 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fde5c104cd0 0x7fde5c1a0600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:12.392 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.390+0000 7fde5bfff700 1 -- 172.21.15.76:0/2358525574 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde54009c40 con 0x7fde5c104330 2024-06-02T05:00:12.392 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.390+0000 7fde5bfff700 1 --2- 172.21.15.76:0/2358525574 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fde5c104330 0x7fde5c1995e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fde48009f80 tx=0x7fde4800ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:00:12.392 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.390+0000 7fde59ffb700 1 -- 172.21.15.76:0/2358525574 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde4800cbd0 con 0x7fde5c104330 2024-06-02T05:00:12.392 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.390+0000 7fde59ffb700 1 -- 172.21.15.76:0/2358525574 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fde4800cd30 con 0x7fde5c104330 2024-06-02T05:00:12.392 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.390+0000 7fde59ffb700 1 -- 172.21.15.76:0/2358525574 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde48005540 con 0x7fde5c104330 2024-06-02T05:00:12.393 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.390+0000 7fde62b44700 1 -- 172.21.15.76:0/2358525574 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde5c06aa20 con 0x7fde5c104330 2024-06-02T05:00:12.393 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.390+0000 7fde62b44700 1 -- 172.21.15.76:0/2358525574 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde5c06aee0 con 0x7fde5c104330 2024-06-02T05:00:12.395 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.395+0000 7fde6ecffb80 1 Processor -- start 2024-06-02T05:00:12.396 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.395+0000 7fde6ecffb80 1 -- start start 2024-06-02T05:00:12.396 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.395+0000 7fde6ecffb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5622d948a290 0x5622d948a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:00:12.396 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.395+0000 7fde6ecffb80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5622d948abf0 0x5622d948b500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:00:12.396 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.395+0000 7fde6ecffb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5622d948bae0 0x5622d948bf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:00:12.396 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.395+0000 7fde6ecffb80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622d93d90f0 con 0x5622d948abf0 2024-06-02T05:00:12.396 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.395+0000 7fde6ecffb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622d93d6ab0 con 0x5622d948a290 2024-06-02T05:00:12.397 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.395+0000 7fde6ecffb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622d93d23a0 con 0x5622d948bae0 2024-06-02T05:00:12.397 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.396+0000 7fde610e1700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5622d948a290 0x5622d948a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:00:12.397 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.396+0000 7fde610e1700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5622d948a290 0x5622d948a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:38872/0 (socket says 172.21.15.76:38872) 2024-06-02T05:00:12.397 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.396+0000 7fde610e1700 1 -- 172.21.15.76:0/2662943118 learned_addr learned my addr 172.21.15.76:0/2662943118 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:00:12.397 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.396+0000 7fde610e1700 1 -- 172.21.15.76:0/2662943118 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5622d948bae0 msgr2=0x5622d948bf60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-02T05:00:12.397 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.396+0000 7fde610e1700 1 --2- 172.21.15.76:0/2662943118 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5622d948bae0 0x5622d948bf60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:12.397 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.396+0000 7fde610e1700 1 -- 172.21.15.76:0/2662943118 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5622d948abf0 msgr2=0x5622d948b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:00:12.397 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.396+0000 7fde610e1700 1 --2- 172.21.15.76:0/2662943118 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5622d948abf0 0x5622d948b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:12.398 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.396+0000 7fde610e1700 1 -- 172.21.15.76:0/2662943118 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5622d9253350 con 0x5622d948a290 2024-06-02T05:00:12.398 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.396+0000 7fde610e1700 1 --2- 172.21.15.76:0/2662943118 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5622d948a290 0x5622d948a6b0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fde54009ae0 tx=0x7fde54009b10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e48fea15b69d49 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:00:12.399 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.398+0000 7fde46ffd700 1 -- 172.21.15.76:0/2662943118 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde5400e040 con 0x5622d948a290 2024-06-02T05:00:12.399 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.398+0000 7fde46ffd700 1 -- 172.21.15.76:0/2662943118 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fde540075e0 con 0x5622d948a290 2024-06-02T05:00:12.399 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.398+0000 7fde46ffd700 1 -- 172.21.15.76:0/2662943118 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde5400bc50 con 0x5622d948a290 2024-06-02T05:00:12.399 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.399+0000 7fde6ecffb80 1 -- 172.21.15.76:0/2662943118 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5622d948a290 msgr2=0x5622d948a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:00:12.399 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.399+0000 7fde6ecffb80 1 --2- 172.21.15.76:0/2662943118 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5622d948a290 0x5622d948a6b0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fde54009ae0 tx=0x7fde54009b10 comp rx=0 tx=0).stop 2024-06-02T05:00:12.400 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.399+0000 7fde6ecffb80 1 -- 172.21.15.76:0/2662943118 shutdown_connections 2024-06-02T05:00:12.400 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.399+0000 7fde6ecffb80 1 --2- 172.21.15.76:0/2662943118 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5622d948bae0 0x5622d948bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:12.400 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.399+0000 7fde6ecffb80 1 --2- 172.21.15.76:0/2662943118 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5622d948a290 0x5622d948a6b0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:12.400 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.399+0000 7fde6ecffb80 1 --2- 172.21.15.76:0/2662943118 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5622d948abf0 0x5622d948b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:12.400 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.399+0000 7fde6ecffb80 1 -- 172.21.15.76:0/2662943118 >> 172.21.15.76:0/2662943118 conn(0x5622d93e01b0 msgr2=0x5622d947e440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:00:12.402 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.401+0000 7fde59ffb700 1 -- 172.21.15.76:0/2358525574 <== mon.2 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fde48004750 con 0x7fde5c104330 2024-06-02T05:00:12.402 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.401+0000 7fde6ecffb80 1 -- 172.21.15.76:0/2662943118 shutdown_connections 2024-06-02T05:00:12.402 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.401+0000 7fde6ecffb80 1 -- 172.21.15.76:0/2662943118 wait complete. 2024-06-02T05:00:12.402 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.401+0000 7fde6ecffb80 1 -- start start 2024-06-02T05:00:12.402 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.402+0000 7fde6ecffb80 1 Processor -- start 2024-06-02T05:00:12.403 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.402+0000 7fde59ffb700 1 --2- 172.21.15.76:0/2358525574 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fde4c0a1130 0x7fde4c0a35f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:00:12.403 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.402+0000 7fde59ffb700 1 -- 172.21.15.76:0/2358525574 <== mon.2 v2:172.21.15.119:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7fde48025070 con 0x7fde5c104330 2024-06-02T05:00:12.403 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.403+0000 7fde610e1700 1 --2- 172.21.15.76:0/2358525574 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fde4c0a1130 0x7fde4c0a35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:00:12.406 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.404+0000 7fde6ecffb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5622d948a290 0x5622d94940c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:00:12.406 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.404+0000 7fde6ecffb80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5622d948abf0 0x5622d9494600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:00:12.406 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.404+0000 7fde6ecffb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5622d948bae0 0x5622d949b610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:00:12.406 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.404+0000 7fde6ecffb80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622d936e500 con 0x5622d948abf0 2024-06-02T05:00:12.406 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.404+0000 7fde6ecffb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622d936e1a0 con 0x5622d948bae0 2024-06-02T05:00:12.406 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.404+0000 7fde6ecffb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622d9255640 con 0x5622d948a290 2024-06-02T05:00:12.406 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.404+0000 7fde6ecffb80 10 client.0 _ll_register_callbacks cb 0x5622d9377ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T05:00:12.406 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.404+0000 7fde5bfff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5622d948abf0 0x5622d9494600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:00:12.406 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.404+0000 7fde5bfff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5622d948abf0 0x5622d9494600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:33650/0 (socket says 172.21.15.76:33650) 2024-06-02T05:00:12.406 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.404+0000 7fde5bfff700 1 -- 172.21.15.76:0/707287817 learned_addr learned my addr 172.21.15.76:0/707287817 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:00:12.406 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.405+0000 7fde608e0700 1 --2- 172.21.15.76:0/707287817 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5622d948a290 0x5622d94940c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:00:12.407 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.405+0000 7fde610e1700 1 --2- 172.21.15.76:0/707287817 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5622d948bae0 0x5622d949b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:00:12.407 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.405+0000 7fde610e1700 1 --2- 172.21.15.76:0/2358525574 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fde4c0a1130 0x7fde4c0a35f0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fde54009c10 tx=0x7fde54009920 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:00:12.407 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.405+0000 7fde608e0700 1 -- 172.21.15.76:0/707287817 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5622d948bae0 msgr2=0x5622d949b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:00:12.407 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.405+0000 7fde608e0700 1 --2- 172.21.15.76:0/707287817 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5622d948bae0 0x5622d949b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:12.407 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.405+0000 7fde608e0700 1 -- 172.21.15.76:0/707287817 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5622d948abf0 msgr2=0x5622d9494600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:00:12.407 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.405+0000 7fde608e0700 1 --2- 172.21.15.76:0/707287817 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5622d948abf0 0x5622d9494600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:12.407 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.405+0000 7fde608e0700 1 -- 172.21.15.76:0/707287817 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde5c10bed0 con 0x5622d948a290 2024-06-02T05:00:12.407 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.406+0000 7fde608e0700 1 --2- 172.21.15.76:0/707287817 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5622d948a290 0x5622d94940c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fde5c104190 tx=0x7fde5000e680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=20942063b764ebfa server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:00:12.408 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.406+0000 7fde3ffff700 10 client.0 ms_handle_connect on v2:172.21.15.192:3300/0 2024-06-02T05:00:12.413 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.406+0000 7fde3ffff700 1 -- 172.21.15.76:0/707287817 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde50005250 con 0x5622d948a290 2024-06-02T05:00:12.413 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.407+0000 7fde3ffff700 1 -- 172.21.15.76:0/707287817 <== mon.1 v2:172.21.15.192:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7fde500053b0 con 0x5622d948a290 2024-06-02T05:00:12.413 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.407+0000 7fde6ecffb80 1 -- 172.21.15.76:0/707287817 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5622d932b210 con 0x5622d948a290 2024-06-02T05:00:12.413 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.407+0000 7fde3ffff700 1 -- 172.21.15.76:0/707287817 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fde5000ee90 con 0x5622d948a290 2024-06-02T05:00:12.413 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.408+0000 7fde6ecffb80 10 client.25963 fetch_fsmap learned FSMap version 36 2024-06-02T05:00:12.413 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.408+0000 7fde6ecffb80 1 -- 172.21.15.76:0/707287817 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x5622d91ffb00 con 0x5622d948a290 2024-06-02T05:00:12.413 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.408+0000 7fde3ffff700 1 -- 172.21.15.76:0/707287817 <== mon.1 v2:172.21.15.192:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5622d932b210 con 0x5622d948a290 2024-06-02T05:00:12.414 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.413+0000 7fde3ffff700 1 -- 172.21.15.76:0/707287817 <== mon.1 v2:172.21.15.192:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fde50016070 con 0x5622d948a290 2024-06-02T05:00:12.414 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.413+0000 7fde6ecffb80 10 client.25963 fetch_fsmap finished waiting for FSMap version 36 2024-06-02T05:00:12.414 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.413+0000 7fde6ecffb80 10 client.25963 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T05:00:12.414 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.413+0000 7fde6ecffb80 20 client.25963 populate_metadata read hostname 'smithi076' 2024-06-02T05:00:12.414 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.413+0000 7fde6ecffb80 1 --2- 172.21.15.76:0/707287817 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5622d9485a00 0x5622d9487e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:00:12.415 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.413+0000 7fde6ecffb80 4 client.25963 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T05:00:12.415 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.413+0000 7fde6ecffb80 1 -- 172.21.15.76:0/707287817 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5622d94517b0 con 0x5622d9485a00 2024-06-02T05:00:12.415 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.414+0000 7fde5bfff700 1 --2- 172.21.15.76:0/707287817 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5622d9485a00 0x5622d9487e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:00:12.415 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.414+0000 7fde5bfff700 1 --2- 172.21.15.76:0/707287817 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5622d9485a00 0x5622d9487e20 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d1022ec288b8a84 server_cookie=c59ad3bc591dc386 in_seq=0 out_seq=0 2024-06-02T05:00:12.416 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.414+0000 7fde3ffff700 10 client.25963 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T05:00:12.416 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.415+0000 7fde3ffff700 1 -- 172.21.15.76:0/707287817 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5622d94517b0 con 0x5622d9485a00 2024-06-02T05:00:12.416 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.415+0000 7fde3ffff700 10 client.25963 handle_command_reply: tid=0 2024-06-02T05:00:12.416 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.415+0000 7fde6ecffb80 1 client.25963 shutdown 2024-06-02T05:00:12.416 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.415+0000 7fde6ecffb80 1 -- 172.21.15.76:0/707287817 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5622d948a290 msgr2=0x5622d94940c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:00:12.416 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.415+0000 7fde6ecffb80 1 --2- 172.21.15.76:0/707287817 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5622d948a290 0x5622d94940c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fde5c104190 tx=0x7fde5000e680 comp rx=0 tx=0).stop 2024-06-02T05:00:12.417 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.415+0000 7fde6ecffb80 1 -- 172.21.15.76:0/707287817 shutdown_connections 2024-06-02T05:00:12.417 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.415+0000 7fde6ecffb80 1 --2- 172.21.15.76:0/707287817 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5622d9485a00 0x5622d9487e20 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:12.417 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.415+0000 7fde6ecffb80 1 --2- 172.21.15.76:0/707287817 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5622d948bae0 0x5622d949b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:12.417 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.415+0000 7fde6ecffb80 1 --2- 172.21.15.76:0/707287817 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5622d948a290 0x5622d94940c0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:12.417 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.415+0000 7fde6ecffb80 1 --2- 172.21.15.76:0/707287817 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5622d948abf0 0x5622d9494600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:12.417 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.415+0000 7fde6ecffb80 1 -- 172.21.15.76:0/707287817 >> 172.21.15.76:0/707287817 conn(0x5622d93e01b0 msgr2=0x5622d947c860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:00:12.417 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.415+0000 7fde3ffff700 0 client.25963 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T05:00:12.417 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.416+0000 7fde6ecffb80 1 -- 172.21.15.76:0/707287817 shutdown_connections 2024-06-02T05:00:12.417 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.416+0000 7fde6ecffb80 1 -- 172.21.15.76:0/707287817 wait complete. 2024-06-02T05:00:12.417 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.416+0000 7fde6ecffb80 20 client.25963 trim_cache size 0 max 16384 2024-06-02T05:00:12.438 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.437+0000 7fde6ecffb80 1 Processor -- start 2024-06-02T05:00:12.439 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.437+0000 7fde6ecffb80 1 -- start start 2024-06-02T05:00:12.439 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.438+0000 7fde6ecffb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5622d948a290 0x5622d9489770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:00:12.439 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.438+0000 7fde6ecffb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5622d948abf0 0x5622d949b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:00:12.439 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.438+0000 7fde6ecffb80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5622d948bae0 0x5622d94b0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:00:12.439 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.438+0000 7fde6ecffb80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622d94799b0 con 0x5622d948bae0 2024-06-02T05:00:12.439 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.438+0000 7fde6ecffb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622d948b1b0 con 0x5622d948abf0 2024-06-02T05:00:12.439 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.438+0000 7fde6ecffb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622d9492b40 con 0x5622d948a290 2024-06-02T05:00:12.439 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.438+0000 7fde610e1700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5622d948bae0 0x5622d94b0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:00:12.439 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.438+0000 7fde5bfff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5622d948abf0 0x5622d949b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:00:12.439 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.438+0000 7fde610e1700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5622d948bae0 0x5622d94b0b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:33658/0 (socket says 172.21.15.76:33658) 2024-06-02T05:00:12.439 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.438+0000 7fde5bfff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5622d948abf0 0x5622d949b530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:38886/0 (socket says 172.21.15.76:38886) 2024-06-02T05:00:12.439 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.438+0000 7fde610e1700 1 -- 172.21.15.76:0/152213840 learned_addr learned my addr 172.21.15.76:0/152213840 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:00:12.439 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.438+0000 7fde608e0700 1 --2- 172.21.15.76:0/152213840 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5622d948a290 0x5622d9489770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:00:12.440 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.438+0000 7fde610e1700 1 -- 172.21.15.76:0/152213840 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5622d948a290 msgr2=0x5622d9489770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:00:12.440 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.438+0000 7fde610e1700 1 --2- 172.21.15.76:0/152213840 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5622d948a290 0x5622d9489770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:12.440 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.438+0000 7fde610e1700 1 -- 172.21.15.76:0/152213840 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5622d948abf0 msgr2=0x5622d949b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:00:12.440 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.438+0000 7fde610e1700 1 --2- 172.21.15.76:0/152213840 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5622d948abf0 0x5622d949b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:12.440 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.438+0000 7fde610e1700 1 -- 172.21.15.76:0/152213840 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5622d9398500 con 0x5622d948bae0 2024-06-02T05:00:12.441 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.439+0000 7fde610e1700 1 --2- 172.21.15.76:0/152213840 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5622d948bae0 0x5622d94b0b80 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fde54003b30 tx=0x7fde5402c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1789cd0c51c304e9 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:00:12.441 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.439+0000 7fde477fe700 1 -- 172.21.15.76:0/152213840 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde54029040 con 0x5622d948bae0 2024-06-02T05:00:12.441 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.439+0000 7fde477fe700 1 -- 172.21.15.76:0/152213840 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fde5400be80 con 0x5622d948bae0 2024-06-02T05:00:12.441 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.439+0000 7fde477fe700 1 -- 172.21.15.76:0/152213840 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde5400e040 con 0x5622d948bae0 2024-06-02T05:00:12.442 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.442+0000 7fde6ecffb80 1 -- 172.21.15.76:0/152213840 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5622d948bae0 msgr2=0x5622d94b0b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:00:12.443 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.442+0000 7fde6ecffb80 1 --2- 172.21.15.76:0/152213840 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5622d948bae0 0x5622d94b0b80 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fde54003b30 tx=0x7fde5402c000 comp rx=0 tx=0).stop 2024-06-02T05:00:12.446 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.444+0000 7fde6ecffb80 1 -- 172.21.15.76:0/152213840 shutdown_connections 2024-06-02T05:00:12.446 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.444+0000 7fde6ecffb80 1 --2- 172.21.15.76:0/152213840 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5622d948bae0 0x5622d94b0b80 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:12.446 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.444+0000 7fde6ecffb80 1 --2- 172.21.15.76:0/152213840 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5622d948a290 0x5622d9489770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:12.447 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.444+0000 7fde6ecffb80 1 --2- 172.21.15.76:0/152213840 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5622d948abf0 0x5622d949b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:12.447 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.444+0000 7fde6ecffb80 1 -- 172.21.15.76:0/152213840 >> 172.21.15.76:0/152213840 conn(0x5622d93e01b0 msgr2=0x5622d94920e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:00:12.447 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.444+0000 7fde6ecffb80 1 -- 172.21.15.76:0/152213840 shutdown_connections 2024-06-02T05:00:12.447 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.444+0000 7fde6ecffb80 1 -- 172.21.15.76:0/152213840 wait complete. 2024-06-02T05:00:12.447 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.444+0000 7fde6ecffb80 1 -- start start 2024-06-02T05:00:12.447 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.444+0000 7fde6ecffb80 1 Processor -- start 2024-06-02T05:00:12.447 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.445+0000 7fde6ecffb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5622d948a290 0x5622d9496de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:00:12.447 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.445+0000 7fde6ecffb80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5622d948abf0 0x5622d9497320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:00:12.447 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.445+0000 7fde6ecffb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5622d948bae0 0x5622d949a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:00:12.447 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.445+0000 7fde6ecffb80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622d949a880 con 0x5622d948abf0 2024-06-02T05:00:12.447 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.445+0000 7fde6ecffb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622d949a9f0 con 0x5622d948bae0 2024-06-02T05:00:12.447 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.445+0000 7fde6ecffb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622d949abb0 con 0x5622d948a290 2024-06-02T05:00:12.448 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.445+0000 7fde6ecffb80 10 client.0 _ll_register_callbacks cb 0x5622d9377ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T05:00:12.448 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.445+0000 7fde5bfff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5622d948abf0 0x5622d9497320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:00:12.448 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.445+0000 7fde5bfff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5622d948abf0 0x5622d9497320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:33670/0 (socket says 172.21.15.76:33670) 2024-06-02T05:00:12.448 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.445+0000 7fde5bfff700 1 -- 172.21.15.76:0/3898317066 learned_addr learned my addr 172.21.15.76:0/3898317066 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:00:12.448 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.446+0000 7fde5bfff700 1 -- 172.21.15.76:0/3898317066 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5622d948a290 msgr2=0x5622d9496de0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-02T05:00:12.448 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.446+0000 7fde5bfff700 1 --2- 172.21.15.76:0/3898317066 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5622d948a290 0x5622d9496de0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:12.448 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.446+0000 7fde5bfff700 1 -- 172.21.15.76:0/3898317066 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5622d948bae0 msgr2=0x5622d949a340 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-02T05:00:12.448 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.446+0000 7fde5bfff700 1 --2- 172.21.15.76:0/3898317066 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5622d948bae0 0x5622d949a340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:12.448 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.446+0000 7fde5bfff700 1 -- 172.21.15.76:0/3898317066 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5622d9253350 con 0x5622d948abf0 2024-06-02T05:00:12.449 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.446+0000 7fde5bfff700 1 --2- 172.21.15.76:0/3898317066 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5622d948abf0 0x5622d9497320 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fde480aacd0 tx=0x7fde48005c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c62472e3ed573da4 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:00:12.449 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.446+0000 7fde3ffff700 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-06-02T05:00:12.449 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.446+0000 7fde3ffff700 1 -- 172.21.15.76:0/3898317066 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde480db500 con 0x5622d948abf0 2024-06-02T05:00:12.450 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.446+0000 7fde3ffff700 1 -- 172.21.15.76:0/3898317066 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7fde480c3040 con 0x5622d948abf0 2024-06-02T05:00:12.450 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.447+0000 7fde6ecffb80 1 -- 172.21.15.76:0/3898317066 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5622d93cae60 con 0x5622d948abf0 2024-06-02T05:00:12.450 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.447+0000 7fde3ffff700 1 -- 172.21.15.76:0/3898317066 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fde480aafa0 con 0x5622d948abf0 2024-06-02T05:00:12.450 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.447+0000 7fde6ecffb80 10 client.16398 fetch_fsmap learned FSMap version 36 2024-06-02T05:00:12.450 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.447+0000 7fde6ecffb80 1 -- 172.21.15.76:0/3898317066 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x5622d9257c70 con 0x5622d948abf0 2024-06-02T05:00:12.450 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.447+0000 7fde3ffff700 1 -- 172.21.15.76:0/3898317066 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5622d93cae60 con 0x5622d948abf0 2024-06-02T05:00:12.450 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.447+0000 7fde3ffff700 1 -- 172.21.15.76:0/3898317066 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fde480b2d30 con 0x5622d948abf0 2024-06-02T05:00:12.450 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.447+0000 7fde6ecffb80 10 client.16398 fetch_fsmap finished waiting for FSMap version 36 2024-06-02T05:00:12.450 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.447+0000 7fde6ecffb80 10 client.16398 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T05:00:12.450 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.447+0000 7fde6ecffb80 20 client.16398 populate_metadata read hostname 'smithi076' 2024-06-02T05:00:12.450 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.447+0000 7fde6ecffb80 1 --2- 172.21.15.76:0/3898317066 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5622d94fee30 0x5622d9501250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:00:12.450 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.447+0000 7fde6ecffb80 4 client.16398 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T05:00:12.450 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.447+0000 7fde6ecffb80 1 -- 172.21.15.76:0/3898317066 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5622d9220c90 con 0x5622d94fee30 2024-06-02T05:00:12.451 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.448+0000 7fde608e0700 1 --2- 172.21.15.76:0/3898317066 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5622d94fee30 0x5622d9501250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:00:12.451 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.448+0000 7fde3ffff700 10 client.16398 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T05:00:12.451 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.448+0000 7fde608e0700 1 --2- 172.21.15.76:0/3898317066 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5622d94fee30 0x5622d9501250 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9ecc0935cfb3ba0a server_cookie=1ac9d79c07ad8439 in_seq=0 out_seq=0 2024-06-02T05:00:12.469 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.468+0000 7fde3ffff700 1 -- 172.21.15.76:0/3898317066 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5622d9220c90 con 0x5622d94fee30 2024-06-02T05:00:12.469 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.468+0000 7fde3ffff700 10 client.16398 handle_command_reply: tid=0 2024-06-02T05:00:12.469 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.468+0000 7fde6ecffb80 1 client.16398 shutdown 2024-06-02T05:00:12.469 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.468+0000 7fde6ecffb80 1 -- 172.21.15.76:0/3898317066 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5622d948abf0 msgr2=0x5622d9497320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:00:12.469 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.468+0000 7fde6ecffb80 1 --2- 172.21.15.76:0/3898317066 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5622d948abf0 0x5622d9497320 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fde480aacd0 tx=0x7fde48005c70 comp rx=0 tx=0).stop 2024-06-02T05:00:12.470 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.469+0000 7fde6ecffb80 1 -- 172.21.15.76:0/3898317066 shutdown_connections 2024-06-02T05:00:12.470 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.469+0000 7fde6ecffb80 1 --2- 172.21.15.76:0/3898317066 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5622d94fee30 0x5622d9501250 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:12.470 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.469+0000 7fde6ecffb80 1 --2- 172.21.15.76:0/3898317066 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5622d948bae0 0x5622d949a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:12.470 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.469+0000 7fde6ecffb80 1 --2- 172.21.15.76:0/3898317066 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5622d948a290 0x5622d9496de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:12.470 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.469+0000 7fde6ecffb80 1 --2- 172.21.15.76:0/3898317066 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5622d948abf0 0x5622d9497320 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:12.470 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.469+0000 7fde6ecffb80 1 -- 172.21.15.76:0/3898317066 >> 172.21.15.76:0/3898317066 conn(0x5622d93e01b0 msgr2=0x5622d94b0b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:00:12.470 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.469+0000 7fde3ffff700 0 client.16398 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T05:00:12.470 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.469+0000 7fde6ecffb80 1 -- 172.21.15.76:0/3898317066 shutdown_connections 2024-06-02T05:00:12.471 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.469+0000 7fde6ecffb80 1 -- 172.21.15.76:0/3898317066 wait complete. 2024-06-02T05:00:12.471 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.469+0000 7fde6ecffb80 20 client.16398 trim_cache size 0 max 16384 2024-06-02T05:00:12.471 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:{ 2024-06-02T05:00:12.471 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "message": "", 2024-06-02T05:00:12.471 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "return_code": 0 2024-06-02T05:00:12.471 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:} 2024-06-02T05:00:12.472 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.470+0000 7fde62b44700 1 -- 172.21.15.76:0/2358525574 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fde4c0a1130 msgr2=0x7fde4c0a35f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:00:12.472 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.470+0000 7fde62b44700 1 --2- 172.21.15.76:0/2358525574 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fde4c0a1130 0x7fde4c0a35f0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fde54009c10 tx=0x7fde54009920 comp rx=0 tx=0).stop 2024-06-02T05:00:12.472 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.470+0000 7fde62b44700 1 -- 172.21.15.76:0/2358525574 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fde5c104330 msgr2=0x7fde5c1995e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:00:12.472 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.470+0000 7fde62b44700 1 --2- 172.21.15.76:0/2358525574 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fde5c104330 0x7fde5c1995e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fde48009f80 tx=0x7fde4800ecd0 comp rx=0 tx=0).stop 2024-06-02T05:00:12.472 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.470+0000 7fde62b44700 1 -- 172.21.15.76:0/2358525574 shutdown_connections 2024-06-02T05:00:12.472 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.470+0000 7fde62b44700 1 --2- 172.21.15.76:0/2358525574 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fde5c104cd0 0x7fde5c1a0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:12.472 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.470+0000 7fde62b44700 1 --2- 172.21.15.76:0/2358525574 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fde5c103140 0x7fde5c1990a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:12.472 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.470+0000 7fde62b44700 1 --2- 172.21.15.76:0/2358525574 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fde4c0a1130 0x7fde4c0a35f0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:12.472 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.470+0000 7fde62b44700 1 --2- 172.21.15.76:0/2358525574 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fde5c104330 0x7fde5c1995e0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:12.472 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.470+0000 7fde62b44700 1 -- 172.21.15.76:0/2358525574 >> 172.21.15.76:0/2358525574 conn(0x7fde5c0fe6b0 msgr2=0x7fde5c107680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:00:12.472 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.470+0000 7fde62b44700 1 -- 172.21.15.76:0/2358525574 shutdown_connections 2024-06-02T05:00:12.472 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:12.470+0000 7fde62b44700 1 -- 172.21.15.76:0/2358525574 wait complete. 2024-06-02T05:00:13.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:00:13 smithi192 ceph-mon[47933]: pgmap v587: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 10 MiB/s wr, 825 op/s 2024-06-02T05:00:13.987 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:00:13 smithi076 ceph-mon[42935]: pgmap v587: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 10 MiB/s wr, 825 op/s 2024-06-02T05:00:14.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:00:13 smithi119 ceph-mon[46633]: pgmap v587: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 10 MiB/s wr, 825 op/s 2024-06-02T05:00:15.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:00:15 smithi192 ceph-mon[47933]: pgmap v588: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 9.6 MiB/s wr, 727 op/s 2024-06-02T05:00:15.986 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:00:15 smithi076 ceph-mon[42935]: pgmap v588: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 9.6 MiB/s wr, 727 op/s 2024-06-02T05:00:16.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:00:15 smithi119 ceph-mon[46633]: pgmap v588: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 9.6 MiB/s wr, 727 op/s 2024-06-02T05:00:16.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 565.0 s, 576.2 tps, lat 173.794 ms stddev 73.435 2024-06-02T05:00:16.646 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:00:16 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T05:00:16.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:00:16 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T05:00:17.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:00:16 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T05:00:17.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:00:17 smithi192 ceph-mon[47933]: pgmap v589: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 10 MiB/s wr, 831 op/s 2024-06-02T05:00:17.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:00:17 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T05:00:17.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:00:17 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T05:00:17.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:00:17 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T05:00:17.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:00:17 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T05:00:17.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:00:17 smithi076 ceph-mon[42935]: pgmap v589: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 10 MiB/s wr, 831 op/s 2024-06-02T05:00:17.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:00:17 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T05:00:17.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:00:17 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T05:00:17.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:00:17 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T05:00:17.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:00:17 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T05:00:18.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:00:17 smithi119 ceph-mon[46633]: pgmap v589: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 10 MiB/s wr, 831 op/s 2024-06-02T05:00:18.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:00:17 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T05:00:18.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:00:17 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T05:00:18.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:00:17 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T05:00:18.097 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:00:17 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T05:00:18.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:00:18 smithi192 ceph-mon[47933]: pgmap v590: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 9.0 MiB/s wr, 754 op/s 2024-06-02T05:00:18.994 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:00:18 smithi076 ceph-mon[42935]: pgmap v590: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 9.0 MiB/s wr, 754 op/s 2024-06-02T05:00:19.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:00:18 smithi119 ceph-mon[46633]: pgmap v590: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 9.0 MiB/s wr, 754 op/s 2024-06-02T05:00:21.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 570.0 s, 566.6 tps, lat 176.507 ms stddev 80.538 2024-06-02T05:00:21.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:00:21 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T05:00:21.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:00:21 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T05:00:21.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:00:21 smithi119 ceph-mon[46633]: pgmap v591: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 9.4 MiB/s wr, 799 op/s 2024-06-02T05:00:21.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:00:21 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T05:00:21.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:00:21 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T05:00:21.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:00:21 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T05:00:21.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:00:21 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T05:00:21.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:00:21 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T05:00:21.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:00:21 smithi192 ceph-mon[47933]: pgmap v591: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 9.4 MiB/s wr, 799 op/s 2024-06-02T05:00:21.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:00:21 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T05:00:21.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:00:21 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T05:00:21.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:00:21 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T05:00:21.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:00:21 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T05:00:21.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:00:21 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T05:00:21.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:00:21 smithi076 ceph-mon[42935]: pgmap v591: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 9.4 MiB/s wr, 799 op/s 2024-06-02T05:00:21.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:00:21 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T05:00:21.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:00:21 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T05:00:21.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:00:21 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T05:00:23.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:00:23 smithi119 ceph-mon[46633]: pgmap v592: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 8.5 MiB/s wr, 761 op/s 2024-06-02T05:00:23.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:00:23 smithi192 ceph-mon[47933]: pgmap v592: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 8.5 MiB/s wr, 761 op/s 2024-06-02T05:00:23.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:00:23 smithi076 ceph-mon[42935]: pgmap v592: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 8.5 MiB/s wr, 761 op/s 2024-06-02T05:00:25.651 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.647+0000 7f98d29fb700 1 -- 172.21.15.76:0/773198168 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f98cc1090d0 msgr2=0x7f98cc10f980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:00:25.652 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.647+0000 7f98d29fb700 1 --2- 172.21.15.76:0/773198168 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f98cc1090d0 0x7f98cc10f980 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f98c4009f90 tx=0x7f98c400b330 comp rx=0 tx=0).stop 2024-06-02T05:00:25.652 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.647+0000 7f98d29fb700 1 -- 172.21.15.76:0/773198168 shutdown_connections 2024-06-02T05:00:25.652 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.647+0000 7f98d29fb700 1 --2- 172.21.15.76:0/773198168 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f98cc1090d0 0x7f98cc10f980 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:25.652 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.647+0000 7f98d29fb700 1 --2- 172.21.15.76:0/773198168 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f98cc107540 0x7f98cc107960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:25.652 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.647+0000 7f98d29fb700 1 --2- 172.21.15.76:0/773198168 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98cc108730 0x7f98cc108b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:25.652 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.647+0000 7f98d29fb700 1 -- 172.21.15.76:0/773198168 >> 172.21.15.76:0/773198168 conn(0x7f98cc0764d0 msgr2=0x7f98cc078910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:00:25.652 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.651+0000 7f98d29fb700 1 -- 172.21.15.76:0/773198168 shutdown_connections 2024-06-02T05:00:25.653 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.652+0000 7f98d29fb700 1 -- 172.21.15.76:0/773198168 wait complete. 2024-06-02T05:00:25.654 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.652+0000 7f98d29fb700 1 Processor -- start 2024-06-02T05:00:25.654 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.652+0000 7f98d29fb700 1 -- start start 2024-06-02T05:00:25.654 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.653+0000 7f98d29fb700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98cc107540 0x7f98cc19d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:00:25.654 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.653+0000 7f98d29fb700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f98cc108730 0x7f98cc19da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:00:25.654 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.653+0000 7f98d29fb700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f98cc1090d0 0x7f98cc1a4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:00:25.654 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.653+0000 7f98d29fb700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98cc1a5000 con 0x7f98cc108730 2024-06-02T05:00:25.654 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.653+0000 7f98d29fb700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98cc1a5140 con 0x7f98cc107540 2024-06-02T05:00:25.654 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.653+0000 7f98d29fb700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98cc1a52d0 con 0x7f98cc1090d0 2024-06-02T05:00:25.654 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.653+0000 7f98cb7fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f98cc108730 0x7f98cc19da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:00:25.654 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.653+0000 7f98d0f98700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f98cc1090d0 0x7f98cc1a4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:00:25.655 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.653+0000 7f98d0f98700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f98cc1090d0 0x7f98cc1a4a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:48266/0 (socket says 172.21.15.76:48266) 2024-06-02T05:00:25.655 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.653+0000 7f98d0f98700 1 -- 172.21.15.76:0/2783560166 learned_addr learned my addr 172.21.15.76:0/2783560166 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:00:25.656 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.654+0000 7f98cb7fe700 1 -- 172.21.15.76:0/2783560166 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f98cc1090d0 msgr2=0x7f98cc1a4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:00:25.656 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.654+0000 7f98cb7fe700 1 --2- 172.21.15.76:0/2783560166 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f98cc1090d0 0x7f98cc1a4a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:25.656 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.654+0000 7f98cb7fe700 1 -- 172.21.15.76:0/2783560166 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98cc107540 msgr2=0x7f98cc19d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:00:25.656 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.654+0000 7f98cb7fe700 1 --2- 172.21.15.76:0/2783560166 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98cc107540 0x7f98cc19d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:25.656 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.654+0000 7f98cb7fe700 1 -- 172.21.15.76:0/2783560166 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98c4009c40 con 0x7f98cc108730 2024-06-02T05:00:25.656 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.654+0000 7f98cb7fe700 1 --2- 172.21.15.76:0/2783560166 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f98cc108730 0x7f98cc19da10 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f98c000d950 tx=0x7f98c000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:00:25.657 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.655+0000 7f98c97fa700 1 -- 172.21.15.76:0/2783560166 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98c0009930 con 0x7f98cc108730 2024-06-02T05:00:25.657 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.655+0000 7f98c97fa700 1 -- 172.21.15.76:0/2783560166 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f98c0010460 con 0x7f98cc108730 2024-06-02T05:00:25.657 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.655+0000 7f98d29fb700 1 -- 172.21.15.76:0/2783560166 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98cc1a55b0 con 0x7f98cc108730 2024-06-02T05:00:25.657 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.655+0000 7f98c97fa700 1 -- 172.21.15.76:0/2783560166 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98c000b5d0 con 0x7f98cc108730 2024-06-02T05:00:25.657 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.655+0000 7f98d29fb700 1 -- 172.21.15.76:0/2783560166 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98cc1a5b10 con 0x7f98cc108730 2024-06-02T05:00:25.660 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.659+0000 7f98debb6b80 1 Processor -- start 2024-06-02T05:00:25.662 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.661+0000 7f98debb6b80 1 -- start start 2024-06-02T05:00:25.662 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.661+0000 7f98debb6b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b54e2eca80 0x55b54e2ecea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:00:25.662 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.661+0000 7f98debb6b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b54e2ed3e0 0x55b54e2edcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:00:25.662 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.661+0000 7f98debb6b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b54e2ee2d0 0x55b54e2ee750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:00:25.662 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.661+0000 7f98debb6b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b54e2440f0 con 0x55b54e2ed3e0 2024-06-02T05:00:25.662 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.661+0000 7f98debb6b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b54e241ab0 con 0x55b54e2ee2d0 2024-06-02T05:00:25.662 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.661+0000 7f98debb6b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b54e23d3a0 con 0x55b54e2eca80 2024-06-02T05:00:25.663 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.661+0000 7f98d0f98700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b54e2eca80 0x55b54e2ecea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:00:25.663 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.661+0000 7f98d0f98700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b54e2eca80 0x55b54e2ecea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:48272/0 (socket says 172.21.15.76:48272) 2024-06-02T05:00:25.663 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.661+0000 7f98d0f98700 1 -- 172.21.15.76:0/2405247093 learned_addr learned my addr 172.21.15.76:0/2405247093 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:00:25.663 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.662+0000 7f98cb7fe700 1 --2- 172.21.15.76:0/2405247093 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b54e2ee2d0 0x55b54e2ee750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:00:25.663 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.662+0000 7f98d0f98700 1 -- 172.21.15.76:0/2405247093 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b54e2ee2d0 msgr2=0x55b54e2ee750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:00:25.664 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.662+0000 7f98d0f98700 1 --2- 172.21.15.76:0/2405247093 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b54e2ee2d0 0x55b54e2ee750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:25.664 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.662+0000 7f98d0f98700 1 -- 172.21.15.76:0/2405247093 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b54e2ed3e0 msgr2=0x55b54e2edcf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-02T05:00:25.664 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.662+0000 7f98d0f98700 1 --2- 172.21.15.76:0/2405247093 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b54e2ed3e0 0x55b54e2edcf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:25.664 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.662+0000 7f98d0f98700 1 -- 172.21.15.76:0/2405247093 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b54e0be350 con 0x55b54e2eca80 2024-06-02T05:00:25.664 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.662+0000 7f98d0f98700 1 --2- 172.21.15.76:0/2405247093 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b54e2eca80 0x55b54e2ecea0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f98c4009ba0 tx=0x7f98c4009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e71bdddd1099f814 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:00:25.664 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.663+0000 7f98b27fc700 1 -- 172.21.15.76:0/2405247093 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98c400e040 con 0x55b54e2eca80 2024-06-02T05:00:25.665 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.663+0000 7f98b27fc700 1 -- 172.21.15.76:0/2405247093 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f98c4003a00 con 0x55b54e2eca80 2024-06-02T05:00:25.665 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.663+0000 7f98b27fc700 1 -- 172.21.15.76:0/2405247093 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98c400bd40 con 0x55b54e2eca80 2024-06-02T05:00:25.665 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.664+0000 7f98debb6b80 1 -- 172.21.15.76:0/2405247093 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b54e2eca80 msgr2=0x55b54e2ecea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:00:25.665 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.664+0000 7f98debb6b80 1 --2- 172.21.15.76:0/2405247093 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b54e2eca80 0x55b54e2ecea0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f98c4009ba0 tx=0x7f98c4009bd0 comp rx=0 tx=0).stop 2024-06-02T05:00:25.665 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.664+0000 7f98debb6b80 1 -- 172.21.15.76:0/2405247093 shutdown_connections 2024-06-02T05:00:25.665 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.664+0000 7f98debb6b80 1 --2- 172.21.15.76:0/2405247093 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b54e2ee2d0 0x55b54e2ee750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:25.665 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.664+0000 7f98debb6b80 1 --2- 172.21.15.76:0/2405247093 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b54e2eca80 0x55b54e2ecea0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:25.665 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.664+0000 7f98debb6b80 1 --2- 172.21.15.76:0/2405247093 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b54e2ed3e0 0x55b54e2edcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:25.665 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.664+0000 7f98debb6b80 1 -- 172.21.15.76:0/2405247093 >> 172.21.15.76:0/2405247093 conn(0x55b54e24b1b0 msgr2=0x55b54e2e9440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:00:25.666 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.665+0000 7f98c97fa700 1 -- 172.21.15.76:0/2783560166 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f98c0009a90 con 0x7f98cc108730 2024-06-02T05:00:25.666 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.665+0000 7f98debb6b80 1 -- 172.21.15.76:0/2405247093 shutdown_connections 2024-06-02T05:00:25.666 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.665+0000 7f98debb6b80 1 -- 172.21.15.76:0/2405247093 wait complete. 2024-06-02T05:00:25.666 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.665+0000 7f98c97fa700 1 --2- 172.21.15.76:0/2783560166 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f98b40a1100 0x7f98b40a35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:00:25.667 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.666+0000 7f98c97fa700 1 -- 172.21.15.76:0/2783560166 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f98c00cc800 con 0x7f98cc108730 2024-06-02T05:00:25.667 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.666+0000 7f98debb6b80 1 -- start start 2024-06-02T05:00:25.667 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.666+0000 7f98debb6b80 1 Processor -- start 2024-06-02T05:00:25.668 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.667+0000 7f98debb6b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b54e2eca80 0x55b54e307840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:00:25.668 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.667+0000 7f98debb6b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b54e2ed3e0 0x55b54e307d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:00:25.668 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.667+0000 7f98debb6b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b54e2ee2d0 0x55b54e30edc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:00:25.668 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.667+0000 7f98debb6b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b54e1d9500 con 0x55b54e2eca80 2024-06-02T05:00:25.668 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.667+0000 7f98debb6b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b54e1d91a0 con 0x55b54e2ed3e0 2024-06-02T05:00:25.668 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.667+0000 7f98debb6b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b54e0c0640 con 0x55b54e2ee2d0 2024-06-02T05:00:25.668 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.667+0000 7f98debb6b80 10 client.0 _ll_register_callbacks cb 0x55b54e1e2ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T05:00:25.668 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.667+0000 7f98cbfff700 1 --2- 172.21.15.76:0/2783560166 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f98b40a1100 0x7f98b40a35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:00:25.671 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.667+0000 7f98d0f98700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b54e2ee2d0 0x55b54e30edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:00:25.671 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.667+0000 7f98d0f98700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b54e2ee2d0 0x55b54e30edc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:48286/0 (socket says 172.21.15.76:48286) 2024-06-02T05:00:25.671 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.667+0000 7f98d0f98700 1 -- 172.21.15.76:0/2429448512 learned_addr learned my addr 172.21.15.76:0/2429448512 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:00:25.671 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.668+0000 7f98cbfff700 1 --2- 172.21.15.76:0/2429448512 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b54e2eca80 0x55b54e307840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:00:25.671 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.668+0000 7f98d0f98700 1 -- 172.21.15.76:0/2429448512 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b54e2ed3e0 msgr2=0x55b54e307d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:00:25.671 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.668+0000 7f98d0f98700 1 --2- 172.21.15.76:0/2429448512 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b54e2ed3e0 0x55b54e307d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:25.671 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.668+0000 7f98d0f98700 1 -- 172.21.15.76:0/2429448512 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b54e2eca80 msgr2=0x55b54e307840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:00:25.672 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.668+0000 7f98d0f98700 1 --2- 172.21.15.76:0/2429448512 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b54e2eca80 0x55b54e307840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:25.672 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.668+0000 7f98d0f98700 1 -- 172.21.15.76:0/2429448512 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98cc1102d0 con 0x55b54e2ee2d0 2024-06-02T05:00:25.672 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.669+0000 7f98d0f98700 1 --2- 172.21.15.76:0/2429448512 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b54e2ee2d0 0x55b54e30edc0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f98c400b370 tx=0x7f98c4007df0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b4a1b2cb753e97cc server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:00:25.672 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.669+0000 7f98ab7fe700 10 client.0 ms_handle_connect on v2:172.21.15.192:3300/0 2024-06-02T05:00:25.672 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.669+0000 7f98cbfff700 1 --2- 172.21.15.76:0/2783560166 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f98b40a1100 0x7f98b40a35c0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f98cc108590 tx=0x7f98bc0127e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:00:25.672 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.669+0000 7f98ab7fe700 1 -- 172.21.15.76:0/2429448512 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98c400e040 con 0x55b54e2ee2d0 2024-06-02T05:00:25.672 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.669+0000 7f98ab7fe700 1 -- 172.21.15.76:0/2429448512 <== mon.1 v2:172.21.15.192:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f98c401c440 con 0x55b54e2ee2d0 2024-06-02T05:00:25.672 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.669+0000 7f98debb6b80 1 -- 172.21.15.76:0/2429448512 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b54e196210 con 0x55b54e2ee2d0 2024-06-02T05:00:25.672 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.669+0000 7f98ab7fe700 1 -- 172.21.15.76:0/2429448512 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f98c401c620 con 0x55b54e2ee2d0 2024-06-02T05:00:25.673 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.669+0000 7f98debb6b80 10 client.25978 fetch_fsmap learned FSMap version 36 2024-06-02T05:00:25.673 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.669+0000 7f98debb6b80 1 -- 172.21.15.76:0/2429448512 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55b54e06ab00 con 0x55b54e2ee2d0 2024-06-02T05:00:25.673 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.669+0000 7f98ab7fe700 1 -- 172.21.15.76:0/2429448512 <== mon.1 v2:172.21.15.192:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b54e196210 con 0x55b54e2ee2d0 2024-06-02T05:00:25.673 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.669+0000 7f98ab7fe700 1 -- 172.21.15.76:0/2429448512 <== mon.1 v2:172.21.15.192:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f98c4019070 con 0x55b54e2ee2d0 2024-06-02T05:00:25.673 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.669+0000 7f98debb6b80 10 client.25978 fetch_fsmap finished waiting for FSMap version 36 2024-06-02T05:00:25.673 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.669+0000 7f98debb6b80 10 client.25978 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T05:00:25.673 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.670+0000 7f98debb6b80 20 client.25978 populate_metadata read hostname 'smithi076' 2024-06-02T05:00:25.673 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.670+0000 7f98debb6b80 1 --2- 172.21.15.76:0/2429448512 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55b54e313280 0x55b54e315670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:00:25.673 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.670+0000 7f98debb6b80 4 client.25978 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T05:00:25.673 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.670+0000 7f98debb6b80 1 -- 172.21.15.76:0/2429448512 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b54e2bc7b0 con 0x55b54e313280 2024-06-02T05:00:25.673 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.670+0000 7f98cbfff700 1 --2- 172.21.15.76:0/2429448512 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55b54e313280 0x55b54e315670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:00:25.673 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.670+0000 7f98cbfff700 1 --2- 172.21.15.76:0/2429448512 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55b54e313280 0x55b54e315670 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a23f87d4e8e1b48a server_cookie=48da7f2dde3e9ea0 in_seq=0 out_seq=0 2024-06-02T05:00:25.674 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.670+0000 7f98ab7fe700 10 client.25978 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T05:00:25.675 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.671+0000 7f98ab7fe700 1 -- 172.21.15.76:0/2429448512 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55b54e2bc7b0 con 0x55b54e313280 2024-06-02T05:00:25.675 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.671+0000 7f98ab7fe700 10 client.25978 handle_command_reply: tid=0 2024-06-02T05:00:25.675 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.671+0000 7f98debb6b80 1 client.25978 shutdown 2024-06-02T05:00:25.675 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.672+0000 7f98debb6b80 1 -- 172.21.15.76:0/2429448512 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b54e2ee2d0 msgr2=0x55b54e30edc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:00:25.675 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.672+0000 7f98debb6b80 1 --2- 172.21.15.76:0/2429448512 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b54e2ee2d0 0x55b54e30edc0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f98c400b370 tx=0x7f98c4007df0 comp rx=0 tx=0).stop 2024-06-02T05:00:25.675 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.672+0000 7f98debb6b80 1 -- 172.21.15.76:0/2429448512 shutdown_connections 2024-06-02T05:00:25.675 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.672+0000 7f98debb6b80 1 --2- 172.21.15.76:0/2429448512 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55b54e313280 0x55b54e315670 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:25.676 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.672+0000 7f98debb6b80 1 --2- 172.21.15.76:0/2429448512 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b54e2ee2d0 0x55b54e30edc0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:25.676 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.672+0000 7f98debb6b80 1 --2- 172.21.15.76:0/2429448512 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b54e2eca80 0x55b54e307840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:25.676 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.672+0000 7f98debb6b80 1 --2- 172.21.15.76:0/2429448512 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b54e2ed3e0 0x55b54e307d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:25.676 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.672+0000 7f98debb6b80 1 -- 172.21.15.76:0/2429448512 >> 172.21.15.76:0/2429448512 conn(0x55b54e24b1b0 msgr2=0x55b54e2e7860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:00:25.676 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.672+0000 7f98ab7fe700 0 client.25978 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T05:00:25.676 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.672+0000 7f98debb6b80 1 -- 172.21.15.76:0/2429448512 shutdown_connections 2024-06-02T05:00:25.676 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.672+0000 7f98debb6b80 1 -- 172.21.15.76:0/2429448512 wait complete. 2024-06-02T05:00:25.676 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.672+0000 7f98debb6b80 20 client.25978 trim_cache size 0 max 16384 2024-06-02T05:00:25.705 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.704+0000 7f98debb6b80 1 Processor -- start 2024-06-02T05:00:25.705 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.704+0000 7f98debb6b80 1 -- start start 2024-06-02T05:00:25.706 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.704+0000 7f98debb6b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b54e2eca80 0x55b54e2ece60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:00:25.706 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.704+0000 7f98debb6b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b54e2ed3e0 0x55b54e30f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:00:25.706 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.704+0000 7f98debb6b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b54e2ee2d0 0x55b54e306d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:00:25.706 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.704+0000 7f98debb6b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b54e2e2330 con 0x55b54e2ed3e0 2024-06-02T05:00:25.706 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.704+0000 7f98debb6b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b54e2ed9f0 con 0x55b54e2eca80 2024-06-02T05:00:25.706 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.704+0000 7f98debb6b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b54e3073b0 con 0x55b54e2ee2d0 2024-06-02T05:00:25.706 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.705+0000 7f98cb7fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b54e2ed3e0 0x55b54e30f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:00:25.707 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.705+0000 7f98cb7fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b54e2ed3e0 0x55b54e30f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:35176/0 (socket says 172.21.15.76:35176) 2024-06-02T05:00:25.707 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.705+0000 7f98cb7fe700 1 -- 172.21.15.76:0/187968255 learned_addr learned my addr 172.21.15.76:0/187968255 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:00:25.707 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.705+0000 7f98d0f98700 1 --2- 172.21.15.76:0/187968255 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b54e2ee2d0 0x55b54e306d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:00:25.707 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.705+0000 7f98cbfff700 1 --2- 172.21.15.76:0/187968255 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b54e2eca80 0x55b54e2ece60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:00:25.707 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.705+0000 7f98cb7fe700 1 -- 172.21.15.76:0/187968255 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b54e2ee2d0 msgr2=0x55b54e306d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:00:25.707 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.705+0000 7f98cb7fe700 1 --2- 172.21.15.76:0/187968255 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b54e2ee2d0 0x55b54e306d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:25.707 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.705+0000 7f98cb7fe700 1 -- 172.21.15.76:0/187968255 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b54e2eca80 msgr2=0x55b54e2ece60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:00:25.707 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.705+0000 7f98cb7fe700 1 --2- 172.21.15.76:0/187968255 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b54e2eca80 0x55b54e2ece60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:25.707 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.705+0000 7f98cb7fe700 1 -- 172.21.15.76:0/187968255 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b54e203500 con 0x55b54e2ed3e0 2024-06-02T05:00:25.707 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.705+0000 7f98cbfff700 1 --2- 172.21.15.76:0/187968255 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b54e2eca80 0x55b54e2ece60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T05:00:25.707 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.706+0000 7f98cb7fe700 1 --2- 172.21.15.76:0/187968255 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b54e2ed3e0 0x55b54e30f470 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f98c0099840 tx=0x7f98c0099470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1d465f99797f0d0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:00:25.708 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.706+0000 7f98b2ffd700 1 -- 172.21.15.76:0/187968255 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98c0014020 con 0x55b54e2ed3e0 2024-06-02T05:00:25.708 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.706+0000 7f98b2ffd700 1 -- 172.21.15.76:0/187968255 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f98c0010820 con 0x55b54e2ed3e0 2024-06-02T05:00:25.708 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.706+0000 7f98b2ffd700 1 -- 172.21.15.76:0/187968255 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98c00b7ea0 con 0x55b54e2ed3e0 2024-06-02T05:00:25.708 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.707+0000 7f98debb6b80 1 -- 172.21.15.76:0/187968255 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b54e2ed3e0 msgr2=0x55b54e30f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:00:25.708 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.707+0000 7f98debb6b80 1 --2- 172.21.15.76:0/187968255 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b54e2ed3e0 0x55b54e30f470 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f98c0099840 tx=0x7f98c0099470 comp rx=0 tx=0).stop 2024-06-02T05:00:25.709 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.708+0000 7f98debb6b80 1 -- 172.21.15.76:0/187968255 shutdown_connections 2024-06-02T05:00:25.709 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.708+0000 7f98debb6b80 1 --2- 172.21.15.76:0/187968255 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b54e2ee2d0 0x55b54e306d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:25.709 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.708+0000 7f98debb6b80 1 --2- 172.21.15.76:0/187968255 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b54e2eca80 0x55b54e2ece60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:25.709 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.708+0000 7f98debb6b80 1 --2- 172.21.15.76:0/187968255 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b54e2ed3e0 0x55b54e30f470 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:25.709 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.708+0000 7f98debb6b80 1 -- 172.21.15.76:0/187968255 >> 172.21.15.76:0/187968255 conn(0x55b54e24b1b0 msgr2=0x55b54e2f4830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:00:25.709 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.708+0000 7f98debb6b80 1 -- 172.21.15.76:0/187968255 shutdown_connections 2024-06-02T05:00:25.709 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.708+0000 7f98debb6b80 1 -- 172.21.15.76:0/187968255 wait complete. 2024-06-02T05:00:25.709 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.708+0000 7f98debb6b80 1 -- start start 2024-06-02T05:00:25.710 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.709+0000 7f98debb6b80 1 Processor -- start 2024-06-02T05:00:25.711 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.709+0000 7f98debb6b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b54e2eca80 0x55b54e30c530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:00:25.711 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.709+0000 7f98debb6b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b54e2ed3e0 0x55b54e30ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:00:25.711 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.709+0000 7f98debb6b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b54e2ee2d0 0x55b54e30da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:00:25.711 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.709+0000 7f98debb6b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b54e30df70 con 0x55b54e2ee2d0 2024-06-02T05:00:25.711 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.709+0000 7f98debb6b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b54e30e0e0 con 0x55b54e2ed3e0 2024-06-02T05:00:25.711 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.709+0000 7f98debb6b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b54e30e250 con 0x55b54e2eca80 2024-06-02T05:00:25.711 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.709+0000 7f98debb6b80 10 client.0 _ll_register_callbacks cb 0x55b54e1e2ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T05:00:25.711 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.709+0000 7f98cbfff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b54e2eca80 0x55b54e30c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:00:25.711 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.709+0000 7f98cbfff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b54e2eca80 0x55b54e30c530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:48304/0 (socket says 172.21.15.76:48304) 2024-06-02T05:00:25.712 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.709+0000 7f98cbfff700 1 -- 172.21.15.76:0/2894982415 learned_addr learned my addr 172.21.15.76:0/2894982415 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:00:25.712 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.710+0000 7f98d0f98700 1 --2- 172.21.15.76:0/2894982415 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b54e2ee2d0 0x55b54e30da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:00:25.712 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.710+0000 7f98cb7fe700 1 --2- 172.21.15.76:0/2894982415 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b54e2ed3e0 0x55b54e30ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:00:25.712 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.710+0000 7f98cbfff700 1 -- 172.21.15.76:0/2894982415 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b54e2ed3e0 msgr2=0x55b54e30ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:00:25.712 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.710+0000 7f98cbfff700 1 --2- 172.21.15.76:0/2894982415 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b54e2ed3e0 0x55b54e30ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:25.712 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.710+0000 7f98cbfff700 1 -- 172.21.15.76:0/2894982415 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b54e2ee2d0 msgr2=0x55b54e30da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:00:25.712 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.710+0000 7f98cbfff700 1 --2- 172.21.15.76:0/2894982415 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b54e2ee2d0 0x55b54e30da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:25.712 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.710+0000 7f98cbfff700 1 -- 172.21.15.76:0/2894982415 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98cc1a5b10 con 0x55b54e2eca80 2024-06-02T05:00:25.712 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.710+0000 7f98cbfff700 1 --2- 172.21.15.76:0/2894982415 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b54e2eca80 0x55b54e30c530 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x55b54e315f20 tx=0x7f98bc01b000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dbea1420d9fa269b server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:00:25.712 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.710+0000 7f98ab7fe700 10 client.0 ms_handle_connect on v2:172.21.15.192:3300/0 2024-06-02T05:00:25.712 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.710+0000 7f98ab7fe700 1 -- 172.21.15.76:0/2894982415 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98bc025040 con 0x55b54e2eca80 2024-06-02T05:00:25.713 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.711+0000 7f98ab7fe700 1 -- 172.21.15.76:0/2894982415 <== mon.1 v2:172.21.15.192:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f98bc02b070 con 0x55b54e2eca80 2024-06-02T05:00:25.714 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.711+0000 7f98debb6b80 1 -- 172.21.15.76:0/2894982415 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f98c4003a00 con 0x55b54e2eca80 2024-06-02T05:00:25.714 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.711+0000 7f98ab7fe700 1 -- 172.21.15.76:0/2894982415 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f98bc00edb0 con 0x55b54e2eca80 2024-06-02T05:00:25.714 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.711+0000 7f98debb6b80 10 client.25984 fetch_fsmap learned FSMap version 36 2024-06-02T05:00:25.714 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.711+0000 7f98debb6b80 1 -- 172.21.15.76:0/2894982415 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55b54e0c2c70 con 0x55b54e2eca80 2024-06-02T05:00:25.714 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.712+0000 7f98ab7fe700 1 -- 172.21.15.76:0/2894982415 <== mon.1 v2:172.21.15.192:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f98c4003a00 con 0x55b54e2eca80 2024-06-02T05:00:25.714 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.713+0000 7f98ab7fe700 1 -- 172.21.15.76:0/2894982415 <== mon.1 v2:172.21.15.192:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f98bc030460 con 0x55b54e2eca80 2024-06-02T05:00:25.714 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.713+0000 7f98debb6b80 10 client.25984 fetch_fsmap finished waiting for FSMap version 36 2024-06-02T05:00:25.714 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.713+0000 7f98debb6b80 10 client.25984 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T05:00:25.714 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.713+0000 7f98debb6b80 20 client.25984 populate_metadata read hostname 'smithi076' 2024-06-02T05:00:25.714 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.713+0000 7f98debb6b80 1 --2- 172.21.15.76:0/2894982415 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55b54e37af70 0x55b54e37d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:00:25.714 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.713+0000 7f98debb6b80 4 client.25984 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T05:00:25.714 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.713+0000 7f98debb6b80 1 -- 172.21.15.76:0/2894982415 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55b54e235e60 con 0x55b54e37af70 2024-06-02T05:00:25.715 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.713+0000 7f98cb7fe700 1 --2- 172.21.15.76:0/2894982415 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55b54e37af70 0x55b54e37d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:00:25.715 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.714+0000 7f98cb7fe700 1 --2- 172.21.15.76:0/2894982415 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55b54e37af70 0x55b54e37d360 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b19519dba1578f4b server_cookie=f10679cffc386f7e in_seq=0 out_seq=0 2024-06-02T05:00:25.715 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.714+0000 7f98ab7fe700 10 client.25984 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T05:00:25.742 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.736+0000 7f98ab7fe700 1 -- 172.21.15.76:0/2894982415 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55b54e235e60 con 0x55b54e37af70 2024-06-02T05:00:25.742 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.736+0000 7f98ab7fe700 10 client.25984 handle_command_reply: tid=0 2024-06-02T05:00:25.742 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.736+0000 7f98debb6b80 1 client.25984 shutdown 2024-06-02T05:00:25.742 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.741+0000 7f98debb6b80 1 -- 172.21.15.76:0/2894982415 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b54e2eca80 msgr2=0x55b54e30c530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:00:25.742 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.741+0000 7f98debb6b80 1 --2- 172.21.15.76:0/2894982415 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b54e2eca80 0x55b54e30c530 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x55b54e315f20 tx=0x7f98bc01b000 comp rx=0 tx=0).stop 2024-06-02T05:00:25.742 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.741+0000 7f98debb6b80 1 -- 172.21.15.76:0/2894982415 shutdown_connections 2024-06-02T05:00:25.742 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.741+0000 7f98debb6b80 1 --2- 172.21.15.76:0/2894982415 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55b54e37af70 0x55b54e37d360 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:25.742 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.741+0000 7f98debb6b80 1 --2- 172.21.15.76:0/2894982415 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b54e2ee2d0 0x55b54e30da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:25.743 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.741+0000 7f98debb6b80 1 --2- 172.21.15.76:0/2894982415 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b54e2eca80 0x55b54e30c530 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:25.743 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.741+0000 7f98debb6b80 1 --2- 172.21.15.76:0/2894982415 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b54e2ed3e0 0x55b54e30ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:25.743 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.741+0000 7f98debb6b80 1 -- 172.21.15.76:0/2894982415 >> 172.21.15.76:0/2894982415 conn(0x55b54e24b1b0 msgr2=0x55b54e2f1510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:00:25.743 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.741+0000 7f98ab7fe700 0 client.25984 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T05:00:25.743 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.742+0000 7f98debb6b80 1 -- 172.21.15.76:0/2894982415 shutdown_connections 2024-06-02T05:00:25.743 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.742+0000 7f98debb6b80 1 -- 172.21.15.76:0/2894982415 wait complete. 2024-06-02T05:00:25.744 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.742+0000 7f98debb6b80 20 client.25984 trim_cache size 0 max 16384 2024-06-02T05:00:25.746 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:{ 2024-06-02T05:00:25.747 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "message": "", 2024-06-02T05:00:25.747 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "return_code": 0 2024-06-02T05:00:25.747 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:} 2024-06-02T05:00:25.747 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.743+0000 7f98d29fb700 1 -- 172.21.15.76:0/2783560166 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f98b40a1100 msgr2=0x7f98b40a35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:00:25.747 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.743+0000 7f98d29fb700 1 --2- 172.21.15.76:0/2783560166 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f98b40a1100 0x7f98b40a35c0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f98cc108590 tx=0x7f98bc0127e0 comp rx=0 tx=0).stop 2024-06-02T05:00:25.747 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.743+0000 7f98d29fb700 1 -- 172.21.15.76:0/2783560166 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f98cc108730 msgr2=0x7f98cc19da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:00:25.747 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.743+0000 7f98d29fb700 1 --2- 172.21.15.76:0/2783560166 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f98cc108730 0x7f98cc19da10 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f98c000d950 tx=0x7f98c000dc60 comp rx=0 tx=0).stop 2024-06-02T05:00:25.747 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.743+0000 7f98d29fb700 1 -- 172.21.15.76:0/2783560166 shutdown_connections 2024-06-02T05:00:25.748 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.743+0000 7f98d29fb700 1 --2- 172.21.15.76:0/2783560166 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f98cc1090d0 0x7f98cc1a4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:25.748 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.743+0000 7f98d29fb700 1 --2- 172.21.15.76:0/2783560166 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f98b40a1100 0x7f98b40a35c0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:25.748 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.743+0000 7f98d29fb700 1 --2- 172.21.15.76:0/2783560166 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98cc107540 0x7f98cc19d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:25.748 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.743+0000 7f98d29fb700 1 --2- 172.21.15.76:0/2783560166 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f98cc108730 0x7f98cc19da10 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:25.748 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.743+0000 7f98d29fb700 1 -- 172.21.15.76:0/2783560166 >> 172.21.15.76:0/2783560166 conn(0x7f98cc0764d0 msgr2=0x7f98cc10ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:00:25.748 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.744+0000 7f98d29fb700 1 -- 172.21.15.76:0/2783560166 shutdown_connections 2024-06-02T05:00:25.748 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:25.747+0000 7f98d29fb700 1 -- 172.21.15.76:0/2783560166 wait complete. 2024-06-02T05:00:25.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:00:25 smithi119 ceph-mon[46633]: pgmap v593: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 7.7 MiB/s wr, 674 op/s 2024-06-02T05:00:25.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:00:25 smithi192 ceph-mon[47933]: pgmap v593: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 7.7 MiB/s wr, 674 op/s 2024-06-02T05:00:25.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:00:25 smithi076 ceph-mon[42935]: pgmap v593: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 7.7 MiB/s wr, 674 op/s 2024-06-02T05:00:26.316 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 575.0 s, 569.8 tps, lat 175.103 ms stddev 62.865 2024-06-02T05:00:27.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:00:27 smithi192 ceph-mon[47933]: pgmap v594: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 8.4 MiB/s wr, 771 op/s 2024-06-02T05:00:27.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:00:27 smithi076 ceph-mon[42935]: pgmap v594: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 8.4 MiB/s wr, 771 op/s 2024-06-02T05:00:28.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:00:27 smithi119 ceph-mon[46633]: pgmap v594: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 8.4 MiB/s wr, 771 op/s 2024-06-02T05:00:29.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:00:29 smithi192 ceph-mon[47933]: pgmap v595: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 8.0 MiB/s wr, 711 op/s 2024-06-02T05:00:29.989 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:00:29 smithi076 ceph-mon[42935]: pgmap v595: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 8.0 MiB/s wr, 711 op/s 2024-06-02T05:00:30.097 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:00:29 smithi119 ceph-mon[46633]: pgmap v595: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 8.0 MiB/s wr, 711 op/s 2024-06-02T05:00:31.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 580.0 s, 558.2 tps, lat 180.857 ms stddev 250.650 2024-06-02T05:00:31.934 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:00:31 smithi192 ceph-mon[47933]: pgmap v596: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 9.0 MiB/s wr, 790 op/s 2024-06-02T05:00:31.988 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:00:31 smithi076 ceph-mon[42935]: pgmap v596: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 9.0 MiB/s wr, 790 op/s 2024-06-02T05:00:32.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:00:31 smithi119 ceph-mon[46633]: pgmap v596: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 9.0 MiB/s wr, 790 op/s 2024-06-02T05:00:33.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:00:33 smithi192 ceph-mon[47933]: pgmap v597: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 8.7 MiB/s wr, 790 op/s 2024-06-02T05:00:33.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:00:33 smithi076 ceph-mon[42935]: pgmap v597: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 8.7 MiB/s wr, 790 op/s 2024-06-02T05:00:34.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:00:33 smithi119 ceph-mon[46633]: pgmap v597: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 8.7 MiB/s wr, 790 op/s 2024-06-02T05:00:35.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:00:35 smithi192 ceph-mon[47933]: pgmap v598: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 8.5 MiB/s wr, 727 op/s 2024-06-02T05:00:35.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:00:35 smithi076 ceph-mon[42935]: pgmap v598: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 8.5 MiB/s wr, 727 op/s 2024-06-02T05:00:36.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:00:35 smithi119 ceph-mon[46633]: pgmap v598: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 8.5 MiB/s wr, 727 op/s 2024-06-02T05:00:36.316 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 585.0 s, 557.4 tps, lat 177.255 ms stddev 70.524 2024-06-02T05:00:37.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:00:37 smithi192 ceph-mon[47933]: pgmap v599: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 9.0 MiB/s wr, 825 op/s 2024-06-02T05:00:37.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:00:37 smithi076 ceph-mon[42935]: pgmap v599: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 9.0 MiB/s wr, 825 op/s 2024-06-02T05:00:38.097 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:00:37 smithi119 ceph-mon[46633]: pgmap v599: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 9.0 MiB/s wr, 825 op/s 2024-06-02T05:00:38.931 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.929+0000 7f0062f57700 1 -- 172.21.15.76:0/1167718580 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f005c100ff0 msgr2=0x7f005c101450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:00:38.931 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.929+0000 7f0062f57700 1 --2- 172.21.15.76:0/1167718580 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f005c100ff0 0x7f005c101450 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f00580099c0 tx=0x7f0058009cd0 comp rx=0 tx=0).stop 2024-06-02T05:00:38.931 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.929+0000 7f0062f57700 1 -- 172.21.15.76:0/1167718580 shutdown_connections 2024-06-02T05:00:38.931 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.929+0000 7f0062f57700 1 --2- 172.21.15.76:0/1167718580 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f005c101990 0x7f005c108240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:38.931 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.929+0000 7f0062f57700 1 --2- 172.21.15.76:0/1167718580 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f005c0ffe00 0x7f005c100220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:38.931 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.929+0000 7f0062f57700 1 --2- 172.21.15.76:0/1167718580 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f005c100ff0 0x7f005c101450 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:38.931 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.929+0000 7f0062f57700 1 -- 172.21.15.76:0/1167718580 >> 172.21.15.76:0/1167718580 conn(0x7f005c0fb390 msgr2=0x7f005c0fd7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:00:38.931 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.929+0000 7f0062f57700 1 -- 172.21.15.76:0/1167718580 shutdown_connections 2024-06-02T05:00:38.931 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.929+0000 7f0062f57700 1 -- 172.21.15.76:0/1167718580 wait complete. 2024-06-02T05:00:38.932 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.930+0000 7f0062f57700 1 Processor -- start 2024-06-02T05:00:38.932 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.930+0000 7f0062f57700 1 -- start start 2024-06-02T05:00:38.932 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.930+0000 7f0062f57700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f005c0ffe00 0x7f005c1070f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:00:38.932 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.930+0000 7f0062f57700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f005c100ff0 0x7f005c107630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:00:38.933 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.930+0000 7f0062f57700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f005c101990 0x7f005c19c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:00:38.933 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.930+0000 7f0062f57700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f005c19c870 con 0x7f005c100ff0 2024-06-02T05:00:38.933 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.930+0000 7f0062f57700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f005c19c9b0 con 0x7f005c0ffe00 2024-06-02T05:00:38.933 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.930+0000 7f0062f57700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f005c19caf0 con 0x7f005c101990 2024-06-02T05:00:38.933 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.931+0000 7f00614f4700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f005c101990 0x7f005c19c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:00:38.933 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.931+0000 7f00614f4700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f005c101990 0x7f005c19c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:36660/0 (socket says 172.21.15.76:36660) 2024-06-02T05:00:38.933 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.931+0000 7f00614f4700 1 -- 172.21.15.76:0/173992368 learned_addr learned my addr 172.21.15.76:0/173992368 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:00:38.934 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.931+0000 7f0053fff700 1 --2- 172.21.15.76:0/173992368 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f005c100ff0 0x7f005c107630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:00:38.934 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.931+0000 7f0060cf3700 1 --2- 172.21.15.76:0/173992368 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f005c0ffe00 0x7f005c1070f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:00:38.934 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.931+0000 7f00614f4700 1 -- 172.21.15.76:0/173992368 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f005c0ffe00 msgr2=0x7f005c1070f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:00:38.934 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.931+0000 7f00614f4700 1 --2- 172.21.15.76:0/173992368 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f005c0ffe00 0x7f005c1070f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:38.934 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.931+0000 7f00614f4700 1 -- 172.21.15.76:0/173992368 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f005c100ff0 msgr2=0x7f005c107630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:00:38.934 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.931+0000 7f00614f4700 1 --2- 172.21.15.76:0/173992368 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f005c100ff0 0x7f005c107630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:38.935 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.931+0000 7f00614f4700 1 -- 172.21.15.76:0/173992368 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00580095f0 con 0x7f005c101990 2024-06-02T05:00:38.935 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.931+0000 7f00614f4700 1 --2- 172.21.15.76:0/173992368 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f005c101990 0x7f005c19c330 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f005400b970 tx=0x7f005400bd30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:00:38.935 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.932+0000 7f0051ffb700 1 -- 172.21.15.76:0/173992368 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f005400c9b0 con 0x7f005c101990 2024-06-02T05:00:38.935 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.932+0000 7f0051ffb700 1 -- 172.21.15.76:0/173992368 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0054014440 con 0x7f005c101990 2024-06-02T05:00:38.935 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.932+0000 7f0051ffb700 1 -- 172.21.15.76:0/173992368 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00540075d0 con 0x7f005c101990 2024-06-02T05:00:38.935 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.932+0000 7f0062f57700 1 -- 172.21.15.76:0/173992368 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f005c19cd50 con 0x7f005c101990 2024-06-02T05:00:38.935 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.933+0000 7f0062f57700 1 -- 172.21.15.76:0/173992368 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f005c19d1b0 con 0x7f005c101990 2024-06-02T05:00:38.938 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.937+0000 7f0051ffb700 1 -- 172.21.15.76:0/173992368 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f0054007730 con 0x7f005c101990 2024-06-02T05:00:38.940 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.939+0000 7f0051ffb700 1 --2- 172.21.15.76:0/173992368 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f00440b21b0 0x7f00440b4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:00:38.941 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.939+0000 7f006f112b80 1 Processor -- start 2024-06-02T05:00:38.941 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.939+0000 7f0051ffb700 1 -- 172.21.15.76:0/173992368 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f0054006e40 con 0x7f005c101990 2024-06-02T05:00:38.941 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.939+0000 7f006f112b80 1 -- start start 2024-06-02T05:00:38.941 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.939+0000 7f006f112b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56109e41fa80 0x56109e41fea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:00:38.942 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.940+0000 7f006f112b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56109e4203e0 0x56109e420cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:00:38.942 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.940+0000 7f006f112b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56109e4212d0 0x56109e421750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:00:38.942 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.940+0000 7f006f112b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x56109e3770f0 con 0x56109e41fa80 2024-06-02T05:00:38.942 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.940+0000 7f006f112b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x56109e374ab0 con 0x56109e4203e0 2024-06-02T05:00:38.942 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.940+0000 7f006f112b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x56109e3703a0 con 0x56109e4212d0 2024-06-02T05:00:38.942 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.941+0000 7f0060cf3700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56109e41fa80 0x56109e41fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:00:38.943 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.941+0000 7f0060cf3700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56109e41fa80 0x56109e41fea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:37624/0 (socket says 172.21.15.76:37624) 2024-06-02T05:00:38.943 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.941+0000 7f0060cf3700 1 -- 172.21.15.76:0/2189273816 learned_addr learned my addr 172.21.15.76:0/2189273816 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:00:38.943 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.941+0000 7f0060cf3700 1 --2- 172.21.15.76:0/173992368 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f00440b21b0 0x7f00440b4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:00:38.943 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.942+0000 7f0060cf3700 1 -- 172.21.15.76:0/2189273816 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56109e4212d0 msgr2=0x56109e421750 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-02T05:00:38.944 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.942+0000 7f0060cf3700 1 --2- 172.21.15.76:0/2189273816 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56109e4212d0 0x56109e421750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:38.944 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.942+0000 7f0060cf3700 1 -- 172.21.15.76:0/2189273816 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56109e4203e0 msgr2=0x56109e420cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:00:38.944 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.942+0000 7f0060cf3700 1 --2- 172.21.15.76:0/2189273816 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56109e4203e0 0x56109e420cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:38.944 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.942+0000 7f0060cf3700 1 -- 172.21.15.76:0/2189273816 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56109e1f1350 con 0x56109e41fa80 2024-06-02T05:00:38.944 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.943+0000 7f0060cf3700 1 --2- 172.21.15.76:0/2189273816 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56109e41fa80 0x56109e41fea0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f004c013b40 tx=0x7f004c013e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bc17c6368963391 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:00:38.944 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.943+0000 7f0060cf3700 1 --2- 172.21.15.76:0/173992368 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f00440b21b0 0x7f00440b4670 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f004c010650 tx=0x7f004c015000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:00:38.945 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.943+0000 7f0042ffd700 1 -- 172.21.15.76:0/2189273816 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f004c010e80 con 0x56109e41fa80 2024-06-02T05:00:38.945 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.943+0000 7f0042ffd700 1 -- 172.21.15.76:0/2189273816 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f004c019040 con 0x56109e41fa80 2024-06-02T05:00:38.945 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.943+0000 7f0042ffd700 1 -- 172.21.15.76:0/2189273816 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f004c005350 con 0x56109e41fa80 2024-06-02T05:00:38.945 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.944+0000 7f006f112b80 1 -- 172.21.15.76:0/2189273816 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56109e41fa80 msgr2=0x56109e41fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:00:38.946 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.944+0000 7f006f112b80 1 --2- 172.21.15.76:0/2189273816 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56109e41fa80 0x56109e41fea0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f004c013b40 tx=0x7f004c013e50 comp rx=0 tx=0).stop 2024-06-02T05:00:38.948 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.947+0000 7f006f112b80 1 -- 172.21.15.76:0/2189273816 shutdown_connections 2024-06-02T05:00:38.948 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.947+0000 7f006f112b80 1 --2- 172.21.15.76:0/2189273816 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56109e4212d0 0x56109e421750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:38.948 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.947+0000 7f006f112b80 1 --2- 172.21.15.76:0/2189273816 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56109e41fa80 0x56109e41fea0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:38.948 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.947+0000 7f006f112b80 1 --2- 172.21.15.76:0/2189273816 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56109e4203e0 0x56109e420cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:38.948 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.947+0000 7f006f112b80 1 -- 172.21.15.76:0/2189273816 >> 172.21.15.76:0/2189273816 conn(0x56109e37e1b0 msgr2=0x56109e41c440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:00:38.949 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.947+0000 7f006f112b80 1 -- 172.21.15.76:0/2189273816 shutdown_connections 2024-06-02T05:00:38.949 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.947+0000 7f006f112b80 1 -- 172.21.15.76:0/2189273816 wait complete. 2024-06-02T05:00:38.949 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.948+0000 7f006f112b80 1 -- start start 2024-06-02T05:00:38.949 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.948+0000 7f006f112b80 1 Processor -- start 2024-06-02T05:00:38.950 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.949+0000 7f006f112b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56109e41fa80 0x56109e4299c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:00:38.950 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.949+0000 7f006f112b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56109e4203e0 0x56109e429f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:00:38.950 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.949+0000 7f006f112b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56109e4212d0 0x56109e430f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:00:38.950 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.949+0000 7f006f112b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x56109e30c500 con 0x56109e4203e0 2024-06-02T05:00:38.950 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.949+0000 7f006f112b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x56109e30c1a0 con 0x56109e4212d0 2024-06-02T05:00:38.951 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.949+0000 7f006f112b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x56109e1f3640 con 0x56109e41fa80 2024-06-02T05:00:38.951 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.949+0000 7f006f112b80 10 client.0 _ll_register_callbacks cb 0x56109e315ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T05:00:38.952 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.949+0000 7f0060cf3700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56109e41fa80 0x56109e4299c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:00:38.952 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.949+0000 7f0060cf3700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56109e41fa80 0x56109e4299c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:36684/0 (socket says 172.21.15.76:36684) 2024-06-02T05:00:38.952 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.949+0000 7f0060cf3700 1 -- 172.21.15.76:0/1670205543 learned_addr learned my addr 172.21.15.76:0/1670205543 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:00:38.952 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.949+0000 7f00614f4700 1 --2- 172.21.15.76:0/1670205543 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56109e4212d0 0x56109e430f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:00:38.952 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.949+0000 7f0053fff700 1 --2- 172.21.15.76:0/1670205543 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56109e4203e0 0x56109e429f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:00:38.952 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.950+0000 7f0053fff700 1 -- 172.21.15.76:0/1670205543 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56109e41fa80 msgr2=0x56109e4299c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:00:38.952 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.950+0000 7f0053fff700 1 --2- 172.21.15.76:0/1670205543 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56109e41fa80 0x56109e4299c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:38.952 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.950+0000 7f0053fff700 1 -- 172.21.15.76:0/1670205543 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56109e4212d0 msgr2=0x56109e430f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:00:38.952 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.950+0000 7f0053fff700 1 --2- 172.21.15.76:0/1670205543 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56109e4212d0 0x56109e430f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:38.952 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.950+0000 7f0053fff700 1 -- 172.21.15.76:0/1670205543 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f004c013720 con 0x56109e4203e0 2024-06-02T05:00:38.952 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.950+0000 7f00614f4700 1 --2- 172.21.15.76:0/1670205543 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56109e4212d0 0x56109e430f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T05:00:38.953 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.950+0000 7f0053fff700 1 --2- 172.21.15.76:0/1670205543 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56109e4203e0 0x56109e429f00 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f005800b580 tx=0x7f0058005f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d269111d96247358 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:00:38.953 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.950+0000 7f003bfff700 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-06-02T05:00:38.953 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.950+0000 7f003bfff700 1 -- 172.21.15.76:0/1670205543 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0058005450 con 0x56109e4203e0 2024-06-02T05:00:38.954 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.950+0000 7f003bfff700 1 -- 172.21.15.76:0/1670205543 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f00580055b0 con 0x56109e4203e0 2024-06-02T05:00:38.954 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.950+0000 7f006f112b80 1 -- 172.21.15.76:0/1670205543 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56109e2c9210 con 0x56109e4203e0 2024-06-02T05:00:38.954 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.951+0000 7f003bfff700 1 -- 172.21.15.76:0/1670205543 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0058004500 con 0x56109e4203e0 2024-06-02T05:00:38.954 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.951+0000 7f006f112b80 10 client.16422 fetch_fsmap learned FSMap version 36 2024-06-02T05:00:38.954 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.951+0000 7f006f112b80 1 -- 172.21.15.76:0/1670205543 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x56109e19db00 con 0x56109e4203e0 2024-06-02T05:00:38.954 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.951+0000 7f003bfff700 1 -- 172.21.15.76:0/1670205543 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56109e2c9210 con 0x56109e4203e0 2024-06-02T05:00:38.954 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.952+0000 7f003bfff700 1 -- 172.21.15.76:0/1670205543 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f0058004660 con 0x56109e4203e0 2024-06-02T05:00:38.955 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.952+0000 7f006f112b80 10 client.16422 fetch_fsmap finished waiting for FSMap version 36 2024-06-02T05:00:38.955 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.952+0000 7f006f112b80 10 client.16422 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T05:00:38.955 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.952+0000 7f006f112b80 20 client.16422 populate_metadata read hostname 'smithi076' 2024-06-02T05:00:38.955 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.952+0000 7f006f112b80 1 --2- 172.21.15.76:0/1670205543 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x56109e435780 0x56109e437ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:00:38.955 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.952+0000 7f006f112b80 4 client.16422 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T05:00:38.955 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.952+0000 7f006f112b80 1 -- 172.21.15.76:0/1670205543 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56109e3ef7b0 con 0x56109e435780 2024-06-02T05:00:38.955 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.953+0000 7f0060cf3700 1 --2- 172.21.15.76:0/1670205543 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x56109e435780 0x56109e437ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:00:38.955 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.953+0000 7f0060cf3700 1 --2- 172.21.15.76:0/1670205543 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x56109e435780 0x56109e437ba0 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4a920bd9ca490c75 server_cookie=c615f00ffc32f04d in_seq=0 out_seq=0 2024-06-02T05:00:38.959 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.958+0000 7f003bfff700 10 client.16422 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T05:00:38.959 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.958+0000 7f003bfff700 1 -- 172.21.15.76:0/1670205543 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56109e3ef7b0 con 0x56109e435780 2024-06-02T05:00:38.959 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.958+0000 7f003bfff700 10 client.16422 handle_command_reply: tid=0 2024-06-02T05:00:38.959 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.958+0000 7f006f112b80 1 client.16422 shutdown 2024-06-02T05:00:38.960 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.958+0000 7f006f112b80 1 -- 172.21.15.76:0/1670205543 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56109e4203e0 msgr2=0x56109e429f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:00:38.960 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.958+0000 7f006f112b80 1 --2- 172.21.15.76:0/1670205543 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56109e4203e0 0x56109e429f00 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f005800b580 tx=0x7f0058005f00 comp rx=0 tx=0).stop 2024-06-02T05:00:38.960 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.958+0000 7f006f112b80 1 -- 172.21.15.76:0/1670205543 shutdown_connections 2024-06-02T05:00:38.960 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.958+0000 7f006f112b80 1 --2- 172.21.15.76:0/1670205543 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x56109e435780 0x56109e437ba0 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:38.960 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.958+0000 7f006f112b80 1 --2- 172.21.15.76:0/1670205543 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56109e4212d0 0x56109e430f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:38.961 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.958+0000 7f006f112b80 1 --2- 172.21.15.76:0/1670205543 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56109e41fa80 0x56109e4299c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:38.961 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.958+0000 7f006f112b80 1 --2- 172.21.15.76:0/1670205543 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56109e4203e0 0x56109e429f00 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:38.961 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.958+0000 7f006f112b80 1 -- 172.21.15.76:0/1670205543 >> 172.21.15.76:0/1670205543 conn(0x56109e37e1b0 msgr2=0x56109e41a860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:00:38.961 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.958+0000 7f003bfff700 0 client.16422 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T05:00:38.961 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.958+0000 7f006f112b80 1 -- 172.21.15.76:0/1670205543 shutdown_connections 2024-06-02T05:00:38.961 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.958+0000 7f006f112b80 1 -- 172.21.15.76:0/1670205543 wait complete. 2024-06-02T05:00:38.961 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.959+0000 7f006f112b80 20 client.16422 trim_cache size 0 max 16384 2024-06-02T05:00:38.982 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.980+0000 7f006f112b80 1 Processor -- start 2024-06-02T05:00:38.986 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.984+0000 7f006f112b80 1 -- start start 2024-06-02T05:00:38.986 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.984+0000 7f006f112b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56109e41fa80 0x56109e427930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:00:38.986 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.984+0000 7f006f112b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56109e4212d0 0x56109e430e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:00:38.986 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.984+0000 7f006f112b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56109e43c4c0 0x56109e43c940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:00:38.986 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.984+0000 7f006f112b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x56109e4179b0 con 0x56109e41fa80 2024-06-02T05:00:38.986 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.984+0000 7f006f112b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x56109e4207c0 con 0x56109e4212d0 2024-06-02T05:00:38.986 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.984+0000 7f006f112b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x56109e4320c0 con 0x56109e43c4c0 2024-06-02T05:00:38.986 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.984+0000 7f0060cf3700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56109e41fa80 0x56109e427930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:00:38.986 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.984+0000 7f0060cf3700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56109e41fa80 0x56109e427930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:37652/0 (socket says 172.21.15.76:37652) 2024-06-02T05:00:38.986 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.984+0000 7f0060cf3700 1 -- 172.21.15.76:0/2397376860 learned_addr learned my addr 172.21.15.76:0/2397376860 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:00:38.987 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.984+0000 7f0053fff700 1 --2- 172.21.15.76:0/2397376860 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56109e4212d0 0x56109e430e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:00:38.987 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.984+0000 7f00614f4700 1 --2- 172.21.15.76:0/2397376860 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56109e43c4c0 0x56109e43c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:00:38.987 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.985+0000 7f00614f4700 1 -- 172.21.15.76:0/2397376860 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56109e4212d0 msgr2=0x56109e430e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:00:38.987 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.985+0000 7f00614f4700 1 --2- 172.21.15.76:0/2397376860 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56109e4212d0 0x56109e430e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:38.987 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.985+0000 7f00614f4700 1 -- 172.21.15.76:0/2397376860 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56109e41fa80 msgr2=0x56109e427930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:00:38.987 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.985+0000 7f00614f4700 1 --2- 172.21.15.76:0/2397376860 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56109e41fa80 0x56109e427930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:38.987 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.985+0000 7f00614f4700 1 -- 172.21.15.76:0/2397376860 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56109e336500 con 0x56109e43c4c0 2024-06-02T05:00:38.991 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.988+0000 7f00614f4700 1 --2- 172.21.15.76:0/2397376860 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56109e43c4c0 0x56109e43c940 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f00540ca000 tx=0x7f0054096140 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cbeab60d8d04ea0f server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:00:38.991 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.988+0000 7f00437fe700 1 -- 172.21.15.76:0/2397376860 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00540987e0 con 0x56109e43c4c0 2024-06-02T05:00:38.991 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.988+0000 7f00437fe700 1 -- 172.21.15.76:0/2397376860 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0054085070 con 0x56109e43c4c0 2024-06-02T05:00:38.991 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.988+0000 7f00437fe700 1 -- 172.21.15.76:0/2397376860 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0054014810 con 0x56109e43c4c0 2024-06-02T05:00:38.991 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.989+0000 7f006f112b80 1 -- 172.21.15.76:0/2397376860 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56109e43c4c0 msgr2=0x56109e43c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:00:38.991 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.989+0000 7f006f112b80 1 --2- 172.21.15.76:0/2397376860 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56109e43c4c0 0x56109e43c940 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f00540ca000 tx=0x7f0054096140 comp rx=0 tx=0).stop 2024-06-02T05:00:38.991 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.989+0000 7f006f112b80 1 -- 172.21.15.76:0/2397376860 shutdown_connections 2024-06-02T05:00:38.992 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.989+0000 7f006f112b80 1 --2- 172.21.15.76:0/2397376860 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56109e43c4c0 0x56109e43c940 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:38.992 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.989+0000 7f006f112b80 1 --2- 172.21.15.76:0/2397376860 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56109e41fa80 0x56109e427930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:38.992 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.989+0000 7f006f112b80 1 --2- 172.21.15.76:0/2397376860 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56109e4212d0 0x56109e430e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:38.992 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.989+0000 7f006f112b80 1 -- 172.21.15.76:0/2397376860 >> 172.21.15.76:0/2397376860 conn(0x56109e37e1b0 msgr2=0x56109e424510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:00:38.992 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.989+0000 7f006f112b80 1 -- 172.21.15.76:0/2397376860 shutdown_connections 2024-06-02T05:00:38.992 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.989+0000 7f006f112b80 1 -- 172.21.15.76:0/2397376860 wait complete. 2024-06-02T05:00:38.993 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.990+0000 7f006f112b80 1 -- start start 2024-06-02T05:00:38.993 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.990+0000 7f006f112b80 1 Processor -- start 2024-06-02T05:00:38.993 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.990+0000 7f006f112b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56109e41fa80 0x56109e42e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:00:38.993 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.990+0000 7f006f112b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56109e4212d0 0x56109e42ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:00:38.993 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.991+0000 7f006f112b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56109e43c4c0 0x56109e42fa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:00:38.993 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.991+0000 7f006f112b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x56109e42ffa0 con 0x56109e43c4c0 2024-06-02T05:00:38.993 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.991+0000 7f006f112b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x56109e430110 con 0x56109e41fa80 2024-06-02T05:00:38.993 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.991+0000 7f006f112b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x56109e4302d0 con 0x56109e4212d0 2024-06-02T05:00:38.993 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.991+0000 7f006f112b80 10 client.0 _ll_register_callbacks cb 0x56109e315ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T05:00:38.993 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.991+0000 7f0053fff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56109e4212d0 0x56109e42ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:00:38.993 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.991+0000 7f0053fff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56109e4212d0 0x56109e42ea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:36696/0 (socket says 172.21.15.76:36696) 2024-06-02T05:00:38.994 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.991+0000 7f0053fff700 1 -- 172.21.15.76:0/883815206 learned_addr learned my addr 172.21.15.76:0/883815206 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:00:38.994 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.991+0000 7f0060cf3700 1 --2- 172.21.15.76:0/883815206 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56109e41fa80 0x56109e42e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:00:38.994 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.991+0000 7f00614f4700 1 --2- 172.21.15.76:0/883815206 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56109e43c4c0 0x56109e42fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:00:38.996 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.992+0000 7f00614f4700 1 -- 172.21.15.76:0/883815206 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56109e4212d0 msgr2=0x56109e42ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:00:38.996 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.992+0000 7f00614f4700 1 --2- 172.21.15.76:0/883815206 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56109e4212d0 0x56109e42ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:38.996 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.992+0000 7f00614f4700 1 -- 172.21.15.76:0/883815206 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56109e41fa80 msgr2=0x56109e42e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:00:38.997 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.992+0000 7f00614f4700 1 --2- 172.21.15.76:0/883815206 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56109e41fa80 0x56109e42e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:38.997 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.992+0000 7f00614f4700 1 -- 172.21.15.76:0/883815206 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f005c19d1b0 con 0x56109e43c4c0 2024-06-02T05:00:38.997 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.992+0000 7f00614f4700 1 --2- 172.21.15.76:0/883815206 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56109e43c4c0 0x56109e42fa60 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f0054004b10 tx=0x7f00540966e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=257f42d1f5fb7077 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:00:38.997 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.992+0000 7f003bfff700 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-06-02T05:00:38.997 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.992+0000 7f003bfff700 1 -- 172.21.15.76:0/883815206 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00540145b0 con 0x56109e43c4c0 2024-06-02T05:00:38.997 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.992+0000 7f003bfff700 1 -- 172.21.15.76:0/883815206 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f0054014710 con 0x56109e43c4c0 2024-06-02T05:00:38.997 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.992+0000 7f006f112b80 1 -- 172.21.15.76:0/883815206 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f004c019040 con 0x56109e43c4c0 2024-06-02T05:00:38.997 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.992+0000 7f003bfff700 1 -- 172.21.15.76:0/883815206 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f00540148d0 con 0x56109e43c4c0 2024-06-02T05:00:38.997 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.992+0000 7f006f112b80 10 client.16428 fetch_fsmap learned FSMap version 36 2024-06-02T05:00:38.997 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.992+0000 7f006f112b80 1 -- 172.21.15.76:0/883815206 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x56109e1f5c70 con 0x56109e43c4c0 2024-06-02T05:00:38.997 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.993+0000 7f003bfff700 1 -- 172.21.15.76:0/883815206 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f004c019040 con 0x56109e43c4c0 2024-06-02T05:00:38.997 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.993+0000 7f003bfff700 1 -- 172.21.15.76:0/883815206 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f005409d310 con 0x56109e43c4c0 2024-06-02T05:00:38.997 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.993+0000 7f006f112b80 10 client.16428 fetch_fsmap finished waiting for FSMap version 36 2024-06-02T05:00:38.998 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.993+0000 7f006f112b80 10 client.16428 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T05:00:38.998 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.993+0000 7f006f112b80 20 client.16428 populate_metadata read hostname 'smithi076' 2024-06-02T05:00:38.998 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.993+0000 7f006f112b80 1 --2- 172.21.15.76:0/883815206 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x56109e48c100 0x56109e48e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:00:38.998 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.993+0000 7f006f112b80 4 client.16428 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T05:00:38.998 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.993+0000 7f006f112b80 1 -- 172.21.15.76:0/883815206 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x56109e368e60 con 0x56109e48c100 2024-06-02T05:00:38.998 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.995+0000 7f0060cf3700 1 --2- 172.21.15.76:0/883815206 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x56109e48c100 0x56109e48e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:00:38.998 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.995+0000 7f003bfff700 10 client.16428 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T05:00:38.998 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:38.996+0000 7f0060cf3700 1 --2- 172.21.15.76:0/883815206 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x56109e48c100 0x56109e48e550 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a4b8a58e1a33e01 server_cookie=7a9650b4dac1b94f in_seq=0 out_seq=0 2024-06-02T05:00:39.032 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:39.020+0000 7f003bfff700 1 -- 172.21.15.76:0/883815206 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x56109e368e60 con 0x56109e48c100 2024-06-02T05:00:39.032 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:39.020+0000 7f003bfff700 10 client.16428 handle_command_reply: tid=0 2024-06-02T05:00:39.032 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:39.021+0000 7f006f112b80 1 client.16428 shutdown 2024-06-02T05:00:39.032 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:39.024+0000 7f006f112b80 1 -- 172.21.15.76:0/883815206 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56109e43c4c0 msgr2=0x56109e42fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:00:39.032 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:39.024+0000 7f006f112b80 1 --2- 172.21.15.76:0/883815206 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56109e43c4c0 0x56109e42fa60 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f0054004b10 tx=0x7f00540966e0 comp rx=0 tx=0).stop 2024-06-02T05:00:39.033 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:39.025+0000 7f006f112b80 1 -- 172.21.15.76:0/883815206 shutdown_connections 2024-06-02T05:00:39.033 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:39.025+0000 7f006f112b80 1 --2- 172.21.15.76:0/883815206 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x56109e48c100 0x56109e48e550 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:39.033 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:39.025+0000 7f006f112b80 1 --2- 172.21.15.76:0/883815206 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56109e43c4c0 0x56109e42fa60 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:39.033 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:39.025+0000 7f006f112b80 1 --2- 172.21.15.76:0/883815206 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56109e41fa80 0x56109e42e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:39.033 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:39.025+0000 7f006f112b80 1 --2- 172.21.15.76:0/883815206 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56109e4212d0 0x56109e42ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:39.033 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:39.025+0000 7f006f112b80 1 -- 172.21.15.76:0/883815206 >> 172.21.15.76:0/883815206 conn(0x56109e37e1b0 msgr2=0x56109e41c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:00:39.033 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:39.025+0000 7f003bfff700 0 client.16428 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T05:00:39.033 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:39.025+0000 7f006f112b80 1 -- 172.21.15.76:0/883815206 shutdown_connections 2024-06-02T05:00:39.033 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:39.025+0000 7f006f112b80 1 -- 172.21.15.76:0/883815206 wait complete. 2024-06-02T05:00:39.033 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:39.028+0000 7f006f112b80 20 client.16428 trim_cache size 0 max 16384 2024-06-02T05:00:39.037 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:{ 2024-06-02T05:00:39.037 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "message": "", 2024-06-02T05:00:39.037 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "return_code": 0 2024-06-02T05:00:39.037 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:} 2024-06-02T05:00:39.043 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:39.041+0000 7f0062f57700 1 -- 172.21.15.76:0/173992368 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f00440b21b0 msgr2=0x7f00440b4670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:00:39.043 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:39.041+0000 7f0062f57700 1 --2- 172.21.15.76:0/173992368 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f00440b21b0 0x7f00440b4670 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f004c010650 tx=0x7f004c015000 comp rx=0 tx=0).stop 2024-06-02T05:00:39.043 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:39.041+0000 7f0062f57700 1 -- 172.21.15.76:0/173992368 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f005c101990 msgr2=0x7f005c19c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:00:39.043 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:39.041+0000 7f0062f57700 1 --2- 172.21.15.76:0/173992368 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f005c101990 0x7f005c19c330 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f005400b970 tx=0x7f005400bd30 comp rx=0 tx=0).stop 2024-06-02T05:00:39.043 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:39.041+0000 7f0062f57700 1 -- 172.21.15.76:0/173992368 shutdown_connections 2024-06-02T05:00:39.043 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:39.041+0000 7f0062f57700 1 --2- 172.21.15.76:0/173992368 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f005c101990 0x7f005c19c330 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:39.043 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:39.041+0000 7f0062f57700 1 --2- 172.21.15.76:0/173992368 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f00440b21b0 0x7f00440b4670 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:39.043 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:39.041+0000 7f0062f57700 1 --2- 172.21.15.76:0/173992368 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f005c0ffe00 0x7f005c1070f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:39.043 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:39.041+0000 7f0062f57700 1 --2- 172.21.15.76:0/173992368 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f005c100ff0 0x7f005c107630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:39.044 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:39.041+0000 7f0062f57700 1 -- 172.21.15.76:0/173992368 >> 172.21.15.76:0/173992368 conn(0x7f005c0fb390 msgr2=0x7f005c068330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:00:39.044 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:39.043+0000 7f0062f57700 1 -- 172.21.15.76:0/173992368 shutdown_connections 2024-06-02T05:00:39.044 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:39.043+0000 7f0062f57700 1 -- 172.21.15.76:0/173992368 wait complete. 2024-06-02T05:00:39.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:00:39 smithi192 ceph-mon[47933]: pgmap v600: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 8.7 MiB/s wr, 761 op/s 2024-06-02T05:00:39.986 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:00:39 smithi076 ceph-mon[42935]: pgmap v600: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 8.7 MiB/s wr, 761 op/s 2024-06-02T05:00:40.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:00:39 smithi119 ceph-mon[46633]: pgmap v600: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 8.7 MiB/s wr, 761 op/s 2024-06-02T05:00:40.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:00:40 smithi192 ceph-mon[47933]: pgmap v601: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 9.2 MiB/s wr, 815 op/s 2024-06-02T05:00:40.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:00:40 smithi076 ceph-mon[42935]: pgmap v601: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 9.2 MiB/s wr, 815 op/s 2024-06-02T05:00:41.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:00:40 smithi119 ceph-mon[46633]: pgmap v601: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 9.2 MiB/s wr, 815 op/s 2024-06-02T05:00:41.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 590.0 s, 586.4 tps, lat 170.642 ms stddev 79.983 2024-06-02T05:00:43.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:00:43 smithi192 ceph-mon[47933]: pgmap v602: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 8.6 MiB/s wr, 778 op/s 2024-06-02T05:00:43.985 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:00:43 smithi076 ceph-mon[42935]: pgmap v602: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 8.6 MiB/s wr, 778 op/s 2024-06-02T05:00:44.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:00:43 smithi119 ceph-mon[46633]: pgmap v602: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 8.6 MiB/s wr, 778 op/s 2024-06-02T05:00:45.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:00:45 smithi192 ceph-mon[47933]: pgmap v603: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 8.0 MiB/s wr, 681 op/s 2024-06-02T05:00:45.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:00:45 smithi076 ceph-mon[42935]: pgmap v603: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 8.0 MiB/s wr, 681 op/s 2024-06-02T05:00:46.097 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:00:45 smithi119 ceph-mon[46633]: pgmap v603: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 8.0 MiB/s wr, 681 op/s 2024-06-02T05:00:46.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 595.0 s, 619.0 tps, lat 162.714 ms stddev 77.127 2024-06-02T05:00:47.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:00:47 smithi192 ceph-mon[47933]: pgmap v604: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 8.7 MiB/s wr, 766 op/s 2024-06-02T05:00:47.986 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:00:47 smithi076 ceph-mon[42935]: pgmap v604: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 8.7 MiB/s wr, 766 op/s 2024-06-02T05:00:48.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:00:47 smithi119 ceph-mon[46633]: pgmap v604: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 8.7 MiB/s wr, 766 op/s 2024-06-02T05:00:49.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:00:49 smithi192 ceph-mon[47933]: pgmap v605: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 9.7 MiB/s wr, 711 op/s 2024-06-02T05:00:49.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:00:49 smithi076 ceph-mon[42935]: pgmap v605: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 9.7 MiB/s wr, 711 op/s 2024-06-02T05:00:50.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:00:49 smithi119 ceph-mon[46633]: pgmap v605: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 9.7 MiB/s wr, 711 op/s 2024-06-02T05:00:51.316 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 600.0 s, 681.0 tps, lat 147.185 ms stddev 57.700 2024-06-02T05:00:51.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:00:51 smithi192 ceph-mon[47933]: pgmap v606: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 12 MiB/s wr, 789 op/s 2024-06-02T05:00:51.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:00:51 smithi076 ceph-mon[42935]: pgmap v606: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 12 MiB/s wr, 789 op/s 2024-06-02T05:00:52.097 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:00:51 smithi119 ceph-mon[46633]: pgmap v606: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 12 MiB/s wr, 789 op/s 2024-06-02T05:00:52.221 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.220+0000 7f6b6ef11700 1 -- 172.21.15.76:0/2954180513 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b68107540 msgr2=0x7f6b68107960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:00:52.221 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.220+0000 7f6b6ef11700 1 --2- 172.21.15.76:0/2954180513 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b68107540 0x7f6b68107960 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c0099c0 tx=0x7f6b5c009cd0 comp rx=0 tx=0).stop 2024-06-02T05:00:52.223 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.222+0000 7f6b6ef11700 1 -- 172.21.15.76:0/2954180513 shutdown_connections 2024-06-02T05:00:52.223 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.222+0000 7f6b6ef11700 1 --2- 172.21.15.76:0/2954180513 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6b681090d0 0x7f6b6810f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:52.223 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.222+0000 7f6b6ef11700 1 --2- 172.21.15.76:0/2954180513 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b68107540 0x7f6b68107960 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:52.223 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.222+0000 7f6b6ef11700 1 --2- 172.21.15.76:0/2954180513 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6b68108730 0x7f6b68108b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:52.223 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.222+0000 7f6b6ef11700 1 -- 172.21.15.76:0/2954180513 >> 172.21.15.76:0/2954180513 conn(0x7f6b680764d0 msgr2=0x7f6b68078910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:00:52.223 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.222+0000 7f6b6ef11700 1 -- 172.21.15.76:0/2954180513 shutdown_connections 2024-06-02T05:00:52.225 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.222+0000 7f6b6ef11700 1 -- 172.21.15.76:0/2954180513 wait complete. 2024-06-02T05:00:52.225 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.223+0000 7f6b6ef11700 1 Processor -- start 2024-06-02T05:00:52.225 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.223+0000 7f6b6ef11700 1 -- start start 2024-06-02T05:00:52.225 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.223+0000 7f6b6ef11700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6b68107540 0x7f6b6807e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:00:52.225 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.223+0000 7f6b6ef11700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6b68108730 0x7f6b6807ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:00:52.225 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.223+0000 7f6b6ef11700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b681090d0 0x7f6b681ad500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:00:52.226 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.223+0000 7f6b6ef11700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b68081d10 con 0x7f6b68107540 2024-06-02T05:00:52.226 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.223+0000 7f6b6ef11700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b68081e50 con 0x7f6b681090d0 2024-06-02T05:00:52.226 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.223+0000 7f6b6ef11700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6806a9c0 con 0x7f6b68108730 2024-06-02T05:00:52.226 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.224+0000 7f6b6d4ae700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b681090d0 0x7f6b681ad500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:00:52.226 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.224+0000 7f6b6d4ae700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b681090d0 0x7f6b681ad500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:57142/0 (socket says 172.21.15.76:57142) 2024-06-02T05:00:52.226 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.224+0000 7f6b6d4ae700 1 -- 172.21.15.76:0/2130201953 learned_addr learned my addr 172.21.15.76:0/2130201953 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:00:52.226 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.224+0000 7f6b67fff700 1 --2- 172.21.15.76:0/2130201953 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6b68108730 0x7f6b6807ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:00:52.226 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.224+0000 7f6b6ccad700 1 --2- 172.21.15.76:0/2130201953 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6b68107540 0x7f6b6807e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:00:52.226 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.224+0000 7f6b6d4ae700 1 -- 172.21.15.76:0/2130201953 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6b68108730 msgr2=0x7f6b6807ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:00:52.226 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.224+0000 7f6b6d4ae700 1 --2- 172.21.15.76:0/2130201953 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6b68108730 0x7f6b6807ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:52.226 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.224+0000 7f6b6d4ae700 1 -- 172.21.15.76:0/2130201953 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6b68107540 msgr2=0x7f6b6807e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:00:52.227 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.224+0000 7f6b6d4ae700 1 --2- 172.21.15.76:0/2130201953 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6b68107540 0x7f6b6807e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:52.227 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.224+0000 7f6b6d4ae700 1 -- 172.21.15.76:0/2130201953 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b5c0095f0 con 0x7f6b681090d0 2024-06-02T05:00:52.227 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.224+0000 7f6b6d4ae700 1 --2- 172.21.15.76:0/2130201953 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b681090d0 0x7f6b681ad500 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6b6000ef30 tx=0x7f6b6000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:00:52.227 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.224+0000 7f6b65ffb700 1 -- 172.21.15.76:0/2130201953 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b60018070 con 0x7f6b681090d0 2024-06-02T05:00:52.227 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.225+0000 7f6b65ffb700 1 -- 172.21.15.76:0/2130201953 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6b6000f040 con 0x7f6b681090d0 2024-06-02T05:00:52.227 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.225+0000 7f6b6ef11700 1 -- 172.21.15.76:0/2130201953 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b6806ac40 con 0x7f6b681090d0 2024-06-02T05:00:52.227 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.225+0000 7f6b65ffb700 1 -- 172.21.15.76:0/2130201953 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b6000cc70 con 0x7f6b681090d0 2024-06-02T05:00:52.227 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.225+0000 7f6b6ef11700 1 -- 172.21.15.76:0/2130201953 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b6806b150 con 0x7f6b681090d0 2024-06-02T05:00:52.228 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.227+0000 7f6b65ffb700 1 -- 172.21.15.76:0/2130201953 <== mon.2 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f6b60007500 con 0x7f6b681090d0 2024-06-02T05:00:52.229 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.228+0000 7f6b65ffb700 1 --2- 172.21.15.76:0/2130201953 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f6b580a11a0 0x7f6b580a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:00:52.229 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.228+0000 7f6b65ffb700 1 -- 172.21.15.76:0/2130201953 <== mon.2 v2:172.21.15.119:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f6b600cc750 con 0x7f6b681090d0 2024-06-02T05:00:52.229 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.229+0000 7f6b7b0ccb80 1 Processor -- start 2024-06-02T05:00:52.232 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.231+0000 7f6b6ccad700 1 --2- 172.21.15.76:0/2130201953 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f6b580a11a0 0x7f6b580a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:00:52.232 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.231+0000 7f6b7b0ccb80 1 -- start start 2024-06-02T05:00:52.232 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.231+0000 7f6b7b0ccb80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55def98daa80 0x55def98daea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:00:52.232 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.231+0000 7f6b7b0ccb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55def98db3e0 0x55def98dbcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:00:52.232 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.231+0000 7f6b7b0ccb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55def98dc2d0 0x55def98dc750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:00:52.232 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.231+0000 7f6b7b0ccb80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55def98320f0 con 0x55def98daa80 2024-06-02T05:00:52.233 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.231+0000 7f6b7b0ccb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55def982fab0 con 0x55def98db3e0 2024-06-02T05:00:52.233 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.231+0000 7f6b7b0ccb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55def982b3a0 con 0x55def98dc2d0 2024-06-02T05:00:52.234 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.232+0000 7f6b6d4ae700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55def98dc2d0 0x55def98dc750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:00:52.234 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.232+0000 7f6b6ccad700 1 --2- 172.21.15.76:0/2130201953 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f6b580a11a0 0x7f6b580a3660 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c009990 tx=0x7f6b5c00b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:00:52.234 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.232+0000 7f6b67fff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55def98db3e0 0x55def98dbcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:00:52.234 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.232+0000 7f6b67fff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55def98db3e0 0x55def98dbcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:51244/0 (socket says 172.21.15.76:51244) 2024-06-02T05:00:52.234 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.232+0000 7f6b67fff700 1 -- 172.21.15.76:0/452773754 learned_addr learned my addr 172.21.15.76:0/452773754 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:00:52.234 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.233+0000 7f6b67fff700 1 -- 172.21.15.76:0/452773754 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55def98dc2d0 msgr2=0x55def98dc750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:00:52.234 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.233+0000 7f6b67fff700 1 --2- 172.21.15.76:0/452773754 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55def98dc2d0 0x55def98dc750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:52.234 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.233+0000 7f6b67fff700 1 -- 172.21.15.76:0/452773754 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55def98daa80 msgr2=0x55def98daea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:00:52.234 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.233+0000 7f6b67fff700 1 --2- 172.21.15.76:0/452773754 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55def98daa80 0x55def98daea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:52.235 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.233+0000 7f6b67fff700 1 -- 172.21.15.76:0/452773754 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55def96ac350 con 0x55def98db3e0 2024-06-02T05:00:52.235 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.233+0000 7f6b67fff700 1 --2- 172.21.15.76:0/452773754 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55def98db3e0 0x55def98dbcf0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6b54009d80 tx=0x7f6b54011720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b223dbb457cda398 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:00:52.235 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.233+0000 7f6b52ffd700 1 -- 172.21.15.76:0/452773754 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b54004230 con 0x55def98db3e0 2024-06-02T05:00:52.235 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.234+0000 7f6b52ffd700 1 -- 172.21.15.76:0/452773754 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6b54004390 con 0x55def98db3e0 2024-06-02T05:00:52.235 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.234+0000 7f6b52ffd700 1 -- 172.21.15.76:0/452773754 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b54019800 con 0x55def98db3e0 2024-06-02T05:00:52.235 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.235+0000 7f6b7b0ccb80 1 -- 172.21.15.76:0/452773754 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55def98db3e0 msgr2=0x55def98dbcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:00:52.236 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.235+0000 7f6b7b0ccb80 1 --2- 172.21.15.76:0/452773754 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55def98db3e0 0x55def98dbcf0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6b54009d80 tx=0x7f6b54011720 comp rx=0 tx=0).stop 2024-06-02T05:00:52.238 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.236+0000 7f6b7b0ccb80 1 -- 172.21.15.76:0/452773754 shutdown_connections 2024-06-02T05:00:52.238 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.236+0000 7f6b7b0ccb80 1 --2- 172.21.15.76:0/452773754 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55def98dc2d0 0x55def98dc750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:52.238 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.236+0000 7f6b7b0ccb80 1 --2- 172.21.15.76:0/452773754 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55def98daa80 0x55def98daea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:52.238 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.236+0000 7f6b7b0ccb80 1 --2- 172.21.15.76:0/452773754 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55def98db3e0 0x55def98dbcf0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:52.239 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.236+0000 7f6b7b0ccb80 1 -- 172.21.15.76:0/452773754 >> 172.21.15.76:0/452773754 conn(0x55def98391b0 msgr2=0x55def98d7440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:00:52.239 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.239+0000 7f6b7b0ccb80 1 -- 172.21.15.76:0/452773754 shutdown_connections 2024-06-02T05:00:52.239 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.239+0000 7f6b7b0ccb80 1 -- 172.21.15.76:0/452773754 wait complete. 2024-06-02T05:00:52.240 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.239+0000 7f6b7b0ccb80 1 -- start start 2024-06-02T05:00:52.240 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.239+0000 7f6b7b0ccb80 1 Processor -- start 2024-06-02T05:00:52.241 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.240+0000 7f6b7b0ccb80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55def98daa80 0x55def98e48c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:00:52.241 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.240+0000 7f6b7b0ccb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55def98db3e0 0x55def98e4e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:00:52.241 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.240+0000 7f6b7b0ccb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55def98dc2d0 0x55def98ebe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:00:52.241 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.240+0000 7f6b7b0ccb80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55def97c7500 con 0x55def98daa80 2024-06-02T05:00:52.241 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.240+0000 7f6b7b0ccb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55def97c71a0 con 0x55def98dc2d0 2024-06-02T05:00:52.241 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.240+0000 7f6b7b0ccb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55def96ae640 con 0x55def98db3e0 2024-06-02T05:00:52.241 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.240+0000 7f6b7b0ccb80 10 client.0 _ll_register_callbacks cb 0x55def97d0ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T05:00:52.242 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.240+0000 7f6b67fff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55def98db3e0 0x55def98e4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:00:52.242 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.240+0000 7f6b67fff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55def98db3e0 0x55def98e4e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:41558/0 (socket says 172.21.15.76:41558) 2024-06-02T05:00:52.242 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.240+0000 7f6b67fff700 1 -- 172.21.15.76:0/55367774 learned_addr learned my addr 172.21.15.76:0/55367774 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:00:52.242 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.240+0000 7f6b6d4ae700 1 --2- 172.21.15.76:0/55367774 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55def98dc2d0 0x55def98ebe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:00:52.242 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.240+0000 7f6b6ccad700 1 --2- 172.21.15.76:0/55367774 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55def98daa80 0x55def98e48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:00:52.242 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.240+0000 7f6b67fff700 1 -- 172.21.15.76:0/55367774 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55def98dc2d0 msgr2=0x55def98ebe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:00:52.242 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.240+0000 7f6b67fff700 1 --2- 172.21.15.76:0/55367774 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55def98dc2d0 0x55def98ebe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:52.242 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.240+0000 7f6b67fff700 1 -- 172.21.15.76:0/55367774 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55def98daa80 msgr2=0x55def98e48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:00:52.242 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.240+0000 7f6b67fff700 1 --2- 172.21.15.76:0/55367774 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55def98daa80 0x55def98e48c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:52.242 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.240+0000 7f6b67fff700 1 -- 172.21.15.76:0/55367774 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b540099e0 con 0x55def98db3e0 2024-06-02T05:00:52.242 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.241+0000 7f6b67fff700 1 --2- 172.21.15.76:0/55367774 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55def98db3e0 0x55def98e4e00 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f6b54005c50 tx=0x7f6b540038b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3073275cee6eace1 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:00:52.243 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.241+0000 7f6b47fff700 10 client.0 ms_handle_connect on v2:172.21.15.192:3300/0 2024-06-02T05:00:52.244 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.241+0000 7f6b47fff700 1 -- 172.21.15.76:0/55367774 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b54005240 con 0x55def98db3e0 2024-06-02T05:00:52.244 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.241+0000 7f6b47fff700 1 -- 172.21.15.76:0/55367774 <== mon.1 v2:172.21.15.192:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f6b540053a0 con 0x55def98db3e0 2024-06-02T05:00:52.244 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.241+0000 7f6b7b0ccb80 1 -- 172.21.15.76:0/55367774 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55def9784210 con 0x55def98db3e0 2024-06-02T05:00:52.244 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.241+0000 7f6b47fff700 1 -- 172.21.15.76:0/55367774 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6b54009ed0 con 0x55def98db3e0 2024-06-02T05:00:52.244 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.241+0000 7f6b7b0ccb80 10 client.26011 fetch_fsmap learned FSMap version 36 2024-06-02T05:00:52.244 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.241+0000 7f6b7b0ccb80 1 -- 172.21.15.76:0/55367774 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55def9658b00 con 0x55def98db3e0 2024-06-02T05:00:52.244 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.241+0000 7f6b47fff700 1 -- 172.21.15.76:0/55367774 <== mon.1 v2:172.21.15.192:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55def9784210 con 0x55def98db3e0 2024-06-02T05:00:52.244 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.241+0000 7f6b47fff700 1 -- 172.21.15.76:0/55367774 <== mon.1 v2:172.21.15.192:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f6b54021040 con 0x55def98db3e0 2024-06-02T05:00:52.244 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.242+0000 7f6b7b0ccb80 10 client.26011 fetch_fsmap finished waiting for FSMap version 36 2024-06-02T05:00:52.244 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.242+0000 7f6b7b0ccb80 10 client.26011 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T05:00:52.244 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.242+0000 7f6b7b0ccb80 20 client.26011 populate_metadata read hostname 'smithi076' 2024-06-02T05:00:52.245 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.242+0000 7f6b7b0ccb80 1 --2- 172.21.15.76:0/55367774 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55def98f05f0 0x55def98f2a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:00:52.245 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.242+0000 7f6b7b0ccb80 4 client.26011 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T05:00:52.245 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.242+0000 7f6b7b0ccb80 1 -- 172.21.15.76:0/55367774 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55def98aa7b0 con 0x55def98f05f0 2024-06-02T05:00:52.245 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.242+0000 7f6b6ccad700 1 --2- 172.21.15.76:0/55367774 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55def98f05f0 0x55def98f2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:00:52.246 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.244+0000 7f6b47fff700 10 client.26011 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T05:00:52.246 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.244+0000 7f6b6ccad700 1 --2- 172.21.15.76:0/55367774 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55def98f05f0 0x55def98f2a10 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fe0891ebd129c8ee server_cookie=267721da14c301c5 in_seq=0 out_seq=0 2024-06-02T05:00:52.246 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.244+0000 7f6b47fff700 1 -- 172.21.15.76:0/55367774 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55def98aa7b0 con 0x55def98f05f0 2024-06-02T05:00:52.247 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.244+0000 7f6b47fff700 10 client.26011 handle_command_reply: tid=0 2024-06-02T05:00:52.247 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.245+0000 7f6b7b0ccb80 1 client.26011 shutdown 2024-06-02T05:00:52.247 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.245+0000 7f6b7b0ccb80 1 -- 172.21.15.76:0/55367774 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55def98db3e0 msgr2=0x55def98e4e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:00:52.247 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.245+0000 7f6b7b0ccb80 1 --2- 172.21.15.76:0/55367774 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55def98db3e0 0x55def98e4e00 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f6b54005c50 tx=0x7f6b540038b0 comp rx=0 tx=0).stop 2024-06-02T05:00:52.247 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.245+0000 7f6b7b0ccb80 1 -- 172.21.15.76:0/55367774 shutdown_connections 2024-06-02T05:00:52.247 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.245+0000 7f6b7b0ccb80 1 --2- 172.21.15.76:0/55367774 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55def98f05f0 0x55def98f2a10 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:52.247 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.245+0000 7f6b7b0ccb80 1 --2- 172.21.15.76:0/55367774 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55def98dc2d0 0x55def98ebe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:52.247 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.245+0000 7f6b7b0ccb80 1 --2- 172.21.15.76:0/55367774 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55def98daa80 0x55def98e48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:52.247 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.245+0000 7f6b7b0ccb80 1 --2- 172.21.15.76:0/55367774 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55def98db3e0 0x55def98e4e00 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:52.248 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.245+0000 7f6b47fff700 0 client.26011 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T05:00:52.248 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.245+0000 7f6b7b0ccb80 1 -- 172.21.15.76:0/55367774 >> 172.21.15.76:0/55367774 conn(0x55def98391b0 msgr2=0x55def98d5860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:00:52.248 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.245+0000 7f6b7b0ccb80 1 -- 172.21.15.76:0/55367774 shutdown_connections 2024-06-02T05:00:52.248 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.245+0000 7f6b7b0ccb80 1 -- 172.21.15.76:0/55367774 wait complete. 2024-06-02T05:00:52.248 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.245+0000 7f6b7b0ccb80 20 client.26011 trim_cache size 0 max 16384 2024-06-02T05:00:52.273 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.272+0000 7f6b7b0ccb80 1 Processor -- start 2024-06-02T05:00:52.273 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.272+0000 7f6b7b0ccb80 1 -- start start 2024-06-02T05:00:52.274 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.273+0000 7f6b7b0ccb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55def98daa80 0x55def98dae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:00:52.274 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.273+0000 7f6b7b0ccb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55def98db3e0 0x55def98e3e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:00:52.274 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.273+0000 7f6b7b0ccb80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55def98dc2d0 0x55def98ebe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:00:52.275 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.273+0000 7f6b7b0ccb80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55def98db7f0 con 0x55def98dc2d0 2024-06-02T05:00:52.275 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.273+0000 7f6b7b0ccb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55def98ecff0 con 0x55def98db3e0 2024-06-02T05:00:52.275 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.273+0000 7f6b7b0ccb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55def98e5ab0 con 0x55def98daa80 2024-06-02T05:00:52.275 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.273+0000 7f6b67fff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55def98db3e0 0x55def98e3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:00:52.275 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.273+0000 7f6b67fff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55def98db3e0 0x55def98e3e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:51262/0 (socket says 172.21.15.76:51262) 2024-06-02T05:00:52.275 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.273+0000 7f6b67fff700 1 -- 172.21.15.76:0/4202381691 learned_addr learned my addr 172.21.15.76:0/4202381691 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:00:52.275 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.273+0000 7f6b6ccad700 1 --2- 172.21.15.76:0/4202381691 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55def98daa80 0x55def98dae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:00:52.275 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.273+0000 7f6b67fff700 1 -- 172.21.15.76:0/4202381691 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55def98daa80 msgr2=0x55def98dae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:00:52.275 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.273+0000 7f6b67fff700 1 --2- 172.21.15.76:0/4202381691 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55def98daa80 0x55def98dae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:52.275 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.273+0000 7f6b67fff700 1 -- 172.21.15.76:0/4202381691 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55def98dc2d0 msgr2=0x55def98ebe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:00:52.275 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.273+0000 7f6b67fff700 1 --2- 172.21.15.76:0/4202381691 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55def98dc2d0 0x55def98ebe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:52.276 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.273+0000 7f6b67fff700 1 -- 172.21.15.76:0/4202381691 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55def97f1500 con 0x55def98db3e0 2024-06-02T05:00:52.276 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.274+0000 7f6b67fff700 1 --2- 172.21.15.76:0/4202381691 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55def98db3e0 0x55def98e3e40 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6b540092a0 tx=0x7f6b54003bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=284c964157075e6c server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:00:52.276 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.274+0000 7f6b537fe700 1 -- 172.21.15.76:0/4202381691 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b54003e50 con 0x55def98db3e0 2024-06-02T05:00:52.276 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.274+0000 7f6b537fe700 1 -- 172.21.15.76:0/4202381691 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6b54009ed0 con 0x55def98db3e0 2024-06-02T05:00:52.276 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.274+0000 7f6b537fe700 1 -- 172.21.15.76:0/4202381691 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b54005290 con 0x55def98db3e0 2024-06-02T05:00:52.278 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.275+0000 7f6b7b0ccb80 1 -- 172.21.15.76:0/4202381691 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55def98db3e0 msgr2=0x55def98e3e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:00:52.278 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.275+0000 7f6b7b0ccb80 1 --2- 172.21.15.76:0/4202381691 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55def98db3e0 0x55def98e3e40 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6b540092a0 tx=0x7f6b54003bb0 comp rx=0 tx=0).stop 2024-06-02T05:00:52.279 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.275+0000 7f6b7b0ccb80 1 -- 172.21.15.76:0/4202381691 shutdown_connections 2024-06-02T05:00:52.279 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.275+0000 7f6b7b0ccb80 1 --2- 172.21.15.76:0/4202381691 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55def98dc2d0 0x55def98ebe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:52.279 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.275+0000 7f6b7b0ccb80 1 --2- 172.21.15.76:0/4202381691 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55def98daa80 0x55def98dae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:52.279 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.275+0000 7f6b7b0ccb80 1 --2- 172.21.15.76:0/4202381691 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55def98db3e0 0x55def98e3e40 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:52.279 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.275+0000 7f6b7b0ccb80 1 -- 172.21.15.76:0/4202381691 >> 172.21.15.76:0/4202381691 conn(0x55def98391b0 msgr2=0x55def98e28a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:00:52.279 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.275+0000 7f6b7b0ccb80 1 -- 172.21.15.76:0/4202381691 shutdown_connections 2024-06-02T05:00:52.279 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.275+0000 7f6b7b0ccb80 1 -- 172.21.15.76:0/4202381691 wait complete. 2024-06-02T05:00:52.279 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.275+0000 7f6b7b0ccb80 1 -- start start 2024-06-02T05:00:52.279 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.275+0000 7f6b7b0ccb80 1 Processor -- start 2024-06-02T05:00:52.279 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.276+0000 7f6b7b0ccb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55def98daa80 0x55def98e9100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:00:52.279 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.276+0000 7f6b7b0ccb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55def98db3e0 0x55def98e9640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:00:52.279 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.276+0000 7f6b7b0ccb80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55def98dc2d0 0x55def98ea650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:00:52.280 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.276+0000 7f6b7b0ccb80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55def98eab90 con 0x55def98dc2d0 2024-06-02T05:00:52.280 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.276+0000 7f6b7b0ccb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55def98ead00 con 0x55def98db3e0 2024-06-02T05:00:52.280 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.276+0000 7f6b7b0ccb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55def98eaec0 con 0x55def98daa80 2024-06-02T05:00:52.280 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.276+0000 7f6b7b0ccb80 10 client.0 _ll_register_callbacks cb 0x55def97d0ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T05:00:52.280 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.276+0000 7f6b6ccad700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55def98daa80 0x55def98e9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:00:52.280 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.276+0000 7f6b6ccad700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55def98daa80 0x55def98e9100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:41576/0 (socket says 172.21.15.76:41576) 2024-06-02T05:00:52.280 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.276+0000 7f6b6ccad700 1 -- 172.21.15.76:0/3274651452 learned_addr learned my addr 172.21.15.76:0/3274651452 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:00:52.280 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.276+0000 7f6b67fff700 1 --2- 172.21.15.76:0/3274651452 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55def98db3e0 0x55def98e9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:00:52.280 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.276+0000 7f6b6ccad700 1 -- 172.21.15.76:0/3274651452 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55def98db3e0 msgr2=0x55def98e9640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:00:52.280 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.276+0000 7f6b6ccad700 1 --2- 172.21.15.76:0/3274651452 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55def98db3e0 0x55def98e9640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:52.280 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.276+0000 7f6b6d4ae700 1 --2- 172.21.15.76:0/3274651452 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55def98dc2d0 0x55def98ea650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:00:52.280 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.276+0000 7f6b6ccad700 1 -- 172.21.15.76:0/3274651452 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55def98dc2d0 msgr2=0x55def98ea650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:00:52.281 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.276+0000 7f6b6ccad700 1 --2- 172.21.15.76:0/3274651452 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55def98dc2d0 0x55def98ea650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:52.281 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.276+0000 7f6b6ccad700 1 -- 172.21.15.76:0/3274651452 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55def9658b00 con 0x55def98daa80 2024-06-02T05:00:52.281 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.276+0000 7f6b67fff700 1 --2- 172.21.15.76:0/3274651452 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55def98db3e0 0x55def98e9640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T05:00:52.281 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.276+0000 7f6b6d4ae700 1 --2- 172.21.15.76:0/3274651452 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55def98dc2d0 0x55def98ea650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T05:00:52.281 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.277+0000 7f6b6ccad700 1 --2- 172.21.15.76:0/3274651452 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55def98daa80 0x55def98e9100 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6b68108590 tx=0x7f6b5c020000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5dc61af5fb1113e5 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:00:52.281 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.277+0000 7f6b47fff700 10 client.0 ms_handle_connect on v2:172.21.15.192:3300/0 2024-06-02T05:00:52.281 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.277+0000 7f6b47fff700 1 -- 172.21.15.76:0/3274651452 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b5c02b030 con 0x55def98daa80 2024-06-02T05:00:52.281 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.277+0000 7f6b47fff700 1 -- 172.21.15.76:0/3274651452 <== mon.1 v2:172.21.15.192:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f6b5c02f6b0 con 0x55def98daa80 2024-06-02T05:00:52.282 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.277+0000 7f6b7b0ccb80 1 -- 172.21.15.76:0/3274651452 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6b54004390 con 0x55def98daa80 2024-06-02T05:00:52.282 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.277+0000 7f6b47fff700 1 -- 172.21.15.76:0/3274651452 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6b5c02fa90 con 0x55def98daa80 2024-06-02T05:00:52.282 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.277+0000 7f6b7b0ccb80 10 client.26017 fetch_fsmap learned FSMap version 36 2024-06-02T05:00:52.282 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.277+0000 7f6b7b0ccb80 1 -- 172.21.15.76:0/3274651452 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55def96b0c70 con 0x55def98daa80 2024-06-02T05:00:52.282 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.277+0000 7f6b47fff700 1 -- 172.21.15.76:0/3274651452 <== mon.1 v2:172.21.15.192:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6b54004390 con 0x55def98daa80 2024-06-02T05:00:52.282 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.278+0000 7f6b47fff700 1 -- 172.21.15.76:0/3274651452 <== mon.1 v2:172.21.15.192:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f6b5c00f4f0 con 0x55def98daa80 2024-06-02T05:00:52.282 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.278+0000 7f6b7b0ccb80 10 client.26017 fetch_fsmap finished waiting for FSMap version 36 2024-06-02T05:00:52.282 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.278+0000 7f6b7b0ccb80 10 client.26017 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T05:00:52.282 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.278+0000 7f6b7b0ccb80 20 client.26017 populate_metadata read hostname 'smithi076' 2024-06-02T05:00:52.282 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.278+0000 7f6b7b0ccb80 1 --2- 172.21.15.76:0/3274651452 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55def9947040 0x55def9949460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:00:52.282 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.278+0000 7f6b7b0ccb80 4 client.26017 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T05:00:52.283 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.278+0000 7f6b7b0ccb80 1 -- 172.21.15.76:0/3274651452 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55def9823e60 con 0x55def9947040 2024-06-02T05:00:52.283 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.278+0000 7f6b67fff700 1 --2- 172.21.15.76:0/3274651452 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55def9947040 0x55def9949460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:00:52.283 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.278+0000 7f6b67fff700 1 --2- 172.21.15.76:0/3274651452 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55def9947040 0x55def9949460 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2580fa8cd77efbe1 server_cookie=2d1bf8f15a7a3be1 in_seq=0 out_seq=0 2024-06-02T05:00:52.283 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.278+0000 7f6b47fff700 10 client.26017 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T05:00:52.312 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.307+0000 7f6b47fff700 1 -- 172.21.15.76:0/3274651452 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55def9823e60 con 0x55def9947040 2024-06-02T05:00:52.312 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.307+0000 7f6b47fff700 10 client.26017 handle_command_reply: tid=0 2024-06-02T05:00:52.312 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.307+0000 7f6b7b0ccb80 1 client.26017 shutdown 2024-06-02T05:00:52.312 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.311+0000 7f6b7b0ccb80 1 -- 172.21.15.76:0/3274651452 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55def98daa80 msgr2=0x55def98e9100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:00:52.312 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.311+0000 7f6b7b0ccb80 1 --2- 172.21.15.76:0/3274651452 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55def98daa80 0x55def98e9100 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6b68108590 tx=0x7f6b5c020000 comp rx=0 tx=0).stop 2024-06-02T05:00:52.313 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.311+0000 7f6b7b0ccb80 1 -- 172.21.15.76:0/3274651452 shutdown_connections 2024-06-02T05:00:52.313 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.311+0000 7f6b7b0ccb80 1 --2- 172.21.15.76:0/3274651452 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55def9947040 0x55def9949460 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:52.313 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.311+0000 7f6b7b0ccb80 1 --2- 172.21.15.76:0/3274651452 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55def98dc2d0 0x55def98ea650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:52.314 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.311+0000 7f6b7b0ccb80 1 --2- 172.21.15.76:0/3274651452 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55def98daa80 0x55def98e9100 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:52.314 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.311+0000 7f6b7b0ccb80 1 --2- 172.21.15.76:0/3274651452 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55def98db3e0 0x55def98e9640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:52.314 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.311+0000 7f6b7b0ccb80 1 -- 172.21.15.76:0/3274651452 >> 172.21.15.76:0/3274651452 conn(0x55def98391b0 msgr2=0x55def98d7020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:00:52.314 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.311+0000 7f6b47fff700 0 client.26017 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T05:00:52.314 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.312+0000 7f6b7b0ccb80 1 -- 172.21.15.76:0/3274651452 shutdown_connections 2024-06-02T05:00:52.314 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.312+0000 7f6b7b0ccb80 1 -- 172.21.15.76:0/3274651452 wait complete. 2024-06-02T05:00:52.319 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:{ 2024-06-02T05:00:52.319 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "message": "", 2024-06-02T05:00:52.319 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "return_code": 0 2024-06-02T05:00:52.319 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:} 2024-06-02T05:00:52.320 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.318+0000 7f6b7b0ccb80 20 client.26017 trim_cache size 0 max 16384 2024-06-02T05:00:52.320 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.318+0000 7f6b6ef11700 1 -- 172.21.15.76:0/2130201953 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f6b580a11a0 msgr2=0x7f6b580a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:00:52.320 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.318+0000 7f6b6ef11700 1 --2- 172.21.15.76:0/2130201953 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f6b580a11a0 0x7f6b580a3660 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c009990 tx=0x7f6b5c00b540 comp rx=0 tx=0).stop 2024-06-02T05:00:52.320 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.318+0000 7f6b6ef11700 1 -- 172.21.15.76:0/2130201953 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b681090d0 msgr2=0x7f6b681ad500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:00:52.320 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.318+0000 7f6b6ef11700 1 --2- 172.21.15.76:0/2130201953 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b681090d0 0x7f6b681ad500 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6b6000ef30 tx=0x7f6b6000c3a0 comp rx=0 tx=0).stop 2024-06-02T05:00:52.320 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.318+0000 7f6b6ef11700 1 -- 172.21.15.76:0/2130201953 shutdown_connections 2024-06-02T05:00:52.321 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.318+0000 7f6b6ef11700 1 --2- 172.21.15.76:0/2130201953 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f6b580a11a0 0x7f6b580a3660 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:52.321 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.318+0000 7f6b6ef11700 1 --2- 172.21.15.76:0/2130201953 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b681090d0 0x7f6b681ad500 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:52.321 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.318+0000 7f6b6ef11700 1 --2- 172.21.15.76:0/2130201953 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6b68107540 0x7f6b6807e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:52.321 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.318+0000 7f6b6ef11700 1 --2- 172.21.15.76:0/2130201953 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6b68108730 0x7f6b6807ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:00:52.321 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.318+0000 7f6b6ef11700 1 -- 172.21.15.76:0/2130201953 >> 172.21.15.76:0/2130201953 conn(0x7f6b680764d0 msgr2=0x7f6b6810bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:00:52.321 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.319+0000 7f6b6ef11700 1 -- 172.21.15.76:0/2130201953 shutdown_connections 2024-06-02T05:00:52.321 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:00:52.319+0000 7f6b6ef11700 1 -- 172.21.15.76:0/2130201953 wait complete. 2024-06-02T05:00:53.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:00:53 smithi192 ceph-mon[47933]: pgmap v607: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 13 MiB/s wr, 819 op/s 2024-06-02T05:00:53.986 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:00:53 smithi076 ceph-mon[42935]: pgmap v607: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 13 MiB/s wr, 819 op/s 2024-06-02T05:00:54.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:00:53 smithi119 ceph-mon[46633]: pgmap v607: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 13 MiB/s wr, 819 op/s 2024-06-02T05:00:55.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:00:55 smithi192 ceph-mon[47933]: pgmap v608: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 13 MiB/s wr, 749 op/s 2024-06-02T05:00:55.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:00:55 smithi076 ceph-mon[42935]: pgmap v608: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 13 MiB/s wr, 749 op/s 2024-06-02T05:00:56.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:00:55 smithi119 ceph-mon[46633]: pgmap v608: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 13 MiB/s wr, 749 op/s 2024-06-02T05:00:56.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 605.0 s, 543.2 tps, lat 184.366 ms stddev 327.193 2024-06-02T05:00:57.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:00:57 smithi192 ceph-mon[47933]: pgmap v609: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 16 MiB/s wr, 906 op/s 2024-06-02T05:00:57.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:00:57 smithi076 ceph-mon[42935]: pgmap v609: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 16 MiB/s wr, 906 op/s 2024-06-02T05:00:58.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:00:57 smithi119 ceph-mon[46633]: pgmap v609: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 16 MiB/s wr, 906 op/s 2024-06-02T05:00:58.988 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:00:58 smithi076 ceph-mon[42935]: pgmap v610: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 15 MiB/s wr, 849 op/s 2024-06-02T05:00:59.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:00:58 smithi119 ceph-mon[46633]: pgmap v610: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 15 MiB/s wr, 849 op/s 2024-06-02T05:00:59.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:00:58 smithi192 ceph-mon[47933]: pgmap v610: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 15 MiB/s wr, 849 op/s 2024-06-02T05:01:01.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 610.0 s, 631.8 tps, lat 157.987 ms stddev 73.862 2024-06-02T05:01:01.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:01:01 smithi192 ceph-mon[47933]: pgmap v611: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 16 MiB/s wr, 928 op/s 2024-06-02T05:01:01.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:01:01 smithi076 ceph-mon[42935]: pgmap v611: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 16 MiB/s wr, 928 op/s 2024-06-02T05:01:02.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:01:01 smithi119 ceph-mon[46633]: pgmap v611: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 16 MiB/s wr, 928 op/s 2024-06-02T05:01:03.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:01:03 smithi192 ceph-mon[47933]: pgmap v612: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 15 MiB/s wr, 919 op/s 2024-06-02T05:01:03.989 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:01:03 smithi076 ceph-mon[42935]: pgmap v612: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 15 MiB/s wr, 919 op/s 2024-06-02T05:01:04.126 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:01:03 smithi119 ceph-mon[46633]: pgmap v612: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 15 MiB/s wr, 919 op/s 2024-06-02T05:01:05.498 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.498+0000 7f660e48c700 1 -- 172.21.15.76:0/3203516210 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6608108730 msgr2=0x7f6608108b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:01:05.499 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.498+0000 7f660e48c700 1 --2- 172.21.15.76:0/3203516210 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6608108730 0x7f6608108b90 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f65f00099c0 tx=0x7f65f0009cd0 comp rx=0 tx=0).stop 2024-06-02T05:01:05.500 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.499+0000 7f660e48c700 1 -- 172.21.15.76:0/3203516210 shutdown_connections 2024-06-02T05:01:05.500 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.499+0000 7f660e48c700 1 --2- 172.21.15.76:0/3203516210 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f66081090d0 0x7f660810f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:05.500 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.499+0000 7f660e48c700 1 --2- 172.21.15.76:0/3203516210 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6608107540 0x7f6608107960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:05.500 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.499+0000 7f660e48c700 1 --2- 172.21.15.76:0/3203516210 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6608108730 0x7f6608108b90 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:05.500 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.499+0000 7f660e48c700 1 -- 172.21.15.76:0/3203516210 >> 172.21.15.76:0/3203516210 conn(0x7f66080764d0 msgr2=0x7f6608078910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:01:05.500 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.499+0000 7f660e48c700 1 -- 172.21.15.76:0/3203516210 shutdown_connections 2024-06-02T05:01:05.500 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.499+0000 7f660e48c700 1 -- 172.21.15.76:0/3203516210 wait complete. 2024-06-02T05:01:05.501 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.500+0000 7f660e48c700 1 Processor -- start 2024-06-02T05:01:05.501 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.500+0000 7f660e48c700 1 -- start start 2024-06-02T05:01:05.501 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.501+0000 7f660e48c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6608107540 0x7f660807e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:01:05.501 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.501+0000 7f660e48c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6608108730 0x7f660807ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:01:05.501 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.501+0000 7f660e48c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f66081090d0 0x7f66081ad540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:01:05.501 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.501+0000 7f660e48c700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6608081c80 con 0x7f66081090d0 2024-06-02T05:01:05.502 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.501+0000 7f660e48c700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6608081dc0 con 0x7f6608107540 2024-06-02T05:01:05.502 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.501+0000 7f660e48c700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f660806a9c0 con 0x7f6608108730 2024-06-02T05:01:05.502 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.501+0000 7f65ff7fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6608108730 0x7f660807ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:01:05.502 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.501+0000 7f65ff7fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6608108730 0x7f660807ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:41098/0 (socket says 172.21.15.76:41098) 2024-06-02T05:01:05.503 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.501+0000 7f65ff7fe700 1 -- 172.21.15.76:0/3172760825 learned_addr learned my addr 172.21.15.76:0/3172760825 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:01:05.503 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.501+0000 7f6607fff700 1 --2- 172.21.15.76:0/3172760825 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6608107540 0x7f660807e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:01:05.503 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.501+0000 7f660ca29700 1 --2- 172.21.15.76:0/3172760825 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f66081090d0 0x7f66081ad540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:01:05.503 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.501+0000 7f65ff7fe700 1 -- 172.21.15.76:0/3172760825 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6608107540 msgr2=0x7f660807e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:01:05.503 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.501+0000 7f65ff7fe700 1 --2- 172.21.15.76:0/3172760825 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6608107540 0x7f660807e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:05.503 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.501+0000 7f65ff7fe700 1 -- 172.21.15.76:0/3172760825 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f66081090d0 msgr2=0x7f66081ad540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:01:05.503 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.501+0000 7f65ff7fe700 1 --2- 172.21.15.76:0/3172760825 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f66081090d0 0x7f66081ad540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:05.503 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.501+0000 7f65ff7fe700 1 -- 172.21.15.76:0/3172760825 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65f00095f0 con 0x7f6608108730 2024-06-02T05:01:05.503 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.502+0000 7f65ff7fe700 1 --2- 172.21.15.76:0/3172760825 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6608108730 0x7f660807ec40 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f65f000c010 tx=0x7f65f000fa00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:01:05.504 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.502+0000 7f6605ffb700 1 -- 172.21.15.76:0/3172760825 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f001d070 con 0x7f6608108730 2024-06-02T05:01:05.504 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.502+0000 7f660e48c700 1 -- 172.21.15.76:0/3172760825 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f660806ac40 con 0x7f6608108730 2024-06-02T05:01:05.504 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.502+0000 7f660e48c700 1 -- 172.21.15.76:0/3172760825 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f660806b140 con 0x7f6608108730 2024-06-02T05:01:05.504 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.502+0000 7f6605ffb700 1 -- 172.21.15.76:0/3172760825 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f65f000fd00 con 0x7f6608108730 2024-06-02T05:01:05.504 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.502+0000 7f6605ffb700 1 -- 172.21.15.76:0/3172760825 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f0004bd0 con 0x7f6608108730 2024-06-02T05:01:05.506 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.505+0000 7f6605ffb700 1 -- 172.21.15.76:0/3172760825 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f65f002b440 con 0x7f6608108730 2024-06-02T05:01:05.509 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.508+0000 7f661a647b80 1 Processor -- start 2024-06-02T05:01:05.509 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.509+0000 7f661a647b80 1 -- start start 2024-06-02T05:01:05.510 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.509+0000 7f661a647b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56300805fa80 0x56300805fea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:01:05.510 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.509+0000 7f661a647b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5630080603e0 0x563008060cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:01:05.510 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.509+0000 7f661a647b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5630080612d0 0x563008061750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:01:05.510 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.509+0000 7f661a647b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x563007fb70f0 con 0x56300805fa80 2024-06-02T05:01:05.510 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.509+0000 7f661a647b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x563007fb4ab0 con 0x5630080612d0 2024-06-02T05:01:05.510 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.509+0000 7f661a647b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x563007fb03a0 con 0x5630080603e0 2024-06-02T05:01:05.511 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.509+0000 7f6607fff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5630080603e0 0x563008060cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:01:05.511 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.509+0000 7f6607fff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5630080603e0 0x563008060cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:41106/0 (socket says 172.21.15.76:41106) 2024-06-02T05:01:05.511 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.509+0000 7f6607fff700 1 -- 172.21.15.76:0/4207362680 learned_addr learned my addr 172.21.15.76:0/4207362680 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:01:05.511 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.510+0000 7f65ff7fe700 1 --2- 172.21.15.76:0/4207362680 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5630080612d0 0x563008061750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:01:05.511 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.510+0000 7f6607fff700 1 -- 172.21.15.76:0/4207362680 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5630080612d0 msgr2=0x563008061750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:01:05.511 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.510+0000 7f6607fff700 1 --2- 172.21.15.76:0/4207362680 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5630080612d0 0x563008061750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:05.511 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.510+0000 7f6607fff700 1 -- 172.21.15.76:0/4207362680 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56300805fa80 msgr2=0x56300805fea0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-02T05:01:05.511 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.510+0000 7f6607fff700 1 --2- 172.21.15.76:0/4207362680 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56300805fa80 0x56300805fea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:05.511 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.510+0000 7f6607fff700 1 -- 172.21.15.76:0/4207362680 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563007e31350 con 0x5630080603e0 2024-06-02T05:01:05.512 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.510+0000 7f6605ffb700 1 --2- 172.21.15.76:0/3172760825 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f65f40a1270 0x7f65f40a3730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:01:05.512 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.511+0000 7f6605ffb700 1 -- 172.21.15.76:0/3172760825 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f65f00cda60 con 0x7f6608108730 2024-06-02T05:01:05.512 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.511+0000 7f6607fff700 1 --2- 172.21.15.76:0/4207362680 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5630080603e0 0x563008060cf0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f65f800a760 tx=0x7f65f80079b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b29f0e6a865d6eb2 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:01:05.513 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.512+0000 7f65fe7fc700 1 -- 172.21.15.76:0/4207362680 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f8018070 con 0x5630080603e0 2024-06-02T05:01:05.513 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.512+0000 7f65fe7fc700 1 -- 172.21.15.76:0/4207362680 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f65f8010040 con 0x5630080603e0 2024-06-02T05:01:05.513 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.512+0000 7f65fe7fc700 1 -- 172.21.15.76:0/4207362680 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f800f050 con 0x5630080603e0 2024-06-02T05:01:05.513 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.512+0000 7f660ca29700 1 --2- 172.21.15.76:0/3172760825 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f65f40a1270 0x7f65f40a3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:01:05.514 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.513+0000 7f661a647b80 1 -- 172.21.15.76:0/4207362680 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5630080603e0 msgr2=0x563008060cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:01:05.514 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.513+0000 7f660ca29700 1 --2- 172.21.15.76:0/3172760825 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f65f40a1270 0x7f65f40a3730 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f6600009c40 tx=0x7f6600009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:01:05.514 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.513+0000 7f661a647b80 1 --2- 172.21.15.76:0/4207362680 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5630080603e0 0x563008060cf0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f65f800a760 tx=0x7f65f80079b0 comp rx=0 tx=0).stop 2024-06-02T05:01:05.514 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.514+0000 7f661a647b80 1 -- 172.21.15.76:0/4207362680 shutdown_connections 2024-06-02T05:01:05.515 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.514+0000 7f661a647b80 1 --2- 172.21.15.76:0/4207362680 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5630080612d0 0x563008061750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:05.515 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.514+0000 7f661a647b80 1 --2- 172.21.15.76:0/4207362680 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56300805fa80 0x56300805fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:05.515 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.514+0000 7f661a647b80 1 --2- 172.21.15.76:0/4207362680 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5630080603e0 0x563008060cf0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:05.515 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.514+0000 7f661a647b80 1 -- 172.21.15.76:0/4207362680 >> 172.21.15.76:0/4207362680 conn(0x563007fbe1b0 msgr2=0x56300805c440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:01:05.515 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.514+0000 7f661a647b80 1 -- 172.21.15.76:0/4207362680 shutdown_connections 2024-06-02T05:01:05.516 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.514+0000 7f661a647b80 1 -- 172.21.15.76:0/4207362680 wait complete. 2024-06-02T05:01:05.516 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.515+0000 7f661a647b80 1 -- start start 2024-06-02T05:01:05.516 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.515+0000 7f661a647b80 1 Processor -- start 2024-06-02T05:01:05.516 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.515+0000 7f661a647b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56300805fa80 0x563008069890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:01:05.516 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.515+0000 7f661a647b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5630080603e0 0x563008069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:01:05.516 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.515+0000 7f661a647b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5630080612d0 0x563008070e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:01:05.516 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.515+0000 7f661a647b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x563007f4c500 con 0x5630080603e0 2024-06-02T05:01:05.516 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.515+0000 7f661a647b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x563007f4c1a0 con 0x56300805fa80 2024-06-02T05:01:05.516 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.515+0000 7f661a647b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x563007e33640 con 0x5630080612d0 2024-06-02T05:01:05.516 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.515+0000 7f661a647b80 10 client.0 _ll_register_callbacks cb 0x563007f55ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T05:01:05.518 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.516+0000 7f660ca29700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5630080612d0 0x563008070e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:01:05.518 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.516+0000 7f660ca29700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5630080612d0 0x563008070e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:41108/0 (socket says 172.21.15.76:41108) 2024-06-02T05:01:05.518 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.516+0000 7f660ca29700 1 -- 172.21.15.76:0/2937577037 learned_addr learned my addr 172.21.15.76:0/2937577037 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:01:05.518 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.516+0000 7f6607fff700 1 --2- 172.21.15.76:0/2937577037 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56300805fa80 0x563008069890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:01:05.518 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.516+0000 7f65ff7fe700 1 --2- 172.21.15.76:0/2937577037 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5630080603e0 0x563008069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:01:05.518 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.516+0000 7f6607fff700 1 -- 172.21.15.76:0/2937577037 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5630080612d0 msgr2=0x563008070e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:01:05.518 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.516+0000 7f6607fff700 1 --2- 172.21.15.76:0/2937577037 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5630080612d0 0x563008070e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:05.518 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.516+0000 7f6607fff700 1 -- 172.21.15.76:0/2937577037 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5630080603e0 msgr2=0x563008069dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:01:05.518 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.516+0000 7f6607fff700 1 --2- 172.21.15.76:0/2937577037 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5630080603e0 0x563008069dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:05.518 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.516+0000 7f6607fff700 1 -- 172.21.15.76:0/2937577037 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65f800a410 con 0x56300805fa80 2024-06-02T05:01:05.519 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.516+0000 7f6607fff700 1 --2- 172.21.15.76:0/2937577037 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56300805fa80 0x563008069890 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f65f800afd0 tx=0x7f65f8003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9240bb3a66876ff9 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:01:05.519 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.516+0000 7f65e77fe700 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-06-02T05:01:05.519 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.517+0000 7f65e77fe700 1 -- 172.21.15.76:0/2937577037 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f8023070 con 0x56300805fa80 2024-06-02T05:01:05.519 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.517+0000 7f65e77fe700 1 -- 172.21.15.76:0/2937577037 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f65f8004040 con 0x56300805fa80 2024-06-02T05:01:05.519 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.517+0000 7f661a647b80 1 -- 172.21.15.76:0/2937577037 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563007f09210 con 0x56300805fa80 2024-06-02T05:01:05.519 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.517+0000 7f65e77fe700 1 -- 172.21.15.76:0/2937577037 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f65f8018030 con 0x56300805fa80 2024-06-02T05:01:05.521 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.521+0000 7f661a647b80 10 client.26054 fetch_fsmap learned FSMap version 36 2024-06-02T05:01:05.522 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.521+0000 7f661a647b80 1 -- 172.21.15.76:0/2937577037 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x563007dddb00 con 0x56300805fa80 2024-06-02T05:01:05.522 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.522+0000 7f65e77fe700 1 -- 172.21.15.76:0/2937577037 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x563007f09210 con 0x56300805fa80 2024-06-02T05:01:05.522 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.522+0000 7f65e77fe700 1 -- 172.21.15.76:0/2937577037 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f65f8026070 con 0x56300805fa80 2024-06-02T05:01:05.522 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.522+0000 7f661a647b80 10 client.26054 fetch_fsmap finished waiting for FSMap version 36 2024-06-02T05:01:05.522 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.522+0000 7f661a647b80 10 client.26054 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T05:01:05.523 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.522+0000 7f661a647b80 20 client.26054 populate_metadata read hostname 'smithi076' 2024-06-02T05:01:05.523 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.522+0000 7f661a647b80 1 --2- 172.21.15.76:0/2937577037 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x563008075610 0x563008077a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:01:05.523 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.522+0000 7f661a647b80 4 client.26054 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T05:01:05.523 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.522+0000 7f661a647b80 1 -- 172.21.15.76:0/2937577037 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56300802f7b0 con 0x563008075610 2024-06-02T05:01:05.523 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.522+0000 7f65ff7fe700 1 --2- 172.21.15.76:0/2937577037 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x563008075610 0x563008077a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:01:05.523 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.523+0000 7f65ff7fe700 1 --2- 172.21.15.76:0/2937577037 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x563008075610 0x563008077a30 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f51bd9bf1a7d7bc4 server_cookie=4f68292a412dbc30 in_seq=0 out_seq=0 2024-06-02T05:01:05.524 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.523+0000 7f65e77fe700 10 client.26054 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T05:01:05.527 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.526+0000 7f65e77fe700 1 -- 172.21.15.76:0/2937577037 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56300802f7b0 con 0x563008075610 2024-06-02T05:01:05.527 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.526+0000 7f65e77fe700 10 client.26054 handle_command_reply: tid=0 2024-06-02T05:01:05.528 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.526+0000 7f661a647b80 1 client.26054 shutdown 2024-06-02T05:01:05.528 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.527+0000 7f661a647b80 1 -- 172.21.15.76:0/2937577037 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56300805fa80 msgr2=0x563008069890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:01:05.528 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.527+0000 7f661a647b80 1 --2- 172.21.15.76:0/2937577037 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56300805fa80 0x563008069890 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f65f800afd0 tx=0x7f65f8003c10 comp rx=0 tx=0).stop 2024-06-02T05:01:05.528 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.527+0000 7f661a647b80 1 -- 172.21.15.76:0/2937577037 shutdown_connections 2024-06-02T05:01:05.528 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.527+0000 7f661a647b80 1 --2- 172.21.15.76:0/2937577037 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x563008075610 0x563008077a30 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:05.528 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.527+0000 7f661a647b80 1 --2- 172.21.15.76:0/2937577037 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5630080612d0 0x563008070e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:05.528 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.527+0000 7f65e77fe700 0 client.26054 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T05:01:05.528 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.527+0000 7f661a647b80 1 --2- 172.21.15.76:0/2937577037 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56300805fa80 0x563008069890 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:05.528 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.527+0000 7f661a647b80 1 --2- 172.21.15.76:0/2937577037 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5630080603e0 0x563008069dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:05.528 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.527+0000 7f661a647b80 1 -- 172.21.15.76:0/2937577037 >> 172.21.15.76:0/2937577037 conn(0x563007fbe1b0 msgr2=0x56300805a860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:01:05.529 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.527+0000 7f661a647b80 1 -- 172.21.15.76:0/2937577037 shutdown_connections 2024-06-02T05:01:05.529 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.527+0000 7f661a647b80 1 -- 172.21.15.76:0/2937577037 wait complete. 2024-06-02T05:01:05.529 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.528+0000 7f661a647b80 20 client.26054 trim_cache size 0 max 16384 2024-06-02T05:01:05.559 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.553+0000 7f661a647b80 1 Processor -- start 2024-06-02T05:01:05.559 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.557+0000 7f661a647b80 1 -- start start 2024-06-02T05:01:05.559 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.557+0000 7f661a647b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56300805fa80 0x563008077a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:01:05.559 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.557+0000 7f661a647b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5630080603e0 0x5630080616b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:01:05.559 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.557+0000 7f661a647b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5630080612d0 0x563008070d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:01:05.559 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.557+0000 7f661a647b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x563008071f90 con 0x56300805fa80 2024-06-02T05:01:05.559 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.557+0000 7f661a647b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x563008068330 con 0x5630080612d0 2024-06-02T05:01:05.559 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.557+0000 7f661a647b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x563008071270 con 0x5630080603e0 2024-06-02T05:01:05.560 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.557+0000 7f660ca29700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5630080612d0 0x563008070d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:01:05.560 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.557+0000 7f660ca29700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5630080612d0 0x563008070d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:54568/0 (socket says 172.21.15.76:54568) 2024-06-02T05:01:05.560 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.557+0000 7f660ca29700 1 -- 172.21.15.76:0/533220365 learned_addr learned my addr 172.21.15.76:0/533220365 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:01:05.560 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.558+0000 7f660ca29700 1 -- 172.21.15.76:0/533220365 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5630080603e0 msgr2=0x5630080616b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-02T05:01:05.560 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.558+0000 7f660ca29700 1 --2- 172.21.15.76:0/533220365 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5630080603e0 0x5630080616b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:05.560 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.558+0000 7f660ca29700 1 -- 172.21.15.76:0/533220365 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56300805fa80 msgr2=0x563008077a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:01:05.560 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.558+0000 7f660ca29700 1 --2- 172.21.15.76:0/533220365 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56300805fa80 0x563008077a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:05.560 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.558+0000 7f660ca29700 1 -- 172.21.15.76:0/533220365 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563007f76500 con 0x5630080612d0 2024-06-02T05:01:05.560 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.558+0000 7f660ca29700 1 --2- 172.21.15.76:0/533220365 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5630080612d0 0x563008070d30 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6600011df0 tx=0x7f6600014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=93b9fdee60b6d584 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:01:05.560 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.558+0000 7f65feffd700 1 -- 172.21.15.76:0/533220365 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6600022070 con 0x5630080612d0 2024-06-02T05:01:05.560 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.558+0000 7f65feffd700 1 -- 172.21.15.76:0/533220365 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f66000044c0 con 0x5630080612d0 2024-06-02T05:01:05.561 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.558+0000 7f65feffd700 1 -- 172.21.15.76:0/533220365 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6600003c50 con 0x5630080612d0 2024-06-02T05:01:05.561 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.559+0000 7f661a647b80 1 -- 172.21.15.76:0/533220365 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5630080612d0 msgr2=0x563008070d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:01:05.561 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.559+0000 7f661a647b80 1 --2- 172.21.15.76:0/533220365 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5630080612d0 0x563008070d30 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6600011df0 tx=0x7f6600014000 comp rx=0 tx=0).stop 2024-06-02T05:01:05.563 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.563+0000 7f661a647b80 1 -- 172.21.15.76:0/533220365 shutdown_connections 2024-06-02T05:01:05.563 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.563+0000 7f661a647b80 1 --2- 172.21.15.76:0/533220365 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5630080612d0 0x563008070d30 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:05.563 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.563+0000 7f661a647b80 1 --2- 172.21.15.76:0/533220365 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56300805fa80 0x563008077a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:05.563 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.563+0000 7f661a647b80 1 --2- 172.21.15.76:0/533220365 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5630080603e0 0x5630080616b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:05.563 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.563+0000 7f661a647b80 1 -- 172.21.15.76:0/533220365 >> 172.21.15.76:0/533220365 conn(0x563007fbe1b0 msgr2=0x563008067800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:01:05.565 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.565+0000 7f661a647b80 1 -- 172.21.15.76:0/533220365 shutdown_connections 2024-06-02T05:01:05.566 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.565+0000 7f661a647b80 1 -- 172.21.15.76:0/533220365 wait complete. 2024-06-02T05:01:05.566 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.565+0000 7f661a647b80 1 -- start start 2024-06-02T05:01:05.566 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.566+0000 7f661a647b80 1 Processor -- start 2024-06-02T05:01:05.567 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.566+0000 7f661a647b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56300805fa80 0x56300806e280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:01:05.567 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.566+0000 7f661a647b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5630080603e0 0x56300806e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:01:05.567 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.566+0000 7f661a647b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5630080612d0 0x56300806f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:01:05.567 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.566+0000 7f661a647b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x56300806fc70 con 0x5630080612d0 2024-06-02T05:01:05.567 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.566+0000 7f661a647b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x56300806fde0 con 0x56300805fa80 2024-06-02T05:01:05.567 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.566+0000 7f661a647b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x56300806ffa0 con 0x5630080603e0 2024-06-02T05:01:05.567 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.566+0000 7f661a647b80 10 client.0 _ll_register_callbacks cb 0x563007f55ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T05:01:05.568 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.566+0000 7f65ff7fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5630080603e0 0x56300806e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:01:05.568 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.566+0000 7f65ff7fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5630080603e0 0x56300806e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:41122/0 (socket says 172.21.15.76:41122) 2024-06-02T05:01:05.568 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.566+0000 7f65ff7fe700 1 -- 172.21.15.76:0/302204630 learned_addr learned my addr 172.21.15.76:0/302204630 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:01:05.569 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.567+0000 7f660ca29700 1 --2- 172.21.15.76:0/302204630 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5630080612d0 0x56300806f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:01:05.570 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.567+0000 7f65ff7fe700 1 -- 172.21.15.76:0/302204630 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56300805fa80 msgr2=0x56300806e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:01:05.570 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.567+0000 7f65ff7fe700 1 --2- 172.21.15.76:0/302204630 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56300805fa80 0x56300806e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:05.570 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.567+0000 7f65ff7fe700 1 -- 172.21.15.76:0/302204630 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5630080612d0 msgr2=0x56300806f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:01:05.570 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.567+0000 7f65ff7fe700 1 --2- 172.21.15.76:0/302204630 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5630080612d0 0x56300806f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:05.570 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.567+0000 7f65ff7fe700 1 -- 172.21.15.76:0/302204630 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6600017070 con 0x5630080603e0 2024-06-02T05:01:05.570 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.567+0000 7f660ca29700 1 --2- 172.21.15.76:0/302204630 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5630080612d0 0x56300806f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T05:01:05.570 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.567+0000 7f65ff7fe700 1 --2- 172.21.15.76:0/302204630 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5630080603e0 0x56300806e7c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f65f0097610 tx=0x7f65f009a790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=379ae67c56ba5a2 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:01:05.570 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.567+0000 7f65e77fe700 10 client.0 ms_handle_connect on v2:172.21.15.192:3300/0 2024-06-02T05:01:05.570 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.567+0000 7f65e77fe700 1 -- 172.21.15.76:0/302204630 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f009aba0 con 0x5630080603e0 2024-06-02T05:01:05.570 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.567+0000 7f65e77fe700 1 -- 172.21.15.76:0/302204630 <== mon.1 v2:172.21.15.192:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f65f009e9d0 con 0x5630080603e0 2024-06-02T05:01:05.571 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.568+0000 7f661a647b80 1 -- 172.21.15.76:0/302204630 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f65f8010040 con 0x5630080603e0 2024-06-02T05:01:05.571 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.568+0000 7f65e77fe700 1 -- 172.21.15.76:0/302204630 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f65f00a2f90 con 0x5630080603e0 2024-06-02T05:01:05.571 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.568+0000 7f661a647b80 10 client.26032 fetch_fsmap learned FSMap version 36 2024-06-02T05:01:05.571 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.568+0000 7f661a647b80 1 -- 172.21.15.76:0/302204630 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x563007e35c70 con 0x5630080603e0 2024-06-02T05:01:05.571 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.569+0000 7f65e77fe700 1 -- 172.21.15.76:0/302204630 <== mon.1 v2:172.21.15.192:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f65f00b8080 con 0x5630080603e0 2024-06-02T05:01:05.571 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.569+0000 7f65e77fe700 1 -- 172.21.15.76:0/302204630 <== mon.1 v2:172.21.15.192:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f65f009ae00 con 0x5630080603e0 2024-06-02T05:01:05.571 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.569+0000 7f661a647b80 10 client.26032 fetch_fsmap finished waiting for FSMap version 36 2024-06-02T05:01:05.571 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.569+0000 7f661a647b80 10 client.26032 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T05:01:05.571 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.569+0000 7f661a647b80 20 client.26032 populate_metadata read hostname 'smithi076' 2024-06-02T05:01:05.571 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.569+0000 7f661a647b80 1 --2- 172.21.15.76:0/302204630 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5630080cbe70 0x5630080ce290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:01:05.571 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.569+0000 7f661a647b80 4 client.26032 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T05:01:05.571 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.569+0000 7f661a647b80 1 -- 172.21.15.76:0/302204630 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x563007fa8e60 con 0x5630080cbe70 2024-06-02T05:01:05.572 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.569+0000 7f6607fff700 1 --2- 172.21.15.76:0/302204630 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5630080cbe70 0x5630080ce290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:01:05.572 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.570+0000 7f65e77fe700 10 client.26032 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T05:01:05.572 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.570+0000 7f6607fff700 1 --2- 172.21.15.76:0/302204630 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5630080cbe70 0x5630080ce290 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e80ca04789c7cce server_cookie=7568874f6d768c28 in_seq=0 out_seq=0 2024-06-02T05:01:05.615 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.613+0000 7f65e77fe700 1 -- 172.21.15.76:0/302204630 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x563007fa8e60 con 0x5630080cbe70 2024-06-02T05:01:05.615 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.613+0000 7f65e77fe700 10 client.26032 handle_command_reply: tid=0 2024-06-02T05:01:05.615 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.613+0000 7f661a647b80 1 client.26032 shutdown 2024-06-02T05:01:05.615 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.613+0000 7f661a647b80 1 -- 172.21.15.76:0/302204630 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5630080603e0 msgr2=0x56300806e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:01:05.615 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.613+0000 7f661a647b80 1 --2- 172.21.15.76:0/302204630 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5630080603e0 0x56300806e7c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f65f0097610 tx=0x7f65f009a790 comp rx=0 tx=0).stop 2024-06-02T05:01:05.615 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.614+0000 7f661a647b80 1 -- 172.21.15.76:0/302204630 shutdown_connections 2024-06-02T05:01:05.615 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.614+0000 7f661a647b80 1 --2- 172.21.15.76:0/302204630 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5630080cbe70 0x5630080ce290 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:05.615 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.614+0000 7f661a647b80 1 --2- 172.21.15.76:0/302204630 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5630080612d0 0x56300806f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:05.615 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.614+0000 7f661a647b80 1 --2- 172.21.15.76:0/302204630 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56300805fa80 0x56300806e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:05.615 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.614+0000 7f661a647b80 1 --2- 172.21.15.76:0/302204630 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5630080603e0 0x56300806e7c0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:05.616 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.614+0000 7f661a647b80 1 -- 172.21.15.76:0/302204630 >> 172.21.15.76:0/302204630 conn(0x563007fbe1b0 msgr2=0x56300805c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:01:05.616 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.614+0000 7f65e77fe700 0 client.26032 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T05:01:05.616 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.614+0000 7f661a647b80 1 -- 172.21.15.76:0/302204630 shutdown_connections 2024-06-02T05:01:05.616 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.614+0000 7f661a647b80 1 -- 172.21.15.76:0/302204630 wait complete. 2024-06-02T05:01:05.616 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.614+0000 7f661a647b80 20 client.26032 trim_cache size 0 max 16384 2024-06-02T05:01:05.616 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:{ 2024-06-02T05:01:05.616 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "message": "", 2024-06-02T05:01:05.616 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "return_code": 0 2024-06-02T05:01:05.617 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:} 2024-06-02T05:01:05.617 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.615+0000 7f660e48c700 1 -- 172.21.15.76:0/3172760825 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f65f40a1270 msgr2=0x7f65f40a3730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:01:05.617 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.615+0000 7f660e48c700 1 --2- 172.21.15.76:0/3172760825 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f65f40a1270 0x7f65f40a3730 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f6600009c40 tx=0x7f6600009260 comp rx=0 tx=0).stop 2024-06-02T05:01:05.617 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.615+0000 7f660e48c700 1 -- 172.21.15.76:0/3172760825 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6608108730 msgr2=0x7f660807ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:01:05.617 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.615+0000 7f660e48c700 1 --2- 172.21.15.76:0/3172760825 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6608108730 0x7f660807ec40 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f65f000c010 tx=0x7f65f000fa00 comp rx=0 tx=0).stop 2024-06-02T05:01:05.619 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.619+0000 7f660e48c700 1 -- 172.21.15.76:0/3172760825 shutdown_connections 2024-06-02T05:01:05.619 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.619+0000 7f660e48c700 1 --2- 172.21.15.76:0/3172760825 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f66081090d0 0x7f66081ad540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:05.619 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.619+0000 7f660e48c700 1 --2- 172.21.15.76:0/3172760825 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f65f40a1270 0x7f65f40a3730 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:05.620 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.619+0000 7f660e48c700 1 --2- 172.21.15.76:0/3172760825 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6608107540 0x7f660807e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:05.620 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.619+0000 7f660e48c700 1 --2- 172.21.15.76:0/3172760825 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6608108730 0x7f660807ec40 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:05.620 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.619+0000 7f660e48c700 1 -- 172.21.15.76:0/3172760825 >> 172.21.15.76:0/3172760825 conn(0x7f66080764d0 msgr2=0x7f660810bb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:01:05.628 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.628+0000 7f660e48c700 1 -- 172.21.15.76:0/3172760825 shutdown_connections 2024-06-02T05:01:05.629 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:05.628+0000 7f660e48c700 1 -- 172.21.15.76:0/3172760825 wait complete. 2024-06-02T05:01:05.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:01:05 smithi192 ceph-mon[47933]: pgmap v613: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 14 MiB/s wr, 801 op/s 2024-06-02T05:01:05.988 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:01:05 smithi076 ceph-mon[42935]: pgmap v613: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 14 MiB/s wr, 801 op/s 2024-06-02T05:01:06.114 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:01:05 smithi119 ceph-mon[46633]: pgmap v613: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 14 MiB/s wr, 801 op/s 2024-06-02T05:01:06.317 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 615.0 s, 615.6 tps, lat 162.066 ms stddev 66.817 2024-06-02T05:01:07.933 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:01:07 smithi192 ceph-mon[47933]: pgmap v614: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 15 MiB/s wr, 902 op/s 2024-06-02T05:01:07.985 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:01:07 smithi076 ceph-mon[42935]: pgmap v614: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 15 MiB/s wr, 902 op/s 2024-06-02T05:01:08.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:01:07 smithi119 ceph-mon[46633]: pgmap v614: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 15 MiB/s wr, 902 op/s 2024-06-02T05:01:09.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:01:09 smithi192 ceph-mon[47933]: pgmap v615: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 12 MiB/s wr, 776 op/s 2024-06-02T05:01:09.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:01:09 smithi076 ceph-mon[42935]: pgmap v615: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 12 MiB/s wr, 776 op/s 2024-06-02T05:01:10.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:01:09 smithi119 ceph-mon[46633]: pgmap v615: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 12 MiB/s wr, 776 op/s 2024-06-02T05:01:10.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:01:10 smithi076 ceph-mon[42935]: pgmap v616: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 14 MiB/s wr, 861 op/s 2024-06-02T05:01:11.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:01:10 smithi119 ceph-mon[46633]: pgmap v616: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 14 MiB/s wr, 861 op/s 2024-06-02T05:01:11.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:01:10 smithi192 ceph-mon[47933]: pgmap v616: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 14 MiB/s wr, 861 op/s 2024-06-02T05:01:11.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 620.0 s, 567.8 tps, lat 175.460 ms stddev 67.936 2024-06-02T05:01:13.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:01:13 smithi192 ceph-mon[47933]: pgmap v617: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 13 MiB/s wr, 817 op/s 2024-06-02T05:01:13.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:01:13 smithi076 ceph-mon[42935]: pgmap v617: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 13 MiB/s wr, 817 op/s 2024-06-02T05:01:14.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:01:13 smithi119 ceph-mon[46633]: pgmap v617: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 13 MiB/s wr, 817 op/s 2024-06-02T05:01:15.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:01:15 smithi192 ceph-mon[47933]: pgmap v618: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 11 MiB/s wr, 700 op/s 2024-06-02T05:01:15.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:01:15 smithi076 ceph-mon[42935]: pgmap v618: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 11 MiB/s wr, 700 op/s 2024-06-02T05:01:16.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:01:15 smithi119 ceph-mon[46633]: pgmap v618: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 11 MiB/s wr, 700 op/s 2024-06-02T05:01:16.319 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 625.0 s, 567.7 tps, lat 176.583 ms stddev 70.058 2024-06-02T05:01:17.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:01:17 smithi192 ceph-mon[47933]: pgmap v619: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 12 MiB/s wr, 811 op/s 2024-06-02T05:01:17.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:01:17 smithi076 ceph-mon[42935]: pgmap v619: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 12 MiB/s wr, 811 op/s 2024-06-02T05:01:18.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:01:17 smithi119 ceph-mon[46633]: pgmap v619: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 12 MiB/s wr, 811 op/s 2024-06-02T05:01:18.828 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.827+0000 7f96b50bc700 1 -- 172.21.15.76:0/880929256 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f96b0104cb0 msgr2=0x7f96b010b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:01:18.828 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.827+0000 7f96b50bc700 1 --2- 172.21.15.76:0/880929256 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f96b0104cb0 0x7f96b010b560 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f96a801c0d0 tx=0x7f96a801c3e0 comp rx=0 tx=0).stop 2024-06-02T05:01:18.828 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.827+0000 7f96b50bc700 1 -- 172.21.15.76:0/880929256 shutdown_connections 2024-06-02T05:01:18.828 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.827+0000 7f96b50bc700 1 --2- 172.21.15.76:0/880929256 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f96b0104cb0 0x7f96b010b560 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:18.829 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.827+0000 7f96b50bc700 1 --2- 172.21.15.76:0/880929256 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96b0103120 0x7f96b0103540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:18.829 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.827+0000 7f96b50bc700 1 --2- 172.21.15.76:0/880929256 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f96b0104310 0x7f96b0104770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:18.829 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.827+0000 7f96b50bc700 1 -- 172.21.15.76:0/880929256 >> 172.21.15.76:0/880929256 conn(0x7f96b00fe6b0 msgr2=0x7f96b0100ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:01:18.829 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.827+0000 7f96b50bc700 1 -- 172.21.15.76:0/880929256 shutdown_connections 2024-06-02T05:01:18.830 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.827+0000 7f96b50bc700 1 -- 172.21.15.76:0/880929256 wait complete. 2024-06-02T05:01:18.830 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.828+0000 7f96b50bc700 1 Processor -- start 2024-06-02T05:01:18.830 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.829+0000 7f96b50bc700 1 -- start start 2024-06-02T05:01:18.830 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.829+0000 7f96b50bc700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f96b0104cb0 0x7f96b0075600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:01:18.830 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.829+0000 7f96b50bc700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96b0075b40 0x7f96b0078650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:01:18.830 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.829+0000 7f96b50bc700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f96b0075fc0 0x7f96b0078bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:01:18.830 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.829+0000 7f96b50bc700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96b0079390 con 0x7f96b0075fc0 2024-06-02T05:01:18.830 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.829+0000 7f96b50bc700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96b0079500 con 0x7f96b0075b40 2024-06-02T05:01:18.830 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.829+0000 7f96b50bc700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96b01b2e20 con 0x7f96b0104cb0 2024-06-02T05:01:18.831 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.829+0000 7f96ae59c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96b0075b40 0x7f96b0078650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:01:18.831 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.829+0000 7f96ae59c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96b0075b40 0x7f96b0078650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:55988/0 (socket says 172.21.15.76:55988) 2024-06-02T05:01:18.831 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.829+0000 7f96ae59c700 1 -- 172.21.15.76:0/1669193894 learned_addr learned my addr 172.21.15.76:0/1669193894 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:01:18.831 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.830+0000 7f96aed9d700 1 --2- 172.21.15.76:0/1669193894 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f96b0104cb0 0x7f96b0075600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:01:18.831 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.830+0000 7f96ae59c700 1 -- 172.21.15.76:0/1669193894 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f96b0104cb0 msgr2=0x7f96b0075600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:01:18.832 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.830+0000 7f96ae59c700 1 --2- 172.21.15.76:0/1669193894 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f96b0104cb0 0x7f96b0075600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:18.832 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.830+0000 7f96ae59c700 1 -- 172.21.15.76:0/1669193894 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f96b0075fc0 msgr2=0x7f96b0078bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:01:18.832 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.830+0000 7f96ae59c700 1 --2- 172.21.15.76:0/1669193894 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f96b0075fc0 0x7f96b0078bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:18.832 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.830+0000 7f96ae59c700 1 -- 172.21.15.76:0/1669193894 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96a801ad10 con 0x7f96b0075b40 2024-06-02T05:01:18.832 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.830+0000 7f96ae59c700 1 --2- 172.21.15.76:0/1669193894 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96b0075b40 0x7f96b0078650 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f96a000b450 tx=0x7f96a000b760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:01:18.832 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.830+0000 7f9697fff700 1 -- 172.21.15.76:0/1669193894 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96a0011630 con 0x7f96b0075b40 2024-06-02T05:01:18.832 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.831+0000 7f9697fff700 1 -- 172.21.15.76:0/1669193894 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f96a0011c20 con 0x7f96b0075b40 2024-06-02T05:01:18.832 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.831+0000 7f9697fff700 1 -- 172.21.15.76:0/1669193894 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96a0010ba0 con 0x7f96b0075b40 2024-06-02T05:01:18.832 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.831+0000 7f96b50bc700 1 -- 172.21.15.76:0/1669193894 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96b01b3100 con 0x7f96b0075b40 2024-06-02T05:01:18.832 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.831+0000 7f96b50bc700 1 -- 172.21.15.76:0/1669193894 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96b01b35c0 con 0x7f96b0075b40 2024-06-02T05:01:18.837 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.836+0000 7f9697fff700 1 -- 172.21.15.76:0/1669193894 <== mon.2 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f96a0010d00 con 0x7f96b0075b40 2024-06-02T05:01:18.838 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.837+0000 7f9697fff700 1 --2- 172.21.15.76:0/1669193894 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f96980a11a0 0x7f96980a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:01:18.838 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.837+0000 7f9697fff700 1 -- 172.21.15.76:0/1669193894 <== mon.2 v2:172.21.15.119:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f96a00cc2f0 con 0x7f96b0075b40 2024-06-02T05:01:18.838 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.837+0000 7f96aed9d700 1 --2- 172.21.15.76:0/1669193894 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f96980a11a0 0x7f96980a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:01:18.843 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.843+0000 7f96aed9d700 1 --2- 172.21.15.76:0/1669193894 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f96980a11a0 0x7f96980a3660 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f96b0102c60 tx=0x7f96a4009110 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:01:18.843 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.843+0000 7f96c1277b80 1 Processor -- start 2024-06-02T05:01:18.844 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.843+0000 7f96c1277b80 1 -- start start 2024-06-02T05:01:18.844 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.843+0000 7f96c1277b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a2f7acda80 0x55a2f7acdea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:01:18.844 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.843+0000 7f96c1277b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a2f7ace3e0 0x55a2f7acecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:01:18.844 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.843+0000 7f96c1277b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a2f7acf2d0 0x55a2f7acf750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:01:18.844 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.843+0000 7f96c1277b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2f7a250f0 con 0x55a2f7acf2d0 2024-06-02T05:01:18.844 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.843+0000 7f96c1277b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2f7a22ab0 con 0x55a2f7acda80 2024-06-02T05:01:18.845 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.843+0000 7f96c1277b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2f7a1e3a0 con 0x55a2f7ace3e0 2024-06-02T05:01:18.846 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.844+0000 7f96af59e700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a2f7acf2d0 0x55a2f7acf750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:01:18.846 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.844+0000 7f96af59e700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a2f7acf2d0 0x55a2f7acf750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:52924/0 (socket says 172.21.15.76:52924) 2024-06-02T05:01:18.846 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.844+0000 7f96af59e700 1 -- 172.21.15.76:0/3844948089 learned_addr learned my addr 172.21.15.76:0/3844948089 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:01:18.846 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.844+0000 7f96aed9d700 1 --2- 172.21.15.76:0/3844948089 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a2f7acda80 0x55a2f7acdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:01:18.846 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.844+0000 7f96ae59c700 1 --2- 172.21.15.76:0/3844948089 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a2f7ace3e0 0x55a2f7acecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:01:18.846 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.844+0000 7f96aed9d700 1 -- 172.21.15.76:0/3844948089 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a2f7ace3e0 msgr2=0x55a2f7acecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:01:18.846 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.845+0000 7f96aed9d700 1 --2- 172.21.15.76:0/3844948089 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a2f7ace3e0 0x55a2f7acecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:18.846 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.845+0000 7f96aed9d700 1 -- 172.21.15.76:0/3844948089 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a2f7acf2d0 msgr2=0x55a2f7acf750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:01:18.846 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.845+0000 7f96aed9d700 1 --2- 172.21.15.76:0/3844948089 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a2f7acf2d0 0x55a2f7acf750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:18.846 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.845+0000 7f96aed9d700 1 -- 172.21.15.76:0/3844948089 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a2f789f350 con 0x55a2f7acda80 2024-06-02T05:01:18.847 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.845+0000 7f96aed9d700 1 --2- 172.21.15.76:0/3844948089 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a2f7acda80 0x55a2f7acdea0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f96b0104170 tx=0x7f96a4011000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4710b638183fb8a server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:01:18.847 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.845+0000 7f96957fa700 1 -- 172.21.15.76:0/3844948089 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96a4009620 con 0x55a2f7acda80 2024-06-02T05:01:18.847 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.845+0000 7f96957fa700 1 -- 172.21.15.76:0/3844948089 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f96a4015910 con 0x55a2f7acda80 2024-06-02T05:01:18.847 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.845+0000 7f96957fa700 1 -- 172.21.15.76:0/3844948089 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96a4013830 con 0x55a2f7acda80 2024-06-02T05:01:18.849 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.846+0000 7f96c1277b80 1 -- 172.21.15.76:0/3844948089 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a2f7acda80 msgr2=0x55a2f7acdea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:01:18.849 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.846+0000 7f96c1277b80 1 --2- 172.21.15.76:0/3844948089 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a2f7acda80 0x55a2f7acdea0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f96b0104170 tx=0x7f96a4011000 comp rx=0 tx=0).stop 2024-06-02T05:01:18.849 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.846+0000 7f96c1277b80 1 -- 172.21.15.76:0/3844948089 shutdown_connections 2024-06-02T05:01:18.849 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.846+0000 7f96c1277b80 1 --2- 172.21.15.76:0/3844948089 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a2f7acf2d0 0x55a2f7acf750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:18.849 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.846+0000 7f96c1277b80 1 --2- 172.21.15.76:0/3844948089 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a2f7acda80 0x55a2f7acdea0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:18.849 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.846+0000 7f96c1277b80 1 --2- 172.21.15.76:0/3844948089 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a2f7ace3e0 0x55a2f7acecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:18.849 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.846+0000 7f96c1277b80 1 -- 172.21.15.76:0/3844948089 >> 172.21.15.76:0/3844948089 conn(0x55a2f7a2c1b0 msgr2=0x55a2f7aca440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:01:18.850 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.846+0000 7f96c1277b80 1 -- 172.21.15.76:0/3844948089 shutdown_connections 2024-06-02T05:01:18.850 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.846+0000 7f96c1277b80 1 -- 172.21.15.76:0/3844948089 wait complete. 2024-06-02T05:01:18.850 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.847+0000 7f96c1277b80 1 -- start start 2024-06-02T05:01:18.850 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.847+0000 7f96c1277b80 1 Processor -- start 2024-06-02T05:01:18.850 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.847+0000 7f96c1277b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a2f7acda80 0x55a2f7ad78e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:01:18.850 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.847+0000 7f96c1277b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a2f7ace3e0 0x55a2f7ad7e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:01:18.850 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.847+0000 7f96c1277b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a2f7acf2d0 0x55a2f7adee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:01:18.850 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.847+0000 7f96c1277b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2f79ba500 con 0x55a2f7acda80 2024-06-02T05:01:18.850 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.847+0000 7f96c1277b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2f79ba1a0 con 0x55a2f7acf2d0 2024-06-02T05:01:18.850 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.847+0000 7f96c1277b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2f78a1640 con 0x55a2f7ace3e0 2024-06-02T05:01:18.850 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.847+0000 7f96c1277b80 10 client.0 _ll_register_callbacks cb 0x55a2f79c3ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T05:01:18.851 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.848+0000 7f96af59e700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a2f7acf2d0 0x55a2f7adee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:01:18.851 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.848+0000 7f96af59e700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a2f7acf2d0 0x55a2f7adee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:56012/0 (socket says 172.21.15.76:56012) 2024-06-02T05:01:18.851 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.848+0000 7f96af59e700 1 -- 172.21.15.76:0/2840659250 learned_addr learned my addr 172.21.15.76:0/2840659250 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:01:18.851 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.848+0000 7f96ae59c700 1 --2- 172.21.15.76:0/2840659250 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a2f7ace3e0 0x55a2f7ad7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:01:18.851 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.848+0000 7f96aed9d700 1 --2- 172.21.15.76:0/2840659250 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a2f7acda80 0x55a2f7ad78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:01:18.851 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.848+0000 7f96af59e700 1 -- 172.21.15.76:0/2840659250 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a2f7ace3e0 msgr2=0x55a2f7ad7e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:01:18.851 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.848+0000 7f96af59e700 1 --2- 172.21.15.76:0/2840659250 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a2f7ace3e0 0x55a2f7ad7e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:18.851 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.848+0000 7f96af59e700 1 -- 172.21.15.76:0/2840659250 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a2f7acda80 msgr2=0x55a2f7ad78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:01:18.851 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.848+0000 7f96af59e700 1 --2- 172.21.15.76:0/2840659250 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a2f7acda80 0x55a2f7ad78e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:18.851 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.848+0000 7f96af59e700 1 -- 172.21.15.76:0/2840659250 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96a400e690 con 0x55a2f7acf2d0 2024-06-02T05:01:18.852 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.849+0000 7f96af59e700 1 --2- 172.21.15.76:0/2840659250 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a2f7acf2d0 0x55a2f7adee60 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f96a801c0d0 tx=0x7f96a8003c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe11b37d7ffaf186 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:01:18.853 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.849+0000 7f9692ff5700 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-06-02T05:01:18.853 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.849+0000 7f9692ff5700 1 -- 172.21.15.76:0/2840659250 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96a801f040 con 0x55a2f7acf2d0 2024-06-02T05:01:18.853 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.849+0000 7f9692ff5700 1 -- 172.21.15.76:0/2840659250 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f96a80052e0 con 0x55a2f7acf2d0 2024-06-02T05:01:18.853 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.849+0000 7f96c1277b80 1 -- 172.21.15.76:0/2840659250 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a2f7977210 con 0x55a2f7acf2d0 2024-06-02T05:01:18.853 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.850+0000 7f9692ff5700 1 -- 172.21.15.76:0/2840659250 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f96a801a710 con 0x55a2f7acf2d0 2024-06-02T05:01:18.853 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.850+0000 7f96c1277b80 10 client.26066 fetch_fsmap learned FSMap version 36 2024-06-02T05:01:18.853 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.850+0000 7f96c1277b80 1 -- 172.21.15.76:0/2840659250 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55a2f784bb00 con 0x55a2f7acf2d0 2024-06-02T05:01:18.853 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.851+0000 7f9692ff5700 1 -- 172.21.15.76:0/2840659250 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55a2f7977210 con 0x55a2f7acf2d0 2024-06-02T05:01:18.853 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.851+0000 7f9692ff5700 1 -- 172.21.15.76:0/2840659250 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f96a802a030 con 0x55a2f7acf2d0 2024-06-02T05:01:18.853 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.851+0000 7f96c1277b80 10 client.26066 fetch_fsmap finished waiting for FSMap version 36 2024-06-02T05:01:18.853 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.851+0000 7f96c1277b80 10 client.26066 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T05:01:18.853 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.851+0000 7f96c1277b80 20 client.26066 populate_metadata read hostname 'smithi076' 2024-06-02T05:01:18.854 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.851+0000 7f96c1277b80 1 --2- 172.21.15.76:0/2840659250 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55a2f7ae36c0 0x55a2f7ae5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:01:18.854 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.851+0000 7f96c1277b80 4 client.26066 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T05:01:18.854 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.851+0000 7f96c1277b80 1 -- 172.21.15.76:0/2840659250 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a2f7a9d7b0 con 0x55a2f7ae36c0 2024-06-02T05:01:18.854 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.851+0000 7f96aed9d700 1 --2- 172.21.15.76:0/2840659250 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55a2f7ae36c0 0x55a2f7ae5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:01:18.854 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.852+0000 7f96aed9d700 1 --2- 172.21.15.76:0/2840659250 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55a2f7ae36c0 0x55a2f7ae5ae0 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b4a4482a486d6245 server_cookie=14daabfc6d384388 in_seq=0 out_seq=0 2024-06-02T05:01:18.854 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.852+0000 7f9692ff5700 10 client.26066 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T05:01:18.855 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.852+0000 7f9692ff5700 1 -- 172.21.15.76:0/2840659250 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55a2f7a9d7b0 con 0x55a2f7ae36c0 2024-06-02T05:01:18.855 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.852+0000 7f9692ff5700 10 client.26066 handle_command_reply: tid=0 2024-06-02T05:01:18.855 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.852+0000 7f96c1277b80 1 client.26066 shutdown 2024-06-02T05:01:18.855 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.853+0000 7f96c1277b80 1 -- 172.21.15.76:0/2840659250 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a2f7acf2d0 msgr2=0x55a2f7adee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:01:18.855 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.853+0000 7f96c1277b80 1 --2- 172.21.15.76:0/2840659250 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a2f7acf2d0 0x55a2f7adee60 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f96a801c0d0 tx=0x7f96a8003c30 comp rx=0 tx=0).stop 2024-06-02T05:01:18.855 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.853+0000 7f96c1277b80 1 -- 172.21.15.76:0/2840659250 shutdown_connections 2024-06-02T05:01:18.856 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.853+0000 7f96c1277b80 1 --2- 172.21.15.76:0/2840659250 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55a2f7ae36c0 0x55a2f7ae5ae0 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:18.856 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.853+0000 7f96c1277b80 1 --2- 172.21.15.76:0/2840659250 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a2f7acf2d0 0x55a2f7adee60 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:18.856 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.853+0000 7f96c1277b80 1 --2- 172.21.15.76:0/2840659250 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a2f7acda80 0x55a2f7ad78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:18.856 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.853+0000 7f96c1277b80 1 --2- 172.21.15.76:0/2840659250 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a2f7ace3e0 0x55a2f7ad7e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:18.856 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.853+0000 7f96c1277b80 1 -- 172.21.15.76:0/2840659250 >> 172.21.15.76:0/2840659250 conn(0x55a2f7a2c1b0 msgr2=0x55a2f7ac8860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:01:18.856 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.853+0000 7f9692ff5700 0 client.26066 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T05:01:18.856 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.853+0000 7f96c1277b80 1 -- 172.21.15.76:0/2840659250 shutdown_connections 2024-06-02T05:01:18.856 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.853+0000 7f96c1277b80 1 -- 172.21.15.76:0/2840659250 wait complete. 2024-06-02T05:01:18.856 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.853+0000 7f96c1277b80 20 client.26066 trim_cache size 0 max 16384 2024-06-02T05:01:18.879 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.878+0000 7f96c1277b80 1 Processor -- start 2024-06-02T05:01:18.883 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.878+0000 7f96c1277b80 1 -- start start 2024-06-02T05:01:18.884 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.878+0000 7f96c1277b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a2f7acda80 0x55a2f7ae56d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:01:18.884 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.878+0000 7f96c1277b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a2f7ace3e0 0x55a2f7adee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:01:18.884 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.878+0000 7f96c1277b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a2f7acf2d0 0x55a2f7aea440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:01:18.884 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.878+0000 7f96c1277b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2f7adffe0 con 0x55a2f7ace3e0 2024-06-02T05:01:18.884 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.878+0000 7f96c1277b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2f7ad7450 con 0x55a2f7acda80 2024-06-02T05:01:18.884 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.878+0000 7f96c1277b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2f7ad8ad0 con 0x55a2f7acf2d0 2024-06-02T05:01:18.884 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.879+0000 7f96aed9d700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a2f7acda80 0x55a2f7ae56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:01:18.884 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.879+0000 7f96aed9d700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a2f7acda80 0x55a2f7ae56d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:56026/0 (socket says 172.21.15.76:56026) 2024-06-02T05:01:18.884 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.879+0000 7f96aed9d700 1 -- 172.21.15.76:0/3239418122 learned_addr learned my addr 172.21.15.76:0/3239418122 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:01:18.884 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.879+0000 7f96af59e700 1 --2- 172.21.15.76:0/3239418122 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a2f7acf2d0 0x55a2f7aea440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:01:18.885 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.879+0000 7f96ae59c700 1 --2- 172.21.15.76:0/3239418122 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a2f7ace3e0 0x55a2f7adee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:01:18.885 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.879+0000 7f96aed9d700 1 -- 172.21.15.76:0/3239418122 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a2f7acf2d0 msgr2=0x55a2f7aea440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:01:18.885 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.879+0000 7f96aed9d700 1 --2- 172.21.15.76:0/3239418122 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a2f7acf2d0 0x55a2f7aea440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:18.885 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.879+0000 7f96aed9d700 1 -- 172.21.15.76:0/3239418122 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a2f7ace3e0 msgr2=0x55a2f7adee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:01:18.885 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.879+0000 7f96aed9d700 1 --2- 172.21.15.76:0/3239418122 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a2f7ace3e0 0x55a2f7adee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:18.885 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.879+0000 7f96aed9d700 1 -- 172.21.15.76:0/3239418122 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a2f79e4500 con 0x55a2f7acda80 2024-06-02T05:01:18.885 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.880+0000 7f96aed9d700 1 --2- 172.21.15.76:0/3239418122 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a2f7acda80 0x55a2f7ae56d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f96a400ed40 tx=0x7f96a4006df0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6cc35d22e9238ced server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:01:18.885 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.880+0000 7f9695ffb700 1 -- 172.21.15.76:0/3239418122 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96a4035030 con 0x55a2f7acda80 2024-06-02T05:01:18.885 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.880+0000 7f9695ffb700 1 -- 172.21.15.76:0/3239418122 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f96a4031350 con 0x55a2f7acda80 2024-06-02T05:01:18.885 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.880+0000 7f9695ffb700 1 -- 172.21.15.76:0/3239418122 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96a40042a0 con 0x55a2f7acda80 2024-06-02T05:01:18.885 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.881+0000 7f96c1277b80 1 -- 172.21.15.76:0/3239418122 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a2f7acda80 msgr2=0x55a2f7ae56d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:01:18.885 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.881+0000 7f96c1277b80 1 --2- 172.21.15.76:0/3239418122 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a2f7acda80 0x55a2f7ae56d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f96a400ed40 tx=0x7f96a4006df0 comp rx=0 tx=0).stop 2024-06-02T05:01:18.885 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.881+0000 7f96c1277b80 1 -- 172.21.15.76:0/3239418122 shutdown_connections 2024-06-02T05:01:18.886 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.881+0000 7f96c1277b80 1 --2- 172.21.15.76:0/3239418122 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a2f7acf2d0 0x55a2f7aea440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:18.886 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.881+0000 7f96c1277b80 1 --2- 172.21.15.76:0/3239418122 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a2f7acda80 0x55a2f7ae56d0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:18.886 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.881+0000 7f96c1277b80 1 --2- 172.21.15.76:0/3239418122 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a2f7ace3e0 0x55a2f7adee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:18.886 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.881+0000 7f96c1277b80 1 -- 172.21.15.76:0/3239418122 >> 172.21.15.76:0/3239418122 conn(0x55a2f7a2c1b0 msgr2=0x55a2f7ad58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:01:18.886 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.881+0000 7f96c1277b80 1 -- 172.21.15.76:0/3239418122 shutdown_connections 2024-06-02T05:01:18.886 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.881+0000 7f96c1277b80 1 -- 172.21.15.76:0/3239418122 wait complete. 2024-06-02T05:01:18.886 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.882+0000 7f96c1277b80 1 -- start start 2024-06-02T05:01:18.886 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.882+0000 7f96c1277b80 1 Processor -- start 2024-06-02T05:01:18.886 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.882+0000 7f96c1277b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a2f7acda80 0x55a2f7adc0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:01:18.886 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.882+0000 7f96c1277b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a2f7ace3e0 0x55a2f7adc5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:01:18.886 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.882+0000 7f96c1277b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a2f7acf2d0 0x55a2f7add560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:01:18.886 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.882+0000 7f96c1277b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2f7addaa0 con 0x55a2f7acf2d0 2024-06-02T05:01:18.886 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.882+0000 7f96c1277b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2f7addc10 con 0x55a2f7acda80 2024-06-02T05:01:18.887 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.882+0000 7f96c1277b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2f7adddd0 con 0x55a2f7ace3e0 2024-06-02T05:01:18.887 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.882+0000 7f96c1277b80 10 client.0 _ll_register_callbacks cb 0x55a2f79c3ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T05:01:18.887 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.882+0000 7f96ae59c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a2f7ace3e0 0x55a2f7adc5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:01:18.887 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.883+0000 7f96aed9d700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a2f7acda80 0x55a2f7adc0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:01:18.887 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.883+0000 7f96ae59c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a2f7ace3e0 0x55a2f7adc5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:39028/0 (socket says 172.21.15.76:39028) 2024-06-02T05:01:18.887 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.883+0000 7f96ae59c700 1 -- 172.21.15.76:0/3717241772 learned_addr learned my addr 172.21.15.76:0/3717241772 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:01:18.888 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.883+0000 7f96ae59c700 1 -- 172.21.15.76:0/3717241772 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a2f7acda80 msgr2=0x55a2f7adc0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:01:18.888 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.883+0000 7f96ae59c700 1 --2- 172.21.15.76:0/3717241772 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a2f7acda80 0x55a2f7adc0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:18.888 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.883+0000 7f96ae59c700 1 -- 172.21.15.76:0/3717241772 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a2f7acf2d0 msgr2=0x55a2f7add560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:01:18.888 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.883+0000 7f96ae59c700 1 --2- 172.21.15.76:0/3717241772 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a2f7acf2d0 0x55a2f7add560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:18.888 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.883+0000 7f96ae59c700 1 -- 172.21.15.76:0/3717241772 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a2f789f350 con 0x55a2f7ace3e0 2024-06-02T05:01:18.888 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.884+0000 7f96ae59c700 1 --2- 172.21.15.76:0/3717241772 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a2f7ace3e0 0x55a2f7adc5e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f96a0099330 tx=0x7f96a0098df0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5944925f64ba9045 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:01:18.888 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.887+0000 7f9692ff5700 10 client.0 ms_handle_connect on v2:172.21.15.192:3300/0 2024-06-02T05:01:18.888 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.887+0000 7f9692ff5700 1 -- 172.21.15.76:0/3717241772 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96a0098a90 con 0x55a2f7ace3e0 2024-06-02T05:01:18.888 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.887+0000 7f9692ff5700 1 -- 172.21.15.76:0/3717241772 <== mon.1 v2:172.21.15.192:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f96a0099aa0 con 0x55a2f7ace3e0 2024-06-02T05:01:18.888 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.887+0000 7f96c1277b80 1 -- 172.21.15.76:0/3717241772 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f96a4015910 con 0x55a2f7ace3e0 2024-06-02T05:01:18.890 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.887+0000 7f9692ff5700 1 -- 172.21.15.76:0/3717241772 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f96a00993a0 con 0x55a2f7ace3e0 2024-06-02T05:01:18.890 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.890+0000 7f96c1277b80 10 client.26047 fetch_fsmap learned FSMap version 36 2024-06-02T05:01:18.890 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.890+0000 7f96c1277b80 1 -- 172.21.15.76:0/3717241772 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55a2f78a3c70 con 0x55a2f7ace3e0 2024-06-02T05:01:18.891 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.890+0000 7f9692ff5700 1 -- 172.21.15.76:0/3717241772 <== mon.1 v2:172.21.15.192:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f96a4015910 con 0x55a2f7ace3e0 2024-06-02T05:01:18.891 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.890+0000 7f9692ff5700 1 -- 172.21.15.76:0/3717241772 <== mon.1 v2:172.21.15.192:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f96a00a1390 con 0x55a2f7ace3e0 2024-06-02T05:01:18.891 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.890+0000 7f96c1277b80 10 client.26047 fetch_fsmap finished waiting for FSMap version 36 2024-06-02T05:01:18.891 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.890+0000 7f96c1277b80 10 client.26047 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T05:01:18.891 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.890+0000 7f96c1277b80 20 client.26047 populate_metadata read hostname 'smithi076' 2024-06-02T05:01:18.892 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.890+0000 7f96c1277b80 1 --2- 172.21.15.76:0/3717241772 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55a2f7b39f50 0x55a2f7b3c370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:01:18.892 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.890+0000 7f96c1277b80 4 client.26047 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T05:01:18.892 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.890+0000 7f96c1277b80 1 -- 172.21.15.76:0/3717241772 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55a2f7a16e60 con 0x55a2f7b39f50 2024-06-02T05:01:18.892 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.891+0000 7f96aed9d700 1 --2- 172.21.15.76:0/3717241772 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55a2f7b39f50 0x55a2f7b3c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:01:18.894 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.893+0000 7f96aed9d700 1 --2- 172.21.15.76:0/3717241772 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55a2f7b39f50 0x55a2f7b3c370 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f6a443b3da247d29 server_cookie=3a86b33c58a88452 in_seq=0 out_seq=0 2024-06-02T05:01:18.894 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.893+0000 7f9692ff5700 10 client.26047 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T05:01:18.928 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.927+0000 7f9692ff5700 1 -- 172.21.15.76:0/3717241772 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55a2f7a16e60 con 0x55a2f7b39f50 2024-06-02T05:01:18.928 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.927+0000 7f9692ff5700 10 client.26047 handle_command_reply: tid=0 2024-06-02T05:01:18.928 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.927+0000 7f96c1277b80 1 client.26047 shutdown 2024-06-02T05:01:18.936 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.935+0000 7f96c1277b80 1 -- 172.21.15.76:0/3717241772 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a2f7ace3e0 msgr2=0x55a2f7adc5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:01:18.936 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.935+0000 7f96c1277b80 1 --2- 172.21.15.76:0/3717241772 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a2f7ace3e0 0x55a2f7adc5e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f96a0099330 tx=0x7f96a0098df0 comp rx=0 tx=0).stop 2024-06-02T05:01:18.936 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.935+0000 7f96c1277b80 1 -- 172.21.15.76:0/3717241772 shutdown_connections 2024-06-02T05:01:18.936 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.935+0000 7f96c1277b80 1 --2- 172.21.15.76:0/3717241772 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55a2f7b39f50 0x55a2f7b3c370 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:18.936 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.935+0000 7f96c1277b80 1 --2- 172.21.15.76:0/3717241772 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a2f7acf2d0 0x55a2f7add560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:18.936 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.935+0000 7f96c1277b80 1 --2- 172.21.15.76:0/3717241772 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a2f7acda80 0x55a2f7adc0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:18.936 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.935+0000 7f96c1277b80 1 --2- 172.21.15.76:0/3717241772 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a2f7ace3e0 0x55a2f7adc5e0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:18.937 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.935+0000 7f96c1277b80 1 -- 172.21.15.76:0/3717241772 >> 172.21.15.76:0/3717241772 conn(0x55a2f7a2c1b0 msgr2=0x55a2f7ae56d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:01:18.937 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.935+0000 7f9692ff5700 0 client.26047 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T05:01:18.937 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.935+0000 7f96c1277b80 1 -- 172.21.15.76:0/3717241772 shutdown_connections 2024-06-02T05:01:18.937 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.935+0000 7f96c1277b80 1 -- 172.21.15.76:0/3717241772 wait complete. 2024-06-02T05:01:18.941 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:{ 2024-06-02T05:01:18.942 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "message": "", 2024-06-02T05:01:18.942 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "return_code": 0 2024-06-02T05:01:18.942 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:} 2024-06-02T05:01:18.942 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.936+0000 7f96c1277b80 20 client.26047 trim_cache size 0 max 16384 2024-06-02T05:01:18.946 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.946+0000 7f96b50bc700 1 -- 172.21.15.76:0/1669193894 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f96980a11a0 msgr2=0x7f96980a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:01:18.946 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.946+0000 7f96b50bc700 1 --2- 172.21.15.76:0/1669193894 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f96980a11a0 0x7f96980a3660 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f96b0102c60 tx=0x7f96a4009110 comp rx=0 tx=0).stop 2024-06-02T05:01:18.946 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.946+0000 7f96b50bc700 1 -- 172.21.15.76:0/1669193894 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96b0075b40 msgr2=0x7f96b0078650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:01:18.946 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.946+0000 7f96b50bc700 1 --2- 172.21.15.76:0/1669193894 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96b0075b40 0x7f96b0078650 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f96a000b450 tx=0x7f96a000b760 comp rx=0 tx=0).stop 2024-06-02T05:01:18.950 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.950+0000 7f96b50bc700 1 -- 172.21.15.76:0/1669193894 shutdown_connections 2024-06-02T05:01:18.950 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.950+0000 7f96b50bc700 1 --2- 172.21.15.76:0/1669193894 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f96b0075fc0 0x7f96b0078bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:18.950 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.950+0000 7f96b50bc700 1 --2- 172.21.15.76:0/1669193894 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f96b0104cb0 0x7f96b0075600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:18.950 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.950+0000 7f96b50bc700 1 --2- 172.21.15.76:0/1669193894 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f96980a11a0 0x7f96980a3660 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:18.951 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.950+0000 7f96b50bc700 1 --2- 172.21.15.76:0/1669193894 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96b0075b40 0x7f96b0078650 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:18.951 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.950+0000 7f96b50bc700 1 -- 172.21.15.76:0/1669193894 >> 172.21.15.76:0/1669193894 conn(0x7f96b00fe6b0 msgr2=0x7f96b006ffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:01:18.951 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.950+0000 7f96b50bc700 1 -- 172.21.15.76:0/1669193894 shutdown_connections 2024-06-02T05:01:18.952 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:18.951+0000 7f96b50bc700 1 -- 172.21.15.76:0/1669193894 wait complete. 2024-06-02T05:01:19.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:01:19 smithi192 ceph-mon[47933]: pgmap v620: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 11 MiB/s wr, 740 op/s 2024-06-02T05:01:19.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:01:19 smithi076 ceph-mon[42935]: pgmap v620: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 11 MiB/s wr, 740 op/s 2024-06-02T05:01:20.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:01:19 smithi119 ceph-mon[46633]: pgmap v620: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 11 MiB/s wr, 740 op/s 2024-06-02T05:01:21.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 630.0 s, 635.6 tps, lat 157.534 ms stddev 87.028 2024-06-02T05:01:21.940 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:01:21 smithi192 ceph-mon[47933]: pgmap v621: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 11 MiB/s wr, 814 op/s 2024-06-02T05:01:21.940 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:01:21 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T05:01:21.989 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:01:21 smithi076 ceph-mon[42935]: pgmap v621: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 11 MiB/s wr, 814 op/s 2024-06-02T05:01:21.989 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:01:21 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T05:01:22.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:01:21 smithi119 ceph-mon[46633]: pgmap v621: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 11 MiB/s wr, 814 op/s 2024-06-02T05:01:22.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:01:21 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T05:01:22.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:01:22 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T05:01:22.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:01:22 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T05:01:22.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:01:22 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T05:01:22.989 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:01:22 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T05:01:22.990 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:01:22 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T05:01:22.990 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:01:22 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T05:01:23.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:01:22 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T05:01:23.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:01:22 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T05:01:23.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:01:22 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T05:01:23.978 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:01:23 smithi192 ceph-mon[47933]: pgmap v622: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 11 MiB/s wr, 789 op/s 2024-06-02T05:01:23.983 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:01:23 smithi076 ceph-mon[42935]: pgmap v622: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 11 MiB/s wr, 789 op/s 2024-06-02T05:01:24.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:01:23 smithi119 ceph-mon[46633]: pgmap v622: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 11 MiB/s wr, 789 op/s 2024-06-02T05:01:24.987 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:01:24 smithi076 ceph-mon[42935]: pgmap v623: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 9.7 MiB/s wr, 715 op/s 2024-06-02T05:01:25.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:01:24 smithi119 ceph-mon[46633]: pgmap v623: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 9.7 MiB/s wr, 715 op/s 2024-06-02T05:01:25.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:01:24 smithi192 ceph-mon[47933]: pgmap v623: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 9.7 MiB/s wr, 715 op/s 2024-06-02T05:01:26.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 635.0 s, 623.8 tps, lat 159.652 ms stddev 58.456 2024-06-02T05:01:27.963 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:01:27 smithi192 ceph-mon[47933]: pgmap v624: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 11 MiB/s wr, 820 op/s 2024-06-02T05:01:27.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:01:27 smithi076 ceph-mon[42935]: pgmap v624: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 11 MiB/s wr, 820 op/s 2024-06-02T05:01:28.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:01:27 smithi119 ceph-mon[46633]: pgmap v624: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 11 MiB/s wr, 820 op/s 2024-06-02T05:01:29.955 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:01:29 smithi192 ceph-mon[47933]: pgmap v625: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 9.8 MiB/s wr, 743 op/s 2024-06-02T05:01:29.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:01:29 smithi076 ceph-mon[42935]: pgmap v625: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 9.8 MiB/s wr, 743 op/s 2024-06-02T05:01:30.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:01:29 smithi119 ceph-mon[46633]: pgmap v625: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 9.8 MiB/s wr, 743 op/s 2024-06-02T05:01:31.316 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 640.0 s, 618.0 tps, lat 161.826 ms stddev 58.333 2024-06-02T05:01:31.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:01:31 smithi192 ceph-mon[47933]: pgmap v626: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 11 MiB/s wr, 828 op/s 2024-06-02T05:01:31.985 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:01:31 smithi076 ceph-mon[42935]: pgmap v626: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 11 MiB/s wr, 828 op/s 2024-06-02T05:01:32.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:01:31 smithi119 ceph-mon[46633]: pgmap v626: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 11 MiB/s wr, 828 op/s 2024-06-02T05:01:32.141 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.139+0000 7f9a3b09f700 1 -- 172.21.15.76:0/3534648 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9a340fff00 msgr2=0x7f9a34100380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:01:32.141 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.139+0000 7f9a3b09f700 1 --2- 172.21.15.76:0/3534648 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9a340fff00 0x7f9a34100380 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9a280098f0 tx=0x7f9a28009c00 comp rx=0 tx=0).stop 2024-06-02T05:01:32.141 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.140+0000 7f9a3b09f700 1 -- 172.21.15.76:0/3534648 shutdown_connections 2024-06-02T05:01:32.141 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.140+0000 7f9a3b09f700 1 --2- 172.21.15.76:0/3534648 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9a341008c0 0x7f9a34105160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:32.141 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.140+0000 7f9a3b09f700 1 --2- 172.21.15.76:0/3534648 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9a340ff1f0 0x7f9a340ff610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:32.141 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.140+0000 7f9a3b09f700 1 --2- 172.21.15.76:0/3534648 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9a340fff00 0x7f9a34100380 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:32.141 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.140+0000 7f9a3b09f700 1 -- 172.21.15.76:0/3534648 >> 172.21.15.76:0/3534648 conn(0x7f9a340faaf0 msgr2=0x7f9a340fcf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:01:32.141 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.140+0000 7f9a3b09f700 1 -- 172.21.15.76:0/3534648 shutdown_connections 2024-06-02T05:01:32.142 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.140+0000 7f9a3b09f700 1 -- 172.21.15.76:0/3534648 wait complete. 2024-06-02T05:01:32.142 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.141+0000 7f9a3b09f700 1 Processor -- start 2024-06-02T05:01:32.143 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.142+0000 7f9a3b09f700 1 -- start start 2024-06-02T05:01:32.143 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.142+0000 7f9a3b09f700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9a340ff1f0 0x7f9a3410ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:01:32.143 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.142+0000 7f9a3b09f700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9a340fff00 0x7f9a34110460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:01:32.143 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.142+0000 7f9a3b09f700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9a341008c0 0x7f9a340710a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:01:32.143 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.142+0000 7f9a3b09f700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a34071670 con 0x7f9a340ff1f0 2024-06-02T05:01:32.143 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.142+0000 7f9a3b09f700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a340717e0 con 0x7f9a341008c0 2024-06-02T05:01:32.143 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.142+0000 7f9a3b09f700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a340719a0 con 0x7f9a340fff00 2024-06-02T05:01:32.144 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.142+0000 7f9a3963c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9a341008c0 0x7f9a340710a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:01:32.144 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.142+0000 7f9a3963c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9a341008c0 0x7f9a340710a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:57342/0 (socket says 172.21.15.76:57342) 2024-06-02T05:01:32.144 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.142+0000 7f9a3963c700 1 -- 172.21.15.76:0/134989583 learned_addr learned my addr 172.21.15.76:0/134989583 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:01:32.144 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.143+0000 7f9a3963c700 1 -- 172.21.15.76:0/134989583 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9a340fff00 msgr2=0x7f9a34110460 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-02T05:01:32.145 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.143+0000 7f9a3963c700 1 --2- 172.21.15.76:0/134989583 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9a340fff00 0x7f9a34110460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:32.145 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.143+0000 7f9a3963c700 1 -- 172.21.15.76:0/134989583 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9a340ff1f0 msgr2=0x7f9a3410ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:01:32.145 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.143+0000 7f9a3963c700 1 --2- 172.21.15.76:0/134989583 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9a340ff1f0 0x7f9a3410ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:32.145 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.143+0000 7f9a3963c700 1 -- 172.21.15.76:0/134989583 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a28009520 con 0x7f9a341008c0 2024-06-02T05:01:32.145 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.143+0000 7f9a3963c700 1 --2- 172.21.15.76:0/134989583 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9a341008c0 0x7f9a340710a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c01d110 tx=0x7f9a2c01d4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:01:32.145 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.143+0000 7f9a31ffb700 1 -- 172.21.15.76:0/134989583 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a2c028070 con 0x7f9a341008c0 2024-06-02T05:01:32.145 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.144+0000 7f9a31ffb700 1 -- 172.21.15.76:0/134989583 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9a2c01f050 con 0x7f9a341008c0 2024-06-02T05:01:32.145 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.144+0000 7f9a31ffb700 1 -- 172.21.15.76:0/134989583 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a2c018970 con 0x7f9a341008c0 2024-06-02T05:01:32.145 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.144+0000 7f9a3b09f700 1 -- 172.21.15.76:0/134989583 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a34071bc0 con 0x7f9a341008c0 2024-06-02T05:01:32.146 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.144+0000 7f9a3b09f700 1 -- 172.21.15.76:0/134989583 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a34072080 con 0x7f9a341008c0 2024-06-02T05:01:32.150 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.149+0000 7f9a4725ab80 1 Processor -- start 2024-06-02T05:01:32.150 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.149+0000 7f9a4725ab80 1 -- start start 2024-06-02T05:01:32.150 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.149+0000 7f9a4725ab80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56473e2b5a80 0x56473e2b5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:01:32.151 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.149+0000 7f9a4725ab80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56473e2b63e0 0x56473e2b6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:01:32.151 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.149+0000 7f9a4725ab80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56473e2b72d0 0x56473e2b7750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:01:32.151 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.149+0000 7f9a4725ab80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x56473e20d0f0 con 0x56473e2b5a80 2024-06-02T05:01:32.151 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.149+0000 7f9a4725ab80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x56473e20aab0 con 0x56473e2b72d0 2024-06-02T05:01:32.151 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.149+0000 7f9a4725ab80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x56473e2063a0 con 0x56473e2b63e0 2024-06-02T05:01:32.151 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.150+0000 7f9a33fff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56473e2b72d0 0x56473e2b7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:01:32.151 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.150+0000 7f9a33fff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56473e2b72d0 0x56473e2b7750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:57356/0 (socket says 172.21.15.76:57356) 2024-06-02T05:01:32.151 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.150+0000 7f9a33fff700 1 -- 172.21.15.76:0/2681748920 learned_addr learned my addr 172.21.15.76:0/2681748920 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:01:32.151 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.150+0000 7f9a33fff700 1 --2- 172.21.15.76:0/2681748920 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56473e2b5a80 0x56473e2b5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:01:32.151 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.150+0000 7f9a38e3b700 1 --2- 172.21.15.76:0/2681748920 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56473e2b63e0 0x56473e2b6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:01:32.152 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.150+0000 7f9a33fff700 1 -- 172.21.15.76:0/2681748920 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56473e2b63e0 msgr2=0x56473e2b6cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:01:32.152 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.150+0000 7f9a33fff700 1 --2- 172.21.15.76:0/2681748920 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56473e2b63e0 0x56473e2b6cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:32.152 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.151+0000 7f9a33fff700 1 -- 172.21.15.76:0/2681748920 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56473e2b5a80 msgr2=0x56473e2b5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:01:32.152 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.151+0000 7f9a33fff700 1 --2- 172.21.15.76:0/2681748920 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56473e2b5a80 0x56473e2b5ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:32.153 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.151+0000 7f9a33fff700 1 -- 172.21.15.76:0/2681748920 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56473e087350 con 0x56473e2b72d0 2024-06-02T05:01:32.153 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.151+0000 7f9a33fff700 1 --2- 172.21.15.76:0/2681748920 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56473e2b72d0 0x56473e2b7750 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f9a28016000 tx=0x7f9a28009f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8ec5a86e6a9117e server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:01:32.153 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.151+0000 7f9a31ffb700 1 -- 172.21.15.76:0/134989583 <== mon.2 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f9a2c004ad0 con 0x7f9a341008c0 2024-06-02T05:01:32.153 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.151+0000 7f9a1effd700 1 -- 172.21.15.76:0/2681748920 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a2800fda0 con 0x56473e2b72d0 2024-06-02T05:01:32.153 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.151+0000 7f9a1effd700 1 -- 172.21.15.76:0/2681748920 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9a28005110 con 0x56473e2b72d0 2024-06-02T05:01:32.153 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.151+0000 7f9a1effd700 1 -- 172.21.15.76:0/2681748920 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a2800b8e0 con 0x56473e2b72d0 2024-06-02T05:01:32.154 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.152+0000 7f9a31ffb700 1 --2- 172.21.15.76:0/134989583 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f9a240a1270 0x7f9a240a3730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:01:32.154 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.152+0000 7f9a31ffb700 1 -- 172.21.15.76:0/134989583 <== mon.2 v2:172.21.15.119:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f9a2c0dd810 con 0x7f9a341008c0 2024-06-02T05:01:32.154 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.152+0000 7f9a4725ab80 1 -- 172.21.15.76:0/2681748920 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56473e2b72d0 msgr2=0x56473e2b7750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:01:32.154 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.152+0000 7f9a4725ab80 1 --2- 172.21.15.76:0/2681748920 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56473e2b72d0 0x56473e2b7750 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f9a28016000 tx=0x7f9a28009f90 comp rx=0 tx=0).stop 2024-06-02T05:01:32.154 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.152+0000 7f9a4725ab80 1 -- 172.21.15.76:0/2681748920 shutdown_connections 2024-06-02T05:01:32.154 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.152+0000 7f9a4725ab80 1 --2- 172.21.15.76:0/2681748920 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56473e2b72d0 0x56473e2b7750 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:32.154 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.152+0000 7f9a4725ab80 1 --2- 172.21.15.76:0/2681748920 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56473e2b5a80 0x56473e2b5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:32.154 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.152+0000 7f9a4725ab80 1 --2- 172.21.15.76:0/2681748920 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56473e2b63e0 0x56473e2b6cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:32.154 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.152+0000 7f9a4725ab80 1 -- 172.21.15.76:0/2681748920 >> 172.21.15.76:0/2681748920 conn(0x56473e2141b0 msgr2=0x56473e2b2440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:01:32.155 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.152+0000 7f9a38e3b700 1 --2- 172.21.15.76:0/134989583 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f9a240a1270 0x7f9a240a3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:01:32.155 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.153+0000 7f9a4725ab80 1 -- 172.21.15.76:0/2681748920 shutdown_connections 2024-06-02T05:01:32.155 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.153+0000 7f9a4725ab80 1 -- 172.21.15.76:0/2681748920 wait complete. 2024-06-02T05:01:32.155 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.153+0000 7f9a4725ab80 1 -- start start 2024-06-02T05:01:32.155 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.153+0000 7f9a4725ab80 1 Processor -- start 2024-06-02T05:01:32.156 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.154+0000 7f9a4725ab80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56473e2b5a80 0x56473e2bf830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:01:32.156 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.154+0000 7f9a4725ab80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56473e2b63e0 0x56473e2bfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:01:32.157 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.154+0000 7f9a4725ab80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56473e2b72d0 0x56473e2c6db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:01:32.157 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.154+0000 7f9a4725ab80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x56473e1a2500 con 0x56473e2b72d0 2024-06-02T05:01:32.157 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.154+0000 7f9a4725ab80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x56473e1a21a0 con 0x56473e2b63e0 2024-06-02T05:01:32.157 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.154+0000 7f9a4725ab80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x56473e089640 con 0x56473e2b5a80 2024-06-02T05:01:32.157 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.154+0000 7f9a4725ab80 10 client.0 _ll_register_callbacks cb 0x56473e1abad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T05:01:32.157 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.154+0000 7f9a38e3b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56473e2b5a80 0x56473e2bf830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:01:32.157 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.155+0000 7f9a38e3b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56473e2b5a80 0x56473e2bf830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:34460/0 (socket says 172.21.15.76:34460) 2024-06-02T05:01:32.157 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.155+0000 7f9a38e3b700 1 -- 172.21.15.76:0/3073315052 learned_addr learned my addr 172.21.15.76:0/3073315052 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:01:32.157 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.155+0000 7f9a38e3b700 1 --2- 172.21.15.76:0/134989583 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f9a240a1270 0x7f9a240a3730 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f9a20005fd0 tx=0x7f9a20005e60 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:01:32.157 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.155+0000 7f9a33fff700 1 --2- 172.21.15.76:0/3073315052 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56473e2b63e0 0x56473e2bfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:01:32.157 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.155+0000 7f9a38e3b700 1 -- 172.21.15.76:0/3073315052 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56473e2b63e0 msgr2=0x56473e2bfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:01:32.158 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.155+0000 7f9a38e3b700 1 --2- 172.21.15.76:0/3073315052 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56473e2b63e0 0x56473e2bfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:32.158 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.155+0000 7f9a38e3b700 1 -- 172.21.15.76:0/3073315052 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56473e2b72d0 msgr2=0x56473e2c6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:01:32.158 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.155+0000 7f9a38e3b700 1 --2- 172.21.15.76:0/3073315052 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56473e2b72d0 0x56473e2c6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:32.158 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.155+0000 7f9a38e3b700 1 -- 172.21.15.76:0/3073315052 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a28020040 con 0x56473e2b5a80 2024-06-02T05:01:32.158 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.155+0000 7f9a33fff700 1 --2- 172.21.15.76:0/3073315052 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56473e2b63e0 0x56473e2bfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T05:01:32.158 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.155+0000 7f9a38e3b700 1 --2- 172.21.15.76:0/3073315052 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56473e2b5a80 0x56473e2bf830 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f9a200106b0 tx=0x7f9a20010a70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ef96c8596a358c1 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:01:32.158 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.155+0000 7f9a13fff700 10 client.0 ms_handle_connect on v2:172.21.15.192:3300/0 2024-06-02T05:01:32.158 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.155+0000 7f9a13fff700 1 -- 172.21.15.76:0/3073315052 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a2001d860 con 0x56473e2b5a80 2024-06-02T05:01:32.158 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.155+0000 7f9a4725ab80 1 -- 172.21.15.76:0/3073315052 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56473e15f210 con 0x56473e2b5a80 2024-06-02T05:01:32.158 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.155+0000 7f9a13fff700 1 -- 172.21.15.76:0/3073315052 <== mon.1 v2:172.21.15.192:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f9a2001d9c0 con 0x56473e2b5a80 2024-06-02T05:01:32.158 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.156+0000 7f9a13fff700 1 -- 172.21.15.76:0/3073315052 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9a2001db80 con 0x56473e2b5a80 2024-06-02T05:01:32.159 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.156+0000 7f9a4725ab80 10 client.26056 fetch_fsmap learned FSMap version 36 2024-06-02T05:01:32.159 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.156+0000 7f9a4725ab80 1 -- 172.21.15.76:0/3073315052 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x56473e033b00 con 0x56473e2b5a80 2024-06-02T05:01:32.159 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.156+0000 7f9a13fff700 1 -- 172.21.15.76:0/3073315052 <== mon.1 v2:172.21.15.192:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56473e15f210 con 0x56473e2b5a80 2024-06-02T05:01:32.160 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.157+0000 7f9a13fff700 1 -- 172.21.15.76:0/3073315052 <== mon.1 v2:172.21.15.192:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f9a2000f440 con 0x56473e2b5a80 2024-06-02T05:01:32.160 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.157+0000 7f9a4725ab80 10 client.26056 fetch_fsmap finished waiting for FSMap version 36 2024-06-02T05:01:32.160 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.157+0000 7f9a4725ab80 10 client.26056 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T05:01:32.160 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.157+0000 7f9a4725ab80 20 client.26056 populate_metadata read hostname 'smithi076' 2024-06-02T05:01:32.160 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.157+0000 7f9a4725ab80 1 --2- 172.21.15.76:0/3073315052 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x56473e2cb720 0x56473e2cdb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:01:32.160 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.157+0000 7f9a4725ab80 4 client.26056 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T05:01:32.160 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.157+0000 7f9a4725ab80 1 -- 172.21.15.76:0/3073315052 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56473e2857b0 con 0x56473e2cb720 2024-06-02T05:01:32.161 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.157+0000 7f9a33fff700 1 --2- 172.21.15.76:0/3073315052 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x56473e2cb720 0x56473e2cdb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:01:32.161 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.158+0000 7f9a33fff700 1 --2- 172.21.15.76:0/3073315052 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x56473e2cb720 0x56473e2cdb40 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fd1ab8c8d64c1adc server_cookie=79cac328f67c2a06 in_seq=0 out_seq=0 2024-06-02T05:01:32.161 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.158+0000 7f9a13fff700 10 client.26056 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T05:01:32.161 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.158+0000 7f9a13fff700 1 -- 172.21.15.76:0/3073315052 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56473e2857b0 con 0x56473e2cb720 2024-06-02T05:01:32.161 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.159+0000 7f9a13fff700 10 client.26056 handle_command_reply: tid=0 2024-06-02T05:01:32.161 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.159+0000 7f9a4725ab80 1 client.26056 shutdown 2024-06-02T05:01:32.161 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.159+0000 7f9a4725ab80 1 -- 172.21.15.76:0/3073315052 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56473e2b5a80 msgr2=0x56473e2bf830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:01:32.161 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.159+0000 7f9a4725ab80 1 --2- 172.21.15.76:0/3073315052 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56473e2b5a80 0x56473e2bf830 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f9a200106b0 tx=0x7f9a20010a70 comp rx=0 tx=0).stop 2024-06-02T05:01:32.161 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.159+0000 7f9a4725ab80 1 -- 172.21.15.76:0/3073315052 shutdown_connections 2024-06-02T05:01:32.161 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.159+0000 7f9a4725ab80 1 --2- 172.21.15.76:0/3073315052 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x56473e2cb720 0x56473e2cdb40 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:32.161 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.159+0000 7f9a4725ab80 1 --2- 172.21.15.76:0/3073315052 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56473e2b72d0 0x56473e2c6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:32.162 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.159+0000 7f9a4725ab80 1 --2- 172.21.15.76:0/3073315052 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56473e2b5a80 0x56473e2bf830 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:32.162 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.159+0000 7f9a4725ab80 1 --2- 172.21.15.76:0/3073315052 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56473e2b63e0 0x56473e2bfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:32.162 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.159+0000 7f9a4725ab80 1 -- 172.21.15.76:0/3073315052 >> 172.21.15.76:0/3073315052 conn(0x56473e2141b0 msgr2=0x56473e2b0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:01:32.162 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.159+0000 7f9a13fff700 0 client.26056 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T05:01:32.162 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.159+0000 7f9a4725ab80 1 -- 172.21.15.76:0/3073315052 shutdown_connections 2024-06-02T05:01:32.163 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.160+0000 7f9a4725ab80 1 -- 172.21.15.76:0/3073315052 wait complete. 2024-06-02T05:01:32.164 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.160+0000 7f9a4725ab80 20 client.26056 trim_cache size 0 max 16384 2024-06-02T05:01:32.183 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.182+0000 7f9a4725ab80 1 Processor -- start 2024-06-02T05:01:32.183 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.182+0000 7f9a4725ab80 1 -- start start 2024-06-02T05:01:32.184 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.183+0000 7f9a4725ab80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56473e2b5a80 0x56473e2d24c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:01:32.184 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.183+0000 7f9a4725ab80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56473e2b63e0 0x56473e2c6d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:01:32.184 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.183+0000 7f9a4725ab80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56473e2b72d0 0x56473e2bea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:01:32.184 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.183+0000 7f9a4725ab80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x56473e2b67f0 con 0x56473e2b63e0 2024-06-02T05:01:32.184 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.183+0000 7f9a4725ab80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x56473e2b5520 con 0x56473e2b5a80 2024-06-02T05:01:32.184 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.183+0000 7f9a4725ab80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x56473e2badd0 con 0x56473e2b72d0 2024-06-02T05:01:32.185 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.183+0000 7f9a3963c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56473e2b72d0 0x56473e2bea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:01:32.185 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.183+0000 7f9a3963c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56473e2b72d0 0x56473e2bea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:34462/0 (socket says 172.21.15.76:34462) 2024-06-02T05:01:32.186 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.183+0000 7f9a3963c700 1 -- 172.21.15.76:0/109272585 learned_addr learned my addr 172.21.15.76:0/109272585 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:01:32.186 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.183+0000 7f9a3963c700 1 -- 172.21.15.76:0/109272585 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56473e2b5a80 msgr2=0x56473e2d24c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-02T05:01:32.186 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.183+0000 7f9a38e3b700 1 --2- 172.21.15.76:0/109272585 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56473e2b5a80 0x56473e2d24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:01:32.186 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.184+0000 7f9a33fff700 1 --2- 172.21.15.76:0/109272585 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56473e2b63e0 0x56473e2c6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:01:32.186 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.184+0000 7f9a3963c700 1 --2- 172.21.15.76:0/109272585 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56473e2b5a80 0x56473e2d24c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:32.186 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.184+0000 7f9a3963c700 1 -- 172.21.15.76:0/109272585 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56473e2b63e0 msgr2=0x56473e2c6d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:01:32.186 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.184+0000 7f9a3963c700 1 --2- 172.21.15.76:0/109272585 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56473e2b63e0 0x56473e2c6d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:32.186 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.184+0000 7f9a3963c700 1 -- 172.21.15.76:0/109272585 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56473e1cc500 con 0x56473e2b72d0 2024-06-02T05:01:32.186 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.184+0000 7f9a3963c700 1 --2- 172.21.15.76:0/109272585 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56473e2b72d0 0x56473e2bea50 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c0a7330 tx=0x7f9a2c0aa520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e54653df434318c6 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:01:32.186 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.185+0000 7f9a1f7fe700 1 -- 172.21.15.76:0/109272585 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a2c0aa8c0 con 0x56473e2b72d0 2024-06-02T05:01:32.186 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.185+0000 7f9a1f7fe700 1 -- 172.21.15.76:0/109272585 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9a2c020040 con 0x56473e2b72d0 2024-06-02T05:01:32.187 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.185+0000 7f9a33fff700 1 --2- 172.21.15.76:0/109272585 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56473e2b63e0 0x56473e2c6d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T05:01:32.187 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.185+0000 7f9a1f7fe700 1 -- 172.21.15.76:0/109272585 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a2c0aad80 con 0x56473e2b72d0 2024-06-02T05:01:32.188 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.186+0000 7f9a38e3b700 1 --2- 172.21.15.76:0/109272585 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56473e2b5a80 0x56473e2d24c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T05:01:32.188 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.186+0000 7f9a4725ab80 1 -- 172.21.15.76:0/109272585 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56473e2b72d0 msgr2=0x56473e2bea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:01:32.188 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.186+0000 7f9a4725ab80 1 --2- 172.21.15.76:0/109272585 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56473e2b72d0 0x56473e2bea50 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c0a7330 tx=0x7f9a2c0aa520 comp rx=0 tx=0).stop 2024-06-02T05:01:32.188 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.186+0000 7f9a4725ab80 1 -- 172.21.15.76:0/109272585 shutdown_connections 2024-06-02T05:01:32.188 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.186+0000 7f9a4725ab80 1 --2- 172.21.15.76:0/109272585 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56473e2b72d0 0x56473e2bea50 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:32.188 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.186+0000 7f9a4725ab80 1 --2- 172.21.15.76:0/109272585 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56473e2b5a80 0x56473e2d24c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:32.188 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.186+0000 7f9a4725ab80 1 --2- 172.21.15.76:0/109272585 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56473e2b63e0 0x56473e2c6d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:32.188 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.186+0000 7f9a4725ab80 1 -- 172.21.15.76:0/109272585 >> 172.21.15.76:0/109272585 conn(0x56473e2141b0 msgr2=0x56473e2ba510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:01:32.189 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.186+0000 7f9a4725ab80 1 -- 172.21.15.76:0/109272585 shutdown_connections 2024-06-02T05:01:32.189 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.186+0000 7f9a4725ab80 1 -- 172.21.15.76:0/109272585 wait complete. 2024-06-02T05:01:32.189 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.186+0000 7f9a4725ab80 1 -- start start 2024-06-02T05:01:32.189 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.186+0000 7f9a4725ab80 1 Processor -- start 2024-06-02T05:01:32.189 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.187+0000 7f9a4725ab80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56473e2b5a80 0x56473e2c4700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:01:32.189 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.187+0000 7f9a4725ab80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56473e2b63e0 0x56473e2c4c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:01:32.189 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.187+0000 7f9a4725ab80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56473e2b72d0 0x56473e2c5c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:01:32.189 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.187+0000 7f9a4725ab80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x56473e2c6190 con 0x56473e2b72d0 2024-06-02T05:01:32.189 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.187+0000 7f9a4725ab80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x56473e2c6300 con 0x56473e2b63e0 2024-06-02T05:01:32.189 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.187+0000 7f9a4725ab80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x56473e2c64c0 con 0x56473e2b5a80 2024-06-02T05:01:32.189 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.187+0000 7f9a4725ab80 10 client.0 _ll_register_callbacks cb 0x56473e1abad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T05:01:32.189 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.187+0000 7f9a33fff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56473e2b63e0 0x56473e2c4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:01:32.190 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.187+0000 7f9a33fff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56473e2b63e0 0x56473e2c4c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:57382/0 (socket says 172.21.15.76:57382) 2024-06-02T05:01:32.190 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.187+0000 7f9a33fff700 1 -- 172.21.15.76:0/4096677395 learned_addr learned my addr 172.21.15.76:0/4096677395 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:01:32.190 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.187+0000 7f9a3963c700 1 --2- 172.21.15.76:0/4096677395 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56473e2b72d0 0x56473e2c5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:01:32.190 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.187+0000 7f9a38e3b700 1 --2- 172.21.15.76:0/4096677395 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56473e2b5a80 0x56473e2c4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:01:32.191 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.188+0000 7f9a38e3b700 1 -- 172.21.15.76:0/4096677395 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56473e2b63e0 msgr2=0x56473e2c4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:01:32.191 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.188+0000 7f9a38e3b700 1 --2- 172.21.15.76:0/4096677395 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56473e2b63e0 0x56473e2c4c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:32.191 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.188+0000 7f9a38e3b700 1 -- 172.21.15.76:0/4096677395 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56473e2b72d0 msgr2=0x56473e2c5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:01:32.191 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.188+0000 7f9a38e3b700 1 --2- 172.21.15.76:0/4096677395 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56473e2b72d0 0x56473e2c5c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:32.191 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.188+0000 7f9a38e3b700 1 -- 172.21.15.76:0/4096677395 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a34072080 con 0x56473e2b5a80 2024-06-02T05:01:32.192 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.188+0000 7f9a3963c700 1 --2- 172.21.15.76:0/4096677395 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56473e2b72d0 0x56473e2c5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T05:01:32.192 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.188+0000 7f9a38e3b700 1 --2- 172.21.15.76:0/4096677395 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56473e2b5a80 0x56473e2c4700 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9a2000a420 tx=0x7f9a2000fa80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=99443fff3a7ca71d server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:01:32.192 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.188+0000 7f9a13fff700 10 client.0 ms_handle_connect on v2:172.21.15.192:3300/0 2024-06-02T05:01:32.192 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.188+0000 7f9a13fff700 1 -- 172.21.15.76:0/4096677395 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a20004a30 con 0x56473e2b5a80 2024-06-02T05:01:32.192 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.188+0000 7f9a4725ab80 1 -- 172.21.15.76:0/4096677395 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9a28005110 con 0x56473e2b5a80 2024-06-02T05:01:32.192 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.188+0000 7f9a13fff700 1 -- 172.21.15.76:0/4096677395 <== mon.1 v2:172.21.15.192:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f9a2000fd50 con 0x56473e2b5a80 2024-06-02T05:01:32.192 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.189+0000 7f9a13fff700 1 -- 172.21.15.76:0/4096677395 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9a20004b90 con 0x56473e2b5a80 2024-06-02T05:01:32.192 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.189+0000 7f9a4725ab80 10 client.26062 fetch_fsmap learned FSMap version 36 2024-06-02T05:01:32.192 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.189+0000 7f9a4725ab80 1 -- 172.21.15.76:0/4096677395 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x56473e08bc70 con 0x56473e2b5a80 2024-06-02T05:01:32.192 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.189+0000 7f9a13fff700 1 -- 172.21.15.76:0/4096677395 <== mon.1 v2:172.21.15.192:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9a28005110 con 0x56473e2b5a80 2024-06-02T05:01:32.192 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.189+0000 7f9a13fff700 1 -- 172.21.15.76:0/4096677395 <== mon.1 v2:172.21.15.192:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f9a2001d6f0 con 0x56473e2b5a80 2024-06-02T05:01:32.192 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.189+0000 7f9a4725ab80 10 client.26062 fetch_fsmap finished waiting for FSMap version 36 2024-06-02T05:01:32.192 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.189+0000 7f9a4725ab80 10 client.26062 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T05:01:32.193 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.189+0000 7f9a4725ab80 20 client.26062 populate_metadata read hostname 'smithi076' 2024-06-02T05:01:32.193 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.189+0000 7f9a4725ab80 1 --2- 172.21.15.76:0/4096677395 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x56473e322640 0x56473e324a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:01:32.193 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.189+0000 7f9a4725ab80 4 client.26062 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T05:01:32.193 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.189+0000 7f9a4725ab80 1 -- 172.21.15.76:0/4096677395 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x56473e1fee60 con 0x56473e322640 2024-06-02T05:01:32.193 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.190+0000 7f9a33fff700 1 --2- 172.21.15.76:0/4096677395 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x56473e322640 0x56473e324a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:01:32.198 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.194+0000 7f9a33fff700 1 --2- 172.21.15.76:0/4096677395 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x56473e322640 0x56473e324a60 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8aae219fb18cb066 server_cookie=28200099798f6554 in_seq=0 out_seq=0 2024-06-02T05:01:32.198 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.194+0000 7f9a13fff700 10 client.26062 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T05:01:32.230 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.229+0000 7f9a13fff700 1 -- 172.21.15.76:0/4096677395 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x56473e1fee60 con 0x56473e322640 2024-06-02T05:01:32.230 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.229+0000 7f9a13fff700 10 client.26062 handle_command_reply: tid=0 2024-06-02T05:01:32.237 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.234+0000 7f9a4725ab80 1 client.26062 shutdown 2024-06-02T05:01:32.237 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.234+0000 7f9a4725ab80 1 -- 172.21.15.76:0/4096677395 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56473e2b5a80 msgr2=0x56473e2c4700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:01:32.237 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.234+0000 7f9a4725ab80 1 --2- 172.21.15.76:0/4096677395 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56473e2b5a80 0x56473e2c4700 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9a2000a420 tx=0x7f9a2000fa80 comp rx=0 tx=0).stop 2024-06-02T05:01:32.237 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.235+0000 7f9a4725ab80 1 -- 172.21.15.76:0/4096677395 shutdown_connections 2024-06-02T05:01:32.237 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.235+0000 7f9a4725ab80 1 --2- 172.21.15.76:0/4096677395 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x56473e322640 0x56473e324a60 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:32.237 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.235+0000 7f9a4725ab80 1 --2- 172.21.15.76:0/4096677395 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56473e2b72d0 0x56473e2c5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:32.237 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.235+0000 7f9a4725ab80 1 --2- 172.21.15.76:0/4096677395 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56473e2b5a80 0x56473e2c4700 secure :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9a2000a420 tx=0x7f9a2000fa80 comp rx=0 tx=0).stop 2024-06-02T05:01:32.238 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.235+0000 7f9a4725ab80 1 --2- 172.21.15.76:0/4096677395 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56473e2b63e0 0x56473e2c4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:32.238 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.235+0000 7f9a4725ab80 1 -- 172.21.15.76:0/4096677395 >> 172.21.15.76:0/4096677395 conn(0x56473e2141b0 msgr2=0x56473e2d24c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:01:32.238 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.236+0000 7f9a13fff700 0 client.26062 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T05:01:32.238 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.236+0000 7f9a4725ab80 1 -- 172.21.15.76:0/4096677395 shutdown_connections 2024-06-02T05:01:32.238 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.236+0000 7f9a4725ab80 1 -- 172.21.15.76:0/4096677395 wait complete. 2024-06-02T05:01:32.238 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.237+0000 7f9a4725ab80 20 client.26062 trim_cache size 0 max 16384 2024-06-02T05:01:32.238 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:{ 2024-06-02T05:01:32.239 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "message": "", 2024-06-02T05:01:32.239 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "return_code": 0 2024-06-02T05:01:32.239 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:} 2024-06-02T05:01:32.240 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.239+0000 7f9a3b09f700 1 -- 172.21.15.76:0/134989583 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f9a240a1270 msgr2=0x7f9a240a3730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:01:32.240 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.239+0000 7f9a3b09f700 1 --2- 172.21.15.76:0/134989583 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f9a240a1270 0x7f9a240a3730 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f9a20005fd0 tx=0x7f9a20005e60 comp rx=0 tx=0).stop 2024-06-02T05:01:32.240 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.239+0000 7f9a3b09f700 1 -- 172.21.15.76:0/134989583 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9a341008c0 msgr2=0x7f9a340710a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:01:32.240 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.239+0000 7f9a3b09f700 1 --2- 172.21.15.76:0/134989583 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9a341008c0 0x7f9a340710a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c01d110 tx=0x7f9a2c01d4d0 comp rx=0 tx=0).stop 2024-06-02T05:01:32.240 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.240+0000 7f9a3b09f700 1 -- 172.21.15.76:0/134989583 shutdown_connections 2024-06-02T05:01:32.240 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.240+0000 7f9a3b09f700 1 --2- 172.21.15.76:0/134989583 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f9a240a1270 0x7f9a240a3730 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:32.240 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.240+0000 7f9a3b09f700 1 --2- 172.21.15.76:0/134989583 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9a341008c0 0x7f9a340710a0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:32.240 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.240+0000 7f9a3b09f700 1 --2- 172.21.15.76:0/134989583 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9a340ff1f0 0x7f9a3410ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:32.240 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.240+0000 7f9a3b09f700 1 --2- 172.21.15.76:0/134989583 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9a340fff00 0x7f9a34110460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:32.241 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.240+0000 7f9a3b09f700 1 -- 172.21.15.76:0/134989583 >> 172.21.15.76:0/134989583 conn(0x7f9a340faaf0 msgr2=0x7f9a34103370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:01:32.241 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.240+0000 7f9a3b09f700 1 -- 172.21.15.76:0/134989583 shutdown_connections 2024-06-02T05:01:32.241 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:32.240+0000 7f9a3b09f700 1 -- 172.21.15.76:0/134989583 wait complete. 2024-06-02T05:01:33.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:01:33 smithi192 ceph-mon[47933]: pgmap v627: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 11 MiB/s wr, 809 op/s 2024-06-02T05:01:33.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:01:33 smithi076 ceph-mon[42935]: pgmap v627: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 11 MiB/s wr, 809 op/s 2024-06-02T05:01:34.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:01:33 smithi119 ceph-mon[46633]: pgmap v627: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 11 MiB/s wr, 809 op/s 2024-06-02T05:01:35.988 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:01:35 smithi076 ceph-mon[42935]: pgmap v628: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 8.9 MiB/s wr, 699 op/s 2024-06-02T05:01:36.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:01:35 smithi119 ceph-mon[46633]: pgmap v628: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 8.9 MiB/s wr, 699 op/s 2024-06-02T05:01:36.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:01:35 smithi192 ceph-mon[47933]: pgmap v628: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 8.9 MiB/s wr, 699 op/s 2024-06-02T05:01:36.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 645.0 s, 596.2 tps, lat 168.303 ms stddev 71.717 2024-06-02T05:01:37.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:01:36 smithi119 ceph-mon[46633]: pgmap v629: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 9.9 MiB/s wr, 797 op/s 2024-06-02T05:01:37.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:01:36 smithi192 ceph-mon[47933]: pgmap v629: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 9.9 MiB/s wr, 797 op/s 2024-06-02T05:01:37.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:01:36 smithi076 ceph-mon[42935]: pgmap v629: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 9.9 MiB/s wr, 797 op/s 2024-06-02T05:01:39.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:01:39 smithi192 ceph-mon[47933]: pgmap v630: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 9.3 MiB/s wr, 746 op/s 2024-06-02T05:01:39.985 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:01:39 smithi076 ceph-mon[42935]: pgmap v630: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 9.3 MiB/s wr, 746 op/s 2024-06-02T05:01:40.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:01:39 smithi119 ceph-mon[46633]: pgmap v630: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 9.3 MiB/s wr, 746 op/s 2024-06-02T05:01:41.317 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 650.0 s, 614.7 tps, lat 162.014 ms stddev 70.791 2024-06-02T05:01:41.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:01:41 smithi192 ceph-mon[47933]: pgmap v631: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 10 MiB/s wr, 823 op/s 2024-06-02T05:01:41.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:01:41 smithi076 ceph-mon[42935]: pgmap v631: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 10 MiB/s wr, 823 op/s 2024-06-02T05:01:42.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:01:41 smithi119 ceph-mon[46633]: pgmap v631: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 10 MiB/s wr, 823 op/s 2024-06-02T05:01:43.935 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:01:43 smithi192 ceph-mon[47933]: pgmap v632: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 9.4 MiB/s wr, 795 op/s 2024-06-02T05:01:43.985 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:01:43 smithi076 ceph-mon[42935]: pgmap v632: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 9.4 MiB/s wr, 795 op/s 2024-06-02T05:01:44.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:01:43 smithi119 ceph-mon[46633]: pgmap v632: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 9.4 MiB/s wr, 795 op/s 2024-06-02T05:01:45.443 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.442+0000 7fa9f878a700 1 -- 172.21.15.76:0/1207514980 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa9f00ffe00 msgr2=0x7fa9f0100220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:01:45.443 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.442+0000 7fa9f878a700 1 --2- 172.21.15.76:0/1207514980 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa9f00ffe00 0x7fa9f0100220 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec009990 tx=0x7fa9ec009ca0 comp rx=0 tx=0).stop 2024-06-02T05:01:45.443 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.442+0000 7fa9f878a700 1 -- 172.21.15.76:0/1207514980 shutdown_connections 2024-06-02T05:01:45.444 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.442+0000 7fa9f878a700 1 --2- 172.21.15.76:0/1207514980 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa9f0101990 0x7fa9f0108240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:45.444 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.443+0000 7fa9f878a700 1 --2- 172.21.15.76:0/1207514980 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa9f00ffe00 0x7fa9f0100220 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:45.444 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.443+0000 7fa9f878a700 1 --2- 172.21.15.76:0/1207514980 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa9f0100ff0 0x7fa9f0101450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:45.444 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.443+0000 7fa9f878a700 1 -- 172.21.15.76:0/1207514980 >> 172.21.15.76:0/1207514980 conn(0x7fa9f00fb390 msgr2=0x7fa9f00fd7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:01:45.447 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.444+0000 7fa9f878a700 1 -- 172.21.15.76:0/1207514980 shutdown_connections 2024-06-02T05:01:45.450 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.449+0000 7fa9f878a700 1 -- 172.21.15.76:0/1207514980 wait complete. 2024-06-02T05:01:45.450 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.450+0000 7fa9f878a700 1 Processor -- start 2024-06-02T05:01:45.451 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.450+0000 7fa9f878a700 1 -- start start 2024-06-02T05:01:45.451 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.450+0000 7fa9f878a700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa9f00ffe00 0x7fa9f019d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:01:45.451 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.450+0000 7fa9f878a700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa9f0100ff0 0x7fa9f019da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:01:45.451 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.450+0000 7fa9f878a700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa9f0101990 0x7fa9f01a4a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:01:45.451 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.450+0000 7fa9f878a700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f01a5060 con 0x7fa9f0100ff0 2024-06-02T05:01:45.451 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.450+0000 7fa9f878a700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f01a51a0 con 0x7fa9f0101990 2024-06-02T05:01:45.451 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.450+0000 7fa9f878a700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f01a5330 con 0x7fa9f00ffe00 2024-06-02T05:01:45.452 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.451+0000 7fa9f6526700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa9f00ffe00 0x7fa9f019d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:01:45.452 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.451+0000 7fa9f6d27700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa9f0101990 0x7fa9f01a4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:01:45.453 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.451+0000 7fa9f6526700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa9f00ffe00 0x7fa9f019d530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:53792/0 (socket says 172.21.15.76:53792) 2024-06-02T05:01:45.453 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.451+0000 7fa9f6526700 1 -- 172.21.15.76:0/2162555680 learned_addr learned my addr 172.21.15.76:0/2162555680 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:01:45.453 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.451+0000 7fa9f5d25700 1 --2- 172.21.15.76:0/2162555680 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa9f0100ff0 0x7fa9f019da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:01:45.453 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.451+0000 7fa9f6d27700 1 -- 172.21.15.76:0/2162555680 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa9f00ffe00 msgr2=0x7fa9f019d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:01:45.453 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.451+0000 7fa9f6d27700 1 --2- 172.21.15.76:0/2162555680 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa9f00ffe00 0x7fa9f019d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:45.453 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.451+0000 7fa9f6d27700 1 -- 172.21.15.76:0/2162555680 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa9f0100ff0 msgr2=0x7fa9f019da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:01:45.453 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.451+0000 7fa9f6d27700 1 --2- 172.21.15.76:0/2162555680 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa9f0100ff0 0x7fa9f019da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:45.453 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.451+0000 7fa9f6d27700 1 -- 172.21.15.76:0/2162555680 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9ec0095f0 con 0x7fa9f0101990 2024-06-02T05:01:45.453 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.451+0000 7fa9f5d25700 1 --2- 172.21.15.76:0/2162555680 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa9f0100ff0 0x7fa9f019da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T05:01:45.453 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.452+0000 7fa9f6d27700 1 --2- 172.21.15.76:0/2162555680 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa9f0101990 0x7fa9f01a4a90 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa9e800be20 tx=0x7fa9e8009ed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:01:45.456 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.455+0000 7fa9e77fe700 1 -- 172.21.15.76:0/2162555680 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9e800cc10 con 0x7fa9f0101990 2024-06-02T05:01:45.456 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.455+0000 7fa9e77fe700 1 -- 172.21.15.76:0/2162555680 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa9e800cd70 con 0x7fa9f0101990 2024-06-02T05:01:45.456 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.455+0000 7fa9e77fe700 1 -- 172.21.15.76:0/2162555680 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9e80125c0 con 0x7fa9f0101990 2024-06-02T05:01:45.456 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.455+0000 7fa9f878a700 1 -- 172.21.15.76:0/2162555680 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9f01a5610 con 0x7fa9f0101990 2024-06-02T05:01:45.456 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.455+0000 7fa9f878a700 1 -- 172.21.15.76:0/2162555680 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9f01a5b50 con 0x7fa9f0101990 2024-06-02T05:01:45.460 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.458+0000 7fa9e77fe700 1 -- 172.21.15.76:0/2162555680 <== mon.2 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fa9e8014440 con 0x7fa9f0101990 2024-06-02T05:01:45.460 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.459+0000 7fa9e77fe700 1 --2- 172.21.15.76:0/2162555680 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fa9dc0a1270 0x7fa9dc0a3730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:01:45.460 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.459+0000 7fa9e77fe700 1 -- 172.21.15.76:0/2162555680 <== mon.2 v2:172.21.15.119:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7fa9e8006e40 con 0x7fa9f0101990 2024-06-02T05:01:45.460 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.460+0000 7fa9f6526700 1 --2- 172.21.15.76:0/2162555680 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fa9dc0a1270 0x7fa9dc0a3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:01:45.461 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.460+0000 7faa04945b80 1 Processor -- start 2024-06-02T05:01:45.461 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.460+0000 7faa04945b80 1 -- start start 2024-06-02T05:01:45.461 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.460+0000 7fa9f6526700 1 --2- 172.21.15.76:0/2162555680 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fa9dc0a1270 0x7fa9dc0a3730 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec00b5c0 tx=0x7fa9ec0037c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:01:45.462 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.460+0000 7faa04945b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561de185ba80 0x561de185bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:01:45.462 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.460+0000 7faa04945b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561de185c3e0 0x561de185ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:01:45.462 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.460+0000 7faa04945b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561de185d2d0 0x561de185d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:01:45.462 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.460+0000 7faa04945b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x561de17b30f0 con 0x561de185ba80 2024-06-02T05:01:45.462 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.460+0000 7faa04945b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x561de17b0ab0 con 0x561de185c3e0 2024-06-02T05:01:45.462 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.460+0000 7faa04945b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x561de17ac3a0 con 0x561de185d2d0 2024-06-02T05:01:45.467 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.462+0000 7fa9f5d25700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561de185c3e0 0x561de185ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:01:45.467 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.462+0000 7fa9f5d25700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561de185c3e0 0x561de185ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:51102/0 (socket says 172.21.15.76:51102) 2024-06-02T05:01:45.467 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.462+0000 7fa9f5d25700 1 -- 172.21.15.76:0/1617415938 learned_addr learned my addr 172.21.15.76:0/1617415938 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:01:45.467 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.462+0000 7fa9f5d25700 1 -- 172.21.15.76:0/1617415938 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561de185d2d0 msgr2=0x561de185d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:01:45.468 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.462+0000 7fa9f5d25700 1 --2- 172.21.15.76:0/1617415938 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561de185d2d0 0x561de185d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:45.468 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.462+0000 7fa9f5d25700 1 -- 172.21.15.76:0/1617415938 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561de185ba80 msgr2=0x561de185bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:01:45.468 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.462+0000 7fa9f5d25700 1 --2- 172.21.15.76:0/1617415938 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561de185ba80 0x561de185bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:45.468 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.462+0000 7fa9f5d25700 1 -- 172.21.15.76:0/1617415938 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561de162d350 con 0x561de185c3e0 2024-06-02T05:01:45.468 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.462+0000 7fa9f5d25700 1 --2- 172.21.15.76:0/1617415938 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561de185c3e0 0x561de185ccf0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa9e000aa50 tx=0x7fa9e000ad60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=38f4872297d67531 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:01:45.468 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.463+0000 7fa9e4ff9700 1 -- 172.21.15.76:0/1617415938 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9e000ca90 con 0x561de185c3e0 2024-06-02T05:01:45.468 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.463+0000 7fa9e4ff9700 1 -- 172.21.15.76:0/1617415938 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa9e000cbf0 con 0x561de185c3e0 2024-06-02T05:01:45.468 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.463+0000 7fa9e4ff9700 1 -- 172.21.15.76:0/1617415938 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9e00185c0 con 0x561de185c3e0 2024-06-02T05:01:45.468 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.467+0000 7faa04945b80 1 -- 172.21.15.76:0/1617415938 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561de185c3e0 msgr2=0x561de185ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:01:45.468 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.467+0000 7faa04945b80 1 --2- 172.21.15.76:0/1617415938 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561de185c3e0 0x561de185ccf0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa9e000aa50 tx=0x7fa9e000ad60 comp rx=0 tx=0).stop 2024-06-02T05:01:45.473 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.472+0000 7faa04945b80 1 -- 172.21.15.76:0/1617415938 shutdown_connections 2024-06-02T05:01:45.474 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.472+0000 7faa04945b80 1 --2- 172.21.15.76:0/1617415938 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561de185d2d0 0x561de185d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:45.474 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.472+0000 7faa04945b80 1 --2- 172.21.15.76:0/1617415938 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561de185ba80 0x561de185bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:45.474 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.472+0000 7faa04945b80 1 --2- 172.21.15.76:0/1617415938 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561de185c3e0 0x561de185ccf0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:45.474 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.472+0000 7faa04945b80 1 -- 172.21.15.76:0/1617415938 >> 172.21.15.76:0/1617415938 conn(0x561de17ba1b0 msgr2=0x561de1858440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:01:45.476 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.476+0000 7faa04945b80 1 -- 172.21.15.76:0/1617415938 shutdown_connections 2024-06-02T05:01:45.477 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.476+0000 7faa04945b80 1 -- 172.21.15.76:0/1617415938 wait complete. 2024-06-02T05:01:45.481 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.476+0000 7faa04945b80 1 -- start start 2024-06-02T05:01:45.481 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.476+0000 7faa04945b80 1 Processor -- start 2024-06-02T05:01:45.481 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.476+0000 7faa04945b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561de185ba80 0x561de1876970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:01:45.481 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.476+0000 7faa04945b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561de185c3e0 0x561de1876eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:01:45.481 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.476+0000 7faa04945b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561de185d2d0 0x561de187def0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:01:45.481 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.476+0000 7faa04945b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x561de1748500 con 0x561de185ba80 2024-06-02T05:01:45.481 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.476+0000 7faa04945b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x561de17481a0 con 0x561de185d2d0 2024-06-02T05:01:45.482 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.476+0000 7faa04945b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x561de162f640 con 0x561de185c3e0 2024-06-02T05:01:45.482 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.477+0000 7faa04945b80 10 client.0 _ll_register_callbacks cb 0x561de1751ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T05:01:45.482 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.477+0000 7fa9f6d27700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561de185d2d0 0x561de187def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:01:45.482 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.477+0000 7fa9f6d27700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561de185d2d0 0x561de187def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:51104/0 (socket says 172.21.15.76:51104) 2024-06-02T05:01:45.482 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.477+0000 7fa9f6d27700 1 -- 172.21.15.76:0/285621120 learned_addr learned my addr 172.21.15.76:0/285621120 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:01:45.482 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.477+0000 7fa9f6526700 1 --2- 172.21.15.76:0/285621120 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561de185ba80 0x561de1876970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:01:45.482 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.479+0000 7fa9f6d27700 1 -- 172.21.15.76:0/285621120 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561de185c3e0 msgr2=0x561de1876eb0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-02T05:01:45.482 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.479+0000 7fa9f6d27700 1 --2- 172.21.15.76:0/285621120 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561de185c3e0 0x561de1876eb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:45.482 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.479+0000 7fa9f6d27700 1 -- 172.21.15.76:0/285621120 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561de185ba80 msgr2=0x561de1876970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:01:45.482 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.479+0000 7fa9f6d27700 1 --2- 172.21.15.76:0/285621120 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561de185ba80 0x561de1876970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:45.482 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.479+0000 7fa9f6d27700 1 -- 172.21.15.76:0/285621120 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9e000a680 con 0x561de185d2d0 2024-06-02T05:01:45.483 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.482+0000 7fa9f6d27700 1 --2- 172.21.15.76:0/285621120 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561de185d2d0 0x561de187def0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa9e80995c0 tx=0x7fa9e8099010 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab869b0df643b92e server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:01:45.483 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.482+0000 7fa9d9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-06-02T05:01:45.483 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.482+0000 7fa9d9ffb700 1 -- 172.21.15.76:0/285621120 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9e809d460 con 0x561de185d2d0 2024-06-02T05:01:45.483 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.482+0000 7fa9d9ffb700 1 -- 172.21.15.76:0/285621120 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7fa9e80a1ab0 con 0x561de185d2d0 2024-06-02T05:01:45.483 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.482+0000 7faa04945b80 1 -- 172.21.15.76:0/285621120 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561de1705210 con 0x561de185d2d0 2024-06-02T05:01:45.483 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.483+0000 7fa9d9ffb700 1 -- 172.21.15.76:0/285621120 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa9e80c9df0 con 0x561de185d2d0 2024-06-02T05:01:45.484 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.483+0000 7faa04945b80 10 client.26093 fetch_fsmap learned FSMap version 36 2024-06-02T05:01:45.484 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.483+0000 7faa04945b80 1 -- 172.21.15.76:0/285621120 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x561de15d9b00 con 0x561de185d2d0 2024-06-02T05:01:45.484 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.483+0000 7fa9d9ffb700 1 -- 172.21.15.76:0/285621120 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x561de1705210 con 0x561de185d2d0 2024-06-02T05:01:45.484 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.483+0000 7fa9d9ffb700 1 -- 172.21.15.76:0/285621120 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fa9e8098c20 con 0x561de185d2d0 2024-06-02T05:01:45.484 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.483+0000 7faa04945b80 10 client.26093 fetch_fsmap finished waiting for FSMap version 36 2024-06-02T05:01:45.485 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.483+0000 7faa04945b80 10 client.26093 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T05:01:45.485 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.483+0000 7faa04945b80 20 client.26093 populate_metadata read hostname 'smithi076' 2024-06-02T05:01:45.485 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.483+0000 7faa04945b80 1 --2- 172.21.15.76:0/285621120 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x561de18937e0 0x561de1895c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:01:45.485 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.483+0000 7faa04945b80 4 client.26093 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T05:01:45.485 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.483+0000 7faa04945b80 1 -- 172.21.15.76:0/285621120 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561de182b7b0 con 0x561de18937e0 2024-06-02T05:01:45.485 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.484+0000 7fa9f6526700 1 --2- 172.21.15.76:0/285621120 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x561de18937e0 0x561de1895c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:01:45.485 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.485+0000 7fa9f6526700 1 --2- 172.21.15.76:0/285621120 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x561de18937e0 0x561de1895c00 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e2b7a26c8136338e server_cookie=7da1d60a215107a6 in_seq=0 out_seq=0 2024-06-02T05:01:45.485 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.485+0000 7fa9d9ffb700 10 client.26093 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T05:01:45.486 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.485+0000 7fa9d9ffb700 1 -- 172.21.15.76:0/285621120 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x561de182b7b0 con 0x561de18937e0 2024-06-02T05:01:45.486 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.485+0000 7fa9d9ffb700 10 client.26093 handle_command_reply: tid=0 2024-06-02T05:01:45.486 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.486+0000 7faa04945b80 1 client.26093 shutdown 2024-06-02T05:01:45.493 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.492+0000 7faa04945b80 1 -- 172.21.15.76:0/285621120 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561de185d2d0 msgr2=0x561de187def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:01:45.493 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.492+0000 7faa04945b80 1 --2- 172.21.15.76:0/285621120 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561de185d2d0 0x561de187def0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa9e80995c0 tx=0x7fa9e8099010 comp rx=0 tx=0).stop 2024-06-02T05:01:45.493 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.493+0000 7faa04945b80 1 -- 172.21.15.76:0/285621120 shutdown_connections 2024-06-02T05:01:45.494 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.493+0000 7faa04945b80 1 --2- 172.21.15.76:0/285621120 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x561de18937e0 0x561de1895c00 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:45.494 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.493+0000 7faa04945b80 1 --2- 172.21.15.76:0/285621120 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561de185d2d0 0x561de187def0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:45.494 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.493+0000 7faa04945b80 1 --2- 172.21.15.76:0/285621120 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561de185ba80 0x561de1876970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:45.494 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.493+0000 7faa04945b80 1 --2- 172.21.15.76:0/285621120 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561de185c3e0 0x561de1876eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:45.494 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.493+0000 7faa04945b80 1 -- 172.21.15.76:0/285621120 >> 172.21.15.76:0/285621120 conn(0x561de17ba1b0 msgr2=0x561de1856860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:01:45.494 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.493+0000 7fa9d9ffb700 0 client.26093 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T05:01:45.494 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.493+0000 7faa04945b80 1 -- 172.21.15.76:0/285621120 shutdown_connections 2024-06-02T05:01:45.494 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.493+0000 7faa04945b80 1 -- 172.21.15.76:0/285621120 wait complete. 2024-06-02T05:01:45.497 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.496+0000 7faa04945b80 20 client.26093 trim_cache size 0 max 16384 2024-06-02T05:01:45.527 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.526+0000 7faa04945b80 1 Processor -- start 2024-06-02T05:01:45.528 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.527+0000 7faa04945b80 1 -- start start 2024-06-02T05:01:45.528 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.527+0000 7faa04945b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561de185ba80 0x561de188f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:01:45.528 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.527+0000 7faa04945b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561de185c3e0 0x561de187deb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:01:45.528 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.527+0000 7faa04945b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561de185d2d0 0x561de1875e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:01:45.528 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.527+0000 7faa04945b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x561de185b5e0 con 0x561de185c3e0 2024-06-02T05:01:45.529 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.527+0000 7faa04945b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x561de1857bc0 con 0x561de185d2d0 2024-06-02T05:01:45.529 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.527+0000 7faa04945b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x561de189adb0 con 0x561de185ba80 2024-06-02T05:01:45.529 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.527+0000 7fa9f5d25700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561de185c3e0 0x561de187deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:01:45.529 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.527+0000 7fa9f5d25700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561de185c3e0 0x561de187deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:34482/0 (socket says 172.21.15.76:34482) 2024-06-02T05:01:45.529 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.527+0000 7fa9f5d25700 1 -- 172.21.15.76:0/4063244384 learned_addr learned my addr 172.21.15.76:0/4063244384 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:01:45.529 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.527+0000 7fa9f6d27700 1 --2- 172.21.15.76:0/4063244384 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561de185d2d0 0x561de1875e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:01:45.529 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.528+0000 7fa9f5d25700 1 -- 172.21.15.76:0/4063244384 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561de185ba80 msgr2=0x561de188f5b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-02T05:01:45.529 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.528+0000 7fa9f5d25700 1 --2- 172.21.15.76:0/4063244384 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561de185ba80 0x561de188f5b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:45.529 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.528+0000 7fa9f5d25700 1 -- 172.21.15.76:0/4063244384 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561de185d2d0 msgr2=0x561de1875e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:01:45.529 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.528+0000 7fa9f5d25700 1 --2- 172.21.15.76:0/4063244384 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561de185d2d0 0x561de1875e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:45.529 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.528+0000 7fa9f5d25700 1 -- 172.21.15.76:0/4063244384 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561de1772500 con 0x561de185c3e0 2024-06-02T05:01:45.530 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.528+0000 7fa9f5d25700 1 --2- 172.21.15.76:0/4063244384 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561de185c3e0 0x561de187deb0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fa9e000a650 tx=0x7fa9e000a310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc2384808f15e369 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:01:45.530 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.528+0000 7fa9e57fa700 1 -- 172.21.15.76:0/4063244384 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9e000c890 con 0x561de185c3e0 2024-06-02T05:01:45.530 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.529+0000 7fa9e57fa700 1 -- 172.21.15.76:0/4063244384 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa9e000c9f0 con 0x561de185c3e0 2024-06-02T05:01:45.530 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.529+0000 7fa9e57fa700 1 -- 172.21.15.76:0/4063244384 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9e0003d80 con 0x561de185c3e0 2024-06-02T05:01:45.531 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.530+0000 7faa04945b80 1 -- 172.21.15.76:0/4063244384 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561de185c3e0 msgr2=0x561de187deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:01:45.531 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.530+0000 7faa04945b80 1 --2- 172.21.15.76:0/4063244384 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561de185c3e0 0x561de187deb0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fa9e000a650 tx=0x7fa9e000a310 comp rx=0 tx=0).stop 2024-06-02T05:01:45.531 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.530+0000 7faa04945b80 1 -- 172.21.15.76:0/4063244384 shutdown_connections 2024-06-02T05:01:45.531 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.530+0000 7faa04945b80 1 --2- 172.21.15.76:0/4063244384 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561de185d2d0 0x561de1875e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:45.531 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.530+0000 7faa04945b80 1 --2- 172.21.15.76:0/4063244384 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561de185ba80 0x561de188f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:45.531 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.530+0000 7faa04945b80 1 --2- 172.21.15.76:0/4063244384 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561de185c3e0 0x561de187deb0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:45.531 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.530+0000 7faa04945b80 1 -- 172.21.15.76:0/4063244384 >> 172.21.15.76:0/4063244384 conn(0x561de17ba1b0 msgr2=0x561de1852e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:01:45.532 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.530+0000 7faa04945b80 1 -- 172.21.15.76:0/4063244384 shutdown_connections 2024-06-02T05:01:45.532 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.530+0000 7faa04945b80 1 -- 172.21.15.76:0/4063244384 wait complete. 2024-06-02T05:01:45.532 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.530+0000 7faa04945b80 1 -- start start 2024-06-02T05:01:45.532 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.531+0000 7faa04945b80 1 Processor -- start 2024-06-02T05:01:45.532 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.531+0000 7faa04945b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561de185ba80 0x561de187b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:01:45.532 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.531+0000 7faa04945b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561de185c3e0 0x561de187bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:01:45.532 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.531+0000 7faa04945b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561de185d2d0 0x561de187c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:01:45.532 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.531+0000 7faa04945b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x561de187cf20 con 0x561de185d2d0 2024-06-02T05:01:45.533 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.531+0000 7faa04945b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x561de187d090 con 0x561de185ba80 2024-06-02T05:01:45.533 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.531+0000 7faa04945b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x561de187d250 con 0x561de185c3e0 2024-06-02T05:01:45.533 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.531+0000 7faa04945b80 10 client.0 _ll_register_callbacks cb 0x561de1751ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T05:01:45.533 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.531+0000 7fa9f6d27700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561de185d2d0 0x561de187c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:01:45.533 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.531+0000 7fa9f6d27700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561de185d2d0 0x561de187c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:34484/0 (socket says 172.21.15.76:34484) 2024-06-02T05:01:45.533 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.531+0000 7fa9f6d27700 1 -- 172.21.15.76:0/3426094309 learned_addr learned my addr 172.21.15.76:0/3426094309 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:01:45.534 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.532+0000 7fa9f5d25700 1 --2- 172.21.15.76:0/3426094309 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561de185c3e0 0x561de187bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:01:45.534 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.532+0000 7fa9f6d27700 1 -- 172.21.15.76:0/3426094309 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561de185c3e0 msgr2=0x561de187bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:01:45.534 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.532+0000 7fa9f6d27700 1 --2- 172.21.15.76:0/3426094309 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561de185c3e0 0x561de187bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:45.535 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.532+0000 7fa9f6d27700 1 -- 172.21.15.76:0/3426094309 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561de185ba80 msgr2=0x561de187b6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-02T05:01:45.535 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.532+0000 7fa9f6d27700 1 --2- 172.21.15.76:0/3426094309 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561de185ba80 0x561de187b6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:45.535 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.532+0000 7fa9f6d27700 1 -- 172.21.15.76:0/3426094309 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561de162d350 con 0x561de185d2d0 2024-06-02T05:01:45.535 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.532+0000 7fa9f6d27700 1 --2- 172.21.15.76:0/3426094309 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561de185d2d0 0x561de187c9e0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fa9e8095b30 tx=0x7fa9e80996f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1311b73b940bc6b server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:01:45.535 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.532+0000 7fa9d9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-06-02T05:01:45.535 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.532+0000 7fa9d9ffb700 1 -- 172.21.15.76:0/3426094309 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9e80a1ab0 con 0x561de185d2d0 2024-06-02T05:01:45.535 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.532+0000 7fa9d9ffb700 1 -- 172.21.15.76:0/3426094309 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7fa9e80841d0 con 0x561de185d2d0 2024-06-02T05:01:45.535 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.533+0000 7faa04945b80 1 -- 172.21.15.76:0/3426094309 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa9e000cbf0 con 0x561de185d2d0 2024-06-02T05:01:45.535 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.533+0000 7fa9d9ffb700 1 -- 172.21.15.76:0/3426094309 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa9e809d460 con 0x561de185d2d0 2024-06-02T05:01:45.535 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.533+0000 7faa04945b80 10 client.16470 fetch_fsmap learned FSMap version 36 2024-06-02T05:01:45.536 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.533+0000 7faa04945b80 1 -- 172.21.15.76:0/3426094309 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x561de1631c70 con 0x561de185d2d0 2024-06-02T05:01:45.536 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.534+0000 7fa9d9ffb700 1 -- 172.21.15.76:0/3426094309 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa9e000cbf0 con 0x561de185d2d0 2024-06-02T05:01:45.536 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.534+0000 7fa9d9ffb700 1 -- 172.21.15.76:0/3426094309 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fa9e8081050 con 0x561de185d2d0 2024-06-02T05:01:45.536 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.534+0000 7faa04945b80 10 client.16470 fetch_fsmap finished waiting for FSMap version 36 2024-06-02T05:01:45.536 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.534+0000 7faa04945b80 10 client.16470 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T05:01:45.536 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.534+0000 7faa04945b80 20 client.16470 populate_metadata read hostname 'smithi076' 2024-06-02T05:01:45.536 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.534+0000 7faa04945b80 1 --2- 172.21.15.76:0/3426094309 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x561de18ea130 0x561de18ec550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:01:45.536 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.534+0000 7faa04945b80 4 client.16470 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T05:01:45.536 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.534+0000 7faa04945b80 1 -- 172.21.15.76:0/3426094309 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x561de17a4e60 con 0x561de18ea130 2024-06-02T05:01:45.537 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.534+0000 7fa9f6526700 1 --2- 172.21.15.76:0/3426094309 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x561de18ea130 0x561de18ec550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:01:45.537 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.535+0000 7fa9f6526700 1 --2- 172.21.15.76:0/3426094309 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x561de18ea130 0x561de18ec550 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=599a5927623e5e6d server_cookie=771db85ea3f5006 in_seq=0 out_seq=0 2024-06-02T05:01:45.537 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.535+0000 7fa9d9ffb700 10 client.16470 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T05:01:45.575 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.574+0000 7fa9d9ffb700 1 -- 172.21.15.76:0/3426094309 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x561de17a4e60 con 0x561de18ea130 2024-06-02T05:01:45.575 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.574+0000 7fa9d9ffb700 10 client.16470 handle_command_reply: tid=0 2024-06-02T05:01:45.575 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.574+0000 7faa04945b80 1 client.16470 shutdown 2024-06-02T05:01:45.575 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.574+0000 7faa04945b80 1 -- 172.21.15.76:0/3426094309 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561de185d2d0 msgr2=0x561de187c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:01:45.575 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.574+0000 7faa04945b80 1 --2- 172.21.15.76:0/3426094309 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561de185d2d0 0x561de187c9e0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fa9e8095b30 tx=0x7fa9e80996f0 comp rx=0 tx=0).stop 2024-06-02T05:01:45.576 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.574+0000 7faa04945b80 1 -- 172.21.15.76:0/3426094309 shutdown_connections 2024-06-02T05:01:45.576 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.574+0000 7faa04945b80 1 --2- 172.21.15.76:0/3426094309 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x561de18ea130 0x561de18ec550 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:45.576 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.574+0000 7faa04945b80 1 --2- 172.21.15.76:0/3426094309 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561de185d2d0 0x561de187c9e0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:45.576 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.574+0000 7faa04945b80 1 --2- 172.21.15.76:0/3426094309 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561de185ba80 0x561de187b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:45.576 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.574+0000 7faa04945b80 1 --2- 172.21.15.76:0/3426094309 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561de185c3e0 0x561de187bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:45.576 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.574+0000 7faa04945b80 1 -- 172.21.15.76:0/3426094309 >> 172.21.15.76:0/3426094309 conn(0x561de17ba1b0 msgr2=0x561de1858020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:01:45.576 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.574+0000 7fa9d9ffb700 0 client.16470 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T05:01:45.576 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.575+0000 7faa04945b80 1 -- 172.21.15.76:0/3426094309 shutdown_connections 2024-06-02T05:01:45.576 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.575+0000 7faa04945b80 1 -- 172.21.15.76:0/3426094309 wait complete. 2024-06-02T05:01:45.578 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.578+0000 7faa04945b80 20 client.16470 trim_cache size 0 max 16384 2024-06-02T05:01:45.579 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:{ 2024-06-02T05:01:45.579 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "message": "", 2024-06-02T05:01:45.579 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "return_code": 0 2024-06-02T05:01:45.579 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:} 2024-06-02T05:01:45.580 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.578+0000 7fa9f878a700 1 -- 172.21.15.76:0/2162555680 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fa9dc0a1270 msgr2=0x7fa9dc0a3730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:01:45.580 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.578+0000 7fa9f878a700 1 --2- 172.21.15.76:0/2162555680 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fa9dc0a1270 0x7fa9dc0a3730 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec00b5c0 tx=0x7fa9ec0037c0 comp rx=0 tx=0).stop 2024-06-02T05:01:45.580 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.578+0000 7fa9f878a700 1 -- 172.21.15.76:0/2162555680 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa9f0101990 msgr2=0x7fa9f01a4a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:01:45.580 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.578+0000 7fa9f878a700 1 --2- 172.21.15.76:0/2162555680 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa9f0101990 0x7fa9f01a4a90 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa9e800be20 tx=0x7fa9e8009ed0 comp rx=0 tx=0).stop 2024-06-02T05:01:45.580 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.578+0000 7fa9f878a700 1 -- 172.21.15.76:0/2162555680 shutdown_connections 2024-06-02T05:01:45.580 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.578+0000 7fa9f878a700 1 --2- 172.21.15.76:0/2162555680 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fa9dc0a1270 0x7fa9dc0a3730 secure :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec00b5c0 tx=0x7fa9ec0037c0 comp rx=0 tx=0).stop 2024-06-02T05:01:45.580 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.578+0000 7fa9f878a700 1 --2- 172.21.15.76:0/2162555680 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa9f0101990 0x7fa9f01a4a90 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:45.580 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.578+0000 7fa9f878a700 1 --2- 172.21.15.76:0/2162555680 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa9f00ffe00 0x7fa9f019d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:45.581 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.578+0000 7fa9f878a700 1 --2- 172.21.15.76:0/2162555680 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa9f0100ff0 0x7fa9f019da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:45.581 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.579+0000 7fa9f878a700 1 -- 172.21.15.76:0/2162555680 >> 172.21.15.76:0/2162555680 conn(0x7fa9f00fb390 msgr2=0x7fa9f010d310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:01:45.581 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.579+0000 7fa9f878a700 1 -- 172.21.15.76:0/2162555680 shutdown_connections 2024-06-02T05:01:45.581 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:45.579+0000 7fa9f878a700 1 -- 172.21.15.76:0/2162555680 wait complete. 2024-06-02T05:01:45.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:01:45 smithi192 ceph-mon[47933]: pgmap v633: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 8.2 MiB/s wr, 705 op/s 2024-06-02T05:01:45.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:01:45 smithi076 ceph-mon[42935]: pgmap v633: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 8.2 MiB/s wr, 705 op/s 2024-06-02T05:01:46.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:01:45 smithi119 ceph-mon[46633]: pgmap v633: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 8.2 MiB/s wr, 705 op/s 2024-06-02T05:01:46.321 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 655.0 s, 584.2 tps, lat 170.976 ms stddev 70.102 2024-06-02T05:01:47.934 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:01:47 smithi192 ceph-mon[47933]: pgmap v634: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 10 MiB/s wr, 823 op/s 2024-06-02T05:01:47.987 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:01:47 smithi076 ceph-mon[42935]: pgmap v634: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 10 MiB/s wr, 823 op/s 2024-06-02T05:01:48.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:01:47 smithi119 ceph-mon[46633]: pgmap v634: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 10 MiB/s wr, 823 op/s 2024-06-02T05:01:49.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:01:49 smithi076 ceph-mon[42935]: pgmap v635: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 9.4 MiB/s wr, 768 op/s 2024-06-02T05:01:50.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:01:49 smithi119 ceph-mon[46633]: pgmap v635: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 9.4 MiB/s wr, 768 op/s 2024-06-02T05:01:50.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:01:49 smithi192 ceph-mon[47933]: pgmap v635: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 9.4 MiB/s wr, 768 op/s 2024-06-02T05:01:51.318 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 660.0 s, 453.8 tps, lat 169.577 ms stddev 204.357 2024-06-02T05:01:51.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:01:51 smithi076 ceph-mon[42935]: pgmap v636: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 10 MiB/s wr, 844 op/s 2024-06-02T05:01:52.098 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:01:51 smithi119 ceph-mon[46633]: pgmap v636: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 10 MiB/s wr, 844 op/s 2024-06-02T05:01:52.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:01:51 smithi192 ceph-mon[47933]: pgmap v636: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 10 MiB/s wr, 844 op/s 2024-06-02T05:01:52.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:01:52 smithi076 ceph-mon[42935]: pgmap v637: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 9.9 MiB/s wr, 833 op/s 2024-06-02T05:01:53.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:01:52 smithi119 ceph-mon[46633]: pgmap v637: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 9.9 MiB/s wr, 833 op/s 2024-06-02T05:01:53.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:01:52 smithi192 ceph-mon[47933]: pgmap v637: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 9.9 MiB/s wr, 833 op/s 2024-06-02T05:01:55.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:01:55 smithi192 ceph-mon[47933]: pgmap v638: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 9.1 MiB/s wr, 745 op/s 2024-06-02T05:01:55.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:01:55 smithi076 ceph-mon[42935]: pgmap v638: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 9.1 MiB/s wr, 745 op/s 2024-06-02T05:01:56.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:01:55 smithi119 ceph-mon[46633]: pgmap v638: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 9.1 MiB/s wr, 745 op/s 2024-06-02T05:01:56.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 665.0 s, 552.0 tps, lat 223.603 ms stddev 393.908 2024-06-02T05:01:57.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:01:57 smithi192 ceph-mon[47933]: pgmap v639: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 11 MiB/s wr, 888 op/s 2024-06-02T05:01:57.988 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:01:57 smithi076 ceph-mon[42935]: pgmap v639: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 11 MiB/s wr, 888 op/s 2024-06-02T05:01:58.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:01:57 smithi119 ceph-mon[46633]: pgmap v639: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 11 MiB/s wr, 888 op/s 2024-06-02T05:01:58.750 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.749+0000 7fae59949700 1 -- 172.21.15.76:0/551252035 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fae54101990 msgr2=0x7fae54108240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:01:58.750 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.749+0000 7fae59949700 1 --2- 172.21.15.76:0/551252035 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fae54101990 0x7fae54108240 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fae4c00b0d0 tx=0x7fae4c00b3e0 comp rx=0 tx=0).stop 2024-06-02T05:01:58.755 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.754+0000 7fae59949700 1 -- 172.21.15.76:0/551252035 shutdown_connections 2024-06-02T05:01:58.755 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.754+0000 7fae59949700 1 --2- 172.21.15.76:0/551252035 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fae54101990 0x7fae54108240 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:58.755 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.754+0000 7fae59949700 1 --2- 172.21.15.76:0/551252035 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fae540ffe00 0x7fae54100220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:58.755 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.754+0000 7fae59949700 1 --2- 172.21.15.76:0/551252035 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fae54100ff0 0x7fae54101450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:58.756 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.754+0000 7fae59949700 1 -- 172.21.15.76:0/551252035 >> 172.21.15.76:0/551252035 conn(0x7fae540fb390 msgr2=0x7fae540fd7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:01:58.757 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.756+0000 7fae59949700 1 -- 172.21.15.76:0/551252035 shutdown_connections 2024-06-02T05:01:58.757 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.756+0000 7fae59949700 1 -- 172.21.15.76:0/551252035 wait complete. 2024-06-02T05:01:58.757 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.757+0000 7fae59949700 1 Processor -- start 2024-06-02T05:01:58.758 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.757+0000 7fae59949700 1 -- start start 2024-06-02T05:01:58.758 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.757+0000 7fae59949700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fae540ffe00 0x7fae5406f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:01:58.758 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.757+0000 7fae59949700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fae54100ff0 0x7fae5406fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:01:58.758 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.757+0000 7fae59949700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fae54101990 0x7fae541a4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:01:58.758 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.757+0000 7fae59949700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae54072e50 con 0x7fae54101990 2024-06-02T05:01:58.758 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.757+0000 7fae59949700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae54072fc0 con 0x7fae540ffe00 2024-06-02T05:01:58.758 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.757+0000 7fae59949700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae541a5230 con 0x7fae54100ff0 2024-06-02T05:01:58.764 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.757+0000 7fae52ffd700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fae540ffe00 0x7fae5406f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:01:58.764 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.757+0000 7fae527fc700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fae54100ff0 0x7fae5406fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:01:58.764 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.757+0000 7fae52ffd700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fae540ffe00 0x7fae5406f8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:55592/0 (socket says 172.21.15.76:55592) 2024-06-02T05:01:58.765 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.757+0000 7fae52ffd700 1 -- 172.21.15.76:0/488779057 learned_addr learned my addr 172.21.15.76:0/488779057 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:01:58.765 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.758+0000 7fae537fe700 1 --2- 172.21.15.76:0/488779057 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fae54101990 0x7fae541a4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:01:58.765 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.758+0000 7fae52ffd700 1 -- 172.21.15.76:0/488779057 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fae54100ff0 msgr2=0x7fae5406fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:01:58.765 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.758+0000 7fae52ffd700 1 --2- 172.21.15.76:0/488779057 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fae54100ff0 0x7fae5406fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:58.765 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.758+0000 7fae52ffd700 1 -- 172.21.15.76:0/488779057 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fae54101990 msgr2=0x7fae541a4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:01:58.766 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.758+0000 7fae52ffd700 1 --2- 172.21.15.76:0/488779057 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fae54101990 0x7fae541a4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:58.766 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.758+0000 7fae52ffd700 1 -- 172.21.15.76:0/488779057 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae4c009d00 con 0x7fae540ffe00 2024-06-02T05:01:58.766 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.758+0000 7fae527fc700 1 --2- 172.21.15.76:0/488779057 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fae54100ff0 0x7fae5406fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T05:01:58.766 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.758+0000 7fae52ffd700 1 --2- 172.21.15.76:0/488779057 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fae540ffe00 0x7fae5406f8d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fae44007ba0 tx=0x7fae44007eb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:01:58.766 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.758+0000 7fae58947700 1 -- 172.21.15.76:0/488779057 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae44010040 con 0x7fae540ffe00 2024-06-02T05:01:58.766 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.758+0000 7fae58947700 1 -- 172.21.15.76:0/488779057 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fae440044b0 con 0x7fae540ffe00 2024-06-02T05:01:58.766 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.758+0000 7fae58947700 1 -- 172.21.15.76:0/488779057 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae440038e0 con 0x7fae540ffe00 2024-06-02T05:01:58.766 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.758+0000 7fae59949700 1 -- 172.21.15.76:0/488779057 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae541a5490 con 0x7fae540ffe00 2024-06-02T05:01:58.766 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.758+0000 7fae59949700 1 -- 172.21.15.76:0/488779057 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae541a5920 con 0x7fae540ffe00 2024-06-02T05:01:58.767 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.765+0000 7fae65b04b80 1 Processor -- start 2024-06-02T05:01:58.772 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.767+0000 7fae58947700 1 -- 172.21.15.76:0/488779057 <== mon.2 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fae44003a40 con 0x7fae540ffe00 2024-06-02T05:01:58.773 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.767+0000 7fae58947700 1 --2- 172.21.15.76:0/488779057 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fae3c0a11a0 0x7fae3c0a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:01:58.773 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.768+0000 7fae65b04b80 1 -- start start 2024-06-02T05:01:58.773 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.768+0000 7fae58947700 1 -- 172.21.15.76:0/488779057 <== mon.2 v2:172.21.15.119:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7fae440cc5f0 con 0x7fae540ffe00 2024-06-02T05:01:58.773 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.768+0000 7fae65b04b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5626a0724a80 0x5626a0724ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:01:58.773 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.768+0000 7fae65b04b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5626a07253e0 0x5626a0725cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:01:58.773 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.768+0000 7fae65b04b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5626a07262d0 0x5626a0726750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:01:58.774 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.768+0000 7fae65b04b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626a067c0f0 con 0x5626a0724a80 2024-06-02T05:01:58.774 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.768+0000 7fae65b04b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626a0679ab0 con 0x5626a07262d0 2024-06-02T05:01:58.774 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.768+0000 7fae65b04b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626a06753a0 con 0x5626a07253e0 2024-06-02T05:01:58.774 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.768+0000 7fae537fe700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5626a07262d0 0x5626a0726750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:01:58.774 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.768+0000 7fae52ffd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5626a0724a80 0x5626a0724ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:01:58.775 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.768+0000 7fae52ffd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5626a0724a80 0x5626a0724ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:50794/0 (socket says 172.21.15.76:50794) 2024-06-02T05:01:58.775 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.768+0000 7fae52ffd700 1 -- 172.21.15.76:0/2870720534 learned_addr learned my addr 172.21.15.76:0/2870720534 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:01:58.775 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.768+0000 7fae527fc700 1 --2- 172.21.15.76:0/2870720534 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5626a07253e0 0x5626a0725cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:01:58.775 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.769+0000 7fae527fc700 1 -- 172.21.15.76:0/2870720534 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5626a07262d0 msgr2=0x5626a0726750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:01:58.775 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.769+0000 7fae527fc700 1 --2- 172.21.15.76:0/2870720534 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5626a07262d0 0x5626a0726750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:58.775 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.769+0000 7fae527fc700 1 -- 172.21.15.76:0/2870720534 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5626a0724a80 msgr2=0x5626a0724ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:01:58.776 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.769+0000 7fae527fc700 1 --2- 172.21.15.76:0/2870720534 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5626a0724a80 0x5626a0724ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:58.776 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.769+0000 7fae527fc700 1 -- 172.21.15.76:0/2870720534 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5626a04f6350 con 0x5626a07253e0 2024-06-02T05:01:58.776 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.769+0000 7fae527fc700 1 --2- 172.21.15.76:0/2870720534 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5626a07253e0 0x5626a0725cf0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fae4800b390 tx=0x7fae4800d670 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3d1562af99af58d5 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:01:58.776 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.769+0000 7fae39ffb700 1 -- 172.21.15.76:0/2870720534 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae48012040 con 0x5626a07253e0 2024-06-02T05:01:58.776 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.769+0000 7fae39ffb700 1 -- 172.21.15.76:0/2870720534 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fae4802ade0 con 0x5626a07253e0 2024-06-02T05:01:58.776 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.769+0000 7fae39ffb700 1 -- 172.21.15.76:0/2870720534 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae48004a70 con 0x5626a07253e0 2024-06-02T05:01:58.776 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.769+0000 7fae537fe700 1 --2- 172.21.15.76:0/488779057 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fae3c0a11a0 0x7fae3c0a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:01:58.777 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.770+0000 7fae65b04b80 1 -- 172.21.15.76:0/2870720534 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5626a07253e0 msgr2=0x5626a0725cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:01:58.777 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.770+0000 7fae65b04b80 1 --2- 172.21.15.76:0/2870720534 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5626a07253e0 0x5626a0725cf0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fae4800b390 tx=0x7fae4800d670 comp rx=0 tx=0).stop 2024-06-02T05:01:58.777 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.770+0000 7fae65b04b80 1 -- 172.21.15.76:0/2870720534 shutdown_connections 2024-06-02T05:01:58.777 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.770+0000 7fae65b04b80 1 --2- 172.21.15.76:0/2870720534 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5626a07262d0 0x5626a0726750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:58.777 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.770+0000 7fae65b04b80 1 --2- 172.21.15.76:0/2870720534 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5626a0724a80 0x5626a0724ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:58.777 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.770+0000 7fae65b04b80 1 --2- 172.21.15.76:0/2870720534 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5626a07253e0 0x5626a0725cf0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:58.777 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.770+0000 7fae65b04b80 1 -- 172.21.15.76:0/2870720534 >> 172.21.15.76:0/2870720534 conn(0x5626a06831b0 msgr2=0x5626a0721440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:01:58.777 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.770+0000 7fae65b04b80 1 -- 172.21.15.76:0/2870720534 shutdown_connections 2024-06-02T05:01:58.777 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.770+0000 7fae537fe700 1 --2- 172.21.15.76:0/488779057 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fae3c0a11a0 0x7fae3c0a3660 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fae4c007bc0 tx=0x7fae4c005040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:01:58.777 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.770+0000 7fae65b04b80 1 -- 172.21.15.76:0/2870720534 wait complete. 2024-06-02T05:01:58.777 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.771+0000 7fae65b04b80 1 -- start start 2024-06-02T05:01:58.778 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.771+0000 7fae65b04b80 1 Processor -- start 2024-06-02T05:01:58.778 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.771+0000 7fae65b04b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5626a0724a80 0x5626a072e820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:01:58.778 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.771+0000 7fae65b04b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5626a07253e0 0x5626a072ed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:01:58.778 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.771+0000 7fae65b04b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5626a07262d0 0x5626a0735da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:01:58.778 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.771+0000 7fae65b04b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626a0611500 con 0x5626a0724a80 2024-06-02T05:01:58.779 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.771+0000 7fae65b04b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626a06111a0 con 0x5626a07262d0 2024-06-02T05:01:58.779 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.771+0000 7fae65b04b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626a04f8640 con 0x5626a07253e0 2024-06-02T05:01:58.779 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.771+0000 7fae65b04b80 10 client.0 _ll_register_callbacks cb 0x5626a061aad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T05:01:58.780 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.772+0000 7fae537fe700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5626a07262d0 0x5626a0735da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:01:58.780 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.772+0000 7fae537fe700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5626a07262d0 0x5626a0735da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:55614/0 (socket says 172.21.15.76:55614) 2024-06-02T05:01:58.780 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.772+0000 7fae537fe700 1 -- 172.21.15.76:0/3631154348 learned_addr learned my addr 172.21.15.76:0/3631154348 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:01:58.781 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.772+0000 7fae537fe700 1 -- 172.21.15.76:0/3631154348 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5626a07253e0 msgr2=0x5626a072ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:01:58.781 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.772+0000 7fae537fe700 1 --2- 172.21.15.76:0/3631154348 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5626a07253e0 0x5626a072ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:58.781 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.772+0000 7fae537fe700 1 -- 172.21.15.76:0/3631154348 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5626a0724a80 msgr2=0x5626a072e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:01:58.781 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.772+0000 7fae537fe700 1 --2- 172.21.15.76:0/3631154348 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5626a0724a80 0x5626a072e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:58.781 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.772+0000 7fae537fe700 1 -- 172.21.15.76:0/3631154348 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae4800d2e0 con 0x5626a07262d0 2024-06-02T05:01:58.781 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.772+0000 7fae537fe700 1 --2- 172.21.15.76:0/3631154348 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5626a07262d0 0x5626a0735da0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fae4c007a90 tx=0x7fae4c00b3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=789ff15c36bfde37 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:01:58.782 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.772+0000 7fae32ffd700 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-06-02T05:01:58.782 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.773+0000 7fae32ffd700 1 -- 172.21.15.76:0/3631154348 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae4c0050b0 con 0x5626a07262d0 2024-06-02T05:01:58.782 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.773+0000 7fae32ffd700 1 -- 172.21.15.76:0/3631154348 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7fae4c005210 con 0x5626a07262d0 2024-06-02T05:01:58.782 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.773+0000 7fae65b04b80 1 -- 172.21.15.76:0/3631154348 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5626a05ce210 con 0x5626a07262d0 2024-06-02T05:01:58.782 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.777+0000 7fae32ffd700 1 -- 172.21.15.76:0/3631154348 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fae4c0053d0 con 0x5626a07262d0 2024-06-02T05:01:58.783 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.778+0000 7fae65b04b80 10 client.26108 fetch_fsmap learned FSMap version 36 2024-06-02T05:01:58.783 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.778+0000 7fae65b04b80 1 -- 172.21.15.76:0/3631154348 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x5626a04a2b00 con 0x5626a07262d0 2024-06-02T05:01:58.783 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.779+0000 7fae32ffd700 1 -- 172.21.15.76:0/3631154348 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fae4c037030 con 0x5626a07262d0 2024-06-02T05:01:58.783 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.779+0000 7fae32ffd700 1 -- 172.21.15.76:0/3631154348 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fae4c02e020 con 0x5626a07262d0 2024-06-02T05:01:58.783 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.779+0000 7fae65b04b80 10 client.26108 fetch_fsmap finished waiting for FSMap version 36 2024-06-02T05:01:58.783 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.779+0000 7fae65b04b80 10 client.26108 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T05:01:58.783 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.779+0000 7fae65b04b80 20 client.26108 populate_metadata read hostname 'smithi076' 2024-06-02T05:01:58.786 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.779+0000 7fae65b04b80 1 --2- 172.21.15.76:0/3631154348 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5626a073a600 0x5626a073ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:01:58.786 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.779+0000 7fae65b04b80 4 client.26108 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T05:01:58.787 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.779+0000 7fae65b04b80 1 -- 172.21.15.76:0/3631154348 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5626a06f47b0 con 0x5626a073a600 2024-06-02T05:01:58.787 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.780+0000 7fae52ffd700 1 --2- 172.21.15.76:0/3631154348 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5626a073a600 0x5626a073ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:01:58.789 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.780+0000 7fae52ffd700 1 --2- 172.21.15.76:0/3631154348 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5626a073a600 0x5626a073ca20 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ccbad204c77c654a server_cookie=2e7480ad8b86ad9a in_seq=0 out_seq=0 2024-06-02T05:01:58.789 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.780+0000 7fae32ffd700 10 client.26108 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T05:01:58.789 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.781+0000 7fae32ffd700 1 -- 172.21.15.76:0/3631154348 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5626a06f47b0 con 0x5626a073a600 2024-06-02T05:01:58.789 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.781+0000 7fae32ffd700 10 client.26108 handle_command_reply: tid=0 2024-06-02T05:01:58.790 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.784+0000 7fae65b04b80 1 client.26108 shutdown 2024-06-02T05:01:58.790 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.785+0000 7fae65b04b80 1 -- 172.21.15.76:0/3631154348 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5626a07262d0 msgr2=0x5626a0735da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:01:58.790 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.785+0000 7fae65b04b80 1 --2- 172.21.15.76:0/3631154348 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5626a07262d0 0x5626a0735da0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fae4c007a90 tx=0x7fae4c00b3e0 comp rx=0 tx=0).stop 2024-06-02T05:01:58.790 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.785+0000 7fae65b04b80 1 -- 172.21.15.76:0/3631154348 shutdown_connections 2024-06-02T05:01:58.791 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.785+0000 7fae65b04b80 1 --2- 172.21.15.76:0/3631154348 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5626a073a600 0x5626a073ca20 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:58.791 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.785+0000 7fae65b04b80 1 --2- 172.21.15.76:0/3631154348 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5626a07262d0 0x5626a0735da0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:58.791 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.785+0000 7fae65b04b80 1 --2- 172.21.15.76:0/3631154348 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5626a0724a80 0x5626a072e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:58.791 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.785+0000 7fae65b04b80 1 --2- 172.21.15.76:0/3631154348 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5626a07253e0 0x5626a072ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:58.791 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.785+0000 7fae65b04b80 1 -- 172.21.15.76:0/3631154348 >> 172.21.15.76:0/3631154348 conn(0x5626a06831b0 msgr2=0x5626a071f860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:01:58.792 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.786+0000 7fae32ffd700 0 client.26108 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T05:01:58.792 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.786+0000 7fae65b04b80 1 -- 172.21.15.76:0/3631154348 shutdown_connections 2024-06-02T05:01:58.792 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.786+0000 7fae65b04b80 1 -- 172.21.15.76:0/3631154348 wait complete. 2024-06-02T05:01:58.792 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.788+0000 7fae65b04b80 20 client.26108 trim_cache size 0 max 16384 2024-06-02T05:01:58.817 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.816+0000 7fae65b04b80 1 Processor -- start 2024-06-02T05:01:58.825 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.820+0000 7fae65b04b80 1 -- start start 2024-06-02T05:01:58.825 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.820+0000 7fae65b04b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5626a0724a80 0x5626a07266b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:01:58.825 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.820+0000 7fae65b04b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5626a07253e0 0x5626a0735d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:01:58.825 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.820+0000 7fae65b04b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5626a07262d0 0x5626a072c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:01:58.825 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.820+0000 7fae65b04b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626a072fa10 con 0x5626a0724a80 2024-06-02T05:01:58.825 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.820+0000 7fae65b04b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626a0741c50 con 0x5626a07253e0 2024-06-02T05:01:58.825 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.820+0000 7fae65b04b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626a072c4c0 con 0x5626a07262d0 2024-06-02T05:01:58.825 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.820+0000 7fae527fc700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5626a07253e0 0x5626a0735d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:01:58.826 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.820+0000 7fae527fc700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5626a07253e0 0x5626a0735d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:55622/0 (socket says 172.21.15.76:55622) 2024-06-02T05:01:58.826 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.820+0000 7fae527fc700 1 -- 172.21.15.76:0/33486214 learned_addr learned my addr 172.21.15.76:0/33486214 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:01:58.826 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.820+0000 7fae52ffd700 1 --2- 172.21.15.76:0/33486214 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5626a0724a80 0x5626a07266b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:01:58.826 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.821+0000 7fae527fc700 1 -- 172.21.15.76:0/33486214 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5626a07262d0 msgr2=0x5626a072c840 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-02T05:01:58.826 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.821+0000 7fae527fc700 1 --2- 172.21.15.76:0/33486214 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5626a07262d0 0x5626a072c840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:58.826 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.821+0000 7fae527fc700 1 -- 172.21.15.76:0/33486214 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5626a0724a80 msgr2=0x5626a07266b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:01:58.826 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.821+0000 7fae527fc700 1 --2- 172.21.15.76:0/33486214 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5626a0724a80 0x5626a07266b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:58.826 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.821+0000 7fae527fc700 1 -- 172.21.15.76:0/33486214 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5626a063b500 con 0x5626a07253e0 2024-06-02T05:01:58.826 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.821+0000 7fae527fc700 1 --2- 172.21.15.76:0/33486214 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5626a07253e0 0x5626a0735d60 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fae4800f010 tx=0x7fae4802af90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6845c744592518db server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:01:58.826 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.821+0000 7fae3a7fc700 1 -- 172.21.15.76:0/33486214 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae48012070 con 0x5626a07253e0 2024-06-02T05:01:58.826 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.821+0000 7fae3a7fc700 1 -- 172.21.15.76:0/33486214 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fae4802ab50 con 0x5626a07253e0 2024-06-02T05:01:58.826 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.821+0000 7fae3a7fc700 1 -- 172.21.15.76:0/33486214 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae480195b0 con 0x5626a07253e0 2024-06-02T05:01:58.827 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.822+0000 7fae65b04b80 1 -- 172.21.15.76:0/33486214 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5626a07253e0 msgr2=0x5626a0735d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:01:58.827 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.822+0000 7fae65b04b80 1 --2- 172.21.15.76:0/33486214 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5626a07253e0 0x5626a0735d60 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fae4800f010 tx=0x7fae4802af90 comp rx=0 tx=0).stop 2024-06-02T05:01:58.830 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.827+0000 7fae65b04b80 1 -- 172.21.15.76:0/33486214 shutdown_connections 2024-06-02T05:01:58.831 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.827+0000 7fae65b04b80 1 --2- 172.21.15.76:0/33486214 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5626a07262d0 0x5626a072c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:58.831 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.827+0000 7fae65b04b80 1 --2- 172.21.15.76:0/33486214 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5626a0724a80 0x5626a07266b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:58.831 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.828+0000 7fae65b04b80 1 --2- 172.21.15.76:0/33486214 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5626a07253e0 0x5626a0735d60 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:58.831 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.828+0000 7fae65b04b80 1 -- 172.21.15.76:0/33486214 >> 172.21.15.76:0/33486214 conn(0x5626a06831b0 msgr2=0x5626a072dda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:01:58.831 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.828+0000 7fae65b04b80 1 -- 172.21.15.76:0/33486214 shutdown_connections 2024-06-02T05:01:58.831 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.828+0000 7fae65b04b80 1 -- 172.21.15.76:0/33486214 wait complete. 2024-06-02T05:01:58.831 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.828+0000 7fae65b04b80 1 -- start start 2024-06-02T05:01:58.831 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.829+0000 7fae65b04b80 1 Processor -- start 2024-06-02T05:01:58.831 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.829+0000 7fae65b04b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5626a0724a80 0x5626a0732fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:01:58.831 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.829+0000 7fae65b04b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5626a07253e0 0x5626a0733520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:01:58.831 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.829+0000 7fae65b04b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5626a07262d0 0x5626a0734390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:01:58.831 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.829+0000 7fae65b04b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626a0734940 con 0x5626a07262d0 2024-06-02T05:01:58.832 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.829+0000 7fae65b04b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626a0734ab0 con 0x5626a0724a80 2024-06-02T05:01:58.832 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.829+0000 7fae65b04b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626a0734c70 con 0x5626a07253e0 2024-06-02T05:01:58.832 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.829+0000 7fae65b04b80 10 client.0 _ll_register_callbacks cb 0x5626a061aad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T05:01:58.832 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.830+0000 7fae537fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5626a07262d0 0x5626a0734390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:01:58.832 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.830+0000 7fae537fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5626a07262d0 0x5626a0734390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:50820/0 (socket says 172.21.15.76:50820) 2024-06-02T05:01:58.832 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.830+0000 7fae537fe700 1 -- 172.21.15.76:0/4143070561 learned_addr learned my addr 172.21.15.76:0/4143070561 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:01:58.832 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.830+0000 7fae52ffd700 1 --2- 172.21.15.76:0/4143070561 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5626a0724a80 0x5626a0732fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:01:58.832 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.830+0000 7fae527fc700 1 --2- 172.21.15.76:0/4143070561 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5626a07253e0 0x5626a0733520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:01:58.833 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.830+0000 7fae537fe700 1 -- 172.21.15.76:0/4143070561 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5626a07253e0 msgr2=0x5626a0733520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:01:58.834 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.830+0000 7fae537fe700 1 --2- 172.21.15.76:0/4143070561 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5626a07253e0 0x5626a0733520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:58.834 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.830+0000 7fae537fe700 1 -- 172.21.15.76:0/4143070561 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5626a0724a80 msgr2=0x5626a0732fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:01:58.834 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.830+0000 7fae537fe700 1 --2- 172.21.15.76:0/4143070561 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5626a0724a80 0x5626a0732fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:58.834 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.830+0000 7fae537fe700 1 -- 172.21.15.76:0/4143070561 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5626a04f6350 con 0x5626a07262d0 2024-06-02T05:01:58.834 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.831+0000 7fae537fe700 1 --2- 172.21.15.76:0/4143070561 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5626a07262d0 0x5626a0734390 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fae4c009610 tx=0x7fae4c00bf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1722eab08e3081e7 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:01:58.834 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.831+0000 7fae32ffd700 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-06-02T05:01:58.834 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.831+0000 7fae32ffd700 1 -- 172.21.15.76:0/4143070561 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae4c0054c0 con 0x5626a07262d0 2024-06-02T05:01:58.834 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.831+0000 7fae32ffd700 1 -- 172.21.15.76:0/4143070561 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7fae4c01daa0 con 0x5626a07262d0 2024-06-02T05:01:58.834 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.831+0000 7fae65b04b80 1 -- 172.21.15.76:0/4143070561 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fae4802ade0 con 0x5626a07262d0 2024-06-02T05:01:58.834 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.831+0000 7fae32ffd700 1 -- 172.21.15.76:0/4143070561 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fae4c005620 con 0x5626a07262d0 2024-06-02T05:01:58.834 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.831+0000 7fae65b04b80 10 client.16485 fetch_fsmap learned FSMap version 36 2024-06-02T05:01:58.834 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.831+0000 7fae65b04b80 1 -- 172.21.15.76:0/4143070561 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x5626a04fac70 con 0x5626a07262d0 2024-06-02T05:01:58.835 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.832+0000 7fae32ffd700 1 -- 172.21.15.76:0/4143070561 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fae4802ade0 con 0x5626a07262d0 2024-06-02T05:01:58.835 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.832+0000 7fae32ffd700 1 -- 172.21.15.76:0/4143070561 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fae4c02e040 con 0x5626a07262d0 2024-06-02T05:01:58.835 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.832+0000 7fae65b04b80 10 client.16485 fetch_fsmap finished waiting for FSMap version 36 2024-06-02T05:01:58.835 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.832+0000 7fae65b04b80 10 client.16485 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T05:01:58.835 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.832+0000 7fae65b04b80 20 client.16485 populate_metadata read hostname 'smithi076' 2024-06-02T05:01:58.835 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.832+0000 7fae65b04b80 1 --2- 172.21.15.76:0/4143070561 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5626a0790b30 0x5626a0792f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:01:58.835 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.832+0000 7fae65b04b80 4 client.16485 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T05:01:58.835 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.832+0000 7fae65b04b80 1 -- 172.21.15.76:0/4143070561 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5626a066de60 con 0x5626a0790b30 2024-06-02T05:01:58.835 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.832+0000 7fae52ffd700 1 --2- 172.21.15.76:0/4143070561 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5626a0790b30 0x5626a0792f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:01:58.835 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.833+0000 7fae52ffd700 1 --2- 172.21.15.76:0/4143070561 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5626a0790b30 0x5626a0792f20 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c8bb25afca7e74d server_cookie=b70ddbb381712558 in_seq=0 out_seq=0 2024-06-02T05:01:58.835 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.833+0000 7fae32ffd700 10 client.16485 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T05:01:58.856 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.854+0000 7fae32ffd700 1 -- 172.21.15.76:0/4143070561 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5626a066de60 con 0x5626a0790b30 2024-06-02T05:01:58.856 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.854+0000 7fae32ffd700 10 client.16485 handle_command_reply: tid=0 2024-06-02T05:01:58.856 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.855+0000 7fae65b04b80 1 client.16485 shutdown 2024-06-02T05:01:58.856 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.855+0000 7fae65b04b80 1 -- 172.21.15.76:0/4143070561 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5626a07262d0 msgr2=0x5626a0734390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:01:58.857 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.855+0000 7fae65b04b80 1 --2- 172.21.15.76:0/4143070561 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5626a07262d0 0x5626a0734390 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fae4c009610 tx=0x7fae4c00bf20 comp rx=0 tx=0).stop 2024-06-02T05:01:58.857 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.855+0000 7fae65b04b80 1 -- 172.21.15.76:0/4143070561 shutdown_connections 2024-06-02T05:01:58.857 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.855+0000 7fae65b04b80 1 --2- 172.21.15.76:0/4143070561 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5626a0790b30 0x5626a0792f20 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:58.857 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.855+0000 7fae65b04b80 1 --2- 172.21.15.76:0/4143070561 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5626a07262d0 0x5626a0734390 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:58.857 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.855+0000 7fae65b04b80 1 --2- 172.21.15.76:0/4143070561 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5626a0724a80 0x5626a0732fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:58.858 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.855+0000 7fae65b04b80 1 --2- 172.21.15.76:0/4143070561 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5626a07253e0 0x5626a0733520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:58.858 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.855+0000 7fae65b04b80 1 -- 172.21.15.76:0/4143070561 >> 172.21.15.76:0/4143070561 conn(0x5626a06831b0 msgr2=0x5626a072c770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:01:58.858 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.855+0000 7fae32ffd700 0 client.16485 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T05:01:58.861 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.860+0000 7fae65b04b80 1 -- 172.21.15.76:0/4143070561 shutdown_connections 2024-06-02T05:01:58.861 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.860+0000 7fae65b04b80 1 -- 172.21.15.76:0/4143070561 wait complete. 2024-06-02T05:01:58.862 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.861+0000 7fae65b04b80 20 client.16485 trim_cache size 0 max 16384 2024-06-02T05:01:58.862 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:{ 2024-06-02T05:01:58.862 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "message": "", 2024-06-02T05:01:58.863 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "return_code": 0 2024-06-02T05:01:58.863 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:} 2024-06-02T05:01:58.864 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.861+0000 7fae59949700 1 -- 172.21.15.76:0/488779057 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fae3c0a11a0 msgr2=0x7fae3c0a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:01:58.864 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.861+0000 7fae59949700 1 --2- 172.21.15.76:0/488779057 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fae3c0a11a0 0x7fae3c0a3660 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fae4c007bc0 tx=0x7fae4c005040 comp rx=0 tx=0).stop 2024-06-02T05:01:58.864 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.861+0000 7fae59949700 1 -- 172.21.15.76:0/488779057 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fae540ffe00 msgr2=0x7fae5406f8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:01:58.865 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.861+0000 7fae59949700 1 --2- 172.21.15.76:0/488779057 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fae540ffe00 0x7fae5406f8d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fae44007ba0 tx=0x7fae44007eb0 comp rx=0 tx=0).stop 2024-06-02T05:01:58.865 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.862+0000 7fae59949700 1 -- 172.21.15.76:0/488779057 shutdown_connections 2024-06-02T05:01:58.865 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.862+0000 7fae59949700 1 --2- 172.21.15.76:0/488779057 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fae54101990 0x7fae541a4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:58.865 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.862+0000 7fae59949700 1 --2- 172.21.15.76:0/488779057 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fae3c0a11a0 0x7fae3c0a3660 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:58.865 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.862+0000 7fae59949700 1 --2- 172.21.15.76:0/488779057 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fae540ffe00 0x7fae5406f8d0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:58.865 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.862+0000 7fae59949700 1 --2- 172.21.15.76:0/488779057 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fae54100ff0 0x7fae5406fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:01:58.866 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.862+0000 7fae59949700 1 -- 172.21.15.76:0/488779057 >> 172.21.15.76:0/488779057 conn(0x7fae540fb390 msgr2=0x7fae54104370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:01:58.872 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.872+0000 7fae59949700 1 -- 172.21.15.76:0/488779057 shutdown_connections 2024-06-02T05:01:58.878 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:01:58.878+0000 7fae59949700 1 -- 172.21.15.76:0/488779057 wait complete. 2024-06-02T05:01:59.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:01:58 smithi119 ceph-mon[46633]: pgmap v640: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 9.2 MiB/s wr, 771 op/s 2024-06-02T05:01:59.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:01:58 smithi192 ceph-mon[47933]: pgmap v640: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 9.2 MiB/s wr, 771 op/s 2024-06-02T05:01:59.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:01:58 smithi076 ceph-mon[42935]: pgmap v640: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 9.2 MiB/s wr, 771 op/s 2024-06-02T05:02:01.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 670.0 s, 589.2 tps, lat 171.196 ms stddev 78.434 2024-06-02T05:02:01.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:02:01 smithi192 ceph-mon[47933]: pgmap v641: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 9.5 MiB/s wr, 805 op/s 2024-06-02T05:02:01.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:02:01 smithi076 ceph-mon[42935]: pgmap v641: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 9.5 MiB/s wr, 805 op/s 2024-06-02T05:02:02.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:02:01 smithi119 ceph-mon[46633]: pgmap v641: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 9.5 MiB/s wr, 805 op/s 2024-06-02T05:02:03.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:02:03 smithi192 ceph-mon[47933]: pgmap v642: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 9.8 MiB/s wr, 780 op/s 2024-06-02T05:02:03.990 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:02:03 smithi076 ceph-mon[42935]: pgmap v642: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 9.8 MiB/s wr, 780 op/s 2024-06-02T05:02:04.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:02:03 smithi119 ceph-mon[46633]: pgmap v642: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 9.8 MiB/s wr, 780 op/s 2024-06-02T05:02:05.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:02:05 smithi192 ceph-mon[47933]: pgmap v643: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 8.5 MiB/s wr, 662 op/s 2024-06-02T05:02:05.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:02:05 smithi076 ceph-mon[42935]: pgmap v643: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 8.5 MiB/s wr, 662 op/s 2024-06-02T05:02:06.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:02:05 smithi119 ceph-mon[46633]: pgmap v643: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 8.5 MiB/s wr, 662 op/s 2024-06-02T05:02:06.319 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 675.0 s, 607.9 tps, lat 162.408 ms stddev 70.279 2024-06-02T05:02:07.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:02:07 smithi192 ceph-mon[47933]: pgmap v644: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 9.8 MiB/s wr, 795 op/s 2024-06-02T05:02:07.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:02:07 smithi076 ceph-mon[42935]: pgmap v644: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 9.8 MiB/s wr, 795 op/s 2024-06-02T05:02:08.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:02:07 smithi119 ceph-mon[46633]: pgmap v644: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 9.8 MiB/s wr, 795 op/s 2024-06-02T05:02:09.985 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:02:09 smithi076 ceph-mon[42935]: pgmap v645: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 7.9 MiB/s wr, 651 op/s 2024-06-02T05:02:10.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:02:09 smithi119 ceph-mon[46633]: pgmap v645: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 7.9 MiB/s wr, 651 op/s 2024-06-02T05:02:10.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:02:09 smithi192 ceph-mon[47933]: pgmap v645: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 7.9 MiB/s wr, 651 op/s 2024-06-02T05:02:11.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:02:10 smithi119 ceph-mon[46633]: pgmap v646: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 9.2 MiB/s wr, 757 op/s 2024-06-02T05:02:11.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:02:10 smithi192 ceph-mon[47933]: pgmap v646: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 9.2 MiB/s wr, 757 op/s 2024-06-02T05:02:11.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:02:10 smithi076 ceph-mon[42935]: pgmap v646: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 9.2 MiB/s wr, 757 op/s 2024-06-02T05:02:11.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 680.0 s, 501.9 tps, lat 199.408 ms stddev 70.630 2024-06-02T05:02:12.062 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.061+0000 7f86fa545700 1 -- 172.21.15.76:0/607133660 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86f40ff770 msgr2=0x7f86f4101ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:02:12.062 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.061+0000 7f86fa545700 1 --2- 172.21.15.76:0/607133660 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86f40ff770 0x7f86f4101ba0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f86e401a9a0 tx=0x7f86e401acb0 comp rx=0 tx=0).stop 2024-06-02T05:02:12.062 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.061+0000 7f86fa545700 1 -- 172.21.15.76:0/607133660 shutdown_connections 2024-06-02T05:02:12.063 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.061+0000 7f86fa545700 1 --2- 172.21.15.76:0/607133660 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f86f4104ab0 0x7f86f4104f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:12.063 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.061+0000 7f86fa545700 1 --2- 172.21.15.76:0/607133660 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86f40ff770 0x7f86f4101ba0 secure :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f86e401a9a0 tx=0x7f86e401acb0 comp rx=0 tx=0).stop 2024-06-02T05:02:12.063 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.061+0000 7f86fa545700 1 --2- 172.21.15.76:0/607133660 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f86f41020e0 0x7f86f4104570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:12.063 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.061+0000 7f86fa545700 1 -- 172.21.15.76:0/607133660 >> 172.21.15.76:0/607133660 conn(0x7f86f40fb390 msgr2=0x7f86f40fd7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:02:12.063 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.061+0000 7f86fa545700 1 -- 172.21.15.76:0/607133660 shutdown_connections 2024-06-02T05:02:12.063 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.061+0000 7f86fa545700 1 -- 172.21.15.76:0/607133660 wait complete. 2024-06-02T05:02:12.065 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.062+0000 7f86fa545700 1 Processor -- start 2024-06-02T05:02:12.065 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.062+0000 7f86fa545700 1 -- start start 2024-06-02T05:02:12.065 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.062+0000 7f86fa545700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86f41020e0 0x7f86f4194ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:02:12.066 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.062+0000 7f86fa545700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f86f4104ab0 0x7f86f4195430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:02:12.066 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.062+0000 7f86fa545700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f86f419a440 0x7f86f419c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:02:12.066 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.062+0000 7f86fa545700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86f419ce00 con 0x7f86f419a440 2024-06-02T05:02:12.066 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.062+0000 7f86fa545700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86f406a9c0 con 0x7f86f41020e0 2024-06-02T05:02:12.066 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.062+0000 7f86fa545700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86f406ab50 con 0x7f86f4104ab0 2024-06-02T05:02:12.066 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.063+0000 7f86f3fff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86f41020e0 0x7f86f4194ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:02:12.066 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.063+0000 7f86f3fff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86f41020e0 0x7f86f4194ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:58860/0 (socket says 172.21.15.76:58860) 2024-06-02T05:02:12.066 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.063+0000 7f86f3fff700 1 -- 172.21.15.76:0/2724167015 learned_addr learned my addr 172.21.15.76:0/2724167015 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:02:12.066 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.063+0000 7f86f37fe700 1 --2- 172.21.15.76:0/2724167015 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f86f4104ab0 0x7f86f4195430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:02:12.066 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.063+0000 7f86f3fff700 1 -- 172.21.15.76:0/2724167015 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f86f4104ab0 msgr2=0x7f86f4195430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:02:12.067 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.063+0000 7f86f3fff700 1 --2- 172.21.15.76:0/2724167015 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f86f4104ab0 0x7f86f4195430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:12.067 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.063+0000 7f86f3fff700 1 -- 172.21.15.76:0/2724167015 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f86f419a440 msgr2=0x7f86f419c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:02:12.067 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.063+0000 7f86f3fff700 1 --2- 172.21.15.76:0/2724167015 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f86f419a440 0x7f86f419c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:12.067 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.063+0000 7f86f3fff700 1 -- 172.21.15.76:0/2724167015 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86e401a600 con 0x7f86f41020e0 2024-06-02T05:02:12.067 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.063+0000 7f86f3fff700 1 --2- 172.21.15.76:0/2724167015 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86f41020e0 0x7f86f4194ef0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f86e4000c00 tx=0x7f86e40057b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:02:12.067 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.063+0000 7f86f17fa700 1 -- 172.21.15.76:0/2724167015 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e402d070 con 0x7f86f41020e0 2024-06-02T05:02:12.067 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.063+0000 7f86f17fa700 1 -- 172.21.15.76:0/2724167015 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f86e4005a00 con 0x7f86f41020e0 2024-06-02T05:02:12.067 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.063+0000 7f86fa545700 1 -- 172.21.15.76:0/2724167015 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86f406add0 con 0x7f86f41020e0 2024-06-02T05:02:12.067 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.063+0000 7f86f17fa700 1 -- 172.21.15.76:0/2724167015 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e4028c60 con 0x7f86f41020e0 2024-06-02T05:02:12.067 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.063+0000 7f86fa545700 1 -- 172.21.15.76:0/2724167015 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86f406b250 con 0x7f86f41020e0 2024-06-02T05:02:12.069 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.068+0000 7f86f17fa700 1 -- 172.21.15.76:0/2724167015 <== mon.2 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f86e40595c0 con 0x7f86f41020e0 2024-06-02T05:02:12.069 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.068+0000 7f8706700b80 1 Processor -- start 2024-06-02T05:02:12.069 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.068+0000 7f86f17fa700 1 --2- 172.21.15.76:0/2724167015 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f86dc0a11f0 0x7f86dc0a36b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:02:12.069 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.069+0000 7f86f17fa700 1 -- 172.21.15.76:0/2724167015 <== mon.2 v2:172.21.15.119:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f86e40df310 con 0x7f86f41020e0 2024-06-02T05:02:12.076 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.074+0000 7f8706700b80 1 -- start start 2024-06-02T05:02:12.077 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.074+0000 7f8706700b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5653a277ea80 0x5653a277eea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:02:12.077 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.074+0000 7f8706700b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5653a277f3e0 0x5653a277fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:02:12.077 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.074+0000 7f8706700b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5653a27802d0 0x5653a2780750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:02:12.077 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.074+0000 7f8706700b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653a26d60f0 con 0x5653a277ea80 2024-06-02T05:02:12.077 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.074+0000 7f8706700b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653a26d3ab0 con 0x5653a277f3e0 2024-06-02T05:02:12.077 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.074+0000 7f8706700b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653a26cf3a0 con 0x5653a27802d0 2024-06-02T05:02:12.077 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.074+0000 7f86f8ae2700 1 --2- 172.21.15.76:0/2724167015 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f86dc0a11f0 0x7f86dc0a36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:02:12.077 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.074+0000 7f86f37fe700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5653a277f3e0 0x5653a277fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:02:12.077 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.074+0000 7f86f37fe700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5653a277f3e0 0x5653a277fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:58876/0 (socket says 172.21.15.76:58876) 2024-06-02T05:02:12.077 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.074+0000 7f86f37fe700 1 -- 172.21.15.76:0/199504390 learned_addr learned my addr 172.21.15.76:0/199504390 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:02:12.077 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.074+0000 7f86f8ae2700 1 --2- 172.21.15.76:0/199504390 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5653a27802d0 0x5653a2780750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:02:12.077 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.074+0000 7f86f3fff700 1 --2- 172.21.15.76:0/199504390 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5653a277ea80 0x5653a277eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:02:12.078 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.075+0000 7f86f37fe700 1 -- 172.21.15.76:0/199504390 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5653a27802d0 msgr2=0x5653a2780750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:02:12.078 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.075+0000 7f86f37fe700 1 --2- 172.21.15.76:0/199504390 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5653a27802d0 0x5653a2780750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:12.078 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.075+0000 7f86f37fe700 1 -- 172.21.15.76:0/199504390 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5653a277ea80 msgr2=0x5653a277eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:02:12.078 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.075+0000 7f86f37fe700 1 --2- 172.21.15.76:0/199504390 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5653a277ea80 0x5653a277eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:12.078 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.075+0000 7f86f37fe700 1 -- 172.21.15.76:0/199504390 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5653a2550350 con 0x5653a277f3e0 2024-06-02T05:02:12.078 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.075+0000 7f86f37fe700 1 --2- 172.21.15.76:0/199504390 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5653a277f3e0 0x5653a277fcf0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f86e8009ad0 tx=0x7f86e8009de0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d2defae50edb1dfc server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:02:12.078 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.075+0000 7f86e27fc700 1 -- 172.21.15.76:0/199504390 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e800e990 con 0x5653a277f3e0 2024-06-02T05:02:12.078 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.075+0000 7f86e27fc700 1 -- 172.21.15.76:0/199504390 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f86e8013470 con 0x5653a277f3e0 2024-06-02T05:02:12.078 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.075+0000 7f86e27fc700 1 -- 172.21.15.76:0/199504390 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e8012630 con 0x5653a277f3e0 2024-06-02T05:02:12.078 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.076+0000 7f8706700b80 1 -- 172.21.15.76:0/199504390 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5653a277f3e0 msgr2=0x5653a277fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:02:12.078 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.076+0000 7f8706700b80 1 --2- 172.21.15.76:0/199504390 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5653a277f3e0 0x5653a277fcf0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f86e8009ad0 tx=0x7f86e8009de0 comp rx=0 tx=0).stop 2024-06-02T05:02:12.078 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.076+0000 7f86f8ae2700 1 --2- 172.21.15.76:0/2724167015 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f86dc0a11f0 0x7f86dc0a36b0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x5653a277fab0 tx=0x7f86ec00a5f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:02:12.081 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.076+0000 7f8706700b80 1 -- 172.21.15.76:0/199504390 shutdown_connections 2024-06-02T05:02:12.081 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.076+0000 7f8706700b80 1 --2- 172.21.15.76:0/199504390 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5653a27802d0 0x5653a2780750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:12.081 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.076+0000 7f8706700b80 1 --2- 172.21.15.76:0/199504390 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5653a277ea80 0x5653a277eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:12.081 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.076+0000 7f8706700b80 1 --2- 172.21.15.76:0/199504390 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5653a277f3e0 0x5653a277fcf0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:12.081 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.076+0000 7f8706700b80 1 -- 172.21.15.76:0/199504390 >> 172.21.15.76:0/199504390 conn(0x5653a26dd1b0 msgr2=0x5653a277b440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:02:12.081 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.076+0000 7f8706700b80 1 -- 172.21.15.76:0/199504390 shutdown_connections 2024-06-02T05:02:12.081 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.076+0000 7f8706700b80 1 -- 172.21.15.76:0/199504390 wait complete. 2024-06-02T05:02:12.081 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.077+0000 7f8706700b80 1 -- start start 2024-06-02T05:02:12.081 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.077+0000 7f8706700b80 1 Processor -- start 2024-06-02T05:02:12.081 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.077+0000 7f8706700b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5653a277ea80 0x5653a27888b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:02:12.081 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.077+0000 7f8706700b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5653a277f3e0 0x5653a2788df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:02:12.082 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.077+0000 7f8706700b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5653a27802d0 0x5653a278fe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:02:12.082 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.077+0000 7f8706700b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653a266b500 con 0x5653a277f3e0 2024-06-02T05:02:12.082 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.077+0000 7f8706700b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653a266b1a0 con 0x5653a277ea80 2024-06-02T05:02:12.082 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.077+0000 7f8706700b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653a2552640 con 0x5653a27802d0 2024-06-02T05:02:12.082 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.077+0000 7f8706700b80 10 client.0 _ll_register_callbacks cb 0x5653a2674ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T05:02:12.082 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.078+0000 7f86f37fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5653a277f3e0 0x5653a2788df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:02:12.082 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.078+0000 7f86f37fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5653a277f3e0 0x5653a2788df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:59502/0 (socket says 172.21.15.76:59502) 2024-06-02T05:02:12.082 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.078+0000 7f86f37fe700 1 -- 172.21.15.76:0/2806329614 learned_addr learned my addr 172.21.15.76:0/2806329614 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:02:12.082 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.078+0000 7f86f8ae2700 1 --2- 172.21.15.76:0/2806329614 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5653a27802d0 0x5653a278fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:02:12.082 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.078+0000 7f86f3fff700 1 --2- 172.21.15.76:0/2806329614 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5653a277ea80 0x5653a27888b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:02:12.082 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.078+0000 7f86f37fe700 1 -- 172.21.15.76:0/2806329614 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5653a27802d0 msgr2=0x5653a278fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:02:12.082 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.078+0000 7f86f37fe700 1 --2- 172.21.15.76:0/2806329614 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5653a27802d0 0x5653a278fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:12.083 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.078+0000 7f86f37fe700 1 -- 172.21.15.76:0/2806329614 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5653a277ea80 msgr2=0x5653a27888b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:02:12.083 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.078+0000 7f86f37fe700 1 --2- 172.21.15.76:0/2806329614 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5653a277ea80 0x5653a27888b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:12.083 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.078+0000 7f86f37fe700 1 -- 172.21.15.76:0/2806329614 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86e8009730 con 0x5653a277f3e0 2024-06-02T05:02:12.083 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.078+0000 7f86f8ae2700 1 --2- 172.21.15.76:0/2806329614 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5653a27802d0 0x5653a278fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T05:02:12.083 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.078+0000 7f86f3fff700 1 --2- 172.21.15.76:0/2806329614 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5653a277ea80 0x5653a27888b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T05:02:12.083 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.078+0000 7f86f37fe700 1 --2- 172.21.15.76:0/2806329614 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5653a277f3e0 0x5653a2788df0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f86e800ebc0 tx=0x7f86e8013b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87875c8ff180c830 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:02:12.083 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.078+0000 7f86d77fe700 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-06-02T05:02:12.083 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.079+0000 7f86d77fe700 1 -- 172.21.15.76:0/2806329614 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e8006da0 con 0x5653a277f3e0 2024-06-02T05:02:12.083 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.079+0000 7f86d77fe700 1 -- 172.21.15.76:0/2806329614 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f86e800ee20 con 0x5653a277f3e0 2024-06-02T05:02:12.083 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.079+0000 7f8706700b80 1 -- 172.21.15.76:0/2806329614 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5653a2628210 con 0x5653a277f3e0 2024-06-02T05:02:12.083 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.079+0000 7f86d77fe700 1 -- 172.21.15.76:0/2806329614 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f86e801c660 con 0x5653a277f3e0 2024-06-02T05:02:12.083 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.079+0000 7f8706700b80 10 client.16491 fetch_fsmap learned FSMap version 36 2024-06-02T05:02:12.083 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.079+0000 7f8706700b80 1 -- 172.21.15.76:0/2806329614 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x5653a24fcb00 con 0x5653a277f3e0 2024-06-02T05:02:12.084 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.082+0000 7f86d77fe700 1 -- 172.21.15.76:0/2806329614 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5653a2628210 con 0x5653a277f3e0 2024-06-02T05:02:12.084 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.082+0000 7f86d77fe700 1 -- 172.21.15.76:0/2806329614 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f86e8011070 con 0x5653a277f3e0 2024-06-02T05:02:12.085 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.083+0000 7f8706700b80 10 client.16491 fetch_fsmap finished waiting for FSMap version 36 2024-06-02T05:02:12.085 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.083+0000 7f8706700b80 10 client.16491 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T05:02:12.085 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.083+0000 7f8706700b80 20 client.16491 populate_metadata read hostname 'smithi076' 2024-06-02T05:02:12.085 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.083+0000 7f8706700b80 1 --2- 172.21.15.76:0/2806329614 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5653a2794530 0x5653a2796950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:02:12.085 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.083+0000 7f8706700b80 4 client.16491 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T05:02:12.085 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.083+0000 7f8706700b80 1 -- 172.21.15.76:0/2806329614 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5653a274e7b0 con 0x5653a2794530 2024-06-02T05:02:12.085 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.083+0000 7f86f3fff700 1 --2- 172.21.15.76:0/2806329614 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5653a2794530 0x5653a2796950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:02:12.085 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.083+0000 7f86f3fff700 1 --2- 172.21.15.76:0/2806329614 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5653a2794530 0x5653a2796950 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e24c30b4e6f62bef server_cookie=cabfb620b5a0a75a in_seq=0 out_seq=0 2024-06-02T05:02:12.085 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.083+0000 7f86d77fe700 10 client.16491 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T05:02:12.085 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.084+0000 7f86d77fe700 1 -- 172.21.15.76:0/2806329614 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5653a274e7b0 con 0x5653a2794530 2024-06-02T05:02:12.085 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.084+0000 7f86d77fe700 10 client.16491 handle_command_reply: tid=0 2024-06-02T05:02:12.085 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.084+0000 7f8706700b80 1 client.16491 shutdown 2024-06-02T05:02:12.086 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.085+0000 7f8706700b80 1 -- 172.21.15.76:0/2806329614 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5653a277f3e0 msgr2=0x5653a2788df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:02:12.086 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.085+0000 7f8706700b80 1 --2- 172.21.15.76:0/2806329614 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5653a277f3e0 0x5653a2788df0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f86e800ebc0 tx=0x7f86e8013b00 comp rx=0 tx=0).stop 2024-06-02T05:02:12.086 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.085+0000 7f8706700b80 1 -- 172.21.15.76:0/2806329614 shutdown_connections 2024-06-02T05:02:12.086 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.085+0000 7f8706700b80 1 --2- 172.21.15.76:0/2806329614 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5653a2794530 0x5653a2796950 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:12.087 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.085+0000 7f8706700b80 1 --2- 172.21.15.76:0/2806329614 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5653a27802d0 0x5653a278fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:12.087 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.085+0000 7f8706700b80 1 --2- 172.21.15.76:0/2806329614 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5653a277ea80 0x5653a27888b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:12.087 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.085+0000 7f8706700b80 1 --2- 172.21.15.76:0/2806329614 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5653a277f3e0 0x5653a2788df0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:12.087 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.085+0000 7f8706700b80 1 -- 172.21.15.76:0/2806329614 >> 172.21.15.76:0/2806329614 conn(0x5653a26dd1b0 msgr2=0x5653a2779860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:02:12.087 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.085+0000 7f86d77fe700 0 client.16491 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T05:02:12.087 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.085+0000 7f8706700b80 1 -- 172.21.15.76:0/2806329614 shutdown_connections 2024-06-02T05:02:12.087 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.085+0000 7f8706700b80 1 -- 172.21.15.76:0/2806329614 wait complete. 2024-06-02T05:02:12.087 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.086+0000 7f8706700b80 20 client.16491 trim_cache size 0 max 16384 2024-06-02T05:02:12.113 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.113+0000 7f8706700b80 1 Processor -- start 2024-06-02T05:02:12.114 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.113+0000 7f8706700b80 1 -- start start 2024-06-02T05:02:12.114 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.113+0000 7f8706700b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5653a277ea80 0x5653a2787dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:02:12.114 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.113+0000 7f8706700b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5653a277f3e0 0x5653a278fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:02:12.114 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.113+0000 7f8706700b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5653a27802d0 0x5653a27806b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:02:12.114 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.113+0000 7f8706700b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653a277f7c0 con 0x5653a277ea80 2024-06-02T05:02:12.114 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.113+0000 7f8706700b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653a2786510 con 0x5653a277f3e0 2024-06-02T05:02:12.114 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.113+0000 7f8706700b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653a2783e00 con 0x5653a27802d0 2024-06-02T05:02:12.115 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.114+0000 7f86f37fe700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5653a277f3e0 0x5653a278fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:02:12.115 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.114+0000 7f86f3fff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5653a277ea80 0x5653a2787dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:02:12.115 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.114+0000 7f86f3fff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5653a277ea80 0x5653a2787dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:59516/0 (socket says 172.21.15.76:59516) 2024-06-02T05:02:12.116 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.114+0000 7f86f3fff700 1 -- 172.21.15.76:0/1799276474 learned_addr learned my addr 172.21.15.76:0/1799276474 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:02:12.116 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.114+0000 7f86f37fe700 1 -- 172.21.15.76:0/1799276474 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5653a27802d0 msgr2=0x5653a27806b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:02:12.116 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.114+0000 7f86f37fe700 1 --2- 172.21.15.76:0/1799276474 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5653a27802d0 0x5653a27806b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:12.116 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.114+0000 7f86f37fe700 1 -- 172.21.15.76:0/1799276474 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5653a277ea80 msgr2=0x5653a2787dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:02:12.116 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.114+0000 7f86f37fe700 1 --2- 172.21.15.76:0/1799276474 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5653a277ea80 0x5653a2787dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:12.116 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.114+0000 7f86f37fe700 1 -- 172.21.15.76:0/1799276474 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5653a2695500 con 0x5653a277f3e0 2024-06-02T05:02:12.117 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.115+0000 7f86f37fe700 1 --2- 172.21.15.76:0/1799276474 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5653a277f3e0 0x5653a278fdf0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f86e8009ad0 tx=0x7f86e800e4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=11b7cc7aacc41ebc server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:02:12.117 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.115+0000 7f86e2ffd700 1 -- 172.21.15.76:0/1799276474 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e80095b0 con 0x5653a277f3e0 2024-06-02T05:02:12.117 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.115+0000 7f86e2ffd700 1 -- 172.21.15.76:0/1799276474 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f86e8012930 con 0x5653a277f3e0 2024-06-02T05:02:12.117 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.115+0000 7f86e2ffd700 1 -- 172.21.15.76:0/1799276474 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e8013b70 con 0x5653a277f3e0 2024-06-02T05:02:12.117 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.116+0000 7f8706700b80 1 -- 172.21.15.76:0/1799276474 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5653a277f3e0 msgr2=0x5653a278fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:02:12.117 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.116+0000 7f8706700b80 1 --2- 172.21.15.76:0/1799276474 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5653a277f3e0 0x5653a278fdf0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f86e8009ad0 tx=0x7f86e800e4b0 comp rx=0 tx=0).stop 2024-06-02T05:02:12.117 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.116+0000 7f8706700b80 1 -- 172.21.15.76:0/1799276474 shutdown_connections 2024-06-02T05:02:12.117 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.116+0000 7f8706700b80 1 --2- 172.21.15.76:0/1799276474 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5653a27802d0 0x5653a27806b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:12.118 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.116+0000 7f8706700b80 1 --2- 172.21.15.76:0/1799276474 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5653a277ea80 0x5653a2787dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:12.118 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.116+0000 7f8706700b80 1 --2- 172.21.15.76:0/1799276474 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5653a277f3e0 0x5653a278fdf0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:12.118 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.116+0000 7f8706700b80 1 -- 172.21.15.76:0/1799276474 >> 172.21.15.76:0/1799276474 conn(0x5653a26dd1b0 msgr2=0x5653a2789530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:02:12.120 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.117+0000 7f8706700b80 1 -- 172.21.15.76:0/1799276474 shutdown_connections 2024-06-02T05:02:12.120 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.119+0000 7f8706700b80 1 -- 172.21.15.76:0/1799276474 wait complete. 2024-06-02T05:02:12.120 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.120+0000 7f8706700b80 1 -- start start 2024-06-02T05:02:12.121 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.120+0000 7f8706700b80 1 Processor -- start 2024-06-02T05:02:12.121 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.120+0000 7f8706700b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5653a277ea80 0x5653a278fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:02:12.122 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.120+0000 7f8706700b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5653a277f3e0 0x5653a278c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:02:12.122 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.120+0000 7f8706700b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5653a27802d0 0x5653a278ce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:02:12.122 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.120+0000 7f8706700b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653a278d540 con 0x5653a277ea80 2024-06-02T05:02:12.122 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.120+0000 7f8706700b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653a27e8a40 con 0x5653a27802d0 2024-06-02T05:02:12.122 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.121+0000 7f8706700b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653a27e8c00 con 0x5653a277f3e0 2024-06-02T05:02:12.122 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.121+0000 7f8706700b80 10 client.0 _ll_register_callbacks cb 0x5653a2674ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T05:02:12.122 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.121+0000 7f86f8ae2700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5653a27802d0 0x5653a278ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:02:12.122 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.121+0000 7f86f8ae2700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5653a27802d0 0x5653a278ce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:58906/0 (socket says 172.21.15.76:58906) 2024-06-02T05:02:12.122 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.121+0000 7f86f8ae2700 1 -- 172.21.15.76:0/1214350616 learned_addr learned my addr 172.21.15.76:0/1214350616 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:02:12.123 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.121+0000 7f86f3fff700 1 --2- 172.21.15.76:0/1214350616 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5653a277ea80 0x5653a278fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:02:12.123 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.122+0000 7f86f8ae2700 1 -- 172.21.15.76:0/1214350616 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5653a277f3e0 msgr2=0x5653a278c8d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-02T05:02:12.123 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.122+0000 7f86f8ae2700 1 --2- 172.21.15.76:0/1214350616 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5653a277f3e0 0x5653a278c8d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:12.123 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.122+0000 7f86f8ae2700 1 -- 172.21.15.76:0/1214350616 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5653a277ea80 msgr2=0x5653a278fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:02:12.124 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.122+0000 7f86f8ae2700 1 --2- 172.21.15.76:0/1214350616 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5653a277ea80 0x5653a278fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:12.124 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.122+0000 7f86f8ae2700 1 -- 172.21.15.76:0/1214350616 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5653a24fcb00 con 0x5653a27802d0 2024-06-02T05:02:12.124 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.122+0000 7f86f8ae2700 1 --2- 172.21.15.76:0/1214350616 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5653a27802d0 0x5653a278ce30 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f86ec00ff20 tx=0x7f86ec009230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d64c70d78fda5119 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:02:12.124 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.122+0000 7f86d77fe700 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-06-02T05:02:12.124 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.122+0000 7f86d77fe700 1 -- 172.21.15.76:0/1214350616 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86ec01de40 con 0x5653a27802d0 2024-06-02T05:02:12.124 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.122+0000 7f86d77fe700 1 -- 172.21.15.76:0/1214350616 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f86ec01e410 con 0x5653a27802d0 2024-06-02T05:02:12.124 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.123+0000 7f8706700b80 1 -- 172.21.15.76:0/1214350616 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f86e8013470 con 0x5653a27802d0 2024-06-02T05:02:12.125 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.123+0000 7f86d77fe700 1 -- 172.21.15.76:0/1214350616 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f86ec01e5d0 con 0x5653a27802d0 2024-06-02T05:02:12.125 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.123+0000 7f8706700b80 10 client.26132 fetch_fsmap learned FSMap version 36 2024-06-02T05:02:12.125 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.123+0000 7f8706700b80 1 -- 172.21.15.76:0/1214350616 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x5653a2554c70 con 0x5653a27802d0 2024-06-02T05:02:12.125 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.123+0000 7f86d77fe700 1 -- 172.21.15.76:0/1214350616 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f86e8013470 con 0x5653a27802d0 2024-06-02T05:02:12.126 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.123+0000 7f86d77fe700 1 -- 172.21.15.76:0/1214350616 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f86ec0317e0 con 0x5653a27802d0 2024-06-02T05:02:12.126 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.124+0000 7f8706700b80 10 client.26132 fetch_fsmap finished waiting for FSMap version 36 2024-06-02T05:02:12.126 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.124+0000 7f8706700b80 10 client.26132 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T05:02:12.126 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.124+0000 7f8706700b80 20 client.26132 populate_metadata read hostname 'smithi076' 2024-06-02T05:02:12.126 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.124+0000 7f8706700b80 1 --2- 172.21.15.76:0/1214350616 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5653a27ea670 0x5653a27eca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:02:12.126 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.124+0000 7f8706700b80 4 client.26132 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T05:02:12.126 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.124+0000 7f8706700b80 1 -- 172.21.15.76:0/1214350616 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5653a26c7e60 con 0x5653a27ea670 2024-06-02T05:02:12.126 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.124+0000 7f86f3fff700 1 --2- 172.21.15.76:0/1214350616 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5653a27ea670 0x5653a27eca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:02:12.127 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.125+0000 7f86f3fff700 1 --2- 172.21.15.76:0/1214350616 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5653a27ea670 0x5653a27eca90 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5aed3e53af7a6426 server_cookie=8e3d046256e5101 in_seq=0 out_seq=0 2024-06-02T05:02:12.127 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.125+0000 7f86d77fe700 10 client.26132 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T05:02:12.173 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.169+0000 7f86d77fe700 1 -- 172.21.15.76:0/1214350616 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5653a26c7e60 con 0x5653a27ea670 2024-06-02T05:02:12.173 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.169+0000 7f86d77fe700 10 client.26132 handle_command_reply: tid=0 2024-06-02T05:02:12.173 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.171+0000 7f8706700b80 1 client.26132 shutdown 2024-06-02T05:02:12.173 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.172+0000 7f8706700b80 1 -- 172.21.15.76:0/1214350616 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5653a27802d0 msgr2=0x5653a278ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:02:12.173 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.172+0000 7f8706700b80 1 --2- 172.21.15.76:0/1214350616 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5653a27802d0 0x5653a278ce30 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f86ec00ff20 tx=0x7f86ec009230 comp rx=0 tx=0).stop 2024-06-02T05:02:12.173 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.172+0000 7f8706700b80 1 -- 172.21.15.76:0/1214350616 shutdown_connections 2024-06-02T05:02:12.173 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.172+0000 7f8706700b80 1 --2- 172.21.15.76:0/1214350616 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5653a27ea670 0x5653a27eca90 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:12.173 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.172+0000 7f8706700b80 1 --2- 172.21.15.76:0/1214350616 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5653a27802d0 0x5653a278ce30 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:12.173 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.172+0000 7f8706700b80 1 --2- 172.21.15.76:0/1214350616 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5653a277ea80 0x5653a278fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:12.173 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.172+0000 7f86d77fe700 0 client.26132 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T05:02:12.173 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.172+0000 7f8706700b80 1 --2- 172.21.15.76:0/1214350616 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5653a277f3e0 0x5653a278c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:12.174 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.172+0000 7f8706700b80 1 -- 172.21.15.76:0/1214350616 >> 172.21.15.76:0/1214350616 conn(0x5653a26dd1b0 msgr2=0x5653a2786820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:02:12.174 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.172+0000 7f8706700b80 1 -- 172.21.15.76:0/1214350616 shutdown_connections 2024-06-02T05:02:12.174 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.172+0000 7f8706700b80 1 -- 172.21.15.76:0/1214350616 wait complete. 2024-06-02T05:02:12.174 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.172+0000 7f8706700b80 20 client.26132 trim_cache size 0 max 16384 2024-06-02T05:02:12.174 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:{ 2024-06-02T05:02:12.175 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "message": "", 2024-06-02T05:02:12.175 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "return_code": 0 2024-06-02T05:02:12.175 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:} 2024-06-02T05:02:12.175 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.173+0000 7f86fa545700 1 -- 172.21.15.76:0/2724167015 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f86dc0a11f0 msgr2=0x7f86dc0a36b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:02:12.175 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.173+0000 7f86fa545700 1 --2- 172.21.15.76:0/2724167015 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f86dc0a11f0 0x7f86dc0a36b0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x5653a277fab0 tx=0x7f86ec00a5f0 comp rx=0 tx=0).stop 2024-06-02T05:02:12.176 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.173+0000 7f86fa545700 1 -- 172.21.15.76:0/2724167015 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86f41020e0 msgr2=0x7f86f4194ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:02:12.176 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.173+0000 7f86fa545700 1 --2- 172.21.15.76:0/2724167015 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86f41020e0 0x7f86f4194ef0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f86e4000c00 tx=0x7f86e40057b0 comp rx=0 tx=0).stop 2024-06-02T05:02:12.176 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.173+0000 7f86fa545700 1 -- 172.21.15.76:0/2724167015 shutdown_connections 2024-06-02T05:02:12.176 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.173+0000 7f86fa545700 1 --2- 172.21.15.76:0/2724167015 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f86f419a440 0x7f86f419c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:12.176 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.173+0000 7f86fa545700 1 --2- 172.21.15.76:0/2724167015 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f86dc0a11f0 0x7f86dc0a36b0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:12.176 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.173+0000 7f86fa545700 1 --2- 172.21.15.76:0/2724167015 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86f41020e0 0x7f86f4194ef0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:12.176 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.173+0000 7f86fa545700 1 --2- 172.21.15.76:0/2724167015 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f86f4104ab0 0x7f86f4195430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:12.176 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.173+0000 7f86fa545700 1 -- 172.21.15.76:0/2724167015 >> 172.21.15.76:0/2724167015 conn(0x7f86f40fb390 msgr2=0x7f86f40fd780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:02:12.176 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.174+0000 7f86fa545700 1 -- 172.21.15.76:0/2724167015 shutdown_connections 2024-06-02T05:02:12.176 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:12.174+0000 7f86fa545700 1 -- 172.21.15.76:0/2724167015 wait complete. 2024-06-02T05:02:13.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:02:13 smithi192 ceph-mon[47933]: pgmap v647: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 9.0 MiB/s wr, 744 op/s 2024-06-02T05:02:13.989 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:02:13 smithi076 ceph-mon[42935]: pgmap v647: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 9.0 MiB/s wr, 744 op/s 2024-06-02T05:02:14.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:02:13 smithi119 ceph-mon[46633]: pgmap v647: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 9.0 MiB/s wr, 744 op/s 2024-06-02T05:02:15.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:02:15 smithi192 ceph-mon[47933]: pgmap v648: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 7.1 MiB/s wr, 645 op/s 2024-06-02T05:02:15.987 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:02:15 smithi076 ceph-mon[42935]: pgmap v648: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 7.1 MiB/s wr, 645 op/s 2024-06-02T05:02:16.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:02:15 smithi119 ceph-mon[46633]: pgmap v648: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 7.1 MiB/s wr, 645 op/s 2024-06-02T05:02:16.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 685.0 s, 516.2 tps, lat 193.132 ms stddev 73.701 2024-06-02T05:02:17.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:02:17 smithi076 ceph-mon[42935]: pgmap v649: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 8.7 MiB/s wr, 791 op/s 2024-06-02T05:02:18.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:02:17 smithi119 ceph-mon[46633]: pgmap v649: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 8.7 MiB/s wr, 791 op/s 2024-06-02T05:02:18.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:02:17 smithi192 ceph-mon[47933]: pgmap v649: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 8.7 MiB/s wr, 791 op/s 2024-06-02T05:02:19.990 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:02:19 smithi076 ceph-mon[42935]: pgmap v650: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 7.1 MiB/s wr, 654 op/s 2024-06-02T05:02:20.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:02:19 smithi119 ceph-mon[46633]: pgmap v650: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 7.1 MiB/s wr, 654 op/s 2024-06-02T05:02:20.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:02:19 smithi192 ceph-mon[47933]: pgmap v650: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 7.1 MiB/s wr, 654 op/s 2024-06-02T05:02:21.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 690.0 s, 501.9 tps, lat 200.123 ms stddev 97.177 2024-06-02T05:02:21.987 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:02:21 smithi076 ceph-mon[42935]: pgmap v651: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 8.2 MiB/s wr, 753 op/s 2024-06-02T05:02:22.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:02:21 smithi119 ceph-mon[46633]: pgmap v651: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 8.2 MiB/s wr, 753 op/s 2024-06-02T05:02:22.183 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:02:21 smithi192 ceph-mon[47933]: pgmap v651: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 8.2 MiB/s wr, 753 op/s 2024-06-02T05:02:22.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:02:22 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T05:02:23.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:02:22 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T05:02:23.238 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:02:22 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T05:02:23.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:02:23 smithi076 ceph-mon[42935]: pgmap v652: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 7.8 MiB/s wr, 734 op/s 2024-06-02T05:02:23.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:02:23 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T05:02:23.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:02:23 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T05:02:23.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:02:23 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T05:02:24.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:02:23 smithi119 ceph-mon[46633]: pgmap v652: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 7.8 MiB/s wr, 734 op/s 2024-06-02T05:02:24.097 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:02:23 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T05:02:24.097 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:02:23 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T05:02:24.097 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:02:23 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T05:02:24.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:02:23 smithi192 ceph-mon[47933]: pgmap v652: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 7.8 MiB/s wr, 734 op/s 2024-06-02T05:02:24.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:02:23 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T05:02:24.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:02:23 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T05:02:24.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:02:23 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T05:02:25.358 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.354+0000 7f9db6b93700 1 -- 172.21.15.76:0/2610195429 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9db0101930 msgr2=0x7f9db0108250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:02:25.359 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.354+0000 7f9db6b93700 1 --2- 172.21.15.76:0/2610195429 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9db0101930 0x7f9db0108250 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9da4009990 tx=0x7f9da4009ca0 comp rx=0 tx=0).stop 2024-06-02T05:02:25.359 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.354+0000 7f9db6b93700 1 -- 172.21.15.76:0/2610195429 shutdown_connections 2024-06-02T05:02:25.359 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.354+0000 7f9db6b93700 1 --2- 172.21.15.76:0/2610195429 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9db0101930 0x7f9db0108250 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:25.359 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.354+0000 7f9db6b93700 1 --2- 172.21.15.76:0/2610195429 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9db00ffe20 0x7f9db0100240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:25.359 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.354+0000 7f9db6b93700 1 --2- 172.21.15.76:0/2610195429 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9db0100f70 0x7f9db01013f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:25.359 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.354+0000 7f9db6b93700 1 -- 172.21.15.76:0/2610195429 >> 172.21.15.76:0/2610195429 conn(0x7f9db00fb390 msgr2=0x7f9db00fd7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:02:25.359 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.356+0000 7f9db6b93700 1 -- 172.21.15.76:0/2610195429 shutdown_connections 2024-06-02T05:02:25.359 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.356+0000 7f9db6b93700 1 -- 172.21.15.76:0/2610195429 wait complete. 2024-06-02T05:02:25.359 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.357+0000 7f9db6b93700 1 Processor -- start 2024-06-02T05:02:25.359 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.357+0000 7f9db6b93700 1 -- start start 2024-06-02T05:02:25.360 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.357+0000 7f9db6b93700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9db00ffe20 0x7f9db010e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:02:25.360 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.357+0000 7f9db6b93700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9db0101930 0x7f9db010e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:02:25.360 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.357+0000 7f9db6b93700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9db0113640 0x7f9db0115ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:02:25.360 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.357+0000 7f9db6b93700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9db0116010 con 0x7f9db0101930 2024-06-02T05:02:25.360 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.357+0000 7f9db6b93700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9db0116180 con 0x7f9db00ffe20 2024-06-02T05:02:25.360 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.357+0000 7f9db6b93700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9db0116340 con 0x7f9db0113640 2024-06-02T05:02:25.360 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.358+0000 7f9db492f700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9db00ffe20 0x7f9db010e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:02:25.360 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.358+0000 7f9db492f700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9db00ffe20 0x7f9db010e0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:57898/0 (socket says 172.21.15.76:57898) 2024-06-02T05:02:25.360 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.358+0000 7f9db492f700 1 -- 172.21.15.76:0/3983006663 learned_addr learned my addr 172.21.15.76:0/3983006663 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:02:25.360 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.358+0000 7f9db5130700 1 --2- 172.21.15.76:0/3983006663 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9db0113640 0x7f9db0115ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:02:25.360 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.358+0000 7f9daffff700 1 --2- 172.21.15.76:0/3983006663 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9db0101930 0x7f9db010e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:02:25.361 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.358+0000 7f9db492f700 1 -- 172.21.15.76:0/3983006663 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9db0113640 msgr2=0x7f9db0115ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:02:25.361 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.358+0000 7f9db492f700 1 --2- 172.21.15.76:0/3983006663 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9db0113640 0x7f9db0115ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:25.361 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.358+0000 7f9db492f700 1 -- 172.21.15.76:0/3983006663 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9db0101930 msgr2=0x7f9db010e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:02:25.361 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.358+0000 7f9db492f700 1 --2- 172.21.15.76:0/3983006663 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9db0101930 0x7f9db010e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:25.362 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.358+0000 7f9db492f700 1 -- 172.21.15.76:0/3983006663 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9da40095f0 con 0x7f9db00ffe20 2024-06-02T05:02:25.362 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.358+0000 7f9daffff700 1 --2- 172.21.15.76:0/3983006663 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9db0101930 0x7f9db010e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T05:02:25.362 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.358+0000 7f9db492f700 1 --2- 172.21.15.76:0/3983006663 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9db00ffe20 0x7f9db010e0f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f9da800ba50 tx=0x7f9da800bd60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:02:25.362 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.358+0000 7f9dadffb700 1 -- 172.21.15.76:0/3983006663 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da800c9b0 con 0x7f9db00ffe20 2024-06-02T05:02:25.362 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.358+0000 7f9dadffb700 1 -- 172.21.15.76:0/3983006663 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9da8014440 con 0x7f9db00ffe20 2024-06-02T05:02:25.362 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.358+0000 7f9dadffb700 1 -- 172.21.15.76:0/3983006663 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da80075d0 con 0x7f9db00ffe20 2024-06-02T05:02:25.362 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.358+0000 7f9db6b93700 1 -- 172.21.15.76:0/3983006663 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9db0116620 con 0x7f9db00ffe20 2024-06-02T05:02:25.362 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.359+0000 7f9db6b93700 1 -- 172.21.15.76:0/3983006663 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9db0116ae0 con 0x7f9db00ffe20 2024-06-02T05:02:25.363 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.363+0000 7f9dadffb700 1 -- 172.21.15.76:0/3983006663 <== mon.2 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f9da80145b0 con 0x7f9db00ffe20 2024-06-02T05:02:25.365 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.364+0000 7f9dc2d4eb80 1 Processor -- start 2024-06-02T05:02:25.365 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.364+0000 7f9dadffb700 1 --2- 172.21.15.76:0/3983006663 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f9d980a1210 0x7f9d980a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:02:25.365 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.364+0000 7f9db5130700 1 --2- 172.21.15.76:0/3983006663 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f9d980a1210 0x7f9d980a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:02:25.365 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.364+0000 7f9dadffb700 1 -- 172.21.15.76:0/3983006663 <== mon.2 v2:172.21.15.119:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f9da8006e40 con 0x7f9db00ffe20 2024-06-02T05:02:25.367 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.365+0000 7f9dc2d4eb80 1 -- start start 2024-06-02T05:02:25.367 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.365+0000 7f9db5130700 1 --2- 172.21.15.76:0/3983006663 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f9d980a1210 0x7f9d980a36d0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f9da400d7d0 tx=0x7f9da401d040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:02:25.367 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.365+0000 7f9dc2d4eb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d835aa9a80 0x55d835aa9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:02:25.367 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.365+0000 7f9dc2d4eb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d835aaa3e0 0x55d835aaacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:02:25.367 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.365+0000 7f9dc2d4eb80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d835aab2d0 0x55d835aab750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:02:25.367 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.365+0000 7f9dc2d4eb80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d835a010f0 con 0x55d835aab2d0 2024-06-02T05:02:25.367 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.365+0000 7f9dc2d4eb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8359feab0 con 0x55d835aa9a80 2024-06-02T05:02:25.368 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.365+0000 7f9dc2d4eb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8359fa3a0 con 0x55d835aaa3e0 2024-06-02T05:02:25.368 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.365+0000 7f9db5130700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d835aab2d0 0x55d835aab750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:02:25.368 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.365+0000 7f9db5130700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d835aab2d0 0x55d835aab750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:57778/0 (socket says 172.21.15.76:57778) 2024-06-02T05:02:25.368 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.365+0000 7f9db5130700 1 -- 172.21.15.76:0/2493631813 learned_addr learned my addr 172.21.15.76:0/2493631813 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:02:25.368 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.365+0000 7f9daffff700 1 --2- 172.21.15.76:0/2493631813 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d835aaa3e0 0x55d835aaacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:02:25.368 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.365+0000 7f9db492f700 1 --2- 172.21.15.76:0/2493631813 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d835aa9a80 0x55d835aa9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:02:25.368 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.366+0000 7f9db492f700 1 -- 172.21.15.76:0/2493631813 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d835aaa3e0 msgr2=0x55d835aaacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:02:25.368 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.366+0000 7f9db492f700 1 --2- 172.21.15.76:0/2493631813 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d835aaa3e0 0x55d835aaacf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:25.368 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.366+0000 7f9db492f700 1 -- 172.21.15.76:0/2493631813 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d835aab2d0 msgr2=0x55d835aab750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:02:25.368 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.366+0000 7f9db492f700 1 --2- 172.21.15.76:0/2493631813 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d835aab2d0 0x55d835aab750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:25.368 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.366+0000 7f9db492f700 1 -- 172.21.15.76:0/2493631813 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d83587b350 con 0x55d835aa9a80 2024-06-02T05:02:25.368 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.366+0000 7f9daffff700 1 --2- 172.21.15.76:0/2493631813 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d835aaa3e0 0x55d835aaacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T05:02:25.368 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.366+0000 7f9db5130700 1 --2- 172.21.15.76:0/2493631813 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d835aab2d0 0x55d835aab750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T05:02:25.369 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.366+0000 7f9db492f700 1 --2- 172.21.15.76:0/2493631813 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d835aa9a80 0x55d835aa9ea0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f9da80c9c80 tx=0x7f9da80994d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b9da65f07b70f37 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:02:25.369 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.366+0000 7f9d96ffd700 1 -- 172.21.15.76:0/2493631813 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da80b9070 con 0x55d835aa9a80 2024-06-02T05:02:25.369 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.366+0000 7f9d96ffd700 1 -- 172.21.15.76:0/2493631813 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9da80cb070 con 0x55d835aa9a80 2024-06-02T05:02:25.369 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.366+0000 7f9d96ffd700 1 -- 172.21.15.76:0/2493631813 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da8097970 con 0x55d835aa9a80 2024-06-02T05:02:25.371 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.367+0000 7f9dc2d4eb80 1 -- 172.21.15.76:0/2493631813 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d835aa9a80 msgr2=0x55d835aa9ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:02:25.371 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.367+0000 7f9dc2d4eb80 1 --2- 172.21.15.76:0/2493631813 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d835aa9a80 0x55d835aa9ea0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f9da80c9c80 tx=0x7f9da80994d0 comp rx=0 tx=0).stop 2024-06-02T05:02:25.371 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.367+0000 7f9dc2d4eb80 1 -- 172.21.15.76:0/2493631813 shutdown_connections 2024-06-02T05:02:25.371 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.367+0000 7f9dc2d4eb80 1 --2- 172.21.15.76:0/2493631813 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d835aab2d0 0x55d835aab750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:25.371 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.367+0000 7f9dc2d4eb80 1 --2- 172.21.15.76:0/2493631813 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d835aa9a80 0x55d835aa9ea0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:25.371 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.367+0000 7f9dc2d4eb80 1 --2- 172.21.15.76:0/2493631813 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d835aaa3e0 0x55d835aaacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:25.371 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.367+0000 7f9dc2d4eb80 1 -- 172.21.15.76:0/2493631813 >> 172.21.15.76:0/2493631813 conn(0x55d835a081b0 msgr2=0x55d835aa6440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:02:25.371 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.367+0000 7f9dc2d4eb80 1 -- 172.21.15.76:0/2493631813 shutdown_connections 2024-06-02T05:02:25.372 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.367+0000 7f9dc2d4eb80 1 -- 172.21.15.76:0/2493631813 wait complete. 2024-06-02T05:02:25.372 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.368+0000 7f9dc2d4eb80 1 -- start start 2024-06-02T05:02:25.372 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.368+0000 7f9dc2d4eb80 1 Processor -- start 2024-06-02T05:02:25.372 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.368+0000 7f9dc2d4eb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d835aa9a80 0x55d835ab3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:02:25.372 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.368+0000 7f9dc2d4eb80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d835aaa3e0 0x55d835ab3e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:02:25.372 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.368+0000 7f9dc2d4eb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d835aab2d0 0x55d835abaec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:02:25.372 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.368+0000 7f9dc2d4eb80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d835996500 con 0x55d835aaa3e0 2024-06-02T05:02:25.372 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.368+0000 7f9dc2d4eb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8359961a0 con 0x55d835aab2d0 2024-06-02T05:02:25.372 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.368+0000 7f9dc2d4eb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d83587d640 con 0x55d835aa9a80 2024-06-02T05:02:25.372 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.369+0000 7f9dc2d4eb80 10 client.0 _ll_register_callbacks cb 0x55d83599fad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T05:02:25.372 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.369+0000 7f9db492f700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d835aa9a80 0x55d835ab3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:02:25.372 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.369+0000 7f9db5130700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d835aab2d0 0x55d835abaec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:02:25.373 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.369+0000 7f9db492f700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d835aa9a80 0x55d835ab3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:42234/0 (socket says 172.21.15.76:42234) 2024-06-02T05:02:25.373 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.369+0000 7f9db492f700 1 -- 172.21.15.76:0/495711982 learned_addr learned my addr 172.21.15.76:0/495711982 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:02:25.373 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.369+0000 7f9db5130700 1 -- 172.21.15.76:0/495711982 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d835aa9a80 msgr2=0x55d835ab3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:02:25.373 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.369+0000 7f9db5130700 1 --2- 172.21.15.76:0/495711982 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d835aa9a80 0x55d835ab3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:25.373 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.369+0000 7f9db5130700 1 -- 172.21.15.76:0/495711982 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d835aaa3e0 msgr2=0x55d835ab3e80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-02T05:02:25.373 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.369+0000 7f9db5130700 1 --2- 172.21.15.76:0/495711982 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d835aaa3e0 0x55d835ab3e80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:25.373 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.369+0000 7f9db5130700 1 -- 172.21.15.76:0/495711982 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9db0108b80 con 0x55d835aab2d0 2024-06-02T05:02:25.373 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.369+0000 7f9db492f700 1 --2- 172.21.15.76:0/495711982 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d835aa9a80 0x55d835ab3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T05:02:25.373 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.369+0000 7f9db5130700 1 --2- 172.21.15.76:0/495711982 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d835aab2d0 0x55d835abaec0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9da4006010 tx=0x7f9da4009ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=95bc99db4b423116 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:02:25.373 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.369+0000 7f9d8ffff700 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-06-02T05:02:25.373 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.370+0000 7f9d8ffff700 1 -- 172.21.15.76:0/495711982 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da402d050 con 0x55d835aab2d0 2024-06-02T05:02:25.373 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.370+0000 7f9d8ffff700 1 -- 172.21.15.76:0/495711982 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f9da4032600 con 0x55d835aab2d0 2024-06-02T05:02:25.373 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.370+0000 7f9dc2d4eb80 1 -- 172.21.15.76:0/495711982 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d835953210 con 0x55d835aab2d0 2024-06-02T05:02:25.374 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.370+0000 7f9d8ffff700 1 -- 172.21.15.76:0/495711982 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9da4020040 con 0x55d835aab2d0 2024-06-02T05:02:25.374 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.370+0000 7f9dc2d4eb80 10 client.26144 fetch_fsmap learned FSMap version 36 2024-06-02T05:02:25.374 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.370+0000 7f9dc2d4eb80 1 -- 172.21.15.76:0/495711982 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x7f9db0116ae0 con 0x55d835aab2d0 2024-06-02T05:02:25.374 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.370+0000 7f9d8ffff700 1 -- 172.21.15.76:0/495711982 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55d835953210 con 0x55d835aab2d0 2024-06-02T05:02:25.374 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.370+0000 7f9d8ffff700 1 -- 172.21.15.76:0/495711982 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f9da4026760 con 0x55d835aab2d0 2024-06-02T05:02:25.374 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.372+0000 7f9dc2d4eb80 10 client.26144 fetch_fsmap finished waiting for FSMap version 36 2024-06-02T05:02:25.375 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.372+0000 7f9dc2d4eb80 10 client.26144 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T05:02:25.375 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.372+0000 7f9dc2d4eb80 20 client.26144 populate_metadata read hostname 'smithi076' 2024-06-02T05:02:25.375 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.373+0000 7f9dc2d4eb80 1 --2- 172.21.15.76:0/495711982 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55d835abf6e0 0x55d835ac1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:02:25.375 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.373+0000 7f9dc2d4eb80 4 client.26144 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T05:02:25.375 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.373+0000 7f9dc2d4eb80 1 -- 172.21.15.76:0/495711982 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d835a797b0 con 0x55d835abf6e0 2024-06-02T05:02:25.375 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.373+0000 7f9db492f700 1 --2- 172.21.15.76:0/495711982 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55d835abf6e0 0x55d835ac1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:02:25.379 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.378+0000 7f9db492f700 1 --2- 172.21.15.76:0/495711982 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55d835abf6e0 0x55d835ac1ad0 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5d28caf4cda76ffa server_cookie=b9cd23e12eab8f76 in_seq=0 out_seq=0 2024-06-02T05:02:25.379 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.379+0000 7f9d8ffff700 10 client.26144 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T05:02:25.379 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.379+0000 7f9d8ffff700 1 -- 172.21.15.76:0/495711982 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55d835a797b0 con 0x55d835abf6e0 2024-06-02T05:02:25.379 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.379+0000 7f9d8ffff700 10 client.26144 handle_command_reply: tid=0 2024-06-02T05:02:25.380 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.379+0000 7f9dc2d4eb80 1 client.26144 shutdown 2024-06-02T05:02:25.380 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.380+0000 7f9dc2d4eb80 1 -- 172.21.15.76:0/495711982 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d835aab2d0 msgr2=0x55d835abaec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:02:25.381 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.380+0000 7f9dc2d4eb80 1 --2- 172.21.15.76:0/495711982 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d835aab2d0 0x55d835abaec0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9da4006010 tx=0x7f9da4009ca0 comp rx=0 tx=0).stop 2024-06-02T05:02:25.381 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.380+0000 7f9dc2d4eb80 1 -- 172.21.15.76:0/495711982 shutdown_connections 2024-06-02T05:02:25.381 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.380+0000 7f9dc2d4eb80 1 --2- 172.21.15.76:0/495711982 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55d835abf6e0 0x55d835ac1ad0 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:25.381 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.380+0000 7f9dc2d4eb80 1 --2- 172.21.15.76:0/495711982 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d835aab2d0 0x55d835abaec0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:25.381 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.380+0000 7f9dc2d4eb80 1 --2- 172.21.15.76:0/495711982 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d835aa9a80 0x55d835ab3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:25.381 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.380+0000 7f9dc2d4eb80 1 --2- 172.21.15.76:0/495711982 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d835aaa3e0 0x55d835ab3e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:25.381 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.380+0000 7f9dc2d4eb80 1 -- 172.21.15.76:0/495711982 >> 172.21.15.76:0/495711982 conn(0x55d835a081b0 msgr2=0x55d835aa4860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:02:25.381 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.380+0000 7f9d8ffff700 0 client.26144 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T05:02:25.381 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.380+0000 7f9dc2d4eb80 1 -- 172.21.15.76:0/495711982 shutdown_connections 2024-06-02T05:02:25.382 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.380+0000 7f9dc2d4eb80 1 -- 172.21.15.76:0/495711982 wait complete. 2024-06-02T05:02:25.382 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.381+0000 7f9dc2d4eb80 20 client.26144 trim_cache size 0 max 16384 2024-06-02T05:02:25.414 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.413+0000 7f9dc2d4eb80 1 Processor -- start 2024-06-02T05:02:25.414 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.413+0000 7f9dc2d4eb80 1 -- start start 2024-06-02T05:02:25.414 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.413+0000 7f9dc2d4eb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d835aa9a80 0x55d835ab1900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:02:25.415 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.413+0000 7f9dc2d4eb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d835aaa3e0 0x55d835abae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:02:25.415 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.413+0000 7f9dc2d4eb80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d835aab2d0 0x55d835ac6430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:02:25.415 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.413+0000 7f9dc2d4eb80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d835aab100 con 0x55d835aab2d0 2024-06-02T05:02:25.415 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.413+0000 7f9dc2d4eb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d835ab4890 con 0x55d835aa9a80 2024-06-02T05:02:25.415 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.413+0000 7f9dc2d4eb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d835aaa7c0 con 0x55d835aaa3e0 2024-06-02T05:02:25.415 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.414+0000 7f9db5130700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d835aab2d0 0x55d835ac6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:02:25.416 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.414+0000 7f9db5130700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d835aab2d0 0x55d835ac6430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:57780/0 (socket says 172.21.15.76:57780) 2024-06-02T05:02:25.416 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.414+0000 7f9db5130700 1 -- 172.21.15.76:0/2403985954 learned_addr learned my addr 172.21.15.76:0/2403985954 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:02:25.416 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.415+0000 7f9db5130700 1 -- 172.21.15.76:0/2403985954 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d835aaa3e0 msgr2=0x55d835abae80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-02T05:02:25.416 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.415+0000 7f9db5130700 1 --2- 172.21.15.76:0/2403985954 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d835aaa3e0 0x55d835abae80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:25.416 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.415+0000 7f9db5130700 1 -- 172.21.15.76:0/2403985954 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d835aa9a80 msgr2=0x55d835ab1900 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-02T05:02:25.416 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.415+0000 7f9db5130700 1 --2- 172.21.15.76:0/2403985954 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d835aa9a80 0x55d835ab1900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:25.416 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.415+0000 7f9db5130700 1 -- 172.21.15.76:0/2403985954 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d835827b00 con 0x55d835aab2d0 2024-06-02T05:02:25.416 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.416+0000 7f9db5130700 1 --2- 172.21.15.76:0/2403985954 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d835aab2d0 0x55d835ac6430 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f9da40098e0 tx=0x7f9da4009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b66362a21436311a server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:02:25.417 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.417+0000 7f9d977fe700 1 -- 172.21.15.76:0/2403985954 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da4020050 con 0x55d835aab2d0 2024-06-02T05:02:25.417 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.417+0000 7f9d977fe700 1 -- 172.21.15.76:0/2403985954 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9da402e040 con 0x55d835aab2d0 2024-06-02T05:02:25.417 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.417+0000 7f9d977fe700 1 -- 172.21.15.76:0/2403985954 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da402d040 con 0x55d835aab2d0 2024-06-02T05:02:25.418 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.418+0000 7f9dc2d4eb80 1 -- 172.21.15.76:0/2403985954 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d835aab2d0 msgr2=0x55d835ac6430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:02:25.418 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.418+0000 7f9dc2d4eb80 1 --2- 172.21.15.76:0/2403985954 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d835aab2d0 0x55d835ac6430 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f9da40098e0 tx=0x7f9da4009310 comp rx=0 tx=0).stop 2024-06-02T05:02:25.419 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.419+0000 7f9dc2d4eb80 1 -- 172.21.15.76:0/2403985954 shutdown_connections 2024-06-02T05:02:25.419 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.419+0000 7f9dc2d4eb80 1 --2- 172.21.15.76:0/2403985954 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d835aab2d0 0x55d835ac6430 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:25.419 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.419+0000 7f9dc2d4eb80 1 --2- 172.21.15.76:0/2403985954 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d835aa9a80 0x55d835ab1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:25.419 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.419+0000 7f9dc2d4eb80 1 --2- 172.21.15.76:0/2403985954 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d835aaa3e0 0x55d835abae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:25.419 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.419+0000 7f9dc2d4eb80 1 -- 172.21.15.76:0/2403985954 >> 172.21.15.76:0/2403985954 conn(0x55d835a081b0 msgr2=0x55d835ab2e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:02:25.420 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.419+0000 7f9dc2d4eb80 1 -- 172.21.15.76:0/2403985954 shutdown_connections 2024-06-02T05:02:25.420 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.419+0000 7f9dc2d4eb80 1 -- 172.21.15.76:0/2403985954 wait complete. 2024-06-02T05:02:25.420 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.419+0000 7f9dc2d4eb80 1 -- start start 2024-06-02T05:02:25.420 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.419+0000 7f9dc2d4eb80 1 Processor -- start 2024-06-02T05:02:25.421 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.420+0000 7f9dc2d4eb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d835aa9a80 0x55d835ab8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:02:25.421 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.420+0000 7f9dc2d4eb80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d835aaa3e0 0x55d835ab8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:02:25.421 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.420+0000 7f9dc2d4eb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d835aab2d0 0x55d835ab9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:02:25.421 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.420+0000 7f9dc2d4eb80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d835aba0a0 con 0x55d835aaa3e0 2024-06-02T05:02:25.421 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.420+0000 7f9dc2d4eb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d835aba210 con 0x55d835aa9a80 2024-06-02T05:02:25.421 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.420+0000 7f9dc2d4eb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d835aba380 con 0x55d835aab2d0 2024-06-02T05:02:25.422 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.420+0000 7f9dc2d4eb80 10 client.0 _ll_register_callbacks cb 0x55d835abba90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T05:02:25.422 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.420+0000 7f9db492f700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d835aa9a80 0x55d835ab8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:02:25.422 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.420+0000 7f9db492f700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d835aa9a80 0x55d835ab8660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:57922/0 (socket says 172.21.15.76:57922) 2024-06-02T05:02:25.422 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.420+0000 7f9db492f700 1 -- 172.21.15.76:0/27586113 learned_addr learned my addr 172.21.15.76:0/27586113 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:02:25.422 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.421+0000 7f9db5130700 1 --2- 172.21.15.76:0/27586113 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d835aab2d0 0x55d835ab9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:02:25.425 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.421+0000 7f9daffff700 1 --2- 172.21.15.76:0/27586113 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d835aaa3e0 0x55d835ab8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:02:25.425 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.422+0000 7f9db5130700 1 -- 172.21.15.76:0/27586113 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d835aa9a80 msgr2=0x55d835ab8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:02:25.425 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.422+0000 7f9db5130700 1 --2- 172.21.15.76:0/27586113 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d835aa9a80 0x55d835ab8660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:25.425 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.422+0000 7f9db5130700 1 -- 172.21.15.76:0/27586113 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d835aaa3e0 msgr2=0x55d835ab8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:02:25.425 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.422+0000 7f9db5130700 1 --2- 172.21.15.76:0/27586113 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d835aaa3e0 0x55d835ab8ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:25.425 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.422+0000 7f9db5130700 1 -- 172.21.15.76:0/27586113 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9db0116ae0 con 0x55d835aab2d0 2024-06-02T05:02:25.425 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.422+0000 7f9db5130700 1 --2- 172.21.15.76:0/27586113 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d835aab2d0 0x55d835ab9b60 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x55d835a9f440 tx=0x7f9da4005d00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f79efa9bee4098d server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:02:25.425 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.422+0000 7f9d8ffff700 10 client.0 ms_handle_connect on v2:172.21.15.192:3300/0 2024-06-02T05:02:25.426 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.423+0000 7f9d8ffff700 1 -- 172.21.15.76:0/27586113 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da402d070 con 0x55d835aab2d0 2024-06-02T05:02:25.426 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.423+0000 7f9dc2d4eb80 1 -- 172.21.15.76:0/27586113 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9da80cb070 con 0x55d835aab2d0 2024-06-02T05:02:25.426 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.423+0000 7f9d8ffff700 1 -- 172.21.15.76:0/27586113 <== mon.1 v2:172.21.15.192:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f9da4044af0 con 0x55d835aab2d0 2024-06-02T05:02:25.426 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.423+0000 7f9d8ffff700 1 -- 172.21.15.76:0/27586113 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9da4020040 con 0x55d835aab2d0 2024-06-02T05:02:25.426 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.423+0000 7f9dc2d4eb80 10 client.26101 fetch_fsmap learned FSMap version 36 2024-06-02T05:02:25.426 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.423+0000 7f9dc2d4eb80 1 -- 172.21.15.76:0/27586113 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55d8359c0500 con 0x55d835aab2d0 2024-06-02T05:02:25.426 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.423+0000 7f9d8ffff700 1 -- 172.21.15.76:0/27586113 <== mon.1 v2:172.21.15.192:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9da80cb070 con 0x55d835aab2d0 2024-06-02T05:02:25.426 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.423+0000 7f9d8ffff700 1 -- 172.21.15.76:0/27586113 <== mon.1 v2:172.21.15.192:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f9da404b020 con 0x55d835aab2d0 2024-06-02T05:02:25.426 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.423+0000 7f9dc2d4eb80 10 client.26101 fetch_fsmap finished waiting for FSMap version 36 2024-06-02T05:02:25.426 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.423+0000 7f9dc2d4eb80 10 client.26101 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T05:02:25.426 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.423+0000 7f9dc2d4eb80 20 client.26101 populate_metadata read hostname 'smithi076' 2024-06-02T05:02:25.426 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.423+0000 7f9dc2d4eb80 1 --2- 172.21.15.76:0/27586113 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55d835b27050 0x55d835b29440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:02:25.427 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.423+0000 7f9dc2d4eb80 4 client.26101 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T05:02:25.427 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.423+0000 7f9dc2d4eb80 1 -- 172.21.15.76:0/27586113 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55d8359f2e60 con 0x55d835b27050 2024-06-02T05:02:25.427 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.424+0000 7f9db492f700 1 --2- 172.21.15.76:0/27586113 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55d835b27050 0x55d835b29440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:02:25.427 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.424+0000 7f9d8ffff700 10 client.26101 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T05:02:25.427 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.424+0000 7f9db492f700 1 --2- 172.21.15.76:0/27586113 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55d835b27050 0x55d835b29440 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9ee4d07d84d72cf4 server_cookie=587498a3bbd16cbd in_seq=0 out_seq=0 2024-06-02T05:02:25.444 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.442+0000 7f9d8ffff700 1 -- 172.21.15.76:0/27586113 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55d8359f2e60 con 0x55d835b27050 2024-06-02T05:02:25.444 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.442+0000 7f9d8ffff700 10 client.26101 handle_command_reply: tid=0 2024-06-02T05:02:25.444 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.442+0000 7f9dc2d4eb80 1 client.26101 shutdown 2024-06-02T05:02:25.444 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.443+0000 7f9dc2d4eb80 1 -- 172.21.15.76:0/27586113 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d835aab2d0 msgr2=0x55d835ab9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:02:25.445 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.443+0000 7f9dc2d4eb80 1 --2- 172.21.15.76:0/27586113 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d835aab2d0 0x55d835ab9b60 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x55d835a9f440 tx=0x7f9da4005d00 comp rx=0 tx=0).stop 2024-06-02T05:02:25.445 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.443+0000 7f9dc2d4eb80 1 -- 172.21.15.76:0/27586113 shutdown_connections 2024-06-02T05:02:25.445 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.443+0000 7f9dc2d4eb80 1 --2- 172.21.15.76:0/27586113 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55d835b27050 0x55d835b29440 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:25.445 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.443+0000 7f9dc2d4eb80 1 --2- 172.21.15.76:0/27586113 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d835aab2d0 0x55d835ab9b60 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:25.445 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.443+0000 7f9dc2d4eb80 1 --2- 172.21.15.76:0/27586113 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d835aa9a80 0x55d835ab8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:25.445 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.443+0000 7f9dc2d4eb80 1 --2- 172.21.15.76:0/27586113 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d835aaa3e0 0x55d835ab8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:25.445 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.443+0000 7f9dc2d4eb80 1 -- 172.21.15.76:0/27586113 >> 172.21.15.76:0/27586113 conn(0x55d835a081b0 msgr2=0x55d835ab1890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:02:25.445 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.443+0000 7f9d8ffff700 0 client.26101 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T05:02:25.445 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.443+0000 7f9dc2d4eb80 1 -- 172.21.15.76:0/27586113 shutdown_connections 2024-06-02T05:02:25.445 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.443+0000 7f9dc2d4eb80 1 -- 172.21.15.76:0/27586113 wait complete. 2024-06-02T05:02:25.445 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.443+0000 7f9dc2d4eb80 20 client.26101 trim_cache size 0 max 16384 2024-06-02T05:02:25.446 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:{ 2024-06-02T05:02:25.446 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "message": "", 2024-06-02T05:02:25.446 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "return_code": 0 2024-06-02T05:02:25.446 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:} 2024-06-02T05:02:25.447 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.444+0000 7f9db6b93700 1 -- 172.21.15.76:0/3983006663 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f9d980a1210 msgr2=0x7f9d980a36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:02:25.447 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.444+0000 7f9db6b93700 1 --2- 172.21.15.76:0/3983006663 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f9d980a1210 0x7f9d980a36d0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f9da400d7d0 tx=0x7f9da401d040 comp rx=0 tx=0).stop 2024-06-02T05:02:25.447 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.444+0000 7f9db6b93700 1 -- 172.21.15.76:0/3983006663 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9db00ffe20 msgr2=0x7f9db010e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:02:25.447 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.444+0000 7f9db6b93700 1 --2- 172.21.15.76:0/3983006663 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9db00ffe20 0x7f9db010e0f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f9da800ba50 tx=0x7f9da800bd60 comp rx=0 tx=0).stop 2024-06-02T05:02:25.447 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.444+0000 7f9db6b93700 1 -- 172.21.15.76:0/3983006663 shutdown_connections 2024-06-02T05:02:25.447 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.444+0000 7f9db6b93700 1 --2- 172.21.15.76:0/3983006663 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9db0113640 0x7f9db0115ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:25.447 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.444+0000 7f9db6b93700 1 --2- 172.21.15.76:0/3983006663 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f9d980a1210 0x7f9d980a36d0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:25.447 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.444+0000 7f9db6b93700 1 --2- 172.21.15.76:0/3983006663 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9db00ffe20 0x7f9db010e0f0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:25.447 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.444+0000 7f9db6b93700 1 --2- 172.21.15.76:0/3983006663 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9db0101930 0x7f9db010e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:25.447 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.444+0000 7f9db6b93700 1 -- 172.21.15.76:0/3983006663 >> 172.21.15.76:0/3983006663 conn(0x7f9db00fb390 msgr2=0x7f9db01043a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:02:25.447 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.444+0000 7f9db6b93700 1 -- 172.21.15.76:0/3983006663 shutdown_connections 2024-06-02T05:02:25.447 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:25.444+0000 7f9db6b93700 1 -- 172.21.15.76:0/3983006663 wait complete. 2024-06-02T05:02:25.987 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:02:25 smithi076 ceph-mon[42935]: pgmap v653: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 7.0 MiB/s wr, 654 op/s 2024-06-02T05:02:26.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:02:25 smithi119 ceph-mon[46633]: pgmap v653: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 7.0 MiB/s wr, 654 op/s 2024-06-02T05:02:26.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:02:25 smithi192 ceph-mon[47933]: pgmap v653: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 7.0 MiB/s wr, 654 op/s 2024-06-02T05:02:26.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 695.0 s, 530.3 tps, lat 187.759 ms stddev 65.237 2024-06-02T05:02:27.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:02:26 smithi119 ceph-mon[46633]: pgmap v654: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 8.7 MiB/s wr, 787 op/s 2024-06-02T05:02:27.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:02:26 smithi192 ceph-mon[47933]: pgmap v654: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 8.7 MiB/s wr, 787 op/s 2024-06-02T05:02:27.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:02:26 smithi076 ceph-mon[42935]: pgmap v654: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 8.7 MiB/s wr, 787 op/s 2024-06-02T05:02:29.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:02:29 smithi192 ceph-mon[47933]: pgmap v655: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 7.6 MiB/s wr, 669 op/s 2024-06-02T05:02:29.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:02:29 smithi076 ceph-mon[42935]: pgmap v655: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 7.6 MiB/s wr, 669 op/s 2024-06-02T05:02:30.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:02:29 smithi119 ceph-mon[46633]: pgmap v655: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 7.6 MiB/s wr, 669 op/s 2024-06-02T05:02:31.316 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 700.0 s, 495.4 tps, lat 201.443 ms stddev 72.360 2024-06-02T05:02:31.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:02:31 smithi076 ceph-mon[42935]: pgmap v656: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 7.7 MiB/s wr, 724 op/s 2024-06-02T05:02:32.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:02:31 smithi119 ceph-mon[46633]: pgmap v656: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 7.7 MiB/s wr, 724 op/s 2024-06-02T05:02:32.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:02:31 smithi192 ceph-mon[47933]: pgmap v656: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 7.7 MiB/s wr, 724 op/s 2024-06-02T05:02:33.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:02:33 smithi076 ceph-mon[42935]: pgmap v657: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 7.5 MiB/s wr, 701 op/s 2024-06-02T05:02:34.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:02:33 smithi119 ceph-mon[46633]: pgmap v657: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 7.5 MiB/s wr, 701 op/s 2024-06-02T05:02:34.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:02:33 smithi192 ceph-mon[47933]: pgmap v657: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 7.5 MiB/s wr, 701 op/s 2024-06-02T05:02:35.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:02:35 smithi076 ceph-mon[42935]: pgmap v658: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.6 MiB/s wr, 604 op/s 2024-06-02T05:02:36.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:02:35 smithi119 ceph-mon[46633]: pgmap v658: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.6 MiB/s wr, 604 op/s 2024-06-02T05:02:36.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:02:35 smithi192 ceph-mon[47933]: pgmap v658: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.6 MiB/s wr, 604 op/s 2024-06-02T05:02:36.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 705.0 s, 490.6 tps, lat 204.282 ms stddev 74.684 2024-06-02T05:02:37.989 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:02:37 smithi076 ceph-mon[42935]: pgmap v659: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 7.7 MiB/s wr, 732 op/s 2024-06-02T05:02:38.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:02:37 smithi119 ceph-mon[46633]: pgmap v659: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 7.7 MiB/s wr, 732 op/s 2024-06-02T05:02:38.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:02:37 smithi192 ceph-mon[47933]: pgmap v659: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 7.7 MiB/s wr, 732 op/s 2024-06-02T05:02:38.630 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.629+0000 7f6eb9c43700 1 -- 172.21.15.76:0/2503102165 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6eb4106be0 msgr2=0x7f6eb4109050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:02:38.630 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.629+0000 7f6eb9c43700 1 --2- 172.21.15.76:0/2503102165 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6eb4106be0 0x7f6eb4109050 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f6eac009990 tx=0x7f6eac009ca0 comp rx=0 tx=0).stop 2024-06-02T05:02:38.630 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.629+0000 7f6eb9c43700 1 -- 172.21.15.76:0/2503102165 shutdown_connections 2024-06-02T05:02:38.630 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.629+0000 7f6eb9c43700 1 --2- 172.21.15.76:0/2503102165 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6eb4106be0 0x7f6eb4109050 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:38.631 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.629+0000 7f6eb9c43700 1 --2- 172.21.15.76:0/2503102165 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6eb4101980 0x7f6eb4103d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:38.631 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.629+0000 7f6eb9c43700 1 --2- 172.21.15.76:0/2503102165 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6eb41042b0 0x7f6eb41066a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:38.631 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.629+0000 7f6eb9c43700 1 -- 172.21.15.76:0/2503102165 >> 172.21.15.76:0/2503102165 conn(0x7f6eb40fb390 msgr2=0x7f6eb40fd7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:02:38.631 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.630+0000 7f6eb9c43700 1 -- 172.21.15.76:0/2503102165 shutdown_connections 2024-06-02T05:02:38.631 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.630+0000 7f6eb9c43700 1 -- 172.21.15.76:0/2503102165 wait complete. 2024-06-02T05:02:38.632 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.631+0000 7f6eb9c43700 1 Processor -- start 2024-06-02T05:02:38.632 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.631+0000 7f6eb9c43700 1 -- start start 2024-06-02T05:02:38.632 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.631+0000 7f6eb9c43700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6eb4101980 0x7f6eb410fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:02:38.632 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.631+0000 7f6eb9c43700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6eb41042b0 0x7f6eb4110400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:02:38.632 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.631+0000 7f6eb9c43700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6eb4106be0 0x7f6eb41113f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:02:38.632 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.631+0000 7f6eb9c43700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb41119c0 con 0x7f6eb41042b0 2024-06-02T05:02:38.632 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.631+0000 7f6eb9c43700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb4111b30 con 0x7f6eb4101980 2024-06-02T05:02:38.632 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.631+0000 7f6eb9c43700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb4111cf0 con 0x7f6eb4106be0 2024-06-02T05:02:38.633 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.632+0000 7f6eb37fe700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6eb4101980 0x7f6eb410fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:02:38.633 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.632+0000 7f6eb37fe700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6eb4101980 0x7f6eb410fec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:49588/0 (socket says 172.21.15.76:49588) 2024-06-02T05:02:38.633 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.633+0000 7f6eb37fe700 1 -- 172.21.15.76:0/3302465626 learned_addr learned my addr 172.21.15.76:0/3302465626 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:02:38.634 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.633+0000 7f6eb37fe700 1 -- 172.21.15.76:0/3302465626 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6eb4106be0 msgr2=0x7f6eb41113f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-02T05:02:38.634 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.633+0000 7f6eb37fe700 1 --2- 172.21.15.76:0/3302465626 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6eb4106be0 0x7f6eb41113f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:38.634 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.633+0000 7f6eb37fe700 1 -- 172.21.15.76:0/3302465626 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6eb41042b0 msgr2=0x7f6eb4110400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:02:38.634 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.633+0000 7f6eb37fe700 1 --2- 172.21.15.76:0/3302465626 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6eb41042b0 0x7f6eb4110400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:38.634 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.633+0000 7f6eb37fe700 1 -- 172.21.15.76:0/3302465626 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eac0095f0 con 0x7f6eb4101980 2024-06-02T05:02:38.634 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.634+0000 7f6eb37fe700 1 --2- 172.21.15.76:0/3302465626 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6eb4101980 0x7f6eb410fec0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6ea400ba50 tx=0x7f6ea400be10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:02:38.640 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.639+0000 7f6eb17fa700 1 -- 172.21.15.76:0/3302465626 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea400cab0 con 0x7f6eb4101980 2024-06-02T05:02:38.640 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.639+0000 7f6eb17fa700 1 -- 172.21.15.76:0/3302465626 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6ea400cc10 con 0x7f6eb4101980 2024-06-02T05:02:38.640 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.639+0000 7f6eb17fa700 1 -- 172.21.15.76:0/3302465626 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea40075b0 con 0x7f6eb4101980 2024-06-02T05:02:38.640 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.639+0000 7f6eb9c43700 1 -- 172.21.15.76:0/3302465626 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6eb4111f70 con 0x7f6eb4101980 2024-06-02T05:02:38.640 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.639+0000 7f6eb9c43700 1 -- 172.21.15.76:0/3302465626 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6eb41124b0 con 0x7f6eb4101980 2024-06-02T05:02:38.644 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.642+0000 7f6eb17fa700 1 -- 172.21.15.76:0/3302465626 <== mon.2 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f6ea4007710 con 0x7f6eb4101980 2024-06-02T05:02:38.644 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.642+0000 7f6eb17fa700 1 --2- 172.21.15.76:0/3302465626 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f6ea00a1250 0x7f6ea00a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:02:38.644 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.642+0000 7f6eb17fa700 1 -- 172.21.15.76:0/3302465626 <== mon.2 v2:172.21.15.119:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f6ea40cc250 con 0x7f6eb4101980 2024-06-02T05:02:38.646 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.644+0000 7f6eaaffd700 1 --2- 172.21.15.76:0/3302465626 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f6ea00a1250 0x7f6ea00a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:02:38.646 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.644+0000 7f6ec5dfeb80 1 Processor -- start 2024-06-02T05:02:38.647 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.644+0000 7f6ec5dfeb80 1 -- start start 2024-06-02T05:02:38.647 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.644+0000 7f6ec5dfeb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a9e978fa90 0x55a9e978feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:02:38.647 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.644+0000 7f6ec5dfeb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a9e97903f0 0x55a9e9790d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:02:38.647 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.644+0000 7f6ec5dfeb80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a9e97912e0 0x55a9e9791760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:02:38.647 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.644+0000 7f6ec5dfeb80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9e96d60f0 con 0x55a9e97912e0 2024-06-02T05:02:38.647 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.644+0000 7f6ec5dfeb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9e96d3ab0 con 0x55a9e97903f0 2024-06-02T05:02:38.647 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.644+0000 7f6ec5dfeb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9e96cf3a0 con 0x55a9e978fa90 2024-06-02T05:02:38.647 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.644+0000 7f6eaaffd700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a9e97903f0 0x55a9e9790d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:02:38.647 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.644+0000 7f6eb37fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a9e978fa90 0x55a9e978feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:02:38.647 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.644+0000 7f6eaaffd700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a9e97903f0 0x55a9e9790d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:49598/0 (socket says 172.21.15.76:49598) 2024-06-02T05:02:38.647 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.644+0000 7f6eaaffd700 1 -- 172.21.15.76:0/1440627259 learned_addr learned my addr 172.21.15.76:0/1440627259 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:02:38.647 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.645+0000 7f6eb3fff700 1 --2- 172.21.15.76:0/1440627259 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a9e97912e0 0x55a9e9791760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:02:38.647 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.645+0000 7f6eb37fe700 1 -- 172.21.15.76:0/1440627259 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a9e97903f0 msgr2=0x55a9e9790d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:02:38.648 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.645+0000 7f6eb37fe700 1 --2- 172.21.15.76:0/1440627259 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a9e97903f0 0x55a9e9790d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:38.648 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.645+0000 7f6eb37fe700 1 -- 172.21.15.76:0/1440627259 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a9e97912e0 msgr2=0x55a9e9791760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:02:38.648 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.645+0000 7f6eb37fe700 1 --2- 172.21.15.76:0/1440627259 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a9e97912e0 0x55a9e9791760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:38.648 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.645+0000 7f6eb37fe700 1 -- 172.21.15.76:0/1440627259 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a9e9550350 con 0x55a9e978fa90 2024-06-02T05:02:38.648 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.645+0000 7f6eb37fe700 1 --2- 172.21.15.76:0/1440627259 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a9e978fa90 0x55a9e978feb0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f6ea40c9d80 tx=0x7f6ea4014bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=80e372742552c148 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:02:38.648 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.645+0000 7f6ea9ffb700 1 -- 172.21.15.76:0/1440627259 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea409a300 con 0x55a9e978fa90 2024-06-02T05:02:38.648 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.645+0000 7f6ea9ffb700 1 -- 172.21.15.76:0/1440627259 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6ea409e130 con 0x55a9e978fa90 2024-06-02T05:02:38.648 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.646+0000 7f6ea9ffb700 1 -- 172.21.15.76:0/1440627259 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea40997f0 con 0x55a9e978fa90 2024-06-02T05:02:38.649 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.647+0000 7f6ec5dfeb80 1 -- 172.21.15.76:0/1440627259 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a9e978fa90 msgr2=0x55a9e978feb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:02:38.649 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.647+0000 7f6ec5dfeb80 1 --2- 172.21.15.76:0/1440627259 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a9e978fa90 0x55a9e978feb0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f6ea40c9d80 tx=0x7f6ea4014bb0 comp rx=0 tx=0).stop 2024-06-02T05:02:38.649 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.648+0000 7f6eaaffd700 1 --2- 172.21.15.76:0/3302465626 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f6ea00a1250 0x7f6ea00a3710 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c009fd0 tx=0x7f6e9c009610 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:02:38.649 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.648+0000 7f6ec5dfeb80 1 -- 172.21.15.76:0/1440627259 shutdown_connections 2024-06-02T05:02:38.649 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.648+0000 7f6ec5dfeb80 1 --2- 172.21.15.76:0/1440627259 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a9e97912e0 0x55a9e9791760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:38.649 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.648+0000 7f6ec5dfeb80 1 --2- 172.21.15.76:0/1440627259 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a9e978fa90 0x55a9e978feb0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:38.649 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.648+0000 7f6ec5dfeb80 1 --2- 172.21.15.76:0/1440627259 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a9e97903f0 0x55a9e9790d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:38.649 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.648+0000 7f6ec5dfeb80 1 -- 172.21.15.76:0/1440627259 >> 172.21.15.76:0/1440627259 conn(0x55a9e96dd1b0 msgr2=0x55a9e977b440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:02:38.655 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.654+0000 7f6ec5dfeb80 1 -- 172.21.15.76:0/1440627259 shutdown_connections 2024-06-02T05:02:38.655 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.654+0000 7f6ec5dfeb80 1 -- 172.21.15.76:0/1440627259 wait complete. 2024-06-02T05:02:38.656 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.655+0000 7f6ec5dfeb80 1 -- start start 2024-06-02T05:02:38.656 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.655+0000 7f6ec5dfeb80 1 Processor -- start 2024-06-02T05:02:38.659 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.658+0000 7f6ec5dfeb80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a9e978fa90 0x55a9e977fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:02:38.659 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.658+0000 7f6ec5dfeb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a9e97903f0 0x55a9e9780360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:02:38.659 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.658+0000 7f6ec5dfeb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a9e97912e0 0x55a9e97873a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:02:38.659 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.658+0000 7f6ec5dfeb80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9e966b500 con 0x55a9e978fa90 2024-06-02T05:02:38.659 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.658+0000 7f6ec5dfeb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9e966b1a0 con 0x55a9e97903f0 2024-06-02T05:02:38.659 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.658+0000 7f6ec5dfeb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9e9552640 con 0x55a9e97912e0 2024-06-02T05:02:38.659 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.658+0000 7f6ec5dfeb80 10 client.0 _ll_register_callbacks cb 0x55a9e9674ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T05:02:38.660 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.659+0000 7f6eb3fff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a9e97912e0 0x55a9e97873a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:02:38.660 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.659+0000 7f6eb3fff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a9e97912e0 0x55a9e97873a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:37260/0 (socket says 172.21.15.76:37260) 2024-06-02T05:02:38.660 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.659+0000 7f6eb3fff700 1 -- 172.21.15.76:0/4054414858 learned_addr learned my addr 172.21.15.76:0/4054414858 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:02:38.660 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.659+0000 7f6eb3fff700 1 -- 172.21.15.76:0/4054414858 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a9e97903f0 msgr2=0x55a9e9780360 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-02T05:02:38.660 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.659+0000 7f6eb3fff700 1 --2- 172.21.15.76:0/4054414858 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a9e97903f0 0x55a9e9780360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:38.660 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.659+0000 7f6eb3fff700 1 -- 172.21.15.76:0/4054414858 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a9e978fa90 msgr2=0x55a9e977fe20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-02T05:02:38.661 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.659+0000 7f6eb3fff700 1 --2- 172.21.15.76:0/4054414858 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a9e978fa90 0x55a9e977fe20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:38.661 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.659+0000 7f6eb3fff700 1 -- 172.21.15.76:0/4054414858 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6eb41124b0 con 0x55a9e97912e0 2024-06-02T05:02:38.661 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.659+0000 7f6eb3fff700 1 --2- 172.21.15.76:0/4054414858 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a9e97912e0 0x55a9e97873a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6eac015000 tx=0x7f6eac005800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=667e5740c72ceb85 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:02:38.661 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.659+0000 7f6e92ffd700 10 client.0 ms_handle_connect on v2:172.21.15.192:3300/0 2024-06-02T05:02:38.661 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.660+0000 7f6e92ffd700 1 -- 172.21.15.76:0/4054414858 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eac00bbe0 con 0x55a9e97912e0 2024-06-02T05:02:38.661 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.660+0000 7f6e92ffd700 1 -- 172.21.15.76:0/4054414858 <== mon.1 v2:172.21.15.192:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f6eac00bd40 con 0x55a9e97912e0 2024-06-02T05:02:38.667 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.667+0000 7f6ec5dfeb80 1 -- 172.21.15.76:0/4054414858 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a9e9628210 con 0x55a9e97912e0 2024-06-02T05:02:38.668 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.667+0000 7f6e92ffd700 1 -- 172.21.15.76:0/4054414858 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6eac0038c0 con 0x55a9e97912e0 2024-06-02T05:02:38.668 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.667+0000 7f6ec5dfeb80 10 client.26107 fetch_fsmap learned FSMap version 36 2024-06-02T05:02:38.668 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.667+0000 7f6ec5dfeb80 1 -- 172.21.15.76:0/4054414858 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55a9e94fcb00 con 0x55a9e97912e0 2024-06-02T05:02:38.669 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.668+0000 7f6e92ffd700 1 -- 172.21.15.76:0/4054414858 <== mon.1 v2:172.21.15.192:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55a9e9628210 con 0x55a9e97912e0 2024-06-02T05:02:38.669 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.668+0000 7f6e92ffd700 1 -- 172.21.15.76:0/4054414858 <== mon.1 v2:172.21.15.192:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f6eac02a070 con 0x55a9e97912e0 2024-06-02T05:02:38.669 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.669+0000 7f6ec5dfeb80 10 client.26107 fetch_fsmap finished waiting for FSMap version 36 2024-06-02T05:02:38.669 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.669+0000 7f6ec5dfeb80 10 client.26107 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T05:02:38.670 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.669+0000 7f6ec5dfeb80 20 client.26107 populate_metadata read hostname 'smithi076' 2024-06-02T05:02:38.670 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.669+0000 7f6ec5dfeb80 1 --2- 172.21.15.76:0/4054414858 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55a9e978bcb0 0x55a9e978e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:02:38.670 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.669+0000 7f6ec5dfeb80 4 client.26107 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T05:02:38.670 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.669+0000 7f6ec5dfeb80 1 -- 172.21.15.76:0/4054414858 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a9e974e7b0 con 0x55a9e978bcb0 2024-06-02T05:02:38.670 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.669+0000 7f6eb37fe700 1 --2- 172.21.15.76:0/4054414858 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55a9e978bcb0 0x55a9e978e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:02:38.670 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.670+0000 7f6e92ffd700 10 client.26107 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T05:02:38.670 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.670+0000 7f6eb37fe700 1 --2- 172.21.15.76:0/4054414858 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55a9e978bcb0 0x55a9e978e0d0 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=56845a5cbc81153a server_cookie=c33a7ad15bc3cc28 in_seq=0 out_seq=0 2024-06-02T05:02:38.671 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.670+0000 7f6e92ffd700 1 -- 172.21.15.76:0/4054414858 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55a9e974e7b0 con 0x55a9e978bcb0 2024-06-02T05:02:38.671 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.670+0000 7f6e92ffd700 10 client.26107 handle_command_reply: tid=0 2024-06-02T05:02:38.671 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.671+0000 7f6ec5dfeb80 1 client.26107 shutdown 2024-06-02T05:02:38.671 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.671+0000 7f6ec5dfeb80 1 -- 172.21.15.76:0/4054414858 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a9e97912e0 msgr2=0x55a9e97873a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:02:38.671 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.671+0000 7f6ec5dfeb80 1 --2- 172.21.15.76:0/4054414858 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a9e97912e0 0x55a9e97873a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6eac015000 tx=0x7f6eac005800 comp rx=0 tx=0).stop 2024-06-02T05:02:38.680 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.679+0000 7f6ec5dfeb80 1 -- 172.21.15.76:0/4054414858 shutdown_connections 2024-06-02T05:02:38.682 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.679+0000 7f6ec5dfeb80 1 --2- 172.21.15.76:0/4054414858 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55a9e978bcb0 0x55a9e978e0d0 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:38.682 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.679+0000 7f6ec5dfeb80 1 --2- 172.21.15.76:0/4054414858 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a9e97912e0 0x55a9e97873a0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:38.682 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.679+0000 7f6ec5dfeb80 1 --2- 172.21.15.76:0/4054414858 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a9e978fa90 0x55a9e977fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:38.682 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.679+0000 7f6ec5dfeb80 1 --2- 172.21.15.76:0/4054414858 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a9e97903f0 0x55a9e9780360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:38.682 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.679+0000 7f6e92ffd700 0 client.26107 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T05:02:38.682 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.679+0000 7f6ec5dfeb80 1 -- 172.21.15.76:0/4054414858 >> 172.21.15.76:0/4054414858 conn(0x55a9e96dd1b0 msgr2=0x55a9e9779860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:02:38.685 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.685+0000 7f6ec5dfeb80 1 -- 172.21.15.76:0/4054414858 shutdown_connections 2024-06-02T05:02:38.685 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.685+0000 7f6ec5dfeb80 1 -- 172.21.15.76:0/4054414858 wait complete. 2024-06-02T05:02:38.686 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.685+0000 7f6ec5dfeb80 20 client.26107 trim_cache size 0 max 16384 2024-06-02T05:02:38.712 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.711+0000 7f6ec5dfeb80 1 Processor -- start 2024-06-02T05:02:38.713 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.711+0000 7f6ec5dfeb80 1 -- start start 2024-06-02T05:02:38.713 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.712+0000 7f6ec5dfeb80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a9e978fa90 0x55a9e978fe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:02:38.713 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.712+0000 7f6ec5dfeb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a9e97903f0 0x55a9e97916c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:02:38.713 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.712+0000 7f6ec5dfeb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a9e97912e0 0x55a9e97872c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:02:38.713 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.712+0000 7f6ec5dfeb80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9e97747c0 con 0x55a9e978fa90 2024-06-02T05:02:38.714 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.712+0000 7f6ec5dfeb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9e977e5c0 con 0x55a9e97903f0 2024-06-02T05:02:38.714 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.712+0000 7f6ec5dfeb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9e97769b0 con 0x55a9e97912e0 2024-06-02T05:02:38.714 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.712+0000 7f6eb3fff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a9e97912e0 0x55a9e97872c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:02:38.714 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.712+0000 7f6eb3fff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a9e97912e0 0x55a9e97872c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:37262/0 (socket says 172.21.15.76:37262) 2024-06-02T05:02:38.714 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.712+0000 7f6eb3fff700 1 -- 172.21.15.76:0/2199358323 learned_addr learned my addr 172.21.15.76:0/2199358323 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:02:38.714 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.712+0000 7f6eb3fff700 1 -- 172.21.15.76:0/2199358323 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a9e97903f0 msgr2=0x55a9e97916c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-02T05:02:38.714 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.712+0000 7f6eb3fff700 1 --2- 172.21.15.76:0/2199358323 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a9e97903f0 0x55a9e97916c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:38.715 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.713+0000 7f6eb3fff700 1 -- 172.21.15.76:0/2199358323 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a9e978fa90 msgr2=0x55a9e978fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:02:38.715 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.713+0000 7f6eb3fff700 1 --2- 172.21.15.76:0/2199358323 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a9e978fa90 0x55a9e978fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:38.715 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.713+0000 7f6eb3fff700 1 -- 172.21.15.76:0/2199358323 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a9e9695500 con 0x55a9e97912e0 2024-06-02T05:02:38.715 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.713+0000 7f6eb3fff700 1 --2- 172.21.15.76:0/2199358323 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a9e97912e0 0x55a9e97872c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f6eac00b540 tx=0x7f6eac00b570 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5f065a87382ae9bd server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:02:38.716 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.714+0000 7f6eaa7fc700 1 -- 172.21.15.76:0/2199358323 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eac004ad0 con 0x55a9e97912e0 2024-06-02T05:02:38.716 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.714+0000 7f6eaa7fc700 1 -- 172.21.15.76:0/2199358323 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6eac01e040 con 0x55a9e97912e0 2024-06-02T05:02:38.716 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.714+0000 7f6eaa7fc700 1 -- 172.21.15.76:0/2199358323 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eac02b3a0 con 0x55a9e97912e0 2024-06-02T05:02:38.716 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.715+0000 7f6ec5dfeb80 1 -- 172.21.15.76:0/2199358323 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a9e97912e0 msgr2=0x55a9e97872c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:02:38.716 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.715+0000 7f6ec5dfeb80 1 --2- 172.21.15.76:0/2199358323 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a9e97912e0 0x55a9e97872c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f6eac00b540 tx=0x7f6eac00b570 comp rx=0 tx=0).stop 2024-06-02T05:02:38.717 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.717+0000 7f6ec5dfeb80 1 -- 172.21.15.76:0/2199358323 shutdown_connections 2024-06-02T05:02:38.717 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.717+0000 7f6ec5dfeb80 1 --2- 172.21.15.76:0/2199358323 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a9e97912e0 0x55a9e97872c0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:38.718 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.717+0000 7f6ec5dfeb80 1 --2- 172.21.15.76:0/2199358323 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a9e978fa90 0x55a9e978fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:38.718 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.717+0000 7f6ec5dfeb80 1 --2- 172.21.15.76:0/2199358323 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a9e97903f0 0x55a9e97916c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:38.718 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.717+0000 7f6ec5dfeb80 1 -- 172.21.15.76:0/2199358323 >> 172.21.15.76:0/2199358323 conn(0x55a9e96dd1b0 msgr2=0x55a9e9797990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:02:38.718 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.717+0000 7f6ec5dfeb80 1 -- 172.21.15.76:0/2199358323 shutdown_connections 2024-06-02T05:02:38.719 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.718+0000 7f6ec5dfeb80 1 -- 172.21.15.76:0/2199358323 wait complete. 2024-06-02T05:02:38.719 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.718+0000 7f6ec5dfeb80 1 -- start start 2024-06-02T05:02:38.719 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.718+0000 7f6ec5dfeb80 1 Processor -- start 2024-06-02T05:02:38.719 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.719+0000 7f6ec5dfeb80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a9e978fa90 0x55a9e9786b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:02:38.719 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.719+0000 7f6ec5dfeb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a9e97903f0 0x55a9e9787110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:02:38.719 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.719+0000 7f6ec5dfeb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a9e97912e0 0x55a9e9783820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:02:38.720 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.719+0000 7f6ec5dfeb80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9e9783f60 con 0x55a9e978fa90 2024-06-02T05:02:38.720 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.719+0000 7f6ec5dfeb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9e97840d0 con 0x55a9e97903f0 2024-06-02T05:02:38.720 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.719+0000 7f6ec5dfeb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9e9784290 con 0x55a9e97912e0 2024-06-02T05:02:38.720 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.719+0000 7f6ec5dfeb80 10 client.0 _ll_register_callbacks cb 0x55a9e9674ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T05:02:38.720 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.719+0000 7f6eaaffd700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a9e97903f0 0x55a9e9787110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:02:38.720 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.719+0000 7f6eb3fff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a9e97912e0 0x55a9e9783820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:02:38.720 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.719+0000 7f6eaaffd700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a9e97903f0 0x55a9e9787110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:49606/0 (socket says 172.21.15.76:49606) 2024-06-02T05:02:38.720 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.719+0000 7f6eb3fff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a9e97912e0 0x55a9e9783820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:37264/0 (socket says 172.21.15.76:37264) 2024-06-02T05:02:38.720 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.719+0000 7f6eaaffd700 1 -- 172.21.15.76:0/3686563141 learned_addr learned my addr 172.21.15.76:0/3686563141 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:02:38.722 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.719+0000 7f6eb37fe700 1 --2- 172.21.15.76:0/3686563141 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a9e978fa90 0x55a9e9786b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:02:38.722 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.719+0000 7f6eaaffd700 1 -- 172.21.15.76:0/3686563141 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a9e97912e0 msgr2=0x55a9e9783820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:02:38.722 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.719+0000 7f6eaaffd700 1 --2- 172.21.15.76:0/3686563141 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a9e97912e0 0x55a9e9783820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:38.722 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.719+0000 7f6eaaffd700 1 -- 172.21.15.76:0/3686563141 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a9e978fa90 msgr2=0x55a9e9786b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:02:38.722 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.719+0000 7f6eaaffd700 1 --2- 172.21.15.76:0/3686563141 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a9e978fa90 0x55a9e9786b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:38.722 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.719+0000 7f6eaaffd700 1 -- 172.21.15.76:0/3686563141 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a9e94fcb00 con 0x55a9e97903f0 2024-06-02T05:02:38.722 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.720+0000 7f6eaaffd700 1 --2- 172.21.15.76:0/3686563141 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a9e97903f0 0x55a9e9787110 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c03cdc0 tx=0x7f6e9c006cd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b2b168366fa2a08 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:02:38.722 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.720+0000 7f6e92ffd700 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-06-02T05:02:38.722 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.720+0000 7f6e92ffd700 1 -- 172.21.15.76:0/3686563141 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e9c009360 con 0x55a9e97903f0 2024-06-02T05:02:38.722 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.720+0000 7f6e92ffd700 1 -- 172.21.15.76:0/3686563141 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f6e9c036d30 con 0x55a9e97903f0 2024-06-02T05:02:38.723 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.720+0000 7f6ec5dfeb80 1 -- 172.21.15.76:0/3686563141 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6ea409e130 con 0x55a9e97903f0 2024-06-02T05:02:38.723 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.720+0000 7f6e92ffd700 1 -- 172.21.15.76:0/3686563141 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6e9c03ab70 con 0x55a9e97903f0 2024-06-02T05:02:38.723 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.720+0000 7f6ec5dfeb80 10 client.26156 fetch_fsmap learned FSMap version 36 2024-06-02T05:02:38.723 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.720+0000 7f6ec5dfeb80 1 -- 172.21.15.76:0/3686563141 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55a9e9554c70 con 0x55a9e97903f0 2024-06-02T05:02:38.723 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.721+0000 7f6e92ffd700 1 -- 172.21.15.76:0/3686563141 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6ea409e130 con 0x55a9e97903f0 2024-06-02T05:02:38.723 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.721+0000 7f6e92ffd700 1 -- 172.21.15.76:0/3686563141 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f6e9c044ad0 con 0x55a9e97903f0 2024-06-02T05:02:38.723 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.721+0000 7f6ec5dfeb80 10 client.26156 fetch_fsmap finished waiting for FSMap version 36 2024-06-02T05:02:38.723 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.721+0000 7f6ec5dfeb80 10 client.26156 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T05:02:38.723 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.721+0000 7f6ec5dfeb80 20 client.26156 populate_metadata read hostname 'smithi076' 2024-06-02T05:02:38.723 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.721+0000 7f6ec5dfeb80 1 --2- 172.21.15.76:0/3686563141 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55a9e97eaf60 0x55a9e97ed380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:02:38.723 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.721+0000 7f6ec5dfeb80 4 client.26156 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T05:02:38.723 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.721+0000 7f6ec5dfeb80 1 -- 172.21.15.76:0/3686563141 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55a9e96c7e60 con 0x55a9e97eaf60 2024-06-02T05:02:38.724 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.722+0000 7f6eb37fe700 1 --2- 172.21.15.76:0/3686563141 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55a9e97eaf60 0x55a9e97ed380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:02:38.724 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.722+0000 7f6eb37fe700 1 --2- 172.21.15.76:0/3686563141 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55a9e97eaf60 0x55a9e97ed380 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=abb9e817c583daa1 server_cookie=e997e8bdc2060105 in_seq=0 out_seq=0 2024-06-02T05:02:38.724 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.722+0000 7f6e92ffd700 10 client.26156 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T05:02:38.759 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.757+0000 7f6e92ffd700 1 -- 172.21.15.76:0/3686563141 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55a9e96c7e60 con 0x55a9e97eaf60 2024-06-02T05:02:38.759 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.757+0000 7f6e92ffd700 10 client.26156 handle_command_reply: tid=0 2024-06-02T05:02:38.759 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.757+0000 7f6ec5dfeb80 1 client.26156 shutdown 2024-06-02T05:02:38.759 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.758+0000 7f6ec5dfeb80 1 -- 172.21.15.76:0/3686563141 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a9e97903f0 msgr2=0x55a9e9787110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:02:38.759 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.758+0000 7f6ec5dfeb80 1 --2- 172.21.15.76:0/3686563141 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a9e97903f0 0x55a9e9787110 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c03cdc0 tx=0x7f6e9c006cd0 comp rx=0 tx=0).stop 2024-06-02T05:02:38.759 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.758+0000 7f6ec5dfeb80 1 -- 172.21.15.76:0/3686563141 shutdown_connections 2024-06-02T05:02:38.759 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.758+0000 7f6ec5dfeb80 1 --2- 172.21.15.76:0/3686563141 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55a9e97eaf60 0x55a9e97ed380 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:38.759 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.758+0000 7f6ec5dfeb80 1 --2- 172.21.15.76:0/3686563141 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a9e97912e0 0x55a9e9783820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:38.759 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.758+0000 7f6ec5dfeb80 1 --2- 172.21.15.76:0/3686563141 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a9e978fa90 0x55a9e9786b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:38.759 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.758+0000 7f6ec5dfeb80 1 --2- 172.21.15.76:0/3686563141 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a9e97903f0 0x55a9e9787110 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:38.759 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.758+0000 7f6ec5dfeb80 1 -- 172.21.15.76:0/3686563141 >> 172.21.15.76:0/3686563141 conn(0x55a9e96dd1b0 msgr2=0x55a9e977f3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:02:38.760 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.758+0000 7f6e92ffd700 0 client.26156 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T05:02:38.766 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.765+0000 7f6ec5dfeb80 1 -- 172.21.15.76:0/3686563141 shutdown_connections 2024-06-02T05:02:38.773 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.770+0000 7f6ec5dfeb80 1 -- 172.21.15.76:0/3686563141 wait complete. 2024-06-02T05:02:38.774 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.774+0000 7f6ec5dfeb80 20 client.26156 trim_cache size 0 max 16384 2024-06-02T05:02:38.775 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:{ 2024-06-02T05:02:38.775 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "message": "", 2024-06-02T05:02:38.775 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "return_code": 0 2024-06-02T05:02:38.775 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:} 2024-06-02T05:02:38.779 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.778+0000 7f6eb9c43700 1 -- 172.21.15.76:0/3302465626 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f6ea00a1250 msgr2=0x7f6ea00a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:02:38.779 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.778+0000 7f6eb9c43700 1 --2- 172.21.15.76:0/3302465626 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f6ea00a1250 0x7f6ea00a3710 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c009fd0 tx=0x7f6e9c009610 comp rx=0 tx=0).stop 2024-06-02T05:02:38.779 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.778+0000 7f6eb9c43700 1 -- 172.21.15.76:0/3302465626 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6eb4101980 msgr2=0x7f6eb410fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:02:38.779 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.778+0000 7f6eb9c43700 1 --2- 172.21.15.76:0/3302465626 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6eb4101980 0x7f6eb410fec0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6ea400ba50 tx=0x7f6ea400be10 comp rx=0 tx=0).stop 2024-06-02T05:02:38.779 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.778+0000 7f6eb9c43700 1 -- 172.21.15.76:0/3302465626 shutdown_connections 2024-06-02T05:02:38.779 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.778+0000 7f6eb9c43700 1 --2- 172.21.15.76:0/3302465626 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6eb4106be0 0x7f6eb41113f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:38.779 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.778+0000 7f6eb9c43700 1 --2- 172.21.15.76:0/3302465626 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f6ea00a1250 0x7f6ea00a3710 secure :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c009fd0 tx=0x7f6e9c009610 comp rx=0 tx=0).stop 2024-06-02T05:02:38.779 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.778+0000 7f6eb9c43700 1 --2- 172.21.15.76:0/3302465626 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6eb4101980 0x7f6eb410fec0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:38.780 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.778+0000 7f6eb9c43700 1 --2- 172.21.15.76:0/3302465626 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6eb41042b0 0x7f6eb4110400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:38.780 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.778+0000 7f6eb9c43700 1 -- 172.21.15.76:0/3302465626 >> 172.21.15.76:0/3302465626 conn(0x7f6eb40fb390 msgr2=0x7f6eb4102420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:02:38.782 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.782+0000 7f6eb9c43700 1 -- 172.21.15.76:0/3302465626 shutdown_connections 2024-06-02T05:02:38.784 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:38.784+0000 7f6eb9c43700 1 -- 172.21.15.76:0/3302465626 wait complete. 2024-06-02T05:02:39.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:02:39 smithi076 ceph-mon[42935]: pgmap v660: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.5 MiB/s wr, 616 op/s 2024-06-02T05:02:40.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:02:39 smithi119 ceph-mon[46633]: pgmap v660: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.5 MiB/s wr, 616 op/s 2024-06-02T05:02:40.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:02:39 smithi192 ceph-mon[47933]: pgmap v660: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.5 MiB/s wr, 616 op/s 2024-06-02T05:02:41.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 710.0 s, 487.0 tps, lat 206.590 ms stddev 89.045 2024-06-02T05:02:41.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:02:41 smithi076 ceph-mon[42935]: pgmap v661: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 7.2 MiB/s wr, 690 op/s 2024-06-02T05:02:42.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:02:41 smithi119 ceph-mon[46633]: pgmap v661: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 7.2 MiB/s wr, 690 op/s 2024-06-02T05:02:42.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:02:41 smithi192 ceph-mon[47933]: pgmap v661: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 7.2 MiB/s wr, 690 op/s 2024-06-02T05:02:44.097 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:02:43 smithi119 ceph-mon[46633]: pgmap v662: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 9.2 MiB/s wr, 728 op/s 2024-06-02T05:02:44.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:02:43 smithi192 ceph-mon[47933]: pgmap v662: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 9.2 MiB/s wr, 728 op/s 2024-06-02T05:02:44.236 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:02:43 smithi076 ceph-mon[42935]: pgmap v662: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 9.2 MiB/s wr, 728 op/s 2024-06-02T05:02:45.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:02:44 smithi119 ceph-mon[46633]: pgmap v663: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 8.8 MiB/s wr, 645 op/s 2024-06-02T05:02:45.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:02:44 smithi192 ceph-mon[47933]: pgmap v663: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 8.8 MiB/s wr, 645 op/s 2024-06-02T05:02:45.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:02:44 smithi076 ceph-mon[42935]: pgmap v663: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 8.8 MiB/s wr, 645 op/s 2024-06-02T05:02:46.317 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 715.0 s, 679.0 tps, lat 147.073 ms stddev 70.052 2024-06-02T05:02:47.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:02:47 smithi076 ceph-mon[42935]: pgmap v664: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 12 MiB/s wr, 838 op/s 2024-06-02T05:02:48.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:02:47 smithi119 ceph-mon[46633]: pgmap v664: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 12 MiB/s wr, 838 op/s 2024-06-02T05:02:48.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:02:47 smithi192 ceph-mon[47933]: pgmap v664: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 12 MiB/s wr, 838 op/s 2024-06-02T05:02:49.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:02:49 smithi076 ceph-mon[42935]: pgmap v665: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 12 MiB/s wr, 742 op/s 2024-06-02T05:02:50.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:02:49 smithi119 ceph-mon[46633]: pgmap v665: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 12 MiB/s wr, 742 op/s 2024-06-02T05:02:50.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:02:49 smithi192 ceph-mon[47933]: pgmap v665: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 12 MiB/s wr, 742 op/s 2024-06-02T05:02:51.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 720.0 s, 551.2 tps, lat 162.222 ms stddev 79.521 2024-06-02T05:02:51.986 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:02:51 smithi076 ceph-mon[42935]: pgmap v666: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 14 MiB/s wr, 856 op/s 2024-06-02T05:02:51.999 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:51.998+0000 7f5d450b6700 1 -- 172.21.15.76:0/2090553491 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5d4010d5e0 msgr2=0x7f5d4010faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:02:51.999 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:51.998+0000 7f5d450b6700 1 --2- 172.21.15.76:0/2090553491 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5d4010d5e0 0x7f5d4010faa0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f5d300074e0 tx=0x7f5d3000af90 comp rx=0 tx=0).stop 2024-06-02T05:02:52.007 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.006+0000 7f5d450b6700 1 -- 172.21.15.76:0/2090553491 shutdown_connections 2024-06-02T05:02:52.007 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.006+0000 7f5d450b6700 1 --2- 172.21.15.76:0/2090553491 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5d4010d5e0 0x7f5d4010faa0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:52.007 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.006+0000 7f5d450b6700 1 --2- 172.21.15.76:0/2090553491 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5d40108180 0x7f5d4010a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:52.007 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.006+0000 7f5d450b6700 1 --2- 172.21.15.76:0/2090553491 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5d4010ab40 0x7f5d4010cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:52.008 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.007+0000 7f5d450b6700 1 -- 172.21.15.76:0/2090553491 >> 172.21.15.76:0/2090553491 conn(0x7f5d4006e0f0 msgr2=0x7f5d40070530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:02:52.017 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.017+0000 7f5d450b6700 1 -- 172.21.15.76:0/2090553491 shutdown_connections 2024-06-02T05:02:52.018 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.017+0000 7f5d450b6700 1 -- 172.21.15.76:0/2090553491 wait complete. 2024-06-02T05:02:52.019 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.018+0000 7f5d450b6700 1 Processor -- start 2024-06-02T05:02:52.020 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.018+0000 7f5d450b6700 1 -- start start 2024-06-02T05:02:52.020 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.018+0000 7f5d450b6700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5d40108180 0x7f5d40118790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:02:52.020 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.018+0000 7f5d450b6700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5d4010ab40 0x7f5d40118cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:02:52.020 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.018+0000 7f5d450b6700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5d4010d5e0 0x7f5d401b5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:02:52.020 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.018+0000 7f5d450b6700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4011fd80 con 0x7f5d40108180 2024-06-02T05:02:52.021 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.018+0000 7f5d450b6700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4011fef0 con 0x7f5d4010ab40 2024-06-02T05:02:52.021 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.018+0000 7f5d450b6700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d401b6420 con 0x7f5d4010d5e0 2024-06-02T05:02:52.021 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.019+0000 7f5d3f59e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5d4010d5e0 0x7f5d401b5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:02:52.021 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.019+0000 7f5d3f59e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5d4010d5e0 0x7f5d401b5ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:47298/0 (socket says 172.21.15.76:47298) 2024-06-02T05:02:52.021 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.019+0000 7f5d3f59e700 1 -- 172.21.15.76:0/3386481370 learned_addr learned my addr 172.21.15.76:0/3386481370 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:02:52.022 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.019+0000 7f5d3f59e700 1 -- 172.21.15.76:0/3386481370 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5d4010ab40 msgr2=0x7f5d40118cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:02:52.023 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.019+0000 7f5d3f59e700 1 --2- 172.21.15.76:0/3386481370 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5d4010ab40 0x7f5d40118cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:52.023 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.019+0000 7f5d3f59e700 1 -- 172.21.15.76:0/3386481370 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5d40108180 msgr2=0x7f5d40118790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:02:52.023 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.019+0000 7f5d3f59e700 1 --2- 172.21.15.76:0/3386481370 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5d40108180 0x7f5d40118790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:52.024 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.019+0000 7f5d3f59e700 1 -- 172.21.15.76:0/3386481370 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d300071c0 con 0x7f5d4010d5e0 2024-06-02T05:02:52.024 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.019+0000 7f5d3f59e700 1 --2- 172.21.15.76:0/3386481370 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5d4010d5e0 0x7f5d401b5ee0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5d3000c3b0 tx=0x7f5d30003ee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:02:52.024 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.020+0000 7f5d27fff700 1 -- 172.21.15.76:0/3386481370 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d3000f070 con 0x7f5d4010d5e0 2024-06-02T05:02:52.024 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.020+0000 7f5d27fff700 1 -- 172.21.15.76:0/3386481370 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5d3000ca50 con 0x7f5d4010d5e0 2024-06-02T05:02:52.024 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.020+0000 7f5d27fff700 1 -- 172.21.15.76:0/3386481370 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d3000a6c0 con 0x7f5d4010d5e0 2024-06-02T05:02:52.026 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.020+0000 7f5d450b6700 1 -- 172.21.15.76:0/3386481370 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d401b6560 con 0x7f5d4010d5e0 2024-06-02T05:02:52.026 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.020+0000 7f5d450b6700 1 -- 172.21.15.76:0/3386481370 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d401b69b0 con 0x7f5d4010d5e0 2024-06-02T05:02:52.026 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.025+0000 7f5d51271b80 1 Processor -- start 2024-06-02T05:02:52.027 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.025+0000 7f5d51271b80 1 -- start start 2024-06-02T05:02:52.027 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.026+0000 7f5d51271b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555eb12d9a80 0x555eb12d9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:02:52.027 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.026+0000 7f5d51271b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555eb12da3e0 0x555eb12dacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:02:52.027 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.026+0000 7f5d51271b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555eb12db2d0 0x555eb12db750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:02:52.027 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.026+0000 7f5d51271b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x555eb12310f0 con 0x555eb12db2d0 2024-06-02T05:02:52.027 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.026+0000 7f5d51271b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x555eb122eab0 con 0x555eb12da3e0 2024-06-02T05:02:52.027 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.026+0000 7f5d51271b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x555eb122a3a0 con 0x555eb12d9a80 2024-06-02T05:02:52.027 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.026+0000 7f5d3ed9d700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555eb12da3e0 0x555eb12dacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:02:52.028 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.026+0000 7f5d3ed9d700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555eb12da3e0 0x555eb12dacf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:43860/0 (socket says 172.21.15.76:43860) 2024-06-02T05:02:52.028 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.026+0000 7f5d3ed9d700 1 -- 172.21.15.76:0/2227441159 learned_addr learned my addr 172.21.15.76:0/2227441159 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:02:52.028 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.026+0000 7f5d3e59c700 1 --2- 172.21.15.76:0/2227441159 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555eb12d9a80 0x555eb12d9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:02:52.028 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.026+0000 7f5d3ed9d700 1 -- 172.21.15.76:0/2227441159 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555eb12d9a80 msgr2=0x555eb12d9ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:02:52.028 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.026+0000 7f5d3ed9d700 1 --2- 172.21.15.76:0/2227441159 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555eb12d9a80 0x555eb12d9ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:52.028 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.026+0000 7f5d3ed9d700 1 -- 172.21.15.76:0/2227441159 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555eb12db2d0 msgr2=0x555eb12db750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:02:52.028 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.026+0000 7f5d3ed9d700 1 --2- 172.21.15.76:0/2227441159 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555eb12db2d0 0x555eb12db750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:52.028 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.026+0000 7f5d3ed9d700 1 -- 172.21.15.76:0/2227441159 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555eb10ab350 con 0x555eb12da3e0 2024-06-02T05:02:52.038 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.037+0000 7f5d3ed9d700 1 --2- 172.21.15.76:0/2227441159 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555eb12da3e0 0x555eb12dacf0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5d38009d80 tx=0x7f5d3800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8dac60e1a969c28c server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:02:52.039 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.039+0000 7f5d27fff700 1 -- 172.21.15.76:0/3386481370 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f5d3000a820 con 0x7f5d4010d5e0 2024-06-02T05:02:52.041 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.039+0000 7f5d27fff700 1 --2- 172.21.15.76:0/3386481370 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f5d280a12a0 0x7f5d280a3760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:02:52.041 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.040+0000 7f5d27fff700 1 -- 172.21.15.76:0/3386481370 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f5d300cd7d0 con 0x7f5d4010d5e0 2024-06-02T05:02:52.041 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.041+0000 7f5d3e59c700 1 --2- 172.21.15.76:0/3386481370 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f5d280a12a0 0x7f5d280a3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:02:52.042 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.042+0000 7f5d3e59c700 1 --2- 172.21.15.76:0/3386481370 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f5d280a12a0 0x7f5d280a3760 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x555eb12daab0 tx=0x7f5d3400b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:02:52.042 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.042+0000 7f5d257fa700 1 -- 172.21.15.76:0/2227441159 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d3800e070 con 0x555eb12da3e0 2024-06-02T05:02:52.042 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.042+0000 7f5d257fa700 1 -- 172.21.15.76:0/2227441159 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5d380098b0 con 0x555eb12da3e0 2024-06-02T05:02:52.043 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.042+0000 7f5d257fa700 1 -- 172.21.15.76:0/2227441159 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d38011390 con 0x555eb12da3e0 2024-06-02T05:02:52.048 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.043+0000 7f5d51271b80 1 -- 172.21.15.76:0/2227441159 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555eb12da3e0 msgr2=0x555eb12dacf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:02:52.048 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.043+0000 7f5d51271b80 1 --2- 172.21.15.76:0/2227441159 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555eb12da3e0 0x555eb12dacf0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5d38009d80 tx=0x7f5d3800b330 comp rx=0 tx=0).stop 2024-06-02T05:02:52.048 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.047+0000 7f5d51271b80 1 -- 172.21.15.76:0/2227441159 shutdown_connections 2024-06-02T05:02:52.048 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.048+0000 7f5d51271b80 1 --2- 172.21.15.76:0/2227441159 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555eb12db2d0 0x555eb12db750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:52.049 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.048+0000 7f5d51271b80 1 --2- 172.21.15.76:0/2227441159 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555eb12d9a80 0x555eb12d9ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:52.049 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.048+0000 7f5d51271b80 1 --2- 172.21.15.76:0/2227441159 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555eb12da3e0 0x555eb12dacf0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:52.049 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.048+0000 7f5d51271b80 1 -- 172.21.15.76:0/2227441159 >> 172.21.15.76:0/2227441159 conn(0x555eb12381b0 msgr2=0x555eb12d6440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:02:52.053 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.053+0000 7f5d51271b80 1 -- 172.21.15.76:0/2227441159 shutdown_connections 2024-06-02T05:02:52.054 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.053+0000 7f5d51271b80 1 -- 172.21.15.76:0/2227441159 wait complete. 2024-06-02T05:02:52.054 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.053+0000 7f5d51271b80 1 -- start start 2024-06-02T05:02:52.054 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.053+0000 7f5d51271b80 1 Processor -- start 2024-06-02T05:02:52.054 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.054+0000 7f5d51271b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555eb12d9a80 0x555eb12e38f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:02:52.055 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.054+0000 7f5d51271b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555eb12da3e0 0x555eb12e3e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:02:52.055 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.054+0000 7f5d51271b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555eb12db2d0 0x555eb12eae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:02:52.055 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.054+0000 7f5d51271b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x555eb11c6500 con 0x555eb12da3e0 2024-06-02T05:02:52.055 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.054+0000 7f5d51271b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x555eb11c61a0 con 0x555eb12d9a80 2024-06-02T05:02:52.055 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.054+0000 7f5d51271b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x555eb10ad640 con 0x555eb12db2d0 2024-06-02T05:02:52.055 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.054+0000 7f5d51271b80 10 client.0 _ll_register_callbacks cb 0x555eb11cfad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T05:02:52.059 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.054+0000 7f5d3ed9d700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555eb12d9a80 0x555eb12e38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:02:52.060 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.054+0000 7f5d3ed9d700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555eb12d9a80 0x555eb12e38f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:43864/0 (socket says 172.21.15.76:43864) 2024-06-02T05:02:52.060 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.054+0000 7f5d3ed9d700 1 -- 172.21.15.76:0/4119197393 learned_addr learned my addr 172.21.15.76:0/4119197393 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:02:52.060 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.055+0000 7f5d3ed9d700 1 -- 172.21.15.76:0/4119197393 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555eb12db2d0 msgr2=0x555eb12eae70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-02T05:02:52.060 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.055+0000 7f5d3ed9d700 1 --2- 172.21.15.76:0/4119197393 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555eb12db2d0 0x555eb12eae70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:52.060 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.055+0000 7f5d3ed9d700 1 -- 172.21.15.76:0/4119197393 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555eb12da3e0 msgr2=0x555eb12e3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:02:52.060 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.055+0000 7f5d3ed9d700 1 --2- 172.21.15.76:0/4119197393 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555eb12da3e0 0x555eb12e3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:52.060 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.055+0000 7f5d3ed9d700 1 -- 172.21.15.76:0/4119197393 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d38009a30 con 0x555eb12d9a80 2024-06-02T05:02:52.060 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.055+0000 7f5d3ed9d700 1 --2- 172.21.15.76:0/4119197393 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555eb12d9a80 0x555eb12e38f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5d3800bdc0 tx=0x7f5d3800bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=69920052ba6003e1 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:02:52.060 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.055+0000 7f5d22ff5700 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-06-02T05:02:52.060 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.055+0000 7f5d22ff5700 1 -- 172.21.15.76:0/4119197393 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d3800e040 con 0x555eb12d9a80 2024-06-02T05:02:52.060 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.055+0000 7f5d22ff5700 1 -- 172.21.15.76:0/4119197393 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f5d3801b830 con 0x555eb12d9a80 2024-06-02T05:02:52.061 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.059+0000 7f5d51271b80 1 -- 172.21.15.76:0/4119197393 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555eb12a97b0 con 0x555eb12d9a80 2024-06-02T05:02:52.061 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.061+0000 7f5d22ff5700 1 -- 172.21.15.76:0/4119197393 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5d3801b9f0 con 0x555eb12d9a80 2024-06-02T05:02:52.075 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.065+0000 7f5d51271b80 10 client.26162 fetch_fsmap learned FSMap version 36 2024-06-02T05:02:52.075 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.065+0000 7f5d51271b80 1 -- 172.21.15.76:0/4119197393 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x555eb1057b00 con 0x555eb12d9a80 2024-06-02T05:02:52.084 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.084+0000 7f5d22ff5700 1 -- 172.21.15.76:0/4119197393 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5d3802b030 con 0x555eb12d9a80 2024-06-02T05:02:52.084 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.084+0000 7f5d22ff5700 1 -- 172.21.15.76:0/4119197393 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f5d3801a380 con 0x555eb12d9a80 2024-06-02T05:02:52.093 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.087+0000 7f5d51271b80 10 client.26162 fetch_fsmap finished waiting for FSMap version 36 2024-06-02T05:02:52.093 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.087+0000 7f5d51271b80 10 client.26162 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T05:02:52.093 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.087+0000 7f5d51271b80 20 client.26162 populate_metadata read hostname 'smithi076' 2024-06-02T05:02:52.093 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.087+0000 7f5d51271b80 1 --2- 172.21.15.76:0/4119197393 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x555eb12ef690 0x555eb12f1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:02:52.094 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.087+0000 7f5d51271b80 4 client.26162 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T05:02:52.094 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.087+0000 7f5d51271b80 1 -- 172.21.15.76:0/4119197393 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555eb1222e60 con 0x555eb12ef690 2024-06-02T05:02:52.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:02:51 smithi119 ceph-mon[46633]: pgmap v666: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 14 MiB/s wr, 856 op/s 2024-06-02T05:02:52.101 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.098+0000 7f5d3e59c700 1 --2- 172.21.15.76:0/4119197393 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x555eb12ef690 0x555eb12f1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:02:52.101 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.099+0000 7f5d3e59c700 1 --2- 172.21.15.76:0/4119197393 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x555eb12ef690 0x555eb12f1ab0 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6872fc3a08504a26 server_cookie=8c4e06b57bff2c6d in_seq=0 out_seq=0 2024-06-02T05:02:52.101 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.099+0000 7f5d22ff5700 10 client.26162 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T05:02:52.101 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.100+0000 7f5d22ff5700 1 -- 172.21.15.76:0/4119197393 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x555eb1222e60 con 0x555eb12ef690 2024-06-02T05:02:52.101 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.100+0000 7f5d22ff5700 10 client.26162 handle_command_reply: tid=0 2024-06-02T05:02:52.101 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.100+0000 7f5d51271b80 1 client.26162 shutdown 2024-06-02T05:02:52.102 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.100+0000 7f5d51271b80 1 -- 172.21.15.76:0/4119197393 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555eb12d9a80 msgr2=0x555eb12e38f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:02:52.102 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.100+0000 7f5d51271b80 1 --2- 172.21.15.76:0/4119197393 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555eb12d9a80 0x555eb12e38f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5d3800bdc0 tx=0x7f5d3800bea0 comp rx=0 tx=0).stop 2024-06-02T05:02:52.108 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.108+0000 7f5d51271b80 1 -- 172.21.15.76:0/4119197393 shutdown_connections 2024-06-02T05:02:52.109 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.108+0000 7f5d51271b80 1 --2- 172.21.15.76:0/4119197393 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x555eb12ef690 0x555eb12f1ab0 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:52.109 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.108+0000 7f5d51271b80 1 --2- 172.21.15.76:0/4119197393 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555eb12db2d0 0x555eb12eae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:52.109 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.108+0000 7f5d51271b80 1 --2- 172.21.15.76:0/4119197393 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555eb12d9a80 0x555eb12e38f0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:52.109 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.108+0000 7f5d51271b80 1 --2- 172.21.15.76:0/4119197393 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555eb12da3e0 0x555eb12e3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:52.109 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.108+0000 7f5d51271b80 1 -- 172.21.15.76:0/4119197393 >> 172.21.15.76:0/4119197393 conn(0x555eb12381b0 msgr2=0x555eb12d4860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:02:52.120 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.115+0000 7f5d22ff5700 0 client.26162 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T05:02:52.120 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.119+0000 7f5d51271b80 1 -- 172.21.15.76:0/4119197393 shutdown_connections 2024-06-02T05:02:52.120 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.119+0000 7f5d51271b80 1 -- 172.21.15.76:0/4119197393 wait complete. 2024-06-02T05:02:52.121 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.121+0000 7f5d51271b80 20 client.26162 trim_cache size 0 max 16384 2024-06-02T05:02:52.171 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.168+0000 7f5d51271b80 1 Processor -- start 2024-06-02T05:02:52.171 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.169+0000 7f5d51271b80 1 -- start start 2024-06-02T05:02:52.172 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.169+0000 7f5d51271b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555eb12d9a80 0x555eb12e2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:02:52.172 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.169+0000 7f5d51271b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555eb12da3e0 0x555eb12e2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:02:52.172 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.169+0000 7f5d51271b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555eb12db2d0 0x555eb12ead90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:02:52.172 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.169+0000 7f5d51271b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x555eb12eb2d0 con 0x555eb12d9a80 2024-06-02T05:02:52.172 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.169+0000 7f5d51271b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x555eb12e4ae0 con 0x555eb12da3e0 2024-06-02T05:02:52.172 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.169+0000 7f5d51271b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x555eb12e1480 con 0x555eb12db2d0 2024-06-02T05:02:52.172 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.170+0000 7f5d3ed9d700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555eb12d9a80 0x555eb12e2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:02:52.172 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.170+0000 7f5d3ed9d700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555eb12d9a80 0x555eb12e2ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:48118/0 (socket says 172.21.15.76:48118) 2024-06-02T05:02:52.172 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.170+0000 7f5d3ed9d700 1 -- 172.21.15.76:0/2744190605 learned_addr learned my addr 172.21.15.76:0/2744190605 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:02:52.172 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.170+0000 7f5d3f59e700 1 --2- 172.21.15.76:0/2744190605 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555eb12db2d0 0x555eb12ead90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:02:52.176 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.171+0000 7f5d3ed9d700 1 -- 172.21.15.76:0/2744190605 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555eb12db2d0 msgr2=0x555eb12ead90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:02:52.177 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.171+0000 7f5d3ed9d700 1 --2- 172.21.15.76:0/2744190605 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555eb12db2d0 0x555eb12ead90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:52.177 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.171+0000 7f5d3ed9d700 1 -- 172.21.15.76:0/2744190605 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555eb12da3e0 msgr2=0x555eb12e2ff0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-02T05:02:52.177 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.171+0000 7f5d3ed9d700 1 --2- 172.21.15.76:0/2744190605 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555eb12da3e0 0x555eb12e2ff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:52.177 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.171+0000 7f5d3ed9d700 1 -- 172.21.15.76:0/2744190605 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555eb11f0500 con 0x555eb12d9a80 2024-06-02T05:02:52.177 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.171+0000 7f5d3ed9d700 1 --2- 172.21.15.76:0/2744190605 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555eb12d9a80 0x555eb12e2ab0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f5d38002230 tx=0x7f5d38012890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73743bc0da2ec776 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:02:52.177 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.172+0000 7f5d25ffb700 1 -- 172.21.15.76:0/2744190605 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d3800e040 con 0x555eb12d9a80 2024-06-02T05:02:52.177 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.172+0000 7f5d25ffb700 1 -- 172.21.15.76:0/2744190605 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5d3802b070 con 0x555eb12d9a80 2024-06-02T05:02:52.177 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.172+0000 7f5d25ffb700 1 -- 172.21.15.76:0/2744190605 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d3801be70 con 0x555eb12d9a80 2024-06-02T05:02:52.177 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.173+0000 7f5d51271b80 1 -- 172.21.15.76:0/2744190605 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555eb12d9a80 msgr2=0x555eb12e2ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:02:52.178 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.173+0000 7f5d51271b80 1 --2- 172.21.15.76:0/2744190605 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555eb12d9a80 0x555eb12e2ab0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f5d38002230 tx=0x7f5d38012890 comp rx=0 tx=0).stop 2024-06-02T05:02:52.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:02:51 smithi192 ceph-mon[47933]: pgmap v666: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 14 MiB/s wr, 856 op/s 2024-06-02T05:02:52.202 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.193+0000 7f5d51271b80 1 -- 172.21.15.76:0/2744190605 shutdown_connections 2024-06-02T05:02:52.202 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.193+0000 7f5d51271b80 1 --2- 172.21.15.76:0/2744190605 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555eb12db2d0 0x555eb12ead90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:52.202 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.193+0000 7f5d51271b80 1 --2- 172.21.15.76:0/2744190605 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555eb12d9a80 0x555eb12e2ab0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:52.202 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.193+0000 7f5d51271b80 1 --2- 172.21.15.76:0/2744190605 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555eb12da3e0 0x555eb12e2ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:52.203 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.193+0000 7f5d51271b80 1 -- 172.21.15.76:0/2744190605 >> 172.21.15.76:0/2744190605 conn(0x555eb12381b0 msgr2=0x555eb12f6430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:02:52.203 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.196+0000 7f5d51271b80 1 -- 172.21.15.76:0/2744190605 shutdown_connections 2024-06-02T05:02:52.206 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.202+0000 7f5d51271b80 1 -- 172.21.15.76:0/2744190605 wait complete. 2024-06-02T05:02:52.206 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.202+0000 7f5d51271b80 1 -- start start 2024-06-02T05:02:52.206 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.202+0000 7f5d51271b80 1 Processor -- start 2024-06-02T05:02:52.206 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.202+0000 7f5d51271b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555eb12d9a80 0x555eb12e8220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:02:52.206 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.202+0000 7f5d51271b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555eb12da3e0 0x555eb12e8760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:02:52.206 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.202+0000 7f5d51271b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555eb12db2d0 0x555eb12e96d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:02:52.206 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.202+0000 7f5d51271b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x555eb12e9c10 con 0x555eb12db2d0 2024-06-02T05:02:52.206 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.202+0000 7f5d51271b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x555eb12e9d80 con 0x555eb12da3e0 2024-06-02T05:02:52.206 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.202+0000 7f5d51271b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x555eb12e9f40 con 0x555eb12d9a80 2024-06-02T05:02:52.206 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.202+0000 7f5d51271b80 10 client.0 _ll_register_callbacks cb 0x555eb11cfad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T05:02:52.206 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.205+0000 7f5d3e59c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555eb12da3e0 0x555eb12e8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:02:52.207 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.205+0000 7f5d3e59c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555eb12da3e0 0x555eb12e8760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:43872/0 (socket says 172.21.15.76:43872) 2024-06-02T05:02:52.207 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.205+0000 7f5d3e59c700 1 -- 172.21.15.76:0/3746065145 learned_addr learned my addr 172.21.15.76:0/3746065145 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:02:52.207 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.205+0000 7f5d3e59c700 1 -- 172.21.15.76:0/3746065145 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555eb12d9a80 msgr2=0x555eb12e8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:02:52.207 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.205+0000 7f5d3e59c700 1 --2- 172.21.15.76:0/3746065145 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555eb12d9a80 0x555eb12e8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:52.207 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.205+0000 7f5d3e59c700 1 -- 172.21.15.76:0/3746065145 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555eb12db2d0 msgr2=0x555eb12e96d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:02:52.207 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.205+0000 7f5d3e59c700 1 --2- 172.21.15.76:0/3746065145 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555eb12db2d0 0x555eb12e96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:52.207 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.205+0000 7f5d3e59c700 1 -- 172.21.15.76:0/3746065145 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555eb1057b00 con 0x555eb12da3e0 2024-06-02T05:02:52.207 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.205+0000 7f5d3e59c700 1 --2- 172.21.15.76:0/3746065145 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555eb12da3e0 0x555eb12e8760 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5d34006010 tx=0x7f5d34001140 comp rx=0 tx=0).ready entity=mon.2 client_cookie=62ea53590064506f server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:02:52.208 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.207+0000 7f5d22ff5700 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-06-02T05:02:52.208 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.207+0000 7f5d22ff5700 1 -- 172.21.15.76:0/3746065145 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d34022640 con 0x555eb12da3e0 2024-06-02T05:02:52.208 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.207+0000 7f5d22ff5700 1 -- 172.21.15.76:0/3746065145 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f5d340227a0 con 0x555eb12da3e0 2024-06-02T05:02:52.214 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.214+0000 7f5d51271b80 1 -- 172.21.15.76:0/3746065145 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555eb1183210 con 0x555eb12da3e0 2024-06-02T05:02:52.216 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.216+0000 7f5d22ff5700 1 -- 172.21.15.76:0/3746065145 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5d34008e80 con 0x555eb12da3e0 2024-06-02T05:02:52.225 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.225+0000 7f5d51271b80 10 client.26165 fetch_fsmap learned FSMap version 36 2024-06-02T05:02:52.226 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.225+0000 7f5d51271b80 1 -- 172.21.15.76:0/3746065145 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x555eb10afc70 con 0x555eb12da3e0 2024-06-02T05:02:52.244 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.243+0000 7f5d22ff5700 1 -- 172.21.15.76:0/3746065145 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x555eb1183210 con 0x555eb12da3e0 2024-06-02T05:02:52.244 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.243+0000 7f5d22ff5700 1 -- 172.21.15.76:0/3746065145 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f5d3402a070 con 0x555eb12da3e0 2024-06-02T05:02:52.244 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.243+0000 7f5d51271b80 10 client.26165 fetch_fsmap finished waiting for FSMap version 36 2024-06-02T05:02:52.244 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.243+0000 7f5d51271b80 10 client.26165 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T05:02:52.244 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.243+0000 7f5d51271b80 20 client.26165 populate_metadata read hostname 'smithi076' 2024-06-02T05:02:52.244 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.243+0000 7f5d51271b80 1 --2- 172.21.15.76:0/3746065145 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x555eb1346200 0x555eb1348620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:02:52.244 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.243+0000 7f5d51271b80 4 client.26165 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T05:02:52.244 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.243+0000 7f5d51271b80 1 -- 172.21.15.76:0/3746065145 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x555eb1078c90 con 0x555eb1346200 2024-06-02T05:02:52.256 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.256+0000 7f5d3ed9d700 1 --2- 172.21.15.76:0/3746065145 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x555eb1346200 0x555eb1348620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:02:52.268 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.268+0000 7f5d3ed9d700 1 --2- 172.21.15.76:0/3746065145 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x555eb1346200 0x555eb1348620 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=15ab5b9f736b727c server_cookie=32ead8df64ddc6a2 in_seq=0 out_seq=0 2024-06-02T05:02:52.279 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.270+0000 7f5d22ff5700 10 client.26165 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T05:02:52.332 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.331+0000 7f5d22ff5700 1 -- 172.21.15.76:0/3746065145 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x555eb1078c90 con 0x555eb1346200 2024-06-02T05:02:52.332 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.331+0000 7f5d22ff5700 10 client.26165 handle_command_reply: tid=0 2024-06-02T05:02:52.332 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.331+0000 7f5d51271b80 1 client.26165 shutdown 2024-06-02T05:02:52.332 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.331+0000 7f5d51271b80 1 -- 172.21.15.76:0/3746065145 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555eb12da3e0 msgr2=0x555eb12e8760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:02:52.332 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.331+0000 7f5d51271b80 1 --2- 172.21.15.76:0/3746065145 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555eb12da3e0 0x555eb12e8760 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5d34006010 tx=0x7f5d34001140 comp rx=0 tx=0).stop 2024-06-02T05:02:52.332 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.331+0000 7f5d51271b80 1 -- 172.21.15.76:0/3746065145 shutdown_connections 2024-06-02T05:02:52.332 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.331+0000 7f5d51271b80 1 --2- 172.21.15.76:0/3746065145 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x555eb1346200 0x555eb1348620 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:52.332 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.331+0000 7f5d51271b80 1 --2- 172.21.15.76:0/3746065145 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555eb12db2d0 0x555eb12e96d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:52.333 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.331+0000 7f5d51271b80 1 --2- 172.21.15.76:0/3746065145 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555eb12d9a80 0x555eb12e8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:52.333 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.331+0000 7f5d51271b80 1 --2- 172.21.15.76:0/3746065145 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555eb12da3e0 0x555eb12e8760 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:52.333 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.331+0000 7f5d51271b80 1 -- 172.21.15.76:0/3746065145 >> 172.21.15.76:0/3746065145 conn(0x555eb12381b0 msgr2=0x555eb12e2ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:02:52.333 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.331+0000 7f5d22ff5700 0 client.26165 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T05:02:52.335 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.334+0000 7f5d51271b80 1 -- 172.21.15.76:0/3746065145 shutdown_connections 2024-06-02T05:02:52.335 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.335+0000 7f5d51271b80 1 -- 172.21.15.76:0/3746065145 wait complete. 2024-06-02T05:02:52.335 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.335+0000 7f5d51271b80 20 client.26165 trim_cache size 0 max 16384 2024-06-02T05:02:52.336 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:{ 2024-06-02T05:02:52.336 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "message": "", 2024-06-02T05:02:52.336 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "return_code": 0 2024-06-02T05:02:52.336 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:} 2024-06-02T05:02:52.336 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.336+0000 7f5d450b6700 1 -- 172.21.15.76:0/3386481370 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f5d280a12a0 msgr2=0x7f5d280a3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:02:52.337 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.336+0000 7f5d450b6700 1 --2- 172.21.15.76:0/3386481370 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f5d280a12a0 0x7f5d280a3760 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x555eb12daab0 tx=0x7f5d3400b040 comp rx=0 tx=0).stop 2024-06-02T05:02:52.337 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.336+0000 7f5d450b6700 1 -- 172.21.15.76:0/3386481370 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5d4010d5e0 msgr2=0x7f5d401b5ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:02:52.337 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.336+0000 7f5d450b6700 1 --2- 172.21.15.76:0/3386481370 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5d4010d5e0 0x7f5d401b5ee0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5d3000c3b0 tx=0x7f5d30003ee0 comp rx=0 tx=0).stop 2024-06-02T05:02:52.341 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.341+0000 7f5d450b6700 1 -- 172.21.15.76:0/3386481370 shutdown_connections 2024-06-02T05:02:52.341 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.341+0000 7f5d450b6700 1 --2- 172.21.15.76:0/3386481370 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5d4010d5e0 0x7f5d401b5ee0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:52.341 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.341+0000 7f5d450b6700 1 --2- 172.21.15.76:0/3386481370 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5d40108180 0x7f5d40118790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:52.341 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.341+0000 7f5d450b6700 1 --2- 172.21.15.76:0/3386481370 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f5d280a12a0 0x7f5d280a3760 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:52.342 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.341+0000 7f5d450b6700 1 --2- 172.21.15.76:0/3386481370 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5d4010ab40 0x7f5d40118cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:02:52.342 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.341+0000 7f5d450b6700 1 -- 172.21.15.76:0/3386481370 >> 172.21.15.76:0/3386481370 conn(0x7f5d4006e0f0 msgr2=0x7f5d40108a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:02:52.353 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.352+0000 7f5d450b6700 1 -- 172.21.15.76:0/3386481370 shutdown_connections 2024-06-02T05:02:52.354 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:02:52.353+0000 7f5d450b6700 1 -- 172.21.15.76:0/3386481370 wait complete. 2024-06-02T05:02:53.985 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:02:53 smithi076 ceph-mon[42935]: pgmap v667: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 16 MiB/s wr, 875 op/s 2024-06-02T05:02:54.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:02:53 smithi119 ceph-mon[46633]: pgmap v667: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 16 MiB/s wr, 875 op/s 2024-06-02T05:02:54.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:02:53 smithi192 ceph-mon[47933]: pgmap v667: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 16 MiB/s wr, 875 op/s 2024-06-02T05:02:55.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:02:55 smithi076 ceph-mon[42935]: pgmap v668: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 14 MiB/s wr, 778 op/s 2024-06-02T05:02:56.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:02:55 smithi119 ceph-mon[46633]: pgmap v668: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 14 MiB/s wr, 778 op/s 2024-06-02T05:02:56.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:02:55 smithi192 ceph-mon[47933]: pgmap v668: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 14 MiB/s wr, 778 op/s 2024-06-02T05:02:56.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 725.0 s, 510.6 tps, lat 217.681 ms stddev 408.091 2024-06-02T05:02:57.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:02:57 smithi076 ceph-mon[42935]: pgmap v669: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 16 MiB/s wr, 950 op/s 2024-06-02T05:02:58.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:02:57 smithi119 ceph-mon[46633]: pgmap v669: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 16 MiB/s wr, 950 op/s 2024-06-02T05:02:58.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:02:57 smithi192 ceph-mon[47933]: pgmap v669: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 16 MiB/s wr, 950 op/s 2024-06-02T05:03:00.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:02:59 smithi119 ceph-mon[46633]: pgmap v670: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 13 MiB/s wr, 788 op/s 2024-06-02T05:03:00.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:02:59 smithi192 ceph-mon[47933]: pgmap v670: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 13 MiB/s wr, 788 op/s 2024-06-02T05:03:00.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:02:59 smithi076 ceph-mon[42935]: pgmap v670: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 13 MiB/s wr, 788 op/s 2024-06-02T05:03:01.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 730.0 s, 608.9 tps, lat 163.973 ms stddev 80.389 2024-06-02T05:03:01.436 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:03:01 smithi192 ceph-mon[47933]: pgmap v671: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 14 MiB/s wr, 885 op/s 2024-06-02T05:03:01.484 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:03:01 smithi076 ceph-mon[42935]: pgmap v671: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 14 MiB/s wr, 885 op/s 2024-06-02T05:03:01.596 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:03:01 smithi119 ceph-mon[46633]: pgmap v671: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 14 MiB/s wr, 885 op/s 2024-06-02T05:03:03.990 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:03:03 smithi076 ceph-mon[42935]: pgmap v672: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 14 MiB/s wr, 863 op/s 2024-06-02T05:03:04.097 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:03:03 smithi119 ceph-mon[46633]: pgmap v672: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 14 MiB/s wr, 863 op/s 2024-06-02T05:03:04.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:03:03 smithi192 ceph-mon[47933]: pgmap v672: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 14 MiB/s wr, 863 op/s 2024-06-02T05:03:05.564 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.560+0000 7fcdab27a700 1 -- 172.21.15.76:0/186313553 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcda410a910 msgr2=0x7fcda410cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:03:05.564 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.560+0000 7fcdab27a700 1 --2- 172.21.15.76:0/186313553 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcda410a910 0x7fcda410cda0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fcda0009990 tx=0x7fcda0009ca0 comp rx=0 tx=0).stop 2024-06-02T05:03:05.567 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.566+0000 7fcdab27a700 1 -- 172.21.15.76:0/186313553 shutdown_connections 2024-06-02T05:03:05.567 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.566+0000 7fcdab27a700 1 --2- 172.21.15.76:0/186313553 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcda410d2e0 0x7fcda410d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:05.567 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.566+0000 7fcdab27a700 1 --2- 172.21.15.76:0/186313553 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcda4107fa0 0x7fcda410a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:05.567 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.566+0000 7fcdab27a700 1 --2- 172.21.15.76:0/186313553 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcda410a910 0x7fcda410cda0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:05.567 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.566+0000 7fcdab27a700 1 -- 172.21.15.76:0/186313553 >> 172.21.15.76:0/186313553 conn(0x7fcda406df30 msgr2=0x7fcda4070370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:03:05.568 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.568+0000 7fcdab27a700 1 -- 172.21.15.76:0/186313553 shutdown_connections 2024-06-02T05:03:05.569 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.568+0000 7fcdab27a700 1 -- 172.21.15.76:0/186313553 wait complete. 2024-06-02T05:03:05.569 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.568+0000 7fcdab27a700 1 Processor -- start 2024-06-02T05:03:05.569 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.568+0000 7fcdab27a700 1 -- start start 2024-06-02T05:03:05.569 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.569+0000 7fcdab27a700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcda4107fa0 0x7fcda4114680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:03:05.570 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.569+0000 7fcdab27a700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcda410a910 0x7fcda4114bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:03:05.570 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.569+0000 7fcdab27a700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcda410d2e0 0x7fcda41b5da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:03:05.570 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.569+0000 7fcdab27a700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcda4115190 con 0x7fcda410a910 2024-06-02T05:03:05.570 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.569+0000 7fcdab27a700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcda4115300 con 0x7fcda410d2e0 2024-06-02T05:03:05.570 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.569+0000 7fcdab27a700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcda41b62e0 con 0x7fcda4107fa0 2024-06-02T05:03:05.570 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.569+0000 7fcda8815700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcda410a910 0x7fcda4114bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:03:05.570 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.569+0000 7fcda8815700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcda410a910 0x7fcda4114bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:41712/0 (socket says 172.21.15.76:41712) 2024-06-02T05:03:05.571 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.569+0000 7fcda8815700 1 -- 172.21.15.76:0/2988198885 learned_addr learned my addr 172.21.15.76:0/2988198885 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:03:05.571 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.570+0000 7fcda8815700 1 -- 172.21.15.76:0/2988198885 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcda4107fa0 msgr2=0x7fcda4114680 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-06-02T05:03:05.571 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.570+0000 7fcda8815700 1 --2- 172.21.15.76:0/2988198885 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcda4107fa0 0x7fcda4114680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:05.571 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.570+0000 7fcda8815700 1 -- 172.21.15.76:0/2988198885 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcda410d2e0 msgr2=0x7fcda41b5da0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-06-02T05:03:05.571 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.570+0000 7fcda8815700 1 --2- 172.21.15.76:0/2988198885 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcda410d2e0 0x7fcda41b5da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:05.571 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.570+0000 7fcda8815700 1 -- 172.21.15.76:0/2988198885 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcda00095f0 con 0x7fcda410a910 2024-06-02T05:03:05.571 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.571+0000 7fcda8815700 1 --2- 172.21.15.76:0/2988198885 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcda410a910 0x7fcda4114bc0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fcda00098e0 tx=0x7fcda00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:03:05.572 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.572+0000 7fcd9a7fc700 1 -- 172.21.15.76:0/2988198885 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda001d070 con 0x7fcda410a910 2024-06-02T05:03:05.572 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.572+0000 7fcd9a7fc700 1 -- 172.21.15.76:0/2988198885 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcda00041a0 con 0x7fcda410a910 2024-06-02T05:03:05.572 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.572+0000 7fcd9a7fc700 1 -- 172.21.15.76:0/2988198885 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda0022e60 con 0x7fcda410a910 2024-06-02T05:03:05.575 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.574+0000 7fcdab27a700 1 -- 172.21.15.76:0/2988198885 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcda41b6560 con 0x7fcda410a910 2024-06-02T05:03:05.575 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.574+0000 7fcdab27a700 1 -- 172.21.15.76:0/2988198885 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcda41b6950 con 0x7fcda410a910 2024-06-02T05:03:05.579 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.578+0000 7fcdb7435b80 1 Processor -- start 2024-06-02T05:03:05.581 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.579+0000 7fcdb7435b80 1 -- start start 2024-06-02T05:03:05.581 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.579+0000 7fcdb7435b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5651457e3a80 0x5651457e3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:03:05.581 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.579+0000 7fcdb7435b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5651457e43e0 0x5651457e4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:03:05.582 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.579+0000 7fcdb7435b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5651457e52d0 0x5651457e5750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:03:05.582 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.579+0000 7fcdb7435b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x56514573b0f0 con 0x5651457e43e0 2024-06-02T05:03:05.582 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.579+0000 7fcdb7435b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x565145738ab0 con 0x5651457e52d0 2024-06-02T05:03:05.582 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.579+0000 7fcdb7435b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651457343a0 con 0x5651457e3a80 2024-06-02T05:03:05.582 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.579+0000 7fcda9817700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5651457e3a80 0x5651457e3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:03:05.582 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.580+0000 7fcda9817700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5651457e3a80 0x5651457e3ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:58014/0 (socket says 172.21.15.76:58014) 2024-06-02T05:03:05.582 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.580+0000 7fcda9817700 1 -- 172.21.15.76:0/2289607480 learned_addr learned my addr 172.21.15.76:0/2289607480 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:03:05.582 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.580+0000 7fcda9016700 1 --2- 172.21.15.76:0/2289607480 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5651457e43e0 0x5651457e4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:03:05.582 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.580+0000 7fcda8815700 1 --2- 172.21.15.76:0/2289607480 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5651457e52d0 0x5651457e5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:03:05.582 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.580+0000 7fcda9016700 1 -- 172.21.15.76:0/2289607480 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5651457e3a80 msgr2=0x5651457e3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:03:05.582 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.580+0000 7fcda9016700 1 --2- 172.21.15.76:0/2289607480 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5651457e3a80 0x5651457e3ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:05.582 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.580+0000 7fcda9016700 1 -- 172.21.15.76:0/2289607480 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5651457e52d0 msgr2=0x5651457e5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:03:05.583 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.580+0000 7fcda9016700 1 --2- 172.21.15.76:0/2289607480 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5651457e52d0 0x5651457e5750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:05.583 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.580+0000 7fcda9016700 1 -- 172.21.15.76:0/2289607480 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5651455b5350 con 0x5651457e43e0 2024-06-02T05:03:05.583 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.580+0000 7fcda9016700 1 --2- 172.21.15.76:0/2289607480 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5651457e43e0 0x5651457e4cf0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fcd94009740 tx=0x7fcd94009a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5756682e7672021 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:03:05.584 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.583+0000 7fcd8f7fe700 1 -- 172.21.15.76:0/2289607480 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd94011830 con 0x5651457e43e0 2024-06-02T05:03:05.584 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.583+0000 7fcd8f7fe700 1 -- 172.21.15.76:0/2289607480 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcd94011e20 con 0x5651457e43e0 2024-06-02T05:03:05.584 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.583+0000 7fcd8f7fe700 1 -- 172.21.15.76:0/2289607480 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd94010e10 con 0x5651457e43e0 2024-06-02T05:03:05.586 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.585+0000 7fcdb7435b80 1 -- 172.21.15.76:0/2289607480 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5651457e43e0 msgr2=0x5651457e4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:03:05.586 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.585+0000 7fcdb7435b80 1 --2- 172.21.15.76:0/2289607480 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5651457e43e0 0x5651457e4cf0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fcd94009740 tx=0x7fcd94009a50 comp rx=0 tx=0).stop 2024-06-02T05:03:05.590 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.588+0000 7fcdb7435b80 1 -- 172.21.15.76:0/2289607480 shutdown_connections 2024-06-02T05:03:05.590 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.588+0000 7fcdb7435b80 1 --2- 172.21.15.76:0/2289607480 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5651457e52d0 0x5651457e5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:05.590 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.588+0000 7fcdb7435b80 1 --2- 172.21.15.76:0/2289607480 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5651457e3a80 0x5651457e3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:05.590 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.588+0000 7fcdb7435b80 1 --2- 172.21.15.76:0/2289607480 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5651457e43e0 0x5651457e4cf0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:05.590 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.588+0000 7fcdb7435b80 1 -- 172.21.15.76:0/2289607480 >> 172.21.15.76:0/2289607480 conn(0x5651457421b0 msgr2=0x5651457e0440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:03:05.591 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.591+0000 7fcd9a7fc700 1 -- 172.21.15.76:0/2988198885 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fcda0022470 con 0x7fcda410a910 2024-06-02T05:03:05.592 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.591+0000 7fcd9a7fc700 1 --2- 172.21.15.76:0/2988198885 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fcd900a1200 0x7fcd900a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:03:05.592 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.592+0000 7fcd9a7fc700 1 -- 172.21.15.76:0/2988198885 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7fcda00d1210 con 0x7fcda410a910 2024-06-02T05:03:05.594 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.592+0000 7fcdb7435b80 1 -- 172.21.15.76:0/2289607480 shutdown_connections 2024-06-02T05:03:05.595 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.592+0000 7fcdb7435b80 1 -- 172.21.15.76:0/2289607480 wait complete. 2024-06-02T05:03:05.595 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.592+0000 7fcdb7435b80 1 -- start start 2024-06-02T05:03:05.595 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.592+0000 7fcdb7435b80 1 Processor -- start 2024-06-02T05:03:05.595 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.593+0000 7fcdb7435b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5651457e3a80 0x5651457ed910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:03:05.595 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.593+0000 7fcdb7435b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5651457e43e0 0x5651457ede50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:03:05.595 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.593+0000 7fcdb7435b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5651457e52d0 0x5651457f4e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:03:05.596 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.593+0000 7fcdb7435b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651456d0500 con 0x5651457e52d0 2024-06-02T05:03:05.596 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.593+0000 7fcdb7435b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651456d01a0 con 0x5651457e3a80 2024-06-02T05:03:05.596 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.593+0000 7fcdb7435b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651455b7640 con 0x5651457e43e0 2024-06-02T05:03:05.596 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.593+0000 7fcdb7435b80 10 client.0 _ll_register_callbacks cb 0x5651456d9ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T05:03:05.597 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.595+0000 7fcda9817700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5651457e52d0 0x5651457f4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:03:05.597 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.595+0000 7fcda9817700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5651457e52d0 0x5651457f4e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:41738/0 (socket says 172.21.15.76:41738) 2024-06-02T05:03:05.597 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.595+0000 7fcda9817700 1 -- 172.21.15.76:0/2344893592 learned_addr learned my addr 172.21.15.76:0/2344893592 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:03:05.597 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.596+0000 7fcda9817700 1 -- 172.21.15.76:0/2344893592 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5651457e43e0 msgr2=0x5651457ede50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-02T05:03:05.597 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.596+0000 7fcda9817700 1 --2- 172.21.15.76:0/2344893592 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5651457e43e0 0x5651457ede50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:05.597 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.596+0000 7fcda9817700 1 -- 172.21.15.76:0/2344893592 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5651457e3a80 msgr2=0x5651457ed910 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-02T05:03:05.597 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.596+0000 7fcda9817700 1 --2- 172.21.15.76:0/2344893592 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5651457e3a80 0x5651457ed910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:05.597 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.596+0000 7fcda9817700 1 -- 172.21.15.76:0/2344893592 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd94009370 con 0x5651457e52d0 2024-06-02T05:03:05.598 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.596+0000 7fcda9817700 1 --2- 172.21.15.76:0/2344893592 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5651457e52d0 0x5651457f4e90 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c0077e0 tx=0x7fcd9c007ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3405c93bffd43d7 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:03:05.598 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.596+0000 7fcd8cff9700 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-06-02T05:03:05.598 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.597+0000 7fcd8cff9700 1 -- 172.21.15.76:0/2344893592 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd9c013790 con 0x5651457e52d0 2024-06-02T05:03:05.599 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.597+0000 7fcd8cff9700 1 -- 172.21.15.76:0/2344893592 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7fcd9c0138f0 con 0x5651457e52d0 2024-06-02T05:03:05.599 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.597+0000 7fcdb7435b80 1 -- 172.21.15.76:0/2344893592 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56514568d210 con 0x5651457e52d0 2024-06-02T05:03:05.599 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.597+0000 7fcd8cff9700 1 -- 172.21.15.76:0/2344893592 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcd9c013ad0 con 0x5651457e52d0 2024-06-02T05:03:05.599 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.597+0000 7fcdb7435b80 10 client.16533 fetch_fsmap learned FSMap version 36 2024-06-02T05:03:05.599 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.597+0000 7fcdb7435b80 1 -- 172.21.15.76:0/2344893592 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x565145561b00 con 0x5651457e52d0 2024-06-02T05:03:05.599 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.597+0000 7fcd8cff9700 1 -- 172.21.15.76:0/2344893592 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56514568d210 con 0x5651457e52d0 2024-06-02T05:03:05.600 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.598+0000 7fcd8cff9700 1 -- 172.21.15.76:0/2344893592 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fcd9c01d3b0 con 0x5651457e52d0 2024-06-02T05:03:05.600 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.598+0000 7fcdb7435b80 10 client.16533 fetch_fsmap finished waiting for FSMap version 36 2024-06-02T05:03:05.601 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.598+0000 7fcdb7435b80 10 client.16533 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T05:03:05.601 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.598+0000 7fcdb7435b80 20 client.16533 populate_metadata read hostname 'smithi076' 2024-06-02T05:03:05.601 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.598+0000 7fcdb7435b80 1 --2- 172.21.15.76:0/2344893592 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5651457f97d0 0x5651457fbc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:03:05.601 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.598+0000 7fcdb7435b80 4 client.16533 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T05:03:05.601 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.598+0000 7fcdb7435b80 1 -- 172.21.15.76:0/2344893592 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5651457b37b0 con 0x5651457f97d0 2024-06-02T05:03:05.601 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.599+0000 7fcda9016700 1 --2- 172.21.15.76:0/2988198885 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fcd900a1200 0x7fcd900a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:03:05.601 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.600+0000 7fcda9016700 1 --2- 172.21.15.76:0/2344893592 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5651457f97d0 0x5651457fbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:03:05.603 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.602+0000 7fcda9016700 1 --2- 172.21.15.76:0/2344893592 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5651457f97d0 0x5651457fbc30 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5891402c6dd4b3cf server_cookie=fc63a7977394cd51 in_seq=0 out_seq=0 2024-06-02T05:03:05.603 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.602+0000 7fcd8cff9700 10 client.16533 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T05:03:05.603 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.602+0000 7fcda9016700 1 --2- 172.21.15.76:0/2988198885 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fcd900a1200 0x7fcd900a36c0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x5651457fc520 tx=0x7fcd94006c80 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:03:05.603 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.602+0000 7fcd8cff9700 1 -- 172.21.15.76:0/2344893592 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5651457b37b0 con 0x5651457f97d0 2024-06-02T05:03:05.604 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.602+0000 7fcd8cff9700 10 client.16533 handle_command_reply: tid=0 2024-06-02T05:03:05.604 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.602+0000 7fcdb7435b80 1 client.16533 shutdown 2024-06-02T05:03:05.608 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.603+0000 7fcdb7435b80 1 -- 172.21.15.76:0/2344893592 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5651457e52d0 msgr2=0x5651457f4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:03:05.608 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.603+0000 7fcdb7435b80 1 --2- 172.21.15.76:0/2344893592 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5651457e52d0 0x5651457f4e90 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c0077e0 tx=0x7fcd9c007ba0 comp rx=0 tx=0).stop 2024-06-02T05:03:05.608 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.606+0000 7fcdb7435b80 1 -- 172.21.15.76:0/2344893592 shutdown_connections 2024-06-02T05:03:05.608 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.607+0000 7fcdb7435b80 1 --2- 172.21.15.76:0/2344893592 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5651457f97d0 0x5651457fbc30 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:05.608 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.607+0000 7fcdb7435b80 1 --2- 172.21.15.76:0/2344893592 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5651457e52d0 0x5651457f4e90 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:05.608 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.607+0000 7fcdb7435b80 1 --2- 172.21.15.76:0/2344893592 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5651457e3a80 0x5651457ed910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:05.608 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.607+0000 7fcdb7435b80 1 --2- 172.21.15.76:0/2344893592 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5651457e43e0 0x5651457ede50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:05.609 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.607+0000 7fcdb7435b80 1 -- 172.21.15.76:0/2344893592 >> 172.21.15.76:0/2344893592 conn(0x5651457421b0 msgr2=0x5651457de860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:03:05.609 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.607+0000 7fcd8cff9700 0 client.16533 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T05:03:05.611 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.610+0000 7fcdb7435b80 1 -- 172.21.15.76:0/2344893592 shutdown_connections 2024-06-02T05:03:05.611 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.610+0000 7fcdb7435b80 1 -- 172.21.15.76:0/2344893592 wait complete. 2024-06-02T05:03:05.612 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.612+0000 7fcdb7435b80 20 client.16533 trim_cache size 0 max 16384 2024-06-02T05:03:05.639 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.637+0000 7fcdb7435b80 1 Processor -- start 2024-06-02T05:03:05.639 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.638+0000 7fcdb7435b80 1 -- start start 2024-06-02T05:03:05.639 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.638+0000 7fcdb7435b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5651457e3a80 0x5651457f5540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:03:05.639 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.638+0000 7fcdb7435b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5651457e43e0 0x5651457f4e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:03:05.639 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.638+0000 7fcdb7435b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5651457e52d0 0x5651457e56b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:03:05.639 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.638+0000 7fcdb7435b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651457f6c20 con 0x5651457e43e0 2024-06-02T05:03:05.639 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.638+0000 7fcdb7435b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651457f6010 con 0x5651457e3a80 2024-06-02T05:03:05.639 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.638+0000 7fcdb7435b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651457eeb00 con 0x5651457e52d0 2024-06-02T05:03:05.640 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.638+0000 7fcda9016700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5651457e3a80 0x5651457f5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:03:05.640 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.638+0000 7fcda9016700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5651457e3a80 0x5651457f5540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:43692/0 (socket says 172.21.15.76:43692) 2024-06-02T05:03:05.640 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.638+0000 7fcda9016700 1 -- 172.21.15.76:0/3259352499 learned_addr learned my addr 172.21.15.76:0/3259352499 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:03:05.641 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.638+0000 7fcda9016700 1 -- 172.21.15.76:0/3259352499 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5651457e52d0 msgr2=0x5651457e56b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-02T05:03:05.641 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.638+0000 7fcda9016700 1 --2- 172.21.15.76:0/3259352499 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5651457e52d0 0x5651457e56b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:05.641 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.638+0000 7fcda9016700 1 -- 172.21.15.76:0/3259352499 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5651457e43e0 msgr2=0x5651457f4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:03:05.641 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.638+0000 7fcda9016700 1 --2- 172.21.15.76:0/3259352499 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5651457e43e0 0x5651457f4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:05.641 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.638+0000 7fcda9016700 1 -- 172.21.15.76:0/3259352499 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5651456fa500 con 0x5651457e3a80 2024-06-02T05:03:05.641 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.639+0000 7fcda9016700 1 --2- 172.21.15.76:0/3259352499 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5651457e3a80 0x5651457f5540 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fcd94010820 tx=0x7fcd94027000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8c9d418a9e012d50 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:03:05.641 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.639+0000 7fcd8ffff700 1 -- 172.21.15.76:0/3259352499 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd9402d070 con 0x5651457e3a80 2024-06-02T05:03:05.642 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.639+0000 7fcd8ffff700 1 -- 172.21.15.76:0/3259352499 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcd94010380 con 0x5651457e3a80 2024-06-02T05:03:05.642 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.639+0000 7fcd8ffff700 1 -- 172.21.15.76:0/3259352499 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd94023070 con 0x5651457e3a80 2024-06-02T05:03:05.642 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.640+0000 7fcdb7435b80 1 -- 172.21.15.76:0/3259352499 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5651457e3a80 msgr2=0x5651457f5540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:03:05.642 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.640+0000 7fcdb7435b80 1 --2- 172.21.15.76:0/3259352499 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5651457e3a80 0x5651457f5540 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fcd94010820 tx=0x7fcd94027000 comp rx=0 tx=0).stop 2024-06-02T05:03:05.642 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.640+0000 7fcdb7435b80 1 -- 172.21.15.76:0/3259352499 shutdown_connections 2024-06-02T05:03:05.642 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.640+0000 7fcdb7435b80 1 --2- 172.21.15.76:0/3259352499 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5651457e52d0 0x5651457e56b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:05.642 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.640+0000 7fcdb7435b80 1 --2- 172.21.15.76:0/3259352499 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5651457e3a80 0x5651457f5540 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:05.642 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.640+0000 7fcdb7435b80 1 --2- 172.21.15.76:0/3259352499 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5651457e43e0 0x5651457f4e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:05.642 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.640+0000 7fcdb7435b80 1 -- 172.21.15.76:0/3259352499 >> 172.21.15.76:0/3259352499 conn(0x5651457421b0 msgr2=0x5651457ece90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:03:05.643 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.643+0000 7fcdb7435b80 1 -- 172.21.15.76:0/3259352499 shutdown_connections 2024-06-02T05:03:05.644 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.643+0000 7fcdb7435b80 1 -- 172.21.15.76:0/3259352499 wait complete. 2024-06-02T05:03:05.644 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.643+0000 7fcdb7435b80 1 -- start start 2024-06-02T05:03:05.645 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.644+0000 7fcdb7435b80 1 Processor -- start 2024-06-02T05:03:05.645 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.644+0000 7fcdb7435b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5651457e3a80 0x5651457f20d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:03:05.646 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.644+0000 7fcdb7435b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5651457e43e0 0x5651457f2610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:03:05.646 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.644+0000 7fcdb7435b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5651457e52d0 0x5651457f3540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:03:05.646 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.644+0000 7fcdb7435b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651457f3a80 con 0x5651457e52d0 2024-06-02T05:03:05.647 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.644+0000 7fcdb7435b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651457f3bf0 con 0x5651457e3a80 2024-06-02T05:03:05.647 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.644+0000 7fcdb7435b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651457f3db0 con 0x5651457e43e0 2024-06-02T05:03:05.647 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.644+0000 7fcdb7435b80 10 client.0 _ll_register_callbacks cb 0x5651456d9ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T05:03:05.647 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.644+0000 7fcda9817700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5651457e52d0 0x5651457f3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:03:05.647 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.644+0000 7fcda9817700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5651457e52d0 0x5651457f3540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:41746/0 (socket says 172.21.15.76:41746) 2024-06-02T05:03:05.647 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.644+0000 7fcda9817700 1 -- 172.21.15.76:0/4004722996 learned_addr learned my addr 172.21.15.76:0/4004722996 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:03:05.647 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.644+0000 7fcda9016700 1 --2- 172.21.15.76:0/4004722996 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5651457e3a80 0x5651457f20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:03:05.648 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.645+0000 7fcda9016700 1 -- 172.21.15.76:0/4004722996 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5651457e43e0 msgr2=0x5651457f2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:03:05.648 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.645+0000 7fcda9016700 1 --2- 172.21.15.76:0/4004722996 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5651457e43e0 0x5651457f2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:05.648 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.645+0000 7fcda9016700 1 -- 172.21.15.76:0/4004722996 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5651457e52d0 msgr2=0x5651457f3540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:03:05.648 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.645+0000 7fcda9016700 1 --2- 172.21.15.76:0/4004722996 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5651457e52d0 0x5651457f3540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:05.648 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.645+0000 7fcda9016700 1 -- 172.21.15.76:0/4004722996 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5651455b5350 con 0x5651457e3a80 2024-06-02T05:03:05.648 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.645+0000 7fcda9817700 1 --2- 172.21.15.76:0/4004722996 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5651457e52d0 0x5651457f3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T05:03:05.648 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.645+0000 7fcda9016700 1 --2- 172.21.15.76:0/4004722996 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5651457e3a80 0x5651457f20d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x5651457dfcf0 tx=0x7fcd94010580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4cc10f82faed7fa server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:03:05.648 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.645+0000 7fcd8cff9700 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-06-02T05:03:05.648 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.645+0000 7fcd8cff9700 1 -- 172.21.15.76:0/4004722996 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd94023040 con 0x5651457e3a80 2024-06-02T05:03:05.648 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.645+0000 7fcd8cff9700 1 -- 172.21.15.76:0/4004722996 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7fcd9402d1a0 con 0x5651457e3a80 2024-06-02T05:03:05.648 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.645+0000 7fcdb7435b80 1 -- 172.21.15.76:0/4004722996 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcd94011e20 con 0x5651457e3a80 2024-06-02T05:03:05.648 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.645+0000 7fcd8cff9700 1 -- 172.21.15.76:0/4004722996 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcd9402d040 con 0x5651457e3a80 2024-06-02T05:03:05.648 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.645+0000 7fcdb7435b80 10 client.26171 fetch_fsmap learned FSMap version 36 2024-06-02T05:03:05.649 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.645+0000 7fcdb7435b80 1 -- 172.21.15.76:0/4004722996 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x5651455b9c70 con 0x5651457e3a80 2024-06-02T05:03:05.649 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.646+0000 7fcd8cff9700 1 -- 172.21.15.76:0/4004722996 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcd9403e020 con 0x5651457e3a80 2024-06-02T05:03:05.650 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.646+0000 7fcd8cff9700 1 -- 172.21.15.76:0/4004722996 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fcd9401ccf0 con 0x5651457e3a80 2024-06-02T05:03:05.650 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.646+0000 7fcdb7435b80 10 client.26171 fetch_fsmap finished waiting for FSMap version 36 2024-06-02T05:03:05.650 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.646+0000 7fcdb7435b80 10 client.26171 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T05:03:05.650 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.646+0000 7fcdb7435b80 20 client.26171 populate_metadata read hostname 'smithi076' 2024-06-02T05:03:05.650 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.646+0000 7fcdb7435b80 1 --2- 172.21.15.76:0/4004722996 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x56514584fe00 0x5651458521f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:03:05.650 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.646+0000 7fcdb7435b80 4 client.26171 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T05:03:05.651 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.646+0000 7fcdb7435b80 1 -- 172.21.15.76:0/4004722996 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x56514572ce60 con 0x56514584fe00 2024-06-02T05:03:05.651 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.646+0000 7fcda8815700 1 --2- 172.21.15.76:0/4004722996 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x56514584fe00 0x5651458521f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:03:05.651 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.647+0000 7fcd8cff9700 10 client.26171 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T05:03:05.651 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.647+0000 7fcda8815700 1 --2- 172.21.15.76:0/4004722996 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x56514584fe00 0x5651458521f0 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=af6de9f8f482ce1d server_cookie=b6f051bddb4ea3c3 in_seq=0 out_seq=0 2024-06-02T05:03:05.668 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.667+0000 7fcd8cff9700 1 -- 172.21.15.76:0/4004722996 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x56514572ce60 con 0x56514584fe00 2024-06-02T05:03:05.668 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.667+0000 7fcd8cff9700 10 client.26171 handle_command_reply: tid=0 2024-06-02T05:03:05.668 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.667+0000 7fcdb7435b80 1 client.26171 shutdown 2024-06-02T05:03:05.669 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.668+0000 7fcdb7435b80 1 -- 172.21.15.76:0/4004722996 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5651457e3a80 msgr2=0x5651457f20d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:03:05.669 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.668+0000 7fcdb7435b80 1 --2- 172.21.15.76:0/4004722996 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5651457e3a80 0x5651457f20d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x5651457dfcf0 tx=0x7fcd94010580 comp rx=0 tx=0).stop 2024-06-02T05:03:05.674 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.673+0000 7fcdb7435b80 1 -- 172.21.15.76:0/4004722996 shutdown_connections 2024-06-02T05:03:05.674 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.673+0000 7fcdb7435b80 1 --2- 172.21.15.76:0/4004722996 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x56514584fe00 0x5651458521f0 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:05.674 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.673+0000 7fcdb7435b80 1 --2- 172.21.15.76:0/4004722996 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5651457e52d0 0x5651457f3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:05.674 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.673+0000 7fcdb7435b80 1 --2- 172.21.15.76:0/4004722996 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5651457e3a80 0x5651457f20d0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:05.674 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.673+0000 7fcdb7435b80 1 --2- 172.21.15.76:0/4004722996 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5651457e43e0 0x5651457f2610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:05.674 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.673+0000 7fcdb7435b80 1 -- 172.21.15.76:0/4004722996 >> 172.21.15.76:0/4004722996 conn(0x5651457421b0 msgr2=0x5651457eb7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:03:05.674 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.673+0000 7fcd8cff9700 0 client.26171 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T05:03:05.674 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.673+0000 7fcdb7435b80 1 -- 172.21.15.76:0/4004722996 shutdown_connections 2024-06-02T05:03:05.674 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.673+0000 7fcdb7435b80 1 -- 172.21.15.76:0/4004722996 wait complete. 2024-06-02T05:03:05.675 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.673+0000 7fcdb7435b80 20 client.26171 trim_cache size 0 max 16384 2024-06-02T05:03:05.675 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:{ 2024-06-02T05:03:05.675 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "message": "", 2024-06-02T05:03:05.675 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "return_code": 0 2024-06-02T05:03:05.675 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:} 2024-06-02T05:03:05.676 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.675+0000 7fcdab27a700 1 -- 172.21.15.76:0/2988198885 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fcd900a1200 msgr2=0x7fcd900a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:03:05.676 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.675+0000 7fcdab27a700 1 --2- 172.21.15.76:0/2988198885 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fcd900a1200 0x7fcd900a36c0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x5651457fc520 tx=0x7fcd94006c80 comp rx=0 tx=0).stop 2024-06-02T05:03:05.676 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.675+0000 7fcdab27a700 1 -- 172.21.15.76:0/2988198885 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcda410a910 msgr2=0x7fcda4114bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:03:05.676 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.675+0000 7fcdab27a700 1 --2- 172.21.15.76:0/2988198885 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcda410a910 0x7fcda4114bc0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fcda00098e0 tx=0x7fcda00057f0 comp rx=0 tx=0).stop 2024-06-02T05:03:05.676 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.675+0000 7fcdab27a700 1 -- 172.21.15.76:0/2988198885 shutdown_connections 2024-06-02T05:03:05.676 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.675+0000 7fcdab27a700 1 --2- 172.21.15.76:0/2988198885 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fcd900a1200 0x7fcd900a36c0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:05.676 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.675+0000 7fcdab27a700 1 --2- 172.21.15.76:0/2988198885 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcda410d2e0 0x7fcda41b5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:05.676 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.675+0000 7fcdab27a700 1 --2- 172.21.15.76:0/2988198885 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcda4107fa0 0x7fcda4114680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:05.677 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.675+0000 7fcdab27a700 1 --2- 172.21.15.76:0/2988198885 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcda410a910 0x7fcda4114bc0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:05.677 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.675+0000 7fcdab27a700 1 -- 172.21.15.76:0/2988198885 >> 172.21.15.76:0/2988198885 conn(0x7fcda406df30 msgr2=0x7fcda41083c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:03:05.677 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.675+0000 7fcdab27a700 1 -- 172.21.15.76:0/2988198885 shutdown_connections 2024-06-02T05:03:05.677 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:05.676+0000 7fcdab27a700 1 -- 172.21.15.76:0/2988198885 wait complete. 2024-06-02T05:03:05.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:03:05 smithi076 ceph-mon[42935]: pgmap v673: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 12 MiB/s wr, 756 op/s 2024-06-02T05:03:06.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:03:05 smithi119 ceph-mon[46633]: pgmap v673: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 12 MiB/s wr, 756 op/s 2024-06-02T05:03:06.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:03:05 smithi192 ceph-mon[47933]: pgmap v673: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 12 MiB/s wr, 756 op/s 2024-06-02T05:03:06.316 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 735.0 s, 549.0 tps, lat 181.890 ms stddev 72.861 2024-06-02T05:03:07.986 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:03:07 smithi076 ceph-mon[42935]: pgmap v674: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 14 MiB/s wr, 901 op/s 2024-06-02T05:03:08.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:03:07 smithi119 ceph-mon[46633]: pgmap v674: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 14 MiB/s wr, 901 op/s 2024-06-02T05:03:08.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:03:07 smithi192 ceph-mon[47933]: pgmap v674: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 14 MiB/s wr, 901 op/s 2024-06-02T05:03:09.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:03:09 smithi076 ceph-mon[42935]: pgmap v675: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 12 MiB/s wr, 732 op/s 2024-06-02T05:03:10.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:03:09 smithi119 ceph-mon[46633]: pgmap v675: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 12 MiB/s wr, 732 op/s 2024-06-02T05:03:10.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:03:09 smithi192 ceph-mon[47933]: pgmap v675: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 12 MiB/s wr, 732 op/s 2024-06-02T05:03:11.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 740.0 s, 525.3 tps, lat 187.863 ms stddev 65.579 2024-06-02T05:03:11.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:03:11 smithi076 ceph-mon[42935]: pgmap v676: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 13 MiB/s wr, 825 op/s 2024-06-02T05:03:12.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:03:11 smithi119 ceph-mon[46633]: pgmap v676: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 13 MiB/s wr, 825 op/s 2024-06-02T05:03:12.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:03:11 smithi192 ceph-mon[47933]: pgmap v676: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 13 MiB/s wr, 825 op/s 2024-06-02T05:03:14.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:03:13 smithi119 ceph-mon[46633]: pgmap v677: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 13 MiB/s wr, 803 op/s 2024-06-02T05:03:14.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:03:13 smithi192 ceph-mon[47933]: pgmap v677: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 13 MiB/s wr, 803 op/s 2024-06-02T05:03:14.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:03:13 smithi076 ceph-mon[42935]: pgmap v677: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 13 MiB/s wr, 803 op/s 2024-06-02T05:03:16.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:03:15 smithi119 ceph-mon[46633]: pgmap v678: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 11 MiB/s wr, 705 op/s 2024-06-02T05:03:16.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:03:15 smithi192 ceph-mon[47933]: pgmap v678: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 11 MiB/s wr, 705 op/s 2024-06-02T05:03:16.237 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:03:15 smithi076 ceph-mon[42935]: pgmap v678: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 11 MiB/s wr, 705 op/s 2024-06-02T05:03:16.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 745.0 s, 619.4 tps, lat 162.187 ms stddev 103.209 2024-06-02T05:03:18.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:03:17 smithi119 ceph-mon[46633]: pgmap v679: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 11 MiB/s wr, 844 op/s 2024-06-02T05:03:18.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:03:17 smithi192 ceph-mon[47933]: pgmap v679: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 11 MiB/s wr, 844 op/s 2024-06-02T05:03:18.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:03:17 smithi076 ceph-mon[42935]: pgmap v679: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 11 MiB/s wr, 844 op/s 2024-06-02T05:03:18.863 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.861+0000 7f2604a32700 1 -- 172.21.15.76:0/2255571229 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2600104ab0 msgr2=0x7f2600104f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:03:18.863 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.861+0000 7f2604a32700 1 --2- 172.21.15.76:0/2255571229 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2600104ab0 0x7f2600104f30 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f25f800b0a0 tx=0x7f25f800b3b0 comp rx=0 tx=0).stop 2024-06-02T05:03:18.872 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.868+0000 7f2604a32700 1 -- 172.21.15.76:0/2255571229 shutdown_connections 2024-06-02T05:03:18.873 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.868+0000 7f2604a32700 1 --2- 172.21.15.76:0/2255571229 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2600104ab0 0x7f2600104f30 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:18.873 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.868+0000 7f2604a32700 1 --2- 172.21.15.76:0/2255571229 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f26000ff770 0x7f2600101ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:18.873 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.868+0000 7f2604a32700 1 --2- 172.21.15.76:0/2255571229 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f26001020e0 0x7f2600104570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:18.873 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.868+0000 7f2604a32700 1 -- 172.21.15.76:0/2255571229 >> 172.21.15.76:0/2255571229 conn(0x7f26000fb390 msgr2=0x7f26000fd7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:03:18.876 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.875+0000 7f2604a32700 1 -- 172.21.15.76:0/2255571229 shutdown_connections 2024-06-02T05:03:18.882 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.880+0000 7f2604a32700 1 -- 172.21.15.76:0/2255571229 wait complete. 2024-06-02T05:03:18.882 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.881+0000 7f2604a32700 1 Processor -- start 2024-06-02T05:03:18.882 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.881+0000 7f2604a32700 1 -- start start 2024-06-02T05:03:18.882 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.881+0000 7f2604a32700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f26000ff770 0x7f260006fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:03:18.882 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.881+0000 7f2604a32700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f26001020e0 0x7f260006ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:03:18.883 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.881+0000 7f2604a32700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2600104ab0 0x7f26001ad430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:03:18.883 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.881+0000 7f2604a32700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26000705a0 con 0x7f2600104ab0 2024-06-02T05:03:18.883 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.881+0000 7f2604a32700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26001ad970 con 0x7f26000ff770 2024-06-02T05:03:18.883 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.881+0000 7f2604a32700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26001adab0 con 0x7f26001020e0 2024-06-02T05:03:18.884 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.882+0000 7f25fed9d700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2600104ab0 0x7f26001ad430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:03:18.884 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.882+0000 7f25fed9d700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2600104ab0 0x7f26001ad430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:57930/0 (socket says 172.21.15.76:57930) 2024-06-02T05:03:18.884 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.882+0000 7f25fed9d700 1 -- 172.21.15.76:0/1382802447 learned_addr learned my addr 172.21.15.76:0/1382802447 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:03:18.884 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.882+0000 7f25fe59c700 1 --2- 172.21.15.76:0/1382802447 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f26000ff770 0x7f260006fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:03:18.884 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.882+0000 7f25f7fff700 1 --2- 172.21.15.76:0/1382802447 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f26001020e0 0x7f260006ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:03:18.884 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.882+0000 7f25f7fff700 1 -- 172.21.15.76:0/1382802447 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f26000ff770 msgr2=0x7f260006fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:03:18.884 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.882+0000 7f25f7fff700 1 --2- 172.21.15.76:0/1382802447 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f26000ff770 0x7f260006fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:18.885 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.882+0000 7f25f7fff700 1 -- 172.21.15.76:0/1382802447 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2600104ab0 msgr2=0x7f26001ad430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:03:18.885 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.882+0000 7f25f7fff700 1 --2- 172.21.15.76:0/1382802447 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2600104ab0 0x7f26001ad430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:18.885 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.882+0000 7f25f7fff700 1 -- 172.21.15.76:0/1382802447 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25f8009d00 con 0x7f26001020e0 2024-06-02T05:03:18.885 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.883+0000 7f25f7fff700 1 --2- 172.21.15.76:0/1382802447 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f26001020e0 0x7f260006ff40 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f25f000e9f0 tx=0x7f25f000ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:03:18.889 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.883+0000 7f25f77fe700 1 -- 172.21.15.76:0/1382802447 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25f000c9c0 con 0x7f26001020e0 2024-06-02T05:03:18.889 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.883+0000 7f25f77fe700 1 -- 172.21.15.76:0/1382802447 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f25f0010430 con 0x7f26001020e0 2024-06-02T05:03:18.889 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.883+0000 7f25f77fe700 1 -- 172.21.15.76:0/1382802447 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25f0018680 con 0x7f26001020e0 2024-06-02T05:03:18.889 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.883+0000 7f2604a32700 1 -- 172.21.15.76:0/1382802447 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26001adce0 con 0x7f26001020e0 2024-06-02T05:03:18.889 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.884+0000 7f2604a32700 1 -- 172.21.15.76:0/1382802447 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26001ae140 con 0x7f26001020e0 2024-06-02T05:03:18.891 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.890+0000 7f25f77fe700 1 -- 172.21.15.76:0/1382802447 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f25f00187e0 con 0x7f26001020e0 2024-06-02T05:03:18.892 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.891+0000 7f25f77fe700 1 --2- 172.21.15.76:0/1382802447 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f25ec0a1270 0x7f25ec0a3730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:03:18.892 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.891+0000 7f25f77fe700 1 -- 172.21.15.76:0/1382802447 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f25f0014070 con 0x7f26001020e0 2024-06-02T05:03:18.896 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.896+0000 7f25fe59c700 1 --2- 172.21.15.76:0/1382802447 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f25ec0a1270 0x7f25ec0a3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:03:18.897 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.896+0000 7f25fe59c700 1 --2- 172.21.15.76:0/1382802447 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f25ec0a1270 0x7f25ec0a3730 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f25e8005950 tx=0x7f25e800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:03:18.897 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.897+0000 7f2610bedb80 1 Processor -- start 2024-06-02T05:03:18.898 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.897+0000 7f2610bedb80 1 -- start start 2024-06-02T05:03:18.898 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.897+0000 7f2610bedb80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d3db787a80 0x55d3db787ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:03:18.898 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.897+0000 7f2610bedb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d3db7883e0 0x55d3db788cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:03:18.899 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.897+0000 7f2610bedb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d3db7892d0 0x55d3db789750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:03:18.899 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.897+0000 7f2610bedb80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3db6df0f0 con 0x55d3db787a80 2024-06-02T05:03:18.899 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.897+0000 7f2610bedb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3db6dcab0 con 0x55d3db7892d0 2024-06-02T05:03:18.899 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.897+0000 7f2610bedb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3db6d83a0 con 0x55d3db7883e0 2024-06-02T05:03:18.899 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.898+0000 7f25fed9d700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d3db7892d0 0x55d3db789750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:03:18.899 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.898+0000 7f25fed9d700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d3db7892d0 0x55d3db789750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:50412/0 (socket says 172.21.15.76:50412) 2024-06-02T05:03:18.899 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.898+0000 7f25fed9d700 1 -- 172.21.15.76:0/166353324 learned_addr learned my addr 172.21.15.76:0/166353324 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:03:18.899 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.898+0000 7f25f7fff700 1 --2- 172.21.15.76:0/166353324 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d3db7883e0 0x55d3db788cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:03:18.900 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.898+0000 7f25fe59c700 1 --2- 172.21.15.76:0/166353324 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d3db787a80 0x55d3db787ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:03:18.900 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.898+0000 7f25fed9d700 1 -- 172.21.15.76:0/166353324 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d3db7883e0 msgr2=0x55d3db788cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:03:18.900 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.898+0000 7f25fed9d700 1 --2- 172.21.15.76:0/166353324 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d3db7883e0 0x55d3db788cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:18.900 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.898+0000 7f25fed9d700 1 -- 172.21.15.76:0/166353324 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d3db787a80 msgr2=0x55d3db787ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:03:18.900 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.898+0000 7f25fed9d700 1 --2- 172.21.15.76:0/166353324 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d3db787a80 0x55d3db787ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:18.900 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.898+0000 7f25fed9d700 1 -- 172.21.15.76:0/166353324 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d3db559350 con 0x55d3db7892d0 2024-06-02T05:03:18.900 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.898+0000 7f25fed9d700 1 --2- 172.21.15.76:0/166353324 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d3db7892d0 0x55d3db789750 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f25f800d010 tx=0x7f25f80093f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d4ad4ab72756a88a server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:03:18.900 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.899+0000 7f25f4ff9700 1 -- 172.21.15.76:0/166353324 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25f800e040 con 0x55d3db7892d0 2024-06-02T05:03:18.900 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.899+0000 7f25f4ff9700 1 -- 172.21.15.76:0/166353324 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f25f8009b80 con 0x55d3db7892d0 2024-06-02T05:03:18.901 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.899+0000 7f25f4ff9700 1 -- 172.21.15.76:0/166353324 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25f8003e80 con 0x55d3db7892d0 2024-06-02T05:03:18.901 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.900+0000 7f2610bedb80 1 -- 172.21.15.76:0/166353324 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d3db7892d0 msgr2=0x55d3db789750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:03:18.901 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.900+0000 7f2610bedb80 1 --2- 172.21.15.76:0/166353324 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d3db7892d0 0x55d3db789750 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f25f800d010 tx=0x7f25f80093f0 comp rx=0 tx=0).stop 2024-06-02T05:03:18.903 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.902+0000 7f2610bedb80 1 -- 172.21.15.76:0/166353324 shutdown_connections 2024-06-02T05:03:18.903 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.902+0000 7f2610bedb80 1 --2- 172.21.15.76:0/166353324 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d3db7892d0 0x55d3db789750 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:18.903 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.902+0000 7f2610bedb80 1 --2- 172.21.15.76:0/166353324 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d3db787a80 0x55d3db787ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:18.903 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.902+0000 7f2610bedb80 1 --2- 172.21.15.76:0/166353324 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d3db7883e0 0x55d3db788cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:18.903 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.902+0000 7f2610bedb80 1 -- 172.21.15.76:0/166353324 >> 172.21.15.76:0/166353324 conn(0x55d3db6e61b0 msgr2=0x55d3db784440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:03:18.903 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.902+0000 7f2610bedb80 1 -- 172.21.15.76:0/166353324 shutdown_connections 2024-06-02T05:03:18.904 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.902+0000 7f2610bedb80 1 -- 172.21.15.76:0/166353324 wait complete. 2024-06-02T05:03:18.904 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.903+0000 7f2610bedb80 1 -- start start 2024-06-02T05:03:18.904 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.903+0000 7f2610bedb80 1 Processor -- start 2024-06-02T05:03:18.905 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.904+0000 7f2610bedb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d3db787a80 0x55d3db7918f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:03:18.905 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.904+0000 7f2610bedb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d3db7883e0 0x55d3db791e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:03:18.905 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.904+0000 7f2610bedb80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d3db7892d0 0x55d3db798e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:03:18.905 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.904+0000 7f2610bedb80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3db674500 con 0x55d3db7892d0 2024-06-02T05:03:18.905 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.904+0000 7f2610bedb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3db6741a0 con 0x55d3db787a80 2024-06-02T05:03:18.905 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.904+0000 7f2610bedb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3db55b640 con 0x55d3db7883e0 2024-06-02T05:03:18.905 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.904+0000 7f2610bedb80 10 client.0 _ll_register_callbacks cb 0x55d3db67dad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T05:03:18.906 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.904+0000 7f25f7fff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d3db7883e0 0x55d3db791e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:03:18.906 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.904+0000 7f25fe59c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d3db787a80 0x55d3db7918f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:03:18.906 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.904+0000 7f25f7fff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d3db7883e0 0x55d3db791e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:39248/0 (socket says 172.21.15.76:39248) 2024-06-02T05:03:18.906 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.904+0000 7f25f7fff700 1 -- 172.21.15.76:0/3104408420 learned_addr learned my addr 172.21.15.76:0/3104408420 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:03:18.907 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.905+0000 7f25fed9d700 1 --2- 172.21.15.76:0/3104408420 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d3db7892d0 0x55d3db798e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:03:18.907 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.905+0000 7f25fed9d700 1 -- 172.21.15.76:0/3104408420 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d3db7883e0 msgr2=0x55d3db791e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:03:18.907 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.905+0000 7f25fed9d700 1 --2- 172.21.15.76:0/3104408420 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d3db7883e0 0x55d3db791e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:18.908 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.905+0000 7f25fed9d700 1 -- 172.21.15.76:0/3104408420 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d3db787a80 msgr2=0x55d3db7918f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:03:18.908 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.905+0000 7f25fed9d700 1 --2- 172.21.15.76:0/3104408420 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d3db787a80 0x55d3db7918f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:18.908 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.905+0000 7f25fed9d700 1 -- 172.21.15.76:0/3104408420 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2600105a60 con 0x55d3db7892d0 2024-06-02T05:03:18.908 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.905+0000 7f25fed9d700 1 --2- 172.21.15.76:0/3104408420 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d3db7892d0 0x55d3db798e70 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f25f80079c0 tx=0x7f25f8007ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77ffc6d912b2490f server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:03:18.908 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.906+0000 7f25e5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-06-02T05:03:18.908 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.906+0000 7f25e5ffb700 1 -- 172.21.15.76:0/3104408420 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25f802c070 con 0x55d3db7892d0 2024-06-02T05:03:18.908 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.906+0000 7f25e5ffb700 1 -- 172.21.15.76:0/3104408420 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f25f800bcc0 con 0x55d3db7892d0 2024-06-02T05:03:18.908 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.906+0000 7f2610bedb80 1 -- 172.21.15.76:0/3104408420 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d3db7577b0 con 0x55d3db7892d0 2024-06-02T05:03:18.908 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.906+0000 7f25e5ffb700 1 -- 172.21.15.76:0/3104408420 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f25f800e050 con 0x55d3db7892d0 2024-06-02T05:03:18.908 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.906+0000 7f2610bedb80 10 client.16548 fetch_fsmap learned FSMap version 36 2024-06-02T05:03:18.908 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.906+0000 7f2610bedb80 1 -- 172.21.15.76:0/3104408420 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55d3db505b00 con 0x55d3db7892d0 2024-06-02T05:03:18.908 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.907+0000 7f25e5ffb700 1 -- 172.21.15.76:0/3104408420 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55d3db7577b0 con 0x55d3db7892d0 2024-06-02T05:03:18.909 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.907+0000 7f25e5ffb700 1 -- 172.21.15.76:0/3104408420 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f25f802f030 con 0x55d3db7892d0 2024-06-02T05:03:18.909 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.907+0000 7f2610bedb80 10 client.16548 fetch_fsmap finished waiting for FSMap version 36 2024-06-02T05:03:18.909 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.907+0000 7f2610bedb80 10 client.16548 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T05:03:18.909 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.907+0000 7f2610bedb80 20 client.16548 populate_metadata read hostname 'smithi076' 2024-06-02T05:03:18.909 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.907+0000 7f2610bedb80 1 --2- 172.21.15.76:0/3104408420 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55d3db7ae180 0x55d3db7b05a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:03:18.909 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.907+0000 7f2610bedb80 4 client.16548 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T05:03:18.910 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.907+0000 7f2610bedb80 1 -- 172.21.15.76:0/3104408420 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d3db6d0e60 con 0x55d3db7ae180 2024-06-02T05:03:18.911 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.909+0000 7f25fe59c700 1 --2- 172.21.15.76:0/3104408420 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55d3db7ae180 0x55d3db7b05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:03:18.912 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.911+0000 7f25fe59c700 1 --2- 172.21.15.76:0/3104408420 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55d3db7ae180 0x55d3db7b05a0 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9582696ff3a92f47 server_cookie=8013ec3437a331f3 in_seq=0 out_seq=0 2024-06-02T05:03:18.912 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.911+0000 7f25e5ffb700 10 client.16548 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T05:03:18.915 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.913+0000 7f25e5ffb700 1 -- 172.21.15.76:0/3104408420 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55d3db6d0e60 con 0x55d3db7ae180 2024-06-02T05:03:18.915 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.913+0000 7f25e5ffb700 10 client.16548 handle_command_reply: tid=0 2024-06-02T05:03:18.916 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.915+0000 7f2610bedb80 1 client.16548 shutdown 2024-06-02T05:03:18.922 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.921+0000 7f2610bedb80 1 -- 172.21.15.76:0/3104408420 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d3db7892d0 msgr2=0x55d3db798e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:03:18.923 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.921+0000 7f2610bedb80 1 --2- 172.21.15.76:0/3104408420 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d3db7892d0 0x55d3db798e70 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f25f80079c0 tx=0x7f25f8007ed0 comp rx=0 tx=0).stop 2024-06-02T05:03:18.923 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.921+0000 7f2610bedb80 1 -- 172.21.15.76:0/3104408420 shutdown_connections 2024-06-02T05:03:18.923 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.921+0000 7f2610bedb80 1 --2- 172.21.15.76:0/3104408420 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55d3db7ae180 0x55d3db7b05a0 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:18.923 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.921+0000 7f2610bedb80 1 --2- 172.21.15.76:0/3104408420 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d3db7892d0 0x55d3db798e70 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:18.923 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.921+0000 7f2610bedb80 1 --2- 172.21.15.76:0/3104408420 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d3db787a80 0x55d3db7918f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:18.923 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.921+0000 7f2610bedb80 1 --2- 172.21.15.76:0/3104408420 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d3db7883e0 0x55d3db791e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:18.923 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.921+0000 7f2610bedb80 1 -- 172.21.15.76:0/3104408420 >> 172.21.15.76:0/3104408420 conn(0x55d3db6e61b0 msgr2=0x55d3db782860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:03:18.924 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.922+0000 7f25e5ffb700 0 client.16548 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T05:03:18.924 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.922+0000 7f2610bedb80 1 -- 172.21.15.76:0/3104408420 shutdown_connections 2024-06-02T05:03:18.924 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.922+0000 7f2610bedb80 1 -- 172.21.15.76:0/3104408420 wait complete. 2024-06-02T05:03:18.924 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.924+0000 7f2610bedb80 20 client.16548 trim_cache size 0 max 16384 2024-06-02T05:03:18.950 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.949+0000 7f2610bedb80 1 Processor -- start 2024-06-02T05:03:18.951 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.950+0000 7f2610bedb80 1 -- start start 2024-06-02T05:03:18.951 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.950+0000 7f2610bedb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d3db787a80 0x55d3db7b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:03:18.951 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.950+0000 7f2610bedb80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d3db7883e0 0x55d3db798e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:03:18.951 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.950+0000 7f2610bedb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d3db7892d0 0x55d3db784020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:03:18.951 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.950+0000 7f2610bedb80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3db7ab000 con 0x55d3db7883e0 2024-06-02T05:03:18.951 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.950+0000 7f2610bedb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3db7927f0 con 0x55d3db7892d0 2024-06-02T05:03:18.951 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.950+0000 7f2610bedb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3db791460 con 0x55d3db787a80 2024-06-02T05:03:18.951 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.950+0000 7f25f7fff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d3db7883e0 0x55d3db798e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:03:18.951 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.950+0000 7f25f7fff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d3db7883e0 0x55d3db798e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:57952/0 (socket says 172.21.15.76:57952) 2024-06-02T05:03:18.951 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.950+0000 7f25f7fff700 1 -- 172.21.15.76:0/2474455360 learned_addr learned my addr 172.21.15.76:0/2474455360 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:03:18.951 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.950+0000 7f25fe59c700 1 --2- 172.21.15.76:0/2474455360 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d3db787a80 0x55d3db7b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:03:18.952 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.950+0000 7f25fed9d700 1 --2- 172.21.15.76:0/2474455360 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d3db7892d0 0x55d3db784020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:03:18.952 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.950+0000 7f25fe59c700 1 -- 172.21.15.76:0/2474455360 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d3db7892d0 msgr2=0x55d3db784020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:03:18.952 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.950+0000 7f25fe59c700 1 --2- 172.21.15.76:0/2474455360 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d3db7892d0 0x55d3db784020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:18.952 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.950+0000 7f25fe59c700 1 -- 172.21.15.76:0/2474455360 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d3db7883e0 msgr2=0x55d3db798e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:03:18.952 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.950+0000 7f25fe59c700 1 --2- 172.21.15.76:0/2474455360 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d3db7883e0 0x55d3db798e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:18.952 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.950+0000 7f25fe59c700 1 -- 172.21.15.76:0/2474455360 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d3db69e500 con 0x55d3db787a80 2024-06-02T05:03:18.952 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.951+0000 7f25fe59c700 1 --2- 172.21.15.76:0/2474455360 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d3db787a80 0x55d3db7b4ec0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f25e8011010 tx=0x7f25e8013000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=33ea55ee6bb69afe server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:03:18.954 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.953+0000 7f25f57fa700 1 -- 172.21.15.76:0/2474455360 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e802b070 con 0x55d3db787a80 2024-06-02T05:03:18.954 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.953+0000 7f25f57fa700 1 -- 172.21.15.76:0/2474455360 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f25e8015070 con 0x55d3db787a80 2024-06-02T05:03:18.954 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.953+0000 7f25f57fa700 1 -- 172.21.15.76:0/2474455360 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e8025070 con 0x55d3db787a80 2024-06-02T05:03:18.954 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.954+0000 7f2610bedb80 1 -- 172.21.15.76:0/2474455360 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d3db787a80 msgr2=0x55d3db7b4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:03:18.954 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.954+0000 7f2610bedb80 1 --2- 172.21.15.76:0/2474455360 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d3db787a80 0x55d3db7b4ec0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f25e8011010 tx=0x7f25e8013000 comp rx=0 tx=0).stop 2024-06-02T05:03:18.957 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.956+0000 7f2610bedb80 1 -- 172.21.15.76:0/2474455360 shutdown_connections 2024-06-02T05:03:18.957 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.956+0000 7f2610bedb80 1 --2- 172.21.15.76:0/2474455360 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d3db7892d0 0x55d3db784020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:18.957 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.956+0000 7f2610bedb80 1 --2- 172.21.15.76:0/2474455360 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d3db787a80 0x55d3db7b4ec0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:18.957 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.956+0000 7f2610bedb80 1 --2- 172.21.15.76:0/2474455360 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d3db7883e0 0x55d3db798e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:18.957 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.956+0000 7f2610bedb80 1 -- 172.21.15.76:0/2474455360 >> 172.21.15.76:0/2474455360 conn(0x55d3db6e61b0 msgr2=0x55d3db78f860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:03:18.957 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.956+0000 7f2610bedb80 1 -- 172.21.15.76:0/2474455360 shutdown_connections 2024-06-02T05:03:18.958 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.956+0000 7f2610bedb80 1 -- 172.21.15.76:0/2474455360 wait complete. 2024-06-02T05:03:18.958 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.957+0000 7f2610bedb80 1 -- start start 2024-06-02T05:03:18.958 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.957+0000 7f2610bedb80 1 Processor -- start 2024-06-02T05:03:18.958 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.957+0000 7f2610bedb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d3db787a80 0x55d3db796430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:03:18.958 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.957+0000 7f2610bedb80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d3db7883e0 0x55d3db796970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:03:18.958 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.957+0000 7f2610bedb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d3db7892d0 0x55d3db797980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:03:18.958 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.957+0000 7f2610bedb80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3db797ec0 con 0x55d3db7883e0 2024-06-02T05:03:18.958 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.957+0000 7f2610bedb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3db798030 con 0x55d3db787a80 2024-06-02T05:03:18.959 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.957+0000 7f2610bedb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3db7981f0 con 0x55d3db7892d0 2024-06-02T05:03:18.959 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.957+0000 7f2610bedb80 10 client.0 _ll_register_callbacks cb 0x55d3db67dad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T05:03:18.963 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.957+0000 7f25f7fff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d3db7883e0 0x55d3db796970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:03:18.963 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.957+0000 7f25f7fff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d3db7883e0 0x55d3db796970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:57956/0 (socket says 172.21.15.76:57956) 2024-06-02T05:03:18.963 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.957+0000 7f25fe59c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d3db787a80 0x55d3db796430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:03:18.963 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.957+0000 7f25f7fff700 1 -- 172.21.15.76:0/35208003 learned_addr learned my addr 172.21.15.76:0/35208003 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:03:18.963 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.958+0000 7f25f7fff700 1 -- 172.21.15.76:0/35208003 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d3db7892d0 msgr2=0x55d3db797980 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-02T05:03:18.963 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.958+0000 7f25f7fff700 1 --2- 172.21.15.76:0/35208003 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d3db7892d0 0x55d3db797980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:18.964 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.958+0000 7f25f7fff700 1 -- 172.21.15.76:0/35208003 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d3db787a80 msgr2=0x55d3db796430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:03:18.964 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.958+0000 7f25f7fff700 1 --2- 172.21.15.76:0/35208003 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d3db787a80 0x55d3db796430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:18.964 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.958+0000 7f25f7fff700 1 -- 172.21.15.76:0/35208003 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25e8010d30 con 0x55d3db7883e0 2024-06-02T05:03:18.964 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.962+0000 7f25f7fff700 1 --2- 172.21.15.76:0/35208003 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d3db7883e0 0x55d3db796970 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f25f009a980 tx=0x7f25f00cd040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac2dcdb6b584980e server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:03:18.964 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.962+0000 7f25e5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-06-02T05:03:18.964 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.962+0000 7f25e5ffb700 1 -- 172.21.15.76:0/35208003 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25f00a2e70 con 0x55d3db7883e0 2024-06-02T05:03:18.964 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.962+0000 7f25e5ffb700 1 -- 172.21.15.76:0/35208003 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f25f009eab0 con 0x55d3db7883e0 2024-06-02T05:03:18.964 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.962+0000 7f2610bedb80 1 -- 172.21.15.76:0/35208003 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d3db631210 con 0x55d3db7883e0 2024-06-02T05:03:18.964 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.962+0000 7f25e5ffb700 1 -- 172.21.15.76:0/35208003 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f25f00a3100 con 0x55d3db7883e0 2024-06-02T05:03:18.964 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.962+0000 7f2610bedb80 10 client.16554 fetch_fsmap learned FSMap version 36 2024-06-02T05:03:18.964 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.962+0000 7f2610bedb80 1 -- 172.21.15.76:0/35208003 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55d3db55dc70 con 0x55d3db7883e0 2024-06-02T05:03:18.965 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.963+0000 7f25e5ffb700 1 -- 172.21.15.76:0/35208003 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55d3db631210 con 0x55d3db7883e0 2024-06-02T05:03:18.965 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.963+0000 7f25e5ffb700 1 -- 172.21.15.76:0/35208003 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f25f0096c80 con 0x55d3db7883e0 2024-06-02T05:03:18.965 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.963+0000 7f2610bedb80 10 client.16554 fetch_fsmap finished waiting for FSMap version 36 2024-06-02T05:03:18.965 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.963+0000 7f2610bedb80 10 client.16554 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T05:03:18.965 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.963+0000 7f2610bedb80 20 client.16554 populate_metadata read hostname 'smithi076' 2024-06-02T05:03:18.965 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.963+0000 7f2610bedb80 1 --2- 172.21.15.76:0/35208003 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55d3db804ee0 0x55d3db807300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:03:18.965 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.963+0000 7f2610bedb80 4 client.16554 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T05:03:18.966 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.963+0000 7f2610bedb80 1 -- 172.21.15.76:0/35208003 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55d3db526c90 con 0x55d3db804ee0 2024-06-02T05:03:18.966 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.964+0000 7f25fe59c700 1 --2- 172.21.15.76:0/35208003 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55d3db804ee0 0x55d3db807300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:03:18.966 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.965+0000 7f25fe59c700 1 --2- 172.21.15.76:0/35208003 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55d3db804ee0 0x55d3db807300 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=18ce81985802daae server_cookie=400bbfa306771669 in_seq=0 out_seq=0 2024-06-02T05:03:18.970 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.969+0000 7f25e5ffb700 10 client.16554 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T05:03:18.990 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.989+0000 7f25e5ffb700 1 -- 172.21.15.76:0/35208003 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55d3db526c90 con 0x55d3db804ee0 2024-06-02T05:03:18.990 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.989+0000 7f25e5ffb700 10 client.16554 handle_command_reply: tid=0 2024-06-02T05:03:18.991 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.989+0000 7f2610bedb80 1 client.16554 shutdown 2024-06-02T05:03:18.991 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.989+0000 7f2610bedb80 1 -- 172.21.15.76:0/35208003 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d3db7883e0 msgr2=0x55d3db796970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:03:18.991 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.989+0000 7f2610bedb80 1 --2- 172.21.15.76:0/35208003 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d3db7883e0 0x55d3db796970 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f25f009a980 tx=0x7f25f00cd040 comp rx=0 tx=0).stop 2024-06-02T05:03:18.991 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.989+0000 7f2610bedb80 1 -- 172.21.15.76:0/35208003 shutdown_connections 2024-06-02T05:03:18.991 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.989+0000 7f2610bedb80 1 --2- 172.21.15.76:0/35208003 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55d3db804ee0 0x55d3db807300 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:18.991 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.989+0000 7f2610bedb80 1 --2- 172.21.15.76:0/35208003 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d3db7892d0 0x55d3db797980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:18.991 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.989+0000 7f2610bedb80 1 --2- 172.21.15.76:0/35208003 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d3db787a80 0x55d3db796430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:18.991 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.989+0000 7f2610bedb80 1 --2- 172.21.15.76:0/35208003 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d3db7883e0 0x55d3db796970 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:18.991 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.989+0000 7f2610bedb80 1 -- 172.21.15.76:0/35208003 >> 172.21.15.76:0/35208003 conn(0x55d3db6e61b0 msgr2=0x55d3db7b4ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:03:18.991 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.989+0000 7f25e5ffb700 0 client.16554 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T05:03:18.991 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.990+0000 7f2610bedb80 1 -- 172.21.15.76:0/35208003 shutdown_connections 2024-06-02T05:03:18.991 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.990+0000 7f2610bedb80 1 -- 172.21.15.76:0/35208003 wait complete. 2024-06-02T05:03:18.992 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.990+0000 7f2610bedb80 20 client.16554 trim_cache size 0 max 16384 2024-06-02T05:03:18.992 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:{ 2024-06-02T05:03:18.992 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "message": "", 2024-06-02T05:03:18.992 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "return_code": 0 2024-06-02T05:03:18.992 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:} 2024-06-02T05:03:18.998 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.997+0000 7f2604a32700 1 -- 172.21.15.76:0/1382802447 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f25ec0a1270 msgr2=0x7f25ec0a3730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:03:18.998 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.997+0000 7f2604a32700 1 --2- 172.21.15.76:0/1382802447 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f25ec0a1270 0x7f25ec0a3730 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f25e8005950 tx=0x7f25e800b410 comp rx=0 tx=0).stop 2024-06-02T05:03:18.998 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.997+0000 7f2604a32700 1 -- 172.21.15.76:0/1382802447 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f26001020e0 msgr2=0x7f260006ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:03:18.998 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.997+0000 7f2604a32700 1 --2- 172.21.15.76:0/1382802447 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f26001020e0 0x7f260006ff40 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f25f000e9f0 tx=0x7f25f000ed00 comp rx=0 tx=0).stop 2024-06-02T05:03:18.999 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.997+0000 7f2604a32700 1 -- 172.21.15.76:0/1382802447 shutdown_connections 2024-06-02T05:03:18.999 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.998+0000 7f2604a32700 1 --2- 172.21.15.76:0/1382802447 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2600104ab0 0x7f26001ad430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:18.999 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.998+0000 7f2604a32700 1 --2- 172.21.15.76:0/1382802447 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f25ec0a1270 0x7f25ec0a3730 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:18.999 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.998+0000 7f2604a32700 1 --2- 172.21.15.76:0/1382802447 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f26000ff770 0x7f260006fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:18.999 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.998+0000 7f2604a32700 1 --2- 172.21.15.76:0/1382802447 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f26001020e0 0x7f260006ff40 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:18.999 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.998+0000 7f2604a32700 1 -- 172.21.15.76:0/1382802447 >> 172.21.15.76:0/1382802447 conn(0x7f26000fb390 msgr2=0x7f26001000f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:03:18.999 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.998+0000 7f2604a32700 1 -- 172.21.15.76:0/1382802447 shutdown_connections 2024-06-02T05:03:18.999 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:18.998+0000 7f2604a32700 1 -- 172.21.15.76:0/1382802447 wait complete. 2024-06-02T05:03:19.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:03:18 smithi119 ceph-mon[46633]: pgmap v680: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 9.3 MiB/s wr, 713 op/s 2024-06-02T05:03:19.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:03:18 smithi192 ceph-mon[47933]: pgmap v680: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 9.3 MiB/s wr, 713 op/s 2024-06-02T05:03:19.235 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:03:18 smithi076 ceph-mon[42935]: pgmap v680: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 9.3 MiB/s wr, 713 op/s 2024-06-02T05:03:21.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 750.0 s, 637.2 tps, lat 150.600 ms stddev 69.849 2024-06-02T05:03:21.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:03:21 smithi076 ceph-mon[42935]: pgmap v681: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 10 MiB/s wr, 815 op/s 2024-06-02T05:03:22.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:03:21 smithi119 ceph-mon[46633]: pgmap v681: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 10 MiB/s wr, 815 op/s 2024-06-02T05:03:22.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:03:21 smithi192 ceph-mon[47933]: pgmap v681: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 10 MiB/s wr, 815 op/s 2024-06-02T05:03:23.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:03:23 smithi076 ceph-mon[42935]: pgmap v682: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 11 MiB/s wr, 828 op/s 2024-06-02T05:03:23.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:03:23 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T05:03:23.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:03:23 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T05:03:23.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:03:23 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T05:03:24.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:03:23 smithi119 ceph-mon[46633]: pgmap v682: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 11 MiB/s wr, 828 op/s 2024-06-02T05:03:24.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:03:23 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T05:03:24.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:03:23 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T05:03:24.097 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:03:23 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T05:03:24.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:03:23 smithi192 ceph-mon[47933]: pgmap v682: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 11 MiB/s wr, 828 op/s 2024-06-02T05:03:24.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:03:23 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T05:03:24.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:03:23 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T05:03:24.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:03:23 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T05:03:24.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:03:24 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T05:03:24.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:03:24 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T05:03:24.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:03:24 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T05:03:25.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:03:24 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T05:03:25.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:03:24 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T05:03:25.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:03:24 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T05:03:25.183 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:03:24 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T05:03:25.187 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:03:24 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T05:03:25.187 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:03:24 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T05:03:25.986 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:03:25 smithi076 ceph-mon[42935]: pgmap v683: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 9.4 MiB/s wr, 734 op/s 2024-06-02T05:03:26.097 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:03:25 smithi119 ceph-mon[46633]: pgmap v683: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 9.4 MiB/s wr, 734 op/s 2024-06-02T05:03:26.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:03:25 smithi192 ceph-mon[47933]: pgmap v683: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 9.4 MiB/s wr, 734 op/s 2024-06-02T05:03:26.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 755.0 s, 440.4 tps, lat 221.000 ms stddev 386.194 2024-06-02T05:03:28.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:03:27 smithi119 ceph-mon[46633]: pgmap v684: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 11 MiB/s wr, 865 op/s 2024-06-02T05:03:28.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:03:27 smithi192 ceph-mon[47933]: pgmap v684: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 11 MiB/s wr, 865 op/s 2024-06-02T05:03:28.237 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:03:27 smithi076 ceph-mon[42935]: pgmap v684: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 11 MiB/s wr, 865 op/s 2024-06-02T05:03:30.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:03:29 smithi119 ceph-mon[46633]: pgmap v685: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 11 MiB/s wr, 755 op/s 2024-06-02T05:03:30.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:03:29 smithi192 ceph-mon[47933]: pgmap v685: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 11 MiB/s wr, 755 op/s 2024-06-02T05:03:30.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:03:29 smithi076 ceph-mon[42935]: pgmap v685: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 11 MiB/s wr, 755 op/s 2024-06-02T05:03:31.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 760.0 s, 462.4 tps, lat 231.950 ms stddev 378.388 2024-06-02T05:03:32.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:03:31 smithi119 ceph-mon[46633]: pgmap v686: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 11 MiB/s wr, 822 op/s 2024-06-02T05:03:32.182 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.179+0000 7f406bc18700 1 -- 172.21.15.76:0/4030565427 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4064072da0 msgr2=0x7f40640731c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:03:32.182 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.179+0000 7f406bc18700 1 --2- 172.21.15.76:0/4030565427 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4064072da0 0x7f40640731c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f4060009990 tx=0x7f4060009ca0 comp rx=0 tx=0).stop 2024-06-02T05:03:32.183 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.179+0000 7f406bc18700 1 -- 172.21.15.76:0/4030565427 shutdown_connections 2024-06-02T05:03:32.183 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.179+0000 7f406bc18700 1 --2- 172.21.15.76:0/4030565427 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f40640786a0 0x7f406407ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:32.183 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.179+0000 7f406bc18700 1 --2- 172.21.15.76:0/4030565427 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4064072da0 0x7f40640731c0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:32.183 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.179+0000 7f406bc18700 1 --2- 172.21.15.76:0/4030565427 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4064075cd0 0x7f4064078160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:32.183 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.179+0000 7f406bc18700 1 -- 172.21.15.76:0/4030565427 >> 172.21.15.76:0/4030565427 conn(0x7f406406df30 msgr2=0x7f4064070370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:03:32.183 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:03:31 smithi192 ceph-mon[47933]: pgmap v686: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 11 MiB/s wr, 822 op/s 2024-06-02T05:03:32.184 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.182+0000 7f406bc18700 1 -- 172.21.15.76:0/4030565427 shutdown_connections 2024-06-02T05:03:32.184 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.182+0000 7f406bc18700 1 -- 172.21.15.76:0/4030565427 wait complete. 2024-06-02T05:03:32.186 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.183+0000 7f406bc18700 1 Processor -- start 2024-06-02T05:03:32.186 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.184+0000 7f406bc18700 1 -- start start 2024-06-02T05:03:32.187 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.184+0000 7f406bc18700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4064072da0 0x7f40641b0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:03:32.187 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.184+0000 7f406bc18700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4064075cd0 0x7f40641b3220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:03:32.187 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.184+0000 7f406bc18700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f40640786a0 0x7f40641b5770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:03:32.187 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.184+0000 7f406bc18700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40641b5e50 con 0x7f40640786a0 2024-06-02T05:03:32.187 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.184+0000 7f406bc18700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40641b5fc0 con 0x7f4064075cd0 2024-06-02T05:03:32.187 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.184+0000 7f406bc18700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40641b6180 con 0x7f4064072da0 2024-06-02T05:03:32.187 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.184+0000 7f40699b4700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4064072da0 0x7f40641b0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:03:32.187 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.184+0000 7f40699b4700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4064072da0 0x7f40641b0cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:46716/0 (socket says 172.21.15.76:46716) 2024-06-02T05:03:32.187 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.184+0000 7f40699b4700 1 -- 172.21.15.76:0/1208742842 learned_addr learned my addr 172.21.15.76:0/1208742842 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:03:32.187 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.184+0000 7f406a1b5700 1 --2- 172.21.15.76:0/1208742842 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f40640786a0 0x7f40641b5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:03:32.187 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.184+0000 7f40691b3700 1 --2- 172.21.15.76:0/1208742842 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4064075cd0 0x7f40641b3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:03:32.187 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.184+0000 7f40699b4700 1 -- 172.21.15.76:0/1208742842 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4064075cd0 msgr2=0x7f40641b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:03:32.188 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.184+0000 7f40699b4700 1 --2- 172.21.15.76:0/1208742842 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4064075cd0 0x7f40641b3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:32.188 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.184+0000 7f40699b4700 1 -- 172.21.15.76:0/1208742842 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f40640786a0 msgr2=0x7f40641b5770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:03:32.188 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.184+0000 7f40699b4700 1 --2- 172.21.15.76:0/1208742842 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f40640786a0 0x7f40641b5770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:32.188 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.184+0000 7f40699b4700 1 -- 172.21.15.76:0/1208742842 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40600095f0 con 0x7f4064072da0 2024-06-02T05:03:32.188 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.185+0000 7f40699b4700 1 --2- 172.21.15.76:0/1208742842 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4064072da0 0x7f40641b0cd0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f4060005740 tx=0x7f4060005770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:03:32.188 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.185+0000 7f405affd700 1 -- 172.21.15.76:0/1208742842 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f406001d070 con 0x7f4064072da0 2024-06-02T05:03:32.188 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.185+0000 7f406bc18700 1 -- 172.21.15.76:0/1208742842 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40641b6400 con 0x7f4064072da0 2024-06-02T05:03:32.188 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.185+0000 7f405affd700 1 -- 172.21.15.76:0/1208742842 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f406000beb0 con 0x7f4064072da0 2024-06-02T05:03:32.188 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.185+0000 7f405affd700 1 -- 172.21.15.76:0/1208742842 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4060021410 con 0x7f4064072da0 2024-06-02T05:03:32.188 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.185+0000 7f406bc18700 1 -- 172.21.15.76:0/1208742842 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40641b6880 con 0x7f4064072da0 2024-06-02T05:03:32.189 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.188+0000 7f405affd700 1 -- 172.21.15.76:0/1208742842 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f406002b440 con 0x7f4064072da0 2024-06-02T05:03:32.189 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.189+0000 7f405affd700 1 --2- 172.21.15.76:0/1208742842 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f40500a99a0 0x7f40500abe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:03:32.189 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.189+0000 7f405affd700 1 -- 172.21.15.76:0/1208742842 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f40600cedc0 con 0x7f4064072da0 2024-06-02T05:03:32.191 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.190+0000 7f4077dd3b80 1 Processor -- start 2024-06-02T05:03:32.191 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.190+0000 7f4077dd3b80 1 -- start start 2024-06-02T05:03:32.191 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.190+0000 7f4077dd3b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f21b94fa80 0x55f21b94fea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:03:32.191 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.190+0000 7f4077dd3b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f21b9503e0 0x55f21b950cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:03:32.191 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.190+0000 7f4077dd3b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f21b9512d0 0x55f21b951750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:03:32.191 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.190+0000 7f4077dd3b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f21b8a70f0 con 0x55f21b9503e0 2024-06-02T05:03:32.191 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.190+0000 7f4077dd3b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f21b8a4ab0 con 0x55f21b94fa80 2024-06-02T05:03:32.191 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.190+0000 7f4077dd3b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f21b8a03a0 con 0x55f21b9512d0 2024-06-02T05:03:32.192 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.191+0000 7f40699b4700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f21b94fa80 0x55f21b94fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:03:32.192 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.191+0000 7f40699b4700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f21b94fa80 0x55f21b94fea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:50354/0 (socket says 172.21.15.76:50354) 2024-06-02T05:03:32.192 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.191+0000 7f40699b4700 1 -- 172.21.15.76:0/3500253120 learned_addr learned my addr 172.21.15.76:0/3500253120 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:03:32.192 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.191+0000 7f406a1b5700 1 --2- 172.21.15.76:0/3500253120 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f21b9512d0 0x55f21b951750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:03:32.193 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.191+0000 7f40699b4700 1 -- 172.21.15.76:0/3500253120 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f21b9512d0 msgr2=0x55f21b951750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:03:32.193 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.191+0000 7f40699b4700 1 --2- 172.21.15.76:0/3500253120 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f21b9512d0 0x55f21b951750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:32.193 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.191+0000 7f40699b4700 1 -- 172.21.15.76:0/3500253120 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f21b9503e0 msgr2=0x55f21b950cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:03:32.193 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.191+0000 7f40699b4700 1 --2- 172.21.15.76:0/3500253120 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f21b9503e0 0x55f21b950cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:32.193 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.191+0000 7f40699b4700 1 -- 172.21.15.76:0/3500253120 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f21b721350 con 0x55f21b94fa80 2024-06-02T05:03:32.193 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.191+0000 7f40691b3700 1 --2- 172.21.15.76:0/1208742842 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f40500a99a0 0x7f40500abe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:03:32.193 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.191+0000 7f40699b4700 1 --2- 172.21.15.76:0/3500253120 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f21b94fa80 0x55f21b94fea0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f406009bc60 tx=0x7f406009be60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a9b7bc861497cc03 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:03:32.193 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.191+0000 7f404ffff700 1 -- 172.21.15.76:0/3500253120 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f406009bf60 con 0x55f21b94fa80 2024-06-02T05:03:32.193 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.191+0000 7f404ffff700 1 -- 172.21.15.76:0/3500253120 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f406009fd90 con 0x55f21b94fa80 2024-06-02T05:03:32.193 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.191+0000 7f404ffff700 1 -- 172.21.15.76:0/3500253120 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40600a3ec0 con 0x55f21b94fa80 2024-06-02T05:03:32.194 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.192+0000 7f4077dd3b80 1 -- 172.21.15.76:0/3500253120 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f21b94fa80 msgr2=0x55f21b94fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:03:32.194 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.192+0000 7f4077dd3b80 1 --2- 172.21.15.76:0/3500253120 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f21b94fa80 0x55f21b94fea0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f406009bc60 tx=0x7f406009be60 comp rx=0 tx=0).stop 2024-06-02T05:03:32.194 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.193+0000 7f4077dd3b80 1 -- 172.21.15.76:0/3500253120 shutdown_connections 2024-06-02T05:03:32.194 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.193+0000 7f4077dd3b80 1 --2- 172.21.15.76:0/3500253120 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f21b9512d0 0x55f21b951750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:32.194 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.193+0000 7f4077dd3b80 1 --2- 172.21.15.76:0/3500253120 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f21b94fa80 0x55f21b94fea0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:32.194 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.193+0000 7f4077dd3b80 1 --2- 172.21.15.76:0/3500253120 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f21b9503e0 0x55f21b950cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:32.195 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.193+0000 7f4077dd3b80 1 -- 172.21.15.76:0/3500253120 >> 172.21.15.76:0/3500253120 conn(0x55f21b8ae1b0 msgr2=0x55f21b94c440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:03:32.195 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.193+0000 7f4077dd3b80 1 -- 172.21.15.76:0/3500253120 shutdown_connections 2024-06-02T05:03:32.195 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.193+0000 7f4077dd3b80 1 -- 172.21.15.76:0/3500253120 wait complete. 2024-06-02T05:03:32.195 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.193+0000 7f4077dd3b80 1 -- start start 2024-06-02T05:03:32.195 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.193+0000 7f4077dd3b80 1 Processor -- start 2024-06-02T05:03:32.196 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.194+0000 7f40691b3700 1 --2- 172.21.15.76:0/1208742842 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f40500a99a0 0x7f40500abe60 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f4054009d20 tx=0x7f4054009610 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:03:32.196 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.194+0000 7f4077dd3b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f21b94fa80 0x55f21b959550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:03:32.196 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.194+0000 7f4077dd3b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f21b9503e0 0x55f21b959a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:03:32.196 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.194+0000 7f4077dd3b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f21b9512d0 0x55f21b960ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:03:32.196 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.194+0000 7f4077dd3b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f21b83c500 con 0x55f21b9503e0 2024-06-02T05:03:32.196 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.194+0000 7f4077dd3b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f21b83c1a0 con 0x55f21b9512d0 2024-06-02T05:03:32.196 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.194+0000 7f4077dd3b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f21b723640 con 0x55f21b94fa80 2024-06-02T05:03:32.196 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.194+0000 7f4077dd3b80 10 client.0 _ll_register_callbacks cb 0x55f21b845ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T05:03:32.196 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.194+0000 7f40699b4700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f21b94fa80 0x55f21b959550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:03:32.197 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.194+0000 7f40699b4700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f21b94fa80 0x55f21b959550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:46734/0 (socket says 172.21.15.76:46734) 2024-06-02T05:03:32.197 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.194+0000 7f40699b4700 1 -- 172.21.15.76:0/1029394181 learned_addr learned my addr 172.21.15.76:0/1029394181 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:03:32.197 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.195+0000 7f40699b4700 1 -- 172.21.15.76:0/1029394181 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f21b9512d0 msgr2=0x55f21b960ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:03:32.197 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.195+0000 7f40699b4700 1 --2- 172.21.15.76:0/1029394181 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f21b9512d0 0x55f21b960ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:32.197 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.195+0000 7f40699b4700 1 -- 172.21.15.76:0/1029394181 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f21b9503e0 msgr2=0x55f21b959a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:03:32.197 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.195+0000 7f40699b4700 1 --2- 172.21.15.76:0/1029394181 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f21b9503e0 0x55f21b959a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:32.197 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.195+0000 7f40699b4700 1 -- 172.21.15.76:0/1029394181 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40641b6880 con 0x55f21b94fa80 2024-06-02T05:03:32.197 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.195+0000 7f40699b4700 1 --2- 172.21.15.76:0/1029394181 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f21b94fa80 0x55f21b959550 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f40600989d0 tx=0x7f406009a3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=50970d8e179aee4f server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:03:32.197 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.195+0000 7f404d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.192:3300/0 2024-06-02T05:03:32.197 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.195+0000 7f404d7fa700 1 -- 172.21.15.76:0/1029394181 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4060096b70 con 0x55f21b94fa80 2024-06-02T05:03:32.197 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.195+0000 7f404d7fa700 1 -- 172.21.15.76:0/1029394181 <== mon.1 v2:172.21.15.192:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f4060096cd0 con 0x55f21b94fa80 2024-06-02T05:03:32.198 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.197+0000 7f4077dd3b80 1 -- 172.21.15.76:0/1029394181 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f21b7f9210 con 0x55f21b94fa80 2024-06-02T05:03:32.198 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.197+0000 7f404d7fa700 1 -- 172.21.15.76:0/1029394181 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4060096e90 con 0x55f21b94fa80 2024-06-02T05:03:32.198 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.197+0000 7f4077dd3b80 10 client.26152 fetch_fsmap learned FSMap version 36 2024-06-02T05:03:32.198 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.197+0000 7f4077dd3b80 1 -- 172.21.15.76:0/1029394181 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55f21b6cdb00 con 0x55f21b94fa80 2024-06-02T05:03:32.199 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.198+0000 7f404d7fa700 1 -- 172.21.15.76:0/1029394181 <== mon.1 v2:172.21.15.192:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55f21b7f9210 con 0x55f21b94fa80 2024-06-02T05:03:32.199 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.198+0000 7f404d7fa700 1 -- 172.21.15.76:0/1029394181 <== mon.1 v2:172.21.15.192:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f40600b9f60 con 0x55f21b94fa80 2024-06-02T05:03:32.199 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.198+0000 7f4077dd3b80 10 client.26152 fetch_fsmap finished waiting for FSMap version 36 2024-06-02T05:03:32.199 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.198+0000 7f4077dd3b80 10 client.26152 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T05:03:32.199 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.198+0000 7f4077dd3b80 20 client.26152 populate_metadata read hostname 'smithi076' 2024-06-02T05:03:32.199 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.198+0000 7f4077dd3b80 1 --2- 172.21.15.76:0/1029394181 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55f21b964fa0 0x55f21b9673c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:03:32.199 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.198+0000 7f4077dd3b80 4 client.26152 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T05:03:32.199 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.198+0000 7f4077dd3b80 1 -- 172.21.15.76:0/1029394181 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f21b91f7b0 con 0x55f21b964fa0 2024-06-02T05:03:32.200 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.198+0000 7f40691b3700 1 --2- 172.21.15.76:0/1029394181 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55f21b964fa0 0x55f21b9673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:03:32.200 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.198+0000 7f404d7fa700 10 client.26152 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T05:03:32.200 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.198+0000 7f40691b3700 1 --2- 172.21.15.76:0/1029394181 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55f21b964fa0 0x55f21b9673c0 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e2970352c669307 server_cookie=3e1005dfa3a415b6 in_seq=0 out_seq=0 2024-06-02T05:03:32.200 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.199+0000 7f404d7fa700 1 -- 172.21.15.76:0/1029394181 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55f21b91f7b0 con 0x55f21b964fa0 2024-06-02T05:03:32.200 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.199+0000 7f404d7fa700 10 client.26152 handle_command_reply: tid=0 2024-06-02T05:03:32.200 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.199+0000 7f4077dd3b80 1 client.26152 shutdown 2024-06-02T05:03:32.201 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.200+0000 7f4077dd3b80 1 -- 172.21.15.76:0/1029394181 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f21b94fa80 msgr2=0x55f21b959550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:03:32.201 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.200+0000 7f4077dd3b80 1 --2- 172.21.15.76:0/1029394181 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f21b94fa80 0x55f21b959550 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f40600989d0 tx=0x7f406009a3b0 comp rx=0 tx=0).stop 2024-06-02T05:03:32.201 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.200+0000 7f4077dd3b80 1 -- 172.21.15.76:0/1029394181 shutdown_connections 2024-06-02T05:03:32.201 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.200+0000 7f4077dd3b80 1 --2- 172.21.15.76:0/1029394181 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55f21b964fa0 0x55f21b9673c0 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:32.201 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.200+0000 7f4077dd3b80 1 --2- 172.21.15.76:0/1029394181 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f21b9512d0 0x55f21b960ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:32.201 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.200+0000 7f4077dd3b80 1 --2- 172.21.15.76:0/1029394181 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f21b94fa80 0x55f21b959550 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:32.201 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.200+0000 7f4077dd3b80 1 --2- 172.21.15.76:0/1029394181 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f21b9503e0 0x55f21b959a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:32.201 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.200+0000 7f404d7fa700 0 client.26152 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T05:03:32.201 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.200+0000 7f4077dd3b80 1 -- 172.21.15.76:0/1029394181 >> 172.21.15.76:0/1029394181 conn(0x55f21b8ae1b0 msgr2=0x55f21b94a860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:03:32.202 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.200+0000 7f4077dd3b80 1 -- 172.21.15.76:0/1029394181 shutdown_connections 2024-06-02T05:03:32.202 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.200+0000 7f4077dd3b80 1 -- 172.21.15.76:0/1029394181 wait complete. 2024-06-02T05:03:32.202 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.201+0000 7f4077dd3b80 20 client.26152 trim_cache size 0 max 16384 2024-06-02T05:03:32.225 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.225+0000 7f4077dd3b80 1 Processor -- start 2024-06-02T05:03:32.226 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.225+0000 7f4077dd3b80 1 -- start start 2024-06-02T05:03:32.226 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.225+0000 7f4077dd3b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f21b94fa80 0x55f21b961180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:03:32.226 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.225+0000 7f4077dd3b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f21b9503e0 0x55f21b960a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:03:32.226 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.225+0000 7f4077dd3b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f21b9512d0 0x55f21b9516b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:03:32.226 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.225+0000 7f4077dd3b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f21b95a740 con 0x55f21b9503e0 2024-06-02T05:03:32.226 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.225+0000 7f4077dd3b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f21b96c5b0 con 0x55f21b94fa80 2024-06-02T05:03:32.226 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.225+0000 7f4077dd3b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f21b94f5e0 con 0x55f21b9512d0 2024-06-02T05:03:32.227 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.225+0000 7f406a1b5700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f21b9512d0 0x55f21b9516b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:03:32.227 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.225+0000 7f406a1b5700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f21b9512d0 0x55f21b9516b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:46746/0 (socket says 172.21.15.76:46746) 2024-06-02T05:03:32.227 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.225+0000 7f40691b3700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f21b9503e0 0x55f21b960a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:03:32.227 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.225+0000 7f406a1b5700 1 -- 172.21.15.76:0/2623629832 learned_addr learned my addr 172.21.15.76:0/2623629832 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:03:32.227 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.226+0000 7f406a1b5700 1 -- 172.21.15.76:0/2623629832 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f21b94fa80 msgr2=0x55f21b961180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:03:32.227 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.226+0000 7f406a1b5700 1 --2- 172.21.15.76:0/2623629832 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f21b94fa80 0x55f21b961180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:32.228 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.226+0000 7f406a1b5700 1 -- 172.21.15.76:0/2623629832 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f21b9503e0 msgr2=0x55f21b960a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:03:32.228 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.226+0000 7f406a1b5700 1 --2- 172.21.15.76:0/2623629832 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f21b9503e0 0x55f21b960a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:32.228 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.226+0000 7f406a1b5700 1 -- 172.21.15.76:0/2623629832 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f21b866500 con 0x55f21b9512d0 2024-06-02T05:03:32.228 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.226+0000 7f40691b3700 1 --2- 172.21.15.76:0/2623629832 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f21b9503e0 0x55f21b960a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T05:03:32.228 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.226+0000 7f406a1b5700 1 --2- 172.21.15.76:0/2623629832 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f21b9512d0 0x55f21b9516b0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f405c003f10 tx=0x7f405c009ac0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b09c3c117fe913e8 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:03:32.228 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.226+0000 7f4058da5700 1 -- 172.21.15.76:0/2623629832 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f405c004bb0 con 0x55f21b9512d0 2024-06-02T05:03:32.228 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.226+0000 7f4058da5700 1 -- 172.21.15.76:0/2623629832 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f405c00f070 con 0x55f21b9512d0 2024-06-02T05:03:32.228 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.226+0000 7f4058da5700 1 -- 172.21.15.76:0/2623629832 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f405c0077c0 con 0x55f21b9512d0 2024-06-02T05:03:32.228 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.227+0000 7f4077dd3b80 1 -- 172.21.15.76:0/2623629832 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f21b9512d0 msgr2=0x55f21b9516b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:03:32.229 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.227+0000 7f4077dd3b80 1 --2- 172.21.15.76:0/2623629832 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f21b9512d0 0x55f21b9516b0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f405c003f10 tx=0x7f405c009ac0 comp rx=0 tx=0).stop 2024-06-02T05:03:32.229 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.227+0000 7f4077dd3b80 1 -- 172.21.15.76:0/2623629832 shutdown_connections 2024-06-02T05:03:32.229 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.227+0000 7f4077dd3b80 1 --2- 172.21.15.76:0/2623629832 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f21b9512d0 0x55f21b9516b0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:32.229 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.227+0000 7f4077dd3b80 1 --2- 172.21.15.76:0/2623629832 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f21b94fa80 0x55f21b961180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:32.229 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.227+0000 7f4077dd3b80 1 --2- 172.21.15.76:0/2623629832 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f21b9503e0 0x55f21b960a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:32.229 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.227+0000 7f4077dd3b80 1 -- 172.21.15.76:0/2623629832 >> 172.21.15.76:0/2623629832 conn(0x55f21b8ae1b0 msgr2=0x55f21b954510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:03:32.230 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.229+0000 7f4077dd3b80 1 -- 172.21.15.76:0/2623629832 shutdown_connections 2024-06-02T05:03:32.230 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.229+0000 7f4077dd3b80 1 -- 172.21.15.76:0/2623629832 wait complete. 2024-06-02T05:03:32.230 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.229+0000 7f4077dd3b80 1 -- start start 2024-06-02T05:03:32.230 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.229+0000 7f4077dd3b80 1 Processor -- start 2024-06-02T05:03:32.231 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.229+0000 7f4077dd3b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f21b9503e0 0x55f21b95e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:03:32.232 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.229+0000 7f4077dd3b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f21b9512d0 0x55f21b95eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:03:32.232 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.229+0000 7f4077dd3b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f21b95fac0 0x55f21b95ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:03:32.232 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.229+0000 7f4077dd3b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f21b960480 con 0x55f21b9512d0 2024-06-02T05:03:32.232 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.229+0000 7f4077dd3b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f21b9605f0 con 0x55f21b95fac0 2024-06-02T05:03:32.232 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.229+0000 7f4077dd3b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f21b9607b0 con 0x55f21b9503e0 2024-06-02T05:03:32.232 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.230+0000 7f4077dd3b80 10 client.0 _ll_register_callbacks cb 0x55f21b845ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T05:03:32.232 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.230+0000 7f406a1b5700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f21b95fac0 0x55f21b95ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:03:32.232 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.230+0000 7f406a1b5700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f21b95fac0 0x55f21b95ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:36636/0 (socket says 172.21.15.76:36636) 2024-06-02T05:03:32.232 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.230+0000 7f40691b3700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f21b9512d0 0x55f21b95eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:03:32.232 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.230+0000 7f406a1b5700 1 -- 172.21.15.76:0/466438503 learned_addr learned my addr 172.21.15.76:0/466438503 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:03:32.232 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.230+0000 7f40699b4700 1 --2- 172.21.15.76:0/466438503 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f21b9503e0 0x55f21b95e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:03:32.233 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.230+0000 7f40691b3700 1 -- 172.21.15.76:0/466438503 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f21b9503e0 msgr2=0x55f21b95e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:03:32.233 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.230+0000 7f40691b3700 1 --2- 172.21.15.76:0/466438503 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f21b9503e0 0x55f21b95e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:32.233 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.230+0000 7f40691b3700 1 -- 172.21.15.76:0/466438503 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f21b95fac0 msgr2=0x55f21b95ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:03:32.233 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.230+0000 7f40691b3700 1 --2- 172.21.15.76:0/466438503 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f21b95fac0 0x55f21b95ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:32.233 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.230+0000 7f40691b3700 1 -- 172.21.15.76:0/466438503 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4054009e60 con 0x55f21b9512d0 2024-06-02T05:03:32.233 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.230+0000 7f40691b3700 1 --2- 172.21.15.76:0/466438503 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f21b9512d0 0x55f21b95eb50 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x55f21b965380 tx=0x7f4054013040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e40d28a0a7a2ca2 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:03:32.233 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.230+0000 7f404d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-06-02T05:03:32.233 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.231+0000 7f404d7fa700 1 -- 172.21.15.76:0/466438503 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40540246a0 con 0x55f21b9512d0 2024-06-02T05:03:32.233 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.231+0000 7f404d7fa700 1 -- 172.21.15.76:0/466438503 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f4054021070 con 0x55f21b9512d0 2024-06-02T05:03:32.233 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.231+0000 7f4077dd3b80 1 -- 172.21.15.76:0/466438503 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f406009fd90 con 0x55f21b9512d0 2024-06-02T05:03:32.233 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.231+0000 7f404d7fa700 1 -- 172.21.15.76:0/466438503 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4054024800 con 0x55f21b9512d0 2024-06-02T05:03:32.233 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.231+0000 7f4077dd3b80 10 client.16566 fetch_fsmap learned FSMap version 36 2024-06-02T05:03:32.233 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.231+0000 7f4077dd3b80 1 -- 172.21.15.76:0/466438503 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x7f405c003bf0 con 0x55f21b9512d0 2024-06-02T05:03:32.234 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.231+0000 7f404d7fa700 1 -- 172.21.15.76:0/466438503 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f406009fd90 con 0x55f21b9512d0 2024-06-02T05:03:32.234 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.232+0000 7f404d7fa700 1 -- 172.21.15.76:0/466438503 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f40540106a0 con 0x55f21b9512d0 2024-06-02T05:03:32.235 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.232+0000 7f4077dd3b80 10 client.16566 fetch_fsmap finished waiting for FSMap version 36 2024-06-02T05:03:32.235 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.232+0000 7f4077dd3b80 10 client.16566 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T05:03:32.235 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.232+0000 7f4077dd3b80 20 client.16566 populate_metadata read hostname 'smithi076' 2024-06-02T05:03:32.235 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.232+0000 7f4077dd3b80 1 --2- 172.21.15.76:0/466438503 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55f21b9bc5b0 0x55f21b9be9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:03:32.235 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.232+0000 7f4077dd3b80 4 client.16566 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T05:03:32.235 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.232+0000 7f4077dd3b80 1 -- 172.21.15.76:0/466438503 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55f21b898e60 con 0x55f21b9bc5b0 2024-06-02T05:03:32.235 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.232+0000 7f40699b4700 1 --2- 172.21.15.76:0/466438503 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55f21b9bc5b0 0x55f21b9be9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:03:32.235 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.232+0000 7f40699b4700 1 --2- 172.21.15.76:0/466438503 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55f21b9bc5b0 0x55f21b9be9d0 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fddf367e1b6c529d server_cookie=62443ad651d630e6 in_seq=0 out_seq=0 2024-06-02T05:03:32.235 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.233+0000 7f404d7fa700 10 client.16566 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T05:03:32.235 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:03:31 smithi076 ceph-mon[42935]: pgmap v686: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 11 MiB/s wr, 822 op/s 2024-06-02T05:03:32.270 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.269+0000 7f404d7fa700 1 -- 172.21.15.76:0/466438503 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55f21b898e60 con 0x55f21b9bc5b0 2024-06-02T05:03:32.270 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.269+0000 7f404d7fa700 10 client.16566 handle_command_reply: tid=0 2024-06-02T05:03:32.270 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.269+0000 7f4077dd3b80 1 client.16566 shutdown 2024-06-02T05:03:32.270 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.269+0000 7f4077dd3b80 1 -- 172.21.15.76:0/466438503 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f21b9512d0 msgr2=0x55f21b95eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:03:32.270 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.269+0000 7f4077dd3b80 1 --2- 172.21.15.76:0/466438503 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f21b9512d0 0x55f21b95eb50 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x55f21b965380 tx=0x7f4054013040 comp rx=0 tx=0).stop 2024-06-02T05:03:32.271 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.270+0000 7f4077dd3b80 1 -- 172.21.15.76:0/466438503 shutdown_connections 2024-06-02T05:03:32.271 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.270+0000 7f4077dd3b80 1 --2- 172.21.15.76:0/466438503 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55f21b9bc5b0 0x55f21b9be9d0 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:32.271 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.270+0000 7f4077dd3b80 1 --2- 172.21.15.76:0/466438503 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f21b95fac0 0x55f21b95ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:32.271 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.270+0000 7f4077dd3b80 1 --2- 172.21.15.76:0/466438503 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f21b9503e0 0x55f21b95e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:32.271 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.270+0000 7f4077dd3b80 1 --2- 172.21.15.76:0/466438503 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f21b9512d0 0x55f21b95eb50 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:32.271 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.270+0000 7f4077dd3b80 1 -- 172.21.15.76:0/466438503 >> 172.21.15.76:0/466438503 conn(0x55f21b8ae1b0 msgr2=0x55f21b958730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:03:32.271 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.270+0000 7f404d7fa700 0 client.16566 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T05:03:32.272 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.270+0000 7f4077dd3b80 1 -- 172.21.15.76:0/466438503 shutdown_connections 2024-06-02T05:03:32.272 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.271+0000 7f4077dd3b80 1 -- 172.21.15.76:0/466438503 wait complete. 2024-06-02T05:03:32.276 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.276+0000 7f4077dd3b80 20 client.16566 trim_cache size 0 max 16384 2024-06-02T05:03:32.280 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:{ 2024-06-02T05:03:32.281 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "message": "", 2024-06-02T05:03:32.281 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "return_code": 0 2024-06-02T05:03:32.281 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:} 2024-06-02T05:03:32.281 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.281+0000 7f406bc18700 1 -- 172.21.15.76:0/1208742842 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f40500a99a0 msgr2=0x7f40500abe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:03:32.281 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.281+0000 7f406bc18700 1 --2- 172.21.15.76:0/1208742842 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f40500a99a0 0x7f40500abe60 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f4054009d20 tx=0x7f4054009610 comp rx=0 tx=0).stop 2024-06-02T05:03:32.281 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.281+0000 7f406bc18700 1 -- 172.21.15.76:0/1208742842 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4064072da0 msgr2=0x7f40641b0cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:03:32.281 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.281+0000 7f406bc18700 1 --2- 172.21.15.76:0/1208742842 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4064072da0 0x7f40641b0cd0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f4060005740 tx=0x7f4060005770 comp rx=0 tx=0).stop 2024-06-02T05:03:32.283 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.283+0000 7f406bc18700 1 -- 172.21.15.76:0/1208742842 shutdown_connections 2024-06-02T05:03:32.283 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.283+0000 7f406bc18700 1 --2- 172.21.15.76:0/1208742842 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f40640786a0 0x7f40641b5770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:32.283 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.283+0000 7f406bc18700 1 --2- 172.21.15.76:0/1208742842 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4064072da0 0x7f40641b0cd0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:32.283 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.283+0000 7f406bc18700 1 --2- 172.21.15.76:0/1208742842 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f40500a99a0 0x7f40500abe60 secure :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f4054009d20 tx=0x7f4054009610 comp rx=0 tx=0).stop 2024-06-02T05:03:32.283 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.283+0000 7f406bc18700 1 --2- 172.21.15.76:0/1208742842 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4064075cd0 0x7f40641b3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:32.284 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.283+0000 7f406bc18700 1 -- 172.21.15.76:0/1208742842 >> 172.21.15.76:0/1208742842 conn(0x7f406406df30 msgr2=0x7f4064077370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:03:32.287 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.286+0000 7f406bc18700 1 -- 172.21.15.76:0/1208742842 shutdown_connections 2024-06-02T05:03:32.293 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:32.291+0000 7f406bc18700 1 -- 172.21.15.76:0/1208742842 wait complete. 2024-06-02T05:03:34.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:03:33 smithi119 ceph-mon[46633]: pgmap v687: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 11 MiB/s wr, 792 op/s 2024-06-02T05:03:34.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:03:33 smithi192 ceph-mon[47933]: pgmap v687: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 11 MiB/s wr, 792 op/s 2024-06-02T05:03:34.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:03:33 smithi076 ceph-mon[42935]: pgmap v687: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 11 MiB/s wr, 792 op/s 2024-06-02T05:03:36.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:03:35 smithi119 ceph-mon[46633]: pgmap v688: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 8.7 MiB/s wr, 670 op/s 2024-06-02T05:03:36.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:03:35 smithi192 ceph-mon[47933]: pgmap v688: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 8.7 MiB/s wr, 670 op/s 2024-06-02T05:03:36.235 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:03:35 smithi076 ceph-mon[42935]: pgmap v688: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 8.7 MiB/s wr, 670 op/s 2024-06-02T05:03:36.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 765.0 s, 630.2 tps, lat 159.231 ms stddev 69.443 2024-06-02T05:03:38.098 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:03:37 smithi119 ceph-mon[46633]: pgmap v689: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 11 MiB/s wr, 816 op/s 2024-06-02T05:03:38.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:03:37 smithi192 ceph-mon[47933]: pgmap v689: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 11 MiB/s wr, 816 op/s 2024-06-02T05:03:38.235 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:03:37 smithi076 ceph-mon[42935]: pgmap v689: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 11 MiB/s wr, 816 op/s 2024-06-02T05:03:40.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:03:39 smithi119 ceph-mon[46633]: pgmap v690: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 9.6 MiB/s wr, 691 op/s 2024-06-02T05:03:40.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:03:39 smithi192 ceph-mon[47933]: pgmap v690: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 9.6 MiB/s wr, 691 op/s 2024-06-02T05:03:40.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:03:39 smithi076 ceph-mon[42935]: pgmap v690: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 9.6 MiB/s wr, 691 op/s 2024-06-02T05:03:41.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:03:40 smithi119 ceph-mon[46633]: pgmap v691: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 9.5 MiB/s wr, 757 op/s 2024-06-02T05:03:41.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:03:40 smithi192 ceph-mon[47933]: pgmap v691: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 9.5 MiB/s wr, 757 op/s 2024-06-02T05:03:41.237 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:03:40 smithi076 ceph-mon[42935]: pgmap v691: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 9.5 MiB/s wr, 757 op/s 2024-06-02T05:03:41.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 770.0 s, 614.6 tps, lat 161.619 ms stddev 87.518 2024-06-02T05:03:43.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:03:43 smithi076 ceph-mon[42935]: pgmap v692: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 10 MiB/s wr, 790 op/s 2024-06-02T05:03:44.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:03:43 smithi119 ceph-mon[46633]: pgmap v692: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 10 MiB/s wr, 790 op/s 2024-06-02T05:03:44.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:03:43 smithi192 ceph-mon[47933]: pgmap v692: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 10 MiB/s wr, 790 op/s 2024-06-02T05:03:45.483 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.477+0000 7f198fdb8700 1 -- 172.21.15.76:0/285144648 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1988108730 msgr2=0x7f1988108b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:03:45.483 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.477+0000 7f198fdb8700 1 --2- 172.21.15.76:0/285144648 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1988108730 0x7f1988108b90 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f197801a9a0 tx=0x7f197801acb0 comp rx=0 tx=0).stop 2024-06-02T05:03:45.483 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.477+0000 7f198fdb8700 1 -- 172.21.15.76:0/285144648 shutdown_connections 2024-06-02T05:03:45.483 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.477+0000 7f198fdb8700 1 --2- 172.21.15.76:0/285144648 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f19881090d0 0x7f198810f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:45.483 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.477+0000 7f198fdb8700 1 --2- 172.21.15.76:0/285144648 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1988107540 0x7f1988107960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:45.484 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.477+0000 7f198fdb8700 1 --2- 172.21.15.76:0/285144648 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1988108730 0x7f1988108b90 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:45.484 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.477+0000 7f198fdb8700 1 -- 172.21.15.76:0/285144648 >> 172.21.15.76:0/285144648 conn(0x7f19880764d0 msgr2=0x7f1988078910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:03:45.484 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.477+0000 7f198fdb8700 1 -- 172.21.15.76:0/285144648 shutdown_connections 2024-06-02T05:03:45.484 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.477+0000 7f198fdb8700 1 -- 172.21.15.76:0/285144648 wait complete. 2024-06-02T05:03:45.484 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.478+0000 7f198fdb8700 1 Processor -- start 2024-06-02T05:03:45.484 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.478+0000 7f198fdb8700 1 -- start start 2024-06-02T05:03:45.484 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.478+0000 7f198fdb8700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1988107540 0x7f19881b9430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:03:45.484 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.478+0000 7f198fdb8700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1988108730 0x7f19881bb980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:03:45.484 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.478+0000 7f198fdb8700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f19881090d0 0x7f19881bdf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:03:45.484 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.478+0000 7f198fdb8700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19881be740 con 0x7f1988107540 2024-06-02T05:03:45.484 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.478+0000 7f198fdb8700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19881be8b0 con 0x7f19881090d0 2024-06-02T05:03:45.485 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.478+0000 7f198fdb8700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19881bea70 con 0x7f1988108730 2024-06-02T05:03:45.485 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.478+0000 7f198d353700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1988108730 0x7f19881bb980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:03:45.485 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.478+0000 7f198e355700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f19881090d0 0x7f19881bdf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:03:45.485 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.478+0000 7f198d353700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1988108730 0x7f19881bb980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:40544/0 (socket says 172.21.15.76:40544) 2024-06-02T05:03:45.485 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.478+0000 7f198d353700 1 -- 172.21.15.76:0/1817206531 learned_addr learned my addr 172.21.15.76:0/1817206531 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:03:45.485 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.479+0000 7f198db54700 1 --2- 172.21.15.76:0/1817206531 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1988107540 0x7f19881b9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:03:45.485 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.479+0000 7f198d353700 1 -- 172.21.15.76:0/1817206531 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f19881090d0 msgr2=0x7f19881bdf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:03:45.485 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.479+0000 7f198d353700 1 --2- 172.21.15.76:0/1817206531 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f19881090d0 0x7f19881bdf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:45.485 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.479+0000 7f198d353700 1 -- 172.21.15.76:0/1817206531 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1988107540 msgr2=0x7f19881b9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:03:45.485 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.479+0000 7f198d353700 1 --2- 172.21.15.76:0/1817206531 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1988107540 0x7f19881b9430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:45.485 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.479+0000 7f198d353700 1 -- 172.21.15.76:0/1817206531 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f197801a600 con 0x7f1988108730 2024-06-02T05:03:45.485 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.479+0000 7f198e355700 1 --2- 172.21.15.76:0/1817206531 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f19881090d0 0x7f19881bdf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T05:03:45.485 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.479+0000 7f198d353700 1 --2- 172.21.15.76:0/1817206531 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1988108730 0x7f19881bb980 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f197801a8f0 tx=0x7f197801a590 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:03:45.486 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.480+0000 7f197effd700 1 -- 172.21.15.76:0/1817206531 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1978005500 con 0x7f1988108730 2024-06-02T05:03:45.486 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.480+0000 7f197effd700 1 -- 172.21.15.76:0/1817206531 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1978005660 con 0x7f1988108730 2024-06-02T05:03:45.486 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.480+0000 7f197effd700 1 -- 172.21.15.76:0/1817206531 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1978004cf0 con 0x7f1988108730 2024-06-02T05:03:45.486 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.480+0000 7f198fdb8700 1 -- 172.21.15.76:0/1817206531 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19881becf0 con 0x7f1988108730 2024-06-02T05:03:45.487 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.480+0000 7f198fdb8700 1 -- 172.21.15.76:0/1817206531 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19881bf0c0 con 0x7f1988108730 2024-06-02T05:03:45.487 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.482+0000 7f197effd700 1 -- 172.21.15.76:0/1817206531 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f197801f760 con 0x7f1988108730 2024-06-02T05:03:45.487 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.483+0000 7f197effd700 1 --2- 172.21.15.76:0/1817206531 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f19740a12a0 0x7f19740a3760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:03:45.487 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.484+0000 7f197effd700 1 -- 172.21.15.76:0/1817206531 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f19780cdf90 con 0x7f1988108730 2024-06-02T05:03:45.487 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.486+0000 7f199bf73b80 1 Processor -- start 2024-06-02T05:03:45.487 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.486+0000 7f199bf73b80 1 -- start start 2024-06-02T05:03:45.488 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.486+0000 7f199bf73b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56093a875a80 0x56093a875ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:03:45.488 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.486+0000 7f199bf73b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56093a8763e0 0x56093a876cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:03:45.488 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.486+0000 7f199bf73b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56093a8772d0 0x56093a877750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:03:45.488 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.486+0000 7f199bf73b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x56093a7cd0f0 con 0x56093a875a80 2024-06-02T05:03:45.488 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.486+0000 7f199bf73b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x56093a7caab0 con 0x56093a8763e0 2024-06-02T05:03:45.488 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.486+0000 7f199bf73b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x56093a7c63a0 con 0x56093a8772d0 2024-06-02T05:03:45.488 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.486+0000 7f198e355700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56093a8772d0 0x56093a877750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:03:45.488 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.486+0000 7f198e355700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56093a8772d0 0x56093a877750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:40556/0 (socket says 172.21.15.76:40556) 2024-06-02T05:03:45.488 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.486+0000 7f198e355700 1 -- 172.21.15.76:0/2870016979 learned_addr learned my addr 172.21.15.76:0/2870016979 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:03:45.488 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.487+0000 7f198e355700 1 -- 172.21.15.76:0/2870016979 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56093a8763e0 msgr2=0x56093a876cf0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-02T05:03:45.488 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.487+0000 7f198e355700 1 --2- 172.21.15.76:0/2870016979 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56093a8763e0 0x56093a876cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:45.488 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.487+0000 7f198e355700 1 -- 172.21.15.76:0/2870016979 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56093a875a80 msgr2=0x56093a875ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:03:45.488 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.487+0000 7f198e355700 1 --2- 172.21.15.76:0/2870016979 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56093a875a80 0x56093a875ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:45.489 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.487+0000 7f198e355700 1 -- 172.21.15.76:0/2870016979 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56093a647350 con 0x56093a8772d0 2024-06-02T05:03:45.489 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.487+0000 7f198db54700 1 --2- 172.21.15.76:0/1817206531 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f19740a12a0 0x7f19740a3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:03:45.489 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.488+0000 7f198db54700 1 --2- 172.21.15.76:0/1817206531 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f19740a12a0 0x7f19740a3760 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f198810fd70 tx=0x7f1984009a50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:03:45.489 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.488+0000 7f198e355700 1 --2- 172.21.15.76:0/2870016979 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56093a8772d0 0x56093a877750 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f198000a870 tx=0x7f1980009650 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fdc93123d05176dd server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:03:45.489 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.488+0000 7f1973fff700 1 -- 172.21.15.76:0/2870016979 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1980010040 con 0x56093a8772d0 2024-06-02T05:03:45.489 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.488+0000 7f1973fff700 1 -- 172.21.15.76:0/2870016979 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1980014d60 con 0x56093a8772d0 2024-06-02T05:03:45.489 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.488+0000 7f1973fff700 1 -- 172.21.15.76:0/2870016979 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1980013b90 con 0x56093a8772d0 2024-06-02T05:03:45.490 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.489+0000 7f199bf73b80 1 -- 172.21.15.76:0/2870016979 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56093a8772d0 msgr2=0x56093a877750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:03:45.491 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.489+0000 7f199bf73b80 1 --2- 172.21.15.76:0/2870016979 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56093a8772d0 0x56093a877750 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f198000a870 tx=0x7f1980009650 comp rx=0 tx=0).stop 2024-06-02T05:03:45.491 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.489+0000 7f199bf73b80 1 -- 172.21.15.76:0/2870016979 shutdown_connections 2024-06-02T05:03:45.491 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.489+0000 7f199bf73b80 1 --2- 172.21.15.76:0/2870016979 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56093a8772d0 0x56093a877750 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:45.491 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.489+0000 7f199bf73b80 1 --2- 172.21.15.76:0/2870016979 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56093a875a80 0x56093a875ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:45.491 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.489+0000 7f199bf73b80 1 --2- 172.21.15.76:0/2870016979 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56093a8763e0 0x56093a876cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:45.491 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.489+0000 7f199bf73b80 1 -- 172.21.15.76:0/2870016979 >> 172.21.15.76:0/2870016979 conn(0x56093a7d41b0 msgr2=0x56093a872440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:03:45.491 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.489+0000 7f199bf73b80 1 -- 172.21.15.76:0/2870016979 shutdown_connections 2024-06-02T05:03:45.491 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.489+0000 7f199bf73b80 1 -- 172.21.15.76:0/2870016979 wait complete. 2024-06-02T05:03:45.491 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.490+0000 7f199bf73b80 1 -- start start 2024-06-02T05:03:45.491 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.490+0000 7f199bf73b80 1 Processor -- start 2024-06-02T05:03:45.491 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.490+0000 7f199bf73b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56093a875a80 0x56093a890910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:03:45.491 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.490+0000 7f199bf73b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56093a8763e0 0x56093a890e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:03:45.493 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.490+0000 7f199bf73b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56093a8772d0 0x56093a897e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:03:45.494 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.490+0000 7f199bf73b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x56093a762500 con 0x56093a8763e0 2024-06-02T05:03:45.494 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.490+0000 7f199bf73b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x56093a7621a0 con 0x56093a875a80 2024-06-02T05:03:45.494 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.490+0000 7f199bf73b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x56093a649640 con 0x56093a8772d0 2024-06-02T05:03:45.494 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.490+0000 7f199bf73b80 10 client.0 _ll_register_callbacks cb 0x56093a76bad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T05:03:45.494 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.490+0000 7f198e355700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56093a8772d0 0x56093a897e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:03:45.494 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.490+0000 7f198db54700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56093a875a80 0x56093a890910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:03:45.494 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.490+0000 7f198e355700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56093a8772d0 0x56093a897e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:40560/0 (socket says 172.21.15.76:40560) 2024-06-02T05:03:45.494 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.490+0000 7f198e355700 1 -- 172.21.15.76:0/2362424481 learned_addr learned my addr 172.21.15.76:0/2362424481 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:03:45.494 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.491+0000 7f198db54700 1 -- 172.21.15.76:0/2362424481 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56093a8772d0 msgr2=0x56093a897e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:03:45.494 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.491+0000 7f198db54700 1 --2- 172.21.15.76:0/2362424481 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56093a8772d0 0x56093a897e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:45.494 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.491+0000 7f198db54700 1 -- 172.21.15.76:0/2362424481 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56093a8763e0 msgr2=0x56093a890e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:03:45.494 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.491+0000 7f198db54700 1 --2- 172.21.15.76:0/2362424481 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56093a8763e0 0x56093a890e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:45.495 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.491+0000 7f198db54700 1 -- 172.21.15.76:0/2362424481 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f198000a4a0 con 0x56093a875a80 2024-06-02T05:03:45.495 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.491+0000 7f198e355700 1 --2- 172.21.15.76:0/2362424481 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56093a8772d0 0x56093a897e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T05:03:45.495 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.491+0000 7f198db54700 1 --2- 172.21.15.76:0/2362424481 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56093a875a80 0x56093a890910 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f198400e630 tx=0x7f1984009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ea608b29273e6e6 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:03:45.495 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.491+0000 7f19717fa700 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-06-02T05:03:45.495 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.491+0000 7f19717fa700 1 -- 172.21.15.76:0/2362424481 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1984026630 con 0x56093a875a80 2024-06-02T05:03:45.495 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.491+0000 7f199bf73b80 1 -- 172.21.15.76:0/2362424481 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56093a71f210 con 0x56093a875a80 2024-06-02T05:03:45.495 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.491+0000 7f19717fa700 1 -- 172.21.15.76:0/2362424481 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f198401c410 con 0x56093a875a80 2024-06-02T05:03:45.495 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.491+0000 7f19717fa700 1 -- 172.21.15.76:0/2362424481 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1984026790 con 0x56093a875a80 2024-06-02T05:03:45.495 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.491+0000 7f199bf73b80 10 client.26210 fetch_fsmap learned FSMap version 36 2024-06-02T05:03:45.495 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.491+0000 7f199bf73b80 1 -- 172.21.15.76:0/2362424481 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x56093a5f3b00 con 0x56093a875a80 2024-06-02T05:03:45.495 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.492+0000 7f19717fa700 1 -- 172.21.15.76:0/2362424481 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56093a71f210 con 0x56093a875a80 2024-06-02T05:03:45.495 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.492+0000 7f19717fa700 1 -- 172.21.15.76:0/2362424481 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f198401ca80 con 0x56093a875a80 2024-06-02T05:03:45.496 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.492+0000 7f199bf73b80 10 client.26210 fetch_fsmap finished waiting for FSMap version 36 2024-06-02T05:03:45.496 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.492+0000 7f199bf73b80 10 client.26210 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T05:03:45.496 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.492+0000 7f199bf73b80 20 client.26210 populate_metadata read hostname 'smithi076' 2024-06-02T05:03:45.496 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.492+0000 7f199bf73b80 1 --2- 172.21.15.76:0/2362424481 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x56093a89c840 0x56093a89ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:03:45.496 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.492+0000 7f199bf73b80 4 client.26210 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T05:03:45.496 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.492+0000 7f199bf73b80 1 -- 172.21.15.76:0/2362424481 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56093a8457b0 con 0x56093a89c840 2024-06-02T05:03:45.496 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.492+0000 7f198d353700 1 --2- 172.21.15.76:0/2362424481 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x56093a89c840 0x56093a89ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:03:45.496 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.493+0000 7f198d353700 1 --2- 172.21.15.76:0/2362424481 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x56093a89c840 0x56093a89ec60 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f2fac5b28fc6fa8 server_cookie=e6818facedfccd96 in_seq=0 out_seq=0 2024-06-02T05:03:45.496 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.493+0000 7f19717fa700 10 client.26210 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T05:03:45.497 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.495+0000 7f19717fa700 1 -- 172.21.15.76:0/2362424481 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56093a8457b0 con 0x56093a89c840 2024-06-02T05:03:45.497 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.495+0000 7f19717fa700 10 client.26210 handle_command_reply: tid=0 2024-06-02T05:03:45.497 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.495+0000 7f199bf73b80 1 client.26210 shutdown 2024-06-02T05:03:45.497 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.496+0000 7f199bf73b80 1 -- 172.21.15.76:0/2362424481 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56093a875a80 msgr2=0x56093a890910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:03:45.497 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.496+0000 7f199bf73b80 1 --2- 172.21.15.76:0/2362424481 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56093a875a80 0x56093a890910 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f198400e630 tx=0x7f1984009260 comp rx=0 tx=0).stop 2024-06-02T05:03:45.497 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.496+0000 7f199bf73b80 1 -- 172.21.15.76:0/2362424481 shutdown_connections 2024-06-02T05:03:45.498 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.496+0000 7f199bf73b80 1 --2- 172.21.15.76:0/2362424481 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x56093a89c840 0x56093a89ec60 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:45.498 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.496+0000 7f199bf73b80 1 --2- 172.21.15.76:0/2362424481 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56093a8772d0 0x56093a897e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:45.498 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.496+0000 7f199bf73b80 1 --2- 172.21.15.76:0/2362424481 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56093a875a80 0x56093a890910 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:45.498 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.496+0000 7f199bf73b80 1 --2- 172.21.15.76:0/2362424481 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56093a8763e0 0x56093a890e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:45.498 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.496+0000 7f199bf73b80 1 -- 172.21.15.76:0/2362424481 >> 172.21.15.76:0/2362424481 conn(0x56093a7d41b0 msgr2=0x56093a870860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:03:45.498 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.496+0000 7f19717fa700 0 client.26210 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T05:03:45.498 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.496+0000 7f199bf73b80 1 -- 172.21.15.76:0/2362424481 shutdown_connections 2024-06-02T05:03:45.498 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.496+0000 7f199bf73b80 1 -- 172.21.15.76:0/2362424481 wait complete. 2024-06-02T05:03:45.498 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.496+0000 7f199bf73b80 20 client.26210 trim_cache size 0 max 16384 2024-06-02T05:03:45.524 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.523+0000 7f199bf73b80 1 Processor -- start 2024-06-02T05:03:45.524 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.523+0000 7f199bf73b80 1 -- start start 2024-06-02T05:03:45.525 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.523+0000 7f199bf73b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56093a875a80 0x56093a875e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:03:45.525 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.523+0000 7f199bf73b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56093a8763e0 0x56093a8776d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:03:45.525 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.523+0000 7f199bf73b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56093a8772d0 0x56093a897e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:03:45.525 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.523+0000 7f199bf73b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x56093a871c30 con 0x56093a8763e0 2024-06-02T05:03:45.525 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.523+0000 7f199bf73b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x56093a87ae00 con 0x56093a8772d0 2024-06-02T05:03:45.525 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.523+0000 7f199bf73b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x56093a871930 con 0x56093a875a80 2024-06-02T05:03:45.525 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.524+0000 7f198e355700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56093a8772d0 0x56093a897e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:03:45.525 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.524+0000 7f198e355700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56093a8772d0 0x56093a897e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:55186/0 (socket says 172.21.15.76:55186) 2024-06-02T05:03:45.525 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.524+0000 7f198e355700 1 -- 172.21.15.76:0/2449514840 learned_addr learned my addr 172.21.15.76:0/2449514840 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:03:45.525 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.524+0000 7f198db54700 1 --2- 172.21.15.76:0/2449514840 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56093a875a80 0x56093a875e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:03:45.525 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.524+0000 7f198d353700 1 --2- 172.21.15.76:0/2449514840 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56093a8763e0 0x56093a8776d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:03:45.526 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.524+0000 7f198e355700 1 -- 172.21.15.76:0/2449514840 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56093a875a80 msgr2=0x56093a875e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:03:45.526 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.524+0000 7f198e355700 1 --2- 172.21.15.76:0/2449514840 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56093a875a80 0x56093a875e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:45.526 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.524+0000 7f198e355700 1 -- 172.21.15.76:0/2449514840 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56093a8763e0 msgr2=0x56093a8776d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:03:45.526 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.524+0000 7f198e355700 1 --2- 172.21.15.76:0/2449514840 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56093a8763e0 0x56093a8776d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:45.526 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.524+0000 7f198e355700 1 -- 172.21.15.76:0/2449514840 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56093a78c500 con 0x56093a8772d0 2024-06-02T05:03:45.527 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.524+0000 7f198e355700 1 --2- 172.21.15.76:0/2449514840 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56093a8772d0 0x56093a897e50 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f198000a790 tx=0x7f1980016040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f10aa69020539f02 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:03:45.527 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.525+0000 7f197cff9700 1 -- 172.21.15.76:0/2449514840 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1980010040 con 0x56093a8772d0 2024-06-02T05:03:45.527 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.525+0000 7f197cff9700 1 -- 172.21.15.76:0/2449514840 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1980013770 con 0x56093a8772d0 2024-06-02T05:03:45.527 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.525+0000 7f197cff9700 1 -- 172.21.15.76:0/2449514840 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f198001d640 con 0x56093a8772d0 2024-06-02T05:03:45.527 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.526+0000 7f199bf73b80 1 -- 172.21.15.76:0/2449514840 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56093a8772d0 msgr2=0x56093a897e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:03:45.527 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.526+0000 7f199bf73b80 1 --2- 172.21.15.76:0/2449514840 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56093a8772d0 0x56093a897e50 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f198000a790 tx=0x7f1980016040 comp rx=0 tx=0).stop 2024-06-02T05:03:45.529 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.528+0000 7f199bf73b80 1 -- 172.21.15.76:0/2449514840 shutdown_connections 2024-06-02T05:03:45.529 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.528+0000 7f199bf73b80 1 --2- 172.21.15.76:0/2449514840 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56093a8772d0 0x56093a897e50 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:45.529 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.528+0000 7f199bf73b80 1 --2- 172.21.15.76:0/2449514840 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56093a875a80 0x56093a875e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:45.529 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.528+0000 7f199bf73b80 1 --2- 172.21.15.76:0/2449514840 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56093a8763e0 0x56093a8776d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:45.529 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.528+0000 7f199bf73b80 1 -- 172.21.15.76:0/2449514840 >> 172.21.15.76:0/2449514840 conn(0x56093a7d41b0 msgr2=0x56093a87d870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:03:45.529 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.528+0000 7f199bf73b80 1 -- 172.21.15.76:0/2449514840 shutdown_connections 2024-06-02T05:03:45.529 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.528+0000 7f199bf73b80 1 -- 172.21.15.76:0/2449514840 wait complete. 2024-06-02T05:03:45.529 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.529+0000 7f199bf73b80 1 -- start start 2024-06-02T05:03:45.530 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.529+0000 7f199bf73b80 1 Processor -- start 2024-06-02T05:03:45.530 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.529+0000 7f199bf73b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56093a875a80 0x56093a895460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:03:45.530 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.529+0000 7f199bf73b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56093a8763e0 0x56093a895a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:03:45.530 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.529+0000 7f199bf73b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56093a8772d0 0x56093a896740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:03:45.530 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.529+0000 7f199bf73b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x56093a896c80 con 0x56093a8772d0 2024-06-02T05:03:45.530 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.529+0000 7f199bf73b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x56093a896df0 con 0x56093a8763e0 2024-06-02T05:03:45.530 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.529+0000 7f199bf73b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x56093a896fb0 con 0x56093a875a80 2024-06-02T05:03:45.531 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.529+0000 7f199bf73b80 10 client.0 _ll_register_callbacks cb 0x56093a76bad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T05:03:45.531 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.529+0000 7f198d353700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56093a8763e0 0x56093a895a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:03:45.531 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.530+0000 7f198db54700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56093a875a80 0x56093a895460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:03:45.531 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.530+0000 7f198d353700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56093a8763e0 0x56093a895a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:55192/0 (socket says 172.21.15.76:55192) 2024-06-02T05:03:45.531 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.530+0000 7f198d353700 1 -- 172.21.15.76:0/2102900446 learned_addr learned my addr 172.21.15.76:0/2102900446 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:03:45.532 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.530+0000 7f198e355700 1 --2- 172.21.15.76:0/2102900446 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56093a8772d0 0x56093a896740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:03:45.532 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.530+0000 7f198db54700 1 -- 172.21.15.76:0/2102900446 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56093a8763e0 msgr2=0x56093a895a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:03:45.533 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.530+0000 7f198db54700 1 --2- 172.21.15.76:0/2102900446 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56093a8763e0 0x56093a895a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:45.533 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.530+0000 7f198db54700 1 -- 172.21.15.76:0/2102900446 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56093a8772d0 msgr2=0x56093a896740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:03:45.533 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.530+0000 7f198db54700 1 --2- 172.21.15.76:0/2102900446 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56093a8772d0 0x56093a896740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:45.533 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.530+0000 7f198db54700 1 -- 172.21.15.76:0/2102900446 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56093a647350 con 0x56093a875a80 2024-06-02T05:03:45.533 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.530+0000 7f198db54700 1 --2- 172.21.15.76:0/2102900446 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56093a875a80 0x56093a895460 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1984009760 tx=0x7f198401c6c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=745e45cf60fb1c17 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:03:45.533 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.530+0000 7f19717fa700 10 client.0 ms_handle_connect on v2:172.21.15.192:3300/0 2024-06-02T05:03:45.533 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.530+0000 7f19717fa700 1 -- 172.21.15.76:0/2102900446 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f198401d660 con 0x56093a875a80 2024-06-02T05:03:45.533 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.531+0000 7f19717fa700 1 -- 172.21.15.76:0/2102900446 <== mon.1 v2:172.21.15.192:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f198401cb70 con 0x56093a875a80 2024-06-02T05:03:45.533 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.531+0000 7f199bf73b80 1 -- 172.21.15.76:0/2102900446 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1980014d60 con 0x56093a875a80 2024-06-02T05:03:45.533 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.531+0000 7f19717fa700 1 -- 172.21.15.76:0/2102900446 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f198400ecd0 con 0x56093a875a80 2024-06-02T05:03:45.533 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.531+0000 7f199bf73b80 10 client.26176 fetch_fsmap learned FSMap version 36 2024-06-02T05:03:45.533 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.531+0000 7f199bf73b80 1 -- 172.21.15.76:0/2102900446 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x56093a64bc70 con 0x56093a875a80 2024-06-02T05:03:45.533 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.531+0000 7f19717fa700 1 -- 172.21.15.76:0/2102900446 <== mon.1 v2:172.21.15.192:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1980014d60 con 0x56093a875a80 2024-06-02T05:03:45.534 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.531+0000 7f19717fa700 1 -- 172.21.15.76:0/2102900446 <== mon.1 v2:172.21.15.192:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f19840367e0 con 0x56093a875a80 2024-06-02T05:03:45.534 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.531+0000 7f199bf73b80 10 client.26176 fetch_fsmap finished waiting for FSMap version 36 2024-06-02T05:03:45.534 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.531+0000 7f199bf73b80 10 client.26176 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T05:03:45.534 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.531+0000 7f199bf73b80 20 client.26176 populate_metadata read hostname 'smithi076' 2024-06-02T05:03:45.534 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.531+0000 7f199bf73b80 1 --2- 172.21.15.76:0/2102900446 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x56093a8f3280 0x56093a8f56a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:03:45.534 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.531+0000 7f199bf73b80 4 client.26176 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T05:03:45.534 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.531+0000 7f199bf73b80 1 -- 172.21.15.76:0/2102900446 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x56093a7bee60 con 0x56093a8f3280 2024-06-02T05:03:45.534 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.532+0000 7f198d353700 1 --2- 172.21.15.76:0/2102900446 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x56093a8f3280 0x56093a8f56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:03:45.534 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.532+0000 7f19717fa700 10 client.26176 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T05:03:45.535 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.532+0000 7f198d353700 1 --2- 172.21.15.76:0/2102900446 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x56093a8f3280 0x56093a8f56a0 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a413f2bfa2fedf59 server_cookie=7242c959345acb1 in_seq=0 out_seq=0 2024-06-02T05:03:45.555 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.555+0000 7f19717fa700 1 -- 172.21.15.76:0/2102900446 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x56093a7bee60 con 0x56093a8f3280 2024-06-02T05:03:45.555 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.555+0000 7f19717fa700 10 client.26176 handle_command_reply: tid=0 2024-06-02T05:03:45.556 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.555+0000 7f199bf73b80 1 client.26176 shutdown 2024-06-02T05:03:45.557 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.557+0000 7f199bf73b80 1 -- 172.21.15.76:0/2102900446 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56093a875a80 msgr2=0x56093a895460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:03:45.558 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.557+0000 7f199bf73b80 1 --2- 172.21.15.76:0/2102900446 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56093a875a80 0x56093a895460 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1984009760 tx=0x7f198401c6c0 comp rx=0 tx=0).stop 2024-06-02T05:03:45.562 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.561+0000 7f199bf73b80 1 -- 172.21.15.76:0/2102900446 shutdown_connections 2024-06-02T05:03:45.562 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.561+0000 7f199bf73b80 1 --2- 172.21.15.76:0/2102900446 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x56093a8f3280 0x56093a8f56a0 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:45.562 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.561+0000 7f199bf73b80 1 --2- 172.21.15.76:0/2102900446 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56093a8772d0 0x56093a896740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:45.562 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.561+0000 7f199bf73b80 1 --2- 172.21.15.76:0/2102900446 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56093a875a80 0x56093a895460 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:45.562 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.561+0000 7f199bf73b80 1 --2- 172.21.15.76:0/2102900446 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56093a8763e0 0x56093a895a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:45.562 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.561+0000 7f199bf73b80 1 -- 172.21.15.76:0/2102900446 >> 172.21.15.76:0/2102900446 conn(0x56093a7d41b0 msgr2=0x56093a88fe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:03:45.562 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.561+0000 7f19717fa700 0 client.26176 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T05:03:45.562 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.561+0000 7f199bf73b80 1 -- 172.21.15.76:0/2102900446 shutdown_connections 2024-06-02T05:03:45.562 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.561+0000 7f199bf73b80 1 -- 172.21.15.76:0/2102900446 wait complete. 2024-06-02T05:03:45.563 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.561+0000 7f199bf73b80 20 client.26176 trim_cache size 0 max 16384 2024-06-02T05:03:45.563 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:{ 2024-06-02T05:03:45.563 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "message": "", 2024-06-02T05:03:45.563 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "return_code": 0 2024-06-02T05:03:45.563 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:} 2024-06-02T05:03:45.571 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.570+0000 7f198fdb8700 1 -- 172.21.15.76:0/1817206531 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f19740a12a0 msgr2=0x7f19740a3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:03:45.571 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.570+0000 7f198fdb8700 1 --2- 172.21.15.76:0/1817206531 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f19740a12a0 0x7f19740a3760 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f198810fd70 tx=0x7f1984009a50 comp rx=0 tx=0).stop 2024-06-02T05:03:45.571 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.570+0000 7f198fdb8700 1 -- 172.21.15.76:0/1817206531 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1988108730 msgr2=0x7f19881bb980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:03:45.571 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.570+0000 7f198fdb8700 1 --2- 172.21.15.76:0/1817206531 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1988108730 0x7f19881bb980 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f197801a8f0 tx=0x7f197801a590 comp rx=0 tx=0).stop 2024-06-02T05:03:45.572 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.570+0000 7f198fdb8700 1 -- 172.21.15.76:0/1817206531 shutdown_connections 2024-06-02T05:03:45.572 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.570+0000 7f198fdb8700 1 --2- 172.21.15.76:0/1817206531 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f19740a12a0 0x7f19740a3760 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:45.572 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.570+0000 7f198fdb8700 1 --2- 172.21.15.76:0/1817206531 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f19881090d0 0x7f19881bdf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:45.572 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.570+0000 7f198fdb8700 1 --2- 172.21.15.76:0/1817206531 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1988107540 0x7f19881b9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:45.572 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.570+0000 7f198fdb8700 1 --2- 172.21.15.76:0/1817206531 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1988108730 0x7f19881bb980 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:45.572 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.570+0000 7f198fdb8700 1 -- 172.21.15.76:0/1817206531 >> 172.21.15.76:0/1817206531 conn(0x7f19880764d0 msgr2=0x7f198806ff00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:03:45.572 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.571+0000 7f198fdb8700 1 -- 172.21.15.76:0/1817206531 shutdown_connections 2024-06-02T05:03:45.572 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:45.571+0000 7f198fdb8700 1 -- 172.21.15.76:0/1817206531 wait complete. 2024-06-02T05:03:45.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:03:45 smithi076 ceph-mon[42935]: pgmap v693: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 10 MiB/s wr, 720 op/s 2024-06-02T05:03:46.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:03:45 smithi119 ceph-mon[46633]: pgmap v693: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 10 MiB/s wr, 720 op/s 2024-06-02T05:03:46.185 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:03:45 smithi192 ceph-mon[47933]: pgmap v693: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 10 MiB/s wr, 720 op/s 2024-06-02T05:03:46.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 775.0 s, 502.0 tps, lat 201.453 ms stddev 228.968 2024-06-02T05:03:47.987 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:03:47 smithi076 ceph-mon[42935]: pgmap v694: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 12 MiB/s wr, 865 op/s 2024-06-02T05:03:48.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:03:47 smithi119 ceph-mon[46633]: pgmap v694: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 12 MiB/s wr, 865 op/s 2024-06-02T05:03:48.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:03:47 smithi192 ceph-mon[47933]: pgmap v694: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 12 MiB/s wr, 865 op/s 2024-06-02T05:03:50.097 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:03:49 smithi119 ceph-mon[46633]: pgmap v695: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 8.9 MiB/s wr, 717 op/s 2024-06-02T05:03:50.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:03:49 smithi192 ceph-mon[47933]: pgmap v695: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 8.9 MiB/s wr, 717 op/s 2024-06-02T05:03:50.237 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:03:49 smithi076 ceph-mon[42935]: pgmap v695: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 8.9 MiB/s wr, 717 op/s 2024-06-02T05:03:51.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 780.0 s, 567.0 tps, lat 176.751 ms stddev 75.757 2024-06-02T05:03:52.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:03:51 smithi119 ceph-mon[46633]: pgmap v696: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 9.7 MiB/s wr, 819 op/s 2024-06-02T05:03:52.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:03:51 smithi192 ceph-mon[47933]: pgmap v696: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 9.7 MiB/s wr, 819 op/s 2024-06-02T05:03:52.235 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:03:51 smithi076 ceph-mon[42935]: pgmap v696: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 9.7 MiB/s wr, 819 op/s 2024-06-02T05:03:54.101 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:03:53 smithi119 ceph-mon[46633]: pgmap v697: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 11 MiB/s wr, 833 op/s 2024-06-02T05:03:54.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:03:53 smithi192 ceph-mon[47933]: pgmap v697: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 11 MiB/s wr, 833 op/s 2024-06-02T05:03:54.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:03:53 smithi076 ceph-mon[42935]: pgmap v697: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 11 MiB/s wr, 833 op/s 2024-06-02T05:03:56.097 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:03:55 smithi119 ceph-mon[46633]: pgmap v698: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 8.1 MiB/s wr, 708 op/s 2024-06-02T05:03:56.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:03:55 smithi192 ceph-mon[47933]: pgmap v698: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 8.1 MiB/s wr, 708 op/s 2024-06-02T05:03:56.236 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:03:55 smithi076 ceph-mon[42935]: pgmap v698: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 8.1 MiB/s wr, 708 op/s 2024-06-02T05:03:56.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 785.0 s, 596.8 tps, lat 166.464 ms stddev 74.731 2024-06-02T05:03:58.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:03:57 smithi119 ceph-mon[46633]: pgmap v699: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 9.8 MiB/s wr, 853 op/s 2024-06-02T05:03:58.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:03:57 smithi192 ceph-mon[47933]: pgmap v699: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 9.8 MiB/s wr, 853 op/s 2024-06-02T05:03:58.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:03:57 smithi076 ceph-mon[42935]: pgmap v699: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 9.8 MiB/s wr, 853 op/s 2024-06-02T05:03:58.857 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.852+0000 7f3880bb7700 1 -- 172.21.15.76:0/1016170598 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f387c0ffe00 msgr2=0x7f387c100220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:03:58.857 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.852+0000 7f3880bb7700 1 --2- 172.21.15.76:0/1016170598 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f387c0ffe00 0x7f387c100220 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f386c0099c0 tx=0x7f386c009cd0 comp rx=0 tx=0).stop 2024-06-02T05:03:58.857 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.854+0000 7f3880bb7700 1 -- 172.21.15.76:0/1016170598 shutdown_connections 2024-06-02T05:03:58.858 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.854+0000 7f3880bb7700 1 --2- 172.21.15.76:0/1016170598 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f387c101990 0x7f387c108240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:58.858 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.854+0000 7f3880bb7700 1 --2- 172.21.15.76:0/1016170598 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f387c0ffe00 0x7f387c100220 secure :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f386c0099c0 tx=0x7f386c009cd0 comp rx=0 tx=0).stop 2024-06-02T05:03:58.858 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.854+0000 7f3880bb7700 1 --2- 172.21.15.76:0/1016170598 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f387c100ff0 0x7f387c101450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:58.858 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.854+0000 7f3880bb7700 1 -- 172.21.15.76:0/1016170598 >> 172.21.15.76:0/1016170598 conn(0x7f387c0fb390 msgr2=0x7f387c0fd7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:03:58.858 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.854+0000 7f3880bb7700 1 -- 172.21.15.76:0/1016170598 shutdown_connections 2024-06-02T05:03:58.858 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.854+0000 7f3880bb7700 1 -- 172.21.15.76:0/1016170598 wait complete. 2024-06-02T05:03:58.858 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.855+0000 7f3880bb7700 1 Processor -- start 2024-06-02T05:03:58.858 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.855+0000 7f3880bb7700 1 -- start start 2024-06-02T05:03:58.858 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.855+0000 7f3880bb7700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f387c100ff0 0x7f387c06fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:03:58.858 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.855+0000 7f3880bb7700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f387c101990 0x7f387c070080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:03:58.859 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.855+0000 7f3880bb7700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f387c1a2df0 0x7f387c1a5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:03:58.859 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.855+0000 7f3880bb7700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f387c070780 con 0x7f387c1a2df0 2024-06-02T05:03:58.859 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.855+0000 7f3880bb7700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f387c1a57c0 con 0x7f387c100ff0 2024-06-02T05:03:58.859 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.855+0000 7f3880bb7700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f387c1a5980 con 0x7f387c101990 2024-06-02T05:03:58.859 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.856+0000 7f387a59c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f387c100ff0 0x7f387c06fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:03:58.859 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.856+0000 7f387a59c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f387c100ff0 0x7f387c06fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:40728/0 (socket says 172.21.15.76:40728) 2024-06-02T05:03:58.859 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.856+0000 7f387a59c700 1 -- 172.21.15.76:0/84457413 learned_addr learned my addr 172.21.15.76:0/84457413 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:03:58.859 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.856+0000 7f3879d9b700 1 --2- 172.21.15.76:0/84457413 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f387c101990 0x7f387c070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:03:58.859 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.856+0000 7f387a59c700 1 -- 172.21.15.76:0/84457413 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f387c101990 msgr2=0x7f387c070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:03:58.859 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.856+0000 7f387a59c700 1 --2- 172.21.15.76:0/84457413 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f387c101990 0x7f387c070080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:58.859 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.856+0000 7f387a59c700 1 -- 172.21.15.76:0/84457413 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f387c1a2df0 msgr2=0x7f387c1a5280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:03:58.859 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.856+0000 7f387a59c700 1 --2- 172.21.15.76:0/84457413 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f387c1a2df0 0x7f387c1a5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:58.859 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.856+0000 7f387a59c700 1 -- 172.21.15.76:0/84457413 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f386c0095f0 con 0x7f387c100ff0 2024-06-02T05:03:58.860 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.856+0000 7f387a59c700 1 --2- 172.21.15.76:0/84457413 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f387c100ff0 0x7f387c06fb40 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f386c006010 tx=0x7f386c0057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:03:58.860 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.857+0000 7f38737fe700 1 -- 172.21.15.76:0/84457413 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f386c01d070 con 0x7f387c100ff0 2024-06-02T05:03:58.860 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.857+0000 7f38737fe700 1 -- 172.21.15.76:0/84457413 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f386c004090 con 0x7f387c100ff0 2024-06-02T05:03:58.860 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.857+0000 7f38737fe700 1 -- 172.21.15.76:0/84457413 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f386c00fca0 con 0x7f387c100ff0 2024-06-02T05:03:58.860 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.857+0000 7f3880bb7700 1 -- 172.21.15.76:0/84457413 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f387c1a5c00 con 0x7f387c100ff0 2024-06-02T05:03:58.860 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.857+0000 7f3880bb7700 1 -- 172.21.15.76:0/84457413 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f387c1a60e0 con 0x7f387c100ff0 2024-06-02T05:03:58.861 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.860+0000 7f38737fe700 1 -- 172.21.15.76:0/84457413 <== mon.2 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f386c00f460 con 0x7f387c100ff0 2024-06-02T05:03:58.863 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.862+0000 7f38737fe700 1 --2- 172.21.15.76:0/84457413 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f38680a12a0 0x7f38680a3760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:03:58.863 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.862+0000 7f38737fe700 1 -- 172.21.15.76:0/84457413 <== mon.2 v2:172.21.15.119:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f386c0cd9f0 con 0x7f387c100ff0 2024-06-02T05:03:58.863 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.862+0000 7f3879d9b700 1 --2- 172.21.15.76:0/84457413 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f38680a12a0 0x7f38680a3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:03:58.863 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.863+0000 7f3879d9b700 1 --2- 172.21.15.76:0/84457413 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f38680a12a0 0x7f38680a3760 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f3864009910 tx=0x7f3864008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:03:58.863 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.863+0000 7f388cd72b80 1 Processor -- start 2024-06-02T05:03:58.864 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.863+0000 7f388cd72b80 1 -- start start 2024-06-02T05:03:58.864 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.863+0000 7f388cd72b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562cf851da80 0x562cf851dea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:03:58.864 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.863+0000 7f388cd72b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562cf851e3e0 0x562cf851ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:03:58.864 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.863+0000 7f388cd72b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562cf851f2d0 0x562cf851f750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:03:58.864 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.863+0000 7f388cd72b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x562cf84750f0 con 0x562cf851f2d0 2024-06-02T05:03:58.864 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.863+0000 7f388cd72b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x562cf8472ab0 con 0x562cf851da80 2024-06-02T05:03:58.864 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.863+0000 7f388cd72b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x562cf846e3a0 con 0x562cf851e3e0 2024-06-02T05:03:58.865 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.863+0000 7f387a59c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562cf851da80 0x562cf851dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:03:58.865 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.863+0000 7f387a59c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562cf851da80 0x562cf851dea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:40738/0 (socket says 172.21.15.76:40738) 2024-06-02T05:03:58.865 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.863+0000 7f387a59c700 1 -- 172.21.15.76:0/1627091360 learned_addr learned my addr 172.21.15.76:0/1627091360 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:03:58.866 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.863+0000 7f3879d9b700 1 --2- 172.21.15.76:0/1627091360 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562cf851e3e0 0x562cf851ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:03:58.866 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.864+0000 7f387a59c700 1 -- 172.21.15.76:0/1627091360 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562cf851e3e0 msgr2=0x562cf851ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:03:58.866 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.864+0000 7f387a59c700 1 --2- 172.21.15.76:0/1627091360 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562cf851e3e0 0x562cf851ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:58.866 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.864+0000 7f387a59c700 1 -- 172.21.15.76:0/1627091360 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562cf851f2d0 msgr2=0x562cf851f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:03:58.866 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.864+0000 7f387a59c700 1 --2- 172.21.15.76:0/1627091360 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562cf851f2d0 0x562cf851f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:58.866 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.864+0000 7f387a59c700 1 -- 172.21.15.76:0/1627091360 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562cf82ef350 con 0x562cf851da80 2024-06-02T05:03:58.866 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.864+0000 7f387a59c700 1 --2- 172.21.15.76:0/1627091360 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562cf851da80 0x562cf851dea0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f386c09a890 tx=0x7f386c009310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a81491439c4a419c server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:03:58.866 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.864+0000 7f3870ff9700 1 -- 172.21.15.76:0/1627091360 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f386c09ab90 con 0x562cf851da80 2024-06-02T05:03:58.866 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.864+0000 7f3870ff9700 1 -- 172.21.15.76:0/1627091360 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f386c09e9c0 con 0x562cf851da80 2024-06-02T05:03:58.866 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.864+0000 7f3870ff9700 1 -- 172.21.15.76:0/1627091360 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f386c09b050 con 0x562cf851da80 2024-06-02T05:03:58.867 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.865+0000 7f388cd72b80 1 -- 172.21.15.76:0/1627091360 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562cf851da80 msgr2=0x562cf851dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:03:58.867 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.865+0000 7f388cd72b80 1 --2- 172.21.15.76:0/1627091360 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562cf851da80 0x562cf851dea0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f386c09a890 tx=0x7f386c009310 comp rx=0 tx=0).stop 2024-06-02T05:03:58.867 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.866+0000 7f388cd72b80 1 -- 172.21.15.76:0/1627091360 shutdown_connections 2024-06-02T05:03:58.867 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.866+0000 7f388cd72b80 1 --2- 172.21.15.76:0/1627091360 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562cf851f2d0 0x562cf851f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:58.867 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.866+0000 7f388cd72b80 1 --2- 172.21.15.76:0/1627091360 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562cf851da80 0x562cf851dea0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:58.867 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.866+0000 7f388cd72b80 1 --2- 172.21.15.76:0/1627091360 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562cf851e3e0 0x562cf851ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:58.867 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.866+0000 7f388cd72b80 1 -- 172.21.15.76:0/1627091360 >> 172.21.15.76:0/1627091360 conn(0x562cf847c1b0 msgr2=0x562cf851a440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:03:58.868 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.866+0000 7f388cd72b80 1 -- 172.21.15.76:0/1627091360 shutdown_connections 2024-06-02T05:03:58.868 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.866+0000 7f388cd72b80 1 -- 172.21.15.76:0/1627091360 wait complete. 2024-06-02T05:03:58.868 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.866+0000 7f388cd72b80 1 -- start start 2024-06-02T05:03:58.868 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.866+0000 7f388cd72b80 1 Processor -- start 2024-06-02T05:03:58.869 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.866+0000 7f388cd72b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562cf851da80 0x562cf8527590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:03:58.869 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.866+0000 7f388cd72b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562cf851e3e0 0x562cf8527ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:03:58.870 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.866+0000 7f388cd72b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562cf851f2d0 0x562cf852eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:03:58.870 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.866+0000 7f388cd72b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x562cf840a500 con 0x562cf851f2d0 2024-06-02T05:03:58.870 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.866+0000 7f388cd72b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x562cf840a1a0 con 0x562cf851e3e0 2024-06-02T05:03:58.870 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.866+0000 7f388cd72b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x562cf82f1640 con 0x562cf851da80 2024-06-02T05:03:58.870 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.867+0000 7f388cd72b80 10 client.0 _ll_register_callbacks cb 0x562cf8413ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T05:03:58.870 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.867+0000 7f3879d9b700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562cf851e3e0 0x562cf8527ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:03:58.870 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.867+0000 7f3879d9b700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562cf851e3e0 0x562cf8527ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:40748/0 (socket says 172.21.15.76:40748) 2024-06-02T05:03:58.870 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.867+0000 7f3879d9b700 1 -- 172.21.15.76:0/1674871606 learned_addr learned my addr 172.21.15.76:0/1674871606 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:03:58.870 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.867+0000 7f3879d9b700 1 -- 172.21.15.76:0/1674871606 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562cf851da80 msgr2=0x562cf8527590 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-02T05:03:58.870 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.867+0000 7f3879d9b700 1 --2- 172.21.15.76:0/1674871606 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562cf851da80 0x562cf8527590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:58.870 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.867+0000 7f3879d9b700 1 -- 172.21.15.76:0/1674871606 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562cf851f2d0 msgr2=0x562cf852eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:03:58.871 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.867+0000 7f3879d9b700 1 --2- 172.21.15.76:0/1674871606 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562cf851f2d0 0x562cf852eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:58.871 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.867+0000 7f3879d9b700 1 -- 172.21.15.76:0/1674871606 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f387c1a60e0 con 0x562cf851e3e0 2024-06-02T05:03:58.871 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.867+0000 7f3879d9b700 1 --2- 172.21.15.76:0/1674871606 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562cf851e3e0 0x562cf8527ad0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3864007fd0 tx=0x7f38640047e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72ec6b3fb33a3cfb server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:03:58.871 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.867+0000 7f3861ffb700 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-06-02T05:03:58.871 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.867+0000 7f3861ffb700 1 -- 172.21.15.76:0/1674871606 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f386400deb0 con 0x562cf851e3e0 2024-06-02T05:03:58.871 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.867+0000 7f3861ffb700 1 -- 172.21.15.76:0/1674871606 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f3864014db0 con 0x562cf851e3e0 2024-06-02T05:03:58.871 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.867+0000 7f388cd72b80 1 -- 172.21.15.76:0/1674871606 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562cf83c7210 con 0x562cf851e3e0 2024-06-02T05:03:58.871 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.868+0000 7f3861ffb700 1 -- 172.21.15.76:0/1674871606 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3864021480 con 0x562cf851e3e0 2024-06-02T05:03:58.871 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.868+0000 7f388cd72b80 10 client.26225 fetch_fsmap learned FSMap version 36 2024-06-02T05:03:58.871 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.868+0000 7f388cd72b80 1 -- 172.21.15.76:0/1674871606 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x562cf829bb00 con 0x562cf851e3e0 2024-06-02T05:03:58.871 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.868+0000 7f3861ffb700 1 -- 172.21.15.76:0/1674871606 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x562cf83c7210 con 0x562cf851e3e0 2024-06-02T05:03:58.871 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.868+0000 7f3861ffb700 1 -- 172.21.15.76:0/1674871606 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f3864020610 con 0x562cf851e3e0 2024-06-02T05:03:58.871 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.868+0000 7f388cd72b80 10 client.26225 fetch_fsmap finished waiting for FSMap version 36 2024-06-02T05:03:58.872 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.868+0000 7f388cd72b80 10 client.26225 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T05:03:58.872 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.868+0000 7f388cd72b80 20 client.26225 populate_metadata read hostname 'smithi076' 2024-06-02T05:03:58.872 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.868+0000 7f388cd72b80 1 --2- 172.21.15.76:0/1674871606 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x562cf8533440 0x562cf8535860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:03:58.872 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.868+0000 7f388cd72b80 4 client.26225 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T05:03:58.872 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.868+0000 7f388cd72b80 1 -- 172.21.15.76:0/1674871606 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562cf84ed7b0 con 0x562cf8533440 2024-06-02T05:03:58.872 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.871+0000 7f387a59c700 1 --2- 172.21.15.76:0/1674871606 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x562cf8533440 0x562cf8535860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:03:58.872 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.872+0000 7f3861ffb700 10 client.26225 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T05:03:58.873 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.872+0000 7f387a59c700 1 --2- 172.21.15.76:0/1674871606 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x562cf8533440 0x562cf8535860 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b4284cecb306497f server_cookie=403df3f0c5bddd83 in_seq=0 out_seq=0 2024-06-02T05:03:58.873 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.872+0000 7f3861ffb700 1 -- 172.21.15.76:0/1674871606 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x562cf84ed7b0 con 0x562cf8533440 2024-06-02T05:03:58.873 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.872+0000 7f3861ffb700 10 client.26225 handle_command_reply: tid=0 2024-06-02T05:03:58.873 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.872+0000 7f388cd72b80 1 client.26225 shutdown 2024-06-02T05:03:58.874 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.872+0000 7f388cd72b80 1 -- 172.21.15.76:0/1674871606 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562cf851e3e0 msgr2=0x562cf8527ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:03:58.874 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.872+0000 7f388cd72b80 1 --2- 172.21.15.76:0/1674871606 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562cf851e3e0 0x562cf8527ad0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3864007fd0 tx=0x7f38640047e0 comp rx=0 tx=0).stop 2024-06-02T05:03:58.885 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.877+0000 7f388cd72b80 1 -- 172.21.15.76:0/1674871606 shutdown_connections 2024-06-02T05:03:58.885 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.877+0000 7f388cd72b80 1 --2- 172.21.15.76:0/1674871606 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x562cf8533440 0x562cf8535860 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:58.885 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.877+0000 7f388cd72b80 1 --2- 172.21.15.76:0/1674871606 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562cf851f2d0 0x562cf852eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:58.885 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.877+0000 7f388cd72b80 1 --2- 172.21.15.76:0/1674871606 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562cf851da80 0x562cf8527590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:58.885 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.877+0000 7f388cd72b80 1 --2- 172.21.15.76:0/1674871606 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562cf851e3e0 0x562cf8527ad0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:58.885 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.877+0000 7f388cd72b80 1 -- 172.21.15.76:0/1674871606 >> 172.21.15.76:0/1674871606 conn(0x562cf847c1b0 msgr2=0x562cf8518860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:03:58.885 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.877+0000 7f3861ffb700 0 client.26225 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T05:03:58.885 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.881+0000 7f388cd72b80 1 -- 172.21.15.76:0/1674871606 shutdown_connections 2024-06-02T05:03:58.885 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.881+0000 7f388cd72b80 1 -- 172.21.15.76:0/1674871606 wait complete. 2024-06-02T05:03:58.886 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.885+0000 7f388cd72b80 20 client.26225 trim_cache size 0 max 16384 2024-06-02T05:03:58.917 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.915+0000 7f388cd72b80 1 Processor -- start 2024-06-02T05:03:58.918 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.917+0000 7f388cd72b80 1 -- start start 2024-06-02T05:03:58.918 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.917+0000 7f388cd72b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562cf851da80 0x562cf8526aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:03:58.918 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.917+0000 7f388cd72b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562cf851e3e0 0x562cf852ea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:03:58.918 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.917+0000 7f388cd72b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562cf851f2d0 0x562cf8526260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:03:58.918 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.917+0000 7f388cd72b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x562cf85159f0 con 0x562cf851e3e0 2024-06-02T05:03:58.918 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.917+0000 7f388cd72b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x562cf85284c0 con 0x562cf851da80 2024-06-02T05:03:58.918 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.917+0000 7f388cd72b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x562cf852ef70 con 0x562cf851f2d0 2024-06-02T05:03:58.919 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.917+0000 7f387ad9d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562cf851f2d0 0x562cf8526260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:03:58.919 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.917+0000 7f387ad9d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562cf851f2d0 0x562cf8526260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:50508/0 (socket says 172.21.15.76:50508) 2024-06-02T05:03:58.919 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.917+0000 7f387ad9d700 1 -- 172.21.15.76:0/4194703045 learned_addr learned my addr 172.21.15.76:0/4194703045 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:03:58.919 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.917+0000 7f3879d9b700 1 --2- 172.21.15.76:0/4194703045 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562cf851e3e0 0x562cf852ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:03:58.920 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.918+0000 7f387ad9d700 1 -- 172.21.15.76:0/4194703045 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562cf851da80 msgr2=0x562cf8526aa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-02T05:03:58.920 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.918+0000 7f387ad9d700 1 --2- 172.21.15.76:0/4194703045 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562cf851da80 0x562cf8526aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:58.920 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.918+0000 7f387ad9d700 1 -- 172.21.15.76:0/4194703045 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562cf851e3e0 msgr2=0x562cf852ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:03:58.920 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.918+0000 7f387ad9d700 1 --2- 172.21.15.76:0/4194703045 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562cf851e3e0 0x562cf852ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:58.920 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.918+0000 7f387ad9d700 1 -- 172.21.15.76:0/4194703045 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562cf8434500 con 0x562cf851f2d0 2024-06-02T05:03:58.920 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.918+0000 7f3879d9b700 1 --2- 172.21.15.76:0/4194703045 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562cf851e3e0 0x562cf852ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T05:03:58.920 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.918+0000 7f387ad9d700 1 --2- 172.21.15.76:0/4194703045 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562cf851f2d0 0x562cf8526260 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f3874009b40 tx=0x7f3874009e50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6cc777d003f9c9f3 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:03:58.920 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.918+0000 7f38717fa700 1 -- 172.21.15.76:0/4194703045 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f387400e070 con 0x562cf851f2d0 2024-06-02T05:03:58.920 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.919+0000 7f38717fa700 1 -- 172.21.15.76:0/4194703045 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3874009670 con 0x562cf851f2d0 2024-06-02T05:03:58.920 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.919+0000 7f38717fa700 1 -- 172.21.15.76:0/4194703045 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3874012ba0 con 0x562cf851f2d0 2024-06-02T05:03:58.922 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.921+0000 7f388cd72b80 1 -- 172.21.15.76:0/4194703045 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562cf851f2d0 msgr2=0x562cf8526260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:03:58.923 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.921+0000 7f388cd72b80 1 --2- 172.21.15.76:0/4194703045 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562cf851f2d0 0x562cf8526260 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f3874009b40 tx=0x7f3874009e50 comp rx=0 tx=0).stop 2024-06-02T05:03:58.923 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.921+0000 7f388cd72b80 1 -- 172.21.15.76:0/4194703045 shutdown_connections 2024-06-02T05:03:58.923 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.921+0000 7f388cd72b80 1 --2- 172.21.15.76:0/4194703045 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562cf851f2d0 0x562cf8526260 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:58.923 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.921+0000 7f388cd72b80 1 --2- 172.21.15.76:0/4194703045 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562cf851da80 0x562cf8526aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:58.923 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.921+0000 7f388cd72b80 1 --2- 172.21.15.76:0/4194703045 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562cf851e3e0 0x562cf852ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:58.923 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.921+0000 7f388cd72b80 1 -- 172.21.15.76:0/4194703045 >> 172.21.15.76:0/4194703045 conn(0x562cf847c1b0 msgr2=0x562cf85258d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:03:58.923 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.921+0000 7f388cd72b80 1 -- 172.21.15.76:0/4194703045 shutdown_connections 2024-06-02T05:03:58.923 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.922+0000 7f388cd72b80 1 -- 172.21.15.76:0/4194703045 wait complete. 2024-06-02T05:03:58.923 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.922+0000 7f388cd72b80 1 -- start start 2024-06-02T05:03:58.923 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.922+0000 7f388cd72b80 1 Processor -- start 2024-06-02T05:03:58.924 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.922+0000 7f388cd72b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562cf851da80 0x562cf852c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:03:58.924 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.922+0000 7f388cd72b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562cf851e3e0 0x562cf852cb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:03:58.924 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.922+0000 7f388cd72b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562cf851f2d0 0x562cf852d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:03:58.925 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.922+0000 7f388cd72b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x562cf852df20 con 0x562cf851e3e0 2024-06-02T05:03:58.925 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.922+0000 7f388cd72b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x562cf852e090 con 0x562cf851da80 2024-06-02T05:03:58.925 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.922+0000 7f388cd72b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x562cf852e250 con 0x562cf851f2d0 2024-06-02T05:03:58.925 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.922+0000 7f388cd72b80 10 client.0 _ll_register_callbacks cb 0x562cf8413ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T05:03:58.925 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.923+0000 7f387ad9d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562cf851f2d0 0x562cf852d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:03:58.925 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.923+0000 7f387a59c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562cf851da80 0x562cf852c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:03:58.925 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.923+0000 7f387ad9d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562cf851f2d0 0x562cf852d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:50514/0 (socket says 172.21.15.76:50514) 2024-06-02T05:03:58.925 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.923+0000 7f387ad9d700 1 -- 172.21.15.76:0/3736679116 learned_addr learned my addr 172.21.15.76:0/3736679116 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:03:58.925 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.923+0000 7f387ad9d700 1 -- 172.21.15.76:0/3736679116 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562cf851da80 msgr2=0x562cf852c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:03:58.925 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.923+0000 7f387ad9d700 1 --2- 172.21.15.76:0/3736679116 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562cf851da80 0x562cf852c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:58.925 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.923+0000 7f387ad9d700 1 -- 172.21.15.76:0/3736679116 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562cf851e3e0 msgr2=0x562cf852cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:03:58.925 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.923+0000 7f387ad9d700 1 --2- 172.21.15.76:0/3736679116 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562cf851e3e0 0x562cf852cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:58.926 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.923+0000 7f387ad9d700 1 -- 172.21.15.76:0/3736679116 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562cf829bb00 con 0x562cf851f2d0 2024-06-02T05:03:58.926 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.923+0000 7f387ad9d700 1 --2- 172.21.15.76:0/3736679116 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562cf851f2d0 0x562cf852d9e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3874012470 tx=0x7f387400b9b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=57e528ed2c30bde9 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:03:58.926 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.923+0000 7f3861ffb700 10 client.0 ms_handle_connect on v2:172.21.15.192:3300/0 2024-06-02T05:03:58.926 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.923+0000 7f3861ffb700 1 -- 172.21.15.76:0/3736679116 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f387400e040 con 0x562cf851f2d0 2024-06-02T05:03:58.926 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.923+0000 7f3861ffb700 1 -- 172.21.15.76:0/3736679116 <== mon.1 v2:172.21.15.192:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f387401b420 con 0x562cf851f2d0 2024-06-02T05:03:58.926 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.924+0000 7f388cd72b80 1 -- 172.21.15.76:0/3736679116 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562cf8466e60 con 0x562cf851f2d0 2024-06-02T05:03:58.927 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.924+0000 7f3861ffb700 1 -- 172.21.15.76:0/3736679116 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3874009670 con 0x562cf851f2d0 2024-06-02T05:03:58.927 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.924+0000 7f388cd72b80 10 client.26188 fetch_fsmap learned FSMap version 36 2024-06-02T05:03:58.927 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.924+0000 7f388cd72b80 1 -- 172.21.15.76:0/3736679116 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x7f38740097f0 con 0x562cf851f2d0 2024-06-02T05:03:58.927 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.924+0000 7f3861ffb700 1 -- 172.21.15.76:0/3736679116 <== mon.1 v2:172.21.15.192:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x562cf8466e60 con 0x562cf851f2d0 2024-06-02T05:03:58.927 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.924+0000 7f3861ffb700 1 -- 172.21.15.76:0/3736679116 <== mon.1 v2:172.21.15.192:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f3874027600 con 0x562cf851f2d0 2024-06-02T05:03:58.927 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.924+0000 7f388cd72b80 10 client.26188 fetch_fsmap finished waiting for FSMap version 36 2024-06-02T05:03:58.927 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.924+0000 7f388cd72b80 10 client.26188 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T05:03:58.928 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.924+0000 7f388cd72b80 20 client.26188 populate_metadata read hostname 'smithi076' 2024-06-02T05:03:58.928 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.924+0000 7f388cd72b80 1 --2- 172.21.15.76:0/3736679116 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x562cf858a500 0x562cf858c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:03:58.928 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.924+0000 7f388cd72b80 4 client.26188 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T05:03:58.928 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.924+0000 7f388cd72b80 1 -- 172.21.15.76:0/3736679116 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x562cf82bcc90 con 0x562cf858a500 2024-06-02T05:03:58.928 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.925+0000 7f387a59c700 1 --2- 172.21.15.76:0/3736679116 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x562cf858a500 0x562cf858c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:03:58.928 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.925+0000 7f3861ffb700 10 client.26188 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T05:03:58.928 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.925+0000 7f387a59c700 1 --2- 172.21.15.76:0/3736679116 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x562cf858a500 0x562cf858c920 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2993bbf79de4a9fd server_cookie=974edcd317ce34bd in_seq=0 out_seq=0 2024-06-02T05:03:58.959 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.952+0000 7f3861ffb700 1 -- 172.21.15.76:0/3736679116 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x562cf82bcc90 con 0x562cf858a500 2024-06-02T05:03:58.960 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.952+0000 7f3861ffb700 10 client.26188 handle_command_reply: tid=0 2024-06-02T05:03:58.960 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.958+0000 7f388cd72b80 1 client.26188 shutdown 2024-06-02T05:03:58.965 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.962+0000 7f388cd72b80 1 -- 172.21.15.76:0/3736679116 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562cf851f2d0 msgr2=0x562cf852d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:03:58.965 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.962+0000 7f388cd72b80 1 --2- 172.21.15.76:0/3736679116 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562cf851f2d0 0x562cf852d9e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3874012470 tx=0x7f387400b9b0 comp rx=0 tx=0).stop 2024-06-02T05:03:58.965 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.962+0000 7f388cd72b80 1 -- 172.21.15.76:0/3736679116 shutdown_connections 2024-06-02T05:03:58.965 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.962+0000 7f388cd72b80 1 --2- 172.21.15.76:0/3736679116 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x562cf858a500 0x562cf858c920 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:58.965 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.962+0000 7f388cd72b80 1 --2- 172.21.15.76:0/3736679116 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562cf851f2d0 0x562cf852d9e0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:58.965 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.962+0000 7f388cd72b80 1 --2- 172.21.15.76:0/3736679116 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562cf851da80 0x562cf852c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:58.966 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.962+0000 7f388cd72b80 1 --2- 172.21.15.76:0/3736679116 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562cf851e3e0 0x562cf852cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:58.966 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.962+0000 7f388cd72b80 1 -- 172.21.15.76:0/3736679116 >> 172.21.15.76:0/3736679116 conn(0x562cf847c1b0 msgr2=0x562cf851a020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:03:58.966 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.962+0000 7f3861ffb700 0 client.26188 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T05:03:58.966 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.965+0000 7f388cd72b80 1 -- 172.21.15.76:0/3736679116 shutdown_connections 2024-06-02T05:03:58.975 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:{ 2024-06-02T05:03:58.975 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "message": "", 2024-06-02T05:03:58.975 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "return_code": 0 2024-06-02T05:03:58.975 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:} 2024-06-02T05:03:58.975 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.972+0000 7f388cd72b80 1 -- 172.21.15.76:0/3736679116 wait complete. 2024-06-02T05:03:58.975 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.974+0000 7f388cd72b80 20 client.26188 trim_cache size 0 max 16384 2024-06-02T05:03:58.976 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.975+0000 7f3880bb7700 1 -- 172.21.15.76:0/84457413 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f38680a12a0 msgr2=0x7f38680a3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:03:58.976 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.975+0000 7f3880bb7700 1 --2- 172.21.15.76:0/84457413 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f38680a12a0 0x7f38680a3760 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f3864009910 tx=0x7f3864008040 comp rx=0 tx=0).stop 2024-06-02T05:03:58.976 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.975+0000 7f3880bb7700 1 -- 172.21.15.76:0/84457413 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f387c100ff0 msgr2=0x7f387c06fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:03:58.976 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.975+0000 7f3880bb7700 1 --2- 172.21.15.76:0/84457413 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f387c100ff0 0x7f387c06fb40 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f386c006010 tx=0x7f386c0057f0 comp rx=0 tx=0).stop 2024-06-02T05:03:58.976 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.976+0000 7f3880bb7700 1 -- 172.21.15.76:0/84457413 shutdown_connections 2024-06-02T05:03:58.977 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.976+0000 7f3880bb7700 1 --2- 172.21.15.76:0/84457413 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f387c1a2df0 0x7f387c1a5280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:58.977 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.976+0000 7f3880bb7700 1 --2- 172.21.15.76:0/84457413 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f38680a12a0 0x7f38680a3760 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:58.977 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.976+0000 7f3880bb7700 1 --2- 172.21.15.76:0/84457413 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f387c100ff0 0x7f387c06fb40 secure :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f386c006010 tx=0x7f386c0057f0 comp rx=0 tx=0).stop 2024-06-02T05:03:58.977 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.976+0000 7f3880bb7700 1 --2- 172.21.15.76:0/84457413 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f387c101990 0x7f387c070080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:03:58.977 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.976+0000 7f3880bb7700 1 -- 172.21.15.76:0/84457413 >> 172.21.15.76:0/84457413 conn(0x7f387c0fb390 msgr2=0x7f387c0fcc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:03:58.983 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.978+0000 7f3880bb7700 1 -- 172.21.15.76:0/84457413 shutdown_connections 2024-06-02T05:03:58.983 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:03:58.980+0000 7f3880bb7700 1 -- 172.21.15.76:0/84457413 wait complete. 2024-06-02T05:04:00.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:03:59 smithi119 ceph-mon[46633]: pgmap v700: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 8.8 MiB/s wr, 729 op/s 2024-06-02T05:04:00.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:03:59 smithi192 ceph-mon[47933]: pgmap v700: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 8.8 MiB/s wr, 729 op/s 2024-06-02T05:04:00.239 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:03:59 smithi076 ceph-mon[42935]: pgmap v700: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 8.8 MiB/s wr, 729 op/s 2024-06-02T05:04:01.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 790.0 s, 531.2 tps, lat 187.818 ms stddev 116.641 2024-06-02T05:04:02.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:04:01 smithi119 ceph-mon[46633]: pgmap v701: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 10 MiB/s wr, 830 op/s 2024-06-02T05:04:02.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:04:01 smithi192 ceph-mon[47933]: pgmap v701: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 10 MiB/s wr, 830 op/s 2024-06-02T05:04:02.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:04:01 smithi076 ceph-mon[42935]: pgmap v701: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 10 MiB/s wr, 830 op/s 2024-06-02T05:04:04.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:04:03 smithi119 ceph-mon[46633]: pgmap v702: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 9.8 MiB/s wr, 789 op/s 2024-06-02T05:04:04.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:04:03 smithi192 ceph-mon[47933]: pgmap v702: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 9.8 MiB/s wr, 789 op/s 2024-06-02T05:04:04.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:04:03 smithi076 ceph-mon[42935]: pgmap v702: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 9.8 MiB/s wr, 789 op/s 2024-06-02T05:04:05.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:04:04 smithi119 ceph-mon[46633]: pgmap v703: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 7.9 MiB/s wr, 678 op/s 2024-06-02T05:04:05.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:04:04 smithi192 ceph-mon[47933]: pgmap v703: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 7.9 MiB/s wr, 678 op/s 2024-06-02T05:04:05.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:04:04 smithi076 ceph-mon[42935]: pgmap v703: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 7.9 MiB/s wr, 678 op/s 2024-06-02T05:04:06.316 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 795.0 s, 522.0 tps, lat 191.125 ms stddev 68.617 2024-06-02T05:04:08.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:04:07 smithi119 ceph-mon[46633]: pgmap v704: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 9.3 MiB/s wr, 815 op/s 2024-06-02T05:04:08.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:04:07 smithi192 ceph-mon[47933]: pgmap v704: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 9.3 MiB/s wr, 815 op/s 2024-06-02T05:04:08.237 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:04:07 smithi076 ceph-mon[42935]: pgmap v704: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 9.3 MiB/s wr, 815 op/s 2024-06-02T05:04:10.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:04:09 smithi119 ceph-mon[46633]: pgmap v705: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 7.8 MiB/s wr, 683 op/s 2024-06-02T05:04:10.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:04:09 smithi192 ceph-mon[47933]: pgmap v705: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 7.8 MiB/s wr, 683 op/s 2024-06-02T05:04:10.235 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:04:09 smithi076 ceph-mon[42935]: pgmap v705: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 7.8 MiB/s wr, 683 op/s 2024-06-02T05:04:11.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 800.0 s, 497.6 tps, lat 201.627 ms stddev 84.394 2024-06-02T05:04:12.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:04:11 smithi119 ceph-mon[46633]: pgmap v706: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 8.2 MiB/s wr, 767 op/s 2024-06-02T05:04:12.151 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.151+0000 7f32eec0a700 1 -- 172.21.15.76:0/2502126737 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f32e8108730 msgr2=0x7f32e8108b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:04:12.152 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.151+0000 7f32eec0a700 1 --2- 172.21.15.76:0/2502126737 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f32e8108730 0x7f32e8108b90 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f32d40099c0 tx=0x7f32d4009cd0 comp rx=0 tx=0).stop 2024-06-02T05:04:12.154 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.154+0000 7f32eec0a700 1 -- 172.21.15.76:0/2502126737 shutdown_connections 2024-06-02T05:04:12.154 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.154+0000 7f32eec0a700 1 --2- 172.21.15.76:0/2502126737 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f32e81090d0 0x7f32e810f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:12.155 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.154+0000 7f32eec0a700 1 --2- 172.21.15.76:0/2502126737 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f32e8107540 0x7f32e8107960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:12.155 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.154+0000 7f32eec0a700 1 --2- 172.21.15.76:0/2502126737 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f32e8108730 0x7f32e8108b90 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:12.155 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.154+0000 7f32eec0a700 1 -- 172.21.15.76:0/2502126737 >> 172.21.15.76:0/2502126737 conn(0x7f32e80764d0 msgr2=0x7f32e8078910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:04:12.156 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.155+0000 7f32eec0a700 1 -- 172.21.15.76:0/2502126737 shutdown_connections 2024-06-02T05:04:12.156 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.155+0000 7f32eec0a700 1 -- 172.21.15.76:0/2502126737 wait complete. 2024-06-02T05:04:12.157 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.156+0000 7f32eec0a700 1 Processor -- start 2024-06-02T05:04:12.157 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.156+0000 7f32eec0a700 1 -- start start 2024-06-02T05:04:12.157 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.156+0000 7f32eec0a700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f32e8107540 0x7f32e807e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:04:12.157 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.157+0000 7f32eec0a700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f32e8108730 0x7f32e807ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:04:12.158 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.157+0000 7f32eec0a700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f32e81090d0 0x7f32e81ad4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:04:12.158 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.157+0000 7f32eec0a700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32e8081cf0 con 0x7f32e8107540 2024-06-02T05:04:12.158 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.157+0000 7f32eec0a700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32e8081e60 con 0x7f32e8108730 2024-06-02T05:04:12.158 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.157+0000 7f32eec0a700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32e81ada30 con 0x7f32e81090d0 2024-06-02T05:04:12.158 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.157+0000 7f32ec9a6700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f32e8107540 0x7f32e807e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:04:12.159 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.157+0000 7f32e7fff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f32e8108730 0x7f32e807ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:04:12.159 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.157+0000 7f32ec9a6700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f32e8107540 0x7f32e807e720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:44642/0 (socket says 172.21.15.76:44642) 2024-06-02T05:04:12.159 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.157+0000 7f32e7fff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f32e8108730 0x7f32e807ec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:44372/0 (socket says 172.21.15.76:44372) 2024-06-02T05:04:12.159 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.157+0000 7f32ec9a6700 1 -- 172.21.15.76:0/416626898 learned_addr learned my addr 172.21.15.76:0/416626898 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:04:12.159 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.157+0000 7f32ed1a7700 1 --2- 172.21.15.76:0/416626898 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f32e81090d0 0x7f32e81ad4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:04:12.159 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.157+0000 7f32ed1a7700 1 -- 172.21.15.76:0/416626898 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f32e8108730 msgr2=0x7f32e807ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:04:12.159 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.157+0000 7f32ed1a7700 1 --2- 172.21.15.76:0/416626898 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f32e8108730 0x7f32e807ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:12.159 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.157+0000 7f32ed1a7700 1 -- 172.21.15.76:0/416626898 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f32e8107540 msgr2=0x7f32e807e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:04:12.159 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.157+0000 7f32ed1a7700 1 --2- 172.21.15.76:0/416626898 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f32e8107540 0x7f32e807e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:12.159 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.157+0000 7f32ed1a7700 1 -- 172.21.15.76:0/416626898 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32d40095f0 con 0x7f32e81090d0 2024-06-02T05:04:12.159 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.157+0000 7f32ec9a6700 1 --2- 172.21.15.76:0/416626898 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f32e8107540 0x7f32e807e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T05:04:12.161 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.158+0000 7f32ed1a7700 1 --2- 172.21.15.76:0/416626898 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f32e81090d0 0x7f32e81ad4f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f32e0007f10 tx=0x7f32e000d3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:04:12.161 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.158+0000 7f32e5ffb700 1 -- 172.21.15.76:0/416626898 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e0004db0 con 0x7f32e81090d0 2024-06-02T05:04:12.161 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.158+0000 7f32e5ffb700 1 -- 172.21.15.76:0/416626898 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f32e000f040 con 0x7f32e81090d0 2024-06-02T05:04:12.161 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.158+0000 7f32e5ffb700 1 -- 172.21.15.76:0/416626898 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e0005860 con 0x7f32e81090d0 2024-06-02T05:04:12.164 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.159+0000 7f32eec0a700 1 -- 172.21.15.76:0/416626898 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32e81adce0 con 0x7f32e81090d0 2024-06-02T05:04:12.164 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.159+0000 7f32eec0a700 1 -- 172.21.15.76:0/416626898 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32e81ae1a0 con 0x7f32e81090d0 2024-06-02T05:04:12.164 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.163+0000 7f32fadc5b80 1 Processor -- start 2024-06-02T05:04:12.164 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.163+0000 7f32fadc5b80 1 -- start start 2024-06-02T05:04:12.164 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.164+0000 7f32fadc5b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c3df81da80 0x55c3df81dea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:04:12.164 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.164+0000 7f32fadc5b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c3df81e3e0 0x55c3df81ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:04:12.164 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.164+0000 7f32fadc5b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c3df81f2d0 0x55c3df81f750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:04:12.165 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.164+0000 7f32fadc5b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3df7750f0 con 0x55c3df81e3e0 2024-06-02T05:04:12.165 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.164+0000 7f32fadc5b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3df772ab0 con 0x55c3df81f2d0 2024-06-02T05:04:12.165 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.164+0000 7f32fadc5b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3df76e3a0 con 0x55c3df81da80 2024-06-02T05:04:12.165 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.164+0000 7f32ec9a6700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c3df81e3e0 0x55c3df81ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:04:12.165 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.164+0000 7f32ec9a6700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c3df81e3e0 0x55c3df81ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:44656/0 (socket says 172.21.15.76:44656) 2024-06-02T05:04:12.166 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.164+0000 7f32ec9a6700 1 -- 172.21.15.76:0/554663913 learned_addr learned my addr 172.21.15.76:0/554663913 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:04:12.166 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.164+0000 7f32ec9a6700 1 -- 172.21.15.76:0/554663913 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c3df81da80 msgr2=0x55c3df81dea0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-02T05:04:12.166 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.164+0000 7f32ec9a6700 1 --2- 172.21.15.76:0/554663913 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c3df81da80 0x55c3df81dea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:12.166 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.164+0000 7f32ec9a6700 1 -- 172.21.15.76:0/554663913 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c3df81f2d0 msgr2=0x55c3df81f750 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-02T05:04:12.166 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.164+0000 7f32ec9a6700 1 --2- 172.21.15.76:0/554663913 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c3df81f2d0 0x55c3df81f750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:12.166 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.164+0000 7f32ec9a6700 1 -- 172.21.15.76:0/554663913 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c3df5ef350 con 0x55c3df81e3e0 2024-06-02T05:04:12.166 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.165+0000 7f32ec9a6700 1 --2- 172.21.15.76:0/554663913 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c3df81e3e0 0x55c3df81ecf0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f32dc010770 tx=0x7f32dc010a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=595a48d907617bfa server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:04:12.169 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.169+0000 7f32d2ffd700 1 -- 172.21.15.76:0/554663913 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32dc011700 con 0x55c3df81e3e0 2024-06-02T05:04:12.169 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.169+0000 7f32d2ffd700 1 -- 172.21.15.76:0/554663913 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f32dc015070 con 0x55c3df81e3e0 2024-06-02T05:04:12.169 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.169+0000 7f32d2ffd700 1 -- 172.21.15.76:0/554663913 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32dc019ac0 con 0x55c3df81e3e0 2024-06-02T05:04:12.170 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.170+0000 7f32e5ffb700 1 -- 172.21.15.76:0/416626898 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f32e000dac0 con 0x7f32e81090d0 2024-06-02T05:04:12.170 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.170+0000 7f32fadc5b80 1 -- 172.21.15.76:0/554663913 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c3df81e3e0 msgr2=0x55c3df81ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:04:12.170 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.170+0000 7f32fadc5b80 1 --2- 172.21.15.76:0/554663913 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c3df81e3e0 0x55c3df81ecf0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f32dc010770 tx=0x7f32dc010a80 comp rx=0 tx=0).stop 2024-06-02T05:04:12.171 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.170+0000 7f32fadc5b80 1 -- 172.21.15.76:0/554663913 shutdown_connections 2024-06-02T05:04:12.171 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.170+0000 7f32fadc5b80 1 --2- 172.21.15.76:0/554663913 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c3df81f2d0 0x55c3df81f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:12.171 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.170+0000 7f32fadc5b80 1 --2- 172.21.15.76:0/554663913 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c3df81da80 0x55c3df81dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:12.171 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.170+0000 7f32fadc5b80 1 --2- 172.21.15.76:0/554663913 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c3df81e3e0 0x55c3df81ecf0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:12.171 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.170+0000 7f32fadc5b80 1 -- 172.21.15.76:0/554663913 >> 172.21.15.76:0/554663913 conn(0x55c3df77c1b0 msgr2=0x55c3df81a440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:04:12.172 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.170+0000 7f32e5ffb700 1 --2- 172.21.15.76:0/416626898 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f32d80a12f0 0x7f32d80a37b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:04:12.172 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.170+0000 7f32e5ffb700 1 -- 172.21.15.76:0/416626898 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f32e00cc3d0 con 0x7f32e81090d0 2024-06-02T05:04:12.172 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.170+0000 7f32ec9a6700 1 --2- 172.21.15.76:0/416626898 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f32d80a12f0 0x7f32d80a37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:04:12.172 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.171+0000 7f32fadc5b80 1 -- 172.21.15.76:0/554663913 shutdown_connections 2024-06-02T05:04:12.172 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.171+0000 7f32fadc5b80 1 -- 172.21.15.76:0/554663913 wait complete. 2024-06-02T05:04:12.172 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.171+0000 7f32fadc5b80 1 -- start start 2024-06-02T05:04:12.172 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.172+0000 7f32fadc5b80 1 Processor -- start 2024-06-02T05:04:12.173 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.172+0000 7f32fadc5b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c3df81da80 0x55c3df827870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:04:12.173 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.172+0000 7f32fadc5b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c3df81e3e0 0x55c3df827db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:04:12.173 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.172+0000 7f32fadc5b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c3df81f2d0 0x55c3df82edf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:04:12.173 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.172+0000 7f32fadc5b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3df70a500 con 0x55c3df81da80 2024-06-02T05:04:12.173 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.172+0000 7f32fadc5b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3df70a1a0 con 0x55c3df81f2d0 2024-06-02T05:04:12.173 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.172+0000 7f32fadc5b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3df5f1640 con 0x55c3df81e3e0 2024-06-02T05:04:12.173 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.172+0000 7f32fadc5b80 10 client.0 _ll_register_callbacks cb 0x55c3df713ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T05:04:12.175 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.173+0000 7f32e7fff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c3df81e3e0 0x55c3df827db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:04:12.175 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.173+0000 7f32ec9a6700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c3df81da80 0x55c3df827870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:04:12.176 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.173+0000 7f32e7fff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c3df81e3e0 0x55c3df827db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:39392/0 (socket says 172.21.15.76:39392) 2024-06-02T05:04:12.176 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.173+0000 7f32e7fff700 1 -- 172.21.15.76:0/1493058820 learned_addr learned my addr 172.21.15.76:0/1493058820 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:04:12.176 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.173+0000 7f32ed1a7700 1 --2- 172.21.15.76:0/1493058820 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c3df81f2d0 0x55c3df82edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:04:12.176 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.173+0000 7f32e7fff700 1 -- 172.21.15.76:0/1493058820 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c3df81f2d0 msgr2=0x55c3df82edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:04:12.176 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.173+0000 7f32e7fff700 1 --2- 172.21.15.76:0/1493058820 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c3df81f2d0 0x55c3df82edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:12.176 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.173+0000 7f32e7fff700 1 -- 172.21.15.76:0/1493058820 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c3df81da80 msgr2=0x55c3df827870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:04:12.176 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.173+0000 7f32e7fff700 1 --2- 172.21.15.76:0/1493058820 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c3df81da80 0x55c3df827870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:12.176 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.173+0000 7f32e7fff700 1 -- 172.21.15.76:0/1493058820 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32dc0103d0 con 0x55c3df81e3e0 2024-06-02T05:04:12.176 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.173+0000 7f32ec9a6700 1 --2- 172.21.15.76:0/416626898 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f32d80a12f0 0x7f32d80a37b0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f32dc011010 tx=0x7f32dc00b710 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:04:12.176 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.173+0000 7f32e7fff700 1 --2- 172.21.15.76:0/1493058820 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c3df81e3e0 0x55c3df827db0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f32d40098e0 tx=0x7f32d4005320 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af1301af555e0c01 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:04:12.176 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.173+0000 7f32c7fff700 10 client.0 ms_handle_connect on v2:172.21.15.192:3300/0 2024-06-02T05:04:12.176 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.173+0000 7f32c7fff700 1 -- 172.21.15.76:0/1493058820 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d401d070 con 0x55c3df81e3e0 2024-06-02T05:04:12.177 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.174+0000 7f32c7fff700 1 -- 172.21.15.76:0/1493058820 <== mon.1 v2:172.21.15.192:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f32d4004700 con 0x55c3df81e3e0 2024-06-02T05:04:12.177 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.174+0000 7f32fadc5b80 1 -- 172.21.15.76:0/1493058820 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c3df6c7210 con 0x55c3df81e3e0 2024-06-02T05:04:12.177 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.174+0000 7f32c7fff700 1 -- 172.21.15.76:0/1493058820 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f32d4005a00 con 0x55c3df81e3e0 2024-06-02T05:04:12.177 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.174+0000 7f32fadc5b80 10 client.26197 fetch_fsmap learned FSMap version 36 2024-06-02T05:04:12.177 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.174+0000 7f32fadc5b80 1 -- 172.21.15.76:0/1493058820 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55c3df59bb00 con 0x55c3df81e3e0 2024-06-02T05:04:12.177 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.175+0000 7f32c7fff700 1 -- 172.21.15.76:0/1493058820 <== mon.1 v2:172.21.15.192:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55c3df6c7210 con 0x55c3df81e3e0 2024-06-02T05:04:12.177 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.175+0000 7f32c7fff700 1 -- 172.21.15.76:0/1493058820 <== mon.1 v2:172.21.15.192:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f32d40039b0 con 0x55c3df81e3e0 2024-06-02T05:04:12.177 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.175+0000 7f32fadc5b80 10 client.26197 fetch_fsmap finished waiting for FSMap version 36 2024-06-02T05:04:12.177 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.175+0000 7f32fadc5b80 10 client.26197 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T05:04:12.177 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.175+0000 7f32fadc5b80 20 client.26197 populate_metadata read hostname 'smithi076' 2024-06-02T05:04:12.177 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.175+0000 7f32fadc5b80 1 --2- 172.21.15.76:0/1493058820 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55c3df8336f0 0x55c3df835b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:04:12.177 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.175+0000 7f32fadc5b80 4 client.26197 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T05:04:12.177 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.175+0000 7f32fadc5b80 1 -- 172.21.15.76:0/1493058820 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c3df7ed7b0 con 0x55c3df8336f0 2024-06-02T05:04:12.179 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.175+0000 7f32ec9a6700 1 --2- 172.21.15.76:0/1493058820 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55c3df8336f0 0x55c3df835b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:04:12.180 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.176+0000 7f32ec9a6700 1 --2- 172.21.15.76:0/1493058820 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55c3df8336f0 0x55c3df835b10 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f773378cfcbf05b7 server_cookie=fde3147e9724c046 in_seq=0 out_seq=0 2024-06-02T05:04:12.180 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.176+0000 7f32c7fff700 10 client.26197 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T05:04:12.180 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.178+0000 7f32c7fff700 1 -- 172.21.15.76:0/1493058820 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55c3df7ed7b0 con 0x55c3df8336f0 2024-06-02T05:04:12.180 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.178+0000 7f32c7fff700 10 client.26197 handle_command_reply: tid=0 2024-06-02T05:04:12.180 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.178+0000 7f32fadc5b80 1 client.26197 shutdown 2024-06-02T05:04:12.180 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.178+0000 7f32fadc5b80 1 -- 172.21.15.76:0/1493058820 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c3df81e3e0 msgr2=0x55c3df827db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:04:12.180 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.178+0000 7f32fadc5b80 1 --2- 172.21.15.76:0/1493058820 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c3df81e3e0 0x55c3df827db0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f32d40098e0 tx=0x7f32d4005320 comp rx=0 tx=0).stop 2024-06-02T05:04:12.180 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.178+0000 7f32fadc5b80 1 -- 172.21.15.76:0/1493058820 shutdown_connections 2024-06-02T05:04:12.180 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.178+0000 7f32fadc5b80 1 --2- 172.21.15.76:0/1493058820 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55c3df8336f0 0x55c3df835b10 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:12.180 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.178+0000 7f32fadc5b80 1 --2- 172.21.15.76:0/1493058820 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c3df81f2d0 0x55c3df82edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:12.180 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.178+0000 7f32fadc5b80 1 --2- 172.21.15.76:0/1493058820 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c3df81da80 0x55c3df827870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:12.180 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.178+0000 7f32fadc5b80 1 --2- 172.21.15.76:0/1493058820 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c3df81e3e0 0x55c3df827db0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:12.181 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.178+0000 7f32fadc5b80 1 -- 172.21.15.76:0/1493058820 >> 172.21.15.76:0/1493058820 conn(0x55c3df77c1b0 msgr2=0x55c3df818860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:04:12.181 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.178+0000 7f32c7fff700 0 client.26197 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T05:04:12.181 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.178+0000 7f32fadc5b80 1 -- 172.21.15.76:0/1493058820 shutdown_connections 2024-06-02T05:04:12.181 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.178+0000 7f32fadc5b80 1 -- 172.21.15.76:0/1493058820 wait complete. 2024-06-02T05:04:12.181 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.179+0000 7f32fadc5b80 20 client.26197 trim_cache size 0 max 16384 2024-06-02T05:04:12.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:04:11 smithi192 ceph-mon[47933]: pgmap v706: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 8.2 MiB/s wr, 767 op/s 2024-06-02T05:04:12.205 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.204+0000 7f32fadc5b80 1 Processor -- start 2024-06-02T05:04:12.205 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.204+0000 7f32fadc5b80 1 -- start start 2024-06-02T05:04:12.205 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.205+0000 7f32fadc5b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c3df81da80 0x55c3df82f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:04:12.206 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.205+0000 7f32fadc5b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c3df81e3e0 0x55c3df826d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:04:12.206 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.205+0000 7f32fadc5b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c3df81f2d0 0x55c3df82edb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:04:12.206 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.205+0000 7f32fadc5b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3df81f150 con 0x55c3df81f2d0 2024-06-02T05:04:12.206 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.205+0000 7f32fadc5b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3df82ff70 con 0x55c3df81e3e0 2024-06-02T05:04:12.206 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.205+0000 7f32fadc5b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3df828ab0 con 0x55c3df81da80 2024-06-02T05:04:12.206 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.205+0000 7f32e7fff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c3df81e3e0 0x55c3df826d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:04:12.206 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.205+0000 7f32e7fff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c3df81e3e0 0x55c3df826d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:44392/0 (socket says 172.21.15.76:44392) 2024-06-02T05:04:12.207 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.205+0000 7f32e7fff700 1 -- 172.21.15.76:0/924658312 learned_addr learned my addr 172.21.15.76:0/924658312 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:04:12.208 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.205+0000 7f32e7fff700 1 -- 172.21.15.76:0/924658312 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c3df81da80 msgr2=0x55c3df82f4a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-02T05:04:12.208 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.205+0000 7f32e7fff700 1 --2- 172.21.15.76:0/924658312 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c3df81da80 0x55c3df82f4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:12.209 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.205+0000 7f32e7fff700 1 -- 172.21.15.76:0/924658312 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c3df81f2d0 msgr2=0x55c3df82edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:04:12.209 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.205+0000 7f32e7fff700 1 --2- 172.21.15.76:0/924658312 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c3df81f2d0 0x55c3df82edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:12.209 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.205+0000 7f32e7fff700 1 -- 172.21.15.76:0/924658312 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c3df734500 con 0x55c3df81e3e0 2024-06-02T05:04:12.209 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.206+0000 7f32e7fff700 1 --2- 172.21.15.76:0/924658312 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c3df81e3e0 0x55c3df826d80 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f32d400b5c0 tx=0x7f32d4009f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=88d6b7b8ee171e62 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:04:12.210 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.208+0000 7f32d37fe700 1 -- 172.21.15.76:0/924658312 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d401d040 con 0x55c3df81e3e0 2024-06-02T05:04:12.210 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.208+0000 7f32d37fe700 1 -- 172.21.15.76:0/924658312 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f32d401e040 con 0x55c3df81e3e0 2024-06-02T05:04:12.210 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.208+0000 7f32d37fe700 1 -- 172.21.15.76:0/924658312 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d400f7a0 con 0x55c3df81e3e0 2024-06-02T05:04:12.210 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.209+0000 7f32fadc5b80 1 -- 172.21.15.76:0/924658312 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c3df81e3e0 msgr2=0x55c3df826d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:04:12.210 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.209+0000 7f32fadc5b80 1 --2- 172.21.15.76:0/924658312 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c3df81e3e0 0x55c3df826d80 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f32d400b5c0 tx=0x7f32d4009f10 comp rx=0 tx=0).stop 2024-06-02T05:04:12.210 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.209+0000 7f32fadc5b80 1 -- 172.21.15.76:0/924658312 shutdown_connections 2024-06-02T05:04:12.210 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.209+0000 7f32fadc5b80 1 --2- 172.21.15.76:0/924658312 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c3df81f2d0 0x55c3df82edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:12.210 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.209+0000 7f32fadc5b80 1 --2- 172.21.15.76:0/924658312 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c3df81da80 0x55c3df82f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:12.210 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.209+0000 7f32fadc5b80 1 --2- 172.21.15.76:0/924658312 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c3df81e3e0 0x55c3df826d80 secure :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f32d400b5c0 tx=0x7f32d4009f10 comp rx=0 tx=0).stop 2024-06-02T05:04:12.210 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.209+0000 7f32fadc5b80 1 -- 172.21.15.76:0/924658312 >> 172.21.15.76:0/924658312 conn(0x55c3df77c1b0 msgr2=0x55c3df81a020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:04:12.211 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.210+0000 7f32fadc5b80 1 -- 172.21.15.76:0/924658312 shutdown_connections 2024-06-02T05:04:12.211 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.210+0000 7f32fadc5b80 1 -- 172.21.15.76:0/924658312 wait complete. 2024-06-02T05:04:12.211 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.210+0000 7f32fadc5b80 1 -- start start 2024-06-02T05:04:12.211 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.210+0000 7f32fadc5b80 1 Processor -- start 2024-06-02T05:04:12.212 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.211+0000 7f32fadc5b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c3df81f2d0 0x55c3df82a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:04:12.212 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.211+0000 7f32fadc5b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c3df82a600 0x55c3df82d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:04:12.212 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.211+0000 7f32fadc5b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c3df82aa80 0x55c3df82daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:04:12.212 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.211+0000 7f32fadc5b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3df82e280 con 0x55c3df82a600 2024-06-02T05:04:12.212 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.211+0000 7f32fadc5b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3df82e3f0 con 0x55c3df82aa80 2024-06-02T05:04:12.212 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.211+0000 7f32fadc5b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3df82e5b0 con 0x55c3df81f2d0 2024-06-02T05:04:12.212 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.211+0000 7f32fadc5b80 10 client.0 _ll_register_callbacks cb 0x55c3df713ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T05:04:12.212 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.211+0000 7f32ed1a7700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c3df82aa80 0x55c3df82daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:04:12.212 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.211+0000 7f32ed1a7700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c3df82aa80 0x55c3df82daf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:44406/0 (socket says 172.21.15.76:44406) 2024-06-02T05:04:12.212 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.211+0000 7f32ed1a7700 1 -- 172.21.15.76:0/2058637228 learned_addr learned my addr 172.21.15.76:0/2058637228 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:04:12.213 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.212+0000 7f32ed1a7700 1 -- 172.21.15.76:0/2058637228 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c3df81f2d0 msgr2=0x55c3df82a0c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-02T05:04:12.213 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.212+0000 7f32e7fff700 1 --2- 172.21.15.76:0/2058637228 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c3df82a600 0x55c3df82d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:04:12.213 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.212+0000 7f32ed1a7700 1 --2- 172.21.15.76:0/2058637228 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c3df81f2d0 0x55c3df82a0c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:12.213 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.212+0000 7f32ed1a7700 1 -- 172.21.15.76:0/2058637228 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c3df82a600 msgr2=0x55c3df82d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:04:12.213 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.212+0000 7f32ed1a7700 1 --2- 172.21.15.76:0/2058637228 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c3df82a600 0x55c3df82d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:12.213 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.212+0000 7f32ed1a7700 1 -- 172.21.15.76:0/2058637228 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c3df59bb00 con 0x55c3df82aa80 2024-06-02T05:04:12.213 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.212+0000 7f32e7fff700 1 --2- 172.21.15.76:0/2058637228 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c3df82a600 0x55c3df82d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T05:04:12.213 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.212+0000 7f32ed1a7700 1 --2- 172.21.15.76:0/2058637228 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c3df82aa80 0x55c3df82daf0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f32e0007ee0 tx=0x7f32e0098fc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c5c9450baa863331 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:04:12.214 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.213+0000 7f32c7fff700 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-06-02T05:04:12.225 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.225+0000 7f32c7fff700 1 -- 172.21.15.76:0/2058637228 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e0098de0 con 0x55c3df82aa80 2024-06-02T05:04:12.225 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.225+0000 7f32c7fff700 1 -- 172.21.15.76:0/2058637228 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f32e0009e20 con 0x55c3df82aa80 2024-06-02T05:04:12.225 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.225+0000 7f32fadc5b80 1 -- 172.21.15.76:0/2058637228 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f32dc015070 con 0x55c3df82aa80 2024-06-02T05:04:12.226 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.225+0000 7f32c7fff700 1 -- 172.21.15.76:0/2058637228 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f32e0099b80 con 0x55c3df82aa80 2024-06-02T05:04:12.226 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.225+0000 7f32fadc5b80 10 client.26243 fetch_fsmap learned FSMap version 36 2024-06-02T05:04:12.226 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.225+0000 7f32fadc5b80 1 -- 172.21.15.76:0/2058637228 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55c3df5f3c70 con 0x55c3df82aa80 2024-06-02T05:04:12.227 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.226+0000 7f32c7fff700 1 -- 172.21.15.76:0/2058637228 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f32dc015070 con 0x55c3df82aa80 2024-06-02T05:04:12.227 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.226+0000 7f32c7fff700 1 -- 172.21.15.76:0/2058637228 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f32e0098970 con 0x55c3df82aa80 2024-06-02T05:04:12.227 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.226+0000 7f32fadc5b80 10 client.26243 fetch_fsmap finished waiting for FSMap version 36 2024-06-02T05:04:12.227 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.226+0000 7f32fadc5b80 10 client.26243 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T05:04:12.227 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.226+0000 7f32fadc5b80 20 client.26243 populate_metadata read hostname 'smithi076' 2024-06-02T05:04:12.227 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.226+0000 7f32fadc5b80 1 --2- 172.21.15.76:0/2058637228 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55c3df89b740 0x55c3df89db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:04:12.227 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.226+0000 7f32fadc5b80 4 client.26243 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T05:04:12.227 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.226+0000 7f32fadc5b80 1 -- 172.21.15.76:0/2058637228 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55c3df766e60 con 0x55c3df89b740 2024-06-02T05:04:12.227 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.226+0000 7f32ec9a6700 1 --2- 172.21.15.76:0/2058637228 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55c3df89b740 0x55c3df89db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:04:12.228 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.227+0000 7f32ec9a6700 1 --2- 172.21.15.76:0/2058637228 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55c3df89b740 0x55c3df89db60 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eb387bd1e5b445d server_cookie=21d38b330761fbbd in_seq=0 out_seq=0 2024-06-02T05:04:12.228 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.227+0000 7f32c7fff700 10 client.26243 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T05:04:12.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:04:11 smithi076 ceph-mon[42935]: pgmap v706: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 8.2 MiB/s wr, 767 op/s 2024-06-02T05:04:12.257 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.256+0000 7f32c7fff700 1 -- 172.21.15.76:0/2058637228 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55c3df766e60 con 0x55c3df89b740 2024-06-02T05:04:12.257 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.256+0000 7f32c7fff700 10 client.26243 handle_command_reply: tid=0 2024-06-02T05:04:12.257 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.256+0000 7f32fadc5b80 1 client.26243 shutdown 2024-06-02T05:04:12.258 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.257+0000 7f32fadc5b80 1 -- 172.21.15.76:0/2058637228 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c3df82aa80 msgr2=0x55c3df82daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:04:12.258 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.257+0000 7f32fadc5b80 1 --2- 172.21.15.76:0/2058637228 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c3df82aa80 0x55c3df82daf0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f32e0007ee0 tx=0x7f32e0098fc0 comp rx=0 tx=0).stop 2024-06-02T05:04:12.258 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.257+0000 7f32fadc5b80 1 -- 172.21.15.76:0/2058637228 shutdown_connections 2024-06-02T05:04:12.258 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.257+0000 7f32fadc5b80 1 --2- 172.21.15.76:0/2058637228 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55c3df89b740 0x55c3df89db60 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:12.258 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.257+0000 7f32fadc5b80 1 --2- 172.21.15.76:0/2058637228 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c3df82aa80 0x55c3df82daf0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:12.258 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.257+0000 7f32fadc5b80 1 --2- 172.21.15.76:0/2058637228 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c3df81f2d0 0x55c3df82a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:12.258 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.257+0000 7f32fadc5b80 1 --2- 172.21.15.76:0/2058637228 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c3df82a600 0x55c3df82d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:12.258 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.257+0000 7f32fadc5b80 1 -- 172.21.15.76:0/2058637228 >> 172.21.15.76:0/2058637228 conn(0x55c3df77c1b0 msgr2=0x55c3df81a020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:04:12.258 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.257+0000 7f32c7fff700 0 client.26243 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T05:04:12.258 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.257+0000 7f32fadc5b80 1 -- 172.21.15.76:0/2058637228 shutdown_connections 2024-06-02T05:04:12.258 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.257+0000 7f32fadc5b80 1 -- 172.21.15.76:0/2058637228 wait complete. 2024-06-02T05:04:12.259 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:{ 2024-06-02T05:04:12.259 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "message": "", 2024-06-02T05:04:12.259 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "return_code": 0 2024-06-02T05:04:12.259 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:} 2024-06-02T05:04:12.260 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.257+0000 7f32fadc5b80 20 client.26243 trim_cache size 0 max 16384 2024-06-02T05:04:12.260 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.258+0000 7f32eec0a700 1 -- 172.21.15.76:0/416626898 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f32d80a12f0 msgr2=0x7f32d80a37b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:04:12.260 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.258+0000 7f32eec0a700 1 --2- 172.21.15.76:0/416626898 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f32d80a12f0 0x7f32d80a37b0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f32dc011010 tx=0x7f32dc00b710 comp rx=0 tx=0).stop 2024-06-02T05:04:12.260 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.258+0000 7f32eec0a700 1 -- 172.21.15.76:0/416626898 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f32e81090d0 msgr2=0x7f32e81ad4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:04:12.261 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.258+0000 7f32eec0a700 1 --2- 172.21.15.76:0/416626898 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f32e81090d0 0x7f32e81ad4f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f32e0007f10 tx=0x7f32e000d3b0 comp rx=0 tx=0).stop 2024-06-02T05:04:12.261 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.258+0000 7f32eec0a700 1 -- 172.21.15.76:0/416626898 shutdown_connections 2024-06-02T05:04:12.261 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.258+0000 7f32eec0a700 1 --2- 172.21.15.76:0/416626898 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f32e81090d0 0x7f32e81ad4f0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:12.261 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.258+0000 7f32eec0a700 1 --2- 172.21.15.76:0/416626898 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f32e8107540 0x7f32e807e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:12.261 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.258+0000 7f32eec0a700 1 --2- 172.21.15.76:0/416626898 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f32d80a12f0 0x7f32d80a37b0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:12.261 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.258+0000 7f32eec0a700 1 --2- 172.21.15.76:0/416626898 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f32e8108730 0x7f32e807ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:12.261 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.258+0000 7f32eec0a700 1 -- 172.21.15.76:0/416626898 >> 172.21.15.76:0/416626898 conn(0x7f32e80764d0 msgr2=0x7f32e810bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:04:12.261 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.258+0000 7f32eec0a700 1 -- 172.21.15.76:0/416626898 shutdown_connections 2024-06-02T05:04:12.261 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:12.258+0000 7f32eec0a700 1 -- 172.21.15.76:0/416626898 wait complete. 2024-06-02T05:04:14.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:04:13 smithi119 ceph-mon[46633]: pgmap v707: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 7.6 MiB/s wr, 732 op/s 2024-06-02T05:04:14.185 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:04:13 smithi192 ceph-mon[47933]: pgmap v707: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 7.6 MiB/s wr, 732 op/s 2024-06-02T05:04:14.235 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:04:13 smithi076 ceph-mon[42935]: pgmap v707: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 7.6 MiB/s wr, 732 op/s 2024-06-02T05:04:16.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:04:15 smithi119 ceph-mon[46633]: pgmap v708: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 7.8 MiB/s wr, 681 op/s 2024-06-02T05:04:16.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:04:15 smithi192 ceph-mon[47933]: pgmap v708: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 7.8 MiB/s wr, 681 op/s 2024-06-02T05:04:16.244 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:04:15 smithi076 ceph-mon[42935]: pgmap v708: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 7.8 MiB/s wr, 681 op/s 2024-06-02T05:04:16.317 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 805.0 s, 536.0 tps, lat 187.109 ms stddev 71.785 2024-06-02T05:04:18.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:04:17 smithi119 ceph-mon[46633]: pgmap v709: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 8.8 MiB/s wr, 802 op/s 2024-06-02T05:04:18.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:04:17 smithi192 ceph-mon[47933]: pgmap v709: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 8.8 MiB/s wr, 802 op/s 2024-06-02T05:04:18.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:04:17 smithi076 ceph-mon[42935]: pgmap v709: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 8.8 MiB/s wr, 802 op/s 2024-06-02T05:04:20.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:04:19 smithi119 ceph-mon[46633]: pgmap v710: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 7.8 MiB/s wr, 690 op/s 2024-06-02T05:04:20.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:04:19 smithi192 ceph-mon[47933]: pgmap v710: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 7.8 MiB/s wr, 690 op/s 2024-06-02T05:04:20.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:04:19 smithi076 ceph-mon[42935]: pgmap v710: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 7.8 MiB/s wr, 690 op/s 2024-06-02T05:04:21.323 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 810.0 s, 507.8 tps, lat 194.846 ms stddev 73.068 2024-06-02T05:04:22.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:04:21 smithi119 ceph-mon[46633]: pgmap v711: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 8.5 MiB/s wr, 773 op/s 2024-06-02T05:04:22.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:04:21 smithi192 ceph-mon[47933]: pgmap v711: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 8.5 MiB/s wr, 773 op/s 2024-06-02T05:04:22.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:04:21 smithi076 ceph-mon[42935]: pgmap v711: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 8.5 MiB/s wr, 773 op/s 2024-06-02T05:04:24.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:04:23 smithi119 ceph-mon[46633]: pgmap v712: 129 pgs: 129 active+clean; 1.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 8.6 MiB/s wr, 769 op/s 2024-06-02T05:04:24.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:04:23 smithi192 ceph-mon[47933]: pgmap v712: 129 pgs: 129 active+clean; 1.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 8.6 MiB/s wr, 769 op/s 2024-06-02T05:04:24.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:04:23 smithi076 ceph-mon[42935]: pgmap v712: 129 pgs: 129 active+clean; 1.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 8.6 MiB/s wr, 769 op/s 2024-06-02T05:04:25.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:04:24 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T05:04:25.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:04:24 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T05:04:25.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:04:24 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T05:04:25.441 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.437+0000 7f9396dde700 1 -- 172.21.15.76:0/1458589998 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f93900ff580 msgr2=0x7f93900ff9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:04:25.441 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.437+0000 7f9396dde700 1 --2- 172.21.15.76:0/1458589998 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f93900ff580 0x7f93900ff9a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f938400fc10 tx=0x7f938400ff20 comp rx=0 tx=0).stop 2024-06-02T05:04:25.441 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.440+0000 7f9396dde700 1 -- 172.21.15.76:0/1458589998 shutdown_connections 2024-06-02T05:04:25.441 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.440+0000 7f9396dde700 1 --2- 172.21.15.76:0/1458589998 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9390101110 0x7f93901079c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:25.442 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.440+0000 7f9396dde700 1 --2- 172.21.15.76:0/1458589998 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f93900ff580 0x7f93900ff9a0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:25.442 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.440+0000 7f9396dde700 1 --2- 172.21.15.76:0/1458589998 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9390100770 0x7f9390100bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:25.442 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.440+0000 7f9396dde700 1 -- 172.21.15.76:0/1458589998 >> 172.21.15.76:0/1458589998 conn(0x7f93900faaf0 msgr2=0x7f93900fcf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:04:25.444 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.444+0000 7f9396dde700 1 -- 172.21.15.76:0/1458589998 shutdown_connections 2024-06-02T05:04:25.445 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.444+0000 7f9396dde700 1 -- 172.21.15.76:0/1458589998 wait complete. 2024-06-02T05:04:25.445 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.444+0000 7f9396dde700 1 Processor -- start 2024-06-02T05:04:25.445 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.445+0000 7f9396dde700 1 -- start start 2024-06-02T05:04:25.445 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.445+0000 7f9396dde700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f93900ff580 0x7f93901a5c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:04:25.446 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.445+0000 7f9396dde700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9390100770 0x7f93901a61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:04:25.446 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.445+0000 7f9396dde700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9390101110 0x7f93901ad1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:04:25.446 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.445+0000 7f9396dde700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93901ad780 con 0x7f93900ff580 2024-06-02T05:04:25.446 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.445+0000 7f9396dde700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f939006a9f0 con 0x7f9390100770 2024-06-02T05:04:25.446 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.445+0000 7f9396dde700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f939006abb0 con 0x7f9390101110 2024-06-02T05:04:25.446 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.445+0000 7f9394b7a700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f93900ff580 0x7f93901a5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:04:25.446 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.445+0000 7f9394b7a700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f93900ff580 0x7f93901a5c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:36712/0 (socket says 172.21.15.76:36712) 2024-06-02T05:04:25.447 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.445+0000 7f9394b7a700 1 -- 172.21.15.76:0/1191591449 learned_addr learned my addr 172.21.15.76:0/1191591449 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:04:25.447 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.445+0000 7f938ffff700 1 --2- 172.21.15.76:0/1191591449 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9390100770 0x7f93901a61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:04:25.447 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.445+0000 7f939537b700 1 --2- 172.21.15.76:0/1191591449 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9390101110 0x7f93901ad1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:04:25.447 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.446+0000 7f938ffff700 1 -- 172.21.15.76:0/1191591449 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9390101110 msgr2=0x7f93901ad1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:04:25.447 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.446+0000 7f938ffff700 1 --2- 172.21.15.76:0/1191591449 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9390101110 0x7f93901ad1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:25.447 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.446+0000 7f938ffff700 1 -- 172.21.15.76:0/1191591449 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f93900ff580 msgr2=0x7f93901a5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:04:25.447 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.446+0000 7f938ffff700 1 --2- 172.21.15.76:0/1191591449 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f93900ff580 0x7f93901a5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:25.447 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.446+0000 7f938ffff700 1 -- 172.21.15.76:0/1191591449 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f938400f850 con 0x7f9390100770 2024-06-02T05:04:25.451 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.448+0000 7f938ffff700 1 --2- 172.21.15.76:0/1191591449 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9390100770 0x7f93901a61d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f937c007970 tx=0x7f937c007c80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:04:25.454 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.453+0000 7f938dffb700 1 -- 172.21.15.76:0/1191591449 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f937c010040 con 0x7f9390100770 2024-06-02T05:04:25.454 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.453+0000 7f938dffb700 1 -- 172.21.15.76:0/1191591449 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f937c00fe60 con 0x7f9390100770 2024-06-02T05:04:25.454 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.453+0000 7f938dffb700 1 -- 172.21.15.76:0/1191591449 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f937c0143d0 con 0x7f9390100770 2024-06-02T05:04:25.454 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.453+0000 7f9396dde700 1 -- 172.21.15.76:0/1191591449 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f939006ae90 con 0x7f9390100770 2024-06-02T05:04:25.454 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.453+0000 7f9396dde700 1 -- 172.21.15.76:0/1191591449 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f939006b350 con 0x7f9390100770 2024-06-02T05:04:25.460 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.460+0000 7f93a2f99b80 1 Processor -- start 2024-06-02T05:04:25.462 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.461+0000 7f938dffb700 1 -- 172.21.15.76:0/1191591449 <== mon.2 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f937c00f9d0 con 0x7f9390100770 2024-06-02T05:04:25.462 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.461+0000 7f938dffb700 1 --2- 172.21.15.76:0/1191591449 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f93800a1320 0x7f93800a37e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:04:25.463 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.461+0000 7f938dffb700 1 -- 172.21.15.76:0/1191591449 <== mon.2 v2:172.21.15.119:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f937c0ccf90 con 0x7f9390100770 2024-06-02T05:04:25.463 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.462+0000 7f93a2f99b80 1 -- start start 2024-06-02T05:04:25.463 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.462+0000 7f93a2f99b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d9e84e5a80 0x55d9e84e5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:04:25.463 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.462+0000 7f93a2f99b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d9e84e63e0 0x55d9e84e6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:04:25.463 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.462+0000 7f93a2f99b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d9e84e72d0 0x55d9e84e7750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:04:25.463 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.462+0000 7f93a2f99b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9e843d0f0 con 0x55d9e84e5a80 2024-06-02T05:04:25.463 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.462+0000 7f93a2f99b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9e843aab0 con 0x55d9e84e72d0 2024-06-02T05:04:25.463 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.462+0000 7f93a2f99b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9e84363a0 con 0x55d9e84e63e0 2024-06-02T05:04:25.464 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.462+0000 7f938ffff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d9e84e63e0 0x55d9e84e6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:04:25.464 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.462+0000 7f938ffff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d9e84e63e0 0x55d9e84e6cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:47804/0 (socket says 172.21.15.76:47804) 2024-06-02T05:04:25.464 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.462+0000 7f938ffff700 1 -- 172.21.15.76:0/4086318855 learned_addr learned my addr 172.21.15.76:0/4086318855 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:04:25.464 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.462+0000 7f9394b7a700 1 --2- 172.21.15.76:0/4086318855 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d9e84e5a80 0x55d9e84e5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:04:25.464 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.462+0000 7f938ffff700 1 -- 172.21.15.76:0/4086318855 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d9e84e72d0 msgr2=0x55d9e84e7750 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-02T05:04:25.464 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.462+0000 7f938ffff700 1 --2- 172.21.15.76:0/4086318855 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d9e84e72d0 0x55d9e84e7750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:25.464 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.462+0000 7f938ffff700 1 -- 172.21.15.76:0/4086318855 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d9e84e5a80 msgr2=0x55d9e84e5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:04:25.464 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.462+0000 7f938ffff700 1 --2- 172.21.15.76:0/4086318855 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d9e84e5a80 0x55d9e84e5ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:25.464 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.462+0000 7f938ffff700 1 -- 172.21.15.76:0/4086318855 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d9e82b7350 con 0x55d9e84e63e0 2024-06-02T05:04:25.465 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.463+0000 7f938ffff700 1 --2- 172.21.15.76:0/4086318855 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d9e84e63e0 0x55d9e84e6cf0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f937c099fd0 tx=0x7f937c099e90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=31b6deed72f0af72 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:04:25.467 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.464+0000 7f937affd700 1 -- 172.21.15.76:0/4086318855 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f937c0b1070 con 0x55d9e84e63e0 2024-06-02T05:04:25.467 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.464+0000 7f937affd700 1 -- 172.21.15.76:0/4086318855 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f937c015600 con 0x55d9e84e63e0 2024-06-02T05:04:25.467 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.464+0000 7f937affd700 1 -- 172.21.15.76:0/4086318855 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f937c0a24c0 con 0x55d9e84e63e0 2024-06-02T05:04:25.468 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.464+0000 7f93a2f99b80 1 -- 172.21.15.76:0/4086318855 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d9e84e63e0 msgr2=0x55d9e84e6cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:04:25.468 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.464+0000 7f93a2f99b80 1 --2- 172.21.15.76:0/4086318855 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d9e84e63e0 0x55d9e84e6cf0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f937c099fd0 tx=0x7f937c099e90 comp rx=0 tx=0).stop 2024-06-02T05:04:25.468 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.465+0000 7f939537b700 1 --2- 172.21.15.76:0/1191591449 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f93800a1320 0x7f93800a37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:04:25.470 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.469+0000 7f93a2f99b80 1 -- 172.21.15.76:0/4086318855 shutdown_connections 2024-06-02T05:04:25.470 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.469+0000 7f93a2f99b80 1 --2- 172.21.15.76:0/4086318855 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d9e84e72d0 0x55d9e84e7750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:25.470 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.469+0000 7f93a2f99b80 1 --2- 172.21.15.76:0/4086318855 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d9e84e5a80 0x55d9e84e5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:25.470 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.470+0000 7f93a2f99b80 1 --2- 172.21.15.76:0/4086318855 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d9e84e63e0 0x55d9e84e6cf0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:25.470 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.470+0000 7f93a2f99b80 1 -- 172.21.15.76:0/4086318855 >> 172.21.15.76:0/4086318855 conn(0x55d9e84441b0 msgr2=0x55d9e84e2440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:04:25.471 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.470+0000 7f939537b700 1 --2- 172.21.15.76:0/1191591449 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f93800a1320 0x7f93800a37e0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x55d9e84e6ab0 tx=0x7f9388008200 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:04:25.473 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.472+0000 7f93a2f99b80 1 -- 172.21.15.76:0/4086318855 shutdown_connections 2024-06-02T05:04:25.475 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.474+0000 7f93a2f99b80 1 -- 172.21.15.76:0/4086318855 wait complete. 2024-06-02T05:04:25.475 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.474+0000 7f93a2f99b80 1 -- start start 2024-06-02T05:04:25.475 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.474+0000 7f93a2f99b80 1 Processor -- start 2024-06-02T05:04:25.475 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.475+0000 7f93a2f99b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d9e84e5a80 0x55d9e84ef950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:04:25.476 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.475+0000 7f93a2f99b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d9e84e63e0 0x55d9e84efe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:04:25.476 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.475+0000 7f93a2f99b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d9e84e72d0 0x55d9e84f6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:04:25.476 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.475+0000 7f93a2f99b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9e83d2500 con 0x55d9e84e5a80 2024-06-02T05:04:25.476 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.475+0000 7f93a2f99b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9e83d21a0 con 0x55d9e84e63e0 2024-06-02T05:04:25.476 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.475+0000 7f93a2f99b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9e82b9640 con 0x55d9e84e72d0 2024-06-02T05:04:25.476 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.475+0000 7f93a2f99b80 10 client.0 _ll_register_callbacks cb 0x55d9e83dbad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T05:04:25.476 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.476+0000 7f939537b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d9e84e72d0 0x55d9e84f6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:04:25.476 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.476+0000 7f938ffff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d9e84e63e0 0x55d9e84efe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:04:25.476 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.476+0000 7f9394b7a700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d9e84e5a80 0x55d9e84ef950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:04:25.477 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.476+0000 7f9394b7a700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d9e84e5a80 0x55d9e84ef950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:36736/0 (socket says 172.21.15.76:36736) 2024-06-02T05:04:25.477 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.476+0000 7f9394b7a700 1 -- 172.21.15.76:0/3677041168 learned_addr learned my addr 172.21.15.76:0/3677041168 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:04:25.477 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.476+0000 7f938ffff700 1 -- 172.21.15.76:0/3677041168 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d9e84e72d0 msgr2=0x55d9e84f6ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:04:25.477 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.476+0000 7f938ffff700 1 --2- 172.21.15.76:0/3677041168 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d9e84e72d0 0x55d9e84f6ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:25.478 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.476+0000 7f938ffff700 1 -- 172.21.15.76:0/3677041168 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d9e84e5a80 msgr2=0x55d9e84ef950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:04:25.478 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.476+0000 7f938ffff700 1 --2- 172.21.15.76:0/3677041168 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d9e84e5a80 0x55d9e84ef950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:25.478 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.476+0000 7f938ffff700 1 -- 172.21.15.76:0/3677041168 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f939006b350 con 0x55d9e84e63e0 2024-06-02T05:04:25.478 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.476+0000 7f938ffff700 1 --2- 172.21.15.76:0/3677041168 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d9e84e63e0 0x55d9e84efe90 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f937c015790 tx=0x7f937c09a040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b2eeda07f2b8815 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:04:25.478 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.476+0000 7f936ffff700 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-06-02T05:04:25.478 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.477+0000 7f936ffff700 1 -- 172.21.15.76:0/3677041168 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f937c0b1030 con 0x55d9e84e63e0 2024-06-02T05:04:25.478 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.477+0000 7f936ffff700 1 -- 172.21.15.76:0/3677041168 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f937c0b2070 con 0x55d9e84e63e0 2024-06-02T05:04:25.478 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.477+0000 7f93a2f99b80 1 -- 172.21.15.76:0/3677041168 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d9e838f210 con 0x55d9e84e63e0 2024-06-02T05:04:25.479 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.477+0000 7f936ffff700 1 -- 172.21.15.76:0/3677041168 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f937c09a740 con 0x55d9e84e63e0 2024-06-02T05:04:25.480 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.480+0000 7f93a2f99b80 10 client.26252 fetch_fsmap learned FSMap version 36 2024-06-02T05:04:25.480 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.480+0000 7f93a2f99b80 1 -- 172.21.15.76:0/3677041168 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55d9e8263b00 con 0x55d9e84e63e0 2024-06-02T05:04:25.481 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.480+0000 7f936ffff700 1 -- 172.21.15.76:0/3677041168 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55d9e838f210 con 0x55d9e84e63e0 2024-06-02T05:04:25.481 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.480+0000 7f936ffff700 1 -- 172.21.15.76:0/3677041168 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f937c0a2150 con 0x55d9e84e63e0 2024-06-02T05:04:25.481 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.480+0000 7f93a2f99b80 10 client.26252 fetch_fsmap finished waiting for FSMap version 36 2024-06-02T05:04:25.481 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.480+0000 7f93a2f99b80 10 client.26252 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T05:04:25.481 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.480+0000 7f93a2f99b80 20 client.26252 populate_metadata read hostname 'smithi076' 2024-06-02T05:04:25.481 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.480+0000 7f93a2f99b80 1 --2- 172.21.15.76:0/3677041168 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55d9e84fb2f0 0x55d9e84fd6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:04:25.481 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.480+0000 7f93a2f99b80 4 client.26252 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T05:04:25.481 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.480+0000 7f93a2f99b80 1 -- 172.21.15.76:0/3677041168 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d9e84b57b0 con 0x55d9e84fb2f0 2024-06-02T05:04:25.482 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.481+0000 7f9394b7a700 1 --2- 172.21.15.76:0/3677041168 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55d9e84fb2f0 0x55d9e84fd6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:04:25.482 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.481+0000 7f9394b7a700 1 --2- 172.21.15.76:0/3677041168 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55d9e84fb2f0 0x55d9e84fd6e0 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b9804f7547c2e3ef server_cookie=e9932192ceb96d92 in_seq=0 out_seq=0 2024-06-02T05:04:25.482 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.481+0000 7f936ffff700 10 client.26252 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T05:04:25.482 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.482+0000 7f936ffff700 1 -- 172.21.15.76:0/3677041168 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55d9e84b57b0 con 0x55d9e84fb2f0 2024-06-02T05:04:25.482 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.482+0000 7f936ffff700 10 client.26252 handle_command_reply: tid=0 2024-06-02T05:04:25.483 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.482+0000 7f93a2f99b80 1 client.26252 shutdown 2024-06-02T05:04:25.486 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.485+0000 7f93a2f99b80 1 -- 172.21.15.76:0/3677041168 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d9e84e63e0 msgr2=0x55d9e84efe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:04:25.486 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.485+0000 7f93a2f99b80 1 --2- 172.21.15.76:0/3677041168 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d9e84e63e0 0x55d9e84efe90 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f937c015790 tx=0x7f937c09a040 comp rx=0 tx=0).stop 2024-06-02T05:04:25.486 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.485+0000 7f93a2f99b80 1 -- 172.21.15.76:0/3677041168 shutdown_connections 2024-06-02T05:04:25.486 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.485+0000 7f93a2f99b80 1 --2- 172.21.15.76:0/3677041168 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55d9e84fb2f0 0x55d9e84fd6e0 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:25.486 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.485+0000 7f93a2f99b80 1 --2- 172.21.15.76:0/3677041168 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d9e84e72d0 0x55d9e84f6ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:25.486 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.485+0000 7f93a2f99b80 1 --2- 172.21.15.76:0/3677041168 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d9e84e5a80 0x55d9e84ef950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:25.487 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.485+0000 7f93a2f99b80 1 --2- 172.21.15.76:0/3677041168 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d9e84e63e0 0x55d9e84efe90 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:25.487 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.485+0000 7f93a2f99b80 1 -- 172.21.15.76:0/3677041168 >> 172.21.15.76:0/3677041168 conn(0x55d9e84441b0 msgr2=0x55d9e84e0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:04:25.487 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.485+0000 7f936ffff700 0 client.26252 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T05:04:25.487 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.485+0000 7f93a2f99b80 1 -- 172.21.15.76:0/3677041168 shutdown_connections 2024-06-02T05:04:25.487 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.487+0000 7f93a2f99b80 1 -- 172.21.15.76:0/3677041168 wait complete. 2024-06-02T05:04:25.496 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.495+0000 7f93a2f99b80 20 client.26252 trim_cache size 0 max 16384 2024-06-02T05:04:25.526 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.525+0000 7f93a2f99b80 1 Processor -- start 2024-06-02T05:04:25.526 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.525+0000 7f93a2f99b80 1 -- start start 2024-06-02T05:04:25.526 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.525+0000 7f93a2f99b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d9e84e5a80 0x55d9e84ee540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:04:25.526 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.525+0000 7f93a2f99b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d9e84e63e0 0x55d9e84f6e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:04:25.526 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.525+0000 7f93a2f99b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d9e84e72d0 0x55d9e84eee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:04:25.526 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.525+0000 7f93a2f99b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9e84e1930 con 0x55d9e84e72d0 2024-06-02T05:04:25.527 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.525+0000 7f93a2f99b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9e84db750 con 0x55d9e84e5a80 2024-06-02T05:04:25.527 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.525+0000 7f93a2f99b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9e85028d0 con 0x55d9e84e63e0 2024-06-02T05:04:25.527 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.526+0000 7f9394b7a700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d9e84e5a80 0x55d9e84ee540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:04:25.527 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.526+0000 7f9394b7a700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d9e84e5a80 0x55d9e84ee540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:52834/0 (socket says 172.21.15.76:52834) 2024-06-02T05:04:25.527 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.526+0000 7f9394b7a700 1 -- 172.21.15.76:0/2489755514 learned_addr learned my addr 172.21.15.76:0/2489755514 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:04:25.527 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.526+0000 7f938ffff700 1 --2- 172.21.15.76:0/2489755514 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d9e84e63e0 0x55d9e84f6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:04:25.527 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.526+0000 7f939537b700 1 --2- 172.21.15.76:0/2489755514 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d9e84e72d0 0x55d9e84eee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:04:25.531 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.526+0000 7f9394b7a700 1 -- 172.21.15.76:0/2489755514 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d9e84e63e0 msgr2=0x55d9e84f6e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:04:25.531 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.526+0000 7f9394b7a700 1 --2- 172.21.15.76:0/2489755514 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d9e84e63e0 0x55d9e84f6e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:25.531 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.526+0000 7f9394b7a700 1 -- 172.21.15.76:0/2489755514 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d9e84e72d0 msgr2=0x55d9e84eee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:04:25.532 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.526+0000 7f9394b7a700 1 --2- 172.21.15.76:0/2489755514 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d9e84e72d0 0x55d9e84eee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:25.532 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.526+0000 7f9394b7a700 1 -- 172.21.15.76:0/2489755514 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d9e83fc500 con 0x55d9e84e5a80 2024-06-02T05:04:25.532 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.527+0000 7f9394b7a700 1 --2- 172.21.15.76:0/2489755514 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d9e84e5a80 0x55d9e84ee540 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f9384006010 tx=0x7f9384011040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f628e614159d100 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:04:25.532 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.527+0000 7f937b7fe700 1 -- 172.21.15.76:0/2489755514 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9384025070 con 0x55d9e84e5a80 2024-06-02T05:04:25.532 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.527+0000 7f937b7fe700 1 -- 172.21.15.76:0/2489755514 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9384015040 con 0x55d9e84e5a80 2024-06-02T05:04:25.532 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.527+0000 7f937b7fe700 1 -- 172.21.15.76:0/2489755514 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9384018c00 con 0x55d9e84e5a80 2024-06-02T05:04:25.532 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.528+0000 7f93a2f99b80 1 -- 172.21.15.76:0/2489755514 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d9e84e5a80 msgr2=0x55d9e84ee540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:04:25.532 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.528+0000 7f93a2f99b80 1 --2- 172.21.15.76:0/2489755514 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d9e84e5a80 0x55d9e84ee540 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f9384006010 tx=0x7f9384011040 comp rx=0 tx=0).stop 2024-06-02T05:04:25.533 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.531+0000 7f93a2f99b80 1 -- 172.21.15.76:0/2489755514 shutdown_connections 2024-06-02T05:04:25.533 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.531+0000 7f93a2f99b80 1 --2- 172.21.15.76:0/2489755514 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d9e84e72d0 0x55d9e84eee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:25.533 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.531+0000 7f93a2f99b80 1 --2- 172.21.15.76:0/2489755514 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d9e84e5a80 0x55d9e84ee540 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:25.533 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.531+0000 7f93a2f99b80 1 --2- 172.21.15.76:0/2489755514 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d9e84e63e0 0x55d9e84f6e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:25.533 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.531+0000 7f93a2f99b80 1 -- 172.21.15.76:0/2489755514 >> 172.21.15.76:0/2489755514 conn(0x55d9e84441b0 msgr2=0x55d9e84ed8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:04:25.533 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.531+0000 7f93a2f99b80 1 -- 172.21.15.76:0/2489755514 shutdown_connections 2024-06-02T05:04:25.533 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.531+0000 7f93a2f99b80 1 -- 172.21.15.76:0/2489755514 wait complete. 2024-06-02T05:04:25.534 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.532+0000 7f93a2f99b80 1 -- start start 2024-06-02T05:04:25.534 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.532+0000 7f93a2f99b80 1 Processor -- start 2024-06-02T05:04:25.534 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.532+0000 7f93a2f99b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d9e84e5a80 0x55d9e84f48c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:04:25.534 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.532+0000 7f93a2f99b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d9e84e63e0 0x55d9e84f4e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:04:25.534 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.532+0000 7f93a2f99b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d9e84e72d0 0x55d9e84f5e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:04:25.534 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.532+0000 7f93a2f99b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9e84f6350 con 0x55d9e84e5a80 2024-06-02T05:04:25.534 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.532+0000 7f93a2f99b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9e84f64c0 con 0x55d9e84e63e0 2024-06-02T05:04:25.534 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.532+0000 7f93a2f99b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9e84f6680 con 0x55d9e84e72d0 2024-06-02T05:04:25.534 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.532+0000 7f93a2f99b80 10 client.0 _ll_register_callbacks cb 0x55d9e83dbad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T05:04:25.534 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.532+0000 7f938ffff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d9e84e63e0 0x55d9e84f4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:04:25.534 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.532+0000 7f938ffff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d9e84e63e0 0x55d9e84f4e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:52842/0 (socket says 172.21.15.76:52842) 2024-06-02T05:04:25.534 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.532+0000 7f938ffff700 1 -- 172.21.15.76:0/1785890178 learned_addr learned my addr 172.21.15.76:0/1785890178 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:04:25.535 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.533+0000 7f938ffff700 1 -- 172.21.15.76:0/1785890178 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d9e84e72d0 msgr2=0x55d9e84f5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:04:25.535 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.533+0000 7f938ffff700 1 --2- 172.21.15.76:0/1785890178 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d9e84e72d0 0x55d9e84f5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:25.535 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.533+0000 7f938ffff700 1 -- 172.21.15.76:0/1785890178 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d9e84e5a80 msgr2=0x55d9e84f48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:04:25.536 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.533+0000 7f938ffff700 1 --2- 172.21.15.76:0/1785890178 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d9e84e5a80 0x55d9e84f48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:25.536 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.533+0000 7f938ffff700 1 -- 172.21.15.76:0/1785890178 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9390108310 con 0x55d9e84e63e0 2024-06-02T05:04:25.536 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.533+0000 7f938ffff700 1 --2- 172.21.15.76:0/1785890178 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d9e84e63e0 0x55d9e84f4e00 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f937c098390 tx=0x7f937c0998a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8912c39439839ced server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:04:25.536 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.533+0000 7f936ffff700 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-06-02T05:04:25.536 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.533+0000 7f936ffff700 1 -- 172.21.15.76:0/1785890178 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f937c0b1030 con 0x55d9e84e63e0 2024-06-02T05:04:25.536 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.533+0000 7f936ffff700 1 -- 172.21.15.76:0/1785890178 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f937c0b2070 con 0x55d9e84e63e0 2024-06-02T05:04:25.536 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.533+0000 7f93a2f99b80 1 -- 172.21.15.76:0/1785890178 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f937c015600 con 0x55d9e84e63e0 2024-06-02T05:04:25.536 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.534+0000 7f936ffff700 1 -- 172.21.15.76:0/1785890178 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f937c0cada0 con 0x55d9e84e63e0 2024-06-02T05:04:25.536 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.534+0000 7f93a2f99b80 10 client.26258 fetch_fsmap learned FSMap version 36 2024-06-02T05:04:25.536 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.534+0000 7f93a2f99b80 1 -- 172.21.15.76:0/1785890178 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55d9e82bbc70 con 0x55d9e84e63e0 2024-06-02T05:04:25.536 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.534+0000 7f936ffff700 1 -- 172.21.15.76:0/1785890178 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f937c015600 con 0x55d9e84e63e0 2024-06-02T05:04:25.536 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.534+0000 7f936ffff700 1 -- 172.21.15.76:0/1785890178 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f937c095e30 con 0x55d9e84e63e0 2024-06-02T05:04:25.537 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.535+0000 7f93a2f99b80 10 client.26258 fetch_fsmap finished waiting for FSMap version 36 2024-06-02T05:04:25.537 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.535+0000 7f93a2f99b80 10 client.26258 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T05:04:25.537 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.535+0000 7f93a2f99b80 20 client.26258 populate_metadata read hostname 'smithi076' 2024-06-02T05:04:25.537 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.535+0000 7f93a2f99b80 1 --2- 172.21.15.76:0/1785890178 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55d9e8551f30 0x55d9e8554350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:04:25.538 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.535+0000 7f93a2f99b80 4 client.26258 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T05:04:25.538 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.535+0000 7f93a2f99b80 1 -- 172.21.15.76:0/1785890178 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55d9e842ee60 con 0x55d9e8551f30 2024-06-02T05:04:25.538 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.536+0000 7f9394b7a700 1 --2- 172.21.15.76:0/1785890178 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55d9e8551f30 0x55d9e8554350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:04:25.538 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.536+0000 7f9394b7a700 1 --2- 172.21.15.76:0/1785890178 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55d9e8551f30 0x55d9e8554350 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b07431bdf70d5d1c server_cookie=cc6f1ec874e2e1a5 in_seq=0 out_seq=0 2024-06-02T05:04:25.538 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.536+0000 7f936ffff700 10 client.26258 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T05:04:25.565 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.564+0000 7f936ffff700 1 -- 172.21.15.76:0/1785890178 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55d9e842ee60 con 0x55d9e8551f30 2024-06-02T05:04:25.565 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.564+0000 7f936ffff700 10 client.26258 handle_command_reply: tid=0 2024-06-02T05:04:25.565 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.564+0000 7f93a2f99b80 1 client.26258 shutdown 2024-06-02T05:04:25.574 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:{ 2024-06-02T05:04:25.574 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "message": "", 2024-06-02T05:04:25.574 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "return_code": 0 2024-06-02T05:04:25.574 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:} 2024-06-02T05:04:25.575 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.567+0000 7f93a2f99b80 1 -- 172.21.15.76:0/1785890178 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d9e84e63e0 msgr2=0x55d9e84f4e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:04:25.575 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.567+0000 7f93a2f99b80 1 --2- 172.21.15.76:0/1785890178 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d9e84e63e0 0x55d9e84f4e00 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f937c098390 tx=0x7f937c0998a0 comp rx=0 tx=0).stop 2024-06-02T05:04:25.575 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.568+0000 7f93a2f99b80 1 -- 172.21.15.76:0/1785890178 shutdown_connections 2024-06-02T05:04:25.575 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.568+0000 7f93a2f99b80 1 --2- 172.21.15.76:0/1785890178 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55d9e8551f30 0x55d9e8554350 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:25.575 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.568+0000 7f93a2f99b80 1 --2- 172.21.15.76:0/1785890178 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d9e84e72d0 0x55d9e84f5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:25.575 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.568+0000 7f93a2f99b80 1 --2- 172.21.15.76:0/1785890178 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d9e84e5a80 0x55d9e84f48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:25.575 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.568+0000 7f93a2f99b80 1 --2- 172.21.15.76:0/1785890178 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d9e84e63e0 0x55d9e84f4e00 secure :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f937c098390 tx=0x7f937c0998a0 comp rx=0 tx=0).stop 2024-06-02T05:04:25.575 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.568+0000 7f93a2f99b80 1 -- 172.21.15.76:0/1785890178 >> 172.21.15.76:0/1785890178 conn(0x55d9e84441b0 msgr2=0x55d9e84e2020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:04:25.575 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.568+0000 7f936ffff700 0 client.26258 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T05:04:25.575 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.568+0000 7f93a2f99b80 1 -- 172.21.15.76:0/1785890178 shutdown_connections 2024-06-02T05:04:25.575 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.568+0000 7f93a2f99b80 1 -- 172.21.15.76:0/1785890178 wait complete. 2024-06-02T05:04:25.575 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.573+0000 7f93a2f99b80 20 client.26258 trim_cache size 0 max 16384 2024-06-02T05:04:25.577 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.576+0000 7f9396dde700 1 -- 172.21.15.76:0/1191591449 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f93800a1320 msgr2=0x7f93800a37e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:04:25.577 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.576+0000 7f9396dde700 1 --2- 172.21.15.76:0/1191591449 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f93800a1320 0x7f93800a37e0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x55d9e84e6ab0 tx=0x7f9388008200 comp rx=0 tx=0).stop 2024-06-02T05:04:25.577 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.576+0000 7f9396dde700 1 -- 172.21.15.76:0/1191591449 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9390100770 msgr2=0x7f93901a61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:04:25.577 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.576+0000 7f9396dde700 1 --2- 172.21.15.76:0/1191591449 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9390100770 0x7f93901a61d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f937c007970 tx=0x7f937c007c80 comp rx=0 tx=0).stop 2024-06-02T05:04:25.577 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.576+0000 7f9396dde700 1 -- 172.21.15.76:0/1191591449 shutdown_connections 2024-06-02T05:04:25.577 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.576+0000 7f9396dde700 1 --2- 172.21.15.76:0/1191591449 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9390101110 0x7f93901ad1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:25.578 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.576+0000 7f9396dde700 1 --2- 172.21.15.76:0/1191591449 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f93900ff580 0x7f93901a5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:25.578 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.576+0000 7f9396dde700 1 --2- 172.21.15.76:0/1191591449 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f93800a1320 0x7f93800a37e0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:25.578 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.576+0000 7f9396dde700 1 --2- 172.21.15.76:0/1191591449 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9390100770 0x7f93901a61d0 secure :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f937c007970 tx=0x7f937c007c80 comp rx=0 tx=0).stop 2024-06-02T05:04:25.578 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.576+0000 7f9396dde700 1 -- 172.21.15.76:0/1191591449 >> 172.21.15.76:0/1191591449 conn(0x7f93900faaf0 msgr2=0x7f9390103ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:04:25.580 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.579+0000 7f9396dde700 1 -- 172.21.15.76:0/1191591449 shutdown_connections 2024-06-02T05:04:25.581 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:25.581+0000 7f9396dde700 1 -- 172.21.15.76:0/1191591449 wait complete. 2024-06-02T05:04:26.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:04:25 smithi119 ceph-mon[46633]: pgmap v713: 129 pgs: 129 active+clean; 1.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 7.8 MiB/s wr, 690 op/s 2024-06-02T05:04:26.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:04:25 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T05:04:26.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:04:25 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T05:04:26.097 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:04:25 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T05:04:26.097 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:04:25 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T05:04:26.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:04:25 smithi192 ceph-mon[47933]: pgmap v713: 129 pgs: 129 active+clean; 1.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 7.8 MiB/s wr, 690 op/s 2024-06-02T05:04:26.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:04:25 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T05:04:26.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:04:25 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T05:04:26.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:04:25 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T05:04:26.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:04:25 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T05:04:26.237 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:04:25 smithi076 ceph-mon[42935]: pgmap v713: 129 pgs: 129 active+clean; 1.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 7.8 MiB/s wr, 690 op/s 2024-06-02T05:04:26.237 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:04:25 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T05:04:26.237 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:04:25 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T05:04:26.237 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:04:25 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T05:04:26.237 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:04:25 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T05:04:26.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 815.0 s, 496.0 tps, lat 186.144 ms stddev 77.738 2024-06-02T05:04:27.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:04:26 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T05:04:27.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:04:26 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T05:04:27.097 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:04:26 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T05:04:27.097 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:04:26 smithi119 ceph-mon[46633]: pgmap v714: 129 pgs: 129 active+clean; 1.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 8.6 MiB/s wr, 810 op/s 2024-06-02T05:04:27.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:04:26 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T05:04:27.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:04:26 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T05:04:27.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:04:26 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T05:04:27.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:04:26 smithi192 ceph-mon[47933]: pgmap v714: 129 pgs: 129 active+clean; 1.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 8.6 MiB/s wr, 810 op/s 2024-06-02T05:04:27.237 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:04:26 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T05:04:27.238 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:04:26 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T05:04:27.238 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:04:26 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T05:04:27.238 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:04:26 smithi076 ceph-mon[42935]: pgmap v714: 129 pgs: 129 active+clean; 1.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 8.6 MiB/s wr, 810 op/s 2024-06-02T05:04:30.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:04:29 smithi119 ceph-mon[46633]: pgmap v715: 129 pgs: 129 active+clean; 1.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.6 MiB/s wr, 694 op/s 2024-06-02T05:04:30.184 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:04:29 smithi192 ceph-mon[47933]: pgmap v715: 129 pgs: 129 active+clean; 1.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.6 MiB/s wr, 694 op/s 2024-06-02T05:04:30.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:04:29 smithi076 ceph-mon[42935]: pgmap v715: 129 pgs: 129 active+clean; 1.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.6 MiB/s wr, 694 op/s 2024-06-02T05:04:31.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 820.0 s, 538.0 tps, lat 139.612 ms stddev 55.401 2024-06-02T05:04:32.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:04:31 smithi119 ceph-mon[46633]: pgmap v716: 129 pgs: 129 active+clean; 1.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 8.7 MiB/s wr, 794 op/s 2024-06-02T05:04:32.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:04:31 smithi192 ceph-mon[47933]: pgmap v716: 129 pgs: 129 active+clean; 1.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 8.7 MiB/s wr, 794 op/s 2024-06-02T05:04:32.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:04:31 smithi076 ceph-mon[42935]: pgmap v716: 129 pgs: 129 active+clean; 1.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 8.7 MiB/s wr, 794 op/s 2024-06-02T05:04:34.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:04:33 smithi119 ceph-mon[46633]: pgmap v717: 129 pgs: 129 active+clean; 1.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 8.8 MiB/s wr, 788 op/s 2024-06-02T05:04:34.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:04:33 smithi192 ceph-mon[47933]: pgmap v717: 129 pgs: 129 active+clean; 1.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 8.8 MiB/s wr, 788 op/s 2024-06-02T05:04:34.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:04:33 smithi076 ceph-mon[42935]: pgmap v717: 129 pgs: 129 active+clean; 1.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 8.8 MiB/s wr, 788 op/s 2024-06-02T05:04:36.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:04:35 smithi119 ceph-mon[46633]: pgmap v718: 129 pgs: 129 active+clean; 1.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 7.2 MiB/s wr, 671 op/s 2024-06-02T05:04:36.183 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:04:35 smithi192 ceph-mon[47933]: pgmap v718: 129 pgs: 129 active+clean; 1.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 7.2 MiB/s wr, 671 op/s 2024-06-02T05:04:36.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:04:35 smithi076 ceph-mon[42935]: pgmap v718: 129 pgs: 129 active+clean; 1.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 7.2 MiB/s wr, 671 op/s 2024-06-02T05:04:36.323 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 825.0 s, 422.0 tps, lat 314.433 ms stddev 947.627 2024-06-02T05:04:38.098 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:04:37 smithi119 ceph-mon[46633]: pgmap v719: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 9.1 MiB/s wr, 814 op/s 2024-06-02T05:04:38.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:04:37 smithi192 ceph-mon[47933]: pgmap v719: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 9.1 MiB/s wr, 814 op/s 2024-06-02T05:04:38.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:04:37 smithi076 ceph-mon[42935]: pgmap v719: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 9.1 MiB/s wr, 814 op/s 2024-06-02T05:04:38.743 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.741+0000 7f15e1b96700 1 -- 172.21.15.76:0/2401456886 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f15dc1008e0 msgr2=0x7f15dc105180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:04:38.744 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.741+0000 7f15e1b96700 1 --2- 172.21.15.76:0/2401456886 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f15dc1008e0 0x7f15dc105180 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f15d401c0d0 tx=0x7f15d401c3e0 comp rx=0 tx=0).stop 2024-06-02T05:04:38.744 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.741+0000 7f15e1b96700 1 -- 172.21.15.76:0/2401456886 shutdown_connections 2024-06-02T05:04:38.744 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.741+0000 7f15e1b96700 1 --2- 172.21.15.76:0/2401456886 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f15dc1008e0 0x7f15dc105180 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:38.745 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.741+0000 7f15e1b96700 1 --2- 172.21.15.76:0/2401456886 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f15dc0ff1c0 0x7f15dc0ff5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:38.745 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.741+0000 7f15e1b96700 1 --2- 172.21.15.76:0/2401456886 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15dc0fff20 0x7f15dc1003a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:38.745 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.741+0000 7f15e1b96700 1 -- 172.21.15.76:0/2401456886 >> 172.21.15.76:0/2401456886 conn(0x7f15dc0faaf0 msgr2=0x7f15dc0fcf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:04:38.746 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.745+0000 7f15e1b96700 1 -- 172.21.15.76:0/2401456886 shutdown_connections 2024-06-02T05:04:38.746 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.745+0000 7f15e1b96700 1 -- 172.21.15.76:0/2401456886 wait complete. 2024-06-02T05:04:38.747 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.745+0000 7f15e1b96700 1 Processor -- start 2024-06-02T05:04:38.748 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.746+0000 7f15e1b96700 1 -- start start 2024-06-02T05:04:38.748 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.746+0000 7f15e1b96700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f15dc0fff20 0x7f15dc0716b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:04:38.748 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.746+0000 7f15e1b96700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f15dc1008e0 0x7f15dc071bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:04:38.748 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.746+0000 7f15e1b96700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15dc072130 0x7f15dc1a4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:04:38.748 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.746+0000 7f15e1b96700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15dc1a53e0 con 0x7f15dc1008e0 2024-06-02T05:04:38.748 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.746+0000 7f15e1b96700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15dc1a5520 con 0x7f15dc072130 2024-06-02T05:04:38.748 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.746+0000 7f15e1b96700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15dc1a56e0 con 0x7f15dc0fff20 2024-06-02T05:04:38.749 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.746+0000 7f15dbfff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15dc072130 0x7f15dc1a4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:04:38.749 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.746+0000 7f15dbfff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15dc072130 0x7f15dc1a4e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:43962/0 (socket says 172.21.15.76:43962) 2024-06-02T05:04:38.749 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.746+0000 7f15dbfff700 1 -- 172.21.15.76:0/3853173911 learned_addr learned my addr 172.21.15.76:0/3853173911 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:04:38.749 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.746+0000 7f15db7fe700 1 --2- 172.21.15.76:0/3853173911 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f15dc0fff20 0x7f15dc0716b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:04:38.749 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.746+0000 7f15daffd700 1 --2- 172.21.15.76:0/3853173911 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f15dc1008e0 0x7f15dc071bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:04:38.749 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.747+0000 7f15db7fe700 1 -- 172.21.15.76:0/3853173911 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15dc072130 msgr2=0x7f15dc1a4e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:04:38.749 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.747+0000 7f15db7fe700 1 --2- 172.21.15.76:0/3853173911 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15dc072130 0x7f15dc1a4e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:38.749 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.747+0000 7f15db7fe700 1 -- 172.21.15.76:0/3853173911 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f15dc1008e0 msgr2=0x7f15dc071bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:04:38.750 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.747+0000 7f15db7fe700 1 --2- 172.21.15.76:0/3853173911 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f15dc1008e0 0x7f15dc071bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:38.750 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.747+0000 7f15db7fe700 1 -- 172.21.15.76:0/3853173911 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15d0009520 con 0x7f15dc0fff20 2024-06-02T05:04:38.750 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.747+0000 7f15db7fe700 1 --2- 172.21.15.76:0/3853173911 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f15dc0fff20 0x7f15dc0716b0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f15dc067c40 tx=0x7f15cc00b6e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:04:38.753 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.752+0000 7f15d8ff9700 1 -- 172.21.15.76:0/3853173911 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15cc011830 con 0x7f15dc0fff20 2024-06-02T05:04:38.753 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.752+0000 7f15d8ff9700 1 -- 172.21.15.76:0/3853173911 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f15cc00be60 con 0x7f15dc0fff20 2024-06-02T05:04:38.753 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.752+0000 7f15d8ff9700 1 -- 172.21.15.76:0/3853173911 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15cc010c80 con 0x7f15dc0fff20 2024-06-02T05:04:38.754 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.752+0000 7f15e1b96700 1 -- 172.21.15.76:0/3853173911 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15d401ad10 con 0x7f15dc0fff20 2024-06-02T05:04:38.754 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.752+0000 7f15e1b96700 1 -- 172.21.15.76:0/3853173911 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15dc1a5cf0 con 0x7f15dc0fff20 2024-06-02T05:04:38.757 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.756+0000 7f15d8ff9700 1 -- 172.21.15.76:0/3853173911 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f15cc011990 con 0x7f15dc0fff20 2024-06-02T05:04:38.759 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.756+0000 7f15d8ff9700 1 --2- 172.21.15.76:0/3853173911 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f15c40a1320 0x7f15c40a37e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:04:38.759 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.756+0000 7f15edd51b80 1 Processor -- start 2024-06-02T05:04:38.759 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.757+0000 7f15d8ff9700 1 -- 172.21.15.76:0/3853173911 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f15cc0cc530 con 0x7f15dc0fff20 2024-06-02T05:04:38.759 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.757+0000 7f15edd51b80 1 -- start start 2024-06-02T05:04:38.760 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.757+0000 7f15edd51b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dc17903a80 0x55dc17903ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:04:38.760 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.757+0000 7f15edd51b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55dc179043e0 0x55dc17904cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:04:38.760 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.757+0000 7f15edd51b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55dc179052d0 0x55dc17905750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:04:38.760 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.757+0000 7f15edd51b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc1785b0f0 con 0x55dc179043e0 2024-06-02T05:04:38.760 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.757+0000 7f15edd51b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc17858ab0 con 0x55dc179052d0 2024-06-02T05:04:38.760 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.757+0000 7f15edd51b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc178543a0 con 0x55dc17903a80 2024-06-02T05:04:38.760 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.757+0000 7f15db7fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dc17903a80 0x55dc17903ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:04:38.760 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.757+0000 7f15db7fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dc17903a80 0x55dc17903ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:34082/0 (socket says 172.21.15.76:34082) 2024-06-02T05:04:38.760 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.757+0000 7f15db7fe700 1 -- 172.21.15.76:0/2839670195 learned_addr learned my addr 172.21.15.76:0/2839670195 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:04:38.760 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.757+0000 7f15dbfff700 1 --2- 172.21.15.76:0/2839670195 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55dc179052d0 0x55dc17905750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:04:38.760 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.757+0000 7f15daffd700 1 --2- 172.21.15.76:0/2839670195 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55dc179043e0 0x55dc17904cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:04:38.760 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.757+0000 7f15dbfff700 1 -- 172.21.15.76:0/2839670195 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dc17903a80 msgr2=0x55dc17903ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:04:38.761 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.757+0000 7f15dbfff700 1 --2- 172.21.15.76:0/2839670195 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dc17903a80 0x55dc17903ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:38.761 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.757+0000 7f15dbfff700 1 -- 172.21.15.76:0/2839670195 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55dc179043e0 msgr2=0x55dc17904cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:04:38.761 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.757+0000 7f15dbfff700 1 --2- 172.21.15.76:0/2839670195 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55dc179043e0 0x55dc17904cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:38.761 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.757+0000 7f15dbfff700 1 -- 172.21.15.76:0/2839670195 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dc176d5350 con 0x55dc179052d0 2024-06-02T05:04:38.761 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.757+0000 7f15db7fe700 1 --2- 172.21.15.76:0/2839670195 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dc17903a80 0x55dc17903ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T05:04:38.761 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.758+0000 7f15dbfff700 1 --2- 172.21.15.76:0/2839670195 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55dc179052d0 0x55dc17905750 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f15d401a4f0 tx=0x7f15d401a520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c38d1dae3cfdf75f server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:04:38.761 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.758+0000 7f15c1ffb700 1 -- 172.21.15.76:0/2839670195 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15d401f050 con 0x55dc179052d0 2024-06-02T05:04:38.761 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.758+0000 7f15c1ffb700 1 -- 172.21.15.76:0/2839670195 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f15d401cae0 con 0x55dc179052d0 2024-06-02T05:04:38.761 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.758+0000 7f15c1ffb700 1 -- 172.21.15.76:0/2839670195 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15d4005070 con 0x55dc179052d0 2024-06-02T05:04:38.763 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.759+0000 7f15edd51b80 1 -- 172.21.15.76:0/2839670195 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55dc179052d0 msgr2=0x55dc17905750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:04:38.763 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.759+0000 7f15edd51b80 1 --2- 172.21.15.76:0/2839670195 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55dc179052d0 0x55dc17905750 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f15d401a4f0 tx=0x7f15d401a520 comp rx=0 tx=0).stop 2024-06-02T05:04:38.763 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.759+0000 7f15daffd700 1 --2- 172.21.15.76:0/3853173911 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f15c40a1320 0x7f15c40a37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:04:38.764 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.759+0000 7f15edd51b80 1 -- 172.21.15.76:0/2839670195 shutdown_connections 2024-06-02T05:04:38.764 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.759+0000 7f15edd51b80 1 --2- 172.21.15.76:0/2839670195 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55dc179052d0 0x55dc17905750 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:38.764 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.759+0000 7f15edd51b80 1 --2- 172.21.15.76:0/2839670195 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dc17903a80 0x55dc17903ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:38.764 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.759+0000 7f15edd51b80 1 --2- 172.21.15.76:0/2839670195 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55dc179043e0 0x55dc17904cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:38.764 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.759+0000 7f15edd51b80 1 -- 172.21.15.76:0/2839670195 >> 172.21.15.76:0/2839670195 conn(0x55dc178621b0 msgr2=0x55dc17900440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:04:38.764 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.759+0000 7f15edd51b80 1 -- 172.21.15.76:0/2839670195 shutdown_connections 2024-06-02T05:04:38.764 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.759+0000 7f15edd51b80 1 -- 172.21.15.76:0/2839670195 wait complete. 2024-06-02T05:04:38.764 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.759+0000 7f15edd51b80 1 -- start start 2024-06-02T05:04:38.764 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.759+0000 7f15edd51b80 1 Processor -- start 2024-06-02T05:04:38.764 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.759+0000 7f15daffd700 1 --2- 172.21.15.76:0/3853173911 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f15c40a1320 0x7f15c40a37e0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f15d0009470 tx=0x7f15d00047c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:04:38.764 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.759+0000 7f15edd51b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55dc17903a80 0x55dc1790d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:04:38.765 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.759+0000 7f15edd51b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55dc179043e0 0x55dc1790dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:04:38.765 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.760+0000 7f15edd51b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dc179052d0 0x55dc17914d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:04:38.765 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.760+0000 7f15edd51b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc177f0500 con 0x55dc17903a80 2024-06-02T05:04:38.765 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.760+0000 7f15edd51b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc177f01a0 con 0x55dc179043e0 2024-06-02T05:04:38.765 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.760+0000 7f15edd51b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc176d7640 con 0x55dc179052d0 2024-06-02T05:04:38.765 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.760+0000 7f15edd51b80 10 client.0 _ll_register_callbacks cb 0x55dc177f9ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T05:04:38.765 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.760+0000 7f15db7fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55dc17903a80 0x55dc1790d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:04:38.765 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.760+0000 7f15db7fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55dc17903a80 0x55dc1790d810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:58476/0 (socket says 172.21.15.76:58476) 2024-06-02T05:04:38.765 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.760+0000 7f15db7fe700 1 -- 172.21.15.76:0/2286113619 learned_addr learned my addr 172.21.15.76:0/2286113619 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:04:38.765 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.760+0000 7f15daffd700 1 --2- 172.21.15.76:0/2286113619 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55dc179043e0 0x55dc1790dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:04:38.765 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.760+0000 7f15dbfff700 1 --2- 172.21.15.76:0/2286113619 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dc179052d0 0x55dc17914d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:04:38.765 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.760+0000 7f15daffd700 1 -- 172.21.15.76:0/2286113619 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dc179052d0 msgr2=0x55dc17914d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:04:38.766 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.760+0000 7f15daffd700 1 --2- 172.21.15.76:0/2286113619 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dc179052d0 0x55dc17914d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:38.766 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.760+0000 7f15daffd700 1 -- 172.21.15.76:0/2286113619 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55dc17903a80 msgr2=0x55dc1790d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:04:38.766 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.760+0000 7f15daffd700 1 --2- 172.21.15.76:0/2286113619 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55dc17903a80 0x55dc1790d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:38.766 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.760+0000 7f15daffd700 1 -- 172.21.15.76:0/2286113619 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15dc1a5cf0 con 0x55dc179043e0 2024-06-02T05:04:38.766 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.760+0000 7f15daffd700 1 --2- 172.21.15.76:0/2286113619 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55dc179043e0 0x55dc1790dd50 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f15d0010ba0 tx=0x7f15d0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f4db4a62fe881ed server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:04:38.766 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.760+0000 7f15baffd700 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-06-02T05:04:38.766 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.760+0000 7f15baffd700 1 -- 172.21.15.76:0/2286113619 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15d0022070 con 0x55dc179043e0 2024-06-02T05:04:38.766 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.760+0000 7f15baffd700 1 -- 172.21.15.76:0/2286113619 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f15d001d2e0 con 0x55dc179043e0 2024-06-02T05:04:38.766 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.760+0000 7f15edd51b80 1 -- 172.21.15.76:0/2286113619 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55dc177ad210 con 0x55dc179043e0 2024-06-02T05:04:38.766 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.761+0000 7f15baffd700 1 -- 172.21.15.76:0/2286113619 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f15d0016040 con 0x55dc179043e0 2024-06-02T05:04:38.766 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.761+0000 7f15edd51b80 10 client.26270 fetch_fsmap learned FSMap version 36 2024-06-02T05:04:38.766 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.761+0000 7f15edd51b80 1 -- 172.21.15.76:0/2286113619 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x7f15dc105bb0 con 0x55dc179043e0 2024-06-02T05:04:38.767 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.761+0000 7f15baffd700 1 -- 172.21.15.76:0/2286113619 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55dc177ad210 con 0x55dc179043e0 2024-06-02T05:04:38.767 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.761+0000 7f15baffd700 1 -- 172.21.15.76:0/2286113619 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f15d001ad20 con 0x55dc179043e0 2024-06-02T05:04:38.767 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.761+0000 7f15edd51b80 10 client.26270 fetch_fsmap finished waiting for FSMap version 36 2024-06-02T05:04:38.767 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.761+0000 7f15edd51b80 10 client.26270 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T05:04:38.767 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.761+0000 7f15edd51b80 20 client.26270 populate_metadata read hostname 'smithi076' 2024-06-02T05:04:38.767 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.761+0000 7f15edd51b80 1 --2- 172.21.15.76:0/2286113619 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55dc179196a0 0x55dc1791bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:04:38.767 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.761+0000 7f15edd51b80 4 client.26270 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T05:04:38.767 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.761+0000 7f15edd51b80 1 -- 172.21.15.76:0/2286113619 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55dc178d37b0 con 0x55dc179196a0 2024-06-02T05:04:38.767 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.761+0000 7f15db7fe700 1 --2- 172.21.15.76:0/2286113619 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55dc179196a0 0x55dc1791bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:04:38.767 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.761+0000 7f15baffd700 10 client.26270 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T05:04:38.768 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.762+0000 7f15db7fe700 1 --2- 172.21.15.76:0/2286113619 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55dc179196a0 0x55dc1791bac0 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1029d86715d59501 server_cookie=62426037de6de393 in_seq=0 out_seq=0 2024-06-02T05:04:38.769 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.763+0000 7f15baffd700 1 -- 172.21.15.76:0/2286113619 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55dc178d37b0 con 0x55dc179196a0 2024-06-02T05:04:38.769 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.763+0000 7f15baffd700 10 client.26270 handle_command_reply: tid=0 2024-06-02T05:04:38.769 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.764+0000 7f15edd51b80 1 client.26270 shutdown 2024-06-02T05:04:38.769 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.764+0000 7f15edd51b80 1 -- 172.21.15.76:0/2286113619 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55dc179043e0 msgr2=0x55dc1790dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:04:38.769 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.764+0000 7f15edd51b80 1 --2- 172.21.15.76:0/2286113619 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55dc179043e0 0x55dc1790dd50 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f15d0010ba0 tx=0x7f15d0004750 comp rx=0 tx=0).stop 2024-06-02T05:04:38.769 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.767+0000 7f15edd51b80 1 -- 172.21.15.76:0/2286113619 shutdown_connections 2024-06-02T05:04:38.769 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.767+0000 7f15edd51b80 1 --2- 172.21.15.76:0/2286113619 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55dc179196a0 0x55dc1791bac0 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:38.769 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.767+0000 7f15edd51b80 1 --2- 172.21.15.76:0/2286113619 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dc179052d0 0x55dc17914d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:38.769 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.767+0000 7f15edd51b80 1 --2- 172.21.15.76:0/2286113619 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55dc17903a80 0x55dc1790d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:38.769 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.767+0000 7f15edd51b80 1 --2- 172.21.15.76:0/2286113619 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55dc179043e0 0x55dc1790dd50 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:38.769 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.767+0000 7f15edd51b80 1 -- 172.21.15.76:0/2286113619 >> 172.21.15.76:0/2286113619 conn(0x55dc178621b0 msgr2=0x55dc178fe860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:04:38.770 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.767+0000 7f15baffd700 0 client.26270 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T05:04:38.770 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.767+0000 7f15edd51b80 1 -- 172.21.15.76:0/2286113619 shutdown_connections 2024-06-02T05:04:38.770 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.767+0000 7f15edd51b80 1 -- 172.21.15.76:0/2286113619 wait complete. 2024-06-02T05:04:38.770 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.768+0000 7f15edd51b80 20 client.26270 trim_cache size 0 max 16384 2024-06-02T05:04:38.795 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.793+0000 7f15edd51b80 1 Processor -- start 2024-06-02T05:04:38.798 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.796+0000 7f15edd51b80 1 -- start start 2024-06-02T05:04:38.798 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.796+0000 7f15edd51b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55dc17903a80 0x55dc179056b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:04:38.798 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.796+0000 7f15edd51b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55dc179043e0 0x55dc17914d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:04:38.798 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.796+0000 7f15edd51b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dc179052d0 0x55dc1790b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:04:38.799 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.796+0000 7f15edd51b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc17916b20 con 0x55dc17903a80 2024-06-02T05:04:38.799 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.796+0000 7f15edd51b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc1790e710 con 0x55dc179043e0 2024-06-02T05:04:38.799 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.796+0000 7f15edd51b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc1790d380 con 0x55dc179052d0 2024-06-02T05:04:38.799 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.796+0000 7f15db7fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55dc17903a80 0x55dc179056b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:04:38.799 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.796+0000 7f15db7fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55dc17903a80 0x55dc179056b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:58486/0 (socket says 172.21.15.76:58486) 2024-06-02T05:04:38.799 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.796+0000 7f15db7fe700 1 -- 172.21.15.76:0/317264499 learned_addr learned my addr 172.21.15.76:0/317264499 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:04:38.800 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.797+0000 7f15db7fe700 1 -- 172.21.15.76:0/317264499 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dc179052d0 msgr2=0x55dc1790b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:04:38.800 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.797+0000 7f15db7fe700 1 --2- 172.21.15.76:0/317264499 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dc179052d0 0x55dc1790b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:38.800 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.797+0000 7f15db7fe700 1 -- 172.21.15.76:0/317264499 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55dc179043e0 msgr2=0x55dc17914d50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-02T05:04:38.800 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.797+0000 7f15db7fe700 1 --2- 172.21.15.76:0/317264499 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55dc179043e0 0x55dc17914d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:38.800 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.797+0000 7f15db7fe700 1 -- 172.21.15.76:0/317264499 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dc17681b00 con 0x55dc17903a80 2024-06-02T05:04:38.800 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.797+0000 7f15db7fe700 1 --2- 172.21.15.76:0/317264499 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55dc17903a80 0x55dc179056b0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f15cc099570 tx=0x7f15cc0c9b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6af038c5d67f712c server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:04:38.800 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.797+0000 7f15c27fc700 1 -- 172.21.15.76:0/317264499 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15cc010380 con 0x55dc17903a80 2024-06-02T05:04:38.800 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.797+0000 7f15c27fc700 1 -- 172.21.15.76:0/317264499 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f15cc018310 con 0x55dc17903a80 2024-06-02T05:04:38.800 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.797+0000 7f15c27fc700 1 -- 172.21.15.76:0/317264499 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15cc0c9da0 con 0x55dc17903a80 2024-06-02T05:04:38.801 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.798+0000 7f15edd51b80 1 -- 172.21.15.76:0/317264499 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55dc17903a80 msgr2=0x55dc179056b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:04:38.801 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.798+0000 7f15edd51b80 1 --2- 172.21.15.76:0/317264499 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55dc17903a80 0x55dc179056b0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f15cc099570 tx=0x7f15cc0c9b60 comp rx=0 tx=0).stop 2024-06-02T05:04:38.801 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.798+0000 7f15edd51b80 1 -- 172.21.15.76:0/317264499 shutdown_connections 2024-06-02T05:04:38.801 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.798+0000 7f15edd51b80 1 --2- 172.21.15.76:0/317264499 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dc179052d0 0x55dc1790b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:38.801 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.798+0000 7f15edd51b80 1 --2- 172.21.15.76:0/317264499 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55dc17903a80 0x55dc179056b0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:38.801 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.798+0000 7f15edd51b80 1 --2- 172.21.15.76:0/317264499 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55dc179043e0 0x55dc17914d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:38.801 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.798+0000 7f15edd51b80 1 -- 172.21.15.76:0/317264499 >> 172.21.15.76:0/317264499 conn(0x55dc178621b0 msgr2=0x55dc17908510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:04:38.805 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.803+0000 7f15edd51b80 1 -- 172.21.15.76:0/317264499 shutdown_connections 2024-06-02T05:04:38.805 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.803+0000 7f15edd51b80 1 -- 172.21.15.76:0/317264499 wait complete. 2024-06-02T05:04:38.805 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.803+0000 7f15edd51b80 1 -- start start 2024-06-02T05:04:38.805 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.803+0000 7f15edd51b80 1 Processor -- start 2024-06-02T05:04:38.810 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.804+0000 7f15edd51b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dc17903a80 0x55dc17912360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:04:38.810 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.804+0000 7f15edd51b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55dc179043e0 0x55dc179128a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:04:38.810 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.804+0000 7f15edd51b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55dc179052d0 0x55dc17913720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:04:38.810 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.804+0000 7f15edd51b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc17913c60 con 0x55dc179043e0 2024-06-02T05:04:38.810 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.804+0000 7f15edd51b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc17913dd0 con 0x55dc179052d0 2024-06-02T05:04:38.810 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.804+0000 7f15edd51b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc17913f90 con 0x55dc17903a80 2024-06-02T05:04:38.811 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.804+0000 7f15edd51b80 10 client.0 _ll_register_callbacks cb 0x55dc177f9ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T05:04:38.811 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.804+0000 7f15db7fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dc17903a80 0x55dc17912360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:04:38.811 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.804+0000 7f15db7fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dc17903a80 0x55dc17912360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:34102/0 (socket says 172.21.15.76:34102) 2024-06-02T05:04:38.811 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.804+0000 7f15db7fe700 1 -- 172.21.15.76:0/3074955154 learned_addr learned my addr 172.21.15.76:0/3074955154 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:04:38.811 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.804+0000 7f15dbfff700 1 --2- 172.21.15.76:0/3074955154 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55dc179052d0 0x55dc17913720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:04:38.811 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.804+0000 7f15db7fe700 1 -- 172.21.15.76:0/3074955154 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55dc179052d0 msgr2=0x55dc17913720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:04:38.811 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.804+0000 7f15db7fe700 1 --2- 172.21.15.76:0/3074955154 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55dc179052d0 0x55dc17913720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:38.811 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.804+0000 7f15db7fe700 1 -- 172.21.15.76:0/3074955154 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55dc179043e0 msgr2=0x55dc179128a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:04:38.812 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.804+0000 7f15db7fe700 1 --2- 172.21.15.76:0/3074955154 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55dc179043e0 0x55dc179128a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:38.812 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.804+0000 7f15db7fe700 1 -- 172.21.15.76:0/3074955154 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15cc0cc040 con 0x55dc17903a80 2024-06-02T05:04:38.812 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.804+0000 7f15db7fe700 1 --2- 172.21.15.76:0/3074955154 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dc17903a80 0x55dc17912360 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f15cc095ae0 tx=0x7f15cc010680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b624601543b18ebd server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:04:38.812 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.804+0000 7f15baffd700 10 client.0 ms_handle_connect on v2:172.21.15.192:3300/0 2024-06-02T05:04:38.812 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.805+0000 7f15baffd700 1 -- 172.21.15.76:0/3074955154 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15cc0995e0 con 0x55dc17903a80 2024-06-02T05:04:38.812 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.805+0000 7f15baffd700 1 -- 172.21.15.76:0/3074955154 <== mon.1 v2:172.21.15.192:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f15cc0b3070 con 0x55dc17903a80 2024-06-02T05:04:38.812 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.805+0000 7f15edd51b80 1 -- 172.21.15.76:0/3074955154 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f15d401cae0 con 0x55dc17903a80 2024-06-02T05:04:38.813 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.809+0000 7f15baffd700 1 -- 172.21.15.76:0/3074955154 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f15cc099ce0 con 0x55dc17903a80 2024-06-02T05:04:38.813 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.809+0000 7f15edd51b80 10 client.26221 fetch_fsmap learned FSMap version 36 2024-06-02T05:04:38.813 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.809+0000 7f15edd51b80 1 -- 172.21.15.76:0/3074955154 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55dc1781a500 con 0x55dc17903a80 2024-06-02T05:04:38.813 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.809+0000 7f15baffd700 1 -- 172.21.15.76:0/3074955154 <== mon.1 v2:172.21.15.192:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f15d401cae0 con 0x55dc17903a80 2024-06-02T05:04:38.814 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.809+0000 7f15baffd700 1 -- 172.21.15.76:0/3074955154 <== mon.1 v2:172.21.15.192:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f15cc099840 con 0x55dc17903a80 2024-06-02T05:04:38.814 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.810+0000 7f15edd51b80 10 client.26221 fetch_fsmap finished waiting for FSMap version 36 2024-06-02T05:04:38.814 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.810+0000 7f15edd51b80 10 client.26221 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T05:04:38.814 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.810+0000 7f15edd51b80 20 client.26221 populate_metadata read hostname 'smithi076' 2024-06-02T05:04:38.814 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.810+0000 7f15edd51b80 1 --2- 172.21.15.76:0/3074955154 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55dc1796ff00 0x55dc179722f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:04:38.814 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.810+0000 7f15edd51b80 4 client.26221 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T05:04:38.814 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.810+0000 7f15edd51b80 1 -- 172.21.15.76:0/3074955154 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55dc1784ce60 con 0x55dc1796ff00 2024-06-02T05:04:38.814 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.810+0000 7f15daffd700 1 --2- 172.21.15.76:0/3074955154 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55dc1796ff00 0x55dc179722f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:04:38.814 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.811+0000 7f15baffd700 10 client.26221 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T05:04:38.814 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.811+0000 7f15daffd700 1 --2- 172.21.15.76:0/3074955154 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55dc1796ff00 0x55dc179722f0 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e431612f3b1715e server_cookie=f69f50e3d075dd04 in_seq=0 out_seq=0 2024-06-02T05:04:38.843 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.841+0000 7f15baffd700 1 -- 172.21.15.76:0/3074955154 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55dc1784ce60 con 0x55dc1796ff00 2024-06-02T05:04:38.843 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.841+0000 7f15baffd700 10 client.26221 handle_command_reply: tid=0 2024-06-02T05:04:38.844 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.843+0000 7f15edd51b80 1 client.26221 shutdown 2024-06-02T05:04:38.847 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.844+0000 7f15edd51b80 1 -- 172.21.15.76:0/3074955154 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dc17903a80 msgr2=0x55dc17912360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:04:38.847 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.844+0000 7f15edd51b80 1 --2- 172.21.15.76:0/3074955154 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dc17903a80 0x55dc17912360 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f15cc095ae0 tx=0x7f15cc010680 comp rx=0 tx=0).stop 2024-06-02T05:04:38.847 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.845+0000 7f15edd51b80 1 -- 172.21.15.76:0/3074955154 shutdown_connections 2024-06-02T05:04:38.847 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.845+0000 7f15edd51b80 1 --2- 172.21.15.76:0/3074955154 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55dc1796ff00 0x55dc179722f0 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:38.847 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.845+0000 7f15edd51b80 1 --2- 172.21.15.76:0/3074955154 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55dc179052d0 0x55dc17913720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:38.847 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.845+0000 7f15edd51b80 1 --2- 172.21.15.76:0/3074955154 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dc17903a80 0x55dc17912360 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:38.847 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.845+0000 7f15edd51b80 1 --2- 172.21.15.76:0/3074955154 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55dc179043e0 0x55dc179128a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:38.847 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.845+0000 7f15edd51b80 1 -- 172.21.15.76:0/3074955154 >> 172.21.15.76:0/3074955154 conn(0x55dc178621b0 msgr2=0x55dc1790c9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:04:38.847 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.845+0000 7f15baffd700 0 client.26221 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T05:04:38.847 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.845+0000 7f15edd51b80 1 -- 172.21.15.76:0/3074955154 shutdown_connections 2024-06-02T05:04:38.848 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.845+0000 7f15edd51b80 1 -- 172.21.15.76:0/3074955154 wait complete. 2024-06-02T05:04:38.848 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.845+0000 7f15edd51b80 20 client.26221 trim_cache size 0 max 16384 2024-06-02T05:04:38.848 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:{ 2024-06-02T05:04:38.848 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "message": "", 2024-06-02T05:04:38.848 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "return_code": 0 2024-06-02T05:04:38.848 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:} 2024-06-02T05:04:38.849 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.845+0000 7f15e1b96700 1 -- 172.21.15.76:0/3853173911 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f15c40a1320 msgr2=0x7f15c40a37e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:04:38.849 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.845+0000 7f15e1b96700 1 --2- 172.21.15.76:0/3853173911 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f15c40a1320 0x7f15c40a37e0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f15d0009470 tx=0x7f15d00047c0 comp rx=0 tx=0).stop 2024-06-02T05:04:38.849 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.845+0000 7f15e1b96700 1 -- 172.21.15.76:0/3853173911 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f15dc0fff20 msgr2=0x7f15dc0716b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:04:38.849 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.845+0000 7f15e1b96700 1 --2- 172.21.15.76:0/3853173911 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f15dc0fff20 0x7f15dc0716b0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f15dc067c40 tx=0x7f15cc00b6e0 comp rx=0 tx=0).stop 2024-06-02T05:04:38.849 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.845+0000 7f15e1b96700 1 -- 172.21.15.76:0/3853173911 shutdown_connections 2024-06-02T05:04:38.849 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.845+0000 7f15e1b96700 1 --2- 172.21.15.76:0/3853173911 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f15c40a1320 0x7f15c40a37e0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:38.849 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.845+0000 7f15e1b96700 1 --2- 172.21.15.76:0/3853173911 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15dc072130 0x7f15dc1a4e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:38.850 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.845+0000 7f15e1b96700 1 --2- 172.21.15.76:0/3853173911 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f15dc0fff20 0x7f15dc0716b0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:38.850 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.845+0000 7f15e1b96700 1 --2- 172.21.15.76:0/3853173911 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f15dc1008e0 0x7f15dc071bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:38.850 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.845+0000 7f15e1b96700 1 -- 172.21.15.76:0/3853173911 >> 172.21.15.76:0/3853173911 conn(0x7f15dc0faaf0 msgr2=0x7f15dc103240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:04:38.850 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.846+0000 7f15e1b96700 1 -- 172.21.15.76:0/3853173911 shutdown_connections 2024-06-02T05:04:38.850 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:38.846+0000 7f15e1b96700 1 -- 172.21.15.76:0/3853173911 wait complete. 2024-06-02T05:04:40.097 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:04:39 smithi119 ceph-mon[46633]: pgmap v720: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 7.9 MiB/s wr, 687 op/s 2024-06-02T05:04:40.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:04:39 smithi192 ceph-mon[47933]: pgmap v720: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 7.9 MiB/s wr, 687 op/s 2024-06-02T05:04:40.248 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:04:39 smithi076 ceph-mon[42935]: pgmap v720: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 7.9 MiB/s wr, 687 op/s 2024-06-02T05:04:41.318 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 830.0 s, 612.5 tps, lat 163.164 ms stddev 80.957 2024-06-02T05:04:42.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:04:41 smithi119 ceph-mon[46633]: pgmap v721: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 10 MiB/s wr, 804 op/s 2024-06-02T05:04:42.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:04:41 smithi192 ceph-mon[47933]: pgmap v721: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 10 MiB/s wr, 804 op/s 2024-06-02T05:04:42.237 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:04:41 smithi076 ceph-mon[42935]: pgmap v721: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 10 MiB/s wr, 804 op/s 2024-06-02T05:04:44.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:04:43 smithi119 ceph-mon[46633]: pgmap v722: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 13 MiB/s wr, 799 op/s 2024-06-02T05:04:44.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:04:43 smithi192 ceph-mon[47933]: pgmap v722: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 13 MiB/s wr, 799 op/s 2024-06-02T05:04:44.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:04:43 smithi076 ceph-mon[42935]: pgmap v722: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 13 MiB/s wr, 799 op/s 2024-06-02T05:04:46.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:04:45 smithi119 ceph-mon[46633]: pgmap v723: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 12 MiB/s wr, 715 op/s 2024-06-02T05:04:46.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:04:45 smithi192 ceph-mon[47933]: pgmap v723: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 12 MiB/s wr, 715 op/s 2024-06-02T05:04:46.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:04:45 smithi076 ceph-mon[42935]: pgmap v723: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 12 MiB/s wr, 715 op/s 2024-06-02T05:04:46.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 835.0 s, 652.0 tps, lat 153.756 ms stddev 64.080 2024-06-02T05:04:48.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:04:47 smithi192 ceph-mon[47933]: pgmap v724: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 15 MiB/s wr, 894 op/s 2024-06-02T05:04:48.237 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:04:47 smithi076 ceph-mon[42935]: pgmap v724: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 15 MiB/s wr, 894 op/s 2024-06-02T05:04:48.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:04:47 smithi119 ceph-mon[46633]: pgmap v724: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 15 MiB/s wr, 894 op/s 2024-06-02T05:04:50.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:04:49 smithi192 ceph-mon[47933]: pgmap v725: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 15 MiB/s wr, 771 op/s 2024-06-02T05:04:50.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:04:49 smithi076 ceph-mon[42935]: pgmap v725: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 15 MiB/s wr, 771 op/s 2024-06-02T05:04:50.351 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:04:49 smithi119 ceph-mon[46633]: pgmap v725: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 15 MiB/s wr, 771 op/s 2024-06-02T05:04:51.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 840.0 s, 569.8 tps, lat 176.398 ms stddev 72.134 2024-06-02T05:04:52.028 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.027+0000 7ff61b4e7700 1 -- 172.21.15.76:0/1452468800 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff614102080 msgr2=0x7ff614102500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:04:52.029 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.027+0000 7ff61b4e7700 1 --2- 172.21.15.76:0/1452468800 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff614102080 0x7ff614102500 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7ff6040098f0 tx=0x7ff604009c00 comp rx=0 tx=0).stop 2024-06-02T05:04:52.029 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.028+0000 7ff61b4e7700 1 -- 172.21.15.76:0/1452468800 shutdown_connections 2024-06-02T05:04:52.029 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.028+0000 7ff61b4e7700 1 --2- 172.21.15.76:0/1452468800 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff614102a40 0x7ff614109360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:52.029 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.028+0000 7ff61b4e7700 1 --2- 172.21.15.76:0/1452468800 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff614100f30 0x7ff614101350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:52.029 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.028+0000 7ff61b4e7700 1 --2- 172.21.15.76:0/1452468800 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff614102080 0x7ff614102500 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:52.029 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.028+0000 7ff61b4e7700 1 -- 172.21.15.76:0/1452468800 >> 172.21.15.76:0/1452468800 conn(0x7ff6140fc4e0 msgr2=0x7ff6140fe900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:04:52.030 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.029+0000 7ff61b4e7700 1 -- 172.21.15.76:0/1452468800 shutdown_connections 2024-06-02T05:04:52.030 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.029+0000 7ff61b4e7700 1 -- 172.21.15.76:0/1452468800 wait complete. 2024-06-02T05:04:52.030 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.030+0000 7ff61b4e7700 1 Processor -- start 2024-06-02T05:04:52.031 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.030+0000 7ff61b4e7700 1 -- start start 2024-06-02T05:04:52.031 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.030+0000 7ff61b4e7700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff614100f30 0x7ff614074d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:04:52.031 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.030+0000 7ff61b4e7700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff614102080 0x7ff614073390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:04:52.031 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.030+0000 7ff61b4e7700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff614102a40 0x7ff6140738d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:04:52.032 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.030+0000 7ff61b4e7700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff61419acb0 con 0x7ff614102a40 2024-06-02T05:04:52.032 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.030+0000 7ff61b4e7700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff61419ae20 con 0x7ff614102080 2024-06-02T05:04:52.032 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.030+0000 7ff61b4e7700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff61419afe0 con 0x7ff614100f30 2024-06-02T05:04:52.032 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.031+0000 7ff619283700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff614100f30 0x7ff614074d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:04:52.032 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.031+0000 7ff618a82700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff614102080 0x7ff614073390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:04:52.032 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.031+0000 7ff619283700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff614100f30 0x7ff614074d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:32770/0 (socket says 172.21.15.76:32770) 2024-06-02T05:04:52.032 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.031+0000 7ff619283700 1 -- 172.21.15.76:0/575855139 learned_addr learned my addr 172.21.15.76:0/575855139 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:04:52.033 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.031+0000 7ff619283700 1 -- 172.21.15.76:0/575855139 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff614102080 msgr2=0x7ff614073390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:04:52.033 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.031+0000 7ff619283700 1 --2- 172.21.15.76:0/575855139 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff614102080 0x7ff614073390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:52.033 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.031+0000 7ff619283700 1 -- 172.21.15.76:0/575855139 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff614102a40 msgr2=0x7ff6140738d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:04:52.033 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.031+0000 7ff619283700 1 --2- 172.21.15.76:0/575855139 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff614102a40 0x7ff6140738d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:52.033 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.031+0000 7ff619283700 1 -- 172.21.15.76:0/575855139 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff604009520 con 0x7ff614100f30 2024-06-02T05:04:52.033 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.031+0000 7ff619283700 1 --2- 172.21.15.76:0/575855139 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff614100f30 0x7ff614074d00 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff61000d980 tx=0x7ff61000dd40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:04:52.033 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.031+0000 7ff60a7fc700 1 -- 172.21.15.76:0/575855139 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff610009b40 con 0x7ff614100f30 2024-06-02T05:04:52.033 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.032+0000 7ff60a7fc700 1 -- 172.21.15.76:0/575855139 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff61000de60 con 0x7ff614100f30 2024-06-02T05:04:52.033 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.032+0000 7ff60a7fc700 1 -- 172.21.15.76:0/575855139 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff61000f620 con 0x7ff614100f30 2024-06-02T05:04:52.034 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.034+0000 7ff61b4e7700 1 -- 172.21.15.76:0/575855139 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff61419b260 con 0x7ff614100f30 2024-06-02T05:04:52.034 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.034+0000 7ff61b4e7700 1 -- 172.21.15.76:0/575855139 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff61419b720 con 0x7ff614100f30 2024-06-02T05:04:52.036 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.036+0000 7ff60a7fc700 1 -- 172.21.15.76:0/575855139 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7ff610010460 con 0x7ff614100f30 2024-06-02T05:04:52.037 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.036+0000 7ff60a7fc700 1 --2- 172.21.15.76:0/575855139 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7ff6000a1120 0x7ff6000a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:04:52.037 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.036+0000 7ff60a7fc700 1 -- 172.21.15.76:0/575855139 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7ff6100cca90 con 0x7ff614100f30 2024-06-02T05:04:52.037 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.037+0000 7ff618a82700 1 --2- 172.21.15.76:0/575855139 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7ff6000a1120 0x7ff6000a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:04:52.038 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.037+0000 7ff618a82700 1 --2- 172.21.15.76:0/575855139 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7ff6000a1120 0x7ff6000a35e0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7ff60400f910 tx=0x7ff604019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:04:52.047 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.043+0000 7ff6276a2b80 1 Processor -- start 2024-06-02T05:04:52.047 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.043+0000 7ff6276a2b80 1 -- start start 2024-06-02T05:04:52.047 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.044+0000 7ff6276a2b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f43530ea90 0x55f43530eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:04:52.047 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.044+0000 7ff6276a2b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f43530f3f0 0x55f43530fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:04:52.047 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.044+0000 7ff6276a2b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f4353102e0 0x55f435310760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:04:52.047 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.044+0000 7ff6276a2b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4352550f0 con 0x55f43530f3f0 2024-06-02T05:04:52.047 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.044+0000 7ff6276a2b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f435252ab0 con 0x55f4353102e0 2024-06-02T05:04:52.047 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.044+0000 7ff6276a2b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f43524e3a0 con 0x55f43530ea90 2024-06-02T05:04:52.047 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.044+0000 7ff618a82700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f43530f3f0 0x55f43530fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:04:52.048 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.044+0000 7ff618a82700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f43530f3f0 0x55f43530fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:47302/0 (socket says 172.21.15.76:47302) 2024-06-02T05:04:52.048 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.044+0000 7ff618a82700 1 -- 172.21.15.76:0/3574067573 learned_addr learned my addr 172.21.15.76:0/3574067573 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:04:52.048 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.044+0000 7ff619283700 1 --2- 172.21.15.76:0/3574067573 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f43530ea90 0x55f43530eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:04:52.048 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.044+0000 7ff619a84700 1 --2- 172.21.15.76:0/3574067573 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f4353102e0 0x55f435310760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:04:52.048 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.044+0000 7ff618a82700 1 -- 172.21.15.76:0/3574067573 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f43530ea90 msgr2=0x55f43530eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:04:52.048 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.044+0000 7ff618a82700 1 --2- 172.21.15.76:0/3574067573 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f43530ea90 0x55f43530eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:52.048 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.044+0000 7ff618a82700 1 -- 172.21.15.76:0/3574067573 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f4353102e0 msgr2=0x55f435310760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:04:52.048 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.044+0000 7ff618a82700 1 --2- 172.21.15.76:0/3574067573 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f4353102e0 0x55f435310760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:52.048 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.044+0000 7ff618a82700 1 -- 172.21.15.76:0/3574067573 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f4350cf350 con 0x55f43530f3f0 2024-06-02T05:04:52.048 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.045+0000 7ff618a82700 1 --2- 172.21.15.76:0/3574067573 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f43530f3f0 0x55f43530fd00 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7ff604016000 tx=0x7ff60401d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c79c74d4c320cd4 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:04:52.049 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.048+0000 7ff5ff7fe700 1 -- 172.21.15.76:0/3574067573 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff60404a070 con 0x55f43530f3f0 2024-06-02T05:04:52.049 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.048+0000 7ff5ff7fe700 1 -- 172.21.15.76:0/3574067573 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff60400b990 con 0x55f43530f3f0 2024-06-02T05:04:52.049 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.048+0000 7ff5ff7fe700 1 -- 172.21.15.76:0/3574067573 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff60401c040 con 0x55f43530f3f0 2024-06-02T05:04:52.049 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.049+0000 7ff6276a2b80 1 -- 172.21.15.76:0/3574067573 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f43530f3f0 msgr2=0x55f43530fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:04:52.050 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.049+0000 7ff6276a2b80 1 --2- 172.21.15.76:0/3574067573 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f43530f3f0 0x55f43530fd00 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7ff604016000 tx=0x7ff60401d000 comp rx=0 tx=0).stop 2024-06-02T05:04:52.050 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.049+0000 7ff6276a2b80 1 -- 172.21.15.76:0/3574067573 shutdown_connections 2024-06-02T05:04:52.050 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.049+0000 7ff6276a2b80 1 --2- 172.21.15.76:0/3574067573 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f4353102e0 0x55f435310760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:52.050 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.049+0000 7ff6276a2b80 1 --2- 172.21.15.76:0/3574067573 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f43530ea90 0x55f43530eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:52.050 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.049+0000 7ff6276a2b80 1 --2- 172.21.15.76:0/3574067573 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f43530f3f0 0x55f43530fd00 secure :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7ff604016000 tx=0x7ff60401d000 comp rx=0 tx=0).stop 2024-06-02T05:04:52.050 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.049+0000 7ff6276a2b80 1 -- 172.21.15.76:0/3574067573 >> 172.21.15.76:0/3574067573 conn(0x55f43525c1b0 msgr2=0x55f4352fa440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:04:52.053 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.052+0000 7ff6276a2b80 1 -- 172.21.15.76:0/3574067573 shutdown_connections 2024-06-02T05:04:52.054 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.053+0000 7ff6276a2b80 1 -- 172.21.15.76:0/3574067573 wait complete. 2024-06-02T05:04:52.054 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.053+0000 7ff6276a2b80 1 -- start start 2024-06-02T05:04:52.054 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.054+0000 7ff6276a2b80 1 Processor -- start 2024-06-02T05:04:52.055 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.054+0000 7ff6276a2b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f43530ea90 0x55f4352ff090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:04:52.055 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.054+0000 7ff6276a2b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f4353102e0 0x55f4352ff5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:04:52.055 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.054+0000 7ff6276a2b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f4353045b0 0x55f435306a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:04:52.055 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.054+0000 7ff6276a2b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4351ea500 con 0x55f4353045b0 2024-06-02T05:04:52.055 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.054+0000 7ff6276a2b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4351ea1a0 con 0x55f43530ea90 2024-06-02T05:04:52.055 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.054+0000 7ff6276a2b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4350d1640 con 0x55f4353102e0 2024-06-02T05:04:52.056 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.054+0000 7ff6276a2b80 10 client.0 _ll_register_callbacks cb 0x55f4351f3ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T05:04:52.056 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.055+0000 7ff619283700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f43530ea90 0x55f4352ff090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:04:52.057 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.055+0000 7ff619283700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f43530ea90 0x55f4352ff090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:43420/0 (socket says 172.21.15.76:43420) 2024-06-02T05:04:52.057 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.055+0000 7ff619283700 1 -- 172.21.15.76:0/3670920601 learned_addr learned my addr 172.21.15.76:0/3670920601 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:04:52.057 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.055+0000 7ff618a82700 1 --2- 172.21.15.76:0/3670920601 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f4353102e0 0x55f4352ff5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:04:52.057 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.055+0000 7ff619a84700 1 --2- 172.21.15.76:0/3670920601 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f4353045b0 0x55f435306a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:04:52.057 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.055+0000 7ff619283700 1 -- 172.21.15.76:0/3670920601 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f4353102e0 msgr2=0x55f4352ff5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:04:52.057 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.055+0000 7ff619283700 1 --2- 172.21.15.76:0/3670920601 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f4353102e0 0x55f4352ff5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:52.057 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.055+0000 7ff619283700 1 -- 172.21.15.76:0/3670920601 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f4353045b0 msgr2=0x55f435306a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:04:52.057 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.055+0000 7ff619283700 1 --2- 172.21.15.76:0/3670920601 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f4353045b0 0x55f435306a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:52.057 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.055+0000 7ff619283700 1 -- 172.21.15.76:0/3670920601 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff614109c90 con 0x55f43530ea90 2024-06-02T05:04:52.057 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.055+0000 7ff619283700 1 --2- 172.21.15.76:0/3670920601 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f43530ea90 0x55f4352ff090 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff61000b2d0 tx=0x7ff61009a3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=548cfcc4161ab9fb server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:04:52.057 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.055+0000 7ff5fcff9700 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-06-02T05:04:52.057 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.056+0000 7ff5fcff9700 1 -- 172.21.15.76:0/3670920601 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff610010910 con 0x55f43530ea90 2024-06-02T05:04:52.058 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.056+0000 7ff5fcff9700 1 -- 172.21.15.76:0/3670920601 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7ff6100b9040 con 0x55f43530ea90 2024-06-02T05:04:52.058 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.056+0000 7ff6276a2b80 1 -- 172.21.15.76:0/3670920601 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f4351a7210 con 0x55f43530ea90 2024-06-02T05:04:52.058 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.056+0000 7ff5fcff9700 1 -- 172.21.15.76:0/3670920601 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff6100a2020 con 0x55f43530ea90 2024-06-02T05:04:52.058 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.056+0000 7ff6276a2b80 10 client.26285 fetch_fsmap learned FSMap version 36 2024-06-02T05:04:52.058 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.056+0000 7ff6276a2b80 1 -- 172.21.15.76:0/3670920601 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55f43507bb00 con 0x55f43530ea90 2024-06-02T05:04:52.058 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.056+0000 7ff5fcff9700 1 -- 172.21.15.76:0/3670920601 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55f4351a7210 con 0x55f43530ea90 2024-06-02T05:04:52.058 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.056+0000 7ff5fcff9700 1 -- 172.21.15.76:0/3670920601 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7ff6100991b0 con 0x55f43530ea90 2024-06-02T05:04:52.059 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.057+0000 7ff6276a2b80 10 client.26285 fetch_fsmap finished waiting for FSMap version 36 2024-06-02T05:04:52.059 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.057+0000 7ff6276a2b80 10 client.26285 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T05:04:52.059 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.057+0000 7ff6276a2b80 20 client.26285 populate_metadata read hostname 'smithi076' 2024-06-02T05:04:52.059 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.057+0000 7ff6276a2b80 1 --2- 172.21.15.76:0/3670920601 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55f43530b0e0 0x55f43530d500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:04:52.059 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.057+0000 7ff6276a2b80 4 client.26285 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T05:04:52.059 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.057+0000 7ff6276a2b80 1 -- 172.21.15.76:0/3670920601 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f4352cd7b0 con 0x55f43530b0e0 2024-06-02T05:04:52.059 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.058+0000 7ff618a82700 1 --2- 172.21.15.76:0/3670920601 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55f43530b0e0 0x55f43530d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:04:52.059 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.058+0000 7ff618a82700 1 --2- 172.21.15.76:0/3670920601 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55f43530b0e0 0x55f43530d500 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f9ff24895376bed1 server_cookie=b8ac5966939415bf in_seq=0 out_seq=0 2024-06-02T05:04:52.059 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.058+0000 7ff5fcff9700 10 client.26285 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T05:04:52.060 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.059+0000 7ff5fcff9700 1 -- 172.21.15.76:0/3670920601 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55f4352cd7b0 con 0x55f43530b0e0 2024-06-02T05:04:52.060 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.059+0000 7ff5fcff9700 10 client.26285 handle_command_reply: tid=0 2024-06-02T05:04:52.062 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.061+0000 7ff6276a2b80 1 client.26285 shutdown 2024-06-02T05:04:52.062 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.061+0000 7ff6276a2b80 1 -- 172.21.15.76:0/3670920601 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f43530ea90 msgr2=0x55f4352ff090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:04:52.062 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.061+0000 7ff6276a2b80 1 --2- 172.21.15.76:0/3670920601 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f43530ea90 0x55f4352ff090 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff61000b2d0 tx=0x7ff61009a3e0 comp rx=0 tx=0).stop 2024-06-02T05:04:52.062 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.061+0000 7ff6276a2b80 1 -- 172.21.15.76:0/3670920601 shutdown_connections 2024-06-02T05:04:52.062 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.061+0000 7ff6276a2b80 1 --2- 172.21.15.76:0/3670920601 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55f43530b0e0 0x55f43530d500 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:52.062 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.061+0000 7ff6276a2b80 1 --2- 172.21.15.76:0/3670920601 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f4353045b0 0x55f435306a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:52.062 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.061+0000 7ff6276a2b80 1 --2- 172.21.15.76:0/3670920601 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f43530ea90 0x55f4352ff090 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:52.062 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.061+0000 7ff6276a2b80 1 --2- 172.21.15.76:0/3670920601 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f4353102e0 0x55f4352ff5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:52.062 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.061+0000 7ff6276a2b80 1 -- 172.21.15.76:0/3670920601 >> 172.21.15.76:0/3670920601 conn(0x55f43525c1b0 msgr2=0x55f4352f8860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:04:52.062 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.061+0000 7ff5fcff9700 0 client.26285 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T05:04:52.063 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.061+0000 7ff6276a2b80 1 -- 172.21.15.76:0/3670920601 shutdown_connections 2024-06-02T05:04:52.063 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.061+0000 7ff6276a2b80 1 -- 172.21.15.76:0/3670920601 wait complete. 2024-06-02T05:04:52.063 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.061+0000 7ff6276a2b80 20 client.26285 trim_cache size 0 max 16384 2024-06-02T05:04:52.087 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.086+0000 7ff6276a2b80 1 Processor -- start 2024-06-02T05:04:52.087 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.086+0000 7ff6276a2b80 1 -- start start 2024-06-02T05:04:52.087 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.086+0000 7ff6276a2b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f4353045b0 0x55f435306a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:04:52.087 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.086+0000 7ff6276a2b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f43530ea90 0x55f4353106c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:04:52.087 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.086+0000 7ff6276a2b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f4353102e0 0x55f4352f4e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:04:52.088 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.086+0000 7ff6276a2b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f435300050 con 0x55f4353102e0 2024-06-02T05:04:52.088 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.086+0000 7ff6276a2b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f435300230 con 0x55f4353045b0 2024-06-02T05:04:52.088 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.086+0000 7ff6276a2b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4352fd770 con 0x55f43530ea90 2024-06-02T05:04:52.088 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.087+0000 7ff619283700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f4353045b0 0x55f435306a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:04:52.088 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.087+0000 7ff619283700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f4353045b0 0x55f435306a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:43432/0 (socket says 172.21.15.76:43432) 2024-06-02T05:04:52.088 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.087+0000 7ff619283700 1 -- 172.21.15.76:0/2966329598 learned_addr learned my addr 172.21.15.76:0/2966329598 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:04:52.088 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.087+0000 7ff618a82700 1 --2- 172.21.15.76:0/2966329598 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f43530ea90 0x55f4353106c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:04:52.093 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.090+0000 7ff618a82700 1 -- 172.21.15.76:0/2966329598 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f4353045b0 msgr2=0x55f435306a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:04:52.093 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.090+0000 7ff618a82700 1 --2- 172.21.15.76:0/2966329598 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f4353045b0 0x55f435306a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:52.093 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.090+0000 7ff618a82700 1 -- 172.21.15.76:0/2966329598 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f4353102e0 msgr2=0x55f4352f4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:04:52.093 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.090+0000 7ff618a82700 1 --2- 172.21.15.76:0/2966329598 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f4353102e0 0x55f4352f4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:52.093 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.090+0000 7ff618a82700 1 -- 172.21.15.76:0/2966329598 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f435214500 con 0x55f43530ea90 2024-06-02T05:04:52.093 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.092+0000 7ff618a82700 1 --2- 172.21.15.76:0/2966329598 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f43530ea90 0x55f4353106c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff60404b000 tx=0x7ff604009f50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a8d88f7fa01d2c2 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:04:52.093 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.092+0000 7ff5fffff700 1 -- 172.21.15.76:0/2966329598 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff60401c040 con 0x55f43530ea90 2024-06-02T05:04:52.094 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.092+0000 7ff5fffff700 1 -- 172.21.15.76:0/2966329598 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff60400bb00 con 0x55f43530ea90 2024-06-02T05:04:52.094 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.092+0000 7ff5fffff700 1 -- 172.21.15.76:0/2966329598 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff60404a040 con 0x55f43530ea90 2024-06-02T05:04:52.094 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.093+0000 7ff6276a2b80 1 -- 172.21.15.76:0/2966329598 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f43530ea90 msgr2=0x55f4353106c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:04:52.094 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.093+0000 7ff6276a2b80 1 --2- 172.21.15.76:0/2966329598 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f43530ea90 0x55f4353106c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff60404b000 tx=0x7ff604009f50 comp rx=0 tx=0).stop 2024-06-02T05:04:52.094 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.093+0000 7ff6276a2b80 1 -- 172.21.15.76:0/2966329598 shutdown_connections 2024-06-02T05:04:52.095 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.093+0000 7ff6276a2b80 1 --2- 172.21.15.76:0/2966329598 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f4353102e0 0x55f4352f4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:52.095 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.093+0000 7ff6276a2b80 1 --2- 172.21.15.76:0/2966329598 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f4353045b0 0x55f435306a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:52.095 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.093+0000 7ff6276a2b80 1 --2- 172.21.15.76:0/2966329598 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f43530ea90 0x55f4353106c0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:52.095 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.094+0000 7ff6276a2b80 1 -- 172.21.15.76:0/2966329598 >> 172.21.15.76:0/2966329598 conn(0x55f43525c1b0 msgr2=0x55f4352fa020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:04:52.095 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.094+0000 7ff6276a2b80 1 -- 172.21.15.76:0/2966329598 shutdown_connections 2024-06-02T05:04:52.095 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.094+0000 7ff6276a2b80 1 -- 172.21.15.76:0/2966329598 wait complete. 2024-06-02T05:04:52.095 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.094+0000 7ff6276a2b80 1 -- start start 2024-06-02T05:04:52.095 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.094+0000 7ff6276a2b80 1 Processor -- start 2024-06-02T05:04:52.096 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.095+0000 7ff6276a2b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f4353045b0 0x55f43531b250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:04:52.096 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.095+0000 7ff6276a2b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f43530ea90 0x55f435319a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:04:52.096 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.095+0000 7ff6276a2b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f4353102e0 0x55f435319f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:04:52.097 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.095+0000 7ff6276a2b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f43531bad0 con 0x55f43530ea90 2024-06-02T05:04:52.097 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.095+0000 7ff6276a2b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f43531a4d0 con 0x55f4353045b0 2024-06-02T05:04:52.097 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.095+0000 7ff6276a2b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f43531a660 con 0x55f4353102e0 2024-06-02T05:04:52.097 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.095+0000 7ff6276a2b80 10 client.0 _ll_register_callbacks cb 0x55f4351f3ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T05:04:52.097 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.095+0000 7ff619283700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f4353045b0 0x55f43531b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:04:52.097 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.095+0000 7ff619283700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f4353045b0 0x55f43531b250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:43436/0 (socket says 172.21.15.76:43436) 2024-06-02T05:04:52.097 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.095+0000 7ff619283700 1 -- 172.21.15.76:0/778349143 learned_addr learned my addr 172.21.15.76:0/778349143 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:04:52.097 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.095+0000 7ff619a84700 1 --2- 172.21.15.76:0/778349143 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f4353102e0 0x55f435319f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:04:52.097 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.096+0000 7ff619283700 1 -- 172.21.15.76:0/778349143 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f4353102e0 msgr2=0x55f435319f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:04:52.097 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.096+0000 7ff619283700 1 --2- 172.21.15.76:0/778349143 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f4353102e0 0x55f435319f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:52.097 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.096+0000 7ff619283700 1 -- 172.21.15.76:0/778349143 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f43530ea90 msgr2=0x55f435319a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:04:52.097 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.096+0000 7ff619283700 1 --2- 172.21.15.76:0/778349143 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f43530ea90 0x55f435319a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:52.098 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.096+0000 7ff619283700 1 -- 172.21.15.76:0/778349143 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f4350cf350 con 0x55f4353045b0 2024-06-02T05:04:52.099 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.096+0000 7ff619283700 1 --2- 172.21.15.76:0/778349143 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f4353045b0 0x55f43531b250 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff61000b2d0 tx=0x7ff61009a0b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e93c8b53e6d003a9 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:04:52.099 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.096+0000 7ff5fcff9700 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-06-02T05:04:52.099 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.097+0000 7ff5fcff9700 1 -- 172.21.15.76:0/778349143 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff610095ee0 con 0x55f4353045b0 2024-06-02T05:04:52.099 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.097+0000 7ff5fcff9700 1 -- 172.21.15.76:0/778349143 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7ff6100a2020 con 0x55f4353045b0 2024-06-02T05:04:52.099 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.097+0000 7ff6276a2b80 1 -- 172.21.15.76:0/778349143 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff60400b990 con 0x55f4353045b0 2024-06-02T05:04:52.100 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.097+0000 7ff5fcff9700 1 -- 172.21.15.76:0/778349143 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff610099970 con 0x55f4353045b0 2024-06-02T05:04:52.100 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.097+0000 7ff6276a2b80 10 client.26291 fetch_fsmap learned FSMap version 36 2024-06-02T05:04:52.100 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.097+0000 7ff6276a2b80 1 -- 172.21.15.76:0/778349143 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55f4350d3c70 con 0x55f4353045b0 2024-06-02T05:04:52.100 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.097+0000 7ff5fcff9700 1 -- 172.21.15.76:0/778349143 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff60400b990 con 0x55f4353045b0 2024-06-02T05:04:52.101 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.098+0000 7ff5fcff9700 1 -- 172.21.15.76:0/778349143 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7ff6100b2300 con 0x55f4353045b0 2024-06-02T05:04:52.101 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.098+0000 7ff6276a2b80 10 client.26291 fetch_fsmap finished waiting for FSMap version 36 2024-06-02T05:04:52.101 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.098+0000 7ff6276a2b80 10 client.26291 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T05:04:52.101 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.098+0000 7ff6276a2b80 20 client.26291 populate_metadata read hostname 'smithi076' 2024-06-02T05:04:52.101 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.098+0000 7ff6276a2b80 1 --2- 172.21.15.76:0/778349143 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55f435369be0 0x55f43536c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:04:52.101 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.098+0000 7ff6276a2b80 4 client.26291 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T05:04:52.101 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.098+0000 7ff6276a2b80 1 -- 172.21.15.76:0/778349143 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55f435246e60 con 0x55f435369be0 2024-06-02T05:04:52.101 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.098+0000 7ff618a82700 1 --2- 172.21.15.76:0/778349143 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55f435369be0 0x55f43536c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:04:52.102 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.101+0000 7ff618a82700 1 --2- 172.21.15.76:0/778349143 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55f435369be0 0x55f43536c000 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ed0c35a544feb5fb server_cookie=bcd71c1a29927e0e in_seq=0 out_seq=0 2024-06-02T05:04:52.102 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.101+0000 7ff5fcff9700 10 client.26291 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T05:04:52.136 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:{ 2024-06-02T05:04:52.136 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "message": "", 2024-06-02T05:04:52.136 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "return_code": 0 2024-06-02T05:04:52.137 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:} 2024-06-02T05:04:52.137 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.134+0000 7ff5fcff9700 1 -- 172.21.15.76:0/778349143 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55f435246e60 con 0x55f435369be0 2024-06-02T05:04:52.137 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.134+0000 7ff5fcff9700 10 client.26291 handle_command_reply: tid=0 2024-06-02T05:04:52.138 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.134+0000 7ff6276a2b80 1 client.26291 shutdown 2024-06-02T05:04:52.138 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.134+0000 7ff6276a2b80 1 -- 172.21.15.76:0/778349143 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f4353045b0 msgr2=0x55f43531b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:04:52.138 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.134+0000 7ff6276a2b80 1 --2- 172.21.15.76:0/778349143 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f4353045b0 0x55f43531b250 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff61000b2d0 tx=0x7ff61009a0b0 comp rx=0 tx=0).stop 2024-06-02T05:04:52.138 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.134+0000 7ff6276a2b80 1 -- 172.21.15.76:0/778349143 shutdown_connections 2024-06-02T05:04:52.138 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.134+0000 7ff6276a2b80 1 --2- 172.21.15.76:0/778349143 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55f435369be0 0x55f43536c000 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:52.139 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.134+0000 7ff6276a2b80 1 --2- 172.21.15.76:0/778349143 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f4353102e0 0x55f435319f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:52.139 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.134+0000 7ff6276a2b80 1 --2- 172.21.15.76:0/778349143 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f4353045b0 0x55f43531b250 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:52.139 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.134+0000 7ff6276a2b80 1 --2- 172.21.15.76:0/778349143 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f43530ea90 0x55f435319a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:52.139 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.134+0000 7ff6276a2b80 1 -- 172.21.15.76:0/778349143 >> 172.21.15.76:0/778349143 conn(0x55f43525c1b0 msgr2=0x55f4352fd9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:04:52.139 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.135+0000 7ff5fcff9700 0 client.26291 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T05:04:52.139 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.135+0000 7ff6276a2b80 1 -- 172.21.15.76:0/778349143 shutdown_connections 2024-06-02T05:04:52.140 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.135+0000 7ff6276a2b80 1 -- 172.21.15.76:0/778349143 wait complete. 2024-06-02T05:04:52.140 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.135+0000 7ff6276a2b80 20 client.26291 trim_cache size 0 max 16384 2024-06-02T05:04:52.140 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.135+0000 7ff61b4e7700 1 -- 172.21.15.76:0/575855139 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7ff6000a1120 msgr2=0x7ff6000a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:04:52.140 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.135+0000 7ff61b4e7700 1 --2- 172.21.15.76:0/575855139 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7ff6000a1120 0x7ff6000a35e0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7ff60400f910 tx=0x7ff604019040 comp rx=0 tx=0).stop 2024-06-02T05:04:52.140 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.135+0000 7ff61b4e7700 1 -- 172.21.15.76:0/575855139 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff614100f30 msgr2=0x7ff614074d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:04:52.140 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.135+0000 7ff61b4e7700 1 --2- 172.21.15.76:0/575855139 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff614100f30 0x7ff614074d00 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff61000d980 tx=0x7ff61000dd40 comp rx=0 tx=0).stop 2024-06-02T05:04:52.141 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.136+0000 7ff61b4e7700 1 -- 172.21.15.76:0/575855139 shutdown_connections 2024-06-02T05:04:52.141 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.136+0000 7ff61b4e7700 1 --2- 172.21.15.76:0/575855139 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff614102a40 0x7ff6140738d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:52.141 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.136+0000 7ff61b4e7700 1 --2- 172.21.15.76:0/575855139 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff614100f30 0x7ff614074d00 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:52.141 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.136+0000 7ff61b4e7700 1 --2- 172.21.15.76:0/575855139 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7ff6000a1120 0x7ff6000a35e0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:52.141 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.136+0000 7ff61b4e7700 1 --2- 172.21.15.76:0/575855139 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff614102080 0x7ff614073390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:04:52.141 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.136+0000 7ff61b4e7700 1 -- 172.21.15.76:0/575855139 >> 172.21.15.76:0/575855139 conn(0x7ff6140fc4e0 msgr2=0x7ff614105530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:04:52.142 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.139+0000 7ff61b4e7700 1 -- 172.21.15.76:0/575855139 shutdown_connections 2024-06-02T05:04:52.143 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:04:52.140+0000 7ff61b4e7700 1 -- 172.21.15.76:0/575855139 wait complete. 2024-06-02T05:04:52.183 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:04:51 smithi192 ceph-mon[47933]: pgmap v726: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 16 MiB/s wr, 880 op/s 2024-06-02T05:04:52.233 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:04:51 smithi076 ceph-mon[42935]: pgmap v726: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 16 MiB/s wr, 880 op/s 2024-06-02T05:04:52.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:04:51 smithi119 ceph-mon[46633]: pgmap v726: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 16 MiB/s wr, 880 op/s 2024-06-02T05:04:53.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:04:52 smithi192 ceph-mon[47933]: pgmap v727: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 16 MiB/s wr, 868 op/s 2024-06-02T05:04:53.237 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:04:52 smithi076 ceph-mon[42935]: pgmap v727: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 16 MiB/s wr, 868 op/s 2024-06-02T05:04:53.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:04:52 smithi119 ceph-mon[46633]: pgmap v727: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 16 MiB/s wr, 868 op/s 2024-06-02T05:04:56.097 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:04:55 smithi119 ceph-mon[46633]: pgmap v728: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 12 MiB/s wr, 748 op/s 2024-06-02T05:04:56.186 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:04:55 smithi192 ceph-mon[47933]: pgmap v728: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 12 MiB/s wr, 748 op/s 2024-06-02T05:04:56.236 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:04:55 smithi076 ceph-mon[42935]: pgmap v728: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 12 MiB/s wr, 748 op/s 2024-06-02T05:04:56.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 845.0 s, 492.8 tps, lat 200.954 ms stddev 90.297 2024-06-02T05:04:58.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:04:57 smithi119 ceph-mon[46633]: pgmap v729: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 14 MiB/s wr, 896 op/s 2024-06-02T05:04:58.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:04:57 smithi192 ceph-mon[47933]: pgmap v729: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 14 MiB/s wr, 896 op/s 2024-06-02T05:04:58.235 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:04:57 smithi076 ceph-mon[42935]: pgmap v729: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 14 MiB/s wr, 896 op/s 2024-06-02T05:05:00.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:04:59 smithi119 ceph-mon[46633]: pgmap v730: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 11 MiB/s wr, 737 op/s 2024-06-02T05:05:00.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:04:59 smithi192 ceph-mon[47933]: pgmap v730: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 11 MiB/s wr, 737 op/s 2024-06-02T05:05:00.236 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:04:59 smithi076 ceph-mon[42935]: pgmap v730: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 11 MiB/s wr, 737 op/s 2024-06-02T05:05:01.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 850.0 s, 532.4 tps, lat 188.607 ms stddev 81.896 2024-06-02T05:05:02.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:05:01 smithi119 ceph-mon[46633]: pgmap v731: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 13 MiB/s wr, 863 op/s 2024-06-02T05:05:02.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:05:01 smithi192 ceph-mon[47933]: pgmap v731: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 13 MiB/s wr, 863 op/s 2024-06-02T05:05:02.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:05:01 smithi076 ceph-mon[42935]: pgmap v731: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 13 MiB/s wr, 863 op/s 2024-06-02T05:05:04.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:05:03 smithi119 ceph-mon[46633]: pgmap v732: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 12 MiB/s wr, 836 op/s 2024-06-02T05:05:04.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:05:03 smithi192 ceph-mon[47933]: pgmap v732: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 12 MiB/s wr, 836 op/s 2024-06-02T05:05:04.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:05:03 smithi076 ceph-mon[42935]: pgmap v732: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 12 MiB/s wr, 836 op/s 2024-06-02T05:05:05.386 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.385+0000 7fc2e4f3b700 1 -- 172.21.15.76:0/2823053239 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc2e0100f90 msgr2=0x7fc2e0101410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:05:05.387 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.385+0000 7fc2e4f3b700 1 --2- 172.21.15.76:0/2823053239 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc2e0100f90 0x7fc2e0101410 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fc2d4009990 tx=0x7fc2d4009ca0 comp rx=0 tx=0).stop 2024-06-02T05:05:05.387 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.386+0000 7fc2e4f3b700 1 -- 172.21.15.76:0/2823053239 shutdown_connections 2024-06-02T05:05:05.387 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.386+0000 7fc2e4f3b700 1 --2- 172.21.15.76:0/2823053239 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc2e0101950 0x7fc2e0108270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:05.387 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.386+0000 7fc2e4f3b700 1 --2- 172.21.15.76:0/2823053239 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc2e00ffe40 0x7fc2e0100260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:05.387 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.386+0000 7fc2e4f3b700 1 --2- 172.21.15.76:0/2823053239 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc2e0100f90 0x7fc2e0101410 secure :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fc2d4009990 tx=0x7fc2d4009ca0 comp rx=0 tx=0).stop 2024-06-02T05:05:05.387 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.386+0000 7fc2e4f3b700 1 -- 172.21.15.76:0/2823053239 >> 172.21.15.76:0/2823053239 conn(0x7fc2e00fb3b0 msgr2=0x7fc2e00fd7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:05:05.389 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.389+0000 7fc2e4f3b700 1 -- 172.21.15.76:0/2823053239 shutdown_connections 2024-06-02T05:05:05.390 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.389+0000 7fc2e4f3b700 1 -- 172.21.15.76:0/2823053239 wait complete. 2024-06-02T05:05:05.390 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.390+0000 7fc2e4f3b700 1 Processor -- start 2024-06-02T05:05:05.391 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.390+0000 7fc2e4f3b700 1 -- start start 2024-06-02T05:05:05.391 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.390+0000 7fc2e4f3b700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc2e00ffe40 0x7fc2e010a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:05:05.391 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.390+0000 7fc2e4f3b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc2e0101950 0x7fc2e0108ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:05:05.391 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.390+0000 7fc2e4f3b700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc2e0108ff0 0x7fc2e0109470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:05:05.391 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.390+0000 7fc2e4f3b700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e01a6fa0 con 0x7fc2e00ffe40 2024-06-02T05:05:05.391 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.390+0000 7fc2e4f3b700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e01a7110 con 0x7fc2e0108ff0 2024-06-02T05:05:05.391 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.390+0000 7fc2e4f3b700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e01a72d0 con 0x7fc2e0101950 2024-06-02T05:05:05.392 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.391+0000 7fc2ddd9b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc2e0101950 0x7fc2e0108ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:05:05.393 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.391+0000 7fc2ddd9b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc2e0101950 0x7fc2e0108ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:53674/0 (socket says 172.21.15.76:53674) 2024-06-02T05:05:05.393 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.391+0000 7fc2ddd9b700 1 -- 172.21.15.76:0/1920381483 learned_addr learned my addr 172.21.15.76:0/1920381483 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:05:05.393 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.391+0000 7fc2ded9d700 1 --2- 172.21.15.76:0/1920381483 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc2e0108ff0 0x7fc2e0109470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:05:05.393 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.391+0000 7fc2ddd9b700 1 -- 172.21.15.76:0/1920381483 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc2e0108ff0 msgr2=0x7fc2e0109470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:05:05.393 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.391+0000 7fc2ddd9b700 1 --2- 172.21.15.76:0/1920381483 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc2e0108ff0 0x7fc2e0109470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:05.393 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.391+0000 7fc2ddd9b700 1 -- 172.21.15.76:0/1920381483 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc2e00ffe40 msgr2=0x7fc2e010a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:05:05.393 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.391+0000 7fc2ddd9b700 1 --2- 172.21.15.76:0/1920381483 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc2e00ffe40 0x7fc2e010a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:05.393 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.391+0000 7fc2ddd9b700 1 -- 172.21.15.76:0/1920381483 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2d40095f0 con 0x7fc2e0101950 2024-06-02T05:05:05.393 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.391+0000 7fc2ddd9b700 1 --2- 172.21.15.76:0/1920381483 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc2e0101950 0x7fc2e0108ab0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc2d4000c00 tx=0x7fc2d4003b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:05:05.393 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.391+0000 7fc2cf7fe700 1 -- 172.21.15.76:0/1920381483 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2d401d070 con 0x7fc2e0101950 2024-06-02T05:05:05.393 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.391+0000 7fc2cf7fe700 1 -- 172.21.15.76:0/1920381483 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc2d400bd70 con 0x7fc2e0101950 2024-06-02T05:05:05.394 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.392+0000 7fc2e4f3b700 1 -- 172.21.15.76:0/1920381483 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2e00717d0 con 0x7fc2e0101950 2024-06-02T05:05:05.394 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.392+0000 7fc2cf7fe700 1 -- 172.21.15.76:0/1920381483 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2d400fd90 con 0x7fc2e0101950 2024-06-02T05:05:05.394 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.392+0000 7fc2e4f3b700 1 -- 172.21.15.76:0/1920381483 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2e0071c30 con 0x7fc2e0101950 2024-06-02T05:05:05.395 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.394+0000 7fc2cf7fe700 1 -- 172.21.15.76:0/1920381483 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fc2d400f460 con 0x7fc2e0101950 2024-06-02T05:05:05.395 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.395+0000 7fc2cf7fe700 1 --2- 172.21.15.76:0/1920381483 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fc2c80a1120 0x7fc2c80a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:05:05.396 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.395+0000 7fc2de59c700 1 --2- 172.21.15.76:0/1920381483 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fc2c80a1120 0x7fc2c80a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:05:05.396 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.395+0000 7fc2cf7fe700 1 -- 172.21.15.76:0/1920381483 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7fc2d40ce0a0 con 0x7fc2e0101950 2024-06-02T05:05:05.396 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.396+0000 7fc2de59c700 1 --2- 172.21.15.76:0/1920381483 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fc2c80a1120 0x7fc2c80a35e0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fc2d0009770 tx=0x7fc2d0006cd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:05:05.397 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.396+0000 7fc2f10f6b80 1 Processor -- start 2024-06-02T05:05:05.397 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.396+0000 7fc2f10f6b80 1 -- start start 2024-06-02T05:05:05.397 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.396+0000 7fc2f10f6b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563dd6863a80 0x563dd6863ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:05:05.397 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.396+0000 7fc2f10f6b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563dd68643e0 0x563dd6864cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:05:05.397 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.396+0000 7fc2f10f6b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563dd68652d0 0x563dd6865750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:05:05.397 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.396+0000 7fc2f10f6b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x563dd67bb0f0 con 0x563dd6863a80 2024-06-02T05:05:05.397 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.396+0000 7fc2f10f6b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x563dd67b8ab0 con 0x563dd68643e0 2024-06-02T05:05:05.397 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.396+0000 7fc2f10f6b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x563dd67b43a0 con 0x563dd68652d0 2024-06-02T05:05:05.398 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.396+0000 7fc2ddd9b700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563dd68643e0 0x563dd6864cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:05:05.398 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.396+0000 7fc2ddd9b700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563dd68643e0 0x563dd6864cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:57046/0 (socket says 172.21.15.76:57046) 2024-06-02T05:05:05.398 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.396+0000 7fc2ddd9b700 1 -- 172.21.15.76:0/4243520790 learned_addr learned my addr 172.21.15.76:0/4243520790 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:05:05.398 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.396+0000 7fc2ded9d700 1 --2- 172.21.15.76:0/4243520790 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563dd68652d0 0x563dd6865750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:05:05.398 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.397+0000 7fc2de59c700 1 --2- 172.21.15.76:0/4243520790 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563dd6863a80 0x563dd6863ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:05:05.398 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.397+0000 7fc2ddd9b700 1 -- 172.21.15.76:0/4243520790 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563dd68652d0 msgr2=0x563dd6865750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:05:05.399 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.397+0000 7fc2ddd9b700 1 --2- 172.21.15.76:0/4243520790 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563dd68652d0 0x563dd6865750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:05.399 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.397+0000 7fc2ddd9b700 1 -- 172.21.15.76:0/4243520790 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563dd6863a80 msgr2=0x563dd6863ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:05:05.399 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.397+0000 7fc2ddd9b700 1 --2- 172.21.15.76:0/4243520790 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563dd6863a80 0x563dd6863ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:05.399 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.397+0000 7fc2ddd9b700 1 -- 172.21.15.76:0/4243520790 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563dd6635350 con 0x563dd68643e0 2024-06-02T05:05:05.399 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.397+0000 7fc2de59c700 1 --2- 172.21.15.76:0/4243520790 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563dd6863a80 0x563dd6863ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T05:05:05.399 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.397+0000 7fc2ddd9b700 1 --2- 172.21.15.76:0/4243520790 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563dd68643e0 0x563dd6864cf0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc2d4097740 tx=0x7fc2d409ac70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9de213dbd385bf16 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:05:05.399 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.397+0000 7fc2ccff9700 1 -- 172.21.15.76:0/4243520790 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2d409b240 con 0x563dd68643e0 2024-06-02T05:05:05.399 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.397+0000 7fc2ccff9700 1 -- 172.21.15.76:0/4243520790 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc2d409f070 con 0x563dd68643e0 2024-06-02T05:05:05.399 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.397+0000 7fc2ccff9700 1 -- 172.21.15.76:0/4243520790 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2d40a10f0 con 0x563dd68643e0 2024-06-02T05:05:05.400 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.398+0000 7fc2f10f6b80 1 -- 172.21.15.76:0/4243520790 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563dd68643e0 msgr2=0x563dd6864cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:05:05.400 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.398+0000 7fc2f10f6b80 1 --2- 172.21.15.76:0/4243520790 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563dd68643e0 0x563dd6864cf0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc2d4097740 tx=0x7fc2d409ac70 comp rx=0 tx=0).stop 2024-06-02T05:05:05.401 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.398+0000 7fc2f10f6b80 1 -- 172.21.15.76:0/4243520790 shutdown_connections 2024-06-02T05:05:05.401 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.398+0000 7fc2f10f6b80 1 --2- 172.21.15.76:0/4243520790 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563dd68652d0 0x563dd6865750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:05.401 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.398+0000 7fc2f10f6b80 1 --2- 172.21.15.76:0/4243520790 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563dd6863a80 0x563dd6863ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:05.401 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.398+0000 7fc2f10f6b80 1 --2- 172.21.15.76:0/4243520790 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563dd68643e0 0x563dd6864cf0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:05.401 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.398+0000 7fc2f10f6b80 1 -- 172.21.15.76:0/4243520790 >> 172.21.15.76:0/4243520790 conn(0x563dd67c21b0 msgr2=0x563dd6860440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:05:05.401 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.398+0000 7fc2f10f6b80 1 -- 172.21.15.76:0/4243520790 shutdown_connections 2024-06-02T05:05:05.401 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.398+0000 7fc2f10f6b80 1 -- 172.21.15.76:0/4243520790 wait complete. 2024-06-02T05:05:05.401 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.399+0000 7fc2f10f6b80 1 -- start start 2024-06-02T05:05:05.401 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.399+0000 7fc2f10f6b80 1 Processor -- start 2024-06-02T05:05:05.401 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.399+0000 7fc2f10f6b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563dd6863a80 0x563dd686d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:05:05.401 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.399+0000 7fc2f10f6b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563dd68643e0 0x563dd686dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:05:05.401 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.399+0000 7fc2f10f6b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563dd68652d0 0x563dd6874b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:05:05.401 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.399+0000 7fc2f10f6b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x563dd6750500 con 0x563dd68652d0 2024-06-02T05:05:05.402 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.399+0000 7fc2f10f6b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x563dd67501a0 con 0x563dd6863a80 2024-06-02T05:05:05.402 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.399+0000 7fc2f10f6b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x563dd6637640 con 0x563dd68643e0 2024-06-02T05:05:05.402 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.399+0000 7fc2f10f6b80 10 client.0 _ll_register_callbacks cb 0x563dd6759ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T05:05:05.402 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.400+0000 7fc2de59c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563dd6863a80 0x563dd686d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:05:05.402 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.400+0000 7fc2ddd9b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563dd68643e0 0x563dd686dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:05:05.403 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.400+0000 7fc2ddd9b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563dd68643e0 0x563dd686dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:53686/0 (socket says 172.21.15.76:53686) 2024-06-02T05:05:05.403 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.400+0000 7fc2ddd9b700 1 -- 172.21.15.76:0/982717274 learned_addr learned my addr 172.21.15.76:0/982717274 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:05:05.403 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.401+0000 7fc2ddd9b700 1 -- 172.21.15.76:0/982717274 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563dd6863a80 msgr2=0x563dd686d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:05:05.403 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.401+0000 7fc2ddd9b700 1 --2- 172.21.15.76:0/982717274 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563dd6863a80 0x563dd686d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:05.403 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.401+0000 7fc2ddd9b700 1 -- 172.21.15.76:0/982717274 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563dd68652d0 msgr2=0x563dd6874b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:05:05.403 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.401+0000 7fc2ddd9b700 1 --2- 172.21.15.76:0/982717274 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563dd68652d0 0x563dd6874b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:05.403 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.401+0000 7fc2ddd9b700 1 -- 172.21.15.76:0/982717274 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2e0071c30 con 0x563dd68643e0 2024-06-02T05:05:05.403 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.401+0000 7fc2ddd9b700 1 --2- 172.21.15.76:0/982717274 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563dd68643e0 0x563dd686dad0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc2d4019040 tx=0x7fc2d4009ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=295ac26865b8596d server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:05:05.404 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.401+0000 7fc2c5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.192:3300/0 2024-06-02T05:05:05.404 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.401+0000 7fc2c5ffb700 1 -- 172.21.15.76:0/982717274 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2d40a3630 con 0x563dd68643e0 2024-06-02T05:05:05.404 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.401+0000 7fc2c5ffb700 1 -- 172.21.15.76:0/982717274 <== mon.1 v2:172.21.15.192:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7fc2d409b240 con 0x563dd68643e0 2024-06-02T05:05:05.404 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.401+0000 7fc2f10f6b80 1 -- 172.21.15.76:0/982717274 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563dd670d210 con 0x563dd68643e0 2024-06-02T05:05:05.404 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.402+0000 7fc2c5ffb700 1 -- 172.21.15.76:0/982717274 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc2d409a730 con 0x563dd68643e0 2024-06-02T05:05:05.404 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.402+0000 7fc2f10f6b80 10 client.26248 fetch_fsmap learned FSMap version 36 2024-06-02T05:05:05.404 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.402+0000 7fc2f10f6b80 1 -- 172.21.15.76:0/982717274 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x563dd65e1b00 con 0x563dd68643e0 2024-06-02T05:05:05.404 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.402+0000 7fc2c5ffb700 1 -- 172.21.15.76:0/982717274 <== mon.1 v2:172.21.15.192:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x563dd670d210 con 0x563dd68643e0 2024-06-02T05:05:05.404 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.402+0000 7fc2c5ffb700 1 -- 172.21.15.76:0/982717274 <== mon.1 v2:172.21.15.192:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fc2d409e070 con 0x563dd68643e0 2024-06-02T05:05:05.404 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.402+0000 7fc2f10f6b80 10 client.26248 fetch_fsmap finished waiting for FSMap version 36 2024-06-02T05:05:05.404 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.402+0000 7fc2f10f6b80 10 client.26248 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T05:05:05.404 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.402+0000 7fc2f10f6b80 20 client.26248 populate_metadata read hostname 'smithi076' 2024-06-02T05:05:05.404 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.402+0000 7fc2f10f6b80 1 --2- 172.21.15.76:0/982717274 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x563dd6878f00 0x563dd687b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:05:05.405 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.402+0000 7fc2f10f6b80 4 client.26248 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T05:05:05.405 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.402+0000 7fc2f10f6b80 1 -- 172.21.15.76:0/982717274 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563dd68337b0 con 0x563dd6878f00 2024-06-02T05:05:05.405 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.403+0000 7fc2de59c700 1 --2- 172.21.15.76:0/982717274 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x563dd6878f00 0x563dd687b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:05:05.405 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.403+0000 7fc2de59c700 1 --2- 172.21.15.76:0/982717274 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x563dd6878f00 0x563dd687b320 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=590828cce93e142e server_cookie=31b9237c9cadadca in_seq=0 out_seq=0 2024-06-02T05:05:05.406 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.403+0000 7fc2c5ffb700 10 client.26248 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T05:05:05.406 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.404+0000 7fc2c5ffb700 1 -- 172.21.15.76:0/982717274 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x563dd68337b0 con 0x563dd6878f00 2024-06-02T05:05:05.406 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.404+0000 7fc2c5ffb700 10 client.26248 handle_command_reply: tid=0 2024-06-02T05:05:05.406 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.404+0000 7fc2f10f6b80 1 client.26248 shutdown 2024-06-02T05:05:05.406 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.404+0000 7fc2f10f6b80 1 -- 172.21.15.76:0/982717274 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563dd68643e0 msgr2=0x563dd686dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:05:05.406 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.404+0000 7fc2f10f6b80 1 --2- 172.21.15.76:0/982717274 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563dd68643e0 0x563dd686dad0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc2d4019040 tx=0x7fc2d4009ca0 comp rx=0 tx=0).stop 2024-06-02T05:05:05.406 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.406+0000 7fc2f10f6b80 1 -- 172.21.15.76:0/982717274 shutdown_connections 2024-06-02T05:05:05.407 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.406+0000 7fc2f10f6b80 1 --2- 172.21.15.76:0/982717274 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x563dd6878f00 0x563dd687b320 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:05.407 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.406+0000 7fc2f10f6b80 1 --2- 172.21.15.76:0/982717274 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563dd68652d0 0x563dd6874b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:05.407 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.406+0000 7fc2f10f6b80 1 --2- 172.21.15.76:0/982717274 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563dd6863a80 0x563dd686d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:05.407 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.406+0000 7fc2f10f6b80 1 --2- 172.21.15.76:0/982717274 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563dd68643e0 0x563dd686dad0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:05.407 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.406+0000 7fc2f10f6b80 1 -- 172.21.15.76:0/982717274 >> 172.21.15.76:0/982717274 conn(0x563dd67c21b0 msgr2=0x563dd685e860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:05:05.407 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.406+0000 7fc2c5ffb700 0 client.26248 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T05:05:05.409 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.409+0000 7fc2f10f6b80 1 -- 172.21.15.76:0/982717274 shutdown_connections 2024-06-02T05:05:05.409 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.409+0000 7fc2f10f6b80 1 -- 172.21.15.76:0/982717274 wait complete. 2024-06-02T05:05:05.411 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.410+0000 7fc2f10f6b80 20 client.26248 trim_cache size 0 max 16384 2024-06-02T05:05:05.436 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.433+0000 7fc2f10f6b80 1 Processor -- start 2024-06-02T05:05:05.436 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.435+0000 7fc2f10f6b80 1 -- start start 2024-06-02T05:05:05.438 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.435+0000 7fc2f10f6b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563dd6863a80 0x563dd68656b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:05:05.438 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.435+0000 7fc2f10f6b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563dd68643e0 0x563dd6874ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:05:05.438 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.435+0000 7fc2f10f6b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563dd68652d0 0x563dd68751c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:05:05.438 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.435+0000 7fc2f10f6b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x563dd6859330 con 0x563dd68643e0 2024-06-02T05:05:05.438 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.435+0000 7fc2f10f6b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x563dd686d100 con 0x563dd68652d0 2024-06-02T05:05:05.438 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.435+0000 7fc2f10f6b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x563dd68647f0 con 0x563dd6863a80 2024-06-02T05:05:05.438 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.435+0000 7fc2ddd9b700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563dd68643e0 0x563dd6874ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:05:05.438 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.435+0000 7fc2ddd9b700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563dd68643e0 0x563dd6874ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:44792/0 (socket says 172.21.15.76:44792) 2024-06-02T05:05:05.438 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.435+0000 7fc2ddd9b700 1 -- 172.21.15.76:0/4157923714 learned_addr learned my addr 172.21.15.76:0/4157923714 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:05:05.438 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.435+0000 7fc2de59c700 1 --2- 172.21.15.76:0/4157923714 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563dd6863a80 0x563dd68656b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:05:05.439 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.436+0000 7fc2de59c700 1 -- 172.21.15.76:0/4157923714 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563dd68652d0 msgr2=0x563dd68751c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-02T05:05:05.439 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.436+0000 7fc2de59c700 1 --2- 172.21.15.76:0/4157923714 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563dd68652d0 0x563dd68751c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:05.439 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.436+0000 7fc2de59c700 1 -- 172.21.15.76:0/4157923714 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563dd68643e0 msgr2=0x563dd6874ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:05:05.439 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.436+0000 7fc2de59c700 1 --2- 172.21.15.76:0/4157923714 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563dd68643e0 0x563dd6874ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:05.439 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.436+0000 7fc2de59c700 1 -- 172.21.15.76:0/4157923714 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563dd677a500 con 0x563dd6863a80 2024-06-02T05:05:05.439 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.436+0000 7fc2de59c700 1 --2- 172.21.15.76:0/4157923714 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563dd6863a80 0x563dd68656b0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x563dd687bbc0 tx=0x7fc2d000e000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2d78b532e99e2baf server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:05:05.439 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.436+0000 7fc2cd7fa700 1 -- 172.21.15.76:0/4157923714 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2d0024210 con 0x563dd6863a80 2024-06-02T05:05:05.439 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.436+0000 7fc2cd7fa700 1 -- 172.21.15.76:0/4157923714 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc2d0024800 con 0x563dd6863a80 2024-06-02T05:05:05.439 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.436+0000 7fc2cd7fa700 1 -- 172.21.15.76:0/4157923714 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2d0020b90 con 0x563dd6863a80 2024-06-02T05:05:05.441 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.437+0000 7fc2f10f6b80 1 -- 172.21.15.76:0/4157923714 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563dd6863a80 msgr2=0x563dd68656b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:05:05.442 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.437+0000 7fc2f10f6b80 1 --2- 172.21.15.76:0/4157923714 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563dd6863a80 0x563dd68656b0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x563dd687bbc0 tx=0x7fc2d000e000 comp rx=0 tx=0).stop 2024-06-02T05:05:05.442 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.437+0000 7fc2f10f6b80 1 -- 172.21.15.76:0/4157923714 shutdown_connections 2024-06-02T05:05:05.442 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.437+0000 7fc2f10f6b80 1 --2- 172.21.15.76:0/4157923714 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563dd68652d0 0x563dd68751c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:05.442 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.437+0000 7fc2f10f6b80 1 --2- 172.21.15.76:0/4157923714 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563dd6863a80 0x563dd68656b0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:05.442 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.437+0000 7fc2f10f6b80 1 --2- 172.21.15.76:0/4157923714 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563dd68643e0 0x563dd6874ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:05.442 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.437+0000 7fc2f10f6b80 1 -- 172.21.15.76:0/4157923714 >> 172.21.15.76:0/4157923714 conn(0x563dd67c21b0 msgr2=0x563dd687fc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:05:05.442 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.438+0000 7fc2f10f6b80 1 -- 172.21.15.76:0/4157923714 shutdown_connections 2024-06-02T05:05:05.442 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.438+0000 7fc2f10f6b80 1 -- 172.21.15.76:0/4157923714 wait complete. 2024-06-02T05:05:05.442 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.438+0000 7fc2f10f6b80 1 -- start start 2024-06-02T05:05:05.442 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.438+0000 7fc2f10f6b80 1 Processor -- start 2024-06-02T05:05:05.443 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.438+0000 7fc2f10f6b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563dd6863a80 0x563dd6871c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:05:05.443 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.438+0000 7fc2f10f6b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563dd68643e0 0x563dd6872190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:05:05.443 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.438+0000 7fc2f10f6b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563dd68652d0 0x563dd68731a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:05:05.443 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.438+0000 7fc2f10f6b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x563dd68736e0 con 0x563dd68652d0 2024-06-02T05:05:05.443 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.438+0000 7fc2f10f6b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x563dd6873850 con 0x563dd68643e0 2024-06-02T05:05:05.443 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.438+0000 7fc2f10f6b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x563dd6873a10 con 0x563dd6863a80 2024-06-02T05:05:05.443 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.439+0000 7fc2f10f6b80 10 client.0 _ll_register_callbacks cb 0x563dd6759ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T05:05:05.443 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.439+0000 7fc2de59c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563dd6863a80 0x563dd6871c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:05:05.443 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.439+0000 7fc2ddd9b700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563dd68643e0 0x563dd6872190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:05:05.443 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.439+0000 7fc2ddd9b700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563dd68643e0 0x563dd6872190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:57068/0 (socket says 172.21.15.76:57068) 2024-06-02T05:05:05.443 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.439+0000 7fc2ddd9b700 1 -- 172.21.15.76:0/2722323455 learned_addr learned my addr 172.21.15.76:0/2722323455 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:05:05.443 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.439+0000 7fc2ded9d700 1 --2- 172.21.15.76:0/2722323455 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563dd68652d0 0x563dd68731a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:05:05.444 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.439+0000 7fc2ddd9b700 1 -- 172.21.15.76:0/2722323455 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563dd6863a80 msgr2=0x563dd6871c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:05:05.444 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.440+0000 7fc2ddd9b700 1 --2- 172.21.15.76:0/2722323455 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563dd6863a80 0x563dd6871c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:05.444 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.440+0000 7fc2ddd9b700 1 -- 172.21.15.76:0/2722323455 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563dd68652d0 msgr2=0x563dd68731a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:05:05.444 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.440+0000 7fc2ddd9b700 1 --2- 172.21.15.76:0/2722323455 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563dd68652d0 0x563dd68731a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:05.444 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.440+0000 7fc2ddd9b700 1 -- 172.21.15.76:0/2722323455 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2d0013740 con 0x563dd68643e0 2024-06-02T05:05:05.444 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.440+0000 7fc2ddd9b700 1 --2- 172.21.15.76:0/2722323455 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563dd68643e0 0x563dd6872190 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc2d4005cb0 tx=0x7fc2d40997f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e551464ee084705 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:05:05.444 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.440+0000 7fc2c5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-06-02T05:05:05.444 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.440+0000 7fc2c5ffb700 1 -- 172.21.15.76:0/2722323455 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2d409aba0 con 0x563dd68643e0 2024-06-02T05:05:05.444 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.440+0000 7fc2c5ffb700 1 -- 172.21.15.76:0/2722323455 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7fc2d40998a0 con 0x563dd68643e0 2024-06-02T05:05:05.444 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.440+0000 7fc2f10f6b80 1 -- 172.21.15.76:0/2722323455 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc2d409f070 con 0x563dd68643e0 2024-06-02T05:05:05.444 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.440+0000 7fc2c5ffb700 1 -- 172.21.15.76:0/2722323455 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc2d409b240 con 0x563dd68643e0 2024-06-02T05:05:05.444 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.440+0000 7fc2f10f6b80 10 client.26303 fetch_fsmap learned FSMap version 36 2024-06-02T05:05:05.444 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.441+0000 7fc2f10f6b80 1 -- 172.21.15.76:0/2722323455 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x563dd6639c70 con 0x563dd68643e0 2024-06-02T05:05:05.445 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.441+0000 7fc2c5ffb700 1 -- 172.21.15.76:0/2722323455 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc2d409f070 con 0x563dd68643e0 2024-06-02T05:05:05.445 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.441+0000 7fc2c5ffb700 1 -- 172.21.15.76:0/2722323455 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fc2d409e030 con 0x563dd68643e0 2024-06-02T05:05:05.445 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.441+0000 7fc2f10f6b80 10 client.26303 fetch_fsmap finished waiting for FSMap version 36 2024-06-02T05:05:05.445 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.441+0000 7fc2f10f6b80 10 client.26303 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T05:05:05.445 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.441+0000 7fc2f10f6b80 20 client.26303 populate_metadata read hostname 'smithi076' 2024-06-02T05:05:05.445 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.441+0000 7fc2f10f6b80 1 --2- 172.21.15.76:0/2722323455 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x563dd68cf3b0 0x563dd68d17a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:05:05.445 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.441+0000 7fc2f10f6b80 4 client.26303 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T05:05:05.445 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.441+0000 7fc2f10f6b80 1 -- 172.21.15.76:0/2722323455 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x563dd67ace60 con 0x563dd68cf3b0 2024-06-02T05:05:05.452 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.451+0000 7fc2de59c700 1 --2- 172.21.15.76:0/2722323455 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x563dd68cf3b0 0x563dd68d17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:05:05.453 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.452+0000 7fc2de59c700 1 --2- 172.21.15.76:0/2722323455 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x563dd68cf3b0 0x563dd68d17a0 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4a8514d5a4229940 server_cookie=1e101bd4eee66b0f in_seq=0 out_seq=0 2024-06-02T05:05:05.453 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.452+0000 7fc2c5ffb700 10 client.26303 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T05:05:05.485 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.484+0000 7fc2c5ffb700 1 -- 172.21.15.76:0/2722323455 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x563dd67ace60 con 0x563dd68cf3b0 2024-06-02T05:05:05.486 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.484+0000 7fc2c5ffb700 10 client.26303 handle_command_reply: tid=0 2024-06-02T05:05:05.486 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.484+0000 7fc2f10f6b80 1 client.26303 shutdown 2024-06-02T05:05:05.486 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.484+0000 7fc2f10f6b80 1 -- 172.21.15.76:0/2722323455 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563dd68643e0 msgr2=0x563dd6872190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:05:05.486 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.484+0000 7fc2f10f6b80 1 --2- 172.21.15.76:0/2722323455 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563dd68643e0 0x563dd6872190 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc2d4005cb0 tx=0x7fc2d40997f0 comp rx=0 tx=0).stop 2024-06-02T05:05:05.486 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.484+0000 7fc2f10f6b80 1 -- 172.21.15.76:0/2722323455 shutdown_connections 2024-06-02T05:05:05.486 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.484+0000 7fc2f10f6b80 1 --2- 172.21.15.76:0/2722323455 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x563dd68cf3b0 0x563dd68d17a0 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:05.486 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.484+0000 7fc2f10f6b80 1 --2- 172.21.15.76:0/2722323455 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563dd68652d0 0x563dd68731a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:05.486 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.484+0000 7fc2f10f6b80 1 --2- 172.21.15.76:0/2722323455 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563dd6863a80 0x563dd6871c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:05.486 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.484+0000 7fc2f10f6b80 1 --2- 172.21.15.76:0/2722323455 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563dd68643e0 0x563dd6872190 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:05.486 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.484+0000 7fc2f10f6b80 1 -- 172.21.15.76:0/2722323455 >> 172.21.15.76:0/2722323455 conn(0x563dd67c21b0 msgr2=0x563dd687fc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:05:05.486 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.485+0000 7fc2c5ffb700 0 client.26303 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T05:05:05.486 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.485+0000 7fc2f10f6b80 1 -- 172.21.15.76:0/2722323455 shutdown_connections 2024-06-02T05:05:05.487 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.485+0000 7fc2f10f6b80 1 -- 172.21.15.76:0/2722323455 wait complete. 2024-06-02T05:05:05.487 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.486+0000 7fc2f10f6b80 20 client.26303 trim_cache size 0 max 16384 2024-06-02T05:05:05.487 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:{ 2024-06-02T05:05:05.488 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "message": "", 2024-06-02T05:05:05.488 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "return_code": 0 2024-06-02T05:05:05.488 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:} 2024-06-02T05:05:05.488 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.487+0000 7fc2e4f3b700 1 -- 172.21.15.76:0/1920381483 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fc2c80a1120 msgr2=0x7fc2c80a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:05:05.488 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.487+0000 7fc2e4f3b700 1 --2- 172.21.15.76:0/1920381483 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fc2c80a1120 0x7fc2c80a35e0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fc2d0009770 tx=0x7fc2d0006cd0 comp rx=0 tx=0).stop 2024-06-02T05:05:05.488 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.487+0000 7fc2e4f3b700 1 -- 172.21.15.76:0/1920381483 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc2e0101950 msgr2=0x7fc2e0108ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:05:05.489 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.487+0000 7fc2e4f3b700 1 --2- 172.21.15.76:0/1920381483 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc2e0101950 0x7fc2e0108ab0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc2d4000c00 tx=0x7fc2d4003b30 comp rx=0 tx=0).stop 2024-06-02T05:05:05.489 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.487+0000 7fc2e4f3b700 1 -- 172.21.15.76:0/1920381483 shutdown_connections 2024-06-02T05:05:05.489 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.487+0000 7fc2e4f3b700 1 --2- 172.21.15.76:0/1920381483 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fc2c80a1120 0x7fc2c80a35e0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:05.489 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.487+0000 7fc2e4f3b700 1 --2- 172.21.15.76:0/1920381483 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc2e0108ff0 0x7fc2e0109470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:05.489 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.487+0000 7fc2e4f3b700 1 --2- 172.21.15.76:0/1920381483 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc2e00ffe40 0x7fc2e010a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:05.489 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.487+0000 7fc2e4f3b700 1 --2- 172.21.15.76:0/1920381483 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc2e0101950 0x7fc2e0108ab0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:05.489 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.487+0000 7fc2e4f3b700 1 -- 172.21.15.76:0/1920381483 >> 172.21.15.76:0/1920381483 conn(0x7fc2e00fb3b0 msgr2=0x7fc2e0104550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:05:05.489 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.487+0000 7fc2e4f3b700 1 -- 172.21.15.76:0/1920381483 shutdown_connections 2024-06-02T05:05:05.489 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:05.487+0000 7fc2e4f3b700 1 -- 172.21.15.76:0/1920381483 wait complete. 2024-06-02T05:05:06.097 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:05:05 smithi119 ceph-mon[46633]: pgmap v733: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 10 MiB/s wr, 722 op/s 2024-06-02T05:05:06.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:05:05 smithi192 ceph-mon[47933]: pgmap v733: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 10 MiB/s wr, 722 op/s 2024-06-02T05:05:06.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:05:05 smithi076 ceph-mon[42935]: pgmap v733: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 10 MiB/s wr, 722 op/s 2024-06-02T05:05:06.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 855.0 s, 573.2 tps, lat 170.130 ms stddev 71.265 2024-06-02T05:05:08.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:05:07 smithi119 ceph-mon[46633]: pgmap v734: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 13 MiB/s wr, 904 op/s 2024-06-02T05:05:08.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:05:07 smithi192 ceph-mon[47933]: pgmap v734: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 13 MiB/s wr, 904 op/s 2024-06-02T05:05:08.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:05:07 smithi076 ceph-mon[42935]: pgmap v734: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 13 MiB/s wr, 904 op/s 2024-06-02T05:05:10.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:05:09 smithi119 ceph-mon[46633]: pgmap v735: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 11 MiB/s wr, 770 op/s 2024-06-02T05:05:10.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:05:09 smithi192 ceph-mon[47933]: pgmap v735: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 11 MiB/s wr, 770 op/s 2024-06-02T05:05:10.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:05:09 smithi076 ceph-mon[42935]: pgmap v735: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 11 MiB/s wr, 770 op/s 2024-06-02T05:05:11.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 860.0 s, 379.0 tps, lat 157.848 ms stddev 220.695 2024-06-02T05:05:12.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:05:11 smithi192 ceph-mon[47933]: pgmap v736: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 12 MiB/s wr, 885 op/s 2024-06-02T05:05:12.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:05:11 smithi076 ceph-mon[42935]: pgmap v736: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 12 MiB/s wr, 885 op/s 2024-06-02T05:05:12.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:05:11 smithi119 ceph-mon[46633]: pgmap v736: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 12 MiB/s wr, 885 op/s 2024-06-02T05:05:14.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:05:13 smithi192 ceph-mon[47933]: pgmap v737: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 12 MiB/s wr, 860 op/s 2024-06-02T05:05:14.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:05:13 smithi076 ceph-mon[42935]: pgmap v737: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 12 MiB/s wr, 860 op/s 2024-06-02T05:05:14.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:05:13 smithi119 ceph-mon[46633]: pgmap v737: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 12 MiB/s wr, 860 op/s 2024-06-02T05:05:16.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:05:15 smithi192 ceph-mon[47933]: pgmap v738: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 10 MiB/s wr, 772 op/s 2024-06-02T05:05:16.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:05:15 smithi076 ceph-mon[42935]: pgmap v738: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 10 MiB/s wr, 772 op/s 2024-06-02T05:05:16.318 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 865.0 s, 113.9 tps, lat 517.790 ms stddev 1001.091 2024-06-02T05:05:16.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:05:15 smithi119 ceph-mon[46633]: pgmap v738: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 10 MiB/s wr, 772 op/s 2024-06-02T05:05:18.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:05:17 smithi192 ceph-mon[47933]: pgmap v739: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 11 MiB/s wr, 870 op/s 2024-06-02T05:05:18.236 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:05:17 smithi076 ceph-mon[42935]: pgmap v739: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 11 MiB/s wr, 870 op/s 2024-06-02T05:05:18.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:05:17 smithi119 ceph-mon[46633]: pgmap v739: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 11 MiB/s wr, 870 op/s 2024-06-02T05:05:18.751 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.746+0000 7f5fd6b8d700 1 -- 172.21.15.76:0/2777826098 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5fd00ffe00 msgr2=0x7f5fd0100220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:05:18.751 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.746+0000 7f5fd6b8d700 1 --2- 172.21.15.76:0/2777826098 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5fd00ffe00 0x7f5fd0100220 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f5fbc01a9d0 tx=0x7f5fbc01ace0 comp rx=0 tx=0).stop 2024-06-02T05:05:18.751 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.746+0000 7f5fd6b8d700 1 -- 172.21.15.76:0/2777826098 shutdown_connections 2024-06-02T05:05:18.751 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.746+0000 7f5fd6b8d700 1 --2- 172.21.15.76:0/2777826098 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5fd0101990 0x7f5fd0108240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:18.751 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.746+0000 7f5fd6b8d700 1 --2- 172.21.15.76:0/2777826098 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5fd00ffe00 0x7f5fd0100220 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:18.751 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.746+0000 7f5fd6b8d700 1 --2- 172.21.15.76:0/2777826098 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5fd0100ff0 0x7f5fd0101450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:18.751 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.746+0000 7f5fd6b8d700 1 -- 172.21.15.76:0/2777826098 >> 172.21.15.76:0/2777826098 conn(0x7f5fd00fb390 msgr2=0x7f5fd00fd7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:05:18.751 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.747+0000 7f5fd6b8d700 1 -- 172.21.15.76:0/2777826098 shutdown_connections 2024-06-02T05:05:18.751 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.747+0000 7f5fd6b8d700 1 -- 172.21.15.76:0/2777826098 wait complete. 2024-06-02T05:05:18.751 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.747+0000 7f5fd6b8d700 1 Processor -- start 2024-06-02T05:05:18.751 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.748+0000 7f5fd6b8d700 1 -- start start 2024-06-02T05:05:18.752 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.748+0000 7f5fd6b8d700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5fd00ffe00 0x7f5fd0109000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:05:18.752 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.748+0000 7f5fd6b8d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5fd0101990 0x7f5fd0109540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:05:18.752 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.748+0000 7f5fd6b8d700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5fd010df40 0x7f5fd01103d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:05:18.752 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.748+0000 7f5fd6b8d700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd0110910 con 0x7f5fd00ffe00 2024-06-02T05:05:18.752 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.748+0000 7f5fd6b8d700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd0110a80 con 0x7f5fd010df40 2024-06-02T05:05:18.752 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.748+0000 7f5fd6b8d700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd0110c40 con 0x7f5fd0101990 2024-06-02T05:05:18.752 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.748+0000 7f5fd4929700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5fd00ffe00 0x7f5fd0109000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:05:18.752 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.748+0000 7f5fd4929700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5fd00ffe00 0x7f5fd0109000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:39930/0 (socket says 172.21.15.76:39930) 2024-06-02T05:05:18.752 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.748+0000 7f5fd4929700 1 -- 172.21.15.76:0/435053202 learned_addr learned my addr 172.21.15.76:0/435053202 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:05:18.752 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.748+0000 7f5fcffff700 1 --2- 172.21.15.76:0/435053202 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5fd0101990 0x7f5fd0109540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:05:18.752 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.749+0000 7f5fd4929700 1 -- 172.21.15.76:0/435053202 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5fd0101990 msgr2=0x7f5fd0109540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:05:18.752 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.749+0000 7f5fd4929700 1 --2- 172.21.15.76:0/435053202 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5fd0101990 0x7f5fd0109540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:18.753 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.749+0000 7f5fd4929700 1 -- 172.21.15.76:0/435053202 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5fd010df40 msgr2=0x7f5fd01103d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-06-02T05:05:18.753 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.749+0000 7f5fd4929700 1 --2- 172.21.15.76:0/435053202 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5fd010df40 0x7f5fd01103d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:18.753 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.749+0000 7f5fd4929700 1 -- 172.21.15.76:0/435053202 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fbc01a600 con 0x7f5fd00ffe00 2024-06-02T05:05:18.753 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.749+0000 7f5fd4929700 1 --2- 172.21.15.76:0/435053202 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5fd00ffe00 0x7f5fd0109000 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f5fbc01c590 tx=0x7f5fbc0054e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:05:18.753 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.751+0000 7f5fcdffb700 1 -- 172.21.15.76:0/435053202 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fbc003cd0 con 0x7f5fd00ffe00 2024-06-02T05:05:18.753 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.751+0000 7f5fcdffb700 1 -- 172.21.15.76:0/435053202 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5fbc003e30 con 0x7f5fd00ffe00 2024-06-02T05:05:18.753 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.751+0000 7f5fcdffb700 1 -- 172.21.15.76:0/435053202 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fbc01f720 con 0x7f5fd00ffe00 2024-06-02T05:05:18.753 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.751+0000 7f5fd6b8d700 1 -- 172.21.15.76:0/435053202 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fd00696b0 con 0x7f5fd00ffe00 2024-06-02T05:05:18.753 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.752+0000 7f5fd6b8d700 1 -- 172.21.15.76:0/435053202 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fd0069aa0 con 0x7f5fd00ffe00 2024-06-02T05:05:18.757 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.756+0000 7f5fe2d48b80 1 Processor -- start 2024-06-02T05:05:18.758 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.757+0000 7f5fe2d48b80 1 -- start start 2024-06-02T05:05:18.758 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.757+0000 7f5fe2d48b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564a9ecf0a80 0x564a9ecf0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:05:18.758 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.757+0000 7f5fe2d48b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564a9ecf13e0 0x564a9ecf1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:05:18.758 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.757+0000 7f5fe2d48b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564a9ecf22d0 0x564a9ecf2750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:05:18.758 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.757+0000 7f5fe2d48b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a9ec480f0 con 0x564a9ecf22d0 2024-06-02T05:05:18.759 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.757+0000 7f5fe2d48b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a9ec45ab0 con 0x564a9ecf13e0 2024-06-02T05:05:18.759 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.757+0000 7f5fe2d48b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a9ec413a0 con 0x564a9ecf0a80 2024-06-02T05:05:18.759 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.757+0000 7f5fd512a700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564a9ecf0a80 0x564a9ecf0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:05:18.759 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.758+0000 7f5fd512a700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564a9ecf0a80 0x564a9ecf0ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:52648/0 (socket says 172.21.15.76:52648) 2024-06-02T05:05:18.759 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.758+0000 7f5fd512a700 1 -- 172.21.15.76:0/41674108 learned_addr learned my addr 172.21.15.76:0/41674108 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:05:18.759 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.758+0000 7f5fcffff700 1 --2- 172.21.15.76:0/41674108 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564a9ecf22d0 0x564a9ecf2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:05:18.759 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.758+0000 7f5fd4929700 1 --2- 172.21.15.76:0/41674108 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564a9ecf13e0 0x564a9ecf1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:05:18.760 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.758+0000 7f5fcffff700 1 -- 172.21.15.76:0/41674108 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564a9ecf0a80 msgr2=0x564a9ecf0ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:05:18.760 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.758+0000 7f5fcffff700 1 --2- 172.21.15.76:0/41674108 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564a9ecf0a80 0x564a9ecf0ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:18.760 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.758+0000 7f5fcffff700 1 -- 172.21.15.76:0/41674108 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564a9ecf13e0 msgr2=0x564a9ecf1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:05:18.760 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.758+0000 7f5fcffff700 1 --2- 172.21.15.76:0/41674108 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564a9ecf13e0 0x564a9ecf1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:18.760 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.758+0000 7f5fcffff700 1 -- 172.21.15.76:0/41674108 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564a9eac2350 con 0x564a9ecf22d0 2024-06-02T05:05:18.760 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.758+0000 7f5fcffff700 1 --2- 172.21.15.76:0/41674108 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564a9ecf22d0 0x564a9ecf2750 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f5fd0100b30 tx=0x7f5fc400ba70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87fff2ecc94d94e8 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:05:18.760 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.759+0000 7f5fbaffd700 1 -- 172.21.15.76:0/41674108 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fc4011590 con 0x564a9ecf22d0 2024-06-02T05:05:18.760 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.759+0000 7f5fbaffd700 1 -- 172.21.15.76:0/41674108 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5fc4011b80 con 0x564a9ecf22d0 2024-06-02T05:05:18.760 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.759+0000 7f5fbaffd700 1 -- 172.21.15.76:0/41674108 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fc4012c90 con 0x564a9ecf22d0 2024-06-02T05:05:18.761 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.760+0000 7f5fcdffb700 1 -- 172.21.15.76:0/435053202 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f5fbc01f880 con 0x7f5fd00ffe00 2024-06-02T05:05:18.761 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.760+0000 7f5fe2d48b80 1 -- 172.21.15.76:0/41674108 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564a9ecf22d0 msgr2=0x564a9ecf2750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:05:18.761 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.760+0000 7f5fe2d48b80 1 --2- 172.21.15.76:0/41674108 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564a9ecf22d0 0x564a9ecf2750 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f5fd0100b30 tx=0x7f5fc400ba70 comp rx=0 tx=0).stop 2024-06-02T05:05:18.762 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.761+0000 7f5fcdffb700 1 --2- 172.21.15.76:0/435053202 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f5fc00a12f0 0x7f5fc00a37b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:05:18.762 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.761+0000 7f5fcdffb700 1 -- 172.21.15.76:0/435053202 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f5fbc0d5430 con 0x7f5fd00ffe00 2024-06-02T05:05:18.762 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.761+0000 7f5fd512a700 1 --2- 172.21.15.76:0/435053202 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f5fc00a12f0 0x7f5fc00a37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:05:18.762 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.762+0000 7f5fd512a700 1 --2- 172.21.15.76:0/435053202 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f5fc00a12f0 0x7f5fc00a37b0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f5fc8009fa0 tx=0x7f5fc800b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:05:18.763 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.762+0000 7f5fe2d48b80 1 -- 172.21.15.76:0/41674108 shutdown_connections 2024-06-02T05:05:18.763 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.762+0000 7f5fe2d48b80 1 --2- 172.21.15.76:0/41674108 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564a9ecf22d0 0x564a9ecf2750 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:18.763 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.762+0000 7f5fe2d48b80 1 --2- 172.21.15.76:0/41674108 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564a9ecf0a80 0x564a9ecf0ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:18.763 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.762+0000 7f5fe2d48b80 1 --2- 172.21.15.76:0/41674108 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564a9ecf13e0 0x564a9ecf1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:18.763 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.762+0000 7f5fe2d48b80 1 -- 172.21.15.76:0/41674108 >> 172.21.15.76:0/41674108 conn(0x564a9ec4f1b0 msgr2=0x564a9eced440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:05:18.764 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.763+0000 7f5fe2d48b80 1 -- 172.21.15.76:0/41674108 shutdown_connections 2024-06-02T05:05:18.764 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.763+0000 7f5fe2d48b80 1 -- 172.21.15.76:0/41674108 wait complete. 2024-06-02T05:05:18.765 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.764+0000 7f5fe2d48b80 1 -- start start 2024-06-02T05:05:18.765 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.764+0000 7f5fe2d48b80 1 Processor -- start 2024-06-02T05:05:18.766 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.765+0000 7f5fe2d48b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564a9ecf0a80 0x564a9ed0b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:05:18.766 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.765+0000 7f5fe2d48b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564a9ecf13e0 0x564a9ed0be30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:05:18.766 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.765+0000 7f5fe2d48b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564a9ecf22d0 0x564a9ed12e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:05:18.766 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.765+0000 7f5fe2d48b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a9ebdd500 con 0x564a9ecf0a80 2024-06-02T05:05:18.766 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.765+0000 7f5fe2d48b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a9ebdd1a0 con 0x564a9ecf22d0 2024-06-02T05:05:18.766 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.765+0000 7f5fe2d48b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a9eac4640 con 0x564a9ecf13e0 2024-06-02T05:05:18.767 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.765+0000 7f5fe2d48b80 10 client.0 _ll_register_callbacks cb 0x564a9ebe6ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T05:05:18.769 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.768+0000 7f5fd512a700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564a9ecf22d0 0x564a9ed12e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:05:18.769 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.768+0000 7f5fd512a700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564a9ecf22d0 0x564a9ed12e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:59168/0 (socket says 172.21.15.76:59168) 2024-06-02T05:05:18.770 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.768+0000 7f5fd512a700 1 -- 172.21.15.76:0/289208828 learned_addr learned my addr 172.21.15.76:0/289208828 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:05:18.770 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.769+0000 7f5fcffff700 1 --2- 172.21.15.76:0/289208828 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564a9ecf13e0 0x564a9ed0be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:05:18.770 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.769+0000 7f5fd512a700 1 -- 172.21.15.76:0/289208828 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564a9ecf13e0 msgr2=0x564a9ed0be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:05:18.770 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.769+0000 7f5fd512a700 1 --2- 172.21.15.76:0/289208828 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564a9ecf13e0 0x564a9ed0be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:18.770 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.769+0000 7f5fd512a700 1 -- 172.21.15.76:0/289208828 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564a9ecf0a80 msgr2=0x564a9ed0b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:05:18.770 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.769+0000 7f5fd512a700 1 --2- 172.21.15.76:0/289208828 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564a9ecf0a80 0x564a9ed0b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:18.770 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.769+0000 7f5fd512a700 1 -- 172.21.15.76:0/289208828 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fc400e040 con 0x564a9ecf22d0 2024-06-02T05:05:18.771 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.770+0000 7f5fd512a700 1 --2- 172.21.15.76:0/289208828 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564a9ecf22d0 0x564a9ed12e70 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f5fc80159a0 tx=0x7f5fc8004be0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e62813130960da1 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:05:18.771 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.770+0000 7f5faffff700 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-06-02T05:05:18.771 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.770+0000 7f5faffff700 1 -- 172.21.15.76:0/289208828 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fc8013a50 con 0x564a9ecf22d0 2024-06-02T05:05:18.771 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.770+0000 7f5faffff700 1 -- 172.21.15.76:0/289208828 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f5fc8006e40 con 0x564a9ecf22d0 2024-06-02T05:05:18.771 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.770+0000 7f5fe2d48b80 1 -- 172.21.15.76:0/289208828 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564a9eb9a210 con 0x564a9ecf22d0 2024-06-02T05:05:18.771 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.770+0000 7f5faffff700 1 -- 172.21.15.76:0/289208828 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5fc800eeb0 con 0x564a9ecf22d0 2024-06-02T05:05:18.772 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.771+0000 7f5fe2d48b80 10 client.26312 fetch_fsmap learned FSMap version 36 2024-06-02T05:05:18.772 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.771+0000 7f5fe2d48b80 1 -- 172.21.15.76:0/289208828 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x564a9ea6eb00 con 0x564a9ecf22d0 2024-06-02T05:05:18.775 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.774+0000 7f5faffff700 1 -- 172.21.15.76:0/289208828 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x564a9eb9a210 con 0x564a9ecf22d0 2024-06-02T05:05:18.775 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.774+0000 7f5faffff700 1 -- 172.21.15.76:0/289208828 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f5fc801fad0 con 0x564a9ecf22d0 2024-06-02T05:05:18.775 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.774+0000 7f5fe2d48b80 10 client.26312 fetch_fsmap finished waiting for FSMap version 36 2024-06-02T05:05:18.775 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.774+0000 7f5fe2d48b80 10 client.26312 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T05:05:18.775 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.774+0000 7f5fe2d48b80 20 client.26312 populate_metadata read hostname 'smithi076' 2024-06-02T05:05:18.775 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.774+0000 7f5fe2d48b80 1 --2- 172.21.15.76:0/289208828 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x564a9ed17730 0x564a9ed19b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:05:18.775 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.774+0000 7f5fe2d48b80 4 client.26312 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T05:05:18.775 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.774+0000 7f5fe2d48b80 1 -- 172.21.15.76:0/289208828 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564a9ecc07b0 con 0x564a9ed17730 2024-06-02T05:05:18.775 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.774+0000 7f5fd4929700 1 --2- 172.21.15.76:0/289208828 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x564a9ed17730 0x564a9ed19b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:05:18.776 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.774+0000 7f5faffff700 10 client.26312 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T05:05:18.776 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.774+0000 7f5fd4929700 1 --2- 172.21.15.76:0/289208828 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x564a9ed17730 0x564a9ed19b50 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=155272615a5d4c35 server_cookie=5ab0c2772a9cc0ab in_seq=0 out_seq=0 2024-06-02T05:05:18.776 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.775+0000 7f5faffff700 1 -- 172.21.15.76:0/289208828 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x564a9ecc07b0 con 0x564a9ed17730 2024-06-02T05:05:18.776 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.775+0000 7f5faffff700 10 client.26312 handle_command_reply: tid=0 2024-06-02T05:05:18.776 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.775+0000 7f5fe2d48b80 1 client.26312 shutdown 2024-06-02T05:05:18.776 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.775+0000 7f5fe2d48b80 1 -- 172.21.15.76:0/289208828 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564a9ecf22d0 msgr2=0x564a9ed12e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:05:18.776 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.775+0000 7f5fe2d48b80 1 --2- 172.21.15.76:0/289208828 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564a9ecf22d0 0x564a9ed12e70 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f5fc80159a0 tx=0x7f5fc8004be0 comp rx=0 tx=0).stop 2024-06-02T05:05:18.784 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.783+0000 7f5fe2d48b80 1 -- 172.21.15.76:0/289208828 shutdown_connections 2024-06-02T05:05:18.784 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.783+0000 7f5fe2d48b80 1 --2- 172.21.15.76:0/289208828 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x564a9ed17730 0x564a9ed19b50 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:18.784 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.783+0000 7f5fe2d48b80 1 --2- 172.21.15.76:0/289208828 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564a9ecf22d0 0x564a9ed12e70 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:18.784 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.783+0000 7f5fe2d48b80 1 --2- 172.21.15.76:0/289208828 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564a9ecf0a80 0x564a9ed0b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:18.784 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.783+0000 7f5fe2d48b80 1 --2- 172.21.15.76:0/289208828 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564a9ecf13e0 0x564a9ed0be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:18.784 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.783+0000 7f5fe2d48b80 1 -- 172.21.15.76:0/289208828 >> 172.21.15.76:0/289208828 conn(0x564a9ec4f1b0 msgr2=0x564a9eceb860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:05:18.784 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.783+0000 7f5faffff700 0 client.26312 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T05:05:18.784 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.783+0000 7f5fe2d48b80 1 -- 172.21.15.76:0/289208828 shutdown_connections 2024-06-02T05:05:18.785 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.784+0000 7f5fe2d48b80 1 -- 172.21.15.76:0/289208828 wait complete. 2024-06-02T05:05:18.785 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.784+0000 7f5fe2d48b80 20 client.26312 trim_cache size 0 max 16384 2024-06-02T05:05:18.805 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.800+0000 7f5fe2d48b80 1 Processor -- start 2024-06-02T05:05:18.806 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.800+0000 7f5fe2d48b80 1 -- start start 2024-06-02T05:05:18.806 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.800+0000 7f5fe2d48b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564a9ecf0a80 0x564a9ecf26b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:05:18.806 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.800+0000 7f5fe2d48b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564a9ecf13e0 0x564a9ed12e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:05:18.806 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.800+0000 7f5fe2d48b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564a9ecf22d0 0x564a9ed0ae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:05:18.806 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.800+0000 7f5fe2d48b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a9ecf5e20 con 0x564a9ecf0a80 2024-06-02T05:05:18.806 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.800+0000 7f5fe2d48b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a9ed17480 con 0x564a9ecf22d0 2024-06-02T05:05:18.806 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.800+0000 7f5fe2d48b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a9ed0b340 con 0x564a9ecf13e0 2024-06-02T05:05:18.806 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.800+0000 7f5fd4929700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564a9ecf0a80 0x564a9ecf26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:05:18.806 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.800+0000 7f5fd4929700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564a9ecf0a80 0x564a9ecf26b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:39948/0 (socket says 172.21.15.76:39948) 2024-06-02T05:05:18.807 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.800+0000 7f5fd4929700 1 -- 172.21.15.76:0/4015858611 learned_addr learned my addr 172.21.15.76:0/4015858611 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:05:18.807 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.801+0000 7f5fcffff700 1 --2- 172.21.15.76:0/4015858611 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564a9ecf13e0 0x564a9ed12e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:05:18.807 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.801+0000 7f5fd512a700 1 --2- 172.21.15.76:0/4015858611 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564a9ecf22d0 0x564a9ed0ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:05:18.807 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.801+0000 7f5fd4929700 1 -- 172.21.15.76:0/4015858611 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564a9ecf13e0 msgr2=0x564a9ed12e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:05:18.807 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.801+0000 7f5fd4929700 1 --2- 172.21.15.76:0/4015858611 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564a9ecf13e0 0x564a9ed12e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:18.807 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.801+0000 7f5fd4929700 1 -- 172.21.15.76:0/4015858611 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564a9ecf22d0 msgr2=0x564a9ed0ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:05:18.807 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.801+0000 7f5fd4929700 1 --2- 172.21.15.76:0/4015858611 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564a9ecf22d0 0x564a9ed0ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:18.807 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.801+0000 7f5fd4929700 1 -- 172.21.15.76:0/4015858611 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564a9ec07500 con 0x564a9ecf0a80 2024-06-02T05:05:18.807 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.801+0000 7f5fcffff700 1 --2- 172.21.15.76:0/4015858611 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564a9ecf13e0 0x564a9ed12e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T05:05:18.807 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.801+0000 7f5fd4929700 1 --2- 172.21.15.76:0/4015858611 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564a9ecf0a80 0x564a9ecf26b0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f5fbc005f30 tx=0x7f5fbc02b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19f67b3fa251bcc9 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:05:18.807 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.801+0000 7f5fbb7fe700 1 -- 172.21.15.76:0/4015858611 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fbc09e820 con 0x564a9ecf0a80 2024-06-02T05:05:18.807 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.801+0000 7f5fbb7fe700 1 -- 172.21.15.76:0/4015858611 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5fbc0a22b0 con 0x564a9ecf0a80 2024-06-02T05:05:18.807 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.801+0000 7f5fbb7fe700 1 -- 172.21.15.76:0/4015858611 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fbc0a6310 con 0x564a9ecf0a80 2024-06-02T05:05:18.808 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.802+0000 7f5fe2d48b80 1 -- 172.21.15.76:0/4015858611 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564a9ecf0a80 msgr2=0x564a9ecf26b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:05:18.808 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.802+0000 7f5fe2d48b80 1 --2- 172.21.15.76:0/4015858611 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564a9ecf0a80 0x564a9ecf26b0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f5fbc005f30 tx=0x7f5fbc02b000 comp rx=0 tx=0).stop 2024-06-02T05:05:18.808 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.802+0000 7f5fe2d48b80 1 -- 172.21.15.76:0/4015858611 shutdown_connections 2024-06-02T05:05:18.808 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.802+0000 7f5fe2d48b80 1 --2- 172.21.15.76:0/4015858611 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564a9ecf22d0 0x564a9ed0ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:18.808 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.802+0000 7f5fe2d48b80 1 --2- 172.21.15.76:0/4015858611 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564a9ecf0a80 0x564a9ecf26b0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:18.808 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.802+0000 7f5fe2d48b80 1 --2- 172.21.15.76:0/4015858611 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564a9ecf13e0 0x564a9ed12e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:18.808 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.802+0000 7f5fe2d48b80 1 -- 172.21.15.76:0/4015858611 >> 172.21.15.76:0/4015858611 conn(0x564a9ec4f1b0 msgr2=0x564a9ecf88b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:05:18.808 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.802+0000 7f5fe2d48b80 1 -- 172.21.15.76:0/4015858611 shutdown_connections 2024-06-02T05:05:18.808 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.802+0000 7f5fe2d48b80 1 -- 172.21.15.76:0/4015858611 wait complete. 2024-06-02T05:05:18.808 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.802+0000 7f5fe2d48b80 1 -- start start 2024-06-02T05:05:18.808 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.802+0000 7f5fe2d48b80 1 Processor -- start 2024-06-02T05:05:18.808 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.803+0000 7f5fe2d48b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564a9ecf0a80 0x564a9ed10410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:05:18.809 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.803+0000 7f5fe2d48b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564a9ecf13e0 0x564a9ed10950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:05:18.809 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.803+0000 7f5fe2d48b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564a9ecf22d0 0x564a9ed11960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:05:18.809 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.803+0000 7f5fe2d48b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a9ed11ea0 con 0x564a9ecf0a80 2024-06-02T05:05:18.809 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.803+0000 7f5fe2d48b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a9ed12010 con 0x564a9ecf13e0 2024-06-02T05:05:18.809 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.803+0000 7f5fe2d48b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a9ed121d0 con 0x564a9ecf22d0 2024-06-02T05:05:18.809 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.803+0000 7f5fe2d48b80 10 client.0 _ll_register_callbacks cb 0x564a9ebe6ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T05:05:18.809 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.803+0000 7f5fcffff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564a9ecf13e0 0x564a9ed10950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:05:18.809 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.803+0000 7f5fcffff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564a9ecf13e0 0x564a9ed10950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:59184/0 (socket says 172.21.15.76:59184) 2024-06-02T05:05:18.809 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.803+0000 7f5fcffff700 1 -- 172.21.15.76:0/1357064332 learned_addr learned my addr 172.21.15.76:0/1357064332 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:05:18.809 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.803+0000 7f5fd512a700 1 --2- 172.21.15.76:0/1357064332 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564a9ecf22d0 0x564a9ed11960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:05:18.809 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.803+0000 7f5fcffff700 1 -- 172.21.15.76:0/1357064332 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564a9ecf22d0 msgr2=0x564a9ed11960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:05:18.809 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.803+0000 7f5fcffff700 1 --2- 172.21.15.76:0/1357064332 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564a9ecf22d0 0x564a9ed11960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:18.810 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.803+0000 7f5fcffff700 1 -- 172.21.15.76:0/1357064332 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564a9ecf0a80 msgr2=0x564a9ed10410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:05:18.810 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.803+0000 7f5fcffff700 1 --2- 172.21.15.76:0/1357064332 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564a9ecf0a80 0x564a9ed10410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:18.810 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.803+0000 7f5fcffff700 1 -- 172.21.15.76:0/1357064332 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fd0069aa0 con 0x564a9ecf13e0 2024-06-02T05:05:18.810 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.803+0000 7f5fcffff700 1 --2- 172.21.15.76:0/1357064332 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564a9ecf13e0 0x564a9ed10950 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x564a9ecf1ab0 tx=0x7f5fc40126c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=443d71162aa23ef4 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:05:18.810 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.803+0000 7f5faffff700 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-06-02T05:05:18.810 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.803+0000 7f5faffff700 1 -- 172.21.15.76:0/1357064332 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fc4021070 con 0x564a9ecf13e0 2024-06-02T05:05:18.810 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.803+0000 7f5fe2d48b80 1 -- 172.21.15.76:0/1357064332 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5fc4011b80 con 0x564a9ecf13e0 2024-06-02T05:05:18.810 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.803+0000 7f5faffff700 1 -- 172.21.15.76:0/1357064332 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f5fc4011590 con 0x564a9ecf13e0 2024-06-02T05:05:18.810 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.803+0000 7f5faffff700 1 -- 172.21.15.76:0/1357064332 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5fc4011750 con 0x564a9ecf13e0 2024-06-02T05:05:18.810 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.804+0000 7f5fe2d48b80 10 client.26318 fetch_fsmap learned FSMap version 36 2024-06-02T05:05:18.810 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.804+0000 7f5fe2d48b80 1 -- 172.21.15.76:0/1357064332 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x564a9eac6c70 con 0x564a9ecf13e0 2024-06-02T05:05:18.810 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.804+0000 7f5faffff700 1 -- 172.21.15.76:0/1357064332 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5fc4011b80 con 0x564a9ecf13e0 2024-06-02T05:05:18.810 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.804+0000 7f5faffff700 1 -- 172.21.15.76:0/1357064332 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f5fc40129f0 con 0x564a9ecf13e0 2024-06-02T05:05:18.811 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.804+0000 7f5fe2d48b80 10 client.26318 fetch_fsmap finished waiting for FSMap version 36 2024-06-02T05:05:18.811 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.804+0000 7f5fe2d48b80 10 client.26318 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T05:05:18.811 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.804+0000 7f5fe2d48b80 20 client.26318 populate_metadata read hostname 'smithi076' 2024-06-02T05:05:18.811 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.804+0000 7f5fe2d48b80 1 --2- 172.21.15.76:0/1357064332 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x564a9ed6e3a0 0x564a9ed707c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:05:18.811 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.804+0000 7f5fe2d48b80 4 client.26318 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T05:05:18.811 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.804+0000 7f5fe2d48b80 1 -- 172.21.15.76:0/1357064332 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x564a9ec39e60 con 0x564a9ed6e3a0 2024-06-02T05:05:18.811 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.804+0000 7f5fd4929700 1 --2- 172.21.15.76:0/1357064332 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x564a9ed6e3a0 0x564a9ed707c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:05:18.811 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.804+0000 7f5faffff700 10 client.26318 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T05:05:18.811 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.804+0000 7f5fd4929700 1 --2- 172.21.15.76:0/1357064332 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x564a9ed6e3a0 0x564a9ed707c0 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bb776d8acd9698aa server_cookie=bbdfb000c5bc3131 in_seq=0 out_seq=0 2024-06-02T05:05:18.898 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.897+0000 7f5faffff700 1 -- 172.21.15.76:0/1357064332 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x564a9ec39e60 con 0x564a9ed6e3a0 2024-06-02T05:05:18.898 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.897+0000 7f5faffff700 10 client.26318 handle_command_reply: tid=0 2024-06-02T05:05:18.898 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.897+0000 7f5fe2d48b80 1 client.26318 shutdown 2024-06-02T05:05:18.898 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.897+0000 7f5fe2d48b80 1 -- 172.21.15.76:0/1357064332 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564a9ecf13e0 msgr2=0x564a9ed10950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:05:18.898 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.897+0000 7f5fe2d48b80 1 --2- 172.21.15.76:0/1357064332 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564a9ecf13e0 0x564a9ed10950 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x564a9ecf1ab0 tx=0x7f5fc40126c0 comp rx=0 tx=0).stop 2024-06-02T05:05:18.898 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.897+0000 7f5fe2d48b80 1 -- 172.21.15.76:0/1357064332 shutdown_connections 2024-06-02T05:05:18.899 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.897+0000 7f5fe2d48b80 1 --2- 172.21.15.76:0/1357064332 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x564a9ed6e3a0 0x564a9ed707c0 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:18.899 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.897+0000 7f5fe2d48b80 1 --2- 172.21.15.76:0/1357064332 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564a9ecf22d0 0x564a9ed11960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:18.899 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.897+0000 7f5fe2d48b80 1 --2- 172.21.15.76:0/1357064332 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564a9ecf0a80 0x564a9ed10410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:18.899 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.897+0000 7f5fe2d48b80 1 --2- 172.21.15.76:0/1357064332 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564a9ecf13e0 0x564a9ed10950 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:18.899 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.897+0000 7f5fe2d48b80 1 -- 172.21.15.76:0/1357064332 >> 172.21.15.76:0/1357064332 conn(0x564a9ec4f1b0 msgr2=0x564a9ed19740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:05:18.899 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.897+0000 7f5faffff700 0 client.26318 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T05:05:18.900 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.897+0000 7f5fe2d48b80 1 -- 172.21.15.76:0/1357064332 shutdown_connections 2024-06-02T05:05:18.900 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.899+0000 7f5fe2d48b80 1 -- 172.21.15.76:0/1357064332 wait complete. 2024-06-02T05:05:18.904 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.903+0000 7f5fe2d48b80 20 client.26318 trim_cache size 0 max 16384 2024-06-02T05:05:18.905 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:{ 2024-06-02T05:05:18.906 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "message": "", 2024-06-02T05:05:18.906 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "return_code": 0 2024-06-02T05:05:18.907 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:} 2024-06-02T05:05:18.908 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.905+0000 7f5fd6b8d700 1 -- 172.21.15.76:0/435053202 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f5fc00a12f0 msgr2=0x7f5fc00a37b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:05:18.908 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.905+0000 7f5fd6b8d700 1 --2- 172.21.15.76:0/435053202 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f5fc00a12f0 0x7f5fc00a37b0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f5fc8009fa0 tx=0x7f5fc800b040 comp rx=0 tx=0).stop 2024-06-02T05:05:18.908 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.905+0000 7f5fd6b8d700 1 -- 172.21.15.76:0/435053202 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5fd00ffe00 msgr2=0x7f5fd0109000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:05:18.908 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.905+0000 7f5fd6b8d700 1 --2- 172.21.15.76:0/435053202 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5fd00ffe00 0x7f5fd0109000 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f5fbc01c590 tx=0x7f5fbc0054e0 comp rx=0 tx=0).stop 2024-06-02T05:05:18.908 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.905+0000 7f5fd6b8d700 1 -- 172.21.15.76:0/435053202 shutdown_connections 2024-06-02T05:05:18.908 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.905+0000 7f5fd6b8d700 1 --2- 172.21.15.76:0/435053202 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f5fc00a12f0 0x7f5fc00a37b0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:18.908 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.905+0000 7f5fd6b8d700 1 --2- 172.21.15.76:0/435053202 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5fd010df40 0x7f5fd01103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:18.908 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.905+0000 7f5fd6b8d700 1 --2- 172.21.15.76:0/435053202 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5fd00ffe00 0x7f5fd0109000 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:18.909 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.905+0000 7f5fd6b8d700 1 --2- 172.21.15.76:0/435053202 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5fd0101990 0x7f5fd0109540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:18.909 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.905+0000 7f5fd6b8d700 1 -- 172.21.15.76:0/435053202 >> 172.21.15.76:0/435053202 conn(0x7f5fd00fb390 msgr2=0x7f5fd0070050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:05:18.909 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.905+0000 7f5fd6b8d700 1 -- 172.21.15.76:0/435053202 shutdown_connections 2024-06-02T05:05:18.909 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:18.905+0000 7f5fd6b8d700 1 -- 172.21.15.76:0/435053202 wait complete. 2024-06-02T05:05:20.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:05:19 smithi192 ceph-mon[47933]: pgmap v740: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 8.4 MiB/s wr, 663 op/s 2024-06-02T05:05:20.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:05:19 smithi076 ceph-mon[42935]: pgmap v740: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 8.4 MiB/s wr, 663 op/s 2024-06-02T05:05:20.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:05:19 smithi119 ceph-mon[46633]: pgmap v740: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 8.4 MiB/s wr, 663 op/s 2024-06-02T05:05:21.316 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 870.0 s, 613.5 tps, lat 300.178 ms stddev 852.606 2024-06-02T05:05:22.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:05:21 smithi192 ceph-mon[47933]: pgmap v741: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 8.4 MiB/s wr, 666 op/s 2024-06-02T05:05:22.235 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:05:21 smithi076 ceph-mon[42935]: pgmap v741: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 8.4 MiB/s wr, 666 op/s 2024-06-02T05:05:22.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:05:21 smithi119 ceph-mon[46633]: pgmap v741: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 8.4 MiB/s wr, 666 op/s 2024-06-02T05:05:23.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:05:22 smithi192 ceph-mon[47933]: pgmap v742: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 9.3 MiB/s wr, 625 op/s 2024-06-02T05:05:23.242 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:05:22 smithi076 ceph-mon[42935]: pgmap v742: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 9.3 MiB/s wr, 625 op/s 2024-06-02T05:05:23.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:05:22 smithi119 ceph-mon[46633]: pgmap v742: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 9.3 MiB/s wr, 625 op/s 2024-06-02T05:05:26.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:05:25 smithi119 ceph-mon[46633]: pgmap v743: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 7.0 MiB/s wr, 502 op/s 2024-06-02T05:05:26.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:05:25 smithi192 ceph-mon[47933]: pgmap v743: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 7.0 MiB/s wr, 502 op/s 2024-06-02T05:05:26.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:05:25 smithi076 ceph-mon[42935]: pgmap v743: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 7.0 MiB/s wr, 502 op/s 2024-06-02T05:05:26.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 875.0 s, 622.4 tps, lat 159.982 ms stddev 83.942 2024-06-02T05:05:27.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:05:26 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T05:05:27.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:05:26 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T05:05:27.237 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:05:26 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T05:05:28.098 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:05:27 smithi119 ceph-mon[46633]: pgmap v744: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 8.7 MiB/s wr, 636 op/s 2024-06-02T05:05:28.099 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:05:27 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T05:05:28.099 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:05:27 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T05:05:28.099 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:05:27 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T05:05:28.183 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:05:27 smithi192 ceph-mon[47933]: pgmap v744: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 8.7 MiB/s wr, 636 op/s 2024-06-02T05:05:28.184 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:05:27 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T05:05:28.184 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:05:27 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T05:05:28.184 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:05:27 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T05:05:28.236 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:05:27 smithi076 ceph-mon[42935]: pgmap v744: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 8.7 MiB/s wr, 636 op/s 2024-06-02T05:05:28.236 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:05:27 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T05:05:28.236 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:05:27 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T05:05:28.236 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:05:27 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T05:05:30.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:05:29 smithi119 ceph-mon[46633]: pgmap v745: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 8.3 MiB/s wr, 555 op/s 2024-06-02T05:05:30.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:05:29 smithi192 ceph-mon[47933]: pgmap v745: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 8.3 MiB/s wr, 555 op/s 2024-06-02T05:05:30.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:05:29 smithi076 ceph-mon[42935]: pgmap v745: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 8.3 MiB/s wr, 555 op/s 2024-06-02T05:05:31.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 880.0 s, 650.9 tps, lat 154.774 ms stddev 71.272 2024-06-02T05:05:32.094 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.089+0000 7f8995678700 1 -- 172.21.15.76:0/3234461889 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f899010d5e0 msgr2=0x7f899010faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:05:32.094 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.089+0000 7f8995678700 1 --2- 172.21.15.76:0/3234461889 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f899010d5e0 0x7f899010faa0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f898800c310 tx=0x7f898800c620 comp rx=0 tx=0).stop 2024-06-02T05:05:32.094 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.093+0000 7f8995678700 1 -- 172.21.15.76:0/3234461889 shutdown_connections 2024-06-02T05:05:32.094 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.093+0000 7f8995678700 1 --2- 172.21.15.76:0/3234461889 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f899010d5e0 0x7f899010faa0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:32.094 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.093+0000 7f8995678700 1 --2- 172.21.15.76:0/3234461889 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8990108180 0x7f899010a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:32.094 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.093+0000 7f8995678700 1 --2- 172.21.15.76:0/3234461889 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f899010ab40 0x7f899010cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:32.094 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.093+0000 7f8995678700 1 -- 172.21.15.76:0/3234461889 >> 172.21.15.76:0/3234461889 conn(0x7f899006e0f0 msgr2=0x7f8990070530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:05:32.095 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.093+0000 7f8995678700 1 -- 172.21.15.76:0/3234461889 shutdown_connections 2024-06-02T05:05:32.095 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.093+0000 7f8995678700 1 -- 172.21.15.76:0/3234461889 wait complete. 2024-06-02T05:05:32.095 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.094+0000 7f8995678700 1 Processor -- start 2024-06-02T05:05:32.095 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.094+0000 7f8995678700 1 -- start start 2024-06-02T05:05:32.095 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.094+0000 7f8995678700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8990108180 0x7f89901185e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:05:32.096 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.094+0000 7f8995678700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f899010ab40 0x7f8990118b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:05:32.096 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.094+0000 7f8995678700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f899010d5e0 0x7f8990116d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:05:32.096 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.094+0000 7f8995678700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89901174c0 con 0x7f899010ab40 2024-06-02T05:05:32.096 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.094+0000 7f8995678700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8990117630 con 0x7f899010d5e0 2024-06-02T05:05:32.096 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.094+0000 7f8995678700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89901177f0 con 0x7f8990108180 2024-06-02T05:05:32.096 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.094+0000 7f898effd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8990108180 0x7f89901185e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:05:32.096 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.094+0000 7f898effd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8990108180 0x7f89901185e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:49124/0 (socket says 172.21.15.76:49124) 2024-06-02T05:05:32.096 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.094+0000 7f898effd700 1 -- 172.21.15.76:0/545869213 learned_addr learned my addr 172.21.15.76:0/545869213 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:05:32.096 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.095+0000 7f898f7fe700 1 --2- 172.21.15.76:0/545869213 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f899010d5e0 0x7f8990116d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:05:32.097 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:05:31 smithi119 ceph-mon[46633]: pgmap v746: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 10 MiB/s wr, 710 op/s 2024-06-02T05:05:32.097 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.095+0000 7f898f7fe700 1 -- 172.21.15.76:0/545869213 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8990108180 msgr2=0x7f89901185e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:05:32.098 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.095+0000 7f898f7fe700 1 --2- 172.21.15.76:0/545869213 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8990108180 0x7f89901185e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:32.098 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.095+0000 7f898f7fe700 1 -- 172.21.15.76:0/545869213 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f899010ab40 msgr2=0x7f8990118b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:05:32.098 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.095+0000 7f898f7fe700 1 --2- 172.21.15.76:0/545869213 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f899010ab40 0x7f8990118b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:32.098 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.095+0000 7f898f7fe700 1 -- 172.21.15.76:0/545869213 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f898800c050 con 0x7f899010d5e0 2024-06-02T05:05:32.098 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.095+0000 7f898f7fe700 1 --2- 172.21.15.76:0/545869213 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f899010d5e0 0x7f8990116d60 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f8988014ff0 tx=0x7f8988012760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:05:32.098 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.096+0000 7f8977fff700 1 -- 172.21.15.76:0/545869213 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f898800f040 con 0x7f899010d5e0 2024-06-02T05:05:32.098 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.096+0000 7f8977fff700 1 -- 172.21.15.76:0/545869213 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8988013dd0 con 0x7f899010d5e0 2024-06-02T05:05:32.098 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.096+0000 7f8977fff700 1 -- 172.21.15.76:0/545869213 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8988005800 con 0x7f899010d5e0 2024-06-02T05:05:32.098 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.096+0000 7f8995678700 1 -- 172.21.15.76:0/545869213 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8990117a70 con 0x7f899010d5e0 2024-06-02T05:05:32.098 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.096+0000 7f8995678700 1 -- 172.21.15.76:0/545869213 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89901b69f0 con 0x7f899010d5e0 2024-06-02T05:05:32.105 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.101+0000 7f89a1833b80 1 Processor -- start 2024-06-02T05:05:32.105 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.104+0000 7f89a1833b80 1 -- start start 2024-06-02T05:05:32.106 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.105+0000 7f89a1833b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55aeec000130 0x55aeec000570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:05:32.106 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.105+0000 7f89a1833b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55aeec000ab0 0x55aeec005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:05:32.106 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.105+0000 7f89a1833b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55aeec005540 0x55aeec007990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:05:32.106 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.105+0000 7f89a1833b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aeebf570f0 con 0x55aeec005540 2024-06-02T05:05:32.106 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.105+0000 7f89a1833b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aeebf54ab0 con 0x55aeec000130 2024-06-02T05:05:32.106 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.105+0000 7f89a1833b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aeebf503a0 con 0x55aeec000ab0 2024-06-02T05:05:32.106 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.105+0000 7f898e7fc700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55aeec000130 0x55aeec000570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:05:32.106 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.105+0000 7f898e7fc700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55aeec000130 0x55aeec000570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:51062/0 (socket says 172.21.15.76:51062) 2024-06-02T05:05:32.106 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.105+0000 7f898e7fc700 1 -- 172.21.15.76:0/2879975754 learned_addr learned my addr 172.21.15.76:0/2879975754 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:05:32.106 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.105+0000 7f898effd700 1 --2- 172.21.15.76:0/2879975754 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55aeec000ab0 0x55aeec005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:05:32.107 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.105+0000 7f898e7fc700 1 --2- 172.21.15.76:0/2879975754 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55aeec005540 0x55aeec007990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:05:32.107 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.105+0000 7f898effd700 1 -- 172.21.15.76:0/2879975754 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55aeec000130 msgr2=0x55aeec000570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:05:32.107 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.105+0000 7f898effd700 1 --2- 172.21.15.76:0/2879975754 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55aeec000130 0x55aeec000570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:32.107 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.105+0000 7f898effd700 1 -- 172.21.15.76:0/2879975754 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55aeec005540 msgr2=0x55aeec007990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:05:32.107 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.105+0000 7f898effd700 1 --2- 172.21.15.76:0/2879975754 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55aeec005540 0x55aeec007990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:32.107 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.105+0000 7f898effd700 1 -- 172.21.15.76:0/2879975754 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55aeebdd1350 con 0x55aeec000ab0 2024-06-02T05:05:32.107 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.105+0000 7f898e7fc700 1 --2- 172.21.15.76:0/2879975754 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55aeec005540 0x55aeec007990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T05:05:32.108 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.107+0000 7f898effd700 1 --2- 172.21.15.76:0/2879975754 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55aeec000ab0 0x55aeec005000 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f8980009ae0 tx=0x7f8980009df0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=874796adbcceacf5 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:05:32.111 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.111+0000 7f8977fff700 1 -- 172.21.15.76:0/545869213 <== mon.2 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f8988012a00 con 0x7f899010d5e0 2024-06-02T05:05:32.112 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.111+0000 7f8977fff700 1 --2- 172.21.15.76:0/545869213 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f89780a1210 0x7f89780a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:05:32.112 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.112+0000 7f8977fff700 1 -- 172.21.15.76:0/545869213 <== mon.2 v2:172.21.15.119:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f89880ce760 con 0x7f899010d5e0 2024-06-02T05:05:32.112 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.112+0000 7f8995678700 1 -- 172.21.15.76:0/2879975754 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f898000e8d0 con 0x55aeec000ab0 2024-06-02T05:05:32.114 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.112+0000 7f8995678700 1 -- 172.21.15.76:0/2879975754 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f898000eec0 con 0x55aeec000ab0 2024-06-02T05:05:32.114 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.112+0000 7f8995678700 1 -- 172.21.15.76:0/2879975754 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8980013ea0 con 0x55aeec000ab0 2024-06-02T05:05:32.114 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.113+0000 7f89a1833b80 1 -- 172.21.15.76:0/2879975754 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55aeec000ab0 msgr2=0x55aeec005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:05:32.114 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.113+0000 7f89a1833b80 1 --2- 172.21.15.76:0/2879975754 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55aeec000ab0 0x55aeec005000 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f8980009ae0 tx=0x7f8980009df0 comp rx=0 tx=0).stop 2024-06-02T05:05:32.114 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.113+0000 7f89a1833b80 1 -- 172.21.15.76:0/2879975754 shutdown_connections 2024-06-02T05:05:32.114 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.113+0000 7f89a1833b80 1 --2- 172.21.15.76:0/2879975754 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55aeec005540 0x55aeec007990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:32.114 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.113+0000 7f89a1833b80 1 --2- 172.21.15.76:0/2879975754 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55aeec000130 0x55aeec000570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:32.114 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.113+0000 7f89a1833b80 1 --2- 172.21.15.76:0/2879975754 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55aeec000ab0 0x55aeec005000 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:32.114 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.113+0000 7f89a1833b80 1 -- 172.21.15.76:0/2879975754 >> 172.21.15.76:0/2879975754 conn(0x55aeebf5e1b0 msgr2=0x55aeebffaa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:05:32.114 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.113+0000 7f898e7fc700 1 --2- 172.21.15.76:0/545869213 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f89780a1210 0x7f89780a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:05:32.114 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.113+0000 7f89a1833b80 1 -- 172.21.15.76:0/2879975754 shutdown_connections 2024-06-02T05:05:32.115 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.113+0000 7f89a1833b80 1 -- 172.21.15.76:0/2879975754 wait complete. 2024-06-02T05:05:32.115 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.114+0000 7f89a1833b80 1 -- start start 2024-06-02T05:05:32.115 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.114+0000 7f89a1833b80 1 Processor -- start 2024-06-02T05:05:32.115 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.114+0000 7f898e7fc700 1 --2- 172.21.15.76:0/545869213 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f89780a1210 0x7f89780a36d0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x55aeebffb620 tx=0x7f8984001140 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:05:32.115 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.114+0000 7f89a1833b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55aeec000130 0x55aeec009940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:05:32.115 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.114+0000 7f89a1833b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55aeec000ab0 0x55aeec009e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:05:32.115 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.114+0000 7f89a1833b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55aeec005540 0x55aeec010ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:05:32.115 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.114+0000 7f89a1833b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aeebeec500 con 0x55aeec000130 2024-06-02T05:05:32.116 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.114+0000 7f89a1833b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aeebeec1a0 con 0x55aeec000ab0 2024-06-02T05:05:32.116 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.114+0000 7f89a1833b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aeebdd3640 con 0x55aeec005540 2024-06-02T05:05:32.116 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.114+0000 7f89a1833b80 10 client.0 _ll_register_callbacks cb 0x55aeebef5ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T05:05:32.116 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.114+0000 7f898e7fc700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55aeec000ab0 0x55aeec009e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:05:32.116 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.114+0000 7f898e7fc700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55aeec000ab0 0x55aeec009e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:51066/0 (socket says 172.21.15.76:51066) 2024-06-02T05:05:32.116 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.114+0000 7f898e7fc700 1 -- 172.21.15.76:0/4255070972 learned_addr learned my addr 172.21.15.76:0/4255070972 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:05:32.116 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.115+0000 7f898e7fc700 1 -- 172.21.15.76:0/4255070972 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55aeec005540 msgr2=0x55aeec010ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:05:32.117 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.115+0000 7f898e7fc700 1 --2- 172.21.15.76:0/4255070972 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55aeec005540 0x55aeec010ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:32.117 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.115+0000 7f898e7fc700 1 -- 172.21.15.76:0/4255070972 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55aeec000130 msgr2=0x55aeec009940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:05:32.117 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.115+0000 7f898e7fc700 1 --2- 172.21.15.76:0/4255070972 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55aeec000130 0x55aeec009940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:32.117 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.115+0000 7f898e7fc700 1 -- 172.21.15.76:0/4255070972 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8980009710 con 0x55aeec000ab0 2024-06-02T05:05:32.118 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.118+0000 7f898e7fc700 1 --2- 172.21.15.76:0/4255070972 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55aeec000ab0 0x55aeec009e80 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f8984009e00 tx=0x7f8984001300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f392f4429b8cd84 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:05:32.118 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.118+0000 7f8972ff5700 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-06-02T05:05:32.124 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.123+0000 7f8972ff5700 1 -- 172.21.15.76:0/4255070972 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8984017b30 con 0x55aeec000ab0 2024-06-02T05:05:32.124 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.123+0000 7f8972ff5700 1 -- 172.21.15.76:0/4255070972 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f8984017c90 con 0x55aeec000ab0 2024-06-02T05:05:32.124 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.123+0000 7f89a1833b80 1 -- 172.21.15.76:0/4255070972 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55aeebfcf7b0 con 0x55aeec000ab0 2024-06-02T05:05:32.124 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.123+0000 7f8972ff5700 1 -- 172.21.15.76:0/4255070972 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8984017e50 con 0x55aeec000ab0 2024-06-02T05:05:32.124 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.123+0000 7f89a1833b80 10 client.26330 fetch_fsmap learned FSMap version 36 2024-06-02T05:05:32.124 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.123+0000 7f89a1833b80 1 -- 172.21.15.76:0/4255070972 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55aeebd7db00 con 0x55aeec000ab0 2024-06-02T05:05:32.124 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.123+0000 7f8972ff5700 1 -- 172.21.15.76:0/4255070972 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55aeebfcf7b0 con 0x55aeec000ab0 2024-06-02T05:05:32.125 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.124+0000 7f8972ff5700 1 -- 172.21.15.76:0/4255070972 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f89840153e0 con 0x55aeec000ab0 2024-06-02T05:05:32.125 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.124+0000 7f89a1833b80 10 client.26330 fetch_fsmap finished waiting for FSMap version 36 2024-06-02T05:05:32.125 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.124+0000 7f89a1833b80 10 client.26330 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T05:05:32.125 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.124+0000 7f89a1833b80 20 client.26330 populate_metadata read hostname 'smithi076' 2024-06-02T05:05:32.126 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.125+0000 7f89a1833b80 1 --2- 172.21.15.76:0/4255070972 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55aeec015740 0x55aeec017b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:05:32.126 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.125+0000 7f89a1833b80 4 client.26330 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T05:05:32.126 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.125+0000 7f89a1833b80 1 -- 172.21.15.76:0/4255070972 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55aeebf48e60 con 0x55aeec015740 2024-06-02T05:05:32.126 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.125+0000 7f898effd700 1 --2- 172.21.15.76:0/4255070972 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55aeec015740 0x55aeec017b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:05:32.126 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.126+0000 7f898effd700 1 --2- 172.21.15.76:0/4255070972 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55aeec015740 0x55aeec017b80 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c3ac780f514dba89 server_cookie=4c67ebc043aeba78 in_seq=0 out_seq=0 2024-06-02T05:05:32.133 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.130+0000 7f8972ff5700 10 client.26330 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T05:05:32.133 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.131+0000 7f8972ff5700 1 -- 172.21.15.76:0/4255070972 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55aeebf48e60 con 0x55aeec015740 2024-06-02T05:05:32.133 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.131+0000 7f8972ff5700 10 client.26330 handle_command_reply: tid=0 2024-06-02T05:05:32.134 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.131+0000 7f89a1833b80 1 client.26330 shutdown 2024-06-02T05:05:32.136 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.136+0000 7f89a1833b80 1 -- 172.21.15.76:0/4255070972 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55aeec000ab0 msgr2=0x55aeec009e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:05:32.137 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.136+0000 7f89a1833b80 1 --2- 172.21.15.76:0/4255070972 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55aeec000ab0 0x55aeec009e80 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f8984009e00 tx=0x7f8984001300 comp rx=0 tx=0).stop 2024-06-02T05:05:32.137 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.136+0000 7f89a1833b80 1 -- 172.21.15.76:0/4255070972 shutdown_connections 2024-06-02T05:05:32.137 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.136+0000 7f89a1833b80 1 --2- 172.21.15.76:0/4255070972 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55aeec015740 0x55aeec017b80 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:32.137 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.136+0000 7f89a1833b80 1 --2- 172.21.15.76:0/4255070972 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55aeec005540 0x55aeec010ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:32.137 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.136+0000 7f89a1833b80 1 --2- 172.21.15.76:0/4255070972 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55aeec000130 0x55aeec009940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:32.137 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.136+0000 7f89a1833b80 1 --2- 172.21.15.76:0/4255070972 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55aeec000ab0 0x55aeec009e80 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:32.137 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.136+0000 7f89a1833b80 1 -- 172.21.15.76:0/4255070972 >> 172.21.15.76:0/4255070972 conn(0x55aeebf5e1b0 msgr2=0x55aeebffa190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:05:32.142 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.141+0000 7f8972ff5700 0 client.26330 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T05:05:32.142 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.141+0000 7f89a1833b80 1 -- 172.21.15.76:0/4255070972 shutdown_connections 2024-06-02T05:05:32.142 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.142+0000 7f89a1833b80 1 -- 172.21.15.76:0/4255070972 wait complete. 2024-06-02T05:05:32.143 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.142+0000 7f89a1833b80 20 client.26330 trim_cache size 0 max 16384 2024-06-02T05:05:32.167 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.166+0000 7f89a1833b80 1 Processor -- start 2024-06-02T05:05:32.177 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.176+0000 7f89a1833b80 1 -- start start 2024-06-02T05:05:32.177 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.176+0000 7f89a1833b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55aeec000130 0x55aeec01c520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:05:32.177 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.176+0000 7f89a1833b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55aeec000ab0 0x55aeec010e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:05:32.177 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.176+0000 7f89a1833b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55aeec005540 0x55aeec0017e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:05:32.177 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.176+0000 7f89a1833b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aeebffc550 con 0x55aeec000130 2024-06-02T05:05:32.177 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.176+0000 7f89a1833b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aeec012bc0 con 0x55aeec000ab0 2024-06-02T05:05:32.177 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.176+0000 7f89a1833b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aeebff5770 con 0x55aeec005540 2024-06-02T05:05:32.177 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.176+0000 7f898e7fc700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55aeec000ab0 0x55aeec010e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:05:32.177 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.176+0000 7f898e7fc700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55aeec000ab0 0x55aeec010e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:51070/0 (socket says 172.21.15.76:51070) 2024-06-02T05:05:32.177 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.176+0000 7f898e7fc700 1 -- 172.21.15.76:0/916360008 learned_addr learned my addr 172.21.15.76:0/916360008 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:05:32.179 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.176+0000 7f898e7fc700 1 -- 172.21.15.76:0/916360008 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55aeec005540 msgr2=0x55aeec0017e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-02T05:05:32.179 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.176+0000 7f898e7fc700 1 --2- 172.21.15.76:0/916360008 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55aeec005540 0x55aeec0017e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:32.179 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.176+0000 7f898e7fc700 1 -- 172.21.15.76:0/916360008 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55aeec000130 msgr2=0x55aeec01c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:05:32.179 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.176+0000 7f898e7fc700 1 --2- 172.21.15.76:0/916360008 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55aeec000130 0x55aeec01c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:32.179 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.176+0000 7f898e7fc700 1 -- 172.21.15.76:0/916360008 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55aeebf16500 con 0x55aeec000ab0 2024-06-02T05:05:32.179 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.177+0000 7f898e7fc700 1 --2- 172.21.15.76:0/916360008 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55aeec000ab0 0x55aeec010e80 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f8984017860 tx=0x7f8984017890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a0cc8bb0269e2301 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:05:32.179 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.177+0000 7f89757fa700 1 -- 172.21.15.76:0/916360008 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8984015a80 con 0x55aeec000ab0 2024-06-02T05:05:32.179 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.177+0000 7f89757fa700 1 -- 172.21.15.76:0/916360008 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f89840089b0 con 0x55aeec000ab0 2024-06-02T05:05:32.179 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.177+0000 7f89757fa700 1 -- 172.21.15.76:0/916360008 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8984009520 con 0x55aeec000ab0 2024-06-02T05:05:32.179 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.178+0000 7f89a1833b80 1 -- 172.21.15.76:0/916360008 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55aeec000ab0 msgr2=0x55aeec010e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:05:32.179 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.178+0000 7f89a1833b80 1 --2- 172.21.15.76:0/916360008 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55aeec000ab0 0x55aeec010e80 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f8984017860 tx=0x7f8984017890 comp rx=0 tx=0).stop 2024-06-02T05:05:32.180 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.178+0000 7f89a1833b80 1 -- 172.21.15.76:0/916360008 shutdown_connections 2024-06-02T05:05:32.180 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.178+0000 7f89a1833b80 1 --2- 172.21.15.76:0/916360008 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55aeec005540 0x55aeec0017e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:32.180 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.178+0000 7f89a1833b80 1 --2- 172.21.15.76:0/916360008 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55aeec000130 0x55aeec01c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:32.180 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.178+0000 7f89a1833b80 1 --2- 172.21.15.76:0/916360008 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55aeec000ab0 0x55aeec010e80 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:32.180 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.178+0000 7f89a1833b80 1 -- 172.21.15.76:0/916360008 >> 172.21.15.76:0/916360008 conn(0x55aeebf5e1b0 msgr2=0x55aeec008e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:05:32.180 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.178+0000 7f89a1833b80 1 -- 172.21.15.76:0/916360008 shutdown_connections 2024-06-02T05:05:32.180 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.178+0000 7f89a1833b80 1 -- 172.21.15.76:0/916360008 wait complete. 2024-06-02T05:05:32.180 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.178+0000 7f89a1833b80 1 -- start start 2024-06-02T05:05:32.180 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.178+0000 7f89a1833b80 1 Processor -- start 2024-06-02T05:05:32.182 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.179+0000 7f89a1833b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55aeec000130 0x55aeec00e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:05:32.182 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.179+0000 7f89a1833b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55aeec000ab0 0x55aeec00e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:05:32.182 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.179+0000 7f89a1833b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55aeec005540 0x55aeec00f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:05:32.182 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.179+0000 7f89a1833b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aeec00fbe0 con 0x55aeec005540 2024-06-02T05:05:32.182 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.179+0000 7f89a1833b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aeec00fd50 con 0x55aeec000ab0 2024-06-02T05:05:32.183 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.179+0000 7f89a1833b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aeec00ff10 con 0x55aeec000130 2024-06-02T05:05:32.183 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.179+0000 7f89a1833b80 10 client.0 _ll_register_callbacks cb 0x55aeebef5ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T05:05:32.183 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.179+0000 7f898e7fc700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55aeec000ab0 0x55aeec00e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:05:32.183 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.179+0000 7f898e7fc700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55aeec000ab0 0x55aeec00e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:51076/0 (socket says 172.21.15.76:51076) 2024-06-02T05:05:32.183 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.179+0000 7f898e7fc700 1 -- 172.21.15.76:0/498299549 learned_addr learned my addr 172.21.15.76:0/498299549 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:05:32.183 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.179+0000 7f898f7fe700 1 --2- 172.21.15.76:0/498299549 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55aeec005540 0x55aeec00f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:05:32.183 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.179+0000 7f898effd700 1 --2- 172.21.15.76:0/498299549 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55aeec000130 0x55aeec00e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:05:32.183 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.179+0000 7f898e7fc700 1 -- 172.21.15.76:0/498299549 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55aeec000130 msgr2=0x55aeec00e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:05:32.183 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.179+0000 7f898e7fc700 1 --2- 172.21.15.76:0/498299549 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55aeec000130 0x55aeec00e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:32.183 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.179+0000 7f898e7fc700 1 -- 172.21.15.76:0/498299549 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55aeec005540 msgr2=0x55aeec00f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:05:32.183 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.179+0000 7f898e7fc700 1 --2- 172.21.15.76:0/498299549 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55aeec005540 0x55aeec00f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:32.183 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.179+0000 7f898e7fc700 1 -- 172.21.15.76:0/498299549 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55aeebd7db00 con 0x55aeec000ab0 2024-06-02T05:05:32.183 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.180+0000 7f898e7fc700 1 --2- 172.21.15.76:0/498299549 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55aeec000ab0 0x55aeec00e690 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f8984017830 tx=0x7f8984015b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2831c79c97897544 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:05:32.184 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.180+0000 7f8972ff5700 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-06-02T05:05:32.184 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.180+0000 7f8972ff5700 1 -- 172.21.15.76:0/498299549 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8984009220 con 0x55aeec000ab0 2024-06-02T05:05:32.184 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.180+0000 7f8972ff5700 1 -- 172.21.15.76:0/498299549 <== mon.2 v2:172.21.15.119:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f8984009380 con 0x55aeec000ab0 2024-06-02T05:05:32.184 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.180+0000 7f89a1833b80 1 -- 172.21.15.76:0/498299549 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55aeebea9210 con 0x55aeec000ab0 2024-06-02T05:05:32.184 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.180+0000 7f8972ff5700 1 -- 172.21.15.76:0/498299549 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8984009580 con 0x55aeec000ab0 2024-06-02T05:05:32.184 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.180+0000 7f89a1833b80 10 client.26336 fetch_fsmap learned FSMap version 36 2024-06-02T05:05:32.184 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.180+0000 7f89a1833b80 1 -- 172.21.15.76:0/498299549 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55aeebdd5c70 con 0x55aeec000ab0 2024-06-02T05:05:32.184 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.180+0000 7f8972ff5700 1 -- 172.21.15.76:0/498299549 <== mon.2 v2:172.21.15.119:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55aeebea9210 con 0x55aeec000ab0 2024-06-02T05:05:32.184 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.180+0000 7f8972ff5700 1 -- 172.21.15.76:0/498299549 <== mon.2 v2:172.21.15.119:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f8984022c20 con 0x55aeec000ab0 2024-06-02T05:05:32.185 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.180+0000 7f89a1833b80 10 client.26336 fetch_fsmap finished waiting for FSMap version 36 2024-06-02T05:05:32.185 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.180+0000 7f89a1833b80 10 client.26336 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T05:05:32.185 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.180+0000 7f89a1833b80 20 client.26336 populate_metadata read hostname 'smithi076' 2024-06-02T05:05:32.185 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.180+0000 7f89a1833b80 1 --2- 172.21.15.76:0/498299549 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55aeec06bde0 0x55aeec06e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:05:32.185 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.180+0000 7f89a1833b80 4 client.26336 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T05:05:32.185 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.181+0000 7f89a1833b80 1 -- 172.21.15.76:0/498299549 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55aeebd9ec90 con 0x55aeec06bde0 2024-06-02T05:05:32.185 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.181+0000 7f898effd700 1 --2- 172.21.15.76:0/498299549 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55aeec06bde0 0x55aeec06e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:05:32.185 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.181+0000 7f898effd700 1 --2- 172.21.15.76:0/498299549 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55aeec06bde0 0x55aeec06e1d0 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a84f0c689a35c98a server_cookie=e724490ee1e348eb in_seq=0 out_seq=0 2024-06-02T05:05:32.186 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.181+0000 7f8972ff5700 10 client.26336 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T05:05:32.186 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:05:31 smithi192 ceph-mon[47933]: pgmap v746: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 10 MiB/s wr, 710 op/s 2024-06-02T05:05:32.215 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.214+0000 7f8972ff5700 1 -- 172.21.15.76:0/498299549 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55aeebd9ec90 con 0x55aeec06bde0 2024-06-02T05:05:32.215 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.214+0000 7f8972ff5700 10 client.26336 handle_command_reply: tid=0 2024-06-02T05:05:32.215 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.214+0000 7f89a1833b80 1 client.26336 shutdown 2024-06-02T05:05:32.215 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.214+0000 7f89a1833b80 1 -- 172.21.15.76:0/498299549 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55aeec000ab0 msgr2=0x55aeec00e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:05:32.215 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.214+0000 7f89a1833b80 1 --2- 172.21.15.76:0/498299549 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55aeec000ab0 0x55aeec00e690 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f8984017830 tx=0x7f8984015b80 comp rx=0 tx=0).stop 2024-06-02T05:05:32.217 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.216+0000 7f89a1833b80 1 -- 172.21.15.76:0/498299549 shutdown_connections 2024-06-02T05:05:32.217 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.216+0000 7f89a1833b80 1 --2- 172.21.15.76:0/498299549 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x55aeec06bde0 0x55aeec06e1d0 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:32.217 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.216+0000 7f89a1833b80 1 --2- 172.21.15.76:0/498299549 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55aeec005540 0x55aeec00f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:32.217 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.216+0000 7f89a1833b80 1 --2- 172.21.15.76:0/498299549 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55aeec000130 0x55aeec00e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:32.217 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.216+0000 7f8972ff5700 0 client.26336 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T05:05:32.217 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.216+0000 7f89a1833b80 1 --2- 172.21.15.76:0/498299549 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55aeec000ab0 0x55aeec00e690 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:32.217 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.216+0000 7f89a1833b80 1 -- 172.21.15.76:0/498299549 >> 172.21.15.76:0/498299549 conn(0x55aeebf5e1b0 msgr2=0x55aeec0098e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:05:32.217 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.216+0000 7f89a1833b80 1 -- 172.21.15.76:0/498299549 shutdown_connections 2024-06-02T05:05:32.217 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.216+0000 7f89a1833b80 1 -- 172.21.15.76:0/498299549 wait complete. 2024-06-02T05:05:32.217 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.216+0000 7f89a1833b80 20 client.26336 trim_cache size 0 max 16384 2024-06-02T05:05:32.218 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:{ 2024-06-02T05:05:32.218 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "message": "", 2024-06-02T05:05:32.218 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "return_code": 0 2024-06-02T05:05:32.218 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:} 2024-06-02T05:05:32.218 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.217+0000 7f8975ffb700 1 -- 172.21.15.76:0/545869213 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f89780a1210 msgr2=0x7f89780a36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:05:32.219 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.217+0000 7f8975ffb700 1 --2- 172.21.15.76:0/545869213 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f89780a1210 0x7f89780a36d0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x55aeebffb620 tx=0x7f8984001140 comp rx=0 tx=0).stop 2024-06-02T05:05:32.219 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.217+0000 7f8975ffb700 1 -- 172.21.15.76:0/545869213 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f899010d5e0 msgr2=0x7f8990116d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:05:32.219 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.217+0000 7f8975ffb700 1 --2- 172.21.15.76:0/545869213 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f899010d5e0 0x7f8990116d60 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f8988014ff0 tx=0x7f8988012760 comp rx=0 tx=0).stop 2024-06-02T05:05:32.219 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.217+0000 7f8975ffb700 1 -- 172.21.15.76:0/545869213 shutdown_connections 2024-06-02T05:05:32.219 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.217+0000 7f8975ffb700 1 --2- 172.21.15.76:0/545869213 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f89780a1210 0x7f89780a36d0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:32.219 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.217+0000 7f8975ffb700 1 --2- 172.21.15.76:0/545869213 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f899010d5e0 0x7f8990116d60 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:32.219 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.217+0000 7f8975ffb700 1 --2- 172.21.15.76:0/545869213 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8990108180 0x7f89901185e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:32.219 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.217+0000 7f8975ffb700 1 --2- 172.21.15.76:0/545869213 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f899010ab40 0x7f8990118b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:32.219 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.217+0000 7f8975ffb700 1 -- 172.21.15.76:0/545869213 >> 172.21.15.76:0/545869213 conn(0x7f899006e0f0 msgr2=0x7f8990108c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:05:32.219 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.217+0000 7f8975ffb700 1 -- 172.21.15.76:0/545869213 shutdown_connections 2024-06-02T05:05:32.219 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:32.217+0000 7f8975ffb700 1 -- 172.21.15.76:0/545869213 wait complete. 2024-06-02T05:05:32.236 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:05:31 smithi076 ceph-mon[42935]: pgmap v746: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 10 MiB/s wr, 710 op/s 2024-06-02T05:05:34.099 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:05:33 smithi119 ceph-mon[46633]: pgmap v747: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 11 MiB/s wr, 787 op/s 2024-06-02T05:05:34.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:05:33 smithi192 ceph-mon[47933]: pgmap v747: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 11 MiB/s wr, 787 op/s 2024-06-02T05:05:34.237 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:05:33 smithi076 ceph-mon[42935]: pgmap v747: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 11 MiB/s wr, 787 op/s 2024-06-02T05:05:36.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:05:35 smithi119 ceph-mon[46633]: pgmap v748: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 8.9 MiB/s wr, 714 op/s 2024-06-02T05:05:36.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:05:35 smithi192 ceph-mon[47933]: pgmap v748: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 8.9 MiB/s wr, 714 op/s 2024-06-02T05:05:36.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:05:35 smithi076 ceph-mon[42935]: pgmap v748: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 8.9 MiB/s wr, 714 op/s 2024-06-02T05:05:36.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 885.0 s, 642.2 tps, lat 154.123 ms stddev 69.434 2024-06-02T05:05:38.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:05:37 smithi192 ceph-mon[47933]: pgmap v749: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 11 MiB/s wr, 881 op/s 2024-06-02T05:05:38.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:05:37 smithi076 ceph-mon[42935]: pgmap v749: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 11 MiB/s wr, 881 op/s 2024-06-02T05:05:38.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:05:37 smithi119 ceph-mon[46633]: pgmap v749: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 11 MiB/s wr, 881 op/s 2024-06-02T05:05:40.186 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:05:39 smithi192 ceph-mon[47933]: pgmap v750: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 9.3 MiB/s wr, 754 op/s 2024-06-02T05:05:40.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:05:39 smithi076 ceph-mon[42935]: pgmap v750: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 9.3 MiB/s wr, 754 op/s 2024-06-02T05:05:40.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:05:39 smithi119 ceph-mon[46633]: pgmap v750: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 9.3 MiB/s wr, 754 op/s 2024-06-02T05:05:41.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 890.0 s, 705.6 tps, lat 142.816 ms stddev 109.970 2024-06-02T05:05:42.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:05:41 smithi192 ceph-mon[47933]: pgmap v751: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 10 MiB/s wr, 847 op/s 2024-06-02T05:05:42.239 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:05:41 smithi076 ceph-mon[42935]: pgmap v751: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 10 MiB/s wr, 847 op/s 2024-06-02T05:05:42.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:05:41 smithi119 ceph-mon[46633]: pgmap v751: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 10 MiB/s wr, 847 op/s 2024-06-02T05:05:44.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:05:43 smithi192 ceph-mon[47933]: pgmap v752: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 10 MiB/s wr, 805 op/s 2024-06-02T05:05:44.236 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:05:43 smithi076 ceph-mon[42935]: pgmap v752: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 10 MiB/s wr, 805 op/s 2024-06-02T05:05:44.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:05:43 smithi119 ceph-mon[46633]: pgmap v752: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 10 MiB/s wr, 805 op/s 2024-06-02T05:05:45.386 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.384+0000 7f54d0ea8700 1 -- 172.21.15.76:0/2217901496 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f54cc0ffe30 msgr2=0x7f54cc100250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:05:45.386 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.384+0000 7f54d0ea8700 1 --2- 172.21.15.76:0/2217901496 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f54cc0ffe30 0x7f54cc100250 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f54bc009990 tx=0x7f54bc009ca0 comp rx=0 tx=0).stop 2024-06-02T05:05:45.386 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.385+0000 7f54d0ea8700 1 -- 172.21.15.76:0/2217901496 shutdown_connections 2024-06-02T05:05:45.386 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.385+0000 7f54d0ea8700 1 --2- 172.21.15.76:0/2217901496 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54cc101940 0x7f54cc108260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:45.387 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.385+0000 7f54d0ea8700 1 --2- 172.21.15.76:0/2217901496 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f54cc0ffe30 0x7f54cc100250 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:45.387 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.385+0000 7f54d0ea8700 1 --2- 172.21.15.76:0/2217901496 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f54cc100f80 0x7f54cc101400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:45.387 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.385+0000 7f54d0ea8700 1 -- 172.21.15.76:0/2217901496 >> 172.21.15.76:0/2217901496 conn(0x7f54cc0fb3a0 msgr2=0x7f54cc0fd7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:05:45.387 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.385+0000 7f54d0ea8700 1 -- 172.21.15.76:0/2217901496 shutdown_connections 2024-06-02T05:05:45.387 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.385+0000 7f54d0ea8700 1 -- 172.21.15.76:0/2217901496 wait complete. 2024-06-02T05:05:45.389 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.386+0000 7f54d0ea8700 1 Processor -- start 2024-06-02T05:05:45.389 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.386+0000 7f54d0ea8700 1 -- start start 2024-06-02T05:05:45.389 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.386+0000 7f54d0ea8700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54cc0ffe30 0x7f54cc10cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:05:45.389 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.386+0000 7f54d0ea8700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f54cc100f80 0x7f54cc10b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:05:45.389 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.386+0000 7f54d0ea8700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f54cc101940 0x7f54cc10b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:05:45.389 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.386+0000 7f54d0ea8700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54cc10bf40 con 0x7f54cc100f80 2024-06-02T05:05:45.389 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.386+0000 7f54d0ea8700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54cc10c0b0 con 0x7f54cc101940 2024-06-02T05:05:45.390 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.386+0000 7f54d0ea8700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54cc1a0e40 con 0x7f54cc0ffe30 2024-06-02T05:05:45.390 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.386+0000 7f54ca59c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54cc0ffe30 0x7f54cc10cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:05:45.390 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.386+0000 7f54ca59c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54cc0ffe30 0x7f54cc10cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:55576/0 (socket says 172.21.15.76:55576) 2024-06-02T05:05:45.390 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.386+0000 7f54ca59c700 1 -- 172.21.15.76:0/1940147735 learned_addr learned my addr 172.21.15.76:0/1940147735 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:05:45.390 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.387+0000 7f54c9d9b700 1 --2- 172.21.15.76:0/1940147735 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f54cc100f80 0x7f54cc10b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:05:45.390 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.387+0000 7f54ca59c700 1 -- 172.21.15.76:0/1940147735 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f54cc101940 msgr2=0x7f54cc10b7a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-06-02T05:05:45.390 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.387+0000 7f54ca59c700 1 --2- 172.21.15.76:0/1940147735 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f54cc101940 0x7f54cc10b7a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:45.390 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.387+0000 7f54ca59c700 1 -- 172.21.15.76:0/1940147735 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f54cc100f80 msgr2=0x7f54cc10b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:05:45.390 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.387+0000 7f54ca59c700 1 --2- 172.21.15.76:0/1940147735 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f54cc100f80 0x7f54cc10b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:45.391 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.387+0000 7f54ca59c700 1 -- 172.21.15.76:0/1940147735 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54bc0095f0 con 0x7f54cc0ffe30 2024-06-02T05:05:45.391 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.387+0000 7f54ca59c700 1 --2- 172.21.15.76:0/1940147735 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54cc0ffe30 0x7f54cc10cbd0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f54bc006010 tx=0x7f54bc004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:05:45.391 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.387+0000 7f54bb7fe700 1 -- 172.21.15.76:0/1940147735 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54bc01d070 con 0x7f54cc0ffe30 2024-06-02T05:05:45.391 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.388+0000 7f54d0ea8700 1 -- 172.21.15.76:0/1940147735 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54cc1a1070 con 0x7f54cc0ffe30 2024-06-02T05:05:45.391 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.388+0000 7f54d0ea8700 1 -- 172.21.15.76:0/1940147735 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54cc1a1490 con 0x7f54cc0ffe30 2024-06-02T05:05:45.391 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.388+0000 7f54bb7fe700 1 -- 172.21.15.76:0/1940147735 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f54bc00bd50 con 0x7f54cc0ffe30 2024-06-02T05:05:45.391 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.388+0000 7f54bb7fe700 1 -- 172.21.15.76:0/1940147735 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54bc00fd90 con 0x7f54cc0ffe30 2024-06-02T05:05:45.393 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.392+0000 7f54bb7fe700 1 -- 172.21.15.76:0/1940147735 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f54bc00f460 con 0x7f54cc0ffe30 2024-06-02T05:05:45.396 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.393+0000 7f54dd063b80 1 Processor -- start 2024-06-02T05:05:45.396 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.393+0000 7f54dd063b80 1 -- start start 2024-06-02T05:05:45.396 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.394+0000 7f54dd063b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55587205c290 0x55587205c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:05:45.396 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.394+0000 7f54dd063b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55587205cbf0 0x55587205d500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:05:45.396 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.394+0000 7f54dd063b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55587205dae0 0x55587205df60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:05:45.396 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.394+0000 7f54dd063b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x555871fab0f0 con 0x55587205dae0 2024-06-02T05:05:45.396 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.394+0000 7f54dd063b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x555871fa8ab0 con 0x55587205c290 2024-06-02T05:05:45.396 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.394+0000 7f54dd063b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x555871fa43a0 con 0x55587205cbf0 2024-06-02T05:05:45.396 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.394+0000 7f54cad9d700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55587205c290 0x55587205c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:05:45.396 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.394+0000 7f54c9d9b700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55587205dae0 0x55587205df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:05:45.396 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.394+0000 7f54c9d9b700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55587205dae0 0x55587205df60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:42880/0 (socket says 172.21.15.76:42880) 2024-06-02T05:05:45.397 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.394+0000 7f54c9d9b700 1 -- 172.21.15.76:0/1654332129 learned_addr learned my addr 172.21.15.76:0/1654332129 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:05:45.397 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.394+0000 7f54ca59c700 1 --2- 172.21.15.76:0/1654332129 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55587205cbf0 0x55587205d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:05:45.397 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.395+0000 7f54ca59c700 1 -- 172.21.15.76:0/1654332129 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55587205c290 msgr2=0x55587205c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:05:45.397 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.395+0000 7f54ca59c700 1 --2- 172.21.15.76:0/1654332129 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55587205c290 0x55587205c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:45.397 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.395+0000 7f54ca59c700 1 -- 172.21.15.76:0/1654332129 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55587205dae0 msgr2=0x55587205df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:05:45.397 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.395+0000 7f54ca59c700 1 --2- 172.21.15.76:0/1654332129 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55587205dae0 0x55587205df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:45.397 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.395+0000 7f54ca59c700 1 -- 172.21.15.76:0/1654332129 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555871e25350 con 0x55587205cbf0 2024-06-02T05:05:45.397 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.395+0000 7f54c9d9b700 1 --2- 172.21.15.76:0/1654332129 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55587205dae0 0x55587205df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T05:05:45.397 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.395+0000 7f54ca59c700 1 --2- 172.21.15.76:0/1654332129 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55587205cbf0 0x55587205d500 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f54bc0cb550 tx=0x7f54bc0d4400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc2803e4fd92b119 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:05:45.397 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.395+0000 7f54bb7fe700 1 --2- 172.21.15.76:0/1940147735 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f54b40a11a0 0x7f54b40a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:05:45.398 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.396+0000 7f54bb7fe700 1 -- 172.21.15.76:0/1940147735 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f54bc0cddc0 con 0x7f54cc0ffe30 2024-06-02T05:05:45.398 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.397+0000 7f54b8ff9700 1 -- 172.21.15.76:0/1654332129 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54bc0d9070 con 0x55587205cbf0 2024-06-02T05:05:45.398 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.397+0000 7f54b8ff9700 1 -- 172.21.15.76:0/1654332129 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f54bc095940 con 0x55587205cbf0 2024-06-02T05:05:45.398 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.397+0000 7f54b8ff9700 1 -- 172.21.15.76:0/1654332129 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54bc08b1e0 con 0x55587205cbf0 2024-06-02T05:05:45.399 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.398+0000 7f54cad9d700 1 --2- 172.21.15.76:0/1940147735 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f54b40a11a0 0x7f54b40a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:05:45.399 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.398+0000 7f54dd063b80 1 -- 172.21.15.76:0/1654332129 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55587205cbf0 msgr2=0x55587205d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:05:45.399 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.398+0000 7f54dd063b80 1 --2- 172.21.15.76:0/1654332129 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55587205cbf0 0x55587205d500 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f54bc0cb550 tx=0x7f54bc0d4400 comp rx=0 tx=0).stop 2024-06-02T05:05:45.399 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.398+0000 7f54dd063b80 1 -- 172.21.15.76:0/1654332129 shutdown_connections 2024-06-02T05:05:45.399 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.398+0000 7f54dd063b80 1 --2- 172.21.15.76:0/1654332129 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55587205dae0 0x55587205df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:45.399 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.398+0000 7f54dd063b80 1 --2- 172.21.15.76:0/1654332129 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55587205c290 0x55587205c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:45.399 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.398+0000 7f54dd063b80 1 --2- 172.21.15.76:0/1654332129 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55587205cbf0 0x55587205d500 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:45.399 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.398+0000 7f54dd063b80 1 -- 172.21.15.76:0/1654332129 >> 172.21.15.76:0/1654332129 conn(0x555871fb21b0 msgr2=0x555872050440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:05:45.399 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.398+0000 7f54dd063b80 1 -- 172.21.15.76:0/1654332129 shutdown_connections 2024-06-02T05:05:45.399 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.398+0000 7f54dd063b80 1 -- 172.21.15.76:0/1654332129 wait complete. 2024-06-02T05:05:45.400 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.399+0000 7f54cad9d700 1 --2- 172.21.15.76:0/1940147735 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f54b40a11a0 0x7f54b40a3660 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f54c400f500 tx=0x7f54c400b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:05:45.400 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.399+0000 7f54dd063b80 1 -- start start 2024-06-02T05:05:45.400 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.399+0000 7f54dd063b80 1 Processor -- start 2024-06-02T05:05:45.400 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.399+0000 7f54dd063b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55587205c290 0x555872054c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:05:45.400 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.399+0000 7f54dd063b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55587205cbf0 0x5558720551b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:05:45.400 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.399+0000 7f54dd063b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55587205dae0 0x55587205a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:05:45.401 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.399+0000 7f54dd063b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x555871f40500 con 0x55587205dae0 2024-06-02T05:05:45.401 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.399+0000 7f54dd063b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x555871f401a0 con 0x55587205cbf0 2024-06-02T05:05:45.401 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.399+0000 7f54dd063b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x555871e27640 con 0x55587205c290 2024-06-02T05:05:45.401 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.399+0000 7f54dd063b80 10 client.0 _ll_register_callbacks cb 0x555871f49ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T05:05:45.401 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.400+0000 7f54c9d9b700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55587205cbf0 0x5558720551b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:05:45.402 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.400+0000 7f54ca59c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55587205c290 0x555872054c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:05:45.402 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.400+0000 7f54c9d9b700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55587205cbf0 0x5558720551b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:48944/0 (socket says 172.21.15.76:48944) 2024-06-02T05:05:45.402 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.400+0000 7f54c9d9b700 1 -- 172.21.15.76:0/3805697000 learned_addr learned my addr 172.21.15.76:0/3805697000 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:05:45.402 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.400+0000 7f54ca59c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55587205c290 0x555872054c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:55598/0 (socket says 172.21.15.76:55598) 2024-06-02T05:05:45.402 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.400+0000 7f54cad9d700 1 --2- 172.21.15.76:0/3805697000 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55587205dae0 0x55587205a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:05:45.402 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.400+0000 7f54ca59c700 1 -- 172.21.15.76:0/3805697000 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55587205cbf0 msgr2=0x5558720551b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:05:45.402 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.400+0000 7f54ca59c700 1 --2- 172.21.15.76:0/3805697000 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55587205cbf0 0x5558720551b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:45.402 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.400+0000 7f54ca59c700 1 -- 172.21.15.76:0/3805697000 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55587205dae0 msgr2=0x55587205a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:05:45.402 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.400+0000 7f54ca59c700 1 --2- 172.21.15.76:0/3805697000 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55587205dae0 0x55587205a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:45.402 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.400+0000 7f54ca59c700 1 -- 172.21.15.76:0/3805697000 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54c00099e0 con 0x55587205c290 2024-06-02T05:05:45.402 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.401+0000 7f54ca59c700 1 --2- 172.21.15.76:0/3805697000 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55587205c290 0x555872054c70 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f54bc09ac60 tx=0x7f54bc005ac0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aec802795f17a418 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:05:45.402 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.401+0000 7f54b1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.192:3300/0 2024-06-02T05:05:45.404 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.401+0000 7f54b1ffb700 1 -- 172.21.15.76:0/3805697000 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54bc00f710 con 0x55587205c290 2024-06-02T05:05:45.404 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.401+0000 7f54b1ffb700 1 -- 172.21.15.76:0/3805697000 <== mon.1 v2:172.21.15.192:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f54bc09af60 con 0x55587205c290 2024-06-02T05:05:45.404 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.401+0000 7f54dd063b80 1 -- 172.21.15.76:0/3805697000 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555871efd210 con 0x55587205c290 2024-06-02T05:05:45.404 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.401+0000 7f54b1ffb700 1 -- 172.21.15.76:0/3805697000 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f54bc00bec0 con 0x55587205c290 2024-06-02T05:05:45.406 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.405+0000 7f54dd063b80 10 client.26290 fetch_fsmap learned FSMap version 36 2024-06-02T05:05:45.406 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.405+0000 7f54dd063b80 1 -- 172.21.15.76:0/3805697000 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x7f54cc1a1490 con 0x55587205c290 2024-06-02T05:05:45.407 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.406+0000 7f54b1ffb700 1 -- 172.21.15.76:0/3805697000 <== mon.1 v2:172.21.15.192:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x555871efd210 con 0x55587205c290 2024-06-02T05:05:45.408 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.407+0000 7f54b1ffb700 1 -- 172.21.15.76:0/3805697000 <== mon.1 v2:172.21.15.192:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f54bc09b1c0 con 0x55587205c290 2024-06-02T05:05:45.408 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.407+0000 7f54dd063b80 10 client.26290 fetch_fsmap finished waiting for FSMap version 36 2024-06-02T05:05:45.408 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.407+0000 7f54dd063b80 10 client.26290 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T05:05:45.408 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.407+0000 7f54dd063b80 20 client.26290 populate_metadata read hostname 'smithi076' 2024-06-02T05:05:45.408 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.407+0000 7f54dd063b80 1 --2- 172.21.15.76:0/3805697000 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x555872079e00 0x55587207c220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:05:45.408 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.407+0000 7f54dd063b80 4 client.26290 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T05:05:45.408 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.407+0000 7f54dd063b80 1 -- 172.21.15.76:0/3805697000 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5558720237b0 con 0x555872079e00 2024-06-02T05:05:45.410 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.410+0000 7f54c9d9b700 1 --2- 172.21.15.76:0/3805697000 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x555872079e00 0x55587207c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:05:45.411 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.410+0000 7f54c9d9b700 1 --2- 172.21.15.76:0/3805697000 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x555872079e00 0x55587207c220 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f235a96d7953f4e server_cookie=3ace46c40dd78046 in_seq=0 out_seq=0 2024-06-02T05:05:45.411 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.410+0000 7f54b1ffb700 10 client.26290 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T05:05:45.412 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.411+0000 7f54b1ffb700 1 -- 172.21.15.76:0/3805697000 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5558720237b0 con 0x555872079e00 2024-06-02T05:05:45.412 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.411+0000 7f54b1ffb700 10 client.26290 handle_command_reply: tid=0 2024-06-02T05:05:45.412 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.411+0000 7f54dd063b80 1 client.26290 shutdown 2024-06-02T05:05:45.412 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.411+0000 7f54dd063b80 1 -- 172.21.15.76:0/3805697000 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55587205c290 msgr2=0x555872054c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:05:45.412 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.411+0000 7f54dd063b80 1 --2- 172.21.15.76:0/3805697000 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55587205c290 0x555872054c70 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f54bc09ac60 tx=0x7f54bc005ac0 comp rx=0 tx=0).stop 2024-06-02T05:05:45.413 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.413+0000 7f54dd063b80 1 -- 172.21.15.76:0/3805697000 shutdown_connections 2024-06-02T05:05:45.413 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.413+0000 7f54dd063b80 1 --2- 172.21.15.76:0/3805697000 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x555872079e00 0x55587207c220 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:45.413 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.413+0000 7f54dd063b80 1 --2- 172.21.15.76:0/3805697000 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55587205dae0 0x55587205a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:45.414 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.413+0000 7f54dd063b80 1 --2- 172.21.15.76:0/3805697000 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55587205c290 0x555872054c70 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:45.414 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.413+0000 7f54dd063b80 1 --2- 172.21.15.76:0/3805697000 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55587205cbf0 0x5558720551b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:45.414 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.413+0000 7f54dd063b80 1 -- 172.21.15.76:0/3805697000 >> 172.21.15.76:0/3805697000 conn(0x555871fb21b0 msgr2=0x55587204e860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:05:45.414 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.413+0000 7f54b1ffb700 0 client.26290 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T05:05:45.414 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.414+0000 7f54dd063b80 1 -- 172.21.15.76:0/3805697000 shutdown_connections 2024-06-02T05:05:45.414 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.414+0000 7f54dd063b80 1 -- 172.21.15.76:0/3805697000 wait complete. 2024-06-02T05:05:45.415 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.414+0000 7f54dd063b80 20 client.26290 trim_cache size 0 max 16384 2024-06-02T05:05:45.436 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.435+0000 7f54dd063b80 1 Processor -- start 2024-06-02T05:05:45.437 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.436+0000 7f54dd063b80 1 -- start start 2024-06-02T05:05:45.437 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.436+0000 7f54dd063b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55587205c290 0x55587205a890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:05:45.437 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.436+0000 7f54dd063b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55587205cbf0 0x55587205dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:05:45.437 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.436+0000 7f54dd063b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55587205dae0 0x555872060d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:05:45.437 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.436+0000 7f54dd063b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x555872049330 con 0x55587205dae0 2024-06-02T05:05:45.437 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.436+0000 7f54dd063b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55587205bf10 con 0x55587205c290 2024-06-02T05:05:45.437 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.436+0000 7f54dd063b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55587205b360 con 0x55587205cbf0 2024-06-02T05:05:45.438 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.436+0000 7f54ca59c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55587205c290 0x55587205a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:05:45.438 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.436+0000 7f54ca59c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55587205c290 0x55587205a890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:48956/0 (socket says 172.21.15.76:48956) 2024-06-02T05:05:45.438 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.436+0000 7f54ca59c700 1 -- 172.21.15.76:0/3984961439 learned_addr learned my addr 172.21.15.76:0/3984961439 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:05:45.438 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.436+0000 7f54cad9d700 1 --2- 172.21.15.76:0/3984961439 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55587205dae0 0x555872060d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:05:45.438 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.436+0000 7f54ca59c700 1 -- 172.21.15.76:0/3984961439 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55587205cbf0 msgr2=0x55587205dec0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-02T05:05:45.438 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.436+0000 7f54ca59c700 1 --2- 172.21.15.76:0/3984961439 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55587205cbf0 0x55587205dec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:45.438 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.436+0000 7f54ca59c700 1 -- 172.21.15.76:0/3984961439 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55587205dae0 msgr2=0x555872060d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:05:45.438 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.436+0000 7f54ca59c700 1 --2- 172.21.15.76:0/3984961439 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55587205dae0 0x555872060d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:45.439 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.436+0000 7f54ca59c700 1 -- 172.21.15.76:0/3984961439 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555871dd1b00 con 0x55587205c290 2024-06-02T05:05:45.439 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.437+0000 7f54ca59c700 1 --2- 172.21.15.76:0/3984961439 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55587205c290 0x55587205a890 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f54bc09aef0 tx=0x7f54bc009ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cd96edaf2944a4f5 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:05:45.439 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.437+0000 7f54b97fa700 1 -- 172.21.15.76:0/3984961439 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54bc0d4850 con 0x55587205c290 2024-06-02T05:05:45.439 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.437+0000 7f54b97fa700 1 -- 172.21.15.76:0/3984961439 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f54bc0972a0 con 0x55587205c290 2024-06-02T05:05:45.439 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.437+0000 7f54b97fa700 1 -- 172.21.15.76:0/3984961439 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54bc09ad30 con 0x55587205c290 2024-06-02T05:05:45.439 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.438+0000 7f54dd063b80 1 -- 172.21.15.76:0/3984961439 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55587205c290 msgr2=0x55587205a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:05:45.440 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.438+0000 7f54dd063b80 1 --2- 172.21.15.76:0/3984961439 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55587205c290 0x55587205a890 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f54bc09aef0 tx=0x7f54bc009ca0 comp rx=0 tx=0).stop 2024-06-02T05:05:45.440 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.438+0000 7f54dd063b80 1 -- 172.21.15.76:0/3984961439 shutdown_connections 2024-06-02T05:05:45.440 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.438+0000 7f54dd063b80 1 --2- 172.21.15.76:0/3984961439 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55587205dae0 0x555872060d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:45.440 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.438+0000 7f54dd063b80 1 --2- 172.21.15.76:0/3984961439 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55587205c290 0x55587205a890 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:45.440 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.438+0000 7f54dd063b80 1 --2- 172.21.15.76:0/3984961439 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55587205cbf0 0x55587205dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:45.440 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.438+0000 7f54dd063b80 1 -- 172.21.15.76:0/3984961439 >> 172.21.15.76:0/3984961439 conn(0x555871fb21b0 msgr2=0x555872064070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:05:45.454 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.453+0000 7f54dd063b80 1 -- 172.21.15.76:0/3984961439 shutdown_connections 2024-06-02T05:05:45.454 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.454+0000 7f54dd063b80 1 -- 172.21.15.76:0/3984961439 wait complete. 2024-06-02T05:05:45.456 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.454+0000 7f54dd063b80 1 -- start start 2024-06-02T05:05:45.456 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.454+0000 7f54dd063b80 1 Processor -- start 2024-06-02T05:05:45.456 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.455+0000 7f54dd063b80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55587205c290 0x55587208a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:05:45.456 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.455+0000 7f54dd063b80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55587205dae0 0x555872088bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:05:45.456 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.455+0000 7f54dd063b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555872089100 0x555872089580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:05:45.456 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.455+0000 7f54dd063b80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558720cee70 con 0x55587205dae0 2024-06-02T05:05:45.456 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.455+0000 7f54dd063b80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558720cefe0 con 0x55587205c290 2024-06-02T05:05:45.456 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.455+0000 7f54dd063b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558720cf1a0 con 0x555872089100 2024-06-02T05:05:45.456 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.455+0000 7f54dd063b80 10 client.0 _ll_register_callbacks cb 0x555871f49ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T05:05:45.456 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.455+0000 7f54cad9d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555872089100 0x555872089580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:05:45.457 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.455+0000 7f54ca59c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55587205c290 0x55587208a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:05:45.457 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.455+0000 7f54cad9d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555872089100 0x555872089580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:55612/0 (socket says 172.21.15.76:55612) 2024-06-02T05:05:45.457 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.455+0000 7f54cad9d700 1 -- 172.21.15.76:0/4210556361 learned_addr learned my addr 172.21.15.76:0/4210556361 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:05:45.457 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.455+0000 7f54c9d9b700 1 --2- 172.21.15.76:0/4210556361 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55587205dae0 0x555872088bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:05:45.458 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.456+0000 7f54c9d9b700 1 -- 172.21.15.76:0/4210556361 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555872089100 msgr2=0x555872089580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:05:45.458 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.456+0000 7f54c9d9b700 1 --2- 172.21.15.76:0/4210556361 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555872089100 0x555872089580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:45.458 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.456+0000 7f54c9d9b700 1 -- 172.21.15.76:0/4210556361 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55587205c290 msgr2=0x55587208a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:05:45.458 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.456+0000 7f54c9d9b700 1 --2- 172.21.15.76:0/4210556361 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55587205c290 0x55587208a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:45.458 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.456+0000 7f54c9d9b700 1 -- 172.21.15.76:0/4210556361 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54cc1a1490 con 0x55587205dae0 2024-06-02T05:05:45.458 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.456+0000 7f54ca59c700 1 --2- 172.21.15.76:0/4210556361 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55587205c290 0x55587208a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T05:05:45.458 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.456+0000 7f54c9d9b700 1 --2- 172.21.15.76:0/4210556361 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55587205dae0 0x555872088bc0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x55587205d3b0 tx=0x7f54c0012e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15e209d8fe613bd3 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:05:45.458 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.456+0000 7f54b1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-06-02T05:05:45.458 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.456+0000 7f54b1ffb700 1 -- 172.21.15.76:0/4210556361 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54c0017040 con 0x55587205dae0 2024-06-02T05:05:45.458 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.456+0000 7f54b1ffb700 1 -- 172.21.15.76:0/4210556361 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f54c0005ce0 con 0x55587205dae0 2024-06-02T05:05:45.459 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.456+0000 7f54dd063b80 1 -- 172.21.15.76:0/4210556361 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f54bc095940 con 0x55587205dae0 2024-06-02T05:05:45.459 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.457+0000 7f54b1ffb700 1 -- 172.21.15.76:0/4210556361 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f54c00122e0 con 0x55587205dae0 2024-06-02T05:05:45.459 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.457+0000 7f54dd063b80 10 client.16668 fetch_fsmap learned FSMap version 36 2024-06-02T05:05:45.459 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.457+0000 7f54dd063b80 1 -- 172.21.15.76:0/4210556361 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x555871f6a500 con 0x55587205dae0 2024-06-02T05:05:45.459 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.457+0000 7f54b1ffb700 1 -- 172.21.15.76:0/4210556361 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f54bc095940 con 0x55587205dae0 2024-06-02T05:05:45.459 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.458+0000 7f54b1ffb700 1 -- 172.21.15.76:0/4210556361 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f54c00213a0 con 0x55587205dae0 2024-06-02T05:05:45.459 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.459+0000 7f54dd063b80 10 client.16668 fetch_fsmap finished waiting for FSMap version 36 2024-06-02T05:05:45.460 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.459+0000 7f54dd063b80 10 client.16668 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T05:05:45.460 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.459+0000 7f54dd063b80 20 client.16668 populate_metadata read hostname 'smithi076' 2024-06-02T05:05:45.460 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.459+0000 7f54dd063b80 1 --2- 172.21.15.76:0/4210556361 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5558720d0af0 0x5558720d2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:05:45.460 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.459+0000 7f54dd063b80 4 client.16668 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T05:05:45.460 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.459+0000 7f54dd063b80 1 -- 172.21.15.76:0/4210556361 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x555871f9ce60 con 0x5558720d0af0 2024-06-02T05:05:45.460 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.459+0000 7f54ca59c700 1 --2- 172.21.15.76:0/4210556361 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5558720d0af0 0x5558720d2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:05:45.461 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.460+0000 7f54ca59c700 1 --2- 172.21.15.76:0/4210556361 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5558720d0af0 0x5558720d2ee0 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=139103185c80c44e server_cookie=53a87060603339ce in_seq=0 out_seq=0 2024-06-02T05:05:45.461 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.460+0000 7f54b1ffb700 10 client.16668 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T05:05:45.478 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.477+0000 7f54b1ffb700 1 -- 172.21.15.76:0/4210556361 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x555871f9ce60 con 0x5558720d0af0 2024-06-02T05:05:45.478 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.477+0000 7f54b1ffb700 10 client.16668 handle_command_reply: tid=0 2024-06-02T05:05:45.478 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.477+0000 7f54dd063b80 1 client.16668 shutdown 2024-06-02T05:05:45.483 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.482+0000 7f54dd063b80 1 -- 172.21.15.76:0/4210556361 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55587205dae0 msgr2=0x555872088bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:05:45.483 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.482+0000 7f54dd063b80 1 --2- 172.21.15.76:0/4210556361 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55587205dae0 0x555872088bc0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x55587205d3b0 tx=0x7f54c0012e20 comp rx=0 tx=0).stop 2024-06-02T05:05:45.483 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.482+0000 7f54dd063b80 1 -- 172.21.15.76:0/4210556361 shutdown_connections 2024-06-02T05:05:45.484 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.482+0000 7f54dd063b80 1 --2- 172.21.15.76:0/4210556361 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x5558720d0af0 0x5558720d2ee0 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:45.484 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.482+0000 7f54dd063b80 1 --2- 172.21.15.76:0/4210556361 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555872089100 0x555872089580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:45.484 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.482+0000 7f54dd063b80 1 --2- 172.21.15.76:0/4210556361 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55587205c290 0x55587208a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:45.484 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.482+0000 7f54dd063b80 1 --2- 172.21.15.76:0/4210556361 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55587205dae0 0x555872088bc0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:45.484 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.482+0000 7f54dd063b80 1 -- 172.21.15.76:0/4210556361 >> 172.21.15.76:0/4210556361 conn(0x555871fb21b0 msgr2=0x555872080b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:05:45.484 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.482+0000 7f54b1ffb700 0 client.16668 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T05:05:45.484 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.482+0000 7f54dd063b80 1 -- 172.21.15.76:0/4210556361 shutdown_connections 2024-06-02T05:05:45.484 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.482+0000 7f54dd063b80 1 -- 172.21.15.76:0/4210556361 wait complete. 2024-06-02T05:05:45.484 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.483+0000 7f54dd063b80 20 client.16668 trim_cache size 0 max 16384 2024-06-02T05:05:45.484 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:{ 2024-06-02T05:05:45.485 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "message": "", 2024-06-02T05:05:45.485 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "return_code": 0 2024-06-02T05:05:45.485 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:} 2024-06-02T05:05:45.485 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.483+0000 7f54d0ea8700 1 -- 172.21.15.76:0/1940147735 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f54b40a11a0 msgr2=0x7f54b40a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:05:45.485 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.483+0000 7f54d0ea8700 1 --2- 172.21.15.76:0/1940147735 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f54b40a11a0 0x7f54b40a3660 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f54c400f500 tx=0x7f54c400b040 comp rx=0 tx=0).stop 2024-06-02T05:05:45.485 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.483+0000 7f54d0ea8700 1 -- 172.21.15.76:0/1940147735 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54cc0ffe30 msgr2=0x7f54cc10cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:05:45.486 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.483+0000 7f54d0ea8700 1 --2- 172.21.15.76:0/1940147735 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54cc0ffe30 0x7f54cc10cbd0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f54bc006010 tx=0x7f54bc004730 comp rx=0 tx=0).stop 2024-06-02T05:05:45.486 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.484+0000 7f54d0ea8700 1 -- 172.21.15.76:0/1940147735 shutdown_connections 2024-06-02T05:05:45.486 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.484+0000 7f54d0ea8700 1 --2- 172.21.15.76:0/1940147735 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f54b40a11a0 0x7f54b40a3660 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:45.486 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.484+0000 7f54d0ea8700 1 --2- 172.21.15.76:0/1940147735 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f54cc101940 0x7f54cc10b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:45.486 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.484+0000 7f54d0ea8700 1 --2- 172.21.15.76:0/1940147735 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54cc0ffe30 0x7f54cc10cbd0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:45.486 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.484+0000 7f54d0ea8700 1 --2- 172.21.15.76:0/1940147735 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f54cc100f80 0x7f54cc10b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:45.486 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.484+0000 7f54d0ea8700 1 -- 172.21.15.76:0/1940147735 >> 172.21.15.76:0/1940147735 conn(0x7f54cc0fb3a0 msgr2=0x7f54cc104310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:05:45.486 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.484+0000 7f54d0ea8700 1 -- 172.21.15.76:0/1940147735 shutdown_connections 2024-06-02T05:05:45.486 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:45.484+0000 7f54d0ea8700 1 -- 172.21.15.76:0/1940147735 wait complete. 2024-06-02T05:05:46.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:05:45 smithi192 ceph-mon[47933]: pgmap v753: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 9.1 MiB/s wr, 710 op/s 2024-06-02T05:05:46.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:05:45 smithi076 ceph-mon[42935]: pgmap v753: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 9.1 MiB/s wr, 710 op/s 2024-06-02T05:05:46.315 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 895.0 s, 750.5 tps, lat 133.123 ms stddev 138.498 2024-06-02T05:05:46.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:05:45 smithi119 ceph-mon[46633]: pgmap v753: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 9.1 MiB/s wr, 710 op/s 2024-06-02T05:05:48.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:05:47 smithi192 ceph-mon[47933]: pgmap v754: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 11 MiB/s wr, 819 op/s 2024-06-02T05:05:48.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:05:47 smithi076 ceph-mon[42935]: pgmap v754: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 11 MiB/s wr, 819 op/s 2024-06-02T05:05:48.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:05:47 smithi119 ceph-mon[46633]: pgmap v754: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 11 MiB/s wr, 819 op/s 2024-06-02T05:05:50.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:05:49 smithi192 ceph-mon[47933]: pgmap v755: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 9.7 MiB/s wr, 666 op/s 2024-06-02T05:05:50.235 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:05:49 smithi076 ceph-mon[42935]: pgmap v755: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 9.7 MiB/s wr, 666 op/s 2024-06-02T05:05:50.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:05:49 smithi119 ceph-mon[46633]: pgmap v755: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 9.7 MiB/s wr, 666 op/s 2024-06-02T05:05:51.319 INFO:teuthology.orchestra.run.smithi076.stderr:progress: 900.0 s, 587.8 tps, lat 167.065 ms stddev 135.244 2024-06-02T05:05:51.585 INFO:teuthology.orchestra.run.smithi076.stdout:transaction type: 2024-06-02T05:05:51.585 INFO:teuthology.orchestra.run.smithi076.stdout:scaling factor: 32 2024-06-02T05:05:51.585 INFO:teuthology.orchestra.run.smithi076.stdout:query mode: simple 2024-06-02T05:05:51.585 INFO:teuthology.orchestra.run.smithi076.stdout:number of clients: 100 2024-06-02T05:05:51.586 INFO:teuthology.orchestra.run.smithi076.stdout:number of threads: 4 2024-06-02T05:05:51.586 INFO:teuthology.orchestra.run.smithi076.stdout:duration: 900 s 2024-06-02T05:05:51.586 INFO:teuthology.orchestra.run.smithi076.stdout:number of transactions actually processed: 660345 2024-06-02T05:05:51.586 INFO:teuthology.orchestra.run.smithi076.stdout:latency average = 136.264 ms 2024-06-02T05:05:51.586 INFO:teuthology.orchestra.run.smithi076.stdout:latency stddev = 178.366 ms 2024-06-02T05:05:51.586 INFO:teuthology.orchestra.run.smithi076.stdout:tps = 733.496550 (including connections establishing) 2024-06-02T05:05:51.586 INFO:teuthology.orchestra.run.smithi076.stdout:tps = 733.506693 (excluding connections establishing) 2024-06-02T05:05:51.621 DEBUG:teuthology.orchestra.run.smithi076:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo systemctl stop postgresql' 2024-06-02T05:05:52.236 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:05:51 smithi076 ceph-mon[42935]: pgmap v756: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 10 MiB/s wr, 743 op/s 2024-06-02T05:05:52.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:05:51 smithi119 ceph-mon[46633]: pgmap v756: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 10 MiB/s wr, 743 op/s 2024-06-02T05:05:52.431 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:05:51 smithi192 ceph-mon[47933]: pgmap v756: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 10 MiB/s wr, 743 op/s 2024-06-02T05:05:53.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:05:52 smithi076 ceph-mon[42935]: pgmap v757: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 9.8 MiB/s wr, 721 op/s 2024-06-02T05:05:53.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:05:52 smithi119 ceph-mon[46633]: pgmap v757: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 9.8 MiB/s wr, 721 op/s 2024-06-02T05:05:53.433 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:05:52 smithi192 ceph-mon[47933]: pgmap v757: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 9.8 MiB/s wr, 721 op/s 2024-06-02T05:05:56.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:05:55 smithi119 ceph-mon[46633]: pgmap v758: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 9.0 MiB/s wr, 664 op/s 2024-06-02T05:05:56.183 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:05:55 smithi192 ceph-mon[47933]: pgmap v758: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 9.0 MiB/s wr, 664 op/s 2024-06-02T05:05:56.235 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:05:55 smithi076 ceph-mon[42935]: pgmap v758: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 9.0 MiB/s wr, 664 op/s 2024-06-02T05:05:58.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:05:57 smithi119 ceph-mon[46633]: pgmap v759: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 11 MiB/s wr, 895 op/s 2024-06-02T05:05:58.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:05:57 smithi192 ceph-mon[47933]: pgmap v759: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 11 MiB/s wr, 895 op/s 2024-06-02T05:05:58.241 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:05:57 smithi076 ceph-mon[42935]: pgmap v759: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 11 MiB/s wr, 895 op/s 2024-06-02T05:05:58.700 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.697+0000 7f87ac973700 1 -- 172.21.15.76:0/386321330 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f87a810a910 msgr2=0x7f87a810cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:05:58.700 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.697+0000 7f87ac973700 1 --2- 172.21.15.76:0/386321330 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f87a810a910 0x7f87a810cda0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f879c009990 tx=0x7f879c009ca0 comp rx=0 tx=0).stop 2024-06-02T05:05:58.723 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.718+0000 7f87ac973700 1 -- 172.21.15.76:0/386321330 shutdown_connections 2024-06-02T05:05:58.723 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.718+0000 7f87ac973700 1 --2- 172.21.15.76:0/386321330 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f87a810d2e0 0x7f87a810d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:58.723 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.718+0000 7f87ac973700 1 --2- 172.21.15.76:0/386321330 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f87a8107fa0 0x7f87a810a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:58.724 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.718+0000 7f87ac973700 1 --2- 172.21.15.76:0/386321330 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f87a810a910 0x7f87a810cda0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:58.724 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.718+0000 7f87ac973700 1 -- 172.21.15.76:0/386321330 >> 172.21.15.76:0/386321330 conn(0x7f87a806df30 msgr2=0x7f87a8070370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:05:58.734 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.729+0000 7f87ac973700 1 -- 172.21.15.76:0/386321330 shutdown_connections 2024-06-02T05:05:58.738 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.737+0000 7f87ac973700 1 -- 172.21.15.76:0/386321330 wait complete. 2024-06-02T05:05:58.738 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.737+0000 7f87ac973700 1 Processor -- start 2024-06-02T05:05:58.749 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.738+0000 7f87ac973700 1 -- start start 2024-06-02T05:05:58.749 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.738+0000 7f87ac973700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f87a8107fa0 0x7f87a8116640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:05:58.749 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.738+0000 7f87ac973700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f87a810a910 0x7f87a8116b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:05:58.749 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.738+0000 7f87ac973700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f87a810d2e0 0x7f87a81b5da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:05:58.750 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.738+0000 7f87ac973700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87a8117150 con 0x7f87a810d2e0 2024-06-02T05:05:58.750 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.738+0000 7f87ac973700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87a81172c0 con 0x7f87a810a910 2024-06-02T05:05:58.750 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.738+0000 7f87ac973700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87a81b62e0 con 0x7f87a8107fa0 2024-06-02T05:05:58.750 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.749+0000 7f87a5d9b700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f87a810a910 0x7f87a8116b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:05:58.750 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.749+0000 7f87a5d9b700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f87a810a910 0x7f87a8116b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:36838/0 (socket says 172.21.15.76:36838) 2024-06-02T05:05:58.750 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.749+0000 7f87a5d9b700 1 -- 172.21.15.76:0/3203684457 learned_addr learned my addr 172.21.15.76:0/3203684457 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:05:58.750 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.749+0000 7f87a6d9d700 1 --2- 172.21.15.76:0/3203684457 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f87a810d2e0 0x7f87a81b5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:05:58.761 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.752+0000 7f87a659c700 1 --2- 172.21.15.76:0/3203684457 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f87a8107fa0 0x7f87a8116640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:05:58.774 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.763+0000 7f87a5d9b700 1 -- 172.21.15.76:0/3203684457 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f87a8107fa0 msgr2=0x7f87a8116640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:05:58.774 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.763+0000 7f87a5d9b700 1 --2- 172.21.15.76:0/3203684457 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f87a8107fa0 0x7f87a8116640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:58.774 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.763+0000 7f87a5d9b700 1 -- 172.21.15.76:0/3203684457 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f87a810d2e0 msgr2=0x7f87a81b5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:05:58.774 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.763+0000 7f87a5d9b700 1 --2- 172.21.15.76:0/3203684457 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f87a810d2e0 0x7f87a81b5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:58.775 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.763+0000 7f87a5d9b700 1 -- 172.21.15.76:0/3203684457 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f879c0095f0 con 0x7f87a810a910 2024-06-02T05:05:58.775 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.771+0000 7f87a5d9b700 1 --2- 172.21.15.76:0/3203684457 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f87a810a910 0x7f87a8116b80 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f879c006010 tx=0x7f879c005740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:05:58.785 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.781+0000 7f87977fe700 1 -- 172.21.15.76:0/3203684457 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f879c01d070 con 0x7f87a810a910 2024-06-02T05:05:58.786 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.781+0000 7f87977fe700 1 -- 172.21.15.76:0/3203684457 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f879c0040a0 con 0x7f87a810a910 2024-06-02T05:05:58.786 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.781+0000 7f87977fe700 1 -- 172.21.15.76:0/3203684457 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f879c022da0 con 0x7f87a810a910 2024-06-02T05:05:58.786 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.784+0000 7f87ac973700 1 -- 172.21.15.76:0/3203684457 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87a81b6560 con 0x7f87a810a910 2024-06-02T05:05:58.786 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.784+0000 7f87ac973700 1 -- 172.21.15.76:0/3203684457 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87a81b6950 con 0x7f87a810a910 2024-06-02T05:05:58.789 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.789+0000 7f87b8b2eb80 1 Processor -- start 2024-06-02T05:05:58.791 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.790+0000 7f87b8b2eb80 1 -- start start 2024-06-02T05:05:58.791 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.790+0000 7f87b8b2eb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562f3fd12a80 0x562f3fd12ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:05:58.791 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.790+0000 7f87b8b2eb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562f3fd133e0 0x562f3fd13cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:05:58.791 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.790+0000 7f87b8b2eb80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562f3fd142d0 0x562f3fd14750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:05:58.791 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.790+0000 7f87b8b2eb80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f3fc6a0f0 con 0x562f3fd142d0 2024-06-02T05:05:58.791 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.790+0000 7f87b8b2eb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f3fc67ab0 con 0x562f3fd133e0 2024-06-02T05:05:58.792 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.790+0000 7f87b8b2eb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f3fc633a0 con 0x562f3fd12a80 2024-06-02T05:05:58.795 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.794+0000 7f87a5d9b700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562f3fd142d0 0x562f3fd14750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:05:58.795 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.794+0000 7f87a5d9b700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562f3fd142d0 0x562f3fd14750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:43622/0 (socket says 172.21.15.76:43622) 2024-06-02T05:05:58.795 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.794+0000 7f87a5d9b700 1 -- 172.21.15.76:0/3285052451 learned_addr learned my addr 172.21.15.76:0/3285052451 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:05:58.795 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.794+0000 7f87977fe700 1 -- 172.21.15.76:0/3203684457 <== mon.2 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f879c022570 con 0x7f87a810a910 2024-06-02T05:05:58.795 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.795+0000 7f87a5d9b700 1 -- 172.21.15.76:0/3285052451 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562f3fd12a80 msgr2=0x562f3fd12ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:05:58.796 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.795+0000 7f87a5d9b700 1 --2- 172.21.15.76:0/3285052451 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562f3fd12a80 0x562f3fd12ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:58.796 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.795+0000 7f87a5d9b700 1 -- 172.21.15.76:0/3285052451 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562f3fd133e0 msgr2=0x562f3fd13cf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-02T05:05:58.796 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.795+0000 7f87a5d9b700 1 --2- 172.21.15.76:0/3285052451 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562f3fd133e0 0x562f3fd13cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:58.806 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.795+0000 7f87a5d9b700 1 -- 172.21.15.76:0/3285052451 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562f3fae4350 con 0x562f3fd142d0 2024-06-02T05:05:58.806 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.803+0000 7f87977fe700 1 --2- 172.21.15.76:0/3203684457 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f87900a12f0 0x7f87900a37b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:05:58.807 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.803+0000 7f87a6d9d700 1 --2- 172.21.15.76:0/3203684457 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f87900a12f0 0x7f87900a37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:05:58.807 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.806+0000 7f87977fe700 1 -- 172.21.15.76:0/3203684457 <== mon.2 v2:172.21.15.119:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f879c0cff80 con 0x7f87a810a910 2024-06-02T05:05:58.814 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.814+0000 7f87a6d9d700 1 --2- 172.21.15.76:0/3203684457 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f87900a12f0 0x7f87900a37b0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f8798009300 tx=0x7f8798009290 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:05:58.822 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.820+0000 7f87a5d9b700 1 --2- 172.21.15.76:0/3285052451 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562f3fd142d0 0x562f3fd14750 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f879c0d1ca0 tx=0x7f879c0d63d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f399230a47364c8b server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:05:58.834 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.831+0000 7f8794ff9700 1 -- 172.21.15.76:0/3285052451 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f879c099400 con 0x562f3fd142d0 2024-06-02T05:05:58.834 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.831+0000 7f8794ff9700 1 -- 172.21.15.76:0/3285052451 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f879c09ce90 con 0x562f3fd142d0 2024-06-02T05:05:58.834 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.831+0000 7f8794ff9700 1 -- 172.21.15.76:0/3285052451 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f879c09cc00 con 0x562f3fd142d0 2024-06-02T05:05:58.834 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.832+0000 7f87b8b2eb80 1 -- 172.21.15.76:0/3285052451 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562f3fd142d0 msgr2=0x562f3fd14750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:05:58.834 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.832+0000 7f87b8b2eb80 1 --2- 172.21.15.76:0/3285052451 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562f3fd142d0 0x562f3fd14750 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f879c0d1ca0 tx=0x7f879c0d63d0 comp rx=0 tx=0).stop 2024-06-02T05:05:58.834 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.832+0000 7f87b8b2eb80 1 -- 172.21.15.76:0/3285052451 shutdown_connections 2024-06-02T05:05:58.835 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.832+0000 7f87b8b2eb80 1 --2- 172.21.15.76:0/3285052451 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562f3fd142d0 0x562f3fd14750 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:58.835 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.832+0000 7f87b8b2eb80 1 --2- 172.21.15.76:0/3285052451 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562f3fd12a80 0x562f3fd12ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:58.835 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.832+0000 7f87b8b2eb80 1 --2- 172.21.15.76:0/3285052451 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562f3fd133e0 0x562f3fd13cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:58.835 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.832+0000 7f87b8b2eb80 1 -- 172.21.15.76:0/3285052451 >> 172.21.15.76:0/3285052451 conn(0x562f3fc711b0 msgr2=0x562f3fd0f440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:05:58.835 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.832+0000 7f87b8b2eb80 1 -- 172.21.15.76:0/3285052451 shutdown_connections 2024-06-02T05:05:58.835 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.833+0000 7f87b8b2eb80 1 -- 172.21.15.76:0/3285052451 wait complete. 2024-06-02T05:05:58.835 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.834+0000 7f87b8b2eb80 1 -- start start 2024-06-02T05:05:58.835 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.834+0000 7f87b8b2eb80 1 Processor -- start 2024-06-02T05:05:58.848 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.847+0000 7f87b8b2eb80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562f3fd12a80 0x562f3fd1c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:05:58.848 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.847+0000 7f87b8b2eb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562f3fd133e0 0x562f3fd1cb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:05:58.848 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.847+0000 7f87b8b2eb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562f3fd142d0 0x562f3fd23b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:05:58.848 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.847+0000 7f87b8b2eb80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f3fbff500 con 0x562f3fd12a80 2024-06-02T05:05:58.848 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.847+0000 7f87b8b2eb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f3fbff1a0 con 0x562f3fd133e0 2024-06-02T05:05:58.849 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.847+0000 7f87b8b2eb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f3fae6640 con 0x562f3fd142d0 2024-06-02T05:05:58.849 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.847+0000 7f87b8b2eb80 10 client.0 _ll_register_callbacks cb 0x562f3fc08ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T05:05:58.854 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.853+0000 7f87a5d9b700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562f3fd133e0 0x562f3fd1cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:05:58.854 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.853+0000 7f87a5d9b700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562f3fd133e0 0x562f3fd1cb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:36852/0 (socket says 172.21.15.76:36852) 2024-06-02T05:05:58.854 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.853+0000 7f87a5d9b700 1 -- 172.21.15.76:0/2023523260 learned_addr learned my addr 172.21.15.76:0/2023523260 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:05:58.859 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.859+0000 7f87a6d9d700 1 --2- 172.21.15.76:0/2023523260 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562f3fd142d0 0x562f3fd23b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:05:58.878 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.872+0000 7f87a6d9d700 1 -- 172.21.15.76:0/2023523260 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562f3fd133e0 msgr2=0x562f3fd1cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:05:58.878 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.872+0000 7f87a6d9d700 1 --2- 172.21.15.76:0/2023523260 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562f3fd133e0 0x562f3fd1cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:58.878 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.872+0000 7f87a6d9d700 1 -- 172.21.15.76:0/2023523260 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562f3fd12a80 msgr2=0x562f3fd1c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:05:58.878 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.872+0000 7f87a6d9d700 1 --2- 172.21.15.76:0/2023523260 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562f3fd12a80 0x562f3fd1c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:58.878 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.872+0000 7f87a6d9d700 1 -- 172.21.15.76:0/2023523260 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87a81b6950 con 0x562f3fd142d0 2024-06-02T05:05:58.900 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.891+0000 7f87a6d9d700 1 --2- 172.21.15.76:0/2023523260 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562f3fd142d0 0x562f3fd23b10 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8798004840 tx=0x7f8798004790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=133bb4b91cbd3ddb server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:05:58.900 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.894+0000 7f878dffb700 10 client.0 ms_handle_connect on v2:172.21.15.192:3300/0 2024-06-02T05:05:58.905 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.905+0000 7f878dffb700 1 -- 172.21.15.76:0/2023523260 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87980158e0 con 0x562f3fd142d0 2024-06-02T05:05:58.906 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.905+0000 7f878dffb700 1 -- 172.21.15.76:0/2023523260 <== mon.1 v2:172.21.15.192:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f8798015a40 con 0x562f3fd142d0 2024-06-02T05:05:58.906 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.905+0000 7f87b8b2eb80 1 -- 172.21.15.76:0/2023523260 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562f3fbbc210 con 0x562f3fd142d0 2024-06-02T05:05:58.916 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.916+0000 7f878dffb700 1 -- 172.21.15.76:0/2023523260 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8798015c00 con 0x562f3fd142d0 2024-06-02T05:05:58.916 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.916+0000 7f87b8b2eb80 10 client.26302 fetch_fsmap learned FSMap version 36 2024-06-02T05:05:58.916 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.916+0000 7f87b8b2eb80 1 -- 172.21.15.76:0/2023523260 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x562f3fa90b00 con 0x562f3fd142d0 2024-06-02T05:05:58.928 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.927+0000 7f878dffb700 1 -- 172.21.15.76:0/2023523260 <== mon.1 v2:172.21.15.192:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x562f3fbbc210 con 0x562f3fd142d0 2024-06-02T05:05:58.928 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.927+0000 7f878dffb700 1 -- 172.21.15.76:0/2023523260 <== mon.1 v2:172.21.15.192:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f87980283f0 con 0x562f3fd142d0 2024-06-02T05:05:58.928 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.927+0000 7f87b8b2eb80 10 client.26302 fetch_fsmap finished waiting for FSMap version 36 2024-06-02T05:05:58.928 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.927+0000 7f87b8b2eb80 10 client.26302 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T05:05:58.928 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.927+0000 7f87b8b2eb80 20 client.26302 populate_metadata read hostname 'smithi076' 2024-06-02T05:05:58.929 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.927+0000 7f87b8b2eb80 1 --2- 172.21.15.76:0/2023523260 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x562f3fd283f0 0x562f3fd2a810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:05:58.929 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.927+0000 7f87b8b2eb80 4 client.26302 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T05:05:58.929 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.927+0000 7f87b8b2eb80 1 -- 172.21.15.76:0/2023523260 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562f3fce27b0 con 0x562f3fd283f0 2024-06-02T05:05:58.930 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.928+0000 7f87a659c700 1 --2- 172.21.15.76:0/2023523260 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x562f3fd283f0 0x562f3fd2a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:05:58.961 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.956+0000 7f87a659c700 1 --2- 172.21.15.76:0/2023523260 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x562f3fd283f0 0x562f3fd2a810 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4d90114c24803a20 server_cookie=5ae9518eac2f2430 in_seq=0 out_seq=0 2024-06-02T05:05:58.962 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.960+0000 7f878dffb700 10 client.26302 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T05:05:58.962 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.960+0000 7f878dffb700 1 -- 172.21.15.76:0/2023523260 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x562f3fce27b0 con 0x562f3fd283f0 2024-06-02T05:05:58.962 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.960+0000 7f878dffb700 10 client.26302 handle_command_reply: tid=0 2024-06-02T05:05:58.966 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.966+0000 7f87b8b2eb80 1 client.26302 shutdown 2024-06-02T05:05:58.978 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.978+0000 7f87b8b2eb80 1 -- 172.21.15.76:0/2023523260 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562f3fd142d0 msgr2=0x562f3fd23b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:05:58.978 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.978+0000 7f87b8b2eb80 1 --2- 172.21.15.76:0/2023523260 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562f3fd142d0 0x562f3fd23b10 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8798004840 tx=0x7f8798004790 comp rx=0 tx=0).stop 2024-06-02T05:05:58.982 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.982+0000 7f87b8b2eb80 1 -- 172.21.15.76:0/2023523260 shutdown_connections 2024-06-02T05:05:58.982 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.982+0000 7f87b8b2eb80 1 --2- 172.21.15.76:0/2023523260 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x562f3fd283f0 0x562f3fd2a810 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:58.982 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.982+0000 7f87b8b2eb80 1 --2- 172.21.15.76:0/2023523260 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562f3fd142d0 0x562f3fd23b10 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:58.982 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.982+0000 7f87b8b2eb80 1 --2- 172.21.15.76:0/2023523260 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562f3fd12a80 0x562f3fd1c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:58.983 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.982+0000 7f87b8b2eb80 1 --2- 172.21.15.76:0/2023523260 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562f3fd133e0 0x562f3fd1cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:58.983 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.982+0000 7f878dffb700 0 client.26302 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T05:05:58.983 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.982+0000 7f87b8b2eb80 1 -- 172.21.15.76:0/2023523260 >> 172.21.15.76:0/2023523260 conn(0x562f3fc711b0 msgr2=0x562f3fd0d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:05:58.988 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.986+0000 7f87b8b2eb80 1 -- 172.21.15.76:0/2023523260 shutdown_connections 2024-06-02T05:05:58.988 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.986+0000 7f87b8b2eb80 1 -- 172.21.15.76:0/2023523260 wait complete. 2024-06-02T05:05:58.988 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:58.987+0000 7f87b8b2eb80 20 client.26302 trim_cache size 0 max 16384 2024-06-02T05:05:59.015 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:59.015+0000 7f87b8b2eb80 1 Processor -- start 2024-06-02T05:05:59.016 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:59.015+0000 7f87b8b2eb80 1 -- start start 2024-06-02T05:05:59.016 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:59.015+0000 7f87b8b2eb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562f3fd12a80 0x562f3fd12e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:05:59.016 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:59.015+0000 7f87b8b2eb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562f3fd133e0 0x562f3fd23ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:05:59.016 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:59.015+0000 7f87b8b2eb80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562f3fd142d0 0x562f3fd241c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:05:59.016 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:59.015+0000 7f87b8b2eb80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f3fd14140 con 0x562f3fd142d0 2024-06-02T05:05:59.016 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:59.015+0000 7f87b8b2eb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f3fd137c0 con 0x562f3fd12a80 2024-06-02T05:05:59.016 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:59.015+0000 7f87b8b2eb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f3fd0e930 con 0x562f3fd133e0 2024-06-02T05:05:59.017 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:59.016+0000 7f87a6d9d700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562f3fd142d0 0x562f3fd241c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:05:59.017 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:59.016+0000 7f87a6d9d700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562f3fd142d0 0x562f3fd241c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:43640/0 (socket says 172.21.15.76:43640) 2024-06-02T05:05:59.017 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:59.016+0000 7f87a6d9d700 1 -- 172.21.15.76:0/709170726 learned_addr learned my addr 172.21.15.76:0/709170726 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:05:59.017 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:59.016+0000 7f87a5d9b700 1 --2- 172.21.15.76:0/709170726 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562f3fd133e0 0x562f3fd23ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:05:59.017 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:59.016+0000 7f87a6d9d700 1 -- 172.21.15.76:0/709170726 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562f3fd133e0 msgr2=0x562f3fd23ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:05:59.018 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:59.016+0000 7f87a6d9d700 1 --2- 172.21.15.76:0/709170726 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562f3fd133e0 0x562f3fd23ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:59.018 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:59.016+0000 7f87a6d9d700 1 -- 172.21.15.76:0/709170726 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562f3fd12a80 msgr2=0x562f3fd12e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:05:59.018 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:59.016+0000 7f87a6d9d700 1 --2- 172.21.15.76:0/709170726 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562f3fd12a80 0x562f3fd12e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:59.018 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:59.016+0000 7f87a6d9d700 1 -- 172.21.15.76:0/709170726 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562f3fc29500 con 0x562f3fd142d0 2024-06-02T05:05:59.018 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:59.017+0000 7f87a6d9d700 1 --2- 172.21.15.76:0/709170726 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562f3fd142d0 0x562f3fd241c0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f8798009370 tx=0x7f87980093a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a91a3f1bcfe40b18 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:05:59.018 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:59.017+0000 7f87957fa700 1 -- 172.21.15.76:0/709170726 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8798028530 con 0x562f3fd142d0 2024-06-02T05:05:59.018 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:59.017+0000 7f87957fa700 1 -- 172.21.15.76:0/709170726 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f87980044b0 con 0x562f3fd142d0 2024-06-02T05:05:59.018 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:59.017+0000 7f87957fa700 1 -- 172.21.15.76:0/709170726 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8798003740 con 0x562f3fd142d0 2024-06-02T05:05:59.019 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:59.018+0000 7f87b8b2eb80 1 -- 172.21.15.76:0/709170726 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562f3fd142d0 msgr2=0x562f3fd241c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:05:59.019 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:59.018+0000 7f87b8b2eb80 1 --2- 172.21.15.76:0/709170726 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562f3fd142d0 0x562f3fd241c0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f8798009370 tx=0x7f87980093a0 comp rx=0 tx=0).stop 2024-06-02T05:05:59.022 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:59.021+0000 7f87b8b2eb80 1 -- 172.21.15.76:0/709170726 shutdown_connections 2024-06-02T05:05:59.022 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:59.021+0000 7f87b8b2eb80 1 --2- 172.21.15.76:0/709170726 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562f3fd142d0 0x562f3fd241c0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:59.022 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:59.021+0000 7f87b8b2eb80 1 --2- 172.21.15.76:0/709170726 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562f3fd12a80 0x562f3fd12e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:59.022 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:59.021+0000 7f87b8b2eb80 1 --2- 172.21.15.76:0/709170726 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562f3fd133e0 0x562f3fd23ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:59.022 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:59.021+0000 7f87b8b2eb80 1 -- 172.21.15.76:0/709170726 >> 172.21.15.76:0/709170726 conn(0x562f3fc711b0 msgr2=0x562f3fd1b7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:05:59.024 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:59.024+0000 7f87b8b2eb80 1 -- 172.21.15.76:0/709170726 shutdown_connections 2024-06-02T05:05:59.025 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:59.024+0000 7f87b8b2eb80 1 -- 172.21.15.76:0/709170726 wait complete. 2024-06-02T05:05:59.025 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:59.024+0000 7f87b8b2eb80 1 -- start start 2024-06-02T05:05:59.025 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:59.024+0000 7f87b8b2eb80 1 Processor -- start 2024-06-02T05:05:59.026 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:59.025+0000 7f87b8b2eb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562f3fd12a80 0x562f3fd213b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:05:59.026 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:59.025+0000 7f87b8b2eb80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562f3fd133e0 0x562f3fd218f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:05:59.026 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:59.025+0000 7f87b8b2eb80 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562f3fd142d0 0x562f3fd22900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:05:59.026 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:59.025+0000 7f87b8b2eb80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f3fd22e40 con 0x562f3fd133e0 2024-06-02T05:05:59.026 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:59.025+0000 7f87b8b2eb80 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f3fd22fb0 con 0x562f3fd142d0 2024-06-02T05:05:59.027 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:59.025+0000 7f87b8b2eb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f3fd23170 con 0x562f3fd12a80 2024-06-02T05:05:59.027 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:59.025+0000 7f87b8b2eb80 10 client.0 _ll_register_callbacks cb 0x562f3fc08ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T05:05:59.027 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:59.025+0000 7f87a659c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562f3fd12a80 0x562f3fd213b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:05:59.027 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:59.025+0000 7f87a659c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562f3fd12a80 0x562f3fd213b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:49412/0 (socket says 172.21.15.76:49412) 2024-06-02T05:05:59.027 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:59.025+0000 7f87a659c700 1 -- 172.21.15.76:0/1328494217 learned_addr learned my addr 172.21.15.76:0/1328494217 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:05:59.036 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:59.030+0000 7f87a6d9d700 1 --2- 172.21.15.76:0/1328494217 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562f3fd142d0 0x562f3fd22900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:05:59.036 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:59.030+0000 7f87a5d9b700 1 --2- 172.21.15.76:0/1328494217 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562f3fd133e0 0x562f3fd218f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:05:59.036 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:59.030+0000 7f87a659c700 1 -- 172.21.15.76:0/1328494217 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562f3fd142d0 msgr2=0x562f3fd22900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:05:59.037 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:59.030+0000 7f87a659c700 1 --2- 172.21.15.76:0/1328494217 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562f3fd142d0 0x562f3fd22900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:59.037 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:59.030+0000 7f87a659c700 1 -- 172.21.15.76:0/1328494217 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562f3fd133e0 msgr2=0x562f3fd218f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T05:05:59.037 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:59.030+0000 7f87a659c700 1 --2- 172.21.15.76:0/1328494217 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562f3fd133e0 0x562f3fd218f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:59.037 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:59.030+0000 7f87a659c700 1 -- 172.21.15.76:0/1328494217 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562f3fa90b00 con 0x562f3fd12a80 2024-06-02T05:05:59.043 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:59.041+0000 7f87a659c700 1 --2- 172.21.15.76:0/1328494217 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562f3fd12a80 0x562f3fd213b0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x562f3fd2b0f0 tx=0x7f87a000b9d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=48199c09f2418972 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:05:59.043 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:59.042+0000 7f878dffb700 10 client.0 ms_handle_connect on v2:172.21.15.192:3300/0 2024-06-02T05:05:59.043 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:59.042+0000 7f878dffb700 1 -- 172.21.15.76:0/1328494217 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a0011070 con 0x562f3fd12a80 2024-06-02T05:05:59.043 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:59.042+0000 7f878dffb700 1 -- 172.21.15.76:0/1328494217 <== mon.1 v2:172.21.15.192:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f87a0015750 con 0x562f3fd12a80 2024-06-02T05:05:59.043 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:59.042+0000 7f87b8b2eb80 1 -- 172.21.15.76:0/1328494217 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f879c09ce90 con 0x562f3fd12a80 2024-06-02T05:05:59.053 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:59.053+0000 7f878dffb700 1 -- 172.21.15.76:0/1328494217 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f87a0015a90 con 0x562f3fd12a80 2024-06-02T05:05:59.054 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:59.053+0000 7f87b8b2eb80 10 client.26308 fetch_fsmap learned FSMap version 36 2024-06-02T05:05:59.054 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:59.053+0000 7f87b8b2eb80 1 -- 172.21.15.76:0/1328494217 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x562f3fae8c70 con 0x562f3fd12a80 2024-06-02T05:05:59.067 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:59.066+0000 7f878dffb700 1 -- 172.21.15.76:0/1328494217 <== mon.1 v2:172.21.15.192:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f879c09ce90 con 0x562f3fd12a80 2024-06-02T05:05:59.067 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:59.066+0000 7f878dffb700 1 -- 172.21.15.76:0/1328494217 <== mon.1 v2:172.21.15.192:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f87a001e480 con 0x562f3fd12a80 2024-06-02T05:05:59.067 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:59.066+0000 7f87b8b2eb80 10 client.26308 fetch_fsmap finished waiting for FSMap version 36 2024-06-02T05:05:59.067 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:59.066+0000 7f87b8b2eb80 10 client.26308 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-02T05:05:59.067 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:59.066+0000 7f87b8b2eb80 20 client.26308 populate_metadata read hostname 'smithi076' 2024-06-02T05:05:59.067 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:59.066+0000 7f87b8b2eb80 1 --2- 172.21.15.76:0/1328494217 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x562f3fd7f490 0x562f3fd818b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:05:59.067 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:59.066+0000 7f87b8b2eb80 4 client.26308 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T05:05:59.068 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:59.066+0000 7f87b8b2eb80 1 -- 172.21.15.76:0/1328494217 --> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x562f3fc5be60 con 0x562f3fd7f490 2024-06-02T05:05:59.072 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:59.071+0000 7f87a5d9b700 1 --2- 172.21.15.76:0/1328494217 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x562f3fd7f490 0x562f3fd818b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:05:59.085 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:59.084+0000 7f87a5d9b700 1 --2- 172.21.15.76:0/1328494217 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x562f3fd7f490 0x562f3fd818b0 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=50383de1f7ede236 server_cookie=4fa559e0a2ce06e in_seq=0 out_seq=0 2024-06-02T05:05:59.086 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:59.085+0000 7f878dffb700 10 client.26308 ms_handle_connect on v2:172.21.15.119:6838/4098406903 2024-06-02T05:05:59.297 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:59.296+0000 7f878dffb700 1 -- 172.21.15.76:0/1328494217 <== mds.0 v2:172.21.15.119:6838/4098406903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x562f3fc5be60 con 0x562f3fd7f490 2024-06-02T05:05:59.297 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:59.296+0000 7f878dffb700 10 client.26308 handle_command_reply: tid=0 2024-06-02T05:05:59.297 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:59.296+0000 7f87b8b2eb80 1 client.26308 shutdown 2024-06-02T05:05:59.298 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:59.296+0000 7f87b8b2eb80 1 -- 172.21.15.76:0/1328494217 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562f3fd12a80 msgr2=0x562f3fd213b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:05:59.298 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:59.296+0000 7f87b8b2eb80 1 --2- 172.21.15.76:0/1328494217 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562f3fd12a80 0x562f3fd213b0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x562f3fd2b0f0 tx=0x7f87a000b9d0 comp rx=0 tx=0).stop 2024-06-02T05:05:59.298 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:59.297+0000 7f87b8b2eb80 1 -- 172.21.15.76:0/1328494217 shutdown_connections 2024-06-02T05:05:59.298 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:59.297+0000 7f87b8b2eb80 1 --2- 172.21.15.76:0/1328494217 >> [v2:172.21.15.119:6838/4098406903,v1:172.21.15.119:6839/4098406903] conn(0x562f3fd7f490 0x562f3fd818b0 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:59.298 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:59.297+0000 7f87b8b2eb80 1 --2- 172.21.15.76:0/1328494217 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562f3fd142d0 0x562f3fd22900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:59.298 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:59.297+0000 7f87b8b2eb80 1 --2- 172.21.15.76:0/1328494217 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562f3fd12a80 0x562f3fd213b0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:59.298 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:59.297+0000 7f87b8b2eb80 1 --2- 172.21.15.76:0/1328494217 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562f3fd133e0 0x562f3fd218f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:59.298 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:59.297+0000 7f87b8b2eb80 1 -- 172.21.15.76:0/1328494217 >> 172.21.15.76:0/1328494217 conn(0x562f3fc711b0 msgr2=0x562f3fd1b7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:05:59.298 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:59.297+0000 7f878dffb700 0 client.26308 ms_handle_reset on v2:172.21.15.119:6838/4098406903 2024-06-02T05:05:59.299 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:59.297+0000 7f87b8b2eb80 1 -- 172.21.15.76:0/1328494217 shutdown_connections 2024-06-02T05:05:59.299 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:59.297+0000 7f87b8b2eb80 1 -- 172.21.15.76:0/1328494217 wait complete. 2024-06-02T05:05:59.299 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:59.299+0000 7f87b8b2eb80 20 client.26308 trim_cache size 0 max 16384 2024-06-02T05:05:59.302 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:{ 2024-06-02T05:05:59.303 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "message": "", 2024-06-02T05:05:59.303 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout: "return_code": 0 2024-06-02T05:05:59.303 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stdout:} 2024-06-02T05:05:59.304 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:59.304+0000 7f87ac973700 1 -- 172.21.15.76:0/3203684457 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f87900a12f0 msgr2=0x7f87900a37b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:05:59.304 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:59.304+0000 7f87ac973700 1 --2- 172.21.15.76:0/3203684457 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f87900a12f0 0x7f87900a37b0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f8798009300 tx=0x7f8798009290 comp rx=0 tx=0).stop 2024-06-02T05:05:59.304 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:59.304+0000 7f87ac973700 1 -- 172.21.15.76:0/3203684457 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f87a810a910 msgr2=0x7f87a8116b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:05:59.304 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:59.304+0000 7f87ac973700 1 --2- 172.21.15.76:0/3203684457 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f87a810a910 0x7f87a8116b80 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f879c006010 tx=0x7f879c005740 comp rx=0 tx=0).stop 2024-06-02T05:05:59.308 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:59.307+0000 7f87ac973700 1 -- 172.21.15.76:0/3203684457 shutdown_connections 2024-06-02T05:05:59.308 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:59.307+0000 7f87ac973700 1 --2- 172.21.15.76:0/3203684457 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f87a810d2e0 0x7f87a81b5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:59.308 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:59.307+0000 7f87ac973700 1 --2- 172.21.15.76:0/3203684457 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f87a8107fa0 0x7f87a8116640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:59.308 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:59.307+0000 7f87ac973700 1 --2- 172.21.15.76:0/3203684457 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f87900a12f0 0x7f87900a37b0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:59.308 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:59.307+0000 7f87ac973700 1 --2- 172.21.15.76:0/3203684457 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f87a810a910 0x7f87a8116b80 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:05:59.308 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:59.307+0000 7f87ac973700 1 -- 172.21.15.76:0/3203684457 >> 172.21.15.76:0/3203684457 conn(0x7f87a806df30 msgr2=0x7f87a810b210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:05:59.309 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:59.309+0000 7f87ac973700 1 -- 172.21.15.76:0/3203684457 shutdown_connections 2024-06-02T05:05:59.310 INFO:teuthology.task.background_exec.ubuntu@smithi076.front.sepia.ceph.com.smithi076.stderr:2024-06-02T05:05:59.309+0000 7f87ac973700 1 -- 172.21.15.76:0/3203684457 wait complete. 2024-06-02T05:06:00.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:05:59 smithi192 ceph-mon[47933]: pgmap v760: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 8.7 MiB/s wr, 820 op/s 2024-06-02T05:06:00.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:05:59 smithi076 ceph-mon[42935]: pgmap v760: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 8.7 MiB/s wr, 820 op/s 2024-06-02T05:06:00.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:05:59 smithi119 ceph-mon[46633]: pgmap v760: 129 pgs: 129 active+clean; 1.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 8.7 MiB/s wr, 820 op/s 2024-06-02T05:06:01.461 DEBUG:teuthology.orchestra.run.smithi076:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -lZaR /tmp/cephfs/postgres/' 2024-06-02T05:06:01.857 INFO:teuthology.orchestra.run.smithi076.stdout:/tmp/cephfs/postgres/: 2024-06-02T05:06:01.857 INFO:teuthology.orchestra.run.smithi076.stdout:total 2 2024-06-02T05:06:01.857 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1696119068 Jun 2 04:49 . 2024-06-02T05:06:01.857 INFO:teuthology.orchestra.run.smithi076.stdout:drwxrwxrwt. 3 root root system_u:object_r:postgresql_db_t:s0 1696119068 Jun 2 04:49 .. 2024-06-02T05:06:01.857 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1695868587 Jun 2 05:06 data 2024-06-02T05:06:01.857 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T05:06:01.857 INFO:teuthology.orchestra.run.smithi076.stdout:/tmp/cephfs/postgres/data: 2024-06-02T05:06:01.857 INFO:teuthology.orchestra.run.smithi076.stdout:total 41 2024-06-02T05:06:01.858 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1695868587 Jun 2 05:06 . 2024-06-02T05:06:01.858 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1696119068 Jun 2 04:49 .. 2024-06-02T05:06:01.858 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 638042253 Jun 2 04:50 base 2024-06-02T05:06:01.858 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 30 Jun 2 04:50 current_logfiles 2024-06-02T05:06:01.858 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 587404 Jun 2 04:50 global 2024-06-02T05:06:01.858 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 522 Jun 2 04:50 log 2024-06-02T05:06:01.858 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 pg_commit_ts 2024-06-02T05:06:01.858 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 pg_dynshmem 2024-06-02T05:06:01.858 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 4269 Jun 2 04:49 pg_hba.conf 2024-06-02T05:06:01.858 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1636 Jun 2 04:49 pg_ident.conf 2024-06-02T05:06:01.858 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Jun 2 05:05 pg_logical 2024-06-02T05:06:01.859 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 pg_multixact 2024-06-02T05:06:01.859 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:50 pg_notify 2024-06-02T05:06:01.859 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 pg_replslot 2024-06-02T05:06:01.859 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 pg_serial 2024-06-02T05:06:01.859 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 pg_snapshots 2024-06-02T05:06:01.859 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 11771 Jun 2 05:06 pg_stat 2024-06-02T05:06:01.859 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 11771 Jun 2 05:06 pg_stat_tmp 2024-06-02T05:06:01.859 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 05:06 pg_subtrans 2024-06-02T05:06:01.859 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 pg_tblspc 2024-06-02T05:06:01.859 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 pg_twophase 2024-06-02T05:06:01.859 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Jun 2 04:49 PG_VERSION 2024-06-02T05:06:01.859 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1056964608 Jun 2 05:06 pg_wal 2024-06-02T05:06:01.860 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 172032 Jun 2 04:49 pg_xact 2024-06-02T05:06:01.860 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 88 Jun 2 04:49 postgresql.auto.conf 2024-06-02T05:06:01.860 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 22989 Jun 2 04:49 postgresql.conf 2024-06-02T05:06:01.860 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 51 Jun 2 04:50 postmaster.opts 2024-06-02T05:06:01.860 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T05:06:01.860 INFO:teuthology.orchestra.run.smithi076.stdout:/tmp/cephfs/postgres/data/base: 2024-06-02T05:06:01.860 INFO:teuthology.orchestra.run.smithi076.stdout:total 3 2024-06-02T05:06:01.860 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 638042253 Jun 2 04:50 . 2024-06-02T05:06:01.860 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1695868587 Jun 2 05:06 .. 2024-06-02T05:06:01.861 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7381507 Jun 2 04:49 1 2024-06-02T05:06:01.861 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7381507 Jun 2 04:49 12346 2024-06-02T05:06:01.861 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 623279239 Jun 2 04:51 12347 2024-06-02T05:06:01.861 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:50 pgsql_tmp 2024-06-02T05:06:01.861 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T05:06:01.861 INFO:teuthology.orchestra.run.smithi076.stdout:/tmp/cephfs/postgres/data/base/1: 2024-06-02T05:06:01.861 INFO:teuthology.orchestra.run.smithi076.stdout:total 7210 2024-06-02T05:06:01.861 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7381507 Jun 2 04:49 . 2024-06-02T05:06:01.861 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 638042253 Jun 2 04:50 .. 2024-06-02T05:06:01.861 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 112 2024-06-02T05:06:01.861 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 113 2024-06-02T05:06:01.861 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Jun 2 04:49 12182 2024-06-02T05:06:01.861 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 12182_fsm 2024-06-02T05:06:01.862 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 12182_vm 2024-06-02T05:06:01.862 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 12184 2024-06-02T05:06:01.862 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 12186 2024-06-02T05:06:01.862 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 12187 2024-06-02T05:06:01.862 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 12187_fsm 2024-06-02T05:06:01.862 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 12187_vm 2024-06-02T05:06:01.862 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 12189 2024-06-02T05:06:01.862 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 12191 2024-06-02T05:06:01.862 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 12192 2024-06-02T05:06:01.862 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 12192_fsm 2024-06-02T05:06:01.862 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 12192_vm 2024-06-02T05:06:01.862 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 12194 2024-06-02T05:06:01.862 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 12196 2024-06-02T05:06:01.863 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 12197 2024-06-02T05:06:01.863 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 12197_fsm 2024-06-02T05:06:01.863 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 12197_vm 2024-06-02T05:06:01.863 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 12199 2024-06-02T05:06:01.863 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 12201 2024-06-02T05:06:01.863 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 12202 2024-06-02T05:06:01.863 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 12202_fsm 2024-06-02T05:06:01.863 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 12202_vm 2024-06-02T05:06:01.863 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 12204 2024-06-02T05:06:01.863 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 12206 2024-06-02T05:06:01.863 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 12207 2024-06-02T05:06:01.863 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 12207_fsm 2024-06-02T05:06:01.863 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 12207_vm 2024-06-02T05:06:01.863 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 12209 2024-06-02T05:06:01.864 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 12211 2024-06-02T05:06:01.864 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 12212 2024-06-02T05:06:01.864 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 12214 2024-06-02T05:06:01.864 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 12216 2024-06-02T05:06:01.864 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 73728 Jun 2 04:49 1247 2024-06-02T05:06:01.864 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 1247_fsm 2024-06-02T05:06:01.864 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 1247_vm 2024-06-02T05:06:01.864 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 393216 Jun 2 04:49 1249 2024-06-02T05:06:01.864 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 1249_fsm 2024-06-02T05:06:01.864 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 1249_vm 2024-06-02T05:06:01.864 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 606208 Jun 2 04:49 1255 2024-06-02T05:06:01.864 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 1255_fsm 2024-06-02T05:06:01.864 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 1255_vm 2024-06-02T05:06:01.865 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Jun 2 04:49 1259 2024-06-02T05:06:01.865 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 1259_fsm 2024-06-02T05:06:01.865 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 1259_vm 2024-06-02T05:06:01.865 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 1417 2024-06-02T05:06:01.865 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 1417_vm 2024-06-02T05:06:01.865 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 1418 2024-06-02T05:06:01.865 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 1418_vm 2024-06-02T05:06:01.865 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 174 2024-06-02T05:06:01.865 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 175 2024-06-02T05:06:01.865 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2187 2024-06-02T05:06:01.865 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2224 2024-06-02T05:06:01.865 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2224_vm 2024-06-02T05:06:01.865 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2328 2024-06-02T05:06:01.865 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2328_vm 2024-06-02T05:06:01.866 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2336 2024-06-02T05:06:01.866 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2336_vm 2024-06-02T05:06:01.866 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2337 2024-06-02T05:06:01.866 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2600 2024-06-02T05:06:01.866 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2600_fsm 2024-06-02T05:06:01.866 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2600_vm 2024-06-02T05:06:01.866 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2601 2024-06-02T05:06:01.866 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2601_fsm 2024-06-02T05:06:01.866 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2601_vm 2024-06-02T05:06:01.866 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Jun 2 04:49 2602 2024-06-02T05:06:01.866 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2602_fsm 2024-06-02T05:06:01.866 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2602_vm 2024-06-02T05:06:01.867 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 04:49 2603 2024-06-02T05:06:01.867 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2603_fsm 2024-06-02T05:06:01.867 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2603_vm 2024-06-02T05:06:01.867 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2604 2024-06-02T05:06:01.867 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2604_vm 2024-06-02T05:06:01.867 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2605 2024-06-02T05:06:01.867 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2605_fsm 2024-06-02T05:06:01.867 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2605_vm 2024-06-02T05:06:01.867 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2606 2024-06-02T05:06:01.867 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2606_fsm 2024-06-02T05:06:01.867 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2606_vm 2024-06-02T05:06:01.867 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2607 2024-06-02T05:06:01.867 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2607_fsm 2024-06-02T05:06:01.868 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2607_vm 2024-06-02T05:06:01.868 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 442368 Jun 2 04:49 2608 2024-06-02T05:06:01.868 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2608_fsm 2024-06-02T05:06:01.868 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2608_vm 2024-06-02T05:06:01.868 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 286720 Jun 2 04:49 2609 2024-06-02T05:06:01.868 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2609_fsm 2024-06-02T05:06:01.868 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2609_vm 2024-06-02T05:06:01.868 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2610 2024-06-02T05:06:01.868 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2610_fsm 2024-06-02T05:06:01.868 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2610_vm 2024-06-02T05:06:01.868 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2611 2024-06-02T05:06:01.868 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2611_vm 2024-06-02T05:06:01.868 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2612 2024-06-02T05:06:01.869 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2612_fsm 2024-06-02T05:06:01.869 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2612_vm 2024-06-02T05:06:01.869 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2613 2024-06-02T05:06:01.869 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2613_vm 2024-06-02T05:06:01.869 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2615 2024-06-02T05:06:01.869 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2615_fsm 2024-06-02T05:06:01.869 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2615_vm 2024-06-02T05:06:01.869 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2616 2024-06-02T05:06:01.869 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2616_fsm 2024-06-02T05:06:01.869 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2616_vm 2024-06-02T05:06:01.869 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Jun 2 04:49 2617 2024-06-02T05:06:01.869 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2617_fsm 2024-06-02T05:06:01.869 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2617_vm 2024-06-02T05:06:01.869 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Jun 2 04:49 2618 2024-06-02T05:06:01.870 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2618_fsm 2024-06-02T05:06:01.870 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2618_vm 2024-06-02T05:06:01.870 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 131072 Jun 2 04:49 2619 2024-06-02T05:06:01.870 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2619_fsm 2024-06-02T05:06:01.870 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2619_vm 2024-06-02T05:06:01.870 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2620 2024-06-02T05:06:01.870 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2620_vm 2024-06-02T05:06:01.870 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2650 2024-06-02T05:06:01.870 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2651 2024-06-02T05:06:01.870 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2652 2024-06-02T05:06:01.870 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jun 2 04:49 2653 2024-06-02T05:06:01.870 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jun 2 04:49 2654 2024-06-02T05:06:01.870 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 04:49 2655 2024-06-02T05:06:01.871 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2656 2024-06-02T05:06:01.871 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2657 2024-06-02T05:06:01.871 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Jun 2 04:49 2658 2024-06-02T05:06:01.871 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Jun 2 04:49 2659 2024-06-02T05:06:01.871 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2660 2024-06-02T05:06:01.871 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2661 2024-06-02T05:06:01.871 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 04:49 2662 2024-06-02T05:06:01.871 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Jun 2 04:49 2663 2024-06-02T05:06:01.871 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2664 2024-06-02T05:06:01.871 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2665 2024-06-02T05:06:01.871 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2666 2024-06-02T05:06:01.871 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2667 2024-06-02T05:06:01.871 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2668 2024-06-02T05:06:01.871 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2669 2024-06-02T05:06:01.872 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2670 2024-06-02T05:06:01.872 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 327680 Jun 2 04:49 2673 2024-06-02T05:06:01.872 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 385024 Jun 2 04:49 2674 2024-06-02T05:06:01.872 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 180224 Jun 2 04:49 2675 2024-06-02T05:06:01.872 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2678 2024-06-02T05:06:01.872 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2679 2024-06-02T05:06:01.872 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2680 2024-06-02T05:06:01.872 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2681 2024-06-02T05:06:01.872 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2682 2024-06-02T05:06:01.872 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2683 2024-06-02T05:06:01.872 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2684 2024-06-02T05:06:01.872 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2685 2024-06-02T05:06:01.872 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2686 2024-06-02T05:06:01.872 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2687 2024-06-02T05:06:01.873 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jun 2 04:49 2688 2024-06-02T05:06:01.873 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Jun 2 04:49 2689 2024-06-02T05:06:01.873 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Jun 2 04:49 2690 2024-06-02T05:06:01.873 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 270336 Jun 2 04:49 2691 2024-06-02T05:06:01.873 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2692 2024-06-02T05:06:01.873 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2693 2024-06-02T05:06:01.873 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2696 2024-06-02T05:06:01.873 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2699 2024-06-02T05:06:01.873 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2701 2024-06-02T05:06:01.873 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2702 2024-06-02T05:06:01.873 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2703 2024-06-02T05:06:01.873 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jun 2 04:49 2704 2024-06-02T05:06:01.873 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2753 2024-06-02T05:06:01.873 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2753_fsm 2024-06-02T05:06:01.874 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2753_vm 2024-06-02T05:06:01.874 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2754 2024-06-02T05:06:01.874 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2755 2024-06-02T05:06:01.874 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 04:49 2756 2024-06-02T05:06:01.874 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 04:49 2757 2024-06-02T05:06:01.874 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2830 2024-06-02T05:06:01.874 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2830_vm 2024-06-02T05:06:01.874 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2831 2024-06-02T05:06:01.874 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2832 2024-06-02T05:06:01.874 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2832_vm 2024-06-02T05:06:01.874 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2833 2024-06-02T05:06:01.874 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2834 2024-06-02T05:06:01.874 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2834_vm 2024-06-02T05:06:01.875 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2835 2024-06-02T05:06:01.875 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2836 2024-06-02T05:06:01.875 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2836_vm 2024-06-02T05:06:01.875 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2837 2024-06-02T05:06:01.875 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 417792 Jun 2 04:49 2838 2024-06-02T05:06:01.875 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2838_fsm 2024-06-02T05:06:01.875 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2838_vm 2024-06-02T05:06:01.875 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2839 2024-06-02T05:06:01.875 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2840 2024-06-02T05:06:01.875 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2840_fsm 2024-06-02T05:06:01.875 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2840_vm 2024-06-02T05:06:01.875 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2841 2024-06-02T05:06:01.875 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2995 2024-06-02T05:06:01.875 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2995_vm 2024-06-02T05:06:01.876 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2996 2024-06-02T05:06:01.876 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3079 2024-06-02T05:06:01.876 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 3079_fsm 2024-06-02T05:06:01.876 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3079_vm 2024-06-02T05:06:01.876 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 3080 2024-06-02T05:06:01.876 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 3081 2024-06-02T05:06:01.876 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 3085 2024-06-02T05:06:01.876 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3118 2024-06-02T05:06:01.876 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3118_vm 2024-06-02T05:06:01.876 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3119 2024-06-02T05:06:01.876 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 3164 2024-06-02T05:06:01.876 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3256 2024-06-02T05:06:01.876 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3256_vm 2024-06-02T05:06:01.877 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3257 2024-06-02T05:06:01.877 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3258 2024-06-02T05:06:01.877 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3350 2024-06-02T05:06:01.877 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3350_vm 2024-06-02T05:06:01.877 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3351 2024-06-02T05:06:01.877 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3379 2024-06-02T05:06:01.877 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3380 2024-06-02T05:06:01.877 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3381 2024-06-02T05:06:01.877 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3381_vm 2024-06-02T05:06:01.877 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 3394 2024-06-02T05:06:01.877 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 3394_fsm 2024-06-02T05:06:01.877 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3394_vm 2024-06-02T05:06:01.877 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 3395 2024-06-02T05:06:01.877 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3439 2024-06-02T05:06:01.878 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3439_vm 2024-06-02T05:06:01.878 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3440 2024-06-02T05:06:01.878 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jun 2 04:49 3455 2024-06-02T05:06:01.878 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 3456 2024-06-02T05:06:01.878 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 3456_fsm 2024-06-02T05:06:01.878 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3456_vm 2024-06-02T05:06:01.878 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3466 2024-06-02T05:06:01.878 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3466_vm 2024-06-02T05:06:01.878 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3467 2024-06-02T05:06:01.878 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3468 2024-06-02T05:06:01.878 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3501 2024-06-02T05:06:01.878 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3501_vm 2024-06-02T05:06:01.878 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3502 2024-06-02T05:06:01.879 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3503 2024-06-02T05:06:01.879 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3534 2024-06-02T05:06:01.879 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3541 2024-06-02T05:06:01.879 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 3541_fsm 2024-06-02T05:06:01.879 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3541_vm 2024-06-02T05:06:01.879 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 3542 2024-06-02T05:06:01.879 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3574 2024-06-02T05:06:01.879 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3575 2024-06-02T05:06:01.879 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3576 2024-06-02T05:06:01.879 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3576_vm 2024-06-02T05:06:01.879 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3596 2024-06-02T05:06:01.879 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3596_vm 2024-06-02T05:06:01.879 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3597 2024-06-02T05:06:01.880 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3598 2024-06-02T05:06:01.880 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3598_vm 2024-06-02T05:06:01.880 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3599 2024-06-02T05:06:01.880 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3600 2024-06-02T05:06:01.880 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 3600_fsm 2024-06-02T05:06:01.880 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3600_vm 2024-06-02T05:06:01.880 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3601 2024-06-02T05:06:01.880 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 3601_fsm 2024-06-02T05:06:01.880 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3601_vm 2024-06-02T05:06:01.880 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3602 2024-06-02T05:06:01.880 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 3602_fsm 2024-06-02T05:06:01.880 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3602_vm 2024-06-02T05:06:01.880 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 3603 2024-06-02T05:06:01.880 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 3603_fsm 2024-06-02T05:06:01.881 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3603_vm 2024-06-02T05:06:01.881 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 3604 2024-06-02T05:06:01.881 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 3605 2024-06-02T05:06:01.881 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 3606 2024-06-02T05:06:01.881 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 3607 2024-06-02T05:06:01.881 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 3608 2024-06-02T05:06:01.881 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 04:49 3609 2024-06-02T05:06:01.881 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 3712 2024-06-02T05:06:01.881 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3764 2024-06-02T05:06:01.881 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 3764_fsm 2024-06-02T05:06:01.881 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3764_vm 2024-06-02T05:06:01.881 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 3766 2024-06-02T05:06:01.881 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 3767 2024-06-02T05:06:01.881 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3997 2024-06-02T05:06:01.882 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 5002 2024-06-02T05:06:01.882 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 548 2024-06-02T05:06:01.882 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 549 2024-06-02T05:06:01.882 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 6102 2024-06-02T05:06:01.882 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 6102_vm 2024-06-02T05:06:01.882 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 6104 2024-06-02T05:06:01.882 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 6104_vm 2024-06-02T05:06:01.882 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 6106 2024-06-02T05:06:01.882 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 6106_vm 2024-06-02T05:06:01.882 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 6110 2024-06-02T05:06:01.882 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 6111 2024-06-02T05:06:01.882 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 6112 2024-06-02T05:06:01.882 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 6113 2024-06-02T05:06:01.883 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 6117 2024-06-02T05:06:01.883 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 826 2024-06-02T05:06:01.883 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 826_vm 2024-06-02T05:06:01.883 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 827 2024-06-02T05:06:01.883 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 828 2024-06-02T05:06:01.883 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Jun 2 04:49 pg_filenode.map 2024-06-02T05:06:02.135 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Jun 2 04:49 PG_VERSION 2024-06-02T05:06:02.135 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T05:06:02.135 INFO:teuthology.orchestra.run.smithi076.stdout:/tmp/cephfs/postgres/data/base/12346: 2024-06-02T05:06:02.135 INFO:teuthology.orchestra.run.smithi076.stdout:total 7210 2024-06-02T05:06:02.135 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7381507 Jun 2 04:49 . 2024-06-02T05:06:02.135 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 638042253 Jun 2 04:50 .. 2024-06-02T05:06:02.135 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 112 2024-06-02T05:06:02.135 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 113 2024-06-02T05:06:02.135 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Jun 2 04:49 12182 2024-06-02T05:06:02.135 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 12182_fsm 2024-06-02T05:06:02.136 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 12182_vm 2024-06-02T05:06:02.136 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 12184 2024-06-02T05:06:02.136 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 12186 2024-06-02T05:06:02.136 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 12187 2024-06-02T05:06:02.136 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 12187_fsm 2024-06-02T05:06:02.136 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 12187_vm 2024-06-02T05:06:02.136 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 12189 2024-06-02T05:06:02.136 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 12191 2024-06-02T05:06:02.136 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 12192 2024-06-02T05:06:02.136 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 12192_fsm 2024-06-02T05:06:02.136 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 12192_vm 2024-06-02T05:06:02.136 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 12194 2024-06-02T05:06:02.137 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 12196 2024-06-02T05:06:02.137 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 12197 2024-06-02T05:06:02.137 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 12197_fsm 2024-06-02T05:06:02.137 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 12197_vm 2024-06-02T05:06:02.137 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 12199 2024-06-02T05:06:02.137 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 12201 2024-06-02T05:06:02.137 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 12202 2024-06-02T05:06:02.137 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 12202_fsm 2024-06-02T05:06:02.137 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 12202_vm 2024-06-02T05:06:02.137 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 12204 2024-06-02T05:06:02.137 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 12206 2024-06-02T05:06:02.137 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 12207 2024-06-02T05:06:02.137 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 12207_fsm 2024-06-02T05:06:02.138 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 12207_vm 2024-06-02T05:06:02.138 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 12209 2024-06-02T05:06:02.138 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 12211 2024-06-02T05:06:02.138 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 12212 2024-06-02T05:06:02.138 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 12214 2024-06-02T05:06:02.138 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 12216 2024-06-02T05:06:02.138 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 73728 Jun 2 04:49 1247 2024-06-02T05:06:02.138 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 1247_fsm 2024-06-02T05:06:02.138 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 1247_vm 2024-06-02T05:06:02.138 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 393216 Jun 2 04:49 1249 2024-06-02T05:06:02.138 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 1249_fsm 2024-06-02T05:06:02.138 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 1249_vm 2024-06-02T05:06:02.138 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 606208 Jun 2 04:49 1255 2024-06-02T05:06:02.139 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 1255_fsm 2024-06-02T05:06:02.139 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 1255_vm 2024-06-02T05:06:02.139 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Jun 2 04:49 1259 2024-06-02T05:06:02.139 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 1259_fsm 2024-06-02T05:06:02.139 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 1259_vm 2024-06-02T05:06:02.139 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 1417 2024-06-02T05:06:02.139 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 1417_vm 2024-06-02T05:06:02.139 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 1418 2024-06-02T05:06:02.139 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 1418_vm 2024-06-02T05:06:02.139 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 174 2024-06-02T05:06:02.139 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 175 2024-06-02T05:06:02.139 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2187 2024-06-02T05:06:02.140 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2224 2024-06-02T05:06:02.140 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2224_vm 2024-06-02T05:06:02.140 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2328 2024-06-02T05:06:02.140 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2328_vm 2024-06-02T05:06:02.140 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2336 2024-06-02T05:06:02.140 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2336_vm 2024-06-02T05:06:02.140 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2337 2024-06-02T05:06:02.140 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2600 2024-06-02T05:06:02.140 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2600_fsm 2024-06-02T05:06:02.141 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2600_vm 2024-06-02T05:06:02.141 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2601 2024-06-02T05:06:02.141 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2601_fsm 2024-06-02T05:06:02.141 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2601_vm 2024-06-02T05:06:02.141 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Jun 2 04:49 2602 2024-06-02T05:06:02.141 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2602_fsm 2024-06-02T05:06:02.141 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2602_vm 2024-06-02T05:06:02.141 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 04:49 2603 2024-06-02T05:06:02.141 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2603_fsm 2024-06-02T05:06:02.141 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2603_vm 2024-06-02T05:06:02.141 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2604 2024-06-02T05:06:02.141 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2604_vm 2024-06-02T05:06:02.141 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2605 2024-06-02T05:06:02.142 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2605_fsm 2024-06-02T05:06:02.142 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2605_vm 2024-06-02T05:06:02.142 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2606 2024-06-02T05:06:02.142 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2606_fsm 2024-06-02T05:06:02.142 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2606_vm 2024-06-02T05:06:02.142 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2607 2024-06-02T05:06:02.142 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2607_fsm 2024-06-02T05:06:02.142 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2607_vm 2024-06-02T05:06:02.142 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 442368 Jun 2 04:49 2608 2024-06-02T05:06:02.142 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2608_fsm 2024-06-02T05:06:02.142 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2608_vm 2024-06-02T05:06:02.143 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 286720 Jun 2 04:49 2609 2024-06-02T05:06:02.143 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2609_fsm 2024-06-02T05:06:02.143 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2609_vm 2024-06-02T05:06:02.143 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2610 2024-06-02T05:06:02.143 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2610_fsm 2024-06-02T05:06:02.143 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2610_vm 2024-06-02T05:06:02.143 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2611 2024-06-02T05:06:02.143 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2611_vm 2024-06-02T05:06:02.143 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2612 2024-06-02T05:06:02.143 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2612_fsm 2024-06-02T05:06:02.143 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2612_vm 2024-06-02T05:06:02.144 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2613 2024-06-02T05:06:02.144 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2613_vm 2024-06-02T05:06:02.144 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2615 2024-06-02T05:06:02.144 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2615_fsm 2024-06-02T05:06:02.144 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2615_vm 2024-06-02T05:06:02.144 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2616 2024-06-02T05:06:02.144 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2616_fsm 2024-06-02T05:06:02.144 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2616_vm 2024-06-02T05:06:02.144 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Jun 2 04:49 2617 2024-06-02T05:06:02.144 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2617_fsm 2024-06-02T05:06:02.144 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2617_vm 2024-06-02T05:06:02.144 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Jun 2 04:49 2618 2024-06-02T05:06:02.145 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2618_fsm 2024-06-02T05:06:02.145 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2618_vm 2024-06-02T05:06:02.145 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 131072 Jun 2 04:49 2619 2024-06-02T05:06:02.145 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2619_fsm 2024-06-02T05:06:02.145 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2619_vm 2024-06-02T05:06:02.145 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2620 2024-06-02T05:06:02.145 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2620_vm 2024-06-02T05:06:02.145 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2650 2024-06-02T05:06:02.145 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2651 2024-06-02T05:06:02.146 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2652 2024-06-02T05:06:02.146 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jun 2 04:49 2653 2024-06-02T05:06:02.146 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jun 2 04:49 2654 2024-06-02T05:06:02.146 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 04:49 2655 2024-06-02T05:06:02.146 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2656 2024-06-02T05:06:02.146 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2657 2024-06-02T05:06:02.146 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Jun 2 04:49 2658 2024-06-02T05:06:02.146 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Jun 2 04:49 2659 2024-06-02T05:06:02.146 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2660 2024-06-02T05:06:02.146 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2661 2024-06-02T05:06:02.146 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 04:49 2662 2024-06-02T05:06:02.147 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Jun 2 04:49 2663 2024-06-02T05:06:02.147 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2664 2024-06-02T05:06:02.147 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2665 2024-06-02T05:06:02.147 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2666 2024-06-02T05:06:02.147 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2667 2024-06-02T05:06:02.147 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2668 2024-06-02T05:06:02.147 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2669 2024-06-02T05:06:02.147 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2670 2024-06-02T05:06:02.147 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 327680 Jun 2 04:49 2673 2024-06-02T05:06:02.147 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 385024 Jun 2 04:49 2674 2024-06-02T05:06:02.148 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 180224 Jun 2 04:49 2675 2024-06-02T05:06:02.148 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2678 2024-06-02T05:06:02.148 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2679 2024-06-02T05:06:02.148 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2680 2024-06-02T05:06:02.148 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2681 2024-06-02T05:06:02.148 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2682 2024-06-02T05:06:02.148 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2683 2024-06-02T05:06:02.148 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2684 2024-06-02T05:06:02.148 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2685 2024-06-02T05:06:02.148 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2686 2024-06-02T05:06:02.148 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2687 2024-06-02T05:06:02.149 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jun 2 04:49 2688 2024-06-02T05:06:02.149 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Jun 2 04:49 2689 2024-06-02T05:06:02.149 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Jun 2 04:49 2690 2024-06-02T05:06:02.149 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 270336 Jun 2 04:49 2691 2024-06-02T05:06:02.149 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2692 2024-06-02T05:06:02.149 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2693 2024-06-02T05:06:02.149 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2696 2024-06-02T05:06:02.149 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2699 2024-06-02T05:06:02.149 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2701 2024-06-02T05:06:02.150 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2702 2024-06-02T05:06:02.150 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2703 2024-06-02T05:06:02.150 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jun 2 04:49 2704 2024-06-02T05:06:02.150 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2753 2024-06-02T05:06:02.150 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2753_fsm 2024-06-02T05:06:02.150 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2753_vm 2024-06-02T05:06:02.150 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2754 2024-06-02T05:06:02.150 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2755 2024-06-02T05:06:02.150 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 04:49 2756 2024-06-02T05:06:02.150 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 04:49 2757 2024-06-02T05:06:02.151 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2830 2024-06-02T05:06:02.151 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2830_vm 2024-06-02T05:06:02.151 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2831 2024-06-02T05:06:02.151 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2832 2024-06-02T05:06:02.151 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2832_vm 2024-06-02T05:06:02.151 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2833 2024-06-02T05:06:02.151 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2834 2024-06-02T05:06:02.151 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2834_vm 2024-06-02T05:06:02.152 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2835 2024-06-02T05:06:02.152 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2836 2024-06-02T05:06:02.152 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2836_vm 2024-06-02T05:06:02.152 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2837 2024-06-02T05:06:02.152 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 417792 Jun 2 04:49 2838 2024-06-02T05:06:02.152 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2838_fsm 2024-06-02T05:06:02.152 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2838_vm 2024-06-02T05:06:02.152 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2839 2024-06-02T05:06:02.152 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2840 2024-06-02T05:06:02.153 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2840_fsm 2024-06-02T05:06:02.153 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2840_vm 2024-06-02T05:06:02.153 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2841 2024-06-02T05:06:02.153 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2995 2024-06-02T05:06:02.153 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2995_vm 2024-06-02T05:06:02.153 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2996 2024-06-02T05:06:02.153 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3079 2024-06-02T05:06:02.153 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 3079_fsm 2024-06-02T05:06:02.153 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3079_vm 2024-06-02T05:06:02.153 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 3080 2024-06-02T05:06:02.153 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 3081 2024-06-02T05:06:02.153 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 3085 2024-06-02T05:06:02.153 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3118 2024-06-02T05:06:02.154 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3118_vm 2024-06-02T05:06:02.154 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3119 2024-06-02T05:06:02.154 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 3164 2024-06-02T05:06:02.154 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3256 2024-06-02T05:06:02.154 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3256_vm 2024-06-02T05:06:02.154 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3257 2024-06-02T05:06:02.154 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3258 2024-06-02T05:06:02.154 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3350 2024-06-02T05:06:02.154 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3350_vm 2024-06-02T05:06:02.154 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3351 2024-06-02T05:06:02.154 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3379 2024-06-02T05:06:02.154 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3380 2024-06-02T05:06:02.154 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3381 2024-06-02T05:06:02.155 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3381_vm 2024-06-02T05:06:02.155 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 3394 2024-06-02T05:06:02.155 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 3394_fsm 2024-06-02T05:06:02.155 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3394_vm 2024-06-02T05:06:02.155 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 3395 2024-06-02T05:06:02.155 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3439 2024-06-02T05:06:02.155 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3439_vm 2024-06-02T05:06:02.155 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3440 2024-06-02T05:06:02.155 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jun 2 04:49 3455 2024-06-02T05:06:02.155 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 3456 2024-06-02T05:06:02.155 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 3456_fsm 2024-06-02T05:06:02.155 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3456_vm 2024-06-02T05:06:02.156 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3466 2024-06-02T05:06:02.156 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3466_vm 2024-06-02T05:06:02.156 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3467 2024-06-02T05:06:02.156 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3468 2024-06-02T05:06:02.156 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3501 2024-06-02T05:06:02.156 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3501_vm 2024-06-02T05:06:02.156 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3502 2024-06-02T05:06:02.156 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3503 2024-06-02T05:06:02.156 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3534 2024-06-02T05:06:02.156 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3541 2024-06-02T05:06:02.156 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 3541_fsm 2024-06-02T05:06:02.156 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3541_vm 2024-06-02T05:06:02.156 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 3542 2024-06-02T05:06:02.157 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3574 2024-06-02T05:06:02.157 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3575 2024-06-02T05:06:02.157 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3576 2024-06-02T05:06:02.157 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3576_vm 2024-06-02T05:06:02.157 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3596 2024-06-02T05:06:02.157 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3596_vm 2024-06-02T05:06:02.157 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3597 2024-06-02T05:06:02.157 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3598 2024-06-02T05:06:02.157 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3598_vm 2024-06-02T05:06:02.157 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3599 2024-06-02T05:06:02.157 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3600 2024-06-02T05:06:02.157 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 3600_fsm 2024-06-02T05:06:02.157 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3600_vm 2024-06-02T05:06:02.158 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3601 2024-06-02T05:06:02.158 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 3601_fsm 2024-06-02T05:06:02.158 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3601_vm 2024-06-02T05:06:02.158 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3602 2024-06-02T05:06:02.158 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 3602_fsm 2024-06-02T05:06:02.158 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3602_vm 2024-06-02T05:06:02.158 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 3603 2024-06-02T05:06:02.158 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 3603_fsm 2024-06-02T05:06:02.158 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3603_vm 2024-06-02T05:06:02.158 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 3604 2024-06-02T05:06:02.158 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 3605 2024-06-02T05:06:02.159 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 3606 2024-06-02T05:06:02.159 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 3607 2024-06-02T05:06:02.159 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 3608 2024-06-02T05:06:02.159 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 04:49 3609 2024-06-02T05:06:02.159 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 3712 2024-06-02T05:06:02.159 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3764 2024-06-02T05:06:02.159 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 3764_fsm 2024-06-02T05:06:02.159 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3764_vm 2024-06-02T05:06:02.159 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 3766 2024-06-02T05:06:02.159 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 3767 2024-06-02T05:06:02.159 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3997 2024-06-02T05:06:02.159 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 5002 2024-06-02T05:06:02.159 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 548 2024-06-02T05:06:02.159 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 549 2024-06-02T05:06:02.160 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 6102 2024-06-02T05:06:02.160 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 6102_vm 2024-06-02T05:06:02.160 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 6104 2024-06-02T05:06:02.160 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 6104_vm 2024-06-02T05:06:02.160 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 6106 2024-06-02T05:06:02.160 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 6106_vm 2024-06-02T05:06:02.160 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 6110 2024-06-02T05:06:02.160 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 6111 2024-06-02T05:06:02.160 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 6112 2024-06-02T05:06:02.160 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 6113 2024-06-02T05:06:02.160 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 6117 2024-06-02T05:06:02.160 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 826 2024-06-02T05:06:02.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:06:01 smithi192 ceph-mon[47933]: pgmap v761: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 10 MiB/s wr, 992 op/s 2024-06-02T05:06:02.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:06:01 smithi076 ceph-mon[42935]: pgmap v761: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 10 MiB/s wr, 992 op/s 2024-06-02T05:06:02.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:06:01 smithi119 ceph-mon[46633]: pgmap v761: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 10 MiB/s wr, 992 op/s 2024-06-02T05:06:02.430 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 826_vm 2024-06-02T05:06:02.430 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 827 2024-06-02T05:06:02.430 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 828 2024-06-02T05:06:02.430 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Jun 2 04:49 pg_filenode.map 2024-06-02T05:06:02.430 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Jun 2 04:49 PG_VERSION 2024-06-02T05:06:02.430 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T05:06:02.430 INFO:teuthology.orchestra.run.smithi076.stdout:/tmp/cephfs/postgres/data/base/12347: 2024-06-02T05:06:02.430 INFO:teuthology.orchestra.run.smithi076.stdout:total 609681 2024-06-02T05:06:02.430 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 623279239 Jun 2 04:51 . 2024-06-02T05:06:02.430 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 638042253 Jun 2 04:50 .. 2024-06-02T05:06:02.430 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 112 2024-06-02T05:06:02.431 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 113 2024-06-02T05:06:02.431 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Jun 2 04:49 12182 2024-06-02T05:06:02.431 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 12182_fsm 2024-06-02T05:06:02.431 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 12182_vm 2024-06-02T05:06:02.431 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 12184 2024-06-02T05:06:02.431 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 12186 2024-06-02T05:06:02.431 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 12187 2024-06-02T05:06:02.431 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 12187_fsm 2024-06-02T05:06:02.431 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 12187_vm 2024-06-02T05:06:02.431 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 12189 2024-06-02T05:06:02.431 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 12191 2024-06-02T05:06:02.431 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 12192 2024-06-02T05:06:02.431 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 12192_fsm 2024-06-02T05:06:02.432 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 12192_vm 2024-06-02T05:06:02.432 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 12194 2024-06-02T05:06:02.432 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 12196 2024-06-02T05:06:02.432 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 12197 2024-06-02T05:06:02.432 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 12197_fsm 2024-06-02T05:06:02.432 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 12197_vm 2024-06-02T05:06:02.432 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 12199 2024-06-02T05:06:02.432 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 12201 2024-06-02T05:06:02.432 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 12202 2024-06-02T05:06:02.432 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 12202_fsm 2024-06-02T05:06:02.432 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 12202_vm 2024-06-02T05:06:02.432 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 12204 2024-06-02T05:06:02.432 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 12206 2024-06-02T05:06:02.433 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 12207 2024-06-02T05:06:02.433 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 12207_fsm 2024-06-02T05:06:02.433 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 12207_vm 2024-06-02T05:06:02.433 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 12209 2024-06-02T05:06:02.433 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 12211 2024-06-02T05:06:02.433 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 12212 2024-06-02T05:06:02.433 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 12214 2024-06-02T05:06:02.433 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 12216 2024-06-02T05:06:02.433 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 73728 Jun 2 04:50 1247 2024-06-02T05:06:02.433 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:50 1247_fsm 2024-06-02T05:06:02.433 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:50 1247_vm 2024-06-02T05:06:02.433 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 393216 Jun 2 04:50 1249 2024-06-02T05:06:02.433 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:50 1249_fsm 2024-06-02T05:06:02.433 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:50 1249_vm 2024-06-02T05:06:02.434 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 606208 Jun 2 04:49 1255 2024-06-02T05:06:02.434 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 1255_fsm 2024-06-02T05:06:02.434 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 1255_vm 2024-06-02T05:06:02.434 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Jun 2 05:05 1259 2024-06-02T05:06:02.434 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 1259_fsm 2024-06-02T05:06:02.434 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:50 1259_vm 2024-06-02T05:06:02.434 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 1417 2024-06-02T05:06:02.434 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 1417_vm 2024-06-02T05:06:02.434 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 1418 2024-06-02T05:06:02.434 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 1418_vm 2024-06-02T05:06:02.434 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 14721024 Jun 2 05:05 16387 2024-06-02T05:06:02.434 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 05:05 16387_fsm 2024-06-02T05:06:02.434 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 05:05 16387_vm 2024-06-02T05:06:02.435 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 13287424 Jun 2 05:05 16393 2024-06-02T05:06:02.435 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 05:05 16393_fsm 2024-06-02T05:06:02.435 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 05:05 16393_vm 2024-06-02T05:06:02.435 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 473513984 Jun 2 05:05 16396 2024-06-02T05:06:02.435 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 139264 Jun 2 05:05 16396_fsm 2024-06-02T05:06:02.435 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 05:02 16396_vm 2024-06-02T05:06:02.435 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Jun 2 05:05 16397 2024-06-02T05:06:02.435 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 581632 Jun 2 05:05 16399 2024-06-02T05:06:02.435 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 78954496 Jun 2 05:05 16401 2024-06-02T05:06:02.435 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 35299328 Jun 2 05:05 16403 2024-06-02T05:06:02.435 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 05:05 16403_fsm 2024-06-02T05:06:02.435 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 174 2024-06-02T05:06:02.435 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 175 2024-06-02T05:06:02.436 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2187 2024-06-02T05:06:02.436 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2224 2024-06-02T05:06:02.436 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2224_vm 2024-06-02T05:06:02.436 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2328 2024-06-02T05:06:02.436 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2328_vm 2024-06-02T05:06:02.436 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2336 2024-06-02T05:06:02.436 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2336_vm 2024-06-02T05:06:02.436 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2337 2024-06-02T05:06:02.436 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2600 2024-06-02T05:06:02.436 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2600_fsm 2024-06-02T05:06:02.436 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2600_vm 2024-06-02T05:06:02.436 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2601 2024-06-02T05:06:02.436 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2601_fsm 2024-06-02T05:06:02.437 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2601_vm 2024-06-02T05:06:02.437 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Jun 2 04:49 2602 2024-06-02T05:06:02.437 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2602_fsm 2024-06-02T05:06:02.437 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2602_vm 2024-06-02T05:06:02.437 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 04:49 2603 2024-06-02T05:06:02.437 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2603_fsm 2024-06-02T05:06:02.437 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2603_vm 2024-06-02T05:06:02.437 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2604 2024-06-02T05:06:02.437 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2604_vm 2024-06-02T05:06:02.437 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2605 2024-06-02T05:06:02.437 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2605_fsm 2024-06-02T05:06:02.437 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2605_vm 2024-06-02T05:06:02.437 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:50 2606 2024-06-02T05:06:02.437 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2606_fsm 2024-06-02T05:06:02.438 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:50 2606_vm 2024-06-02T05:06:02.438 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2607 2024-06-02T05:06:02.438 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2607_fsm 2024-06-02T05:06:02.438 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2607_vm 2024-06-02T05:06:02.438 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 450560 Jun 2 04:50 2608 2024-06-02T05:06:02.438 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:50 2608_fsm 2024-06-02T05:06:02.438 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:50 2608_vm 2024-06-02T05:06:02.438 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 286720 Jun 2 04:49 2609 2024-06-02T05:06:02.438 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2609_fsm 2024-06-02T05:06:02.438 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2609_vm 2024-06-02T05:06:02.438 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 04:50 2610 2024-06-02T05:06:02.438 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:50 2610_fsm 2024-06-02T05:06:02.438 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:50 2610_vm 2024-06-02T05:06:02.439 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2611 2024-06-02T05:06:02.439 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2611_vm 2024-06-02T05:06:02.439 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2612 2024-06-02T05:06:02.439 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2612_fsm 2024-06-02T05:06:02.439 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2612_vm 2024-06-02T05:06:02.439 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2613 2024-06-02T05:06:02.439 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2613_vm 2024-06-02T05:06:02.439 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2615 2024-06-02T05:06:02.439 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2615_fsm 2024-06-02T05:06:02.439 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2615_vm 2024-06-02T05:06:02.439 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2616 2024-06-02T05:06:02.439 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2616_fsm 2024-06-02T05:06:02.439 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2616_vm 2024-06-02T05:06:02.440 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Jun 2 04:49 2617 2024-06-02T05:06:02.440 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2617_fsm 2024-06-02T05:06:02.440 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2617_vm 2024-06-02T05:06:02.440 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Jun 2 04:49 2618 2024-06-02T05:06:02.440 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2618_fsm 2024-06-02T05:06:02.440 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2618_vm 2024-06-02T05:06:02.440 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 180224 Jun 2 05:05 2619 2024-06-02T05:06:02.440 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 05:04 2619_fsm 2024-06-02T05:06:02.440 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:50 2619_vm 2024-06-02T05:06:02.440 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2620 2024-06-02T05:06:02.440 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2620_vm 2024-06-02T05:06:02.440 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2650 2024-06-02T05:06:02.440 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2651 2024-06-02T05:06:02.440 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2652 2024-06-02T05:06:02.441 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jun 2 04:49 2653 2024-06-02T05:06:02.441 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jun 2 04:49 2654 2024-06-02T05:06:02.441 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 04:49 2655 2024-06-02T05:06:02.441 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2656 2024-06-02T05:06:02.441 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2657 2024-06-02T05:06:02.441 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Jun 2 04:50 2658 2024-06-02T05:06:02.441 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Jun 2 04:50 2659 2024-06-02T05:06:02.441 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2660 2024-06-02T05:06:02.441 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2661 2024-06-02T05:06:02.441 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 04:50 2662 2024-06-02T05:06:02.441 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Jun 2 04:50 2663 2024-06-02T05:06:02.441 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:50 2664 2024-06-02T05:06:02.441 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:50 2665 2024-06-02T05:06:02.442 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:50 2666 2024-06-02T05:06:02.442 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:50 2667 2024-06-02T05:06:02.442 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2668 2024-06-02T05:06:02.442 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2669 2024-06-02T05:06:02.442 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2670 2024-06-02T05:06:02.442 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 327680 Jun 2 04:50 2673 2024-06-02T05:06:02.442 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 385024 Jun 2 04:50 2674 2024-06-02T05:06:02.442 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 180224 Jun 2 04:49 2675 2024-06-02T05:06:02.442 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:50 2678 2024-06-02T05:06:02.442 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:50 2679 2024-06-02T05:06:02.442 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2680 2024-06-02T05:06:02.442 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2681 2024-06-02T05:06:02.442 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2682 2024-06-02T05:06:02.443 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2683 2024-06-02T05:06:02.443 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2684 2024-06-02T05:06:02.443 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2685 2024-06-02T05:06:02.443 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2686 2024-06-02T05:06:02.443 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2687 2024-06-02T05:06:02.443 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jun 2 04:49 2688 2024-06-02T05:06:02.443 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Jun 2 04:49 2689 2024-06-02T05:06:02.443 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Jun 2 04:49 2690 2024-06-02T05:06:02.443 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 270336 Jun 2 04:49 2691 2024-06-02T05:06:02.443 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2692 2024-06-02T05:06:02.443 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2693 2024-06-02T05:06:02.443 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 05:05 2696 2024-06-02T05:06:02.443 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2699 2024-06-02T05:06:02.443 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2701 2024-06-02T05:06:02.443 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2702 2024-06-02T05:06:02.444 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:50 2703 2024-06-02T05:06:02.444 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jun 2 04:50 2704 2024-06-02T05:06:02.444 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2753 2024-06-02T05:06:02.444 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2753_fsm 2024-06-02T05:06:02.444 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2753_vm 2024-06-02T05:06:02.444 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2754 2024-06-02T05:06:02.444 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2755 2024-06-02T05:06:02.444 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 04:49 2756 2024-06-02T05:06:02.444 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 04:49 2757 2024-06-02T05:06:02.444 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2830 2024-06-02T05:06:02.444 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2830_vm 2024-06-02T05:06:02.444 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2831 2024-06-02T05:06:02.444 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2832 2024-06-02T05:06:02.444 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2832_vm 2024-06-02T05:06:02.444 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2833 2024-06-02T05:06:02.445 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2834 2024-06-02T05:06:02.445 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2834_vm 2024-06-02T05:06:02.445 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2835 2024-06-02T05:06:02.445 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2836 2024-06-02T05:06:02.445 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2836_vm 2024-06-02T05:06:02.445 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2837 2024-06-02T05:06:02.445 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 417792 Jun 2 04:49 2838 2024-06-02T05:06:02.445 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2838_fsm 2024-06-02T05:06:02.445 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2838_vm 2024-06-02T05:06:02.445 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2839 2024-06-02T05:06:02.445 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2840 2024-06-02T05:06:02.445 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2840_fsm 2024-06-02T05:06:02.445 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2840_vm 2024-06-02T05:06:02.445 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2841 2024-06-02T05:06:02.446 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2995 2024-06-02T05:06:02.446 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2995_vm 2024-06-02T05:06:02.446 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2996 2024-06-02T05:06:02.446 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3079 2024-06-02T05:06:02.446 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 3079_fsm 2024-06-02T05:06:02.446 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3079_vm 2024-06-02T05:06:02.446 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 3080 2024-06-02T05:06:02.446 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 3081 2024-06-02T05:06:02.446 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 3085 2024-06-02T05:06:02.446 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3118 2024-06-02T05:06:02.446 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3118_vm 2024-06-02T05:06:02.446 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3119 2024-06-02T05:06:02.446 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 3164 2024-06-02T05:06:02.447 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3256 2024-06-02T05:06:02.447 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3256_vm 2024-06-02T05:06:02.447 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3257 2024-06-02T05:06:02.447 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3258 2024-06-02T05:06:02.447 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3350 2024-06-02T05:06:02.447 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3350_vm 2024-06-02T05:06:02.447 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3351 2024-06-02T05:06:02.447 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3379 2024-06-02T05:06:02.447 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3380 2024-06-02T05:06:02.447 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3381 2024-06-02T05:06:02.447 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3381_vm 2024-06-02T05:06:02.447 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 3394 2024-06-02T05:06:02.447 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 3394_fsm 2024-06-02T05:06:02.447 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3394_vm 2024-06-02T05:06:02.448 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 3395 2024-06-02T05:06:02.448 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3439 2024-06-02T05:06:02.448 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3439_vm 2024-06-02T05:06:02.448 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3440 2024-06-02T05:06:02.448 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jun 2 04:50 3455 2024-06-02T05:06:02.448 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 3456 2024-06-02T05:06:02.448 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 3456_fsm 2024-06-02T05:06:02.448 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3456_vm 2024-06-02T05:06:02.448 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3466 2024-06-02T05:06:02.448 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3466_vm 2024-06-02T05:06:02.448 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3467 2024-06-02T05:06:02.448 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3468 2024-06-02T05:06:02.448 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3501 2024-06-02T05:06:02.448 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3501_vm 2024-06-02T05:06:02.448 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3502 2024-06-02T05:06:02.449 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3503 2024-06-02T05:06:02.449 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3534 2024-06-02T05:06:02.449 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3541 2024-06-02T05:06:02.449 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 3541_fsm 2024-06-02T05:06:02.449 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3541_vm 2024-06-02T05:06:02.449 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 3542 2024-06-02T05:06:02.449 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3574 2024-06-02T05:06:02.449 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3575 2024-06-02T05:06:02.449 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3576 2024-06-02T05:06:02.449 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3576_vm 2024-06-02T05:06:02.449 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3596 2024-06-02T05:06:02.449 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3596_vm 2024-06-02T05:06:02.449 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3597 2024-06-02T05:06:02.450 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3598 2024-06-02T05:06:02.450 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3598_vm 2024-06-02T05:06:02.450 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3599 2024-06-02T05:06:02.450 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3600 2024-06-02T05:06:02.450 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 3600_fsm 2024-06-02T05:06:02.450 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3600_vm 2024-06-02T05:06:02.450 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3601 2024-06-02T05:06:02.450 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 3601_fsm 2024-06-02T05:06:02.450 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3601_vm 2024-06-02T05:06:02.450 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3602 2024-06-02T05:06:02.450 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 3602_fsm 2024-06-02T05:06:02.450 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3602_vm 2024-06-02T05:06:02.450 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 3603 2024-06-02T05:06:02.450 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 3603_fsm 2024-06-02T05:06:02.451 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3603_vm 2024-06-02T05:06:02.451 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 3604 2024-06-02T05:06:02.451 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 3605 2024-06-02T05:06:02.451 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 3606 2024-06-02T05:06:02.451 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 3607 2024-06-02T05:06:02.451 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 3608 2024-06-02T05:06:02.451 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 04:49 3609 2024-06-02T05:06:02.451 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 3712 2024-06-02T05:06:02.451 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3764 2024-06-02T05:06:02.451 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 3764_fsm 2024-06-02T05:06:02.481 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3764_vm 2024-06-02T05:06:02.481 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 3766 2024-06-02T05:06:02.481 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 3767 2024-06-02T05:06:02.481 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3997 2024-06-02T05:06:02.481 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 5002 2024-06-02T05:06:02.481 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 548 2024-06-02T05:06:02.481 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 549 2024-06-02T05:06:02.482 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 6102 2024-06-02T05:06:02.482 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 6102_vm 2024-06-02T05:06:02.482 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 6104 2024-06-02T05:06:02.482 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 6104_vm 2024-06-02T05:06:02.482 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 6106 2024-06-02T05:06:02.482 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 6106_vm 2024-06-02T05:06:02.482 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 6110 2024-06-02T05:06:02.482 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 6111 2024-06-02T05:06:02.482 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 6112 2024-06-02T05:06:02.482 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 6113 2024-06-02T05:06:02.482 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 6117 2024-06-02T05:06:02.483 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 826 2024-06-02T05:06:02.483 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 826_vm 2024-06-02T05:06:02.483 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 827 2024-06-02T05:06:02.483 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 828 2024-06-02T05:06:02.483 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Jun 2 04:49 pg_filenode.map 2024-06-02T05:06:02.483 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 137860 Jun 2 04:50 pg_internal.init 2024-06-02T05:06:02.483 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Jun 2 04:49 PG_VERSION 2024-06-02T05:06:02.483 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T05:06:02.483 INFO:teuthology.orchestra.run.smithi076.stdout:/tmp/cephfs/postgres/data/base/pgsql_tmp: 2024-06-02T05:06:02.483 INFO:teuthology.orchestra.run.smithi076.stdout:total 1 2024-06-02T05:06:02.483 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:50 . 2024-06-02T05:06:02.483 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 638042253 Jun 2 04:50 .. 2024-06-02T05:06:02.483 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T05:06:02.484 INFO:teuthology.orchestra.run.smithi076.stdout:/tmp/cephfs/postgres/data/global: 2024-06-02T05:06:02.484 INFO:teuthology.orchestra.run.smithi076.stdout:total 575 2024-06-02T05:06:02.484 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 587404 Jun 2 04:50 . 2024-06-02T05:06:02.484 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1695868587 Jun 2 05:06 .. 2024-06-02T05:06:02.484 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 1136 2024-06-02T05:06:02.484 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 1136_fsm 2024-06-02T05:06:02.484 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 1136_vm 2024-06-02T05:06:02.484 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 1137 2024-06-02T05:06:02.484 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 1213 2024-06-02T05:06:02.484 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 1213_fsm 2024-06-02T05:06:02.484 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 1213_vm 2024-06-02T05:06:02.484 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 1214 2024-06-02T05:06:02.484 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 1214_fsm 2024-06-02T05:06:02.485 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 1214_vm 2024-06-02T05:06:02.485 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 1232 2024-06-02T05:06:02.485 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 1233 2024-06-02T05:06:02.485 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 1260 2024-06-02T05:06:02.485 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 1260_fsm 2024-06-02T05:06:02.485 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 1260_vm 2024-06-02T05:06:02.485 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 1261 2024-06-02T05:06:02.485 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 1261_fsm 2024-06-02T05:06:02.485 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 1261_vm 2024-06-02T05:06:02.485 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 1262 2024-06-02T05:06:02.485 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 1262_fsm 2024-06-02T05:06:02.485 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 1262_vm 2024-06-02T05:06:02.485 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2396 2024-06-02T05:06:02.485 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:49 2396_fsm 2024-06-02T05:06:02.486 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2396_vm 2024-06-02T05:06:02.486 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2397 2024-06-02T05:06:02.486 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2671 2024-06-02T05:06:02.486 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2672 2024-06-02T05:06:02.486 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2676 2024-06-02T05:06:02.486 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2677 2024-06-02T05:06:02.486 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2694 2024-06-02T05:06:02.486 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2695 2024-06-02T05:06:02.486 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2697 2024-06-02T05:06:02.486 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 2698 2024-06-02T05:06:02.486 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2846 2024-06-02T05:06:02.486 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2846_vm 2024-06-02T05:06:02.486 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2847 2024-06-02T05:06:02.487 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2964 2024-06-02T05:06:02.487 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2964_vm 2024-06-02T05:06:02.487 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2965 2024-06-02T05:06:02.487 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2966 2024-06-02T05:06:02.487 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 2966_vm 2024-06-02T05:06:02.487 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 2967 2024-06-02T05:06:02.487 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3592 2024-06-02T05:06:02.487 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 3592_vm 2024-06-02T05:06:02.487 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 3593 2024-06-02T05:06:02.487 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 4060 2024-06-02T05:06:02.487 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 4060_vm 2024-06-02T05:06:02.487 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 4061 2024-06-02T05:06:02.487 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 6000 2024-06-02T05:06:02.487 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 6000_vm 2024-06-02T05:06:02.488 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 6001 2024-06-02T05:06:02.488 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 6002 2024-06-02T05:06:02.488 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 6100 2024-06-02T05:06:02.523 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 6100_vm 2024-06-02T05:06:02.523 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 6114 2024-06-02T05:06:02.523 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 6115 2024-06-02T05:06:02.523 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 05:05 pg_control 2024-06-02T05:06:02.523 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Jun 2 04:49 pg_filenode.map 2024-06-02T05:06:02.524 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 21644 Jun 2 04:50 pg_internal.init 2024-06-02T05:06:02.524 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T05:06:02.524 INFO:teuthology.orchestra.run.smithi076.stdout:/tmp/cephfs/postgres/data/log: 2024-06-02T05:06:02.524 INFO:teuthology.orchestra.run.smithi076.stdout:total 2 2024-06-02T05:06:02.524 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 522 Jun 2 04:50 . 2024-06-02T05:06:02.524 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1695868587 Jun 2 05:06 .. 2024-06-02T05:06:02.524 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 594 Jun 2 05:06 postgresql-Sun.log 2024-06-02T05:06:02.524 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T05:06:02.524 INFO:teuthology.orchestra.run.smithi076.stdout:/tmp/cephfs/postgres/data/pg_commit_ts: 2024-06-02T05:06:02.524 INFO:teuthology.orchestra.run.smithi076.stdout:total 1 2024-06-02T05:06:02.524 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 . 2024-06-02T05:06:02.524 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1695868587 Jun 2 05:06 .. 2024-06-02T05:06:02.524 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T05:06:02.525 INFO:teuthology.orchestra.run.smithi076.stdout:/tmp/cephfs/postgres/data/pg_dynshmem: 2024-06-02T05:06:02.525 INFO:teuthology.orchestra.run.smithi076.stdout:total 1 2024-06-02T05:06:02.525 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 . 2024-06-02T05:06:02.525 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1695868587 Jun 2 05:06 .. 2024-06-02T05:06:02.525 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T05:06:02.525 INFO:teuthology.orchestra.run.smithi076.stdout:/tmp/cephfs/postgres/data/pg_logical: 2024-06-02T05:06:02.525 INFO:teuthology.orchestra.run.smithi076.stdout:total 3 2024-06-02T05:06:02.525 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Jun 2 05:05 . 2024-06-02T05:06:02.525 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1695868587 Jun 2 05:06 .. 2024-06-02T05:06:02.525 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 mappings 2024-06-02T05:06:02.525 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Jun 2 05:05 replorigin_checkpoint 2024-06-02T05:06:02.525 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 snapshots 2024-06-02T05:06:02.525 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T05:06:02.525 INFO:teuthology.orchestra.run.smithi076.stdout:/tmp/cephfs/postgres/data/pg_logical/mappings: 2024-06-02T05:06:02.526 INFO:teuthology.orchestra.run.smithi076.stdout:total 1 2024-06-02T05:06:02.526 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 . 2024-06-02T05:06:02.526 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Jun 2 05:05 .. 2024-06-02T05:06:02.526 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T05:06:02.526 INFO:teuthology.orchestra.run.smithi076.stdout:/tmp/cephfs/postgres/data/pg_logical/snapshots: 2024-06-02T05:06:02.526 INFO:teuthology.orchestra.run.smithi076.stdout:total 1 2024-06-02T05:06:02.526 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 . 2024-06-02T05:06:02.526 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Jun 2 05:05 .. 2024-06-02T05:06:02.526 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T05:06:02.526 INFO:teuthology.orchestra.run.smithi076.stdout:/tmp/cephfs/postgres/data/pg_multixact: 2024-06-02T05:06:02.526 INFO:teuthology.orchestra.run.smithi076.stdout:total 2 2024-06-02T05:06:02.526 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 . 2024-06-02T05:06:02.526 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1695868587 Jun 2 05:06 .. 2024-06-02T05:06:02.527 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 members 2024-06-02T05:06:02.527 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 offsets 2024-06-02T05:06:02.527 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T05:06:02.527 INFO:teuthology.orchestra.run.smithi076.stdout:/tmp/cephfs/postgres/data/pg_multixact/members: 2024-06-02T05:06:02.527 INFO:teuthology.orchestra.run.smithi076.stdout:total 9 2024-06-02T05:06:02.527 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 . 2024-06-02T05:06:02.527 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 .. 2024-06-02T05:06:02.527 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 0000 2024-06-02T05:06:02.527 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T05:06:02.527 INFO:teuthology.orchestra.run.smithi076.stdout:/tmp/cephfs/postgres/data/pg_multixact/offsets: 2024-06-02T05:06:02.527 INFO:teuthology.orchestra.run.smithi076.stdout:total 9 2024-06-02T05:06:02.527 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:49 . 2024-06-02T05:06:02.527 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:49 .. 2024-06-02T05:06:02.528 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:50 0000 2024-06-02T05:06:02.528 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T05:06:02.528 INFO:teuthology.orchestra.run.smithi076.stdout:/tmp/cephfs/postgres/data/pg_notify: 2024-06-02T05:06:02.528 INFO:teuthology.orchestra.run.smithi076.stdout:total 9 2024-06-02T05:06:02.528 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:50 . 2024-06-02T05:06:02.528 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1695868587 Jun 2 05:06 .. 2024-06-02T05:06:02.528 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:50 0000 2024-06-02T05:06:02.528 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T05:06:02.528 INFO:teuthology.orchestra.run.smithi076.stdout:/tmp/cephfs/postgres/data/pg_replslot: 2024-06-02T05:06:02.528 INFO:teuthology.orchestra.run.smithi076.stdout:total 1 2024-06-02T05:06:02.528 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 . 2024-06-02T05:06:02.600 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1695868587 Jun 2 05:06 .. 2024-06-02T05:06:02.600 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T05:06:02.600 INFO:teuthology.orchestra.run.smithi076.stdout:/tmp/cephfs/postgres/data/pg_serial: 2024-06-02T05:06:02.600 INFO:teuthology.orchestra.run.smithi076.stdout:total 1 2024-06-02T05:06:02.600 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 . 2024-06-02T05:06:02.600 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1695868587 Jun 2 05:06 .. 2024-06-02T05:06:02.600 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T05:06:02.600 INFO:teuthology.orchestra.run.smithi076.stdout:/tmp/cephfs/postgres/data/pg_snapshots: 2024-06-02T05:06:02.600 INFO:teuthology.orchestra.run.smithi076.stdout:total 1 2024-06-02T05:06:02.600 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 . 2024-06-02T05:06:02.600 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1695868587 Jun 2 05:06 .. 2024-06-02T05:06:02.600 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T05:06:02.601 INFO:teuthology.orchestra.run.smithi076.stdout:/tmp/cephfs/postgres/data/pg_stat: 2024-06-02T05:06:02.601 INFO:teuthology.orchestra.run.smithi076.stdout:total 14 2024-06-02T05:06:02.601 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 11771 Jun 2 05:06 . 2024-06-02T05:06:02.601 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1695868587 Jun 2 05:06 .. 2024-06-02T05:06:02.601 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1864 Jun 2 05:06 db_0.stat 2024-06-02T05:06:02.601 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 9300 Jun 2 05:06 db_12347.stat 2024-06-02T05:06:02.601 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 607 Jun 2 05:06 global.stat 2024-06-02T05:06:02.601 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T05:06:02.601 INFO:teuthology.orchestra.run.smithi076.stdout:/tmp/cephfs/postgres/data/pg_stat_tmp: 2024-06-02T05:06:02.601 INFO:teuthology.orchestra.run.smithi076.stdout:total 1 2024-06-02T05:06:02.601 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 11771 Jun 2 05:06 . 2024-06-02T05:06:02.601 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1695868587 Jun 2 05:06 .. 2024-06-02T05:06:02.601 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T05:06:02.601 INFO:teuthology.orchestra.run.smithi076.stdout:/tmp/cephfs/postgres/data/pg_subtrans: 2024-06-02T05:06:02.602 INFO:teuthology.orchestra.run.smithi076.stdout:total 25 2024-06-02T05:06:02.602 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 05:06 . 2024-06-02T05:06:02.602 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1695868587 Jun 2 05:06 .. 2024-06-02T05:06:02.602 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 05:05 000A 2024-06-02T05:06:02.602 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T05:06:02.602 INFO:teuthology.orchestra.run.smithi076.stdout:/tmp/cephfs/postgres/data/pg_tblspc: 2024-06-02T05:06:02.602 INFO:teuthology.orchestra.run.smithi076.stdout:total 1 2024-06-02T05:06:02.602 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 . 2024-06-02T05:06:02.602 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1695868587 Jun 2 05:06 .. 2024-06-02T05:06:02.602 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T05:06:02.602 INFO:teuthology.orchestra.run.smithi076.stdout:/tmp/cephfs/postgres/data/pg_twophase: 2024-06-02T05:06:02.602 INFO:teuthology.orchestra.run.smithi076.stdout:total 1 2024-06-02T05:06:02.603 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 . 2024-06-02T05:06:02.603 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1695868587 Jun 2 05:06 .. 2024-06-02T05:06:02.603 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T05:06:02.603 INFO:teuthology.orchestra.run.smithi076.stdout:/tmp/cephfs/postgres/data/pg_wal: 2024-06-02T05:06:02.603 INFO:teuthology.orchestra.run.smithi076.stdout:total 1032194 2024-06-02T05:06:02.603 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1056964608 Jun 2 05:06 . 2024-06-02T05:06:02.603 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1695868587 Jun 2 05:06 .. 2024-06-02T05:06:02.603 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 05:04 0000000100000000000000E2 2024-06-02T05:06:02.603 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 05:04 0000000100000000000000E3 2024-06-02T05:06:02.603 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 05:04 0000000100000000000000E4 2024-06-02T05:06:02.603 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 05:04 0000000100000000000000E5 2024-06-02T05:06:02.603 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 05:04 0000000100000000000000E6 2024-06-02T05:06:02.603 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 05:04 0000000100000000000000E7 2024-06-02T05:06:02.603 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 05:04 0000000100000000000000E8 2024-06-02T05:06:02.604 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 05:04 0000000100000000000000E9 2024-06-02T05:06:02.604 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 05:04 0000000100000000000000EA 2024-06-02T05:06:02.604 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 05:04 0000000100000000000000EB 2024-06-02T05:06:02.604 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 05:05 0000000100000000000000EC 2024-06-02T05:06:02.604 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 05:05 0000000100000000000000ED 2024-06-02T05:06:02.604 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 05:05 0000000100000000000000EE 2024-06-02T05:06:02.604 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 05:05 0000000100000000000000EF 2024-06-02T05:06:02.604 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 05:05 0000000100000000000000F0 2024-06-02T05:06:02.604 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 05:05 0000000100000000000000F1 2024-06-02T05:06:02.604 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 05:05 0000000100000000000000F2 2024-06-02T05:06:02.604 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 05:05 0000000100000000000000F3 2024-06-02T05:06:02.604 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 05:05 0000000100000000000000F4 2024-06-02T05:06:02.604 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 05:05 0000000100000000000000F5 2024-06-02T05:06:02.604 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 05:05 0000000100000000000000F6 2024-06-02T05:06:02.605 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 05:00 0000000100000000000000F7 2024-06-02T05:06:02.605 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 05:00 0000000100000000000000F8 2024-06-02T05:06:02.605 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 05:02 0000000100000000000000F9 2024-06-02T05:06:02.605 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 05:01 0000000100000000000000FA 2024-06-02T05:06:02.605 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 05:01 0000000100000000000000FB 2024-06-02T05:06:02.605 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 05:01 0000000100000000000000FC 2024-06-02T05:06:02.605 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 05:01 0000000100000000000000FD 2024-06-02T05:06:02.605 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 05:02 0000000100000000000000FE 2024-06-02T05:06:02.605 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 05:00 0000000100000000000000FF 2024-06-02T05:06:02.605 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 05:02 000000010000000100000000 2024-06-02T05:06:02.605 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 05:01 000000010000000100000001 2024-06-02T05:06:02.605 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 05:01 000000010000000100000002 2024-06-02T05:06:02.605 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 05:01 000000010000000100000003 2024-06-02T05:06:02.605 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 05:01 000000010000000100000004 2024-06-02T05:06:02.606 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 05:01 000000010000000100000005 2024-06-02T05:06:02.606 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 05:01 000000010000000100000006 2024-06-02T05:06:02.606 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 05:00 000000010000000100000007 2024-06-02T05:06:02.606 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 05:04 000000010000000100000008 2024-06-02T05:06:02.606 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 05:02 000000010000000100000009 2024-06-02T05:06:02.606 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 05:04 00000001000000010000000A 2024-06-02T05:06:02.606 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 05:03 00000001000000010000000B 2024-06-02T05:06:02.606 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 05:03 00000001000000010000000C 2024-06-02T05:06:02.606 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 05:03 00000001000000010000000D 2024-06-02T05:06:02.606 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 05:03 00000001000000010000000E 2024-06-02T05:06:02.606 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 05:03 00000001000000010000000F 2024-06-02T05:06:02.606 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 05:03 000000010000000100000010 2024-06-02T05:06:02.607 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 05:02 000000010000000100000011 2024-06-02T05:06:02.607 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 05:02 000000010000000100000012 2024-06-02T05:06:02.607 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 05:04 000000010000000100000013 2024-06-02T05:06:02.607 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 05:03 000000010000000100000014 2024-06-02T05:06:02.607 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 05:03 000000010000000100000015 2024-06-02T05:06:02.607 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 05:03 000000010000000100000016 2024-06-02T05:06:02.607 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 05:02 000000010000000100000017 2024-06-02T05:06:02.607 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 05:02 000000010000000100000018 2024-06-02T05:06:02.607 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 05:04 000000010000000100000019 2024-06-02T05:06:02.608 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 05:02 00000001000000010000001A 2024-06-02T05:06:02.608 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 05:04 00000001000000010000001B 2024-06-02T05:06:02.608 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 05:02 00000001000000010000001C 2024-06-02T05:06:02.608 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 05:02 00000001000000010000001D 2024-06-02T05:06:02.608 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 05:03 00000001000000010000001E 2024-06-02T05:06:02.608 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 05:03 00000001000000010000001F 2024-06-02T05:06:02.608 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 05:03 000000010000000100000020 2024-06-02T05:06:02.608 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 archive_status 2024-06-02T05:06:02.608 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T05:06:02.608 INFO:teuthology.orchestra.run.smithi076.stdout:/tmp/cephfs/postgres/data/pg_wal/archive_status: 2024-06-02T05:06:02.608 INFO:teuthology.orchestra.run.smithi076.stdout:total 1 2024-06-02T05:06:02.608 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:49 . 2024-06-02T05:06:02.608 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1056964608 Jun 2 05:06 .. 2024-06-02T05:06:02.609 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T05:06:02.609 INFO:teuthology.orchestra.run.smithi076.stdout:/tmp/cephfs/postgres/data/pg_xact: 2024-06-02T05:06:02.609 INFO:teuthology.orchestra.run.smithi076.stdout:total 169 2024-06-02T05:06:02.609 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 172032 Jun 2 04:49 . 2024-06-02T05:06:02.609 INFO:teuthology.orchestra.run.smithi076.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1695868587 Jun 2 05:06 .. 2024-06-02T05:06:02.609 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 172032 Jun 2 05:05 0000 2024-06-02T05:06:02.610 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2024-06-02T05:06:02.625 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi076.front.sepia.ceph.com 2024-06-02T05:06:02.633 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-06-02T05:06:02.648 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-06-02T05:06:02.648 ERROR:teuthology.run_tasks:Manager failed: fwd_scrub Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e1979f064b0becde2020282c7e87cf3c5e98026c/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_111a617aaeda17ec8908c7a46e47c4a09ebf905d/qa/tasks/fwd_scrub.py", line 164, in task stop_all_fwd_scrubbers(ctx.ceph[config['cluster']].thrashers) File "/home/teuthworker/src/git.ceph.com_ceph_111a617aaeda17ec8908c7a46e47c4a09ebf905d/qa/tasks/fwd_scrub.py", line 99, in stop_all_fwd_scrubbers raise RuntimeError(f"error during scrub thrashing: {thrasher.exception}") RuntimeError: error during scrub thrashing: rank damage found: {'backtrace'} 2024-06-02T05:06:02.649 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-06-02T05:06:02.664 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-02T05:06:02.827 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:02.825+0000 7f5b526ad700 1 -- 172.21.15.76:0/1494941097 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5b4c100f80 msgr2=0x7f5b4c1013e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:06:02.827 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:02.825+0000 7f5b526ad700 1 --2- 172.21.15.76:0/1494941097 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5b4c100f80 0x7f5b4c1013e0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f5b400099c0 tx=0x7f5b40009cd0 comp rx=0 tx=0).stop 2024-06-02T05:06:02.827 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:02.825+0000 7f5b526ad700 1 -- 172.21.15.76:0/1494941097 shutdown_connections 2024-06-02T05:06:02.827 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:02.825+0000 7f5b526ad700 1 --2- 172.21.15.76:0/1494941097 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5b4c101920 0x7f5b4c1081d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:02.827 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:02.825+0000 7f5b526ad700 1 --2- 172.21.15.76:0/1494941097 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b4c0ffd90 0x7f5b4c1001b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:02.827 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:02.825+0000 7f5b526ad700 1 --2- 172.21.15.76:0/1494941097 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5b4c100f80 0x7f5b4c1013e0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:02.827 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:02.825+0000 7f5b526ad700 1 -- 172.21.15.76:0/1494941097 >> 172.21.15.76:0/1494941097 conn(0x7f5b4c0fb300 msgr2=0x7f5b4c0fd740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:06:02.827 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:02.825+0000 7f5b526ad700 1 -- 172.21.15.76:0/1494941097 shutdown_connections 2024-06-02T05:06:02.827 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:02.825+0000 7f5b526ad700 1 -- 172.21.15.76:0/1494941097 wait complete. 2024-06-02T05:06:02.828 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:02.826+0000 7f5b526ad700 1 Processor -- start 2024-06-02T05:06:02.828 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:02.826+0000 7f5b526ad700 1 -- start start 2024-06-02T05:06:02.829 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:02.826+0000 7f5b526ad700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b4c0ffd90 0x7f5b4c196e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:06:02.829 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:02.826+0000 7f5b526ad700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5b4c100f80 0x7f5b4c197350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:06:02.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:02.826+0000 7f5b526ad700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5b4c101920 0x7f5b4c19e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:06:02.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:02.826+0000 7f5b526ad700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b4c19e940 con 0x7f5b4c100f80 2024-06-02T05:06:02.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:02.826+0000 7f5b526ad700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b4c19ea80 con 0x7f5b4c101920 2024-06-02T05:06:02.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:02.826+0000 7f5b526ad700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b4c19ec10 con 0x7f5b4c0ffd90 2024-06-02T05:06:02.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:02.827+0000 7f5b4b7fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5b4c100f80 0x7f5b4c197350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:06:02.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:02.827+0000 7f5b4b7fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5b4c100f80 0x7f5b4c197350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:60004/0 (socket says 172.21.15.76:60004) 2024-06-02T05:06:02.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:02.827+0000 7f5b4b7fe700 1 -- 172.21.15.76:0/2087448964 learned_addr learned my addr 172.21.15.76:0/2087448964 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:06:02.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:02.827+0000 7f5b50c4a700 1 --2- 172.21.15.76:0/2087448964 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5b4c101920 0x7f5b4c19e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:06:02.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:02.827+0000 7f5b4bfff700 1 --2- 172.21.15.76:0/2087448964 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b4c0ffd90 0x7f5b4c196e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:06:02.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:02.827+0000 7f5b4b7fe700 1 -- 172.21.15.76:0/2087448964 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b4c0ffd90 msgr2=0x7f5b4c196e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:06:02.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:02.827+0000 7f5b4b7fe700 1 --2- 172.21.15.76:0/2087448964 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b4c0ffd90 0x7f5b4c196e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:02.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:02.827+0000 7f5b4b7fe700 1 -- 172.21.15.76:0/2087448964 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5b4c101920 msgr2=0x7f5b4c19e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:06:02.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:02.827+0000 7f5b4b7fe700 1 --2- 172.21.15.76:0/2087448964 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5b4c101920 0x7f5b4c19e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:02.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:02.827+0000 7f5b4b7fe700 1 -- 172.21.15.76:0/2087448964 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b400095f0 con 0x7f5b4c100f80 2024-06-02T05:06:02.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:02.827+0000 7f5b4b7fe700 1 --2- 172.21.15.76:0/2087448964 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5b4c100f80 0x7f5b4c197350 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f5b40009990 tx=0x7f5b4000fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:06:02.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:02.827+0000 7f5b497fa700 1 -- 172.21.15.76:0/2087448964 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b4001d070 con 0x7f5b4c100f80 2024-06-02T05:06:02.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:02.827+0000 7f5b497fa700 1 -- 172.21.15.76:0/2087448964 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5b4000bd10 con 0x7f5b4c100f80 2024-06-02T05:06:02.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:02.827+0000 7f5b526ad700 1 -- 172.21.15.76:0/2087448964 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b4c19ee90 con 0x7f5b4c100f80 2024-06-02T05:06:02.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:02.827+0000 7f5b497fa700 1 -- 172.21.15.76:0/2087448964 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b40017650 con 0x7f5b4c100f80 2024-06-02T05:06:02.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:02.827+0000 7f5b526ad700 1 -- 172.21.15.76:0/2087448964 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b4c19f250 con 0x7f5b4c100f80 2024-06-02T05:06:02.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:02.828+0000 7f5b526ad700 1 -- 172.21.15.76:0/2087448964 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b4c067380 con 0x7f5b4c100f80 2024-06-02T05:06:02.832 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:02.829+0000 7f5b497fa700 1 -- 172.21.15.76:0/2087448964 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f5b40022470 con 0x7f5b4c100f80 2024-06-02T05:06:02.832 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:02.830+0000 7f5b497fa700 1 --2- 172.21.15.76:0/2087448964 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f5b340a1120 0x7f5b340a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:06:02.832 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:02.830+0000 7f5b4bfff700 1 --2- 172.21.15.76:0/2087448964 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f5b340a1120 0x7f5b340a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:06:02.832 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:02.830+0000 7f5b497fa700 1 -- 172.21.15.76:0/2087448964 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f5b400ce330 con 0x7f5b4c100f80 2024-06-02T05:06:02.832 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:02.830+0000 7f5b4bfff700 1 --2- 172.21.15.76:0/2087448964 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f5b340a1120 0x7f5b340a35e0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f5b3c005950 tx=0x7f5b3c0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:06:02.835 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:02.834+0000 7f5b497fa700 1 -- 172.21.15.76:0/2087448964 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f5b40097810 con 0x7f5b4c100f80 2024-06-02T05:06:03.051 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:03.050+0000 7f5b526ad700 1 -- 172.21.15.76:0/2087448964 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5b4c10b4a0 con 0x7f5b4c100f80 2024-06-02T05:06:03.505 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:03.052+0000 7f5b497fa700 1 -- 172.21.15.76:0/2087448964 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+24575 (secure 0 0 0) 0x7f5b4009ae30 con 0x7f5b4c100f80 2024-06-02T05:06:03.506 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T05:06:03.506 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":84,"fsid":"60ab6d30-209a-11ef-bc9b-c7b262605968","created":"2024-06-02T04:42:21.007333+0000","modified":"2024-06-02T04:50:08.858987+0000","last_up_change":"2024-06-02T04:47:29.822242+0000","last_in_change":"2024-06-02T04:47:14.253449+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T04:44:56.408602+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-02T04:48:01.194954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-02T04:48:01.828863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-02T04:48:04.916565+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"33a51ba2-be5c-41d0-b5d1-8d6039f2ca4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6802","nonce":2869602045},{"type":"v1","addr":"172.21.15.76:6803","nonce":2869602045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6804","nonce":2869602045},{"type":"v1","addr":"172.21.15.76:6805","nonce":2869602045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6808","nonce":2869602045},{"type":"v1","addr":"172.21.15.76:6809","nonce":2869602045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6806","nonce":2869602045},{"type":"v1","addr":"172.21.15.76:6807","nonce":2869602045}]},"public_addr":"172.21.15.76:6803/2869602045","cluster_addr":"172.21.15.76:6805/2869602045","heartbeat_back_addr":"172.21.15.76:6809/2869602045","heartbeat_front_addr":"172.21.15.76:6807/2869602045","state":["exists","up"]},{"osd":1,"uuid":"ace46e13-3bb7-4103-973a-6860554df8b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":2353738098},{"type":"v1","addr":"172.21.15.119:6801","nonce":2353738098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":2353738098},{"type":"v1","addr":"172.21.15.119:6803","nonce":2353738098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":2353738098},{"type":"v1","addr":"172.21.15.119:6807","nonce":2353738098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":2353738098},{"type":"v1","addr":"172.21.15.119:6805","nonce":2353738098}]},"public_addr":"172.21.15.119:6801/2353738098","cluster_addr":"172.21.15.119:6803/2353738098","heartbeat_back_addr":"172.21.15.119:6807/2353738098","heartbeat_front_addr":"172.21.15.119:6805/2353738098","state":["exists","up"]},{"osd":2,"uuid":"4addc09e-77a9-428a-bcc4-38194f486cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":3206918546},{"type":"v1","addr":"172.21.15.192:6801","nonce":3206918546}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":3206918546},{"type":"v1","addr":"172.21.15.192:6803","nonce":3206918546}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":3206918546},{"type":"v1","addr":"172.21.15.192:6807","nonce":3206918546}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":3206918546},{"type":"v1","addr":"172.21.15.192:6805","nonce":3206918546}]},"public_addr":"172.21.15.192:6801/3206918546","cluster_addr":"172.21.15.192:6803/3206918546","heartbeat_back_addr":"172.21.15.192:6807/3206918546","heartbeat_front_addr":"172.21.15.192:6805/3206918546","state":["exists","up"]},{"osd":3,"uuid":"dc525518-82c6-49ed-8ca8-e3bd5bfc18d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6810","nonce":3747864233},{"type":"v1","addr":"172.21.15.76:6811","nonce":3747864233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6812","nonce":3747864233},{"type":"v1","addr":"172.21.15.76:6813","nonce":3747864233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6816","nonce":3747864233},{"type":"v1","addr":"172.21.15.76:6817","nonce":3747864233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6814","nonce":3747864233},{"type":"v1","addr":"172.21.15.76:6815","nonce":3747864233}]},"public_addr":"172.21.15.76:6811/3747864233","cluster_addr":"172.21.15.76:6813/3747864233","heartbeat_back_addr":"172.21.15.76:6817/3747864233","heartbeat_front_addr":"172.21.15.76:6815/3747864233","state":["exists","up"]},{"osd":4,"uuid":"eef293d0-cb87-47b3-9751-c6437a1cf079","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":2571629047},{"type":"v1","addr":"172.21.15.119:6809","nonce":2571629047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":2571629047},{"type":"v1","addr":"172.21.15.119:6811","nonce":2571629047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":2571629047},{"type":"v1","addr":"172.21.15.119:6815","nonce":2571629047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":2571629047},{"type":"v1","addr":"172.21.15.119:6813","nonce":2571629047}]},"public_addr":"172.21.15.119:6809/2571629047","cluster_addr":"172.21.15.119:6811/2571629047","heartbeat_back_addr":"172.21.15.119:6815/2571629047","heartbeat_front_addr":"172.21.15.119:6813/2571629047","state":["exists","up"]},{"osd":5,"uuid":"60eb8c6e-766c-49d0-9997-44f85776b3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3285065416},{"type":"v1","addr":"172.21.15.192:6809","nonce":3285065416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":3285065416},{"type":"v1","addr":"172.21.15.192:6811","nonce":3285065416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3285065416},{"type":"v1","addr":"172.21.15.192:6815","nonce":3285065416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":3285065416},{"type":"v1","addr":"172.21.15.192:6813","nonce":3285065416}]},"public_addr":"172.21.15.192:6809/3285065416","cluster_addr":"172.21.15.192:6811/3285065416","heartbeat_back_addr":"172.21.15.192:6815/3285065416","heartbeat_front_addr":"172.21.15.192:6813/3285065416","state":["exists","up"]},{"osd":6,"uuid":"e6dc8b9d-dd06-4870-a506-def8201b7e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6818","nonce":2951381580},{"type":"v1","addr":"172.21.15.76:6819","nonce":2951381580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6820","nonce":2951381580},{"type":"v1","addr":"172.21.15.76:6821","nonce":2951381580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6824","nonce":2951381580},{"type":"v1","addr":"172.21.15.76:6825","nonce":2951381580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6822","nonce":2951381580},{"type":"v1","addr":"172.21.15.76:6823","nonce":2951381580}]},"public_addr":"172.21.15.76:6819/2951381580","cluster_addr":"172.21.15.76:6821/2951381580","heartbeat_back_addr":"172.21.15.76:6825/2951381580","heartbeat_front_addr":"172.21.15.76:6823/2951381580","state":["exists","up"]},{"osd":7,"uuid":"2f5dccb3-39a1-4f25-8715-fa264d59db97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1802558756},{"type":"v1","addr":"172.21.15.119:6817","nonce":1802558756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1802558756},{"type":"v1","addr":"172.21.15.119:6819","nonce":1802558756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1802558756},{"type":"v1","addr":"172.21.15.119:6823","nonce":1802558756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1802558756},{"type":"v1","addr":"172.21.15.119:6821","nonce":1802558756}]},"public_addr":"172.21.15.119:6817/1802558756","cluster_addr":"172.21.15.119:6819/1802558756","heartbeat_back_addr":"172.21.15.119:6823/1802558756","heartbeat_front_addr":"172.21.15.119:6821/1802558756","state":["exists","up"]},{"osd":8,"uuid":"39b6ccd0-16e7-4cd5-87e0-d827e9172984","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":1214972276},{"type":"v1","addr":"172.21.15.192:6817","nonce":1214972276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":1214972276},{"type":"v1","addr":"172.21.15.192:6819","nonce":1214972276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":1214972276},{"type":"v1","addr":"172.21.15.192:6823","nonce":1214972276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":1214972276},{"type":"v1","addr":"172.21.15.192:6821","nonce":1214972276}]},"public_addr":"172.21.15.192:6817/1214972276","cluster_addr":"172.21.15.192:6819/1214972276","heartbeat_back_addr":"172.21.15.192:6823/1214972276","heartbeat_front_addr":"172.21.15.192:6821/1214972276","state":["exists","up"]},{"osd":9,"uuid":"851b2155-07bd-45de-bfe0-53021fda733f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6826","nonce":3095501821},{"type":"v1","addr":"172.21.15.76:6827","nonce":3095501821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6828","nonce":3095501821},{"type":"v1","addr":"172.21.15.76:6829","nonce":3095501821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":3095501821},{"type":"v1","addr":"172.21.15.76:6833","nonce":3095501821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6830","nonce":3095501821},{"type":"v1","addr":"172.21.15.76:6831","nonce":3095501821}]},"public_addr":"172.21.15.76:6827/3095501821","cluster_addr":"172.21.15.76:6829/3095501821","heartbeat_back_addr":"172.21.15.76:6833/3095501821","heartbeat_front_addr":"172.21.15.76:6831/3095501821","state":["exists","up"]},{"osd":10,"uuid":"e4b18e7e-bddf-4dd4-84f6-7902ea327cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":4082130894},{"type":"v1","addr":"172.21.15.119:6825","nonce":4082130894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":4082130894},{"type":"v1","addr":"172.21.15.119:6827","nonce":4082130894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":4082130894},{"type":"v1","addr":"172.21.15.119:6831","nonce":4082130894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":4082130894},{"type":"v1","addr":"172.21.15.119:6829","nonce":4082130894}]},"public_addr":"172.21.15.119:6825/4082130894","cluster_addr":"172.21.15.119:6827/4082130894","heartbeat_back_addr":"172.21.15.119:6831/4082130894","heartbeat_front_addr":"172.21.15.119:6829/4082130894","state":["exists","up"]},{"osd":11,"uuid":"54567e18-920c-4ae9-9557-0efba5a1a820","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":439693921},{"type":"v1","addr":"172.21.15.192:6825","nonce":439693921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":439693921},{"type":"v1","addr":"172.21.15.192:6827","nonce":439693921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":439693921},{"type":"v1","addr":"172.21.15.192:6831","nonce":439693921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":439693921},{"type":"v1","addr":"172.21.15.192:6829","nonce":439693921}]},"public_addr":"172.21.15.192:6825/439693921","cluster_addr":"172.21.15.192:6827/439693921","heartbeat_back_addr":"172.21.15.192:6831/439693921","heartbeat_front_addr":"172.21.15.192:6829/439693921","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:44:19.922390+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:44:36.895563+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:44:53.699019+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:45:11.167404+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:45:27.955899+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:45:44.850368+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:46:02.003588+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:46:19.019217+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:46:36.189670+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:46:53.919365+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:47:11.563053+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:47:28.822443+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":4}]},{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4},{"from":8,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.8","mappings":[{"from":5,"to":10}]},{"pgid":"4.14","mappings":[{"from":9,"to":8}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.76:6801/4200406736":"2024-06-03T04:43:06.092916+0000","172.21.15.76:6800/4200406736":"2024-06-03T04:43:06.092916+0000","172.21.15.76:0/1524144593":"2024-06-03T04:43:06.092916+0000","172.21.15.76:0/3269372590":"2024-06-03T04:43:06.092916+0000","172.21.15.76:0/3570893846":"2024-06-03T04:42:44.872236+0000","172.21.15.76:0/902035790":"2024-06-03T04:43:06.092916+0000","172.21.15.76:6800/2550846765":"2024-06-03T04:42:44.872236+0000","172.21.15.76:6801/2550846765":"2024-06-03T04:42:44.872236+0000","172.21.15.76:0/2646712763":"2024-06-03T04:42:44.872236+0000","172.21.15.76:0/964578813":"2024-06-03T04:42:44.872236+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T05:06:03.508 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:03.054+0000 7f5b526ad700 1 -- 172.21.15.76:0/2087448964 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f5b340a1120 msgr2=0x7f5b340a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:06:03.508 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:03.054+0000 7f5b526ad700 1 --2- 172.21.15.76:0/2087448964 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f5b340a1120 0x7f5b340a35e0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f5b3c005950 tx=0x7f5b3c0058e0 comp rx=0 tx=0).stop 2024-06-02T05:06:03.508 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:03.054+0000 7f5b526ad700 1 -- 172.21.15.76:0/2087448964 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5b4c100f80 msgr2=0x7f5b4c197350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:06:03.508 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:03.054+0000 7f5b526ad700 1 --2- 172.21.15.76:0/2087448964 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5b4c100f80 0x7f5b4c197350 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f5b40009990 tx=0x7f5b4000fa00 comp rx=0 tx=0).stop 2024-06-02T05:06:03.508 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:03.054+0000 7f5b526ad700 1 -- 172.21.15.76:0/2087448964 shutdown_connections 2024-06-02T05:06:03.508 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:03.054+0000 7f5b526ad700 1 --2- 172.21.15.76:0/2087448964 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f5b340a1120 0x7f5b340a35e0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:03.508 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:03.054+0000 7f5b526ad700 1 --2- 172.21.15.76:0/2087448964 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5b4c101920 0x7f5b4c19e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:03.508 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:03.054+0000 7f5b526ad700 1 --2- 172.21.15.76:0/2087448964 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b4c0ffd90 0x7f5b4c196e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:03.508 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:03.054+0000 7f5b526ad700 1 --2- 172.21.15.76:0/2087448964 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5b4c100f80 0x7f5b4c197350 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:03.509 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:03.054+0000 7f5b526ad700 1 -- 172.21.15.76:0/2087448964 >> 172.21.15.76:0/2087448964 conn(0x7f5b4c0fb300 msgr2=0x7f5b4c069260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:06:03.509 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:03.054+0000 7f5b526ad700 1 -- 172.21.15.76:0/2087448964 shutdown_connections 2024-06-02T05:06:03.509 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:03.054+0000 7f5b526ad700 1 -- 172.21.15.76:0/2087448964 wait complete. 2024-06-02T05:06:03.509 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-06-02T04:44:56.408602+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-06-02T04:48:01.194954+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-06-02T04:48:01.828863+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '76', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-06-02T04:48:04.916565+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-06-02T05:06:03.510 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-06-02T05:06:03.638 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:03.636+0000 7f907ac11700 1 -- 172.21.15.76:0/976320373 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9074100fb0 msgr2=0x7f9074101430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:06:03.639 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:03.636+0000 7f907ac11700 1 --2- 172.21.15.76:0/976320373 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9074100fb0 0x7f9074101430 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f9060009990 tx=0x7f9060009ca0 comp rx=0 tx=0).stop 2024-06-02T05:06:03.639 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:03.637+0000 7f907ac11700 1 -- 172.21.15.76:0/976320373 shutdown_connections 2024-06-02T05:06:03.639 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:03.637+0000 7f907ac11700 1 --2- 172.21.15.76:0/976320373 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9074101970 0x7f9074108290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:03.639 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:03.637+0000 7f907ac11700 1 --2- 172.21.15.76:0/976320373 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f90740ffe60 0x7f9074100280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:03.639 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:03.637+0000 7f907ac11700 1 --2- 172.21.15.76:0/976320373 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9074100fb0 0x7f9074101430 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:03.639 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:03.637+0000 7f907ac11700 1 -- 172.21.15.76:0/976320373 >> 172.21.15.76:0/976320373 conn(0x7f90740fb3f0 msgr2=0x7f90740fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:06:03.639 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:03.637+0000 7f907ac11700 1 -- 172.21.15.76:0/976320373 shutdown_connections 2024-06-02T05:06:03.639 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:03.637+0000 7f907ac11700 1 -- 172.21.15.76:0/976320373 wait complete. 2024-06-02T05:06:03.639 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:03.637+0000 7f907ac11700 1 Processor -- start 2024-06-02T05:06:03.639 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:03.637+0000 7f907ac11700 1 -- start start 2024-06-02T05:06:03.639 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:03.637+0000 7f907ac11700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f90740ffe60 0x7f9074195d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:06:03.640 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:03.637+0000 7f907ac11700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9074100fb0 0x7f9074196240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:06:03.640 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:03.637+0000 7f907ac11700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9074101970 0x7f907419d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:06:03.640 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:03.637+0000 7f907ac11700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f907419d820 con 0x7f90740ffe60 2024-06-02T05:06:03.640 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:03.637+0000 7f907ac11700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f907419d990 con 0x7f9074100fb0 2024-06-02T05:06:03.640 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:03.637+0000 7f907ac11700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f907419db50 con 0x7f9074101970 2024-06-02T05:06:03.640 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:03.638+0000 7f90789ad700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f90740ffe60 0x7f9074195d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:06:03.640 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:03.638+0000 7f90789ad700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f90740ffe60 0x7f9074195d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:60020/0 (socket says 172.21.15.76:60020) 2024-06-02T05:06:03.640 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:03.638+0000 7f90789ad700 1 -- 172.21.15.76:0/393785862 learned_addr learned my addr 172.21.15.76:0/393785862 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:06:03.642 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:03.638+0000 7f90791ae700 1 --2- 172.21.15.76:0/393785862 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9074101970 0x7f907419d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:06:03.642 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:03.638+0000 7f9073fff700 1 --2- 172.21.15.76:0/393785862 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9074100fb0 0x7f9074196240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:06:03.642 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:03.638+0000 7f90789ad700 1 -- 172.21.15.76:0/393785862 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9074101970 msgr2=0x7f907419d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:06:03.642 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:03.638+0000 7f90789ad700 1 --2- 172.21.15.76:0/393785862 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9074101970 0x7f907419d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:03.642 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:03.638+0000 7f90789ad700 1 -- 172.21.15.76:0/393785862 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9074100fb0 msgr2=0x7f9074196240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:06:03.642 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:03.638+0000 7f90789ad700 1 --2- 172.21.15.76:0/393785862 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9074100fb0 0x7f9074196240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:03.642 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:03.638+0000 7f90789ad700 1 -- 172.21.15.76:0/393785862 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90600095f0 con 0x7f90740ffe60 2024-06-02T05:06:03.642 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:03.638+0000 7f90789ad700 1 --2- 172.21.15.76:0/393785862 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f90740ffe60 0x7f9074195d00 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f906800c9b0 tx=0x7f906800ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:06:03.642 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:03.638+0000 7f9071ffb700 1 -- 172.21.15.76:0/393785862 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9068007b00 con 0x7f90740ffe60 2024-06-02T05:06:03.643 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:03.638+0000 7f9071ffb700 1 -- 172.21.15.76:0/393785862 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f906800ce50 con 0x7f90740ffe60 2024-06-02T05:06:03.643 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:03.638+0000 7f907ac11700 1 -- 172.21.15.76:0/393785862 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f907419de30 con 0x7f90740ffe60 2024-06-02T05:06:03.643 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:03.638+0000 7f9071ffb700 1 -- 172.21.15.76:0/393785862 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9068018420 con 0x7f90740ffe60 2024-06-02T05:06:03.643 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:03.638+0000 7f907ac11700 1 -- 172.21.15.76:0/393785862 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f907419e250 con 0x7f90740ffe60 2024-06-02T05:06:03.643 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:03.639+0000 7f907ac11700 1 -- 172.21.15.76:0/393785862 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90741072d0 con 0x7f90740ffe60 2024-06-02T05:06:03.643 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:03.640+0000 7f9071ffb700 1 -- 172.21.15.76:0/393785862 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f906800f450 con 0x7f90740ffe60 2024-06-02T05:06:03.643 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:03.641+0000 7f9071ffb700 1 --2- 172.21.15.76:0/393785862 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f90640a1120 0x7f90640a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:06:03.643 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:03.641+0000 7f9073fff700 1 --2- 172.21.15.76:0/393785862 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f90640a1120 0x7f90640a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:06:03.643 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:03.641+0000 7f9071ffb700 1 -- 172.21.15.76:0/393785862 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f90680ccbd0 con 0x7f90740ffe60 2024-06-02T05:06:03.644 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:03.641+0000 7f9073fff700 1 --2- 172.21.15.76:0/393785862 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f90640a1120 0x7f90640a35e0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f90741971b0 tx=0x7f9060003720 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:06:03.646 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:03.645+0000 7f9071ffb700 1 -- 172.21.15.76:0/393785862 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f9068095fc0 con 0x7f90740ffe60 2024-06-02T05:06:03.850 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:03.849+0000 7f907ac11700 1 -- 172.21.15.76:0/393785862 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f907402cda0 con 0x7f90740ffe60 2024-06-02T05:06:03.850 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:03.849+0000 7f9071ffb700 1 -- 172.21.15.76:0/393785862 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v84) v1 ==== 93+0+10 (secure 0 0 0) 0x7f906800f700 con 0x7f90740ffe60 2024-06-02T05:06:03.850 INFO:teuthology.orchestra.run.smithi076.stdout:pg_num: 1 2024-06-02T05:06:03.853 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:03.852+0000 7f907ac11700 1 -- 172.21.15.76:0/393785862 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f90640a1120 msgr2=0x7f90640a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:06:03.853 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:03.852+0000 7f907ac11700 1 --2- 172.21.15.76:0/393785862 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f90640a1120 0x7f90640a35e0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f90741971b0 tx=0x7f9060003720 comp rx=0 tx=0).stop 2024-06-02T05:06:03.853 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:03.852+0000 7f907ac11700 1 -- 172.21.15.76:0/393785862 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f90740ffe60 msgr2=0x7f9074195d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:06:03.853 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:03.852+0000 7f907ac11700 1 --2- 172.21.15.76:0/393785862 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f90740ffe60 0x7f9074195d00 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f906800c9b0 tx=0x7f906800ccc0 comp rx=0 tx=0).stop 2024-06-02T05:06:03.853 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:03.852+0000 7f907ac11700 1 -- 172.21.15.76:0/393785862 shutdown_connections 2024-06-02T05:06:03.853 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:03.852+0000 7f907ac11700 1 --2- 172.21.15.76:0/393785862 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9074101970 0x7f907419d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:03.854 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:03.852+0000 7f907ac11700 1 --2- 172.21.15.76:0/393785862 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f90740ffe60 0x7f9074195d00 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:03.854 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:03.852+0000 7f907ac11700 1 --2- 172.21.15.76:0/393785862 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f90640a1120 0x7f90640a35e0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:03.854 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:03.852+0000 7f907ac11700 1 --2- 172.21.15.76:0/393785862 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9074100fb0 0x7f9074196240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:03.854 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:03.852+0000 7f907ac11700 1 -- 172.21.15.76:0/393785862 >> 172.21.15.76:0/393785862 conn(0x7f90740fb3f0 msgr2=0x7f9074104410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:06:03.854 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:03.852+0000 7f907ac11700 1 -- 172.21.15.76:0/393785862 shutdown_connections 2024-06-02T05:06:03.854 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:03.852+0000 7f907ac11700 1 -- 172.21.15.76:0/393785862 wait complete. 2024-06-02T05:06:03.865 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-06-02T05:06:03.994 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:03.991+0000 7fd5a660a700 1 -- 172.21.15.76:0/1205704532 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd5a0101970 msgr2=0x7fd5a0108290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:06:03.994 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:03.991+0000 7fd5a660a700 1 --2- 172.21.15.76:0/1205704532 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd5a0101970 0x7fd5a0108290 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fd59800b0a0 tx=0x7fd59800b3b0 comp rx=0 tx=0).stop 2024-06-02T05:06:03.995 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:03.991+0000 7fd5a660a700 1 -- 172.21.15.76:0/1205704532 shutdown_connections 2024-06-02T05:06:03.995 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:03.991+0000 7fd5a660a700 1 --2- 172.21.15.76:0/1205704532 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd5a0101970 0x7fd5a0108290 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:03.995 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:03.991+0000 7fd5a660a700 1 --2- 172.21.15.76:0/1205704532 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5a00ffe60 0x7fd5a0100280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:03.995 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:03.991+0000 7fd5a660a700 1 --2- 172.21.15.76:0/1205704532 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd5a0100fb0 0x7fd5a0101430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:03.995 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:03.991+0000 7fd5a660a700 1 -- 172.21.15.76:0/1205704532 >> 172.21.15.76:0/1205704532 conn(0x7fd5a00fb3f0 msgr2=0x7fd5a00fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:06:03.995 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:03.991+0000 7fd5a660a700 1 -- 172.21.15.76:0/1205704532 shutdown_connections 2024-06-02T05:06:03.995 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:03.991+0000 7fd5a660a700 1 -- 172.21.15.76:0/1205704532 wait complete. 2024-06-02T05:06:03.995 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:03.992+0000 7fd5a660a700 1 Processor -- start 2024-06-02T05:06:03.995 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:03.992+0000 7fd5a660a700 1 -- start start 2024-06-02T05:06:03.995 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:03.992+0000 7fd5a660a700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd5a00ffe60 0x7fd5a0195d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:06:03.996 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:03.992+0000 7fd5a660a700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5a0100fb0 0x7fd5a01962d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:06:03.996 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:03.992+0000 7fd5a660a700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd5a0101970 0x7fd5a019d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:06:03.996 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:03.992+0000 7fd5a660a700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a019d880 con 0x7fd5a0101970 2024-06-02T05:06:03.996 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:03.992+0000 7fd5a660a700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a019d9f0 con 0x7fd5a00ffe60 2024-06-02T05:06:03.996 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:03.992+0000 7fd5a660a700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a019dbb0 con 0x7fd5a0100fb0 2024-06-02T05:06:03.996 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:03.992+0000 7fd5a4ba7700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd5a0101970 0x7fd5a019d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:06:03.996 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:03.992+0000 7fd5a4ba7700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd5a0101970 0x7fd5a019d2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:60040/0 (socket says 172.21.15.76:60040) 2024-06-02T05:06:03.996 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:03.992+0000 7fd5a4ba7700 1 -- 172.21.15.76:0/1804401277 learned_addr learned my addr 172.21.15.76:0/1804401277 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:06:03.996 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:03.992+0000 7fd59f7fe700 1 --2- 172.21.15.76:0/1804401277 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5a0100fb0 0x7fd5a01962d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:06:03.996 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:03.992+0000 7fd5a4ba7700 1 -- 172.21.15.76:0/1804401277 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5a0100fb0 msgr2=0x7fd5a01962d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:06:03.996 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:03.992+0000 7fd5a4ba7700 1 --2- 172.21.15.76:0/1804401277 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5a0100fb0 0x7fd5a01962d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:03.996 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:03.992+0000 7fd59ffff700 1 --2- 172.21.15.76:0/1804401277 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd5a00ffe60 0x7fd5a0195d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:06:03.997 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:03.992+0000 7fd5a4ba7700 1 -- 172.21.15.76:0/1804401277 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd5a00ffe60 msgr2=0x7fd5a0195d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:06:03.997 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:03.992+0000 7fd5a4ba7700 1 --2- 172.21.15.76:0/1804401277 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd5a00ffe60 0x7fd5a0195d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:03.997 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:03.992+0000 7fd5a4ba7700 1 -- 172.21.15.76:0/1804401277 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd598009d00 con 0x7fd5a0101970 2024-06-02T05:06:03.997 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:03.993+0000 7fd5a4ba7700 1 --2- 172.21.15.76:0/1804401277 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd5a0101970 0x7fd5a019d2b0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fd598004ce0 tx=0x7fd598004dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:06:03.997 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:03.993+0000 7fd59d7fa700 1 -- 172.21.15.76:0/1804401277 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd59800e040 con 0x7fd5a0101970 2024-06-02T05:06:03.997 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:03.993+0000 7fd59d7fa700 1 -- 172.21.15.76:0/1804401277 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd59800ce60 con 0x7fd5a0101970 2024-06-02T05:06:03.997 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:03.993+0000 7fd5a660a700 1 -- 172.21.15.76:0/1804401277 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5a019de30 con 0x7fd5a0101970 2024-06-02T05:06:03.997 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:03.993+0000 7fd59d7fa700 1 -- 172.21.15.76:0/1804401277 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd59801bb20 con 0x7fd5a0101970 2024-06-02T05:06:03.997 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:03.993+0000 7fd5a660a700 1 -- 172.21.15.76:0/1804401277 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5a019e1f0 con 0x7fd5a0101970 2024-06-02T05:06:03.997 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:03.994+0000 7fd5a660a700 1 -- 172.21.15.76:0/1804401277 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5a0107200 con 0x7fd5a0101970 2024-06-02T05:06:03.998 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:03.995+0000 7fd59d7fa700 1 -- 172.21.15.76:0/1804401277 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fd59801bc80 con 0x7fd5a0101970 2024-06-02T05:06:03.998 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:03.995+0000 7fd59d7fa700 1 --2- 172.21.15.76:0/1804401277 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fd58c0a1120 0x7fd58c0a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:06:03.998 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:03.996+0000 7fd59ffff700 1 --2- 172.21.15.76:0/1804401277 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fd58c0a1120 0x7fd58c0a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:06:03.998 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:03.996+0000 7fd59d7fa700 1 -- 172.21.15.76:0/1804401277 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7fd5980cf0b0 con 0x7fd5a0101970 2024-06-02T05:06:03.998 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:03.996+0000 7fd59ffff700 1 --2- 172.21.15.76:0/1804401277 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fd58c0a1120 0x7fd58c0a35e0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fd588005950 tx=0x7fd5880058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:06:04.000 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:03.999+0000 7fd59d7fa700 1 -- 172.21.15.76:0/1804401277 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fd598098590 con 0x7fd5a0101970 2024-06-02T05:06:04.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:06:03 smithi192 ceph-mon[47933]: pgmap v762: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 10 MiB/s wr, 1.02k op/s 2024-06-02T05:06:04.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:06:03 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/2087448964' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T05:06:04.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:06:03 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/393785862' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-02T05:06:04.195 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.194+0000 7fd5a660a700 1 -- 172.21.15.76:0/1804401277 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd5a0106be0 con 0x7fd5a0101970 2024-06-02T05:06:04.195 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.195+0000 7fd59d7fa700 1 -- 172.21.15.76:0/1804401277 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v84) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd598096e60 con 0x7fd5a0101970 2024-06-02T05:06:04.196 INFO:teuthology.orchestra.run.smithi076.stdout:pg_num: 32 2024-06-02T05:06:04.198 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.197+0000 7fd5a660a700 1 -- 172.21.15.76:0/1804401277 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fd58c0a1120 msgr2=0x7fd58c0a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:06:04.198 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.197+0000 7fd5a660a700 1 --2- 172.21.15.76:0/1804401277 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fd58c0a1120 0x7fd58c0a35e0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fd588005950 tx=0x7fd5880058e0 comp rx=0 tx=0).stop 2024-06-02T05:06:04.198 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.197+0000 7fd5a660a700 1 -- 172.21.15.76:0/1804401277 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd5a0101970 msgr2=0x7fd5a019d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:06:04.198 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.197+0000 7fd5a660a700 1 --2- 172.21.15.76:0/1804401277 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd5a0101970 0x7fd5a019d2b0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fd598004ce0 tx=0x7fd598004dc0 comp rx=0 tx=0).stop 2024-06-02T05:06:04.198 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.197+0000 7fd5a660a700 1 -- 172.21.15.76:0/1804401277 shutdown_connections 2024-06-02T05:06:04.198 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.197+0000 7fd5a660a700 1 --2- 172.21.15.76:0/1804401277 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd5a0101970 0x7fd5a019d2b0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:04.199 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.197+0000 7fd5a660a700 1 --2- 172.21.15.76:0/1804401277 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fd58c0a1120 0x7fd58c0a35e0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:04.199 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.197+0000 7fd5a660a700 1 --2- 172.21.15.76:0/1804401277 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd5a00ffe60 0x7fd5a0195d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:04.199 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.197+0000 7fd5a660a700 1 --2- 172.21.15.76:0/1804401277 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5a0100fb0 0x7fd5a01962d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:04.199 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.197+0000 7fd5a660a700 1 -- 172.21.15.76:0/1804401277 >> 172.21.15.76:0/1804401277 conn(0x7fd5a00fb3f0 msgr2=0x7fd5a0104340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:06:04.199 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.197+0000 7fd5a660a700 1 -- 172.21.15.76:0/1804401277 shutdown_connections 2024-06-02T05:06:04.199 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.197+0000 7fd5a660a700 1 -- 172.21.15.76:0/1804401277 wait complete. 2024-06-02T05:06:04.209 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:06:03 smithi076 ceph-mon[42935]: pgmap v762: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 10 MiB/s wr, 1.02k op/s 2024-06-02T05:06:04.209 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:06:03 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/2087448964' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T05:06:04.209 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:06:03 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/393785862' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-02T05:06:04.210 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-06-02T05:06:04.336 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.335+0000 7fd591213700 1 -- 172.21.15.76:0/441012541 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd58c0ffe80 msgr2=0x7fd58c1002a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:06:04.336 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.335+0000 7fd591213700 1 --2- 172.21.15.76:0/441012541 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd58c0ffe80 0x7fd58c1002a0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fd57c009990 tx=0x7fd57c009ca0 comp rx=0 tx=0).stop 2024-06-02T05:06:04.337 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.335+0000 7fd591213700 1 -- 172.21.15.76:0/441012541 shutdown_connections 2024-06-02T05:06:04.337 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.335+0000 7fd591213700 1 --2- 172.21.15.76:0/441012541 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd58c101990 0x7fd58c1082b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:04.337 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.335+0000 7fd591213700 1 --2- 172.21.15.76:0/441012541 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd58c0ffe80 0x7fd58c1002a0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:04.337 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.335+0000 7fd591213700 1 --2- 172.21.15.76:0/441012541 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd58c100fd0 0x7fd58c101450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:04.337 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.335+0000 7fd591213700 1 -- 172.21.15.76:0/441012541 >> 172.21.15.76:0/441012541 conn(0x7fd58c0fb3f0 msgr2=0x7fd58c0fd830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:06:04.337 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.335+0000 7fd591213700 1 -- 172.21.15.76:0/441012541 shutdown_connections 2024-06-02T05:06:04.337 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.335+0000 7fd591213700 1 -- 172.21.15.76:0/441012541 wait complete. 2024-06-02T05:06:04.339 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.336+0000 7fd591213700 1 Processor -- start 2024-06-02T05:06:04.339 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.336+0000 7fd591213700 1 -- start start 2024-06-02T05:06:04.340 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.336+0000 7fd591213700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd58c0ffe80 0x7fd58c196dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:06:04.340 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.336+0000 7fd591213700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd58c100fd0 0x7fd58c197300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:06:04.340 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.336+0000 7fd591213700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd58c101990 0x7fd58c19e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:06:04.340 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.337+0000 7fd591213700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd58c19e8f0 con 0x7fd58c0ffe80 2024-06-02T05:06:04.340 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.337+0000 7fd591213700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd58c19ea30 con 0x7fd58c100fd0 2024-06-02T05:06:04.340 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.337+0000 7fd591213700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd58c19ebc0 con 0x7fd58c101990 2024-06-02T05:06:04.340 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.337+0000 7fd58ad9d700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd58c0ffe80 0x7fd58c196dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:06:04.340 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.337+0000 7fd58ad9d700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd58c0ffe80 0x7fd58c196dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:60068/0 (socket says 172.21.15.76:60068) 2024-06-02T05:06:04.340 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.337+0000 7fd58ad9d700 1 -- 172.21.15.76:0/2591404880 learned_addr learned my addr 172.21.15.76:0/2591404880 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:06:04.340 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.337+0000 7fd58a59c700 1 --2- 172.21.15.76:0/2591404880 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd58c100fd0 0x7fd58c197300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:06:04.340 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.337+0000 7fd58b59e700 1 --2- 172.21.15.76:0/2591404880 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd58c101990 0x7fd58c19e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:06:04.340 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.337+0000 7fd58ad9d700 1 -- 172.21.15.76:0/2591404880 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd58c101990 msgr2=0x7fd58c19e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:06:04.341 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.337+0000 7fd58ad9d700 1 --2- 172.21.15.76:0/2591404880 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd58c101990 0x7fd58c19e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:04.341 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.337+0000 7fd58ad9d700 1 -- 172.21.15.76:0/2591404880 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd58c100fd0 msgr2=0x7fd58c197300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:06:04.341 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.337+0000 7fd58ad9d700 1 --2- 172.21.15.76:0/2591404880 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd58c100fd0 0x7fd58c197300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:04.341 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.337+0000 7fd58ad9d700 1 -- 172.21.15.76:0/2591404880 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd57c0095f0 con 0x7fd58c0ffe80 2024-06-02T05:06:04.341 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.337+0000 7fd58ad9d700 1 --2- 172.21.15.76:0/2591404880 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd58c0ffe80 0x7fd58c196dc0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fd57c00b5c0 tx=0x7fd57c003a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:06:04.341 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.337+0000 7fd573fff700 1 -- 172.21.15.76:0/2591404880 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd57c01d070 con 0x7fd58c0ffe80 2024-06-02T05:06:04.341 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.337+0000 7fd591213700 1 -- 172.21.15.76:0/2591404880 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd58c19ee40 con 0x7fd58c0ffe80 2024-06-02T05:06:04.341 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.337+0000 7fd573fff700 1 -- 172.21.15.76:0/2591404880 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd57c00bd10 con 0x7fd58c0ffe80 2024-06-02T05:06:04.341 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.337+0000 7fd573fff700 1 -- 172.21.15.76:0/2591404880 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd57c022c50 con 0x7fd58c0ffe80 2024-06-02T05:06:04.341 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.337+0000 7fd591213700 1 -- 172.21.15.76:0/2591404880 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd58c19f1b0 con 0x7fd58c0ffe80 2024-06-02T05:06:04.341 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.338+0000 7fd591213700 1 -- 172.21.15.76:0/2591404880 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd58c067460 con 0x7fd58c0ffe80 2024-06-02T05:06:04.342 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.340+0000 7fd573fff700 1 -- 172.21.15.76:0/2591404880 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fd57c022470 con 0x7fd58c0ffe80 2024-06-02T05:06:04.342 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.340+0000 7fd573fff700 1 --2- 172.21.15.76:0/2591404880 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fd5740a1120 0x7fd5740a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:06:04.342 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.340+0000 7fd573fff700 1 -- 172.21.15.76:0/2591404880 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7fd57c0cdf70 con 0x7fd58c0ffe80 2024-06-02T05:06:04.342 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.340+0000 7fd58a59c700 1 --2- 172.21.15.76:0/2591404880 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fd5740a1120 0x7fd5740a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:06:04.342 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.341+0000 7fd58a59c700 1 --2- 172.21.15.76:0/2591404880 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fd5740a1120 0x7fd5740a35e0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fd580005950 tx=0x7fd58000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:06:04.344 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.344+0000 7fd573fff700 1 -- 172.21.15.76:0/2591404880 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fd57c097450 con 0x7fd58c0ffe80 2024-06-02T05:06:04.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:06:03 smithi119 ceph-mon[46633]: pgmap v762: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 10 MiB/s wr, 1.02k op/s 2024-06-02T05:06:04.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:06:03 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/2087448964' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T05:06:04.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:06:03 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/393785862' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-02T05:06:04.542 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.541+0000 7fd591213700 1 -- 172.21.15.76:0/2591404880 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd58c19f570 con 0x7fd58c0ffe80 2024-06-02T05:06:04.542 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.541+0000 7fd573fff700 1 -- 172.21.15.76:0/2591404880 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v84) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd57c09fe60 con 0x7fd58c0ffe80 2024-06-02T05:06:04.542 INFO:teuthology.orchestra.run.smithi076.stdout:pg_num: 64 2024-06-02T05:06:04.544 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.543+0000 7fd591213700 1 -- 172.21.15.76:0/2591404880 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fd5740a1120 msgr2=0x7fd5740a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:06:04.544 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.543+0000 7fd591213700 1 --2- 172.21.15.76:0/2591404880 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fd5740a1120 0x7fd5740a35e0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fd580005950 tx=0x7fd58000b410 comp rx=0 tx=0).stop 2024-06-02T05:06:04.545 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.543+0000 7fd591213700 1 -- 172.21.15.76:0/2591404880 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd58c0ffe80 msgr2=0x7fd58c196dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:06:04.545 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.543+0000 7fd591213700 1 --2- 172.21.15.76:0/2591404880 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd58c0ffe80 0x7fd58c196dc0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fd57c00b5c0 tx=0x7fd57c003a50 comp rx=0 tx=0).stop 2024-06-02T05:06:04.545 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.543+0000 7fd591213700 1 -- 172.21.15.76:0/2591404880 shutdown_connections 2024-06-02T05:06:04.545 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.543+0000 7fd591213700 1 --2- 172.21.15.76:0/2591404880 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd58c101990 0x7fd58c19e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:04.545 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.543+0000 7fd591213700 1 --2- 172.21.15.76:0/2591404880 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd58c0ffe80 0x7fd58c196dc0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:04.545 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.543+0000 7fd591213700 1 --2- 172.21.15.76:0/2591404880 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fd5740a1120 0x7fd5740a35e0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:04.545 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.543+0000 7fd591213700 1 --2- 172.21.15.76:0/2591404880 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd58c100fd0 0x7fd58c197300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:04.545 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.543+0000 7fd591213700 1 -- 172.21.15.76:0/2591404880 >> 172.21.15.76:0/2591404880 conn(0x7fd58c0fb3f0 msgr2=0x7fd58c069200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:06:04.545 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.544+0000 7fd591213700 1 -- 172.21.15.76:0/2591404880 shutdown_connections 2024-06-02T05:06:04.545 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.544+0000 7fd591213700 1 -- 172.21.15.76:0/2591404880 wait complete. 2024-06-02T05:06:04.557 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-06-02T05:06:04.683 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.682+0000 7f39f1113700 1 -- 172.21.15.76:0/3239256451 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f39ec101510 msgr2=0x7f39ec101930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:06:04.684 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.682+0000 7f39f1113700 1 --2- 172.21.15.76:0/3239256451 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f39ec101510 0x7f39ec101930 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f39e0009990 tx=0x7f39e0009ca0 comp rx=0 tx=0).stop 2024-06-02T05:06:04.684 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.682+0000 7f39f1113700 1 -- 172.21.15.76:0/3239256451 shutdown_connections 2024-06-02T05:06:04.684 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.682+0000 7f39f1113700 1 --2- 172.21.15.76:0/3239256451 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39ec100a90 0x7f39ec108330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:04.684 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.682+0000 7f39f1113700 1 --2- 172.21.15.76:0/3239256451 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f39ec101510 0x7f39ec101930 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:04.684 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.682+0000 7f39f1113700 1 --2- 172.21.15.76:0/3239256451 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f39ec1000d0 0x7f39ec100550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:04.684 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.682+0000 7f39f1113700 1 -- 172.21.15.76:0/3239256451 >> 172.21.15.76:0/3239256451 conn(0x7f39ec0fab80 msgr2=0x7f39ec0fcfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:06:04.684 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.682+0000 7f39f1113700 1 -- 172.21.15.76:0/3239256451 shutdown_connections 2024-06-02T05:06:04.684 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.682+0000 7f39f1113700 1 -- 172.21.15.76:0/3239256451 wait complete. 2024-06-02T05:06:04.684 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.683+0000 7f39f1113700 1 Processor -- start 2024-06-02T05:06:04.686 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.683+0000 7f39f1113700 1 -- start start 2024-06-02T05:06:04.686 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.683+0000 7f39f1113700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f39ec1000d0 0x7f39ec0ffb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:06:04.686 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.683+0000 7f39f1113700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f39ec100a90 0x7f39ec19bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:06:04.686 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.683+0000 7f39f1113700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39ec101510 0x7f39ec19e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:06:04.687 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.683+0000 7f39f1113700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39ec19e9d0 con 0x7f39ec100a90 2024-06-02T05:06:04.687 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.683+0000 7f39f1113700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39ec19eb40 con 0x7f39ec1000d0 2024-06-02T05:06:04.687 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.683+0000 7f39f1113700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39ec19ed00 con 0x7f39ec101510 2024-06-02T05:06:04.687 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.683+0000 7f39ea59c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f39ec100a90 0x7f39ec19bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:06:04.687 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.683+0000 7f39ea59c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f39ec100a90 0x7f39ec19bbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:60084/0 (socket says 172.21.15.76:60084) 2024-06-02T05:06:04.687 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.683+0000 7f39ea59c700 1 -- 172.21.15.76:0/2139140748 learned_addr learned my addr 172.21.15.76:0/2139140748 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:06:04.687 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.683+0000 7f39ead9d700 1 --2- 172.21.15.76:0/2139140748 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f39ec1000d0 0x7f39ec0ffb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:06:04.687 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.684+0000 7f39ea59c700 1 -- 172.21.15.76:0/2139140748 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39ec101510 msgr2=0x7f39ec19e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:06:04.687 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.684+0000 7f39eb59e700 1 --2- 172.21.15.76:0/2139140748 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39ec101510 0x7f39ec19e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:06:04.687 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.684+0000 7f39ea59c700 1 --2- 172.21.15.76:0/2139140748 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39ec101510 0x7f39ec19e1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:04.687 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.684+0000 7f39ea59c700 1 -- 172.21.15.76:0/2139140748 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f39ec1000d0 msgr2=0x7f39ec0ffb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:06:04.687 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.684+0000 7f39ea59c700 1 --2- 172.21.15.76:0/2139140748 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f39ec1000d0 0x7f39ec0ffb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:04.688 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.684+0000 7f39ea59c700 1 -- 172.21.15.76:0/2139140748 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39e00095f0 con 0x7f39ec100a90 2024-06-02T05:06:04.688 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.684+0000 7f39ea59c700 1 --2- 172.21.15.76:0/2139140748 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f39ec100a90 0x7f39ec19bbc0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f39dc00e9a0 tx=0x7f39dc00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:06:04.688 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.684+0000 7f39d3fff700 1 -- 172.21.15.76:0/2139140748 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39dc009790 con 0x7f39ec100a90 2024-06-02T05:06:04.688 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.684+0000 7f39f1113700 1 -- 172.21.15.76:0/2139140748 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39ec19ef80 con 0x7f39ec100a90 2024-06-02T05:06:04.688 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.684+0000 7f39d3fff700 1 -- 172.21.15.76:0/2139140748 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f39dc00cbd0 con 0x7f39ec100a90 2024-06-02T05:06:04.688 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.684+0000 7f39d3fff700 1 -- 172.21.15.76:0/2139140748 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39dc018680 con 0x7f39ec100a90 2024-06-02T05:06:04.688 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.684+0000 7f39f1113700 1 -- 172.21.15.76:0/2139140748 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39ec19f450 con 0x7f39ec100a90 2024-06-02T05:06:04.688 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.685+0000 7f39f1113700 1 -- 172.21.15.76:0/2139140748 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39ec107410 con 0x7f39ec100a90 2024-06-02T05:06:04.689 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.687+0000 7f39d3fff700 1 -- 172.21.15.76:0/2139140748 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f39dc00cd40 con 0x7f39ec100a90 2024-06-02T05:06:04.689 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.687+0000 7f39d3fff700 1 --2- 172.21.15.76:0/2139140748 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f39d40a1120 0x7f39d40a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:06:04.689 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.687+0000 7f39ead9d700 1 --2- 172.21.15.76:0/2139140748 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f39d40a1120 0x7f39d40a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:06:04.689 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.687+0000 7f39d3fff700 1 -- 172.21.15.76:0/2139140748 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f39dc014070 con 0x7f39ec100a90 2024-06-02T05:06:04.689 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.688+0000 7f39ead9d700 1 --2- 172.21.15.76:0/2139140748 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f39d40a1120 0x7f39d40a35e0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f39e0005910 tx=0x7f39e000b610 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:06:04.691 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.691+0000 7f39d3fff700 1 -- 172.21.15.76:0/2139140748 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f39dc096670 con 0x7f39ec100a90 2024-06-02T05:06:04.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.890+0000 7f39f1113700 1 -- 172.21.15.76:0/2139140748 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f39ec10b740 con 0x7f39ec100a90 2024-06-02T05:06:04.891 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.890+0000 7f39d3fff700 1 -- 172.21.15.76:0/2139140748 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v84) v1 ==== 103+0+11 (secure 0 0 0) 0x7f39dc099c90 con 0x7f39ec100a90 2024-06-02T05:06:04.891 INFO:teuthology.orchestra.run.smithi076.stdout:pg_num: 32 2024-06-02T05:06:04.893 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.892+0000 7f39f1113700 1 -- 172.21.15.76:0/2139140748 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f39d40a1120 msgr2=0x7f39d40a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:06:04.893 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.892+0000 7f39f1113700 1 --2- 172.21.15.76:0/2139140748 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f39d40a1120 0x7f39d40a35e0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f39e0005910 tx=0x7f39e000b610 comp rx=0 tx=0).stop 2024-06-02T05:06:04.893 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.892+0000 7f39f1113700 1 -- 172.21.15.76:0/2139140748 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f39ec100a90 msgr2=0x7f39ec19bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:06:04.893 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.892+0000 7f39f1113700 1 --2- 172.21.15.76:0/2139140748 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f39ec100a90 0x7f39ec19bbc0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f39dc00e9a0 tx=0x7f39dc00ecb0 comp rx=0 tx=0).stop 2024-06-02T05:06:04.894 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.892+0000 7f39f1113700 1 -- 172.21.15.76:0/2139140748 shutdown_connections 2024-06-02T05:06:04.894 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.892+0000 7f39f1113700 1 --2- 172.21.15.76:0/2139140748 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39ec101510 0x7f39ec19e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:04.894 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.892+0000 7f39f1113700 1 --2- 172.21.15.76:0/2139140748 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f39d40a1120 0x7f39d40a35e0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:04.894 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.892+0000 7f39f1113700 1 --2- 172.21.15.76:0/2139140748 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f39ec1000d0 0x7f39ec0ffb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:04.894 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.892+0000 7f39f1113700 1 --2- 172.21.15.76:0/2139140748 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f39ec100a90 0x7f39ec19bbc0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:04.894 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.892+0000 7f39f1113700 1 -- 172.21.15.76:0/2139140748 >> 172.21.15.76:0/2139140748 conn(0x7f39ec0fab80 msgr2=0x7f39ec104550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:06:04.894 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.892+0000 7f39f1113700 1 -- 172.21.15.76:0/2139140748 shutdown_connections 2024-06-02T05:06:04.894 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:04.892+0000 7f39f1113700 1 -- 172.21.15.76:0/2139140748 wait complete. 2024-06-02T05:06:04.906 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-06-02T05:06:05.029 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:05.028+0000 7f74222e9700 1 -- 172.21.15.76:0/3883839383 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f741c100f50 msgr2=0x7f741c1013b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:06:05.029 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:05.028+0000 7f74222e9700 1 --2- 172.21.15.76:0/3883839383 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f741c100f50 0x7f741c1013b0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f740c0099c0 tx=0x7f740c009cd0 comp rx=0 tx=0).stop 2024-06-02T05:06:05.029 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:05.028+0000 7f74222e9700 1 -- 172.21.15.76:0/3883839383 shutdown_connections 2024-06-02T05:06:05.029 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:05.028+0000 7f74222e9700 1 --2- 172.21.15.76:0/3883839383 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f741c1018f0 0x7f741c1081a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:05.029 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:05.028+0000 7f74222e9700 1 --2- 172.21.15.76:0/3883839383 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f741c0ffd60 0x7f741c100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:05.029 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:05.028+0000 7f74222e9700 1 --2- 172.21.15.76:0/3883839383 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f741c100f50 0x7f741c1013b0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:05.030 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:05.028+0000 7f74222e9700 1 -- 172.21.15.76:0/3883839383 >> 172.21.15.76:0/3883839383 conn(0x7f741c0fb2f0 msgr2=0x7f741c0fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:06:05.030 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:05.028+0000 7f74222e9700 1 -- 172.21.15.76:0/3883839383 shutdown_connections 2024-06-02T05:06:05.030 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:05.028+0000 7f74222e9700 1 -- 172.21.15.76:0/3883839383 wait complete. 2024-06-02T05:06:05.030 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:05.028+0000 7f74222e9700 1 Processor -- start 2024-06-02T05:06:05.030 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:05.028+0000 7f74222e9700 1 -- start start 2024-06-02T05:06:05.032 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:05.029+0000 7f74222e9700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f741c0ffd60 0x7f741c198df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:06:05.032 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:05.029+0000 7f74222e9700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f741c100f50 0x7f741c199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:06:05.032 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:05.029+0000 7f74222e9700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f741c1018f0 0x7f741c1a0310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:06:05.032 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:05.029+0000 7f74222e9700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f741c1a08e0 con 0x7f741c100f50 2024-06-02T05:06:05.032 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:05.029+0000 7f74222e9700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f741c1a0a50 con 0x7f741c0ffd60 2024-06-02T05:06:05.032 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:05.029+0000 7f74222e9700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f741c1a0c10 con 0x7f741c1018f0 2024-06-02T05:06:05.033 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:05.029+0000 7f741b7fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f741c100f50 0x7f741c199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:06:05.033 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:05.029+0000 7f741b7fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f741c100f50 0x7f741c199330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:60092/0 (socket says 172.21.15.76:60092) 2024-06-02T05:06:05.033 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:05.029+0000 7f741b7fe700 1 -- 172.21.15.76:0/693750534 learned_addr learned my addr 172.21.15.76:0/693750534 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:06:05.033 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:05.029+0000 7f7420886700 1 --2- 172.21.15.76:0/693750534 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f741c1018f0 0x7f741c1a0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:06:05.033 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:05.029+0000 7f741bfff700 1 --2- 172.21.15.76:0/693750534 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f741c0ffd60 0x7f741c198df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:06:05.033 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:05.029+0000 7f741b7fe700 1 -- 172.21.15.76:0/693750534 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f741c1018f0 msgr2=0x7f741c1a0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:06:05.033 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:05.029+0000 7f741b7fe700 1 --2- 172.21.15.76:0/693750534 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f741c1018f0 0x7f741c1a0310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:05.033 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:05.029+0000 7f741b7fe700 1 -- 172.21.15.76:0/693750534 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f741c0ffd60 msgr2=0x7f741c198df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:06:05.033 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:05.029+0000 7f741b7fe700 1 --2- 172.21.15.76:0/693750534 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f741c0ffd60 0x7f741c198df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:05.033 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:05.029+0000 7f741b7fe700 1 -- 172.21.15.76:0/693750534 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f740c0095f0 con 0x7f741c100f50 2024-06-02T05:06:05.033 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:05.029+0000 7f741bfff700 1 --2- 172.21.15.76:0/693750534 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f741c0ffd60 0x7f741c198df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T05:06:05.033 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:05.029+0000 7f741b7fe700 1 --2- 172.21.15.76:0/693750534 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f741c100f50 0x7f741c199330 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f740c0098e0 tx=0x7f740c003b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:06:05.034 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:05.029+0000 7f74197fa700 1 -- 172.21.15.76:0/693750534 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f740c01d070 con 0x7f741c100f50 2024-06-02T05:06:05.034 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:05.029+0000 7f74197fa700 1 -- 172.21.15.76:0/693750534 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f740c00bd50 con 0x7f741c100f50 2024-06-02T05:06:05.034 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:05.029+0000 7f74222e9700 1 -- 172.21.15.76:0/693750534 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f741c1a0e90 con 0x7f741c100f50 2024-06-02T05:06:05.034 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:05.029+0000 7f74197fa700 1 -- 172.21.15.76:0/693750534 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f740c022d90 con 0x7f741c100f50 2024-06-02T05:06:05.034 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:05.029+0000 7f74222e9700 1 -- 172.21.15.76:0/693750534 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f741c1a12b0 con 0x7f741c100f50 2024-06-02T05:06:05.034 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:05.030+0000 7f74222e9700 1 -- 172.21.15.76:0/693750534 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f741c067c10 con 0x7f741c100f50 2024-06-02T05:06:05.034 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:05.031+0000 7f74197fa700 1 -- 172.21.15.76:0/693750534 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f740c022470 con 0x7f741c100f50 2024-06-02T05:06:05.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:05.032+0000 7f74197fa700 1 --2- 172.21.15.76:0/693750534 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f74040a1120 0x7f74040a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:06:05.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:05.032+0000 7f74197fa700 1 -- 172.21.15.76:0/693750534 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f740c0ce9c0 con 0x7f741c100f50 2024-06-02T05:06:05.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:05.032+0000 7f741bfff700 1 --2- 172.21.15.76:0/693750534 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f74040a1120 0x7f74040a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:06:05.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:05.033+0000 7f741bfff700 1 --2- 172.21.15.76:0/693750534 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f74040a1120 0x7f74040a35e0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f7410005fd0 tx=0x7f7410005e60 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:06:05.036 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:05.036+0000 7f74197fa700 1 -- 172.21.15.76:0/693750534 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f740c097e40 con 0x7f741c100f50 2024-06-02T05:06:05.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:06:04 smithi192 ceph-mon[47933]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-06-02T05:06:05.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:06:04 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/1804401277' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-06-02T05:06:05.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:06:04 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/2591404880' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-06-02T05:06:05.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:06:04 smithi076 ceph-mon[42935]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-06-02T05:06:05.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:06:04 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/1804401277' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-06-02T05:06:05.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:06:04 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/2591404880' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-06-02T05:06:05.290 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:05.289+0000 7f74222e9700 1 -- 172.21.15.76:0/693750534 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) v1 -- 0x7f741c10b5f0 con 0x7f741c100f50 2024-06-02T05:06:05.297 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:05.297+0000 7f74197fa700 1 -- 172.21.15.76:0/693750534 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v18) v1 ==== 81+0+733410 (secure 0 0 0) 0x7f740c09b460 con 0x7f741c100f50 2024-06-02T05:06:05.307 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T05:06:05.308 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-06-02T05:06:05.308 INFO:teuthology.orchestra.run.smithi076.stdout: "epoch": 18, 2024-06-02T05:06:05.308 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.308 INFO:teuthology.orchestra.run.smithi076.stdout: "active_gid": 14152, 2024-06-02T05:06:05.308 INFO:teuthology.orchestra.run.smithi076.stdout: "active_name": "x", 2024-06-02T05:06:05.308 INFO:teuthology.orchestra.run.smithi076.stdout: "active_addrs": { 2024-06-02T05:06:05.308 INFO:teuthology.orchestra.run.smithi076.stdout: "addrvec": [ 2024-06-02T05:06:05.308 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:05.308 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "v2", 2024-06-02T05:06:05.308 INFO:teuthology.orchestra.run.smithi076.stdout: "addr": "172.21.15.76:6800", 2024-06-02T05:06:05.308 INFO:teuthology.orchestra.run.smithi076.stdout: "nonce": 2591353090 2024-06-02T05:06:05.308 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.309 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:05.309 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "v1", 2024-06-02T05:06:05.309 INFO:teuthology.orchestra.run.smithi076.stdout: "addr": "172.21.15.76:6801", 2024-06-02T05:06:05.309 INFO:teuthology.orchestra.run.smithi076.stdout: "nonce": 2591353090 2024-06-02T05:06:05.309 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:05.309 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-06-02T05:06:05.309 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.309 INFO:teuthology.orchestra.run.smithi076.stdout: "active_addr": "172.21.15.76:6801/2591353090", 2024-06-02T05:06:05.309 INFO:teuthology.orchestra.run.smithi076.stdout: "active_change": "2024-06-02T04:43:06.093064+0000", 2024-06-02T05:06:05.309 INFO:teuthology.orchestra.run.smithi076.stdout: "active_mgr_features": 4540138322906710015, 2024-06-02T05:06:05.309 INFO:teuthology.orchestra.run.smithi076.stdout: "available": true, 2024-06-02T05:06:05.309 INFO:teuthology.orchestra.run.smithi076.stdout: "standbys": [ 2024-06-02T05:06:05.309 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:05.310 INFO:teuthology.orchestra.run.smithi076.stdout: "gid": 24109, 2024-06-02T05:06:05.310 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "z", 2024-06-02T05:06:05.310 INFO:teuthology.orchestra.run.smithi076.stdout: "mgr_features": 4540138322906710015, 2024-06-02T05:06:05.310 INFO:teuthology.orchestra.run.smithi076.stdout: "available_modules": [ 2024-06-02T05:06:05.310 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:05.310 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "alerts", 2024-06-02T05:06:05.310 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-06-02T05:06:05.310 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-06-02T05:06:05.310 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-06-02T05:06:05.310 INFO:teuthology.orchestra.run.smithi076.stdout: "interval": { 2024-06-02T05:06:05.310 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "interval", 2024-06-02T05:06:05.310 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-06-02T05:06:05.311 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.311 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.311 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "60", 2024-06-02T05:06:05.311 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.311 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.311 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.311 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "How frequently to reexamine health status", 2024-06-02T05:06:05.311 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.311 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.311 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.311 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.311 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-06-02T05:06:05.312 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-06-02T05:06:05.312 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.312 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.312 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.312 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.312 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.312 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.312 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:05.312 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:05.312 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:05.312 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:05.312 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:05.313 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:05.313 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:05.313 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:05.313 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.313 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.313 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.313 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.313 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.313 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-06-02T05:06:05.313 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-06-02T05:06:05.313 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.313 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.313 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.314 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.314 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.314 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.314 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.314 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.314 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.314 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.314 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.314 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.314 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-06-02T05:06:05.314 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-06-02T05:06:05.314 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.314 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.315 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.315 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-06-02T05:06:05.315 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.315 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.315 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:05.315 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:05.315 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:05.315 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:05.315 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:05.315 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:05.315 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:05.315 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:05.315 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.316 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.316 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.316 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.316 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.316 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-06-02T05:06:05.316 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-06-02T05:06:05.316 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.316 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.316 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.316 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.316 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.316 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.316 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.317 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.317 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.317 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.317 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.317 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.317 INFO:teuthology.orchestra.run.smithi076.stdout: "smtp_destination": { 2024-06-02T05:06:05.317 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "smtp_destination", 2024-06-02T05:06:05.317 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.317 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.317 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.317 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.317 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.317 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.318 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.318 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Email address to send alerts to", 2024-06-02T05:06:05.318 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.318 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.318 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.318 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.318 INFO:teuthology.orchestra.run.smithi076.stdout: "smtp_from_name": { 2024-06-02T05:06:05.318 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "smtp_from_name", 2024-06-02T05:06:05.318 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.318 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.318 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.318 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "Ceph", 2024-06-02T05:06:05.319 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.319 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.319 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.319 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Email From: name", 2024-06-02T05:06:05.319 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.319 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.319 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.319 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.319 INFO:teuthology.orchestra.run.smithi076.stdout: "smtp_host": { 2024-06-02T05:06:05.319 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "smtp_host", 2024-06-02T05:06:05.319 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.319 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.319 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.320 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.320 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.320 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.320 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.320 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "SMTP server", 2024-06-02T05:06:05.320 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.320 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.320 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.320 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.320 INFO:teuthology.orchestra.run.smithi076.stdout: "smtp_password": { 2024-06-02T05:06:05.320 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "smtp_password", 2024-06-02T05:06:05.320 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.320 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.320 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.321 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.321 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.321 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.321 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.321 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Password to authenticate with", 2024-06-02T05:06:05.321 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.321 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.321 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.321 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.321 INFO:teuthology.orchestra.run.smithi076.stdout: "smtp_port": { 2024-06-02T05:06:05.321 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "smtp_port", 2024-06-02T05:06:05.321 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:05.321 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.322 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.322 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "465", 2024-06-02T05:06:05.322 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.322 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.322 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.322 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "SMTP port", 2024-06-02T05:06:05.322 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.322 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.322 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.322 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.322 INFO:teuthology.orchestra.run.smithi076.stdout: "smtp_sender": { 2024-06-02T05:06:05.322 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "smtp_sender", 2024-06-02T05:06:05.322 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.323 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.323 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.323 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.323 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.323 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.323 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.323 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "SMTP envelope sender", 2024-06-02T05:06:05.323 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.323 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.323 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.323 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.323 INFO:teuthology.orchestra.run.smithi076.stdout: "smtp_ssl": { 2024-06-02T05:06:05.324 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "smtp_ssl", 2024-06-02T05:06:05.324 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.324 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.324 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.324 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:05.324 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.324 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.324 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.324 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Use SSL to connect to SMTP server", 2024-06-02T05:06:05.324 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.324 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.324 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.324 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.325 INFO:teuthology.orchestra.run.smithi076.stdout: "smtp_user": { 2024-06-02T05:06:05.325 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "smtp_user", 2024-06-02T05:06:05.325 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.325 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.325 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.325 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.325 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.325 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.325 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.325 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "User to authenticate as", 2024-06-02T05:06:05.325 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.325 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.325 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.326 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:05.326 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:05.326 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.326 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:05.326 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "balancer", 2024-06-02T05:06:05.326 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-06-02T05:06:05.326 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-06-02T05:06:05.326 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-06-02T05:06:05.326 INFO:teuthology.orchestra.run.smithi076.stdout: "active": { 2024-06-02T05:06:05.326 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "active", 2024-06-02T05:06:05.326 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.326 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.326 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.327 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:05.327 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.327 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.327 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.327 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "automatically balance PGs across cluster", 2024-06-02T05:06:05.327 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.327 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.327 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.327 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.327 INFO:teuthology.orchestra.run.smithi076.stdout: "begin_time": { 2024-06-02T05:06:05.327 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "begin_time", 2024-06-02T05:06:05.327 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.327 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.328 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.328 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "0000", 2024-06-02T05:06:05.328 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.328 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.328 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.328 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "beginning time of day to automatically balance", 2024-06-02T05:06:05.328 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-06-02T05:06:05.328 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.328 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.328 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.328 INFO:teuthology.orchestra.run.smithi076.stdout: "begin_weekday": { 2024-06-02T05:06:05.328 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "begin_weekday", 2024-06-02T05:06:05.328 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "uint", 2024-06-02T05:06:05.329 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.329 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.329 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "0", 2024-06-02T05:06:05.329 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "0", 2024-06-02T05:06:05.329 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "6", 2024-06-02T05:06:05.329 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.329 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-06-02T05:06:05.329 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-06-02T05:06:05.329 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.329 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.329 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.329 INFO:teuthology.orchestra.run.smithi076.stdout: "crush_compat_max_iterations": { 2024-06-02T05:06:05.329 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "crush_compat_max_iterations", 2024-06-02T05:06:05.329 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "uint", 2024-06-02T05:06:05.330 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.330 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.330 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "25", 2024-06-02T05:06:05.330 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "1", 2024-06-02T05:06:05.330 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "250", 2024-06-02T05:06:05.330 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.330 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-06-02T05:06:05.330 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.330 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.330 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.330 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.330 INFO:teuthology.orchestra.run.smithi076.stdout: "crush_compat_metrics": { 2024-06-02T05:06:05.331 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "crush_compat_metrics", 2024-06-02T05:06:05.331 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.331 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.331 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.331 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "pgs,objects,bytes", 2024-06-02T05:06:05.331 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.331 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.331 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.331 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-06-02T05:06:05.331 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-06-02T05:06:05.331 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.331 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.331 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.331 INFO:teuthology.orchestra.run.smithi076.stdout: "crush_compat_step": { 2024-06-02T05:06:05.332 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "crush_compat_step", 2024-06-02T05:06:05.332 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "float", 2024-06-02T05:06:05.332 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.332 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.332 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "0.5", 2024-06-02T05:06:05.332 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "0.001", 2024-06-02T05:06:05.332 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "0.999", 2024-06-02T05:06:05.332 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.332 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "aggressiveness of optimization", 2024-06-02T05:06:05.332 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-06-02T05:06:05.332 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.332 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.332 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.333 INFO:teuthology.orchestra.run.smithi076.stdout: "end_time": { 2024-06-02T05:06:05.333 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "end_time", 2024-06-02T05:06:05.333 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.333 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.333 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.333 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "2359", 2024-06-02T05:06:05.333 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.333 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.333 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.333 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "ending time of day to automatically balance", 2024-06-02T05:06:05.333 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-06-02T05:06:05.333 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.333 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.334 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.334 INFO:teuthology.orchestra.run.smithi076.stdout: "end_weekday": { 2024-06-02T05:06:05.334 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "end_weekday", 2024-06-02T05:06:05.334 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "uint", 2024-06-02T05:06:05.334 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.334 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.334 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "0", 2024-06-02T05:06:05.334 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "0", 2024-06-02T05:06:05.334 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "6", 2024-06-02T05:06:05.334 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.334 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-06-02T05:06:05.334 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-06-02T05:06:05.334 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.335 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.335 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.335 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-06-02T05:06:05.335 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-06-02T05:06:05.335 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.335 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.335 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.335 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.335 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.335 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.335 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:05.335 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:05.335 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:05.336 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:05.336 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:05.336 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:05.336 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:05.336 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:05.336 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.336 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.336 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.336 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.336 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.336 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-06-02T05:06:05.336 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-06-02T05:06:05.336 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.337 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.337 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.337 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.337 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.337 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.337 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.337 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.337 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.337 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.337 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.337 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.337 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-06-02T05:06:05.338 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-06-02T05:06:05.338 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.338 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.338 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.338 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-06-02T05:06:05.338 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.338 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.338 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:05.338 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:05.338 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:05.338 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:05.338 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:05.338 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:05.339 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:05.339 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:05.339 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.339 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.339 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.339 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.339 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.339 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-06-02T05:06:05.339 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-06-02T05:06:05.339 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.339 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.339 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.339 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.340 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.340 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.340 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.340 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.340 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.340 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.340 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.340 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.340 INFO:teuthology.orchestra.run.smithi076.stdout: "min_score": { 2024-06-02T05:06:05.340 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "min_score", 2024-06-02T05:06:05.340 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "float", 2024-06-02T05:06:05.340 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.340 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.341 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "0", 2024-06-02T05:06:05.341 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.341 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.341 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.341 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-06-02T05:06:05.341 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.341 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.341 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.341 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.341 INFO:teuthology.orchestra.run.smithi076.stdout: "mode": { 2024-06-02T05:06:05.341 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "mode", 2024-06-02T05:06:05.341 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.341 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.342 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.342 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "upmap", 2024-06-02T05:06:05.342 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.342 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.342 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:05.342 INFO:teuthology.orchestra.run.smithi076.stdout: "crush-compat", 2024-06-02T05:06:05.342 INFO:teuthology.orchestra.run.smithi076.stdout: "none", 2024-06-02T05:06:05.342 INFO:teuthology.orchestra.run.smithi076.stdout: "upmap" 2024-06-02T05:06:05.342 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:05.342 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Balancer mode", 2024-06-02T05:06:05.342 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.342 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.343 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.343 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.343 INFO:teuthology.orchestra.run.smithi076.stdout: "pool_ids": { 2024-06-02T05:06:05.343 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "pool_ids", 2024-06-02T05:06:05.343 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.343 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.343 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.343 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.343 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.343 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.343 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.343 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-06-02T05:06:05.344 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.344 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.344 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.344 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.344 INFO:teuthology.orchestra.run.smithi076.stdout: "sleep_interval": { 2024-06-02T05:06:05.344 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "sleep_interval", 2024-06-02T05:06:05.344 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-06-02T05:06:05.344 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.344 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.344 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "60", 2024-06-02T05:06:05.344 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.344 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.344 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.344 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-06-02T05:06:05.345 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.345 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.345 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.345 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.345 INFO:teuthology.orchestra.run.smithi076.stdout: "upmap_max_deviation": { 2024-06-02T05:06:05.345 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "upmap_max_deviation", 2024-06-02T05:06:05.345 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:05.345 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.345 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.345 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "5", 2024-06-02T05:06:05.345 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "1", 2024-06-02T05:06:05.345 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.346 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.346 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "deviation below which no optimization is attempted", 2024-06-02T05:06:05.346 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-06-02T05:06:05.346 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.346 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.346 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.346 INFO:teuthology.orchestra.run.smithi076.stdout: "upmap_max_optimizations": { 2024-06-02T05:06:05.346 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "upmap_max_optimizations", 2024-06-02T05:06:05.346 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "uint", 2024-06-02T05:06:05.346 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.346 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.346 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "10", 2024-06-02T05:06:05.347 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.347 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.347 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.347 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-06-02T05:06:05.347 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.347 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.347 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.347 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:05.347 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:05.347 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.347 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:05.347 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "cephadm", 2024-06-02T05:06:05.347 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-06-02T05:06:05.347 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-06-02T05:06:05.348 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-06-02T05:06:05.348 INFO:teuthology.orchestra.run.smithi076.stdout: "agent_down_multiplier": { 2024-06-02T05:06:05.348 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "agent_down_multiplier", 2024-06-02T05:06:05.348 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "float", 2024-06-02T05:06:05.348 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.348 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.348 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "3.0", 2024-06-02T05:06:05.348 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.348 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.348 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.348 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-06-02T05:06:05.348 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.348 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.349 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.349 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.349 INFO:teuthology.orchestra.run.smithi076.stdout: "agent_refresh_rate": { 2024-06-02T05:06:05.349 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "agent_refresh_rate", 2024-06-02T05:06:05.349 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-06-02T05:06:05.349 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.349 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.349 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "20", 2024-06-02T05:06:05.349 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.349 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.349 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.349 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-06-02T05:06:05.349 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.349 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.350 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.350 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.350 INFO:teuthology.orchestra.run.smithi076.stdout: "agent_starting_port": { 2024-06-02T05:06:05.350 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "agent_starting_port", 2024-06-02T05:06:05.350 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:05.350 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.350 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.350 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "4721", 2024-06-02T05:06:05.350 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.350 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.350 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.350 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-06-02T05:06:05.350 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.351 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.351 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.351 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.351 INFO:teuthology.orchestra.run.smithi076.stdout: "allow_ptrace": { 2024-06-02T05:06:05.351 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "allow_ptrace", 2024-06-02T05:06:05.351 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.351 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.351 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.351 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.351 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.351 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.352 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.352 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-06-02T05:06:05.352 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-06-02T05:06:05.352 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.352 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.352 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.352 INFO:teuthology.orchestra.run.smithi076.stdout: "autotune_interval": { 2024-06-02T05:06:05.352 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "autotune_interval", 2024-06-02T05:06:05.352 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-06-02T05:06:05.352 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.352 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.352 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "600", 2024-06-02T05:06:05.352 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.353 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.353 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.353 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "how frequently to autotune daemon memory", 2024-06-02T05:06:05.353 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.353 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.353 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.353 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.353 INFO:teuthology.orchestra.run.smithi076.stdout: "autotune_memory_target_ratio": { 2024-06-02T05:06:05.353 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "autotune_memory_target_ratio", 2024-06-02T05:06:05.353 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "float", 2024-06-02T05:06:05.353 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.353 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.353 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "0.7", 2024-06-02T05:06:05.354 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.354 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.354 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.354 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-06-02T05:06:05.354 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.354 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.354 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.354 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.354 INFO:teuthology.orchestra.run.smithi076.stdout: "cgroups_split": { 2024-06-02T05:06:05.354 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "cgroups_split", 2024-06-02T05:06:05.354 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.354 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.355 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.355 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:05.355 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.355 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.355 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.355 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-06-02T05:06:05.355 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.355 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.355 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.355 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.355 INFO:teuthology.orchestra.run.smithi076.stdout: "config_checks_enabled": { 2024-06-02T05:06:05.355 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "config_checks_enabled", 2024-06-02T05:06:05.355 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.355 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.356 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.356 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.356 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.356 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.356 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.356 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-06-02T05:06:05.356 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.356 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.356 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.356 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.356 INFO:teuthology.orchestra.run.smithi076.stdout: "config_dashboard": { 2024-06-02T05:06:05.356 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "config_dashboard", 2024-06-02T05:06:05.356 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.357 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.357 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.357 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:05.357 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.357 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.357 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.357 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-06-02T05:06:05.357 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.357 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.357 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.357 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.357 INFO:teuthology.orchestra.run.smithi076.stdout: "container_image_alertmanager": { 2024-06-02T05:06:05.357 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "container_image_alertmanager", 2024-06-02T05:06:05.358 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.358 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.358 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.358 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-06-02T05:06:05.358 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.358 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.358 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.358 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Prometheus container image", 2024-06-02T05:06:05.358 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.358 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.358 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.358 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.359 INFO:teuthology.orchestra.run.smithi076.stdout: "container_image_base": { 2024-06-02T05:06:05.359 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "container_image_base", 2024-06-02T05:06:05.359 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.359 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.359 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.359 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "quay.io/ceph/ceph", 2024-06-02T05:06:05.359 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.359 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.359 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.359 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Container image name, without the tag", 2024-06-02T05:06:05.359 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.359 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.359 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.359 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.360 INFO:teuthology.orchestra.run.smithi076.stdout: "container_image_elasticsearch": { 2024-06-02T05:06:05.360 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "container_image_elasticsearch", 2024-06-02T05:06:05.360 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.360 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.360 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.360 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-06-02T05:06:05.360 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.360 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.360 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.360 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "elasticsearch container image", 2024-06-02T05:06:05.360 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.360 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.361 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.361 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.361 INFO:teuthology.orchestra.run.smithi076.stdout: "container_image_grafana": { 2024-06-02T05:06:05.361 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "container_image_grafana", 2024-06-02T05:06:05.361 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.361 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.361 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.361 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2024-06-02T05:06:05.361 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.361 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.361 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.361 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Prometheus container image", 2024-06-02T05:06:05.361 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.362 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.362 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.362 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.362 INFO:teuthology.orchestra.run.smithi076.stdout: "container_image_haproxy": { 2024-06-02T05:06:05.362 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "container_image_haproxy", 2024-06-02T05:06:05.362 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.362 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.362 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.362 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-06-02T05:06:05.362 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.362 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.362 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.362 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "HAproxy container image", 2024-06-02T05:06:05.363 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.363 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.363 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.363 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.363 INFO:teuthology.orchestra.run.smithi076.stdout: "container_image_jaeger_agent": { 2024-06-02T05:06:05.363 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "container_image_jaeger_agent", 2024-06-02T05:06:05.363 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.363 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.363 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.363 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-06-02T05:06:05.363 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.363 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.364 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.364 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Jaeger agent container image", 2024-06-02T05:06:05.364 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.364 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.364 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.364 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.364 INFO:teuthology.orchestra.run.smithi076.stdout: "container_image_jaeger_collector": { 2024-06-02T05:06:05.364 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "container_image_jaeger_collector", 2024-06-02T05:06:05.364 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.364 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.364 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.364 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-06-02T05:06:05.365 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.365 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.365 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.365 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Jaeger collector container image", 2024-06-02T05:06:05.365 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.365 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.365 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.365 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.365 INFO:teuthology.orchestra.run.smithi076.stdout: "container_image_jaeger_query": { 2024-06-02T05:06:05.365 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "container_image_jaeger_query", 2024-06-02T05:06:05.365 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.365 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.365 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.366 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-06-02T05:06:05.366 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.366 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.366 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.366 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Jaeger query container image", 2024-06-02T05:06:05.366 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.366 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.366 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.366 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.366 INFO:teuthology.orchestra.run.smithi076.stdout: "container_image_keepalived": { 2024-06-02T05:06:05.366 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "container_image_keepalived", 2024-06-02T05:06:05.366 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.367 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.367 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.367 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-06-02T05:06:05.367 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.367 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.367 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.367 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Keepalived container image", 2024-06-02T05:06:05.367 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.367 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.367 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.367 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.367 INFO:teuthology.orchestra.run.smithi076.stdout: "container_image_loki": { 2024-06-02T05:06:05.367 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "container_image_loki", 2024-06-02T05:06:05.368 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.368 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.368 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.368 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-06-02T05:06:05.368 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.368 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.368 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.368 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Loki container image", 2024-06-02T05:06:05.368 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.368 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.368 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.368 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.368 INFO:teuthology.orchestra.run.smithi076.stdout: "container_image_node_exporter": { 2024-06-02T05:06:05.368 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "container_image_node_exporter", 2024-06-02T05:06:05.369 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.369 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.369 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.369 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-06-02T05:06:05.369 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.369 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.369 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.369 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Prometheus container image", 2024-06-02T05:06:05.369 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.369 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.369 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.369 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.370 INFO:teuthology.orchestra.run.smithi076.stdout: "container_image_nvmeof": { 2024-06-02T05:06:05.370 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "container_image_nvmeof", 2024-06-02T05:06:05.370 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.370 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.370 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.370 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "quay.io/ceph/nvmeof:1.0.0", 2024-06-02T05:06:05.370 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.370 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.370 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.370 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Nvme-of container image", 2024-06-02T05:06:05.370 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.370 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.371 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.371 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.371 INFO:teuthology.orchestra.run.smithi076.stdout: "container_image_prometheus": { 2024-06-02T05:06:05.371 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "container_image_prometheus", 2024-06-02T05:06:05.371 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.371 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.371 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.371 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-06-02T05:06:05.371 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.371 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.371 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.371 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Prometheus container image", 2024-06-02T05:06:05.371 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.372 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.372 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.372 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.372 INFO:teuthology.orchestra.run.smithi076.stdout: "container_image_promtail": { 2024-06-02T05:06:05.372 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "container_image_promtail", 2024-06-02T05:06:05.372 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.372 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.372 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.372 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-06-02T05:06:05.372 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.372 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.372 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.373 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Promtail container image", 2024-06-02T05:06:05.373 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.373 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.373 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.373 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.373 INFO:teuthology.orchestra.run.smithi076.stdout: "container_image_snmp_gateway": { 2024-06-02T05:06:05.373 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "container_image_snmp_gateway", 2024-06-02T05:06:05.373 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.373 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.373 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.373 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-06-02T05:06:05.373 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.373 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.374 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.374 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "SNMP Gateway container image", 2024-06-02T05:06:05.374 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.374 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.374 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.374 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.374 INFO:teuthology.orchestra.run.smithi076.stdout: "container_init": { 2024-06-02T05:06:05.374 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "container_init", 2024-06-02T05:06:05.374 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.374 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.374 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.374 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:05.374 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.375 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.375 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.375 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Run podman/docker with `--init`", 2024-06-02T05:06:05.375 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.375 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.375 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.375 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.375 INFO:teuthology.orchestra.run.smithi076.stdout: "daemon_cache_timeout": { 2024-06-02T05:06:05.375 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "daemon_cache_timeout", 2024-06-02T05:06:05.375 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-06-02T05:06:05.375 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.375 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.375 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "600", 2024-06-02T05:06:05.376 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.376 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.376 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.376 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-06-02T05:06:05.376 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.376 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.376 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.376 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.376 INFO:teuthology.orchestra.run.smithi076.stdout: "default_cephadm_command_timeout": { 2024-06-02T05:06:05.376 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "default_cephadm_command_timeout", 2024-06-02T05:06:05.376 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:05.376 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.376 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.376 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "900", 2024-06-02T05:06:05.377 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.377 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.377 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.377 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-06-02T05:06:05.377 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.377 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.377 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.377 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.377 INFO:teuthology.orchestra.run.smithi076.stdout: "default_registry": { 2024-06-02T05:06:05.377 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "default_registry", 2024-06-02T05:06:05.377 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.378 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.378 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.378 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "docker.io", 2024-06-02T05:06:05.378 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.378 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.378 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.378 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-06-02T05:06:05.378 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.378 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.379 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.379 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.379 INFO:teuthology.orchestra.run.smithi076.stdout: "device_cache_timeout": { 2024-06-02T05:06:05.379 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "device_cache_timeout", 2024-06-02T05:06:05.379 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-06-02T05:06:05.379 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.379 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.379 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "1800", 2024-06-02T05:06:05.379 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.379 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.379 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.379 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "seconds to cache device inventory", 2024-06-02T05:06:05.379 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.380 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.380 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.380 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.380 INFO:teuthology.orchestra.run.smithi076.stdout: "device_enhanced_scan": { 2024-06-02T05:06:05.380 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "device_enhanced_scan", 2024-06-02T05:06:05.380 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.380 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.380 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.380 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.380 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.380 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.380 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.380 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Use libstoragemgmt during device scans", 2024-06-02T05:06:05.381 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.381 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.381 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.381 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.381 INFO:teuthology.orchestra.run.smithi076.stdout: "facts_cache_timeout": { 2024-06-02T05:06:05.381 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "facts_cache_timeout", 2024-06-02T05:06:05.381 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-06-02T05:06:05.381 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.381 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.381 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "60", 2024-06-02T05:06:05.381 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.381 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.381 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.382 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "seconds to cache host facts data", 2024-06-02T05:06:05.382 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.382 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.382 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.382 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.382 INFO:teuthology.orchestra.run.smithi076.stdout: "host_check_interval": { 2024-06-02T05:06:05.382 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "host_check_interval", 2024-06-02T05:06:05.382 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-06-02T05:06:05.382 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.382 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.382 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "600", 2024-06-02T05:06:05.382 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.383 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.383 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.383 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "how frequently to perform a host check", 2024-06-02T05:06:05.383 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.383 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.383 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.383 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.383 INFO:teuthology.orchestra.run.smithi076.stdout: "hw_monitoring": { 2024-06-02T05:06:05.383 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "hw_monitoring", 2024-06-02T05:06:05.383 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.383 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.383 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.384 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.384 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.384 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.384 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.384 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-06-02T05:06:05.384 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.384 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.384 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.384 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.384 INFO:teuthology.orchestra.run.smithi076.stdout: "inventory_list_all": { 2024-06-02T05:06:05.384 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "inventory_list_all", 2024-06-02T05:06:05.384 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.385 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.385 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.385 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.385 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.385 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.385 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.385 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-06-02T05:06:05.385 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.385 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.385 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.385 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.385 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-06-02T05:06:05.386 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-06-02T05:06:05.386 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.386 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.386 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.386 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.386 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.386 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.386 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:05.386 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:05.386 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:05.386 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:05.386 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:05.386 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:05.387 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:05.387 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:05.387 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.387 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.387 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.387 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.387 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.387 INFO:teuthology.orchestra.run.smithi076.stdout: "log_refresh_metadata": { 2024-06-02T05:06:05.387 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_refresh_metadata", 2024-06-02T05:06:05.387 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.387 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.387 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.387 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.388 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.388 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.388 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.388 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-06-02T05:06:05.388 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.388 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.388 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.388 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.388 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-06-02T05:06:05.388 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-06-02T05:06:05.388 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.388 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.389 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.389 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:05.389 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.389 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.389 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.389 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-06-02T05:06:05.389 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.389 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.389 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.389 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.389 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-06-02T05:06:05.389 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-06-02T05:06:05.389 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.390 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.390 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.390 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-06-02T05:06:05.390 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.390 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.390 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:05.390 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:05.390 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:05.390 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:05.390 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:05.390 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:05.391 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:05.391 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:05.391 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.391 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.391 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.391 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.391 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.391 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-06-02T05:06:05.391 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-06-02T05:06:05.391 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.391 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.391 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.392 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.392 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.392 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.392 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.392 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.392 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.392 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.392 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.392 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.392 INFO:teuthology.orchestra.run.smithi076.stdout: "manage_etc_ceph_ceph_conf": { 2024-06-02T05:06:05.392 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-06-02T05:06:05.393 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.393 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.393 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.393 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.393 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.393 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.393 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.393 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-06-02T05:06:05.393 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.393 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.393 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.393 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.393 INFO:teuthology.orchestra.run.smithi076.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-06-02T05:06:05.394 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-06-02T05:06:05.394 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.394 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.394 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.394 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "*", 2024-06-02T05:06:05.394 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.394 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.394 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.394 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-06-02T05:06:05.394 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.394 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.394 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.394 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.395 INFO:teuthology.orchestra.run.smithi076.stdout: "max_count_per_host": { 2024-06-02T05:06:05.395 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "max_count_per_host", 2024-06-02T05:06:05.395 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:05.395 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.395 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.395 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "10", 2024-06-02T05:06:05.395 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.395 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.395 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.395 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "max number of daemons per service per host", 2024-06-02T05:06:05.395 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.395 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.395 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.396 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.396 INFO:teuthology.orchestra.run.smithi076.stdout: "max_osd_draining_count": { 2024-06-02T05:06:05.396 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "max_osd_draining_count", 2024-06-02T05:06:05.396 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:05.396 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.396 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.396 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "10", 2024-06-02T05:06:05.396 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.396 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.396 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.396 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-06-02T05:06:05.396 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.396 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.397 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.397 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.397 INFO:teuthology.orchestra.run.smithi076.stdout: "migration_current": { 2024-06-02T05:06:05.397 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "migration_current", 2024-06-02T05:06:05.397 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:05.397 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.397 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.397 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.397 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.397 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.397 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.397 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "internal - do not modify", 2024-06-02T05:06:05.397 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.398 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.398 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.398 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.398 INFO:teuthology.orchestra.run.smithi076.stdout: "mode": { 2024-06-02T05:06:05.398 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "mode", 2024-06-02T05:06:05.398 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.398 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.398 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.398 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "root", 2024-06-02T05:06:05.398 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.398 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.398 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:05.398 INFO:teuthology.orchestra.run.smithi076.stdout: "cephadm-package", 2024-06-02T05:06:05.399 INFO:teuthology.orchestra.run.smithi076.stdout: "root" 2024-06-02T05:06:05.399 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:05.399 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "mode for remote execution of cephadm", 2024-06-02T05:06:05.399 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.399 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.399 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.399 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.399 INFO:teuthology.orchestra.run.smithi076.stdout: "oob_default_addr": { 2024-06-02T05:06:05.399 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "oob_default_addr", 2024-06-02T05:06:05.399 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.399 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.399 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.399 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "169.254.1.1", 2024-06-02T05:06:05.400 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.400 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.400 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.400 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Default address for RedFish API (oob management).", 2024-06-02T05:06:05.400 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.400 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.400 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.400 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.400 INFO:teuthology.orchestra.run.smithi076.stdout: "prometheus_alerts_path": { 2024-06-02T05:06:05.400 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "prometheus_alerts_path", 2024-06-02T05:06:05.400 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.400 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.400 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.401 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-06-02T05:06:05.401 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.401 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.401 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.401 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-06-02T05:06:05.401 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.401 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.401 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.401 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.401 INFO:teuthology.orchestra.run.smithi076.stdout: "registry_insecure": { 2024-06-02T05:06:05.401 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "registry_insecure", 2024-06-02T05:06:05.401 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.401 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.402 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.402 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.402 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.402 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.402 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.402 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-06-02T05:06:05.402 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.402 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.402 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.402 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.402 INFO:teuthology.orchestra.run.smithi076.stdout: "registry_password": { 2024-06-02T05:06:05.402 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "registry_password", 2024-06-02T05:06:05.402 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.403 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.403 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.403 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.403 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.403 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.403 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.403 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-06-02T05:06:05.403 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.403 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.403 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.403 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.403 INFO:teuthology.orchestra.run.smithi076.stdout: "registry_url": { 2024-06-02T05:06:05.403 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "registry_url", 2024-06-02T05:06:05.404 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.404 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.404 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.404 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.404 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.404 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.404 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.404 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-06-02T05:06:05.404 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.404 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.404 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.404 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.404 INFO:teuthology.orchestra.run.smithi076.stdout: "registry_username": { 2024-06-02T05:06:05.404 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "registry_username", 2024-06-02T05:06:05.405 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.405 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.405 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.405 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.405 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.405 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.405 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.405 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-06-02T05:06:05.405 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.405 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.405 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.405 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.406 INFO:teuthology.orchestra.run.smithi076.stdout: "secure_monitoring_stack": { 2024-06-02T05:06:05.406 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "secure_monitoring_stack", 2024-06-02T05:06:05.406 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.406 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.406 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.406 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.406 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.406 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.406 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.406 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-06-02T05:06:05.406 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.406 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.406 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.407 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.407 INFO:teuthology.orchestra.run.smithi076.stdout: "service_discovery_port": { 2024-06-02T05:06:05.407 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "service_discovery_port", 2024-06-02T05:06:05.407 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:05.407 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.407 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.407 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "8765", 2024-06-02T05:06:05.407 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.407 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.407 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.407 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "cephadm service discovery port", 2024-06-02T05:06:05.407 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.407 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.407 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.408 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.408 INFO:teuthology.orchestra.run.smithi076.stdout: "ssh_config_file": { 2024-06-02T05:06:05.408 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "ssh_config_file", 2024-06-02T05:06:05.408 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.408 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.408 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.408 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.408 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.408 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.408 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.408 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-06-02T05:06:05.408 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.408 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.409 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.409 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.409 INFO:teuthology.orchestra.run.smithi076.stdout: "use_agent": { 2024-06-02T05:06:05.409 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "use_agent", 2024-06-02T05:06:05.409 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.409 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.409 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.409 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.409 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.409 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.409 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.409 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-06-02T05:06:05.409 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.410 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.410 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.410 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.410 INFO:teuthology.orchestra.run.smithi076.stdout: "use_repo_digest": { 2024-06-02T05:06:05.410 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "use_repo_digest", 2024-06-02T05:06:05.410 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.410 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.410 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.410 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:05.410 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.410 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.410 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.410 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-06-02T05:06:05.411 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.411 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.411 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.411 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.411 INFO:teuthology.orchestra.run.smithi076.stdout: "warn_on_failed_host_check": { 2024-06-02T05:06:05.411 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "warn_on_failed_host_check", 2024-06-02T05:06:05.411 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.411 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.411 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.411 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:05.411 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.411 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.411 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.411 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "raise a health warning if the host check fails", 2024-06-02T05:06:05.412 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.412 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.412 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.412 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.412 INFO:teuthology.orchestra.run.smithi076.stdout: "warn_on_stray_daemons": { 2024-06-02T05:06:05.412 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "warn_on_stray_daemons", 2024-06-02T05:06:05.412 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.412 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.412 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.412 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:05.412 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.412 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.412 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.413 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-06-02T05:06:05.413 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.413 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.413 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.413 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.413 INFO:teuthology.orchestra.run.smithi076.stdout: "warn_on_stray_hosts": { 2024-06-02T05:06:05.413 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "warn_on_stray_hosts", 2024-06-02T05:06:05.413 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.413 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.413 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.413 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:05.413 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.414 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.414 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.414 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-06-02T05:06:05.414 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.414 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.414 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.414 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:05.414 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:05.414 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.418 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:05.418 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "crash", 2024-06-02T05:06:05.418 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-06-02T05:06:05.418 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-06-02T05:06:05.418 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-06-02T05:06:05.418 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-06-02T05:06:05.418 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-06-02T05:06:05.418 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.418 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.418 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.419 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.419 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.419 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.419 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:05.419 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:05.419 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:05.419 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:05.419 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:05.419 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:05.419 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:05.419 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:05.419 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.419 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.419 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.419 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.420 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.420 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-06-02T05:06:05.420 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-06-02T05:06:05.420 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.420 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.420 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.420 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.420 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.420 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.420 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.420 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.420 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.420 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.420 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.421 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.421 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-06-02T05:06:05.421 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-06-02T05:06:05.421 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.421 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.421 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.421 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-06-02T05:06:05.421 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.421 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.421 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:05.421 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:05.421 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:05.421 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:05.421 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:05.422 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:05.422 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:05.422 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:05.422 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.422 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.422 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.422 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.422 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.422 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-06-02T05:06:05.422 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-06-02T05:06:05.422 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.423 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.423 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.423 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.423 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.423 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.423 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.423 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.423 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.423 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.423 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.423 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.423 INFO:teuthology.orchestra.run.smithi076.stdout: "retain_interval": { 2024-06-02T05:06:05.424 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "retain_interval", 2024-06-02T05:06:05.424 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-06-02T05:06:05.424 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.424 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.424 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "31536000", 2024-06-02T05:06:05.424 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.424 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.424 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.424 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "how long to retain crashes before pruning them", 2024-06-02T05:06:05.424 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.424 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.424 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.424 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.425 INFO:teuthology.orchestra.run.smithi076.stdout: "warn_recent_interval": { 2024-06-02T05:06:05.425 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "warn_recent_interval", 2024-06-02T05:06:05.425 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-06-02T05:06:05.425 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.425 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.425 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "1209600", 2024-06-02T05:06:05.425 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.425 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.425 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.425 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "time interval in which to warn about recent crashes", 2024-06-02T05:06:05.425 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.425 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.426 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.426 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:05.426 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:05.426 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.426 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:05.426 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "dashboard", 2024-06-02T05:06:05.426 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-06-02T05:06:05.426 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-06-02T05:06:05.426 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-06-02T05:06:05.426 INFO:teuthology.orchestra.run.smithi076.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-06-02T05:06:05.427 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-06-02T05:06:05.427 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:05.427 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.427 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.427 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "10", 2024-06-02T05:06:05.427 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.427 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.427 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.427 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.427 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.427 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.427 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.427 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.428 INFO:teuthology.orchestra.run.smithi076.stdout: "ALERTMANAGER_API_HOST": { 2024-06-02T05:06:05.428 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "ALERTMANAGER_API_HOST", 2024-06-02T05:06:05.428 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.428 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.428 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.428 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.428 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.428 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.428 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.428 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.428 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.428 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.429 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.429 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.429 INFO:teuthology.orchestra.run.smithi076.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-06-02T05:06:05.429 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-06-02T05:06:05.429 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.429 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.429 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.429 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:05.429 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.429 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.429 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.429 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.429 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.430 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.430 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.430 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.430 INFO:teuthology.orchestra.run.smithi076.stdout: "AUDIT_API_ENABLED": { 2024-06-02T05:06:05.430 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "AUDIT_API_ENABLED", 2024-06-02T05:06:05.430 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.430 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.430 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.430 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.430 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.430 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.431 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.431 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.431 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.431 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.431 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.431 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.431 INFO:teuthology.orchestra.run.smithi076.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-06-02T05:06:05.431 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-06-02T05:06:05.431 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.431 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.431 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.431 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:05.431 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.432 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.432 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.432 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.432 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.432 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.432 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.432 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.432 INFO:teuthology.orchestra.run.smithi076.stdout: "ENABLE_BROWSABLE_API": { 2024-06-02T05:06:05.432 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "ENABLE_BROWSABLE_API", 2024-06-02T05:06:05.432 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.432 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.432 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.432 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:05.433 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.433 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.433 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.433 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.433 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.433 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.433 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.433 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.433 INFO:teuthology.orchestra.run.smithi076.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-06-02T05:06:05.433 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-06-02T05:06:05.433 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.433 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.433 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.434 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:05.434 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.434 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.434 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.434 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.434 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.434 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.434 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.434 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.434 INFO:teuthology.orchestra.run.smithi076.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-06-02T05:06:05.435 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-06-02T05:06:05.435 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.435 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.435 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.435 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:05.435 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.435 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.435 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.435 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.435 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.435 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.435 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.435 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.436 INFO:teuthology.orchestra.run.smithi076.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-06-02T05:06:05.436 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-06-02T05:06:05.436 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.436 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.436 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.436 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:05.436 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.436 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.436 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.436 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.436 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.436 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.437 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.437 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.437 INFO:teuthology.orchestra.run.smithi076.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-06-02T05:06:05.437 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-06-02T05:06:05.437 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.437 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.437 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.437 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:05.437 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.437 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.437 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.437 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.438 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.438 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.438 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.438 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.438 INFO:teuthology.orchestra.run.smithi076.stdout: "FEATURE_TOGGLE_NFS": { 2024-06-02T05:06:05.438 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-06-02T05:06:05.438 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.438 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.438 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.438 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:05.438 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.438 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.438 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.439 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.439 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.439 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.439 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.439 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.439 INFO:teuthology.orchestra.run.smithi076.stdout: "FEATURE_TOGGLE_RBD": { 2024-06-02T05:06:05.439 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-06-02T05:06:05.439 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.439 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.439 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.439 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:05.439 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.439 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.440 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.440 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.440 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.440 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.440 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.440 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.440 INFO:teuthology.orchestra.run.smithi076.stdout: "FEATURE_TOGGLE_RGW": { 2024-06-02T05:06:05.440 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-06-02T05:06:05.440 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.440 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.440 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.440 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:05.440 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.441 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.441 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.441 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.441 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.441 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.441 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.441 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.441 INFO:teuthology.orchestra.run.smithi076.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-06-02T05:06:05.441 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-06-02T05:06:05.441 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.441 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.441 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.441 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.441 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.442 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.442 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.442 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.442 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.442 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.442 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.442 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.442 INFO:teuthology.orchestra.run.smithi076.stdout: "GRAFANA_API_PASSWORD": { 2024-06-02T05:06:05.442 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "GRAFANA_API_PASSWORD", 2024-06-02T05:06:05.442 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.442 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.442 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.443 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "admin", 2024-06-02T05:06:05.443 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.443 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.443 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.443 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.443 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.443 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.443 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.443 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.443 INFO:teuthology.orchestra.run.smithi076.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-06-02T05:06:05.443 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-06-02T05:06:05.443 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.444 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.444 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.444 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:05.444 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.444 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.444 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.444 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.444 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.444 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.444 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.444 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.444 INFO:teuthology.orchestra.run.smithi076.stdout: "GRAFANA_API_URL": { 2024-06-02T05:06:05.444 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "GRAFANA_API_URL", 2024-06-02T05:06:05.445 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.445 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.445 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.445 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.445 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.445 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.445 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.445 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.445 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.445 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.445 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.445 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.445 INFO:teuthology.orchestra.run.smithi076.stdout: "GRAFANA_API_USERNAME": { 2024-06-02T05:06:05.446 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "GRAFANA_API_USERNAME", 2024-06-02T05:06:05.446 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.446 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.446 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.446 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "admin", 2024-06-02T05:06:05.446 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.446 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.446 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.446 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.446 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.446 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.446 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.446 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.447 INFO:teuthology.orchestra.run.smithi076.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-06-02T05:06:05.447 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-06-02T05:06:05.447 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.447 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.447 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.447 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.447 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.447 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.447 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.447 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.447 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.447 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.447 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.448 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.448 INFO:teuthology.orchestra.run.smithi076.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-06-02T05:06:05.448 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-06-02T05:06:05.448 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.448 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.448 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.448 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.448 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.448 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.448 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.448 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.448 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.448 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.448 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.449 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.449 INFO:teuthology.orchestra.run.smithi076.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-06-02T05:06:05.449 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-06-02T05:06:05.449 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.449 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.449 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.449 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:05.449 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.449 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.449 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.449 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.449 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.449 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.450 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.450 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.450 INFO:teuthology.orchestra.run.smithi076.stdout: "ISSUE_TRACKER_API_KEY": { 2024-06-02T05:06:05.450 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-06-02T05:06:05.450 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.450 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.450 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.450 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.450 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.450 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.450 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.450 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.450 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.451 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.451 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.451 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.451 INFO:teuthology.orchestra.run.smithi076.stdout: "PROMETHEUS_API_HOST": { 2024-06-02T05:06:05.451 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "PROMETHEUS_API_HOST", 2024-06-02T05:06:05.451 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.451 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.451 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.451 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.451 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.451 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.451 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.451 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.451 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.452 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.452 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.452 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.452 INFO:teuthology.orchestra.run.smithi076.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-06-02T05:06:05.452 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-06-02T05:06:05.452 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.452 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.452 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.452 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:05.452 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.452 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.452 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.452 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.453 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.453 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.453 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.453 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.453 INFO:teuthology.orchestra.run.smithi076.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-06-02T05:06:05.453 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-06-02T05:06:05.453 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.453 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.453 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.453 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.453 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.453 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.453 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.454 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.454 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.454 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.454 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.454 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.454 INFO:teuthology.orchestra.run.smithi076.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-06-02T05:06:05.454 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-06-02T05:06:05.454 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.454 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.454 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.454 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.454 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.454 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.455 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.455 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.455 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.455 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.455 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.455 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.455 INFO:teuthology.orchestra.run.smithi076.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-06-02T05:06:05.455 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-06-02T05:06:05.455 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.455 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.455 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.455 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:05.455 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.456 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.456 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.456 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.456 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.456 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.456 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.456 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.456 INFO:teuthology.orchestra.run.smithi076.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-06-02T05:06:05.456 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-06-02T05:06:05.456 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.456 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.456 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.457 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:05.457 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.457 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.457 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.457 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.457 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.457 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.457 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.457 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.457 INFO:teuthology.orchestra.run.smithi076.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-06-02T05:06:05.457 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-06-02T05:06:05.457 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.457 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.457 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.458 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.458 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.458 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.458 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.458 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.458 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.458 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.458 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.458 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.458 INFO:teuthology.orchestra.run.smithi076.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-06-02T05:06:05.458 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-06-02T05:06:05.458 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.459 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.459 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.459 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.459 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.459 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.459 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.459 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.459 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.459 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.459 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.459 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.459 INFO:teuthology.orchestra.run.smithi076.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-06-02T05:06:05.459 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-06-02T05:06:05.460 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.460 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.460 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.460 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.460 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.460 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.460 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.460 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.460 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.460 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.460 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.460 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.461 INFO:teuthology.orchestra.run.smithi076.stdout: "PWD_POLICY_ENABLED": { 2024-06-02T05:06:05.461 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "PWD_POLICY_ENABLED", 2024-06-02T05:06:05.461 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.461 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.461 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.461 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:05.461 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.461 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.461 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.461 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.461 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.461 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.461 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.461 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.462 INFO:teuthology.orchestra.run.smithi076.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-06-02T05:06:05.462 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-06-02T05:06:05.462 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.462 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.462 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.462 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-06-02T05:06:05.462 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.462 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.462 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.462 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.462 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.462 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.463 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.463 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.463 INFO:teuthology.orchestra.run.smithi076.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-06-02T05:06:05.463 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-06-02T05:06:05.463 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:05.463 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.463 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.463 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "10", 2024-06-02T05:06:05.463 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.463 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.463 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.463 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.463 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.463 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.464 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.464 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.464 INFO:teuthology.orchestra.run.smithi076.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-06-02T05:06:05.464 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-06-02T05:06:05.464 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:05.464 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.464 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.464 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "8", 2024-06-02T05:06:05.464 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.464 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.464 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.464 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.464 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.465 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.465 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.465 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.465 INFO:teuthology.orchestra.run.smithi076.stdout: "REST_REQUESTS_TIMEOUT": { 2024-06-02T05:06:05.465 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-06-02T05:06:05.465 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:05.465 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.465 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.465 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "45", 2024-06-02T05:06:05.465 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.465 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.465 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.466 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.466 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.466 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.466 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.466 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.466 INFO:teuthology.orchestra.run.smithi076.stdout: "RGW_API_ACCESS_KEY": { 2024-06-02T05:06:05.466 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "RGW_API_ACCESS_KEY", 2024-06-02T05:06:05.466 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.466 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.466 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.466 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.466 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.466 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.467 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.467 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.467 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.467 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.467 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.467 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.467 INFO:teuthology.orchestra.run.smithi076.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-06-02T05:06:05.467 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-06-02T05:06:05.467 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.467 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.467 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.467 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "admin", 2024-06-02T05:06:05.468 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.468 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.468 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.468 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.468 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.468 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.468 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.468 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.468 INFO:teuthology.orchestra.run.smithi076.stdout: "RGW_API_SECRET_KEY": { 2024-06-02T05:06:05.468 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "RGW_API_SECRET_KEY", 2024-06-02T05:06:05.468 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.468 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.468 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.469 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.469 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.469 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.469 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.469 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.469 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.469 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.469 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.469 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.469 INFO:teuthology.orchestra.run.smithi076.stdout: "RGW_API_SSL_VERIFY": { 2024-06-02T05:06:05.469 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "RGW_API_SSL_VERIFY", 2024-06-02T05:06:05.469 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.469 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.470 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.470 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:05.470 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.470 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.470 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.470 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.470 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.470 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.470 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.470 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.470 INFO:teuthology.orchestra.run.smithi076.stdout: "UNSAFE_TLS_v1_2": { 2024-06-02T05:06:05.470 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "UNSAFE_TLS_v1_2", 2024-06-02T05:06:05.471 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.471 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.471 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.471 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.471 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.471 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.471 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.471 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.471 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.471 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.471 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.471 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.471 INFO:teuthology.orchestra.run.smithi076.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-06-02T05:06:05.472 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-06-02T05:06:05.472 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:05.472 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.472 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.472 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "0", 2024-06-02T05:06:05.472 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.472 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.472 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.472 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.472 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.472 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.472 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.472 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.473 INFO:teuthology.orchestra.run.smithi076.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-06-02T05:06:05.473 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-06-02T05:06:05.473 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:05.473 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.473 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.473 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "10", 2024-06-02T05:06:05.473 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.473 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.473 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.473 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.473 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.473 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.473 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.474 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.474 INFO:teuthology.orchestra.run.smithi076.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-06-02T05:06:05.474 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-06-02T05:06:05.474 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:05.474 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.474 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.474 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "5", 2024-06-02T05:06:05.474 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.474 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.474 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.474 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.474 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.474 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.475 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.475 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.475 INFO:teuthology.orchestra.run.smithi076.stdout: "cross_origin_url": { 2024-06-02T05:06:05.475 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "cross_origin_url", 2024-06-02T05:06:05.475 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.475 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.475 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.475 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.475 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.475 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.475 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.475 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.475 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.476 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.476 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.476 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.476 INFO:teuthology.orchestra.run.smithi076.stdout: "crt_file": { 2024-06-02T05:06:05.476 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "crt_file", 2024-06-02T05:06:05.476 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.476 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.476 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.476 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.476 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.476 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.476 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.476 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.477 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.477 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.477 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.477 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.477 INFO:teuthology.orchestra.run.smithi076.stdout: "debug": { 2024-06-02T05:06:05.477 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "debug", 2024-06-02T05:06:05.477 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.477 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.477 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.477 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.477 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.477 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.477 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.478 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Enable/disable debug options", 2024-06-02T05:06:05.478 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.478 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.478 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.478 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.478 INFO:teuthology.orchestra.run.smithi076.stdout: "jwt_token_ttl": { 2024-06-02T05:06:05.478 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "jwt_token_ttl", 2024-06-02T05:06:05.478 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:05.478 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.478 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.478 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "28800", 2024-06-02T05:06:05.478 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.478 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.479 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.479 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.479 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.479 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.479 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.479 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.479 INFO:teuthology.orchestra.run.smithi076.stdout: "key_file": { 2024-06-02T05:06:05.479 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "key_file", 2024-06-02T05:06:05.479 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.479 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.479 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.479 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.479 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.479 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.480 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.480 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.480 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.480 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.480 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.480 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.480 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-06-02T05:06:05.480 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-06-02T05:06:05.480 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.480 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.480 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.480 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.481 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.481 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.481 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:05.481 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:05.481 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:05.481 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:05.481 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:05.481 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:05.481 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:05.481 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:05.481 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.481 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.481 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.482 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.482 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.482 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-06-02T05:06:05.482 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-06-02T05:06:05.482 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.482 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.482 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.482 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.482 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.482 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.482 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.482 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.483 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.483 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.483 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.483 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.483 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-06-02T05:06:05.483 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-06-02T05:06:05.483 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.483 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.483 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.483 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-06-02T05:06:05.483 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.483 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.483 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:05.484 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:05.484 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:05.484 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:05.484 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:05.484 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:05.484 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:05.484 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:05.484 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.484 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.484 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.484 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.484 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.484 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-06-02T05:06:05.485 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-06-02T05:06:05.485 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.485 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.485 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.485 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.485 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.485 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.485 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.485 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.485 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.485 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.485 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.485 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.486 INFO:teuthology.orchestra.run.smithi076.stdout: "motd": { 2024-06-02T05:06:05.486 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "motd", 2024-06-02T05:06:05.486 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.486 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.486 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.486 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.486 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.486 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.486 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.486 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "The message of the day", 2024-06-02T05:06:05.486 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.486 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.487 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.487 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.487 INFO:teuthology.orchestra.run.smithi076.stdout: "redirect_resolve_ip_addr": { 2024-06-02T05:06:05.487 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "redirect_resolve_ip_addr", 2024-06-02T05:06:05.487 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.487 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.487 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.487 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.487 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.487 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.487 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.487 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.487 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.488 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.488 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.488 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.488 INFO:teuthology.orchestra.run.smithi076.stdout: "server_addr": { 2024-06-02T05:06:05.488 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "server_addr", 2024-06-02T05:06:05.488 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.488 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.488 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.488 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "::", 2024-06-02T05:06:05.488 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.488 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.488 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.488 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.489 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.489 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.489 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.489 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.489 INFO:teuthology.orchestra.run.smithi076.stdout: "server_port": { 2024-06-02T05:06:05.489 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "server_port", 2024-06-02T05:06:05.489 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:05.489 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.489 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.489 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "8080", 2024-06-02T05:06:05.489 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.489 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.489 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.490 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.490 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.490 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.490 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.490 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.490 INFO:teuthology.orchestra.run.smithi076.stdout: "ssl": { 2024-06-02T05:06:05.490 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "ssl", 2024-06-02T05:06:05.490 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.490 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.490 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.490 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:05.490 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.491 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.491 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.491 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.491 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.491 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.491 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.491 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.491 INFO:teuthology.orchestra.run.smithi076.stdout: "ssl_server_port": { 2024-06-02T05:06:05.491 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "ssl_server_port", 2024-06-02T05:06:05.491 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:05.491 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.491 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.491 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "8443", 2024-06-02T05:06:05.492 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.492 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.492 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.492 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.492 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.492 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.492 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.492 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.492 INFO:teuthology.orchestra.run.smithi076.stdout: "standby_behaviour": { 2024-06-02T05:06:05.492 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "standby_behaviour", 2024-06-02T05:06:05.492 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.492 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.492 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.492 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "redirect", 2024-06-02T05:06:05.492 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.493 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.493 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:05.493 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:05.493 INFO:teuthology.orchestra.run.smithi076.stdout: "redirect" 2024-06-02T05:06:05.493 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:05.493 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.493 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.493 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.493 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.493 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.493 INFO:teuthology.orchestra.run.smithi076.stdout: "standby_error_status_code": { 2024-06-02T05:06:05.493 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "standby_error_status_code", 2024-06-02T05:06:05.493 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:05.493 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.494 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.494 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "500", 2024-06-02T05:06:05.494 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "400", 2024-06-02T05:06:05.494 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "599", 2024-06-02T05:06:05.494 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.494 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.494 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.494 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.494 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.494 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.494 INFO:teuthology.orchestra.run.smithi076.stdout: "url_prefix": { 2024-06-02T05:06:05.494 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "url_prefix", 2024-06-02T05:06:05.494 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.495 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.495 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.495 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.495 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.495 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.495 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.495 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.495 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.495 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.495 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.495 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:05.496 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:05.496 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.496 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:05.496 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "devicehealth", 2024-06-02T05:06:05.496 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-06-02T05:06:05.496 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-06-02T05:06:05.496 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-06-02T05:06:05.496 INFO:teuthology.orchestra.run.smithi076.stdout: "enable_monitoring": { 2024-06-02T05:06:05.496 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "enable_monitoring", 2024-06-02T05:06:05.496 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.496 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.496 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.497 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:05.497 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.497 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.497 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.497 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "monitor device health metrics", 2024-06-02T05:06:05.497 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.497 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.497 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.497 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.497 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-06-02T05:06:05.497 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-06-02T05:06:05.497 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.497 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.497 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.498 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.498 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.498 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.498 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:05.498 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:05.498 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:05.498 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:05.498 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:05.498 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:05.498 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:05.498 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:05.498 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.499 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.499 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.499 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.499 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.499 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-06-02T05:06:05.499 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-06-02T05:06:05.499 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.499 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.499 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.499 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.499 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.499 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.499 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.500 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.500 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.500 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.500 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.500 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.500 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-06-02T05:06:05.500 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-06-02T05:06:05.500 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.500 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.500 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.500 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-06-02T05:06:05.500 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.500 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.501 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:05.501 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:05.501 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:05.501 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:05.501 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:05.501 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:05.501 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:05.501 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:05.501 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.501 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.501 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.501 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.501 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.502 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-06-02T05:06:05.502 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-06-02T05:06:05.502 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.502 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.502 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.502 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.502 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.502 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.502 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.502 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.502 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.502 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.502 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.503 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.503 INFO:teuthology.orchestra.run.smithi076.stdout: "mark_out_threshold": { 2024-06-02T05:06:05.503 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "mark_out_threshold", 2024-06-02T05:06:05.503 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-06-02T05:06:05.503 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.503 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.503 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "2419200", 2024-06-02T05:06:05.503 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.503 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.503 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.503 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-06-02T05:06:05.503 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.503 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.504 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.504 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.504 INFO:teuthology.orchestra.run.smithi076.stdout: "pool_name": { 2024-06-02T05:06:05.504 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "pool_name", 2024-06-02T05:06:05.504 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.504 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.504 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.504 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "device_health_metrics", 2024-06-02T05:06:05.504 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.504 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.504 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.504 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "name of pool in which to store device health metrics", 2024-06-02T05:06:05.504 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.505 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.505 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.505 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.505 INFO:teuthology.orchestra.run.smithi076.stdout: "retention_period": { 2024-06-02T05:06:05.505 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "retention_period", 2024-06-02T05:06:05.505 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-06-02T05:06:05.505 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.505 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.505 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "15552000", 2024-06-02T05:06:05.505 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.505 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.505 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.505 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "how long to retain device health metrics", 2024-06-02T05:06:05.506 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.506 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.506 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.506 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.506 INFO:teuthology.orchestra.run.smithi076.stdout: "scrape_frequency": { 2024-06-02T05:06:05.506 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "scrape_frequency", 2024-06-02T05:06:05.506 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-06-02T05:06:05.506 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.506 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.506 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "86400", 2024-06-02T05:06:05.506 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.506 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.507 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.507 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "how frequently to scrape device health metrics", 2024-06-02T05:06:05.507 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.507 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.507 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.507 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.507 INFO:teuthology.orchestra.run.smithi076.stdout: "self_heal": { 2024-06-02T05:06:05.507 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "self_heal", 2024-06-02T05:06:05.507 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.507 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.507 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.507 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:05.507 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.507 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.508 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.508 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-06-02T05:06:05.508 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.508 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.508 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.508 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.508 INFO:teuthology.orchestra.run.smithi076.stdout: "sleep_interval": { 2024-06-02T05:06:05.508 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "sleep_interval", 2024-06-02T05:06:05.508 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-06-02T05:06:05.508 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.508 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.508 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "600", 2024-06-02T05:06:05.508 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.509 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.509 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.509 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "how frequently to wake up and check device health", 2024-06-02T05:06:05.509 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.509 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.509 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.509 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.509 INFO:teuthology.orchestra.run.smithi076.stdout: "warn_threshold": { 2024-06-02T05:06:05.509 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "warn_threshold", 2024-06-02T05:06:05.509 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-06-02T05:06:05.509 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.509 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.509 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "7257600", 2024-06-02T05:06:05.510 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.510 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.510 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.510 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-06-02T05:06:05.510 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.510 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.510 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.510 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:05.510 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:05.510 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.510 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:05.510 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "diskprediction_local", 2024-06-02T05:06:05.511 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-06-02T05:06:05.511 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-06-02T05:06:05.511 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-06-02T05:06:05.511 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-06-02T05:06:05.511 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-06-02T05:06:05.511 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.511 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.511 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.511 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.511 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.511 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.511 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:05.512 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:05.512 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:05.512 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:05.512 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:05.512 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:05.512 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:05.512 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:05.512 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.512 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.512 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.512 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.512 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.512 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-06-02T05:06:05.513 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-06-02T05:06:05.513 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.513 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.513 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.513 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.513 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.513 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.513 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.513 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.513 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.513 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.513 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.513 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.513 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-06-02T05:06:05.514 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-06-02T05:06:05.514 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.514 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.514 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.514 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-06-02T05:06:05.514 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.514 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.514 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:05.514 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:05.514 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:05.514 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:05.514 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:05.514 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:05.515 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:05.515 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:05.515 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.515 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.515 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.515 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.515 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.515 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-06-02T05:06:05.515 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-06-02T05:06:05.515 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.515 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.515 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.516 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.516 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.516 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.516 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.516 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.516 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.516 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.516 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.516 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.516 INFO:teuthology.orchestra.run.smithi076.stdout: "predict_interval": { 2024-06-02T05:06:05.516 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "predict_interval", 2024-06-02T05:06:05.516 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.516 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.517 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.517 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "86400", 2024-06-02T05:06:05.517 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.517 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.517 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.517 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.517 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.517 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.517 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.517 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.517 INFO:teuthology.orchestra.run.smithi076.stdout: "predictor_model": { 2024-06-02T05:06:05.517 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "predictor_model", 2024-06-02T05:06:05.517 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.518 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.518 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.518 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "prophetstor", 2024-06-02T05:06:05.518 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.518 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.518 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.518 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.518 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.518 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.518 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.518 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.518 INFO:teuthology.orchestra.run.smithi076.stdout: "sleep_interval": { 2024-06-02T05:06:05.518 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "sleep_interval", 2024-06-02T05:06:05.518 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.519 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.519 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.519 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "600", 2024-06-02T05:06:05.519 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.519 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.519 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.519 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.519 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.519 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.519 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.519 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:05.519 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:05.520 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.520 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:05.520 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "influx", 2024-06-02T05:06:05.520 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": false, 2024-06-02T05:06:05.520 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "influxdb python module not found", 2024-06-02T05:06:05.520 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-06-02T05:06:05.520 INFO:teuthology.orchestra.run.smithi076.stdout: "batch_size": { 2024-06-02T05:06:05.520 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "batch_size", 2024-06-02T05:06:05.520 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:05.520 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.520 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.520 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "5000", 2024-06-02T05:06:05.520 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.520 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.521 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.521 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-06-02T05:06:05.521 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.521 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.521 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.521 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.521 INFO:teuthology.orchestra.run.smithi076.stdout: "database": { 2024-06-02T05:06:05.521 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "database", 2024-06-02T05:06:05.521 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.521 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.521 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.521 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "ceph", 2024-06-02T05:06:05.521 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.522 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.522 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.522 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-06-02T05:06:05.522 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.522 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.522 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.522 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.522 INFO:teuthology.orchestra.run.smithi076.stdout: "hostname": { 2024-06-02T05:06:05.522 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "hostname", 2024-06-02T05:06:05.522 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.522 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.522 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.523 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.523 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.523 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.523 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.523 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "InfluxDB server hostname", 2024-06-02T05:06:05.523 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.523 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.523 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.523 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.523 INFO:teuthology.orchestra.run.smithi076.stdout: "interval": { 2024-06-02T05:06:05.523 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "interval", 2024-06-02T05:06:05.523 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-06-02T05:06:05.523 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.523 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.524 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "30", 2024-06-02T05:06:05.524 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "5", 2024-06-02T05:06:05.524 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.524 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.524 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-06-02T05:06:05.524 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.524 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.524 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.524 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.524 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-06-02T05:06:05.524 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-06-02T05:06:05.524 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.525 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.525 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.525 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.525 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.525 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.525 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:05.525 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:05.525 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:05.525 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:05.525 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:05.525 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:05.525 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:05.526 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:05.526 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.526 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.526 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.526 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.526 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.526 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-06-02T05:06:05.526 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-06-02T05:06:05.526 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.526 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.526 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.526 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.526 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.527 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.527 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.527 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.527 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.527 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.527 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.527 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.527 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-06-02T05:06:05.527 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-06-02T05:06:05.527 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.527 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.527 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.528 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-06-02T05:06:05.528 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.528 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.528 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:05.528 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:05.528 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:05.528 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:05.528 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:05.528 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:05.528 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:05.528 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:05.528 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.529 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.529 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.529 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.529 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.529 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-06-02T05:06:05.529 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-06-02T05:06:05.529 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.529 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.529 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.529 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.529 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.529 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.529 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.530 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.530 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.530 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.530 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.530 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.530 INFO:teuthology.orchestra.run.smithi076.stdout: "password": { 2024-06-02T05:06:05.530 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "password", 2024-06-02T05:06:05.530 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.530 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.530 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.530 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.530 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.531 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.531 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.531 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "password of InfluxDB server user", 2024-06-02T05:06:05.531 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.531 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.531 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.531 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.531 INFO:teuthology.orchestra.run.smithi076.stdout: "port": { 2024-06-02T05:06:05.531 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "port", 2024-06-02T05:06:05.531 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:05.531 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.531 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.531 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "8086", 2024-06-02T05:06:05.532 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.532 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.532 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.532 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "InfluxDB server port", 2024-06-02T05:06:05.532 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.532 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.532 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.532 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.532 INFO:teuthology.orchestra.run.smithi076.stdout: "ssl": { 2024-06-02T05:06:05.532 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "ssl", 2024-06-02T05:06:05.532 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.532 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.532 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.533 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "false", 2024-06-02T05:06:05.533 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.533 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.533 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.533 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-06-02T05:06:05.533 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.533 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.533 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.533 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.533 INFO:teuthology.orchestra.run.smithi076.stdout: "threads": { 2024-06-02T05:06:05.533 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "threads", 2024-06-02T05:06:05.533 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:05.533 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.533 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.534 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "5", 2024-06-02T05:06:05.534 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "1", 2024-06-02T05:06:05.534 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "32", 2024-06-02T05:06:05.534 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.534 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-06-02T05:06:05.534 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.534 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.534 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.534 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.534 INFO:teuthology.orchestra.run.smithi076.stdout: "username": { 2024-06-02T05:06:05.534 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "username", 2024-06-02T05:06:05.534 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.534 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.535 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.535 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.535 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.535 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.535 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.535 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "username of InfluxDB server user", 2024-06-02T05:06:05.535 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.535 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.535 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.535 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.535 INFO:teuthology.orchestra.run.smithi076.stdout: "verify_ssl": { 2024-06-02T05:06:05.535 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "verify_ssl", 2024-06-02T05:06:05.535 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.536 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.536 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.536 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "true", 2024-06-02T05:06:05.536 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.536 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.536 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.536 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-06-02T05:06:05.536 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.536 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.536 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.536 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:05.536 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:05.536 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.537 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:05.537 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "insights", 2024-06-02T05:06:05.537 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-06-02T05:06:05.537 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-06-02T05:06:05.537 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-06-02T05:06:05.537 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-06-02T05:06:05.537 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-06-02T05:06:05.537 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.537 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.537 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.537 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.537 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.537 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.537 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:05.538 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:05.538 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:05.538 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:05.538 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:05.538 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:05.538 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:05.538 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:05.538 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.538 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.538 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.538 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.538 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.539 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-06-02T05:06:05.539 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-06-02T05:06:05.539 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.539 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.539 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.539 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.539 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.539 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.539 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.539 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.539 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.539 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.540 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.540 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.540 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-06-02T05:06:05.540 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-06-02T05:06:05.540 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.540 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.540 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.540 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-06-02T05:06:05.540 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.540 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.540 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:05.540 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:05.540 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:05.540 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:05.541 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:05.541 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:05.541 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:05.541 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:05.541 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.541 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.541 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.541 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.541 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.541 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-06-02T05:06:05.541 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-06-02T05:06:05.541 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.541 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.542 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.542 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.542 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.542 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.542 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.542 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.542 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.542 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.542 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.542 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:05.542 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:05.542 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.543 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:05.543 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "iostat", 2024-06-02T05:06:05.543 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-06-02T05:06:05.543 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-06-02T05:06:05.543 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-06-02T05:06:05.543 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-06-02T05:06:05.543 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-06-02T05:06:05.543 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.543 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.543 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.543 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.543 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.543 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.544 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:05.544 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:05.544 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:05.544 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:05.544 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:05.544 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:05.544 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:05.544 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:05.544 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.544 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.544 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.544 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.544 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.545 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-06-02T05:06:05.545 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-06-02T05:06:05.545 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.545 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.545 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.545 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.545 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.545 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.545 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.545 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.545 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.546 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.546 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.546 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.546 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-06-02T05:06:05.546 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-06-02T05:06:05.546 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.546 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.546 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.546 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-06-02T05:06:05.546 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.546 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.546 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:05.547 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:05.547 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:05.547 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:05.547 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:05.547 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:05.547 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:05.547 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:05.547 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.547 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.547 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.547 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.547 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.548 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-06-02T05:06:05.548 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-06-02T05:06:05.548 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.548 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.548 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.548 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.548 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.548 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.548 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.548 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.548 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.548 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.548 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.548 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:05.549 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:05.549 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.549 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:05.549 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "k8sevents", 2024-06-02T05:06:05.549 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-06-02T05:06:05.549 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-06-02T05:06:05.549 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-06-02T05:06:05.549 INFO:teuthology.orchestra.run.smithi076.stdout: "ceph_event_retention_days": { 2024-06-02T05:06:05.549 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "ceph_event_retention_days", 2024-06-02T05:06:05.549 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:05.549 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.549 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.549 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "7", 2024-06-02T05:06:05.550 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.550 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.550 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.550 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Days to hold ceph event information within local cache", 2024-06-02T05:06:05.550 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.550 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.550 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.550 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.550 INFO:teuthology.orchestra.run.smithi076.stdout: "config_check_secs": { 2024-06-02T05:06:05.550 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "config_check_secs", 2024-06-02T05:06:05.550 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:05.550 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.551 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.551 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "10", 2024-06-02T05:06:05.551 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "10", 2024-06-02T05:06:05.551 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.551 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.551 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-06-02T05:06:05.551 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.551 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.551 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.551 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.551 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-06-02T05:06:05.551 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-06-02T05:06:05.551 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.551 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.552 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.552 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.552 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.552 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.552 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:05.552 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:05.552 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:05.552 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:05.552 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:05.552 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:05.552 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:05.552 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:05.552 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.553 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.553 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.553 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.553 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.553 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-06-02T05:06:05.553 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-06-02T05:06:05.553 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.553 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.553 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.553 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.553 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.553 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.553 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.553 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.554 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.554 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.554 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.554 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.554 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-06-02T05:06:05.554 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-06-02T05:06:05.554 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.554 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.554 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.554 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-06-02T05:06:05.554 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.555 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.555 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:05.555 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:05.555 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:05.555 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:05.555 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:05.555 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:05.555 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:05.555 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:05.555 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.555 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.555 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.555 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.555 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.556 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-06-02T05:06:05.556 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-06-02T05:06:05.556 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.556 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.556 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.556 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.556 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.556 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.556 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.556 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.556 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.556 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.556 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.557 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:05.557 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:05.557 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.557 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:05.557 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "localpool", 2024-06-02T05:06:05.557 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-06-02T05:06:05.557 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-06-02T05:06:05.557 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-06-02T05:06:05.557 INFO:teuthology.orchestra.run.smithi076.stdout: "failure_domain": { 2024-06-02T05:06:05.557 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "failure_domain", 2024-06-02T05:06:05.557 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.557 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.558 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.558 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "host", 2024-06-02T05:06:05.558 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.558 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.558 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.558 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "failure domain for any created local pool", 2024-06-02T05:06:05.558 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-06-02T05:06:05.558 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.558 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.558 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.558 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-06-02T05:06:05.558 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-06-02T05:06:05.559 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.559 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.559 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.559 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.559 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.559 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.559 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:05.559 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:05.559 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:05.559 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:05.559 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:05.559 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:05.559 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:05.559 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:05.560 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.560 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.560 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.560 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.560 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.560 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-06-02T05:06:05.560 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-06-02T05:06:05.560 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.560 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.560 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.560 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.560 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.560 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.561 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.561 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.561 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.561 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.561 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.561 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.561 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-06-02T05:06:05.561 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-06-02T05:06:05.561 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.561 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.561 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.561 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-06-02T05:06:05.561 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.562 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.562 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:05.562 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:05.562 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:05.562 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:05.562 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:05.562 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:05.562 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:05.562 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:05.562 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.562 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.562 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.563 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.563 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.563 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-06-02T05:06:05.563 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-06-02T05:06:05.563 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.563 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.563 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.563 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.563 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.563 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.563 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.563 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.563 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.564 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.564 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.564 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.564 INFO:teuthology.orchestra.run.smithi076.stdout: "min_size": { 2024-06-02T05:06:05.564 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "min_size", 2024-06-02T05:06:05.564 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:05.564 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.564 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.564 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.564 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.564 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.564 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.564 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "default min_size for any created local pool", 2024-06-02T05:06:05.565 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-06-02T05:06:05.565 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.565 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.565 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.565 INFO:teuthology.orchestra.run.smithi076.stdout: "num_rep": { 2024-06-02T05:06:05.565 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "num_rep", 2024-06-02T05:06:05.565 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:05.565 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.565 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.565 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "3", 2024-06-02T05:06:05.565 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.565 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.565 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.566 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "default replica count for any created local pool", 2024-06-02T05:06:05.566 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.566 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.566 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.566 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.566 INFO:teuthology.orchestra.run.smithi076.stdout: "pg_num": { 2024-06-02T05:06:05.566 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "pg_num", 2024-06-02T05:06:05.566 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:05.566 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.566 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.566 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "128", 2024-06-02T05:06:05.566 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.567 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.567 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.567 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "default pg_num for any created local pool", 2024-06-02T05:06:05.567 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.567 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.567 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.567 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.567 INFO:teuthology.orchestra.run.smithi076.stdout: "prefix": { 2024-06-02T05:06:05.567 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "prefix", 2024-06-02T05:06:05.567 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.567 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.567 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.568 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.568 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.568 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.568 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.568 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "name prefix for any created local pool", 2024-06-02T05:06:05.568 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.568 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.568 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.568 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.568 INFO:teuthology.orchestra.run.smithi076.stdout: "subtree": { 2024-06-02T05:06:05.568 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "subtree", 2024-06-02T05:06:05.568 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.568 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.569 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.569 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "rack", 2024-06-02T05:06:05.569 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.569 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.569 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.569 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "CRUSH level for which to create a local pool", 2024-06-02T05:06:05.569 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-06-02T05:06:05.569 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.569 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.569 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:05.569 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:05.569 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.570 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:05.570 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "mds_autoscaler", 2024-06-02T05:06:05.570 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-06-02T05:06:05.570 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-06-02T05:06:05.570 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-06-02T05:06:05.570 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-06-02T05:06:05.570 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-06-02T05:06:05.570 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.570 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.570 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.570 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.570 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.570 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.571 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:05.571 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:05.571 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:05.571 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:05.571 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:05.571 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:05.571 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:05.571 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:05.571 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.571 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.571 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.571 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.572 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.572 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-06-02T05:06:05.572 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-06-02T05:06:05.572 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.572 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.572 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.572 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.572 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.572 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.572 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.572 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.572 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.572 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.573 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.573 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.573 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-06-02T05:06:05.573 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-06-02T05:06:05.573 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.573 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.573 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.573 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-06-02T05:06:05.573 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.573 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.573 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:05.573 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:05.573 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:05.574 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:05.574 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:05.574 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:05.574 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:05.574 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:05.574 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.574 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.574 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.574 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.574 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.574 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-06-02T05:06:05.574 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-06-02T05:06:05.574 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.575 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.575 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.575 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.575 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.575 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.575 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.575 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.575 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.575 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.575 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.575 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:05.575 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:05.576 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.576 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:05.576 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "mirroring", 2024-06-02T05:06:05.576 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-06-02T05:06:05.576 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-06-02T05:06:05.576 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-06-02T05:06:05.576 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-06-02T05:06:05.576 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-06-02T05:06:05.576 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.576 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.576 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.576 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.577 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.577 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.577 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:05.577 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:05.577 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:05.577 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:05.577 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:05.577 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:05.577 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:05.577 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:05.577 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.577 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.577 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.578 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.578 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.578 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-06-02T05:06:05.578 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-06-02T05:06:05.578 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.578 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.578 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.578 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.578 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.578 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.578 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.578 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.578 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.579 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.579 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.579 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.579 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-06-02T05:06:05.579 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-06-02T05:06:05.579 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.579 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.579 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.579 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-06-02T05:06:05.579 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.579 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.579 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:05.579 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:05.580 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:05.580 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:05.580 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:05.580 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:05.580 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:05.580 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:05.580 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.580 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.580 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.580 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.580 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.580 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-06-02T05:06:05.580 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-06-02T05:06:05.581 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.581 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.581 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.581 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.581 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.581 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.581 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.581 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.581 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.581 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.581 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.581 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:05.581 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:05.582 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.582 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:05.582 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "nfs", 2024-06-02T05:06:05.582 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-06-02T05:06:05.582 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-06-02T05:06:05.582 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-06-02T05:06:05.582 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-06-02T05:06:05.582 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-06-02T05:06:05.582 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.582 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.582 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.582 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.582 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.583 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.583 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:05.583 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:05.583 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:05.583 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:05.583 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:05.583 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:05.583 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:05.583 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:05.583 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.583 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.583 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.583 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.583 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.584 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-06-02T05:06:05.584 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-06-02T05:06:05.584 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.584 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.584 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.584 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.584 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.584 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.584 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.584 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.584 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.584 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.585 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.585 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.585 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-06-02T05:06:05.585 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-06-02T05:06:05.585 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.585 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.585 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.585 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-06-02T05:06:05.585 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.585 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.585 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:05.585 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:05.585 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:05.586 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:05.586 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:05.586 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:05.586 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:05.586 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:05.586 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.586 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.586 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.586 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.586 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.586 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-06-02T05:06:05.586 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-06-02T05:06:05.586 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.587 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.587 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.587 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.587 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.587 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.587 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.587 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.587 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.587 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.587 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.587 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:05.587 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:05.587 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.587 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:05.588 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "orchestrator", 2024-06-02T05:06:05.588 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-06-02T05:06:05.588 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-06-02T05:06:05.588 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-06-02T05:06:05.588 INFO:teuthology.orchestra.run.smithi076.stdout: "fail_fs": { 2024-06-02T05:06:05.588 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "fail_fs", 2024-06-02T05:06:05.588 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.588 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.588 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.588 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.588 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.588 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.588 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.589 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-06-02T05:06:05.589 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.589 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.589 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.589 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.589 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-06-02T05:06:05.589 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-06-02T05:06:05.589 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.589 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.589 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.589 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.589 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.589 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.590 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:05.590 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:05.590 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:05.590 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:05.590 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:05.590 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:05.590 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:05.590 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:05.590 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.590 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.590 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.590 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.590 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.591 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-06-02T05:06:05.591 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-06-02T05:06:05.591 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.591 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.591 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.591 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.591 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.591 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.591 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.591 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.591 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.591 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.591 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.592 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.592 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-06-02T05:06:05.592 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-06-02T05:06:05.592 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.592 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.592 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.592 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-06-02T05:06:05.592 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.592 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.592 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:05.592 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:05.592 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:05.593 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:05.593 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:05.593 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:05.593 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:05.593 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:05.593 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.593 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.593 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.593 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.593 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.593 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-06-02T05:06:05.593 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-06-02T05:06:05.593 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.594 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.594 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.594 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.594 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.594 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.594 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.594 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.594 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.594 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.594 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.594 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.594 INFO:teuthology.orchestra.run.smithi076.stdout: "orchestrator": { 2024-06-02T05:06:05.594 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "orchestrator", 2024-06-02T05:06:05.595 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.595 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.595 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.595 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.595 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.595 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.595 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:05.595 INFO:teuthology.orchestra.run.smithi076.stdout: "cephadm", 2024-06-02T05:06:05.595 INFO:teuthology.orchestra.run.smithi076.stdout: "rook", 2024-06-02T05:06:05.595 INFO:teuthology.orchestra.run.smithi076.stdout: "test_orchestrator" 2024-06-02T05:06:05.595 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:05.595 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Orchestrator backend", 2024-06-02T05:06:05.595 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.596 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.596 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.596 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:05.596 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:05.596 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.596 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:05.596 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "osd_perf_query", 2024-06-02T05:06:05.596 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-06-02T05:06:05.596 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-06-02T05:06:05.596 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-06-02T05:06:05.596 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-06-02T05:06:05.596 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-06-02T05:06:05.596 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.597 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.597 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.597 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.597 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.597 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.597 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:05.597 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:05.597 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:05.597 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:05.597 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:05.597 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:05.597 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:05.598 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:05.598 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.598 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.598 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.598 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.598 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.598 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-06-02T05:06:05.598 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-06-02T05:06:05.598 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.598 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.598 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.598 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.598 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.599 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.599 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.599 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.599 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.599 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.599 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.599 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.599 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-06-02T05:06:05.599 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-06-02T05:06:05.599 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.599 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.600 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.600 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-06-02T05:06:05.600 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.600 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.600 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:05.600 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:05.600 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:05.600 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:05.600 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:05.600 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:05.600 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:05.600 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:05.600 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.601 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.601 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.601 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.601 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.601 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-06-02T05:06:05.601 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-06-02T05:06:05.601 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.601 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.601 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.601 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.601 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.601 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.601 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.602 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.602 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.602 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.602 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.602 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:05.602 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:05.602 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.602 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:05.602 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "osd_support", 2024-06-02T05:06:05.602 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-06-02T05:06:05.602 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-06-02T05:06:05.603 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-06-02T05:06:05.603 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-06-02T05:06:05.603 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-06-02T05:06:05.603 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.603 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.603 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.603 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.603 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.603 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.603 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:05.603 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:05.603 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:05.603 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:05.604 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:05.604 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:05.604 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:05.604 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:05.604 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.604 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.604 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.604 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.604 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.604 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-06-02T05:06:05.604 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-06-02T05:06:05.604 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.605 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.605 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.605 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.605 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.605 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.605 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.605 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.605 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.605 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.605 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.605 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.605 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-06-02T05:06:05.605 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-06-02T05:06:05.606 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.606 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.606 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.606 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-06-02T05:06:05.606 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.606 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.606 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:05.606 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:05.606 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:05.606 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:05.606 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:05.607 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:05.607 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:05.607 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:05.607 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.607 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.607 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.607 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.607 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.607 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-06-02T05:06:05.607 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-06-02T05:06:05.607 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.607 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.607 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.608 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.608 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.608 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.608 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.608 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.608 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.608 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.608 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.608 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:05.608 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:05.608 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.609 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:05.609 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "pg_autoscaler", 2024-06-02T05:06:05.609 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-06-02T05:06:05.609 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-06-02T05:06:05.609 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-06-02T05:06:05.609 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-06-02T05:06:05.609 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-06-02T05:06:05.609 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.609 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.609 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.609 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.609 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.609 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.610 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:05.610 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:05.610 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:05.610 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:05.610 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:05.610 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:05.610 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:05.610 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:05.610 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.610 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.610 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.610 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.610 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.611 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-06-02T05:06:05.611 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-06-02T05:06:05.611 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.611 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.611 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.611 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.611 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.611 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.611 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.611 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.611 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.611 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.611 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.612 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.612 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-06-02T05:06:05.612 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-06-02T05:06:05.612 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.612 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.612 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.612 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-06-02T05:06:05.612 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.612 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.612 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:05.612 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:05.612 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:05.612 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:05.613 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:05.613 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:05.613 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:05.613 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:05.613 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.613 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.613 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.613 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.613 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.613 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-06-02T05:06:05.613 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-06-02T05:06:05.613 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.613 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.614 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.614 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.614 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.614 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.614 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.614 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.614 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.614 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.614 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.614 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.614 INFO:teuthology.orchestra.run.smithi076.stdout: "sleep_interval": { 2024-06-02T05:06:05.614 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "sleep_interval", 2024-06-02T05:06:05.614 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-06-02T05:06:05.615 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.615 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.615 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "60", 2024-06-02T05:06:05.615 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.615 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.615 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.615 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.615 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.615 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.615 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.615 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.616 INFO:teuthology.orchestra.run.smithi076.stdout: "threshold": { 2024-06-02T05:06:05.616 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "threshold", 2024-06-02T05:06:05.616 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "float", 2024-06-02T05:06:05.616 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.616 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.616 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "3.0", 2024-06-02T05:06:05.616 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "1.0", 2024-06-02T05:06:05.616 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.616 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.616 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "scaling threshold", 2024-06-02T05:06:05.616 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-06-02T05:06:05.616 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.616 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.617 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:05.617 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:05.617 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.617 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:05.617 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "progress", 2024-06-02T05:06:05.617 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-06-02T05:06:05.617 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-06-02T05:06:05.617 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-06-02T05:06:05.617 INFO:teuthology.orchestra.run.smithi076.stdout: "allow_pg_recovery_event": { 2024-06-02T05:06:05.617 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "allow_pg_recovery_event", 2024-06-02T05:06:05.617 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.617 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.618 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.618 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.618 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.618 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.618 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.618 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "allow the module to show pg recovery progress", 2024-06-02T05:06:05.618 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.618 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.618 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.618 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.618 INFO:teuthology.orchestra.run.smithi076.stdout: "enabled": { 2024-06-02T05:06:05.618 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "enabled", 2024-06-02T05:06:05.618 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.619 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.619 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.619 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:05.619 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.619 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.619 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.619 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.619 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.619 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.619 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.619 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.619 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-06-02T05:06:05.620 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-06-02T05:06:05.620 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.620 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.620 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.620 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.620 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.620 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.620 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:05.620 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:05.620 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:05.620 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:05.620 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:05.620 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:05.620 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:05.621 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:05.621 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.621 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.621 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.621 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.621 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.621 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-06-02T05:06:05.621 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-06-02T05:06:05.621 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.621 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.621 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.621 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.621 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.622 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.622 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.622 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.622 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.622 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.622 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.622 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.622 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-06-02T05:06:05.622 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-06-02T05:06:05.622 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.622 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.622 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.623 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-06-02T05:06:05.623 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.623 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.623 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:05.623 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:05.623 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:05.623 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:05.623 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:05.623 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:05.623 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:05.623 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:05.623 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.623 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.624 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.624 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.624 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.624 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-06-02T05:06:05.624 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-06-02T05:06:05.624 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.624 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.624 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.624 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.624 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.624 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.624 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.625 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.625 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.625 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.625 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.625 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.625 INFO:teuthology.orchestra.run.smithi076.stdout: "max_completed_events": { 2024-06-02T05:06:05.625 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "max_completed_events", 2024-06-02T05:06:05.625 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:05.625 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.625 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.625 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "50", 2024-06-02T05:06:05.625 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.625 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.625 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.626 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "number of past completed events to remember", 2024-06-02T05:06:05.626 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.626 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.626 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.626 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.626 INFO:teuthology.orchestra.run.smithi076.stdout: "sleep_interval": { 2024-06-02T05:06:05.626 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "sleep_interval", 2024-06-02T05:06:05.626 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-06-02T05:06:05.626 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.626 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.626 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "5", 2024-06-02T05:06:05.626 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.627 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.627 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.627 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "how long the module is going to sleep", 2024-06-02T05:06:05.627 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.627 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.627 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.627 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:05.627 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:05.627 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.627 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:05.627 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "prometheus", 2024-06-02T05:06:05.627 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-06-02T05:06:05.627 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-06-02T05:06:05.628 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-06-02T05:06:05.628 INFO:teuthology.orchestra.run.smithi076.stdout: "cache": { 2024-06-02T05:06:05.628 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "cache", 2024-06-02T05:06:05.628 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.628 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.628 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.628 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:05.628 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.628 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.628 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.628 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.628 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.628 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.628 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.629 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.629 INFO:teuthology.orchestra.run.smithi076.stdout: "exclude_perf_counters": { 2024-06-02T05:06:05.629 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "exclude_perf_counters", 2024-06-02T05:06:05.629 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.629 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.629 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.629 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:05.629 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.629 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.629 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.629 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-06-02T05:06:05.629 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-06-02T05:06:05.630 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.630 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.630 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.630 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-06-02T05:06:05.630 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-06-02T05:06:05.630 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.630 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.630 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.630 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.630 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.630 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.630 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:05.630 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:05.631 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:05.631 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:05.631 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:05.631 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:05.631 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:05.631 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:05.631 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.631 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.631 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.631 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.631 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.631 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-06-02T05:06:05.631 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-06-02T05:06:05.632 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.632 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.632 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.632 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.632 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.632 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.632 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.632 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.632 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.632 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.632 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.632 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.633 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-06-02T05:06:05.633 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-06-02T05:06:05.633 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.633 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.633 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.633 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-06-02T05:06:05.633 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.633 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.633 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:05.633 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:05.633 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:05.633 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:05.633 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:05.633 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:05.634 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:05.634 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:05.634 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.634 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.634 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.634 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.634 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.634 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-06-02T05:06:05.634 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-06-02T05:06:05.634 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.634 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.634 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.635 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.635 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.635 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.635 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.635 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.635 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.635 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.635 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.635 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.635 INFO:teuthology.orchestra.run.smithi076.stdout: "rbd_stats_pools": { 2024-06-02T05:06:05.635 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "rbd_stats_pools", 2024-06-02T05:06:05.635 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.635 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.636 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.636 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.636 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.636 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.636 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.636 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.636 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.636 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.636 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.636 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.636 INFO:teuthology.orchestra.run.smithi076.stdout: "rbd_stats_pools_refresh_interval": { 2024-06-02T05:06:05.636 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-06-02T05:06:05.637 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:05.637 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.637 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.637 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "300", 2024-06-02T05:06:05.637 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.637 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.637 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.637 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.637 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.637 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.637 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.637 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.637 INFO:teuthology.orchestra.run.smithi076.stdout: "scrape_interval": { 2024-06-02T05:06:05.638 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "scrape_interval", 2024-06-02T05:06:05.638 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "float", 2024-06-02T05:06:05.638 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.638 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.638 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "15.0", 2024-06-02T05:06:05.638 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.638 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.638 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.638 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.638 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.638 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.638 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.638 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.639 INFO:teuthology.orchestra.run.smithi076.stdout: "server_addr": { 2024-06-02T05:06:05.639 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "server_addr", 2024-06-02T05:06:05.639 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.639 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.639 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.639 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "::", 2024-06-02T05:06:05.639 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.639 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.639 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.639 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-06-02T05:06:05.639 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.639 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.639 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.640 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.640 INFO:teuthology.orchestra.run.smithi076.stdout: "server_port": { 2024-06-02T05:06:05.640 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "server_port", 2024-06-02T05:06:05.640 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:05.640 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.640 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.640 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "9283", 2024-06-02T05:06:05.640 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.640 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.640 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.640 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-06-02T05:06:05.640 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.641 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.641 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.641 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.641 INFO:teuthology.orchestra.run.smithi076.stdout: "stale_cache_strategy": { 2024-06-02T05:06:05.641 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "stale_cache_strategy", 2024-06-02T05:06:05.641 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.641 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.641 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.641 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "log", 2024-06-02T05:06:05.641 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.641 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.641 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.641 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.642 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.642 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.642 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.642 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.642 INFO:teuthology.orchestra.run.smithi076.stdout: "standby_behaviour": { 2024-06-02T05:06:05.642 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "standby_behaviour", 2024-06-02T05:06:05.642 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.642 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.642 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.642 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "default", 2024-06-02T05:06:05.642 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.642 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.642 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:05.643 INFO:teuthology.orchestra.run.smithi076.stdout: "default", 2024-06-02T05:06:05.643 INFO:teuthology.orchestra.run.smithi076.stdout: "error" 2024-06-02T05:06:05.643 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:05.643 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.643 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.643 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.643 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.643 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.643 INFO:teuthology.orchestra.run.smithi076.stdout: "standby_error_status_code": { 2024-06-02T05:06:05.643 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "standby_error_status_code", 2024-06-02T05:06:05.643 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:05.643 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.643 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.644 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "500", 2024-06-02T05:06:05.644 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "400", 2024-06-02T05:06:05.644 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "599", 2024-06-02T05:06:05.644 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.644 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.644 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.644 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.644 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.644 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:05.644 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:05.644 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.644 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:05.645 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "rbd_support", 2024-06-02T05:06:05.645 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-06-02T05:06:05.645 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-06-02T05:06:05.645 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-06-02T05:06:05.645 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-06-02T05:06:05.645 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-06-02T05:06:05.645 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.645 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.645 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.645 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.645 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.645 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.645 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:05.646 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:05.646 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:05.646 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:05.646 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:05.646 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:05.646 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:05.646 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:05.646 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.646 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.646 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.646 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.646 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.646 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-06-02T05:06:05.647 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-06-02T05:06:05.647 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.647 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.647 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.647 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.647 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.647 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.647 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.647 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.647 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.647 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.647 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.647 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.648 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-06-02T05:06:05.648 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-06-02T05:06:05.648 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.648 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.648 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.648 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-06-02T05:06:05.648 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.648 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.648 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:05.648 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:05.648 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:05.648 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:05.648 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:05.649 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:05.649 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:05.649 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:05.649 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.649 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.649 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.649 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.649 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.649 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-06-02T05:06:05.649 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-06-02T05:06:05.649 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.649 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.650 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.650 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.650 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.650 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.650 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.650 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.650 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.650 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.650 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.650 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.650 INFO:teuthology.orchestra.run.smithi076.stdout: "max_concurrent_snap_create": { 2024-06-02T05:06:05.650 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "max_concurrent_snap_create", 2024-06-02T05:06:05.650 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:05.651 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.651 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.651 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "10", 2024-06-02T05:06:05.651 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.651 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.651 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.651 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.651 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.651 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.651 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.651 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.651 INFO:teuthology.orchestra.run.smithi076.stdout: "mirror_snapshot_schedule": { 2024-06-02T05:06:05.652 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "mirror_snapshot_schedule", 2024-06-02T05:06:05.652 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.652 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.652 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.652 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.652 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.652 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.652 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.652 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.652 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.652 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.652 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.653 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.653 INFO:teuthology.orchestra.run.smithi076.stdout: "trash_purge_schedule": { 2024-06-02T05:06:05.653 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "trash_purge_schedule", 2024-06-02T05:06:05.653 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.653 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.653 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.653 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.653 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.653 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.653 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.653 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.653 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.654 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.654 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.654 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:05.654 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:05.654 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.654 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:05.654 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "restful", 2024-06-02T05:06:05.654 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-06-02T05:06:05.654 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-06-02T05:06:05.654 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-06-02T05:06:05.654 INFO:teuthology.orchestra.run.smithi076.stdout: "enable_auth": { 2024-06-02T05:06:05.654 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "enable_auth", 2024-06-02T05:06:05.654 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.655 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.655 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.655 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:05.655 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.655 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.655 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.655 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.655 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.655 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.655 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.655 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.655 INFO:teuthology.orchestra.run.smithi076.stdout: "key_file": { 2024-06-02T05:06:05.656 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "key_file", 2024-06-02T05:06:05.656 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.656 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.656 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.656 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.656 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.656 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.656 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.656 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.656 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.656 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.656 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.656 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.657 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-06-02T05:06:05.657 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-06-02T05:06:05.657 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.657 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.657 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.657 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.657 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.657 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.657 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:05.657 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:05.657 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:05.657 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:05.657 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:05.658 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:05.658 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:05.658 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:05.658 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.658 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.658 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.658 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.658 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.658 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-06-02T05:06:05.658 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-06-02T05:06:05.658 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.658 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.658 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.659 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.659 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.659 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.659 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.659 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.659 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.659 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.659 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.659 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.659 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-06-02T05:06:05.659 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-06-02T05:06:05.659 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.660 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.660 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.660 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-06-02T05:06:05.660 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.660 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.660 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:05.660 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:05.660 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:05.660 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:05.660 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:05.660 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:05.661 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:05.661 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:05.661 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.661 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.661 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.661 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.661 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.661 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-06-02T05:06:05.661 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-06-02T05:06:05.661 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.661 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.661 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.661 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.662 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.662 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.662 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.662 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.662 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.662 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.662 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.662 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.662 INFO:teuthology.orchestra.run.smithi076.stdout: "server_addr": { 2024-06-02T05:06:05.662 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "server_addr", 2024-06-02T05:06:05.662 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.662 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.663 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.663 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.663 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.663 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.663 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.663 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.663 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.663 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.663 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.663 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.663 INFO:teuthology.orchestra.run.smithi076.stdout: "server_port": { 2024-06-02T05:06:05.663 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "server_port", 2024-06-02T05:06:05.663 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.664 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.664 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.664 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.664 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.664 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.664 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.664 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.664 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.664 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.664 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.664 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:05.664 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:05.664 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.664 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:05.665 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "rgw", 2024-06-02T05:06:05.665 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-06-02T05:06:05.665 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-06-02T05:06:05.665 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-06-02T05:06:05.665 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-06-02T05:06:05.665 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-06-02T05:06:05.665 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.665 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.665 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.665 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.665 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.665 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.665 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:05.666 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:05.666 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:05.666 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:05.666 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:05.666 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:05.666 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:05.666 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:05.666 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.666 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.666 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.666 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.666 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.667 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-06-02T05:06:05.667 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-06-02T05:06:05.667 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.667 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.667 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.667 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.667 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.667 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.667 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.667 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.667 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.667 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.667 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.667 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.668 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-06-02T05:06:05.668 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-06-02T05:06:05.668 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.668 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.668 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.668 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-06-02T05:06:05.668 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.668 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.668 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:05.668 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:05.668 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:05.668 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:05.668 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:05.668 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:05.669 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:05.669 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:05.669 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.669 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.669 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.669 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.669 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.669 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-06-02T05:06:05.669 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-06-02T05:06:05.669 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.669 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.669 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.669 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.670 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.670 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.670 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.670 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.670 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.670 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.670 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.670 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:05.670 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:05.670 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.670 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:05.670 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "rook", 2024-06-02T05:06:05.670 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-06-02T05:06:05.671 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-06-02T05:06:05.671 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-06-02T05:06:05.671 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-06-02T05:06:05.671 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-06-02T05:06:05.671 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.671 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.671 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.671 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.671 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.671 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.671 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:05.671 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:05.672 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:05.672 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:05.672 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:05.672 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:05.672 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:05.672 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:05.672 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.672 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.672 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.672 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.672 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.672 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-06-02T05:06:05.672 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-06-02T05:06:05.673 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.673 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.673 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.673 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.673 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.673 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.673 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.673 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.673 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.673 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.673 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.673 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.674 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-06-02T05:06:05.674 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-06-02T05:06:05.674 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.674 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.674 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.674 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-06-02T05:06:05.674 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.674 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.674 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:05.674 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:05.674 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:05.674 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:05.674 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:05.675 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:05.675 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:05.675 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:05.675 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.675 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.675 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.675 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.675 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.675 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-06-02T05:06:05.675 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-06-02T05:06:05.675 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.676 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.676 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.676 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.676 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.676 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.676 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.676 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.676 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.676 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.676 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.676 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.676 INFO:teuthology.orchestra.run.smithi076.stdout: "storage_class": { 2024-06-02T05:06:05.676 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "storage_class", 2024-06-02T05:06:05.677 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.677 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.677 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.677 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "local", 2024-06-02T05:06:05.677 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.677 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.677 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.677 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-06-02T05:06:05.677 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.677 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.677 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.677 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:05.677 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:05.678 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.678 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:05.678 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "selftest", 2024-06-02T05:06:05.678 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-06-02T05:06:05.678 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-06-02T05:06:05.678 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-06-02T05:06:05.678 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-06-02T05:06:05.678 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-06-02T05:06:05.678 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.678 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.678 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.678 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.679 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.679 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.679 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:05.679 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:05.679 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:05.679 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:05.679 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:05.679 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:05.679 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:05.679 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:05.679 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.679 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.679 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.679 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.680 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.680 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-06-02T05:06:05.680 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-06-02T05:06:05.680 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.680 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.680 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.680 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.680 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.680 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.680 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.680 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.680 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.681 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.681 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.681 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.681 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-06-02T05:06:05.681 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-06-02T05:06:05.681 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.681 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.681 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.681 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-06-02T05:06:05.681 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.681 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.681 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:05.681 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:05.682 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:05.682 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:05.682 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:05.682 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:05.682 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:05.682 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:05.682 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.682 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.682 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.682 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.682 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.682 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-06-02T05:06:05.682 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-06-02T05:06:05.683 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.683 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.683 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.683 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.683 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.683 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.683 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.683 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.683 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.683 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.683 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.683 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.684 INFO:teuthology.orchestra.run.smithi076.stdout: "roption1": { 2024-06-02T05:06:05.684 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "roption1", 2024-06-02T05:06:05.684 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.684 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.684 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.684 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.684 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.684 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.684 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.684 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.684 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.684 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.684 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.685 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.685 INFO:teuthology.orchestra.run.smithi076.stdout: "roption2": { 2024-06-02T05:06:05.685 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "roption2", 2024-06-02T05:06:05.685 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.685 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.685 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.685 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "xyz", 2024-06-02T05:06:05.685 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.685 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.685 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.685 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.685 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.685 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.686 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.686 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.686 INFO:teuthology.orchestra.run.smithi076.stdout: "rwoption1": { 2024-06-02T05:06:05.686 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "rwoption1", 2024-06-02T05:06:05.686 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.686 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.686 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.686 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.686 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.686 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.686 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.686 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.687 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.687 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.687 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.687 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.687 INFO:teuthology.orchestra.run.smithi076.stdout: "rwoption2": { 2024-06-02T05:06:05.687 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "rwoption2", 2024-06-02T05:06:05.687 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:05.687 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.687 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.687 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.687 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.687 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.687 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.687 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.688 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.688 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.688 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.688 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.688 INFO:teuthology.orchestra.run.smithi076.stdout: "rwoption3": { 2024-06-02T05:06:05.688 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "rwoption3", 2024-06-02T05:06:05.688 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "float", 2024-06-02T05:06:05.688 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.688 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.688 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.688 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.688 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.688 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.689 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.689 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.689 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.689 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.689 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.689 INFO:teuthology.orchestra.run.smithi076.stdout: "rwoption4": { 2024-06-02T05:06:05.689 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "rwoption4", 2024-06-02T05:06:05.689 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.689 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.689 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.689 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.689 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.689 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.690 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.690 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.690 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.690 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.690 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.690 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.690 INFO:teuthology.orchestra.run.smithi076.stdout: "rwoption5": { 2024-06-02T05:06:05.690 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "rwoption5", 2024-06-02T05:06:05.690 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.690 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.690 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.690 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.690 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.691 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.691 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.691 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.691 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.691 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.691 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.691 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.691 INFO:teuthology.orchestra.run.smithi076.stdout: "rwoption6": { 2024-06-02T05:06:05.691 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "rwoption6", 2024-06-02T05:06:05.691 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.691 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.691 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.691 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:05.692 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.692 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.692 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.692 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.692 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.692 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.692 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.692 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.692 INFO:teuthology.orchestra.run.smithi076.stdout: "rwoption7": { 2024-06-02T05:06:05.692 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "rwoption7", 2024-06-02T05:06:05.692 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:05.692 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.692 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.693 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.693 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "1", 2024-06-02T05:06:05.693 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "42", 2024-06-02T05:06:05.693 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.693 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.693 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.693 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.693 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.693 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.693 INFO:teuthology.orchestra.run.smithi076.stdout: "testkey": { 2024-06-02T05:06:05.693 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "testkey", 2024-06-02T05:06:05.693 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.693 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.694 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.694 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.694 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.694 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.694 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.694 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.694 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.694 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.694 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.694 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.694 INFO:teuthology.orchestra.run.smithi076.stdout: "testlkey": { 2024-06-02T05:06:05.694 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "testlkey", 2024-06-02T05:06:05.694 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.695 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.695 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.695 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.695 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.695 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.695 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.695 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.695 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.695 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.695 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.695 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.695 INFO:teuthology.orchestra.run.smithi076.stdout: "testnewline": { 2024-06-02T05:06:05.695 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "testnewline", 2024-06-02T05:06:05.695 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.696 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.696 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.696 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.696 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.696 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.696 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.696 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.696 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.696 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.696 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.696 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:05.696 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:05.696 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.697 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:05.697 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "snap_schedule", 2024-06-02T05:06:05.697 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-06-02T05:06:05.697 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-06-02T05:06:05.697 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-06-02T05:06:05.697 INFO:teuthology.orchestra.run.smithi076.stdout: "allow_m_granularity": { 2024-06-02T05:06:05.697 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "allow_m_granularity", 2024-06-02T05:06:05.697 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.697 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.697 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.697 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.697 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.697 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.698 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.698 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "allow minute scheduled snapshots", 2024-06-02T05:06:05.698 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.698 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.698 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.698 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.698 INFO:teuthology.orchestra.run.smithi076.stdout: "dump_on_update": { 2024-06-02T05:06:05.698 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "dump_on_update", 2024-06-02T05:06:05.698 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.698 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.698 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.698 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.699 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.699 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.699 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.699 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "dump database to debug log on update", 2024-06-02T05:06:05.699 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.699 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.699 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.699 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.699 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-06-02T05:06:05.699 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-06-02T05:06:05.699 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.699 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.699 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.700 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.700 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.700 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.700 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:05.700 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:05.700 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:05.700 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:05.700 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:05.700 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:05.700 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:05.700 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:05.700 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.700 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.701 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.701 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.701 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.701 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-06-02T05:06:05.701 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-06-02T05:06:05.701 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.701 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.701 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.701 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.701 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.701 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.701 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.701 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.701 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.702 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.702 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.702 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.702 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-06-02T05:06:05.702 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-06-02T05:06:05.702 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.702 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.702 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.702 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-06-02T05:06:05.702 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.702 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.702 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:05.702 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:05.703 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:05.703 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:05.703 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:05.703 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:05.703 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:05.703 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:05.703 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.703 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.703 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.703 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.703 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.703 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-06-02T05:06:05.703 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-06-02T05:06:05.704 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.704 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.704 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.704 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.704 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.704 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.704 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.704 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.704 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.704 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.704 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.704 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:05.704 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:05.705 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.705 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:05.705 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "stats", 2024-06-02T05:06:05.705 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-06-02T05:06:05.705 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-06-02T05:06:05.705 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-06-02T05:06:05.705 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-06-02T05:06:05.705 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-06-02T05:06:05.705 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.705 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.705 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.705 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.705 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.706 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.706 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:05.706 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:05.706 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:05.706 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:05.706 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:05.706 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:05.706 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:05.706 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:05.706 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.706 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.706 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.706 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.707 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.707 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-06-02T05:06:05.707 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-06-02T05:06:05.707 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.707 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.707 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.707 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.707 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.707 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.707 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.707 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.707 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.707 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.708 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.708 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.708 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-06-02T05:06:05.708 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-06-02T05:06:05.708 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.708 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.708 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.708 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-06-02T05:06:05.708 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.708 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.708 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:05.708 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:05.708 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:05.709 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:05.709 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:05.709 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:05.709 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:05.709 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:05.709 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.709 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.709 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.709 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.709 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.709 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-06-02T05:06:05.709 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-06-02T05:06:05.709 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.710 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.710 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.710 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.710 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.710 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.710 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.710 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.710 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.710 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.710 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.710 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:05.710 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:05.710 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.711 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:05.711 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "status", 2024-06-02T05:06:05.711 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-06-02T05:06:05.711 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-06-02T05:06:05.711 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-06-02T05:06:05.711 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-06-02T05:06:05.711 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-06-02T05:06:05.711 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.711 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.711 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.711 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.711 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.711 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.712 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:05.712 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:05.712 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:05.712 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:05.712 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:05.712 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:05.712 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:05.712 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:05.712 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.712 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.712 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.712 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.712 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.712 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-06-02T05:06:05.713 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-06-02T05:06:05.713 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.713 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.713 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.713 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.713 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.713 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.713 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.713 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.713 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.713 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.713 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.713 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.714 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-06-02T05:06:05.714 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-06-02T05:06:05.714 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.714 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.714 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.714 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-06-02T05:06:05.714 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.714 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.714 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:05.714 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:05.714 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:05.714 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:05.714 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:05.715 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:05.715 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:05.715 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:05.715 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.715 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.715 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.715 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.715 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.715 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-06-02T05:06:05.715 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-06-02T05:06:05.715 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.715 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.715 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.716 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.716 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.716 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.716 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.716 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.716 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.716 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.716 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.716 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:05.716 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:05.716 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.716 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:05.716 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "telegraf", 2024-06-02T05:06:05.716 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-06-02T05:06:05.717 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-06-02T05:06:05.717 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-06-02T05:06:05.717 INFO:teuthology.orchestra.run.smithi076.stdout: "address": { 2024-06-02T05:06:05.717 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "address", 2024-06-02T05:06:05.717 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.717 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.717 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.717 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-06-02T05:06:05.717 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.717 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.717 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.717 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.717 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.718 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.718 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.718 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.718 INFO:teuthology.orchestra.run.smithi076.stdout: "interval": { 2024-06-02T05:06:05.718 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "interval", 2024-06-02T05:06:05.718 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-06-02T05:06:05.718 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.718 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.718 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "15", 2024-06-02T05:06:05.718 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.718 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.718 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.718 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.718 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.719 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.719 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.719 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.719 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-06-02T05:06:05.719 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-06-02T05:06:05.719 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.719 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.719 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.719 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.719 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.719 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.719 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:05.719 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:05.720 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:05.720 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:05.720 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:05.720 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:05.720 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:05.720 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:05.720 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.720 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.720 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.720 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.720 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.720 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-06-02T05:06:05.721 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-06-02T05:06:05.721 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.721 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.721 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.721 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.721 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.721 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.721 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.721 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.721 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.721 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.721 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.721 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.722 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-06-02T05:06:05.722 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-06-02T05:06:05.722 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.722 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.722 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.722 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-06-02T05:06:05.722 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.722 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.722 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:05.722 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:05.722 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:05.722 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:05.722 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:05.723 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:05.723 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:05.723 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:05.723 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.723 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.723 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.723 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.723 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.723 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-06-02T05:06:05.723 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-06-02T05:06:05.723 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.723 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.723 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.724 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.724 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.724 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.724 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.724 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.724 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.724 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.724 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.724 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:05.724 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:05.724 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.724 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:05.724 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "telemetry", 2024-06-02T05:06:05.724 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-06-02T05:06:05.725 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-06-02T05:06:05.725 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-06-02T05:06:05.725 INFO:teuthology.orchestra.run.smithi076.stdout: "channel_basic": { 2024-06-02T05:06:05.725 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "channel_basic", 2024-06-02T05:06:05.725 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.725 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.725 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.725 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:05.725 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.725 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.725 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.725 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Share basic cluster information (size, version)", 2024-06-02T05:06:05.726 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.726 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.726 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.726 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.726 INFO:teuthology.orchestra.run.smithi076.stdout: "channel_crash": { 2024-06-02T05:06:05.726 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "channel_crash", 2024-06-02T05:06:05.726 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.726 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.726 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.726 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:05.726 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.726 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.726 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.727 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-06-02T05:06:05.727 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.727 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.727 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.727 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.727 INFO:teuthology.orchestra.run.smithi076.stdout: "channel_device": { 2024-06-02T05:06:05.727 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "channel_device", 2024-06-02T05:06:05.727 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.727 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.727 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.727 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:05.727 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.728 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.728 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.728 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-06-02T05:06:05.728 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.728 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.728 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.728 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.728 INFO:teuthology.orchestra.run.smithi076.stdout: "channel_ident": { 2024-06-02T05:06:05.728 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "channel_ident", 2024-06-02T05:06:05.728 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.728 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.728 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.728 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.729 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.729 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.729 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.729 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-06-02T05:06:05.729 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.729 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.729 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.729 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.729 INFO:teuthology.orchestra.run.smithi076.stdout: "channel_perf": { 2024-06-02T05:06:05.729 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "channel_perf", 2024-06-02T05:06:05.729 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.729 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.729 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.730 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.730 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.730 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.730 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.730 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Share various performance metrics of a cluster", 2024-06-02T05:06:05.730 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.730 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.730 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.730 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.730 INFO:teuthology.orchestra.run.smithi076.stdout: "contact": { 2024-06-02T05:06:05.730 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "contact", 2024-06-02T05:06:05.730 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.731 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.731 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.731 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.731 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.731 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.731 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.731 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.731 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.731 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.731 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.731 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.731 INFO:teuthology.orchestra.run.smithi076.stdout: "description": { 2024-06-02T05:06:05.731 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "description", 2024-06-02T05:06:05.732 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.732 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.732 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.732 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.732 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.732 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.732 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.732 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.732 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.732 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.732 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.732 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.732 INFO:teuthology.orchestra.run.smithi076.stdout: "device_url": { 2024-06-02T05:06:05.732 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "device_url", 2024-06-02T05:06:05.733 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.733 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.733 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.733 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-06-02T05:06:05.733 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.733 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.733 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.733 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.733 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.733 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.733 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.733 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.733 INFO:teuthology.orchestra.run.smithi076.stdout: "enabled": { 2024-06-02T05:06:05.734 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "enabled", 2024-06-02T05:06:05.734 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.734 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.734 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.734 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.734 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.734 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.734 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.734 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.734 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.734 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.734 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.735 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.735 INFO:teuthology.orchestra.run.smithi076.stdout: "interval": { 2024-06-02T05:06:05.735 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "interval", 2024-06-02T05:06:05.735 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:05.735 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.735 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.735 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "24", 2024-06-02T05:06:05.735 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "8", 2024-06-02T05:06:05.735 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.735 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.735 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.735 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.736 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.736 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.736 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.736 INFO:teuthology.orchestra.run.smithi076.stdout: "last_opt_revision": { 2024-06-02T05:06:05.736 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "last_opt_revision", 2024-06-02T05:06:05.736 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:05.736 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.736 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.736 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "1", 2024-06-02T05:06:05.736 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.736 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.736 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.736 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.737 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.737 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.737 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.737 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.737 INFO:teuthology.orchestra.run.smithi076.stdout: "leaderboard": { 2024-06-02T05:06:05.737 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "leaderboard", 2024-06-02T05:06:05.737 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.737 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.737 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.737 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.737 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.737 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.737 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.738 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.738 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.738 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.738 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.738 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.738 INFO:teuthology.orchestra.run.smithi076.stdout: "leaderboard_description": { 2024-06-02T05:06:05.738 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "leaderboard_description", 2024-06-02T05:06:05.738 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.738 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.738 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.738 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.738 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.738 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.739 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.739 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.739 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.739 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.739 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.739 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.739 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-06-02T05:06:05.739 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-06-02T05:06:05.739 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.739 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.739 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.739 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.739 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.740 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.740 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:05.740 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:05.740 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:05.740 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:05.740 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:05.740 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:05.740 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:05.740 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:05.740 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.740 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.740 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.740 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.741 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.741 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-06-02T05:06:05.741 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-06-02T05:06:05.741 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.741 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.741 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.741 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.741 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.741 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.741 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.741 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.741 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.741 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.742 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.742 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.742 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-06-02T05:06:05.742 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-06-02T05:06:05.742 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.742 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.742 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.742 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-06-02T05:06:05.742 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.742 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.742 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:05.742 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:05.742 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:05.743 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:05.743 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:05.743 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:05.743 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:05.743 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:05.743 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.743 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.743 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.743 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.743 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.743 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-06-02T05:06:05.743 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-06-02T05:06:05.744 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.744 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.744 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.744 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.744 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.744 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.744 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.744 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.744 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.744 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.744 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.744 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.744 INFO:teuthology.orchestra.run.smithi076.stdout: "organization": { 2024-06-02T05:06:05.744 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "organization", 2024-06-02T05:06:05.745 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.745 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.745 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.745 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.745 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.745 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.745 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.745 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.745 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.745 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.745 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.745 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.746 INFO:teuthology.orchestra.run.smithi076.stdout: "proxy": { 2024-06-02T05:06:05.746 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "proxy", 2024-06-02T05:06:05.746 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.746 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.746 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.746 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.746 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.746 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.746 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.746 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.746 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.746 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.746 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.747 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.747 INFO:teuthology.orchestra.run.smithi076.stdout: "url": { 2024-06-02T05:06:05.747 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "url", 2024-06-02T05:06:05.747 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.747 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.747 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.747 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-06-02T05:06:05.747 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.747 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.747 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.747 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.747 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.747 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.748 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.748 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:05.748 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:05.748 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.748 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:05.748 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "test_orchestrator", 2024-06-02T05:06:05.748 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-06-02T05:06:05.748 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-06-02T05:06:05.748 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-06-02T05:06:05.748 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-06-02T05:06:05.748 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-06-02T05:06:05.748 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.748 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.748 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.749 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.749 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.749 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.749 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:05.749 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:05.749 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:05.749 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:05.749 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:05.749 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:05.749 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:05.749 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:05.749 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.749 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.749 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.750 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.750 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.750 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-06-02T05:06:05.750 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-06-02T05:06:05.750 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.750 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.750 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.750 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.750 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.750 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.750 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.750 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.751 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.751 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.751 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.751 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.751 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-06-02T05:06:05.751 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-06-02T05:06:05.751 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.751 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.751 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.751 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-06-02T05:06:05.751 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.751 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.751 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:05.752 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:05.752 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:05.752 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:05.752 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:05.752 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:05.752 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:05.752 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:05.752 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.752 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.752 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.752 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.752 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.752 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-06-02T05:06:05.752 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-06-02T05:06:05.753 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.753 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.753 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.753 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.753 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.753 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.753 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.753 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.753 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.753 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.753 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.753 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:05.753 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:05.754 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.754 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:05.754 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "volumes", 2024-06-02T05:06:05.754 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-06-02T05:06:05.754 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-06-02T05:06:05.754 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-06-02T05:06:05.754 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-06-02T05:06:05.754 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-06-02T05:06:05.754 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.754 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.754 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.754 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.754 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.755 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.755 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:05.755 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:05.755 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:05.755 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:05.755 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:05.755 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:05.755 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:05.755 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:05.755 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.755 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.755 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.755 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.756 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.756 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-06-02T05:06:05.756 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-06-02T05:06:05.756 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.756 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.756 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.756 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.756 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.756 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.756 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.756 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.756 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.756 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.756 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.757 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.757 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-06-02T05:06:05.757 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-06-02T05:06:05.757 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.757 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.757 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.757 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-06-02T05:06:05.757 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.757 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.757 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:05.757 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:05.757 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:05.757 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:05.758 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:05.758 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:05.758 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:05.758 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:05.758 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.758 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.758 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.758 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.758 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.758 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-06-02T05:06:05.758 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-06-02T05:06:05.758 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.758 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.759 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.759 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.759 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.759 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.759 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.759 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.759 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.759 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.759 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.759 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.759 INFO:teuthology.orchestra.run.smithi076.stdout: "max_concurrent_clones": { 2024-06-02T05:06:05.759 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "max_concurrent_clones", 2024-06-02T05:06:05.759 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:05.760 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.760 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.760 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "4", 2024-06-02T05:06:05.760 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.760 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.760 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.760 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Number of asynchronous cloner threads", 2024-06-02T05:06:05.760 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.760 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.760 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.760 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.760 INFO:teuthology.orchestra.run.smithi076.stdout: "snapshot_clone_delay": { 2024-06-02T05:06:05.760 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "snapshot_clone_delay", 2024-06-02T05:06:05.760 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:05.761 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.761 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.761 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "0", 2024-06-02T05:06:05.761 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.761 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.761 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.761 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-06-02T05:06:05.761 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.761 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.761 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.761 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.761 INFO:teuthology.orchestra.run.smithi076.stdout: "snapshot_clone_no_wait": { 2024-06-02T05:06:05.761 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "snapshot_clone_no_wait", 2024-06-02T05:06:05.762 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.762 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.762 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.762 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:05.762 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.762 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.762 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.762 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-06-02T05:06:05.762 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.762 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.762 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.762 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:05.762 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:05.763 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.763 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:05.763 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "zabbix", 2024-06-02T05:06:05.763 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-06-02T05:06:05.763 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-06-02T05:06:05.763 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-06-02T05:06:05.763 INFO:teuthology.orchestra.run.smithi076.stdout: "discovery_interval": { 2024-06-02T05:06:05.763 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "discovery_interval", 2024-06-02T05:06:05.763 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "uint", 2024-06-02T05:06:05.763 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.763 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.763 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "100", 2024-06-02T05:06:05.763 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.763 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.764 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.764 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.764 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.764 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.764 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.764 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.764 INFO:teuthology.orchestra.run.smithi076.stdout: "identifier": { 2024-06-02T05:06:05.764 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "identifier", 2024-06-02T05:06:05.764 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.764 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.764 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.764 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.765 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.765 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.765 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.765 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.765 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.765 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.765 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.765 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.765 INFO:teuthology.orchestra.run.smithi076.stdout: "interval": { 2024-06-02T05:06:05.765 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "interval", 2024-06-02T05:06:05.765 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-06-02T05:06:05.765 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.765 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.765 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "60", 2024-06-02T05:06:05.766 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.766 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.766 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.766 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.766 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.766 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.766 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.766 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.766 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-06-02T05:06:05.766 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-06-02T05:06:05.766 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.766 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.767 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.767 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.767 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.767 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.767 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:05.767 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:05.767 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:05.767 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:05.767 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:05.767 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:05.767 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:05.767 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:05.767 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.767 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.768 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.768 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.768 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.768 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-06-02T05:06:05.768 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-06-02T05:06:05.768 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.768 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.768 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.768 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.768 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.768 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.768 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.768 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.769 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.769 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.769 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.769 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.769 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-06-02T05:06:05.769 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-06-02T05:06:05.769 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.769 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.769 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.769 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-06-02T05:06:05.769 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.769 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.769 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:05.770 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:05.770 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:05.770 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:05.770 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:05.770 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:05.770 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:05.770 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:05.770 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.770 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.770 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.770 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.770 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.771 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-06-02T05:06:05.771 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-06-02T05:06:05.771 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.771 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.771 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.771 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.771 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.771 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.771 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.771 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.771 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.771 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.771 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.772 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.772 INFO:teuthology.orchestra.run.smithi076.stdout: "zabbix_host": { 2024-06-02T05:06:05.772 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "zabbix_host", 2024-06-02T05:06:05.772 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.772 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.772 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.772 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.772 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.772 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.772 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.772 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.772 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.772 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.773 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.773 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.773 INFO:teuthology.orchestra.run.smithi076.stdout: "zabbix_port": { 2024-06-02T05:06:05.773 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "zabbix_port", 2024-06-02T05:06:05.773 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:05.773 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.773 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.773 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "10051", 2024-06-02T05:06:05.773 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.773 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.773 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.773 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.773 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.773 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.774 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.774 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.774 INFO:teuthology.orchestra.run.smithi076.stdout: "zabbix_sender": { 2024-06-02T05:06:05.774 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "zabbix_sender", 2024-06-02T05:06:05.774 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.774 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.774 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.774 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-06-02T05:06:05.774 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.774 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.774 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.774 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.774 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.775 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.775 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.775 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:05.775 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:05.775 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:05.775 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-06-02T05:06:05.775 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.775 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:05.775 INFO:teuthology.orchestra.run.smithi076.stdout: "gid": 24122, 2024-06-02T05:06:05.775 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "y", 2024-06-02T05:06:05.775 INFO:teuthology.orchestra.run.smithi076.stdout: "mgr_features": 4540138322906710015, 2024-06-02T05:06:05.775 INFO:teuthology.orchestra.run.smithi076.stdout: "available_modules": [ 2024-06-02T05:06:05.776 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:05.776 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "alerts", 2024-06-02T05:06:05.776 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-06-02T05:06:05.776 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-06-02T05:06:05.776 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-06-02T05:06:05.776 INFO:teuthology.orchestra.run.smithi076.stdout: "interval": { 2024-06-02T05:06:05.776 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "interval", 2024-06-02T05:06:05.776 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-06-02T05:06:05.776 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.776 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.776 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "60", 2024-06-02T05:06:05.776 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.776 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.776 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.777 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "How frequently to reexamine health status", 2024-06-02T05:06:05.777 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.777 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.777 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.777 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.777 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-06-02T05:06:05.777 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-06-02T05:06:05.777 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.777 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.777 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.777 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.777 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.777 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.778 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:05.778 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:05.778 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:05.778 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:05.778 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:05.778 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:05.778 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:05.778 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:05.778 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.778 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.778 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.778 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.779 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.779 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-06-02T05:06:05.779 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-06-02T05:06:05.779 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.779 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.779 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.779 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.779 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.779 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.779 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.779 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.779 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.780 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.780 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.780 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.780 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-06-02T05:06:05.780 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-06-02T05:06:05.780 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.780 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.780 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.780 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-06-02T05:06:05.780 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.780 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.780 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:05.780 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:05.780 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:05.781 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:05.781 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:05.781 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:05.781 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:05.781 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:05.781 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.781 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.781 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.781 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.781 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.781 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-06-02T05:06:05.781 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-06-02T05:06:05.781 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.782 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.782 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.782 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.782 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.782 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.782 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.782 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.782 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.782 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.782 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.782 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.782 INFO:teuthology.orchestra.run.smithi076.stdout: "smtp_destination": { 2024-06-02T05:06:05.783 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "smtp_destination", 2024-06-02T05:06:05.783 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.783 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.783 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.783 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.783 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.783 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.783 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.783 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Email address to send alerts to", 2024-06-02T05:06:05.783 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.783 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.783 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.783 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.784 INFO:teuthology.orchestra.run.smithi076.stdout: "smtp_from_name": { 2024-06-02T05:06:05.784 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "smtp_from_name", 2024-06-02T05:06:05.784 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.784 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.784 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.784 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "Ceph", 2024-06-02T05:06:05.784 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.784 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.784 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.784 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Email From: name", 2024-06-02T05:06:05.784 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.784 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.784 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.785 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.785 INFO:teuthology.orchestra.run.smithi076.stdout: "smtp_host": { 2024-06-02T05:06:05.785 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "smtp_host", 2024-06-02T05:06:05.785 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.785 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.785 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.785 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.785 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.785 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.785 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.785 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "SMTP server", 2024-06-02T05:06:05.785 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.785 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.786 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.786 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.786 INFO:teuthology.orchestra.run.smithi076.stdout: "smtp_password": { 2024-06-02T05:06:05.786 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "smtp_password", 2024-06-02T05:06:05.786 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.786 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.786 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.786 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.786 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.786 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.786 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.786 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Password to authenticate with", 2024-06-02T05:06:05.787 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.787 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.787 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.787 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.787 INFO:teuthology.orchestra.run.smithi076.stdout: "smtp_port": { 2024-06-02T05:06:05.787 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "smtp_port", 2024-06-02T05:06:05.787 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:05.787 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.787 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.787 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "465", 2024-06-02T05:06:05.787 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.787 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.788 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.788 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "SMTP port", 2024-06-02T05:06:05.788 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.788 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.788 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.788 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.788 INFO:teuthology.orchestra.run.smithi076.stdout: "smtp_sender": { 2024-06-02T05:06:05.788 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "smtp_sender", 2024-06-02T05:06:05.788 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.788 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.788 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.788 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.788 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.789 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.789 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.789 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "SMTP envelope sender", 2024-06-02T05:06:05.789 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.789 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.789 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.789 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.789 INFO:teuthology.orchestra.run.smithi076.stdout: "smtp_ssl": { 2024-06-02T05:06:05.789 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "smtp_ssl", 2024-06-02T05:06:05.789 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.789 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.789 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.789 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:05.789 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.790 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.790 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.790 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Use SSL to connect to SMTP server", 2024-06-02T05:06:05.790 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.790 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.790 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.790 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.790 INFO:teuthology.orchestra.run.smithi076.stdout: "smtp_user": { 2024-06-02T05:06:05.790 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "smtp_user", 2024-06-02T05:06:05.790 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.790 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.790 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.791 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.791 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.791 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.791 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.791 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "User to authenticate as", 2024-06-02T05:06:05.791 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.791 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.791 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.791 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:05.791 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:05.791 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.791 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:05.791 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "balancer", 2024-06-02T05:06:05.792 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-06-02T05:06:05.792 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-06-02T05:06:05.792 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-06-02T05:06:05.792 INFO:teuthology.orchestra.run.smithi076.stdout: "active": { 2024-06-02T05:06:05.792 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "active", 2024-06-02T05:06:05.792 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.792 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.792 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.792 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:05.792 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.792 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.792 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.792 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "automatically balance PGs across cluster", 2024-06-02T05:06:05.793 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.793 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.793 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.793 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.793 INFO:teuthology.orchestra.run.smithi076.stdout: "begin_time": { 2024-06-02T05:06:05.793 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "begin_time", 2024-06-02T05:06:05.793 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.793 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.793 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.793 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "0000", 2024-06-02T05:06:05.793 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.793 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.793 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.793 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "beginning time of day to automatically balance", 2024-06-02T05:06:05.794 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-06-02T05:06:05.794 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.794 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.794 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.794 INFO:teuthology.orchestra.run.smithi076.stdout: "begin_weekday": { 2024-06-02T05:06:05.794 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "begin_weekday", 2024-06-02T05:06:05.794 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "uint", 2024-06-02T05:06:05.794 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.794 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.794 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "0", 2024-06-02T05:06:05.794 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "0", 2024-06-02T05:06:05.795 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "6", 2024-06-02T05:06:05.795 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.795 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-06-02T05:06:05.795 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-06-02T05:06:05.795 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.795 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.795 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.795 INFO:teuthology.orchestra.run.smithi076.stdout: "crush_compat_max_iterations": { 2024-06-02T05:06:05.795 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "crush_compat_max_iterations", 2024-06-02T05:06:05.795 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "uint", 2024-06-02T05:06:05.795 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.795 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.795 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "25", 2024-06-02T05:06:05.796 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "1", 2024-06-02T05:06:05.796 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "250", 2024-06-02T05:06:05.796 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.796 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-06-02T05:06:05.796 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.796 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.796 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.796 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.796 INFO:teuthology.orchestra.run.smithi076.stdout: "crush_compat_metrics": { 2024-06-02T05:06:05.796 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "crush_compat_metrics", 2024-06-02T05:06:05.796 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.796 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.796 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.797 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "pgs,objects,bytes", 2024-06-02T05:06:05.797 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.797 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.797 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.797 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-06-02T05:06:05.797 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-06-02T05:06:05.797 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.797 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.797 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.797 INFO:teuthology.orchestra.run.smithi076.stdout: "crush_compat_step": { 2024-06-02T05:06:05.797 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "crush_compat_step", 2024-06-02T05:06:05.797 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "float", 2024-06-02T05:06:05.797 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.798 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.798 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "0.5", 2024-06-02T05:06:05.798 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "0.001", 2024-06-02T05:06:05.798 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "0.999", 2024-06-02T05:06:05.798 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.798 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "aggressiveness of optimization", 2024-06-02T05:06:05.798 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-06-02T05:06:05.798 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.798 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.798 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.798 INFO:teuthology.orchestra.run.smithi076.stdout: "end_time": { 2024-06-02T05:06:05.798 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "end_time", 2024-06-02T05:06:05.798 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.799 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.799 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.799 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "2359", 2024-06-02T05:06:05.799 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.799 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.799 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.799 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "ending time of day to automatically balance", 2024-06-02T05:06:05.799 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-06-02T05:06:05.799 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.799 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.799 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.799 INFO:teuthology.orchestra.run.smithi076.stdout: "end_weekday": { 2024-06-02T05:06:05.799 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "end_weekday", 2024-06-02T05:06:05.800 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "uint", 2024-06-02T05:06:05.800 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.800 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.800 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "0", 2024-06-02T05:06:05.800 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "0", 2024-06-02T05:06:05.800 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "6", 2024-06-02T05:06:05.800 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.800 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-06-02T05:06:05.800 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-06-02T05:06:05.800 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.800 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.800 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.800 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-06-02T05:06:05.800 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-06-02T05:06:05.801 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.801 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.801 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.801 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.801 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.801 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.801 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:05.801 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:05.801 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:05.801 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:05.801 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:05.801 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:05.801 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:05.802 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:05.802 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.802 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.802 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.802 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.802 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.802 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-06-02T05:06:05.802 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-06-02T05:06:05.802 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.802 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.802 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.802 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.802 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.803 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.803 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.803 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.803 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.803 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.803 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.803 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.803 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-06-02T05:06:05.803 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-06-02T05:06:05.803 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.803 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.803 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.803 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-06-02T05:06:05.804 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.804 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.804 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:05.804 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:05.804 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:05.804 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:05.804 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:05.804 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:05.804 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:05.804 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:05.804 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.804 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.804 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.804 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.805 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.805 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-06-02T05:06:05.805 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-06-02T05:06:05.805 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.805 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.805 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.805 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.805 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.805 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.805 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.805 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.805 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.805 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.805 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.806 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.806 INFO:teuthology.orchestra.run.smithi076.stdout: "min_score": { 2024-06-02T05:06:05.806 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "min_score", 2024-06-02T05:06:05.806 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "float", 2024-06-02T05:06:05.806 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.806 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.806 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "0", 2024-06-02T05:06:05.806 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.806 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.806 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.806 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-06-02T05:06:05.806 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.806 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.807 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.807 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.807 INFO:teuthology.orchestra.run.smithi076.stdout: "mode": { 2024-06-02T05:06:05.807 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "mode", 2024-06-02T05:06:05.807 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.807 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.807 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.807 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "upmap", 2024-06-02T05:06:05.807 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.807 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.807 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:05.807 INFO:teuthology.orchestra.run.smithi076.stdout: "crush-compat", 2024-06-02T05:06:05.808 INFO:teuthology.orchestra.run.smithi076.stdout: "none", 2024-06-02T05:06:05.808 INFO:teuthology.orchestra.run.smithi076.stdout: "upmap" 2024-06-02T05:06:05.808 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:05.808 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Balancer mode", 2024-06-02T05:06:05.808 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.808 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.808 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.808 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.808 INFO:teuthology.orchestra.run.smithi076.stdout: "pool_ids": { 2024-06-02T05:06:05.808 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "pool_ids", 2024-06-02T05:06:05.808 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.808 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.808 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.808 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.809 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.809 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.809 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.809 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-06-02T05:06:05.809 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.809 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.809 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.809 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.809 INFO:teuthology.orchestra.run.smithi076.stdout: "sleep_interval": { 2024-06-02T05:06:05.809 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "sleep_interval", 2024-06-02T05:06:05.809 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-06-02T05:06:05.809 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.809 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.810 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "60", 2024-06-02T05:06:05.810 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.810 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.810 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.810 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-06-02T05:06:05.810 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.810 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.810 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.810 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.810 INFO:teuthology.orchestra.run.smithi076.stdout: "upmap_max_deviation": { 2024-06-02T05:06:05.810 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "upmap_max_deviation", 2024-06-02T05:06:05.810 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:05.810 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.811 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.811 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "5", 2024-06-02T05:06:05.811 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "1", 2024-06-02T05:06:05.811 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.811 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.811 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "deviation below which no optimization is attempted", 2024-06-02T05:06:05.811 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-06-02T05:06:05.811 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.811 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.811 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.811 INFO:teuthology.orchestra.run.smithi076.stdout: "upmap_max_optimizations": { 2024-06-02T05:06:05.811 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "upmap_max_optimizations", 2024-06-02T05:06:05.811 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "uint", 2024-06-02T05:06:05.812 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.812 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.812 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "10", 2024-06-02T05:06:05.812 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.812 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.812 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.812 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-06-02T05:06:05.812 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.812 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.812 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.812 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:05.812 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:05.812 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.812 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:05.813 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "cephadm", 2024-06-02T05:06:05.813 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-06-02T05:06:05.813 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-06-02T05:06:05.813 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-06-02T05:06:05.813 INFO:teuthology.orchestra.run.smithi076.stdout: "agent_down_multiplier": { 2024-06-02T05:06:05.813 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "agent_down_multiplier", 2024-06-02T05:06:05.813 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "float", 2024-06-02T05:06:05.813 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.813 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.813 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "3.0", 2024-06-02T05:06:05.813 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.813 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.814 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.814 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-06-02T05:06:05.814 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.814 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.814 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.814 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.814 INFO:teuthology.orchestra.run.smithi076.stdout: "agent_refresh_rate": { 2024-06-02T05:06:05.814 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "agent_refresh_rate", 2024-06-02T05:06:05.814 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-06-02T05:06:05.814 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.814 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.814 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "20", 2024-06-02T05:06:05.814 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.815 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.815 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.815 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-06-02T05:06:05.815 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.815 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.815 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.815 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.815 INFO:teuthology.orchestra.run.smithi076.stdout: "agent_starting_port": { 2024-06-02T05:06:05.815 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "agent_starting_port", 2024-06-02T05:06:05.815 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:05.815 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.815 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.815 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "4721", 2024-06-02T05:06:05.816 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.816 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.816 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.816 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-06-02T05:06:05.816 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.816 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.816 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.816 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.816 INFO:teuthology.orchestra.run.smithi076.stdout: "allow_ptrace": { 2024-06-02T05:06:05.816 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "allow_ptrace", 2024-06-02T05:06:05.816 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.816 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.816 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.817 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.817 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.817 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.817 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.817 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-06-02T05:06:05.817 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-06-02T05:06:05.817 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.817 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.817 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.817 INFO:teuthology.orchestra.run.smithi076.stdout: "autotune_interval": { 2024-06-02T05:06:05.817 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "autotune_interval", 2024-06-02T05:06:05.817 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-06-02T05:06:05.817 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.818 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.818 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "600", 2024-06-02T05:06:05.818 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.818 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.818 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.818 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "how frequently to autotune daemon memory", 2024-06-02T05:06:05.818 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.818 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.818 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.818 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.818 INFO:teuthology.orchestra.run.smithi076.stdout: "autotune_memory_target_ratio": { 2024-06-02T05:06:05.818 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "autotune_memory_target_ratio", 2024-06-02T05:06:05.819 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "float", 2024-06-02T05:06:05.819 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.819 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.819 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "0.7", 2024-06-02T05:06:05.819 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.819 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.819 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.819 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-06-02T05:06:05.819 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.819 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.819 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.819 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.820 INFO:teuthology.orchestra.run.smithi076.stdout: "cgroups_split": { 2024-06-02T05:06:05.820 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "cgroups_split", 2024-06-02T05:06:05.820 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.820 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.820 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.820 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:05.820 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.820 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.820 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.820 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-06-02T05:06:05.820 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.820 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.820 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.821 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.821 INFO:teuthology.orchestra.run.smithi076.stdout: "config_checks_enabled": { 2024-06-02T05:06:05.821 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "config_checks_enabled", 2024-06-02T05:06:05.821 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.821 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.821 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.821 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.821 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.821 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.821 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.821 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-06-02T05:06:05.822 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.822 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.822 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.822 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.822 INFO:teuthology.orchestra.run.smithi076.stdout: "config_dashboard": { 2024-06-02T05:06:05.822 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "config_dashboard", 2024-06-02T05:06:05.822 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.822 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.822 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.822 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:05.822 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.822 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.822 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.823 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-06-02T05:06:05.823 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.823 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.823 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.823 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.823 INFO:teuthology.orchestra.run.smithi076.stdout: "container_image_alertmanager": { 2024-06-02T05:06:05.823 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "container_image_alertmanager", 2024-06-02T05:06:05.823 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.823 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.823 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.823 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-06-02T05:06:05.823 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.824 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.824 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.824 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Prometheus container image", 2024-06-02T05:06:05.824 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.824 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.824 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.824 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.824 INFO:teuthology.orchestra.run.smithi076.stdout: "container_image_base": { 2024-06-02T05:06:05.824 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "container_image_base", 2024-06-02T05:06:05.824 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.824 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.824 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.825 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "quay.io/ceph/ceph", 2024-06-02T05:06:05.825 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.825 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.825 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.825 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Container image name, without the tag", 2024-06-02T05:06:05.825 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.825 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.825 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.825 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.825 INFO:teuthology.orchestra.run.smithi076.stdout: "container_image_elasticsearch": { 2024-06-02T05:06:05.825 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "container_image_elasticsearch", 2024-06-02T05:06:05.825 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.825 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.826 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.826 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-06-02T05:06:05.826 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.826 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.826 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.826 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "elasticsearch container image", 2024-06-02T05:06:05.826 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.826 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.826 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.826 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.826 INFO:teuthology.orchestra.run.smithi076.stdout: "container_image_grafana": { 2024-06-02T05:06:05.826 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "container_image_grafana", 2024-06-02T05:06:05.827 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.827 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.827 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.827 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2024-06-02T05:06:05.827 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.827 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.827 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.827 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Prometheus container image", 2024-06-02T05:06:05.827 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.827 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.827 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.827 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.828 INFO:teuthology.orchestra.run.smithi076.stdout: "container_image_haproxy": { 2024-06-02T05:06:05.828 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "container_image_haproxy", 2024-06-02T05:06:05.828 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.828 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.828 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.828 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-06-02T05:06:05.828 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.828 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.828 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.828 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "HAproxy container image", 2024-06-02T05:06:05.828 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.828 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.828 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.829 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.829 INFO:teuthology.orchestra.run.smithi076.stdout: "container_image_jaeger_agent": { 2024-06-02T05:06:05.829 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "container_image_jaeger_agent", 2024-06-02T05:06:05.829 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.830 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.830 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.830 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-06-02T05:06:05.830 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.830 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.830 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.830 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Jaeger agent container image", 2024-06-02T05:06:05.830 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.830 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.830 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.830 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.830 INFO:teuthology.orchestra.run.smithi076.stdout: "container_image_jaeger_collector": { 2024-06-02T05:06:05.830 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "container_image_jaeger_collector", 2024-06-02T05:06:05.831 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.831 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.831 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.831 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-06-02T05:06:05.831 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.831 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.831 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.831 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Jaeger collector container image", 2024-06-02T05:06:05.831 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.831 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.831 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.831 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.831 INFO:teuthology.orchestra.run.smithi076.stdout: "container_image_jaeger_query": { 2024-06-02T05:06:05.832 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "container_image_jaeger_query", 2024-06-02T05:06:05.832 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.832 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.832 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.832 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-06-02T05:06:05.832 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.832 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.832 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.832 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Jaeger query container image", 2024-06-02T05:06:05.832 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.832 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.832 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.832 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.833 INFO:teuthology.orchestra.run.smithi076.stdout: "container_image_keepalived": { 2024-06-02T05:06:05.833 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "container_image_keepalived", 2024-06-02T05:06:05.833 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.833 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.833 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.833 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-06-02T05:06:05.833 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.833 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.833 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.833 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Keepalived container image", 2024-06-02T05:06:05.833 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.833 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.833 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.833 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.834 INFO:teuthology.orchestra.run.smithi076.stdout: "container_image_loki": { 2024-06-02T05:06:05.834 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "container_image_loki", 2024-06-02T05:06:05.834 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.834 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.834 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.834 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-06-02T05:06:05.834 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.834 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.834 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.834 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Loki container image", 2024-06-02T05:06:05.834 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.834 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.835 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.835 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.835 INFO:teuthology.orchestra.run.smithi076.stdout: "container_image_node_exporter": { 2024-06-02T05:06:05.835 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "container_image_node_exporter", 2024-06-02T05:06:05.835 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.835 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.835 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.835 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-06-02T05:06:05.835 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.835 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.835 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.835 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Prometheus container image", 2024-06-02T05:06:05.836 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.836 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.836 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.836 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.836 INFO:teuthology.orchestra.run.smithi076.stdout: "container_image_nvmeof": { 2024-06-02T05:06:05.836 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "container_image_nvmeof", 2024-06-02T05:06:05.836 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.836 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.836 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.836 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "quay.io/ceph/nvmeof:1.0.0", 2024-06-02T05:06:05.836 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.836 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.836 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.837 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Nvme-of container image", 2024-06-02T05:06:05.837 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.837 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.837 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.837 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.837 INFO:teuthology.orchestra.run.smithi076.stdout: "container_image_prometheus": { 2024-06-02T05:06:05.837 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "container_image_prometheus", 2024-06-02T05:06:05.837 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.837 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.837 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.837 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-06-02T05:06:05.837 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.837 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.838 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.838 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Prometheus container image", 2024-06-02T05:06:05.838 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.838 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.838 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.838 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.838 INFO:teuthology.orchestra.run.smithi076.stdout: "container_image_promtail": { 2024-06-02T05:06:05.838 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "container_image_promtail", 2024-06-02T05:06:05.838 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.838 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.838 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.838 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-06-02T05:06:05.838 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.839 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.839 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.839 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Promtail container image", 2024-06-02T05:06:05.839 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.839 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.839 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.839 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.839 INFO:teuthology.orchestra.run.smithi076.stdout: "container_image_snmp_gateway": { 2024-06-02T05:06:05.839 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "container_image_snmp_gateway", 2024-06-02T05:06:05.839 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.839 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.839 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.840 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-06-02T05:06:05.840 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.840 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.840 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.840 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "SNMP Gateway container image", 2024-06-02T05:06:05.840 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.840 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.840 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.840 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.840 INFO:teuthology.orchestra.run.smithi076.stdout: "container_init": { 2024-06-02T05:06:05.840 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "container_init", 2024-06-02T05:06:05.840 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.840 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.841 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.841 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:05.841 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.841 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.841 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.841 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Run podman/docker with `--init`", 2024-06-02T05:06:05.841 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.841 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.841 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.841 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.841 INFO:teuthology.orchestra.run.smithi076.stdout: "daemon_cache_timeout": { 2024-06-02T05:06:05.841 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "daemon_cache_timeout", 2024-06-02T05:06:05.841 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-06-02T05:06:05.842 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.842 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.842 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "600", 2024-06-02T05:06:05.842 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.842 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.842 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.842 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-06-02T05:06:05.842 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.842 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.842 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.842 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.842 INFO:teuthology.orchestra.run.smithi076.stdout: "default_cephadm_command_timeout": { 2024-06-02T05:06:05.843 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "default_cephadm_command_timeout", 2024-06-02T05:06:05.843 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:05.843 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.843 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.843 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "900", 2024-06-02T05:06:05.843 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.843 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.843 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.843 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-06-02T05:06:05.843 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.843 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.843 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.844 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.844 INFO:teuthology.orchestra.run.smithi076.stdout: "default_registry": { 2024-06-02T05:06:05.844 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "default_registry", 2024-06-02T05:06:05.844 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.844 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.844 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.844 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "docker.io", 2024-06-02T05:06:05.844 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.844 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.844 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.844 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-06-02T05:06:05.844 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.844 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.845 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.845 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.845 INFO:teuthology.orchestra.run.smithi076.stdout: "device_cache_timeout": { 2024-06-02T05:06:05.845 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "device_cache_timeout", 2024-06-02T05:06:05.845 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-06-02T05:06:05.845 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.845 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.845 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "1800", 2024-06-02T05:06:05.845 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.845 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.845 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.845 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "seconds to cache device inventory", 2024-06-02T05:06:05.845 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.846 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.846 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.846 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.846 INFO:teuthology.orchestra.run.smithi076.stdout: "device_enhanced_scan": { 2024-06-02T05:06:05.846 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "device_enhanced_scan", 2024-06-02T05:06:05.846 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.846 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.846 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.846 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.846 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.846 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.846 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.846 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Use libstoragemgmt during device scans", 2024-06-02T05:06:05.847 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.847 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.847 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.847 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.847 INFO:teuthology.orchestra.run.smithi076.stdout: "facts_cache_timeout": { 2024-06-02T05:06:05.847 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "facts_cache_timeout", 2024-06-02T05:06:05.847 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-06-02T05:06:05.847 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.847 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.847 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "60", 2024-06-02T05:06:05.847 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.847 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.847 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.847 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "seconds to cache host facts data", 2024-06-02T05:06:05.848 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.848 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.848 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.848 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.848 INFO:teuthology.orchestra.run.smithi076.stdout: "host_check_interval": { 2024-06-02T05:06:05.848 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "host_check_interval", 2024-06-02T05:06:05.848 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-06-02T05:06:05.848 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.848 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.848 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "600", 2024-06-02T05:06:05.848 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.848 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.849 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.849 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "how frequently to perform a host check", 2024-06-02T05:06:05.849 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.849 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.849 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.849 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.849 INFO:teuthology.orchestra.run.smithi076.stdout: "hw_monitoring": { 2024-06-02T05:06:05.849 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "hw_monitoring", 2024-06-02T05:06:05.849 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.849 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.849 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.849 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.849 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.850 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.850 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.850 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-06-02T05:06:05.850 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.850 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.850 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.850 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.850 INFO:teuthology.orchestra.run.smithi076.stdout: "inventory_list_all": { 2024-06-02T05:06:05.850 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "inventory_list_all", 2024-06-02T05:06:05.850 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.850 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.850 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.850 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.851 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.851 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.851 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.851 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-06-02T05:06:05.851 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.851 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.851 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.851 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.851 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-06-02T05:06:05.851 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-06-02T05:06:05.851 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.851 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.851 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.852 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.852 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.852 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.852 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:05.852 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:05.852 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:05.852 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:05.852 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:05.852 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:05.852 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:05.852 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:05.852 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.852 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.853 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.853 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.853 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.853 INFO:teuthology.orchestra.run.smithi076.stdout: "log_refresh_metadata": { 2024-06-02T05:06:05.853 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_refresh_metadata", 2024-06-02T05:06:05.853 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.853 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.853 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.853 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.853 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.853 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.853 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.853 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-06-02T05:06:05.854 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.854 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.854 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.854 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.854 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-06-02T05:06:05.854 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-06-02T05:06:05.854 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.854 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.854 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.854 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:05.854 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.854 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.854 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.855 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-06-02T05:06:05.855 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.855 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.855 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.855 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.855 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-06-02T05:06:05.855 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-06-02T05:06:05.855 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.855 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.855 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.855 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-06-02T05:06:05.855 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.855 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.856 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:05.856 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:05.856 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:05.856 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:05.856 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:05.856 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:05.856 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:05.856 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:05.856 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.856 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.856 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.856 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.857 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.857 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-06-02T05:06:05.857 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-06-02T05:06:05.857 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.857 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.857 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.857 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.857 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.857 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.857 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.857 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.857 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.857 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.857 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.858 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.858 INFO:teuthology.orchestra.run.smithi076.stdout: "manage_etc_ceph_ceph_conf": { 2024-06-02T05:06:05.858 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-06-02T05:06:05.858 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.858 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.858 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.858 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.858 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.858 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.858 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.858 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-06-02T05:06:05.858 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.858 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.859 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.859 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.859 INFO:teuthology.orchestra.run.smithi076.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-06-02T05:06:05.859 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-06-02T05:06:05.859 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.859 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.859 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.859 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "*", 2024-06-02T05:06:05.859 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.859 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.859 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.859 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-06-02T05:06:05.859 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.860 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.860 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.860 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.860 INFO:teuthology.orchestra.run.smithi076.stdout: "max_count_per_host": { 2024-06-02T05:06:05.860 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "max_count_per_host", 2024-06-02T05:06:05.860 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:05.860 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.860 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.860 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "10", 2024-06-02T05:06:05.860 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.860 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.860 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.860 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "max number of daemons per service per host", 2024-06-02T05:06:05.861 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.861 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.861 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.861 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.861 INFO:teuthology.orchestra.run.smithi076.stdout: "max_osd_draining_count": { 2024-06-02T05:06:05.861 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "max_osd_draining_count", 2024-06-02T05:06:05.861 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:05.861 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.861 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.861 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "10", 2024-06-02T05:06:05.861 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.861 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.861 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.862 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-06-02T05:06:05.862 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.862 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.862 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.862 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.862 INFO:teuthology.orchestra.run.smithi076.stdout: "migration_current": { 2024-06-02T05:06:05.862 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "migration_current", 2024-06-02T05:06:05.862 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:05.862 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.862 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.862 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.862 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.863 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.863 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.863 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "internal - do not modify", 2024-06-02T05:06:05.863 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.863 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.863 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.863 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.863 INFO:teuthology.orchestra.run.smithi076.stdout: "mode": { 2024-06-02T05:06:05.863 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "mode", 2024-06-02T05:06:05.863 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.863 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.863 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.864 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "root", 2024-06-02T05:06:05.864 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.864 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.864 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:05.864 INFO:teuthology.orchestra.run.smithi076.stdout: "cephadm-package", 2024-06-02T05:06:05.864 INFO:teuthology.orchestra.run.smithi076.stdout: "root" 2024-06-02T05:06:05.864 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:05.864 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "mode for remote execution of cephadm", 2024-06-02T05:06:05.864 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.864 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.864 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.864 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.864 INFO:teuthology.orchestra.run.smithi076.stdout: "oob_default_addr": { 2024-06-02T05:06:05.865 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "oob_default_addr", 2024-06-02T05:06:05.865 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.865 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.865 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.865 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "169.254.1.1", 2024-06-02T05:06:05.865 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.865 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.865 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.865 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Default address for RedFish API (oob management).", 2024-06-02T05:06:05.865 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.865 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.865 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.865 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.866 INFO:teuthology.orchestra.run.smithi076.stdout: "prometheus_alerts_path": { 2024-06-02T05:06:05.866 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "prometheus_alerts_path", 2024-06-02T05:06:05.866 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.866 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.866 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.866 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-06-02T05:06:05.866 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.866 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.866 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.866 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-06-02T05:06:05.866 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.866 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.867 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.867 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.867 INFO:teuthology.orchestra.run.smithi076.stdout: "registry_insecure": { 2024-06-02T05:06:05.867 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "registry_insecure", 2024-06-02T05:06:05.867 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.867 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.867 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.867 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.867 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.867 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.867 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.867 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-06-02T05:06:05.867 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.867 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.868 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.868 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.868 INFO:teuthology.orchestra.run.smithi076.stdout: "registry_password": { 2024-06-02T05:06:05.868 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "registry_password", 2024-06-02T05:06:05.868 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.868 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.868 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.868 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.868 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.868 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.868 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.868 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-06-02T05:06:05.868 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.869 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.869 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.869 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.869 INFO:teuthology.orchestra.run.smithi076.stdout: "registry_url": { 2024-06-02T05:06:05.869 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "registry_url", 2024-06-02T05:06:05.869 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.869 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.869 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.869 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.869 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.869 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.869 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.869 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-06-02T05:06:05.870 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.870 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.870 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.870 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.870 INFO:teuthology.orchestra.run.smithi076.stdout: "registry_username": { 2024-06-02T05:06:05.870 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "registry_username", 2024-06-02T05:06:05.870 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.870 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.870 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.870 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.870 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.870 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.870 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.871 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-06-02T05:06:05.871 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.871 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.871 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.871 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.871 INFO:teuthology.orchestra.run.smithi076.stdout: "secure_monitoring_stack": { 2024-06-02T05:06:05.871 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "secure_monitoring_stack", 2024-06-02T05:06:05.871 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.871 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.871 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.871 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.871 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.871 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.871 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.872 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-06-02T05:06:05.872 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.872 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.872 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.872 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.872 INFO:teuthology.orchestra.run.smithi076.stdout: "service_discovery_port": { 2024-06-02T05:06:05.872 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "service_discovery_port", 2024-06-02T05:06:05.872 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:05.872 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.872 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.872 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "8765", 2024-06-02T05:06:05.872 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.872 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.873 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.873 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "cephadm service discovery port", 2024-06-02T05:06:05.873 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.873 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.873 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.873 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.873 INFO:teuthology.orchestra.run.smithi076.stdout: "ssh_config_file": { 2024-06-02T05:06:05.873 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "ssh_config_file", 2024-06-02T05:06:05.873 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.873 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.873 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.873 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.873 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.873 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.874 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.874 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-06-02T05:06:05.874 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.874 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.874 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.874 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.874 INFO:teuthology.orchestra.run.smithi076.stdout: "use_agent": { 2024-06-02T05:06:05.874 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "use_agent", 2024-06-02T05:06:05.874 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.874 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.874 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.874 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.874 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.875 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.875 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.875 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-06-02T05:06:05.875 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.875 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.875 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.875 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.875 INFO:teuthology.orchestra.run.smithi076.stdout: "use_repo_digest": { 2024-06-02T05:06:05.875 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "use_repo_digest", 2024-06-02T05:06:05.875 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.875 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.875 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.875 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:05.876 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.876 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.876 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.876 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-06-02T05:06:05.876 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.876 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.876 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.876 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.876 INFO:teuthology.orchestra.run.smithi076.stdout: "warn_on_failed_host_check": { 2024-06-02T05:06:05.876 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "warn_on_failed_host_check", 2024-06-02T05:06:05.876 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.876 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.876 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.877 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:05.877 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.877 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.877 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.877 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "raise a health warning if the host check fails", 2024-06-02T05:06:05.877 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.877 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.877 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.877 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.877 INFO:teuthology.orchestra.run.smithi076.stdout: "warn_on_stray_daemons": { 2024-06-02T05:06:05.877 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "warn_on_stray_daemons", 2024-06-02T05:06:05.877 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.877 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.878 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.878 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:05.878 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.878 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.878 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.878 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-06-02T05:06:05.878 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.878 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.878 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.878 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.878 INFO:teuthology.orchestra.run.smithi076.stdout: "warn_on_stray_hosts": { 2024-06-02T05:06:05.878 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "warn_on_stray_hosts", 2024-06-02T05:06:05.879 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.879 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.879 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.879 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:05.879 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.879 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.879 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.879 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-06-02T05:06:05.879 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.879 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.879 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.879 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:05.879 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:05.880 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.880 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:05.880 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "crash", 2024-06-02T05:06:05.880 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-06-02T05:06:05.880 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-06-02T05:06:05.880 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-06-02T05:06:05.880 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-06-02T05:06:05.880 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-06-02T05:06:05.880 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.880 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.880 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.880 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.880 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.881 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.881 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:05.881 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:05.881 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:05.881 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:05.881 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:05.881 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:05.881 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:05.881 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:05.881 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.881 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.881 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.881 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.882 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.882 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-06-02T05:06:05.882 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-06-02T05:06:05.882 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.882 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.882 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.882 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.882 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.882 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.882 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.882 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.882 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.882 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.883 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.883 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.883 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-06-02T05:06:05.883 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-06-02T05:06:05.883 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.883 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.883 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.883 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-06-02T05:06:05.883 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.883 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.883 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:05.883 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:05.883 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:05.884 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:05.884 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:05.884 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:05.884 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:05.884 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:05.884 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.884 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.884 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.884 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.884 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.884 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-06-02T05:06:05.884 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-06-02T05:06:05.884 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.885 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.885 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.885 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.885 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.885 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.885 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.885 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.885 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.885 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.885 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.885 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.885 INFO:teuthology.orchestra.run.smithi076.stdout: "retain_interval": { 2024-06-02T05:06:05.885 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "retain_interval", 2024-06-02T05:06:05.885 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-06-02T05:06:05.886 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.886 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.886 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "31536000", 2024-06-02T05:06:05.886 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.886 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.886 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.886 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "how long to retain crashes before pruning them", 2024-06-02T05:06:05.886 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.886 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.886 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.886 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.886 INFO:teuthology.orchestra.run.smithi076.stdout: "warn_recent_interval": { 2024-06-02T05:06:05.887 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "warn_recent_interval", 2024-06-02T05:06:05.887 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-06-02T05:06:05.887 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.887 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.887 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "1209600", 2024-06-02T05:06:05.887 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.887 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.887 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.887 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "time interval in which to warn about recent crashes", 2024-06-02T05:06:05.887 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.887 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.887 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.887 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:05.888 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:05.888 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.888 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:05.888 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "dashboard", 2024-06-02T05:06:05.888 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-06-02T05:06:05.888 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-06-02T05:06:05.888 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-06-02T05:06:05.888 INFO:teuthology.orchestra.run.smithi076.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-06-02T05:06:05.888 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-06-02T05:06:05.888 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:05.888 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.888 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.888 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "10", 2024-06-02T05:06:05.888 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.889 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.889 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.889 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.889 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.889 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.889 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.889 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.889 INFO:teuthology.orchestra.run.smithi076.stdout: "ALERTMANAGER_API_HOST": { 2024-06-02T05:06:05.889 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "ALERTMANAGER_API_HOST", 2024-06-02T05:06:05.889 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.889 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.889 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.889 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.890 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.890 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.890 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.890 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.890 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.890 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.890 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.890 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.890 INFO:teuthology.orchestra.run.smithi076.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-06-02T05:06:05.890 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-06-02T05:06:05.890 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.890 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.891 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.891 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:05.891 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.891 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.891 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.891 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.891 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.891 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.891 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.891 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.891 INFO:teuthology.orchestra.run.smithi076.stdout: "AUDIT_API_ENABLED": { 2024-06-02T05:06:05.891 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "AUDIT_API_ENABLED", 2024-06-02T05:06:05.891 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.892 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.892 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.892 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.892 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.892 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.892 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.892 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.892 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.892 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.892 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.892 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.892 INFO:teuthology.orchestra.run.smithi076.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-06-02T05:06:05.892 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-06-02T05:06:05.892 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.893 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.893 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.893 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:05.893 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.893 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.893 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.893 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.893 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.893 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.893 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.893 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.893 INFO:teuthology.orchestra.run.smithi076.stdout: "ENABLE_BROWSABLE_API": { 2024-06-02T05:06:05.893 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "ENABLE_BROWSABLE_API", 2024-06-02T05:06:05.894 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.894 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.894 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.894 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:05.894 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.894 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.894 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.894 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.894 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.894 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.894 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.894 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.895 INFO:teuthology.orchestra.run.smithi076.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-06-02T05:06:05.895 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-06-02T05:06:05.895 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.895 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.895 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.895 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:05.895 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.895 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.895 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.895 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.895 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.895 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.895 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.896 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.896 INFO:teuthology.orchestra.run.smithi076.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-06-02T05:06:05.896 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-06-02T05:06:05.896 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.896 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.896 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.896 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:05.896 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.896 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.896 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.896 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.896 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.896 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.897 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.897 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.897 INFO:teuthology.orchestra.run.smithi076.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-06-02T05:06:05.897 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-06-02T05:06:05.897 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.897 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.897 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.897 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:05.897 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.897 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.897 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.897 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.897 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.898 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.898 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.898 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.898 INFO:teuthology.orchestra.run.smithi076.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-06-02T05:06:05.898 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-06-02T05:06:05.898 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.898 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.898 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.898 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:05.898 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.898 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.898 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.898 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.899 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.899 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.899 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.899 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.899 INFO:teuthology.orchestra.run.smithi076.stdout: "FEATURE_TOGGLE_NFS": { 2024-06-02T05:06:05.899 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-06-02T05:06:05.899 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.899 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.899 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.899 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:05.899 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.899 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.899 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.899 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.900 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.900 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.900 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.900 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.900 INFO:teuthology.orchestra.run.smithi076.stdout: "FEATURE_TOGGLE_RBD": { 2024-06-02T05:06:05.900 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-06-02T05:06:05.900 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.900 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.900 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.900 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:05.900 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.900 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.900 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.901 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.901 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.901 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.901 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.901 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.901 INFO:teuthology.orchestra.run.smithi076.stdout: "FEATURE_TOGGLE_RGW": { 2024-06-02T05:06:05.901 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-06-02T05:06:05.901 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.901 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.901 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.901 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:05.901 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.901 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.902 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.902 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.902 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.902 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.902 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.902 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.902 INFO:teuthology.orchestra.run.smithi076.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-06-02T05:06:05.902 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-06-02T05:06:05.902 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.902 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.902 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.902 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.902 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.903 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.903 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.903 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.903 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.903 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.903 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.903 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.903 INFO:teuthology.orchestra.run.smithi076.stdout: "GRAFANA_API_PASSWORD": { 2024-06-02T05:06:05.903 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "GRAFANA_API_PASSWORD", 2024-06-02T05:06:05.903 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.903 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.903 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.903 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "admin", 2024-06-02T05:06:05.904 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.904 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.904 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.904 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.904 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.904 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.904 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.904 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.904 INFO:teuthology.orchestra.run.smithi076.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-06-02T05:06:05.904 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-06-02T05:06:05.904 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.904 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.904 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.904 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:05.905 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.905 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.905 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.905 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.905 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.905 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.905 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.905 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.905 INFO:teuthology.orchestra.run.smithi076.stdout: "GRAFANA_API_URL": { 2024-06-02T05:06:05.905 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "GRAFANA_API_URL", 2024-06-02T05:06:05.905 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.905 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.906 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.906 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.906 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.906 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.906 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.906 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.906 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.906 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.906 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.906 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.906 INFO:teuthology.orchestra.run.smithi076.stdout: "GRAFANA_API_USERNAME": { 2024-06-02T05:06:05.906 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "GRAFANA_API_USERNAME", 2024-06-02T05:06:05.906 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.907 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.907 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.907 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "admin", 2024-06-02T05:06:05.907 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.907 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.907 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.907 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.907 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.907 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.907 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.907 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.907 INFO:teuthology.orchestra.run.smithi076.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-06-02T05:06:05.907 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-06-02T05:06:05.908 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.908 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.908 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.908 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.908 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.908 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.908 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.908 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.908 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.908 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.908 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.908 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.909 INFO:teuthology.orchestra.run.smithi076.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-06-02T05:06:05.909 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-06-02T05:06:05.909 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.909 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.909 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.909 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.909 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.909 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.909 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.909 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.909 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.909 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.909 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.909 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.910 INFO:teuthology.orchestra.run.smithi076.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-06-02T05:06:05.910 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-06-02T05:06:05.910 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.910 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.910 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.910 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:05.910 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.910 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.910 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.910 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.910 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.910 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.911 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.911 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.911 INFO:teuthology.orchestra.run.smithi076.stdout: "ISSUE_TRACKER_API_KEY": { 2024-06-02T05:06:05.911 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-06-02T05:06:05.911 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.911 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.911 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.911 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.911 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.911 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.911 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.911 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.911 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.911 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.912 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.912 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.912 INFO:teuthology.orchestra.run.smithi076.stdout: "PROMETHEUS_API_HOST": { 2024-06-02T05:06:05.912 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "PROMETHEUS_API_HOST", 2024-06-02T05:06:05.912 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.912 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.912 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.912 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.912 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.912 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.912 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.912 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.912 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.912 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.913 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.913 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.913 INFO:teuthology.orchestra.run.smithi076.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-06-02T05:06:05.913 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-06-02T05:06:05.913 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.913 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.913 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.913 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:05.913 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.913 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.913 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.913 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.913 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.913 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.914 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.914 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.914 INFO:teuthology.orchestra.run.smithi076.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-06-02T05:06:05.914 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-06-02T05:06:05.914 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.914 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.914 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.914 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.914 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.914 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.914 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.914 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.914 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.915 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.915 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.915 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.915 INFO:teuthology.orchestra.run.smithi076.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-06-02T05:06:05.915 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-06-02T05:06:05.915 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.915 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.915 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.915 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.915 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.915 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.915 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.915 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.916 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.916 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.916 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.916 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.916 INFO:teuthology.orchestra.run.smithi076.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-06-02T05:06:05.916 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-06-02T05:06:05.916 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.916 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.916 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.916 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:05.916 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.916 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.916 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.917 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.917 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.917 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.917 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.917 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.917 INFO:teuthology.orchestra.run.smithi076.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-06-02T05:06:05.917 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-06-02T05:06:05.917 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.917 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.917 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.917 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:05.917 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.917 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.918 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.918 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.918 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.918 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.918 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.918 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.918 INFO:teuthology.orchestra.run.smithi076.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-06-02T05:06:05.918 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-06-02T05:06:05.918 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.918 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.918 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.918 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.919 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.919 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.919 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.919 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.919 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.919 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.919 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.919 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.919 INFO:teuthology.orchestra.run.smithi076.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-06-02T05:06:05.919 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-06-02T05:06:05.919 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.919 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.919 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.919 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.920 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.920 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.920 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.920 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.920 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.920 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.920 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.920 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.920 INFO:teuthology.orchestra.run.smithi076.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-06-02T05:06:05.920 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-06-02T05:06:05.920 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.920 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.920 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.921 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.921 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.921 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.921 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.921 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.921 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.921 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.921 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.921 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.921 INFO:teuthology.orchestra.run.smithi076.stdout: "PWD_POLICY_ENABLED": { 2024-06-02T05:06:05.921 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "PWD_POLICY_ENABLED", 2024-06-02T05:06:05.921 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.921 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.921 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.922 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:05.922 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.922 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.922 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.922 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.922 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.922 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.922 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.922 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.922 INFO:teuthology.orchestra.run.smithi076.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-06-02T05:06:05.922 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-06-02T05:06:05.922 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.923 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.923 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.923 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-06-02T05:06:05.923 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.923 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.923 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.923 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.923 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.923 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.923 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.923 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.923 INFO:teuthology.orchestra.run.smithi076.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-06-02T05:06:05.923 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-06-02T05:06:05.924 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:05.924 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.924 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.924 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "10", 2024-06-02T05:06:05.924 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.924 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.924 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.924 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.924 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.924 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.924 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.924 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.924 INFO:teuthology.orchestra.run.smithi076.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-06-02T05:06:05.925 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-06-02T05:06:05.925 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:05.925 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.925 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.925 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "8", 2024-06-02T05:06:05.925 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.925 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.925 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.925 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.925 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.925 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.925 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.926 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.926 INFO:teuthology.orchestra.run.smithi076.stdout: "REST_REQUESTS_TIMEOUT": { 2024-06-02T05:06:05.926 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-06-02T05:06:05.926 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:05.926 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.926 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.926 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "45", 2024-06-02T05:06:05.926 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.926 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.926 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.926 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.926 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.927 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.927 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.927 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.927 INFO:teuthology.orchestra.run.smithi076.stdout: "RGW_API_ACCESS_KEY": { 2024-06-02T05:06:05.927 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "RGW_API_ACCESS_KEY", 2024-06-02T05:06:05.927 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.927 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.927 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.927 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.927 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.927 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.927 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.928 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.928 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.928 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.928 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.928 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.928 INFO:teuthology.orchestra.run.smithi076.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-06-02T05:06:05.928 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-06-02T05:06:05.928 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.928 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.928 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.928 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "admin", 2024-06-02T05:06:05.928 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.928 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.929 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.929 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.929 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.929 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.929 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.929 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.929 INFO:teuthology.orchestra.run.smithi076.stdout: "RGW_API_SECRET_KEY": { 2024-06-02T05:06:05.929 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "RGW_API_SECRET_KEY", 2024-06-02T05:06:05.929 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.929 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.929 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.929 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.930 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.930 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.930 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.930 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.930 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.930 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.930 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.930 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.930 INFO:teuthology.orchestra.run.smithi076.stdout: "RGW_API_SSL_VERIFY": { 2024-06-02T05:06:05.930 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "RGW_API_SSL_VERIFY", 2024-06-02T05:06:05.930 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.930 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.930 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.931 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:05.931 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.931 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.931 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.931 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.931 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.931 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.931 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.931 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.931 INFO:teuthology.orchestra.run.smithi076.stdout: "UNSAFE_TLS_v1_2": { 2024-06-02T05:06:05.931 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "UNSAFE_TLS_v1_2", 2024-06-02T05:06:05.931 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.931 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.932 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.932 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.932 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.932 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.932 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.932 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.932 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.932 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.932 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.932 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.932 INFO:teuthology.orchestra.run.smithi076.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-06-02T05:06:05.932 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-06-02T05:06:05.932 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:05.933 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.933 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.933 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "0", 2024-06-02T05:06:05.933 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.933 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.933 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.933 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.933 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.933 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.933 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.933 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.933 INFO:teuthology.orchestra.run.smithi076.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-06-02T05:06:05.933 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-06-02T05:06:05.934 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:05.934 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.934 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.934 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "10", 2024-06-02T05:06:05.934 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.934 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.934 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.934 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.934 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.934 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.934 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.934 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.934 INFO:teuthology.orchestra.run.smithi076.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-06-02T05:06:05.935 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-06-02T05:06:05.935 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:05.935 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.935 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.935 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "5", 2024-06-02T05:06:05.935 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.935 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.935 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.935 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.935 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.935 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.935 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.935 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.936 INFO:teuthology.orchestra.run.smithi076.stdout: "cross_origin_url": { 2024-06-02T05:06:05.936 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "cross_origin_url", 2024-06-02T05:06:05.936 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.936 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.936 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.936 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.936 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.936 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.936 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.936 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.936 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.936 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.936 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.937 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.937 INFO:teuthology.orchestra.run.smithi076.stdout: "crt_file": { 2024-06-02T05:06:05.937 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "crt_file", 2024-06-02T05:06:05.937 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.937 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.937 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.937 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.937 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.937 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.937 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.937 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.937 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.937 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.937 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.938 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.938 INFO:teuthology.orchestra.run.smithi076.stdout: "debug": { 2024-06-02T05:06:05.938 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "debug", 2024-06-02T05:06:05.938 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.938 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.938 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.938 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.938 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.938 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.938 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.938 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Enable/disable debug options", 2024-06-02T05:06:05.938 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.939 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.939 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.939 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.939 INFO:teuthology.orchestra.run.smithi076.stdout: "jwt_token_ttl": { 2024-06-02T05:06:05.939 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "jwt_token_ttl", 2024-06-02T05:06:05.939 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:05.939 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.939 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.939 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "28800", 2024-06-02T05:06:05.939 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.939 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.939 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.939 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.939 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.940 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.940 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.940 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.940 INFO:teuthology.orchestra.run.smithi076.stdout: "key_file": { 2024-06-02T05:06:05.940 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "key_file", 2024-06-02T05:06:05.940 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.940 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.940 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.940 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.940 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.940 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.940 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.940 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.941 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.941 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.941 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.941 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.941 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-06-02T05:06:05.941 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-06-02T05:06:05.941 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.941 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.941 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.941 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.941 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.941 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.941 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:05.941 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:05.942 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:05.942 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:05.942 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:05.942 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:05.942 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:05.942 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:05.942 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.942 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.942 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.942 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.942 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.942 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-06-02T05:06:05.942 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-06-02T05:06:05.943 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.943 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.943 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.943 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.943 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.943 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.943 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.943 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.943 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.943 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.943 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.943 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.943 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-06-02T05:06:05.943 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-06-02T05:06:05.944 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.944 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.944 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.944 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-06-02T05:06:05.944 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.944 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.944 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:05.944 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:05.944 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:05.944 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:05.944 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:05.944 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:05.944 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:05.945 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:05.945 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.945 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.945 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.945 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.945 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.945 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-06-02T05:06:05.945 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-06-02T05:06:05.945 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.945 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.945 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.945 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.945 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.946 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.946 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.946 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.946 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.946 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.946 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.946 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.946 INFO:teuthology.orchestra.run.smithi076.stdout: "motd": { 2024-06-02T05:06:05.946 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "motd", 2024-06-02T05:06:05.946 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.946 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.946 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.947 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.947 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.947 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.947 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.947 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "The message of the day", 2024-06-02T05:06:05.947 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.947 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.947 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.947 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.947 INFO:teuthology.orchestra.run.smithi076.stdout: "redirect_resolve_ip_addr": { 2024-06-02T05:06:05.947 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "redirect_resolve_ip_addr", 2024-06-02T05:06:05.947 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.947 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.948 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.948 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.948 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.948 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.948 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.948 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.948 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.948 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.948 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.948 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.948 INFO:teuthology.orchestra.run.smithi076.stdout: "server_addr": { 2024-06-02T05:06:05.948 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "server_addr", 2024-06-02T05:06:05.948 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.948 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.949 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.949 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "::", 2024-06-02T05:06:05.949 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.949 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.949 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.949 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.949 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.949 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.949 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.949 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.949 INFO:teuthology.orchestra.run.smithi076.stdout: "server_port": { 2024-06-02T05:06:05.949 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "server_port", 2024-06-02T05:06:05.949 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:05.950 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.950 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.950 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "8080", 2024-06-02T05:06:05.950 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.950 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.950 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.950 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.950 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.950 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.950 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.950 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.950 INFO:teuthology.orchestra.run.smithi076.stdout: "ssl": { 2024-06-02T05:06:05.951 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "ssl", 2024-06-02T05:06:05.951 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.951 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.951 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.951 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:05.951 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.951 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.951 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.951 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.951 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.951 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.951 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.951 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.952 INFO:teuthology.orchestra.run.smithi076.stdout: "ssl_server_port": { 2024-06-02T05:06:05.952 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "ssl_server_port", 2024-06-02T05:06:05.952 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:05.952 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.952 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.952 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "8443", 2024-06-02T05:06:05.952 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.952 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.952 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.952 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.952 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.952 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.952 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.952 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.953 INFO:teuthology.orchestra.run.smithi076.stdout: "standby_behaviour": { 2024-06-02T05:06:05.953 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "standby_behaviour", 2024-06-02T05:06:05.953 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.953 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.953 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.953 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "redirect", 2024-06-02T05:06:05.953 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.953 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.953 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:05.953 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:05.953 INFO:teuthology.orchestra.run.smithi076.stdout: "redirect" 2024-06-02T05:06:05.953 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:05.953 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.954 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.954 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.954 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.954 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.954 INFO:teuthology.orchestra.run.smithi076.stdout: "standby_error_status_code": { 2024-06-02T05:06:05.954 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "standby_error_status_code", 2024-06-02T05:06:05.954 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:05.954 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.954 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.954 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "500", 2024-06-02T05:06:05.954 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "400", 2024-06-02T05:06:05.954 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "599", 2024-06-02T05:06:05.955 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.955 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.955 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.955 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.955 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.955 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.955 INFO:teuthology.orchestra.run.smithi076.stdout: "url_prefix": { 2024-06-02T05:06:05.955 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "url_prefix", 2024-06-02T05:06:05.955 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.955 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.955 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.955 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.955 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.956 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.956 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.956 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.956 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.956 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.956 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.956 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:05.956 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:05.956 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.956 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:05.956 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "devicehealth", 2024-06-02T05:06:05.956 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-06-02T05:06:05.956 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-06-02T05:06:05.956 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-06-02T05:06:05.957 INFO:teuthology.orchestra.run.smithi076.stdout: "enable_monitoring": { 2024-06-02T05:06:05.957 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "enable_monitoring", 2024-06-02T05:06:05.957 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.957 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.957 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.957 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:05.957 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.957 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.957 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.957 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "monitor device health metrics", 2024-06-02T05:06:05.957 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.957 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.957 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.958 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.958 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-06-02T05:06:05.958 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-06-02T05:06:05.958 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.958 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.958 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.958 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.958 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.958 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.958 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:05.958 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:05.958 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:05.958 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:05.959 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:05.959 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:05.959 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:05.959 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:05.959 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.959 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.959 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.959 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.959 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.959 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-06-02T05:06:05.959 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-06-02T05:06:05.959 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.959 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.960 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.960 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.960 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.960 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.960 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.960 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.960 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.960 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.960 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.960 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.960 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-06-02T05:06:05.960 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-06-02T05:06:05.960 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.961 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.961 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.961 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-06-02T05:06:05.961 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.961 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.961 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:05.961 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:05.961 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:05.961 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:05.961 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:05.961 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:05.961 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:05.961 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:05.962 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.962 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.962 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.962 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.962 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.962 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-06-02T05:06:05.962 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-06-02T05:06:05.962 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.962 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.962 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.962 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.962 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.963 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.963 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.963 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.963 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.963 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.963 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.963 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.963 INFO:teuthology.orchestra.run.smithi076.stdout: "mark_out_threshold": { 2024-06-02T05:06:05.963 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "mark_out_threshold", 2024-06-02T05:06:05.963 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-06-02T05:06:05.963 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.963 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.963 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "2419200", 2024-06-02T05:06:05.964 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.964 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.964 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.964 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-06-02T05:06:05.964 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.964 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.964 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.964 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.964 INFO:teuthology.orchestra.run.smithi076.stdout: "pool_name": { 2024-06-02T05:06:05.964 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "pool_name", 2024-06-02T05:06:05.964 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.964 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.964 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.964 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "device_health_metrics", 2024-06-02T05:06:05.965 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.965 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.965 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.965 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "name of pool in which to store device health metrics", 2024-06-02T05:06:05.965 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.965 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.965 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.965 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.965 INFO:teuthology.orchestra.run.smithi076.stdout: "retention_period": { 2024-06-02T05:06:05.965 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "retention_period", 2024-06-02T05:06:05.965 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-06-02T05:06:05.965 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.966 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.966 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "15552000", 2024-06-02T05:06:05.966 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.966 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.966 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.966 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "how long to retain device health metrics", 2024-06-02T05:06:05.966 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.966 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.966 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.966 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.966 INFO:teuthology.orchestra.run.smithi076.stdout: "scrape_frequency": { 2024-06-02T05:06:05.966 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "scrape_frequency", 2024-06-02T05:06:05.967 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-06-02T05:06:05.967 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.967 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.967 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "86400", 2024-06-02T05:06:05.967 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.967 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.967 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.967 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "how frequently to scrape device health metrics", 2024-06-02T05:06:05.967 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.967 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.967 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.967 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.967 INFO:teuthology.orchestra.run.smithi076.stdout: "self_heal": { 2024-06-02T05:06:05.968 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "self_heal", 2024-06-02T05:06:05.968 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.968 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.968 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.968 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:05.968 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.968 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.968 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.968 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-06-02T05:06:05.968 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.968 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.968 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.968 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.968 INFO:teuthology.orchestra.run.smithi076.stdout: "sleep_interval": { 2024-06-02T05:06:05.969 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "sleep_interval", 2024-06-02T05:06:05.969 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-06-02T05:06:05.969 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.969 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.969 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "600", 2024-06-02T05:06:05.969 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.969 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.969 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.969 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "how frequently to wake up and check device health", 2024-06-02T05:06:05.969 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.969 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.969 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.969 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.970 INFO:teuthology.orchestra.run.smithi076.stdout: "warn_threshold": { 2024-06-02T05:06:05.970 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "warn_threshold", 2024-06-02T05:06:05.970 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-06-02T05:06:05.970 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.970 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.970 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "7257600", 2024-06-02T05:06:05.970 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.970 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.970 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.970 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-06-02T05:06:05.970 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.970 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.970 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.971 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:05.971 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:05.971 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.971 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:05.971 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "diskprediction_local", 2024-06-02T05:06:05.971 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-06-02T05:06:05.971 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-06-02T05:06:05.971 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-06-02T05:06:05.971 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-06-02T05:06:05.971 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-06-02T05:06:05.971 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.971 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.971 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.972 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.972 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.972 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.972 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:05.972 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:05.972 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:05.972 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:05.972 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:05.972 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:05.972 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:05.972 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:05.972 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.972 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.972 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.973 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.973 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.973 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-06-02T05:06:05.973 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-06-02T05:06:05.973 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.973 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.973 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.973 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.973 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.973 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.973 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.973 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.973 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.974 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.974 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.974 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.974 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-06-02T05:06:05.974 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-06-02T05:06:05.974 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.974 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.974 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.974 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-06-02T05:06:05.974 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.974 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.974 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:05.974 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:05.975 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:05.975 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:05.975 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:05.975 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:05.975 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:05.975 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:05.975 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.975 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.975 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.975 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.975 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.975 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-06-02T05:06:05.976 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-06-02T05:06:05.976 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.976 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.976 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.976 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.976 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.976 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.976 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.976 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.976 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.976 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.976 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.976 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.977 INFO:teuthology.orchestra.run.smithi076.stdout: "predict_interval": { 2024-06-02T05:06:05.977 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "predict_interval", 2024-06-02T05:06:05.977 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.977 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.977 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.977 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "86400", 2024-06-02T05:06:05.977 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.977 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.977 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.977 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.977 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.977 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.977 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.977 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.978 INFO:teuthology.orchestra.run.smithi076.stdout: "predictor_model": { 2024-06-02T05:06:05.978 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "predictor_model", 2024-06-02T05:06:05.978 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.978 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.978 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.978 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "prophetstor", 2024-06-02T05:06:05.978 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.978 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.978 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.978 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.978 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.978 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.978 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.979 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.979 INFO:teuthology.orchestra.run.smithi076.stdout: "sleep_interval": { 2024-06-02T05:06:05.979 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "sleep_interval", 2024-06-02T05:06:05.979 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.979 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.979 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.979 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "600", 2024-06-02T05:06:05.979 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.979 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.979 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.979 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.979 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.979 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.980 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.980 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:05.980 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:05.980 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.980 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:05.980 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "influx", 2024-06-02T05:06:05.980 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": false, 2024-06-02T05:06:05.980 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "influxdb python module not found", 2024-06-02T05:06:05.980 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-06-02T05:06:05.980 INFO:teuthology.orchestra.run.smithi076.stdout: "batch_size": { 2024-06-02T05:06:05.980 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "batch_size", 2024-06-02T05:06:05.980 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:05.980 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.981 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.981 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "5000", 2024-06-02T05:06:05.981 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.981 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.981 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.981 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-06-02T05:06:05.981 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.981 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.981 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.981 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.981 INFO:teuthology.orchestra.run.smithi076.stdout: "database": { 2024-06-02T05:06:05.981 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "database", 2024-06-02T05:06:05.981 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.982 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.982 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.982 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "ceph", 2024-06-02T05:06:05.982 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.982 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.982 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.982 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-06-02T05:06:05.982 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.982 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.982 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.982 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.982 INFO:teuthology.orchestra.run.smithi076.stdout: "hostname": { 2024-06-02T05:06:05.982 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "hostname", 2024-06-02T05:06:05.983 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.983 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.983 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.983 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.983 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.983 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.983 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.983 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "InfluxDB server hostname", 2024-06-02T05:06:05.983 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.983 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.983 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.983 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.983 INFO:teuthology.orchestra.run.smithi076.stdout: "interval": { 2024-06-02T05:06:05.984 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "interval", 2024-06-02T05:06:05.984 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-06-02T05:06:05.984 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.984 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.984 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "30", 2024-06-02T05:06:05.984 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "5", 2024-06-02T05:06:05.984 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.984 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.984 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-06-02T05:06:05.984 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.984 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.984 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.984 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.985 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-06-02T05:06:05.985 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-06-02T05:06:05.985 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.985 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.985 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.985 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.985 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.985 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.985 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:05.985 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:05.985 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:05.985 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:05.985 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:05.985 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:05.986 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:05.986 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:05.986 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.986 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.986 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.986 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.986 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.986 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-06-02T05:06:05.986 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-06-02T05:06:05.986 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.986 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.986 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.986 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.987 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.987 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.987 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.987 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.987 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.987 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.987 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.987 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.987 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-06-02T05:06:05.987 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-06-02T05:06:05.987 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.987 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.987 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.987 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-06-02T05:06:05.988 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.988 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.988 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:05.988 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:05.988 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:05.988 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:05.988 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:05.988 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:05.988 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:05.988 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:05.988 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.988 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.988 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.989 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.989 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.989 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-06-02T05:06:05.989 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-06-02T05:06:05.989 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.989 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.989 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.989 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.989 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.989 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.989 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.989 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.989 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.990 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.990 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.990 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.990 INFO:teuthology.orchestra.run.smithi076.stdout: "password": { 2024-06-02T05:06:05.990 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "password", 2024-06-02T05:06:05.990 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.990 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.990 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.990 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.990 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.990 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.990 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.990 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "password of InfluxDB server user", 2024-06-02T05:06:05.991 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.991 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.991 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.991 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.991 INFO:teuthology.orchestra.run.smithi076.stdout: "port": { 2024-06-02T05:06:05.991 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "port", 2024-06-02T05:06:05.991 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:05.991 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.991 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.991 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "8086", 2024-06-02T05:06:05.991 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.991 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.991 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.991 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "InfluxDB server port", 2024-06-02T05:06:05.992 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.992 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.992 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.992 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.992 INFO:teuthology.orchestra.run.smithi076.stdout: "ssl": { 2024-06-02T05:06:05.992 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "ssl", 2024-06-02T05:06:05.992 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.992 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.992 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.992 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "false", 2024-06-02T05:06:05.992 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.992 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.992 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.993 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-06-02T05:06:05.993 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.993 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.993 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.993 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.993 INFO:teuthology.orchestra.run.smithi076.stdout: "threads": { 2024-06-02T05:06:05.993 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "threads", 2024-06-02T05:06:05.993 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:05.993 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.993 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.993 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "5", 2024-06-02T05:06:05.993 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "1", 2024-06-02T05:06:05.993 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "32", 2024-06-02T05:06:05.993 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.994 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-06-02T05:06:05.994 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.994 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.994 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.994 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.994 INFO:teuthology.orchestra.run.smithi076.stdout: "username": { 2024-06-02T05:06:05.994 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "username", 2024-06-02T05:06:05.994 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.994 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.994 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.994 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.994 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.994 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.995 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.995 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "username of InfluxDB server user", 2024-06-02T05:06:05.995 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.995 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.995 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.995 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.995 INFO:teuthology.orchestra.run.smithi076.stdout: "verify_ssl": { 2024-06-02T05:06:05.995 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "verify_ssl", 2024-06-02T05:06:05.995 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.995 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.995 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:05.995 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "true", 2024-06-02T05:06:05.995 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.996 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.996 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.996 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-06-02T05:06:05.996 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.996 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.996 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.996 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:05.996 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:05.996 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.996 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:05.996 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "insights", 2024-06-02T05:06:05.996 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-06-02T05:06:05.996 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-06-02T05:06:05.997 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-06-02T05:06:05.997 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-06-02T05:06:05.997 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-06-02T05:06:05.997 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:05.997 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.997 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.997 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:05.997 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.997 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.997 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:05.997 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:05.997 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:05.997 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:05.998 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:05.998 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:05.998 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:05.998 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:05.998 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.998 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.998 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.998 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.998 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.998 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-06-02T05:06:05.998 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-06-02T05:06:05.998 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:05.998 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:05.999 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:05.999 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:05.999 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:05.999 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:05.999 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:05.999 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:05.999 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:05.999 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:05.999 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:05.999 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:05.999 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-06-02T05:06:05.999 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-06-02T05:06:05.999 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.000 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.000 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.000 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-06-02T05:06:06.000 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.000 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.000 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.000 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.000 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.000 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.000 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.000 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.000 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.000 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.001 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.001 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.001 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.001 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.001 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.001 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-06-02T05:06:06.001 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-06-02T05:06:06.001 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.001 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.001 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.001 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.001 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.001 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.002 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.002 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.002 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.002 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.002 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.002 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.002 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.002 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.002 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:06.002 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "iostat", 2024-06-02T05:06:06.002 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-06-02T05:06:06.002 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-06-02T05:06:06.002 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-06-02T05:06:06.003 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-06-02T05:06:06.003 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-06-02T05:06:06.003 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.003 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.003 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.003 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.003 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.003 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.003 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.003 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.003 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.003 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.003 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.003 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.004 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.004 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.004 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.004 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.004 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.004 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.004 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.004 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-06-02T05:06:06.004 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-06-02T05:06:06.004 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.004 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.004 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.005 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.005 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.005 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.005 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.005 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.005 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.005 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.005 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.005 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.005 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-06-02T05:06:06.005 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-06-02T05:06:06.005 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.005 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.005 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.006 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-06-02T05:06:06.006 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.006 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.006 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.006 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.006 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.006 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.006 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.006 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.006 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.006 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.006 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.007 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.007 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.007 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.007 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.007 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-06-02T05:06:06.007 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-06-02T05:06:06.007 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.007 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.007 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.007 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.007 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.007 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.007 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.008 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.008 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.008 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.008 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.008 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.008 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.008 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.008 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:06.008 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "k8sevents", 2024-06-02T05:06:06.008 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-06-02T05:06:06.008 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-06-02T05:06:06.008 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-06-02T05:06:06.009 INFO:teuthology.orchestra.run.smithi076.stdout: "ceph_event_retention_days": { 2024-06-02T05:06:06.009 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "ceph_event_retention_days", 2024-06-02T05:06:06.009 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:06.009 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.009 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.009 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "7", 2024-06-02T05:06:06.009 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.009 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.009 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.009 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Days to hold ceph event information within local cache", 2024-06-02T05:06:06.009 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.009 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.009 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.010 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.010 INFO:teuthology.orchestra.run.smithi076.stdout: "config_check_secs": { 2024-06-02T05:06:06.010 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "config_check_secs", 2024-06-02T05:06:06.010 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:06.010 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.010 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.010 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "10", 2024-06-02T05:06:06.010 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "10", 2024-06-02T05:06:06.010 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.010 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.010 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-06-02T05:06:06.010 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.011 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.011 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.011 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.011 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-06-02T05:06:06.011 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-06-02T05:06:06.011 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.011 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.011 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.011 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.011 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.011 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.011 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.011 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.012 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.012 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.012 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.012 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.012 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.012 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.012 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.012 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.012 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.012 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.012 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.013 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-06-02T05:06:06.013 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-06-02T05:06:06.013 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.013 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.013 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.013 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.013 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.013 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.013 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.013 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.013 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.013 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.013 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.013 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.014 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-06-02T05:06:06.014 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-06-02T05:06:06.014 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.014 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.014 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.014 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-06-02T05:06:06.014 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.014 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.014 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.014 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.014 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.014 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.015 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.015 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.015 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.015 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.015 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.015 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.015 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.015 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.015 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.015 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-06-02T05:06:06.015 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-06-02T05:06:06.015 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.015 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.016 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.016 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.016 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.016 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.016 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.016 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.016 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.016 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.016 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.016 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.016 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.016 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.016 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:06.017 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "localpool", 2024-06-02T05:06:06.017 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-06-02T05:06:06.017 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-06-02T05:06:06.017 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-06-02T05:06:06.017 INFO:teuthology.orchestra.run.smithi076.stdout: "failure_domain": { 2024-06-02T05:06:06.017 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "failure_domain", 2024-06-02T05:06:06.017 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.017 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.017 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.017 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "host", 2024-06-02T05:06:06.017 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.017 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.017 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.018 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "failure domain for any created local pool", 2024-06-02T05:06:06.018 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-06-02T05:06:06.018 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.018 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.018 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.018 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-06-02T05:06:06.018 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-06-02T05:06:06.018 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.018 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.018 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.018 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.018 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.018 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.019 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.019 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.019 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.019 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.019 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.019 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.019 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.019 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.019 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.019 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.019 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.019 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.020 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.020 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-06-02T05:06:06.020 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-06-02T05:06:06.020 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.020 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.020 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.020 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.020 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.020 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.020 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.020 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.020 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.020 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.021 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.021 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.021 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-06-02T05:06:06.021 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-06-02T05:06:06.021 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.021 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.021 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.021 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-06-02T05:06:06.021 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.021 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.021 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.021 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.021 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.022 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.022 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.022 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.022 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.022 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.022 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.022 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.022 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.022 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.022 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.022 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-06-02T05:06:06.022 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-06-02T05:06:06.023 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.023 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.023 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.023 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.023 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.023 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.023 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.023 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.023 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.023 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.023 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.023 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.023 INFO:teuthology.orchestra.run.smithi076.stdout: "min_size": { 2024-06-02T05:06:06.023 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "min_size", 2024-06-02T05:06:06.024 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:06.024 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.024 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.024 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.024 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.024 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.024 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.024 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "default min_size for any created local pool", 2024-06-02T05:06:06.024 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-06-02T05:06:06.024 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.024 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.024 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.024 INFO:teuthology.orchestra.run.smithi076.stdout: "num_rep": { 2024-06-02T05:06:06.025 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "num_rep", 2024-06-02T05:06:06.025 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:06.025 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.025 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.025 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "3", 2024-06-02T05:06:06.025 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.025 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.025 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.025 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "default replica count for any created local pool", 2024-06-02T05:06:06.025 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.025 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.025 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.025 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.026 INFO:teuthology.orchestra.run.smithi076.stdout: "pg_num": { 2024-06-02T05:06:06.026 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "pg_num", 2024-06-02T05:06:06.026 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:06.026 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.026 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.026 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "128", 2024-06-02T05:06:06.026 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.026 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.026 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.026 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "default pg_num for any created local pool", 2024-06-02T05:06:06.026 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.026 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.026 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.027 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.027 INFO:teuthology.orchestra.run.smithi076.stdout: "prefix": { 2024-06-02T05:06:06.027 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "prefix", 2024-06-02T05:06:06.027 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.027 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.027 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.027 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.027 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.027 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.027 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.027 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "name prefix for any created local pool", 2024-06-02T05:06:06.027 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.027 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.028 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.028 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.028 INFO:teuthology.orchestra.run.smithi076.stdout: "subtree": { 2024-06-02T05:06:06.028 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "subtree", 2024-06-02T05:06:06.028 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.028 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.028 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.028 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "rack", 2024-06-02T05:06:06.028 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.028 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.028 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.028 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "CRUSH level for which to create a local pool", 2024-06-02T05:06:06.028 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-06-02T05:06:06.028 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.029 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.029 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.029 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.029 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.029 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:06.029 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "mds_autoscaler", 2024-06-02T05:06:06.029 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-06-02T05:06:06.029 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-06-02T05:06:06.029 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-06-02T05:06:06.029 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-06-02T05:06:06.029 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-06-02T05:06:06.029 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.029 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.030 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.030 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.030 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.030 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.030 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.030 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.030 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.030 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.030 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.030 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.030 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.030 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.030 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.031 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.031 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.031 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.031 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.031 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-06-02T05:06:06.031 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-06-02T05:06:06.031 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.031 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.031 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.031 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.031 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.031 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.032 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.032 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.032 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.032 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.032 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.032 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.032 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-06-02T05:06:06.032 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-06-02T05:06:06.032 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.032 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.032 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.032 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-06-02T05:06:06.032 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.033 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.033 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.033 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.033 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.033 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.033 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.033 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.033 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.033 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.033 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.034 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.034 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.034 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.034 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.034 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-06-02T05:06:06.034 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-06-02T05:06:06.034 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.034 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.034 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.034 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.034 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.034 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.034 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.035 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.035 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.035 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.035 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.035 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.035 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.035 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.035 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:06.035 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "mirroring", 2024-06-02T05:06:06.035 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-06-02T05:06:06.035 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-06-02T05:06:06.035 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-06-02T05:06:06.036 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-06-02T05:06:06.036 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-06-02T05:06:06.036 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.036 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.036 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.036 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.036 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.036 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.036 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.036 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.036 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.036 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.036 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.037 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.037 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.037 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.037 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.037 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.037 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.037 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.037 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.037 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-06-02T05:06:06.037 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-06-02T05:06:06.037 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.037 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.037 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.038 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.038 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.038 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.038 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.038 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.038 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.038 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.038 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.038 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.038 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-06-02T05:06:06.038 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-06-02T05:06:06.038 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.038 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.039 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.039 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-06-02T05:06:06.039 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.039 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.039 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.039 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.039 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.039 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.039 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.039 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.039 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.039 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.039 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.040 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.040 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.040 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.040 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.040 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-06-02T05:06:06.040 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-06-02T05:06:06.040 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.040 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.040 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.040 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.040 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.040 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.040 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.041 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.041 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.041 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.041 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.041 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.041 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.041 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.041 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:06.041 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "nfs", 2024-06-02T05:06:06.041 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-06-02T05:06:06.041 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-06-02T05:06:06.041 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-06-02T05:06:06.042 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-06-02T05:06:06.042 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-06-02T05:06:06.042 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.042 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.042 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.042 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.042 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.042 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.042 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.042 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.042 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.042 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.042 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.043 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.043 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.043 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.043 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.043 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.043 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.043 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.043 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.043 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-06-02T05:06:06.043 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-06-02T05:06:06.043 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.043 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.043 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.044 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.044 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.044 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.044 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.044 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.044 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.044 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.044 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.044 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.044 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-06-02T05:06:06.044 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-06-02T05:06:06.044 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.044 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.045 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.045 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-06-02T05:06:06.045 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.045 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.045 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.045 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.045 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.045 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.045 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.045 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.045 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.045 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.045 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.045 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.046 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.046 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.046 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.046 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-06-02T05:06:06.046 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-06-02T05:06:06.046 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.046 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.046 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.046 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.046 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.046 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.046 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.047 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.047 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.047 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.047 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.047 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.047 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.047 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.047 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:06.047 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "orchestrator", 2024-06-02T05:06:06.047 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-06-02T05:06:06.047 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-06-02T05:06:06.047 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-06-02T05:06:06.047 INFO:teuthology.orchestra.run.smithi076.stdout: "fail_fs": { 2024-06-02T05:06:06.048 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "fail_fs", 2024-06-02T05:06:06.048 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.048 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.048 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.048 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.048 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.048 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.048 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.048 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-06-02T05:06:06.048 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.048 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.048 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.048 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.048 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-06-02T05:06:06.049 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-06-02T05:06:06.049 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.049 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.049 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.049 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.049 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.049 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.049 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.049 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.049 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.049 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.049 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.050 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.050 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.050 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.050 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.050 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.050 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.050 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.050 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.050 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-06-02T05:06:06.050 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-06-02T05:06:06.050 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.050 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.051 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.051 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.051 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.051 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.051 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.051 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.051 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.051 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.051 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.051 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.051 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-06-02T05:06:06.051 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-06-02T05:06:06.052 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.052 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.052 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.052 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-06-02T05:06:06.052 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.052 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.052 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.052 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.052 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.052 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.052 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.052 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.052 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.053 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.053 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.053 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.053 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.053 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.053 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.053 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-06-02T05:06:06.053 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-06-02T05:06:06.053 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.053 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.053 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.053 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.053 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.053 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.054 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.054 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.054 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.054 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.054 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.054 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.054 INFO:teuthology.orchestra.run.smithi076.stdout: "orchestrator": { 2024-06-02T05:06:06.054 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "orchestrator", 2024-06-02T05:06:06.054 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.054 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.054 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.054 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.054 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.055 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.055 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.055 INFO:teuthology.orchestra.run.smithi076.stdout: "cephadm", 2024-06-02T05:06:06.055 INFO:teuthology.orchestra.run.smithi076.stdout: "rook", 2024-06-02T05:06:06.055 INFO:teuthology.orchestra.run.smithi076.stdout: "test_orchestrator" 2024-06-02T05:06:06.055 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.055 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Orchestrator backend", 2024-06-02T05:06:06.055 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.055 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.055 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.055 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.055 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.056 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.056 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:06.056 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "osd_perf_query", 2024-06-02T05:06:06.056 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-06-02T05:06:06.056 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-06-02T05:06:06.056 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-06-02T05:06:06.056 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-06-02T05:06:06.056 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-06-02T05:06:06.056 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.056 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.056 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.056 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.056 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.057 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.057 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.057 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.057 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.057 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.057 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.057 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.057 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.057 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.057 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.057 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.057 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.057 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.058 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.058 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-06-02T05:06:06.058 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-06-02T05:06:06.058 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.058 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.058 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.058 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.058 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.058 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.058 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.058 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.058 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.058 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.059 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.059 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.059 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-06-02T05:06:06.059 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-06-02T05:06:06.059 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.059 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.059 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.059 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-06-02T05:06:06.059 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.059 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.059 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.059 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.059 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.059 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.060 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.060 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.060 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.060 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.060 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.060 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.060 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.060 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.060 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.060 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-06-02T05:06:06.060 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-06-02T05:06:06.060 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.061 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.061 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.061 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.061 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.061 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.061 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.061 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.061 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.061 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.061 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.061 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.061 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.061 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.061 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:06.062 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "osd_support", 2024-06-02T05:06:06.062 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-06-02T05:06:06.062 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-06-02T05:06:06.062 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-06-02T05:06:06.062 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-06-02T05:06:06.062 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-06-02T05:06:06.062 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.062 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.062 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.062 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.062 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.062 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.062 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.063 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.063 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.063 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.063 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.063 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.063 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.063 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.063 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.063 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.063 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.063 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.063 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.063 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-06-02T05:06:06.064 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-06-02T05:06:06.064 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.064 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.064 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.064 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.064 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.064 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.064 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.064 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.064 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.064 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.064 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.064 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.065 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-06-02T05:06:06.065 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-06-02T05:06:06.065 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.065 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.065 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.065 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-06-02T05:06:06.065 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.065 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.065 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.065 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.065 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.065 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.066 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.066 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.066 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.066 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.066 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.066 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.066 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.066 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.066 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.066 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-06-02T05:06:06.066 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-06-02T05:06:06.066 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.066 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.067 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.067 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.067 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.067 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.067 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.067 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.067 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.067 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.067 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.067 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.067 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.067 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.068 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:06.068 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "pg_autoscaler", 2024-06-02T05:06:06.068 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-06-02T05:06:06.068 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-06-02T05:06:06.068 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-06-02T05:06:06.068 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-06-02T05:06:06.068 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-06-02T05:06:06.068 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.068 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.068 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.068 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.068 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.068 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.069 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.069 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.069 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.069 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.069 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.069 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.069 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.069 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.069 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.069 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.069 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.069 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.069 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.070 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-06-02T05:06:06.070 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-06-02T05:06:06.070 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.070 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.070 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.070 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.070 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.070 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.070 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.070 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.070 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.070 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.070 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.071 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.071 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-06-02T05:06:06.071 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-06-02T05:06:06.071 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.071 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.071 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.071 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-06-02T05:06:06.071 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.071 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.071 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.071 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.071 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.071 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.072 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.072 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.072 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.072 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.072 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.072 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.072 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.072 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.072 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.072 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-06-02T05:06:06.072 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-06-02T05:06:06.073 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.073 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.073 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.073 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.073 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.073 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.073 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.073 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.073 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.073 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.073 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.073 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.073 INFO:teuthology.orchestra.run.smithi076.stdout: "sleep_interval": { 2024-06-02T05:06:06.073 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "sleep_interval", 2024-06-02T05:06:06.074 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-06-02T05:06:06.074 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.074 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.074 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "60", 2024-06-02T05:06:06.074 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.074 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.074 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.074 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.074 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.074 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.074 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.074 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.074 INFO:teuthology.orchestra.run.smithi076.stdout: "threshold": { 2024-06-02T05:06:06.075 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "threshold", 2024-06-02T05:06:06.075 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "float", 2024-06-02T05:06:06.075 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.075 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.075 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "3.0", 2024-06-02T05:06:06.075 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "1.0", 2024-06-02T05:06:06.075 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.075 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.075 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "scaling threshold", 2024-06-02T05:06:06.075 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-06-02T05:06:06.075 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.075 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.075 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.076 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.076 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.076 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:06.076 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "progress", 2024-06-02T05:06:06.076 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-06-02T05:06:06.076 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-06-02T05:06:06.076 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-06-02T05:06:06.076 INFO:teuthology.orchestra.run.smithi076.stdout: "allow_pg_recovery_event": { 2024-06-02T05:06:06.076 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "allow_pg_recovery_event", 2024-06-02T05:06:06.076 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.076 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.076 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.076 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.077 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.077 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.077 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.077 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "allow the module to show pg recovery progress", 2024-06-02T05:06:06.077 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.077 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.077 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.077 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.077 INFO:teuthology.orchestra.run.smithi076.stdout: "enabled": { 2024-06-02T05:06:06.077 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "enabled", 2024-06-02T05:06:06.077 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.077 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.077 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.078 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:06.078 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.078 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.078 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.078 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.078 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.078 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.078 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.078 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.078 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-06-02T05:06:06.078 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-06-02T05:06:06.078 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.078 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.079 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.079 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.079 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.079 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.079 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.079 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.079 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.079 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.079 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.079 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.079 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.079 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.079 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.080 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.080 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.080 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.080 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.080 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-06-02T05:06:06.080 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-06-02T05:06:06.080 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.080 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.080 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.080 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.080 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.080 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.080 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.081 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.081 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.081 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.081 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.081 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.081 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-06-02T05:06:06.081 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-06-02T05:06:06.081 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.081 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.081 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.081 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-06-02T05:06:06.081 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.081 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.081 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.082 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.082 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.082 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.082 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.082 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.082 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.082 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.082 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.082 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.082 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.082 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.082 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.082 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-06-02T05:06:06.083 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-06-02T05:06:06.083 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.083 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.083 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.083 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.083 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.083 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.083 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.083 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.083 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.083 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.083 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.083 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.084 INFO:teuthology.orchestra.run.smithi076.stdout: "max_completed_events": { 2024-06-02T05:06:06.084 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "max_completed_events", 2024-06-02T05:06:06.084 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:06.084 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.084 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.084 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "50", 2024-06-02T05:06:06.084 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.084 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.084 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.084 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "number of past completed events to remember", 2024-06-02T05:06:06.084 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.084 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.084 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.084 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.085 INFO:teuthology.orchestra.run.smithi076.stdout: "sleep_interval": { 2024-06-02T05:06:06.085 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "sleep_interval", 2024-06-02T05:06:06.085 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-06-02T05:06:06.085 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.085 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.085 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "5", 2024-06-02T05:06:06.085 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.085 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.085 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.085 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "how long the module is going to sleep", 2024-06-02T05:06:06.085 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.085 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.085 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.086 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.086 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.086 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.086 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:06.086 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "prometheus", 2024-06-02T05:06:06.086 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-06-02T05:06:06.086 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-06-02T05:06:06.086 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-06-02T05:06:06.086 INFO:teuthology.orchestra.run.smithi076.stdout: "cache": { 2024-06-02T05:06:06.086 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "cache", 2024-06-02T05:06:06.086 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.086 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.087 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.087 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:06.087 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.087 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.087 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.087 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.087 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.087 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.087 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.087 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.087 INFO:teuthology.orchestra.run.smithi076.stdout: "exclude_perf_counters": { 2024-06-02T05:06:06.087 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "exclude_perf_counters", 2024-06-02T05:06:06.087 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.087 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.088 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.088 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:06.088 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.088 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.088 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.088 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-06-02T05:06:06.088 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-06-02T05:06:06.088 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.088 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.088 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.088 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-06-02T05:06:06.088 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-06-02T05:06:06.088 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.089 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.089 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.089 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.089 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.089 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.089 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.089 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.089 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.089 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.089 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.089 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.089 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.090 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.090 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.090 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.090 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.090 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.090 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.090 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-06-02T05:06:06.090 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-06-02T05:06:06.090 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.090 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.090 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.090 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.090 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.090 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.091 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.091 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.091 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.091 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.091 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.091 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.091 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-06-02T05:06:06.091 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-06-02T05:06:06.091 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.092 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.092 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.092 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-06-02T05:06:06.092 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.092 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.092 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.092 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.092 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.092 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.092 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.092 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.092 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.092 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.093 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.093 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.093 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.093 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.093 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.093 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-06-02T05:06:06.093 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-06-02T05:06:06.093 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.093 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.093 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.093 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.093 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.093 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.094 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.094 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.094 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.094 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.094 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.094 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.094 INFO:teuthology.orchestra.run.smithi076.stdout: "rbd_stats_pools": { 2024-06-02T05:06:06.094 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "rbd_stats_pools", 2024-06-02T05:06:06.094 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.094 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.094 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.094 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.095 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.095 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.095 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.095 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.095 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.095 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.095 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.095 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.095 INFO:teuthology.orchestra.run.smithi076.stdout: "rbd_stats_pools_refresh_interval": { 2024-06-02T05:06:06.095 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-06-02T05:06:06.095 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:06.095 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.095 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.096 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "300", 2024-06-02T05:06:06.096 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.096 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.096 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.096 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.096 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.096 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.096 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.096 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.096 INFO:teuthology.orchestra.run.smithi076.stdout: "scrape_interval": { 2024-06-02T05:06:06.096 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "scrape_interval", 2024-06-02T05:06:06.096 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "float", 2024-06-02T05:06:06.096 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.097 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.097 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "15.0", 2024-06-02T05:06:06.097 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.097 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.097 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.097 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.097 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.097 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.097 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.097 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.097 INFO:teuthology.orchestra.run.smithi076.stdout: "server_addr": { 2024-06-02T05:06:06.097 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "server_addr", 2024-06-02T05:06:06.097 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.098 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.098 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.098 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "::", 2024-06-02T05:06:06.098 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.098 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.098 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.098 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-06-02T05:06:06.098 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.098 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.098 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.098 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.098 INFO:teuthology.orchestra.run.smithi076.stdout: "server_port": { 2024-06-02T05:06:06.099 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "server_port", 2024-06-02T05:06:06.099 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:06.099 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.099 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.099 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "9283", 2024-06-02T05:06:06.099 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.099 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.099 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.099 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-06-02T05:06:06.099 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.099 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.099 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.099 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.100 INFO:teuthology.orchestra.run.smithi076.stdout: "stale_cache_strategy": { 2024-06-02T05:06:06.100 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "stale_cache_strategy", 2024-06-02T05:06:06.100 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.100 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.100 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.100 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "log", 2024-06-02T05:06:06.100 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.100 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.100 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.100 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.100 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.100 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.100 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.100 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.101 INFO:teuthology.orchestra.run.smithi076.stdout: "standby_behaviour": { 2024-06-02T05:06:06.101 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "standby_behaviour", 2024-06-02T05:06:06.101 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.101 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.101 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.101 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "default", 2024-06-02T05:06:06.101 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.101 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.101 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.101 INFO:teuthology.orchestra.run.smithi076.stdout: "default", 2024-06-02T05:06:06.101 INFO:teuthology.orchestra.run.smithi076.stdout: "error" 2024-06-02T05:06:06.101 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.101 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.102 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.102 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.102 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.102 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.102 INFO:teuthology.orchestra.run.smithi076.stdout: "standby_error_status_code": { 2024-06-02T05:06:06.102 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "standby_error_status_code", 2024-06-02T05:06:06.102 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:06.102 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.102 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.102 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "500", 2024-06-02T05:06:06.102 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "400", 2024-06-02T05:06:06.102 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "599", 2024-06-02T05:06:06.103 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.103 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.103 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.103 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.103 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.103 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.103 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.103 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.103 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:06.103 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "rbd_support", 2024-06-02T05:06:06.103 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-06-02T05:06:06.103 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-06-02T05:06:06.103 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-06-02T05:06:06.104 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-06-02T05:06:06.104 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-06-02T05:06:06.104 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.104 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.104 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.104 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.104 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.104 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.104 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.104 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.104 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.104 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.104 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.104 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.105 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.105 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.105 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.105 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.105 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.105 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.105 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.105 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-06-02T05:06:06.105 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-06-02T05:06:06.105 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.105 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.105 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.105 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.106 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.106 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.106 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.106 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.106 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.106 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.106 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.106 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.106 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-06-02T05:06:06.106 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-06-02T05:06:06.106 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.106 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.106 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.107 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-06-02T05:06:06.107 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.107 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.107 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.107 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.107 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.107 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.107 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.107 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.107 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.107 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.107 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.107 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.108 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.108 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.108 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.108 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-06-02T05:06:06.108 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-06-02T05:06:06.108 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.108 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.108 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.108 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.108 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.108 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.108 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.108 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.108 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.109 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.109 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.109 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.109 INFO:teuthology.orchestra.run.smithi076.stdout: "max_concurrent_snap_create": { 2024-06-02T05:06:06.109 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "max_concurrent_snap_create", 2024-06-02T05:06:06.109 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:06.109 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.109 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.109 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "10", 2024-06-02T05:06:06.109 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.109 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.109 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.109 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.110 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.110 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.110 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.110 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.110 INFO:teuthology.orchestra.run.smithi076.stdout: "mirror_snapshot_schedule": { 2024-06-02T05:06:06.110 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "mirror_snapshot_schedule", 2024-06-02T05:06:06.110 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.110 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.110 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.110 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.110 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.110 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.110 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.111 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.111 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.111 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.111 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.111 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.111 INFO:teuthology.orchestra.run.smithi076.stdout: "trash_purge_schedule": { 2024-06-02T05:06:06.111 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "trash_purge_schedule", 2024-06-02T05:06:06.111 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.111 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.111 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.111 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.111 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.111 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.112 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.112 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.112 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.112 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.112 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.112 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.112 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.112 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.112 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:06.112 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "restful", 2024-06-02T05:06:06.112 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-06-02T05:06:06.112 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-06-02T05:06:06.112 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-06-02T05:06:06.113 INFO:teuthology.orchestra.run.smithi076.stdout: "enable_auth": { 2024-06-02T05:06:06.113 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "enable_auth", 2024-06-02T05:06:06.113 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.113 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.113 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.113 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:06.113 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.113 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.113 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.113 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.113 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.113 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.113 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.113 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.114 INFO:teuthology.orchestra.run.smithi076.stdout: "key_file": { 2024-06-02T05:06:06.114 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "key_file", 2024-06-02T05:06:06.114 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.114 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.114 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.114 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.114 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.114 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.114 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.114 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.114 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.114 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.114 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.115 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.115 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-06-02T05:06:06.115 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-06-02T05:06:06.115 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.115 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.115 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.115 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.115 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.115 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.115 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.115 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.115 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.116 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.116 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.116 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.116 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.116 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.116 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.116 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.116 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.116 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.116 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.116 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-06-02T05:06:06.116 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-06-02T05:06:06.117 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.117 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.117 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.117 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.117 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.117 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.117 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.117 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.117 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.117 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.117 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.117 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.117 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-06-02T05:06:06.118 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-06-02T05:06:06.118 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.118 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.118 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.118 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-06-02T05:06:06.118 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.118 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.118 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.118 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.118 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.118 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.118 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.118 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.119 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.119 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.119 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.119 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.119 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.119 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.119 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.119 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-06-02T05:06:06.119 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-06-02T05:06:06.119 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.119 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.119 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.119 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.120 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.120 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.120 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.120 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.120 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.120 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.120 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.120 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.120 INFO:teuthology.orchestra.run.smithi076.stdout: "server_addr": { 2024-06-02T05:06:06.120 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "server_addr", 2024-06-02T05:06:06.120 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.120 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.120 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.120 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.120 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.121 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.121 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.121 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.121 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.121 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.121 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.121 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.121 INFO:teuthology.orchestra.run.smithi076.stdout: "server_port": { 2024-06-02T05:06:06.121 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "server_port", 2024-06-02T05:06:06.121 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.121 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.121 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.121 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.121 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.122 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.122 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.122 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.122 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.122 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.122 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.122 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.122 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.122 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.122 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:06.122 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "rgw", 2024-06-02T05:06:06.122 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-06-02T05:06:06.122 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-06-02T05:06:06.123 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-06-02T05:06:06.123 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-06-02T05:06:06.123 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-06-02T05:06:06.123 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.123 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.123 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.123 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.123 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.123 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.123 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.123 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.123 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.123 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.124 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.124 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.124 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.124 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.124 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.124 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.124 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.124 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.124 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.124 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-06-02T05:06:06.124 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-06-02T05:06:06.124 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.124 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.125 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.125 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.125 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.125 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.125 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.125 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.125 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.125 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.125 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.125 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.125 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-06-02T05:06:06.125 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-06-02T05:06:06.126 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.126 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.126 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.126 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-06-02T05:06:06.126 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.126 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.126 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.126 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.126 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.126 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.126 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.126 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.126 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.127 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.127 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.127 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.127 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.127 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.127 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.127 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-06-02T05:06:06.127 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-06-02T05:06:06.127 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.127 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.127 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.127 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.127 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.128 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.128 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.128 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.128 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.128 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.128 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.128 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.128 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.128 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.128 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:06.128 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "rook", 2024-06-02T05:06:06.128 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-06-02T05:06:06.128 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-06-02T05:06:06.129 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-06-02T05:06:06.129 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-06-02T05:06:06.129 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-06-02T05:06:06.129 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.129 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.129 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.129 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.129 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.129 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.129 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.129 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.129 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.129 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.129 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.130 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.130 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.130 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.130 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.130 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.130 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.130 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.130 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.130 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-06-02T05:06:06.130 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-06-02T05:06:06.130 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.130 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.131 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.131 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.131 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.131 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.131 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.131 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.131 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.131 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.131 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.131 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.131 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-06-02T05:06:06.131 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-06-02T05:06:06.131 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.132 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.132 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.132 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-06-02T05:06:06.132 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.132 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.132 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.132 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.132 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.132 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.132 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.132 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.132 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.132 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.132 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.133 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.133 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.133 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.133 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.133 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-06-02T05:06:06.133 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-06-02T05:06:06.133 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.133 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.133 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.133 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.133 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.133 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.133 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.133 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.134 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.134 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.134 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.134 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.134 INFO:teuthology.orchestra.run.smithi076.stdout: "storage_class": { 2024-06-02T05:06:06.134 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "storage_class", 2024-06-02T05:06:06.134 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.134 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.134 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.134 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "local", 2024-06-02T05:06:06.134 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.134 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.134 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.135 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-06-02T05:06:06.135 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.135 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.135 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.135 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.135 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.135 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.135 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:06.135 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "selftest", 2024-06-02T05:06:06.135 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-06-02T05:06:06.135 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-06-02T05:06:06.135 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-06-02T05:06:06.135 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-06-02T05:06:06.136 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-06-02T05:06:06.136 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.136 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.136 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.136 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.136 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.136 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.136 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.136 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.136 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.136 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.136 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.136 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.136 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.137 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.137 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.137 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.137 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.137 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.137 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.137 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-06-02T05:06:06.137 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-06-02T05:06:06.137 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.137 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.137 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.137 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.137 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.137 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.138 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.138 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.138 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.138 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.138 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.138 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.138 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-06-02T05:06:06.138 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-06-02T05:06:06.138 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.138 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.138 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.138 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-06-02T05:06:06.138 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.139 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.139 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.139 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.139 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.139 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.139 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.139 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.139 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.139 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.139 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.139 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.139 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.139 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.140 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.140 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-06-02T05:06:06.140 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-06-02T05:06:06.140 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.140 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.140 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.140 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.140 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.140 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.140 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.140 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.140 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.140 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.141 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.141 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.141 INFO:teuthology.orchestra.run.smithi076.stdout: "roption1": { 2024-06-02T05:06:06.141 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "roption1", 2024-06-02T05:06:06.141 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.141 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.141 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.141 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.141 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.141 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.141 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.141 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.141 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.141 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.142 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.142 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.142 INFO:teuthology.orchestra.run.smithi076.stdout: "roption2": { 2024-06-02T05:06:06.142 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "roption2", 2024-06-02T05:06:06.142 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.142 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.142 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.142 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "xyz", 2024-06-02T05:06:06.142 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.142 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.142 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.142 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.142 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.143 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.143 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.143 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.143 INFO:teuthology.orchestra.run.smithi076.stdout: "rwoption1": { 2024-06-02T05:06:06.143 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "rwoption1", 2024-06-02T05:06:06.143 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.143 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.143 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.143 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.143 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.143 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.143 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.143 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.144 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.144 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.144 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.144 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.144 INFO:teuthology.orchestra.run.smithi076.stdout: "rwoption2": { 2024-06-02T05:06:06.144 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "rwoption2", 2024-06-02T05:06:06.144 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:06.144 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.144 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.144 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.144 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.144 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.144 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.144 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.145 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.145 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.145 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.145 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.145 INFO:teuthology.orchestra.run.smithi076.stdout: "rwoption3": { 2024-06-02T05:06:06.145 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "rwoption3", 2024-06-02T05:06:06.145 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "float", 2024-06-02T05:06:06.145 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.145 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.145 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.145 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.145 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.145 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.146 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.146 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.146 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.146 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.146 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.146 INFO:teuthology.orchestra.run.smithi076.stdout: "rwoption4": { 2024-06-02T05:06:06.146 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "rwoption4", 2024-06-02T05:06:06.146 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.146 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.146 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.146 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.146 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.146 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.147 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.147 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.147 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.147 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.147 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.147 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.147 INFO:teuthology.orchestra.run.smithi076.stdout: "rwoption5": { 2024-06-02T05:06:06.147 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "rwoption5", 2024-06-02T05:06:06.147 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.147 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.147 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.147 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.147 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.148 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.148 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.148 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.148 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.148 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.148 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.148 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.148 INFO:teuthology.orchestra.run.smithi076.stdout: "rwoption6": { 2024-06-02T05:06:06.148 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "rwoption6", 2024-06-02T05:06:06.148 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.148 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.148 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.148 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:06.148 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.149 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.149 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.149 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.149 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.149 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.149 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.149 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.149 INFO:teuthology.orchestra.run.smithi076.stdout: "rwoption7": { 2024-06-02T05:06:06.149 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "rwoption7", 2024-06-02T05:06:06.149 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:06.149 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.149 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.149 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.150 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "1", 2024-06-02T05:06:06.150 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "42", 2024-06-02T05:06:06.150 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.150 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.150 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.150 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.150 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.150 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.150 INFO:teuthology.orchestra.run.smithi076.stdout: "testkey": { 2024-06-02T05:06:06.150 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "testkey", 2024-06-02T05:06:06.150 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.150 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.150 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.151 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.151 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.151 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.151 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.151 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.151 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.151 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.151 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.151 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.151 INFO:teuthology.orchestra.run.smithi076.stdout: "testlkey": { 2024-06-02T05:06:06.151 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "testlkey", 2024-06-02T05:06:06.151 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.151 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.151 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.152 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.152 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.152 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.152 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.152 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.152 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.152 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.152 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.152 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.152 INFO:teuthology.orchestra.run.smithi076.stdout: "testnewline": { 2024-06-02T05:06:06.152 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "testnewline", 2024-06-02T05:06:06.152 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.153 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.153 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.153 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.153 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.153 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.153 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.153 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.153 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.153 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.153 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.153 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.153 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.153 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.154 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:06.154 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "snap_schedule", 2024-06-02T05:06:06.154 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-06-02T05:06:06.154 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-06-02T05:06:06.154 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-06-02T05:06:06.154 INFO:teuthology.orchestra.run.smithi076.stdout: "allow_m_granularity": { 2024-06-02T05:06:06.154 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "allow_m_granularity", 2024-06-02T05:06:06.154 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.154 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.154 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.154 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.154 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.154 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.155 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.155 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "allow minute scheduled snapshots", 2024-06-02T05:06:06.155 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.155 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.155 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.155 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.155 INFO:teuthology.orchestra.run.smithi076.stdout: "dump_on_update": { 2024-06-02T05:06:06.155 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "dump_on_update", 2024-06-02T05:06:06.155 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.155 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.155 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.155 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.155 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.156 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.156 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.156 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "dump database to debug log on update", 2024-06-02T05:06:06.156 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.156 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.156 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.156 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.156 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-06-02T05:06:06.156 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-06-02T05:06:06.156 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.156 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.156 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.156 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.156 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.157 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.157 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.157 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.157 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.157 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.157 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.157 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.157 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.157 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.157 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.157 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.157 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.157 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.158 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.158 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-06-02T05:06:06.158 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-06-02T05:06:06.158 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.158 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.158 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.158 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.158 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.158 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.158 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.158 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.158 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.159 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.159 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.159 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.159 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-06-02T05:06:06.159 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-06-02T05:06:06.159 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.159 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.159 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.159 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-06-02T05:06:06.159 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.159 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.159 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.159 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.160 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.160 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.160 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.160 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.160 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.160 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.160 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.160 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.160 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.160 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.160 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.160 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-06-02T05:06:06.160 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-06-02T05:06:06.160 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.161 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.161 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.161 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.161 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.161 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.161 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.161 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.161 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.161 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.161 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.161 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.161 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.161 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.161 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:06.161 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "stats", 2024-06-02T05:06:06.162 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-06-02T05:06:06.162 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-06-02T05:06:06.162 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-06-02T05:06:06.162 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-06-02T05:06:06.162 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-06-02T05:06:06.162 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.162 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.162 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.162 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.162 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.162 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.162 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.162 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.163 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.163 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.163 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.163 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.163 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.163 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.163 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.163 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.163 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.163 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.163 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.163 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-06-02T05:06:06.163 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-06-02T05:06:06.164 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.164 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.164 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.164 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.164 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.164 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.164 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.164 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.164 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.164 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.164 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.164 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.164 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-06-02T05:06:06.164 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-06-02T05:06:06.164 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.165 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.165 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.165 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-06-02T05:06:06.165 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.165 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.165 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.165 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.165 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.165 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.165 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.165 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.165 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.165 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.165 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.166 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.166 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.166 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.166 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.166 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-06-02T05:06:06.166 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-06-02T05:06:06.166 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.166 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.166 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.166 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.166 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.166 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.166 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.167 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.167 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.167 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.167 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.167 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.167 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.167 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.167 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:06.167 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "status", 2024-06-02T05:06:06.167 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-06-02T05:06:06.167 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-06-02T05:06:06.167 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-06-02T05:06:06.167 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-06-02T05:06:06.167 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-06-02T05:06:06.168 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.168 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.168 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.168 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.168 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.168 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.168 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.168 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.168 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.168 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.168 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.168 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.168 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.168 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.168 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.169 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.169 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.169 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.169 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.169 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-06-02T05:06:06.169 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-06-02T05:06:06.169 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.169 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.169 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.169 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.169 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.169 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.169 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.169 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.170 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.170 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.170 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.170 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.170 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-06-02T05:06:06.170 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-06-02T05:06:06.170 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.170 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.170 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.170 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-06-02T05:06:06.170 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.170 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.170 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.171 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.171 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.171 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.171 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.171 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.171 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.171 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.171 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.171 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.171 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.171 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.171 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.171 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-06-02T05:06:06.172 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-06-02T05:06:06.172 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.172 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.172 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.172 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.172 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.172 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.172 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.172 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.172 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.172 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.172 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.172 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.172 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.173 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.173 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:06.173 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "telegraf", 2024-06-02T05:06:06.173 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-06-02T05:06:06.173 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-06-02T05:06:06.173 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-06-02T05:06:06.173 INFO:teuthology.orchestra.run.smithi076.stdout: "address": { 2024-06-02T05:06:06.173 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "address", 2024-06-02T05:06:06.173 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.173 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.173 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.173 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-06-02T05:06:06.174 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.174 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.174 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.174 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.174 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.174 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.174 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.174 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.174 INFO:teuthology.orchestra.run.smithi076.stdout: "interval": { 2024-06-02T05:06:06.174 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "interval", 2024-06-02T05:06:06.174 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-06-02T05:06:06.174 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.175 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.175 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "15", 2024-06-02T05:06:06.175 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.175 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.175 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.175 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.175 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.175 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.175 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.175 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.175 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-06-02T05:06:06.175 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-06-02T05:06:06.175 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.175 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.176 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.176 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.176 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.176 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.176 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.176 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.176 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.176 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.176 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.176 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.176 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.176 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.176 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.177 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.177 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.177 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.177 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.177 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-06-02T05:06:06.177 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-06-02T05:06:06.177 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.177 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.177 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.177 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.177 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.177 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.177 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.178 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.178 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.178 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.178 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.178 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.178 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-06-02T05:06:06.178 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-06-02T05:06:06.178 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.178 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.178 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.178 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-06-02T05:06:06.178 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.178 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.179 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.179 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.179 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.179 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.179 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.179 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.179 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.179 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.179 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.179 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.179 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.179 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.179 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.180 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-06-02T05:06:06.180 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-06-02T05:06:06.180 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.180 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.180 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.180 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.180 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.180 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.180 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.180 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.180 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.180 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.181 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.181 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.181 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.181 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.181 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:06.181 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "telemetry", 2024-06-02T05:06:06.181 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-06-02T05:06:06.181 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-06-02T05:06:06.181 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-06-02T05:06:06.181 INFO:teuthology.orchestra.run.smithi076.stdout: "channel_basic": { 2024-06-02T05:06:06.181 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "channel_basic", 2024-06-02T05:06:06.181 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.181 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.182 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.182 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:06.182 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.182 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.182 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.182 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Share basic cluster information (size, version)", 2024-06-02T05:06:06.182 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.182 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.182 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.182 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.182 INFO:teuthology.orchestra.run.smithi076.stdout: "channel_crash": { 2024-06-02T05:06:06.182 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "channel_crash", 2024-06-02T05:06:06.183 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.183 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.183 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.183 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:06.183 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.183 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.183 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.183 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-06-02T05:06:06.183 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.183 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.183 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.183 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.183 INFO:teuthology.orchestra.run.smithi076.stdout: "channel_device": { 2024-06-02T05:06:06.184 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "channel_device", 2024-06-02T05:06:06.184 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.184 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.184 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.184 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:06.184 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.184 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.184 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.184 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-06-02T05:06:06.184 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.184 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.184 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.184 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.185 INFO:teuthology.orchestra.run.smithi076.stdout: "channel_ident": { 2024-06-02T05:06:06.185 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "channel_ident", 2024-06-02T05:06:06.185 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.185 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.185 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.185 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.185 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.185 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.185 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.185 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-06-02T05:06:06.185 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.185 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.185 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.186 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.186 INFO:teuthology.orchestra.run.smithi076.stdout: "channel_perf": { 2024-06-02T05:06:06.186 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "channel_perf", 2024-06-02T05:06:06.186 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.186 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.186 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.186 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.186 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.186 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.186 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.186 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Share various performance metrics of a cluster", 2024-06-02T05:06:06.186 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.186 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.187 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.187 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.187 INFO:teuthology.orchestra.run.smithi076.stdout: "contact": { 2024-06-02T05:06:06.187 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "contact", 2024-06-02T05:06:06.187 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.187 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.187 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.187 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.187 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.187 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.187 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.187 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.187 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.187 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.188 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.188 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.188 INFO:teuthology.orchestra.run.smithi076.stdout: "description": { 2024-06-02T05:06:06.188 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "description", 2024-06-02T05:06:06.188 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.188 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.188 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.188 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.188 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.188 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.188 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.188 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.188 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.189 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.189 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.189 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.189 INFO:teuthology.orchestra.run.smithi076.stdout: "device_url": { 2024-06-02T05:06:06.189 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "device_url", 2024-06-02T05:06:06.189 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.189 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.189 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.189 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-06-02T05:06:06.189 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.189 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.189 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.189 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.190 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.190 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.190 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.190 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.190 INFO:teuthology.orchestra.run.smithi076.stdout: "enabled": { 2024-06-02T05:06:06.190 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "enabled", 2024-06-02T05:06:06.190 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.190 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.190 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.190 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.190 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.190 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.190 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.190 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.191 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.191 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.191 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.191 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.191 INFO:teuthology.orchestra.run.smithi076.stdout: "interval": { 2024-06-02T05:06:06.191 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "interval", 2024-06-02T05:06:06.191 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:06.191 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.191 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.191 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "24", 2024-06-02T05:06:06.191 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "8", 2024-06-02T05:06:06.191 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.191 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.192 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.192 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.192 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.192 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.192 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.192 INFO:teuthology.orchestra.run.smithi076.stdout: "last_opt_revision": { 2024-06-02T05:06:06.192 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "last_opt_revision", 2024-06-02T05:06:06.192 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:06.192 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.192 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.192 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "1", 2024-06-02T05:06:06.192 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.192 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.192 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.193 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.193 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.193 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.193 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.193 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.193 INFO:teuthology.orchestra.run.smithi076.stdout: "leaderboard": { 2024-06-02T05:06:06.193 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "leaderboard", 2024-06-02T05:06:06.193 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.193 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.193 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.193 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.193 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.193 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.194 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.194 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.194 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.194 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.194 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.194 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.194 INFO:teuthology.orchestra.run.smithi076.stdout: "leaderboard_description": { 2024-06-02T05:06:06.194 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "leaderboard_description", 2024-06-02T05:06:06.194 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.194 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.194 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.194 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.194 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.195 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.195 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.195 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.195 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.195 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.195 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.195 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.195 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-06-02T05:06:06.195 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-06-02T05:06:06.195 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.195 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.195 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.195 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.196 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.196 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.196 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.196 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.196 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.196 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.196 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.196 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.196 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.196 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.196 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.196 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.196 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.197 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.197 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.197 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-06-02T05:06:06.197 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-06-02T05:06:06.197 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.197 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.197 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.197 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.197 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.197 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.197 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.197 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.197 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.198 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.198 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.198 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.198 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-06-02T05:06:06.198 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-06-02T05:06:06.198 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.198 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.198 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.198 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-06-02T05:06:06.198 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.198 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.198 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.198 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.199 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.199 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.199 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.199 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.199 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.199 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.199 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.199 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.199 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.199 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.199 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.199 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-06-02T05:06:06.199 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-06-02T05:06:06.200 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.200 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.200 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.200 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.200 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.200 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.200 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.200 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.200 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.200 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.200 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.200 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.200 INFO:teuthology.orchestra.run.smithi076.stdout: "organization": { 2024-06-02T05:06:06.200 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "organization", 2024-06-02T05:06:06.201 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.201 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.201 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.201 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.201 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.201 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.201 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.201 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.201 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.201 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.201 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.201 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.202 INFO:teuthology.orchestra.run.smithi076.stdout: "proxy": { 2024-06-02T05:06:06.202 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "proxy", 2024-06-02T05:06:06.202 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.202 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.202 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.202 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.202 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.202 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.202 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.202 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.202 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.202 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.202 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.203 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.203 INFO:teuthology.orchestra.run.smithi076.stdout: "url": { 2024-06-02T05:06:06.203 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "url", 2024-06-02T05:06:06.203 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.203 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.203 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.203 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-06-02T05:06:06.203 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.203 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.203 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.203 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.203 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.203 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.204 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.204 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.204 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.204 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.204 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:06.204 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "test_orchestrator", 2024-06-02T05:06:06.204 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-06-02T05:06:06.204 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-06-02T05:06:06.204 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-06-02T05:06:06.204 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-06-02T05:06:06.204 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-06-02T05:06:06.204 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.204 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.204 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.205 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.205 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.205 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.205 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.205 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.205 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.205 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.205 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.205 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.205 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.205 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.205 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.205 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.205 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.206 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.206 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.206 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-06-02T05:06:06.206 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-06-02T05:06:06.206 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.206 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.206 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.206 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.206 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.206 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.206 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.206 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.207 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.207 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.207 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.207 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.207 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-06-02T05:06:06.207 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-06-02T05:06:06.207 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.207 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.207 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.207 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-06-02T05:06:06.207 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.207 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.207 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.207 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.207 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.208 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.208 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.208 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.208 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.208 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.208 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.208 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.208 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.208 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.208 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.208 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-06-02T05:06:06.208 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-06-02T05:06:06.208 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.208 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.209 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.209 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.209 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.209 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.209 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.209 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.209 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.209 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.209 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.209 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.209 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.209 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.209 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:06.209 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "volumes", 2024-06-02T05:06:06.210 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-06-02T05:06:06.210 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-06-02T05:06:06.210 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-06-02T05:06:06.210 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-06-02T05:06:06.210 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-06-02T05:06:06.210 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.210 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.210 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.210 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.210 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.210 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.210 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.210 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.211 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.211 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.211 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.211 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.211 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.211 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.211 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.211 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.211 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.211 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.211 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.211 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-06-02T05:06:06.212 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-06-02T05:06:06.212 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.212 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.212 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.212 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.212 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.212 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.212 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.212 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.212 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.212 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.212 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.212 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.213 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-06-02T05:06:06.213 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-06-02T05:06:06.213 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.213 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.213 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.213 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-06-02T05:06:06.213 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.213 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.213 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.213 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.213 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.213 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.213 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.214 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.214 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.214 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.214 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.214 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.214 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.214 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.214 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.214 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-06-02T05:06:06.214 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-06-02T05:06:06.214 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.214 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.214 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.215 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.215 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.215 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.215 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.215 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.215 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.215 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.215 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.215 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.215 INFO:teuthology.orchestra.run.smithi076.stdout: "max_concurrent_clones": { 2024-06-02T05:06:06.215 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "max_concurrent_clones", 2024-06-02T05:06:06.215 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:06.215 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.216 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.216 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "4", 2024-06-02T05:06:06.216 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.216 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.216 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.216 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Number of asynchronous cloner threads", 2024-06-02T05:06:06.216 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.216 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.216 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.216 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.216 INFO:teuthology.orchestra.run.smithi076.stdout: "snapshot_clone_delay": { 2024-06-02T05:06:06.216 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "snapshot_clone_delay", 2024-06-02T05:06:06.217 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:06.217 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.217 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.217 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "0", 2024-06-02T05:06:06.217 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.217 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.217 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.217 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-06-02T05:06:06.217 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.217 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.217 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.217 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.217 INFO:teuthology.orchestra.run.smithi076.stdout: "snapshot_clone_no_wait": { 2024-06-02T05:06:06.218 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "snapshot_clone_no_wait", 2024-06-02T05:06:06.218 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.218 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.218 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.218 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:06.218 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.218 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.218 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.218 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-06-02T05:06:06.218 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.218 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.218 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.219 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.219 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.219 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.219 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:06.219 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "zabbix", 2024-06-02T05:06:06.219 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-06-02T05:06:06.219 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-06-02T05:06:06.219 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-06-02T05:06:06.219 INFO:teuthology.orchestra.run.smithi076.stdout: "discovery_interval": { 2024-06-02T05:06:06.219 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "discovery_interval", 2024-06-02T05:06:06.219 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "uint", 2024-06-02T05:06:06.219 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.219 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.219 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "100", 2024-06-02T05:06:06.220 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.220 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.220 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.220 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.220 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.220 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.220 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.220 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.220 INFO:teuthology.orchestra.run.smithi076.stdout: "identifier": { 2024-06-02T05:06:06.220 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "identifier", 2024-06-02T05:06:06.220 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.220 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.221 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.221 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.221 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.221 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.221 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.221 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.221 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.221 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.221 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.221 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.221 INFO:teuthology.orchestra.run.smithi076.stdout: "interval": { 2024-06-02T05:06:06.221 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "interval", 2024-06-02T05:06:06.221 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-06-02T05:06:06.222 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.222 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.222 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "60", 2024-06-02T05:06:06.222 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.222 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.222 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.222 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.222 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.222 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.222 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.222 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.222 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-06-02T05:06:06.222 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-06-02T05:06:06.223 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.223 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.223 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.223 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.223 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.223 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.223 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.223 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.223 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.223 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.223 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.223 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.223 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.224 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.224 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.224 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.224 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.224 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.224 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.224 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-06-02T05:06:06.224 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-06-02T05:06:06.224 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.224 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.224 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.224 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.225 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.225 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.225 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.225 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.225 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.225 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.225 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.225 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.225 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-06-02T05:06:06.225 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-06-02T05:06:06.225 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.225 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.225 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.226 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-06-02T05:06:06.226 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.226 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.226 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.226 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.226 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.226 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.226 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.226 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.226 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.226 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.226 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.227 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.227 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.227 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.227 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.227 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-06-02T05:06:06.227 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-06-02T05:06:06.227 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.227 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.227 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.227 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.227 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.227 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.228 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.228 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.228 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.228 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.228 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.228 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.228 INFO:teuthology.orchestra.run.smithi076.stdout: "zabbix_host": { 2024-06-02T05:06:06.228 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "zabbix_host", 2024-06-02T05:06:06.228 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.228 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.228 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.228 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.228 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.229 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.229 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.229 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.229 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.229 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.229 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.229 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.229 INFO:teuthology.orchestra.run.smithi076.stdout: "zabbix_port": { 2024-06-02T05:06:06.229 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "zabbix_port", 2024-06-02T05:06:06.229 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:06.229 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.229 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.229 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "10051", 2024-06-02T05:06:06.230 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.230 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.230 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.230 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.230 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.230 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.230 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.230 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.230 INFO:teuthology.orchestra.run.smithi076.stdout: "zabbix_sender": { 2024-06-02T05:06:06.230 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "zabbix_sender", 2024-06-02T05:06:06.230 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.230 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.230 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.231 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-06-02T05:06:06.231 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.231 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.231 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.231 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.231 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.231 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.231 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.231 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.231 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.231 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.231 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-06-02T05:06:06.231 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.232 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.232 INFO:teuthology.orchestra.run.smithi076.stdout: "modules": [ 2024-06-02T05:06:06.232 INFO:teuthology.orchestra.run.smithi076.stdout: "cephadm", 2024-06-02T05:06:06.232 INFO:teuthology.orchestra.run.smithi076.stdout: "dashboard", 2024-06-02T05:06:06.232 INFO:teuthology.orchestra.run.smithi076.stdout: "iostat", 2024-06-02T05:06:06.232 INFO:teuthology.orchestra.run.smithi076.stdout: "nfs", 2024-06-02T05:06:06.232 INFO:teuthology.orchestra.run.smithi076.stdout: "restful" 2024-06-02T05:06:06.232 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.232 INFO:teuthology.orchestra.run.smithi076.stdout: "available_modules": [ 2024-06-02T05:06:06.232 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:06.232 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "alerts", 2024-06-02T05:06:06.232 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-06-02T05:06:06.232 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-06-02T05:06:06.232 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-06-02T05:06:06.233 INFO:teuthology.orchestra.run.smithi076.stdout: "interval": { 2024-06-02T05:06:06.233 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "interval", 2024-06-02T05:06:06.233 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-06-02T05:06:06.233 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.233 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.233 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "60", 2024-06-02T05:06:06.233 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.233 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.233 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.233 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "How frequently to reexamine health status", 2024-06-02T05:06:06.233 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.233 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.233 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.234 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.234 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-06-02T05:06:06.234 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-06-02T05:06:06.234 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.234 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.234 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.234 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.234 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.234 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.234 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.234 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.234 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.235 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.235 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.235 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.235 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.235 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.235 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.235 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.235 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.235 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.235 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.235 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-06-02T05:06:06.235 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-06-02T05:06:06.235 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.236 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.236 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.236 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.236 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.236 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.236 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.236 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.236 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.236 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.236 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.236 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.236 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-06-02T05:06:06.236 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-06-02T05:06:06.237 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.237 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.237 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.237 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-06-02T05:06:06.237 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.237 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.237 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.237 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.237 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.237 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.238 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.238 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.238 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.238 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.238 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.238 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.238 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.238 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.238 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.238 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-06-02T05:06:06.238 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-06-02T05:06:06.238 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.238 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.239 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.239 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.239 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.239 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.239 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.239 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.239 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.239 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.239 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.239 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.239 INFO:teuthology.orchestra.run.smithi076.stdout: "smtp_destination": { 2024-06-02T05:06:06.239 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "smtp_destination", 2024-06-02T05:06:06.239 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.240 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.240 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.240 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.240 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.240 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.240 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.240 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Email address to send alerts to", 2024-06-02T05:06:06.240 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.240 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.240 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.240 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.240 INFO:teuthology.orchestra.run.smithi076.stdout: "smtp_from_name": { 2024-06-02T05:06:06.240 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "smtp_from_name", 2024-06-02T05:06:06.241 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.241 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.241 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.241 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "Ceph", 2024-06-02T05:06:06.241 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.241 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.241 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.241 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Email From: name", 2024-06-02T05:06:06.241 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.241 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.241 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.241 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.241 INFO:teuthology.orchestra.run.smithi076.stdout: "smtp_host": { 2024-06-02T05:06:06.242 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "smtp_host", 2024-06-02T05:06:06.242 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.242 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.242 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.242 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.242 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.242 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.242 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.242 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "SMTP server", 2024-06-02T05:06:06.242 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.242 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.242 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.242 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.243 INFO:teuthology.orchestra.run.smithi076.stdout: "smtp_password": { 2024-06-02T05:06:06.243 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "smtp_password", 2024-06-02T05:06:06.243 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.243 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.243 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.243 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.243 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.243 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.243 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.243 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Password to authenticate with", 2024-06-02T05:06:06.243 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.243 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.243 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.244 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.244 INFO:teuthology.orchestra.run.smithi076.stdout: "smtp_port": { 2024-06-02T05:06:06.244 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "smtp_port", 2024-06-02T05:06:06.244 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:06.244 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.244 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.244 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "465", 2024-06-02T05:06:06.244 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.244 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.244 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.244 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "SMTP port", 2024-06-02T05:06:06.244 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.244 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.245 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.245 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.245 INFO:teuthology.orchestra.run.smithi076.stdout: "smtp_sender": { 2024-06-02T05:06:06.245 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "smtp_sender", 2024-06-02T05:06:06.245 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.245 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.245 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.245 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.245 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.245 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.245 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.245 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "SMTP envelope sender", 2024-06-02T05:06:06.245 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.246 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.246 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.246 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.246 INFO:teuthology.orchestra.run.smithi076.stdout: "smtp_ssl": { 2024-06-02T05:06:06.246 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "smtp_ssl", 2024-06-02T05:06:06.246 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.246 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.246 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.246 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:06.246 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.246 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.246 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.246 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Use SSL to connect to SMTP server", 2024-06-02T05:06:06.247 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.247 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.247 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.247 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.247 INFO:teuthology.orchestra.run.smithi076.stdout: "smtp_user": { 2024-06-02T05:06:06.247 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "smtp_user", 2024-06-02T05:06:06.247 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.247 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.247 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.247 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.247 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.247 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.247 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.248 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "User to authenticate as", 2024-06-02T05:06:06.248 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.248 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.248 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.248 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.248 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.248 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.248 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:06.248 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "balancer", 2024-06-02T05:06:06.248 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-06-02T05:06:06.248 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-06-02T05:06:06.248 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-06-02T05:06:06.248 INFO:teuthology.orchestra.run.smithi076.stdout: "active": { 2024-06-02T05:06:06.249 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "active", 2024-06-02T05:06:06.249 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.249 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.249 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.249 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:06.249 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.249 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.249 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.249 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "automatically balance PGs across cluster", 2024-06-02T05:06:06.249 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.249 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.249 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.249 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.250 INFO:teuthology.orchestra.run.smithi076.stdout: "begin_time": { 2024-06-02T05:06:06.250 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "begin_time", 2024-06-02T05:06:06.250 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.250 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.250 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.250 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "0000", 2024-06-02T05:06:06.250 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.250 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.250 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.250 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "beginning time of day to automatically balance", 2024-06-02T05:06:06.250 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-06-02T05:06:06.250 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.250 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.251 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.251 INFO:teuthology.orchestra.run.smithi076.stdout: "begin_weekday": { 2024-06-02T05:06:06.251 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "begin_weekday", 2024-06-02T05:06:06.251 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "uint", 2024-06-02T05:06:06.251 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.251 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.251 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "0", 2024-06-02T05:06:06.251 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "0", 2024-06-02T05:06:06.251 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "6", 2024-06-02T05:06:06.251 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.251 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-06-02T05:06:06.251 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-06-02T05:06:06.251 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.252 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.252 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.252 INFO:teuthology.orchestra.run.smithi076.stdout: "crush_compat_max_iterations": { 2024-06-02T05:06:06.252 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "crush_compat_max_iterations", 2024-06-02T05:06:06.252 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "uint", 2024-06-02T05:06:06.252 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.252 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.252 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "25", 2024-06-02T05:06:06.252 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "1", 2024-06-02T05:06:06.252 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "250", 2024-06-02T05:06:06.252 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.252 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-06-02T05:06:06.253 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.253 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.253 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.253 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.253 INFO:teuthology.orchestra.run.smithi076.stdout: "crush_compat_metrics": { 2024-06-02T05:06:06.253 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "crush_compat_metrics", 2024-06-02T05:06:06.253 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.253 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.253 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.253 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "pgs,objects,bytes", 2024-06-02T05:06:06.253 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.253 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.253 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.254 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-06-02T05:06:06.254 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-06-02T05:06:06.254 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.254 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.254 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.254 INFO:teuthology.orchestra.run.smithi076.stdout: "crush_compat_step": { 2024-06-02T05:06:06.254 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "crush_compat_step", 2024-06-02T05:06:06.254 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "float", 2024-06-02T05:06:06.254 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.254 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.254 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "0.5", 2024-06-02T05:06:06.254 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "0.001", 2024-06-02T05:06:06.255 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "0.999", 2024-06-02T05:06:06.255 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.255 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "aggressiveness of optimization", 2024-06-02T05:06:06.255 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-06-02T05:06:06.255 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.255 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.255 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.255 INFO:teuthology.orchestra.run.smithi076.stdout: "end_time": { 2024-06-02T05:06:06.255 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "end_time", 2024-06-02T05:06:06.255 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.255 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.255 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.255 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "2359", 2024-06-02T05:06:06.255 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.256 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.256 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.256 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "ending time of day to automatically balance", 2024-06-02T05:06:06.256 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-06-02T05:06:06.256 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.256 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.256 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.256 INFO:teuthology.orchestra.run.smithi076.stdout: "end_weekday": { 2024-06-02T05:06:06.256 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "end_weekday", 2024-06-02T05:06:06.256 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "uint", 2024-06-02T05:06:06.256 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.256 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.256 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "0", 2024-06-02T05:06:06.257 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "0", 2024-06-02T05:06:06.257 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "6", 2024-06-02T05:06:06.257 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.257 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-06-02T05:06:06.257 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-06-02T05:06:06.257 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.257 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.257 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.257 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-06-02T05:06:06.257 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-06-02T05:06:06.257 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.257 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.257 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.257 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.258 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.258 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.258 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.258 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.258 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.258 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.258 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.258 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.258 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.258 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.258 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.258 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.258 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.259 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.259 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.259 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-06-02T05:06:06.259 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-06-02T05:06:06.259 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.259 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.259 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.259 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.259 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.259 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.259 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.259 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.259 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.260 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.260 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.260 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.260 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-06-02T05:06:06.260 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-06-02T05:06:06.260 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.260 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.260 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.260 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-06-02T05:06:06.260 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.260 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.260 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.261 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.261 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.261 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.261 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.261 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.261 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.261 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.261 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.261 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.261 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.261 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.261 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.261 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-06-02T05:06:06.261 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-06-02T05:06:06.262 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.262 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.262 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.262 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.262 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.262 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.262 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.262 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.262 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.262 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.262 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.262 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.263 INFO:teuthology.orchestra.run.smithi076.stdout: "min_score": { 2024-06-02T05:06:06.263 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "min_score", 2024-06-02T05:06:06.263 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "float", 2024-06-02T05:06:06.263 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.263 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.263 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "0", 2024-06-02T05:06:06.263 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.263 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.263 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.263 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-06-02T05:06:06.263 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.263 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.263 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.264 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.264 INFO:teuthology.orchestra.run.smithi076.stdout: "mode": { 2024-06-02T05:06:06.264 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "mode", 2024-06-02T05:06:06.264 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.264 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.264 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.264 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "upmap", 2024-06-02T05:06:06.264 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.264 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.264 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.264 INFO:teuthology.orchestra.run.smithi076.stdout: "crush-compat", 2024-06-02T05:06:06.264 INFO:teuthology.orchestra.run.smithi076.stdout: "none", 2024-06-02T05:06:06.264 INFO:teuthology.orchestra.run.smithi076.stdout: "upmap" 2024-06-02T05:06:06.264 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.265 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Balancer mode", 2024-06-02T05:06:06.265 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.265 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.265 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.265 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.265 INFO:teuthology.orchestra.run.smithi076.stdout: "pool_ids": { 2024-06-02T05:06:06.265 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "pool_ids", 2024-06-02T05:06:06.265 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.265 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.265 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.265 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.265 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.265 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.266 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.266 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-06-02T05:06:06.266 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.266 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.266 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.266 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.266 INFO:teuthology.orchestra.run.smithi076.stdout: "sleep_interval": { 2024-06-02T05:06:06.266 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "sleep_interval", 2024-06-02T05:06:06.266 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-06-02T05:06:06.266 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.266 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.266 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "60", 2024-06-02T05:06:06.266 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.267 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.267 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.267 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-06-02T05:06:06.267 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.267 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.267 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.267 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.267 INFO:teuthology.orchestra.run.smithi076.stdout: "upmap_max_deviation": { 2024-06-02T05:06:06.267 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "upmap_max_deviation", 2024-06-02T05:06:06.267 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:06.267 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.267 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.267 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "5", 2024-06-02T05:06:06.268 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "1", 2024-06-02T05:06:06.268 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.268 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.268 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "deviation below which no optimization is attempted", 2024-06-02T05:06:06.268 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-06-02T05:06:06.268 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.268 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.268 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.268 INFO:teuthology.orchestra.run.smithi076.stdout: "upmap_max_optimizations": { 2024-06-02T05:06:06.268 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "upmap_max_optimizations", 2024-06-02T05:06:06.268 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "uint", 2024-06-02T05:06:06.268 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.268 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.269 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "10", 2024-06-02T05:06:06.269 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.269 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.269 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.269 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-06-02T05:06:06.269 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.269 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.269 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.269 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.269 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.269 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.269 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:06.269 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "cephadm", 2024-06-02T05:06:06.270 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-06-02T05:06:06.270 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-06-02T05:06:06.270 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-06-02T05:06:06.270 INFO:teuthology.orchestra.run.smithi076.stdout: "agent_down_multiplier": { 2024-06-02T05:06:06.270 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "agent_down_multiplier", 2024-06-02T05:06:06.270 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "float", 2024-06-02T05:06:06.270 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.270 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.270 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "3.0", 2024-06-02T05:06:06.270 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.270 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.270 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.270 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-06-02T05:06:06.271 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.271 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.271 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.271 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.271 INFO:teuthology.orchestra.run.smithi076.stdout: "agent_refresh_rate": { 2024-06-02T05:06:06.271 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "agent_refresh_rate", 2024-06-02T05:06:06.271 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-06-02T05:06:06.271 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.271 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.271 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "20", 2024-06-02T05:06:06.271 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.271 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.271 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.272 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-06-02T05:06:06.272 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.272 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.272 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.272 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.272 INFO:teuthology.orchestra.run.smithi076.stdout: "agent_starting_port": { 2024-06-02T05:06:06.272 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "agent_starting_port", 2024-06-02T05:06:06.272 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:06.272 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.272 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.272 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "4721", 2024-06-02T05:06:06.272 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.272 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.272 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.273 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-06-02T05:06:06.273 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.273 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.273 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.273 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.273 INFO:teuthology.orchestra.run.smithi076.stdout: "allow_ptrace": { 2024-06-02T05:06:06.273 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "allow_ptrace", 2024-06-02T05:06:06.273 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.273 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.273 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.273 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.273 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.273 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.274 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.274 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-06-02T05:06:06.274 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-06-02T05:06:06.274 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.274 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.274 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.274 INFO:teuthology.orchestra.run.smithi076.stdout: "autotune_interval": { 2024-06-02T05:06:06.274 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "autotune_interval", 2024-06-02T05:06:06.274 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-06-02T05:06:06.274 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.274 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.274 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "600", 2024-06-02T05:06:06.275 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.275 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.275 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.275 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "how frequently to autotune daemon memory", 2024-06-02T05:06:06.275 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.275 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.275 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.275 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.275 INFO:teuthology.orchestra.run.smithi076.stdout: "autotune_memory_target_ratio": { 2024-06-02T05:06:06.275 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "autotune_memory_target_ratio", 2024-06-02T05:06:06.275 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "float", 2024-06-02T05:06:06.275 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.275 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.276 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "0.7", 2024-06-02T05:06:06.276 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.276 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.276 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.276 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-06-02T05:06:06.276 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.276 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.276 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.276 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.276 INFO:teuthology.orchestra.run.smithi076.stdout: "cgroups_split": { 2024-06-02T05:06:06.276 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "cgroups_split", 2024-06-02T05:06:06.276 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.276 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.277 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.277 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:06.277 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.277 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.277 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.277 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-06-02T05:06:06.277 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.277 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.277 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.277 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.277 INFO:teuthology.orchestra.run.smithi076.stdout: "config_checks_enabled": { 2024-06-02T05:06:06.277 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "config_checks_enabled", 2024-06-02T05:06:06.277 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.278 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.278 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.278 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.278 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.278 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.278 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.278 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-06-02T05:06:06.278 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.278 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.278 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.278 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.278 INFO:teuthology.orchestra.run.smithi076.stdout: "config_dashboard": { 2024-06-02T05:06:06.278 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "config_dashboard", 2024-06-02T05:06:06.279 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.279 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.279 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.279 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:06.279 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.279 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.279 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.279 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-06-02T05:06:06.279 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.279 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.279 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.279 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.279 INFO:teuthology.orchestra.run.smithi076.stdout: "container_image_alertmanager": { 2024-06-02T05:06:06.280 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "container_image_alertmanager", 2024-06-02T05:06:06.280 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.280 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.280 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.280 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-06-02T05:06:06.280 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.280 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.280 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.280 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Prometheus container image", 2024-06-02T05:06:06.280 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.280 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.280 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.280 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.281 INFO:teuthology.orchestra.run.smithi076.stdout: "container_image_base": { 2024-06-02T05:06:06.281 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "container_image_base", 2024-06-02T05:06:06.281 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.281 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.281 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.281 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "quay.io/ceph/ceph", 2024-06-02T05:06:06.281 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.281 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.281 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.281 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Container image name, without the tag", 2024-06-02T05:06:06.281 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.281 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.281 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.282 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.282 INFO:teuthology.orchestra.run.smithi076.stdout: "container_image_elasticsearch": { 2024-06-02T05:06:06.282 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "container_image_elasticsearch", 2024-06-02T05:06:06.282 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.282 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.282 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.282 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-06-02T05:06:06.282 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.282 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.282 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.282 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "elasticsearch container image", 2024-06-02T05:06:06.282 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.282 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.283 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.283 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.283 INFO:teuthology.orchestra.run.smithi076.stdout: "container_image_grafana": { 2024-06-02T05:06:06.283 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "container_image_grafana", 2024-06-02T05:06:06.283 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.283 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.283 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.283 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2024-06-02T05:06:06.283 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.283 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.283 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.283 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Prometheus container image", 2024-06-02T05:06:06.283 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.283 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.284 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.284 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.284 INFO:teuthology.orchestra.run.smithi076.stdout: "container_image_haproxy": { 2024-06-02T05:06:06.284 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "container_image_haproxy", 2024-06-02T05:06:06.284 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.284 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.284 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.284 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-06-02T05:06:06.284 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.284 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.284 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.284 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "HAproxy container image", 2024-06-02T05:06:06.285 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.285 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.285 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.285 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.285 INFO:teuthology.orchestra.run.smithi076.stdout: "container_image_jaeger_agent": { 2024-06-02T05:06:06.285 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "container_image_jaeger_agent", 2024-06-02T05:06:06.285 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.285 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.285 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.285 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-06-02T05:06:06.285 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.285 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.285 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.285 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Jaeger agent container image", 2024-06-02T05:06:06.286 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.286 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.286 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.286 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.286 INFO:teuthology.orchestra.run.smithi076.stdout: "container_image_jaeger_collector": { 2024-06-02T05:06:06.286 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "container_image_jaeger_collector", 2024-06-02T05:06:06.286 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.286 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.286 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.286 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-06-02T05:06:06.286 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.286 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.286 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.287 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Jaeger collector container image", 2024-06-02T05:06:06.287 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.287 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.287 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.287 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.287 INFO:teuthology.orchestra.run.smithi076.stdout: "container_image_jaeger_query": { 2024-06-02T05:06:06.287 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "container_image_jaeger_query", 2024-06-02T05:06:06.287 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.287 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.287 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.287 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-06-02T05:06:06.287 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.287 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.288 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.288 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Jaeger query container image", 2024-06-02T05:06:06.288 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.288 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.288 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.288 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.288 INFO:teuthology.orchestra.run.smithi076.stdout: "container_image_keepalived": { 2024-06-02T05:06:06.288 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "container_image_keepalived", 2024-06-02T05:06:06.288 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.288 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.288 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.288 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-06-02T05:06:06.288 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.289 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.289 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.289 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Keepalived container image", 2024-06-02T05:06:06.289 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.289 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.289 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.289 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.289 INFO:teuthology.orchestra.run.smithi076.stdout: "container_image_loki": { 2024-06-02T05:06:06.289 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "container_image_loki", 2024-06-02T05:06:06.289 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.289 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.289 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.289 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-06-02T05:06:06.290 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.290 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.290 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.290 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Loki container image", 2024-06-02T05:06:06.290 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.290 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.290 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.290 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.290 INFO:teuthology.orchestra.run.smithi076.stdout: "container_image_node_exporter": { 2024-06-02T05:06:06.290 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "container_image_node_exporter", 2024-06-02T05:06:06.290 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.290 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.290 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.291 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-06-02T05:06:06.291 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.291 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.291 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.291 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Prometheus container image", 2024-06-02T05:06:06.291 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.291 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.291 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.291 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.291 INFO:teuthology.orchestra.run.smithi076.stdout: "container_image_nvmeof": { 2024-06-02T05:06:06.291 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "container_image_nvmeof", 2024-06-02T05:06:06.291 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.291 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.292 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.292 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "quay.io/ceph/nvmeof:1.0.0", 2024-06-02T05:06:06.292 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.292 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.292 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.292 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Nvme-of container image", 2024-06-02T05:06:06.292 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.292 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.292 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.292 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.292 INFO:teuthology.orchestra.run.smithi076.stdout: "container_image_prometheus": { 2024-06-02T05:06:06.292 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "container_image_prometheus", 2024-06-02T05:06:06.292 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.293 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.293 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.293 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-06-02T05:06:06.293 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.293 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.293 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.293 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Prometheus container image", 2024-06-02T05:06:06.293 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.293 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.293 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.293 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.293 INFO:teuthology.orchestra.run.smithi076.stdout: "container_image_promtail": { 2024-06-02T05:06:06.293 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "container_image_promtail", 2024-06-02T05:06:06.294 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.294 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.294 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.294 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-06-02T05:06:06.294 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.294 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.294 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.294 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Promtail container image", 2024-06-02T05:06:06.294 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.294 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.294 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.294 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.295 INFO:teuthology.orchestra.run.smithi076.stdout: "container_image_snmp_gateway": { 2024-06-02T05:06:06.295 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "container_image_snmp_gateway", 2024-06-02T05:06:06.295 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.295 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.295 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.295 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-06-02T05:06:06.295 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.295 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.295 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.295 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "SNMP Gateway container image", 2024-06-02T05:06:06.295 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.295 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.295 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.296 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.296 INFO:teuthology.orchestra.run.smithi076.stdout: "container_init": { 2024-06-02T05:06:06.296 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "container_init", 2024-06-02T05:06:06.296 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.296 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.296 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.296 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:06.296 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.296 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.296 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.296 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Run podman/docker with `--init`", 2024-06-02T05:06:06.296 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.296 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.297 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.297 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.297 INFO:teuthology.orchestra.run.smithi076.stdout: "daemon_cache_timeout": { 2024-06-02T05:06:06.297 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "daemon_cache_timeout", 2024-06-02T05:06:06.297 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-06-02T05:06:06.297 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.297 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.297 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "600", 2024-06-02T05:06:06.297 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.297 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.297 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.297 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-06-02T05:06:06.297 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.297 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.298 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.298 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.298 INFO:teuthology.orchestra.run.smithi076.stdout: "default_cephadm_command_timeout": { 2024-06-02T05:06:06.298 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "default_cephadm_command_timeout", 2024-06-02T05:06:06.298 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:06.298 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.298 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.298 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "900", 2024-06-02T05:06:06.298 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.298 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.298 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.298 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-06-02T05:06:06.298 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.299 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.299 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.299 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.299 INFO:teuthology.orchestra.run.smithi076.stdout: "default_registry": { 2024-06-02T05:06:06.299 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "default_registry", 2024-06-02T05:06:06.299 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.299 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.299 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.299 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "docker.io", 2024-06-02T05:06:06.299 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.299 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.299 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.299 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-06-02T05:06:06.300 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.300 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.300 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.300 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.300 INFO:teuthology.orchestra.run.smithi076.stdout: "device_cache_timeout": { 2024-06-02T05:06:06.300 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "device_cache_timeout", 2024-06-02T05:06:06.300 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-06-02T05:06:06.300 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.300 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.300 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "1800", 2024-06-02T05:06:06.300 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.300 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.301 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.301 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "seconds to cache device inventory", 2024-06-02T05:06:06.301 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.301 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.301 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.301 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.301 INFO:teuthology.orchestra.run.smithi076.stdout: "device_enhanced_scan": { 2024-06-02T05:06:06.301 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "device_enhanced_scan", 2024-06-02T05:06:06.301 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.301 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.301 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.301 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.301 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.302 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.302 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.302 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Use libstoragemgmt during device scans", 2024-06-02T05:06:06.302 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.302 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.302 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.302 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.302 INFO:teuthology.orchestra.run.smithi076.stdout: "facts_cache_timeout": { 2024-06-02T05:06:06.302 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "facts_cache_timeout", 2024-06-02T05:06:06.302 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-06-02T05:06:06.302 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.302 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.303 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "60", 2024-06-02T05:06:06.303 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.303 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.303 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.303 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "seconds to cache host facts data", 2024-06-02T05:06:06.303 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.303 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.303 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.303 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.303 INFO:teuthology.orchestra.run.smithi076.stdout: "host_check_interval": { 2024-06-02T05:06:06.303 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "host_check_interval", 2024-06-02T05:06:06.303 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-06-02T05:06:06.303 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.304 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.304 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "600", 2024-06-02T05:06:06.304 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.304 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.304 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.304 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "how frequently to perform a host check", 2024-06-02T05:06:06.304 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.304 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.304 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.304 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.304 INFO:teuthology.orchestra.run.smithi076.stdout: "hw_monitoring": { 2024-06-02T05:06:06.304 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "hw_monitoring", 2024-06-02T05:06:06.304 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.304 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.305 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.305 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.305 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.305 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.305 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.305 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-06-02T05:06:06.305 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.305 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.305 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.305 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.305 INFO:teuthology.orchestra.run.smithi076.stdout: "inventory_list_all": { 2024-06-02T05:06:06.305 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "inventory_list_all", 2024-06-02T05:06:06.305 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.306 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.306 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.306 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.306 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.306 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.306 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.306 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-06-02T05:06:06.306 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.306 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.306 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.306 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.306 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-06-02T05:06:06.306 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-06-02T05:06:06.307 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.307 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.307 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.307 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.307 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.307 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.307 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.307 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.307 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.307 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.307 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.307 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.307 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.308 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.308 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.308 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.308 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.308 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.308 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.308 INFO:teuthology.orchestra.run.smithi076.stdout: "log_refresh_metadata": { 2024-06-02T05:06:06.308 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_refresh_metadata", 2024-06-02T05:06:06.308 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.308 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.308 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.308 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.308 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.309 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.309 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.309 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-06-02T05:06:06.309 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.309 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.309 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.309 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.309 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-06-02T05:06:06.309 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-06-02T05:06:06.309 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.309 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.309 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.309 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:06.310 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.310 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.310 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.310 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-06-02T05:06:06.310 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.310 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.310 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.310 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.310 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-06-02T05:06:06.310 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-06-02T05:06:06.310 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.310 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.310 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.311 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-06-02T05:06:06.311 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.311 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.311 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.311 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.311 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.311 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.311 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.311 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.311 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.311 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.311 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.311 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.312 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.312 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.312 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.312 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-06-02T05:06:06.312 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-06-02T05:06:06.312 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.312 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.312 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.312 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.312 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.312 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.312 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.312 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.313 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.313 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.313 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.313 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.313 INFO:teuthology.orchestra.run.smithi076.stdout: "manage_etc_ceph_ceph_conf": { 2024-06-02T05:06:06.313 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-06-02T05:06:06.313 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.313 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.313 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.313 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.313 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.313 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.313 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.314 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-06-02T05:06:06.314 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.314 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.314 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.314 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.314 INFO:teuthology.orchestra.run.smithi076.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-06-02T05:06:06.314 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-06-02T05:06:06.314 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.314 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.314 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.314 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "*", 2024-06-02T05:06:06.314 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.314 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.315 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.315 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-06-02T05:06:06.315 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.315 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.315 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.315 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.315 INFO:teuthology.orchestra.run.smithi076.stdout: "max_count_per_host": { 2024-06-02T05:06:06.315 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "max_count_per_host", 2024-06-02T05:06:06.315 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:06.315 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.315 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.315 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "10", 2024-06-02T05:06:06.315 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.316 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.316 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.316 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "max number of daemons per service per host", 2024-06-02T05:06:06.316 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.316 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.316 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.316 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.316 INFO:teuthology.orchestra.run.smithi076.stdout: "max_osd_draining_count": { 2024-06-02T05:06:06.316 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "max_osd_draining_count", 2024-06-02T05:06:06.316 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:06.316 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.316 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.316 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "10", 2024-06-02T05:06:06.317 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.317 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.317 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.317 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-06-02T05:06:06.317 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.317 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.317 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.317 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.317 INFO:teuthology.orchestra.run.smithi076.stdout: "migration_current": { 2024-06-02T05:06:06.317 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "migration_current", 2024-06-02T05:06:06.317 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:06.317 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.317 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.318 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.318 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.318 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.318 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.318 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "internal - do not modify", 2024-06-02T05:06:06.318 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.318 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.318 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.318 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.318 INFO:teuthology.orchestra.run.smithi076.stdout: "mode": { 2024-06-02T05:06:06.318 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "mode", 2024-06-02T05:06:06.318 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.318 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.319 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.319 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "root", 2024-06-02T05:06:06.319 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.319 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.319 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.319 INFO:teuthology.orchestra.run.smithi076.stdout: "cephadm-package", 2024-06-02T05:06:06.319 INFO:teuthology.orchestra.run.smithi076.stdout: "root" 2024-06-02T05:06:06.319 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.319 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "mode for remote execution of cephadm", 2024-06-02T05:06:06.319 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.319 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.319 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.319 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.320 INFO:teuthology.orchestra.run.smithi076.stdout: "oob_default_addr": { 2024-06-02T05:06:06.320 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "oob_default_addr", 2024-06-02T05:06:06.320 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.320 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.320 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.320 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "169.254.1.1", 2024-06-02T05:06:06.320 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.320 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.320 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.320 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Default address for RedFish API (oob management).", 2024-06-02T05:06:06.320 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.320 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.320 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.320 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.321 INFO:teuthology.orchestra.run.smithi076.stdout: "prometheus_alerts_path": { 2024-06-02T05:06:06.321 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "prometheus_alerts_path", 2024-06-02T05:06:06.321 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.321 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.321 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.321 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-06-02T05:06:06.321 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.321 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.321 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.321 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-06-02T05:06:06.321 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.321 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.321 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.322 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.322 INFO:teuthology.orchestra.run.smithi076.stdout: "registry_insecure": { 2024-06-02T05:06:06.322 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "registry_insecure", 2024-06-02T05:06:06.322 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.322 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.322 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.322 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.322 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.322 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.322 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.322 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-06-02T05:06:06.322 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.322 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.323 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.323 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.323 INFO:teuthology.orchestra.run.smithi076.stdout: "registry_password": { 2024-06-02T05:06:06.323 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "registry_password", 2024-06-02T05:06:06.323 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.323 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.323 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.323 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.323 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.323 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.323 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.323 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-06-02T05:06:06.323 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.324 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.324 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.324 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.324 INFO:teuthology.orchestra.run.smithi076.stdout: "registry_url": { 2024-06-02T05:06:06.324 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "registry_url", 2024-06-02T05:06:06.324 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.324 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.324 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.324 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.324 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.324 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.324 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.325 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-06-02T05:06:06.325 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.325 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.325 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.325 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.325 INFO:teuthology.orchestra.run.smithi076.stdout: "registry_username": { 2024-06-02T05:06:06.325 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "registry_username", 2024-06-02T05:06:06.325 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.325 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.325 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.325 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.325 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.325 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.325 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.326 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-06-02T05:06:06.326 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.326 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.326 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.326 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.326 INFO:teuthology.orchestra.run.smithi076.stdout: "secure_monitoring_stack": { 2024-06-02T05:06:06.326 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "secure_monitoring_stack", 2024-06-02T05:06:06.326 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.326 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.326 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.326 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.326 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.327 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.327 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.327 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-06-02T05:06:06.327 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.327 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.327 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.327 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.327 INFO:teuthology.orchestra.run.smithi076.stdout: "service_discovery_port": { 2024-06-02T05:06:06.327 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "service_discovery_port", 2024-06-02T05:06:06.327 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:06.327 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.327 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.327 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "8765", 2024-06-02T05:06:06.328 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.328 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.328 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.328 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "cephadm service discovery port", 2024-06-02T05:06:06.328 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.328 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.328 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.328 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.328 INFO:teuthology.orchestra.run.smithi076.stdout: "ssh_config_file": { 2024-06-02T05:06:06.328 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "ssh_config_file", 2024-06-02T05:06:06.328 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.328 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.328 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.328 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.329 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.329 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.329 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.329 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-06-02T05:06:06.329 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.329 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.329 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.329 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.329 INFO:teuthology.orchestra.run.smithi076.stdout: "use_agent": { 2024-06-02T05:06:06.329 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "use_agent", 2024-06-02T05:06:06.329 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.329 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.329 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.330 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.330 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.330 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.330 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.330 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-06-02T05:06:06.330 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.330 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.330 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.330 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.330 INFO:teuthology.orchestra.run.smithi076.stdout: "use_repo_digest": { 2024-06-02T05:06:06.330 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "use_repo_digest", 2024-06-02T05:06:06.330 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.330 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.331 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.331 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:06.331 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.331 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.331 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.331 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-06-02T05:06:06.331 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.331 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.331 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.331 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.331 INFO:teuthology.orchestra.run.smithi076.stdout: "warn_on_failed_host_check": { 2024-06-02T05:06:06.331 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "warn_on_failed_host_check", 2024-06-02T05:06:06.331 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.332 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.332 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.332 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:06.332 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.332 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.332 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.332 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "raise a health warning if the host check fails", 2024-06-02T05:06:06.332 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.332 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.332 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.332 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.332 INFO:teuthology.orchestra.run.smithi076.stdout: "warn_on_stray_daemons": { 2024-06-02T05:06:06.332 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "warn_on_stray_daemons", 2024-06-02T05:06:06.333 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.333 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.333 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.333 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:06.333 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.333 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.333 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.333 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-06-02T05:06:06.333 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.333 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.333 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.333 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.333 INFO:teuthology.orchestra.run.smithi076.stdout: "warn_on_stray_hosts": { 2024-06-02T05:06:06.334 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "warn_on_stray_hosts", 2024-06-02T05:06:06.334 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.334 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.334 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.334 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:06.334 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.334 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.334 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.334 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-06-02T05:06:06.334 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.334 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.334 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.334 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.335 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.335 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.335 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:06.335 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "crash", 2024-06-02T05:06:06.335 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-06-02T05:06:06.335 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-06-02T05:06:06.335 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-06-02T05:06:06.335 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-06-02T05:06:06.335 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-06-02T05:06:06.335 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.335 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.335 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.335 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.336 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.336 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.336 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.336 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.336 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.336 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.336 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.336 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.336 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.336 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.336 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.336 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.336 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.336 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.337 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.337 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-06-02T05:06:06.337 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-06-02T05:06:06.337 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.337 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.337 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.337 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.337 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.337 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.337 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.337 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.337 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.337 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.338 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.338 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.338 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-06-02T05:06:06.338 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-06-02T05:06:06.338 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.338 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.338 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.338 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-06-02T05:06:06.338 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.338 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.338 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.338 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.338 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.339 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.339 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.339 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.339 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.339 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.339 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.339 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.339 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.339 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.339 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.339 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-06-02T05:06:06.339 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-06-02T05:06:06.339 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.340 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.340 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.340 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.340 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.340 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.340 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.340 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.340 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.340 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.340 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.340 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.340 INFO:teuthology.orchestra.run.smithi076.stdout: "retain_interval": { 2024-06-02T05:06:06.341 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "retain_interval", 2024-06-02T05:06:06.341 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-06-02T05:06:06.341 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.341 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.341 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "31536000", 2024-06-02T05:06:06.341 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.341 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.341 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.341 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "how long to retain crashes before pruning them", 2024-06-02T05:06:06.341 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.341 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.341 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.341 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.342 INFO:teuthology.orchestra.run.smithi076.stdout: "warn_recent_interval": { 2024-06-02T05:06:06.342 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "warn_recent_interval", 2024-06-02T05:06:06.342 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-06-02T05:06:06.342 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.342 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.342 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "1209600", 2024-06-02T05:06:06.342 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.342 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.342 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.342 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "time interval in which to warn about recent crashes", 2024-06-02T05:06:06.342 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.342 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.343 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.343 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.343 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.343 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.343 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:06.343 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "dashboard", 2024-06-02T05:06:06.343 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-06-02T05:06:06.343 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-06-02T05:06:06.343 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-06-02T05:06:06.343 INFO:teuthology.orchestra.run.smithi076.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-06-02T05:06:06.343 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-06-02T05:06:06.343 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:06.343 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.344 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.344 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "10", 2024-06-02T05:06:06.344 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.344 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.344 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.344 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.344 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.344 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.344 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.344 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.344 INFO:teuthology.orchestra.run.smithi076.stdout: "ALERTMANAGER_API_HOST": { 2024-06-02T05:06:06.344 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "ALERTMANAGER_API_HOST", 2024-06-02T05:06:06.345 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.345 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.345 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.345 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.345 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.345 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.345 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.345 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.345 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.345 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.345 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.345 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.345 INFO:teuthology.orchestra.run.smithi076.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-06-02T05:06:06.345 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-06-02T05:06:06.346 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.346 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.346 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.346 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:06.346 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.346 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.346 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.346 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.346 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.346 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.346 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.346 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.347 INFO:teuthology.orchestra.run.smithi076.stdout: "AUDIT_API_ENABLED": { 2024-06-02T05:06:06.347 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "AUDIT_API_ENABLED", 2024-06-02T05:06:06.347 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.347 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.347 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.347 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.347 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.347 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.347 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.347 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.347 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.347 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.347 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.348 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.348 INFO:teuthology.orchestra.run.smithi076.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-06-02T05:06:06.348 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-06-02T05:06:06.348 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.348 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.348 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.348 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:06.348 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.348 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.348 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.348 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.348 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.349 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.349 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.349 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.349 INFO:teuthology.orchestra.run.smithi076.stdout: "ENABLE_BROWSABLE_API": { 2024-06-02T05:06:06.349 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "ENABLE_BROWSABLE_API", 2024-06-02T05:06:06.349 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.349 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.349 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.349 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:06.349 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.349 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.349 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.349 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.350 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.350 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.350 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.350 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.350 INFO:teuthology.orchestra.run.smithi076.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-06-02T05:06:06.350 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-06-02T05:06:06.350 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.350 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.350 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.350 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:06.350 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.350 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.350 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.351 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.351 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.351 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.351 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.351 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.351 INFO:teuthology.orchestra.run.smithi076.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-06-02T05:06:06.351 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-06-02T05:06:06.351 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.351 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.351 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.351 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:06.351 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.351 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.352 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.352 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.352 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.352 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.352 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.352 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.352 INFO:teuthology.orchestra.run.smithi076.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-06-02T05:06:06.352 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-06-02T05:06:06.352 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.352 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.352 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.352 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:06.352 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.353 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.353 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.353 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.353 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.353 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.353 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.353 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.353 INFO:teuthology.orchestra.run.smithi076.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-06-02T05:06:06.353 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-06-02T05:06:06.353 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.353 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.353 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.353 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:06.353 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.354 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.354 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.354 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.354 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.354 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.354 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.354 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.354 INFO:teuthology.orchestra.run.smithi076.stdout: "FEATURE_TOGGLE_NFS": { 2024-06-02T05:06:06.354 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-06-02T05:06:06.354 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.354 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.354 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.354 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:06.355 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.355 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.355 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.355 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.355 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.355 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.355 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.355 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.355 INFO:teuthology.orchestra.run.smithi076.stdout: "FEATURE_TOGGLE_RBD": { 2024-06-02T05:06:06.355 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-06-02T05:06:06.355 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.355 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.355 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.356 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:06.356 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.356 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.356 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.356 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.356 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.356 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.356 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.356 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.356 INFO:teuthology.orchestra.run.smithi076.stdout: "FEATURE_TOGGLE_RGW": { 2024-06-02T05:06:06.356 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-06-02T05:06:06.356 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.356 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.357 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.357 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:06.357 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.357 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.357 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.357 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.357 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.357 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.357 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.357 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.357 INFO:teuthology.orchestra.run.smithi076.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-06-02T05:06:06.357 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-06-02T05:06:06.357 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.357 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.358 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.358 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.358 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.358 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.358 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.358 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.358 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.358 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.358 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.358 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.358 INFO:teuthology.orchestra.run.smithi076.stdout: "GRAFANA_API_PASSWORD": { 2024-06-02T05:06:06.358 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "GRAFANA_API_PASSWORD", 2024-06-02T05:06:06.358 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.359 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.359 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.359 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "admin", 2024-06-02T05:06:06.359 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.359 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.359 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.359 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.359 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.359 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.359 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.359 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.359 INFO:teuthology.orchestra.run.smithi076.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-06-02T05:06:06.359 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-06-02T05:06:06.360 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.360 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.360 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.360 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:06.360 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.360 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.360 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.360 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.360 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.360 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.360 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.360 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.360 INFO:teuthology.orchestra.run.smithi076.stdout: "GRAFANA_API_URL": { 2024-06-02T05:06:06.361 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "GRAFANA_API_URL", 2024-06-02T05:06:06.361 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.361 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.361 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.361 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.361 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.361 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.361 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.361 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.361 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.361 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.361 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.361 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.361 INFO:teuthology.orchestra.run.smithi076.stdout: "GRAFANA_API_USERNAME": { 2024-06-02T05:06:06.362 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "GRAFANA_API_USERNAME", 2024-06-02T05:06:06.362 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.362 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.362 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.362 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "admin", 2024-06-02T05:06:06.362 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.362 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.362 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.362 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.362 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.362 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.362 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.363 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.363 INFO:teuthology.orchestra.run.smithi076.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-06-02T05:06:06.363 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-06-02T05:06:06.363 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.363 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.363 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.363 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.363 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.363 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.363 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.363 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.363 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.363 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.363 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.364 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.364 INFO:teuthology.orchestra.run.smithi076.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-06-02T05:06:06.364 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-06-02T05:06:06.364 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.364 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.364 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.364 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.364 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.364 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.364 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.364 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.364 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.364 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.365 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.365 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.365 INFO:teuthology.orchestra.run.smithi076.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-06-02T05:06:06.365 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-06-02T05:06:06.365 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.365 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.365 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.365 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:06.365 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.365 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.365 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.365 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.365 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.366 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.366 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.366 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.366 INFO:teuthology.orchestra.run.smithi076.stdout: "ISSUE_TRACKER_API_KEY": { 2024-06-02T05:06:06.366 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-06-02T05:06:06.366 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.366 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.366 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.366 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.366 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.366 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.366 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.366 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.367 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.367 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.367 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.367 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.367 INFO:teuthology.orchestra.run.smithi076.stdout: "PROMETHEUS_API_HOST": { 2024-06-02T05:06:06.367 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "PROMETHEUS_API_HOST", 2024-06-02T05:06:06.367 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.367 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.367 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.367 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.367 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.367 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.367 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.368 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.368 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.368 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.368 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.368 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.368 INFO:teuthology.orchestra.run.smithi076.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-06-02T05:06:06.368 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-06-02T05:06:06.368 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.368 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.368 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.368 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:06.368 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.368 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.368 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.369 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.369 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.369 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.369 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.369 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.369 INFO:teuthology.orchestra.run.smithi076.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-06-02T05:06:06.369 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-06-02T05:06:06.369 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.369 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.369 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.369 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.369 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.369 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.370 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.370 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.370 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.370 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.370 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.370 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.370 INFO:teuthology.orchestra.run.smithi076.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-06-02T05:06:06.370 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-06-02T05:06:06.370 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.370 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.370 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.370 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.370 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.371 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.371 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.371 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.371 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.371 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.371 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.371 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.371 INFO:teuthology.orchestra.run.smithi076.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-06-02T05:06:06.371 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-06-02T05:06:06.371 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.371 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.371 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.371 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:06.371 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.372 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.372 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.372 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.372 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.372 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.372 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.372 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.372 INFO:teuthology.orchestra.run.smithi076.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-06-02T05:06:06.372 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-06-02T05:06:06.372 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.372 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.372 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.372 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:06.373 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.373 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.373 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.373 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.373 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.373 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.373 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.373 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.373 INFO:teuthology.orchestra.run.smithi076.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-06-02T05:06:06.373 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-06-02T05:06:06.373 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.373 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.373 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.373 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.374 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.374 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.374 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.374 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.374 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.374 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.374 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.374 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.374 INFO:teuthology.orchestra.run.smithi076.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-06-02T05:06:06.374 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-06-02T05:06:06.374 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.374 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.375 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.375 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.375 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.375 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.375 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.375 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.375 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.375 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.375 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.375 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.375 INFO:teuthology.orchestra.run.smithi076.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-06-02T05:06:06.375 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-06-02T05:06:06.375 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.376 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.376 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.376 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.376 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.376 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.376 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.376 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.376 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.376 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.376 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.376 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.376 INFO:teuthology.orchestra.run.smithi076.stdout: "PWD_POLICY_ENABLED": { 2024-06-02T05:06:06.376 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "PWD_POLICY_ENABLED", 2024-06-02T05:06:06.377 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.377 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.377 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.377 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:06.377 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.377 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.377 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.377 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.377 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.377 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.377 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.377 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.377 INFO:teuthology.orchestra.run.smithi076.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-06-02T05:06:06.378 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-06-02T05:06:06.378 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.378 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.378 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.378 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-06-02T05:06:06.378 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.378 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.378 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.378 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.378 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.378 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.378 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.378 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.379 INFO:teuthology.orchestra.run.smithi076.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-06-02T05:06:06.379 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-06-02T05:06:06.379 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:06.379 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.379 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.379 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "10", 2024-06-02T05:06:06.379 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.379 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.379 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.379 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.379 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.379 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.379 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.380 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.380 INFO:teuthology.orchestra.run.smithi076.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-06-02T05:06:06.380 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-06-02T05:06:06.380 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:06.380 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.380 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.380 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "8", 2024-06-02T05:06:06.380 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.380 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.380 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.380 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.380 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.380 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.381 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.381 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.381 INFO:teuthology.orchestra.run.smithi076.stdout: "REST_REQUESTS_TIMEOUT": { 2024-06-02T05:06:06.381 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-06-02T05:06:06.381 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:06.381 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.381 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.381 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "45", 2024-06-02T05:06:06.381 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.381 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.381 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.381 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.381 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.381 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.382 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.382 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.382 INFO:teuthology.orchestra.run.smithi076.stdout: "RGW_API_ACCESS_KEY": { 2024-06-02T05:06:06.382 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "RGW_API_ACCESS_KEY", 2024-06-02T05:06:06.382 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.382 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.382 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.382 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.382 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.382 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.382 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.382 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.383 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.383 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.383 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.383 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.383 INFO:teuthology.orchestra.run.smithi076.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-06-02T05:06:06.383 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-06-02T05:06:06.383 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.383 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.383 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.383 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "admin", 2024-06-02T05:06:06.383 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.383 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.383 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.384 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.384 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.384 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.384 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.384 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.384 INFO:teuthology.orchestra.run.smithi076.stdout: "RGW_API_SECRET_KEY": { 2024-06-02T05:06:06.384 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "RGW_API_SECRET_KEY", 2024-06-02T05:06:06.384 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.384 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.384 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.384 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.384 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.384 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.385 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.385 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.385 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.385 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.385 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.385 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.385 INFO:teuthology.orchestra.run.smithi076.stdout: "RGW_API_SSL_VERIFY": { 2024-06-02T05:06:06.385 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "RGW_API_SSL_VERIFY", 2024-06-02T05:06:06.385 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.385 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.385 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.385 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:06.385 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.386 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.386 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.386 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.386 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.386 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.386 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.386 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.386 INFO:teuthology.orchestra.run.smithi076.stdout: "UNSAFE_TLS_v1_2": { 2024-06-02T05:06:06.386 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "UNSAFE_TLS_v1_2", 2024-06-02T05:06:06.386 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.386 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.386 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.386 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.387 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.387 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.387 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.387 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.387 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.387 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.387 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.387 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.387 INFO:teuthology.orchestra.run.smithi076.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-06-02T05:06:06.387 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-06-02T05:06:06.387 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:06.387 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.387 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.387 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "0", 2024-06-02T05:06:06.388 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.388 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.388 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.388 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.388 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.388 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.388 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.388 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.388 INFO:teuthology.orchestra.run.smithi076.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-06-02T05:06:06.388 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-06-02T05:06:06.388 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:06.388 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.388 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.389 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "10", 2024-06-02T05:06:06.389 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.389 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.389 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.389 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.389 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.389 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.389 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.389 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.389 INFO:teuthology.orchestra.run.smithi076.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-06-02T05:06:06.389 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-06-02T05:06:06.389 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:06.389 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.390 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.390 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "5", 2024-06-02T05:06:06.390 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.390 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.390 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.390 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.390 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.390 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.390 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.390 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.390 INFO:teuthology.orchestra.run.smithi076.stdout: "cross_origin_url": { 2024-06-02T05:06:06.390 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "cross_origin_url", 2024-06-02T05:06:06.390 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.391 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.391 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.391 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.391 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.391 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.391 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.391 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.391 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.391 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.391 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.391 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.391 INFO:teuthology.orchestra.run.smithi076.stdout: "crt_file": { 2024-06-02T05:06:06.391 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "crt_file", 2024-06-02T05:06:06.392 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.392 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.392 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.392 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.392 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.392 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.392 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.392 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.392 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.392 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.392 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.392 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.392 INFO:teuthology.orchestra.run.smithi076.stdout: "debug": { 2024-06-02T05:06:06.393 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "debug", 2024-06-02T05:06:06.393 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.393 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.393 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.393 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.393 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.393 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.393 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.393 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Enable/disable debug options", 2024-06-02T05:06:06.393 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.393 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.393 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.393 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.394 INFO:teuthology.orchestra.run.smithi076.stdout: "jwt_token_ttl": { 2024-06-02T05:06:06.394 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "jwt_token_ttl", 2024-06-02T05:06:06.394 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:06.394 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.394 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.394 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "28800", 2024-06-02T05:06:06.394 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.394 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.394 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.394 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.394 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.394 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.394 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.395 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.395 INFO:teuthology.orchestra.run.smithi076.stdout: "key_file": { 2024-06-02T05:06:06.395 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "key_file", 2024-06-02T05:06:06.395 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.395 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.395 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.395 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.395 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.395 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.395 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.395 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.395 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.395 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.396 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.396 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.396 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-06-02T05:06:06.396 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-06-02T05:06:06.396 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.396 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.396 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.396 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.396 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.396 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.396 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.396 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.396 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.397 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.397 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.397 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.397 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.397 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.397 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.397 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.397 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.397 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.397 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.397 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-06-02T05:06:06.397 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-06-02T05:06:06.398 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.398 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.398 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.398 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.398 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.398 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.398 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.398 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.398 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.398 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.398 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.398 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.399 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-06-02T05:06:06.399 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-06-02T05:06:06.399 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.399 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.399 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.399 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-06-02T05:06:06.399 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.399 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.399 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.399 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.399 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.399 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.399 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.400 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.400 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.400 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.400 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.400 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.400 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.400 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.400 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.400 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-06-02T05:06:06.400 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-06-02T05:06:06.400 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.400 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.400 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.401 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.401 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.401 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.401 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.401 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.401 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.401 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.401 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.401 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.401 INFO:teuthology.orchestra.run.smithi076.stdout: "motd": { 2024-06-02T05:06:06.401 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "motd", 2024-06-02T05:06:06.401 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.401 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.402 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.402 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.402 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.402 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.402 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.402 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "The message of the day", 2024-06-02T05:06:06.402 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.402 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.402 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.402 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.402 INFO:teuthology.orchestra.run.smithi076.stdout: "redirect_resolve_ip_addr": { 2024-06-02T05:06:06.402 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "redirect_resolve_ip_addr", 2024-06-02T05:06:06.403 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.403 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.403 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.403 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.403 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.403 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.403 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.403 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.403 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.403 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.403 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.403 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.403 INFO:teuthology.orchestra.run.smithi076.stdout: "server_addr": { 2024-06-02T05:06:06.404 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "server_addr", 2024-06-02T05:06:06.404 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.404 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.404 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.404 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "::", 2024-06-02T05:06:06.404 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.404 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.404 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.404 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.404 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.404 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.404 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.404 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.405 INFO:teuthology.orchestra.run.smithi076.stdout: "server_port": { 2024-06-02T05:06:06.405 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "server_port", 2024-06-02T05:06:06.405 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:06.405 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.405 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.405 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "8080", 2024-06-02T05:06:06.405 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.405 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.405 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.405 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.405 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.405 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.405 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.405 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.406 INFO:teuthology.orchestra.run.smithi076.stdout: "ssl": { 2024-06-02T05:06:06.406 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "ssl", 2024-06-02T05:06:06.406 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.406 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.406 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.406 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:06.406 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.406 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.406 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.406 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.406 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.406 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.406 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.407 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.407 INFO:teuthology.orchestra.run.smithi076.stdout: "ssl_server_port": { 2024-06-02T05:06:06.407 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "ssl_server_port", 2024-06-02T05:06:06.407 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:06.407 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.407 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.407 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "8443", 2024-06-02T05:06:06.407 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.407 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.407 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.407 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.407 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.407 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.408 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.408 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.408 INFO:teuthology.orchestra.run.smithi076.stdout: "standby_behaviour": { 2024-06-02T05:06:06.408 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "standby_behaviour", 2024-06-02T05:06:06.408 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.408 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.408 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.408 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "redirect", 2024-06-02T05:06:06.408 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.408 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.408 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.408 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.409 INFO:teuthology.orchestra.run.smithi076.stdout: "redirect" 2024-06-02T05:06:06.409 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.409 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.409 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.409 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.409 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.409 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.409 INFO:teuthology.orchestra.run.smithi076.stdout: "standby_error_status_code": { 2024-06-02T05:06:06.409 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "standby_error_status_code", 2024-06-02T05:06:06.409 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:06.409 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.409 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.409 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "500", 2024-06-02T05:06:06.409 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "400", 2024-06-02T05:06:06.410 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "599", 2024-06-02T05:06:06.410 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.410 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.410 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.410 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.410 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.410 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.410 INFO:teuthology.orchestra.run.smithi076.stdout: "url_prefix": { 2024-06-02T05:06:06.410 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "url_prefix", 2024-06-02T05:06:06.410 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.410 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.410 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.410 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.411 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.411 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.411 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.411 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.411 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.411 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.411 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.411 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.411 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.411 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.411 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:06.411 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "devicehealth", 2024-06-02T05:06:06.411 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-06-02T05:06:06.412 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-06-02T05:06:06.412 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-06-02T05:06:06.412 INFO:teuthology.orchestra.run.smithi076.stdout: "enable_monitoring": { 2024-06-02T05:06:06.412 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "enable_monitoring", 2024-06-02T05:06:06.412 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.412 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.412 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.412 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:06.412 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.412 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.412 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.412 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "monitor device health metrics", 2024-06-02T05:06:06.412 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.412 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.413 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.413 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.413 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-06-02T05:06:06.413 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-06-02T05:06:06.413 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.413 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.413 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.413 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.413 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.413 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.413 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.413 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.413 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.414 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.414 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.414 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.414 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.414 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.414 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.414 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.414 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.414 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.414 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.414 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-06-02T05:06:06.414 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-06-02T05:06:06.415 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.415 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.415 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.415 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.415 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.415 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.415 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.415 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.415 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.415 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.415 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.415 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.415 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-06-02T05:06:06.415 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-06-02T05:06:06.416 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.416 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.416 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.416 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-06-02T05:06:06.416 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.416 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.416 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.416 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.416 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.416 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.416 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.416 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.416 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.417 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.417 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.417 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.417 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.417 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.417 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.417 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-06-02T05:06:06.417 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-06-02T05:06:06.417 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.417 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.417 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.417 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.417 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.418 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.418 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.418 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.418 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.418 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.418 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.418 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.418 INFO:teuthology.orchestra.run.smithi076.stdout: "mark_out_threshold": { 2024-06-02T05:06:06.418 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "mark_out_threshold", 2024-06-02T05:06:06.418 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-06-02T05:06:06.418 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.418 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.418 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "2419200", 2024-06-02T05:06:06.419 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.419 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.419 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.419 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-06-02T05:06:06.419 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.419 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.419 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.419 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.419 INFO:teuthology.orchestra.run.smithi076.stdout: "pool_name": { 2024-06-02T05:06:06.419 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "pool_name", 2024-06-02T05:06:06.419 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.419 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.419 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.420 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "device_health_metrics", 2024-06-02T05:06:06.420 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.420 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.420 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.420 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "name of pool in which to store device health metrics", 2024-06-02T05:06:06.420 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.420 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.420 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.420 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.420 INFO:teuthology.orchestra.run.smithi076.stdout: "retention_period": { 2024-06-02T05:06:06.420 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "retention_period", 2024-06-02T05:06:06.420 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-06-02T05:06:06.420 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.421 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.421 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "15552000", 2024-06-02T05:06:06.421 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.421 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.421 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.421 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "how long to retain device health metrics", 2024-06-02T05:06:06.421 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.421 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.421 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.421 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.421 INFO:teuthology.orchestra.run.smithi076.stdout: "scrape_frequency": { 2024-06-02T05:06:06.421 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "scrape_frequency", 2024-06-02T05:06:06.421 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-06-02T05:06:06.421 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.422 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.422 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "86400", 2024-06-02T05:06:06.422 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.422 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.422 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.422 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "how frequently to scrape device health metrics", 2024-06-02T05:06:06.422 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.422 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.422 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.422 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.422 INFO:teuthology.orchestra.run.smithi076.stdout: "self_heal": { 2024-06-02T05:06:06.422 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "self_heal", 2024-06-02T05:06:06.422 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.423 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.423 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.423 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:06.423 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.423 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.423 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.423 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-06-02T05:06:06.423 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.423 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.423 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.423 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.423 INFO:teuthology.orchestra.run.smithi076.stdout: "sleep_interval": { 2024-06-02T05:06:06.423 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "sleep_interval", 2024-06-02T05:06:06.424 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-06-02T05:06:06.424 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.424 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.424 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "600", 2024-06-02T05:06:06.424 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.424 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.424 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.424 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "how frequently to wake up and check device health", 2024-06-02T05:06:06.424 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.424 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.424 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.424 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.424 INFO:teuthology.orchestra.run.smithi076.stdout: "warn_threshold": { 2024-06-02T05:06:06.425 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "warn_threshold", 2024-06-02T05:06:06.425 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-06-02T05:06:06.425 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.425 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.425 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "7257600", 2024-06-02T05:06:06.425 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.425 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.425 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.425 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-06-02T05:06:06.425 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.425 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.425 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.425 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.426 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.426 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.426 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:06.426 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "diskprediction_local", 2024-06-02T05:06:06.426 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-06-02T05:06:06.426 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-06-02T05:06:06.426 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-06-02T05:06:06.426 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-06-02T05:06:06.426 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-06-02T05:06:06.426 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.426 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.426 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.426 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.427 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.427 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.427 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.427 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.427 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.427 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.427 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.427 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.427 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.427 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.427 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.427 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.427 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.428 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.428 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.428 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-06-02T05:06:06.428 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-06-02T05:06:06.428 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.428 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.428 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.428 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.428 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.428 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.428 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.428 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.428 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.429 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.429 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.429 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.429 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-06-02T05:06:06.429 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-06-02T05:06:06.429 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.429 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.429 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.429 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-06-02T05:06:06.429 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.429 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.429 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.429 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.430 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.430 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.430 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.430 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.430 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.430 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.430 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.430 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.430 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.430 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.430 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.430 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-06-02T05:06:06.431 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-06-02T05:06:06.431 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.431 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.431 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.431 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.431 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.431 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.431 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.431 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.431 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.431 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.431 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.431 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.432 INFO:teuthology.orchestra.run.smithi076.stdout: "predict_interval": { 2024-06-02T05:06:06.432 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "predict_interval", 2024-06-02T05:06:06.432 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.432 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.432 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.432 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "86400", 2024-06-02T05:06:06.432 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.432 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.432 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.432 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.432 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.432 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.432 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.433 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.433 INFO:teuthology.orchestra.run.smithi076.stdout: "predictor_model": { 2024-06-02T05:06:06.433 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "predictor_model", 2024-06-02T05:06:06.433 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.433 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.433 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.433 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "prophetstor", 2024-06-02T05:06:06.433 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.433 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.433 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.433 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.433 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.433 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.433 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.434 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.434 INFO:teuthology.orchestra.run.smithi076.stdout: "sleep_interval": { 2024-06-02T05:06:06.434 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "sleep_interval", 2024-06-02T05:06:06.434 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.434 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.434 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.434 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "600", 2024-06-02T05:06:06.434 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.434 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.434 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.434 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.434 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.434 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.435 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.435 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.435 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.435 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.435 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:06.435 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "influx", 2024-06-02T05:06:06.435 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": false, 2024-06-02T05:06:06.435 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "influxdb python module not found", 2024-06-02T05:06:06.435 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-06-02T05:06:06.435 INFO:teuthology.orchestra.run.smithi076.stdout: "batch_size": { 2024-06-02T05:06:06.435 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "batch_size", 2024-06-02T05:06:06.435 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:06.436 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.436 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.436 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "5000", 2024-06-02T05:06:06.436 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.436 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.436 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.436 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-06-02T05:06:06.436 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.436 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.436 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.436 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.436 INFO:teuthology.orchestra.run.smithi076.stdout: "database": { 2024-06-02T05:06:06.436 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "database", 2024-06-02T05:06:06.436 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.437 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.437 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.437 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "ceph", 2024-06-02T05:06:06.437 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.437 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.437 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.437 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-06-02T05:06:06.437 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.437 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.437 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.437 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.437 INFO:teuthology.orchestra.run.smithi076.stdout: "hostname": { 2024-06-02T05:06:06.437 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "hostname", 2024-06-02T05:06:06.438 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.438 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.438 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.438 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.438 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.438 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.438 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.438 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "InfluxDB server hostname", 2024-06-02T05:06:06.438 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.438 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.438 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.438 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.438 INFO:teuthology.orchestra.run.smithi076.stdout: "interval": { 2024-06-02T05:06:06.439 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "interval", 2024-06-02T05:06:06.439 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-06-02T05:06:06.439 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.439 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.439 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "30", 2024-06-02T05:06:06.439 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "5", 2024-06-02T05:06:06.439 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.439 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.439 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-06-02T05:06:06.439 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.439 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.439 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.439 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.440 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-06-02T05:06:06.440 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-06-02T05:06:06.440 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.440 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.440 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.440 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.440 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.440 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.440 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.440 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.440 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.440 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.440 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.441 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.441 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.441 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.441 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.441 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.441 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.441 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.441 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.441 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-06-02T05:06:06.441 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-06-02T05:06:06.441 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.441 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.441 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.442 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.442 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.442 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.442 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.442 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.442 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.442 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.442 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.442 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.442 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-06-02T05:06:06.442 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-06-02T05:06:06.442 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.442 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.443 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.443 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-06-02T05:06:06.443 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.443 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.443 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.443 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.443 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.443 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.443 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.443 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.443 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.443 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.443 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.443 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.444 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.444 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.444 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.444 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-06-02T05:06:06.444 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-06-02T05:06:06.444 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.444 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.444 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.444 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.444 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.444 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.444 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.444 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.445 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.445 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.445 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.445 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.445 INFO:teuthology.orchestra.run.smithi076.stdout: "password": { 2024-06-02T05:06:06.445 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "password", 2024-06-02T05:06:06.445 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.445 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.445 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.445 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.445 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.446 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.446 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.446 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "password of InfluxDB server user", 2024-06-02T05:06:06.446 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.446 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.446 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.446 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.446 INFO:teuthology.orchestra.run.smithi076.stdout: "port": { 2024-06-02T05:06:06.446 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "port", 2024-06-02T05:06:06.446 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:06.446 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.446 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.446 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "8086", 2024-06-02T05:06:06.447 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.447 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.447 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.447 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "InfluxDB server port", 2024-06-02T05:06:06.447 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.447 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.447 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.447 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.447 INFO:teuthology.orchestra.run.smithi076.stdout: "ssl": { 2024-06-02T05:06:06.447 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "ssl", 2024-06-02T05:06:06.447 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.447 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.447 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.448 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "false", 2024-06-02T05:06:06.448 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.448 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.448 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.448 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-06-02T05:06:06.448 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.448 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.448 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.448 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.448 INFO:teuthology.orchestra.run.smithi076.stdout: "threads": { 2024-06-02T05:06:06.448 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "threads", 2024-06-02T05:06:06.448 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:06.448 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.449 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.449 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "5", 2024-06-02T05:06:06.449 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "1", 2024-06-02T05:06:06.449 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "32", 2024-06-02T05:06:06.449 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.449 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-06-02T05:06:06.449 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.449 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.449 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.449 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.449 INFO:teuthology.orchestra.run.smithi076.stdout: "username": { 2024-06-02T05:06:06.449 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "username", 2024-06-02T05:06:06.449 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.450 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.450 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.450 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.450 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.450 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.450 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.450 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "username of InfluxDB server user", 2024-06-02T05:06:06.450 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.450 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.450 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.450 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.450 INFO:teuthology.orchestra.run.smithi076.stdout: "verify_ssl": { 2024-06-02T05:06:06.450 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "verify_ssl", 2024-06-02T05:06:06.451 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.451 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.451 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.451 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "true", 2024-06-02T05:06:06.451 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.451 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.451 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.451 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-06-02T05:06:06.451 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.451 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.451 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.451 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.451 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.452 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.452 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:06.452 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "insights", 2024-06-02T05:06:06.452 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-06-02T05:06:06.452 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-06-02T05:06:06.452 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-06-02T05:06:06.452 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-06-02T05:06:06.452 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-06-02T05:06:06.452 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.452 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.452 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.452 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.452 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.452 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.453 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.453 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.453 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.453 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.453 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.453 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.453 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.453 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.453 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.453 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.453 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.453 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.453 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.454 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-06-02T05:06:06.454 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-06-02T05:06:06.454 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.454 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.454 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.454 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.454 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.454 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.454 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.454 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.454 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.454 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.455 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.455 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.455 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-06-02T05:06:06.455 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-06-02T05:06:06.455 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.455 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.455 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.455 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-06-02T05:06:06.455 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.455 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.455 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.455 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.455 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.455 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.456 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.456 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.456 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.456 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.456 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.456 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.456 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.456 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.456 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.456 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-06-02T05:06:06.456 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-06-02T05:06:06.456 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.456 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.457 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.457 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.457 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.457 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.457 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.457 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.457 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.457 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.457 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.457 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.457 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.457 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.457 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:06.457 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "iostat", 2024-06-02T05:06:06.458 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-06-02T05:06:06.458 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-06-02T05:06:06.458 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-06-02T05:06:06.458 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-06-02T05:06:06.458 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-06-02T05:06:06.458 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.458 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.458 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.458 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.458 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.458 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.458 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.458 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.459 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.459 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.459 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.459 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.459 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.459 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.459 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.459 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.459 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.459 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.459 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.459 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-06-02T05:06:06.459 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-06-02T05:06:06.459 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.460 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.460 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.460 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.460 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.460 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.460 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.460 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.460 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.460 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.460 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.460 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.460 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-06-02T05:06:06.460 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-06-02T05:06:06.461 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.461 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.461 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.461 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-06-02T05:06:06.461 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.461 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.461 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.461 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.461 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.461 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.461 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.461 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.461 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.461 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.462 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.462 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.462 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.462 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.462 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.462 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-06-02T05:06:06.462 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-06-02T05:06:06.462 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.462 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.462 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.462 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.462 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.462 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.463 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.463 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.463 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.463 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.463 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.463 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.463 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.463 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.463 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:06.463 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "k8sevents", 2024-06-02T05:06:06.463 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-06-02T05:06:06.463 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-06-02T05:06:06.463 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-06-02T05:06:06.464 INFO:teuthology.orchestra.run.smithi076.stdout: "ceph_event_retention_days": { 2024-06-02T05:06:06.464 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "ceph_event_retention_days", 2024-06-02T05:06:06.464 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:06.464 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.464 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.464 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "7", 2024-06-02T05:06:06.464 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.464 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.464 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.464 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Days to hold ceph event information within local cache", 2024-06-02T05:06:06.464 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.464 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.464 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.465 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.465 INFO:teuthology.orchestra.run.smithi076.stdout: "config_check_secs": { 2024-06-02T05:06:06.465 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "config_check_secs", 2024-06-02T05:06:06.465 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:06.465 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.465 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.465 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "10", 2024-06-02T05:06:06.465 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "10", 2024-06-02T05:06:06.465 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.465 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.465 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-06-02T05:06:06.465 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.465 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.466 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.466 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.466 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-06-02T05:06:06.466 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-06-02T05:06:06.466 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.466 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.466 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.466 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.466 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.466 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.466 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.466 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.466 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.467 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.467 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.467 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.467 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.467 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.467 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.467 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.467 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.467 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.467 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.467 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-06-02T05:06:06.467 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-06-02T05:06:06.467 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.468 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.468 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.468 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.468 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.468 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.468 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.468 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.468 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.468 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.468 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.468 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.468 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-06-02T05:06:06.468 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-06-02T05:06:06.469 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.469 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.469 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.469 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-06-02T05:06:06.469 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.469 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.469 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.469 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.469 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.469 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.469 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.469 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.469 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.469 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.470 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.470 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.470 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.470 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.470 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.470 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-06-02T05:06:06.470 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-06-02T05:06:06.470 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.470 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.470 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.470 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.470 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.471 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.471 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.471 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.471 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.471 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.471 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.471 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.471 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.471 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.471 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:06.471 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "localpool", 2024-06-02T05:06:06.471 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-06-02T05:06:06.471 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-06-02T05:06:06.472 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-06-02T05:06:06.472 INFO:teuthology.orchestra.run.smithi076.stdout: "failure_domain": { 2024-06-02T05:06:06.472 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "failure_domain", 2024-06-02T05:06:06.472 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.472 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.472 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.472 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "host", 2024-06-02T05:06:06.472 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.472 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.472 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.472 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "failure domain for any created local pool", 2024-06-02T05:06:06.472 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-06-02T05:06:06.472 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.473 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.473 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.473 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-06-02T05:06:06.473 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-06-02T05:06:06.473 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.473 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.473 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.473 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.473 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.473 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.473 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.473 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.473 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.474 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.474 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.474 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.474 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.474 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.474 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.474 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.474 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.474 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.474 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.474 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-06-02T05:06:06.474 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-06-02T05:06:06.474 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.475 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.475 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.475 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.475 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.475 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.475 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.475 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.475 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.475 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.475 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.475 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.475 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-06-02T05:06:06.475 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-06-02T05:06:06.476 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.476 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.476 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.476 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-06-02T05:06:06.476 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.476 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.476 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.476 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.476 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.476 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.476 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.476 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.476 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.477 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.477 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.477 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.477 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.477 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.477 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.477 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-06-02T05:06:06.477 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-06-02T05:06:06.477 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.477 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.477 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.477 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.477 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.477 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.478 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.478 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.478 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.478 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.478 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.478 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.478 INFO:teuthology.orchestra.run.smithi076.stdout: "min_size": { 2024-06-02T05:06:06.478 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "min_size", 2024-06-02T05:06:06.478 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:06.478 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.478 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.478 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.478 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.479 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.479 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.479 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "default min_size for any created local pool", 2024-06-02T05:06:06.479 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-06-02T05:06:06.479 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.479 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.479 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.479 INFO:teuthology.orchestra.run.smithi076.stdout: "num_rep": { 2024-06-02T05:06:06.479 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "num_rep", 2024-06-02T05:06:06.479 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:06.479 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.479 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.479 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "3", 2024-06-02T05:06:06.480 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.480 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.480 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.480 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "default replica count for any created local pool", 2024-06-02T05:06:06.480 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.480 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.480 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.480 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.480 INFO:teuthology.orchestra.run.smithi076.stdout: "pg_num": { 2024-06-02T05:06:06.480 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "pg_num", 2024-06-02T05:06:06.480 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:06.480 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.480 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.480 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "128", 2024-06-02T05:06:06.481 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.481 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.481 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.481 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "default pg_num for any created local pool", 2024-06-02T05:06:06.481 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.481 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.481 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.481 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.481 INFO:teuthology.orchestra.run.smithi076.stdout: "prefix": { 2024-06-02T05:06:06.481 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "prefix", 2024-06-02T05:06:06.481 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.481 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.481 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.482 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.482 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.482 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.482 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.482 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "name prefix for any created local pool", 2024-06-02T05:06:06.482 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.482 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.482 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.482 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.482 INFO:teuthology.orchestra.run.smithi076.stdout: "subtree": { 2024-06-02T05:06:06.482 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "subtree", 2024-06-02T05:06:06.482 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.483 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.483 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.483 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "rack", 2024-06-02T05:06:06.483 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.483 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.483 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.483 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "CRUSH level for which to create a local pool", 2024-06-02T05:06:06.483 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-06-02T05:06:06.483 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.483 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.483 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.483 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.483 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.483 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:06.484 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "mds_autoscaler", 2024-06-02T05:06:06.484 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-06-02T05:06:06.484 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-06-02T05:06:06.484 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-06-02T05:06:06.484 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-06-02T05:06:06.484 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-06-02T05:06:06.484 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.484 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.484 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.484 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.484 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.484 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.484 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.485 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.485 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.485 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.485 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.485 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.485 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.485 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.485 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.485 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.485 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.485 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.485 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.485 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-06-02T05:06:06.486 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-06-02T05:06:06.486 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.486 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.486 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.486 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.486 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.486 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.486 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.486 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.486 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.486 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.486 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.487 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.487 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-06-02T05:06:06.487 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-06-02T05:06:06.487 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.487 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.487 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.487 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-06-02T05:06:06.487 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.487 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.487 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.487 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.487 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.487 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.487 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.488 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.488 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.488 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.488 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.488 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.488 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.488 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.488 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.488 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-06-02T05:06:06.488 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-06-02T05:06:06.488 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.488 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.488 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.489 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.489 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.489 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.489 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.489 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.489 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.489 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.489 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.489 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.489 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.489 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.489 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:06.489 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "mirroring", 2024-06-02T05:06:06.490 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-06-02T05:06:06.490 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-06-02T05:06:06.490 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-06-02T05:06:06.490 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-06-02T05:06:06.490 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-06-02T05:06:06.490 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.490 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.490 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.490 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.490 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.490 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.490 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.490 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.491 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.491 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.491 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.491 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.491 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.491 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.491 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.491 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.491 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.491 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.491 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.491 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-06-02T05:06:06.491 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-06-02T05:06:06.492 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.492 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.492 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.492 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.492 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.492 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.492 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.492 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.492 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.492 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.492 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.492 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.492 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-06-02T05:06:06.493 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-06-02T05:06:06.493 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.493 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.493 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.493 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-06-02T05:06:06.493 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.493 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.493 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.493 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.493 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.493 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.493 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.493 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.493 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.494 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.494 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.494 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.494 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.494 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.494 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.494 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-06-02T05:06:06.494 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-06-02T05:06:06.494 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.494 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.494 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.494 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.494 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.495 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.495 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.495 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.495 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.495 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.495 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.495 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.495 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.495 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.495 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:06.495 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "nfs", 2024-06-02T05:06:06.495 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-06-02T05:06:06.495 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-06-02T05:06:06.495 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-06-02T05:06:06.496 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-06-02T05:06:06.496 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-06-02T05:06:06.496 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.496 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.496 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.496 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.496 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.496 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.496 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.496 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.496 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.496 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.496 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.497 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.497 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.497 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.497 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.497 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.497 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.497 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.497 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.497 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-06-02T05:06:06.497 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-06-02T05:06:06.497 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.497 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.497 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.498 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.498 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.498 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.498 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.498 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.498 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.498 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.498 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.498 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.498 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-06-02T05:06:06.498 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-06-02T05:06:06.498 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.498 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.499 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.499 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-06-02T05:06:06.499 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.499 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.499 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.499 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.499 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.499 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.499 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.499 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.499 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.499 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.499 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.500 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.500 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.500 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.500 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.500 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-06-02T05:06:06.500 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-06-02T05:06:06.500 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.500 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.500 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.500 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.500 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.500 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.500 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.501 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.501 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.501 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.501 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.501 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.501 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.501 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.501 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:06.501 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "orchestrator", 2024-06-02T05:06:06.501 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-06-02T05:06:06.501 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-06-02T05:06:06.501 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-06-02T05:06:06.501 INFO:teuthology.orchestra.run.smithi076.stdout: "fail_fs": { 2024-06-02T05:06:06.502 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "fail_fs", 2024-06-02T05:06:06.502 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.502 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.502 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.502 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.502 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.502 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.502 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.502 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-06-02T05:06:06.502 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.502 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.502 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.502 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.503 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-06-02T05:06:06.503 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-06-02T05:06:06.503 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.503 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.503 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.503 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.503 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.503 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.503 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.503 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.503 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.503 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.503 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.503 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.504 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.504 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.504 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.504 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.504 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.504 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.504 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.504 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-06-02T05:06:06.504 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-06-02T05:06:06.504 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.504 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.504 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.504 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.505 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.505 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.505 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.505 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.505 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.505 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.505 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.505 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.505 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-06-02T05:06:06.505 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-06-02T05:06:06.505 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.505 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.505 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.506 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-06-02T05:06:06.506 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.506 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.506 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.506 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.506 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.506 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.506 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.506 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.506 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.506 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.506 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.507 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.507 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.507 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.507 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.507 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-06-02T05:06:06.507 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-06-02T05:06:06.507 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.507 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.507 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.507 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.507 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.507 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.507 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.507 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.508 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.508 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.508 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.508 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.508 INFO:teuthology.orchestra.run.smithi076.stdout: "orchestrator": { 2024-06-02T05:06:06.508 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "orchestrator", 2024-06-02T05:06:06.508 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.508 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.508 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.508 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.508 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.508 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.508 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.509 INFO:teuthology.orchestra.run.smithi076.stdout: "cephadm", 2024-06-02T05:06:06.509 INFO:teuthology.orchestra.run.smithi076.stdout: "rook", 2024-06-02T05:06:06.509 INFO:teuthology.orchestra.run.smithi076.stdout: "test_orchestrator" 2024-06-02T05:06:06.509 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.509 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Orchestrator backend", 2024-06-02T05:06:06.509 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.509 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.509 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.509 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.509 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.509 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.509 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:06.509 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "osd_perf_query", 2024-06-02T05:06:06.510 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-06-02T05:06:06.510 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-06-02T05:06:06.510 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-06-02T05:06:06.510 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-06-02T05:06:06.510 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-06-02T05:06:06.510 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.510 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.510 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.510 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.510 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.510 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.510 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.510 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.511 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.511 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.511 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.511 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.511 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.511 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.511 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.511 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.511 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.511 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.511 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.511 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-06-02T05:06:06.511 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-06-02T05:06:06.512 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.512 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.512 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.512 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.512 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.512 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.512 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.512 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.512 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.512 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.512 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.512 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.512 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-06-02T05:06:06.513 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-06-02T05:06:06.513 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.513 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.513 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.513 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-06-02T05:06:06.513 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.513 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.513 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.513 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.513 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.513 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.513 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.513 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.514 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.514 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.514 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.514 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.514 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.514 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.514 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.514 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-06-02T05:06:06.514 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-06-02T05:06:06.514 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.514 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.514 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.514 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.515 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.515 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.515 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.515 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.515 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.515 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.515 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.515 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.515 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.515 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.515 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:06.515 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "osd_support", 2024-06-02T05:06:06.515 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-06-02T05:06:06.515 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-06-02T05:06:06.516 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-06-02T05:06:06.516 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-06-02T05:06:06.516 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-06-02T05:06:06.516 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.516 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.516 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.516 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.516 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.516 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.516 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.516 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.516 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.516 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.517 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.517 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.517 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.517 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.517 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.517 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.517 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.517 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.517 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.517 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-06-02T05:06:06.517 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-06-02T05:06:06.517 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.517 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.518 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.518 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.518 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.518 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.518 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.518 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.518 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.518 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.518 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.518 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.518 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-06-02T05:06:06.518 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-06-02T05:06:06.518 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.519 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.519 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.519 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-06-02T05:06:06.519 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.519 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.519 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.519 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.519 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.519 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.519 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.519 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.519 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.519 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.520 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.520 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.520 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.520 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.520 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.520 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-06-02T05:06:06.520 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-06-02T05:06:06.520 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.520 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.520 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.520 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.520 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.520 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.521 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.521 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.521 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.521 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.521 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.521 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.521 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.521 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.521 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:06.521 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "pg_autoscaler", 2024-06-02T05:06:06.521 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-06-02T05:06:06.521 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-06-02T05:06:06.521 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-06-02T05:06:06.522 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-06-02T05:06:06.522 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-06-02T05:06:06.522 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.522 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.522 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.522 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.522 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.522 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.522 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.522 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.522 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.522 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.522 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.523 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.523 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.523 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.523 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.523 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.523 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.523 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.523 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.523 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-06-02T05:06:06.523 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-06-02T05:06:06.523 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.523 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.523 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.524 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.524 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.524 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.524 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.524 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.524 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.524 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.524 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.524 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.524 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-06-02T05:06:06.524 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-06-02T05:06:06.524 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.524 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.525 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.525 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-06-02T05:06:06.525 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.525 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.525 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.525 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.525 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.525 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.525 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.525 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.525 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.525 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.525 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.525 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.526 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.526 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.526 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.526 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-06-02T05:06:06.526 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-06-02T05:06:06.526 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.526 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.526 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.526 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.526 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.526 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.526 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.526 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.527 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.527 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.527 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.527 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.527 INFO:teuthology.orchestra.run.smithi076.stdout: "sleep_interval": { 2024-06-02T05:06:06.527 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "sleep_interval", 2024-06-02T05:06:06.527 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-06-02T05:06:06.527 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.527 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.527 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "60", 2024-06-02T05:06:06.527 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.527 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.528 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.528 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.528 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.528 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.528 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.528 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.528 INFO:teuthology.orchestra.run.smithi076.stdout: "threshold": { 2024-06-02T05:06:06.528 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "threshold", 2024-06-02T05:06:06.528 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "float", 2024-06-02T05:06:06.528 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.528 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.528 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "3.0", 2024-06-02T05:06:06.528 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "1.0", 2024-06-02T05:06:06.528 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.529 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.529 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "scaling threshold", 2024-06-02T05:06:06.529 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-06-02T05:06:06.529 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.529 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.529 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.529 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.529 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.529 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:06.529 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "progress", 2024-06-02T05:06:06.529 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-06-02T05:06:06.529 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-06-02T05:06:06.529 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-06-02T05:06:06.530 INFO:teuthology.orchestra.run.smithi076.stdout: "allow_pg_recovery_event": { 2024-06-02T05:06:06.530 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "allow_pg_recovery_event", 2024-06-02T05:06:06.530 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.530 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.530 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.530 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.530 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.530 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.530 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.530 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "allow the module to show pg recovery progress", 2024-06-02T05:06:06.530 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.530 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.530 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.531 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.531 INFO:teuthology.orchestra.run.smithi076.stdout: "enabled": { 2024-06-02T05:06:06.531 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "enabled", 2024-06-02T05:06:06.531 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.531 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.531 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.531 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:06.531 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.531 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.531 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.531 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.531 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.531 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.531 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.532 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.532 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-06-02T05:06:06.532 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-06-02T05:06:06.532 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.532 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.532 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.532 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.532 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.532 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.532 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.532 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.532 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.532 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.533 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.533 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.533 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.533 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.533 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.533 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.533 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.533 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.533 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.533 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-06-02T05:06:06.533 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-06-02T05:06:06.533 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.533 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.534 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.534 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.534 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.534 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.534 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.534 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.534 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.534 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.534 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.534 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.534 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-06-02T05:06:06.534 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-06-02T05:06:06.534 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.534 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.535 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.535 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-06-02T05:06:06.535 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.535 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.535 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.535 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.535 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.535 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.535 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.535 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.535 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.535 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.535 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.536 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.536 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.536 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.536 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.536 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-06-02T05:06:06.536 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-06-02T05:06:06.536 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.536 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.536 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.536 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.536 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.536 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.536 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.537 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.537 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.537 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.537 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.537 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.537 INFO:teuthology.orchestra.run.smithi076.stdout: "max_completed_events": { 2024-06-02T05:06:06.537 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "max_completed_events", 2024-06-02T05:06:06.537 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:06.537 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.537 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.537 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "50", 2024-06-02T05:06:06.537 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.537 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.538 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.538 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "number of past completed events to remember", 2024-06-02T05:06:06.538 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.538 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.538 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.538 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.538 INFO:teuthology.orchestra.run.smithi076.stdout: "sleep_interval": { 2024-06-02T05:06:06.538 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "sleep_interval", 2024-06-02T05:06:06.538 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-06-02T05:06:06.538 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.538 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.538 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "5", 2024-06-02T05:06:06.538 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.539 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.539 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.539 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "how long the module is going to sleep", 2024-06-02T05:06:06.539 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.539 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.539 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.539 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.539 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.539 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.539 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:06.539 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "prometheus", 2024-06-02T05:06:06.539 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-06-02T05:06:06.539 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-06-02T05:06:06.540 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-06-02T05:06:06.540 INFO:teuthology.orchestra.run.smithi076.stdout: "cache": { 2024-06-02T05:06:06.540 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "cache", 2024-06-02T05:06:06.540 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.540 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.540 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.540 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:06.540 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.540 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.540 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.540 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.540 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.540 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.541 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.541 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.541 INFO:teuthology.orchestra.run.smithi076.stdout: "exclude_perf_counters": { 2024-06-02T05:06:06.541 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "exclude_perf_counters", 2024-06-02T05:06:06.541 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.541 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.541 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.541 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:06.541 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.541 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.541 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.541 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-06-02T05:06:06.541 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-06-02T05:06:06.542 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.542 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.542 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.542 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-06-02T05:06:06.542 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-06-02T05:06:06.542 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.542 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.542 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.542 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.542 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.542 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.542 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.542 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.543 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.543 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.543 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.543 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.543 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.543 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.543 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.543 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.543 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.543 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.543 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.543 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-06-02T05:06:06.543 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-06-02T05:06:06.544 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.544 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.544 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.544 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.544 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.544 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.544 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.544 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.544 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.544 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.544 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.544 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.544 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-06-02T05:06:06.545 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-06-02T05:06:06.545 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.545 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.545 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.545 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-06-02T05:06:06.545 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.545 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.545 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.545 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.545 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.545 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.545 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.545 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.545 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.546 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.546 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.546 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.546 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.546 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.546 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.546 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-06-02T05:06:06.546 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-06-02T05:06:06.546 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.546 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.546 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.546 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.546 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.547 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.547 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.547 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.547 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.547 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.547 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.547 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.547 INFO:teuthology.orchestra.run.smithi076.stdout: "rbd_stats_pools": { 2024-06-02T05:06:06.547 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "rbd_stats_pools", 2024-06-02T05:06:06.547 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.547 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.547 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.547 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.548 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.548 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.548 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.548 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.548 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.548 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.548 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.548 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.548 INFO:teuthology.orchestra.run.smithi076.stdout: "rbd_stats_pools_refresh_interval": { 2024-06-02T05:06:06.548 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-06-02T05:06:06.548 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:06.548 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.548 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.549 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "300", 2024-06-02T05:06:06.549 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.549 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.549 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.549 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.549 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.549 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.549 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.549 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.549 INFO:teuthology.orchestra.run.smithi076.stdout: "scrape_interval": { 2024-06-02T05:06:06.549 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "scrape_interval", 2024-06-02T05:06:06.549 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "float", 2024-06-02T05:06:06.549 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.549 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.550 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "15.0", 2024-06-02T05:06:06.550 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.550 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.550 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.550 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.550 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.550 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.550 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.550 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.550 INFO:teuthology.orchestra.run.smithi076.stdout: "server_addr": { 2024-06-02T05:06:06.550 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "server_addr", 2024-06-02T05:06:06.550 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.551 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.551 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.551 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "::", 2024-06-02T05:06:06.551 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.551 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.551 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.551 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-06-02T05:06:06.551 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.551 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.551 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.551 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.551 INFO:teuthology.orchestra.run.smithi076.stdout: "server_port": { 2024-06-02T05:06:06.551 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "server_port", 2024-06-02T05:06:06.551 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:06.552 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.552 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.552 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "9283", 2024-06-02T05:06:06.552 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.552 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.552 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.552 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-06-02T05:06:06.552 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.552 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.552 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.552 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.552 INFO:teuthology.orchestra.run.smithi076.stdout: "stale_cache_strategy": { 2024-06-02T05:06:06.552 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "stale_cache_strategy", 2024-06-02T05:06:06.553 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.553 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.553 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.553 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "log", 2024-06-02T05:06:06.553 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.553 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.553 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.553 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.553 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.553 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.553 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.553 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.553 INFO:teuthology.orchestra.run.smithi076.stdout: "standby_behaviour": { 2024-06-02T05:06:06.554 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "standby_behaviour", 2024-06-02T05:06:06.554 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.554 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.554 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.554 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "default", 2024-06-02T05:06:06.554 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.554 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.554 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.554 INFO:teuthology.orchestra.run.smithi076.stdout: "default", 2024-06-02T05:06:06.554 INFO:teuthology.orchestra.run.smithi076.stdout: "error" 2024-06-02T05:06:06.554 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.554 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.554 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.555 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.555 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.555 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.555 INFO:teuthology.orchestra.run.smithi076.stdout: "standby_error_status_code": { 2024-06-02T05:06:06.555 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "standby_error_status_code", 2024-06-02T05:06:06.555 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:06.555 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.555 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.555 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "500", 2024-06-02T05:06:06.555 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "400", 2024-06-02T05:06:06.555 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "599", 2024-06-02T05:06:06.555 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.555 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.556 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.556 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.556 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.556 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.556 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.556 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.556 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:06.556 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "rbd_support", 2024-06-02T05:06:06.556 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-06-02T05:06:06.556 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-06-02T05:06:06.556 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-06-02T05:06:06.556 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-06-02T05:06:06.556 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-06-02T05:06:06.557 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.557 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.557 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.557 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.557 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.557 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.557 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.557 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.557 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.557 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.557 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.557 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.557 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.557 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.558 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.558 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.558 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.558 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.558 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.558 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-06-02T05:06:06.558 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-06-02T05:06:06.558 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.558 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.558 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.558 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.558 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.559 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.559 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.559 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.559 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.559 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.559 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.559 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.559 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-06-02T05:06:06.559 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-06-02T05:06:06.559 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.559 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.559 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.559 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-06-02T05:06:06.560 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.560 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.560 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.560 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.560 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.560 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.560 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.560 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.560 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.560 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.560 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.560 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.560 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.560 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.561 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.561 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-06-02T05:06:06.561 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-06-02T05:06:06.561 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.561 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.561 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.561 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.561 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.561 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.561 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.561 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.561 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.561 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.562 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.562 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.562 INFO:teuthology.orchestra.run.smithi076.stdout: "max_concurrent_snap_create": { 2024-06-02T05:06:06.562 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "max_concurrent_snap_create", 2024-06-02T05:06:06.562 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:06.562 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.562 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.562 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "10", 2024-06-02T05:06:06.562 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.562 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.562 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.562 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.562 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.563 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.563 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.563 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.563 INFO:teuthology.orchestra.run.smithi076.stdout: "mirror_snapshot_schedule": { 2024-06-02T05:06:06.563 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "mirror_snapshot_schedule", 2024-06-02T05:06:06.563 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.563 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.563 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.563 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.563 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.563 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.563 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.563 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.564 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.564 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.564 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.564 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.564 INFO:teuthology.orchestra.run.smithi076.stdout: "trash_purge_schedule": { 2024-06-02T05:06:06.564 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "trash_purge_schedule", 2024-06-02T05:06:06.564 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.564 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.564 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.564 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.564 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.564 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.564 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.565 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.565 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.565 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.565 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.565 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.565 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.565 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.565 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:06.565 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "restful", 2024-06-02T05:06:06.565 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-06-02T05:06:06.565 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-06-02T05:06:06.565 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-06-02T05:06:06.565 INFO:teuthology.orchestra.run.smithi076.stdout: "enable_auth": { 2024-06-02T05:06:06.565 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "enable_auth", 2024-06-02T05:06:06.566 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.566 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.566 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.566 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:06.566 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.566 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.566 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.566 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.566 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.566 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.566 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.566 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.566 INFO:teuthology.orchestra.run.smithi076.stdout: "key_file": { 2024-06-02T05:06:06.567 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "key_file", 2024-06-02T05:06:06.567 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.567 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.567 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.567 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.567 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.567 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.567 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.567 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.567 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.567 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.567 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.567 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.567 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-06-02T05:06:06.568 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-06-02T05:06:06.568 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.568 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.568 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.568 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.568 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.568 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.568 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.568 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.568 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.568 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.568 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.568 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.569 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.569 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.569 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.569 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.569 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.569 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.569 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.569 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-06-02T05:06:06.569 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-06-02T05:06:06.569 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.569 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.569 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.569 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.570 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.570 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.570 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.570 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.570 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.570 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.570 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.570 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.570 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-06-02T05:06:06.570 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-06-02T05:06:06.570 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.570 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.570 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.571 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-06-02T05:06:06.571 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.571 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.571 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.571 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.571 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.571 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.571 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.571 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.571 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.571 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.571 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.571 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.572 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.572 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.572 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.572 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-06-02T05:06:06.572 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-06-02T05:06:06.572 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.572 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.572 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.572 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.572 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.572 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.572 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.572 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.573 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.573 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.573 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.573 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.573 INFO:teuthology.orchestra.run.smithi076.stdout: "server_addr": { 2024-06-02T05:06:06.573 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "server_addr", 2024-06-02T05:06:06.573 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.573 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.573 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.573 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.573 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.573 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.573 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.573 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.574 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.574 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.574 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.574 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.574 INFO:teuthology.orchestra.run.smithi076.stdout: "server_port": { 2024-06-02T05:06:06.574 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "server_port", 2024-06-02T05:06:06.574 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.574 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.574 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.574 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.574 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.574 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.574 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.575 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.575 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.575 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.575 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.575 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.575 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.575 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.575 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:06.575 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "rgw", 2024-06-02T05:06:06.575 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-06-02T05:06:06.575 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-06-02T05:06:06.575 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-06-02T05:06:06.575 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-06-02T05:06:06.576 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-06-02T05:06:06.576 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.576 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.576 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.576 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.576 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.576 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.576 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.576 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.576 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.576 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.576 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.576 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.577 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.577 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.577 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.577 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.577 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.577 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.577 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.577 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-06-02T05:06:06.577 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-06-02T05:06:06.577 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.577 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.577 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.577 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.578 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.578 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.578 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.578 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.578 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.578 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.578 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.578 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.578 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-06-02T05:06:06.578 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-06-02T05:06:06.578 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.578 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.578 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.579 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-06-02T05:06:06.579 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.579 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.579 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.579 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.579 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.579 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.579 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.579 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.579 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.579 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.579 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.579 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.579 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.580 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.580 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.580 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-06-02T05:06:06.580 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-06-02T05:06:06.580 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.580 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.580 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.580 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.580 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.580 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.580 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.580 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.580 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.581 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.581 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.581 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.581 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.581 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.581 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:06.581 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "rook", 2024-06-02T05:06:06.581 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-06-02T05:06:06.581 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-06-02T05:06:06.581 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-06-02T05:06:06.581 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-06-02T05:06:06.581 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-06-02T05:06:06.581 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.582 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.582 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.582 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.582 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.582 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.582 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.582 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.582 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.582 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.582 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.582 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.582 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.582 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.583 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.583 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.583 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.583 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.583 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.583 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-06-02T05:06:06.583 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-06-02T05:06:06.583 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.583 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.583 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.583 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.583 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.583 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.584 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.584 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.584 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.584 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.584 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.584 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.584 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-06-02T05:06:06.584 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-06-02T05:06:06.584 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.584 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.584 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.584 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-06-02T05:06:06.584 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.585 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.585 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.585 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.585 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.585 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.585 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.585 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.585 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.585 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.585 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.585 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.585 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.585 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.585 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.586 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-06-02T05:06:06.586 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-06-02T05:06:06.586 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.586 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.586 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.586 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.586 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.586 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.586 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.586 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.586 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.586 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.587 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.587 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.587 INFO:teuthology.orchestra.run.smithi076.stdout: "storage_class": { 2024-06-02T05:06:06.587 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "storage_class", 2024-06-02T05:06:06.587 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.587 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.587 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.587 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "local", 2024-06-02T05:06:06.587 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.587 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.587 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.587 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-06-02T05:06:06.587 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.588 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.588 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.588 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.588 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.588 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.588 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:06.588 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "selftest", 2024-06-02T05:06:06.588 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-06-02T05:06:06.588 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-06-02T05:06:06.588 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-06-02T05:06:06.588 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-06-02T05:06:06.588 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-06-02T05:06:06.588 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.589 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.589 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.589 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.589 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.589 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.589 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.589 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.589 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.589 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.589 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.589 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.589 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.589 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.590 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.590 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.590 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.590 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.590 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.590 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-06-02T05:06:06.590 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-06-02T05:06:06.590 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.590 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.590 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.590 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.590 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.590 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.591 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.591 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.591 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.591 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.591 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.591 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.591 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-06-02T05:06:06.591 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-06-02T05:06:06.591 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.591 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.591 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.591 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-06-02T05:06:06.591 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.592 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.592 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.592 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.592 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.592 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.592 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.592 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.592 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.592 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.592 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.592 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.592 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.593 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.593 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.593 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-06-02T05:06:06.593 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-06-02T05:06:06.593 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.593 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.593 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.593 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.593 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.593 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.593 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.593 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.593 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.594 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.594 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.594 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.594 INFO:teuthology.orchestra.run.smithi076.stdout: "roption1": { 2024-06-02T05:06:06.594 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "roption1", 2024-06-02T05:06:06.594 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.594 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.594 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.594 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.594 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.594 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.594 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.595 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.595 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.595 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.595 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.595 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.595 INFO:teuthology.orchestra.run.smithi076.stdout: "roption2": { 2024-06-02T05:06:06.595 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "roption2", 2024-06-02T05:06:06.595 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.595 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.595 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.595 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "xyz", 2024-06-02T05:06:06.595 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.595 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.596 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.596 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.596 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.596 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.596 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.596 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.596 INFO:teuthology.orchestra.run.smithi076.stdout: "rwoption1": { 2024-06-02T05:06:06.596 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "rwoption1", 2024-06-02T05:06:06.596 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.596 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.596 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.596 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.596 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.597 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.597 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.597 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.597 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.597 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.597 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.597 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.597 INFO:teuthology.orchestra.run.smithi076.stdout: "rwoption2": { 2024-06-02T05:06:06.597 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "rwoption2", 2024-06-02T05:06:06.597 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:06.597 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.597 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.597 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.598 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.598 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.598 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.598 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.598 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.598 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.598 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.598 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.598 INFO:teuthology.orchestra.run.smithi076.stdout: "rwoption3": { 2024-06-02T05:06:06.598 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "rwoption3", 2024-06-02T05:06:06.598 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "float", 2024-06-02T05:06:06.598 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.598 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.599 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.599 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.599 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.599 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.599 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.599 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.599 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.599 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.599 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.599 INFO:teuthology.orchestra.run.smithi076.stdout: "rwoption4": { 2024-06-02T05:06:06.599 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "rwoption4", 2024-06-02T05:06:06.599 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.599 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.600 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.600 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.600 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.600 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.600 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.600 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.600 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.600 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.600 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.600 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.600 INFO:teuthology.orchestra.run.smithi076.stdout: "rwoption5": { 2024-06-02T05:06:06.600 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "rwoption5", 2024-06-02T05:06:06.600 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.601 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.601 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.601 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.601 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.601 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.601 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.601 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.601 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.601 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.601 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.601 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.601 INFO:teuthology.orchestra.run.smithi076.stdout: "rwoption6": { 2024-06-02T05:06:06.602 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "rwoption6", 2024-06-02T05:06:06.602 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.602 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.602 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.602 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:06.602 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.602 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.602 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.602 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.602 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.602 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.602 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.603 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.603 INFO:teuthology.orchestra.run.smithi076.stdout: "rwoption7": { 2024-06-02T05:06:06.603 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "rwoption7", 2024-06-02T05:06:06.603 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:06.603 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.603 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.603 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.603 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "1", 2024-06-02T05:06:06.603 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "42", 2024-06-02T05:06:06.603 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.603 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.603 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.603 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.604 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.604 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.604 INFO:teuthology.orchestra.run.smithi076.stdout: "testkey": { 2024-06-02T05:06:06.604 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "testkey", 2024-06-02T05:06:06.604 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.604 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.604 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.604 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.604 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.604 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.604 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.604 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.604 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.604 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.605 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.605 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.605 INFO:teuthology.orchestra.run.smithi076.stdout: "testlkey": { 2024-06-02T05:06:06.605 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "testlkey", 2024-06-02T05:06:06.605 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.605 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.605 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.605 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.605 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.605 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.605 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.605 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.606 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.606 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.606 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.606 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.606 INFO:teuthology.orchestra.run.smithi076.stdout: "testnewline": { 2024-06-02T05:06:06.606 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "testnewline", 2024-06-02T05:06:06.606 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.606 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.606 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.606 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.606 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.606 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.606 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.607 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.607 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.607 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.607 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.607 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.607 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.607 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.607 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:06.607 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "snap_schedule", 2024-06-02T05:06:06.607 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-06-02T05:06:06.607 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-06-02T05:06:06.607 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-06-02T05:06:06.607 INFO:teuthology.orchestra.run.smithi076.stdout: "allow_m_granularity": { 2024-06-02T05:06:06.608 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "allow_m_granularity", 2024-06-02T05:06:06.608 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.608 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.608 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.608 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.608 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.608 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.608 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.608 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "allow minute scheduled snapshots", 2024-06-02T05:06:06.608 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.608 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.608 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.608 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.609 INFO:teuthology.orchestra.run.smithi076.stdout: "dump_on_update": { 2024-06-02T05:06:06.609 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "dump_on_update", 2024-06-02T05:06:06.609 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.609 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.609 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.609 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.609 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.609 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.609 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.609 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "dump database to debug log on update", 2024-06-02T05:06:06.609 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.609 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.609 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.610 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.610 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-06-02T05:06:06.610 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-06-02T05:06:06.610 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.610 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.610 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.610 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.610 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.610 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.610 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.610 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.610 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.611 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.611 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.611 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.611 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.611 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.611 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.611 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.611 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.611 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.611 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.611 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-06-02T05:06:06.611 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-06-02T05:06:06.611 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.611 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.612 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.612 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.612 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.612 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.612 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.612 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.612 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.612 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.612 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.612 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.612 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-06-02T05:06:06.612 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-06-02T05:06:06.612 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.613 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.613 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.613 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-06-02T05:06:06.613 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.613 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.613 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.613 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.613 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.613 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.613 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.613 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.613 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.613 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.614 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.614 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.614 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.614 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.614 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.614 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-06-02T05:06:06.614 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-06-02T05:06:06.614 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.614 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.614 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.614 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.614 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.614 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.615 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.615 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.615 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.615 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.615 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.615 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.615 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.615 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.615 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:06.615 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "stats", 2024-06-02T05:06:06.615 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-06-02T05:06:06.615 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-06-02T05:06:06.615 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-06-02T05:06:06.616 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-06-02T05:06:06.616 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-06-02T05:06:06.616 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.616 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.616 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.616 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.616 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.616 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.616 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.616 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.616 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.616 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.616 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.617 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.617 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.617 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.617 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.617 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.617 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.617 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.617 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.617 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-06-02T05:06:06.617 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-06-02T05:06:06.617 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.617 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.617 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.618 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.618 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.618 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.618 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.618 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.618 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.618 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.618 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.618 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.618 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-06-02T05:06:06.618 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-06-02T05:06:06.618 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.618 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.619 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.619 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-06-02T05:06:06.619 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.619 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.619 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.619 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.619 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.619 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.619 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.619 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.619 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.619 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.619 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.620 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.620 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.620 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.620 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.620 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-06-02T05:06:06.620 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-06-02T05:06:06.620 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.620 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.620 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.620 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.620 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.620 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.620 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.620 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.621 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.621 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.621 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.621 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.621 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.621 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.621 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:06.621 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "status", 2024-06-02T05:06:06.621 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-06-02T05:06:06.621 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-06-02T05:06:06.621 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-06-02T05:06:06.621 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-06-02T05:06:06.621 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-06-02T05:06:06.622 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.622 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.622 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.622 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.622 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.622 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.622 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.622 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.622 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.622 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.622 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.622 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.622 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.623 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.623 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.623 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.623 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.623 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.623 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.623 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-06-02T05:06:06.623 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-06-02T05:06:06.623 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.623 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.623 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.623 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.623 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.623 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.624 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.624 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.624 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.624 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.624 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.624 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.624 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-06-02T05:06:06.624 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-06-02T05:06:06.624 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.624 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.624 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.624 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-06-02T05:06:06.624 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.624 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.625 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.625 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.625 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.625 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.625 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.625 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.625 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.625 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.625 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.625 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.625 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.625 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.625 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.626 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-06-02T05:06:06.626 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-06-02T05:06:06.626 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.626 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.626 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.626 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.626 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.626 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.626 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.626 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.626 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.626 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.626 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.627 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.627 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.627 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.627 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:06.627 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "telegraf", 2024-06-02T05:06:06.627 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-06-02T05:06:06.627 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-06-02T05:06:06.627 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-06-02T05:06:06.627 INFO:teuthology.orchestra.run.smithi076.stdout: "address": { 2024-06-02T05:06:06.627 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "address", 2024-06-02T05:06:06.627 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.627 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.627 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.628 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-06-02T05:06:06.628 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.628 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.628 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.628 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.628 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.628 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.628 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.628 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.628 INFO:teuthology.orchestra.run.smithi076.stdout: "interval": { 2024-06-02T05:06:06.628 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "interval", 2024-06-02T05:06:06.628 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-06-02T05:06:06.628 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.629 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.629 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "15", 2024-06-02T05:06:06.629 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.629 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.629 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.629 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.629 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.629 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.629 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.629 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.629 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-06-02T05:06:06.629 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-06-02T05:06:06.629 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.629 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.630 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.630 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.630 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.630 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.630 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.630 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.630 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.630 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.630 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.630 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.630 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.630 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.631 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.631 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.631 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.631 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.631 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.631 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-06-02T05:06:06.631 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-06-02T05:06:06.631 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.631 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.631 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.631 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.631 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.631 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.632 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.632 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.632 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.632 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.632 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.632 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.632 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-06-02T05:06:06.632 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-06-02T05:06:06.632 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.632 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.632 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.632 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-06-02T05:06:06.632 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.633 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.633 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.633 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.633 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.633 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.633 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.633 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.633 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.633 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.633 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.633 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.633 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.633 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.634 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.634 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-06-02T05:06:06.634 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-06-02T05:06:06.634 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.634 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.634 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.634 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.634 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.634 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.634 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.634 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.634 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.635 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.635 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.635 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.635 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.635 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.635 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:06.635 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "telemetry", 2024-06-02T05:06:06.635 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-06-02T05:06:06.635 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-06-02T05:06:06.635 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-06-02T05:06:06.635 INFO:teuthology.orchestra.run.smithi076.stdout: "channel_basic": { 2024-06-02T05:06:06.635 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "channel_basic", 2024-06-02T05:06:06.635 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.635 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.636 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.636 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:06.636 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.636 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.636 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.636 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Share basic cluster information (size, version)", 2024-06-02T05:06:06.636 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.636 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.636 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.636 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.636 INFO:teuthology.orchestra.run.smithi076.stdout: "channel_crash": { 2024-06-02T05:06:06.636 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "channel_crash", 2024-06-02T05:06:06.636 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.637 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.637 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.637 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:06.637 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.637 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.637 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.637 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-06-02T05:06:06.637 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.637 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.637 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.637 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.637 INFO:teuthology.orchestra.run.smithi076.stdout: "channel_device": { 2024-06-02T05:06:06.637 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "channel_device", 2024-06-02T05:06:06.638 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.638 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.638 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.638 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:06.638 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.638 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.638 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.638 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-06-02T05:06:06.638 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.638 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.638 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.638 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.638 INFO:teuthology.orchestra.run.smithi076.stdout: "channel_ident": { 2024-06-02T05:06:06.639 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "channel_ident", 2024-06-02T05:06:06.639 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.639 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.639 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.639 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.639 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.639 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.639 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.639 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-06-02T05:06:06.639 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.639 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.639 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.639 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.640 INFO:teuthology.orchestra.run.smithi076.stdout: "channel_perf": { 2024-06-02T05:06:06.640 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "channel_perf", 2024-06-02T05:06:06.640 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.640 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.640 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.640 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.640 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.640 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.640 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.640 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Share various performance metrics of a cluster", 2024-06-02T05:06:06.640 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.640 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.640 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.640 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.641 INFO:teuthology.orchestra.run.smithi076.stdout: "contact": { 2024-06-02T05:06:06.641 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "contact", 2024-06-02T05:06:06.641 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.641 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.641 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.641 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.641 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.641 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.641 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.641 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.641 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.641 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.641 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.642 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.642 INFO:teuthology.orchestra.run.smithi076.stdout: "description": { 2024-06-02T05:06:06.642 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "description", 2024-06-02T05:06:06.642 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.642 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.642 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.642 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.642 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.642 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.642 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.642 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.642 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.642 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.643 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.643 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.643 INFO:teuthology.orchestra.run.smithi076.stdout: "device_url": { 2024-06-02T05:06:06.643 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "device_url", 2024-06-02T05:06:06.643 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.643 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.643 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.643 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-06-02T05:06:06.646 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.646 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.646 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.646 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.646 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.646 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.646 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.646 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.646 INFO:teuthology.orchestra.run.smithi076.stdout: "enabled": { 2024-06-02T05:06:06.647 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "enabled", 2024-06-02T05:06:06.647 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.647 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.647 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.647 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.647 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.647 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.647 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.647 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.647 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.647 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.647 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.648 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.648 INFO:teuthology.orchestra.run.smithi076.stdout: "interval": { 2024-06-02T05:06:06.648 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "interval", 2024-06-02T05:06:06.648 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:06.648 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.648 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.648 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "24", 2024-06-02T05:06:06.648 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "8", 2024-06-02T05:06:06.648 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.648 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.648 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.648 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.648 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.649 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.649 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.649 INFO:teuthology.orchestra.run.smithi076.stdout: "last_opt_revision": { 2024-06-02T05:06:06.649 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "last_opt_revision", 2024-06-02T05:06:06.649 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:06.649 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.649 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.649 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "1", 2024-06-02T05:06:06.649 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.649 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.649 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.649 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.649 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.650 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.650 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.650 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.650 INFO:teuthology.orchestra.run.smithi076.stdout: "leaderboard": { 2024-06-02T05:06:06.650 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "leaderboard", 2024-06-02T05:06:06.650 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.650 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.650 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.650 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.650 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.650 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.650 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.651 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.651 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.651 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.651 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.651 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.651 INFO:teuthology.orchestra.run.smithi076.stdout: "leaderboard_description": { 2024-06-02T05:06:06.651 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "leaderboard_description", 2024-06-02T05:06:06.651 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.651 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.651 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.651 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.651 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.651 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.652 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.652 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.652 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.652 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.652 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.652 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.652 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-06-02T05:06:06.652 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-06-02T05:06:06.652 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.652 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.652 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.652 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.652 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.653 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.653 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.653 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.653 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.653 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.653 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.653 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.653 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.653 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.653 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.653 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.653 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.653 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.654 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.654 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-06-02T05:06:06.654 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-06-02T05:06:06.654 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.654 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.654 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.654 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.654 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.654 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.654 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.654 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.654 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.654 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.655 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.655 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.655 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-06-02T05:06:06.655 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-06-02T05:06:06.655 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.655 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.655 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.655 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-06-02T05:06:06.655 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.655 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.655 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.655 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.656 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.656 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.656 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.656 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.656 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.656 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.656 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.656 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.656 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.656 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.656 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.656 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-06-02T05:06:06.656 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-06-02T05:06:06.656 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.657 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.657 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.657 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.657 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.657 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.657 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.657 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.657 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.657 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.657 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.657 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.657 INFO:teuthology.orchestra.run.smithi076.stdout: "organization": { 2024-06-02T05:06:06.657 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "organization", 2024-06-02T05:06:06.658 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.658 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.658 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.658 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.658 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.658 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.658 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.658 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.658 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.658 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.658 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.658 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.659 INFO:teuthology.orchestra.run.smithi076.stdout: "proxy": { 2024-06-02T05:06:06.659 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "proxy", 2024-06-02T05:06:06.659 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.659 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.659 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.659 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.659 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.659 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.659 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.659 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.659 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.659 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.659 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.660 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.660 INFO:teuthology.orchestra.run.smithi076.stdout: "url": { 2024-06-02T05:06:06.660 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "url", 2024-06-02T05:06:06.660 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.660 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.660 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.660 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-06-02T05:06:06.660 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.660 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.660 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.660 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.660 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.660 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.661 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.661 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.661 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.661 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.661 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:06.661 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "test_orchestrator", 2024-06-02T05:06:06.661 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-06-02T05:06:06.661 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-06-02T05:06:06.661 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-06-02T05:06:06.661 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-06-02T05:06:06.661 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-06-02T05:06:06.661 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.661 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.662 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.662 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.662 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.662 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.662 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.662 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.662 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.662 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.662 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.662 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.662 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.662 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.662 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.663 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.663 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.663 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.663 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.663 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-06-02T05:06:06.663 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-06-02T05:06:06.663 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.663 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.663 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.663 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.663 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.663 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.663 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.663 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.664 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.664 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.664 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.664 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.664 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-06-02T05:06:06.664 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-06-02T05:06:06.664 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.664 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.664 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.664 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-06-02T05:06:06.664 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.664 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.664 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.665 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.665 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.665 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.665 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.665 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.665 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.665 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.665 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.665 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.665 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.665 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.665 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.665 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-06-02T05:06:06.666 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-06-02T05:06:06.666 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.666 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.666 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.666 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.666 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.666 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.666 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.666 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.666 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.666 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.666 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.666 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.667 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.667 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.667 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:06.667 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "volumes", 2024-06-02T05:06:06.667 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-06-02T05:06:06.667 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-06-02T05:06:06.667 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-06-02T05:06:06.667 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-06-02T05:06:06.667 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-06-02T05:06:06.667 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.667 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.667 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.667 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.668 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.668 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.668 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.668 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.668 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.668 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.668 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.668 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.668 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.668 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.668 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.668 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.668 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.669 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.669 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.669 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-06-02T05:06:06.669 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-06-02T05:06:06.669 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.669 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.669 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.669 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.669 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.669 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.669 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.669 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.669 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.670 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.670 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.670 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.670 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-06-02T05:06:06.670 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-06-02T05:06:06.670 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.670 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.670 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.670 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-06-02T05:06:06.670 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.670 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.670 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.670 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.671 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.671 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.671 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.671 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.671 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.671 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.671 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.671 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.671 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.671 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.671 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.671 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-06-02T05:06:06.671 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-06-02T05:06:06.672 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.672 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.672 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.672 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.672 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.672 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.672 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.672 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.672 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.672 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.672 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.672 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.672 INFO:teuthology.orchestra.run.smithi076.stdout: "max_concurrent_clones": { 2024-06-02T05:06:06.673 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "max_concurrent_clones", 2024-06-02T05:06:06.673 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:06.673 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.673 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.673 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "4", 2024-06-02T05:06:06.673 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.673 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.673 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.673 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Number of asynchronous cloner threads", 2024-06-02T05:06:06.673 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.673 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.673 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.673 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.674 INFO:teuthology.orchestra.run.smithi076.stdout: "snapshot_clone_delay": { 2024-06-02T05:06:06.674 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "snapshot_clone_delay", 2024-06-02T05:06:06.674 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:06.674 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.674 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.674 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "0", 2024-06-02T05:06:06.674 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.674 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.674 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.674 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-06-02T05:06:06.674 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.674 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.674 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.675 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.675 INFO:teuthology.orchestra.run.smithi076.stdout: "snapshot_clone_no_wait": { 2024-06-02T05:06:06.675 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "snapshot_clone_no_wait", 2024-06-02T05:06:06.675 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.675 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.675 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.675 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-06-02T05:06:06.675 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.675 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.675 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.675 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-06-02T05:06:06.675 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.675 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.676 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.676 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.676 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.676 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.676 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:06.676 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "zabbix", 2024-06-02T05:06:06.676 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-06-02T05:06:06.676 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-06-02T05:06:06.676 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-06-02T05:06:06.676 INFO:teuthology.orchestra.run.smithi076.stdout: "discovery_interval": { 2024-06-02T05:06:06.676 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "discovery_interval", 2024-06-02T05:06:06.676 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "uint", 2024-06-02T05:06:06.676 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.677 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.677 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "100", 2024-06-02T05:06:06.677 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.677 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.677 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.677 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.677 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.677 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.677 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.677 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.677 INFO:teuthology.orchestra.run.smithi076.stdout: "identifier": { 2024-06-02T05:06:06.677 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "identifier", 2024-06-02T05:06:06.677 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.678 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.678 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.678 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.678 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.678 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.678 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.678 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.678 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.678 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.678 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.678 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.678 INFO:teuthology.orchestra.run.smithi076.stdout: "interval": { 2024-06-02T05:06:06.678 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "interval", 2024-06-02T05:06:06.679 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-06-02T05:06:06.679 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.679 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.679 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "60", 2024-06-02T05:06:06.679 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.679 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.679 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.679 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.679 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.679 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.679 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.679 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.679 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-06-02T05:06:06.679 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-06-02T05:06:06.680 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.680 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.680 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.680 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.680 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.680 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.680 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.680 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.680 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.680 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.680 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.680 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.680 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.681 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.681 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.681 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.681 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.681 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.681 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.681 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-06-02T05:06:06.681 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-06-02T05:06:06.681 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.681 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.681 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.681 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.682 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.682 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.682 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.682 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.682 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.682 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.682 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.682 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.682 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-06-02T05:06:06.682 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-06-02T05:06:06.682 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.682 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.682 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.683 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-06-02T05:06:06.683 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.683 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.683 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-06-02T05:06:06.683 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-06-02T05:06:06.683 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-06-02T05:06:06.683 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-06-02T05:06:06.683 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-06-02T05:06:06.683 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-06-02T05:06:06.683 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-06-02T05:06:06.683 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.683 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.683 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.684 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.684 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.684 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.684 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-06-02T05:06:06.684 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-06-02T05:06:06.684 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-06-02T05:06:06.684 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.684 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-06-02T05:06:06.684 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-06-02T05:06:06.684 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.684 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.684 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.684 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.685 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.685 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.685 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.685 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.685 INFO:teuthology.orchestra.run.smithi076.stdout: "zabbix_host": { 2024-06-02T05:06:06.685 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "zabbix_host", 2024-06-02T05:06:06.685 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.685 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.685 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.685 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-06-02T05:06:06.685 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.685 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.685 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.686 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.686 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.686 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.686 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.686 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.686 INFO:teuthology.orchestra.run.smithi076.stdout: "zabbix_port": { 2024-06-02T05:06:06.686 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "zabbix_port", 2024-06-02T05:06:06.686 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-06-02T05:06:06.686 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.686 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.686 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "10051", 2024-06-02T05:06:06.686 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.686 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.687 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.687 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.687 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.687 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.687 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.687 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.687 INFO:teuthology.orchestra.run.smithi076.stdout: "zabbix_sender": { 2024-06-02T05:06:06.687 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "zabbix_sender", 2024-06-02T05:06:06.687 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-06-02T05:06:06.687 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-06-02T05:06:06.687 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-06-02T05:06:06.687 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-06-02T05:06:06.687 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-06-02T05:06:06.688 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-06-02T05:06:06.688 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-06-02T05:06:06.688 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-06-02T05:06:06.688 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-06-02T05:06:06.688 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-06-02T05:06:06.688 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-06-02T05:06:06.688 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.688 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.688 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.688 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.688 INFO:teuthology.orchestra.run.smithi076.stdout: "services": { 2024-06-02T05:06:06.688 INFO:teuthology.orchestra.run.smithi076.stdout: "dashboard": "https://172.21.15.76:8443/" 2024-06-02T05:06:06.688 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.689 INFO:teuthology.orchestra.run.smithi076.stdout: "always_on_modules": { 2024-06-02T05:06:06.689 INFO:teuthology.orchestra.run.smithi076.stdout: "octopus": [ 2024-06-02T05:06:06.689 INFO:teuthology.orchestra.run.smithi076.stdout: "balancer", 2024-06-02T05:06:06.689 INFO:teuthology.orchestra.run.smithi076.stdout: "crash", 2024-06-02T05:06:06.689 INFO:teuthology.orchestra.run.smithi076.stdout: "devicehealth", 2024-06-02T05:06:06.689 INFO:teuthology.orchestra.run.smithi076.stdout: "orchestrator", 2024-06-02T05:06:06.689 INFO:teuthology.orchestra.run.smithi076.stdout: "pg_autoscaler", 2024-06-02T05:06:06.689 INFO:teuthology.orchestra.run.smithi076.stdout: "progress", 2024-06-02T05:06:06.689 INFO:teuthology.orchestra.run.smithi076.stdout: "rbd_support", 2024-06-02T05:06:06.689 INFO:teuthology.orchestra.run.smithi076.stdout: "status", 2024-06-02T05:06:06.689 INFO:teuthology.orchestra.run.smithi076.stdout: "telemetry", 2024-06-02T05:06:06.689 INFO:teuthology.orchestra.run.smithi076.stdout: "volumes" 2024-06-02T05:06:06.689 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.690 INFO:teuthology.orchestra.run.smithi076.stdout: "pacific": [ 2024-06-02T05:06:06.690 INFO:teuthology.orchestra.run.smithi076.stdout: "balancer", 2024-06-02T05:06:06.690 INFO:teuthology.orchestra.run.smithi076.stdout: "crash", 2024-06-02T05:06:06.690 INFO:teuthology.orchestra.run.smithi076.stdout: "devicehealth", 2024-06-02T05:06:06.690 INFO:teuthology.orchestra.run.smithi076.stdout: "orchestrator", 2024-06-02T05:06:06.690 INFO:teuthology.orchestra.run.smithi076.stdout: "pg_autoscaler", 2024-06-02T05:06:06.690 INFO:teuthology.orchestra.run.smithi076.stdout: "progress", 2024-06-02T05:06:06.690 INFO:teuthology.orchestra.run.smithi076.stdout: "rbd_support", 2024-06-02T05:06:06.690 INFO:teuthology.orchestra.run.smithi076.stdout: "status", 2024-06-02T05:06:06.690 INFO:teuthology.orchestra.run.smithi076.stdout: "telemetry", 2024-06-02T05:06:06.690 INFO:teuthology.orchestra.run.smithi076.stdout: "volumes" 2024-06-02T05:06:06.690 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.690 INFO:teuthology.orchestra.run.smithi076.stdout: "quincy": [ 2024-06-02T05:06:06.691 INFO:teuthology.orchestra.run.smithi076.stdout: "balancer", 2024-06-02T05:06:06.691 INFO:teuthology.orchestra.run.smithi076.stdout: "crash", 2024-06-02T05:06:06.691 INFO:teuthology.orchestra.run.smithi076.stdout: "devicehealth", 2024-06-02T05:06:06.691 INFO:teuthology.orchestra.run.smithi076.stdout: "orchestrator", 2024-06-02T05:06:06.691 INFO:teuthology.orchestra.run.smithi076.stdout: "pg_autoscaler", 2024-06-02T05:06:06.691 INFO:teuthology.orchestra.run.smithi076.stdout: "progress", 2024-06-02T05:06:06.691 INFO:teuthology.orchestra.run.smithi076.stdout: "rbd_support", 2024-06-02T05:06:06.691 INFO:teuthology.orchestra.run.smithi076.stdout: "status", 2024-06-02T05:06:06.691 INFO:teuthology.orchestra.run.smithi076.stdout: "telemetry", 2024-06-02T05:06:06.691 INFO:teuthology.orchestra.run.smithi076.stdout: "volumes" 2024-06-02T05:06:06.691 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-06-02T05:06:06.691 INFO:teuthology.orchestra.run.smithi076.stdout: "reef": [ 2024-06-02T05:06:06.691 INFO:teuthology.orchestra.run.smithi076.stdout: "balancer", 2024-06-02T05:06:06.691 INFO:teuthology.orchestra.run.smithi076.stdout: "crash", 2024-06-02T05:06:06.692 INFO:teuthology.orchestra.run.smithi076.stdout: "devicehealth", 2024-06-02T05:06:06.692 INFO:teuthology.orchestra.run.smithi076.stdout: "orchestrator", 2024-06-02T05:06:06.692 INFO:teuthology.orchestra.run.smithi076.stdout: "pg_autoscaler", 2024-06-02T05:06:06.692 INFO:teuthology.orchestra.run.smithi076.stdout: "progress", 2024-06-02T05:06:06.692 INFO:teuthology.orchestra.run.smithi076.stdout: "rbd_support", 2024-06-02T05:06:06.692 INFO:teuthology.orchestra.run.smithi076.stdout: "status", 2024-06-02T05:06:06.692 INFO:teuthology.orchestra.run.smithi076.stdout: "telemetry", 2024-06-02T05:06:06.692 INFO:teuthology.orchestra.run.smithi076.stdout: "volumes" 2024-06-02T05:06:06.692 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-06-02T05:06:06.692 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.692 INFO:teuthology.orchestra.run.smithi076.stdout: "last_failure_osd_epoch": 3, 2024-06-02T05:06:06.692 INFO:teuthology.orchestra.run.smithi076.stdout: "active_clients": [ 2024-06-02T05:06:06.693 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:06.693 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "devicehealth", 2024-06-02T05:06:06.693 INFO:teuthology.orchestra.run.smithi076.stdout: "addrvec": [ 2024-06-02T05:06:06.693 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:06.693 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "v2", 2024-06-02T05:06:06.693 INFO:teuthology.orchestra.run.smithi076.stdout: "addr": "172.21.15.76:0", 2024-06-02T05:06:06.693 INFO:teuthology.orchestra.run.smithi076.stdout: "nonce": 2276422207 2024-06-02T05:06:06.693 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.693 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-06-02T05:06:06.693 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.693 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:06.693 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "libcephsqlite", 2024-06-02T05:06:06.693 INFO:teuthology.orchestra.run.smithi076.stdout: "addrvec": [ 2024-06-02T05:06:06.694 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:06.694 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "v2", 2024-06-02T05:06:06.694 INFO:teuthology.orchestra.run.smithi076.stdout: "addr": "172.21.15.76:0", 2024-06-02T05:06:06.694 INFO:teuthology.orchestra.run.smithi076.stdout: "nonce": 1431580528 2024-06-02T05:06:06.694 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.694 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-06-02T05:06:06.694 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.694 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:06.694 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "rbd_support", 2024-06-02T05:06:06.694 INFO:teuthology.orchestra.run.smithi076.stdout: "addrvec": [ 2024-06-02T05:06:06.694 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:06.694 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "v2", 2024-06-02T05:06:06.694 INFO:teuthology.orchestra.run.smithi076.stdout: "addr": "172.21.15.76:0", 2024-06-02T05:06:06.695 INFO:teuthology.orchestra.run.smithi076.stdout: "nonce": 2236182587 2024-06-02T05:06:06.695 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.695 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-06-02T05:06:06.695 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:06.695 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:06.695 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "volumes", 2024-06-02T05:06:06.695 INFO:teuthology.orchestra.run.smithi076.stdout: "addrvec": [ 2024-06-02T05:06:06.695 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-06-02T05:06:06.695 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "v2", 2024-06-02T05:06:06.695 INFO:teuthology.orchestra.run.smithi076.stdout: "addr": "172.21.15.76:0", 2024-06-02T05:06:06.695 INFO:teuthology.orchestra.run.smithi076.stdout: "nonce": 1161729051 2024-06-02T05:06:06.695 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.695 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-06-02T05:06:06.696 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:06.696 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-06-02T05:06:06.696 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-06-02T05:06:06.697 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:06:05 smithi192 ceph-mon[47933]: pgmap v763: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 8.9 MiB/s wr, 917 op/s 2024-06-02T05:06:06.697 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:06:05 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/2139140748' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-06-02T05:06:06.697 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:06:05 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/693750534' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-06-02T05:06:06.698 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:06:04 smithi119 ceph-mon[46633]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-06-02T05:06:06.698 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:06:04 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/1804401277' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-06-02T05:06:06.698 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:06:04 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/2591404880' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-06-02T05:06:06.698 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:06:05 smithi119 ceph-mon[46633]: pgmap v763: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 8.9 MiB/s wr, 917 op/s 2024-06-02T05:06:06.698 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:06:05 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/2139140748' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-06-02T05:06:06.698 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:06:05 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/693750534' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-06-02T05:06:06.699 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:05.302+0000 7f74222e9700 1 -- 172.21.15.76:0/693750534 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f74040a1120 msgr2=0x7f74040a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:06:06.699 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:05.302+0000 7f74222e9700 1 --2- 172.21.15.76:0/693750534 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f74040a1120 0x7f74040a35e0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f7410005fd0 tx=0x7f7410005e60 comp rx=0 tx=0).stop 2024-06-02T05:06:06.699 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:05.302+0000 7f74222e9700 1 -- 172.21.15.76:0/693750534 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f741c100f50 msgr2=0x7f741c199330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:06:06.699 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:05.302+0000 7f74222e9700 1 --2- 172.21.15.76:0/693750534 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f741c100f50 0x7f741c199330 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f740c0098e0 tx=0x7f740c003b80 comp rx=0 tx=0).stop 2024-06-02T05:06:06.699 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:05.302+0000 7f74222e9700 1 -- 172.21.15.76:0/693750534 shutdown_connections 2024-06-02T05:06:06.699 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:05.302+0000 7f74222e9700 1 --2- 172.21.15.76:0/693750534 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f741c1018f0 0x7f741c1a0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:06.699 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:05.302+0000 7f74222e9700 1 --2- 172.21.15.76:0/693750534 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f74040a1120 0x7f74040a35e0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:06.699 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:05.302+0000 7f74222e9700 1 --2- 172.21.15.76:0/693750534 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f741c0ffd60 0x7f741c198df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:06.699 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:05.302+0000 7f74222e9700 1 --2- 172.21.15.76:0/693750534 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f741c100f50 0x7f741c199330 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:06.700 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:05.302+0000 7f74222e9700 1 -- 172.21.15.76:0/693750534 >> 172.21.15.76:0/693750534 conn(0x7f741c0fb2f0 msgr2=0x7f741c0fb920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:06:06.700 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:05.302+0000 7f74222e9700 1 -- 172.21.15.76:0/693750534 shutdown_connections 2024-06-02T05:06:06.700 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:05.302+0000 7f74222e9700 1 -- 172.21.15.76:0/693750534 wait complete. 2024-06-02T05:06:06.706 DEBUG:tasks.check_counter:Getting stats from a 2024-06-02T05:06:06.706 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell --fsid 60ab6d30-209a-11ef-bc9b-c7b262605968 -- ceph daemon mds.a perf dump 2024-06-02T05:06:06.706 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:06:05 smithi076 ceph-mon[42935]: pgmap v763: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 8.9 MiB/s wr, 917 op/s 2024-06-02T05:06:06.706 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:06:05 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/2139140748' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-06-02T05:06:06.706 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:06:05 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/693750534' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-06-02T05:06:07.066 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T05:06:08.159 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-06-02T05:06:08.159 INFO:teuthology.orchestra.run.smithi076.stdout: "AsyncMessenger::Worker-0": { 2024-06-02T05:06:08.159 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_recv_messages": 299, 2024-06-02T05:06:08.159 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_send_messages": 294, 2024-06-02T05:06:08.159 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_recv_bytes": 497152, 2024-06-02T05:06:08.159 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_send_bytes": 167504, 2024-06-02T05:06:08.160 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_created_connections": 4, 2024-06-02T05:06:08.160 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_active_connections": 0, 2024-06-02T05:06:08.160 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_running_total_time": 0.039488996, 2024-06-02T05:06:08.160 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_running_send_time": 0.015915660, 2024-06-02T05:06:08.160 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_running_recv_time": 0.014522673, 2024-06-02T05:06:08.160 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_running_fast_dispatch_time": 0.006645352, 2024-06-02T05:06:08.160 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T05:06:08.161 INFO:teuthology.orchestra.run.smithi076.stdout: "avgcount": 294, 2024-06-02T05:06:08.161 INFO:teuthology.orchestra.run.smithi076.stdout: "sum": 0.048903278, 2024-06-02T05:06:08.161 INFO:teuthology.orchestra.run.smithi076.stdout: "avgtime": 0.000166337 2024-06-02T05:06:08.161 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:08.161 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_handle_ack_lat": { 2024-06-02T05:06:08.161 INFO:teuthology.orchestra.run.smithi076.stdout: "avgcount": 0, 2024-06-02T05:06:08.161 INFO:teuthology.orchestra.run.smithi076.stdout: "sum": 0.000000000, 2024-06-02T05:06:08.161 INFO:teuthology.orchestra.run.smithi076.stdout: "avgtime": 0.000000000 2024-06-02T05:06:08.161 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:08.162 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_recv_encrypted_bytes": 497152, 2024-06-02T05:06:08.162 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_send_encrypted_bytes": 167504 2024-06-02T05:06:08.162 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:08.162 INFO:teuthology.orchestra.run.smithi076.stdout: "AsyncMessenger::Worker-1": { 2024-06-02T05:06:08.162 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_recv_messages": 2, 2024-06-02T05:06:08.162 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_send_messages": 223, 2024-06-02T05:06:08.162 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_recv_bytes": 320, 2024-06-02T05:06:08.163 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_send_bytes": 191664, 2024-06-02T05:06:08.163 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_created_connections": 4, 2024-06-02T05:06:08.163 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_active_connections": 2, 2024-06-02T05:06:08.163 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_running_total_time": 0.014858395, 2024-06-02T05:06:08.163 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_running_send_time": 0.011252404, 2024-06-02T05:06:08.163 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_running_recv_time": 0.002018010, 2024-06-02T05:06:08.163 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-06-02T05:06:08.163 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T05:06:08.164 INFO:teuthology.orchestra.run.smithi076.stdout: "avgcount": 221, 2024-06-02T05:06:08.164 INFO:teuthology.orchestra.run.smithi076.stdout: "sum": 0.045785368, 2024-06-02T05:06:08.164 INFO:teuthology.orchestra.run.smithi076.stdout: "avgtime": 0.000207173 2024-06-02T05:06:08.164 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:08.164 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_handle_ack_lat": { 2024-06-02T05:06:08.164 INFO:teuthology.orchestra.run.smithi076.stdout: "avgcount": 0, 2024-06-02T05:06:08.164 INFO:teuthology.orchestra.run.smithi076.stdout: "sum": 0.000000000, 2024-06-02T05:06:08.164 INFO:teuthology.orchestra.run.smithi076.stdout: "avgtime": 0.000000000 2024-06-02T05:06:08.164 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:08.165 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_recv_encrypted_bytes": 320, 2024-06-02T05:06:08.165 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_send_encrypted_bytes": 191664 2024-06-02T05:06:08.165 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:08.165 INFO:teuthology.orchestra.run.smithi076.stdout: "AsyncMessenger::Worker-2": { 2024-06-02T05:06:08.165 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_recv_messages": 0, 2024-06-02T05:06:08.165 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_send_messages": 2, 2024-06-02T05:06:08.165 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_recv_bytes": 0, 2024-06-02T05:06:08.165 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_send_bytes": 0, 2024-06-02T05:06:08.165 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_created_connections": 2, 2024-06-02T05:06:08.165 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_active_connections": 1, 2024-06-02T05:06:08.165 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_running_total_time": 0.000251021, 2024-06-02T05:06:08.165 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_running_send_time": 0.000000000, 2024-06-02T05:06:08.165 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_running_recv_time": 0.000158271, 2024-06-02T05:06:08.166 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-06-02T05:06:08.166 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T05:06:08.166 INFO:teuthology.orchestra.run.smithi076.stdout: "avgcount": 0, 2024-06-02T05:06:08.166 INFO:teuthology.orchestra.run.smithi076.stdout: "sum": 0.000000000, 2024-06-02T05:06:08.166 INFO:teuthology.orchestra.run.smithi076.stdout: "avgtime": 0.000000000 2024-06-02T05:06:08.166 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:08.166 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_handle_ack_lat": { 2024-06-02T05:06:08.166 INFO:teuthology.orchestra.run.smithi076.stdout: "avgcount": 0, 2024-06-02T05:06:08.166 INFO:teuthology.orchestra.run.smithi076.stdout: "sum": 0.000000000, 2024-06-02T05:06:08.166 INFO:teuthology.orchestra.run.smithi076.stdout: "avgtime": 0.000000000 2024-06-02T05:06:08.167 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:08.167 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_recv_encrypted_bytes": 0, 2024-06-02T05:06:08.167 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_send_encrypted_bytes": 0 2024-06-02T05:06:08.167 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:08.167 INFO:teuthology.orchestra.run.smithi076.stdout: "cct": { 2024-06-02T05:06:08.167 INFO:teuthology.orchestra.run.smithi076.stdout: "total_workers": 0, 2024-06-02T05:06:08.167 INFO:teuthology.orchestra.run.smithi076.stdout: "unhealthy_workers": 0 2024-06-02T05:06:08.167 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:08.167 INFO:teuthology.orchestra.run.smithi076.stdout: "mempool": { 2024-06-02T05:06:08.167 INFO:teuthology.orchestra.run.smithi076.stdout: "bloom_filter_bytes": 0, 2024-06-02T05:06:08.167 INFO:teuthology.orchestra.run.smithi076.stdout: "bloom_filter_items": 0, 2024-06-02T05:06:08.167 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_alloc_bytes": 0, 2024-06-02T05:06:08.167 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_alloc_items": 0, 2024-06-02T05:06:08.168 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_cache_data_bytes": 0, 2024-06-02T05:06:08.168 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_cache_data_items": 0, 2024-06-02T05:06:08.168 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_cache_onode_bytes": 0, 2024-06-02T05:06:08.168 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_cache_onode_items": 0, 2024-06-02T05:06:08.168 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_cache_meta_bytes": 0, 2024-06-02T05:06:08.168 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_cache_meta_items": 0, 2024-06-02T05:06:08.168 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_cache_other_bytes": 0, 2024-06-02T05:06:08.168 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_cache_other_items": 0, 2024-06-02T05:06:08.168 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_cache_buffer_bytes": 0, 2024-06-02T05:06:08.168 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_cache_buffer_items": 0, 2024-06-02T05:06:08.169 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_extent_bytes": 0, 2024-06-02T05:06:08.169 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_extent_items": 0, 2024-06-02T05:06:08.169 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_blob_bytes": 0, 2024-06-02T05:06:08.169 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_blob_items": 0, 2024-06-02T05:06:08.169 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_shared_blob_bytes": 0, 2024-06-02T05:06:08.169 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_shared_blob_items": 0, 2024-06-02T05:06:08.169 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_inline_bl_bytes": 0, 2024-06-02T05:06:08.169 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_inline_bl_items": 0, 2024-06-02T05:06:08.169 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_fsck_bytes": 0, 2024-06-02T05:06:08.169 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_fsck_items": 0, 2024-06-02T05:06:08.169 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_txc_bytes": 0, 2024-06-02T05:06:08.169 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_txc_items": 0, 2024-06-02T05:06:08.169 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_writing_deferred_bytes": 0, 2024-06-02T05:06:08.169 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_writing_deferred_items": 0, 2024-06-02T05:06:08.170 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_writing_bytes": 0, 2024-06-02T05:06:08.170 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_writing_items": 0, 2024-06-02T05:06:08.170 INFO:teuthology.orchestra.run.smithi076.stdout: "bluefs_bytes": 0, 2024-06-02T05:06:08.170 INFO:teuthology.orchestra.run.smithi076.stdout: "bluefs_items": 0, 2024-06-02T05:06:08.170 INFO:teuthology.orchestra.run.smithi076.stdout: "bluefs_file_reader_bytes": 0, 2024-06-02T05:06:08.170 INFO:teuthology.orchestra.run.smithi076.stdout: "bluefs_file_reader_items": 0, 2024-06-02T05:06:08.170 INFO:teuthology.orchestra.run.smithi076.stdout: "bluefs_file_writer_bytes": 0, 2024-06-02T05:06:08.170 INFO:teuthology.orchestra.run.smithi076.stdout: "bluefs_file_writer_items": 0, 2024-06-02T05:06:08.170 INFO:teuthology.orchestra.run.smithi076.stdout: "buffer_anon_bytes": 148744, 2024-06-02T05:06:08.170 INFO:teuthology.orchestra.run.smithi076.stdout: "buffer_anon_items": 30, 2024-06-02T05:06:08.170 INFO:teuthology.orchestra.run.smithi076.stdout: "buffer_meta_bytes": 0, 2024-06-02T05:06:08.170 INFO:teuthology.orchestra.run.smithi076.stdout: "buffer_meta_items": 0, 2024-06-02T05:06:08.171 INFO:teuthology.orchestra.run.smithi076.stdout: "osd_bytes": 0, 2024-06-02T05:06:08.171 INFO:teuthology.orchestra.run.smithi076.stdout: "osd_items": 0, 2024-06-02T05:06:08.171 INFO:teuthology.orchestra.run.smithi076.stdout: "osd_mapbl_bytes": 0, 2024-06-02T05:06:08.171 INFO:teuthology.orchestra.run.smithi076.stdout: "osd_mapbl_items": 0, 2024-06-02T05:06:08.171 INFO:teuthology.orchestra.run.smithi076.stdout: "osd_pglog_bytes": 0, 2024-06-02T05:06:08.171 INFO:teuthology.orchestra.run.smithi076.stdout: "osd_pglog_items": 0, 2024-06-02T05:06:08.171 INFO:teuthology.orchestra.run.smithi076.stdout: "osdmap_bytes": 0, 2024-06-02T05:06:08.171 INFO:teuthology.orchestra.run.smithi076.stdout: "osdmap_items": 0, 2024-06-02T05:06:08.171 INFO:teuthology.orchestra.run.smithi076.stdout: "osdmap_mapping_bytes": 0, 2024-06-02T05:06:08.171 INFO:teuthology.orchestra.run.smithi076.stdout: "osdmap_mapping_items": 0, 2024-06-02T05:06:08.171 INFO:teuthology.orchestra.run.smithi076.stdout: "pgmap_bytes": 0, 2024-06-02T05:06:08.171 INFO:teuthology.orchestra.run.smithi076.stdout: "pgmap_items": 0, 2024-06-02T05:06:08.171 INFO:teuthology.orchestra.run.smithi076.stdout: "mds_co_bytes": 928, 2024-06-02T05:06:08.171 INFO:teuthology.orchestra.run.smithi076.stdout: "mds_co_items": 2, 2024-06-02T05:06:08.172 INFO:teuthology.orchestra.run.smithi076.stdout: "unittest_1_bytes": 0, 2024-06-02T05:06:08.172 INFO:teuthology.orchestra.run.smithi076.stdout: "unittest_1_items": 0, 2024-06-02T05:06:08.172 INFO:teuthology.orchestra.run.smithi076.stdout: "unittest_2_bytes": 0, 2024-06-02T05:06:08.172 INFO:teuthology.orchestra.run.smithi076.stdout: "unittest_2_items": 0 2024-06-02T05:06:08.172 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:08.172 INFO:teuthology.orchestra.run.smithi076.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-06-02T05:06:08.172 INFO:teuthology.orchestra.run.smithi076.stdout: "val": 0, 2024-06-02T05:06:08.173 INFO:teuthology.orchestra.run.smithi076.stdout: "max": 104857600, 2024-06-02T05:06:08.173 INFO:teuthology.orchestra.run.smithi076.stdout: "get_started": 0, 2024-06-02T05:06:08.173 INFO:teuthology.orchestra.run.smithi076.stdout: "get": 297, 2024-06-02T05:06:08.173 INFO:teuthology.orchestra.run.smithi076.stdout: "get_sum": 452535, 2024-06-02T05:06:08.173 INFO:teuthology.orchestra.run.smithi076.stdout: "get_or_fail_fail": 0, 2024-06-02T05:06:08.173 INFO:teuthology.orchestra.run.smithi076.stdout: "get_or_fail_success": 297, 2024-06-02T05:06:08.173 INFO:teuthology.orchestra.run.smithi076.stdout: "take": 0, 2024-06-02T05:06:08.173 INFO:teuthology.orchestra.run.smithi076.stdout: "take_sum": 0, 2024-06-02T05:06:08.173 INFO:teuthology.orchestra.run.smithi076.stdout: "put": 297, 2024-06-02T05:06:08.174 INFO:teuthology.orchestra.run.smithi076.stdout: "put_sum": 452535, 2024-06-02T05:06:08.174 INFO:teuthology.orchestra.run.smithi076.stdout: "wait": { 2024-06-02T05:06:08.174 INFO:teuthology.orchestra.run.smithi076.stdout: "avgcount": 0, 2024-06-02T05:06:08.174 INFO:teuthology.orchestra.run.smithi076.stdout: "sum": 0.000000000, 2024-06-02T05:06:08.174 INFO:teuthology.orchestra.run.smithi076.stdout: "avgtime": 0.000000000 2024-06-02T05:06:08.174 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:08.174 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:08.174 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-06-02T05:06:08.181 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:06:07 smithi076 ceph-mon[42935]: pgmap v764: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 7.8 MiB/s wr, 835 op/s 2024-06-02T05:06:08.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:06:07 smithi192 ceph-mon[47933]: pgmap v764: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 7.8 MiB/s wr, 835 op/s 2024-06-02T05:06:08.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:06:07 smithi119 ceph-mon[46633]: pgmap v764: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 7.8 MiB/s wr, 835 op/s 2024-06-02T05:06:08.525 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.a 2024-06-02T05:06:08.525 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.a 2024-06-02T05:06:08.525 DEBUG:tasks.check_counter:Getting stats from d 2024-06-02T05:06:08.526 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell --fsid 60ab6d30-209a-11ef-bc9b-c7b262605968 -- ceph daemon mds.d perf dump 2024-06-02T05:06:08.751 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T05:06:09.761 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-06-02T05:06:09.761 INFO:teuthology.orchestra.run.smithi076.stdout: "AsyncMessenger::Worker-0": { 2024-06-02T05:06:09.761 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_recv_messages": 4, 2024-06-02T05:06:09.761 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_send_messages": 4, 2024-06-02T05:06:09.761 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_recv_bytes": 2912, 2024-06-02T05:06:09.761 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_send_bytes": 448, 2024-06-02T05:06:09.762 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_created_connections": 4, 2024-06-02T05:06:09.762 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_active_connections": 0, 2024-06-02T05:06:09.762 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_running_total_time": 0.001641462, 2024-06-02T05:06:09.762 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_running_send_time": 0.000037598, 2024-06-02T05:06:09.762 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_running_recv_time": 0.000626188, 2024-06-02T05:06:09.762 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-06-02T05:06:09.762 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T05:06:09.762 INFO:teuthology.orchestra.run.smithi076.stdout: "avgcount": 3, 2024-06-02T05:06:09.762 INFO:teuthology.orchestra.run.smithi076.stdout: "sum": 0.000705285, 2024-06-02T05:06:09.762 INFO:teuthology.orchestra.run.smithi076.stdout: "avgtime": 0.000235095 2024-06-02T05:06:09.762 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:09.763 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_handle_ack_lat": { 2024-06-02T05:06:09.763 INFO:teuthology.orchestra.run.smithi076.stdout: "avgcount": 0, 2024-06-02T05:06:09.763 INFO:teuthology.orchestra.run.smithi076.stdout: "sum": 0.000000000, 2024-06-02T05:06:09.763 INFO:teuthology.orchestra.run.smithi076.stdout: "avgtime": 0.000000000 2024-06-02T05:06:09.763 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:09.763 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_recv_encrypted_bytes": 2912, 2024-06-02T05:06:09.763 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_send_encrypted_bytes": 448 2024-06-02T05:06:09.763 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:09.763 INFO:teuthology.orchestra.run.smithi076.stdout: "AsyncMessenger::Worker-1": { 2024-06-02T05:06:09.763 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_recv_messages": 2, 2024-06-02T05:06:09.763 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_send_messages": 226, 2024-06-02T05:06:09.763 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_recv_bytes": 320, 2024-06-02T05:06:09.763 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_send_bytes": 192192, 2024-06-02T05:06:09.764 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_created_connections": 4, 2024-06-02T05:06:09.764 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_active_connections": 2, 2024-06-02T05:06:09.764 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_running_total_time": 0.014555180, 2024-06-02T05:06:09.764 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_running_send_time": 0.011371007, 2024-06-02T05:06:09.764 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_running_recv_time": 0.001525721, 2024-06-02T05:06:09.764 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-06-02T05:06:09.764 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T05:06:09.764 INFO:teuthology.orchestra.run.smithi076.stdout: "avgcount": 224, 2024-06-02T05:06:09.764 INFO:teuthology.orchestra.run.smithi076.stdout: "sum": 0.058849698, 2024-06-02T05:06:09.764 INFO:teuthology.orchestra.run.smithi076.stdout: "avgtime": 0.000262721 2024-06-02T05:06:09.764 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:09.764 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_handle_ack_lat": { 2024-06-02T05:06:09.764 INFO:teuthology.orchestra.run.smithi076.stdout: "avgcount": 0, 2024-06-02T05:06:09.765 INFO:teuthology.orchestra.run.smithi076.stdout: "sum": 0.000000000, 2024-06-02T05:06:09.765 INFO:teuthology.orchestra.run.smithi076.stdout: "avgtime": 0.000000000 2024-06-02T05:06:09.765 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:09.765 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_recv_encrypted_bytes": 320, 2024-06-02T05:06:09.765 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_send_encrypted_bytes": 192192 2024-06-02T05:06:09.765 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:09.765 INFO:teuthology.orchestra.run.smithi076.stdout: "AsyncMessenger::Worker-2": { 2024-06-02T05:06:09.765 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_recv_messages": 298, 2024-06-02T05:06:09.765 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_send_messages": 295, 2024-06-02T05:06:09.765 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_recv_bytes": 495056, 2024-06-02T05:06:09.765 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_send_bytes": 168832, 2024-06-02T05:06:09.765 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_created_connections": 2, 2024-06-02T05:06:09.765 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_active_connections": 1, 2024-06-02T05:06:09.766 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_running_total_time": 0.039800451, 2024-06-02T05:06:09.766 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_running_send_time": 0.016057235, 2024-06-02T05:06:09.766 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_running_recv_time": 0.016293633, 2024-06-02T05:06:09.766 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_running_fast_dispatch_time": 0.006750150, 2024-06-02T05:06:09.766 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T05:06:09.766 INFO:teuthology.orchestra.run.smithi076.stdout: "avgcount": 294, 2024-06-02T05:06:09.766 INFO:teuthology.orchestra.run.smithi076.stdout: "sum": 0.057981646, 2024-06-02T05:06:09.766 INFO:teuthology.orchestra.run.smithi076.stdout: "avgtime": 0.000197216 2024-06-02T05:06:09.766 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:09.766 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_handle_ack_lat": { 2024-06-02T05:06:09.766 INFO:teuthology.orchestra.run.smithi076.stdout: "avgcount": 0, 2024-06-02T05:06:09.766 INFO:teuthology.orchestra.run.smithi076.stdout: "sum": 0.000000000, 2024-06-02T05:06:09.766 INFO:teuthology.orchestra.run.smithi076.stdout: "avgtime": 0.000000000 2024-06-02T05:06:09.767 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:09.767 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_recv_encrypted_bytes": 495056, 2024-06-02T05:06:09.767 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_send_encrypted_bytes": 168832 2024-06-02T05:06:09.767 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:09.767 INFO:teuthology.orchestra.run.smithi076.stdout: "cct": { 2024-06-02T05:06:09.767 INFO:teuthology.orchestra.run.smithi076.stdout: "total_workers": 0, 2024-06-02T05:06:09.767 INFO:teuthology.orchestra.run.smithi076.stdout: "unhealthy_workers": 0 2024-06-02T05:06:09.767 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:09.767 INFO:teuthology.orchestra.run.smithi076.stdout: "mempool": { 2024-06-02T05:06:09.767 INFO:teuthology.orchestra.run.smithi076.stdout: "bloom_filter_bytes": 0, 2024-06-02T05:06:09.767 INFO:teuthology.orchestra.run.smithi076.stdout: "bloom_filter_items": 0, 2024-06-02T05:06:09.767 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_alloc_bytes": 0, 2024-06-02T05:06:09.767 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_alloc_items": 0, 2024-06-02T05:06:09.768 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_cache_data_bytes": 0, 2024-06-02T05:06:09.768 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_cache_data_items": 0, 2024-06-02T05:06:09.768 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_cache_onode_bytes": 0, 2024-06-02T05:06:09.768 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_cache_onode_items": 0, 2024-06-02T05:06:09.768 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_cache_meta_bytes": 0, 2024-06-02T05:06:09.768 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_cache_meta_items": 0, 2024-06-02T05:06:09.768 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_cache_other_bytes": 0, 2024-06-02T05:06:09.768 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_cache_other_items": 0, 2024-06-02T05:06:09.768 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_cache_buffer_bytes": 0, 2024-06-02T05:06:09.768 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_cache_buffer_items": 0, 2024-06-02T05:06:09.768 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_extent_bytes": 0, 2024-06-02T05:06:09.768 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_extent_items": 0, 2024-06-02T05:06:09.768 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_blob_bytes": 0, 2024-06-02T05:06:09.768 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_blob_items": 0, 2024-06-02T05:06:09.769 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_shared_blob_bytes": 0, 2024-06-02T05:06:09.769 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_shared_blob_items": 0, 2024-06-02T05:06:09.769 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_inline_bl_bytes": 0, 2024-06-02T05:06:09.769 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_inline_bl_items": 0, 2024-06-02T05:06:09.769 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_fsck_bytes": 0, 2024-06-02T05:06:09.769 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_fsck_items": 0, 2024-06-02T05:06:09.769 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_txc_bytes": 0, 2024-06-02T05:06:09.769 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_txc_items": 0, 2024-06-02T05:06:09.769 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_writing_deferred_bytes": 0, 2024-06-02T05:06:09.769 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_writing_deferred_items": 0, 2024-06-02T05:06:09.769 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_writing_bytes": 0, 2024-06-02T05:06:09.769 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_writing_items": 0, 2024-06-02T05:06:09.769 INFO:teuthology.orchestra.run.smithi076.stdout: "bluefs_bytes": 0, 2024-06-02T05:06:09.770 INFO:teuthology.orchestra.run.smithi076.stdout: "bluefs_items": 0, 2024-06-02T05:06:09.770 INFO:teuthology.orchestra.run.smithi076.stdout: "bluefs_file_reader_bytes": 0, 2024-06-02T05:06:09.770 INFO:teuthology.orchestra.run.smithi076.stdout: "bluefs_file_reader_items": 0, 2024-06-02T05:06:09.770 INFO:teuthology.orchestra.run.smithi076.stdout: "bluefs_file_writer_bytes": 0, 2024-06-02T05:06:09.770 INFO:teuthology.orchestra.run.smithi076.stdout: "bluefs_file_writer_items": 0, 2024-06-02T05:06:09.770 INFO:teuthology.orchestra.run.smithi076.stdout: "buffer_anon_bytes": 148744, 2024-06-02T05:06:09.770 INFO:teuthology.orchestra.run.smithi076.stdout: "buffer_anon_items": 30, 2024-06-02T05:06:09.770 INFO:teuthology.orchestra.run.smithi076.stdout: "buffer_meta_bytes": 0, 2024-06-02T05:06:09.770 INFO:teuthology.orchestra.run.smithi076.stdout: "buffer_meta_items": 0, 2024-06-02T05:06:09.770 INFO:teuthology.orchestra.run.smithi076.stdout: "osd_bytes": 0, 2024-06-02T05:06:09.770 INFO:teuthology.orchestra.run.smithi076.stdout: "osd_items": 0, 2024-06-02T05:06:09.770 INFO:teuthology.orchestra.run.smithi076.stdout: "osd_mapbl_bytes": 0, 2024-06-02T05:06:09.770 INFO:teuthology.orchestra.run.smithi076.stdout: "osd_mapbl_items": 0, 2024-06-02T05:06:09.770 INFO:teuthology.orchestra.run.smithi076.stdout: "osd_pglog_bytes": 0, 2024-06-02T05:06:09.771 INFO:teuthology.orchestra.run.smithi076.stdout: "osd_pglog_items": 0, 2024-06-02T05:06:09.771 INFO:teuthology.orchestra.run.smithi076.stdout: "osdmap_bytes": 0, 2024-06-02T05:06:09.771 INFO:teuthology.orchestra.run.smithi076.stdout: "osdmap_items": 0, 2024-06-02T05:06:09.771 INFO:teuthology.orchestra.run.smithi076.stdout: "osdmap_mapping_bytes": 0, 2024-06-02T05:06:09.771 INFO:teuthology.orchestra.run.smithi076.stdout: "osdmap_mapping_items": 0, 2024-06-02T05:06:09.771 INFO:teuthology.orchestra.run.smithi076.stdout: "pgmap_bytes": 0, 2024-06-02T05:06:09.771 INFO:teuthology.orchestra.run.smithi076.stdout: "pgmap_items": 0, 2024-06-02T05:06:09.771 INFO:teuthology.orchestra.run.smithi076.stdout: "mds_co_bytes": 928, 2024-06-02T05:06:09.771 INFO:teuthology.orchestra.run.smithi076.stdout: "mds_co_items": 2, 2024-06-02T05:06:09.771 INFO:teuthology.orchestra.run.smithi076.stdout: "unittest_1_bytes": 0, 2024-06-02T05:06:09.771 INFO:teuthology.orchestra.run.smithi076.stdout: "unittest_1_items": 0, 2024-06-02T05:06:09.771 INFO:teuthology.orchestra.run.smithi076.stdout: "unittest_2_bytes": 0, 2024-06-02T05:06:09.771 INFO:teuthology.orchestra.run.smithi076.stdout: "unittest_2_items": 0 2024-06-02T05:06:09.771 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:09.772 INFO:teuthology.orchestra.run.smithi076.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-06-02T05:06:09.772 INFO:teuthology.orchestra.run.smithi076.stdout: "val": 0, 2024-06-02T05:06:09.772 INFO:teuthology.orchestra.run.smithi076.stdout: "max": 104857600, 2024-06-02T05:06:09.772 INFO:teuthology.orchestra.run.smithi076.stdout: "get_started": 0, 2024-06-02T05:06:09.772 INFO:teuthology.orchestra.run.smithi076.stdout: "get": 300, 2024-06-02T05:06:09.772 INFO:teuthology.orchestra.run.smithi076.stdout: "get_sum": 452925, 2024-06-02T05:06:09.772 INFO:teuthology.orchestra.run.smithi076.stdout: "get_or_fail_fail": 0, 2024-06-02T05:06:09.772 INFO:teuthology.orchestra.run.smithi076.stdout: "get_or_fail_success": 300, 2024-06-02T05:06:09.772 INFO:teuthology.orchestra.run.smithi076.stdout: "take": 0, 2024-06-02T05:06:09.772 INFO:teuthology.orchestra.run.smithi076.stdout: "take_sum": 0, 2024-06-02T05:06:09.772 INFO:teuthology.orchestra.run.smithi076.stdout: "put": 300, 2024-06-02T05:06:09.772 INFO:teuthology.orchestra.run.smithi076.stdout: "put_sum": 452925, 2024-06-02T05:06:09.772 INFO:teuthology.orchestra.run.smithi076.stdout: "wait": { 2024-06-02T05:06:09.773 INFO:teuthology.orchestra.run.smithi076.stdout: "avgcount": 0, 2024-06-02T05:06:09.773 INFO:teuthology.orchestra.run.smithi076.stdout: "sum": 0.000000000, 2024-06-02T05:06:09.773 INFO:teuthology.orchestra.run.smithi076.stdout: "avgtime": 0.000000000 2024-06-02T05:06:09.773 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:09.773 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:09.773 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-06-02T05:06:10.126 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-06-02T05:06:10.127 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-06-02T05:06:10.127 DEBUG:tasks.check_counter:Getting stats from g 2024-06-02T05:06:10.127 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell --fsid 60ab6d30-209a-11ef-bc9b-c7b262605968 -- ceph daemon mds.g perf dump 2024-06-02T05:06:10.153 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:06:09 smithi076 ceph-mon[42935]: pgmap v765: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 5.1 MiB/s wr, 544 op/s 2024-06-02T05:06:10.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:06:09 smithi192 ceph-mon[47933]: pgmap v765: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 5.1 MiB/s wr, 544 op/s 2024-06-02T05:06:10.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:06:09 smithi119 ceph-mon[46633]: pgmap v765: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 5.1 MiB/s wr, 544 op/s 2024-06-02T05:06:10.351 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T05:06:11.354 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-06-02T05:06:11.354 INFO:teuthology.orchestra.run.smithi076.stdout: "AsyncMessenger::Worker-0": { 2024-06-02T05:06:11.354 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_recv_messages": 300, 2024-06-02T05:06:11.354 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_send_messages": 295, 2024-06-02T05:06:11.354 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_recv_bytes": 497424, 2024-06-02T05:06:11.354 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_send_bytes": 168096, 2024-06-02T05:06:11.354 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_created_connections": 4, 2024-06-02T05:06:11.355 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_active_connections": 0, 2024-06-02T05:06:11.355 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_running_total_time": 0.040093461, 2024-06-02T05:06:11.355 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_running_send_time": 0.016044620, 2024-06-02T05:06:11.355 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_running_recv_time": 0.014633828, 2024-06-02T05:06:11.355 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_running_fast_dispatch_time": 0.006693563, 2024-06-02T05:06:11.355 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T05:06:11.355 INFO:teuthology.orchestra.run.smithi076.stdout: "avgcount": 295, 2024-06-02T05:06:11.355 INFO:teuthology.orchestra.run.smithi076.stdout: "sum": 0.052348012, 2024-06-02T05:06:11.355 INFO:teuthology.orchestra.run.smithi076.stdout: "avgtime": 0.000177450 2024-06-02T05:06:11.355 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:11.355 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_handle_ack_lat": { 2024-06-02T05:06:11.355 INFO:teuthology.orchestra.run.smithi076.stdout: "avgcount": 0, 2024-06-02T05:06:11.355 INFO:teuthology.orchestra.run.smithi076.stdout: "sum": 0.000000000, 2024-06-02T05:06:11.356 INFO:teuthology.orchestra.run.smithi076.stdout: "avgtime": 0.000000000 2024-06-02T05:06:11.356 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:11.356 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_recv_encrypted_bytes": 497424, 2024-06-02T05:06:11.356 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_send_encrypted_bytes": 168096 2024-06-02T05:06:11.356 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:11.356 INFO:teuthology.orchestra.run.smithi076.stdout: "AsyncMessenger::Worker-1": { 2024-06-02T05:06:11.356 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_recv_messages": 2, 2024-06-02T05:06:11.356 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_send_messages": 224, 2024-06-02T05:06:11.357 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_recv_bytes": 320, 2024-06-02T05:06:11.357 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_send_bytes": 191840, 2024-06-02T05:06:11.357 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_created_connections": 4, 2024-06-02T05:06:11.357 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_active_connections": 2, 2024-06-02T05:06:11.357 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_running_total_time": 0.014708412, 2024-06-02T05:06:11.357 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_running_send_time": 0.011458219, 2024-06-02T05:06:11.357 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_running_recv_time": 0.001583951, 2024-06-02T05:06:11.357 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-06-02T05:06:11.357 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T05:06:11.357 INFO:teuthology.orchestra.run.smithi076.stdout: "avgcount": 222, 2024-06-02T05:06:11.357 INFO:teuthology.orchestra.run.smithi076.stdout: "sum": 0.050603541, 2024-06-02T05:06:11.358 INFO:teuthology.orchestra.run.smithi076.stdout: "avgtime": 0.000227943 2024-06-02T05:06:11.358 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:11.358 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_handle_ack_lat": { 2024-06-02T05:06:11.358 INFO:teuthology.orchestra.run.smithi076.stdout: "avgcount": 0, 2024-06-02T05:06:11.358 INFO:teuthology.orchestra.run.smithi076.stdout: "sum": 0.000000000, 2024-06-02T05:06:11.358 INFO:teuthology.orchestra.run.smithi076.stdout: "avgtime": 0.000000000 2024-06-02T05:06:11.358 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:11.358 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_recv_encrypted_bytes": 320, 2024-06-02T05:06:11.358 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_send_encrypted_bytes": 191840 2024-06-02T05:06:11.358 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:11.358 INFO:teuthology.orchestra.run.smithi076.stdout: "AsyncMessenger::Worker-2": { 2024-06-02T05:06:11.358 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_recv_messages": 0, 2024-06-02T05:06:11.358 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_send_messages": 2, 2024-06-02T05:06:11.359 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_recv_bytes": 0, 2024-06-02T05:06:11.359 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_send_bytes": 0, 2024-06-02T05:06:11.359 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_created_connections": 2, 2024-06-02T05:06:11.359 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_active_connections": 1, 2024-06-02T05:06:11.359 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_running_total_time": 0.000506169, 2024-06-02T05:06:11.359 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_running_send_time": 0.000000000, 2024-06-02T05:06:11.359 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_running_recv_time": 0.000431176, 2024-06-02T05:06:11.359 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-06-02T05:06:11.359 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T05:06:11.359 INFO:teuthology.orchestra.run.smithi076.stdout: "avgcount": 0, 2024-06-02T05:06:11.359 INFO:teuthology.orchestra.run.smithi076.stdout: "sum": 0.000000000, 2024-06-02T05:06:11.359 INFO:teuthology.orchestra.run.smithi076.stdout: "avgtime": 0.000000000 2024-06-02T05:06:11.359 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:11.359 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_handle_ack_lat": { 2024-06-02T05:06:11.360 INFO:teuthology.orchestra.run.smithi076.stdout: "avgcount": 0, 2024-06-02T05:06:11.360 INFO:teuthology.orchestra.run.smithi076.stdout: "sum": 0.000000000, 2024-06-02T05:06:11.360 INFO:teuthology.orchestra.run.smithi076.stdout: "avgtime": 0.000000000 2024-06-02T05:06:11.360 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:11.360 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_recv_encrypted_bytes": 0, 2024-06-02T05:06:11.360 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_send_encrypted_bytes": 0 2024-06-02T05:06:11.360 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:11.360 INFO:teuthology.orchestra.run.smithi076.stdout: "cct": { 2024-06-02T05:06:11.360 INFO:teuthology.orchestra.run.smithi076.stdout: "total_workers": 0, 2024-06-02T05:06:11.360 INFO:teuthology.orchestra.run.smithi076.stdout: "unhealthy_workers": 0 2024-06-02T05:06:11.360 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:11.360 INFO:teuthology.orchestra.run.smithi076.stdout: "mempool": { 2024-06-02T05:06:11.360 INFO:teuthology.orchestra.run.smithi076.stdout: "bloom_filter_bytes": 0, 2024-06-02T05:06:11.361 INFO:teuthology.orchestra.run.smithi076.stdout: "bloom_filter_items": 0, 2024-06-02T05:06:11.361 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_alloc_bytes": 0, 2024-06-02T05:06:11.361 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_alloc_items": 0, 2024-06-02T05:06:11.361 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_cache_data_bytes": 0, 2024-06-02T05:06:11.361 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_cache_data_items": 0, 2024-06-02T05:06:11.361 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_cache_onode_bytes": 0, 2024-06-02T05:06:11.361 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_cache_onode_items": 0, 2024-06-02T05:06:11.361 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_cache_meta_bytes": 0, 2024-06-02T05:06:11.361 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_cache_meta_items": 0, 2024-06-02T05:06:11.361 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_cache_other_bytes": 0, 2024-06-02T05:06:11.361 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_cache_other_items": 0, 2024-06-02T05:06:11.361 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_cache_buffer_bytes": 0, 2024-06-02T05:06:11.361 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_cache_buffer_items": 0, 2024-06-02T05:06:11.361 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_extent_bytes": 0, 2024-06-02T05:06:11.362 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_extent_items": 0, 2024-06-02T05:06:11.362 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_blob_bytes": 0, 2024-06-02T05:06:11.362 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_blob_items": 0, 2024-06-02T05:06:11.362 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_shared_blob_bytes": 0, 2024-06-02T05:06:11.362 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_shared_blob_items": 0, 2024-06-02T05:06:11.362 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_inline_bl_bytes": 0, 2024-06-02T05:06:11.362 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_inline_bl_items": 0, 2024-06-02T05:06:11.362 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_fsck_bytes": 0, 2024-06-02T05:06:11.362 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_fsck_items": 0, 2024-06-02T05:06:11.362 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_txc_bytes": 0, 2024-06-02T05:06:11.362 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_txc_items": 0, 2024-06-02T05:06:11.362 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_writing_deferred_bytes": 0, 2024-06-02T05:06:11.362 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_writing_deferred_items": 0, 2024-06-02T05:06:11.363 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_writing_bytes": 0, 2024-06-02T05:06:11.363 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_writing_items": 0, 2024-06-02T05:06:11.363 INFO:teuthology.orchestra.run.smithi076.stdout: "bluefs_bytes": 0, 2024-06-02T05:06:11.363 INFO:teuthology.orchestra.run.smithi076.stdout: "bluefs_items": 0, 2024-06-02T05:06:11.363 INFO:teuthology.orchestra.run.smithi076.stdout: "bluefs_file_reader_bytes": 0, 2024-06-02T05:06:11.363 INFO:teuthology.orchestra.run.smithi076.stdout: "bluefs_file_reader_items": 0, 2024-06-02T05:06:11.363 INFO:teuthology.orchestra.run.smithi076.stdout: "bluefs_file_writer_bytes": 0, 2024-06-02T05:06:11.363 INFO:teuthology.orchestra.run.smithi076.stdout: "bluefs_file_writer_items": 0, 2024-06-02T05:06:11.363 INFO:teuthology.orchestra.run.smithi076.stdout: "buffer_anon_bytes": 148721, 2024-06-02T05:06:11.363 INFO:teuthology.orchestra.run.smithi076.stdout: "buffer_anon_items": 30, 2024-06-02T05:06:11.363 INFO:teuthology.orchestra.run.smithi076.stdout: "buffer_meta_bytes": 0, 2024-06-02T05:06:11.363 INFO:teuthology.orchestra.run.smithi076.stdout: "buffer_meta_items": 0, 2024-06-02T05:06:11.363 INFO:teuthology.orchestra.run.smithi076.stdout: "osd_bytes": 0, 2024-06-02T05:06:11.363 INFO:teuthology.orchestra.run.smithi076.stdout: "osd_items": 0, 2024-06-02T05:06:11.364 INFO:teuthology.orchestra.run.smithi076.stdout: "osd_mapbl_bytes": 0, 2024-06-02T05:06:11.364 INFO:teuthology.orchestra.run.smithi076.stdout: "osd_mapbl_items": 0, 2024-06-02T05:06:11.364 INFO:teuthology.orchestra.run.smithi076.stdout: "osd_pglog_bytes": 0, 2024-06-02T05:06:11.364 INFO:teuthology.orchestra.run.smithi076.stdout: "osd_pglog_items": 0, 2024-06-02T05:06:11.364 INFO:teuthology.orchestra.run.smithi076.stdout: "osdmap_bytes": 0, 2024-06-02T05:06:11.364 INFO:teuthology.orchestra.run.smithi076.stdout: "osdmap_items": 0, 2024-06-02T05:06:11.364 INFO:teuthology.orchestra.run.smithi076.stdout: "osdmap_mapping_bytes": 0, 2024-06-02T05:06:11.364 INFO:teuthology.orchestra.run.smithi076.stdout: "osdmap_mapping_items": 0, 2024-06-02T05:06:11.364 INFO:teuthology.orchestra.run.smithi076.stdout: "pgmap_bytes": 0, 2024-06-02T05:06:11.364 INFO:teuthology.orchestra.run.smithi076.stdout: "pgmap_items": 0, 2024-06-02T05:06:11.364 INFO:teuthology.orchestra.run.smithi076.stdout: "mds_co_bytes": 928, 2024-06-02T05:06:11.364 INFO:teuthology.orchestra.run.smithi076.stdout: "mds_co_items": 2, 2024-06-02T05:06:11.364 INFO:teuthology.orchestra.run.smithi076.stdout: "unittest_1_bytes": 0, 2024-06-02T05:06:11.364 INFO:teuthology.orchestra.run.smithi076.stdout: "unittest_1_items": 0, 2024-06-02T05:06:11.365 INFO:teuthology.orchestra.run.smithi076.stdout: "unittest_2_bytes": 0, 2024-06-02T05:06:11.365 INFO:teuthology.orchestra.run.smithi076.stdout: "unittest_2_items": 0 2024-06-02T05:06:11.365 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:11.365 INFO:teuthology.orchestra.run.smithi076.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-06-02T05:06:11.365 INFO:teuthology.orchestra.run.smithi076.stdout: "val": 0, 2024-06-02T05:06:11.365 INFO:teuthology.orchestra.run.smithi076.stdout: "max": 104857600, 2024-06-02T05:06:11.365 INFO:teuthology.orchestra.run.smithi076.stdout: "get_started": 0, 2024-06-02T05:06:11.365 INFO:teuthology.orchestra.run.smithi076.stdout: "get": 298, 2024-06-02T05:06:11.365 INFO:teuthology.orchestra.run.smithi076.stdout: "get_sum": 452665, 2024-06-02T05:06:11.365 INFO:teuthology.orchestra.run.smithi076.stdout: "get_or_fail_fail": 0, 2024-06-02T05:06:11.365 INFO:teuthology.orchestra.run.smithi076.stdout: "get_or_fail_success": 298, 2024-06-02T05:06:11.365 INFO:teuthology.orchestra.run.smithi076.stdout: "take": 0, 2024-06-02T05:06:11.365 INFO:teuthology.orchestra.run.smithi076.stdout: "take_sum": 0, 2024-06-02T05:06:11.365 INFO:teuthology.orchestra.run.smithi076.stdout: "put": 298, 2024-06-02T05:06:11.366 INFO:teuthology.orchestra.run.smithi076.stdout: "put_sum": 452665, 2024-06-02T05:06:11.366 INFO:teuthology.orchestra.run.smithi076.stdout: "wait": { 2024-06-02T05:06:11.366 INFO:teuthology.orchestra.run.smithi076.stdout: "avgcount": 0, 2024-06-02T05:06:11.366 INFO:teuthology.orchestra.run.smithi076.stdout: "sum": 0.000000000, 2024-06-02T05:06:11.366 INFO:teuthology.orchestra.run.smithi076.stdout: "avgtime": 0.000000000 2024-06-02T05:06:11.366 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:11.366 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:11.366 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-06-02T05:06:11.734 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.g 2024-06-02T05:06:11.734 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.g 2024-06-02T05:06:11.734 DEBUG:tasks.check_counter:Getting stats from j 2024-06-02T05:06:11.734 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell --fsid 60ab6d30-209a-11ef-bc9b-c7b262605968 -- ceph daemon mds.j perf dump 2024-06-02T05:06:12.000 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T05:06:12.117 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:06:11 smithi076 ceph-mon[42935]: pgmap v766: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 4.2 MiB/s wr, 452 op/s 2024-06-02T05:06:12.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:06:11 smithi192 ceph-mon[47933]: pgmap v766: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 4.2 MiB/s wr, 452 op/s 2024-06-02T05:06:12.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:06:11 smithi119 ceph-mon[46633]: pgmap v766: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 4.2 MiB/s wr, 452 op/s 2024-06-02T05:06:12.978 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-06-02T05:06:12.978 INFO:teuthology.orchestra.run.smithi076.stdout: "AsyncMessenger::Worker-0": { 2024-06-02T05:06:12.978 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_recv_messages": 0, 2024-06-02T05:06:12.978 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_send_messages": 2, 2024-06-02T05:06:12.979 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_recv_bytes": 0, 2024-06-02T05:06:12.979 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_send_bytes": 0, 2024-06-02T05:06:12.979 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_created_connections": 4, 2024-06-02T05:06:12.979 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_active_connections": 0, 2024-06-02T05:06:12.979 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_running_total_time": 0.001327959, 2024-06-02T05:06:12.979 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_running_send_time": 0.000000000, 2024-06-02T05:06:12.979 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_running_recv_time": 0.000276978, 2024-06-02T05:06:12.979 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-06-02T05:06:12.979 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T05:06:12.979 INFO:teuthology.orchestra.run.smithi076.stdout: "avgcount": 0, 2024-06-02T05:06:12.979 INFO:teuthology.orchestra.run.smithi076.stdout: "sum": 0.000000000, 2024-06-02T05:06:12.979 INFO:teuthology.orchestra.run.smithi076.stdout: "avgtime": 0.000000000 2024-06-02T05:06:12.980 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:12.980 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_handle_ack_lat": { 2024-06-02T05:06:12.980 INFO:teuthology.orchestra.run.smithi076.stdout: "avgcount": 0, 2024-06-02T05:06:12.980 INFO:teuthology.orchestra.run.smithi076.stdout: "sum": 0.000000000, 2024-06-02T05:06:12.980 INFO:teuthology.orchestra.run.smithi076.stdout: "avgtime": 0.000000000 2024-06-02T05:06:12.980 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:12.980 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_recv_encrypted_bytes": 0, 2024-06-02T05:06:12.980 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_send_encrypted_bytes": 0 2024-06-02T05:06:12.980 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:12.980 INFO:teuthology.orchestra.run.smithi076.stdout: "AsyncMessenger::Worker-1": { 2024-06-02T05:06:12.980 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_recv_messages": 2, 2024-06-02T05:06:12.980 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_send_messages": 227, 2024-06-02T05:06:12.980 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_recv_bytes": 320, 2024-06-02T05:06:12.981 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_send_bytes": 192368, 2024-06-02T05:06:12.981 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_created_connections": 4, 2024-06-02T05:06:12.981 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_active_connections": 2, 2024-06-02T05:06:12.981 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_running_total_time": 0.014306046, 2024-06-02T05:06:12.981 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_running_send_time": 0.011260283, 2024-06-02T05:06:12.981 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_running_recv_time": 0.001390138, 2024-06-02T05:06:12.981 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-06-02T05:06:12.981 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T05:06:12.981 INFO:teuthology.orchestra.run.smithi076.stdout: "avgcount": 225, 2024-06-02T05:06:12.981 INFO:teuthology.orchestra.run.smithi076.stdout: "sum": 0.030683282, 2024-06-02T05:06:12.981 INFO:teuthology.orchestra.run.smithi076.stdout: "avgtime": 0.000136370 2024-06-02T05:06:12.981 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:12.981 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_handle_ack_lat": { 2024-06-02T05:06:12.982 INFO:teuthology.orchestra.run.smithi076.stdout: "avgcount": 0, 2024-06-02T05:06:12.982 INFO:teuthology.orchestra.run.smithi076.stdout: "sum": 0.000000000, 2024-06-02T05:06:12.982 INFO:teuthology.orchestra.run.smithi076.stdout: "avgtime": 0.000000000 2024-06-02T05:06:12.982 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:12.982 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_recv_encrypted_bytes": 320, 2024-06-02T05:06:12.982 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_send_encrypted_bytes": 192368 2024-06-02T05:06:12.982 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:12.982 INFO:teuthology.orchestra.run.smithi076.stdout: "AsyncMessenger::Worker-2": { 2024-06-02T05:06:12.982 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_recv_messages": 303, 2024-06-02T05:06:12.982 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_send_messages": 298, 2024-06-02T05:06:12.982 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_recv_bytes": 498240, 2024-06-02T05:06:12.982 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_send_bytes": 169872, 2024-06-02T05:06:12.983 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_created_connections": 2, 2024-06-02T05:06:12.983 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_active_connections": 1, 2024-06-02T05:06:12.983 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_running_total_time": 0.039398079, 2024-06-02T05:06:12.983 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_running_send_time": 0.016104784, 2024-06-02T05:06:12.983 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_running_recv_time": 0.015043937, 2024-06-02T05:06:12.983 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_running_fast_dispatch_time": 0.006820714, 2024-06-02T05:06:12.983 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T05:06:12.983 INFO:teuthology.orchestra.run.smithi076.stdout: "avgcount": 298, 2024-06-02T05:06:12.983 INFO:teuthology.orchestra.run.smithi076.stdout: "sum": 0.041517546, 2024-06-02T05:06:12.983 INFO:teuthology.orchestra.run.smithi076.stdout: "avgtime": 0.000139320 2024-06-02T05:06:12.983 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:12.983 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_handle_ack_lat": { 2024-06-02T05:06:12.983 INFO:teuthology.orchestra.run.smithi076.stdout: "avgcount": 0, 2024-06-02T05:06:12.983 INFO:teuthology.orchestra.run.smithi076.stdout: "sum": 0.000000000, 2024-06-02T05:06:12.984 INFO:teuthology.orchestra.run.smithi076.stdout: "avgtime": 0.000000000 2024-06-02T05:06:12.984 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:12.984 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_recv_encrypted_bytes": 498240, 2024-06-02T05:06:12.984 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_send_encrypted_bytes": 169872 2024-06-02T05:06:12.984 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:12.984 INFO:teuthology.orchestra.run.smithi076.stdout: "cct": { 2024-06-02T05:06:12.984 INFO:teuthology.orchestra.run.smithi076.stdout: "total_workers": 0, 2024-06-02T05:06:12.984 INFO:teuthology.orchestra.run.smithi076.stdout: "unhealthy_workers": 0 2024-06-02T05:06:12.984 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:12.984 INFO:teuthology.orchestra.run.smithi076.stdout: "mempool": { 2024-06-02T05:06:12.984 INFO:teuthology.orchestra.run.smithi076.stdout: "bloom_filter_bytes": 0, 2024-06-02T05:06:12.984 INFO:teuthology.orchestra.run.smithi076.stdout: "bloom_filter_items": 0, 2024-06-02T05:06:12.984 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_alloc_bytes": 0, 2024-06-02T05:06:12.985 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_alloc_items": 0, 2024-06-02T05:06:12.985 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_cache_data_bytes": 0, 2024-06-02T05:06:12.985 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_cache_data_items": 0, 2024-06-02T05:06:12.985 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_cache_onode_bytes": 0, 2024-06-02T05:06:12.985 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_cache_onode_items": 0, 2024-06-02T05:06:12.985 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_cache_meta_bytes": 0, 2024-06-02T05:06:12.985 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_cache_meta_items": 0, 2024-06-02T05:06:12.985 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_cache_other_bytes": 0, 2024-06-02T05:06:12.985 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_cache_other_items": 0, 2024-06-02T05:06:12.985 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_cache_buffer_bytes": 0, 2024-06-02T05:06:12.985 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_cache_buffer_items": 0, 2024-06-02T05:06:12.985 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_extent_bytes": 0, 2024-06-02T05:06:12.985 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_extent_items": 0, 2024-06-02T05:06:12.985 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_blob_bytes": 0, 2024-06-02T05:06:12.986 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_blob_items": 0, 2024-06-02T05:06:12.986 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_shared_blob_bytes": 0, 2024-06-02T05:06:12.986 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_shared_blob_items": 0, 2024-06-02T05:06:12.986 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_inline_bl_bytes": 0, 2024-06-02T05:06:12.986 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_inline_bl_items": 0, 2024-06-02T05:06:12.986 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_fsck_bytes": 0, 2024-06-02T05:06:12.986 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_fsck_items": 0, 2024-06-02T05:06:12.986 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_txc_bytes": 0, 2024-06-02T05:06:12.986 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_txc_items": 0, 2024-06-02T05:06:12.986 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_writing_deferred_bytes": 0, 2024-06-02T05:06:12.986 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_writing_deferred_items": 0, 2024-06-02T05:06:12.986 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_writing_bytes": 0, 2024-06-02T05:06:12.986 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_writing_items": 0, 2024-06-02T05:06:12.987 INFO:teuthology.orchestra.run.smithi076.stdout: "bluefs_bytes": 0, 2024-06-02T05:06:12.987 INFO:teuthology.orchestra.run.smithi076.stdout: "bluefs_items": 0, 2024-06-02T05:06:12.987 INFO:teuthology.orchestra.run.smithi076.stdout: "bluefs_file_reader_bytes": 0, 2024-06-02T05:06:12.987 INFO:teuthology.orchestra.run.smithi076.stdout: "bluefs_file_reader_items": 0, 2024-06-02T05:06:12.987 INFO:teuthology.orchestra.run.smithi076.stdout: "bluefs_file_writer_bytes": 0, 2024-06-02T05:06:12.987 INFO:teuthology.orchestra.run.smithi076.stdout: "bluefs_file_writer_items": 0, 2024-06-02T05:06:12.987 INFO:teuthology.orchestra.run.smithi076.stdout: "buffer_anon_bytes": 148704, 2024-06-02T05:06:12.987 INFO:teuthology.orchestra.run.smithi076.stdout: "buffer_anon_items": 29, 2024-06-02T05:06:12.987 INFO:teuthology.orchestra.run.smithi076.stdout: "buffer_meta_bytes": 0, 2024-06-02T05:06:12.987 INFO:teuthology.orchestra.run.smithi076.stdout: "buffer_meta_items": 0, 2024-06-02T05:06:12.987 INFO:teuthology.orchestra.run.smithi076.stdout: "osd_bytes": 0, 2024-06-02T05:06:12.987 INFO:teuthology.orchestra.run.smithi076.stdout: "osd_items": 0, 2024-06-02T05:06:12.987 INFO:teuthology.orchestra.run.smithi076.stdout: "osd_mapbl_bytes": 0, 2024-06-02T05:06:12.987 INFO:teuthology.orchestra.run.smithi076.stdout: "osd_mapbl_items": 0, 2024-06-02T05:06:12.988 INFO:teuthology.orchestra.run.smithi076.stdout: "osd_pglog_bytes": 0, 2024-06-02T05:06:12.988 INFO:teuthology.orchestra.run.smithi076.stdout: "osd_pglog_items": 0, 2024-06-02T05:06:12.988 INFO:teuthology.orchestra.run.smithi076.stdout: "osdmap_bytes": 0, 2024-06-02T05:06:12.988 INFO:teuthology.orchestra.run.smithi076.stdout: "osdmap_items": 0, 2024-06-02T05:06:12.988 INFO:teuthology.orchestra.run.smithi076.stdout: "osdmap_mapping_bytes": 0, 2024-06-02T05:06:12.988 INFO:teuthology.orchestra.run.smithi076.stdout: "osdmap_mapping_items": 0, 2024-06-02T05:06:12.988 INFO:teuthology.orchestra.run.smithi076.stdout: "pgmap_bytes": 0, 2024-06-02T05:06:12.988 INFO:teuthology.orchestra.run.smithi076.stdout: "pgmap_items": 0, 2024-06-02T05:06:12.988 INFO:teuthology.orchestra.run.smithi076.stdout: "mds_co_bytes": 928, 2024-06-02T05:06:12.988 INFO:teuthology.orchestra.run.smithi076.stdout: "mds_co_items": 2, 2024-06-02T05:06:12.988 INFO:teuthology.orchestra.run.smithi076.stdout: "unittest_1_bytes": 0, 2024-06-02T05:06:12.988 INFO:teuthology.orchestra.run.smithi076.stdout: "unittest_1_items": 0, 2024-06-02T05:06:12.988 INFO:teuthology.orchestra.run.smithi076.stdout: "unittest_2_bytes": 0, 2024-06-02T05:06:12.989 INFO:teuthology.orchestra.run.smithi076.stdout: "unittest_2_items": 0 2024-06-02T05:06:12.989 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-06-02T05:06:12.989 INFO:teuthology.orchestra.run.smithi076.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-06-02T05:06:12.989 INFO:teuthology.orchestra.run.smithi076.stdout: "val": 0, 2024-06-02T05:06:12.989 INFO:teuthology.orchestra.run.smithi076.stdout: "max": 104857600, 2024-06-02T05:06:12.989 INFO:teuthology.orchestra.run.smithi076.stdout: "get_started": 0, 2024-06-02T05:06:12.989 INFO:teuthology.orchestra.run.smithi076.stdout: "get": 301, 2024-06-02T05:06:12.989 INFO:teuthology.orchestra.run.smithi076.stdout: "get_sum": 453055, 2024-06-02T05:06:12.989 INFO:teuthology.orchestra.run.smithi076.stdout: "get_or_fail_fail": 0, 2024-06-02T05:06:12.989 INFO:teuthology.orchestra.run.smithi076.stdout: "get_or_fail_success": 301, 2024-06-02T05:06:12.989 INFO:teuthology.orchestra.run.smithi076.stdout: "take": 0, 2024-06-02T05:06:12.989 INFO:teuthology.orchestra.run.smithi076.stdout: "take_sum": 0, 2024-06-02T05:06:12.989 INFO:teuthology.orchestra.run.smithi076.stdout: "put": 301, 2024-06-02T05:06:12.989 INFO:teuthology.orchestra.run.smithi076.stdout: "put_sum": 453055, 2024-06-02T05:06:12.990 INFO:teuthology.orchestra.run.smithi076.stdout: "wait": { 2024-06-02T05:06:12.990 INFO:teuthology.orchestra.run.smithi076.stdout: "avgcount": 0, 2024-06-02T05:06:12.990 INFO:teuthology.orchestra.run.smithi076.stdout: "sum": 0.000000000, 2024-06-02T05:06:12.990 INFO:teuthology.orchestra.run.smithi076.stdout: "avgtime": 0.000000000 2024-06-02T05:06:12.990 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:12.990 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-06-02T05:06:12.990 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-06-02T05:06:13.357 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-06-02T05:06:13.357 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-06-02T05:06:13.358 DEBUG:tasks.check_counter:Getting stats from b 2024-06-02T05:06:13.358 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell --fsid 60ab6d30-209a-11ef-bc9b-c7b262605968 -- ceph daemon mds.b perf dump 2024-06-02T05:06:13.703 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/mon.b/config 2024-06-02T05:06:14.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:06:13 smithi119 ceph-mon[46633]: pgmap v767: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 1.9 MiB/s wr, 220 op/s 2024-06-02T05:06:14.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:06:13 smithi192 ceph-mon[47933]: pgmap v767: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 1.9 MiB/s wr, 220 op/s 2024-06-02T05:06:14.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:06:13 smithi076 ceph-mon[42935]: pgmap v767: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 1.9 MiB/s wr, 220 op/s 2024-06-02T05:06:14.781 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-06-02T05:06:14.781 INFO:teuthology.orchestra.run.smithi119.stdout: "AsyncMessenger::Worker-0": { 2024-06-02T05:06:14.781 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_messages": 9226, 2024-06-02T05:06:14.781 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages": 10778, 2024-06-02T05:06:14.781 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_bytes": 3225947, 2024-06-02T05:06:14.781 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_bytes": 7949311, 2024-06-02T05:06:14.781 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_created_connections": 9, 2024-06-02T05:06:14.781 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_active_connections": 4, 2024-06-02T05:06:14.782 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_total_time": 0.545268885, 2024-06-02T05:06:14.782 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_send_time": 0.195138730, 2024-06-02T05:06:14.782 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_recv_time": 0.302026753, 2024-06-02T05:06:14.782 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_fast_dispatch_time": 0.070914461, 2024-06-02T05:06:14.782 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T05:06:14.782 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 10779, 2024-06-02T05:06:14.782 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 2.032982320, 2024-06-02T05:06:14.782 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000188605 2024-06-02T05:06:14.782 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:14.782 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_handle_ack_lat": { 2024-06-02T05:06:14.782 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 14505, 2024-06-02T05:06:14.782 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.002132605, 2024-06-02T05:06:14.783 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000147 2024-06-02T05:06:14.783 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:14.783 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_encrypted_bytes": 585984, 2024-06-02T05:06:14.783 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_encrypted_bytes": 179792 2024-06-02T05:06:14.783 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:14.783 INFO:teuthology.orchestra.run.smithi119.stdout: "AsyncMessenger::Worker-1": { 2024-06-02T05:06:14.783 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_messages": 6016, 2024-06-02T05:06:14.783 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages": 7434, 2024-06-02T05:06:14.783 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_bytes": 1822506, 2024-06-02T05:06:14.783 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_bytes": 8393515, 2024-06-02T05:06:14.783 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_created_connections": 9, 2024-06-02T05:06:14.783 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_active_connections": 5, 2024-06-02T05:06:14.784 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_total_time": 0.374746300, 2024-06-02T05:06:14.784 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_send_time": 0.131656976, 2024-06-02T05:06:14.784 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_recv_time": 0.170724274, 2024-06-02T05:06:14.784 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_fast_dispatch_time": 0.078358812, 2024-06-02T05:06:14.784 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T05:06:14.784 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 7434, 2024-06-02T05:06:14.784 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 1.494244531, 2024-06-02T05:06:14.784 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000201001 2024-06-02T05:06:14.784 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:14.784 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_handle_ack_lat": { 2024-06-02T05:06:14.784 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 7481, 2024-06-02T05:06:14.784 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.001270272, 2024-06-02T05:06:14.784 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000169 2024-06-02T05:06:14.784 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:14.785 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_encrypted_bytes": 320, 2024-06-02T05:06:14.785 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_encrypted_bytes": 560240 2024-06-02T05:06:14.785 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:14.785 INFO:teuthology.orchestra.run.smithi119.stdout: "AsyncMessenger::Worker-2": { 2024-06-02T05:06:14.785 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_messages": 19540, 2024-06-02T05:06:14.785 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages": 19662, 2024-06-02T05:06:14.785 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_bytes": 6080302, 2024-06-02T05:06:14.785 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_bytes": 23602447, 2024-06-02T05:06:14.785 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_created_connections": 179, 2024-06-02T05:06:14.785 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_active_connections": 11, 2024-06-02T05:06:14.785 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_total_time": 1.200814419, 2024-06-02T05:06:14.785 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_send_time": 0.409001062, 2024-06-02T05:06:14.785 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_recv_time": 0.774109323, 2024-06-02T05:06:14.786 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_fast_dispatch_time": 0.149907052, 2024-06-02T05:06:14.786 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T05:06:14.786 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 19657, 2024-06-02T05:06:14.786 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 6.143490269, 2024-06-02T05:06:14.786 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000312534 2024-06-02T05:06:14.786 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:14.786 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_handle_ack_lat": { 2024-06-02T05:06:14.786 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 30454, 2024-06-02T05:06:14.787 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.004556649, 2024-06-02T05:06:14.787 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000149 2024-06-02T05:06:14.787 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:14.787 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_encrypted_bytes": 52800, 2024-06-02T05:06:14.787 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_encrypted_bytes": 34992 2024-06-02T05:06:14.787 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:14.787 INFO:teuthology.orchestra.run.smithi119.stdout: "cct": { 2024-06-02T05:06:14.787 INFO:teuthology.orchestra.run.smithi119.stdout: "total_workers": 1, 2024-06-02T05:06:14.787 INFO:teuthology.orchestra.run.smithi119.stdout: "unhealthy_workers": 0 2024-06-02T05:06:14.787 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:14.787 INFO:teuthology.orchestra.run.smithi119.stdout: "finisher-MDSRank": { 2024-06-02T05:06:14.787 INFO:teuthology.orchestra.run.smithi119.stdout: "queue_len": 0, 2024-06-02T05:06:14.787 INFO:teuthology.orchestra.run.smithi119.stdout: "complete_latency": { 2024-06-02T05:06:14.788 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 8428, 2024-06-02T05:06:14.788 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 3.753029600, 2024-06-02T05:06:14.788 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000445304 2024-06-02T05:06:14.788 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-06-02T05:06:14.788 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:14.788 INFO:teuthology.orchestra.run.smithi119.stdout: "finisher-PurgeQueue": { 2024-06-02T05:06:14.788 INFO:teuthology.orchestra.run.smithi119.stdout: "queue_len": 0, 2024-06-02T05:06:14.788 INFO:teuthology.orchestra.run.smithi119.stdout: "complete_latency": { 2024-06-02T05:06:14.788 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 525, 2024-06-02T05:06:14.788 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.020016413, 2024-06-02T05:06:14.788 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000038126 2024-06-02T05:06:14.788 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-06-02T05:06:14.788 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:14.788 INFO:teuthology.orchestra.run.smithi119.stdout: "mds": { 2024-06-02T05:06:14.789 INFO:teuthology.orchestra.run.smithi119.stdout: "request": 8138, 2024-06-02T05:06:14.789 INFO:teuthology.orchestra.run.smithi119.stdout: "reply": 5798, 2024-06-02T05:06:14.789 INFO:teuthology.orchestra.run.smithi119.stdout: "reply_latency": { 2024-06-02T05:06:14.789 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 5798, 2024-06-02T05:06:14.789 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 28.022859800, 2024-06-02T05:06:14.789 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.004833194 2024-06-02T05:06:14.789 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:14.789 INFO:teuthology.orchestra.run.smithi119.stdout: "slow_reply": 0, 2024-06-02T05:06:14.789 INFO:teuthology.orchestra.run.smithi119.stdout: "forward": 2340, 2024-06-02T05:06:14.789 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_fetch_complete": 5, 2024-06-02T05:06:14.789 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_fetch_keys": 2, 2024-06-02T05:06:14.789 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_commit": 1090, 2024-06-02T05:06:14.790 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_split": 3, 2024-06-02T05:06:14.790 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_merge": 0, 2024-06-02T05:06:14.790 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes": 593, 2024-06-02T05:06:14.790 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_top": 3, 2024-06-02T05:06:14.790 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_bottom": 569, 2024-06-02T05:06:14.790 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_pin_tail": 21, 2024-06-02T05:06:14.790 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_pinned": 589, 2024-06-02T05:06:14.790 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_expired": 693, 2024-06-02T05:06:14.790 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_with_caps": 564, 2024-06-02T05:06:14.790 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": 564, 2024-06-02T05:06:14.790 INFO:teuthology.orchestra.run.smithi119.stdout: "subtrees": 14, 2024-06-02T05:06:14.790 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse": 11205, 2024-06-02T05:06:14.791 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_hit": 7005, 2024-06-02T05:06:14.791 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_forward": 2303, 2024-06-02T05:06:14.791 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_discover": 0, 2024-06-02T05:06:14.791 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_dir_fetch": 0, 2024-06-02T05:06:14.791 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_remote_ino": 0, 2024-06-02T05:06:14.791 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_lock": 0, 2024-06-02T05:06:14.791 INFO:teuthology.orchestra.run.smithi119.stdout: "load_cent": 65142, 2024-06-02T05:06:14.791 INFO:teuthology.orchestra.run.smithi119.stdout: "q": 0, 2024-06-02T05:06:14.791 INFO:teuthology.orchestra.run.smithi119.stdout: "exported": 18, 2024-06-02T05:06:14.791 INFO:teuthology.orchestra.run.smithi119.stdout: "exported_inodes": 686, 2024-06-02T05:06:14.791 INFO:teuthology.orchestra.run.smithi119.stdout: "imported": 6, 2024-06-02T05:06:14.791 INFO:teuthology.orchestra.run.smithi119.stdout: "imported_inodes": 249, 2024-06-02T05:06:14.791 INFO:teuthology.orchestra.run.smithi119.stdout: "openino_dir_fetch": 0, 2024-06-02T05:06:14.791 INFO:teuthology.orchestra.run.smithi119.stdout: "openino_backtrace_fetch": 471, 2024-06-02T05:06:14.792 INFO:teuthology.orchestra.run.smithi119.stdout: "openino_peer_discover": 0, 2024-06-02T05:06:14.792 INFO:teuthology.orchestra.run.smithi119.stdout: "root_rfiles": 1040, 2024-06-02T05:06:14.792 INFO:teuthology.orchestra.run.smithi119.stdout: "root_rbytes": 1696901085, 2024-06-02T05:06:14.792 INFO:teuthology.orchestra.run.smithi119.stdout: "root_rsnaps": 0, 2024-06-02T05:06:14.792 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_backtrace_fetch": 471, 2024-06-02T05:06:14.792 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_set_tag": 0, 2024-06-02T05:06:14.792 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_backtrace_repaired": 0, 2024-06-02T05:06:14.792 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_inotable_repaired": 0, 2024-06-02T05:06:14.792 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_dir_inodes": 42, 2024-06-02T05:06:14.792 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_dir_base_inodes": 2, 2024-06-02T05:06:14.792 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_dirfrag_rstats": 40, 2024-06-02T05:06:14.792 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_file_inodes": 429, 2024-06-02T05:06:14.793 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_inode_file_caps": 0, 2024-06-02T05:06:14.793 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_cap_op_revoke": 1953, 2024-06-02T05:06:14.793 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_cap_op_grant": 1546, 2024-06-02T05:06:14.793 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_cap_op_trunc": 0, 2024-06-02T05:06:14.793 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-06-02T05:06:14.793 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_cap_op_flush_ack": 0, 2024-06-02T05:06:14.793 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_client_caps": 6171, 2024-06-02T05:06:14.793 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_client_caps_dirty": 1738, 2024-06-02T05:06:14.793 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_client_cap_release": 42, 2024-06-02T05:06:14.793 INFO:teuthology.orchestra.run.smithi119.stdout: "process_request_cap_release": 1601 2024-06-02T05:06:14.793 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:14.793 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_cache": { 2024-06-02T05:06:14.793 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_update": 0, 2024-06-02T05:06:14.794 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_update_receipt": 0, 2024-06-02T05:06:14.794 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_try_discover": 0, 2024-06-02T05:06:14.794 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_send_discover": 0, 2024-06-02T05:06:14.794 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_handle_discover": 15, 2024-06-02T05:06:14.794 INFO:teuthology.orchestra.run.smithi119.stdout: "num_strays": 0, 2024-06-02T05:06:14.794 INFO:teuthology.orchestra.run.smithi119.stdout: "num_strays_delayed": 0, 2024-06-02T05:06:14.794 INFO:teuthology.orchestra.run.smithi119.stdout: "num_strays_enqueuing": 0, 2024-06-02T05:06:14.794 INFO:teuthology.orchestra.run.smithi119.stdout: "strays_created": 123, 2024-06-02T05:06:14.794 INFO:teuthology.orchestra.run.smithi119.stdout: "strays_enqueued": 122, 2024-06-02T05:06:14.794 INFO:teuthology.orchestra.run.smithi119.stdout: "strays_reintegrated": 1, 2024-06-02T05:06:14.794 INFO:teuthology.orchestra.run.smithi119.stdout: "strays_migrated": 0, 2024-06-02T05:06:14.794 INFO:teuthology.orchestra.run.smithi119.stdout: "num_recovering_processing": 0, 2024-06-02T05:06:14.794 INFO:teuthology.orchestra.run.smithi119.stdout: "num_recovering_enqueued": 0, 2024-06-02T05:06:14.795 INFO:teuthology.orchestra.run.smithi119.stdout: "num_recovering_prioritized": 0, 2024-06-02T05:06:14.795 INFO:teuthology.orchestra.run.smithi119.stdout: "recovery_started": 0, 2024-06-02T05:06:14.795 INFO:teuthology.orchestra.run.smithi119.stdout: "recovery_completed": 0, 2024-06-02T05:06:14.795 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_enqueue_scrub": 2, 2024-06-02T05:06:14.795 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_exportdir": 21, 2024-06-02T05:06:14.795 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_flush": 0, 2024-06-02T05:06:14.795 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_fragmentdir": 3, 2024-06-02T05:06:14.795 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_fragstats": 0, 2024-06-02T05:06:14.795 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_inodestats": 0 2024-06-02T05:06:14.795 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:14.795 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_log": { 2024-06-02T05:06:14.795 INFO:teuthology.orchestra.run.smithi119.stdout: "evadd": 8393, 2024-06-02T05:06:14.795 INFO:teuthology.orchestra.run.smithi119.stdout: "evex": 8247, 2024-06-02T05:06:14.796 INFO:teuthology.orchestra.run.smithi119.stdout: "evtrm": 8247, 2024-06-02T05:06:14.796 INFO:teuthology.orchestra.run.smithi119.stdout: "ev": 146, 2024-06-02T05:06:14.796 INFO:teuthology.orchestra.run.smithi119.stdout: "evexg": 0, 2024-06-02T05:06:14.796 INFO:teuthology.orchestra.run.smithi119.stdout: "evexd": 52, 2024-06-02T05:06:14.796 INFO:teuthology.orchestra.run.smithi119.stdout: "segadd": 80, 2024-06-02T05:06:14.796 INFO:teuthology.orchestra.run.smithi119.stdout: "segex": 79, 2024-06-02T05:06:14.796 INFO:teuthology.orchestra.run.smithi119.stdout: "segtrm": 79, 2024-06-02T05:06:14.796 INFO:teuthology.orchestra.run.smithi119.stdout: "seg": 2, 2024-06-02T05:06:14.796 INFO:teuthology.orchestra.run.smithi119.stdout: "segexg": 0, 2024-06-02T05:06:14.796 INFO:teuthology.orchestra.run.smithi119.stdout: "segexd": 1, 2024-06-02T05:06:14.796 INFO:teuthology.orchestra.run.smithi119.stdout: "expos": 24407592, 2024-06-02T05:06:14.796 INFO:teuthology.orchestra.run.smithi119.stdout: "wrpos": 24746924, 2024-06-02T05:06:14.796 INFO:teuthology.orchestra.run.smithi119.stdout: "rdpos": 0, 2024-06-02T05:06:14.797 INFO:teuthology.orchestra.run.smithi119.stdout: "jlat": { 2024-06-02T05:06:14.797 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 3604, 2024-06-02T05:06:14.797 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 16.512546462, 2024-06-02T05:06:14.797 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.004581727 2024-06-02T05:06:14.797 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:14.797 INFO:teuthology.orchestra.run.smithi119.stdout: "replayed": 0 2024-06-02T05:06:14.797 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:14.797 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_mem": { 2024-06-02T05:06:14.797 INFO:teuthology.orchestra.run.smithi119.stdout: "ino": 584, 2024-06-02T05:06:14.797 INFO:teuthology.orchestra.run.smithi119.stdout: "ino+": 1386, 2024-06-02T05:06:14.797 INFO:teuthology.orchestra.run.smithi119.stdout: "ino-": 802, 2024-06-02T05:06:14.797 INFO:teuthology.orchestra.run.smithi119.stdout: "dir": 67, 2024-06-02T05:06:14.797 INFO:teuthology.orchestra.run.smithi119.stdout: "dir+": 73, 2024-06-02T05:06:14.798 INFO:teuthology.orchestra.run.smithi119.stdout: "dir-": 6, 2024-06-02T05:06:14.798 INFO:teuthology.orchestra.run.smithi119.stdout: "dn": 593, 2024-06-02T05:06:14.798 INFO:teuthology.orchestra.run.smithi119.stdout: "dn+": 1433, 2024-06-02T05:06:14.798 INFO:teuthology.orchestra.run.smithi119.stdout: "dn-": 840, 2024-06-02T05:06:14.798 INFO:teuthology.orchestra.run.smithi119.stdout: "cap": 564, 2024-06-02T05:06:14.798 INFO:teuthology.orchestra.run.smithi119.stdout: "cap+": 1374, 2024-06-02T05:06:14.798 INFO:teuthology.orchestra.run.smithi119.stdout: "cap-": 810, 2024-06-02T05:06:14.798 INFO:teuthology.orchestra.run.smithi119.stdout: "rss": 70452, 2024-06-02T05:06:14.798 INFO:teuthology.orchestra.run.smithi119.stdout: "heap": 207156 2024-06-02T05:06:14.798 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:14.798 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_server": { 2024-06-02T05:06:14.798 INFO:teuthology.orchestra.run.smithi119.stdout: "dispatch_client_request": 9481, 2024-06-02T05:06:14.798 INFO:teuthology.orchestra.run.smithi119.stdout: "dispatch_server_request": 1204, 2024-06-02T05:06:14.799 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_client_request": 8138, 2024-06-02T05:06:14.799 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_client_session": 61, 2024-06-02T05:06:14.799 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_peer_request": 2408, 2024-06-02T05:06:14.799 INFO:teuthology.orchestra.run.smithi119.stdout: "req_create_latency": { 2024-06-02T05:06:14.799 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 1096, 2024-06-02T05:06:14.799 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 5.693228108, 2024-06-02T05:06:14.799 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.005194551 2024-06-02T05:06:14.799 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:14.799 INFO:teuthology.orchestra.run.smithi119.stdout: "req_getattr_latency": { 2024-06-02T05:06:14.799 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 507, 2024-06-02T05:06:14.799 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.123053387, 2024-06-02T05:06:14.799 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000242708 2024-06-02T05:06:14.799 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:14.800 INFO:teuthology.orchestra.run.smithi119.stdout: "req_getfilelock_latency": { 2024-06-02T05:06:14.800 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-06-02T05:06:14.800 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-06-02T05:06:14.800 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-06-02T05:06:14.800 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:14.800 INFO:teuthology.orchestra.run.smithi119.stdout: "req_link_latency": { 2024-06-02T05:06:14.800 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 1, 2024-06-02T05:06:14.800 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.002113191, 2024-06-02T05:06:14.800 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.002113191 2024-06-02T05:06:14.800 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:14.800 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookup_latency": { 2024-06-02T05:06:14.800 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 2736, 2024-06-02T05:06:14.800 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 20.747419525, 2024-06-02T05:06:14.801 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.007583121 2024-06-02T05:06:14.801 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:14.801 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookuphash_latency": { 2024-06-02T05:06:14.801 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-06-02T05:06:14.801 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-06-02T05:06:14.801 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-06-02T05:06:14.801 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:14.801 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookupino_latency": { 2024-06-02T05:06:14.801 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-06-02T05:06:14.801 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-06-02T05:06:14.801 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-06-02T05:06:14.801 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:14.801 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookupname_latency": { 2024-06-02T05:06:14.801 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-06-02T05:06:14.802 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-06-02T05:06:14.802 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-06-02T05:06:14.802 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:14.802 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookupparent_latency": { 2024-06-02T05:06:14.802 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-06-02T05:06:14.802 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-06-02T05:06:14.802 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-06-02T05:06:14.802 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:14.802 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookupsnap_latency": { 2024-06-02T05:06:14.802 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-06-02T05:06:14.802 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-06-02T05:06:14.802 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-06-02T05:06:14.802 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:14.802 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lssnap_latency": { 2024-06-02T05:06:14.803 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-06-02T05:06:14.803 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-06-02T05:06:14.803 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-06-02T05:06:14.803 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:14.803 INFO:teuthology.orchestra.run.smithi119.stdout: "req_mkdir_latency": { 2024-06-02T05:06:14.803 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 35, 2024-06-02T05:06:14.803 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.040294540, 2024-06-02T05:06:14.803 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.001151272 2024-06-02T05:06:14.803 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:14.803 INFO:teuthology.orchestra.run.smithi119.stdout: "req_mknod_latency": { 2024-06-02T05:06:14.803 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-06-02T05:06:14.803 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-06-02T05:06:14.803 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-06-02T05:06:14.804 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:14.804 INFO:teuthology.orchestra.run.smithi119.stdout: "req_mksnap_latency": { 2024-06-02T05:06:14.804 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-06-02T05:06:14.804 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-06-02T05:06:14.804 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-06-02T05:06:14.804 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:14.804 INFO:teuthology.orchestra.run.smithi119.stdout: "req_open_latency": { 2024-06-02T05:06:14.804 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 1169, 2024-06-02T05:06:14.804 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.808066263, 2024-06-02T05:06:14.804 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000691245 2024-06-02T05:06:14.804 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:14.804 INFO:teuthology.orchestra.run.smithi119.stdout: "req_readdir_latency": { 2024-06-02T05:06:14.804 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 107, 2024-06-02T05:06:14.805 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.209944927, 2024-06-02T05:06:14.805 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.001962102 2024-06-02T05:06:14.805 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:14.805 INFO:teuthology.orchestra.run.smithi119.stdout: "req_rename_latency": { 2024-06-02T05:06:14.805 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 106, 2024-06-02T05:06:14.805 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.330233406, 2024-06-02T05:06:14.805 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.003115409 2024-06-02T05:06:14.805 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:14.805 INFO:teuthology.orchestra.run.smithi119.stdout: "req_renamesnap_latency": { 2024-06-02T05:06:14.805 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-06-02T05:06:14.805 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-06-02T05:06:14.805 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-06-02T05:06:14.805 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:14.805 INFO:teuthology.orchestra.run.smithi119.stdout: "req_snapdiff_latency": { 2024-06-02T05:06:14.806 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-06-02T05:06:14.806 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-06-02T05:06:14.806 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-06-02T05:06:14.806 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:14.806 INFO:teuthology.orchestra.run.smithi119.stdout: "req_rmdir_latency": { 2024-06-02T05:06:14.806 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-06-02T05:06:14.806 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-06-02T05:06:14.806 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-06-02T05:06:14.806 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:14.806 INFO:teuthology.orchestra.run.smithi119.stdout: "req_rmsnap_latency": { 2024-06-02T05:06:14.806 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-06-02T05:06:14.806 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-06-02T05:06:14.806 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-06-02T05:06:14.807 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:14.807 INFO:teuthology.orchestra.run.smithi119.stdout: "req_rmxattr_latency": { 2024-06-02T05:06:14.807 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-06-02T05:06:14.807 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-06-02T05:06:14.807 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-06-02T05:06:14.807 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:14.807 INFO:teuthology.orchestra.run.smithi119.stdout: "req_setattr_latency": { 2024-06-02T05:06:14.807 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 2, 2024-06-02T05:06:14.807 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.001969829, 2024-06-02T05:06:14.807 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000984914 2024-06-02T05:06:14.807 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:14.807 INFO:teuthology.orchestra.run.smithi119.stdout: "req_setdirlayout_latency": { 2024-06-02T05:06:14.807 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-06-02T05:06:14.808 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-06-02T05:06:14.808 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-06-02T05:06:14.808 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:14.808 INFO:teuthology.orchestra.run.smithi119.stdout: "req_setfilelock_latency": { 2024-06-02T05:06:14.808 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-06-02T05:06:14.808 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-06-02T05:06:14.808 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-06-02T05:06:14.808 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:14.808 INFO:teuthology.orchestra.run.smithi119.stdout: "req_setlayout_latency": { 2024-06-02T05:06:14.808 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-06-02T05:06:14.808 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-06-02T05:06:14.808 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-06-02T05:06:14.808 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:14.809 INFO:teuthology.orchestra.run.smithi119.stdout: "req_setxattr_latency": { 2024-06-02T05:06:14.809 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 8, 2024-06-02T05:06:14.809 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.020600929, 2024-06-02T05:06:14.809 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.002575116 2024-06-02T05:06:14.809 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:14.809 INFO:teuthology.orchestra.run.smithi119.stdout: "req_symlink_latency": { 2024-06-02T05:06:14.809 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-06-02T05:06:14.809 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-06-02T05:06:14.809 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-06-02T05:06:14.809 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:14.809 INFO:teuthology.orchestra.run.smithi119.stdout: "req_unlink_latency": { 2024-06-02T05:06:14.809 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 31, 2024-06-02T05:06:14.809 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.045935695, 2024-06-02T05:06:14.810 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.001481796 2024-06-02T05:06:14.810 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:14.810 INFO:teuthology.orchestra.run.smithi119.stdout: "cap_revoke_eviction": 0, 2024-06-02T05:06:14.810 INFO:teuthology.orchestra.run.smithi119.stdout: "cap_acquisition_throttle": 0, 2024-06-02T05:06:14.810 INFO:teuthology.orchestra.run.smithi119.stdout: "req_getvxattr_latency": { 2024-06-02T05:06:14.810 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-06-02T05:06:14.810 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-06-02T05:06:14.810 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-06-02T05:06:14.810 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-06-02T05:06:14.810 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:14.810 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_sessions": { 2024-06-02T05:06:14.810 INFO:teuthology.orchestra.run.smithi119.stdout: "session_count": 1, 2024-06-02T05:06:14.810 INFO:teuthology.orchestra.run.smithi119.stdout: "session_add": 3, 2024-06-02T05:06:14.811 INFO:teuthology.orchestra.run.smithi119.stdout: "session_remove": 2, 2024-06-02T05:06:14.811 INFO:teuthology.orchestra.run.smithi119.stdout: "sessions_open": 1, 2024-06-02T05:06:14.811 INFO:teuthology.orchestra.run.smithi119.stdout: "sessions_stale": 0, 2024-06-02T05:06:14.811 INFO:teuthology.orchestra.run.smithi119.stdout: "total_load": 674, 2024-06-02T05:06:14.811 INFO:teuthology.orchestra.run.smithi119.stdout: "average_load": 674, 2024-06-02T05:06:14.811 INFO:teuthology.orchestra.run.smithi119.stdout: "avg_session_uptime": 996, 2024-06-02T05:06:14.811 INFO:teuthology.orchestra.run.smithi119.stdout: "mdthresh_evicted": 0 2024-06-02T05:06:14.811 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:14.811 INFO:teuthology.orchestra.run.smithi119.stdout: "mempool": { 2024-06-02T05:06:14.811 INFO:teuthology.orchestra.run.smithi119.stdout: "bloom_filter_bytes": 120, 2024-06-02T05:06:14.811 INFO:teuthology.orchestra.run.smithi119.stdout: "bloom_filter_items": 120, 2024-06-02T05:06:14.811 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_alloc_bytes": 0, 2024-06-02T05:06:14.811 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_alloc_items": 0, 2024-06-02T05:06:14.812 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_data_bytes": 0, 2024-06-02T05:06:14.812 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_data_items": 0, 2024-06-02T05:06:14.812 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_onode_bytes": 0, 2024-06-02T05:06:14.812 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_onode_items": 0, 2024-06-02T05:06:14.812 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_meta_bytes": 0, 2024-06-02T05:06:14.812 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_meta_items": 0, 2024-06-02T05:06:14.812 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_other_bytes": 0, 2024-06-02T05:06:14.812 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_other_items": 0, 2024-06-02T05:06:14.812 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_buffer_bytes": 0, 2024-06-02T05:06:14.812 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_buffer_items": 0, 2024-06-02T05:06:14.812 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_extent_bytes": 0, 2024-06-02T05:06:14.812 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_extent_items": 0, 2024-06-02T05:06:14.812 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_blob_bytes": 0, 2024-06-02T05:06:14.812 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_blob_items": 0, 2024-06-02T05:06:14.813 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_shared_blob_bytes": 0, 2024-06-02T05:06:14.813 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_shared_blob_items": 0, 2024-06-02T05:06:14.813 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_inline_bl_bytes": 0, 2024-06-02T05:06:14.813 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_inline_bl_items": 0, 2024-06-02T05:06:14.813 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_fsck_bytes": 0, 2024-06-02T05:06:14.813 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_fsck_items": 0, 2024-06-02T05:06:14.813 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_txc_bytes": 0, 2024-06-02T05:06:14.813 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_txc_items": 0, 2024-06-02T05:06:14.813 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_writing_deferred_bytes": 0, 2024-06-02T05:06:14.813 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_writing_deferred_items": 0, 2024-06-02T05:06:14.813 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_writing_bytes": 0, 2024-06-02T05:06:14.813 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_writing_items": 0, 2024-06-02T05:06:14.813 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_bytes": 0, 2024-06-02T05:06:14.814 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_items": 0, 2024-06-02T05:06:14.814 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_file_reader_bytes": 0, 2024-06-02T05:06:14.814 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_file_reader_items": 0, 2024-06-02T05:06:14.814 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_file_writer_bytes": 0, 2024-06-02T05:06:14.814 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_file_writer_items": 0, 2024-06-02T05:06:14.814 INFO:teuthology.orchestra.run.smithi119.stdout: "buffer_anon_bytes": 289891, 2024-06-02T05:06:14.814 INFO:teuthology.orchestra.run.smithi119.stdout: "buffer_anon_items": 111, 2024-06-02T05:06:14.814 INFO:teuthology.orchestra.run.smithi119.stdout: "buffer_meta_bytes": 0, 2024-06-02T05:06:14.814 INFO:teuthology.orchestra.run.smithi119.stdout: "buffer_meta_items": 0, 2024-06-02T05:06:14.814 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_bytes": 0, 2024-06-02T05:06:14.814 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_items": 0, 2024-06-02T05:06:14.814 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_mapbl_bytes": 0, 2024-06-02T05:06:14.814 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_mapbl_items": 0, 2024-06-02T05:06:14.815 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_pglog_bytes": 0, 2024-06-02T05:06:14.815 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_pglog_items": 0, 2024-06-02T05:06:14.815 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_bytes": 8800, 2024-06-02T05:06:14.815 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_items": 169, 2024-06-02T05:06:14.815 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_mapping_bytes": 0, 2024-06-02T05:06:14.815 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_mapping_items": 0, 2024-06-02T05:06:14.815 INFO:teuthology.orchestra.run.smithi119.stdout: "pgmap_bytes": 0, 2024-06-02T05:06:14.815 INFO:teuthology.orchestra.run.smithi119.stdout: "pgmap_items": 0, 2024-06-02T05:06:14.815 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_co_bytes": 1959108, 2024-06-02T05:06:14.815 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_co_items": 11968, 2024-06-02T05:06:14.815 INFO:teuthology.orchestra.run.smithi119.stdout: "unittest_1_bytes": 0, 2024-06-02T05:06:14.815 INFO:teuthology.orchestra.run.smithi119.stdout: "unittest_1_items": 0, 2024-06-02T05:06:14.815 INFO:teuthology.orchestra.run.smithi119.stdout: "unittest_2_bytes": 0, 2024-06-02T05:06:14.816 INFO:teuthology.orchestra.run.smithi119.stdout: "unittest_2_items": 0 2024-06-02T05:06:14.816 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:14.816 INFO:teuthology.orchestra.run.smithi119.stdout: "objecter": { 2024-06-02T05:06:14.816 INFO:teuthology.orchestra.run.smithi119.stdout: "op_active": 0, 2024-06-02T05:06:14.816 INFO:teuthology.orchestra.run.smithi119.stdout: "op_laggy": 0, 2024-06-02T05:06:14.816 INFO:teuthology.orchestra.run.smithi119.stdout: "op_send": 8561, 2024-06-02T05:06:14.816 INFO:teuthology.orchestra.run.smithi119.stdout: "op_send_bytes": 23520622, 2024-06-02T05:06:14.816 INFO:teuthology.orchestra.run.smithi119.stdout: "op_resend": 37, 2024-06-02T05:06:14.816 INFO:teuthology.orchestra.run.smithi119.stdout: "op_reply": 8561, 2024-06-02T05:06:14.816 INFO:teuthology.orchestra.run.smithi119.stdout: "op_latency": { 2024-06-02T05:06:14.816 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 8561, 2024-06-02T05:06:14.816 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 198.280158769, 2024-06-02T05:06:14.816 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.023160864 2024-06-02T05:06:14.817 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:14.817 INFO:teuthology.orchestra.run.smithi119.stdout: "op_inflight": 0, 2024-06-02T05:06:14.817 INFO:teuthology.orchestra.run.smithi119.stdout: "oplen_avg": { 2024-06-02T05:06:14.817 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 8561, 2024-06-02T05:06:14.817 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 13681 2024-06-02T05:06:14.817 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:14.817 INFO:teuthology.orchestra.run.smithi119.stdout: "op": 8561, 2024-06-02T05:06:14.817 INFO:teuthology.orchestra.run.smithi119.stdout: "op_r": 550, 2024-06-02T05:06:14.817 INFO:teuthology.orchestra.run.smithi119.stdout: "op_w": 8011, 2024-06-02T05:06:14.817 INFO:teuthology.orchestra.run.smithi119.stdout: "op_rmw": 0, 2024-06-02T05:06:14.817 INFO:teuthology.orchestra.run.smithi119.stdout: "op_pg": 0, 2024-06-02T05:06:14.817 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_stat": 1021, 2024-06-02T05:06:14.817 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_create": 1947, 2024-06-02T05:06:14.818 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_read": 70, 2024-06-02T05:06:14.818 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_write": 3672, 2024-06-02T05:06:14.818 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_writefull": 303, 2024-06-02T05:06:14.818 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_writesame": 0, 2024-06-02T05:06:14.818 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_append": 0, 2024-06-02T05:06:14.818 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_zero": 0, 2024-06-02T05:06:14.818 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_truncate": 3, 2024-06-02T05:06:14.818 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_delete": 779, 2024-06-02T05:06:14.818 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_mapext": 0, 2024-06-02T05:06:14.818 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_sparse_read": 0, 2024-06-02T05:06:14.818 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_clonerange": 0, 2024-06-02T05:06:14.818 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_getxattr": 480, 2024-06-02T05:06:14.818 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_setxattr": 2954, 2024-06-02T05:06:14.819 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_cmpxattr": 0, 2024-06-02T05:06:14.819 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_rmxattr": 0, 2024-06-02T05:06:14.819 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_resetxattrs": 0, 2024-06-02T05:06:14.819 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_call": 0, 2024-06-02T05:06:14.819 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_watch": 0, 2024-06-02T05:06:14.819 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_notify": 0, 2024-06-02T05:06:14.819 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_src_cmpxattr": 0, 2024-06-02T05:06:14.819 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_pgls": 0, 2024-06-02T05:06:14.819 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_pgls_filter": 0, 2024-06-02T05:06:14.819 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_other": 0, 2024-06-02T05:06:14.819 INFO:teuthology.orchestra.run.smithi119.stdout: "linger_active": 0, 2024-06-02T05:06:14.819 INFO:teuthology.orchestra.run.smithi119.stdout: "linger_send": 0, 2024-06-02T05:06:14.819 INFO:teuthology.orchestra.run.smithi119.stdout: "linger_resend": 0, 2024-06-02T05:06:14.820 INFO:teuthology.orchestra.run.smithi119.stdout: "linger_ping": 0, 2024-06-02T05:06:14.820 INFO:teuthology.orchestra.run.smithi119.stdout: "poolop_active": 0, 2024-06-02T05:06:14.820 INFO:teuthology.orchestra.run.smithi119.stdout: "poolop_send": 0, 2024-06-02T05:06:14.820 INFO:teuthology.orchestra.run.smithi119.stdout: "poolop_resend": 0, 2024-06-02T05:06:14.820 INFO:teuthology.orchestra.run.smithi119.stdout: "poolstat_active": 0, 2024-06-02T05:06:14.820 INFO:teuthology.orchestra.run.smithi119.stdout: "poolstat_send": 0, 2024-06-02T05:06:14.820 INFO:teuthology.orchestra.run.smithi119.stdout: "poolstat_resend": 0, 2024-06-02T05:06:14.820 INFO:teuthology.orchestra.run.smithi119.stdout: "statfs_active": 0, 2024-06-02T05:06:14.820 INFO:teuthology.orchestra.run.smithi119.stdout: "statfs_send": 0, 2024-06-02T05:06:14.820 INFO:teuthology.orchestra.run.smithi119.stdout: "statfs_resend": 0, 2024-06-02T05:06:14.820 INFO:teuthology.orchestra.run.smithi119.stdout: "command_active": 0, 2024-06-02T05:06:14.820 INFO:teuthology.orchestra.run.smithi119.stdout: "command_send": 0, 2024-06-02T05:06:14.820 INFO:teuthology.orchestra.run.smithi119.stdout: "command_resend": 0, 2024-06-02T05:06:14.821 INFO:teuthology.orchestra.run.smithi119.stdout: "map_epoch": 84, 2024-06-02T05:06:14.821 INFO:teuthology.orchestra.run.smithi119.stdout: "map_full": 0, 2024-06-02T05:06:14.821 INFO:teuthology.orchestra.run.smithi119.stdout: "map_inc": 9, 2024-06-02T05:06:14.821 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_sessions": 12, 2024-06-02T05:06:14.821 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_session_open": 12, 2024-06-02T05:06:14.821 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_session_close": 0, 2024-06-02T05:06:14.821 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_laggy": 0, 2024-06-02T05:06:14.821 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_wr": 2336, 2024-06-02T05:06:14.821 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_rd": 14, 2024-06-02T05:06:14.821 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_del": 102 2024-06-02T05:06:14.821 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:14.821 INFO:teuthology.orchestra.run.smithi119.stdout: "oft": { 2024-06-02T05:06:14.821 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_total_objs": 1, 2024-06-02T05:06:14.821 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_total_kv_pairs": 0, 2024-06-02T05:06:14.822 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_total_updates": 0, 2024-06-02T05:06:14.822 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_total_removes": 0 2024-06-02T05:06:14.822 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:14.822 INFO:teuthology.orchestra.run.smithi119.stdout: "osd-slow-ops": { 2024-06-02T05:06:14.822 INFO:teuthology.orchestra.run.smithi119.stdout: "slow_ops_count": 0 2024-06-02T05:06:14.822 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:14.822 INFO:teuthology.orchestra.run.smithi119.stdout: "purge_queue": { 2024-06-02T05:06:14.822 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_executing_ops": 0, 2024-06-02T05:06:14.822 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_executing_ops_high_water": 23, 2024-06-02T05:06:14.822 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_executing": 0, 2024-06-02T05:06:14.822 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_executing_high_water": 8, 2024-06-02T05:06:14.822 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_executed": 122, 2024-06-02T05:06:14.822 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_item_in_journal": 0 2024-06-02T05:06:14.823 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:14.823 INFO:teuthology.orchestra.run.smithi119.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-06-02T05:06:14.823 INFO:teuthology.orchestra.run.smithi119.stdout: "val": 0, 2024-06-02T05:06:14.823 INFO:teuthology.orchestra.run.smithi119.stdout: "max": 104857600, 2024-06-02T05:06:14.823 INFO:teuthology.orchestra.run.smithi119.stdout: "get_started": 0, 2024-06-02T05:06:14.823 INFO:teuthology.orchestra.run.smithi119.stdout: "get": 34778, 2024-06-02T05:06:14.823 INFO:teuthology.orchestra.run.smithi119.stdout: "get_sum": 7971336, 2024-06-02T05:06:14.823 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_fail": 0, 2024-06-02T05:06:14.823 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_success": 34778, 2024-06-02T05:06:14.823 INFO:teuthology.orchestra.run.smithi119.stdout: "take": 0, 2024-06-02T05:06:14.823 INFO:teuthology.orchestra.run.smithi119.stdout: "take_sum": 0, 2024-06-02T05:06:14.823 INFO:teuthology.orchestra.run.smithi119.stdout: "put": 34778, 2024-06-02T05:06:14.823 INFO:teuthology.orchestra.run.smithi119.stdout: "put_sum": 7971336, 2024-06-02T05:06:14.824 INFO:teuthology.orchestra.run.smithi119.stdout: "wait": { 2024-06-02T05:06:14.824 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-06-02T05:06:14.824 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-06-02T05:06:14.824 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-06-02T05:06:14.824 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-06-02T05:06:14.824 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:14.824 INFO:teuthology.orchestra.run.smithi119.stdout: "throttle-objecter_bytes": { 2024-06-02T05:06:14.824 INFO:teuthology.orchestra.run.smithi119.stdout: "val": 0, 2024-06-02T05:06:14.824 INFO:teuthology.orchestra.run.smithi119.stdout: "max": 104857600, 2024-06-02T05:06:14.824 INFO:teuthology.orchestra.run.smithi119.stdout: "get_started": 0, 2024-06-02T05:06:14.824 INFO:teuthology.orchestra.run.smithi119.stdout: "get": 0, 2024-06-02T05:06:14.824 INFO:teuthology.orchestra.run.smithi119.stdout: "get_sum": 0, 2024-06-02T05:06:14.824 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_fail": 0, 2024-06-02T05:06:14.825 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_success": 0, 2024-06-02T05:06:14.825 INFO:teuthology.orchestra.run.smithi119.stdout: "take": 8561, 2024-06-02T05:06:14.825 INFO:teuthology.orchestra.run.smithi119.stdout: "take_sum": 23533832, 2024-06-02T05:06:14.825 INFO:teuthology.orchestra.run.smithi119.stdout: "put": 8561, 2024-06-02T05:06:14.825 INFO:teuthology.orchestra.run.smithi119.stdout: "put_sum": 23533832, 2024-06-02T05:06:14.825 INFO:teuthology.orchestra.run.smithi119.stdout: "wait": { 2024-06-02T05:06:14.825 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-06-02T05:06:14.825 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-06-02T05:06:14.825 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-06-02T05:06:14.825 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-06-02T05:06:14.825 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:14.825 INFO:teuthology.orchestra.run.smithi119.stdout: "throttle-objecter_ops": { 2024-06-02T05:06:14.825 INFO:teuthology.orchestra.run.smithi119.stdout: "val": 0, 2024-06-02T05:06:14.825 INFO:teuthology.orchestra.run.smithi119.stdout: "max": 1024, 2024-06-02T05:06:14.826 INFO:teuthology.orchestra.run.smithi119.stdout: "get_started": 0, 2024-06-02T05:06:14.826 INFO:teuthology.orchestra.run.smithi119.stdout: "get": 0, 2024-06-02T05:06:14.826 INFO:teuthology.orchestra.run.smithi119.stdout: "get_sum": 0, 2024-06-02T05:06:14.826 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_fail": 0, 2024-06-02T05:06:14.826 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_success": 0, 2024-06-02T05:06:14.826 INFO:teuthology.orchestra.run.smithi119.stdout: "take": 8561, 2024-06-02T05:06:14.826 INFO:teuthology.orchestra.run.smithi119.stdout: "take_sum": 8561, 2024-06-02T05:06:14.826 INFO:teuthology.orchestra.run.smithi119.stdout: "put": 8561, 2024-06-02T05:06:14.826 INFO:teuthology.orchestra.run.smithi119.stdout: "put_sum": 8561, 2024-06-02T05:06:14.826 INFO:teuthology.orchestra.run.smithi119.stdout: "wait": { 2024-06-02T05:06:14.826 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-06-02T05:06:14.826 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-06-02T05:06:14.826 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-06-02T05:06:14.827 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-06-02T05:06:14.827 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:14.827 INFO:teuthology.orchestra.run.smithi119.stdout: "throttle-write_buf_throttle": { 2024-06-02T05:06:14.827 INFO:teuthology.orchestra.run.smithi119.stdout: "val": 0, 2024-06-02T05:06:14.827 INFO:teuthology.orchestra.run.smithi119.stdout: "max": 3758096384, 2024-06-02T05:06:14.827 INFO:teuthology.orchestra.run.smithi119.stdout: "get_started": 0, 2024-06-02T05:06:14.827 INFO:teuthology.orchestra.run.smithi119.stdout: "get": 122, 2024-06-02T05:06:14.827 INFO:teuthology.orchestra.run.smithi119.stdout: "get_sum": 13298, 2024-06-02T05:06:14.827 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_fail": 0, 2024-06-02T05:06:14.827 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_success": 122, 2024-06-02T05:06:14.827 INFO:teuthology.orchestra.run.smithi119.stdout: "take": 0, 2024-06-02T05:06:14.827 INFO:teuthology.orchestra.run.smithi119.stdout: "take_sum": 0, 2024-06-02T05:06:14.827 INFO:teuthology.orchestra.run.smithi119.stdout: "put": 68, 2024-06-02T05:06:14.828 INFO:teuthology.orchestra.run.smithi119.stdout: "put_sum": 13298, 2024-06-02T05:06:14.828 INFO:teuthology.orchestra.run.smithi119.stdout: "wait": { 2024-06-02T05:06:14.828 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-06-02T05:06:14.828 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-06-02T05:06:14.828 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-06-02T05:06:14.828 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-06-02T05:06:14.828 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:14.828 INFO:teuthology.orchestra.run.smithi119.stdout: "throttle-write_buf_throttle-0x55c0611020a0": { 2024-06-02T05:06:14.828 INFO:teuthology.orchestra.run.smithi119.stdout: "val": 0, 2024-06-02T05:06:14.828 INFO:teuthology.orchestra.run.smithi119.stdout: "max": 3758096384, 2024-06-02T05:06:14.828 INFO:teuthology.orchestra.run.smithi119.stdout: "get_started": 0, 2024-06-02T05:06:14.828 INFO:teuthology.orchestra.run.smithi119.stdout: "get": 8393, 2024-06-02T05:06:14.828 INFO:teuthology.orchestra.run.smithi119.stdout: "get_sum": 20552620, 2024-06-02T05:06:14.829 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_fail": 0, 2024-06-02T05:06:14.829 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_success": 8393, 2024-06-02T05:06:14.829 INFO:teuthology.orchestra.run.smithi119.stdout: "take": 0, 2024-06-02T05:06:14.829 INFO:teuthology.orchestra.run.smithi119.stdout: "take_sum": 0, 2024-06-02T05:06:14.829 INFO:teuthology.orchestra.run.smithi119.stdout: "put": 3604, 2024-06-02T05:06:14.829 INFO:teuthology.orchestra.run.smithi119.stdout: "put_sum": 20552620, 2024-06-02T05:06:14.829 INFO:teuthology.orchestra.run.smithi119.stdout: "wait": { 2024-06-02T05:06:14.829 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-06-02T05:06:14.829 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-06-02T05:06:14.829 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-06-02T05:06:14.829 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-06-02T05:06:14.829 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-06-02T05:06:14.829 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-06-02T05:06:15.134 INFO:tasks.check_counter:Daemon mds.b mds.exported=18 2024-06-02T05:06:15.135 INFO:tasks.check_counter:Daemon mds.b mds.imported=6 2024-06-02T05:06:15.135 DEBUG:tasks.check_counter:Getting stats from e 2024-06-02T05:06:15.135 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell --fsid 60ab6d30-209a-11ef-bc9b-c7b262605968 -- ceph daemon mds.e perf dump 2024-06-02T05:06:15.358 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/mon.b/config 2024-06-02T05:06:16.064 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:06:15 smithi119 ceph-mon[46633]: pgmap v768: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 200 KiB/s wr, 48 op/s 2024-06-02T05:06:16.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:06:15 smithi192 ceph-mon[47933]: pgmap v768: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 200 KiB/s wr, 48 op/s 2024-06-02T05:06:16.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:06:15 smithi076 ceph-mon[42935]: pgmap v768: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 200 KiB/s wr, 48 op/s 2024-06-02T05:06:16.262 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-06-02T05:06:16.262 INFO:teuthology.orchestra.run.smithi119.stdout: "AsyncMessenger::Worker-0": { 2024-06-02T05:06:16.263 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_messages": 1316, 2024-06-02T05:06:16.263 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages": 1316, 2024-06-02T05:06:16.263 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_bytes": 3117695, 2024-06-02T05:06:16.263 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_bytes": 408544, 2024-06-02T05:06:16.263 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_created_connections": 7, 2024-06-02T05:06:16.263 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_active_connections": 2, 2024-06-02T05:06:16.263 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_total_time": 0.089210922, 2024-06-02T05:06:16.263 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_send_time": 0.031245199, 2024-06-02T05:06:16.263 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_recv_time": 0.023660156, 2024-06-02T05:06:16.263 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_fast_dispatch_time": 0.025284573, 2024-06-02T05:06:16.263 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T05:06:16.263 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 1315, 2024-06-02T05:06:16.264 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.072448933, 2024-06-02T05:06:16.264 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000055094 2024-06-02T05:06:16.264 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:16.264 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_handle_ack_lat": { 2024-06-02T05:06:16.264 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-06-02T05:06:16.264 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-06-02T05:06:16.264 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-06-02T05:06:16.264 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:16.264 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_encrypted_bytes": 2912, 2024-06-02T05:06:16.264 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_encrypted_bytes": 448 2024-06-02T05:06:16.264 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:16.264 INFO:teuthology.orchestra.run.smithi119.stdout: "AsyncMessenger::Worker-1": { 2024-06-02T05:06:16.264 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_messages": 1000, 2024-06-02T05:06:16.264 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages": 1225, 2024-06-02T05:06:16.265 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_bytes": 245936, 2024-06-02T05:06:16.265 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_bytes": 770998, 2024-06-02T05:06:16.265 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_created_connections": 5, 2024-06-02T05:06:16.265 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_active_connections": 4, 2024-06-02T05:06:16.265 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_total_time": 0.079346348, 2024-06-02T05:06:16.265 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_send_time": 0.025045871, 2024-06-02T05:06:16.265 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_recv_time": 0.016644909, 2024-06-02T05:06:16.265 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_fast_dispatch_time": 0.029748709, 2024-06-02T05:06:16.265 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T05:06:16.265 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 1223, 2024-06-02T05:06:16.265 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.064181959, 2024-06-02T05:06:16.265 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000052479 2024-06-02T05:06:16.266 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:16.266 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_handle_ack_lat": { 2024-06-02T05:06:16.266 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-06-02T05:06:16.266 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-06-02T05:06:16.266 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-06-02T05:06:16.266 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:16.266 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_encrypted_bytes": 160, 2024-06-02T05:06:16.266 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_encrypted_bytes": 460304 2024-06-02T05:06:16.266 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:16.266 INFO:teuthology.orchestra.run.smithi119.stdout: "AsyncMessenger::Worker-2": { 2024-06-02T05:06:16.266 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_messages": 1386, 2024-06-02T05:06:16.266 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages": 1370, 2024-06-02T05:06:16.266 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_bytes": 919296, 2024-06-02T05:06:16.267 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_bytes": 502191, 2024-06-02T05:06:16.267 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_created_connections": 3, 2024-06-02T05:06:16.267 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_active_connections": 2, 2024-06-02T05:06:16.267 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_total_time": 0.130733408, 2024-06-02T05:06:16.267 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_send_time": 0.040984088, 2024-06-02T05:06:16.267 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_recv_time": 0.042558320, 2024-06-02T05:06:16.267 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_fast_dispatch_time": 0.037980296, 2024-06-02T05:06:16.267 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T05:06:16.267 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 1369, 2024-06-02T05:06:16.267 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.083348052, 2024-06-02T05:06:16.267 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000060882 2024-06-02T05:06:16.267 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:16.267 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_handle_ack_lat": { 2024-06-02T05:06:16.268 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-06-02T05:06:16.268 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-06-02T05:06:16.268 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-06-02T05:06:16.268 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:16.268 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_encrypted_bytes": 561456, 2024-06-02T05:06:16.268 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_encrypted_bytes": 170976 2024-06-02T05:06:16.268 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:16.268 INFO:teuthology.orchestra.run.smithi119.stdout: "cct": { 2024-06-02T05:06:16.268 INFO:teuthology.orchestra.run.smithi119.stdout: "total_workers": 1, 2024-06-02T05:06:16.268 INFO:teuthology.orchestra.run.smithi119.stdout: "unhealthy_workers": 0 2024-06-02T05:06:16.268 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:16.268 INFO:teuthology.orchestra.run.smithi119.stdout: "finisher-MDSRank": { 2024-06-02T05:06:16.268 INFO:teuthology.orchestra.run.smithi119.stdout: "queue_len": 0, 2024-06-02T05:06:16.268 INFO:teuthology.orchestra.run.smithi119.stdout: "complete_latency": { 2024-06-02T05:06:16.269 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 5684, 2024-06-02T05:06:16.269 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.128134193, 2024-06-02T05:06:16.269 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000022542 2024-06-02T05:06:16.269 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-06-02T05:06:16.269 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:16.269 INFO:teuthology.orchestra.run.smithi119.stdout: "finisher-PurgeQueue": { 2024-06-02T05:06:16.269 INFO:teuthology.orchestra.run.smithi119.stdout: "queue_len": 0, 2024-06-02T05:06:16.269 INFO:teuthology.orchestra.run.smithi119.stdout: "complete_latency": { 2024-06-02T05:06:16.269 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-06-02T05:06:16.269 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-06-02T05:06:16.269 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-06-02T05:06:16.269 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-06-02T05:06:16.269 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:16.269 INFO:teuthology.orchestra.run.smithi119.stdout: "mds": { 2024-06-02T05:06:16.270 INFO:teuthology.orchestra.run.smithi119.stdout: "request": 0, 2024-06-02T05:06:16.270 INFO:teuthology.orchestra.run.smithi119.stdout: "reply": 0, 2024-06-02T05:06:16.270 INFO:teuthology.orchestra.run.smithi119.stdout: "reply_latency": { 2024-06-02T05:06:16.270 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-06-02T05:06:16.270 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-06-02T05:06:16.270 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-06-02T05:06:16.270 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:16.270 INFO:teuthology.orchestra.run.smithi119.stdout: "slow_reply": 0, 2024-06-02T05:06:16.270 INFO:teuthology.orchestra.run.smithi119.stdout: "forward": 0, 2024-06-02T05:06:16.270 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_fetch_complete": 0, 2024-06-02T05:06:16.270 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_fetch_keys": 0, 2024-06-02T05:06:16.270 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_commit": 0, 2024-06-02T05:06:16.270 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_split": 0, 2024-06-02T05:06:16.271 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_merge": 0, 2024-06-02T05:06:16.271 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes": 590, 2024-06-02T05:06:16.271 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_top": 84, 2024-06-02T05:06:16.271 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_bottom": 506, 2024-06-02T05:06:16.271 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_pin_tail": 0, 2024-06-02T05:06:16.271 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_pinned": 469, 2024-06-02T05:06:16.271 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_expired": 0, 2024-06-02T05:06:16.271 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_with_caps": 0, 2024-06-02T05:06:16.271 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": 0, 2024-06-02T05:06:16.271 INFO:teuthology.orchestra.run.smithi119.stdout: "subtrees": 13, 2024-06-02T05:06:16.271 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse": 0, 2024-06-02T05:06:16.271 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_hit": 0, 2024-06-02T05:06:16.271 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_forward": 0, 2024-06-02T05:06:16.272 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_discover": 0, 2024-06-02T05:06:16.272 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_dir_fetch": 0, 2024-06-02T05:06:16.272 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_remote_ino": 0, 2024-06-02T05:06:16.272 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_lock": 0, 2024-06-02T05:06:16.272 INFO:teuthology.orchestra.run.smithi119.stdout: "load_cent": 0, 2024-06-02T05:06:16.272 INFO:teuthology.orchestra.run.smithi119.stdout: "q": 0, 2024-06-02T05:06:16.272 INFO:teuthology.orchestra.run.smithi119.stdout: "exported": 0, 2024-06-02T05:06:16.272 INFO:teuthology.orchestra.run.smithi119.stdout: "exported_inodes": 0, 2024-06-02T05:06:16.272 INFO:teuthology.orchestra.run.smithi119.stdout: "imported": 0, 2024-06-02T05:06:16.272 INFO:teuthology.orchestra.run.smithi119.stdout: "imported_inodes": 0, 2024-06-02T05:06:16.272 INFO:teuthology.orchestra.run.smithi119.stdout: "openino_dir_fetch": 0, 2024-06-02T05:06:16.272 INFO:teuthology.orchestra.run.smithi119.stdout: "openino_backtrace_fetch": 0, 2024-06-02T05:06:16.272 INFO:teuthology.orchestra.run.smithi119.stdout: "openino_peer_discover": 0, 2024-06-02T05:06:16.273 INFO:teuthology.orchestra.run.smithi119.stdout: "root_rfiles": 0, 2024-06-02T05:06:16.273 INFO:teuthology.orchestra.run.smithi119.stdout: "root_rbytes": 0, 2024-06-02T05:06:16.273 INFO:teuthology.orchestra.run.smithi119.stdout: "root_rsnaps": 0, 2024-06-02T05:06:16.273 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_backtrace_fetch": 0, 2024-06-02T05:06:16.273 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_set_tag": 0, 2024-06-02T05:06:16.273 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_backtrace_repaired": 0, 2024-06-02T05:06:16.273 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_inotable_repaired": 0, 2024-06-02T05:06:16.273 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_dir_inodes": 0, 2024-06-02T05:06:16.273 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_dir_base_inodes": 0, 2024-06-02T05:06:16.273 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_dirfrag_rstats": 0, 2024-06-02T05:06:16.273 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_file_inodes": 0, 2024-06-02T05:06:16.273 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_inode_file_caps": 0, 2024-06-02T05:06:16.273 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_cap_op_revoke": 0, 2024-06-02T05:06:16.273 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_cap_op_grant": 0, 2024-06-02T05:06:16.274 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_cap_op_trunc": 0, 2024-06-02T05:06:16.274 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-06-02T05:06:16.274 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_cap_op_flush_ack": 0, 2024-06-02T05:06:16.274 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_client_caps": 0, 2024-06-02T05:06:16.274 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_client_caps_dirty": 0, 2024-06-02T05:06:16.274 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_client_cap_release": 0, 2024-06-02T05:06:16.274 INFO:teuthology.orchestra.run.smithi119.stdout: "process_request_cap_release": 0 2024-06-02T05:06:16.274 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:16.274 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_cache": { 2024-06-02T05:06:16.274 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_update": 0, 2024-06-02T05:06:16.274 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_update_receipt": 0, 2024-06-02T05:06:16.274 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_try_discover": 0, 2024-06-02T05:06:16.275 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_send_discover": 0, 2024-06-02T05:06:16.275 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_handle_discover": 0, 2024-06-02T05:06:16.275 INFO:teuthology.orchestra.run.smithi119.stdout: "num_strays": 0, 2024-06-02T05:06:16.275 INFO:teuthology.orchestra.run.smithi119.stdout: "num_strays_delayed": 0, 2024-06-02T05:06:16.275 INFO:teuthology.orchestra.run.smithi119.stdout: "num_strays_enqueuing": 0, 2024-06-02T05:06:16.275 INFO:teuthology.orchestra.run.smithi119.stdout: "strays_created": 0, 2024-06-02T05:06:16.275 INFO:teuthology.orchestra.run.smithi119.stdout: "strays_enqueued": 0, 2024-06-02T05:06:16.275 INFO:teuthology.orchestra.run.smithi119.stdout: "strays_reintegrated": 0, 2024-06-02T05:06:16.275 INFO:teuthology.orchestra.run.smithi119.stdout: "strays_migrated": 0, 2024-06-02T05:06:16.275 INFO:teuthology.orchestra.run.smithi119.stdout: "num_recovering_processing": 0, 2024-06-02T05:06:16.275 INFO:teuthology.orchestra.run.smithi119.stdout: "num_recovering_enqueued": 0, 2024-06-02T05:06:16.275 INFO:teuthology.orchestra.run.smithi119.stdout: "num_recovering_prioritized": 0, 2024-06-02T05:06:16.275 INFO:teuthology.orchestra.run.smithi119.stdout: "recovery_started": 0, 2024-06-02T05:06:16.275 INFO:teuthology.orchestra.run.smithi119.stdout: "recovery_completed": 0, 2024-06-02T05:06:16.276 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_enqueue_scrub": 0, 2024-06-02T05:06:16.276 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_exportdir": 0, 2024-06-02T05:06:16.276 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_flush": 0, 2024-06-02T05:06:16.276 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_fragmentdir": 0, 2024-06-02T05:06:16.276 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_fragstats": 0, 2024-06-02T05:06:16.276 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_inodestats": 0 2024-06-02T05:06:16.276 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:16.276 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_log": { 2024-06-02T05:06:16.276 INFO:teuthology.orchestra.run.smithi119.stdout: "evadd": 0, 2024-06-02T05:06:16.276 INFO:teuthology.orchestra.run.smithi119.stdout: "evex": 0, 2024-06-02T05:06:16.276 INFO:teuthology.orchestra.run.smithi119.stdout: "evtrm": 0, 2024-06-02T05:06:16.276 INFO:teuthology.orchestra.run.smithi119.stdout: "ev": 2289, 2024-06-02T05:06:16.276 INFO:teuthology.orchestra.run.smithi119.stdout: "evexg": 0, 2024-06-02T05:06:16.276 INFO:teuthology.orchestra.run.smithi119.stdout: "evexd": 0, 2024-06-02T05:06:16.277 INFO:teuthology.orchestra.run.smithi119.stdout: "segadd": 0, 2024-06-02T05:06:16.277 INFO:teuthology.orchestra.run.smithi119.stdout: "segex": 0, 2024-06-02T05:06:16.277 INFO:teuthology.orchestra.run.smithi119.stdout: "segtrm": 0, 2024-06-02T05:06:16.277 INFO:teuthology.orchestra.run.smithi119.stdout: "seg": 3, 2024-06-02T05:06:16.277 INFO:teuthology.orchestra.run.smithi119.stdout: "segexg": 0, 2024-06-02T05:06:16.277 INFO:teuthology.orchestra.run.smithi119.stdout: "segexd": 0, 2024-06-02T05:06:16.277 INFO:teuthology.orchestra.run.smithi119.stdout: "expos": 4194304, 2024-06-02T05:06:16.277 INFO:teuthology.orchestra.run.smithi119.stdout: "wrpos": 6968608, 2024-06-02T05:06:16.277 INFO:teuthology.orchestra.run.smithi119.stdout: "rdpos": 6968034, 2024-06-02T05:06:16.277 INFO:teuthology.orchestra.run.smithi119.stdout: "jlat": { 2024-06-02T05:06:16.277 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-06-02T05:06:16.277 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-06-02T05:06:16.277 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-06-02T05:06:16.277 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:16.277 INFO:teuthology.orchestra.run.smithi119.stdout: "replayed": 2289 2024-06-02T05:06:16.278 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:16.278 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_mem": { 2024-06-02T05:06:16.278 INFO:teuthology.orchestra.run.smithi119.stdout: "ino": 453, 2024-06-02T05:06:16.278 INFO:teuthology.orchestra.run.smithi119.stdout: "ino+": 589, 2024-06-02T05:06:16.278 INFO:teuthology.orchestra.run.smithi119.stdout: "ino-": 136, 2024-06-02T05:06:16.278 INFO:teuthology.orchestra.run.smithi119.stdout: "dir": 23, 2024-06-02T05:06:16.278 INFO:teuthology.orchestra.run.smithi119.stdout: "dir+": 24, 2024-06-02T05:06:16.278 INFO:teuthology.orchestra.run.smithi119.stdout: "dir-": 1, 2024-06-02T05:06:16.278 INFO:teuthology.orchestra.run.smithi119.stdout: "dn": 590, 2024-06-02T05:06:16.278 INFO:teuthology.orchestra.run.smithi119.stdout: "dn+": 597, 2024-06-02T05:06:16.278 INFO:teuthology.orchestra.run.smithi119.stdout: "dn-": 7, 2024-06-02T05:06:16.278 INFO:teuthology.orchestra.run.smithi119.stdout: "cap": 0, 2024-06-02T05:06:16.278 INFO:teuthology.orchestra.run.smithi119.stdout: "cap+": 0, 2024-06-02T05:06:16.278 INFO:teuthology.orchestra.run.smithi119.stdout: "cap-": 0, 2024-06-02T05:06:16.278 INFO:teuthology.orchestra.run.smithi119.stdout: "rss": 49980, 2024-06-02T05:06:16.279 INFO:teuthology.orchestra.run.smithi119.stdout: "heap": 207156 2024-06-02T05:06:16.279 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:16.279 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_server": { 2024-06-02T05:06:16.279 INFO:teuthology.orchestra.run.smithi119.stdout: "dispatch_client_request": 0, 2024-06-02T05:06:16.279 INFO:teuthology.orchestra.run.smithi119.stdout: "dispatch_server_request": 0, 2024-06-02T05:06:16.279 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_client_request": 0, 2024-06-02T05:06:16.279 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_client_session": 0, 2024-06-02T05:06:16.279 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_peer_request": 0, 2024-06-02T05:06:16.279 INFO:teuthology.orchestra.run.smithi119.stdout: "req_create_latency": { 2024-06-02T05:06:16.279 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-06-02T05:06:16.279 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-06-02T05:06:16.279 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-06-02T05:06:16.279 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:16.279 INFO:teuthology.orchestra.run.smithi119.stdout: "req_getattr_latency": { 2024-06-02T05:06:16.279 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-06-02T05:06:16.280 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-06-02T05:06:16.280 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-06-02T05:06:16.280 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:16.280 INFO:teuthology.orchestra.run.smithi119.stdout: "req_getfilelock_latency": { 2024-06-02T05:06:16.280 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-06-02T05:06:16.280 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-06-02T05:06:16.280 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-06-02T05:06:16.280 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:16.280 INFO:teuthology.orchestra.run.smithi119.stdout: "req_link_latency": { 2024-06-02T05:06:16.280 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-06-02T05:06:16.280 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-06-02T05:06:16.280 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-06-02T05:06:16.280 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:16.280 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookup_latency": { 2024-06-02T05:06:16.281 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-06-02T05:06:16.281 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-06-02T05:06:16.281 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-06-02T05:06:16.281 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:16.281 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookuphash_latency": { 2024-06-02T05:06:16.281 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-06-02T05:06:16.281 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-06-02T05:06:16.281 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-06-02T05:06:16.281 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:16.281 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookupino_latency": { 2024-06-02T05:06:16.281 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-06-02T05:06:16.281 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-06-02T05:06:16.281 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-06-02T05:06:16.281 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:16.282 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookupname_latency": { 2024-06-02T05:06:16.282 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-06-02T05:06:16.282 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-06-02T05:06:16.282 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-06-02T05:06:16.282 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:16.282 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookupparent_latency": { 2024-06-02T05:06:16.282 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-06-02T05:06:16.282 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-06-02T05:06:16.282 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-06-02T05:06:16.282 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:16.282 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookupsnap_latency": { 2024-06-02T05:06:16.282 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-06-02T05:06:16.282 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-06-02T05:06:16.283 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-06-02T05:06:16.283 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:16.283 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lssnap_latency": { 2024-06-02T05:06:16.283 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-06-02T05:06:16.283 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-06-02T05:06:16.283 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-06-02T05:06:16.283 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:16.283 INFO:teuthology.orchestra.run.smithi119.stdout: "req_mkdir_latency": { 2024-06-02T05:06:16.283 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-06-02T05:06:16.283 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-06-02T05:06:16.283 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-06-02T05:06:16.283 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:16.283 INFO:teuthology.orchestra.run.smithi119.stdout: "req_mknod_latency": { 2024-06-02T05:06:16.284 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-06-02T05:06:16.284 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-06-02T05:06:16.284 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-06-02T05:06:16.284 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:16.284 INFO:teuthology.orchestra.run.smithi119.stdout: "req_mksnap_latency": { 2024-06-02T05:06:16.284 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-06-02T05:06:16.284 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-06-02T05:06:16.284 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-06-02T05:06:16.284 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:16.284 INFO:teuthology.orchestra.run.smithi119.stdout: "req_open_latency": { 2024-06-02T05:06:16.284 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-06-02T05:06:16.284 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-06-02T05:06:16.284 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-06-02T05:06:16.284 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:16.285 INFO:teuthology.orchestra.run.smithi119.stdout: "req_readdir_latency": { 2024-06-02T05:06:16.285 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-06-02T05:06:16.285 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-06-02T05:06:16.285 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-06-02T05:06:16.285 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:16.285 INFO:teuthology.orchestra.run.smithi119.stdout: "req_rename_latency": { 2024-06-02T05:06:16.285 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-06-02T05:06:16.285 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-06-02T05:06:16.285 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-06-02T05:06:16.285 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:16.285 INFO:teuthology.orchestra.run.smithi119.stdout: "req_renamesnap_latency": { 2024-06-02T05:06:16.285 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-06-02T05:06:16.285 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-06-02T05:06:16.286 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-06-02T05:06:16.286 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:16.286 INFO:teuthology.orchestra.run.smithi119.stdout: "req_snapdiff_latency": { 2024-06-02T05:06:16.286 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-06-02T05:06:16.286 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-06-02T05:06:16.286 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-06-02T05:06:16.286 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:16.286 INFO:teuthology.orchestra.run.smithi119.stdout: "req_rmdir_latency": { 2024-06-02T05:06:16.286 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-06-02T05:06:16.286 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-06-02T05:06:16.286 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-06-02T05:06:16.286 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:16.286 INFO:teuthology.orchestra.run.smithi119.stdout: "req_rmsnap_latency": { 2024-06-02T05:06:16.287 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-06-02T05:06:16.287 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-06-02T05:06:16.287 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-06-02T05:06:16.287 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:16.287 INFO:teuthology.orchestra.run.smithi119.stdout: "req_rmxattr_latency": { 2024-06-02T05:06:16.287 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-06-02T05:06:16.287 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-06-02T05:06:16.287 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-06-02T05:06:16.287 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:16.287 INFO:teuthology.orchestra.run.smithi119.stdout: "req_setattr_latency": { 2024-06-02T05:06:16.287 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-06-02T05:06:16.287 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-06-02T05:06:16.287 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-06-02T05:06:16.288 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:16.288 INFO:teuthology.orchestra.run.smithi119.stdout: "req_setdirlayout_latency": { 2024-06-02T05:06:16.288 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-06-02T05:06:16.288 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-06-02T05:06:16.288 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-06-02T05:06:16.288 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:16.288 INFO:teuthology.orchestra.run.smithi119.stdout: "req_setfilelock_latency": { 2024-06-02T05:06:16.288 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-06-02T05:06:16.288 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-06-02T05:06:16.288 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-06-02T05:06:16.288 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:16.288 INFO:teuthology.orchestra.run.smithi119.stdout: "req_setlayout_latency": { 2024-06-02T05:06:16.288 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-06-02T05:06:16.288 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-06-02T05:06:16.289 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-06-02T05:06:16.289 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:16.289 INFO:teuthology.orchestra.run.smithi119.stdout: "req_setxattr_latency": { 2024-06-02T05:06:16.289 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-06-02T05:06:16.289 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-06-02T05:06:16.289 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-06-02T05:06:16.289 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:16.289 INFO:teuthology.orchestra.run.smithi119.stdout: "req_symlink_latency": { 2024-06-02T05:06:16.289 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-06-02T05:06:16.289 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-06-02T05:06:16.289 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-06-02T05:06:16.289 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:16.289 INFO:teuthology.orchestra.run.smithi119.stdout: "req_unlink_latency": { 2024-06-02T05:06:16.290 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-06-02T05:06:16.290 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-06-02T05:06:16.290 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-06-02T05:06:16.290 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:16.290 INFO:teuthology.orchestra.run.smithi119.stdout: "cap_revoke_eviction": 0, 2024-06-02T05:06:16.290 INFO:teuthology.orchestra.run.smithi119.stdout: "cap_acquisition_throttle": 0, 2024-06-02T05:06:16.290 INFO:teuthology.orchestra.run.smithi119.stdout: "req_getvxattr_latency": { 2024-06-02T05:06:16.290 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-06-02T05:06:16.290 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-06-02T05:06:16.290 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-06-02T05:06:16.290 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-06-02T05:06:16.290 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:16.290 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_sessions": { 2024-06-02T05:06:16.290 INFO:teuthology.orchestra.run.smithi119.stdout: "session_count": 1, 2024-06-02T05:06:16.291 INFO:teuthology.orchestra.run.smithi119.stdout: "session_add": 2, 2024-06-02T05:06:16.291 INFO:teuthology.orchestra.run.smithi119.stdout: "session_remove": 1, 2024-06-02T05:06:16.291 INFO:teuthology.orchestra.run.smithi119.stdout: "sessions_open": 2, 2024-06-02T05:06:16.291 INFO:teuthology.orchestra.run.smithi119.stdout: "sessions_stale": 0, 2024-06-02T05:06:16.291 INFO:teuthology.orchestra.run.smithi119.stdout: "total_load": 0, 2024-06-02T05:06:16.291 INFO:teuthology.orchestra.run.smithi119.stdout: "average_load": 0, 2024-06-02T05:06:16.291 INFO:teuthology.orchestra.run.smithi119.stdout: "avg_session_uptime": 3807, 2024-06-02T05:06:16.291 INFO:teuthology.orchestra.run.smithi119.stdout: "mdthresh_evicted": 0 2024-06-02T05:06:16.291 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:16.291 INFO:teuthology.orchestra.run.smithi119.stdout: "mempool": { 2024-06-02T05:06:16.291 INFO:teuthology.orchestra.run.smithi119.stdout: "bloom_filter_bytes": 0, 2024-06-02T05:06:16.291 INFO:teuthology.orchestra.run.smithi119.stdout: "bloom_filter_items": 0, 2024-06-02T05:06:16.292 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_alloc_bytes": 0, 2024-06-02T05:06:16.292 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_alloc_items": 0, 2024-06-02T05:06:16.292 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_data_bytes": 0, 2024-06-02T05:06:16.292 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_data_items": 0, 2024-06-02T05:06:16.292 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_onode_bytes": 0, 2024-06-02T05:06:16.292 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_onode_items": 0, 2024-06-02T05:06:16.292 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_meta_bytes": 0, 2024-06-02T05:06:16.292 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_meta_items": 0, 2024-06-02T05:06:16.292 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_other_bytes": 0, 2024-06-02T05:06:16.292 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_other_items": 0, 2024-06-02T05:06:16.292 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_buffer_bytes": 0, 2024-06-02T05:06:16.292 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_buffer_items": 0, 2024-06-02T05:06:16.292 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_extent_bytes": 0, 2024-06-02T05:06:16.292 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_extent_items": 0, 2024-06-02T05:06:16.293 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_blob_bytes": 0, 2024-06-02T05:06:16.293 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_blob_items": 0, 2024-06-02T05:06:16.293 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_shared_blob_bytes": 0, 2024-06-02T05:06:16.293 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_shared_blob_items": 0, 2024-06-02T05:06:16.293 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_inline_bl_bytes": 0, 2024-06-02T05:06:16.293 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_inline_bl_items": 0, 2024-06-02T05:06:16.293 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_fsck_bytes": 0, 2024-06-02T05:06:16.293 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_fsck_items": 0, 2024-06-02T05:06:16.293 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_txc_bytes": 0, 2024-06-02T05:06:16.293 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_txc_items": 0, 2024-06-02T05:06:16.293 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_writing_deferred_bytes": 0, 2024-06-02T05:06:16.293 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_writing_deferred_items": 0, 2024-06-02T05:06:16.294 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_writing_bytes": 0, 2024-06-02T05:06:16.294 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_writing_items": 0, 2024-06-02T05:06:16.294 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_bytes": 0, 2024-06-02T05:06:16.294 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_items": 0, 2024-06-02T05:06:16.294 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_file_reader_bytes": 0, 2024-06-02T05:06:16.294 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_file_reader_items": 0, 2024-06-02T05:06:16.294 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_file_writer_bytes": 0, 2024-06-02T05:06:16.294 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_file_writer_items": 0, 2024-06-02T05:06:16.294 INFO:teuthology.orchestra.run.smithi119.stdout: "buffer_anon_bytes": 190184, 2024-06-02T05:06:16.294 INFO:teuthology.orchestra.run.smithi119.stdout: "buffer_anon_items": 53, 2024-06-02T05:06:16.294 INFO:teuthology.orchestra.run.smithi119.stdout: "buffer_meta_bytes": 0, 2024-06-02T05:06:16.294 INFO:teuthology.orchestra.run.smithi119.stdout: "buffer_meta_items": 0, 2024-06-02T05:06:16.294 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_bytes": 0, 2024-06-02T05:06:16.295 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_items": 0, 2024-06-02T05:06:16.295 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_mapbl_bytes": 0, 2024-06-02T05:06:16.295 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_mapbl_items": 0, 2024-06-02T05:06:16.295 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_pglog_bytes": 0, 2024-06-02T05:06:16.295 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_pglog_items": 0, 2024-06-02T05:06:16.295 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_bytes": 8800, 2024-06-02T05:06:16.295 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_items": 169, 2024-06-02T05:06:16.295 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_mapping_bytes": 0, 2024-06-02T05:06:16.295 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_mapping_items": 0, 2024-06-02T05:06:16.295 INFO:teuthology.orchestra.run.smithi119.stdout: "pgmap_bytes": 0, 2024-06-02T05:06:16.295 INFO:teuthology.orchestra.run.smithi119.stdout: "pgmap_items": 0, 2024-06-02T05:06:16.295 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_co_bytes": 1370334, 2024-06-02T05:06:16.295 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_co_items": 4137, 2024-06-02T05:06:16.295 INFO:teuthology.orchestra.run.smithi119.stdout: "unittest_1_bytes": 0, 2024-06-02T05:06:16.296 INFO:teuthology.orchestra.run.smithi119.stdout: "unittest_1_items": 0, 2024-06-02T05:06:16.296 INFO:teuthology.orchestra.run.smithi119.stdout: "unittest_2_bytes": 0, 2024-06-02T05:06:16.296 INFO:teuthology.orchestra.run.smithi119.stdout: "unittest_2_items": 0 2024-06-02T05:06:16.296 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:16.296 INFO:teuthology.orchestra.run.smithi119.stdout: "objecter": { 2024-06-02T05:06:16.296 INFO:teuthology.orchestra.run.smithi119.stdout: "op_active": 0, 2024-06-02T05:06:16.296 INFO:teuthology.orchestra.run.smithi119.stdout: "op_laggy": 0, 2024-06-02T05:06:16.296 INFO:teuthology.orchestra.run.smithi119.stdout: "op_send": 3376, 2024-06-02T05:06:16.296 INFO:teuthology.orchestra.run.smithi119.stdout: "op_send_bytes": 21, 2024-06-02T05:06:16.296 INFO:teuthology.orchestra.run.smithi119.stdout: "op_resend": 3, 2024-06-02T05:06:16.296 INFO:teuthology.orchestra.run.smithi119.stdout: "op_reply": 3376, 2024-06-02T05:06:16.296 INFO:teuthology.orchestra.run.smithi119.stdout: "op_latency": { 2024-06-02T05:06:16.296 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 3376, 2024-06-02T05:06:16.297 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 2.956929168, 2024-06-02T05:06:16.297 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000875867 2024-06-02T05:06:16.297 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:16.297 INFO:teuthology.orchestra.run.smithi119.stdout: "op_inflight": 0, 2024-06-02T05:06:16.297 INFO:teuthology.orchestra.run.smithi119.stdout: "oplen_avg": { 2024-06-02T05:06:16.297 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 3376, 2024-06-02T05:06:16.297 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 3377 2024-06-02T05:06:16.297 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:16.297 INFO:teuthology.orchestra.run.smithi119.stdout: "op": 3376, 2024-06-02T05:06:16.297 INFO:teuthology.orchestra.run.smithi119.stdout: "op_r": 3376, 2024-06-02T05:06:16.297 INFO:teuthology.orchestra.run.smithi119.stdout: "op_w": 0, 2024-06-02T05:06:16.297 INFO:teuthology.orchestra.run.smithi119.stdout: "op_rmw": 0, 2024-06-02T05:06:16.297 INFO:teuthology.orchestra.run.smithi119.stdout: "op_pg": 0, 2024-06-02T05:06:16.297 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_stat": 2062, 2024-06-02T05:06:16.298 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_create": 0, 2024-06-02T05:06:16.298 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_read": 1312, 2024-06-02T05:06:16.298 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_write": 0, 2024-06-02T05:06:16.298 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_writefull": 0, 2024-06-02T05:06:16.298 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_writesame": 0, 2024-06-02T05:06:16.298 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_append": 0, 2024-06-02T05:06:16.298 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_zero": 0, 2024-06-02T05:06:16.298 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_truncate": 0, 2024-06-02T05:06:16.298 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_delete": 0, 2024-06-02T05:06:16.298 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_mapext": 0, 2024-06-02T05:06:16.298 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_sparse_read": 0, 2024-06-02T05:06:16.298 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_clonerange": 0, 2024-06-02T05:06:16.298 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_getxattr": 1, 2024-06-02T05:06:16.299 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_setxattr": 0, 2024-06-02T05:06:16.299 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_cmpxattr": 0, 2024-06-02T05:06:16.299 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_rmxattr": 0, 2024-06-02T05:06:16.299 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_resetxattrs": 0, 2024-06-02T05:06:16.299 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_call": 0, 2024-06-02T05:06:16.299 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_watch": 0, 2024-06-02T05:06:16.299 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_notify": 0, 2024-06-02T05:06:16.299 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_src_cmpxattr": 0, 2024-06-02T05:06:16.299 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_pgls": 0, 2024-06-02T05:06:16.299 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_pgls_filter": 0, 2024-06-02T05:06:16.299 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_other": 0, 2024-06-02T05:06:16.299 INFO:teuthology.orchestra.run.smithi119.stdout: "linger_active": 0, 2024-06-02T05:06:16.299 INFO:teuthology.orchestra.run.smithi119.stdout: "linger_send": 0, 2024-06-02T05:06:16.300 INFO:teuthology.orchestra.run.smithi119.stdout: "linger_resend": 0, 2024-06-02T05:06:16.300 INFO:teuthology.orchestra.run.smithi119.stdout: "linger_ping": 0, 2024-06-02T05:06:16.300 INFO:teuthology.orchestra.run.smithi119.stdout: "poolop_active": 0, 2024-06-02T05:06:16.300 INFO:teuthology.orchestra.run.smithi119.stdout: "poolop_send": 0, 2024-06-02T05:06:16.300 INFO:teuthology.orchestra.run.smithi119.stdout: "poolop_resend": 0, 2024-06-02T05:06:16.300 INFO:teuthology.orchestra.run.smithi119.stdout: "poolstat_active": 0, 2024-06-02T05:06:16.300 INFO:teuthology.orchestra.run.smithi119.stdout: "poolstat_send": 0, 2024-06-02T05:06:16.300 INFO:teuthology.orchestra.run.smithi119.stdout: "poolstat_resend": 0, 2024-06-02T05:06:16.300 INFO:teuthology.orchestra.run.smithi119.stdout: "statfs_active": 0, 2024-06-02T05:06:16.300 INFO:teuthology.orchestra.run.smithi119.stdout: "statfs_send": 0, 2024-06-02T05:06:16.300 INFO:teuthology.orchestra.run.smithi119.stdout: "statfs_resend": 0, 2024-06-02T05:06:16.300 INFO:teuthology.orchestra.run.smithi119.stdout: "command_active": 0, 2024-06-02T05:06:16.300 INFO:teuthology.orchestra.run.smithi119.stdout: "command_send": 0, 2024-06-02T05:06:16.300 INFO:teuthology.orchestra.run.smithi119.stdout: "command_resend": 0, 2024-06-02T05:06:16.300 INFO:teuthology.orchestra.run.smithi119.stdout: "map_epoch": 84, 2024-06-02T05:06:16.301 INFO:teuthology.orchestra.run.smithi119.stdout: "map_full": 0, 2024-06-02T05:06:16.301 INFO:teuthology.orchestra.run.smithi119.stdout: "map_inc": 4, 2024-06-02T05:06:16.301 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_sessions": 5, 2024-06-02T05:06:16.301 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_session_open": 6, 2024-06-02T05:06:16.301 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_session_close": 1, 2024-06-02T05:06:16.301 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_laggy": 0, 2024-06-02T05:06:16.301 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_wr": 0, 2024-06-02T05:06:16.301 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_rd": 2, 2024-06-02T05:06:16.301 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_del": 0 2024-06-02T05:06:16.301 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:16.301 INFO:teuthology.orchestra.run.smithi119.stdout: "oft": { 2024-06-02T05:06:16.301 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_total_objs": 0, 2024-06-02T05:06:16.301 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_total_kv_pairs": 0, 2024-06-02T05:06:16.302 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_total_updates": 0, 2024-06-02T05:06:16.302 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_total_removes": 0 2024-06-02T05:06:16.302 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:16.302 INFO:teuthology.orchestra.run.smithi119.stdout: "osd-slow-ops": { 2024-06-02T05:06:16.302 INFO:teuthology.orchestra.run.smithi119.stdout: "slow_ops_count": 0 2024-06-02T05:06:16.302 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:16.302 INFO:teuthology.orchestra.run.smithi119.stdout: "purge_queue": { 2024-06-02T05:06:16.302 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_executing_ops": 0, 2024-06-02T05:06:16.302 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_executing_ops_high_water": 0, 2024-06-02T05:06:16.302 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_executing": 0, 2024-06-02T05:06:16.302 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_executing_high_water": 0, 2024-06-02T05:06:16.302 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_executed": 0, 2024-06-02T05:06:16.302 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_item_in_journal": 0 2024-06-02T05:06:16.302 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:16.303 INFO:teuthology.orchestra.run.smithi119.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-06-02T05:06:16.303 INFO:teuthology.orchestra.run.smithi119.stdout: "val": 0, 2024-06-02T05:06:16.303 INFO:teuthology.orchestra.run.smithi119.stdout: "max": 104857600, 2024-06-02T05:06:16.303 INFO:teuthology.orchestra.run.smithi119.stdout: "get_started": 0, 2024-06-02T05:06:16.303 INFO:teuthology.orchestra.run.smithi119.stdout: "get": 3698, 2024-06-02T05:06:16.303 INFO:teuthology.orchestra.run.smithi119.stdout: "get_sum": 3930687, 2024-06-02T05:06:16.303 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_fail": 0, 2024-06-02T05:06:16.303 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_success": 3698, 2024-06-02T05:06:16.303 INFO:teuthology.orchestra.run.smithi119.stdout: "take": 0, 2024-06-02T05:06:16.303 INFO:teuthology.orchestra.run.smithi119.stdout: "take_sum": 0, 2024-06-02T05:06:16.303 INFO:teuthology.orchestra.run.smithi119.stdout: "put": 3698, 2024-06-02T05:06:16.303 INFO:teuthology.orchestra.run.smithi119.stdout: "put_sum": 3930687, 2024-06-02T05:06:16.303 INFO:teuthology.orchestra.run.smithi119.stdout: "wait": { 2024-06-02T05:06:16.303 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-06-02T05:06:16.304 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-06-02T05:06:16.304 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-06-02T05:06:16.304 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-06-02T05:06:16.304 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:16.304 INFO:teuthology.orchestra.run.smithi119.stdout: "throttle-objecter_bytes": { 2024-06-02T05:06:16.304 INFO:teuthology.orchestra.run.smithi119.stdout: "val": 0, 2024-06-02T05:06:16.304 INFO:teuthology.orchestra.run.smithi119.stdout: "max": 104857600, 2024-06-02T05:06:16.304 INFO:teuthology.orchestra.run.smithi119.stdout: "get_started": 0, 2024-06-02T05:06:16.304 INFO:teuthology.orchestra.run.smithi119.stdout: "get": 0, 2024-06-02T05:06:16.304 INFO:teuthology.orchestra.run.smithi119.stdout: "get_sum": 0, 2024-06-02T05:06:16.304 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_fail": 0, 2024-06-02T05:06:16.304 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_success": 0, 2024-06-02T05:06:16.304 INFO:teuthology.orchestra.run.smithi119.stdout: "take": 3376, 2024-06-02T05:06:16.304 INFO:teuthology.orchestra.run.smithi119.stdout: "take_sum": 2774309, 2024-06-02T05:06:16.305 INFO:teuthology.orchestra.run.smithi119.stdout: "put": 3376, 2024-06-02T05:06:16.305 INFO:teuthology.orchestra.run.smithi119.stdout: "put_sum": 2774309, 2024-06-02T05:06:16.305 INFO:teuthology.orchestra.run.smithi119.stdout: "wait": { 2024-06-02T05:06:16.305 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-06-02T05:06:16.305 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-06-02T05:06:16.305 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-06-02T05:06:16.305 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-06-02T05:06:16.305 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:16.305 INFO:teuthology.orchestra.run.smithi119.stdout: "throttle-objecter_ops": { 2024-06-02T05:06:16.305 INFO:teuthology.orchestra.run.smithi119.stdout: "val": 0, 2024-06-02T05:06:16.305 INFO:teuthology.orchestra.run.smithi119.stdout: "max": 1024, 2024-06-02T05:06:16.305 INFO:teuthology.orchestra.run.smithi119.stdout: "get_started": 0, 2024-06-02T05:06:16.305 INFO:teuthology.orchestra.run.smithi119.stdout: "get": 0, 2024-06-02T05:06:16.305 INFO:teuthology.orchestra.run.smithi119.stdout: "get_sum": 0, 2024-06-02T05:06:16.306 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_fail": 0, 2024-06-02T05:06:16.306 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_success": 0, 2024-06-02T05:06:16.306 INFO:teuthology.orchestra.run.smithi119.stdout: "take": 3376, 2024-06-02T05:06:16.306 INFO:teuthology.orchestra.run.smithi119.stdout: "take_sum": 3376, 2024-06-02T05:06:16.306 INFO:teuthology.orchestra.run.smithi119.stdout: "put": 3376, 2024-06-02T05:06:16.306 INFO:teuthology.orchestra.run.smithi119.stdout: "put_sum": 3376, 2024-06-02T05:06:16.306 INFO:teuthology.orchestra.run.smithi119.stdout: "wait": { 2024-06-02T05:06:16.306 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-06-02T05:06:16.306 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-06-02T05:06:16.306 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-06-02T05:06:16.306 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-06-02T05:06:16.306 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:16.306 INFO:teuthology.orchestra.run.smithi119.stdout: "throttle-write_buf_throttle": { 2024-06-02T05:06:16.307 INFO:teuthology.orchestra.run.smithi119.stdout: "val": 0, 2024-06-02T05:06:16.307 INFO:teuthology.orchestra.run.smithi119.stdout: "max": 3758096384, 2024-06-02T05:06:16.307 INFO:teuthology.orchestra.run.smithi119.stdout: "get_started": 0, 2024-06-02T05:06:16.307 INFO:teuthology.orchestra.run.smithi119.stdout: "get": 0, 2024-06-02T05:06:16.307 INFO:teuthology.orchestra.run.smithi119.stdout: "get_sum": 0, 2024-06-02T05:06:16.307 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_fail": 0, 2024-06-02T05:06:16.307 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_success": 0, 2024-06-02T05:06:16.307 INFO:teuthology.orchestra.run.smithi119.stdout: "take": 0, 2024-06-02T05:06:16.307 INFO:teuthology.orchestra.run.smithi119.stdout: "take_sum": 0, 2024-06-02T05:06:16.307 INFO:teuthology.orchestra.run.smithi119.stdout: "put": 0, 2024-06-02T05:06:16.307 INFO:teuthology.orchestra.run.smithi119.stdout: "put_sum": 0, 2024-06-02T05:06:16.307 INFO:teuthology.orchestra.run.smithi119.stdout: "wait": { 2024-06-02T05:06:16.307 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-06-02T05:06:16.307 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-06-02T05:06:16.308 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-06-02T05:06:16.308 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-06-02T05:06:16.308 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:16.308 INFO:teuthology.orchestra.run.smithi119.stdout: "throttle-write_buf_throttle-0x55564ddaa500": { 2024-06-02T05:06:16.308 INFO:teuthology.orchestra.run.smithi119.stdout: "val": 0, 2024-06-02T05:06:16.308 INFO:teuthology.orchestra.run.smithi119.stdout: "max": 3758096384, 2024-06-02T05:06:16.308 INFO:teuthology.orchestra.run.smithi119.stdout: "get_started": 0, 2024-06-02T05:06:16.308 INFO:teuthology.orchestra.run.smithi119.stdout: "get": 0, 2024-06-02T05:06:16.308 INFO:teuthology.orchestra.run.smithi119.stdout: "get_sum": 0, 2024-06-02T05:06:16.308 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_fail": 0, 2024-06-02T05:06:16.309 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_success": 0, 2024-06-02T05:06:16.309 INFO:teuthology.orchestra.run.smithi119.stdout: "take": 0, 2024-06-02T05:06:16.309 INFO:teuthology.orchestra.run.smithi119.stdout: "take_sum": 0, 2024-06-02T05:06:16.309 INFO:teuthology.orchestra.run.smithi119.stdout: "put": 0, 2024-06-02T05:06:16.309 INFO:teuthology.orchestra.run.smithi119.stdout: "put_sum": 0, 2024-06-02T05:06:16.309 INFO:teuthology.orchestra.run.smithi119.stdout: "wait": { 2024-06-02T05:06:16.309 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-06-02T05:06:16.309 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-06-02T05:06:16.309 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-06-02T05:06:16.309 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-06-02T05:06:16.309 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-06-02T05:06:16.309 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-06-02T05:06:16.617 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-06-02T05:06:16.617 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-06-02T05:06:16.617 DEBUG:tasks.check_counter:Getting stats from h 2024-06-02T05:06:16.618 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell --fsid 60ab6d30-209a-11ef-bc9b-c7b262605968 -- ceph daemon mds.h perf dump 2024-06-02T05:06:16.839 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/mon.b/config 2024-06-02T05:06:17.754 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-06-02T05:06:17.755 INFO:teuthology.orchestra.run.smithi119.stdout: "AsyncMessenger::Worker-0": { 2024-06-02T05:06:17.755 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_messages": 2469, 2024-06-02T05:06:17.755 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages": 2453, 2024-06-02T05:06:17.755 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_bytes": 9180455, 2024-06-02T05:06:17.755 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_bytes": 838576, 2024-06-02T05:06:17.755 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_created_connections": 5, 2024-06-02T05:06:17.755 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_active_connections": 1, 2024-06-02T05:06:17.755 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_total_time": 0.199943533, 2024-06-02T05:06:17.755 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_send_time": 0.067625039, 2024-06-02T05:06:17.755 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_recv_time": 0.058457208, 2024-06-02T05:06:17.755 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_fast_dispatch_time": 0.058597173, 2024-06-02T05:06:17.756 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T05:06:17.756 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 2452, 2024-06-02T05:06:17.756 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.150178885, 2024-06-02T05:06:17.756 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000061247 2024-06-02T05:06:17.756 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:17.756 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_handle_ack_lat": { 2024-06-02T05:06:17.756 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-06-02T05:06:17.756 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-06-02T05:06:17.756 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-06-02T05:06:17.756 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:17.756 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_encrypted_bytes": 561344, 2024-06-02T05:06:17.756 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_encrypted_bytes": 170544 2024-06-02T05:06:17.757 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:17.757 INFO:teuthology.orchestra.run.smithi119.stdout: "AsyncMessenger::Worker-1": { 2024-06-02T05:06:17.757 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_messages": 1073, 2024-06-02T05:06:17.757 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages": 1297, 2024-06-02T05:06:17.757 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_bytes": 8662538, 2024-06-02T05:06:17.757 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_bytes": 878779, 2024-06-02T05:06:17.757 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_created_connections": 6, 2024-06-02T05:06:17.757 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_active_connections": 4, 2024-06-02T05:06:17.757 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_total_time": 0.079361053, 2024-06-02T05:06:17.757 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_send_time": 0.023984599, 2024-06-02T05:06:17.757 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_recv_time": 0.026289344, 2024-06-02T05:06:17.757 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_fast_dispatch_time": 0.021921345, 2024-06-02T05:06:17.757 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T05:06:17.757 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 1295, 2024-06-02T05:06:17.758 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.057085319, 2024-06-02T05:06:17.758 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000044081 2024-06-02T05:06:17.758 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:17.758 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_handle_ack_lat": { 2024-06-02T05:06:17.758 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-06-02T05:06:17.758 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-06-02T05:06:17.758 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-06-02T05:06:17.758 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:17.758 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_encrypted_bytes": 320, 2024-06-02T05:06:17.758 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_encrypted_bytes": 545632 2024-06-02T05:06:17.758 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:17.758 INFO:teuthology.orchestra.run.smithi119.stdout: "AsyncMessenger::Worker-2": { 2024-06-02T05:06:17.758 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_messages": 503, 2024-06-02T05:06:17.759 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages": 503, 2024-06-02T05:06:17.759 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_bytes": 4320284, 2024-06-02T05:06:17.759 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_bytes": 155644, 2024-06-02T05:06:17.759 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_created_connections": 5, 2024-06-02T05:06:17.759 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_active_connections": 4, 2024-06-02T05:06:17.759 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_total_time": 0.041306186, 2024-06-02T05:06:17.759 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_send_time": 0.009407834, 2024-06-02T05:06:17.759 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_recv_time": 0.012490564, 2024-06-02T05:06:17.759 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_fast_dispatch_time": 0.015980297, 2024-06-02T05:06:17.759 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T05:06:17.759 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 502, 2024-06-02T05:06:17.759 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.042831050, 2024-06-02T05:06:17.759 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000085320 2024-06-02T05:06:17.760 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:17.760 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_handle_ack_lat": { 2024-06-02T05:06:17.760 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-06-02T05:06:17.760 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-06-02T05:06:17.760 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-06-02T05:06:17.760 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:17.760 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_encrypted_bytes": 2912, 2024-06-02T05:06:17.760 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_encrypted_bytes": 448 2024-06-02T05:06:17.760 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:17.760 INFO:teuthology.orchestra.run.smithi119.stdout: "cct": { 2024-06-02T05:06:17.760 INFO:teuthology.orchestra.run.smithi119.stdout: "total_workers": 1, 2024-06-02T05:06:17.760 INFO:teuthology.orchestra.run.smithi119.stdout: "unhealthy_workers": 0 2024-06-02T05:06:17.761 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:17.761 INFO:teuthology.orchestra.run.smithi119.stdout: "finisher-MDSRank": { 2024-06-02T05:06:17.761 INFO:teuthology.orchestra.run.smithi119.stdout: "queue_len": 0, 2024-06-02T05:06:17.761 INFO:teuthology.orchestra.run.smithi119.stdout: "complete_latency": { 2024-06-02T05:06:17.761 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 6330, 2024-06-02T05:06:17.761 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.154078618, 2024-06-02T05:06:17.761 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000024341 2024-06-02T05:06:17.761 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-06-02T05:06:17.761 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:17.761 INFO:teuthology.orchestra.run.smithi119.stdout: "finisher-PurgeQueue": { 2024-06-02T05:06:17.761 INFO:teuthology.orchestra.run.smithi119.stdout: "queue_len": 0, 2024-06-02T05:06:17.761 INFO:teuthology.orchestra.run.smithi119.stdout: "complete_latency": { 2024-06-02T05:06:17.761 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-06-02T05:06:17.762 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-06-02T05:06:17.762 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-06-02T05:06:17.762 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-06-02T05:06:17.762 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:17.762 INFO:teuthology.orchestra.run.smithi119.stdout: "mds": { 2024-06-02T05:06:17.762 INFO:teuthology.orchestra.run.smithi119.stdout: "request": 0, 2024-06-02T05:06:17.762 INFO:teuthology.orchestra.run.smithi119.stdout: "reply": 0, 2024-06-02T05:06:17.762 INFO:teuthology.orchestra.run.smithi119.stdout: "reply_latency": { 2024-06-02T05:06:17.762 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-06-02T05:06:17.762 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-06-02T05:06:17.762 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-06-02T05:06:17.762 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:17.763 INFO:teuthology.orchestra.run.smithi119.stdout: "slow_reply": 0, 2024-06-02T05:06:17.763 INFO:teuthology.orchestra.run.smithi119.stdout: "forward": 0, 2024-06-02T05:06:17.763 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_fetch_complete": 0, 2024-06-02T05:06:17.763 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_fetch_keys": 0, 2024-06-02T05:06:17.763 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_commit": 0, 2024-06-02T05:06:17.763 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_split": 0, 2024-06-02T05:06:17.763 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_merge": 0, 2024-06-02T05:06:17.763 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes": 734, 2024-06-02T05:06:17.763 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_top": 472, 2024-06-02T05:06:17.763 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_bottom": 262, 2024-06-02T05:06:17.763 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_pin_tail": 0, 2024-06-02T05:06:17.763 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_pinned": 64, 2024-06-02T05:06:17.763 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_expired": 0, 2024-06-02T05:06:17.764 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_with_caps": 0, 2024-06-02T05:06:17.764 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": 0, 2024-06-02T05:06:17.764 INFO:teuthology.orchestra.run.smithi119.stdout: "subtrees": 14, 2024-06-02T05:06:17.764 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse": 0, 2024-06-02T05:06:17.764 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_hit": 0, 2024-06-02T05:06:17.764 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_forward": 0, 2024-06-02T05:06:17.764 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_discover": 0, 2024-06-02T05:06:17.764 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_dir_fetch": 0, 2024-06-02T05:06:17.764 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_remote_ino": 0, 2024-06-02T05:06:17.764 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_lock": 0, 2024-06-02T05:06:17.764 INFO:teuthology.orchestra.run.smithi119.stdout: "load_cent": 0, 2024-06-02T05:06:17.764 INFO:teuthology.orchestra.run.smithi119.stdout: "q": 0, 2024-06-02T05:06:17.765 INFO:teuthology.orchestra.run.smithi119.stdout: "exported": 0, 2024-06-02T05:06:17.765 INFO:teuthology.orchestra.run.smithi119.stdout: "exported_inodes": 0, 2024-06-02T05:06:17.765 INFO:teuthology.orchestra.run.smithi119.stdout: "imported": 0, 2024-06-02T05:06:17.765 INFO:teuthology.orchestra.run.smithi119.stdout: "imported_inodes": 0, 2024-06-02T05:06:17.765 INFO:teuthology.orchestra.run.smithi119.stdout: "openino_dir_fetch": 0, 2024-06-02T05:06:17.765 INFO:teuthology.orchestra.run.smithi119.stdout: "openino_backtrace_fetch": 0, 2024-06-02T05:06:17.765 INFO:teuthology.orchestra.run.smithi119.stdout: "openino_peer_discover": 0, 2024-06-02T05:06:17.765 INFO:teuthology.orchestra.run.smithi119.stdout: "root_rfiles": 1037, 2024-06-02T05:06:17.765 INFO:teuthology.orchestra.run.smithi119.stdout: "root_rbytes": 1696889314, 2024-06-02T05:06:17.765 INFO:teuthology.orchestra.run.smithi119.stdout: "root_rsnaps": 0, 2024-06-02T05:06:17.765 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_backtrace_fetch": 0, 2024-06-02T05:06:17.765 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_set_tag": 0, 2024-06-02T05:06:17.765 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_backtrace_repaired": 0, 2024-06-02T05:06:17.766 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_inotable_repaired": 0, 2024-06-02T05:06:17.766 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_dir_inodes": 0, 2024-06-02T05:06:17.766 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_dir_base_inodes": 0, 2024-06-02T05:06:17.766 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_dirfrag_rstats": 0, 2024-06-02T05:06:17.766 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_file_inodes": 0, 2024-06-02T05:06:17.766 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_inode_file_caps": 0, 2024-06-02T05:06:17.766 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_cap_op_revoke": 0, 2024-06-02T05:06:17.766 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_cap_op_grant": 0, 2024-06-02T05:06:17.766 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_cap_op_trunc": 0, 2024-06-02T05:06:17.766 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-06-02T05:06:17.766 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_cap_op_flush_ack": 0, 2024-06-02T05:06:17.766 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_client_caps": 0, 2024-06-02T05:06:17.767 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_client_caps_dirty": 0, 2024-06-02T05:06:17.767 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_client_cap_release": 0, 2024-06-02T05:06:17.767 INFO:teuthology.orchestra.run.smithi119.stdout: "process_request_cap_release": 0 2024-06-02T05:06:17.767 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:17.767 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_cache": { 2024-06-02T05:06:17.767 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_update": 0, 2024-06-02T05:06:17.767 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_update_receipt": 0, 2024-06-02T05:06:17.767 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_try_discover": 0, 2024-06-02T05:06:17.767 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_send_discover": 0, 2024-06-02T05:06:17.767 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_handle_discover": 0, 2024-06-02T05:06:17.767 INFO:teuthology.orchestra.run.smithi119.stdout: "num_strays": 0, 2024-06-02T05:06:17.767 INFO:teuthology.orchestra.run.smithi119.stdout: "num_strays_delayed": 0, 2024-06-02T05:06:17.767 INFO:teuthology.orchestra.run.smithi119.stdout: "num_strays_enqueuing": 0, 2024-06-02T05:06:17.768 INFO:teuthology.orchestra.run.smithi119.stdout: "strays_created": 0, 2024-06-02T05:06:17.768 INFO:teuthology.orchestra.run.smithi119.stdout: "strays_enqueued": 0, 2024-06-02T05:06:17.768 INFO:teuthology.orchestra.run.smithi119.stdout: "strays_reintegrated": 0, 2024-06-02T05:06:17.768 INFO:teuthology.orchestra.run.smithi119.stdout: "strays_migrated": 0, 2024-06-02T05:06:17.768 INFO:teuthology.orchestra.run.smithi119.stdout: "num_recovering_processing": 0, 2024-06-02T05:06:17.768 INFO:teuthology.orchestra.run.smithi119.stdout: "num_recovering_enqueued": 0, 2024-06-02T05:06:17.768 INFO:teuthology.orchestra.run.smithi119.stdout: "num_recovering_prioritized": 0, 2024-06-02T05:06:17.768 INFO:teuthology.orchestra.run.smithi119.stdout: "recovery_started": 0, 2024-06-02T05:06:17.768 INFO:teuthology.orchestra.run.smithi119.stdout: "recovery_completed": 0, 2024-06-02T05:06:17.768 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_enqueue_scrub": 0, 2024-06-02T05:06:17.768 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_exportdir": 0, 2024-06-02T05:06:17.768 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_flush": 0, 2024-06-02T05:06:17.768 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_fragmentdir": 0, 2024-06-02T05:06:17.769 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_fragstats": 0, 2024-06-02T05:06:17.769 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_inodestats": 0 2024-06-02T05:06:17.769 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:17.769 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_log": { 2024-06-02T05:06:17.769 INFO:teuthology.orchestra.run.smithi119.stdout: "evadd": 0, 2024-06-02T05:06:17.769 INFO:teuthology.orchestra.run.smithi119.stdout: "evex": 0, 2024-06-02T05:06:17.769 INFO:teuthology.orchestra.run.smithi119.stdout: "evtrm": 0, 2024-06-02T05:06:17.769 INFO:teuthology.orchestra.run.smithi119.stdout: "ev": 8401, 2024-06-02T05:06:17.769 INFO:teuthology.orchestra.run.smithi119.stdout: "evexg": 0, 2024-06-02T05:06:17.769 INFO:teuthology.orchestra.run.smithi119.stdout: "evexd": 0, 2024-06-02T05:06:17.769 INFO:teuthology.orchestra.run.smithi119.stdout: "segadd": 0, 2024-06-02T05:06:17.769 INFO:teuthology.orchestra.run.smithi119.stdout: "segex": 0, 2024-06-02T05:06:17.769 INFO:teuthology.orchestra.run.smithi119.stdout: "segtrm": 0, 2024-06-02T05:06:17.770 INFO:teuthology.orchestra.run.smithi119.stdout: "seg": 2, 2024-06-02T05:06:17.770 INFO:teuthology.orchestra.run.smithi119.stdout: "segexg": 0, 2024-06-02T05:06:17.770 INFO:teuthology.orchestra.run.smithi119.stdout: "segexd": 0, 2024-06-02T05:06:17.770 INFO:teuthology.orchestra.run.smithi119.stdout: "expos": 24407592, 2024-06-02T05:06:17.770 INFO:teuthology.orchestra.run.smithi119.stdout: "wrpos": 24763425, 2024-06-02T05:06:17.770 INFO:teuthology.orchestra.run.smithi119.stdout: "rdpos": 24762025, 2024-06-02T05:06:17.770 INFO:teuthology.orchestra.run.smithi119.stdout: "jlat": { 2024-06-02T05:06:17.770 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-06-02T05:06:17.770 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-06-02T05:06:17.770 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-06-02T05:06:17.770 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:17.770 INFO:teuthology.orchestra.run.smithi119.stdout: "replayed": 8401 2024-06-02T05:06:17.770 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:17.771 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_mem": { 2024-06-02T05:06:17.771 INFO:teuthology.orchestra.run.smithi119.stdout: "ino": 584, 2024-06-02T05:06:17.771 INFO:teuthology.orchestra.run.smithi119.stdout: "ino+": 1382, 2024-06-02T05:06:17.771 INFO:teuthology.orchestra.run.smithi119.stdout: "ino-": 798, 2024-06-02T05:06:17.771 INFO:teuthology.orchestra.run.smithi119.stdout: "dir": 66, 2024-06-02T05:06:17.771 INFO:teuthology.orchestra.run.smithi119.stdout: "dir+": 70, 2024-06-02T05:06:17.771 INFO:teuthology.orchestra.run.smithi119.stdout: "dir-": 4, 2024-06-02T05:06:17.771 INFO:teuthology.orchestra.run.smithi119.stdout: "dn": 734, 2024-06-02T05:06:17.771 INFO:teuthology.orchestra.run.smithi119.stdout: "dn+": 1426, 2024-06-02T05:06:17.771 INFO:teuthology.orchestra.run.smithi119.stdout: "dn-": 692, 2024-06-02T05:06:17.771 INFO:teuthology.orchestra.run.smithi119.stdout: "cap": 0, 2024-06-02T05:06:17.771 INFO:teuthology.orchestra.run.smithi119.stdout: "cap+": 0, 2024-06-02T05:06:17.771 INFO:teuthology.orchestra.run.smithi119.stdout: "cap-": 0, 2024-06-02T05:06:17.772 INFO:teuthology.orchestra.run.smithi119.stdout: "rss": 52920, 2024-06-02T05:06:17.772 INFO:teuthology.orchestra.run.smithi119.stdout: "heap": 207156 2024-06-02T05:06:17.772 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:17.772 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_server": { 2024-06-02T05:06:17.772 INFO:teuthology.orchestra.run.smithi119.stdout: "dispatch_client_request": 0, 2024-06-02T05:06:17.772 INFO:teuthology.orchestra.run.smithi119.stdout: "dispatch_server_request": 0, 2024-06-02T05:06:17.772 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_client_request": 0, 2024-06-02T05:06:17.772 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_client_session": 0, 2024-06-02T05:06:17.772 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_peer_request": 0, 2024-06-02T05:06:17.772 INFO:teuthology.orchestra.run.smithi119.stdout: "req_create_latency": { 2024-06-02T05:06:17.772 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-06-02T05:06:17.772 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-06-02T05:06:17.772 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-06-02T05:06:17.773 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:17.773 INFO:teuthology.orchestra.run.smithi119.stdout: "req_getattr_latency": { 2024-06-02T05:06:17.773 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-06-02T05:06:17.773 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-06-02T05:06:17.773 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-06-02T05:06:17.773 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:17.773 INFO:teuthology.orchestra.run.smithi119.stdout: "req_getfilelock_latency": { 2024-06-02T05:06:17.773 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-06-02T05:06:17.773 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-06-02T05:06:17.773 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-06-02T05:06:17.773 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:17.773 INFO:teuthology.orchestra.run.smithi119.stdout: "req_link_latency": { 2024-06-02T05:06:17.773 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-06-02T05:06:17.773 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-06-02T05:06:17.774 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-06-02T05:06:17.774 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:17.774 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookup_latency": { 2024-06-02T05:06:17.774 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-06-02T05:06:17.774 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-06-02T05:06:17.774 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-06-02T05:06:17.774 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:17.774 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookuphash_latency": { 2024-06-02T05:06:17.774 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-06-02T05:06:17.774 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-06-02T05:06:17.774 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-06-02T05:06:17.774 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:17.775 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookupino_latency": { 2024-06-02T05:06:17.775 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-06-02T05:06:17.775 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-06-02T05:06:17.775 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-06-02T05:06:17.775 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:17.775 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookupname_latency": { 2024-06-02T05:06:17.775 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-06-02T05:06:17.775 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-06-02T05:06:17.775 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-06-02T05:06:17.775 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:17.775 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookupparent_latency": { 2024-06-02T05:06:17.775 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-06-02T05:06:17.775 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-06-02T05:06:17.776 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-06-02T05:06:17.776 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:17.776 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookupsnap_latency": { 2024-06-02T05:06:17.776 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-06-02T05:06:17.776 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-06-02T05:06:17.776 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-06-02T05:06:17.776 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:17.776 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lssnap_latency": { 2024-06-02T05:06:17.776 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-06-02T05:06:17.776 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-06-02T05:06:17.776 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-06-02T05:06:17.776 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:17.776 INFO:teuthology.orchestra.run.smithi119.stdout: "req_mkdir_latency": { 2024-06-02T05:06:17.776 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-06-02T05:06:17.777 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-06-02T05:06:17.777 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-06-02T05:06:17.777 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:17.777 INFO:teuthology.orchestra.run.smithi119.stdout: "req_mknod_latency": { 2024-06-02T05:06:17.777 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-06-02T05:06:17.777 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-06-02T05:06:17.777 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-06-02T05:06:17.777 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:17.777 INFO:teuthology.orchestra.run.smithi119.stdout: "req_mksnap_latency": { 2024-06-02T05:06:17.777 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-06-02T05:06:17.777 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-06-02T05:06:17.777 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-06-02T05:06:17.777 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:17.778 INFO:teuthology.orchestra.run.smithi119.stdout: "req_open_latency": { 2024-06-02T05:06:17.778 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-06-02T05:06:17.778 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-06-02T05:06:17.778 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-06-02T05:06:17.778 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:17.778 INFO:teuthology.orchestra.run.smithi119.stdout: "req_readdir_latency": { 2024-06-02T05:06:17.778 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-06-02T05:06:17.778 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-06-02T05:06:17.778 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-06-02T05:06:17.778 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:17.778 INFO:teuthology.orchestra.run.smithi119.stdout: "req_rename_latency": { 2024-06-02T05:06:17.778 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-06-02T05:06:17.778 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-06-02T05:06:17.779 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-06-02T05:06:17.779 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:17.779 INFO:teuthology.orchestra.run.smithi119.stdout: "req_renamesnap_latency": { 2024-06-02T05:06:17.779 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-06-02T05:06:17.779 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-06-02T05:06:17.779 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-06-02T05:06:17.779 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:17.779 INFO:teuthology.orchestra.run.smithi119.stdout: "req_snapdiff_latency": { 2024-06-02T05:06:17.779 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-06-02T05:06:17.779 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-06-02T05:06:17.779 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-06-02T05:06:17.779 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:17.779 INFO:teuthology.orchestra.run.smithi119.stdout: "req_rmdir_latency": { 2024-06-02T05:06:17.780 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-06-02T05:06:17.780 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-06-02T05:06:17.780 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-06-02T05:06:17.780 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:17.780 INFO:teuthology.orchestra.run.smithi119.stdout: "req_rmsnap_latency": { 2024-06-02T05:06:17.780 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-06-02T05:06:17.780 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-06-02T05:06:17.780 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-06-02T05:06:17.780 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:17.780 INFO:teuthology.orchestra.run.smithi119.stdout: "req_rmxattr_latency": { 2024-06-02T05:06:17.780 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-06-02T05:06:17.780 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-06-02T05:06:17.780 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-06-02T05:06:17.780 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:17.781 INFO:teuthology.orchestra.run.smithi119.stdout: "req_setattr_latency": { 2024-06-02T05:06:17.781 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-06-02T05:06:17.781 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-06-02T05:06:17.781 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-06-02T05:06:17.781 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:17.781 INFO:teuthology.orchestra.run.smithi119.stdout: "req_setdirlayout_latency": { 2024-06-02T05:06:17.781 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-06-02T05:06:17.781 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-06-02T05:06:17.781 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-06-02T05:06:17.781 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:17.781 INFO:teuthology.orchestra.run.smithi119.stdout: "req_setfilelock_latency": { 2024-06-02T05:06:17.781 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-06-02T05:06:17.781 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-06-02T05:06:17.781 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-06-02T05:06:17.782 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:17.782 INFO:teuthology.orchestra.run.smithi119.stdout: "req_setlayout_latency": { 2024-06-02T05:06:17.782 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-06-02T05:06:17.782 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-06-02T05:06:17.782 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-06-02T05:06:17.782 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:17.782 INFO:teuthology.orchestra.run.smithi119.stdout: "req_setxattr_latency": { 2024-06-02T05:06:17.782 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-06-02T05:06:17.782 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-06-02T05:06:17.782 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-06-02T05:06:17.782 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:17.782 INFO:teuthology.orchestra.run.smithi119.stdout: "req_symlink_latency": { 2024-06-02T05:06:17.783 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-06-02T05:06:17.783 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-06-02T05:06:17.783 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-06-02T05:06:17.783 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:17.783 INFO:teuthology.orchestra.run.smithi119.stdout: "req_unlink_latency": { 2024-06-02T05:06:17.783 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-06-02T05:06:17.783 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-06-02T05:06:17.783 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-06-02T05:06:17.783 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:17.783 INFO:teuthology.orchestra.run.smithi119.stdout: "cap_revoke_eviction": 0, 2024-06-02T05:06:17.783 INFO:teuthology.orchestra.run.smithi119.stdout: "cap_acquisition_throttle": 0, 2024-06-02T05:06:17.783 INFO:teuthology.orchestra.run.smithi119.stdout: "req_getvxattr_latency": { 2024-06-02T05:06:17.783 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-06-02T05:06:17.783 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-06-02T05:06:17.784 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-06-02T05:06:17.784 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-06-02T05:06:17.784 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:17.784 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_sessions": { 2024-06-02T05:06:17.784 INFO:teuthology.orchestra.run.smithi119.stdout: "session_count": 1, 2024-06-02T05:06:17.784 INFO:teuthology.orchestra.run.smithi119.stdout: "session_add": 3, 2024-06-02T05:06:17.784 INFO:teuthology.orchestra.run.smithi119.stdout: "session_remove": 2, 2024-06-02T05:06:17.784 INFO:teuthology.orchestra.run.smithi119.stdout: "sessions_open": 2, 2024-06-02T05:06:17.784 INFO:teuthology.orchestra.run.smithi119.stdout: "sessions_stale": 0, 2024-06-02T05:06:17.784 INFO:teuthology.orchestra.run.smithi119.stdout: "total_load": 0, 2024-06-02T05:06:17.784 INFO:teuthology.orchestra.run.smithi119.stdout: "average_load": 0, 2024-06-02T05:06:17.784 INFO:teuthology.orchestra.run.smithi119.stdout: "avg_session_uptime": 3807, 2024-06-02T05:06:17.784 INFO:teuthology.orchestra.run.smithi119.stdout: "mdthresh_evicted": 0 2024-06-02T05:06:17.785 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:17.785 INFO:teuthology.orchestra.run.smithi119.stdout: "mempool": { 2024-06-02T05:06:17.785 INFO:teuthology.orchestra.run.smithi119.stdout: "bloom_filter_bytes": 0, 2024-06-02T05:06:17.785 INFO:teuthology.orchestra.run.smithi119.stdout: "bloom_filter_items": 0, 2024-06-02T05:06:17.785 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_alloc_bytes": 0, 2024-06-02T05:06:17.785 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_alloc_items": 0, 2024-06-02T05:06:17.785 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_data_bytes": 0, 2024-06-02T05:06:17.785 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_data_items": 0, 2024-06-02T05:06:17.785 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_onode_bytes": 0, 2024-06-02T05:06:17.785 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_onode_items": 0, 2024-06-02T05:06:17.785 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_meta_bytes": 0, 2024-06-02T05:06:17.785 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_meta_items": 0, 2024-06-02T05:06:17.785 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_other_bytes": 0, 2024-06-02T05:06:17.786 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_other_items": 0, 2024-06-02T05:06:17.786 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_buffer_bytes": 0, 2024-06-02T05:06:17.786 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_buffer_items": 0, 2024-06-02T05:06:17.786 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_extent_bytes": 0, 2024-06-02T05:06:17.786 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_extent_items": 0, 2024-06-02T05:06:17.786 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_blob_bytes": 0, 2024-06-02T05:06:17.786 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_blob_items": 0, 2024-06-02T05:06:17.786 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_shared_blob_bytes": 0, 2024-06-02T05:06:17.786 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_shared_blob_items": 0, 2024-06-02T05:06:17.786 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_inline_bl_bytes": 0, 2024-06-02T05:06:17.786 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_inline_bl_items": 0, 2024-06-02T05:06:17.786 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_fsck_bytes": 0, 2024-06-02T05:06:17.786 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_fsck_items": 0, 2024-06-02T05:06:17.787 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_txc_bytes": 0, 2024-06-02T05:06:17.787 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_txc_items": 0, 2024-06-02T05:06:17.787 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_writing_deferred_bytes": 0, 2024-06-02T05:06:17.787 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_writing_deferred_items": 0, 2024-06-02T05:06:17.787 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_writing_bytes": 0, 2024-06-02T05:06:17.787 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_writing_items": 0, 2024-06-02T05:06:17.787 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_bytes": 0, 2024-06-02T05:06:17.787 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_items": 0, 2024-06-02T05:06:17.787 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_file_reader_bytes": 0, 2024-06-02T05:06:17.787 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_file_reader_items": 0, 2024-06-02T05:06:17.787 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_file_writer_bytes": 0, 2024-06-02T05:06:17.787 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_file_writer_items": 0, 2024-06-02T05:06:17.787 INFO:teuthology.orchestra.run.smithi119.stdout: "buffer_anon_bytes": 200063, 2024-06-02T05:06:17.787 INFO:teuthology.orchestra.run.smithi119.stdout: "buffer_anon_items": 59, 2024-06-02T05:06:17.788 INFO:teuthology.orchestra.run.smithi119.stdout: "buffer_meta_bytes": 0, 2024-06-02T05:06:17.788 INFO:teuthology.orchestra.run.smithi119.stdout: "buffer_meta_items": 0, 2024-06-02T05:06:17.788 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_bytes": 0, 2024-06-02T05:06:17.788 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_items": 0, 2024-06-02T05:06:17.788 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_mapbl_bytes": 0, 2024-06-02T05:06:17.788 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_mapbl_items": 0, 2024-06-02T05:06:17.788 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_pglog_bytes": 0, 2024-06-02T05:06:17.788 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_pglog_items": 0, 2024-06-02T05:06:17.788 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_bytes": 8800, 2024-06-02T05:06:17.788 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_items": 169, 2024-06-02T05:06:17.788 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_mapping_bytes": 0, 2024-06-02T05:06:17.788 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_mapping_items": 0, 2024-06-02T05:06:17.788 INFO:teuthology.orchestra.run.smithi119.stdout: "pgmap_bytes": 0, 2024-06-02T05:06:17.789 INFO:teuthology.orchestra.run.smithi119.stdout: "pgmap_items": 0, 2024-06-02T05:06:17.789 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_co_bytes": 1805243, 2024-06-02T05:06:17.789 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_co_items": 6332, 2024-06-02T05:06:17.789 INFO:teuthology.orchestra.run.smithi119.stdout: "unittest_1_bytes": 0, 2024-06-02T05:06:17.789 INFO:teuthology.orchestra.run.smithi119.stdout: "unittest_1_items": 0, 2024-06-02T05:06:17.789 INFO:teuthology.orchestra.run.smithi119.stdout: "unittest_2_bytes": 0, 2024-06-02T05:06:17.789 INFO:teuthology.orchestra.run.smithi119.stdout: "unittest_2_items": 0 2024-06-02T05:06:17.789 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:17.789 INFO:teuthology.orchestra.run.smithi119.stdout: "objecter": { 2024-06-02T05:06:17.789 INFO:teuthology.orchestra.run.smithi119.stdout: "op_active": 0, 2024-06-02T05:06:17.789 INFO:teuthology.orchestra.run.smithi119.stdout: "op_laggy": 0, 2024-06-02T05:06:17.789 INFO:teuthology.orchestra.run.smithi119.stdout: "op_send": 3718, 2024-06-02T05:06:17.789 INFO:teuthology.orchestra.run.smithi119.stdout: "op_send_bytes": 26, 2024-06-02T05:06:17.790 INFO:teuthology.orchestra.run.smithi119.stdout: "op_resend": 4, 2024-06-02T05:06:17.790 INFO:teuthology.orchestra.run.smithi119.stdout: "op_reply": 3718, 2024-06-02T05:06:17.790 INFO:teuthology.orchestra.run.smithi119.stdout: "op_latency": { 2024-06-02T05:06:17.790 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 3718, 2024-06-02T05:06:17.790 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 2.948929410, 2024-06-02T05:06:17.790 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000793149 2024-06-02T05:06:17.790 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:17.790 INFO:teuthology.orchestra.run.smithi119.stdout: "op_inflight": 0, 2024-06-02T05:06:17.790 INFO:teuthology.orchestra.run.smithi119.stdout: "oplen_avg": { 2024-06-02T05:06:17.790 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 3718, 2024-06-02T05:06:17.790 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 3719 2024-06-02T05:06:17.790 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:17.790 INFO:teuthology.orchestra.run.smithi119.stdout: "op": 3718, 2024-06-02T05:06:17.791 INFO:teuthology.orchestra.run.smithi119.stdout: "op_r": 3718, 2024-06-02T05:06:17.791 INFO:teuthology.orchestra.run.smithi119.stdout: "op_w": 0, 2024-06-02T05:06:17.791 INFO:teuthology.orchestra.run.smithi119.stdout: "op_rmw": 0, 2024-06-02T05:06:17.791 INFO:teuthology.orchestra.run.smithi119.stdout: "op_pg": 0, 2024-06-02T05:06:17.791 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_stat": 2142, 2024-06-02T05:06:17.791 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_create": 0, 2024-06-02T05:06:17.791 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_read": 1573, 2024-06-02T05:06:17.791 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_write": 0, 2024-06-02T05:06:17.791 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_writefull": 0, 2024-06-02T05:06:17.791 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_writesame": 0, 2024-06-02T05:06:17.791 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_append": 0, 2024-06-02T05:06:17.791 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_zero": 0, 2024-06-02T05:06:17.791 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_truncate": 0, 2024-06-02T05:06:17.792 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_delete": 0, 2024-06-02T05:06:17.792 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_mapext": 0, 2024-06-02T05:06:17.792 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_sparse_read": 0, 2024-06-02T05:06:17.792 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_clonerange": 0, 2024-06-02T05:06:17.792 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_getxattr": 2, 2024-06-02T05:06:17.792 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_setxattr": 0, 2024-06-02T05:06:17.792 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_cmpxattr": 0, 2024-06-02T05:06:17.792 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_rmxattr": 0, 2024-06-02T05:06:17.792 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_resetxattrs": 0, 2024-06-02T05:06:17.792 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_call": 0, 2024-06-02T05:06:17.792 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_watch": 0, 2024-06-02T05:06:17.792 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_notify": 0, 2024-06-02T05:06:17.792 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_src_cmpxattr": 0, 2024-06-02T05:06:17.792 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_pgls": 0, 2024-06-02T05:06:17.793 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_pgls_filter": 0, 2024-06-02T05:06:17.793 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_other": 0, 2024-06-02T05:06:17.793 INFO:teuthology.orchestra.run.smithi119.stdout: "linger_active": 0, 2024-06-02T05:06:17.793 INFO:teuthology.orchestra.run.smithi119.stdout: "linger_send": 0, 2024-06-02T05:06:17.793 INFO:teuthology.orchestra.run.smithi119.stdout: "linger_resend": 0, 2024-06-02T05:06:17.793 INFO:teuthology.orchestra.run.smithi119.stdout: "linger_ping": 0, 2024-06-02T05:06:17.793 INFO:teuthology.orchestra.run.smithi119.stdout: "poolop_active": 0, 2024-06-02T05:06:17.793 INFO:teuthology.orchestra.run.smithi119.stdout: "poolop_send": 0, 2024-06-02T05:06:17.793 INFO:teuthology.orchestra.run.smithi119.stdout: "poolop_resend": 0, 2024-06-02T05:06:17.793 INFO:teuthology.orchestra.run.smithi119.stdout: "poolstat_active": 0, 2024-06-02T05:06:17.793 INFO:teuthology.orchestra.run.smithi119.stdout: "poolstat_send": 0, 2024-06-02T05:06:17.793 INFO:teuthology.orchestra.run.smithi119.stdout: "poolstat_resend": 0, 2024-06-02T05:06:17.793 INFO:teuthology.orchestra.run.smithi119.stdout: "statfs_active": 0, 2024-06-02T05:06:17.794 INFO:teuthology.orchestra.run.smithi119.stdout: "statfs_send": 0, 2024-06-02T05:06:17.794 INFO:teuthology.orchestra.run.smithi119.stdout: "statfs_resend": 0, 2024-06-02T05:06:17.794 INFO:teuthology.orchestra.run.smithi119.stdout: "command_active": 0, 2024-06-02T05:06:17.794 INFO:teuthology.orchestra.run.smithi119.stdout: "command_send": 0, 2024-06-02T05:06:17.794 INFO:teuthology.orchestra.run.smithi119.stdout: "command_resend": 0, 2024-06-02T05:06:17.794 INFO:teuthology.orchestra.run.smithi119.stdout: "map_epoch": 84, 2024-06-02T05:06:17.794 INFO:teuthology.orchestra.run.smithi119.stdout: "map_full": 0, 2024-06-02T05:06:17.794 INFO:teuthology.orchestra.run.smithi119.stdout: "map_inc": 4, 2024-06-02T05:06:17.794 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_sessions": 6, 2024-06-02T05:06:17.794 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_session_open": 6, 2024-06-02T05:06:17.794 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_session_close": 0, 2024-06-02T05:06:17.794 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_laggy": 0, 2024-06-02T05:06:17.795 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_wr": 0, 2024-06-02T05:06:17.795 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_rd": 2, 2024-06-02T05:06:17.795 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_del": 0 2024-06-02T05:06:17.795 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:17.795 INFO:teuthology.orchestra.run.smithi119.stdout: "oft": { 2024-06-02T05:06:17.795 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_total_objs": 0, 2024-06-02T05:06:17.795 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_total_kv_pairs": 0, 2024-06-02T05:06:17.795 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_total_updates": 0, 2024-06-02T05:06:17.795 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_total_removes": 0 2024-06-02T05:06:17.795 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:17.795 INFO:teuthology.orchestra.run.smithi119.stdout: "osd-slow-ops": { 2024-06-02T05:06:17.795 INFO:teuthology.orchestra.run.smithi119.stdout: "slow_ops_count": 0 2024-06-02T05:06:17.795 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:17.795 INFO:teuthology.orchestra.run.smithi119.stdout: "purge_queue": { 2024-06-02T05:06:17.796 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_executing_ops": 0, 2024-06-02T05:06:17.796 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_executing_ops_high_water": 0, 2024-06-02T05:06:17.796 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_executing": 0, 2024-06-02T05:06:17.796 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_executing_high_water": 0, 2024-06-02T05:06:17.796 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_executed": 0, 2024-06-02T05:06:17.796 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_item_in_journal": 0 2024-06-02T05:06:17.796 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:17.796 INFO:teuthology.orchestra.run.smithi119.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-06-02T05:06:17.796 INFO:teuthology.orchestra.run.smithi119.stdout: "val": 0, 2024-06-02T05:06:17.796 INFO:teuthology.orchestra.run.smithi119.stdout: "max": 104857600, 2024-06-02T05:06:17.796 INFO:teuthology.orchestra.run.smithi119.stdout: "get_started": 0, 2024-06-02T05:06:17.796 INFO:teuthology.orchestra.run.smithi119.stdout: "get": 4041, 2024-06-02T05:06:17.796 INFO:teuthology.orchestra.run.smithi119.stdout: "get_sum": 21780130, 2024-06-02T05:06:17.796 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_fail": 0, 2024-06-02T05:06:17.797 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_success": 4041, 2024-06-02T05:06:17.797 INFO:teuthology.orchestra.run.smithi119.stdout: "take": 0, 2024-06-02T05:06:17.797 INFO:teuthology.orchestra.run.smithi119.stdout: "take_sum": 0, 2024-06-02T05:06:17.797 INFO:teuthology.orchestra.run.smithi119.stdout: "put": 4041, 2024-06-02T05:06:17.797 INFO:teuthology.orchestra.run.smithi119.stdout: "put_sum": 21780130, 2024-06-02T05:06:17.797 INFO:teuthology.orchestra.run.smithi119.stdout: "wait": { 2024-06-02T05:06:17.797 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-06-02T05:06:17.797 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-06-02T05:06:17.797 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-06-02T05:06:17.797 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-06-02T05:06:17.797 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:17.797 INFO:teuthology.orchestra.run.smithi119.stdout: "throttle-objecter_bytes": { 2024-06-02T05:06:17.797 INFO:teuthology.orchestra.run.smithi119.stdout: "val": 0, 2024-06-02T05:06:17.798 INFO:teuthology.orchestra.run.smithi119.stdout: "max": 104857600, 2024-06-02T05:06:17.798 INFO:teuthology.orchestra.run.smithi119.stdout: "get_started": 0, 2024-06-02T05:06:17.798 INFO:teuthology.orchestra.run.smithi119.stdout: "get": 0, 2024-06-02T05:06:17.798 INFO:teuthology.orchestra.run.smithi119.stdout: "get_sum": 0, 2024-06-02T05:06:17.798 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_fail": 0, 2024-06-02T05:06:17.798 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_success": 0, 2024-06-02T05:06:17.798 INFO:teuthology.orchestra.run.smithi119.stdout: "take": 3718, 2024-06-02T05:06:17.798 INFO:teuthology.orchestra.run.smithi119.stdout: "take_sum": 20569131, 2024-06-02T05:06:17.798 INFO:teuthology.orchestra.run.smithi119.stdout: "put": 3718, 2024-06-02T05:06:17.798 INFO:teuthology.orchestra.run.smithi119.stdout: "put_sum": 20569131, 2024-06-02T05:06:17.798 INFO:teuthology.orchestra.run.smithi119.stdout: "wait": { 2024-06-02T05:06:17.798 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-06-02T05:06:17.798 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-06-02T05:06:17.799 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-06-02T05:06:17.799 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-06-02T05:06:17.799 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:17.799 INFO:teuthology.orchestra.run.smithi119.stdout: "throttle-objecter_ops": { 2024-06-02T05:06:17.799 INFO:teuthology.orchestra.run.smithi119.stdout: "val": 0, 2024-06-02T05:06:17.799 INFO:teuthology.orchestra.run.smithi119.stdout: "max": 1024, 2024-06-02T05:06:17.799 INFO:teuthology.orchestra.run.smithi119.stdout: "get_started": 0, 2024-06-02T05:06:17.799 INFO:teuthology.orchestra.run.smithi119.stdout: "get": 0, 2024-06-02T05:06:17.799 INFO:teuthology.orchestra.run.smithi119.stdout: "get_sum": 0, 2024-06-02T05:06:17.799 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_fail": 0, 2024-06-02T05:06:17.799 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_success": 0, 2024-06-02T05:06:17.799 INFO:teuthology.orchestra.run.smithi119.stdout: "take": 3718, 2024-06-02T05:06:17.799 INFO:teuthology.orchestra.run.smithi119.stdout: "take_sum": 3718, 2024-06-02T05:06:17.800 INFO:teuthology.orchestra.run.smithi119.stdout: "put": 3718, 2024-06-02T05:06:17.800 INFO:teuthology.orchestra.run.smithi119.stdout: "put_sum": 3718, 2024-06-02T05:06:17.800 INFO:teuthology.orchestra.run.smithi119.stdout: "wait": { 2024-06-02T05:06:17.800 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-06-02T05:06:17.800 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-06-02T05:06:17.800 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-06-02T05:06:17.800 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-06-02T05:06:17.800 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:17.800 INFO:teuthology.orchestra.run.smithi119.stdout: "throttle-write_buf_throttle": { 2024-06-02T05:06:17.800 INFO:teuthology.orchestra.run.smithi119.stdout: "val": 0, 2024-06-02T05:06:17.800 INFO:teuthology.orchestra.run.smithi119.stdout: "max": 3758096384, 2024-06-02T05:06:17.800 INFO:teuthology.orchestra.run.smithi119.stdout: "get_started": 0, 2024-06-02T05:06:17.800 INFO:teuthology.orchestra.run.smithi119.stdout: "get": 0, 2024-06-02T05:06:17.800 INFO:teuthology.orchestra.run.smithi119.stdout: "get_sum": 0, 2024-06-02T05:06:17.801 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_fail": 0, 2024-06-02T05:06:17.801 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_success": 0, 2024-06-02T05:06:17.801 INFO:teuthology.orchestra.run.smithi119.stdout: "take": 0, 2024-06-02T05:06:17.801 INFO:teuthology.orchestra.run.smithi119.stdout: "take_sum": 0, 2024-06-02T05:06:17.801 INFO:teuthology.orchestra.run.smithi119.stdout: "put": 0, 2024-06-02T05:06:17.801 INFO:teuthology.orchestra.run.smithi119.stdout: "put_sum": 0, 2024-06-02T05:06:17.801 INFO:teuthology.orchestra.run.smithi119.stdout: "wait": { 2024-06-02T05:06:17.801 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-06-02T05:06:17.801 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-06-02T05:06:17.801 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-06-02T05:06:17.801 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-06-02T05:06:17.801 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:17.801 INFO:teuthology.orchestra.run.smithi119.stdout: "throttle-write_buf_throttle-0x556a5e5ac5a0": { 2024-06-02T05:06:17.802 INFO:teuthology.orchestra.run.smithi119.stdout: "val": 0, 2024-06-02T05:06:17.802 INFO:teuthology.orchestra.run.smithi119.stdout: "max": 3758096384, 2024-06-02T05:06:17.802 INFO:teuthology.orchestra.run.smithi119.stdout: "get_started": 0, 2024-06-02T05:06:17.802 INFO:teuthology.orchestra.run.smithi119.stdout: "get": 0, 2024-06-02T05:06:17.802 INFO:teuthology.orchestra.run.smithi119.stdout: "get_sum": 0, 2024-06-02T05:06:17.802 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_fail": 0, 2024-06-02T05:06:17.802 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_success": 0, 2024-06-02T05:06:17.802 INFO:teuthology.orchestra.run.smithi119.stdout: "take": 0, 2024-06-02T05:06:17.802 INFO:teuthology.orchestra.run.smithi119.stdout: "take_sum": 0, 2024-06-02T05:06:17.802 INFO:teuthology.orchestra.run.smithi119.stdout: "put": 0, 2024-06-02T05:06:17.802 INFO:teuthology.orchestra.run.smithi119.stdout: "put_sum": 0, 2024-06-02T05:06:17.802 INFO:teuthology.orchestra.run.smithi119.stdout: "wait": { 2024-06-02T05:06:17.802 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-06-02T05:06:17.802 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-06-02T05:06:17.803 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-06-02T05:06:17.803 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-06-02T05:06:17.803 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-06-02T05:06:17.803 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-06-02T05:06:18.109 INFO:tasks.check_counter:Daemon mds.h mds.exported=0 2024-06-02T05:06:18.109 INFO:tasks.check_counter:Daemon mds.h mds.imported=0 2024-06-02T05:06:18.109 DEBUG:tasks.check_counter:Getting stats from k 2024-06-02T05:06:18.110 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell --fsid 60ab6d30-209a-11ef-bc9b-c7b262605968 -- ceph daemon mds.k perf dump 2024-06-02T05:06:18.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:06:17 smithi192 ceph-mon[47933]: pgmap v769: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 10 KiB/s wr, 10 op/s 2024-06-02T05:06:18.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:06:17 smithi076 ceph-mon[42935]: pgmap v769: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 10 KiB/s wr, 10 op/s 2024-06-02T05:06:18.332 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/mon.b/config 2024-06-02T05:06:18.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:06:17 smithi119 ceph-mon[46633]: pgmap v769: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 10 KiB/s wr, 10 op/s 2024-06-02T05:06:19.202 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-06-02T05:06:19.203 INFO:teuthology.orchestra.run.smithi119.stdout: "AsyncMessenger::Worker-0": { 2024-06-02T05:06:19.203 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_messages": 0, 2024-06-02T05:06:19.203 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages": 2, 2024-06-02T05:06:19.203 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_bytes": 0, 2024-06-02T05:06:19.203 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_bytes": 0, 2024-06-02T05:06:19.203 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_created_connections": 4, 2024-06-02T05:06:19.203 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_active_connections": 0, 2024-06-02T05:06:19.203 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_total_time": 0.001125119, 2024-06-02T05:06:19.203 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_send_time": 0.000000000, 2024-06-02T05:06:19.204 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_recv_time": 0.000183086, 2024-06-02T05:06:19.204 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-06-02T05:06:19.204 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T05:06:19.204 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-06-02T05:06:19.204 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-06-02T05:06:19.204 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-06-02T05:06:19.204 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:19.204 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_handle_ack_lat": { 2024-06-02T05:06:19.204 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-06-02T05:06:19.204 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-06-02T05:06:19.204 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-06-02T05:06:19.204 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:19.205 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_encrypted_bytes": 0, 2024-06-02T05:06:19.205 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_encrypted_bytes": 0 2024-06-02T05:06:19.205 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:19.205 INFO:teuthology.orchestra.run.smithi119.stdout: "AsyncMessenger::Worker-1": { 2024-06-02T05:06:19.205 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_messages": 2, 2024-06-02T05:06:19.205 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages": 228, 2024-06-02T05:06:19.205 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_bytes": 320, 2024-06-02T05:06:19.205 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_bytes": 192544, 2024-06-02T05:06:19.205 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_created_connections": 4, 2024-06-02T05:06:19.205 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_active_connections": 2, 2024-06-02T05:06:19.205 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_total_time": 0.010597394, 2024-06-02T05:06:19.206 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_send_time": 0.007491026, 2024-06-02T05:06:19.206 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_recv_time": 0.001262488, 2024-06-02T05:06:19.206 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-06-02T05:06:19.206 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T05:06:19.206 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 226, 2024-06-02T05:06:19.206 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.018822887, 2024-06-02T05:06:19.206 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000083287 2024-06-02T05:06:19.206 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:19.206 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_handle_ack_lat": { 2024-06-02T05:06:19.206 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-06-02T05:06:19.206 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-06-02T05:06:19.206 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-06-02T05:06:19.207 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:19.207 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_encrypted_bytes": 320, 2024-06-02T05:06:19.207 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_encrypted_bytes": 192544 2024-06-02T05:06:19.207 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:19.207 INFO:teuthology.orchestra.run.smithi119.stdout: "AsyncMessenger::Worker-2": { 2024-06-02T05:06:19.207 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_messages": 305, 2024-06-02T05:06:19.207 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages": 300, 2024-06-02T05:06:19.207 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_bytes": 498784, 2024-06-02T05:06:19.207 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_bytes": 171072, 2024-06-02T05:06:19.207 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_created_connections": 2, 2024-06-02T05:06:19.207 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_active_connections": 1, 2024-06-02T05:06:19.207 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_total_time": 0.037726203, 2024-06-02T05:06:19.207 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_send_time": 0.013533412, 2024-06-02T05:06:19.207 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_recv_time": 0.016751027, 2024-06-02T05:06:19.208 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_fast_dispatch_time": 0.006687986, 2024-06-02T05:06:19.208 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T05:06:19.208 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 300, 2024-06-02T05:06:19.208 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.021274719, 2024-06-02T05:06:19.208 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000070915 2024-06-02T05:06:19.208 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:19.208 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_handle_ack_lat": { 2024-06-02T05:06:19.208 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-06-02T05:06:19.208 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-06-02T05:06:19.208 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-06-02T05:06:19.208 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:19.208 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_encrypted_bytes": 498784, 2024-06-02T05:06:19.208 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_encrypted_bytes": 171072 2024-06-02T05:06:19.208 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:19.209 INFO:teuthology.orchestra.run.smithi119.stdout: "cct": { 2024-06-02T05:06:19.209 INFO:teuthology.orchestra.run.smithi119.stdout: "total_workers": 0, 2024-06-02T05:06:19.209 INFO:teuthology.orchestra.run.smithi119.stdout: "unhealthy_workers": 0 2024-06-02T05:06:19.209 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:19.209 INFO:teuthology.orchestra.run.smithi119.stdout: "mempool": { 2024-06-02T05:06:19.209 INFO:teuthology.orchestra.run.smithi119.stdout: "bloom_filter_bytes": 0, 2024-06-02T05:06:19.209 INFO:teuthology.orchestra.run.smithi119.stdout: "bloom_filter_items": 0, 2024-06-02T05:06:19.209 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_alloc_bytes": 0, 2024-06-02T05:06:19.209 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_alloc_items": 0, 2024-06-02T05:06:19.210 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_data_bytes": 0, 2024-06-02T05:06:19.210 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_data_items": 0, 2024-06-02T05:06:19.210 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_onode_bytes": 0, 2024-06-02T05:06:19.210 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_onode_items": 0, 2024-06-02T05:06:19.210 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_meta_bytes": 0, 2024-06-02T05:06:19.210 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_meta_items": 0, 2024-06-02T05:06:19.210 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_other_bytes": 0, 2024-06-02T05:06:19.210 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_other_items": 0, 2024-06-02T05:06:19.210 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_buffer_bytes": 0, 2024-06-02T05:06:19.210 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_buffer_items": 0, 2024-06-02T05:06:19.210 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_extent_bytes": 0, 2024-06-02T05:06:19.210 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_extent_items": 0, 2024-06-02T05:06:19.211 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_blob_bytes": 0, 2024-06-02T05:06:19.211 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_blob_items": 0, 2024-06-02T05:06:19.211 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_shared_blob_bytes": 0, 2024-06-02T05:06:19.211 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_shared_blob_items": 0, 2024-06-02T05:06:19.211 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_inline_bl_bytes": 0, 2024-06-02T05:06:19.211 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_inline_bl_items": 0, 2024-06-02T05:06:19.211 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_fsck_bytes": 0, 2024-06-02T05:06:19.211 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_fsck_items": 0, 2024-06-02T05:06:19.211 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_txc_bytes": 0, 2024-06-02T05:06:19.211 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_txc_items": 0, 2024-06-02T05:06:19.211 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_writing_deferred_bytes": 0, 2024-06-02T05:06:19.211 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_writing_deferred_items": 0, 2024-06-02T05:06:19.211 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_writing_bytes": 0, 2024-06-02T05:06:19.212 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_writing_items": 0, 2024-06-02T05:06:19.212 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_bytes": 0, 2024-06-02T05:06:19.212 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_items": 0, 2024-06-02T05:06:19.212 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_file_reader_bytes": 0, 2024-06-02T05:06:19.212 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_file_reader_items": 0, 2024-06-02T05:06:19.212 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_file_writer_bytes": 0, 2024-06-02T05:06:19.212 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_file_writer_items": 0, 2024-06-02T05:06:19.212 INFO:teuthology.orchestra.run.smithi119.stdout: "buffer_anon_bytes": 148744, 2024-06-02T05:06:19.212 INFO:teuthology.orchestra.run.smithi119.stdout: "buffer_anon_items": 30, 2024-06-02T05:06:19.212 INFO:teuthology.orchestra.run.smithi119.stdout: "buffer_meta_bytes": 0, 2024-06-02T05:06:19.212 INFO:teuthology.orchestra.run.smithi119.stdout: "buffer_meta_items": 0, 2024-06-02T05:06:19.212 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_bytes": 0, 2024-06-02T05:06:19.212 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_items": 0, 2024-06-02T05:06:19.213 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_mapbl_bytes": 0, 2024-06-02T05:06:19.213 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_mapbl_items": 0, 2024-06-02T05:06:19.213 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_pglog_bytes": 0, 2024-06-02T05:06:19.213 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_pglog_items": 0, 2024-06-02T05:06:19.213 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_bytes": 0, 2024-06-02T05:06:19.213 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_items": 0, 2024-06-02T05:06:19.213 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_mapping_bytes": 0, 2024-06-02T05:06:19.213 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_mapping_items": 0, 2024-06-02T05:06:19.213 INFO:teuthology.orchestra.run.smithi119.stdout: "pgmap_bytes": 0, 2024-06-02T05:06:19.213 INFO:teuthology.orchestra.run.smithi119.stdout: "pgmap_items": 0, 2024-06-02T05:06:19.213 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_co_bytes": 928, 2024-06-02T05:06:19.213 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_co_items": 2, 2024-06-02T05:06:19.213 INFO:teuthology.orchestra.run.smithi119.stdout: "unittest_1_bytes": 0, 2024-06-02T05:06:19.214 INFO:teuthology.orchestra.run.smithi119.stdout: "unittest_1_items": 0, 2024-06-02T05:06:19.214 INFO:teuthology.orchestra.run.smithi119.stdout: "unittest_2_bytes": 0, 2024-06-02T05:06:19.214 INFO:teuthology.orchestra.run.smithi119.stdout: "unittest_2_items": 0 2024-06-02T05:06:19.214 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-06-02T05:06:19.214 INFO:teuthology.orchestra.run.smithi119.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-06-02T05:06:19.214 INFO:teuthology.orchestra.run.smithi119.stdout: "val": 0, 2024-06-02T05:06:19.214 INFO:teuthology.orchestra.run.smithi119.stdout: "max": 104857600, 2024-06-02T05:06:19.214 INFO:teuthology.orchestra.run.smithi119.stdout: "get_started": 0, 2024-06-02T05:06:19.214 INFO:teuthology.orchestra.run.smithi119.stdout: "get": 303, 2024-06-02T05:06:19.214 INFO:teuthology.orchestra.run.smithi119.stdout: "get_sum": 453315, 2024-06-02T05:06:19.214 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_fail": 0, 2024-06-02T05:06:19.214 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_success": 303, 2024-06-02T05:06:19.214 INFO:teuthology.orchestra.run.smithi119.stdout: "take": 0, 2024-06-02T05:06:19.215 INFO:teuthology.orchestra.run.smithi119.stdout: "take_sum": 0, 2024-06-02T05:06:19.215 INFO:teuthology.orchestra.run.smithi119.stdout: "put": 303, 2024-06-02T05:06:19.215 INFO:teuthology.orchestra.run.smithi119.stdout: "put_sum": 453315, 2024-06-02T05:06:19.215 INFO:teuthology.orchestra.run.smithi119.stdout: "wait": { 2024-06-02T05:06:19.215 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-06-02T05:06:19.215 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-06-02T05:06:19.215 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-06-02T05:06:19.215 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-06-02T05:06:19.215 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-06-02T05:06:19.215 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-06-02T05:06:19.568 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.k 2024-06-02T05:06:19.568 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.k 2024-06-02T05:06:19.568 DEBUG:tasks.check_counter:Getting stats from c 2024-06-02T05:06:19.568 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell --fsid 60ab6d30-209a-11ef-bc9b-c7b262605968 -- ceph daemon mds.c perf dump 2024-06-02T05:06:19.977 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/mon.c/config 2024-06-02T05:06:20.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:06:19 smithi192 ceph-mon[47933]: pgmap v770: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 8.5 KiB/s wr, 8 op/s 2024-06-02T05:06:20.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:06:19 smithi076 ceph-mon[42935]: pgmap v770: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 8.5 KiB/s wr, 8 op/s 2024-06-02T05:06:20.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:06:19 smithi119 ceph-mon[46633]: pgmap v770: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 8.5 KiB/s wr, 8 op/s 2024-06-02T05:06:21.598 INFO:teuthology.orchestra.run.smithi192.stdout:{ 2024-06-02T05:06:21.598 INFO:teuthology.orchestra.run.smithi192.stdout: "AsyncMessenger::Worker-0": { 2024-06-02T05:06:21.598 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_messages": 1379, 2024-06-02T05:06:21.598 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages": 1364, 2024-06-02T05:06:21.599 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_bytes": 862357, 2024-06-02T05:06:21.599 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_bytes": 3314453, 2024-06-02T05:06:21.599 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_created_connections": 15, 2024-06-02T05:06:21.599 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_active_connections": 7, 2024-06-02T05:06:21.599 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_total_time": 0.122117458, 2024-06-02T05:06:21.599 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_send_time": 0.040417909, 2024-06-02T05:06:21.599 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_recv_time": 0.039476751, 2024-06-02T05:06:21.599 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_fast_dispatch_time": 0.034955041, 2024-06-02T05:06:21.599 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T05:06:21.599 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 1361, 2024-06-02T05:06:21.599 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.124324485, 2024-06-02T05:06:21.599 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000091347 2024-06-02T05:06:21.600 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:21.600 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_handle_ack_lat": { 2024-06-02T05:06:21.600 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 15, 2024-06-02T05:06:21.600 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000002601, 2024-06-02T05:06:21.600 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000173 2024-06-02T05:06:21.600 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:21.600 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_encrypted_bytes": 572144, 2024-06-02T05:06:21.600 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_encrypted_bytes": 177840 2024-06-02T05:06:21.600 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:21.600 INFO:teuthology.orchestra.run.smithi192.stdout: "AsyncMessenger::Worker-1": { 2024-06-02T05:06:21.600 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_messages": 3763, 2024-06-02T05:06:21.600 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages": 3976, 2024-06-02T05:06:21.600 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_bytes": 1237494, 2024-06-02T05:06:21.601 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_bytes": 2571833, 2024-06-02T05:06:21.601 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_created_connections": 13, 2024-06-02T05:06:21.601 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_active_connections": 6, 2024-06-02T05:06:21.601 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_total_time": 0.228259428, 2024-06-02T05:06:21.601 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_send_time": 0.090451650, 2024-06-02T05:06:21.601 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_recv_time": 0.169827288, 2024-06-02T05:06:21.601 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_fast_dispatch_time": 0.007934739, 2024-06-02T05:06:21.601 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T05:06:21.601 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 3975, 2024-06-02T05:06:21.601 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.226120701, 2024-06-02T05:06:21.601 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000056885 2024-06-02T05:06:21.601 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:21.601 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_handle_ack_lat": { 2024-06-02T05:06:21.601 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 6201, 2024-06-02T05:06:21.602 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.001080531, 2024-06-02T05:06:21.602 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000174 2024-06-02T05:06:21.602 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:21.602 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_encrypted_bytes": 3232, 2024-06-02T05:06:21.602 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_encrypted_bytes": 547872 2024-06-02T05:06:21.602 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:21.602 INFO:teuthology.orchestra.run.smithi192.stdout: "AsyncMessenger::Worker-2": { 2024-06-02T05:06:21.602 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_messages": 5123, 2024-06-02T05:06:21.602 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages": 3913, 2024-06-02T05:06:21.602 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_bytes": 1895860, 2024-06-02T05:06:21.602 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_bytes": 1258735, 2024-06-02T05:06:21.603 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_created_connections": 8, 2024-06-02T05:06:21.603 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_active_connections": 5, 2024-06-02T05:06:21.603 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_total_time": 0.247714302, 2024-06-02T05:06:21.603 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_send_time": 0.091053923, 2024-06-02T05:06:21.603 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_recv_time": 0.185548621, 2024-06-02T05:06:21.603 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_fast_dispatch_time": 0.014493719, 2024-06-02T05:06:21.603 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T05:06:21.603 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 3913, 2024-06-02T05:06:21.603 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.189332649, 2024-06-02T05:06:21.603 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000048385 2024-06-02T05:06:21.603 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:21.603 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_handle_ack_lat": { 2024-06-02T05:06:21.604 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 7966, 2024-06-02T05:06:21.604 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.001339304, 2024-06-02T05:06:21.604 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000168 2024-06-02T05:06:21.604 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:21.604 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_encrypted_bytes": 0, 2024-06-02T05:06:21.604 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_encrypted_bytes": 0 2024-06-02T05:06:21.604 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:21.604 INFO:teuthology.orchestra.run.smithi192.stdout: "cct": { 2024-06-02T05:06:21.604 INFO:teuthology.orchestra.run.smithi192.stdout: "total_workers": 1, 2024-06-02T05:06:21.604 INFO:teuthology.orchestra.run.smithi192.stdout: "unhealthy_workers": 0 2024-06-02T05:06:21.604 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:21.604 INFO:teuthology.orchestra.run.smithi192.stdout: "finisher-MDSRank": { 2024-06-02T05:06:21.605 INFO:teuthology.orchestra.run.smithi192.stdout: "queue_len": 0, 2024-06-02T05:06:21.605 INFO:teuthology.orchestra.run.smithi192.stdout: "complete_latency": { 2024-06-02T05:06:21.605 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 1809, 2024-06-02T05:06:21.605 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.502464794, 2024-06-02T05:06:21.605 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000277758 2024-06-02T05:06:21.605 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-06-02T05:06:21.605 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:21.605 INFO:teuthology.orchestra.run.smithi192.stdout: "finisher-PurgeQueue": { 2024-06-02T05:06:21.605 INFO:teuthology.orchestra.run.smithi192.stdout: "queue_len": 0, 2024-06-02T05:06:21.605 INFO:teuthology.orchestra.run.smithi192.stdout: "complete_latency": { 2024-06-02T05:06:21.605 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 595, 2024-06-02T05:06:21.605 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.023289983, 2024-06-02T05:06:21.605 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000039142 2024-06-02T05:06:21.606 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-06-02T05:06:21.606 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:21.606 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": { 2024-06-02T05:06:21.606 INFO:teuthology.orchestra.run.smithi192.stdout: "request": 1306, 2024-06-02T05:06:21.606 INFO:teuthology.orchestra.run.smithi192.stdout: "reply": 1305, 2024-06-02T05:06:21.606 INFO:teuthology.orchestra.run.smithi192.stdout: "reply_latency": { 2024-06-02T05:06:21.606 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 1305, 2024-06-02T05:06:21.606 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 1.535026443, 2024-06-02T05:06:21.606 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.001176265 2024-06-02T05:06:21.606 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:21.606 INFO:teuthology.orchestra.run.smithi192.stdout: "slow_reply": 0, 2024-06-02T05:06:21.606 INFO:teuthology.orchestra.run.smithi192.stdout: "forward": 1, 2024-06-02T05:06:21.606 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_fetch_complete": 0, 2024-06-02T05:06:21.607 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_fetch_keys": 0, 2024-06-02T05:06:21.607 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_commit": 11, 2024-06-02T05:06:21.607 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_split": 0, 2024-06-02T05:06:21.607 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_merge": 0, 2024-06-02T05:06:21.607 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes": 459, 2024-06-02T05:06:21.607 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes_top": 0, 2024-06-02T05:06:21.607 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes_bottom": 0, 2024-06-02T05:06:21.607 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes_pin_tail": 459, 2024-06-02T05:06:21.607 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes_pinned": 459, 2024-06-02T05:06:21.607 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes_expired": 3, 2024-06-02T05:06:21.607 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes_with_caps": 441, 2024-06-02T05:06:21.607 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": 441, 2024-06-02T05:06:21.607 INFO:teuthology.orchestra.run.smithi192.stdout: "subtrees": 13, 2024-06-02T05:06:21.608 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse": 3558, 2024-06-02T05:06:21.608 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse_hit": 2378, 2024-06-02T05:06:21.608 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse_forward": 0, 2024-06-02T05:06:21.608 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse_discover": 8, 2024-06-02T05:06:21.608 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse_dir_fetch": 0, 2024-06-02T05:06:21.608 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse_remote_ino": 0, 2024-06-02T05:06:21.608 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse_lock": 4, 2024-06-02T05:06:21.608 INFO:teuthology.orchestra.run.smithi192.stdout: "load_cent": 6239, 2024-06-02T05:06:21.608 INFO:teuthology.orchestra.run.smithi192.stdout: "q": 0, 2024-06-02T05:06:21.608 INFO:teuthology.orchestra.run.smithi192.stdout: "exported": 1, 2024-06-02T05:06:21.608 INFO:teuthology.orchestra.run.smithi192.stdout: "exported_inodes": 6, 2024-06-02T05:06:21.608 INFO:teuthology.orchestra.run.smithi192.stdout: "imported": 12, 2024-06-02T05:06:21.608 INFO:teuthology.orchestra.run.smithi192.stdout: "imported_inodes": 443, 2024-06-02T05:06:21.609 INFO:teuthology.orchestra.run.smithi192.stdout: "openino_dir_fetch": 0, 2024-06-02T05:06:21.609 INFO:teuthology.orchestra.run.smithi192.stdout: "openino_backtrace_fetch": 301, 2024-06-02T05:06:21.609 INFO:teuthology.orchestra.run.smithi192.stdout: "openino_peer_discover": 0, 2024-06-02T05:06:21.609 INFO:teuthology.orchestra.run.smithi192.stdout: "root_rfiles": 1037, 2024-06-02T05:06:21.609 INFO:teuthology.orchestra.run.smithi192.stdout: "root_rbytes": 1696889314, 2024-06-02T05:06:21.609 INFO:teuthology.orchestra.run.smithi192.stdout: "root_rsnaps": 0, 2024-06-02T05:06:21.609 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_backtrace_fetch": 301, 2024-06-02T05:06:21.609 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_set_tag": 0, 2024-06-02T05:06:21.609 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_backtrace_repaired": 0, 2024-06-02T05:06:21.609 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_inotable_repaired": 0, 2024-06-02T05:06:21.609 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_dir_inodes": 0, 2024-06-02T05:06:21.609 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_dir_base_inodes": 0, 2024-06-02T05:06:21.609 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_dirfrag_rstats": 0, 2024-06-02T05:06:21.610 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_file_inodes": 301, 2024-06-02T05:06:21.610 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_inode_file_caps": 0, 2024-06-02T05:06:21.610 INFO:teuthology.orchestra.run.smithi192.stdout: "ceph_cap_op_revoke": 176, 2024-06-02T05:06:21.610 INFO:teuthology.orchestra.run.smithi192.stdout: "ceph_cap_op_grant": 542, 2024-06-02T05:06:21.610 INFO:teuthology.orchestra.run.smithi192.stdout: "ceph_cap_op_trunc": 0, 2024-06-02T05:06:21.610 INFO:teuthology.orchestra.run.smithi192.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-06-02T05:06:21.610 INFO:teuthology.orchestra.run.smithi192.stdout: "ceph_cap_op_flush_ack": 0, 2024-06-02T05:06:21.610 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_client_caps": 2088, 2024-06-02T05:06:21.611 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_client_caps_dirty": 698, 2024-06-02T05:06:21.611 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_client_cap_release": 43, 2024-06-02T05:06:21.611 INFO:teuthology.orchestra.run.smithi192.stdout: "process_request_cap_release": 668 2024-06-02T05:06:21.611 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:21.611 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_cache": { 2024-06-02T05:06:21.611 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_update": 0, 2024-06-02T05:06:21.611 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_update_receipt": 0, 2024-06-02T05:06:21.611 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_try_discover": 0, 2024-06-02T05:06:21.611 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_send_discover": 8, 2024-06-02T05:06:21.611 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_handle_discover": 0, 2024-06-02T05:06:21.611 INFO:teuthology.orchestra.run.smithi192.stdout: "num_strays": 0, 2024-06-02T05:06:21.611 INFO:teuthology.orchestra.run.smithi192.stdout: "num_strays_delayed": 0, 2024-06-02T05:06:21.612 INFO:teuthology.orchestra.run.smithi192.stdout: "num_strays_enqueuing": 0, 2024-06-02T05:06:21.612 INFO:teuthology.orchestra.run.smithi192.stdout: "strays_created": 135, 2024-06-02T05:06:21.612 INFO:teuthology.orchestra.run.smithi192.stdout: "strays_enqueued": 135, 2024-06-02T05:06:21.612 INFO:teuthology.orchestra.run.smithi192.stdout: "strays_reintegrated": 0, 2024-06-02T05:06:21.612 INFO:teuthology.orchestra.run.smithi192.stdout: "strays_migrated": 0, 2024-06-02T05:06:21.612 INFO:teuthology.orchestra.run.smithi192.stdout: "num_recovering_processing": 0, 2024-06-02T05:06:21.612 INFO:teuthology.orchestra.run.smithi192.stdout: "num_recovering_enqueued": 0, 2024-06-02T05:06:21.612 INFO:teuthology.orchestra.run.smithi192.stdout: "num_recovering_prioritized": 0, 2024-06-02T05:06:21.612 INFO:teuthology.orchestra.run.smithi192.stdout: "recovery_started": 0, 2024-06-02T05:06:21.612 INFO:teuthology.orchestra.run.smithi192.stdout: "recovery_completed": 0, 2024-06-02T05:06:21.612 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_enqueue_scrub": 0, 2024-06-02T05:06:21.612 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_exportdir": 1, 2024-06-02T05:06:21.612 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_flush": 0, 2024-06-02T05:06:21.612 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_fragmentdir": 0, 2024-06-02T05:06:21.613 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_fragstats": 0, 2024-06-02T05:06:21.613 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_inodestats": 0 2024-06-02T05:06:21.613 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:21.613 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_log": { 2024-06-02T05:06:21.613 INFO:teuthology.orchestra.run.smithi192.stdout: "evadd": 2293, 2024-06-02T05:06:21.613 INFO:teuthology.orchestra.run.smithi192.stdout: "evex": 0, 2024-06-02T05:06:21.613 INFO:teuthology.orchestra.run.smithi192.stdout: "evtrm": 0, 2024-06-02T05:06:21.613 INFO:teuthology.orchestra.run.smithi192.stdout: "ev": 2293, 2024-06-02T05:06:21.613 INFO:teuthology.orchestra.run.smithi192.stdout: "evexg": 0, 2024-06-02T05:06:21.613 INFO:teuthology.orchestra.run.smithi192.stdout: "evexd": 0, 2024-06-02T05:06:21.613 INFO:teuthology.orchestra.run.smithi192.stdout: "segadd": 3, 2024-06-02T05:06:21.613 INFO:teuthology.orchestra.run.smithi192.stdout: "segex": 0, 2024-06-02T05:06:21.613 INFO:teuthology.orchestra.run.smithi192.stdout: "segtrm": 0, 2024-06-02T05:06:21.614 INFO:teuthology.orchestra.run.smithi192.stdout: "seg": 3, 2024-06-02T05:06:21.614 INFO:teuthology.orchestra.run.smithi192.stdout: "segexg": 0, 2024-06-02T05:06:21.614 INFO:teuthology.orchestra.run.smithi192.stdout: "segexd": 0, 2024-06-02T05:06:21.614 INFO:teuthology.orchestra.run.smithi192.stdout: "expos": 4194304, 2024-06-02T05:06:21.614 INFO:teuthology.orchestra.run.smithi192.stdout: "wrpos": 6970904, 2024-06-02T05:06:21.614 INFO:teuthology.orchestra.run.smithi192.stdout: "rdpos": 0, 2024-06-02T05:06:21.614 INFO:teuthology.orchestra.run.smithi192.stdout: "jlat": { 2024-06-02T05:06:21.614 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 732, 2024-06-02T05:06:21.615 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 2.810163338, 2024-06-02T05:06:21.615 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.003839020 2024-06-02T05:06:21.615 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:21.615 INFO:teuthology.orchestra.run.smithi192.stdout: "replayed": 0 2024-06-02T05:06:21.615 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:21.615 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_mem": { 2024-06-02T05:06:21.615 INFO:teuthology.orchestra.run.smithi192.stdout: "ino": 461, 2024-06-02T05:06:21.615 INFO:teuthology.orchestra.run.smithi192.stdout: "ino+": 596, 2024-06-02T05:06:21.615 INFO:teuthology.orchestra.run.smithi192.stdout: "ino-": 135, 2024-06-02T05:06:21.615 INFO:teuthology.orchestra.run.smithi192.stdout: "dir": 31, 2024-06-02T05:06:21.615 INFO:teuthology.orchestra.run.smithi192.stdout: "dir+": 32, 2024-06-02T05:06:21.615 INFO:teuthology.orchestra.run.smithi192.stdout: "dir-": 1, 2024-06-02T05:06:21.615 INFO:teuthology.orchestra.run.smithi192.stdout: "dn": 462, 2024-06-02T05:06:21.616 INFO:teuthology.orchestra.run.smithi192.stdout: "dn+": 610, 2024-06-02T05:06:21.616 INFO:teuthology.orchestra.run.smithi192.stdout: "dn-": 148, 2024-06-02T05:06:21.616 INFO:teuthology.orchestra.run.smithi192.stdout: "cap": 441, 2024-06-02T05:06:21.616 INFO:teuthology.orchestra.run.smithi192.stdout: "cap+": 577, 2024-06-02T05:06:21.616 INFO:teuthology.orchestra.run.smithi192.stdout: "cap-": 136, 2024-06-02T05:06:21.616 INFO:teuthology.orchestra.run.smithi192.stdout: "rss": 56748, 2024-06-02T05:06:21.616 INFO:teuthology.orchestra.run.smithi192.stdout: "heap": 198964 2024-06-02T05:06:21.616 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:21.616 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_server": { 2024-06-02T05:06:21.617 INFO:teuthology.orchestra.run.smithi192.stdout: "dispatch_client_request": 2140, 2024-06-02T05:06:21.617 INFO:teuthology.orchestra.run.smithi192.stdout: "dispatch_server_request": 0, 2024-06-02T05:06:21.617 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_client_request": 1306, 2024-06-02T05:06:21.617 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_client_session": 17, 2024-06-02T05:06:21.617 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_peer_request": 271, 2024-06-02T05:06:21.617 INFO:teuthology.orchestra.run.smithi192.stdout: "req_create_latency": { 2024-06-02T05:06:21.617 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 135, 2024-06-02T05:06:21.617 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.403437455, 2024-06-02T05:06:21.617 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.002988425 2024-06-02T05:06:21.617 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:21.617 INFO:teuthology.orchestra.run.smithi192.stdout: "req_getattr_latency": { 2024-06-02T05:06:21.617 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 18, 2024-06-02T05:06:21.617 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.012591350, 2024-06-02T05:06:21.618 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000699519 2024-06-02T05:06:21.618 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:21.618 INFO:teuthology.orchestra.run.smithi192.stdout: "req_getfilelock_latency": { 2024-06-02T05:06:21.618 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-06-02T05:06:21.618 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-06-02T05:06:21.618 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-06-02T05:06:21.618 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:21.618 INFO:teuthology.orchestra.run.smithi192.stdout: "req_link_latency": { 2024-06-02T05:06:21.618 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-06-02T05:06:21.618 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-06-02T05:06:21.618 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-06-02T05:06:21.618 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:21.618 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lookup_latency": { 2024-06-02T05:06:21.619 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 888, 2024-06-02T05:06:21.619 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.358069798, 2024-06-02T05:06:21.619 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000403231 2024-06-02T05:06:21.619 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:21.619 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lookuphash_latency": { 2024-06-02T05:06:21.619 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-06-02T05:06:21.619 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-06-02T05:06:21.619 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-06-02T05:06:21.619 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:21.619 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lookupino_latency": { 2024-06-02T05:06:21.619 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-06-02T05:06:21.619 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-06-02T05:06:21.619 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-06-02T05:06:21.619 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:21.620 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lookupname_latency": { 2024-06-02T05:06:21.620 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-06-02T05:06:21.620 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-06-02T05:06:21.620 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-06-02T05:06:21.620 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:21.620 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lookupparent_latency": { 2024-06-02T05:06:21.620 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-06-02T05:06:21.620 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-06-02T05:06:21.620 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-06-02T05:06:21.620 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:21.620 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lookupsnap_latency": { 2024-06-02T05:06:21.620 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-06-02T05:06:21.620 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-06-02T05:06:21.621 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-06-02T05:06:21.621 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:21.621 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lssnap_latency": { 2024-06-02T05:06:21.621 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-06-02T05:06:21.621 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-06-02T05:06:21.621 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-06-02T05:06:21.621 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:21.621 INFO:teuthology.orchestra.run.smithi192.stdout: "req_mkdir_latency": { 2024-06-02T05:06:21.621 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-06-02T05:06:21.621 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-06-02T05:06:21.621 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-06-02T05:06:21.621 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:21.621 INFO:teuthology.orchestra.run.smithi192.stdout: "req_mknod_latency": { 2024-06-02T05:06:21.622 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-06-02T05:06:21.622 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-06-02T05:06:21.622 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-06-02T05:06:21.622 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:21.622 INFO:teuthology.orchestra.run.smithi192.stdout: "req_mksnap_latency": { 2024-06-02T05:06:21.622 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-06-02T05:06:21.622 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-06-02T05:06:21.622 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-06-02T05:06:21.622 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:21.622 INFO:teuthology.orchestra.run.smithi192.stdout: "req_open_latency": { 2024-06-02T05:06:21.622 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 114, 2024-06-02T05:06:21.622 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.077350669, 2024-06-02T05:06:21.622 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000678514 2024-06-02T05:06:21.623 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:21.623 INFO:teuthology.orchestra.run.smithi192.stdout: "req_readdir_latency": { 2024-06-02T05:06:21.623 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 15, 2024-06-02T05:06:21.623 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.016246708, 2024-06-02T05:06:21.623 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.001083113 2024-06-02T05:06:21.623 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:21.623 INFO:teuthology.orchestra.run.smithi192.stdout: "req_rename_latency": { 2024-06-02T05:06:21.623 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 131, 2024-06-02T05:06:21.623 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.656768796, 2024-06-02T05:06:21.623 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.005013502 2024-06-02T05:06:21.623 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:21.623 INFO:teuthology.orchestra.run.smithi192.stdout: "req_renamesnap_latency": { 2024-06-02T05:06:21.623 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-06-02T05:06:21.624 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-06-02T05:06:21.624 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-06-02T05:06:21.624 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:21.624 INFO:teuthology.orchestra.run.smithi192.stdout: "req_snapdiff_latency": { 2024-06-02T05:06:21.624 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-06-02T05:06:21.624 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-06-02T05:06:21.624 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-06-02T05:06:21.624 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:21.624 INFO:teuthology.orchestra.run.smithi192.stdout: "req_rmdir_latency": { 2024-06-02T05:06:21.624 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-06-02T05:06:21.624 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-06-02T05:06:21.624 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-06-02T05:06:21.624 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:21.624 INFO:teuthology.orchestra.run.smithi192.stdout: "req_rmsnap_latency": { 2024-06-02T05:06:21.625 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-06-02T05:06:21.625 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-06-02T05:06:21.625 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-06-02T05:06:21.625 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:21.625 INFO:teuthology.orchestra.run.smithi192.stdout: "req_rmxattr_latency": { 2024-06-02T05:06:21.625 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-06-02T05:06:21.625 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-06-02T05:06:21.625 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-06-02T05:06:21.625 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:21.625 INFO:teuthology.orchestra.run.smithi192.stdout: "req_setattr_latency": { 2024-06-02T05:06:21.625 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-06-02T05:06:21.625 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-06-02T05:06:21.625 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-06-02T05:06:21.626 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:21.626 INFO:teuthology.orchestra.run.smithi192.stdout: "req_setdirlayout_latency": { 2024-06-02T05:06:21.626 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-06-02T05:06:21.626 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-06-02T05:06:21.626 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-06-02T05:06:21.626 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:21.626 INFO:teuthology.orchestra.run.smithi192.stdout: "req_setfilelock_latency": { 2024-06-02T05:06:21.626 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-06-02T05:06:21.626 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-06-02T05:06:21.626 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-06-02T05:06:21.626 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:21.626 INFO:teuthology.orchestra.run.smithi192.stdout: "req_setlayout_latency": { 2024-06-02T05:06:21.626 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-06-02T05:06:21.627 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-06-02T05:06:21.627 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-06-02T05:06:21.627 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:21.627 INFO:teuthology.orchestra.run.smithi192.stdout: "req_setxattr_latency": { 2024-06-02T05:06:21.627 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-06-02T05:06:21.627 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-06-02T05:06:21.627 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-06-02T05:06:21.627 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:21.627 INFO:teuthology.orchestra.run.smithi192.stdout: "req_symlink_latency": { 2024-06-02T05:06:21.627 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-06-02T05:06:21.627 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-06-02T05:06:21.627 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-06-02T05:06:21.627 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:21.627 INFO:teuthology.orchestra.run.smithi192.stdout: "req_unlink_latency": { 2024-06-02T05:06:21.628 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 4, 2024-06-02T05:06:21.628 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.010561667, 2024-06-02T05:06:21.628 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.002640416 2024-06-02T05:06:21.628 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:21.628 INFO:teuthology.orchestra.run.smithi192.stdout: "cap_revoke_eviction": 0, 2024-06-02T05:06:21.628 INFO:teuthology.orchestra.run.smithi192.stdout: "cap_acquisition_throttle": 0, 2024-06-02T05:06:21.628 INFO:teuthology.orchestra.run.smithi192.stdout: "req_getvxattr_latency": { 2024-06-02T05:06:21.628 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-06-02T05:06:21.628 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-06-02T05:06:21.628 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-06-02T05:06:21.628 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-06-02T05:06:21.628 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:21.628 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_sessions": { 2024-06-02T05:06:21.629 INFO:teuthology.orchestra.run.smithi192.stdout: "session_count": 1, 2024-06-02T05:06:21.629 INFO:teuthology.orchestra.run.smithi192.stdout: "session_add": 2, 2024-06-02T05:06:21.629 INFO:teuthology.orchestra.run.smithi192.stdout: "session_remove": 1, 2024-06-02T05:06:21.629 INFO:teuthology.orchestra.run.smithi192.stdout: "sessions_open": 1, 2024-06-02T05:06:21.629 INFO:teuthology.orchestra.run.smithi192.stdout: "sessions_stale": 0, 2024-06-02T05:06:21.629 INFO:teuthology.orchestra.run.smithi192.stdout: "total_load": 136, 2024-06-02T05:06:21.629 INFO:teuthology.orchestra.run.smithi192.stdout: "average_load": 136, 2024-06-02T05:06:21.629 INFO:teuthology.orchestra.run.smithi192.stdout: "avg_session_uptime": 1002, 2024-06-02T05:06:21.629 INFO:teuthology.orchestra.run.smithi192.stdout: "mdthresh_evicted": 0 2024-06-02T05:06:21.629 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:21.629 INFO:teuthology.orchestra.run.smithi192.stdout: "mempool": { 2024-06-02T05:06:21.629 INFO:teuthology.orchestra.run.smithi192.stdout: "bloom_filter_bytes": 0, 2024-06-02T05:06:21.629 INFO:teuthology.orchestra.run.smithi192.stdout: "bloom_filter_items": 0, 2024-06-02T05:06:21.630 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_alloc_bytes": 0, 2024-06-02T05:06:21.630 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_alloc_items": 0, 2024-06-02T05:06:21.630 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_data_bytes": 0, 2024-06-02T05:06:21.630 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_data_items": 0, 2024-06-02T05:06:21.630 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_onode_bytes": 0, 2024-06-02T05:06:21.630 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_onode_items": 0, 2024-06-02T05:06:21.630 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_meta_bytes": 0, 2024-06-02T05:06:21.630 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_meta_items": 0, 2024-06-02T05:06:21.630 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_other_bytes": 0, 2024-06-02T05:06:21.630 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_other_items": 0, 2024-06-02T05:06:21.630 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_buffer_bytes": 0, 2024-06-02T05:06:21.630 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_buffer_items": 0, 2024-06-02T05:06:21.630 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_extent_bytes": 0, 2024-06-02T05:06:21.631 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_extent_items": 0, 2024-06-02T05:06:21.631 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_blob_bytes": 0, 2024-06-02T05:06:21.631 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_blob_items": 0, 2024-06-02T05:06:21.631 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_shared_blob_bytes": 0, 2024-06-02T05:06:21.631 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_shared_blob_items": 0, 2024-06-02T05:06:21.631 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_inline_bl_bytes": 0, 2024-06-02T05:06:21.631 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_inline_bl_items": 0, 2024-06-02T05:06:21.631 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_fsck_bytes": 0, 2024-06-02T05:06:21.631 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_fsck_items": 0, 2024-06-02T05:06:21.631 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_txc_bytes": 0, 2024-06-02T05:06:21.631 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_txc_items": 0, 2024-06-02T05:06:21.631 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_writing_deferred_bytes": 0, 2024-06-02T05:06:21.632 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_writing_deferred_items": 0, 2024-06-02T05:06:21.632 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_writing_bytes": 0, 2024-06-02T05:06:21.632 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_writing_items": 0, 2024-06-02T05:06:21.632 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_bytes": 0, 2024-06-02T05:06:21.632 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_items": 0, 2024-06-02T05:06:21.632 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_file_reader_bytes": 0, 2024-06-02T05:06:21.632 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_file_reader_items": 0, 2024-06-02T05:06:21.632 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_file_writer_bytes": 0, 2024-06-02T05:06:21.632 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_file_writer_items": 0, 2024-06-02T05:06:21.632 INFO:teuthology.orchestra.run.smithi192.stdout: "buffer_anon_bytes": 294164, 2024-06-02T05:06:21.633 INFO:teuthology.orchestra.run.smithi192.stdout: "buffer_anon_items": 119, 2024-06-02T05:06:21.633 INFO:teuthology.orchestra.run.smithi192.stdout: "buffer_meta_bytes": 0, 2024-06-02T05:06:21.633 INFO:teuthology.orchestra.run.smithi192.stdout: "buffer_meta_items": 0, 2024-06-02T05:06:21.633 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_bytes": 0, 2024-06-02T05:06:21.633 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_items": 0, 2024-06-02T05:06:21.633 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_mapbl_bytes": 0, 2024-06-02T05:06:21.633 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_mapbl_items": 0, 2024-06-02T05:06:21.633 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_pglog_bytes": 0, 2024-06-02T05:06:21.633 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_pglog_items": 0, 2024-06-02T05:06:21.633 INFO:teuthology.orchestra.run.smithi192.stdout: "osdmap_bytes": 8800, 2024-06-02T05:06:21.633 INFO:teuthology.orchestra.run.smithi192.stdout: "osdmap_items": 169, 2024-06-02T05:06:21.633 INFO:teuthology.orchestra.run.smithi192.stdout: "osdmap_mapping_bytes": 0, 2024-06-02T05:06:21.633 INFO:teuthology.orchestra.run.smithi192.stdout: "osdmap_mapping_items": 0, 2024-06-02T05:06:21.634 INFO:teuthology.orchestra.run.smithi192.stdout: "pgmap_bytes": 0, 2024-06-02T05:06:21.634 INFO:teuthology.orchestra.run.smithi192.stdout: "pgmap_items": 0, 2024-06-02T05:06:21.634 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_co_bytes": 1494094, 2024-06-02T05:06:21.634 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_co_items": 7447, 2024-06-02T05:06:21.634 INFO:teuthology.orchestra.run.smithi192.stdout: "unittest_1_bytes": 0, 2024-06-02T05:06:21.634 INFO:teuthology.orchestra.run.smithi192.stdout: "unittest_1_items": 0, 2024-06-02T05:06:21.634 INFO:teuthology.orchestra.run.smithi192.stdout: "unittest_2_bytes": 0, 2024-06-02T05:06:21.634 INFO:teuthology.orchestra.run.smithi192.stdout: "unittest_2_items": 0 2024-06-02T05:06:21.634 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:21.634 INFO:teuthology.orchestra.run.smithi192.stdout: "objecter": { 2024-06-02T05:06:21.634 INFO:teuthology.orchestra.run.smithi192.stdout: "op_active": 0, 2024-06-02T05:06:21.634 INFO:teuthology.orchestra.run.smithi192.stdout: "op_laggy": 0, 2024-06-02T05:06:21.634 INFO:teuthology.orchestra.run.smithi192.stdout: "op_send": 1694, 2024-06-02T05:06:21.635 INFO:teuthology.orchestra.run.smithi192.stdout: "op_send_bytes": 2835849, 2024-06-02T05:06:21.635 INFO:teuthology.orchestra.run.smithi192.stdout: "op_resend": 27, 2024-06-02T05:06:21.635 INFO:teuthology.orchestra.run.smithi192.stdout: "op_reply": 1694, 2024-06-02T05:06:21.635 INFO:teuthology.orchestra.run.smithi192.stdout: "op_latency": { 2024-06-02T05:06:21.635 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 1694, 2024-06-02T05:06:21.635 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 7.817850533, 2024-06-02T05:06:21.635 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.004615023 2024-06-02T05:06:21.635 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:21.635 INFO:teuthology.orchestra.run.smithi192.stdout: "op_inflight": 0, 2024-06-02T05:06:21.635 INFO:teuthology.orchestra.run.smithi192.stdout: "oplen_avg": { 2024-06-02T05:06:21.635 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 1694, 2024-06-02T05:06:21.635 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 1797 2024-06-02T05:06:21.635 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:21.636 INFO:teuthology.orchestra.run.smithi192.stdout: "op": 1694, 2024-06-02T05:06:21.636 INFO:teuthology.orchestra.run.smithi192.stdout: "op_r": 383, 2024-06-02T05:06:21.636 INFO:teuthology.orchestra.run.smithi192.stdout: "op_w": 1311, 2024-06-02T05:06:21.636 INFO:teuthology.orchestra.run.smithi192.stdout: "op_rmw": 0, 2024-06-02T05:06:21.636 INFO:teuthology.orchestra.run.smithi192.stdout: "op_pg": 0, 2024-06-02T05:06:21.636 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_stat": 0, 2024-06-02T05:06:21.636 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_create": 10, 2024-06-02T05:06:21.636 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_read": 82, 2024-06-02T05:06:21.636 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_write": 814, 2024-06-02T05:06:21.636 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_writefull": 123, 2024-06-02T05:06:21.636 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_writesame": 0, 2024-06-02T05:06:21.636 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_append": 0, 2024-06-02T05:06:21.636 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_zero": 0, 2024-06-02T05:06:21.636 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_truncate": 0, 2024-06-02T05:06:21.637 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_delete": 282, 2024-06-02T05:06:21.637 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_mapext": 0, 2024-06-02T05:06:21.637 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_sparse_read": 0, 2024-06-02T05:06:21.637 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_clonerange": 0, 2024-06-02T05:06:21.637 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_getxattr": 301, 2024-06-02T05:06:21.637 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_setxattr": 20, 2024-06-02T05:06:21.637 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_cmpxattr": 0, 2024-06-02T05:06:21.637 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_rmxattr": 0, 2024-06-02T05:06:21.637 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_resetxattrs": 0, 2024-06-02T05:06:21.637 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_call": 0, 2024-06-02T05:06:21.637 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_watch": 0, 2024-06-02T05:06:21.637 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_notify": 0, 2024-06-02T05:06:21.637 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_src_cmpxattr": 0, 2024-06-02T05:06:21.638 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_pgls": 0, 2024-06-02T05:06:21.638 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_pgls_filter": 0, 2024-06-02T05:06:21.638 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_other": 0, 2024-06-02T05:06:21.638 INFO:teuthology.orchestra.run.smithi192.stdout: "linger_active": 0, 2024-06-02T05:06:21.638 INFO:teuthology.orchestra.run.smithi192.stdout: "linger_send": 0, 2024-06-02T05:06:21.638 INFO:teuthology.orchestra.run.smithi192.stdout: "linger_resend": 0, 2024-06-02T05:06:21.638 INFO:teuthology.orchestra.run.smithi192.stdout: "linger_ping": 0, 2024-06-02T05:06:21.638 INFO:teuthology.orchestra.run.smithi192.stdout: "poolop_active": 0, 2024-06-02T05:06:21.638 INFO:teuthology.orchestra.run.smithi192.stdout: "poolop_send": 0, 2024-06-02T05:06:21.638 INFO:teuthology.orchestra.run.smithi192.stdout: "poolop_resend": 0, 2024-06-02T05:06:21.638 INFO:teuthology.orchestra.run.smithi192.stdout: "poolstat_active": 0, 2024-06-02T05:06:21.638 INFO:teuthology.orchestra.run.smithi192.stdout: "poolstat_send": 0, 2024-06-02T05:06:21.638 INFO:teuthology.orchestra.run.smithi192.stdout: "poolstat_resend": 0, 2024-06-02T05:06:21.639 INFO:teuthology.orchestra.run.smithi192.stdout: "statfs_active": 0, 2024-06-02T05:06:21.639 INFO:teuthology.orchestra.run.smithi192.stdout: "statfs_send": 0, 2024-06-02T05:06:21.639 INFO:teuthology.orchestra.run.smithi192.stdout: "statfs_resend": 0, 2024-06-02T05:06:21.639 INFO:teuthology.orchestra.run.smithi192.stdout: "command_active": 0, 2024-06-02T05:06:21.639 INFO:teuthology.orchestra.run.smithi192.stdout: "command_send": 0, 2024-06-02T05:06:21.639 INFO:teuthology.orchestra.run.smithi192.stdout: "command_resend": 0, 2024-06-02T05:06:21.639 INFO:teuthology.orchestra.run.smithi192.stdout: "map_epoch": 84, 2024-06-02T05:06:21.639 INFO:teuthology.orchestra.run.smithi192.stdout: "map_full": 0, 2024-06-02T05:06:21.639 INFO:teuthology.orchestra.run.smithi192.stdout: "map_inc": 4, 2024-06-02T05:06:21.639 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_sessions": 12, 2024-06-02T05:06:21.639 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_session_open": 12, 2024-06-02T05:06:21.639 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_session_close": 0, 2024-06-02T05:06:21.639 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_laggy": 0, 2024-06-02T05:06:21.640 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_wr": 127, 2024-06-02T05:06:21.640 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_rd": 0, 2024-06-02T05:06:21.640 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_del": 38 2024-06-02T05:06:21.640 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:21.640 INFO:teuthology.orchestra.run.smithi192.stdout: "oft": { 2024-06-02T05:06:21.640 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_total_objs": 1, 2024-06-02T05:06:21.640 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_total_kv_pairs": 0, 2024-06-02T05:06:21.640 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_total_updates": 0, 2024-06-02T05:06:21.640 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_total_removes": 0 2024-06-02T05:06:21.640 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:21.640 INFO:teuthology.orchestra.run.smithi192.stdout: "osd-slow-ops": { 2024-06-02T05:06:21.640 INFO:teuthology.orchestra.run.smithi192.stdout: "slow_ops_count": 0 2024-06-02T05:06:21.640 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:21.640 INFO:teuthology.orchestra.run.smithi192.stdout: "purge_queue": { 2024-06-02T05:06:21.641 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_executing_ops": 0, 2024-06-02T05:06:21.641 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_executing_ops_high_water": 12, 2024-06-02T05:06:21.641 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_executing": 0, 2024-06-02T05:06:21.641 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_executing_high_water": 6, 2024-06-02T05:06:21.641 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_executed": 135, 2024-06-02T05:06:21.641 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_item_in_journal": 0 2024-06-02T05:06:21.641 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:21.641 INFO:teuthology.orchestra.run.smithi192.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-06-02T05:06:21.641 INFO:teuthology.orchestra.run.smithi192.stdout: "val": 0, 2024-06-02T05:06:21.641 INFO:teuthology.orchestra.run.smithi192.stdout: "max": 104857600, 2024-06-02T05:06:21.642 INFO:teuthology.orchestra.run.smithi192.stdout: "get_started": 0, 2024-06-02T05:06:21.642 INFO:teuthology.orchestra.run.smithi192.stdout: "get": 10261, 2024-06-02T05:06:21.642 INFO:teuthology.orchestra.run.smithi192.stdout: "get_sum": 3051163, 2024-06-02T05:06:21.642 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_fail": 0, 2024-06-02T05:06:21.642 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_success": 10261, 2024-06-02T05:06:21.642 INFO:teuthology.orchestra.run.smithi192.stdout: "take": 0, 2024-06-02T05:06:21.642 INFO:teuthology.orchestra.run.smithi192.stdout: "take_sum": 0, 2024-06-02T05:06:21.642 INFO:teuthology.orchestra.run.smithi192.stdout: "put": 10261, 2024-06-02T05:06:21.642 INFO:teuthology.orchestra.run.smithi192.stdout: "put_sum": 3051163, 2024-06-02T05:06:21.643 INFO:teuthology.orchestra.run.smithi192.stdout: "wait": { 2024-06-02T05:06:21.643 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-06-02T05:06:21.643 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-06-02T05:06:21.643 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-06-02T05:06:21.643 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-06-02T05:06:21.643 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:21.643 INFO:teuthology.orchestra.run.smithi192.stdout: "throttle-objecter_bytes": { 2024-06-02T05:06:21.643 INFO:teuthology.orchestra.run.smithi192.stdout: "val": 0, 2024-06-02T05:06:21.643 INFO:teuthology.orchestra.run.smithi192.stdout: "max": 104857600, 2024-06-02T05:06:21.643 INFO:teuthology.orchestra.run.smithi192.stdout: "get_started": 0, 2024-06-02T05:06:21.643 INFO:teuthology.orchestra.run.smithi192.stdout: "get": 0, 2024-06-02T05:06:21.643 INFO:teuthology.orchestra.run.smithi192.stdout: "get_sum": 0, 2024-06-02T05:06:21.643 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_fail": 0, 2024-06-02T05:06:21.644 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_success": 0, 2024-06-02T05:06:21.644 INFO:teuthology.orchestra.run.smithi192.stdout: "take": 1694, 2024-06-02T05:06:21.644 INFO:teuthology.orchestra.run.smithi192.stdout: "take_sum": 2850564, 2024-06-02T05:06:21.644 INFO:teuthology.orchestra.run.smithi192.stdout: "put": 1694, 2024-06-02T05:06:21.644 INFO:teuthology.orchestra.run.smithi192.stdout: "put_sum": 2850564, 2024-06-02T05:06:21.644 INFO:teuthology.orchestra.run.smithi192.stdout: "wait": { 2024-06-02T05:06:21.644 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-06-02T05:06:21.644 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-06-02T05:06:21.644 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-06-02T05:06:21.644 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-06-02T05:06:21.644 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:21.644 INFO:teuthology.orchestra.run.smithi192.stdout: "throttle-objecter_ops": { 2024-06-02T05:06:21.645 INFO:teuthology.orchestra.run.smithi192.stdout: "val": 0, 2024-06-02T05:06:21.645 INFO:teuthology.orchestra.run.smithi192.stdout: "max": 1024, 2024-06-02T05:06:21.645 INFO:teuthology.orchestra.run.smithi192.stdout: "get_started": 0, 2024-06-02T05:06:21.645 INFO:teuthology.orchestra.run.smithi192.stdout: "get": 0, 2024-06-02T05:06:21.645 INFO:teuthology.orchestra.run.smithi192.stdout: "get_sum": 0, 2024-06-02T05:06:21.645 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_fail": 0, 2024-06-02T05:06:21.645 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_success": 0, 2024-06-02T05:06:21.645 INFO:teuthology.orchestra.run.smithi192.stdout: "take": 1694, 2024-06-02T05:06:21.645 INFO:teuthology.orchestra.run.smithi192.stdout: "take_sum": 1694, 2024-06-02T05:06:21.645 INFO:teuthology.orchestra.run.smithi192.stdout: "put": 1694, 2024-06-02T05:06:21.645 INFO:teuthology.orchestra.run.smithi192.stdout: "put_sum": 1694, 2024-06-02T05:06:21.645 INFO:teuthology.orchestra.run.smithi192.stdout: "wait": { 2024-06-02T05:06:21.645 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-06-02T05:06:21.646 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-06-02T05:06:21.646 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-06-02T05:06:21.646 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-06-02T05:06:21.646 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:21.646 INFO:teuthology.orchestra.run.smithi192.stdout: "throttle-write_buf_throttle": { 2024-06-02T05:06:21.646 INFO:teuthology.orchestra.run.smithi192.stdout: "val": 0, 2024-06-02T05:06:21.646 INFO:teuthology.orchestra.run.smithi192.stdout: "max": 3758096384, 2024-06-02T05:06:21.646 INFO:teuthology.orchestra.run.smithi192.stdout: "get_started": 0, 2024-06-02T05:06:21.646 INFO:teuthology.orchestra.run.smithi192.stdout: "get": 135, 2024-06-02T05:06:21.646 INFO:teuthology.orchestra.run.smithi192.stdout: "get_sum": 14715, 2024-06-02T05:06:21.646 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_fail": 0, 2024-06-02T05:06:21.646 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_success": 135, 2024-06-02T05:06:21.647 INFO:teuthology.orchestra.run.smithi192.stdout: "take": 0, 2024-06-02T05:06:21.647 INFO:teuthology.orchestra.run.smithi192.stdout: "take_sum": 0, 2024-06-02T05:06:21.647 INFO:teuthology.orchestra.run.smithi192.stdout: "put": 82, 2024-06-02T05:06:21.647 INFO:teuthology.orchestra.run.smithi192.stdout: "put_sum": 14715, 2024-06-02T05:06:21.647 INFO:teuthology.orchestra.run.smithi192.stdout: "wait": { 2024-06-02T05:06:21.647 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-06-02T05:06:21.647 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-06-02T05:06:21.647 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-06-02T05:06:21.647 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-06-02T05:06:21.647 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:21.647 INFO:teuthology.orchestra.run.smithi192.stdout: "throttle-write_buf_throttle-0x561e7d7aa0a0": { 2024-06-02T05:06:21.647 INFO:teuthology.orchestra.run.smithi192.stdout: "val": 0, 2024-06-02T05:06:21.647 INFO:teuthology.orchestra.run.smithi192.stdout: "max": 3758096384, 2024-06-02T05:06:21.647 INFO:teuthology.orchestra.run.smithi192.stdout: "get_started": 0, 2024-06-02T05:06:21.648 INFO:teuthology.orchestra.run.smithi192.stdout: "get": 2293, 2024-06-02T05:06:21.648 INFO:teuthology.orchestra.run.smithi192.stdout: "get_sum": 2776600, 2024-06-02T05:06:21.648 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_fail": 0, 2024-06-02T05:06:21.648 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_success": 2293, 2024-06-02T05:06:21.648 INFO:teuthology.orchestra.run.smithi192.stdout: "take": 0, 2024-06-02T05:06:21.648 INFO:teuthology.orchestra.run.smithi192.stdout: "take_sum": 0, 2024-06-02T05:06:21.648 INFO:teuthology.orchestra.run.smithi192.stdout: "put": 732, 2024-06-02T05:06:21.648 INFO:teuthology.orchestra.run.smithi192.stdout: "put_sum": 2776600, 2024-06-02T05:06:21.648 INFO:teuthology.orchestra.run.smithi192.stdout: "wait": { 2024-06-02T05:06:21.648 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-06-02T05:06:21.648 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-06-02T05:06:21.648 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-06-02T05:06:21.648 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-06-02T05:06:21.649 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-06-02T05:06:21.649 INFO:teuthology.orchestra.run.smithi192.stdout:} 2024-06-02T05:06:21.949 INFO:tasks.check_counter:Daemon mds.c mds.exported=1 2024-06-02T05:06:21.949 INFO:tasks.check_counter:Daemon mds.c mds.imported=12 2024-06-02T05:06:21.949 DEBUG:tasks.check_counter:Getting stats from f 2024-06-02T05:06:21.949 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell --fsid 60ab6d30-209a-11ef-bc9b-c7b262605968 -- ceph daemon mds.f perf dump 2024-06-02T05:06:22.173 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/mon.c/config 2024-06-02T05:06:22.181 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:06:21 smithi192 ceph-mon[47933]: pgmap v771: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 10 KiB/s wr, 11 op/s 2024-06-02T05:06:22.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:06:21 smithi076 ceph-mon[42935]: pgmap v771: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 10 KiB/s wr, 11 op/s 2024-06-02T05:06:22.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:06:21 smithi119 ceph-mon[46633]: pgmap v771: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 10 KiB/s wr, 11 op/s 2024-06-02T05:06:23.161 INFO:teuthology.orchestra.run.smithi192.stdout:{ 2024-06-02T05:06:23.161 INFO:teuthology.orchestra.run.smithi192.stdout: "AsyncMessenger::Worker-0": { 2024-06-02T05:06:23.161 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_messages": 2563, 2024-06-02T05:06:23.161 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages": 2565, 2024-06-02T05:06:23.161 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_bytes": 19505157, 2024-06-02T05:06:23.162 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_bytes": 797100, 2024-06-02T05:06:23.162 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_created_connections": 7, 2024-06-02T05:06:23.162 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_active_connections": 3, 2024-06-02T05:06:23.162 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_total_time": 0.190420463, 2024-06-02T05:06:23.162 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_send_time": 0.054556165, 2024-06-02T05:06:23.162 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_recv_time": 0.056622402, 2024-06-02T05:06:23.162 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_fast_dispatch_time": 0.063684611, 2024-06-02T05:06:23.162 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T05:06:23.162 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 2563, 2024-06-02T05:06:23.162 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.096042747, 2024-06-02T05:06:23.162 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000037472 2024-06-02T05:06:23.162 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:23.163 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_handle_ack_lat": { 2024-06-02T05:06:23.163 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-06-02T05:06:23.163 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-06-02T05:06:23.163 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-06-02T05:06:23.163 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:23.163 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_encrypted_bytes": 0, 2024-06-02T05:06:23.163 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_encrypted_bytes": 0 2024-06-02T05:06:23.163 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:23.163 INFO:teuthology.orchestra.run.smithi192.stdout: "AsyncMessenger::Worker-1": { 2024-06-02T05:06:23.163 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_messages": 696, 2024-06-02T05:06:23.163 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages": 920, 2024-06-02T05:06:23.163 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_bytes": 8569242, 2024-06-02T05:06:23.163 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_bytes": 677459, 2024-06-02T05:06:23.164 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_created_connections": 5, 2024-06-02T05:06:23.164 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_active_connections": 4, 2024-06-02T05:06:23.164 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_total_time": 0.061549785, 2024-06-02T05:06:23.164 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_send_time": 0.019714635, 2024-06-02T05:06:23.164 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_recv_time": 0.019650871, 2024-06-02T05:06:23.164 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_fast_dispatch_time": 0.016397385, 2024-06-02T05:06:23.164 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T05:06:23.164 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 919, 2024-06-02T05:06:23.164 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.053677267, 2024-06-02T05:06:23.164 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000058408 2024-06-02T05:06:23.164 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:23.165 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_handle_ack_lat": { 2024-06-02T05:06:23.165 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-06-02T05:06:23.165 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-06-02T05:06:23.165 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-06-02T05:06:23.165 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:23.165 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_encrypted_bytes": 3072, 2024-06-02T05:06:23.165 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_encrypted_bytes": 462496 2024-06-02T05:06:23.165 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:23.165 INFO:teuthology.orchestra.run.smithi192.stdout: "AsyncMessenger::Worker-2": { 2024-06-02T05:06:23.165 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_messages": 668, 2024-06-02T05:06:23.165 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages": 652, 2024-06-02T05:06:23.166 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_bytes": 4844941, 2024-06-02T05:06:23.166 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_bytes": 279439, 2024-06-02T05:06:23.166 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_created_connections": 5, 2024-06-02T05:06:23.166 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_active_connections": 3, 2024-06-02T05:06:23.166 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_total_time": 0.063751774, 2024-06-02T05:06:23.166 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_send_time": 0.020035573, 2024-06-02T05:06:23.166 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_recv_time": 0.026219704, 2024-06-02T05:06:23.166 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_fast_dispatch_time": 0.014466104, 2024-06-02T05:06:23.166 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T05:06:23.166 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 651, 2024-06-02T05:06:23.166 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.036131724, 2024-06-02T05:06:23.166 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000055501 2024-06-02T05:06:23.166 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:23.167 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_handle_ack_lat": { 2024-06-02T05:06:23.167 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-06-02T05:06:23.167 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-06-02T05:06:23.167 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-06-02T05:06:23.167 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:23.167 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_encrypted_bytes": 562000, 2024-06-02T05:06:23.167 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_encrypted_bytes": 172144 2024-06-02T05:06:23.167 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:23.167 INFO:teuthology.orchestra.run.smithi192.stdout: "cct": { 2024-06-02T05:06:23.167 INFO:teuthology.orchestra.run.smithi192.stdout: "total_workers": 1, 2024-06-02T05:06:23.167 INFO:teuthology.orchestra.run.smithi192.stdout: "unhealthy_workers": 0 2024-06-02T05:06:23.167 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:23.168 INFO:teuthology.orchestra.run.smithi192.stdout: "finisher-MDSRank": { 2024-06-02T05:06:23.168 INFO:teuthology.orchestra.run.smithi192.stdout: "queue_len": 0, 2024-06-02T05:06:23.168 INFO:teuthology.orchestra.run.smithi192.stdout: "complete_latency": { 2024-06-02T05:06:23.168 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 6137, 2024-06-02T05:06:23.168 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.131136618, 2024-06-02T05:06:23.168 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000021368 2024-06-02T05:06:23.168 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-06-02T05:06:23.168 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:23.168 INFO:teuthology.orchestra.run.smithi192.stdout: "finisher-PurgeQueue": { 2024-06-02T05:06:23.168 INFO:teuthology.orchestra.run.smithi192.stdout: "queue_len": 0, 2024-06-02T05:06:23.168 INFO:teuthology.orchestra.run.smithi192.stdout: "complete_latency": { 2024-06-02T05:06:23.169 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-06-02T05:06:23.169 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-06-02T05:06:23.169 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-06-02T05:06:23.169 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-06-02T05:06:23.169 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:23.169 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": { 2024-06-02T05:06:23.169 INFO:teuthology.orchestra.run.smithi192.stdout: "request": 0, 2024-06-02T05:06:23.169 INFO:teuthology.orchestra.run.smithi192.stdout: "reply": 0, 2024-06-02T05:06:23.169 INFO:teuthology.orchestra.run.smithi192.stdout: "reply_latency": { 2024-06-02T05:06:23.169 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-06-02T05:06:23.170 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-06-02T05:06:23.170 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-06-02T05:06:23.170 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:23.170 INFO:teuthology.orchestra.run.smithi192.stdout: "slow_reply": 0, 2024-06-02T05:06:23.170 INFO:teuthology.orchestra.run.smithi192.stdout: "forward": 0, 2024-06-02T05:06:23.170 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_fetch_complete": 0, 2024-06-02T05:06:23.170 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_fetch_keys": 0, 2024-06-02T05:06:23.170 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_commit": 0, 2024-06-02T05:06:23.170 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_split": 0, 2024-06-02T05:06:23.173 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_merge": 0, 2024-06-02T05:06:23.173 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes": 588, 2024-06-02T05:06:23.173 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes_top": 0, 2024-06-02T05:06:23.174 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes_bottom": 588, 2024-06-02T05:06:23.174 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes_pin_tail": 0, 2024-06-02T05:06:23.174 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes_pinned": 588, 2024-06-02T05:06:23.174 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes_expired": 0, 2024-06-02T05:06:23.174 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes_with_caps": 0, 2024-06-02T05:06:23.174 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": 0, 2024-06-02T05:06:23.174 INFO:teuthology.orchestra.run.smithi192.stdout: "subtrees": 3, 2024-06-02T05:06:23.174 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse": 0, 2024-06-02T05:06:23.174 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse_hit": 0, 2024-06-02T05:06:23.174 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse_forward": 0, 2024-06-02T05:06:23.174 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse_discover": 0, 2024-06-02T05:06:23.174 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse_dir_fetch": 0, 2024-06-02T05:06:23.175 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse_remote_ino": 0, 2024-06-02T05:06:23.175 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse_lock": 0, 2024-06-02T05:06:23.175 INFO:teuthology.orchestra.run.smithi192.stdout: "load_cent": 0, 2024-06-02T05:06:23.175 INFO:teuthology.orchestra.run.smithi192.stdout: "q": 0, 2024-06-02T05:06:23.175 INFO:teuthology.orchestra.run.smithi192.stdout: "exported": 0, 2024-06-02T05:06:23.175 INFO:teuthology.orchestra.run.smithi192.stdout: "exported_inodes": 0, 2024-06-02T05:06:23.175 INFO:teuthology.orchestra.run.smithi192.stdout: "imported": 0, 2024-06-02T05:06:23.175 INFO:teuthology.orchestra.run.smithi192.stdout: "imported_inodes": 0, 2024-06-02T05:06:23.175 INFO:teuthology.orchestra.run.smithi192.stdout: "openino_dir_fetch": 0, 2024-06-02T05:06:23.175 INFO:teuthology.orchestra.run.smithi192.stdout: "openino_backtrace_fetch": 0, 2024-06-02T05:06:23.176 INFO:teuthology.orchestra.run.smithi192.stdout: "openino_peer_discover": 0, 2024-06-02T05:06:23.176 INFO:teuthology.orchestra.run.smithi192.stdout: "root_rfiles": 0, 2024-06-02T05:06:23.176 INFO:teuthology.orchestra.run.smithi192.stdout: "root_rbytes": 0, 2024-06-02T05:06:23.176 INFO:teuthology.orchestra.run.smithi192.stdout: "root_rsnaps": 0, 2024-06-02T05:06:23.176 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_backtrace_fetch": 0, 2024-06-02T05:06:23.176 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_set_tag": 0, 2024-06-02T05:06:23.176 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_backtrace_repaired": 0, 2024-06-02T05:06:23.176 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_inotable_repaired": 0, 2024-06-02T05:06:23.176 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_dir_inodes": 0, 2024-06-02T05:06:23.176 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_dir_base_inodes": 0, 2024-06-02T05:06:23.176 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_dirfrag_rstats": 0, 2024-06-02T05:06:23.177 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_file_inodes": 0, 2024-06-02T05:06:23.177 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_inode_file_caps": 0, 2024-06-02T05:06:23.177 INFO:teuthology.orchestra.run.smithi192.stdout: "ceph_cap_op_revoke": 0, 2024-06-02T05:06:23.177 INFO:teuthology.orchestra.run.smithi192.stdout: "ceph_cap_op_grant": 0, 2024-06-02T05:06:23.177 INFO:teuthology.orchestra.run.smithi192.stdout: "ceph_cap_op_trunc": 0, 2024-06-02T05:06:23.177 INFO:teuthology.orchestra.run.smithi192.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-06-02T05:06:23.177 INFO:teuthology.orchestra.run.smithi192.stdout: "ceph_cap_op_flush_ack": 0, 2024-06-02T05:06:23.178 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_client_caps": 0, 2024-06-02T05:06:23.178 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_client_caps_dirty": 0, 2024-06-02T05:06:23.178 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_client_cap_release": 0, 2024-06-02T05:06:23.178 INFO:teuthology.orchestra.run.smithi192.stdout: "process_request_cap_release": 0 2024-06-02T05:06:23.178 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:23.178 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_cache": { 2024-06-02T05:06:23.179 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_update": 0, 2024-06-02T05:06:23.179 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_update_receipt": 0, 2024-06-02T05:06:23.179 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_try_discover": 0, 2024-06-02T05:06:23.179 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_send_discover": 0, 2024-06-02T05:06:23.179 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_handle_discover": 0, 2024-06-02T05:06:23.179 INFO:teuthology.orchestra.run.smithi192.stdout: "num_strays": 0, 2024-06-02T05:06:23.180 INFO:teuthology.orchestra.run.smithi192.stdout: "num_strays_delayed": 0, 2024-06-02T05:06:23.180 INFO:teuthology.orchestra.run.smithi192.stdout: "num_strays_enqueuing": 0, 2024-06-02T05:06:23.180 INFO:teuthology.orchestra.run.smithi192.stdout: "strays_created": 0, 2024-06-02T05:06:23.180 INFO:teuthology.orchestra.run.smithi192.stdout: "strays_enqueued": 0, 2024-06-02T05:06:23.180 INFO:teuthology.orchestra.run.smithi192.stdout: "strays_reintegrated": 0, 2024-06-02T05:06:23.180 INFO:teuthology.orchestra.run.smithi192.stdout: "strays_migrated": 0, 2024-06-02T05:06:23.181 INFO:teuthology.orchestra.run.smithi192.stdout: "num_recovering_processing": 0, 2024-06-02T05:06:23.181 INFO:teuthology.orchestra.run.smithi192.stdout: "num_recovering_enqueued": 0, 2024-06-02T05:06:23.181 INFO:teuthology.orchestra.run.smithi192.stdout: "num_recovering_prioritized": 0, 2024-06-02T05:06:23.181 INFO:teuthology.orchestra.run.smithi192.stdout: "recovery_started": 0, 2024-06-02T05:06:23.181 INFO:teuthology.orchestra.run.smithi192.stdout: "recovery_completed": 0, 2024-06-02T05:06:23.181 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_enqueue_scrub": 0, 2024-06-02T05:06:23.181 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_exportdir": 0, 2024-06-02T05:06:23.182 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_flush": 0, 2024-06-02T05:06:23.182 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_fragmentdir": 0, 2024-06-02T05:06:23.182 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_fragstats": 0, 2024-06-02T05:06:23.182 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_inodestats": 0 2024-06-02T05:06:23.182 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:23.182 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_log": { 2024-06-02T05:06:23.183 INFO:teuthology.orchestra.run.smithi192.stdout: "evadd": 0, 2024-06-02T05:06:23.183 INFO:teuthology.orchestra.run.smithi192.stdout: "evex": 0, 2024-06-02T05:06:23.183 INFO:teuthology.orchestra.run.smithi192.stdout: "evtrm": 0, 2024-06-02T05:06:23.183 INFO:teuthology.orchestra.run.smithi192.stdout: "ev": 24590, 2024-06-02T05:06:23.183 INFO:teuthology.orchestra.run.smithi192.stdout: "evexg": 0, 2024-06-02T05:06:23.183 INFO:teuthology.orchestra.run.smithi192.stdout: "evexd": 0, 2024-06-02T05:06:23.184 INFO:teuthology.orchestra.run.smithi192.stdout: "segadd": 0, 2024-06-02T05:06:23.184 INFO:teuthology.orchestra.run.smithi192.stdout: "segex": 0, 2024-06-02T05:06:23.184 INFO:teuthology.orchestra.run.smithi192.stdout: "segtrm": 0, 2024-06-02T05:06:23.184 INFO:teuthology.orchestra.run.smithi192.stdout: "seg": 30, 2024-06-02T05:06:23.184 INFO:teuthology.orchestra.run.smithi192.stdout: "segexg": 0, 2024-06-02T05:06:23.185 INFO:teuthology.orchestra.run.smithi192.stdout: "segexd": 0, 2024-06-02T05:06:23.185 INFO:teuthology.orchestra.run.smithi192.stdout: "expos": 4194304, 2024-06-02T05:06:23.185 INFO:teuthology.orchestra.run.smithi192.stdout: "wrpos": 35541932, 2024-06-02T05:06:23.185 INFO:teuthology.orchestra.run.smithi192.stdout: "rdpos": 35541358, 2024-06-02T05:06:23.185 INFO:teuthology.orchestra.run.smithi192.stdout: "jlat": { 2024-06-02T05:06:23.185 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-06-02T05:06:23.186 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-06-02T05:06:23.186 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-06-02T05:06:23.186 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:23.186 INFO:teuthology.orchestra.run.smithi192.stdout: "replayed": 24590 2024-06-02T05:06:23.186 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:23.187 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_mem": { 2024-06-02T05:06:23.187 INFO:teuthology.orchestra.run.smithi192.stdout: "ino": 83, 2024-06-02T05:06:23.187 INFO:teuthology.orchestra.run.smithi192.stdout: "ino+": 327, 2024-06-02T05:06:23.187 INFO:teuthology.orchestra.run.smithi192.stdout: "ino-": 244, 2024-06-02T05:06:23.187 INFO:teuthology.orchestra.run.smithi192.stdout: "dir": 19, 2024-06-02T05:06:23.187 INFO:teuthology.orchestra.run.smithi192.stdout: "dir+": 25, 2024-06-02T05:06:23.188 INFO:teuthology.orchestra.run.smithi192.stdout: "dir-": 6, 2024-06-02T05:06:23.188 INFO:teuthology.orchestra.run.smithi192.stdout: "dn": 588, 2024-06-02T05:06:23.188 INFO:teuthology.orchestra.run.smithi192.stdout: "dn+": 834, 2024-06-02T05:06:23.188 INFO:teuthology.orchestra.run.smithi192.stdout: "dn-": 246, 2024-06-02T05:06:23.188 INFO:teuthology.orchestra.run.smithi192.stdout: "cap": 0, 2024-06-02T05:06:23.188 INFO:teuthology.orchestra.run.smithi192.stdout: "cap+": 0, 2024-06-02T05:06:23.188 INFO:teuthology.orchestra.run.smithi192.stdout: "cap-": 0, 2024-06-02T05:06:23.189 INFO:teuthology.orchestra.run.smithi192.stdout: "rss": 50964, 2024-06-02T05:06:23.189 INFO:teuthology.orchestra.run.smithi192.stdout: "heap": 207156 2024-06-02T05:06:23.189 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:23.189 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_server": { 2024-06-02T05:06:23.189 INFO:teuthology.orchestra.run.smithi192.stdout: "dispatch_client_request": 0, 2024-06-02T05:06:23.189 INFO:teuthology.orchestra.run.smithi192.stdout: "dispatch_server_request": 0, 2024-06-02T05:06:23.190 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_client_request": 0, 2024-06-02T05:06:23.190 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_client_session": 0, 2024-06-02T05:06:23.190 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_peer_request": 0, 2024-06-02T05:06:23.190 INFO:teuthology.orchestra.run.smithi192.stdout: "req_create_latency": { 2024-06-02T05:06:23.190 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-06-02T05:06:23.190 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-06-02T05:06:23.191 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-06-02T05:06:23.191 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:23.191 INFO:teuthology.orchestra.run.smithi192.stdout: "req_getattr_latency": { 2024-06-02T05:06:23.191 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-06-02T05:06:23.191 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-06-02T05:06:23.191 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-06-02T05:06:23.192 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:23.192 INFO:teuthology.orchestra.run.smithi192.stdout: "req_getfilelock_latency": { 2024-06-02T05:06:23.192 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-06-02T05:06:23.192 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-06-02T05:06:23.192 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-06-02T05:06:23.192 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:23.193 INFO:teuthology.orchestra.run.smithi192.stdout: "req_link_latency": { 2024-06-02T05:06:23.193 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-06-02T05:06:23.193 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-06-02T05:06:23.193 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-06-02T05:06:23.193 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:23.193 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lookup_latency": { 2024-06-02T05:06:23.194 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-06-02T05:06:23.194 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-06-02T05:06:23.194 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-06-02T05:06:23.194 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:23.195 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lookuphash_latency": { 2024-06-02T05:06:23.195 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-06-02T05:06:23.195 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-06-02T05:06:23.195 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-06-02T05:06:23.195 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:23.196 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lookupino_latency": { 2024-06-02T05:06:23.196 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-06-02T05:06:23.196 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-06-02T05:06:23.196 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-06-02T05:06:23.196 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:23.196 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lookupname_latency": { 2024-06-02T05:06:23.197 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-06-02T05:06:23.197 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-06-02T05:06:23.197 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-06-02T05:06:23.197 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:23.197 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lookupparent_latency": { 2024-06-02T05:06:23.197 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-06-02T05:06:23.198 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-06-02T05:06:23.198 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-06-02T05:06:23.198 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:23.198 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lookupsnap_latency": { 2024-06-02T05:06:23.198 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-06-02T05:06:23.199 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-06-02T05:06:23.199 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-06-02T05:06:23.199 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:23.199 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lssnap_latency": { 2024-06-02T05:06:23.199 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-06-02T05:06:23.199 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-06-02T05:06:23.200 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-06-02T05:06:23.200 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:23.200 INFO:teuthology.orchestra.run.smithi192.stdout: "req_mkdir_latency": { 2024-06-02T05:06:23.200 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-06-02T05:06:23.200 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-06-02T05:06:23.200 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-06-02T05:06:23.201 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:23.201 INFO:teuthology.orchestra.run.smithi192.stdout: "req_mknod_latency": { 2024-06-02T05:06:23.201 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-06-02T05:06:23.201 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-06-02T05:06:23.201 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-06-02T05:06:23.201 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:23.202 INFO:teuthology.orchestra.run.smithi192.stdout: "req_mksnap_latency": { 2024-06-02T05:06:23.202 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-06-02T05:06:23.202 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-06-02T05:06:23.202 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-06-02T05:06:23.202 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:23.203 INFO:teuthology.orchestra.run.smithi192.stdout: "req_open_latency": { 2024-06-02T05:06:23.203 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-06-02T05:06:23.203 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-06-02T05:06:23.203 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-06-02T05:06:23.203 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:23.203 INFO:teuthology.orchestra.run.smithi192.stdout: "req_readdir_latency": { 2024-06-02T05:06:23.204 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-06-02T05:06:23.204 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-06-02T05:06:23.204 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-06-02T05:06:23.204 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:23.204 INFO:teuthology.orchestra.run.smithi192.stdout: "req_rename_latency": { 2024-06-02T05:06:23.204 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-06-02T05:06:23.205 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-06-02T05:06:23.205 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-06-02T05:06:23.205 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:23.205 INFO:teuthology.orchestra.run.smithi192.stdout: "req_renamesnap_latency": { 2024-06-02T05:06:23.205 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-06-02T05:06:23.206 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-06-02T05:06:23.206 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-06-02T05:06:23.206 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:23.206 INFO:teuthology.orchestra.run.smithi192.stdout: "req_snapdiff_latency": { 2024-06-02T05:06:23.206 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-06-02T05:06:23.206 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-06-02T05:06:23.207 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-06-02T05:06:23.207 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:23.207 INFO:teuthology.orchestra.run.smithi192.stdout: "req_rmdir_latency": { 2024-06-02T05:06:23.207 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-06-02T05:06:23.207 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-06-02T05:06:23.208 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-06-02T05:06:23.208 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:23.208 INFO:teuthology.orchestra.run.smithi192.stdout: "req_rmsnap_latency": { 2024-06-02T05:06:23.208 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-06-02T05:06:23.208 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-06-02T05:06:23.208 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-06-02T05:06:23.209 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:23.209 INFO:teuthology.orchestra.run.smithi192.stdout: "req_rmxattr_latency": { 2024-06-02T05:06:23.209 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-06-02T05:06:23.209 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-06-02T05:06:23.209 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-06-02T05:06:23.209 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:23.210 INFO:teuthology.orchestra.run.smithi192.stdout: "req_setattr_latency": { 2024-06-02T05:06:23.210 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-06-02T05:06:23.210 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-06-02T05:06:23.210 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-06-02T05:06:23.210 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:23.211 INFO:teuthology.orchestra.run.smithi192.stdout: "req_setdirlayout_latency": { 2024-06-02T05:06:23.211 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-06-02T05:06:23.211 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-06-02T05:06:23.211 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-06-02T05:06:23.211 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:23.212 INFO:teuthology.orchestra.run.smithi192.stdout: "req_setfilelock_latency": { 2024-06-02T05:06:23.212 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-06-02T05:06:23.212 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-06-02T05:06:23.212 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-06-02T05:06:23.212 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:23.212 INFO:teuthology.orchestra.run.smithi192.stdout: "req_setlayout_latency": { 2024-06-02T05:06:23.213 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-06-02T05:06:23.213 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-06-02T05:06:23.213 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-06-02T05:06:23.213 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:23.213 INFO:teuthology.orchestra.run.smithi192.stdout: "req_setxattr_latency": { 2024-06-02T05:06:23.213 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-06-02T05:06:23.214 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-06-02T05:06:23.214 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-06-02T05:06:23.214 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:23.214 INFO:teuthology.orchestra.run.smithi192.stdout: "req_symlink_latency": { 2024-06-02T05:06:23.214 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-06-02T05:06:23.214 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-06-02T05:06:23.215 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-06-02T05:06:23.215 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:23.215 INFO:teuthology.orchestra.run.smithi192.stdout: "req_unlink_latency": { 2024-06-02T05:06:23.215 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-06-02T05:06:23.215 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-06-02T05:06:23.215 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-06-02T05:06:23.216 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:23.216 INFO:teuthology.orchestra.run.smithi192.stdout: "cap_revoke_eviction": 0, 2024-06-02T05:06:23.216 INFO:teuthology.orchestra.run.smithi192.stdout: "cap_acquisition_throttle": 0, 2024-06-02T05:06:23.216 INFO:teuthology.orchestra.run.smithi192.stdout: "req_getvxattr_latency": { 2024-06-02T05:06:23.216 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-06-02T05:06:23.216 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-06-02T05:06:23.217 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-06-02T05:06:23.217 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-06-02T05:06:23.217 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:23.217 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_sessions": { 2024-06-02T05:06:23.217 INFO:teuthology.orchestra.run.smithi192.stdout: "session_count": 1, 2024-06-02T05:06:23.217 INFO:teuthology.orchestra.run.smithi192.stdout: "session_add": 2, 2024-06-02T05:06:23.217 INFO:teuthology.orchestra.run.smithi192.stdout: "session_remove": 1, 2024-06-02T05:06:23.218 INFO:teuthology.orchestra.run.smithi192.stdout: "sessions_open": 2, 2024-06-02T05:06:23.218 INFO:teuthology.orchestra.run.smithi192.stdout: "sessions_stale": 0, 2024-06-02T05:06:23.218 INFO:teuthology.orchestra.run.smithi192.stdout: "total_load": 0, 2024-06-02T05:06:23.218 INFO:teuthology.orchestra.run.smithi192.stdout: "average_load": 0, 2024-06-02T05:06:23.218 INFO:teuthology.orchestra.run.smithi192.stdout: "avg_session_uptime": 3823, 2024-06-02T05:06:23.218 INFO:teuthology.orchestra.run.smithi192.stdout: "mdthresh_evicted": 0 2024-06-02T05:06:23.218 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:23.218 INFO:teuthology.orchestra.run.smithi192.stdout: "mempool": { 2024-06-02T05:06:23.218 INFO:teuthology.orchestra.run.smithi192.stdout: "bloom_filter_bytes": 0, 2024-06-02T05:06:23.218 INFO:teuthology.orchestra.run.smithi192.stdout: "bloom_filter_items": 0, 2024-06-02T05:06:23.218 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_alloc_bytes": 0, 2024-06-02T05:06:23.218 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_alloc_items": 0, 2024-06-02T05:06:23.219 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_data_bytes": 0, 2024-06-02T05:06:23.219 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_data_items": 0, 2024-06-02T05:06:23.219 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_onode_bytes": 0, 2024-06-02T05:06:23.219 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_onode_items": 0, 2024-06-02T05:06:23.219 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_meta_bytes": 0, 2024-06-02T05:06:23.219 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_meta_items": 0, 2024-06-02T05:06:23.219 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_other_bytes": 0, 2024-06-02T05:06:23.219 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_other_items": 0, 2024-06-02T05:06:23.219 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_buffer_bytes": 0, 2024-06-02T05:06:23.219 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_buffer_items": 0, 2024-06-02T05:06:23.219 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_extent_bytes": 0, 2024-06-02T05:06:23.219 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_extent_items": 0, 2024-06-02T05:06:23.219 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_blob_bytes": 0, 2024-06-02T05:06:23.219 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_blob_items": 0, 2024-06-02T05:06:23.220 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_shared_blob_bytes": 0, 2024-06-02T05:06:23.220 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_shared_blob_items": 0, 2024-06-02T05:06:23.220 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_inline_bl_bytes": 0, 2024-06-02T05:06:23.220 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_inline_bl_items": 0, 2024-06-02T05:06:23.220 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_fsck_bytes": 0, 2024-06-02T05:06:23.220 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_fsck_items": 0, 2024-06-02T05:06:23.220 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_txc_bytes": 0, 2024-06-02T05:06:23.220 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_txc_items": 0, 2024-06-02T05:06:23.220 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_writing_deferred_bytes": 0, 2024-06-02T05:06:23.220 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_writing_deferred_items": 0, 2024-06-02T05:06:23.220 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_writing_bytes": 0, 2024-06-02T05:06:23.220 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_writing_items": 0, 2024-06-02T05:06:23.220 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_bytes": 0, 2024-06-02T05:06:23.220 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_items": 0, 2024-06-02T05:06:23.221 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_file_reader_bytes": 0, 2024-06-02T05:06:23.221 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_file_reader_items": 0, 2024-06-02T05:06:23.221 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_file_writer_bytes": 0, 2024-06-02T05:06:23.221 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_file_writer_items": 0, 2024-06-02T05:06:23.221 INFO:teuthology.orchestra.run.smithi192.stdout: "buffer_anon_bytes": 207935, 2024-06-02T05:06:23.221 INFO:teuthology.orchestra.run.smithi192.stdout: "buffer_anon_items": 65, 2024-06-02T05:06:23.221 INFO:teuthology.orchestra.run.smithi192.stdout: "buffer_meta_bytes": 0, 2024-06-02T05:06:23.221 INFO:teuthology.orchestra.run.smithi192.stdout: "buffer_meta_items": 0, 2024-06-02T05:06:23.221 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_bytes": 0, 2024-06-02T05:06:23.221 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_items": 0, 2024-06-02T05:06:23.221 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_mapbl_bytes": 0, 2024-06-02T05:06:23.221 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_mapbl_items": 0, 2024-06-02T05:06:23.221 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_pglog_bytes": 0, 2024-06-02T05:06:23.221 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_pglog_items": 0, 2024-06-02T05:06:23.222 INFO:teuthology.orchestra.run.smithi192.stdout: "osdmap_bytes": 8800, 2024-06-02T05:06:23.222 INFO:teuthology.orchestra.run.smithi192.stdout: "osdmap_items": 169, 2024-06-02T05:06:23.222 INFO:teuthology.orchestra.run.smithi192.stdout: "osdmap_mapping_bytes": 0, 2024-06-02T05:06:23.222 INFO:teuthology.orchestra.run.smithi192.stdout: "osdmap_mapping_items": 0, 2024-06-02T05:06:23.222 INFO:teuthology.orchestra.run.smithi192.stdout: "pgmap_bytes": 0, 2024-06-02T05:06:23.222 INFO:teuthology.orchestra.run.smithi192.stdout: "pgmap_items": 0, 2024-06-02T05:06:23.222 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_co_bytes": 624665, 2024-06-02T05:06:23.222 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_co_items": 16366, 2024-06-02T05:06:23.222 INFO:teuthology.orchestra.run.smithi192.stdout: "unittest_1_bytes": 0, 2024-06-02T05:06:23.222 INFO:teuthology.orchestra.run.smithi192.stdout: "unittest_1_items": 0, 2024-06-02T05:06:23.222 INFO:teuthology.orchestra.run.smithi192.stdout: "unittest_2_bytes": 0, 2024-06-02T05:06:23.222 INFO:teuthology.orchestra.run.smithi192.stdout: "unittest_2_items": 0 2024-06-02T05:06:23.222 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:23.223 INFO:teuthology.orchestra.run.smithi192.stdout: "objecter": { 2024-06-02T05:06:23.223 INFO:teuthology.orchestra.run.smithi192.stdout: "op_active": 0, 2024-06-02T05:06:23.223 INFO:teuthology.orchestra.run.smithi192.stdout: "op_laggy": 0, 2024-06-02T05:06:23.223 INFO:teuthology.orchestra.run.smithi192.stdout: "op_send": 3599, 2024-06-02T05:06:23.223 INFO:teuthology.orchestra.run.smithi192.stdout: "op_send_bytes": 21, 2024-06-02T05:06:23.223 INFO:teuthology.orchestra.run.smithi192.stdout: "op_resend": 3, 2024-06-02T05:06:23.223 INFO:teuthology.orchestra.run.smithi192.stdout: "op_reply": 3599, 2024-06-02T05:06:23.223 INFO:teuthology.orchestra.run.smithi192.stdout: "op_latency": { 2024-06-02T05:06:23.223 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 3599, 2024-06-02T05:06:23.223 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 2.442953202, 2024-06-02T05:06:23.224 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000678786 2024-06-02T05:06:23.224 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:23.224 INFO:teuthology.orchestra.run.smithi192.stdout: "op_inflight": 0, 2024-06-02T05:06:23.224 INFO:teuthology.orchestra.run.smithi192.stdout: "oplen_avg": { 2024-06-02T05:06:23.224 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 3599, 2024-06-02T05:06:23.224 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 3600 2024-06-02T05:06:23.224 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:23.224 INFO:teuthology.orchestra.run.smithi192.stdout: "op": 3599, 2024-06-02T05:06:23.224 INFO:teuthology.orchestra.run.smithi192.stdout: "op_r": 3599, 2024-06-02T05:06:23.224 INFO:teuthology.orchestra.run.smithi192.stdout: "op_w": 0, 2024-06-02T05:06:23.224 INFO:teuthology.orchestra.run.smithi192.stdout: "op_rmw": 0, 2024-06-02T05:06:23.224 INFO:teuthology.orchestra.run.smithi192.stdout: "op_pg": 0, 2024-06-02T05:06:23.224 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_stat": 2074, 2024-06-02T05:06:23.224 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_create": 0, 2024-06-02T05:06:23.225 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_read": 1523, 2024-06-02T05:06:23.225 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_write": 0, 2024-06-02T05:06:23.225 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_writefull": 0, 2024-06-02T05:06:23.225 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_writesame": 0, 2024-06-02T05:06:23.225 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_append": 0, 2024-06-02T05:06:23.225 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_zero": 0, 2024-06-02T05:06:23.225 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_truncate": 0, 2024-06-02T05:06:23.225 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_delete": 0, 2024-06-02T05:06:23.225 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_mapext": 0, 2024-06-02T05:06:23.225 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_sparse_read": 0, 2024-06-02T05:06:23.225 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_clonerange": 0, 2024-06-02T05:06:23.225 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_getxattr": 1, 2024-06-02T05:06:23.225 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_setxattr": 0, 2024-06-02T05:06:23.225 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_cmpxattr": 0, 2024-06-02T05:06:23.226 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_rmxattr": 0, 2024-06-02T05:06:23.226 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_resetxattrs": 0, 2024-06-02T05:06:23.226 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_call": 0, 2024-06-02T05:06:23.226 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_watch": 0, 2024-06-02T05:06:23.226 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_notify": 0, 2024-06-02T05:06:23.226 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_src_cmpxattr": 0, 2024-06-02T05:06:23.226 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_pgls": 0, 2024-06-02T05:06:23.226 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_pgls_filter": 0, 2024-06-02T05:06:23.226 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_other": 0, 2024-06-02T05:06:23.226 INFO:teuthology.orchestra.run.smithi192.stdout: "linger_active": 0, 2024-06-02T05:06:23.226 INFO:teuthology.orchestra.run.smithi192.stdout: "linger_send": 0, 2024-06-02T05:06:23.226 INFO:teuthology.orchestra.run.smithi192.stdout: "linger_resend": 0, 2024-06-02T05:06:23.226 INFO:teuthology.orchestra.run.smithi192.stdout: "linger_ping": 0, 2024-06-02T05:06:23.227 INFO:teuthology.orchestra.run.smithi192.stdout: "poolop_active": 0, 2024-06-02T05:06:23.227 INFO:teuthology.orchestra.run.smithi192.stdout: "poolop_send": 0, 2024-06-02T05:06:23.227 INFO:teuthology.orchestra.run.smithi192.stdout: "poolop_resend": 0, 2024-06-02T05:06:23.227 INFO:teuthology.orchestra.run.smithi192.stdout: "poolstat_active": 0, 2024-06-02T05:06:23.227 INFO:teuthology.orchestra.run.smithi192.stdout: "poolstat_send": 0, 2024-06-02T05:06:23.227 INFO:teuthology.orchestra.run.smithi192.stdout: "poolstat_resend": 0, 2024-06-02T05:06:23.227 INFO:teuthology.orchestra.run.smithi192.stdout: "statfs_active": 0, 2024-06-02T05:06:23.227 INFO:teuthology.orchestra.run.smithi192.stdout: "statfs_send": 0, 2024-06-02T05:06:23.227 INFO:teuthology.orchestra.run.smithi192.stdout: "statfs_resend": 0, 2024-06-02T05:06:23.227 INFO:teuthology.orchestra.run.smithi192.stdout: "command_active": 0, 2024-06-02T05:06:23.227 INFO:teuthology.orchestra.run.smithi192.stdout: "command_send": 0, 2024-06-02T05:06:23.227 INFO:teuthology.orchestra.run.smithi192.stdout: "command_resend": 0, 2024-06-02T05:06:23.227 INFO:teuthology.orchestra.run.smithi192.stdout: "map_epoch": 84, 2024-06-02T05:06:23.227 INFO:teuthology.orchestra.run.smithi192.stdout: "map_full": 0, 2024-06-02T05:06:23.227 INFO:teuthology.orchestra.run.smithi192.stdout: "map_inc": 4, 2024-06-02T05:06:23.228 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_sessions": 7, 2024-06-02T05:06:23.228 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_session_open": 8, 2024-06-02T05:06:23.228 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_session_close": 1, 2024-06-02T05:06:23.228 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_laggy": 0, 2024-06-02T05:06:23.228 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_wr": 0, 2024-06-02T05:06:23.228 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_rd": 2, 2024-06-02T05:06:23.228 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_del": 0 2024-06-02T05:06:23.228 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:23.228 INFO:teuthology.orchestra.run.smithi192.stdout: "oft": { 2024-06-02T05:06:23.228 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_total_objs": 0, 2024-06-02T05:06:23.228 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_total_kv_pairs": 0, 2024-06-02T05:06:23.228 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_total_updates": 0, 2024-06-02T05:06:23.228 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_total_removes": 0 2024-06-02T05:06:23.228 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:23.229 INFO:teuthology.orchestra.run.smithi192.stdout: "osd-slow-ops": { 2024-06-02T05:06:23.229 INFO:teuthology.orchestra.run.smithi192.stdout: "slow_ops_count": 0 2024-06-02T05:06:23.229 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:23.229 INFO:teuthology.orchestra.run.smithi192.stdout: "purge_queue": { 2024-06-02T05:06:23.229 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_executing_ops": 0, 2024-06-02T05:06:23.229 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_executing_ops_high_water": 0, 2024-06-02T05:06:23.229 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_executing": 0, 2024-06-02T05:06:23.229 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_executing_high_water": 0, 2024-06-02T05:06:23.229 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_executed": 0, 2024-06-02T05:06:23.229 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_item_in_journal": 0 2024-06-02T05:06:23.229 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:23.229 INFO:teuthology.orchestra.run.smithi192.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-06-02T05:06:23.229 INFO:teuthology.orchestra.run.smithi192.stdout: "val": 0, 2024-06-02T05:06:23.230 INFO:teuthology.orchestra.run.smithi192.stdout: "max": 104857600, 2024-06-02T05:06:23.230 INFO:teuthology.orchestra.run.smithi192.stdout: "get_started": 0, 2024-06-02T05:06:23.230 INFO:teuthology.orchestra.run.smithi192.stdout: "get": 3923, 2024-06-02T05:06:23.230 INFO:teuthology.orchestra.run.smithi192.stdout: "get_sum": 32546746, 2024-06-02T05:06:23.230 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_fail": 0, 2024-06-02T05:06:23.230 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_success": 3923, 2024-06-02T05:06:23.230 INFO:teuthology.orchestra.run.smithi192.stdout: "take": 0, 2024-06-02T05:06:23.230 INFO:teuthology.orchestra.run.smithi192.stdout: "take_sum": 0, 2024-06-02T05:06:23.230 INFO:teuthology.orchestra.run.smithi192.stdout: "put": 3923, 2024-06-02T05:06:23.230 INFO:teuthology.orchestra.run.smithi192.stdout: "put_sum": 32546746, 2024-06-02T05:06:23.230 INFO:teuthology.orchestra.run.smithi192.stdout: "wait": { 2024-06-02T05:06:23.230 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-06-02T05:06:23.230 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-06-02T05:06:23.230 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-06-02T05:06:23.231 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-06-02T05:06:23.231 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:23.231 INFO:teuthology.orchestra.run.smithi192.stdout: "throttle-objecter_bytes": { 2024-06-02T05:06:23.231 INFO:teuthology.orchestra.run.smithi192.stdout: "val": 0, 2024-06-02T05:06:23.231 INFO:teuthology.orchestra.run.smithi192.stdout: "max": 104857600, 2024-06-02T05:06:23.231 INFO:teuthology.orchestra.run.smithi192.stdout: "get_started": 0, 2024-06-02T05:06:23.231 INFO:teuthology.orchestra.run.smithi192.stdout: "get": 0, 2024-06-02T05:06:23.231 INFO:teuthology.orchestra.run.smithi192.stdout: "get_sum": 0, 2024-06-02T05:06:23.231 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_fail": 0, 2024-06-02T05:06:23.231 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_success": 0, 2024-06-02T05:06:23.231 INFO:teuthology.orchestra.run.smithi192.stdout: "take": 3599, 2024-06-02T05:06:23.231 INFO:teuthology.orchestra.run.smithi192.stdout: "take_sum": 31353372, 2024-06-02T05:06:23.231 INFO:teuthology.orchestra.run.smithi192.stdout: "put": 3599, 2024-06-02T05:06:23.232 INFO:teuthology.orchestra.run.smithi192.stdout: "put_sum": 31353372, 2024-06-02T05:06:23.232 INFO:teuthology.orchestra.run.smithi192.stdout: "wait": { 2024-06-02T05:06:23.232 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-06-02T05:06:23.232 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-06-02T05:06:23.232 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-06-02T05:06:23.232 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-06-02T05:06:23.232 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:23.232 INFO:teuthology.orchestra.run.smithi192.stdout: "throttle-objecter_ops": { 2024-06-02T05:06:23.232 INFO:teuthology.orchestra.run.smithi192.stdout: "val": 0, 2024-06-02T05:06:23.232 INFO:teuthology.orchestra.run.smithi192.stdout: "max": 1024, 2024-06-02T05:06:23.232 INFO:teuthology.orchestra.run.smithi192.stdout: "get_started": 0, 2024-06-02T05:06:23.232 INFO:teuthology.orchestra.run.smithi192.stdout: "get": 0, 2024-06-02T05:06:23.232 INFO:teuthology.orchestra.run.smithi192.stdout: "get_sum": 0, 2024-06-02T05:06:23.233 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_fail": 0, 2024-06-02T05:06:23.233 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_success": 0, 2024-06-02T05:06:23.233 INFO:teuthology.orchestra.run.smithi192.stdout: "take": 3599, 2024-06-02T05:06:23.233 INFO:teuthology.orchestra.run.smithi192.stdout: "take_sum": 3599, 2024-06-02T05:06:23.233 INFO:teuthology.orchestra.run.smithi192.stdout: "put": 3599, 2024-06-02T05:06:23.233 INFO:teuthology.orchestra.run.smithi192.stdout: "put_sum": 3599, 2024-06-02T05:06:23.233 INFO:teuthology.orchestra.run.smithi192.stdout: "wait": { 2024-06-02T05:06:23.233 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-06-02T05:06:23.233 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-06-02T05:06:23.233 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-06-02T05:06:23.233 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-06-02T05:06:23.233 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:23.233 INFO:teuthology.orchestra.run.smithi192.stdout: "throttle-write_buf_throttle": { 2024-06-02T05:06:23.233 INFO:teuthology.orchestra.run.smithi192.stdout: "val": 0, 2024-06-02T05:06:23.234 INFO:teuthology.orchestra.run.smithi192.stdout: "max": 3758096384, 2024-06-02T05:06:23.234 INFO:teuthology.orchestra.run.smithi192.stdout: "get_started": 0, 2024-06-02T05:06:23.234 INFO:teuthology.orchestra.run.smithi192.stdout: "get": 0, 2024-06-02T05:06:23.234 INFO:teuthology.orchestra.run.smithi192.stdout: "get_sum": 0, 2024-06-02T05:06:23.234 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_fail": 0, 2024-06-02T05:06:23.234 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_success": 0, 2024-06-02T05:06:23.234 INFO:teuthology.orchestra.run.smithi192.stdout: "take": 0, 2024-06-02T05:06:23.234 INFO:teuthology.orchestra.run.smithi192.stdout: "take_sum": 0, 2024-06-02T05:06:23.234 INFO:teuthology.orchestra.run.smithi192.stdout: "put": 0, 2024-06-02T05:06:23.234 INFO:teuthology.orchestra.run.smithi192.stdout: "put_sum": 0, 2024-06-02T05:06:23.234 INFO:teuthology.orchestra.run.smithi192.stdout: "wait": { 2024-06-02T05:06:23.234 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-06-02T05:06:23.234 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-06-02T05:06:23.235 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-06-02T05:06:23.235 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-06-02T05:06:23.235 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:23.235 INFO:teuthology.orchestra.run.smithi192.stdout: "throttle-write_buf_throttle-0x56094deb25a0": { 2024-06-02T05:06:23.235 INFO:teuthology.orchestra.run.smithi192.stdout: "val": 0, 2024-06-02T05:06:23.235 INFO:teuthology.orchestra.run.smithi192.stdout: "max": 3758096384, 2024-06-02T05:06:23.235 INFO:teuthology.orchestra.run.smithi192.stdout: "get_started": 0, 2024-06-02T05:06:23.235 INFO:teuthology.orchestra.run.smithi192.stdout: "get": 0, 2024-06-02T05:06:23.235 INFO:teuthology.orchestra.run.smithi192.stdout: "get_sum": 0, 2024-06-02T05:06:23.235 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_fail": 0, 2024-06-02T05:06:23.235 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_success": 0, 2024-06-02T05:06:23.235 INFO:teuthology.orchestra.run.smithi192.stdout: "take": 0, 2024-06-02T05:06:23.235 INFO:teuthology.orchestra.run.smithi192.stdout: "take_sum": 0, 2024-06-02T05:06:23.236 INFO:teuthology.orchestra.run.smithi192.stdout: "put": 0, 2024-06-02T05:06:23.236 INFO:teuthology.orchestra.run.smithi192.stdout: "put_sum": 0, 2024-06-02T05:06:23.236 INFO:teuthology.orchestra.run.smithi192.stdout: "wait": { 2024-06-02T05:06:23.236 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-06-02T05:06:23.236 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-06-02T05:06:23.236 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-06-02T05:06:23.236 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-06-02T05:06:23.236 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-06-02T05:06:23.236 INFO:teuthology.orchestra.run.smithi192.stdout:} 2024-06-02T05:06:23.532 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-06-02T05:06:23.532 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-06-02T05:06:23.532 DEBUG:tasks.check_counter:Getting stats from i 2024-06-02T05:06:23.533 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell --fsid 60ab6d30-209a-11ef-bc9b-c7b262605968 -- ceph daemon mds.i perf dump 2024-06-02T05:06:23.754 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/mon.c/config 2024-06-02T05:06:24.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:06:23 smithi192 ceph-mon[47933]: pgmap v772: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 3.9 KiB/s wr, 7 op/s 2024-06-02T05:06:24.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:06:23 smithi076 ceph-mon[42935]: pgmap v772: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 3.9 KiB/s wr, 7 op/s 2024-06-02T05:06:24.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:06:23 smithi119 ceph-mon[46633]: pgmap v772: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 3.9 KiB/s wr, 7 op/s 2024-06-02T05:06:24.886 INFO:teuthology.orchestra.run.smithi192.stdout:{ 2024-06-02T05:06:24.886 INFO:teuthology.orchestra.run.smithi192.stdout: "AsyncMessenger::Worker-0": { 2024-06-02T05:06:24.886 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_messages": 10224, 2024-06-02T05:06:24.887 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages": 8643, 2024-06-02T05:06:24.887 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_bytes": 3006264, 2024-06-02T05:06:24.887 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_bytes": 21416598, 2024-06-02T05:06:24.887 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_created_connections": 14, 2024-06-02T05:06:24.887 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_active_connections": 6, 2024-06-02T05:06:24.887 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_total_time": 0.536211408, 2024-06-02T05:06:24.887 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_send_time": 0.213378435, 2024-06-02T05:06:24.887 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_recv_time": 0.325692349, 2024-06-02T05:06:24.887 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_fast_dispatch_time": 0.055387302, 2024-06-02T05:06:24.887 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T05:06:24.887 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 8641, 2024-06-02T05:06:24.887 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.397756094, 2024-06-02T05:06:24.888 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000046031 2024-06-02T05:06:24.888 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:24.888 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_handle_ack_lat": { 2024-06-02T05:06:24.888 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 14754, 2024-06-02T05:06:24.888 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.002494696, 2024-06-02T05:06:24.888 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000169 2024-06-02T05:06:24.888 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:24.888 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_encrypted_bytes": 0, 2024-06-02T05:06:24.888 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_encrypted_bytes": 0 2024-06-02T05:06:24.888 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:24.888 INFO:teuthology.orchestra.run.smithi192.stdout: "AsyncMessenger::Worker-1": { 2024-06-02T05:06:24.888 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_messages": 340, 2024-06-02T05:06:24.888 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages": 565, 2024-06-02T05:06:24.888 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_bytes": 135553, 2024-06-02T05:06:24.889 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_bytes": 4888205, 2024-06-02T05:06:24.889 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_created_connections": 11, 2024-06-02T05:06:24.889 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_active_connections": 5, 2024-06-02T05:06:24.889 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_total_time": 0.043764436, 2024-06-02T05:06:24.889 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_send_time": 0.022422541, 2024-06-02T05:06:24.889 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_recv_time": 0.011107584, 2024-06-02T05:06:24.889 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_fast_dispatch_time": 0.007794800, 2024-06-02T05:06:24.889 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T05:06:24.889 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 563, 2024-06-02T05:06:24.889 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.065452319, 2024-06-02T05:06:24.890 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000116256 2024-06-02T05:06:24.890 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:24.890 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_handle_ack_lat": { 2024-06-02T05:06:24.890 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 160, 2024-06-02T05:06:24.890 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000027338, 2024-06-02T05:06:24.890 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000170 2024-06-02T05:06:24.890 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:24.891 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_encrypted_bytes": 1248, 2024-06-02T05:06:24.891 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_encrypted_bytes": 549776 2024-06-02T05:06:24.891 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:24.891 INFO:teuthology.orchestra.run.smithi192.stdout: "AsyncMessenger::Worker-2": { 2024-06-02T05:06:24.892 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_messages": 29192, 2024-06-02T05:06:24.892 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages": 30461, 2024-06-02T05:06:24.892 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_bytes": 10270536, 2024-06-02T05:06:24.892 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_bytes": 21638286, 2024-06-02T05:06:24.892 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_created_connections": 11, 2024-06-02T05:06:24.893 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_active_connections": 6, 2024-06-02T05:06:24.893 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_total_time": 1.809581577, 2024-06-02T05:06:24.893 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_send_time": 0.668145584, 2024-06-02T05:06:24.893 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_recv_time": 1.501457892, 2024-06-02T05:06:24.893 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_fast_dispatch_time": 0.028370979, 2024-06-02T05:06:24.893 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T05:06:24.894 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 30461, 2024-06-02T05:06:24.894 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 3.158365670, 2024-06-02T05:06:24.894 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000103685 2024-06-02T05:06:24.894 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:24.894 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_handle_ack_lat": { 2024-06-02T05:06:24.895 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 49165, 2024-06-02T05:06:24.895 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.009852838, 2024-06-02T05:06:24.895 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000200 2024-06-02T05:06:24.895 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:24.895 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_encrypted_bytes": 577216, 2024-06-02T05:06:24.895 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_encrypted_bytes": 224688 2024-06-02T05:06:24.896 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:24.896 INFO:teuthology.orchestra.run.smithi192.stdout: "cct": { 2024-06-02T05:06:24.896 INFO:teuthology.orchestra.run.smithi192.stdout: "total_workers": 1, 2024-06-02T05:06:24.896 INFO:teuthology.orchestra.run.smithi192.stdout: "unhealthy_workers": 0 2024-06-02T05:06:24.896 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:24.896 INFO:teuthology.orchestra.run.smithi192.stdout: "finisher-MDSRank": { 2024-06-02T05:06:24.897 INFO:teuthology.orchestra.run.smithi192.stdout: "queue_len": 0, 2024-06-02T05:06:24.897 INFO:teuthology.orchestra.run.smithi192.stdout: "complete_latency": { 2024-06-02T05:06:24.897 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 4861, 2024-06-02T05:06:24.897 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 3.899526658, 2024-06-02T05:06:24.897 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000802206 2024-06-02T05:06:24.897 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-06-02T05:06:24.898 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:24.898 INFO:teuthology.orchestra.run.smithi192.stdout: "finisher-PurgeQueue": { 2024-06-02T05:06:24.898 INFO:teuthology.orchestra.run.smithi192.stdout: "queue_len": 0, 2024-06-02T05:06:24.898 INFO:teuthology.orchestra.run.smithi192.stdout: "complete_latency": { 2024-06-02T05:06:24.898 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 2, 2024-06-02T05:06:24.898 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000008128, 2024-06-02T05:06:24.899 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000004064 2024-06-02T05:06:24.899 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-06-02T05:06:24.899 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:24.899 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": { 2024-06-02T05:06:24.899 INFO:teuthology.orchestra.run.smithi192.stdout: "request": 5590, 2024-06-02T05:06:24.899 INFO:teuthology.orchestra.run.smithi192.stdout: "reply": 5573, 2024-06-02T05:06:24.900 INFO:teuthology.orchestra.run.smithi192.stdout: "reply_latency": { 2024-06-02T05:06:24.900 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 5573, 2024-06-02T05:06:24.900 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 7.089637268, 2024-06-02T05:06:24.900 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.001272140 2024-06-02T05:06:24.900 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:24.900 INFO:teuthology.orchestra.run.smithi192.stdout: "slow_reply": 0, 2024-06-02T05:06:24.900 INFO:teuthology.orchestra.run.smithi192.stdout: "forward": 17, 2024-06-02T05:06:24.901 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_fetch_complete": 0, 2024-06-02T05:06:24.901 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_fetch_keys": 0, 2024-06-02T05:06:24.901 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_commit": 11, 2024-06-02T05:06:24.901 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_split": 0, 2024-06-02T05:06:24.901 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_merge": 0, 2024-06-02T05:06:24.901 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes": 593, 2024-06-02T05:06:24.901 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes_top": 0, 2024-06-02T05:06:24.902 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes_bottom": 529, 2024-06-02T05:06:24.902 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes_pin_tail": 64, 2024-06-02T05:06:24.902 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes_pinned": 592, 2024-06-02T05:06:24.902 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes_expired": 245, 2024-06-02T05:06:24.902 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes_with_caps": 71, 2024-06-02T05:06:24.902 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": 71, 2024-06-02T05:06:24.903 INFO:teuthology.orchestra.run.smithi192.stdout: "subtrees": 4, 2024-06-02T05:06:24.903 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse": 14825, 2024-06-02T05:06:24.903 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse_hit": 11083, 2024-06-02T05:06:24.903 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse_forward": 16, 2024-06-02T05:06:24.903 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse_discover": 7, 2024-06-02T05:06:24.903 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse_dir_fetch": 0, 2024-06-02T05:06:24.904 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse_remote_ino": 0, 2024-06-02T05:06:24.904 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse_lock": 13, 2024-06-02T05:06:24.904 INFO:teuthology.orchestra.run.smithi192.stdout: "load_cent": 13792, 2024-06-02T05:06:24.904 INFO:teuthology.orchestra.run.smithi192.stdout: "q": 0, 2024-06-02T05:06:24.904 INFO:teuthology.orchestra.run.smithi192.stdout: "exported": 5, 2024-06-02T05:06:24.904 INFO:teuthology.orchestra.run.smithi192.stdout: "exported_inodes": 243, 2024-06-02T05:06:24.905 INFO:teuthology.orchestra.run.smithi192.stdout: "imported": 6, 2024-06-02T05:06:24.905 INFO:teuthology.orchestra.run.smithi192.stdout: "imported_inodes": 243, 2024-06-02T05:06:24.905 INFO:teuthology.orchestra.run.smithi192.stdout: "openino_dir_fetch": 0, 2024-06-02T05:06:24.905 INFO:teuthology.orchestra.run.smithi192.stdout: "openino_backtrace_fetch": 249, 2024-06-02T05:06:24.905 INFO:teuthology.orchestra.run.smithi192.stdout: "openino_peer_discover": 0, 2024-06-02T05:06:24.906 INFO:teuthology.orchestra.run.smithi192.stdout: "root_rfiles": 1037, 2024-06-02T05:06:24.906 INFO:teuthology.orchestra.run.smithi192.stdout: "root_rbytes": 1696889314, 2024-06-02T05:06:24.906 INFO:teuthology.orchestra.run.smithi192.stdout: "root_rsnaps": 0, 2024-06-02T05:06:24.906 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_backtrace_fetch": 249, 2024-06-02T05:06:24.906 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_set_tag": 0, 2024-06-02T05:06:24.906 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_backtrace_repaired": 0, 2024-06-02T05:06:24.907 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_inotable_repaired": 0, 2024-06-02T05:06:24.907 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_dir_inodes": 1, 2024-06-02T05:06:24.907 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_dir_base_inodes": 0, 2024-06-02T05:06:24.907 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_dirfrag_rstats": 1, 2024-06-02T05:06:24.907 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_file_inodes": 248, 2024-06-02T05:06:24.908 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_inode_file_caps": 0, 2024-06-02T05:06:24.908 INFO:teuthology.orchestra.run.smithi192.stdout: "ceph_cap_op_revoke": 596, 2024-06-02T05:06:24.908 INFO:teuthology.orchestra.run.smithi192.stdout: "ceph_cap_op_grant": 1130, 2024-06-02T05:06:24.908 INFO:teuthology.orchestra.run.smithi192.stdout: "ceph_cap_op_trunc": 0, 2024-06-02T05:06:24.908 INFO:teuthology.orchestra.run.smithi192.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-06-02T05:06:24.908 INFO:teuthology.orchestra.run.smithi192.stdout: "ceph_cap_op_flush_ack": 0, 2024-06-02T05:06:24.909 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_client_caps": 22517, 2024-06-02T05:06:24.909 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_client_caps_dirty": 20964, 2024-06-02T05:06:24.909 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_client_cap_release": 0, 2024-06-02T05:06:24.909 INFO:teuthology.orchestra.run.smithi192.stdout: "process_request_cap_release": 866 2024-06-02T05:06:24.909 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:24.909 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_cache": { 2024-06-02T05:06:24.910 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_update": 0, 2024-06-02T05:06:24.910 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_update_receipt": 0, 2024-06-02T05:06:24.910 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_try_discover": 0, 2024-06-02T05:06:24.910 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_send_discover": 7, 2024-06-02T05:06:24.910 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_handle_discover": 0, 2024-06-02T05:06:24.910 INFO:teuthology.orchestra.run.smithi192.stdout: "num_strays": 0, 2024-06-02T05:06:24.910 INFO:teuthology.orchestra.run.smithi192.stdout: "num_strays_delayed": 0, 2024-06-02T05:06:24.911 INFO:teuthology.orchestra.run.smithi192.stdout: "num_strays_enqueuing": 0, 2024-06-02T05:06:24.911 INFO:teuthology.orchestra.run.smithi192.stdout: "strays_created": 287, 2024-06-02T05:06:24.911 INFO:teuthology.orchestra.run.smithi192.stdout: "strays_enqueued": 0, 2024-06-02T05:06:24.911 INFO:teuthology.orchestra.run.smithi192.stdout: "strays_reintegrated": 287, 2024-06-02T05:06:24.911 INFO:teuthology.orchestra.run.smithi192.stdout: "strays_migrated": 0, 2024-06-02T05:06:24.911 INFO:teuthology.orchestra.run.smithi192.stdout: "num_recovering_processing": 0, 2024-06-02T05:06:24.911 INFO:teuthology.orchestra.run.smithi192.stdout: "num_recovering_enqueued": 0, 2024-06-02T05:06:24.911 INFO:teuthology.orchestra.run.smithi192.stdout: "num_recovering_prioritized": 0, 2024-06-02T05:06:24.912 INFO:teuthology.orchestra.run.smithi192.stdout: "recovery_started": 0, 2024-06-02T05:06:24.912 INFO:teuthology.orchestra.run.smithi192.stdout: "recovery_completed": 0, 2024-06-02T05:06:24.912 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_enqueue_scrub": 0, 2024-06-02T05:06:24.912 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_exportdir": 5, 2024-06-02T05:06:24.912 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_flush": 0, 2024-06-02T05:06:24.912 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_fragmentdir": 0, 2024-06-02T05:06:24.912 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_fragstats": 0, 2024-06-02T05:06:24.912 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_inodestats": 0 2024-06-02T05:06:24.913 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:24.913 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_log": { 2024-06-02T05:06:24.913 INFO:teuthology.orchestra.run.smithi192.stdout: "evadd": 24590, 2024-06-02T05:06:24.913 INFO:teuthology.orchestra.run.smithi192.stdout: "evex": 0, 2024-06-02T05:06:24.913 INFO:teuthology.orchestra.run.smithi192.stdout: "evtrm": 0, 2024-06-02T05:06:24.913 INFO:teuthology.orchestra.run.smithi192.stdout: "ev": 24590, 2024-06-02T05:06:24.913 INFO:teuthology.orchestra.run.smithi192.stdout: "evexg": 0, 2024-06-02T05:06:24.914 INFO:teuthology.orchestra.run.smithi192.stdout: "evexd": 0, 2024-06-02T05:06:24.914 INFO:teuthology.orchestra.run.smithi192.stdout: "segadd": 30, 2024-06-02T05:06:24.914 INFO:teuthology.orchestra.run.smithi192.stdout: "segex": 0, 2024-06-02T05:06:24.914 INFO:teuthology.orchestra.run.smithi192.stdout: "segtrm": 0, 2024-06-02T05:06:24.914 INFO:teuthology.orchestra.run.smithi192.stdout: "seg": 30, 2024-06-02T05:06:24.914 INFO:teuthology.orchestra.run.smithi192.stdout: "segexg": 0, 2024-06-02T05:06:24.915 INFO:teuthology.orchestra.run.smithi192.stdout: "segexd": 0, 2024-06-02T05:06:24.915 INFO:teuthology.orchestra.run.smithi192.stdout: "expos": 4194304, 2024-06-02T05:06:24.915 INFO:teuthology.orchestra.run.smithi192.stdout: "wrpos": 35541932, 2024-06-02T05:06:24.915 INFO:teuthology.orchestra.run.smithi192.stdout: "rdpos": 0, 2024-06-02T05:06:24.915 INFO:teuthology.orchestra.run.smithi192.stdout: "jlat": { 2024-06-02T05:06:24.915 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 2277, 2024-06-02T05:06:24.916 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 5.550869363, 2024-06-02T05:06:24.916 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.002437799 2024-06-02T05:06:24.916 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:24.916 INFO:teuthology.orchestra.run.smithi192.stdout: "replayed": 0 2024-06-02T05:06:24.916 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:24.916 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_mem": { 2024-06-02T05:06:24.917 INFO:teuthology.orchestra.run.smithi192.stdout: "ino": 88, 2024-06-02T05:06:24.917 INFO:teuthology.orchestra.run.smithi192.stdout: "ino+": 328, 2024-06-02T05:06:24.917 INFO:teuthology.orchestra.run.smithi192.stdout: "ino-": 240, 2024-06-02T05:06:24.917 INFO:teuthology.orchestra.run.smithi192.stdout: "dir": 23, 2024-06-02T05:06:24.917 INFO:teuthology.orchestra.run.smithi192.stdout: "dir+": 27, 2024-06-02T05:06:24.917 INFO:teuthology.orchestra.run.smithi192.stdout: "dir-": 4, 2024-06-02T05:06:24.918 INFO:teuthology.orchestra.run.smithi192.stdout: "dn": 593, 2024-06-02T05:06:24.918 INFO:teuthology.orchestra.run.smithi192.stdout: "dn+": 840, 2024-06-02T05:06:24.918 INFO:teuthology.orchestra.run.smithi192.stdout: "dn-": 247, 2024-06-02T05:06:24.918 INFO:teuthology.orchestra.run.smithi192.stdout: "cap": 71, 2024-06-02T05:06:24.918 INFO:teuthology.orchestra.run.smithi192.stdout: "cap+": 310, 2024-06-02T05:06:24.918 INFO:teuthology.orchestra.run.smithi192.stdout: "cap-": 239, 2024-06-02T05:06:24.918 INFO:teuthology.orchestra.run.smithi192.stdout: "rss": 59384, 2024-06-02T05:06:24.918 INFO:teuthology.orchestra.run.smithi192.stdout: "heap": 198964 2024-06-02T05:06:24.919 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:24.919 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_server": { 2024-06-02T05:06:24.919 INFO:teuthology.orchestra.run.smithi192.stdout: "dispatch_client_request": 9769, 2024-06-02T05:06:24.919 INFO:teuthology.orchestra.run.smithi192.stdout: "dispatch_server_request": 0, 2024-06-02T05:06:24.919 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_client_request": 5590, 2024-06-02T05:06:24.919 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_client_session": 22, 2024-06-02T05:06:24.919 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_peer_request": 933, 2024-06-02T05:06:24.919 INFO:teuthology.orchestra.run.smithi192.stdout: "req_create_latency": { 2024-06-02T05:06:24.919 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 63, 2024-06-02T05:06:24.919 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.136114011, 2024-06-02T05:06:24.919 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.002160539 2024-06-02T05:06:24.919 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:24.919 INFO:teuthology.orchestra.run.smithi192.stdout: "req_getattr_latency": { 2024-06-02T05:06:24.920 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 17, 2024-06-02T05:06:24.920 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.012341600, 2024-06-02T05:06:24.920 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000725976 2024-06-02T05:06:24.920 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:24.920 INFO:teuthology.orchestra.run.smithi192.stdout: "req_getfilelock_latency": { 2024-06-02T05:06:24.920 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-06-02T05:06:24.920 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-06-02T05:06:24.920 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-06-02T05:06:24.920 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:24.920 INFO:teuthology.orchestra.run.smithi192.stdout: "req_link_latency": { 2024-06-02T05:06:24.920 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 287, 2024-06-02T05:06:24.920 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.863328259, 2024-06-02T05:06:24.921 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.003008112 2024-06-02T05:06:24.921 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:24.921 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lookup_latency": { 2024-06-02T05:06:24.921 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 3787, 2024-06-02T05:06:24.921 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 1.801679464, 2024-06-02T05:06:24.921 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000475753 2024-06-02T05:06:24.921 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:24.921 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lookuphash_latency": { 2024-06-02T05:06:24.922 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-06-02T05:06:24.922 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-06-02T05:06:24.922 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-06-02T05:06:24.922 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:24.922 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lookupino_latency": { 2024-06-02T05:06:24.922 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-06-02T05:06:24.922 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-06-02T05:06:24.922 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-06-02T05:06:24.922 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:24.923 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lookupname_latency": { 2024-06-02T05:06:24.923 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-06-02T05:06:24.923 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-06-02T05:06:24.923 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-06-02T05:06:24.923 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:24.923 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lookupparent_latency": { 2024-06-02T05:06:24.924 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-06-02T05:06:24.924 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-06-02T05:06:24.924 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-06-02T05:06:24.924 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:24.924 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lookupsnap_latency": { 2024-06-02T05:06:24.924 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-06-02T05:06:24.924 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-06-02T05:06:24.924 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-06-02T05:06:24.925 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:24.925 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lssnap_latency": { 2024-06-02T05:06:24.925 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-06-02T05:06:24.925 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-06-02T05:06:24.925 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-06-02T05:06:24.925 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:24.925 INFO:teuthology.orchestra.run.smithi192.stdout: "req_mkdir_latency": { 2024-06-02T05:06:24.925 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-06-02T05:06:24.925 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-06-02T05:06:24.925 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-06-02T05:06:24.925 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:24.925 INFO:teuthology.orchestra.run.smithi192.stdout: "req_mknod_latency": { 2024-06-02T05:06:24.925 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-06-02T05:06:24.926 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-06-02T05:06:24.926 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-06-02T05:06:24.926 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:24.926 INFO:teuthology.orchestra.run.smithi192.stdout: "req_mksnap_latency": { 2024-06-02T05:06:24.926 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-06-02T05:06:24.926 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-06-02T05:06:24.926 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-06-02T05:06:24.926 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:24.926 INFO:teuthology.orchestra.run.smithi192.stdout: "req_open_latency": { 2024-06-02T05:06:24.926 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 822, 2024-06-02T05:06:24.926 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.615835306, 2024-06-02T05:06:24.927 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000749191 2024-06-02T05:06:24.927 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:24.927 INFO:teuthology.orchestra.run.smithi192.stdout: "req_readdir_latency": { 2024-06-02T05:06:24.927 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 22, 2024-06-02T05:06:24.927 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.019922437, 2024-06-02T05:06:24.927 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000905565 2024-06-02T05:06:24.927 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:24.927 INFO:teuthology.orchestra.run.smithi192.stdout: "req_rename_latency": { 2024-06-02T05:06:24.927 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 288, 2024-06-02T05:06:24.928 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 2.865262543, 2024-06-02T05:06:24.928 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.009948828 2024-06-02T05:06:24.928 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:24.928 INFO:teuthology.orchestra.run.smithi192.stdout: "req_renamesnap_latency": { 2024-06-02T05:06:24.928 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-06-02T05:06:24.928 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-06-02T05:06:24.928 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-06-02T05:06:24.928 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:24.928 INFO:teuthology.orchestra.run.smithi192.stdout: "req_snapdiff_latency": { 2024-06-02T05:06:24.929 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-06-02T05:06:24.929 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-06-02T05:06:24.929 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-06-02T05:06:24.929 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:24.929 INFO:teuthology.orchestra.run.smithi192.stdout: "req_rmdir_latency": { 2024-06-02T05:06:24.929 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-06-02T05:06:24.929 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-06-02T05:06:24.929 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-06-02T05:06:24.929 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:24.930 INFO:teuthology.orchestra.run.smithi192.stdout: "req_rmsnap_latency": { 2024-06-02T05:06:24.930 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-06-02T05:06:24.930 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-06-02T05:06:24.930 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-06-02T05:06:24.930 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:24.930 INFO:teuthology.orchestra.run.smithi192.stdout: "req_rmxattr_latency": { 2024-06-02T05:06:24.930 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-06-02T05:06:24.930 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-06-02T05:06:24.930 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-06-02T05:06:24.930 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:24.930 INFO:teuthology.orchestra.run.smithi192.stdout: "req_setattr_latency": { 2024-06-02T05:06:24.931 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-06-02T05:06:24.931 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-06-02T05:06:24.931 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-06-02T05:06:24.931 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:24.931 INFO:teuthology.orchestra.run.smithi192.stdout: "req_setdirlayout_latency": { 2024-06-02T05:06:24.931 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-06-02T05:06:24.931 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-06-02T05:06:24.931 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-06-02T05:06:24.931 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:24.931 INFO:teuthology.orchestra.run.smithi192.stdout: "req_setfilelock_latency": { 2024-06-02T05:06:24.931 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-06-02T05:06:24.931 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-06-02T05:06:24.932 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-06-02T05:06:24.932 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:24.932 INFO:teuthology.orchestra.run.smithi192.stdout: "req_setlayout_latency": { 2024-06-02T05:06:24.932 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-06-02T05:06:24.932 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-06-02T05:06:24.932 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-06-02T05:06:24.932 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:24.932 INFO:teuthology.orchestra.run.smithi192.stdout: "req_setxattr_latency": { 2024-06-02T05:06:24.932 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-06-02T05:06:24.932 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-06-02T05:06:24.932 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-06-02T05:06:24.933 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:24.933 INFO:teuthology.orchestra.run.smithi192.stdout: "req_symlink_latency": { 2024-06-02T05:06:24.933 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-06-02T05:06:24.933 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-06-02T05:06:24.933 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-06-02T05:06:24.933 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:24.933 INFO:teuthology.orchestra.run.smithi192.stdout: "req_unlink_latency": { 2024-06-02T05:06:24.933 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 287, 2024-06-02T05:06:24.934 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.775153648, 2024-06-02T05:06:24.934 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.002700883 2024-06-02T05:06:24.934 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:24.934 INFO:teuthology.orchestra.run.smithi192.stdout: "cap_revoke_eviction": 0, 2024-06-02T05:06:24.934 INFO:teuthology.orchestra.run.smithi192.stdout: "cap_acquisition_throttle": 0, 2024-06-02T05:06:24.934 INFO:teuthology.orchestra.run.smithi192.stdout: "req_getvxattr_latency": { 2024-06-02T05:06:24.934 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-06-02T05:06:24.934 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-06-02T05:06:24.934 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-06-02T05:06:24.934 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-06-02T05:06:24.935 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:24.935 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_sessions": { 2024-06-02T05:06:24.935 INFO:teuthology.orchestra.run.smithi192.stdout: "session_count": 1, 2024-06-02T05:06:24.935 INFO:teuthology.orchestra.run.smithi192.stdout: "session_add": 2, 2024-06-02T05:06:24.935 INFO:teuthology.orchestra.run.smithi192.stdout: "session_remove": 1, 2024-06-02T05:06:24.935 INFO:teuthology.orchestra.run.smithi192.stdout: "sessions_open": 1, 2024-06-02T05:06:24.935 INFO:teuthology.orchestra.run.smithi192.stdout: "sessions_stale": 0, 2024-06-02T05:06:24.935 INFO:teuthology.orchestra.run.smithi192.stdout: "total_load": 1273, 2024-06-02T05:06:24.935 INFO:teuthology.orchestra.run.smithi192.stdout: "average_load": 1273, 2024-06-02T05:06:24.936 INFO:teuthology.orchestra.run.smithi192.stdout: "avg_session_uptime": 1005, 2024-06-02T05:06:24.936 INFO:teuthology.orchestra.run.smithi192.stdout: "mdthresh_evicted": 0 2024-06-02T05:06:24.936 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:24.936 INFO:teuthology.orchestra.run.smithi192.stdout: "mempool": { 2024-06-02T05:06:24.936 INFO:teuthology.orchestra.run.smithi192.stdout: "bloom_filter_bytes": 0, 2024-06-02T05:06:24.936 INFO:teuthology.orchestra.run.smithi192.stdout: "bloom_filter_items": 0, 2024-06-02T05:06:24.937 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_alloc_bytes": 0, 2024-06-02T05:06:24.937 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_alloc_items": 0, 2024-06-02T05:06:24.937 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_data_bytes": 0, 2024-06-02T05:06:24.937 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_data_items": 0, 2024-06-02T05:06:24.937 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_onode_bytes": 0, 2024-06-02T05:06:24.938 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_onode_items": 0, 2024-06-02T05:06:24.938 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_meta_bytes": 0, 2024-06-02T05:06:24.938 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_meta_items": 0, 2024-06-02T05:06:24.938 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_other_bytes": 0, 2024-06-02T05:06:24.938 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_other_items": 0, 2024-06-02T05:06:24.938 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_buffer_bytes": 0, 2024-06-02T05:06:24.939 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_buffer_items": 0, 2024-06-02T05:06:24.939 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_extent_bytes": 0, 2024-06-02T05:06:24.939 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_extent_items": 0, 2024-06-02T05:06:24.939 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_blob_bytes": 0, 2024-06-02T05:06:24.939 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_blob_items": 0, 2024-06-02T05:06:24.940 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_shared_blob_bytes": 0, 2024-06-02T05:06:24.940 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_shared_blob_items": 0, 2024-06-02T05:06:24.940 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_inline_bl_bytes": 0, 2024-06-02T05:06:24.940 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_inline_bl_items": 0, 2024-06-02T05:06:24.940 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_fsck_bytes": 0, 2024-06-02T05:06:24.940 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_fsck_items": 0, 2024-06-02T05:06:24.941 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_txc_bytes": 0, 2024-06-02T05:06:24.941 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_txc_items": 0, 2024-06-02T05:06:24.941 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_writing_deferred_bytes": 0, 2024-06-02T05:06:24.941 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_writing_deferred_items": 0, 2024-06-02T05:06:24.941 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_writing_bytes": 0, 2024-06-02T05:06:24.941 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_writing_items": 0, 2024-06-02T05:06:24.941 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_bytes": 0, 2024-06-02T05:06:24.941 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_items": 0, 2024-06-02T05:06:24.942 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_file_reader_bytes": 0, 2024-06-02T05:06:24.942 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_file_reader_items": 0, 2024-06-02T05:06:24.942 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_file_writer_bytes": 0, 2024-06-02T05:06:24.942 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_file_writer_items": 0, 2024-06-02T05:06:24.942 INFO:teuthology.orchestra.run.smithi192.stdout: "buffer_anon_bytes": 313711, 2024-06-02T05:06:24.942 INFO:teuthology.orchestra.run.smithi192.stdout: "buffer_anon_items": 115, 2024-06-02T05:06:24.942 INFO:teuthology.orchestra.run.smithi192.stdout: "buffer_meta_bytes": 0, 2024-06-02T05:06:24.942 INFO:teuthology.orchestra.run.smithi192.stdout: "buffer_meta_items": 0, 2024-06-02T05:06:24.942 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_bytes": 0, 2024-06-02T05:06:24.942 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_items": 0, 2024-06-02T05:06:24.942 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_mapbl_bytes": 0, 2024-06-02T05:06:24.942 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_mapbl_items": 0, 2024-06-02T05:06:24.943 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_pglog_bytes": 0, 2024-06-02T05:06:24.943 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_pglog_items": 0, 2024-06-02T05:06:24.943 INFO:teuthology.orchestra.run.smithi192.stdout: "osdmap_bytes": 8800, 2024-06-02T05:06:24.943 INFO:teuthology.orchestra.run.smithi192.stdout: "osdmap_items": 169, 2024-06-02T05:06:24.943 INFO:teuthology.orchestra.run.smithi192.stdout: "osdmap_mapping_bytes": 0, 2024-06-02T05:06:24.943 INFO:teuthology.orchestra.run.smithi192.stdout: "osdmap_mapping_items": 0, 2024-06-02T05:06:24.943 INFO:teuthology.orchestra.run.smithi192.stdout: "pgmap_bytes": 0, 2024-06-02T05:06:24.943 INFO:teuthology.orchestra.run.smithi192.stdout: "pgmap_items": 0, 2024-06-02T05:06:24.943 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_co_bytes": 702777, 2024-06-02T05:06:24.943 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_co_items": 20453, 2024-06-02T05:06:24.943 INFO:teuthology.orchestra.run.smithi192.stdout: "unittest_1_bytes": 0, 2024-06-02T05:06:24.943 INFO:teuthology.orchestra.run.smithi192.stdout: "unittest_1_items": 0, 2024-06-02T05:06:24.944 INFO:teuthology.orchestra.run.smithi192.stdout: "unittest_2_bytes": 0, 2024-06-02T05:06:24.944 INFO:teuthology.orchestra.run.smithi192.stdout: "unittest_2_items": 0 2024-06-02T05:06:24.944 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:24.944 INFO:teuthology.orchestra.run.smithi192.stdout: "objecter": { 2024-06-02T05:06:24.944 INFO:teuthology.orchestra.run.smithi192.stdout: "op_active": 0, 2024-06-02T05:06:24.944 INFO:teuthology.orchestra.run.smithi192.stdout: "op_laggy": 0, 2024-06-02T05:06:24.944 INFO:teuthology.orchestra.run.smithi192.stdout: "op_send": 2822, 2024-06-02T05:06:24.944 INFO:teuthology.orchestra.run.smithi192.stdout: "op_send_bytes": 31405918, 2024-06-02T05:06:24.945 INFO:teuthology.orchestra.run.smithi192.stdout: "op_resend": 27, 2024-06-02T05:06:24.945 INFO:teuthology.orchestra.run.smithi192.stdout: "op_reply": 2822, 2024-06-02T05:06:24.945 INFO:teuthology.orchestra.run.smithi192.stdout: "op_latency": { 2024-06-02T05:06:24.945 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 2822, 2024-06-02T05:06:24.945 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 6.920866746, 2024-06-02T05:06:24.945 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.002452468 2024-06-02T05:06:24.945 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:24.945 INFO:teuthology.orchestra.run.smithi192.stdout: "op_inflight": 0, 2024-06-02T05:06:24.946 INFO:teuthology.orchestra.run.smithi192.stdout: "oplen_avg": { 2024-06-02T05:06:24.946 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 2822, 2024-06-02T05:06:24.946 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 3166 2024-06-02T05:06:24.946 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:24.946 INFO:teuthology.orchestra.run.smithi192.stdout: "op": 2822, 2024-06-02T05:06:24.946 INFO:teuthology.orchestra.run.smithi192.stdout: "op_r": 249, 2024-06-02T05:06:24.946 INFO:teuthology.orchestra.run.smithi192.stdout: "op_w": 2573, 2024-06-02T05:06:24.946 INFO:teuthology.orchestra.run.smithi192.stdout: "op_rmw": 0, 2024-06-02T05:06:24.946 INFO:teuthology.orchestra.run.smithi192.stdout: "op_pg": 0, 2024-06-02T05:06:24.946 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_stat": 0, 2024-06-02T05:06:24.946 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_create": 10, 2024-06-02T05:06:24.946 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_read": 0, 2024-06-02T05:06:24.947 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_write": 2277, 2024-06-02T05:06:24.947 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_writefull": 72, 2024-06-02T05:06:24.947 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_writesame": 0, 2024-06-02T05:06:24.947 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_append": 0, 2024-06-02T05:06:24.947 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_zero": 0, 2024-06-02T05:06:24.947 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_truncate": 0, 2024-06-02T05:06:24.947 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_delete": 13, 2024-06-02T05:06:24.947 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_mapext": 0, 2024-06-02T05:06:24.947 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_sparse_read": 0, 2024-06-02T05:06:24.947 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_clonerange": 0, 2024-06-02T05:06:24.947 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_getxattr": 249, 2024-06-02T05:06:24.947 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_setxattr": 20, 2024-06-02T05:06:24.947 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_cmpxattr": 0, 2024-06-02T05:06:24.948 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_rmxattr": 0, 2024-06-02T05:06:24.948 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_resetxattrs": 0, 2024-06-02T05:06:24.948 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_call": 0, 2024-06-02T05:06:24.948 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_watch": 0, 2024-06-02T05:06:24.948 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_notify": 0, 2024-06-02T05:06:24.948 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_src_cmpxattr": 0, 2024-06-02T05:06:24.948 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_pgls": 0, 2024-06-02T05:06:24.948 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_pgls_filter": 0, 2024-06-02T05:06:24.948 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_other": 0, 2024-06-02T05:06:24.948 INFO:teuthology.orchestra.run.smithi192.stdout: "linger_active": 0, 2024-06-02T05:06:24.948 INFO:teuthology.orchestra.run.smithi192.stdout: "linger_send": 0, 2024-06-02T05:06:24.948 INFO:teuthology.orchestra.run.smithi192.stdout: "linger_resend": 0, 2024-06-02T05:06:24.948 INFO:teuthology.orchestra.run.smithi192.stdout: "linger_ping": 0, 2024-06-02T05:06:24.948 INFO:teuthology.orchestra.run.smithi192.stdout: "poolop_active": 0, 2024-06-02T05:06:24.949 INFO:teuthology.orchestra.run.smithi192.stdout: "poolop_send": 0, 2024-06-02T05:06:24.949 INFO:teuthology.orchestra.run.smithi192.stdout: "poolop_resend": 0, 2024-06-02T05:06:24.949 INFO:teuthology.orchestra.run.smithi192.stdout: "poolstat_active": 0, 2024-06-02T05:06:24.949 INFO:teuthology.orchestra.run.smithi192.stdout: "poolstat_send": 0, 2024-06-02T05:06:24.949 INFO:teuthology.orchestra.run.smithi192.stdout: "poolstat_resend": 0, 2024-06-02T05:06:24.949 INFO:teuthology.orchestra.run.smithi192.stdout: "statfs_active": 0, 2024-06-02T05:06:24.949 INFO:teuthology.orchestra.run.smithi192.stdout: "statfs_send": 0, 2024-06-02T05:06:24.949 INFO:teuthology.orchestra.run.smithi192.stdout: "statfs_resend": 0, 2024-06-02T05:06:24.949 INFO:teuthology.orchestra.run.smithi192.stdout: "command_active": 0, 2024-06-02T05:06:24.949 INFO:teuthology.orchestra.run.smithi192.stdout: "command_send": 0, 2024-06-02T05:06:24.949 INFO:teuthology.orchestra.run.smithi192.stdout: "command_resend": 0, 2024-06-02T05:06:24.949 INFO:teuthology.orchestra.run.smithi192.stdout: "map_epoch": 84, 2024-06-02T05:06:24.949 INFO:teuthology.orchestra.run.smithi192.stdout: "map_full": 0, 2024-06-02T05:06:24.950 INFO:teuthology.orchestra.run.smithi192.stdout: "map_inc": 4, 2024-06-02T05:06:24.950 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_sessions": 12, 2024-06-02T05:06:24.950 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_session_open": 12, 2024-06-02T05:06:24.950 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_session_close": 0, 2024-06-02T05:06:24.950 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_laggy": 0, 2024-06-02T05:06:24.950 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_wr": 368, 2024-06-02T05:06:24.950 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_rd": 0, 2024-06-02T05:06:24.950 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_del": 157 2024-06-02T05:06:24.950 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:24.950 INFO:teuthology.orchestra.run.smithi192.stdout: "oft": { 2024-06-02T05:06:24.951 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_total_objs": 1, 2024-06-02T05:06:24.951 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_total_kv_pairs": 0, 2024-06-02T05:06:24.951 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_total_updates": 0, 2024-06-02T05:06:24.951 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_total_removes": 0 2024-06-02T05:06:24.951 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:24.951 INFO:teuthology.orchestra.run.smithi192.stdout: "osd-slow-ops": { 2024-06-02T05:06:24.951 INFO:teuthology.orchestra.run.smithi192.stdout: "slow_ops_count": 0 2024-06-02T05:06:24.951 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:24.951 INFO:teuthology.orchestra.run.smithi192.stdout: "purge_queue": { 2024-06-02T05:06:24.951 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_executing_ops": 0, 2024-06-02T05:06:24.951 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_executing_ops_high_water": 0, 2024-06-02T05:06:24.951 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_executing": 0, 2024-06-02T05:06:24.951 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_executing_high_water": 0, 2024-06-02T05:06:24.951 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_executed": 0, 2024-06-02T05:06:24.952 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_item_in_journal": 0 2024-06-02T05:06:24.952 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:24.952 INFO:teuthology.orchestra.run.smithi192.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-06-02T05:06:24.952 INFO:teuthology.orchestra.run.smithi192.stdout: "val": 0, 2024-06-02T05:06:24.952 INFO:teuthology.orchestra.run.smithi192.stdout: "max": 104857600, 2024-06-02T05:06:24.952 INFO:teuthology.orchestra.run.smithi192.stdout: "get_started": 0, 2024-06-02T05:06:24.952 INFO:teuthology.orchestra.run.smithi192.stdout: "get": 39752, 2024-06-02T05:06:24.952 INFO:teuthology.orchestra.run.smithi192.stdout: "get_sum": 9813564, 2024-06-02T05:06:24.952 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_fail": 0, 2024-06-02T05:06:24.952 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_success": 39752, 2024-06-02T05:06:24.952 INFO:teuthology.orchestra.run.smithi192.stdout: "take": 0, 2024-06-02T05:06:24.952 INFO:teuthology.orchestra.run.smithi192.stdout: "take_sum": 0, 2024-06-02T05:06:24.952 INFO:teuthology.orchestra.run.smithi192.stdout: "put": 39752, 2024-06-02T05:06:24.953 INFO:teuthology.orchestra.run.smithi192.stdout: "put_sum": 9813564, 2024-06-02T05:06:24.953 INFO:teuthology.orchestra.run.smithi192.stdout: "wait": { 2024-06-02T05:06:24.953 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-06-02T05:06:24.953 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-06-02T05:06:24.953 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-06-02T05:06:24.953 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-06-02T05:06:24.953 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:24.953 INFO:teuthology.orchestra.run.smithi192.stdout: "throttle-objecter_bytes": { 2024-06-02T05:06:24.953 INFO:teuthology.orchestra.run.smithi192.stdout: "val": 0, 2024-06-02T05:06:24.953 INFO:teuthology.orchestra.run.smithi192.stdout: "max": 104857600, 2024-06-02T05:06:24.953 INFO:teuthology.orchestra.run.smithi192.stdout: "get_started": 0, 2024-06-02T05:06:24.953 INFO:teuthology.orchestra.run.smithi192.stdout: "get": 0, 2024-06-02T05:06:24.953 INFO:teuthology.orchestra.run.smithi192.stdout: "get_sum": 0, 2024-06-02T05:06:24.954 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_fail": 0, 2024-06-02T05:06:24.954 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_success": 0, 2024-06-02T05:06:24.954 INFO:teuthology.orchestra.run.smithi192.stdout: "take": 2822, 2024-06-02T05:06:24.954 INFO:teuthology.orchestra.run.smithi192.stdout: "take_sum": 31405918, 2024-06-02T05:06:24.954 INFO:teuthology.orchestra.run.smithi192.stdout: "put": 2822, 2024-06-02T05:06:24.954 INFO:teuthology.orchestra.run.smithi192.stdout: "put_sum": 31405918, 2024-06-02T05:06:24.954 INFO:teuthology.orchestra.run.smithi192.stdout: "wait": { 2024-06-02T05:06:24.954 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-06-02T05:06:24.955 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-06-02T05:06:24.955 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-06-02T05:06:24.955 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-06-02T05:06:24.955 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:24.955 INFO:teuthology.orchestra.run.smithi192.stdout: "throttle-objecter_ops": { 2024-06-02T05:06:24.955 INFO:teuthology.orchestra.run.smithi192.stdout: "val": 0, 2024-06-02T05:06:24.955 INFO:teuthology.orchestra.run.smithi192.stdout: "max": 1024, 2024-06-02T05:06:24.955 INFO:teuthology.orchestra.run.smithi192.stdout: "get_started": 0, 2024-06-02T05:06:24.955 INFO:teuthology.orchestra.run.smithi192.stdout: "get": 0, 2024-06-02T05:06:24.955 INFO:teuthology.orchestra.run.smithi192.stdout: "get_sum": 0, 2024-06-02T05:06:24.955 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_fail": 0, 2024-06-02T05:06:24.955 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_success": 0, 2024-06-02T05:06:24.955 INFO:teuthology.orchestra.run.smithi192.stdout: "take": 2822, 2024-06-02T05:06:24.956 INFO:teuthology.orchestra.run.smithi192.stdout: "take_sum": 2822, 2024-06-02T05:06:24.956 INFO:teuthology.orchestra.run.smithi192.stdout: "put": 2822, 2024-06-02T05:06:24.956 INFO:teuthology.orchestra.run.smithi192.stdout: "put_sum": 2822, 2024-06-02T05:06:24.956 INFO:teuthology.orchestra.run.smithi192.stdout: "wait": { 2024-06-02T05:06:24.956 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-06-02T05:06:24.956 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-06-02T05:06:24.956 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-06-02T05:06:24.956 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-06-02T05:06:24.956 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:24.957 INFO:teuthology.orchestra.run.smithi192.stdout: "throttle-write_buf_throttle": { 2024-06-02T05:06:24.957 INFO:teuthology.orchestra.run.smithi192.stdout: "val": 0, 2024-06-02T05:06:24.957 INFO:teuthology.orchestra.run.smithi192.stdout: "max": 3758096384, 2024-06-02T05:06:24.957 INFO:teuthology.orchestra.run.smithi192.stdout: "get_started": 0, 2024-06-02T05:06:24.957 INFO:teuthology.orchestra.run.smithi192.stdout: "get": 0, 2024-06-02T05:06:24.957 INFO:teuthology.orchestra.run.smithi192.stdout: "get_sum": 0, 2024-06-02T05:06:24.957 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_fail": 0, 2024-06-02T05:06:24.957 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_success": 0, 2024-06-02T05:06:24.957 INFO:teuthology.orchestra.run.smithi192.stdout: "take": 0, 2024-06-02T05:06:24.957 INFO:teuthology.orchestra.run.smithi192.stdout: "take_sum": 0, 2024-06-02T05:06:24.957 INFO:teuthology.orchestra.run.smithi192.stdout: "put": 0, 2024-06-02T05:06:24.957 INFO:teuthology.orchestra.run.smithi192.stdout: "put_sum": 0, 2024-06-02T05:06:24.957 INFO:teuthology.orchestra.run.smithi192.stdout: "wait": { 2024-06-02T05:06:24.957 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-06-02T05:06:24.958 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-06-02T05:06:24.958 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-06-02T05:06:24.958 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-06-02T05:06:24.958 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:24.958 INFO:teuthology.orchestra.run.smithi192.stdout: "throttle-write_buf_throttle-0x56376d5280a0": { 2024-06-02T05:06:24.958 INFO:teuthology.orchestra.run.smithi192.stdout: "val": 0, 2024-06-02T05:06:24.958 INFO:teuthology.orchestra.run.smithi192.stdout: "max": 3758096384, 2024-06-02T05:06:24.958 INFO:teuthology.orchestra.run.smithi192.stdout: "get_started": 0, 2024-06-02T05:06:24.958 INFO:teuthology.orchestra.run.smithi192.stdout: "get": 24590, 2024-06-02T05:06:24.958 INFO:teuthology.orchestra.run.smithi192.stdout: "get_sum": 31347628, 2024-06-02T05:06:24.958 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_fail": 0, 2024-06-02T05:06:24.958 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_success": 24590, 2024-06-02T05:06:24.958 INFO:teuthology.orchestra.run.smithi192.stdout: "take": 0, 2024-06-02T05:06:24.959 INFO:teuthology.orchestra.run.smithi192.stdout: "take_sum": 0, 2024-06-02T05:06:24.959 INFO:teuthology.orchestra.run.smithi192.stdout: "put": 2277, 2024-06-02T05:06:24.959 INFO:teuthology.orchestra.run.smithi192.stdout: "put_sum": 31347628, 2024-06-02T05:06:24.959 INFO:teuthology.orchestra.run.smithi192.stdout: "wait": { 2024-06-02T05:06:24.959 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-06-02T05:06:24.959 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-06-02T05:06:24.959 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-06-02T05:06:24.959 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-06-02T05:06:24.959 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-06-02T05:06:24.959 INFO:teuthology.orchestra.run.smithi192.stdout:} 2024-06-02T05:06:25.283 INFO:tasks.check_counter:Daemon mds.i mds.exported=5 2024-06-02T05:06:25.283 INFO:tasks.check_counter:Daemon mds.i mds.imported=6 2024-06-02T05:06:25.283 DEBUG:tasks.check_counter:Getting stats from l 2024-06-02T05:06:25.283 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell --fsid 60ab6d30-209a-11ef-bc9b-c7b262605968 -- ceph daemon mds.l perf dump 2024-06-02T05:06:25.519 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/mon.c/config 2024-06-02T05:06:26.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:06:25 smithi192 ceph-mon[47933]: pgmap v773: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.0 KiB/s wr, 9 op/s 2024-06-02T05:06:26.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:06:25 smithi076 ceph-mon[42935]: pgmap v773: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.0 KiB/s wr, 9 op/s 2024-06-02T05:06:26.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:06:25 smithi119 ceph-mon[46633]: pgmap v773: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.0 KiB/s wr, 9 op/s 2024-06-02T05:06:26.443 INFO:teuthology.orchestra.run.smithi192.stdout:{ 2024-06-02T05:06:26.443 INFO:teuthology.orchestra.run.smithi192.stdout: "AsyncMessenger::Worker-0": { 2024-06-02T05:06:26.443 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_messages": 308, 2024-06-02T05:06:26.443 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages": 303, 2024-06-02T05:06:26.443 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_bytes": 499600, 2024-06-02T05:06:26.444 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_bytes": 172848, 2024-06-02T05:06:26.444 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_created_connections": 4, 2024-06-02T05:06:26.444 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_active_connections": 0, 2024-06-02T05:06:26.444 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_total_time": 0.037425391, 2024-06-02T05:06:26.444 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_send_time": 0.013745513, 2024-06-02T05:06:26.444 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_recv_time": 0.015406281, 2024-06-02T05:06:26.444 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_fast_dispatch_time": 0.006103859, 2024-06-02T05:06:26.444 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T05:06:26.444 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 303, 2024-06-02T05:06:26.444 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.014152339, 2024-06-02T05:06:26.444 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000046707 2024-06-02T05:06:26.444 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:26.445 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_handle_ack_lat": { 2024-06-02T05:06:26.445 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-06-02T05:06:26.445 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-06-02T05:06:26.445 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-06-02T05:06:26.445 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:26.445 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_encrypted_bytes": 499600, 2024-06-02T05:06:26.445 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_encrypted_bytes": 172848 2024-06-02T05:06:26.445 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:26.445 INFO:teuthology.orchestra.run.smithi192.stdout: "AsyncMessenger::Worker-1": { 2024-06-02T05:06:26.445 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_messages": 2, 2024-06-02T05:06:26.445 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages": 230, 2024-06-02T05:06:26.445 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_bytes": 320, 2024-06-02T05:06:26.445 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_bytes": 192896, 2024-06-02T05:06:26.446 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_created_connections": 4, 2024-06-02T05:06:26.446 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_active_connections": 2, 2024-06-02T05:06:26.446 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_total_time": 0.010874725, 2024-06-02T05:06:26.446 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_send_time": 0.007925658, 2024-06-02T05:06:26.446 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_recv_time": 0.000967173, 2024-06-02T05:06:26.446 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-06-02T05:06:26.446 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T05:06:26.446 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 228, 2024-06-02T05:06:26.446 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.024842173, 2024-06-02T05:06:26.446 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000108956 2024-06-02T05:06:26.446 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:26.446 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_handle_ack_lat": { 2024-06-02T05:06:26.447 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-06-02T05:06:26.447 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-06-02T05:06:26.447 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-06-02T05:06:26.447 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:26.447 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_encrypted_bytes": 320, 2024-06-02T05:06:26.447 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_encrypted_bytes": 192896 2024-06-02T05:06:26.447 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:26.447 INFO:teuthology.orchestra.run.smithi192.stdout: "AsyncMessenger::Worker-2": { 2024-06-02T05:06:26.447 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_messages": 0, 2024-06-02T05:06:26.447 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages": 2, 2024-06-02T05:06:26.447 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_bytes": 0, 2024-06-02T05:06:26.447 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_bytes": 0, 2024-06-02T05:06:26.447 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_created_connections": 2, 2024-06-02T05:06:26.447 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_active_connections": 1, 2024-06-02T05:06:26.448 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_total_time": 0.000445126, 2024-06-02T05:06:26.448 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_send_time": 0.000000000, 2024-06-02T05:06:26.448 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_recv_time": 0.000380750, 2024-06-02T05:06:26.448 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-06-02T05:06:26.448 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T05:06:26.448 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-06-02T05:06:26.448 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-06-02T05:06:26.448 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-06-02T05:06:26.448 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:26.448 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_handle_ack_lat": { 2024-06-02T05:06:26.448 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-06-02T05:06:26.448 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-06-02T05:06:26.448 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-06-02T05:06:26.448 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:26.449 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_encrypted_bytes": 0, 2024-06-02T05:06:26.449 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_encrypted_bytes": 0 2024-06-02T05:06:26.449 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:26.449 INFO:teuthology.orchestra.run.smithi192.stdout: "cct": { 2024-06-02T05:06:26.449 INFO:teuthology.orchestra.run.smithi192.stdout: "total_workers": 0, 2024-06-02T05:06:26.449 INFO:teuthology.orchestra.run.smithi192.stdout: "unhealthy_workers": 0 2024-06-02T05:06:26.449 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:26.449 INFO:teuthology.orchestra.run.smithi192.stdout: "mempool": { 2024-06-02T05:06:26.449 INFO:teuthology.orchestra.run.smithi192.stdout: "bloom_filter_bytes": 0, 2024-06-02T05:06:26.449 INFO:teuthology.orchestra.run.smithi192.stdout: "bloom_filter_items": 0, 2024-06-02T05:06:26.449 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_alloc_bytes": 0, 2024-06-02T05:06:26.449 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_alloc_items": 0, 2024-06-02T05:06:26.449 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_data_bytes": 0, 2024-06-02T05:06:26.449 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_data_items": 0, 2024-06-02T05:06:26.450 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_onode_bytes": 0, 2024-06-02T05:06:26.450 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_onode_items": 0, 2024-06-02T05:06:26.450 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_meta_bytes": 0, 2024-06-02T05:06:26.450 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_meta_items": 0, 2024-06-02T05:06:26.450 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_other_bytes": 0, 2024-06-02T05:06:26.450 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_other_items": 0, 2024-06-02T05:06:26.450 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_buffer_bytes": 0, 2024-06-02T05:06:26.450 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_buffer_items": 0, 2024-06-02T05:06:26.450 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_extent_bytes": 0, 2024-06-02T05:06:26.450 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_extent_items": 0, 2024-06-02T05:06:26.450 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_blob_bytes": 0, 2024-06-02T05:06:26.450 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_blob_items": 0, 2024-06-02T05:06:26.450 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_shared_blob_bytes": 0, 2024-06-02T05:06:26.451 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_shared_blob_items": 0, 2024-06-02T05:06:26.451 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_inline_bl_bytes": 0, 2024-06-02T05:06:26.451 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_inline_bl_items": 0, 2024-06-02T05:06:26.451 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_fsck_bytes": 0, 2024-06-02T05:06:26.451 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_fsck_items": 0, 2024-06-02T05:06:26.451 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_txc_bytes": 0, 2024-06-02T05:06:26.451 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_txc_items": 0, 2024-06-02T05:06:26.451 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_writing_deferred_bytes": 0, 2024-06-02T05:06:26.451 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_writing_deferred_items": 0, 2024-06-02T05:06:26.451 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_writing_bytes": 0, 2024-06-02T05:06:26.451 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_writing_items": 0, 2024-06-02T05:06:26.451 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_bytes": 0, 2024-06-02T05:06:26.451 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_items": 0, 2024-06-02T05:06:26.451 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_file_reader_bytes": 0, 2024-06-02T05:06:26.452 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_file_reader_items": 0, 2024-06-02T05:06:26.452 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_file_writer_bytes": 0, 2024-06-02T05:06:26.452 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_file_writer_items": 0, 2024-06-02T05:06:26.452 INFO:teuthology.orchestra.run.smithi192.stdout: "buffer_anon_bytes": 148721, 2024-06-02T05:06:26.452 INFO:teuthology.orchestra.run.smithi192.stdout: "buffer_anon_items": 30, 2024-06-02T05:06:26.452 INFO:teuthology.orchestra.run.smithi192.stdout: "buffer_meta_bytes": 0, 2024-06-02T05:06:26.452 INFO:teuthology.orchestra.run.smithi192.stdout: "buffer_meta_items": 0, 2024-06-02T05:06:26.452 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_bytes": 0, 2024-06-02T05:06:26.452 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_items": 0, 2024-06-02T05:06:26.452 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_mapbl_bytes": 0, 2024-06-02T05:06:26.452 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_mapbl_items": 0, 2024-06-02T05:06:26.452 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_pglog_bytes": 0, 2024-06-02T05:06:26.452 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_pglog_items": 0, 2024-06-02T05:06:26.453 INFO:teuthology.orchestra.run.smithi192.stdout: "osdmap_bytes": 0, 2024-06-02T05:06:26.453 INFO:teuthology.orchestra.run.smithi192.stdout: "osdmap_items": 0, 2024-06-02T05:06:26.453 INFO:teuthology.orchestra.run.smithi192.stdout: "osdmap_mapping_bytes": 0, 2024-06-02T05:06:26.453 INFO:teuthology.orchestra.run.smithi192.stdout: "osdmap_mapping_items": 0, 2024-06-02T05:06:26.453 INFO:teuthology.orchestra.run.smithi192.stdout: "pgmap_bytes": 0, 2024-06-02T05:06:26.453 INFO:teuthology.orchestra.run.smithi192.stdout: "pgmap_items": 0, 2024-06-02T05:06:26.453 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_co_bytes": 928, 2024-06-02T05:06:26.453 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_co_items": 2, 2024-06-02T05:06:26.453 INFO:teuthology.orchestra.run.smithi192.stdout: "unittest_1_bytes": 0, 2024-06-02T05:06:26.453 INFO:teuthology.orchestra.run.smithi192.stdout: "unittest_1_items": 0, 2024-06-02T05:06:26.453 INFO:teuthology.orchestra.run.smithi192.stdout: "unittest_2_bytes": 0, 2024-06-02T05:06:26.453 INFO:teuthology.orchestra.run.smithi192.stdout: "unittest_2_items": 0 2024-06-02T05:06:26.453 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-06-02T05:06:26.453 INFO:teuthology.orchestra.run.smithi192.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-06-02T05:06:26.453 INFO:teuthology.orchestra.run.smithi192.stdout: "val": 0, 2024-06-02T05:06:26.454 INFO:teuthology.orchestra.run.smithi192.stdout: "max": 104857600, 2024-06-02T05:06:26.454 INFO:teuthology.orchestra.run.smithi192.stdout: "get_started": 0, 2024-06-02T05:06:26.454 INFO:teuthology.orchestra.run.smithi192.stdout: "get": 306, 2024-06-02T05:06:26.454 INFO:teuthology.orchestra.run.smithi192.stdout: "get_sum": 453705, 2024-06-02T05:06:26.454 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_fail": 0, 2024-06-02T05:06:26.454 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_success": 306, 2024-06-02T05:06:26.454 INFO:teuthology.orchestra.run.smithi192.stdout: "take": 0, 2024-06-02T05:06:26.454 INFO:teuthology.orchestra.run.smithi192.stdout: "take_sum": 0, 2024-06-02T05:06:26.454 INFO:teuthology.orchestra.run.smithi192.stdout: "put": 306, 2024-06-02T05:06:26.454 INFO:teuthology.orchestra.run.smithi192.stdout: "put_sum": 453705, 2024-06-02T05:06:26.454 INFO:teuthology.orchestra.run.smithi192.stdout: "wait": { 2024-06-02T05:06:26.454 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-06-02T05:06:26.454 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-06-02T05:06:26.455 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-06-02T05:06:26.455 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-06-02T05:06:26.455 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-06-02T05:06:26.455 INFO:teuthology.orchestra.run.smithi192.stdout:} 2024-06-02T05:06:26.808 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.l 2024-06-02T05:06:26.808 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.l 2024-06-02T05:06:26.808 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-06-02T05:06:26.819 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-06-02T05:06:26.819 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2024-06-02T05:06:26.819 DEBUG:teuthology.orchestra.run.smithi076:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T05:06:26.854 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2024-06-02T05:06:26.854 DEBUG:teuthology.orchestra.run.smithi076:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T05:06:26.916 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-02T05:06:27.100 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.099+0000 7f65f9013700 1 -- 172.21.15.76:0/1139925940 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f65f40ffd90 msgr2=0x7f65f41001b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:06:27.100 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.099+0000 7f65f9013700 1 --2- 172.21.15.76:0/1139925940 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f65f40ffd90 0x7f65f41001b0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f65dc0099c0 tx=0x7f65dc009cd0 comp rx=0 tx=0).stop 2024-06-02T05:06:27.100 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.099+0000 7f65f9013700 1 -- 172.21.15.76:0/1139925940 shutdown_connections 2024-06-02T05:06:27.101 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.099+0000 7f65f9013700 1 --2- 172.21.15.76:0/1139925940 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f65f4101920 0x7f65f41081d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:27.101 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.099+0000 7f65f9013700 1 --2- 172.21.15.76:0/1139925940 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f65f40ffd90 0x7f65f41001b0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:27.101 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.099+0000 7f65f9013700 1 --2- 172.21.15.76:0/1139925940 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f65f4100f80 0x7f65f41013e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:27.101 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.099+0000 7f65f9013700 1 -- 172.21.15.76:0/1139925940 >> 172.21.15.76:0/1139925940 conn(0x7f65f40fb300 msgr2=0x7f65f40fd740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:06:27.101 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.099+0000 7f65f9013700 1 -- 172.21.15.76:0/1139925940 shutdown_connections 2024-06-02T05:06:27.101 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.099+0000 7f65f9013700 1 -- 172.21.15.76:0/1139925940 wait complete. 2024-06-02T05:06:27.105 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.100+0000 7f65f9013700 1 Processor -- start 2024-06-02T05:06:27.105 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.100+0000 7f65f9013700 1 -- start start 2024-06-02T05:06:27.106 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.100+0000 7f65f9013700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f65f40ffd90 0x7f65f4195b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:06:27.106 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.100+0000 7f65f9013700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f65f4100f80 0x7f65f41960d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:06:27.106 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.100+0000 7f65f9013700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f65f4101920 0x7f65f419d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:06:27.106 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.100+0000 7f65f9013700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65f419d6c0 con 0x7f65f4100f80 2024-06-02T05:06:27.106 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.100+0000 7f65f9013700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65f419d800 con 0x7f65f40ffd90 2024-06-02T05:06:27.106 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.100+0000 7f65f9013700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65f419d990 con 0x7f65f4101920 2024-06-02T05:06:27.106 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.100+0000 7f65f259c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f65f4100f80 0x7f65f41960d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:06:27.107 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.100+0000 7f65f259c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f65f4100f80 0x7f65f41960d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:47054/0 (socket says 172.21.15.76:47054) 2024-06-02T05:06:27.107 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.100+0000 7f65f259c700 1 -- 172.21.15.76:0/1419412554 learned_addr learned my addr 172.21.15.76:0/1419412554 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:06:27.107 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.101+0000 7f65f2d9d700 1 --2- 172.21.15.76:0/1419412554 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f65f40ffd90 0x7f65f4195b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:06:27.107 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.101+0000 7f65f359e700 1 --2- 172.21.15.76:0/1419412554 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f65f4101920 0x7f65f419d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:06:27.107 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.101+0000 7f65f259c700 1 -- 172.21.15.76:0/1419412554 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f65f4101920 msgr2=0x7f65f419d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:06:27.107 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.101+0000 7f65f259c700 1 --2- 172.21.15.76:0/1419412554 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f65f4101920 0x7f65f419d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:27.107 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.101+0000 7f65f259c700 1 -- 172.21.15.76:0/1419412554 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f65f40ffd90 msgr2=0x7f65f4195b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:06:27.107 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.101+0000 7f65f259c700 1 --2- 172.21.15.76:0/1419412554 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f65f40ffd90 0x7f65f4195b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:27.107 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.101+0000 7f65f259c700 1 -- 172.21.15.76:0/1419412554 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65dc0095f0 con 0x7f65f4100f80 2024-06-02T05:06:27.107 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.101+0000 7f65f359e700 1 --2- 172.21.15.76:0/1419412554 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f65f4101920 0x7f65f419d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T05:06:27.107 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.101+0000 7f65f259c700 1 --2- 172.21.15.76:0/1419412554 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f65f4100f80 0x7f65f41960d0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f65e4007b50 tx=0x7f65e4007e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:06:27.107 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.101+0000 7f65ebfff700 1 -- 172.21.15.76:0/1419412554 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e4011070 con 0x7f65f4100f80 2024-06-02T05:06:27.107 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.101+0000 7f65ebfff700 1 -- 172.21.15.76:0/1419412554 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f65e400c2e0 con 0x7f65f4100f80 2024-06-02T05:06:27.108 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.101+0000 7f65f9013700 1 -- 172.21.15.76:0/1419412554 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65f4069490 con 0x7f65f4100f80 2024-06-02T05:06:27.108 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.101+0000 7f65ebfff700 1 -- 172.21.15.76:0/1419412554 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e400a830 con 0x7f65f4100f80 2024-06-02T05:06:27.108 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.101+0000 7f65f9013700 1 -- 172.21.15.76:0/1419412554 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65f40699a0 con 0x7f65f4100f80 2024-06-02T05:06:27.108 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.102+0000 7f65f9013700 1 -- 172.21.15.76:0/1419412554 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65f410bd90 con 0x7f65f4100f80 2024-06-02T05:06:27.108 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.103+0000 7f65ebfff700 1 -- 172.21.15.76:0/1419412554 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f65e400e500 con 0x7f65f4100f80 2024-06-02T05:06:27.108 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.104+0000 7f65ebfff700 1 --2- 172.21.15.76:0/1419412554 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f65e00a1120 0x7f65e00a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:06:27.108 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.104+0000 7f65f2d9d700 1 --2- 172.21.15.76:0/1419412554 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f65e00a1120 0x7f65e00a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:06:27.108 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.104+0000 7f65ebfff700 1 -- 172.21.15.76:0/1419412554 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f65e40ce0c0 con 0x7f65f4100f80 2024-06-02T05:06:27.108 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.104+0000 7f65f2d9d700 1 --2- 172.21.15.76:0/1419412554 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f65e00a1120 0x7f65e00a35e0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f65dc006010 tx=0x7f65dc000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:06:27.108 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.108+0000 7f65ebfff700 1 -- 172.21.15.76:0/1419412554 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f65e40975a0 con 0x7f65f4100f80 2024-06-02T05:06:27.343 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.343+0000 7f65f9013700 1 -- 172.21.15.76:0/1419412554 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f65f410b450 con 0x7f65f4100f80 2024-06-02T05:06:27.345 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.344+0000 7f65ebfff700 1 -- 172.21.15.76:0/1419412554 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+24575 (secure 0 0 0) 0x7f65e400e7b0 con 0x7f65f4100f80 2024-06-02T05:06:27.345 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T05:06:27.345 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":84,"fsid":"60ab6d30-209a-11ef-bc9b-c7b262605968","created":"2024-06-02T04:42:21.007333+0000","modified":"2024-06-02T04:50:08.858987+0000","last_up_change":"2024-06-02T04:47:29.822242+0000","last_in_change":"2024-06-02T04:47:14.253449+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T04:44:56.408602+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-02T04:48:01.194954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-02T04:48:01.828863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-02T04:48:04.916565+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"33a51ba2-be5c-41d0-b5d1-8d6039f2ca4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6802","nonce":2869602045},{"type":"v1","addr":"172.21.15.76:6803","nonce":2869602045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6804","nonce":2869602045},{"type":"v1","addr":"172.21.15.76:6805","nonce":2869602045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6808","nonce":2869602045},{"type":"v1","addr":"172.21.15.76:6809","nonce":2869602045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6806","nonce":2869602045},{"type":"v1","addr":"172.21.15.76:6807","nonce":2869602045}]},"public_addr":"172.21.15.76:6803/2869602045","cluster_addr":"172.21.15.76:6805/2869602045","heartbeat_back_addr":"172.21.15.76:6809/2869602045","heartbeat_front_addr":"172.21.15.76:6807/2869602045","state":["exists","up"]},{"osd":1,"uuid":"ace46e13-3bb7-4103-973a-6860554df8b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":2353738098},{"type":"v1","addr":"172.21.15.119:6801","nonce":2353738098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":2353738098},{"type":"v1","addr":"172.21.15.119:6803","nonce":2353738098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":2353738098},{"type":"v1","addr":"172.21.15.119:6807","nonce":2353738098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":2353738098},{"type":"v1","addr":"172.21.15.119:6805","nonce":2353738098}]},"public_addr":"172.21.15.119:6801/2353738098","cluster_addr":"172.21.15.119:6803/2353738098","heartbeat_back_addr":"172.21.15.119:6807/2353738098","heartbeat_front_addr":"172.21.15.119:6805/2353738098","state":["exists","up"]},{"osd":2,"uuid":"4addc09e-77a9-428a-bcc4-38194f486cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":3206918546},{"type":"v1","addr":"172.21.15.192:6801","nonce":3206918546}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":3206918546},{"type":"v1","addr":"172.21.15.192:6803","nonce":3206918546}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":3206918546},{"type":"v1","addr":"172.21.15.192:6807","nonce":3206918546}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":3206918546},{"type":"v1","addr":"172.21.15.192:6805","nonce":3206918546}]},"public_addr":"172.21.15.192:6801/3206918546","cluster_addr":"172.21.15.192:6803/3206918546","heartbeat_back_addr":"172.21.15.192:6807/3206918546","heartbeat_front_addr":"172.21.15.192:6805/3206918546","state":["exists","up"]},{"osd":3,"uuid":"dc525518-82c6-49ed-8ca8-e3bd5bfc18d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6810","nonce":3747864233},{"type":"v1","addr":"172.21.15.76:6811","nonce":3747864233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6812","nonce":3747864233},{"type":"v1","addr":"172.21.15.76:6813","nonce":3747864233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6816","nonce":3747864233},{"type":"v1","addr":"172.21.15.76:6817","nonce":3747864233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6814","nonce":3747864233},{"type":"v1","addr":"172.21.15.76:6815","nonce":3747864233}]},"public_addr":"172.21.15.76:6811/3747864233","cluster_addr":"172.21.15.76:6813/3747864233","heartbeat_back_addr":"172.21.15.76:6817/3747864233","heartbeat_front_addr":"172.21.15.76:6815/3747864233","state":["exists","up"]},{"osd":4,"uuid":"eef293d0-cb87-47b3-9751-c6437a1cf079","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":2571629047},{"type":"v1","addr":"172.21.15.119:6809","nonce":2571629047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":2571629047},{"type":"v1","addr":"172.21.15.119:6811","nonce":2571629047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":2571629047},{"type":"v1","addr":"172.21.15.119:6815","nonce":2571629047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":2571629047},{"type":"v1","addr":"172.21.15.119:6813","nonce":2571629047}]},"public_addr":"172.21.15.119:6809/2571629047","cluster_addr":"172.21.15.119:6811/2571629047","heartbeat_back_addr":"172.21.15.119:6815/2571629047","heartbeat_front_addr":"172.21.15.119:6813/2571629047","state":["exists","up"]},{"osd":5,"uuid":"60eb8c6e-766c-49d0-9997-44f85776b3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3285065416},{"type":"v1","addr":"172.21.15.192:6809","nonce":3285065416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":3285065416},{"type":"v1","addr":"172.21.15.192:6811","nonce":3285065416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3285065416},{"type":"v1","addr":"172.21.15.192:6815","nonce":3285065416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":3285065416},{"type":"v1","addr":"172.21.15.192:6813","nonce":3285065416}]},"public_addr":"172.21.15.192:6809/3285065416","cluster_addr":"172.21.15.192:6811/3285065416","heartbeat_back_addr":"172.21.15.192:6815/3285065416","heartbeat_front_addr":"172.21.15.192:6813/3285065416","state":["exists","up"]},{"osd":6,"uuid":"e6dc8b9d-dd06-4870-a506-def8201b7e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6818","nonce":2951381580},{"type":"v1","addr":"172.21.15.76:6819","nonce":2951381580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6820","nonce":2951381580},{"type":"v1","addr":"172.21.15.76:6821","nonce":2951381580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6824","nonce":2951381580},{"type":"v1","addr":"172.21.15.76:6825","nonce":2951381580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6822","nonce":2951381580},{"type":"v1","addr":"172.21.15.76:6823","nonce":2951381580}]},"public_addr":"172.21.15.76:6819/2951381580","cluster_addr":"172.21.15.76:6821/2951381580","heartbeat_back_addr":"172.21.15.76:6825/2951381580","heartbeat_front_addr":"172.21.15.76:6823/2951381580","state":["exists","up"]},{"osd":7,"uuid":"2f5dccb3-39a1-4f25-8715-fa264d59db97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1802558756},{"type":"v1","addr":"172.21.15.119:6817","nonce":1802558756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1802558756},{"type":"v1","addr":"172.21.15.119:6819","nonce":1802558756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1802558756},{"type":"v1","addr":"172.21.15.119:6823","nonce":1802558756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1802558756},{"type":"v1","addr":"172.21.15.119:6821","nonce":1802558756}]},"public_addr":"172.21.15.119:6817/1802558756","cluster_addr":"172.21.15.119:6819/1802558756","heartbeat_back_addr":"172.21.15.119:6823/1802558756","heartbeat_front_addr":"172.21.15.119:6821/1802558756","state":["exists","up"]},{"osd":8,"uuid":"39b6ccd0-16e7-4cd5-87e0-d827e9172984","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":1214972276},{"type":"v1","addr":"172.21.15.192:6817","nonce":1214972276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":1214972276},{"type":"v1","addr":"172.21.15.192:6819","nonce":1214972276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":1214972276},{"type":"v1","addr":"172.21.15.192:6823","nonce":1214972276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":1214972276},{"type":"v1","addr":"172.21.15.192:6821","nonce":1214972276}]},"public_addr":"172.21.15.192:6817/1214972276","cluster_addr":"172.21.15.192:6819/1214972276","heartbeat_back_addr":"172.21.15.192:6823/1214972276","heartbeat_front_addr":"172.21.15.192:6821/1214972276","state":["exists","up"]},{"osd":9,"uuid":"851b2155-07bd-45de-bfe0-53021fda733f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6826","nonce":3095501821},{"type":"v1","addr":"172.21.15.76:6827","nonce":3095501821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6828","nonce":3095501821},{"type":"v1","addr":"172.21.15.76:6829","nonce":3095501821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":3095501821},{"type":"v1","addr":"172.21.15.76:6833","nonce":3095501821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6830","nonce":3095501821},{"type":"v1","addr":"172.21.15.76:6831","nonce":3095501821}]},"public_addr":"172.21.15.76:6827/3095501821","cluster_addr":"172.21.15.76:6829/3095501821","heartbeat_back_addr":"172.21.15.76:6833/3095501821","heartbeat_front_addr":"172.21.15.76:6831/3095501821","state":["exists","up"]},{"osd":10,"uuid":"e4b18e7e-bddf-4dd4-84f6-7902ea327cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":4082130894},{"type":"v1","addr":"172.21.15.119:6825","nonce":4082130894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":4082130894},{"type":"v1","addr":"172.21.15.119:6827","nonce":4082130894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":4082130894},{"type":"v1","addr":"172.21.15.119:6831","nonce":4082130894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":4082130894},{"type":"v1","addr":"172.21.15.119:6829","nonce":4082130894}]},"public_addr":"172.21.15.119:6825/4082130894","cluster_addr":"172.21.15.119:6827/4082130894","heartbeat_back_addr":"172.21.15.119:6831/4082130894","heartbeat_front_addr":"172.21.15.119:6829/4082130894","state":["exists","up"]},{"osd":11,"uuid":"54567e18-920c-4ae9-9557-0efba5a1a820","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":439693921},{"type":"v1","addr":"172.21.15.192:6825","nonce":439693921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":439693921},{"type":"v1","addr":"172.21.15.192:6827","nonce":439693921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":439693921},{"type":"v1","addr":"172.21.15.192:6831","nonce":439693921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":439693921},{"type":"v1","addr":"172.21.15.192:6829","nonce":439693921}]},"public_addr":"172.21.15.192:6825/439693921","cluster_addr":"172.21.15.192:6827/439693921","heartbeat_back_addr":"172.21.15.192:6831/439693921","heartbeat_front_addr":"172.21.15.192:6829/439693921","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:44:19.922390+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:44:36.895563+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:44:53.699019+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:45:11.167404+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:45:27.955899+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:45:44.850368+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:46:02.003588+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:46:19.019217+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:46:36.189670+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:46:53.919365+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:47:11.563053+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:47:28.822443+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":4}]},{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4},{"from":8,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.8","mappings":[{"from":5,"to":10}]},{"pgid":"4.14","mappings":[{"from":9,"to":8}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.76:6801/4200406736":"2024-06-03T04:43:06.092916+0000","172.21.15.76:6800/4200406736":"2024-06-03T04:43:06.092916+0000","172.21.15.76:0/1524144593":"2024-06-03T04:43:06.092916+0000","172.21.15.76:0/3269372590":"2024-06-03T04:43:06.092916+0000","172.21.15.76:0/3570893846":"2024-06-03T04:42:44.872236+0000","172.21.15.76:0/902035790":"2024-06-03T04:43:06.092916+0000","172.21.15.76:6800/2550846765":"2024-06-03T04:42:44.872236+0000","172.21.15.76:6801/2550846765":"2024-06-03T04:42:44.872236+0000","172.21.15.76:0/2646712763":"2024-06-03T04:42:44.872236+0000","172.21.15.76:0/964578813":"2024-06-03T04:42:44.872236+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T05:06:27.349 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.348+0000 7f65f9013700 1 -- 172.21.15.76:0/1419412554 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f65e00a1120 msgr2=0x7f65e00a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:06:27.349 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.348+0000 7f65f9013700 1 --2- 172.21.15.76:0/1419412554 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f65e00a1120 0x7f65e00a35e0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f65dc006010 tx=0x7f65dc000bc0 comp rx=0 tx=0).stop 2024-06-02T05:06:27.349 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.348+0000 7f65f9013700 1 -- 172.21.15.76:0/1419412554 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f65f4100f80 msgr2=0x7f65f41960d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:06:27.349 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.348+0000 7f65f9013700 1 --2- 172.21.15.76:0/1419412554 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f65f4100f80 0x7f65f41960d0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f65e4007b50 tx=0x7f65e4007e60 comp rx=0 tx=0).stop 2024-06-02T05:06:27.349 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.348+0000 7f65f9013700 1 -- 172.21.15.76:0/1419412554 shutdown_connections 2024-06-02T05:06:27.349 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.348+0000 7f65f9013700 1 --2- 172.21.15.76:0/1419412554 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f65f4101920 0x7f65f419d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:27.349 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.348+0000 7f65f9013700 1 --2- 172.21.15.76:0/1419412554 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f65e00a1120 0x7f65e00a35e0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:27.350 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.348+0000 7f65f9013700 1 --2- 172.21.15.76:0/1419412554 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f65f40ffd90 0x7f65f4195b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:27.350 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.348+0000 7f65f9013700 1 --2- 172.21.15.76:0/1419412554 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f65f4100f80 0x7f65f41960d0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:27.350 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.348+0000 7f65f9013700 1 -- 172.21.15.76:0/1419412554 >> 172.21.15.76:0/1419412554 conn(0x7f65f40fb300 msgr2=0x7f65f4104350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:06:27.350 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.348+0000 7f65f9013700 1 -- 172.21.15.76:0/1419412554 shutdown_connections 2024-06-02T05:06:27.350 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.348+0000 7f65f9013700 1 -- 172.21.15.76:0/1419412554 wait complete. 2024-06-02T05:06:27.364 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-06-02T04:44:56.408602+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-06-02T04:48:01.194954+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-06-02T04:48:01.828863+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '76', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-06-02T04:48:04.916565+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-06-02T05:06:27.365 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-06-02T05:06:27.500 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.497+0000 7fa952883700 1 -- 172.21.15.76:0/3171627972 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa94c101170 msgr2=0x7fa94c107a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:06:27.500 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.497+0000 7fa952883700 1 --2- 172.21.15.76:0/3171627972 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa94c101170 0x7fa94c107a20 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fa94400c240 tx=0x7fa94400c550 comp rx=0 tx=0).stop 2024-06-02T05:06:27.500 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.497+0000 7fa952883700 1 -- 172.21.15.76:0/3171627972 shutdown_connections 2024-06-02T05:06:27.500 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.497+0000 7fa952883700 1 --2- 172.21.15.76:0/3171627972 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa94c101170 0x7fa94c107a20 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:27.500 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.497+0000 7fa952883700 1 --2- 172.21.15.76:0/3171627972 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa94c0ff5e0 0x7fa94c0ffa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:27.500 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.497+0000 7fa952883700 1 --2- 172.21.15.76:0/3171627972 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa94c1007d0 0x7fa94c100c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:27.500 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.497+0000 7fa952883700 1 -- 172.21.15.76:0/3171627972 >> 172.21.15.76:0/3171627972 conn(0x7fa94c0fab50 msgr2=0x7fa94c0fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:06:27.500 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.497+0000 7fa952883700 1 -- 172.21.15.76:0/3171627972 shutdown_connections 2024-06-02T05:06:27.500 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.497+0000 7fa952883700 1 -- 172.21.15.76:0/3171627972 wait complete. 2024-06-02T05:06:27.500 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.497+0000 7fa952883700 1 Processor -- start 2024-06-02T05:06:27.500 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.498+0000 7fa952883700 1 -- start start 2024-06-02T05:06:27.501 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.498+0000 7fa952883700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa94c0ff5e0 0x7fa94c199160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:06:27.501 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.498+0000 7fa952883700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa94c1007d0 0x7fa94c1996a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:06:27.501 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.498+0000 7fa952883700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa94c101170 0x7fa94c1a06c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:06:27.501 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.498+0000 7fa952883700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa94c1a0c90 con 0x7fa94c101170 2024-06-02T05:06:27.501 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.498+0000 7fa952883700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa94c1a0dd0 con 0x7fa94c1007d0 2024-06-02T05:06:27.501 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.498+0000 7fa952883700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa94c1a0f60 con 0x7fa94c0ff5e0 2024-06-02T05:06:27.501 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.498+0000 7fa94bfff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa94c0ff5e0 0x7fa94c199160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:06:27.501 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.498+0000 7fa94b7fe700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa94c1007d0 0x7fa94c1996a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:06:27.501 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.498+0000 7fa94bfff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa94c0ff5e0 0x7fa94c199160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.76:42390/0 (socket says 172.21.15.76:42390) 2024-06-02T05:06:27.501 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.498+0000 7fa94b7fe700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa94c1007d0 0x7fa94c1996a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.76:45758/0 (socket says 172.21.15.76:45758) 2024-06-02T05:06:27.501 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.498+0000 7fa94bfff700 1 -- 172.21.15.76:0/2859932807 learned_addr learned my addr 172.21.15.76:0/2859932807 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:06:27.501 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.498+0000 7fa950e20700 1 --2- 172.21.15.76:0/2859932807 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa94c101170 0x7fa94c1a06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:06:27.501 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.498+0000 7fa94b7fe700 1 -- 172.21.15.76:0/2859932807 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa94c0ff5e0 msgr2=0x7fa94c199160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:06:27.502 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.498+0000 7fa94b7fe700 1 --2- 172.21.15.76:0/2859932807 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa94c0ff5e0 0x7fa94c199160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:27.502 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.498+0000 7fa94b7fe700 1 -- 172.21.15.76:0/2859932807 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa94c101170 msgr2=0x7fa94c1a06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:06:27.502 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.498+0000 7fa94b7fe700 1 --2- 172.21.15.76:0/2859932807 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa94c101170 0x7fa94c1a06c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:27.502 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.498+0000 7fa94b7fe700 1 -- 172.21.15.76:0/2859932807 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa94400ae10 con 0x7fa94c1007d0 2024-06-02T05:06:27.502 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.499+0000 7fa94b7fe700 1 --2- 172.21.15.76:0/2859932807 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa94c1007d0 0x7fa94c1996a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fa94000e9f0 tx=0x7fa94000ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:06:27.502 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.499+0000 7fa9497fa700 1 -- 172.21.15.76:0/2859932807 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa94000c9c0 con 0x7fa94c1007d0 2024-06-02T05:06:27.502 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.499+0000 7fa9497fa700 1 -- 172.21.15.76:0/2859932807 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa940010430 con 0x7fa94c1007d0 2024-06-02T05:06:27.502 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.499+0000 7fa9497fa700 1 -- 172.21.15.76:0/2859932807 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa940018680 con 0x7fa94c1007d0 2024-06-02T05:06:27.502 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.499+0000 7fa952883700 1 -- 172.21.15.76:0/2859932807 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa94c1a1240 con 0x7fa94c1007d0 2024-06-02T05:06:27.502 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.499+0000 7fa952883700 1 -- 172.21.15.76:0/2859932807 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa94c1a1700 con 0x7fa94c1007d0 2024-06-02T05:06:27.503 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.500+0000 7fa952883700 1 -- 172.21.15.76:0/2859932807 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa94c067460 con 0x7fa94c1007d0 2024-06-02T05:06:27.503 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.501+0000 7fa9497fa700 1 -- 172.21.15.76:0/2859932807 <== mon.2 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fa9400105a0 con 0x7fa94c1007d0 2024-06-02T05:06:27.503 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.502+0000 7fa9497fa700 1 --2- 172.21.15.76:0/2859932807 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fa9340a11a0 0x7fa9340a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:06:27.503 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.502+0000 7fa94bfff700 1 --2- 172.21.15.76:0/2859932807 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fa9340a11a0 0x7fa9340a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:06:27.504 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.502+0000 7fa9497fa700 1 -- 172.21.15.76:0/2859932807 <== mon.2 v2:172.21.15.119:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7fa940014070 con 0x7fa94c1007d0 2024-06-02T05:06:27.504 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.502+0000 7fa94bfff700 1 --2- 172.21.15.76:0/2859932807 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fa9340a11a0 0x7fa9340a3660 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fa93c005950 tx=0x7fa93c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:06:27.507 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.506+0000 7fa9497fa700 1 -- 172.21.15.76:0/2859932807 <== mon.2 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fa940052d60 con 0x7fa94c1007d0 2024-06-02T05:06:27.715 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.714+0000 7fa952883700 1 -- 172.21.15.76:0/2859932807 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa94c1a1920 con 0x7fa94c1007d0 2024-06-02T05:06:27.715 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.715+0000 7fa9497fa700 1 -- 172.21.15.76:0/2859932807 <== mon.2 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v84) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa940096100 con 0x7fa94c1007d0 2024-06-02T05:06:27.716 INFO:teuthology.orchestra.run.smithi076.stdout:pg_num: 1 2024-06-02T05:06:27.718 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.717+0000 7fa952883700 1 -- 172.21.15.76:0/2859932807 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fa9340a11a0 msgr2=0x7fa9340a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:06:27.718 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.717+0000 7fa952883700 1 --2- 172.21.15.76:0/2859932807 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fa9340a11a0 0x7fa9340a3660 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fa93c005950 tx=0x7fa93c009260 comp rx=0 tx=0).stop 2024-06-02T05:06:27.718 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.717+0000 7fa952883700 1 -- 172.21.15.76:0/2859932807 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa94c1007d0 msgr2=0x7fa94c1996a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:06:27.718 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.717+0000 7fa952883700 1 --2- 172.21.15.76:0/2859932807 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa94c1007d0 0x7fa94c1996a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fa94000e9f0 tx=0x7fa94000ed00 comp rx=0 tx=0).stop 2024-06-02T05:06:27.718 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.717+0000 7fa952883700 1 -- 172.21.15.76:0/2859932807 shutdown_connections 2024-06-02T05:06:27.718 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.717+0000 7fa952883700 1 --2- 172.21.15.76:0/2859932807 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa94c101170 0x7fa94c1a06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:27.718 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.717+0000 7fa952883700 1 --2- 172.21.15.76:0/2859932807 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa94c0ff5e0 0x7fa94c199160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:27.719 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.717+0000 7fa952883700 1 --2- 172.21.15.76:0/2859932807 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fa9340a11a0 0x7fa9340a3660 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:27.719 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.717+0000 7fa952883700 1 --2- 172.21.15.76:0/2859932807 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa94c1007d0 0x7fa94c1996a0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:27.719 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.717+0000 7fa952883700 1 -- 172.21.15.76:0/2859932807 >> 172.21.15.76:0/2859932807 conn(0x7fa94c0fab50 msgr2=0x7fa94c1085c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:06:27.719 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.717+0000 7fa952883700 1 -- 172.21.15.76:0/2859932807 shutdown_connections 2024-06-02T05:06:27.719 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.717+0000 7fa952883700 1 -- 172.21.15.76:0/2859932807 wait complete. 2024-06-02T05:06:27.731 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-06-02T05:06:27.857 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.856+0000 7f4f18db7700 1 -- 172.21.15.76:0/395634558 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4f14102b90 msgr2=0x7f4f14109440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:06:27.857 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.856+0000 7f4f18db7700 1 --2- 172.21.15.76:0/395634558 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4f14102b90 0x7f4f14109440 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c00b0a0 tx=0x7f4f0c00b3b0 comp rx=0 tx=0).stop 2024-06-02T05:06:27.857 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.856+0000 7f4f18db7700 1 -- 172.21.15.76:0/395634558 shutdown_connections 2024-06-02T05:06:27.857 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.856+0000 7f4f18db7700 1 --2- 172.21.15.76:0/395634558 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4f14102b90 0x7f4f14109440 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:27.857 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.856+0000 7f4f18db7700 1 --2- 172.21.15.76:0/395634558 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4f140ff220 0x7f4f140ff640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:27.857 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.856+0000 7f4f18db7700 1 --2- 172.21.15.76:0/395634558 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4f141021f0 0x7f4f14102650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:27.858 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.856+0000 7f4f18db7700 1 -- 172.21.15.76:0/395634558 >> 172.21.15.76:0/395634558 conn(0x7f4f140fab50 msgr2=0x7f4f140fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:06:27.858 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.856+0000 7f4f18db7700 1 -- 172.21.15.76:0/395634558 shutdown_connections 2024-06-02T05:06:27.858 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.856+0000 7f4f18db7700 1 -- 172.21.15.76:0/395634558 wait complete. 2024-06-02T05:06:27.860 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.857+0000 7f4f18db7700 1 Processor -- start 2024-06-02T05:06:27.860 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.857+0000 7f4f18db7700 1 -- start start 2024-06-02T05:06:27.860 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.857+0000 7f4f18db7700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4f140ff220 0x7f4f14199110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:06:27.861 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.857+0000 7f4f18db7700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4f141021f0 0x7f4f14199650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:06:27.861 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.857+0000 7f4f18db7700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4f14102b90 0x7f4f141a0670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:06:27.861 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.857+0000 7f4f18db7700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f141a0c40 con 0x7f4f14102b90 2024-06-02T05:06:27.861 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.857+0000 7f4f18db7700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f141a0d80 con 0x7f4f140ff220 2024-06-02T05:06:27.861 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.857+0000 7f4f18db7700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f141a0f10 con 0x7f4f141021f0 2024-06-02T05:06:27.861 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.857+0000 7f4f12d9d700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4f14102b90 0x7f4f141a0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:06:27.861 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.857+0000 7f4f12d9d700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4f14102b90 0x7f4f141a0670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:47074/0 (socket says 172.21.15.76:47074) 2024-06-02T05:06:27.861 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.857+0000 7f4f12d9d700 1 -- 172.21.15.76:0/1961670995 learned_addr learned my addr 172.21.15.76:0/1961670995 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:06:27.861 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.857+0000 7f4f11d9b700 1 --2- 172.21.15.76:0/1961670995 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4f141021f0 0x7f4f14199650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:06:27.861 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.857+0000 7f4f1259c700 1 --2- 172.21.15.76:0/1961670995 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4f140ff220 0x7f4f14199110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:06:27.861 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.857+0000 7f4f12d9d700 1 -- 172.21.15.76:0/1961670995 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4f141021f0 msgr2=0x7f4f14199650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:06:27.861 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.857+0000 7f4f12d9d700 1 --2- 172.21.15.76:0/1961670995 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4f141021f0 0x7f4f14199650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:27.861 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.857+0000 7f4f12d9d700 1 -- 172.21.15.76:0/1961670995 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4f140ff220 msgr2=0x7f4f14199110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:06:27.862 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.857+0000 7f4f12d9d700 1 --2- 172.21.15.76:0/1961670995 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4f140ff220 0x7f4f14199110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:27.862 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.857+0000 7f4f12d9d700 1 -- 172.21.15.76:0/1961670995 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f0c009d00 con 0x7f4f14102b90 2024-06-02T05:06:27.862 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.857+0000 7f4f11d9b700 1 --2- 172.21.15.76:0/1961670995 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4f141021f0 0x7f4f14199650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T05:06:27.862 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.858+0000 7f4f12d9d700 1 --2- 172.21.15.76:0/1961670995 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4f14102b90 0x7f4f141a0670 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c007870 tx=0x7f4f0c0078a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:06:27.862 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.858+0000 7f4f037fe700 1 -- 172.21.15.76:0/1961670995 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f0c00e040 con 0x7f4f14102b90 2024-06-02T05:06:27.862 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.858+0000 7f4f037fe700 1 -- 172.21.15.76:0/1961670995 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4f0c00be70 con 0x7f4f14102b90 2024-06-02T05:06:27.862 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.858+0000 7f4f18db7700 1 -- 172.21.15.76:0/1961670995 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f141a1190 con 0x7f4f14102b90 2024-06-02T05:06:27.862 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.858+0000 7f4f037fe700 1 -- 172.21.15.76:0/1961670995 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f0c005040 con 0x7f4f14102b90 2024-06-02T05:06:27.862 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.858+0000 7f4f18db7700 1 -- 172.21.15.76:0/1961670995 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f141a1610 con 0x7f4f14102b90 2024-06-02T05:06:27.862 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.859+0000 7f4f18db7700 1 -- 172.21.15.76:0/1961670995 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f14067460 con 0x7f4f14102b90 2024-06-02T05:06:27.863 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.860+0000 7f4f037fe700 1 -- 172.21.15.76:0/1961670995 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f4f0c01d470 con 0x7f4f14102b90 2024-06-02T05:06:27.863 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.860+0000 7f4f037fe700 1 --2- 172.21.15.76:0/1961670995 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f4efc0a1120 0x7f4efc0a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:06:27.863 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.860+0000 7f4f1259c700 1 --2- 172.21.15.76:0/1961670995 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f4efc0a1120 0x7f4efc0a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:06:27.863 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.860+0000 7f4f037fe700 1 -- 172.21.15.76:0/1961670995 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f4f0c0ce870 con 0x7f4f14102b90 2024-06-02T05:06:27.864 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.861+0000 7f4f1259c700 1 --2- 172.21.15.76:0/1961670995 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f4efc0a1120 0x7f4efc0a35e0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f4f14067df0 tx=0x7f4f04009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:06:27.864 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:27.864+0000 7f4f037fe700 1 -- 172.21.15.76:0/1961670995 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f4f0c097d50 con 0x7f4f14102b90 2024-06-02T05:06:27.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:06:27 smithi076 ceph-mon[42935]: pgmap v774: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 2.4 KiB/s wr, 7 op/s 2024-06-02T05:06:27.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:06:27 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T05:06:27.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:06:27 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/1419412554' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T05:06:27.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:06:27 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T05:06:27.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:06:27 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T05:06:27.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:06:27 smithi076 ceph-mon[42935]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T05:06:27.984 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:06:27 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/2859932807' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-02T05:06:28.066 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.065+0000 7f4f18db7700 1 -- 172.21.15.76:0/1961670995 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4f1410c750 con 0x7f4f14102b90 2024-06-02T05:06:28.067 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.066+0000 7f4f037fe700 1 -- 172.21.15.76:0/1961670995 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v84) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4f0c09b370 con 0x7f4f14102b90 2024-06-02T05:06:28.067 INFO:teuthology.orchestra.run.smithi076.stdout:pg_num: 32 2024-06-02T05:06:28.069 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.068+0000 7f4f18db7700 1 -- 172.21.15.76:0/1961670995 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f4efc0a1120 msgr2=0x7f4efc0a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:06:28.069 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.068+0000 7f4f18db7700 1 --2- 172.21.15.76:0/1961670995 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f4efc0a1120 0x7f4efc0a35e0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f4f14067df0 tx=0x7f4f04009260 comp rx=0 tx=0).stop 2024-06-02T05:06:28.069 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.068+0000 7f4f18db7700 1 -- 172.21.15.76:0/1961670995 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4f14102b90 msgr2=0x7f4f141a0670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:06:28.069 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.068+0000 7f4f18db7700 1 --2- 172.21.15.76:0/1961670995 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4f14102b90 0x7f4f141a0670 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c007870 tx=0x7f4f0c0078a0 comp rx=0 tx=0).stop 2024-06-02T05:06:28.069 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.068+0000 7f4f18db7700 1 -- 172.21.15.76:0/1961670995 shutdown_connections 2024-06-02T05:06:28.069 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.068+0000 7f4f18db7700 1 --2- 172.21.15.76:0/1961670995 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4f14102b90 0x7f4f141a0670 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:28.069 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.068+0000 7f4f18db7700 1 --2- 172.21.15.76:0/1961670995 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f4efc0a1120 0x7f4efc0a35e0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:28.070 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.068+0000 7f4f18db7700 1 --2- 172.21.15.76:0/1961670995 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4f140ff220 0x7f4f14199110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:28.070 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.068+0000 7f4f18db7700 1 --2- 172.21.15.76:0/1961670995 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4f141021f0 0x7f4f14199650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:28.070 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.068+0000 7f4f18db7700 1 -- 172.21.15.76:0/1961670995 >> 172.21.15.76:0/1961670995 conn(0x7f4f140fab50 msgr2=0x7f4f14107a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:06:28.070 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.068+0000 7f4f18db7700 1 -- 172.21.15.76:0/1961670995 shutdown_connections 2024-06-02T05:06:28.070 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.068+0000 7f4f18db7700 1 -- 172.21.15.76:0/1961670995 wait complete. 2024-06-02T05:06:28.082 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-06-02T05:06:28.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:06:27 smithi192 ceph-mon[47933]: pgmap v774: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 2.4 KiB/s wr, 7 op/s 2024-06-02T05:06:28.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:06:27 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T05:06:28.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:06:27 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/1419412554' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T05:06:28.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:06:27 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T05:06:28.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:06:27 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T05:06:28.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:06:27 smithi192 ceph-mon[47933]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T05:06:28.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:06:27 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/2859932807' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-02T05:06:28.208 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.207+0000 7f53f1ca6700 1 -- 172.21.15.76:0/1988020409 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f53ec101970 msgr2=0x7f53ec108290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:06:28.208 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.207+0000 7f53f1ca6700 1 --2- 172.21.15.76:0/1988020409 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f53ec101970 0x7f53ec108290 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f53e400b0a0 tx=0x7f53e400b3b0 comp rx=0 tx=0).stop 2024-06-02T05:06:28.208 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.207+0000 7f53f1ca6700 1 -- 172.21.15.76:0/1988020409 shutdown_connections 2024-06-02T05:06:28.208 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.207+0000 7f53f1ca6700 1 --2- 172.21.15.76:0/1988020409 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f53ec101970 0x7f53ec108290 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:28.208 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.207+0000 7f53f1ca6700 1 --2- 172.21.15.76:0/1988020409 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f53ec0ffe60 0x7f53ec100280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:28.208 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.207+0000 7f53f1ca6700 1 --2- 172.21.15.76:0/1988020409 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f53ec100fb0 0x7f53ec101430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:28.208 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.207+0000 7f53f1ca6700 1 -- 172.21.15.76:0/1988020409 >> 172.21.15.76:0/1988020409 conn(0x7f53ec0fb3f0 msgr2=0x7f53ec0fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:06:28.209 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.207+0000 7f53f1ca6700 1 -- 172.21.15.76:0/1988020409 shutdown_connections 2024-06-02T05:06:28.209 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.207+0000 7f53f1ca6700 1 -- 172.21.15.76:0/1988020409 wait complete. 2024-06-02T05:06:28.209 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.207+0000 7f53f1ca6700 1 Processor -- start 2024-06-02T05:06:28.209 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.207+0000 7f53f1ca6700 1 -- start start 2024-06-02T05:06:28.211 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.208+0000 7f53f1ca6700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f53ec0ffe60 0x7f53ec196f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:06:28.211 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.208+0000 7f53f1ca6700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f53ec100fb0 0x7f53ec197460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:06:28.211 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.208+0000 7f53f1ca6700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f53ec101970 0x7f53ec19e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:06:28.211 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.208+0000 7f53f1ca6700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53ec19ea50 con 0x7f53ec101970 2024-06-02T05:06:28.211 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.208+0000 7f53f1ca6700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53ec19eb90 con 0x7f53ec100fb0 2024-06-02T05:06:28.211 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.208+0000 7f53f1ca6700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53ec19ed20 con 0x7f53ec0ffe60 2024-06-02T05:06:28.211 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.208+0000 7f53ebfff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f53ec101970 0x7f53ec19e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:06:28.211 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.208+0000 7f53ebfff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f53ec101970 0x7f53ec19e480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:47082/0 (socket says 172.21.15.76:47082) 2024-06-02T05:06:28.211 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.208+0000 7f53ebfff700 1 -- 172.21.15.76:0/727281642 learned_addr learned my addr 172.21.15.76:0/727281642 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:06:28.211 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.208+0000 7f53eb7fe700 1 --2- 172.21.15.76:0/727281642 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f53ec0ffe60 0x7f53ec196f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:06:28.212 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.208+0000 7f53eaffd700 1 --2- 172.21.15.76:0/727281642 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f53ec100fb0 0x7f53ec197460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:06:28.212 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.208+0000 7f53ebfff700 1 -- 172.21.15.76:0/727281642 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f53ec0ffe60 msgr2=0x7f53ec196f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:06:28.212 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.208+0000 7f53ebfff700 1 --2- 172.21.15.76:0/727281642 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f53ec0ffe60 0x7f53ec196f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:28.212 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.208+0000 7f53ebfff700 1 -- 172.21.15.76:0/727281642 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f53ec100fb0 msgr2=0x7f53ec197460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:06:28.212 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.208+0000 7f53ebfff700 1 --2- 172.21.15.76:0/727281642 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f53ec100fb0 0x7f53ec197460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:28.212 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.208+0000 7f53ebfff700 1 -- 172.21.15.76:0/727281642 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53e4009d00 con 0x7f53ec101970 2024-06-02T05:06:28.212 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.208+0000 7f53ebfff700 1 --2- 172.21.15.76:0/727281642 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f53ec101970 0x7f53ec19e480 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f53e4004ce0 tx=0x7f53e4004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:06:28.212 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.208+0000 7f53e8ff9700 1 -- 172.21.15.76:0/727281642 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53e400e040 con 0x7f53ec101970 2024-06-02T05:06:28.212 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.208+0000 7f53e8ff9700 1 -- 172.21.15.76:0/727281642 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f53e400ce60 con 0x7f53ec101970 2024-06-02T05:06:28.212 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.208+0000 7f53f1ca6700 1 -- 172.21.15.76:0/727281642 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53ec19efa0 con 0x7f53ec101970 2024-06-02T05:06:28.212 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.208+0000 7f53e8ff9700 1 -- 172.21.15.76:0/727281642 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53e401bae0 con 0x7f53ec101970 2024-06-02T05:06:28.213 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.208+0000 7f53f1ca6700 1 -- 172.21.15.76:0/727281642 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53ec19f3c0 con 0x7f53ec101970 2024-06-02T05:06:28.213 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.209+0000 7f53f1ca6700 1 -- 172.21.15.76:0/727281642 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53ec1072a0 con 0x7f53ec101970 2024-06-02T05:06:28.214 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.210+0000 7f53e8ff9700 1 -- 172.21.15.76:0/727281642 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f53e401bc40 con 0x7f53ec101970 2024-06-02T05:06:28.214 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.211+0000 7f53e8ff9700 1 --2- 172.21.15.76:0/727281642 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f53d40a1120 0x7f53d40a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:06:28.214 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.211+0000 7f53eb7fe700 1 --2- 172.21.15.76:0/727281642 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f53d40a1120 0x7f53d40a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:06:28.214 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.211+0000 7f53e8ff9700 1 -- 172.21.15.76:0/727281642 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f53e40cf230 con 0x7f53ec101970 2024-06-02T05:06:28.214 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.211+0000 7f53eb7fe700 1 --2- 172.21.15.76:0/727281642 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f53d40a1120 0x7f53d40a35e0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f53dc005950 tx=0x7f53dc00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:06:28.215 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.215+0000 7f53e8ff9700 1 -- 172.21.15.76:0/727281642 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f53e4098710 con 0x7f53ec101970 2024-06-02T05:06:28.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:06:27 smithi119 ceph-mon[46633]: pgmap v774: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 2.4 KiB/s wr, 7 op/s 2024-06-02T05:06:28.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:06:27 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T05:06:28.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:06:27 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/1419412554' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T05:06:28.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:06:27 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T05:06:28.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:06:27 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T05:06:28.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:06:27 smithi119 ceph-mon[46633]: from='mgr.14152 172.21.15.76:0/3623191491' entity='mgr.x' 2024-06-02T05:06:28.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:06:27 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/2859932807' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-02T05:06:28.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.411+0000 7f53f1ca6700 1 -- 172.21.15.76:0/727281642 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f53ec10c7b0 con 0x7f53ec101970 2024-06-02T05:06:28.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.411+0000 7f53e8ff9700 1 -- 172.21.15.76:0/727281642 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v84) v1 ==== 100+0+11 (secure 0 0 0) 0x7f53e409bd30 con 0x7f53ec101970 2024-06-02T05:06:28.412 INFO:teuthology.orchestra.run.smithi076.stdout:pg_num: 64 2024-06-02T05:06:28.414 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.413+0000 7f53f1ca6700 1 -- 172.21.15.76:0/727281642 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f53d40a1120 msgr2=0x7f53d40a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:06:28.414 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.413+0000 7f53f1ca6700 1 --2- 172.21.15.76:0/727281642 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f53d40a1120 0x7f53d40a35e0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f53dc005950 tx=0x7f53dc00b410 comp rx=0 tx=0).stop 2024-06-02T05:06:28.414 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.413+0000 7f53f1ca6700 1 -- 172.21.15.76:0/727281642 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f53ec101970 msgr2=0x7f53ec19e480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:06:28.414 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.413+0000 7f53f1ca6700 1 --2- 172.21.15.76:0/727281642 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f53ec101970 0x7f53ec19e480 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f53e4004ce0 tx=0x7f53e4004d10 comp rx=0 tx=0).stop 2024-06-02T05:06:28.414 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.413+0000 7f53f1ca6700 1 -- 172.21.15.76:0/727281642 shutdown_connections 2024-06-02T05:06:28.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.413+0000 7f53f1ca6700 1 --2- 172.21.15.76:0/727281642 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f53ec101970 0x7f53ec19e480 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:28.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.413+0000 7f53f1ca6700 1 --2- 172.21.15.76:0/727281642 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f53ec0ffe60 0x7f53ec196f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:28.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.413+0000 7f53f1ca6700 1 --2- 172.21.15.76:0/727281642 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f53d40a1120 0x7f53d40a35e0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:28.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.413+0000 7f53f1ca6700 1 --2- 172.21.15.76:0/727281642 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f53ec100fb0 0x7f53ec197460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:28.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.413+0000 7f53f1ca6700 1 -- 172.21.15.76:0/727281642 >> 172.21.15.76:0/727281642 conn(0x7f53ec0fb3f0 msgr2=0x7f53ec1043e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:06:28.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.413+0000 7f53f1ca6700 1 -- 172.21.15.76:0/727281642 shutdown_connections 2024-06-02T05:06:28.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.413+0000 7f53f1ca6700 1 -- 172.21.15.76:0/727281642 wait complete. 2024-06-02T05:06:28.427 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-06-02T05:06:28.555 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.552+0000 7f8b4f269700 1 -- 172.21.15.76:0/2906408947 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8b48102ab0 msgr2=0x7f8b481093d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:06:28.556 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.552+0000 7f8b4f269700 1 --2- 172.21.15.76:0/2906408947 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8b48102ab0 0x7f8b481093d0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f8b4000b0a0 tx=0x7f8b4000b3b0 comp rx=0 tx=0).stop 2024-06-02T05:06:28.556 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.552+0000 7f8b4f269700 1 -- 172.21.15.76:0/2906408947 shutdown_connections 2024-06-02T05:06:28.556 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.552+0000 7f8b4f269700 1 --2- 172.21.15.76:0/2906408947 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8b48102ab0 0x7f8b481093d0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:28.556 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.552+0000 7f8b4f269700 1 --2- 172.21.15.76:0/2906408947 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8b48100f20 0x7f8b48101360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:28.556 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.552+0000 7f8b4f269700 1 --2- 172.21.15.76:0/2906408947 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8b481020f0 0x7f8b48102570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:28.556 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.552+0000 7f8b4f269700 1 -- 172.21.15.76:0/2906408947 >> 172.21.15.76:0/2906408947 conn(0x7f8b480fc500 msgr2=0x7f8b480fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:06:28.556 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.553+0000 7f8b4f269700 1 -- 172.21.15.76:0/2906408947 shutdown_connections 2024-06-02T05:06:28.556 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.553+0000 7f8b4f269700 1 -- 172.21.15.76:0/2906408947 wait complete. 2024-06-02T05:06:28.556 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.553+0000 7f8b4f269700 1 Processor -- start 2024-06-02T05:06:28.556 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.553+0000 7f8b4f269700 1 -- start start 2024-06-02T05:06:28.556 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.553+0000 7f8b4f269700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8b48100f20 0x7f8b48196f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:06:28.557 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.553+0000 7f8b4f269700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8b481020f0 0x7f8b48197460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:06:28.557 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.553+0000 7f8b4f269700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8b48102ab0 0x7f8b4819e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:06:28.557 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.553+0000 7f8b4f269700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b4819ea50 con 0x7f8b48102ab0 2024-06-02T05:06:28.557 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.553+0000 7f8b4f269700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b4819eb90 con 0x7f8b48100f20 2024-06-02T05:06:28.557 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.553+0000 7f8b4f269700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b4819ed20 con 0x7f8b481020f0 2024-06-02T05:06:28.557 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.553+0000 7f8b4d806700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8b48102ab0 0x7f8b4819e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:06:28.557 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.553+0000 7f8b4d806700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8b48102ab0 0x7f8b4819e480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:47090/0 (socket says 172.21.15.76:47090) 2024-06-02T05:06:28.557 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.553+0000 7f8b4d806700 1 -- 172.21.15.76:0/1730959798 learned_addr learned my addr 172.21.15.76:0/1730959798 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:06:28.557 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.554+0000 7f8b4d005700 1 --2- 172.21.15.76:0/1730959798 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8b48100f20 0x7f8b48196f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:06:28.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.554+0000 7f8b4c804700 1 --2- 172.21.15.76:0/1730959798 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8b481020f0 0x7f8b48197460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:06:28.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.554+0000 7f8b4d806700 1 -- 172.21.15.76:0/1730959798 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8b481020f0 msgr2=0x7f8b48197460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:06:28.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.554+0000 7f8b4d806700 1 --2- 172.21.15.76:0/1730959798 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8b481020f0 0x7f8b48197460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:28.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.554+0000 7f8b4d806700 1 -- 172.21.15.76:0/1730959798 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8b48100f20 msgr2=0x7f8b48196f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:06:28.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.554+0000 7f8b4d806700 1 --2- 172.21.15.76:0/1730959798 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8b48100f20 0x7f8b48196f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:28.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.554+0000 7f8b4d806700 1 -- 172.21.15.76:0/1730959798 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b40009d00 con 0x7f8b48102ab0 2024-06-02T05:06:28.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.554+0000 7f8b4d806700 1 --2- 172.21.15.76:0/1730959798 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8b48102ab0 0x7f8b4819e480 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f8b40007a30 tx=0x7f8b40004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:06:28.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.554+0000 7f8b3e7fc700 1 -- 172.21.15.76:0/1730959798 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b4000e040 con 0x7f8b48102ab0 2024-06-02T05:06:28.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.554+0000 7f8b3e7fc700 1 -- 172.21.15.76:0/1730959798 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8b400056e0 con 0x7f8b48102ab0 2024-06-02T05:06:28.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.554+0000 7f8b3e7fc700 1 -- 172.21.15.76:0/1730959798 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b4001da80 con 0x7f8b48102ab0 2024-06-02T05:06:28.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.554+0000 7f8b4f269700 1 -- 172.21.15.76:0/1730959798 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b4819efa0 con 0x7f8b48102ab0 2024-06-02T05:06:28.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.554+0000 7f8b4f269700 1 -- 172.21.15.76:0/1730959798 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b4819f310 con 0x7f8b48102ab0 2024-06-02T05:06:28.559 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.555+0000 7f8b4f269700 1 -- 172.21.15.76:0/1730959798 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b481083c0 con 0x7f8b48102ab0 2024-06-02T05:06:28.559 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.556+0000 7f8b3e7fc700 1 -- 172.21.15.76:0/1730959798 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f8b40005850 con 0x7f8b48102ab0 2024-06-02T05:06:28.559 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.557+0000 7f8b3e7fc700 1 --2- 172.21.15.76:0/1730959798 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f8b340a1120 0x7f8b340a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:06:28.559 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.557+0000 7f8b4d005700 1 --2- 172.21.15.76:0/1730959798 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f8b340a1120 0x7f8b340a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:06:28.560 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.557+0000 7f8b3e7fc700 1 -- 172.21.15.76:0/1730959798 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f8b400cea30 con 0x7f8b48102ab0 2024-06-02T05:06:28.560 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.557+0000 7f8b4d005700 1 --2- 172.21.15.76:0/1730959798 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f8b340a1120 0x7f8b340a35e0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f8b48100c40 tx=0x7f8b4400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:06:28.561 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.560+0000 7f8b3e7fc700 1 -- 172.21.15.76:0/1730959798 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f8b40097f10 con 0x7f8b48102ab0 2024-06-02T05:06:28.758 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.757+0000 7f8b4f269700 1 -- 172.21.15.76:0/1730959798 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f8b4810c7a0 con 0x7f8b48102ab0 2024-06-02T05:06:28.758 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.758+0000 7f8b3e7fc700 1 -- 172.21.15.76:0/1730959798 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v84) v1 ==== 103+0+11 (secure 0 0 0) 0x7f8b4009b530 con 0x7f8b48102ab0 2024-06-02T05:06:28.759 INFO:teuthology.orchestra.run.smithi076.stdout:pg_num: 32 2024-06-02T05:06:28.761 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.760+0000 7f8b4f269700 1 -- 172.21.15.76:0/1730959798 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f8b340a1120 msgr2=0x7f8b340a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:06:28.761 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.760+0000 7f8b4f269700 1 --2- 172.21.15.76:0/1730959798 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f8b340a1120 0x7f8b340a35e0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f8b48100c40 tx=0x7f8b4400b410 comp rx=0 tx=0).stop 2024-06-02T05:06:28.761 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.760+0000 7f8b4f269700 1 -- 172.21.15.76:0/1730959798 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8b48102ab0 msgr2=0x7f8b4819e480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:06:28.761 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.760+0000 7f8b4f269700 1 --2- 172.21.15.76:0/1730959798 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8b48102ab0 0x7f8b4819e480 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f8b40007a30 tx=0x7f8b40004c80 comp rx=0 tx=0).stop 2024-06-02T05:06:28.761 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.760+0000 7f8b4f269700 1 -- 172.21.15.76:0/1730959798 shutdown_connections 2024-06-02T05:06:28.761 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.760+0000 7f8b4f269700 1 --2- 172.21.15.76:0/1730959798 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8b48102ab0 0x7f8b4819e480 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:28.761 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.760+0000 7f8b4f269700 1 --2- 172.21.15.76:0/1730959798 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f8b340a1120 0x7f8b340a35e0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:28.761 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.760+0000 7f8b4f269700 1 --2- 172.21.15.76:0/1730959798 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8b48100f20 0x7f8b48196f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:28.761 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.760+0000 7f8b4f269700 1 --2- 172.21.15.76:0/1730959798 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8b481020f0 0x7f8b48197460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:28.761 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.760+0000 7f8b4f269700 1 -- 172.21.15.76:0/1730959798 >> 172.21.15.76:0/1730959798 conn(0x7f8b480fc500 msgr2=0x7f8b48105500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:06:28.762 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.760+0000 7f8b4f269700 1 -- 172.21.15.76:0/1730959798 shutdown_connections 2024-06-02T05:06:28.762 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.760+0000 7f8b4f269700 1 -- 172.21.15.76:0/1730959798 wait complete. 2024-06-02T05:06:28.773 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-06-02T05:06:28.899 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.896+0000 7fdb96a52700 1 -- 172.21.15.76:0/1626047511 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdb901019e0 msgr2=0x7fdb90103dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:06:28.899 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.896+0000 7fdb96a52700 1 --2- 172.21.15.76:0/1626047511 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdb901019e0 0x7fdb90103dd0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fdb80009990 tx=0x7fdb80009ca0 comp rx=0 tx=0).stop 2024-06-02T05:06:28.900 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.896+0000 7fdb96a52700 1 -- 172.21.15.76:0/1626047511 shutdown_connections 2024-06-02T05:06:28.900 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.896+0000 7fdb96a52700 1 --2- 172.21.15.76:0/1626047511 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdb90106c40 0x7fdb901090b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:28.900 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.896+0000 7fdb96a52700 1 --2- 172.21.15.76:0/1626047511 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdb901019e0 0x7fdb90103dd0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:28.900 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.896+0000 7fdb96a52700 1 --2- 172.21.15.76:0/1626047511 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb90104310 0x7fdb90106700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:28.900 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.896+0000 7fdb96a52700 1 -- 172.21.15.76:0/1626047511 >> 172.21.15.76:0/1626047511 conn(0x7fdb900fb3f0 msgr2=0x7fdb900fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:06:28.900 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.896+0000 7fdb96a52700 1 -- 172.21.15.76:0/1626047511 shutdown_connections 2024-06-02T05:06:28.900 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.897+0000 7fdb96a52700 1 -- 172.21.15.76:0/1626047511 wait complete. 2024-06-02T05:06:28.900 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.897+0000 7fdb96a52700 1 Processor -- start 2024-06-02T05:06:28.900 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.897+0000 7fdb96a52700 1 -- start start 2024-06-02T05:06:28.900 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.897+0000 7fdb96a52700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdb901019e0 0x7fdb90196db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:06:28.900 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.897+0000 7fdb96a52700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb90104310 0x7fdb901972f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:06:28.900 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.897+0000 7fdb96a52700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdb90106c40 0x7fdb9019e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:06:28.901 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.897+0000 7fdb96a52700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb9019e8e0 con 0x7fdb90106c40 2024-06-02T05:06:28.901 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.897+0000 7fdb96a52700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb9019ea20 con 0x7fdb90104310 2024-06-02T05:06:28.901 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.897+0000 7fdb96a52700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb9019ebb0 con 0x7fdb901019e0 2024-06-02T05:06:28.901 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.897+0000 7fdb94fef700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdb90106c40 0x7fdb9019e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:06:28.901 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.898+0000 7fdb94fef700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdb90106c40 0x7fdb9019e310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:47106/0 (socket says 172.21.15.76:47106) 2024-06-02T05:06:28.901 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.898+0000 7fdb94fef700 1 -- 172.21.15.76:0/4026773062 learned_addr learned my addr 172.21.15.76:0/4026773062 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:06:28.901 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.898+0000 7fdb8ffff700 1 --2- 172.21.15.76:0/4026773062 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdb901019e0 0x7fdb90196db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:06:28.901 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.898+0000 7fdb8f7fe700 1 --2- 172.21.15.76:0/4026773062 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb90104310 0x7fdb901972f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:06:28.901 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.898+0000 7fdb94fef700 1 -- 172.21.15.76:0/4026773062 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdb901019e0 msgr2=0x7fdb90196db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:06:28.901 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.898+0000 7fdb94fef700 1 --2- 172.21.15.76:0/4026773062 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdb901019e0 0x7fdb90196db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:28.901 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.898+0000 7fdb94fef700 1 -- 172.21.15.76:0/4026773062 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb90104310 msgr2=0x7fdb901972f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:06:28.901 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.898+0000 7fdb94fef700 1 --2- 172.21.15.76:0/4026773062 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb90104310 0x7fdb901972f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:28.901 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.898+0000 7fdb94fef700 1 -- 172.21.15.76:0/4026773062 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb800095f0 con 0x7fdb90106c40 2024-06-02T05:06:28.902 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.898+0000 7fdb94fef700 1 --2- 172.21.15.76:0/4026773062 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdb90106c40 0x7fdb9019e310 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fdb88007ee0 tx=0x7fdb8800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:06:28.902 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.898+0000 7fdb8d7fa700 1 -- 172.21.15.76:0/4026773062 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb8800ddd0 con 0x7fdb90106c40 2024-06-02T05:06:28.902 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.898+0000 7fdb8d7fa700 1 -- 172.21.15.76:0/4026773062 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdb8800f040 con 0x7fdb90106c40 2024-06-02T05:06:28.902 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.898+0000 7fdb8d7fa700 1 -- 172.21.15.76:0/4026773062 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb88004870 con 0x7fdb90106c40 2024-06-02T05:06:28.902 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.898+0000 7fdb96a52700 1 -- 172.21.15.76:0/4026773062 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb9019ee90 con 0x7fdb90106c40 2024-06-02T05:06:28.902 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.898+0000 7fdb96a52700 1 -- 172.21.15.76:0/4026773062 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb9019f2c0 con 0x7fdb90106c40 2024-06-02T05:06:28.903 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.899+0000 7fdb96a52700 1 -- 172.21.15.76:0/4026773062 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb900fcf70 con 0x7fdb90106c40 2024-06-02T05:06:28.903 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.900+0000 7fdb8d7fa700 1 -- 172.21.15.76:0/4026773062 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fdb88003a00 con 0x7fdb90106c40 2024-06-02T05:06:28.903 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.901+0000 7fdb8d7fa700 1 --2- 172.21.15.76:0/4026773062 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fdb780a11a0 0x7fdb780a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:06:28.903 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.901+0000 7fdb8d7fa700 1 -- 172.21.15.76:0/4026773062 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7fdb880ccd00 con 0x7fdb90106c40 2024-06-02T05:06:28.903 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.901+0000 7fdb8ffff700 1 --2- 172.21.15.76:0/4026773062 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fdb780a11a0 0x7fdb780a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:06:28.903 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.901+0000 7fdb8ffff700 1 --2- 172.21.15.76:0/4026773062 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fdb780a11a0 0x7fdb780a3660 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fdb80003780 tx=0x7fdb80005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:06:28.905 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:28.904+0000 7fdb8d7fa700 1 -- 172.21.15.76:0/4026773062 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fdb88096150 con 0x7fdb90106c40 2024-06-02T05:06:29.118 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.117+0000 7fdb96a52700 1 -- 172.21.15.76:0/4026773062 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fdb9010c5f0 con 0x7fdb90106c40 2024-06-02T05:06:29.118 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.117+0000 7fdb8d7fa700 1 -- 172.21.15.76:0/4026773062 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v84) v1 ==== 81+0+590 (secure 0 0 0) 0x7fdb88023020 con 0x7fdb90106c40 2024-06-02T05:06:29.118 INFO:teuthology.orchestra.run.smithi076.stdout:172.21.15.76:6801/4200406736 2024-06-03T04:43:06.092916+0000 2024-06-02T05:06:29.118 INFO:teuthology.orchestra.run.smithi076.stdout:172.21.15.76:6800/4200406736 2024-06-03T04:43:06.092916+0000 2024-06-02T05:06:29.118 INFO:teuthology.orchestra.run.smithi076.stdout:172.21.15.76:0/1524144593 2024-06-03T04:43:06.092916+0000 2024-06-02T05:06:29.118 INFO:teuthology.orchestra.run.smithi076.stdout:172.21.15.76:0/3269372590 2024-06-03T04:43:06.092916+0000 2024-06-02T05:06:29.119 INFO:teuthology.orchestra.run.smithi076.stdout:172.21.15.76:0/3570893846 2024-06-03T04:42:44.872236+0000 2024-06-02T05:06:29.119 INFO:teuthology.orchestra.run.smithi076.stdout:172.21.15.76:0/902035790 2024-06-03T04:43:06.092916+0000 2024-06-02T05:06:29.119 INFO:teuthology.orchestra.run.smithi076.stdout:172.21.15.76:6800/2550846765 2024-06-03T04:42:44.872236+0000 2024-06-02T05:06:29.119 INFO:teuthology.orchestra.run.smithi076.stdout:172.21.15.76:6801/2550846765 2024-06-03T04:42:44.872236+0000 2024-06-02T05:06:29.119 INFO:teuthology.orchestra.run.smithi076.stdout:172.21.15.76:0/2646712763 2024-06-03T04:42:44.872236+0000 2024-06-02T05:06:29.119 INFO:teuthology.orchestra.run.smithi076.stdout:172.21.15.76:0/964578813 2024-06-03T04:42:44.872236+0000 2024-06-02T05:06:29.120 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.119+0000 7fdb96a52700 1 -- 172.21.15.76:0/4026773062 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fdb780a11a0 msgr2=0x7fdb780a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:06:29.120 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.119+0000 7fdb96a52700 1 --2- 172.21.15.76:0/4026773062 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fdb780a11a0 0x7fdb780a3660 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fdb80003780 tx=0x7fdb80005fd0 comp rx=0 tx=0).stop 2024-06-02T05:06:29.121 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.119+0000 7fdb96a52700 1 -- 172.21.15.76:0/4026773062 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdb90106c40 msgr2=0x7fdb9019e310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:06:29.121 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.119+0000 7fdb96a52700 1 --2- 172.21.15.76:0/4026773062 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdb90106c40 0x7fdb9019e310 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fdb88007ee0 tx=0x7fdb8800d3b0 comp rx=0 tx=0).stop 2024-06-02T05:06:29.121 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.119+0000 7fdb96a52700 1 -- 172.21.15.76:0/4026773062 shutdown_connections 2024-06-02T05:06:29.121 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.119+0000 7fdb96a52700 1 --2- 172.21.15.76:0/4026773062 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdb90106c40 0x7fdb9019e310 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:29.121 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.119+0000 7fdb96a52700 1 --2- 172.21.15.76:0/4026773062 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdb901019e0 0x7fdb90196db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:29.121 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.119+0000 7fdb96a52700 1 --2- 172.21.15.76:0/4026773062 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fdb780a11a0 0x7fdb780a3660 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:29.121 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.119+0000 7fdb96a52700 1 --2- 172.21.15.76:0/4026773062 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb90104310 0x7fdb901972f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:29.121 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.119+0000 7fdb96a52700 1 -- 172.21.15.76:0/4026773062 >> 172.21.15.76:0/4026773062 conn(0x7fdb900fb3f0 msgr2=0x7fdb901024a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:06:29.121 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.120+0000 7fdb96a52700 1 -- 172.21.15.76:0/4026773062 shutdown_connections 2024-06-02T05:06:29.121 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.120+0000 7fdb96a52700 1 -- 172.21.15.76:0/4026773062 wait complete. 2024-06-02T05:06:29.122 INFO:teuthology.orchestra.run.smithi076.stderr:listed 10 entries 2024-06-02T05:06:29.132 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:06:28 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/1961670995' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-06-02T05:06:29.132 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:06:28 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/727281642' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-06-02T05:06:29.132 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:06:28 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/1730959798' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-06-02T05:06:29.133 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2024-06-02T05:06:29.133 DEBUG:teuthology.orchestra.run.smithi076:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T05:06:29.151 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-02T05:06:29.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:06:28 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/1961670995' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-06-02T05:06:29.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:06:28 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/727281642' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-06-02T05:06:29.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:06:28 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/1730959798' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-06-02T05:06:29.316 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.313+0000 7ff568028700 1 -- 172.21.15.76:0/3826436231 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff560100f50 msgr2=0x7ff5601013b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:06:29.316 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.313+0000 7ff568028700 1 --2- 172.21.15.76:0/3826436231 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff560100f50 0x7ff5601013b0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7ff55c0099c0 tx=0x7ff55c009cd0 comp rx=0 tx=0).stop 2024-06-02T05:06:29.316 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.313+0000 7ff568028700 1 -- 172.21.15.76:0/3826436231 shutdown_connections 2024-06-02T05:06:29.316 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.313+0000 7ff568028700 1 --2- 172.21.15.76:0/3826436231 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff5601018f0 0x7ff5601081a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:29.316 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.313+0000 7ff568028700 1 --2- 172.21.15.76:0/3826436231 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5600ffd60 0x7ff560100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:29.316 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.313+0000 7ff568028700 1 --2- 172.21.15.76:0/3826436231 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff560100f50 0x7ff5601013b0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:29.316 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.313+0000 7ff568028700 1 -- 172.21.15.76:0/3826436231 >> 172.21.15.76:0/3826436231 conn(0x7ff5600fb2f0 msgr2=0x7ff5600fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:06:29.316 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.313+0000 7ff568028700 1 -- 172.21.15.76:0/3826436231 shutdown_connections 2024-06-02T05:06:29.317 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.313+0000 7ff568028700 1 -- 172.21.15.76:0/3826436231 wait complete. 2024-06-02T05:06:29.317 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.314+0000 7ff568028700 1 Processor -- start 2024-06-02T05:06:29.317 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.314+0000 7ff568028700 1 -- start start 2024-06-02T05:06:29.317 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.314+0000 7ff568028700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff5600ffd60 0x7ff56010a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:06:29.317 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.314+0000 7ff568028700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff560100f50 0x7ff560108cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:06:29.317 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.314+0000 7ff568028700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff5601018f0 0x7ff5601091f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:06:29.317 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.314+0000 7ff568028700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff560109990 con 0x7ff5601018f0 2024-06-02T05:06:29.317 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.314+0000 7ff568028700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff560109b00 con 0x7ff560100f50 2024-06-02T05:06:29.317 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.314+0000 7ff568028700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5601a0d60 con 0x7ff5600ffd60 2024-06-02T05:06:29.317 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.314+0000 7ff5665c5700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff5601018f0 0x7ff5601091f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:06:29.317 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.314+0000 7ff5665c5700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff5601018f0 0x7ff5601091f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:47116/0 (socket says 172.21.15.76:47116) 2024-06-02T05:06:29.317 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.314+0000 7ff5665c5700 1 -- 172.21.15.76:0/2445255903 learned_addr learned my addr 172.21.15.76:0/2445255903 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:06:29.317 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.314+0000 7ff565dc4700 1 --2- 172.21.15.76:0/2445255903 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff5600ffd60 0x7ff56010a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:06:29.318 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.314+0000 7ff5655c3700 1 --2- 172.21.15.76:0/2445255903 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff560100f50 0x7ff560108cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:06:29.318 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.314+0000 7ff5665c5700 1 -- 172.21.15.76:0/2445255903 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff5600ffd60 msgr2=0x7ff56010a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:06:29.318 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.314+0000 7ff5665c5700 1 --2- 172.21.15.76:0/2445255903 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff5600ffd60 0x7ff56010a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:29.318 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.314+0000 7ff5665c5700 1 -- 172.21.15.76:0/2445255903 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff560100f50 msgr2=0x7ff560108cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:06:29.318 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.314+0000 7ff5665c5700 1 --2- 172.21.15.76:0/2445255903 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff560100f50 0x7ff560108cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:29.318 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.314+0000 7ff5665c5700 1 -- 172.21.15.76:0/2445255903 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff55c0095f0 con 0x7ff5601018f0 2024-06-02T05:06:29.318 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.314+0000 7ff5665c5700 1 --2- 172.21.15.76:0/2445255903 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff5601018f0 0x7ff5601091f0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7ff558007ee0 tx=0x7ff55800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:06:29.318 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.315+0000 7ff556ffd700 1 -- 172.21.15.76:0/2445255903 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff558017070 con 0x7ff5601018f0 2024-06-02T05:06:29.318 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.315+0000 7ff556ffd700 1 -- 172.21.15.76:0/2445255903 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff55800f040 con 0x7ff5601018f0 2024-06-02T05:06:29.318 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.315+0000 7ff568028700 1 -- 172.21.15.76:0/2445255903 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5601a0ff0 con 0x7ff5601018f0 2024-06-02T05:06:29.318 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.315+0000 7ff556ffd700 1 -- 172.21.15.76:0/2445255903 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff558005570 con 0x7ff5601018f0 2024-06-02T05:06:29.318 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.315+0000 7ff568028700 1 -- 172.21.15.76:0/2445255903 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5601a1470 con 0x7ff5601018f0 2024-06-02T05:06:29.319 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.316+0000 7ff568028700 1 -- 172.21.15.76:0/2445255903 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff560107280 con 0x7ff5601018f0 2024-06-02T05:06:29.320 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.317+0000 7ff556ffd700 1 -- 172.21.15.76:0/2445255903 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7ff55800db70 con 0x7ff5601018f0 2024-06-02T05:06:29.320 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.317+0000 7ff556ffd700 1 --2- 172.21.15.76:0/2445255903 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7ff54c0a1120 0x7ff54c0a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:06:29.320 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.317+0000 7ff565dc4700 1 --2- 172.21.15.76:0/2445255903 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7ff54c0a1120 0x7ff54c0a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:06:29.320 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.317+0000 7ff556ffd700 1 -- 172.21.15.76:0/2445255903 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7ff5580cca20 con 0x7ff5601018f0 2024-06-02T05:06:29.320 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.318+0000 7ff565dc4700 1 --2- 172.21.15.76:0/2445255903 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7ff54c0a1120 0x7ff54c0a35e0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7ff560100db0 tx=0x7ff55000a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:06:29.321 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.321+0000 7ff556ffd700 1 -- 172.21.15.76:0/2445255903 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7ff558095e70 con 0x7ff5601018f0 2024-06-02T05:06:29.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:06:28 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/1961670995' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-06-02T05:06:29.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:06:28 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/727281642' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-06-02T05:06:29.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:06:28 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/1730959798' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-06-02T05:06:29.520 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.519+0000 7ff568028700 1 -- 172.21.15.76:0/2445255903 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff56010c590 con 0x7ff5601018f0 2024-06-02T05:06:29.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.521+0000 7ff556ffd700 1 -- 172.21.15.76:0/2445255903 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+24575 (secure 0 0 0) 0x7ff558099490 con 0x7ff5601018f0 2024-06-02T05:06:29.522 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-06-02T05:06:29.522 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":84,"fsid":"60ab6d30-209a-11ef-bc9b-c7b262605968","created":"2024-06-02T04:42:21.007333+0000","modified":"2024-06-02T04:50:08.858987+0000","last_up_change":"2024-06-02T04:47:29.822242+0000","last_in_change":"2024-06-02T04:47:14.253449+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T04:44:56.408602+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-02T04:48:01.194954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-02T04:48:01.828863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-02T04:48:04.916565+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"33a51ba2-be5c-41d0-b5d1-8d6039f2ca4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6802","nonce":2869602045},{"type":"v1","addr":"172.21.15.76:6803","nonce":2869602045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6804","nonce":2869602045},{"type":"v1","addr":"172.21.15.76:6805","nonce":2869602045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6808","nonce":2869602045},{"type":"v1","addr":"172.21.15.76:6809","nonce":2869602045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6806","nonce":2869602045},{"type":"v1","addr":"172.21.15.76:6807","nonce":2869602045}]},"public_addr":"172.21.15.76:6803/2869602045","cluster_addr":"172.21.15.76:6805/2869602045","heartbeat_back_addr":"172.21.15.76:6809/2869602045","heartbeat_front_addr":"172.21.15.76:6807/2869602045","state":["exists","up"]},{"osd":1,"uuid":"ace46e13-3bb7-4103-973a-6860554df8b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":2353738098},{"type":"v1","addr":"172.21.15.119:6801","nonce":2353738098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":2353738098},{"type":"v1","addr":"172.21.15.119:6803","nonce":2353738098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":2353738098},{"type":"v1","addr":"172.21.15.119:6807","nonce":2353738098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":2353738098},{"type":"v1","addr":"172.21.15.119:6805","nonce":2353738098}]},"public_addr":"172.21.15.119:6801/2353738098","cluster_addr":"172.21.15.119:6803/2353738098","heartbeat_back_addr":"172.21.15.119:6807/2353738098","heartbeat_front_addr":"172.21.15.119:6805/2353738098","state":["exists","up"]},{"osd":2,"uuid":"4addc09e-77a9-428a-bcc4-38194f486cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":3206918546},{"type":"v1","addr":"172.21.15.192:6801","nonce":3206918546}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":3206918546},{"type":"v1","addr":"172.21.15.192:6803","nonce":3206918546}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":3206918546},{"type":"v1","addr":"172.21.15.192:6807","nonce":3206918546}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":3206918546},{"type":"v1","addr":"172.21.15.192:6805","nonce":3206918546}]},"public_addr":"172.21.15.192:6801/3206918546","cluster_addr":"172.21.15.192:6803/3206918546","heartbeat_back_addr":"172.21.15.192:6807/3206918546","heartbeat_front_addr":"172.21.15.192:6805/3206918546","state":["exists","up"]},{"osd":3,"uuid":"dc525518-82c6-49ed-8ca8-e3bd5bfc18d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6810","nonce":3747864233},{"type":"v1","addr":"172.21.15.76:6811","nonce":3747864233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6812","nonce":3747864233},{"type":"v1","addr":"172.21.15.76:6813","nonce":3747864233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6816","nonce":3747864233},{"type":"v1","addr":"172.21.15.76:6817","nonce":3747864233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6814","nonce":3747864233},{"type":"v1","addr":"172.21.15.76:6815","nonce":3747864233}]},"public_addr":"172.21.15.76:6811/3747864233","cluster_addr":"172.21.15.76:6813/3747864233","heartbeat_back_addr":"172.21.15.76:6817/3747864233","heartbeat_front_addr":"172.21.15.76:6815/3747864233","state":["exists","up"]},{"osd":4,"uuid":"eef293d0-cb87-47b3-9751-c6437a1cf079","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":2571629047},{"type":"v1","addr":"172.21.15.119:6809","nonce":2571629047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":2571629047},{"type":"v1","addr":"172.21.15.119:6811","nonce":2571629047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":2571629047},{"type":"v1","addr":"172.21.15.119:6815","nonce":2571629047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":2571629047},{"type":"v1","addr":"172.21.15.119:6813","nonce":2571629047}]},"public_addr":"172.21.15.119:6809/2571629047","cluster_addr":"172.21.15.119:6811/2571629047","heartbeat_back_addr":"172.21.15.119:6815/2571629047","heartbeat_front_addr":"172.21.15.119:6813/2571629047","state":["exists","up"]},{"osd":5,"uuid":"60eb8c6e-766c-49d0-9997-44f85776b3fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3285065416},{"type":"v1","addr":"172.21.15.192:6809","nonce":3285065416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":3285065416},{"type":"v1","addr":"172.21.15.192:6811","nonce":3285065416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3285065416},{"type":"v1","addr":"172.21.15.192:6815","nonce":3285065416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":3285065416},{"type":"v1","addr":"172.21.15.192:6813","nonce":3285065416}]},"public_addr":"172.21.15.192:6809/3285065416","cluster_addr":"172.21.15.192:6811/3285065416","heartbeat_back_addr":"172.21.15.192:6815/3285065416","heartbeat_front_addr":"172.21.15.192:6813/3285065416","state":["exists","up"]},{"osd":6,"uuid":"e6dc8b9d-dd06-4870-a506-def8201b7e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6818","nonce":2951381580},{"type":"v1","addr":"172.21.15.76:6819","nonce":2951381580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6820","nonce":2951381580},{"type":"v1","addr":"172.21.15.76:6821","nonce":2951381580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6824","nonce":2951381580},{"type":"v1","addr":"172.21.15.76:6825","nonce":2951381580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6822","nonce":2951381580},{"type":"v1","addr":"172.21.15.76:6823","nonce":2951381580}]},"public_addr":"172.21.15.76:6819/2951381580","cluster_addr":"172.21.15.76:6821/2951381580","heartbeat_back_addr":"172.21.15.76:6825/2951381580","heartbeat_front_addr":"172.21.15.76:6823/2951381580","state":["exists","up"]},{"osd":7,"uuid":"2f5dccb3-39a1-4f25-8715-fa264d59db97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1802558756},{"type":"v1","addr":"172.21.15.119:6817","nonce":1802558756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1802558756},{"type":"v1","addr":"172.21.15.119:6819","nonce":1802558756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1802558756},{"type":"v1","addr":"172.21.15.119:6823","nonce":1802558756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1802558756},{"type":"v1","addr":"172.21.15.119:6821","nonce":1802558756}]},"public_addr":"172.21.15.119:6817/1802558756","cluster_addr":"172.21.15.119:6819/1802558756","heartbeat_back_addr":"172.21.15.119:6823/1802558756","heartbeat_front_addr":"172.21.15.119:6821/1802558756","state":["exists","up"]},{"osd":8,"uuid":"39b6ccd0-16e7-4cd5-87e0-d827e9172984","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":1214972276},{"type":"v1","addr":"172.21.15.192:6817","nonce":1214972276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":1214972276},{"type":"v1","addr":"172.21.15.192:6819","nonce":1214972276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":1214972276},{"type":"v1","addr":"172.21.15.192:6823","nonce":1214972276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":1214972276},{"type":"v1","addr":"172.21.15.192:6821","nonce":1214972276}]},"public_addr":"172.21.15.192:6817/1214972276","cluster_addr":"172.21.15.192:6819/1214972276","heartbeat_back_addr":"172.21.15.192:6823/1214972276","heartbeat_front_addr":"172.21.15.192:6821/1214972276","state":["exists","up"]},{"osd":9,"uuid":"851b2155-07bd-45de-bfe0-53021fda733f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6826","nonce":3095501821},{"type":"v1","addr":"172.21.15.76:6827","nonce":3095501821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6828","nonce":3095501821},{"type":"v1","addr":"172.21.15.76:6829","nonce":3095501821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":3095501821},{"type":"v1","addr":"172.21.15.76:6833","nonce":3095501821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6830","nonce":3095501821},{"type":"v1","addr":"172.21.15.76:6831","nonce":3095501821}]},"public_addr":"172.21.15.76:6827/3095501821","cluster_addr":"172.21.15.76:6829/3095501821","heartbeat_back_addr":"172.21.15.76:6833/3095501821","heartbeat_front_addr":"172.21.15.76:6831/3095501821","state":["exists","up"]},{"osd":10,"uuid":"e4b18e7e-bddf-4dd4-84f6-7902ea327cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":4082130894},{"type":"v1","addr":"172.21.15.119:6825","nonce":4082130894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":4082130894},{"type":"v1","addr":"172.21.15.119:6827","nonce":4082130894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":4082130894},{"type":"v1","addr":"172.21.15.119:6831","nonce":4082130894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":4082130894},{"type":"v1","addr":"172.21.15.119:6829","nonce":4082130894}]},"public_addr":"172.21.15.119:6825/4082130894","cluster_addr":"172.21.15.119:6827/4082130894","heartbeat_back_addr":"172.21.15.119:6831/4082130894","heartbeat_front_addr":"172.21.15.119:6829/4082130894","state":["exists","up"]},{"osd":11,"uuid":"54567e18-920c-4ae9-9557-0efba5a1a820","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":439693921},{"type":"v1","addr":"172.21.15.192:6825","nonce":439693921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":439693921},{"type":"v1","addr":"172.21.15.192:6827","nonce":439693921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":439693921},{"type":"v1","addr":"172.21.15.192:6831","nonce":439693921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":439693921},{"type":"v1","addr":"172.21.15.192:6829","nonce":439693921}]},"public_addr":"172.21.15.192:6825/439693921","cluster_addr":"172.21.15.192:6827/439693921","heartbeat_back_addr":"172.21.15.192:6831/439693921","heartbeat_front_addr":"172.21.15.192:6829/439693921","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:44:19.922390+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:44:36.895563+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:44:53.699019+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:45:11.167404+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:45:27.955899+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:45:44.850368+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:46:02.003588+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:46:19.019217+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:46:36.189670+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:46:53.919365+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:47:11.563053+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:47:28.822443+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":4}]},{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4},{"from":8,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.8","mappings":[{"from":5,"to":10}]},{"pgid":"4.14","mappings":[{"from":9,"to":8}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.76:6801/4200406736":"2024-06-03T04:43:06.092916+0000","172.21.15.76:6800/4200406736":"2024-06-03T04:43:06.092916+0000","172.21.15.76:0/1524144593":"2024-06-03T04:43:06.092916+0000","172.21.15.76:0/3269372590":"2024-06-03T04:43:06.092916+0000","172.21.15.76:0/3570893846":"2024-06-03T04:42:44.872236+0000","172.21.15.76:0/902035790":"2024-06-03T04:43:06.092916+0000","172.21.15.76:6800/2550846765":"2024-06-03T04:42:44.872236+0000","172.21.15.76:6801/2550846765":"2024-06-03T04:42:44.872236+0000","172.21.15.76:0/2646712763":"2024-06-03T04:42:44.872236+0000","172.21.15.76:0/964578813":"2024-06-03T04:42:44.872236+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T05:06:29.524 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.523+0000 7ff568028700 1 -- 172.21.15.76:0/2445255903 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7ff54c0a1120 msgr2=0x7ff54c0a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:06:29.524 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.523+0000 7ff568028700 1 --2- 172.21.15.76:0/2445255903 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7ff54c0a1120 0x7ff54c0a35e0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7ff560100db0 tx=0x7ff55000a380 comp rx=0 tx=0).stop 2024-06-02T05:06:29.524 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.523+0000 7ff568028700 1 -- 172.21.15.76:0/2445255903 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff5601018f0 msgr2=0x7ff5601091f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:06:29.524 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.523+0000 7ff568028700 1 --2- 172.21.15.76:0/2445255903 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff5601018f0 0x7ff5601091f0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7ff558007ee0 tx=0x7ff55800d3b0 comp rx=0 tx=0).stop 2024-06-02T05:06:29.524 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.523+0000 7ff568028700 1 -- 172.21.15.76:0/2445255903 shutdown_connections 2024-06-02T05:06:29.524 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.523+0000 7ff568028700 1 --2- 172.21.15.76:0/2445255903 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff5601018f0 0x7ff5601091f0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:29.524 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.523+0000 7ff568028700 1 --2- 172.21.15.76:0/2445255903 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff5600ffd60 0x7ff56010a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:29.524 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.523+0000 7ff568028700 1 --2- 172.21.15.76:0/2445255903 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7ff54c0a1120 0x7ff54c0a35e0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:29.524 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.523+0000 7ff568028700 1 --2- 172.21.15.76:0/2445255903 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff560100f50 0x7ff560108cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:29.525 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.523+0000 7ff568028700 1 -- 172.21.15.76:0/2445255903 >> 172.21.15.76:0/2445255903 conn(0x7ff5600fb2f0 msgr2=0x7ff5601043c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:06:29.525 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.523+0000 7ff568028700 1 -- 172.21.15.76:0/2445255903 shutdown_connections 2024-06-02T05:06:29.525 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.523+0000 7ff568028700 1 -- 172.21.15.76:0/2445255903 wait complete. 2024-06-02T05:06:29.537 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-06-02T04:44:56.408602+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-06-02T04:48:01.194954+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-06-02T04:48:01.828863+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '76', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-06-02T04:48:04.916565+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-06-02T05:06:29.537 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-06-02T05:06:29.667 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.662+0000 7f91848a6700 1 -- 172.21.15.76:0/957201359 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9180101970 msgr2=0x7f9180108290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:06:29.667 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.662+0000 7f91848a6700 1 --2- 172.21.15.76:0/957201359 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9180101970 0x7f9180108290 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f917800b0a0 tx=0x7f917800b3b0 comp rx=0 tx=0).stop 2024-06-02T05:06:29.667 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.662+0000 7f91848a6700 1 -- 172.21.15.76:0/957201359 shutdown_connections 2024-06-02T05:06:29.667 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.662+0000 7f91848a6700 1 --2- 172.21.15.76:0/957201359 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9180101970 0x7f9180108290 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:29.668 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.662+0000 7f91848a6700 1 --2- 172.21.15.76:0/957201359 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f91800ffe60 0x7f9180100280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:29.668 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.662+0000 7f91848a6700 1 --2- 172.21.15.76:0/957201359 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9180100fb0 0x7f9180101430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:29.668 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.662+0000 7f91848a6700 1 -- 172.21.15.76:0/957201359 >> 172.21.15.76:0/957201359 conn(0x7f91800fb3f0 msgr2=0x7f91800fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:06:29.668 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.662+0000 7f91848a6700 1 -- 172.21.15.76:0/957201359 shutdown_connections 2024-06-02T05:06:29.668 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.662+0000 7f91848a6700 1 -- 172.21.15.76:0/957201359 wait complete. 2024-06-02T05:06:29.668 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.663+0000 7f91848a6700 1 Processor -- start 2024-06-02T05:06:29.668 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.663+0000 7f91848a6700 1 -- start start 2024-06-02T05:06:29.668 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.663+0000 7f91848a6700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f91800ffe60 0x7f9180068b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:06:29.668 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.663+0000 7f91848a6700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9180100fb0 0x7f918019bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:06:29.668 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.663+0000 7f91848a6700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9180101970 0x7f918019e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:06:29.669 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.663+0000 7f91848a6700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f918019ea40 con 0x7f91800ffe60 2024-06-02T05:06:29.669 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.663+0000 7f91848a6700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f918019ebb0 con 0x7f9180100fb0 2024-06-02T05:06:29.669 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.663+0000 7f91848a6700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f918019ed70 con 0x7f9180101970 2024-06-02T05:06:29.669 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.663+0000 7f917e59c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f91800ffe60 0x7f9180068b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:06:29.669 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.663+0000 7f917e59c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f91800ffe60 0x7f9180068b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:47122/0 (socket says 172.21.15.76:47122) 2024-06-02T05:06:29.669 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.663+0000 7f917e59c700 1 -- 172.21.15.76:0/1062343104 learned_addr learned my addr 172.21.15.76:0/1062343104 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:06:29.669 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.663+0000 7f917dd9b700 1 --2- 172.21.15.76:0/1062343104 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9180100fb0 0x7f918019bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:06:29.669 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.663+0000 7f917ed9d700 1 --2- 172.21.15.76:0/1062343104 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9180101970 0x7f918019e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:06:29.669 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.663+0000 7f917e59c700 1 -- 172.21.15.76:0/1062343104 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9180101970 msgr2=0x7f918019e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:06:29.669 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.663+0000 7f917e59c700 1 --2- 172.21.15.76:0/1062343104 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9180101970 0x7f918019e250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:29.669 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.663+0000 7f917e59c700 1 -- 172.21.15.76:0/1062343104 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9180100fb0 msgr2=0x7f918019bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:06:29.669 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.663+0000 7f917e59c700 1 --2- 172.21.15.76:0/1062343104 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9180100fb0 0x7f918019bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:29.670 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.663+0000 7f917e59c700 1 -- 172.21.15.76:0/1062343104 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9178009d00 con 0x7f91800ffe60 2024-06-02T05:06:29.670 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.664+0000 7f917e59c700 1 --2- 172.21.15.76:0/1062343104 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f91800ffe60 0x7f9180068b30 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f917000d950 tx=0x7f917000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:06:29.670 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.664+0000 7f91777fe700 1 -- 172.21.15.76:0/1062343104 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9170009940 con 0x7f91800ffe60 2024-06-02T05:06:29.670 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.664+0000 7f91777fe700 1 -- 172.21.15.76:0/1062343104 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9170010460 con 0x7f91800ffe60 2024-06-02T05:06:29.670 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.664+0000 7f91848a6700 1 -- 172.21.15.76:0/1062343104 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f918019eff0 con 0x7f91800ffe60 2024-06-02T05:06:29.670 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.664+0000 7f91777fe700 1 -- 172.21.15.76:0/1062343104 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f917000f620 con 0x7f91800ffe60 2024-06-02T05:06:29.670 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.664+0000 7f91848a6700 1 -- 172.21.15.76:0/1062343104 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f918019f470 con 0x7f91800ffe60 2024-06-02T05:06:29.670 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.665+0000 7f91848a6700 1 -- 172.21.15.76:0/1062343104 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91801072d0 con 0x7f91800ffe60 2024-06-02T05:06:29.670 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.666+0000 7f91777fe700 1 -- 172.21.15.76:0/1062343104 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f91700105d0 con 0x7f91800ffe60 2024-06-02T05:06:29.671 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.667+0000 7f91777fe700 1 --2- 172.21.15.76:0/1062343104 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f916c0a11a0 0x7f916c0a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:06:29.671 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.667+0000 7f917dd9b700 1 --2- 172.21.15.76:0/1062343104 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f916c0a11a0 0x7f916c0a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:06:29.671 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.667+0000 7f91777fe700 1 -- 172.21.15.76:0/1062343104 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f91700cc9c0 con 0x7f91800ffe60 2024-06-02T05:06:29.671 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.667+0000 7f917dd9b700 1 --2- 172.21.15.76:0/1062343104 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f916c0a11a0 0x7f916c0a3660 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f91800690d0 tx=0x7f916800a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:06:29.671 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.670+0000 7f91777fe700 1 -- 172.21.15.76:0/1062343104 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f9170095e10 con 0x7f91800ffe60 2024-06-02T05:06:29.869 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.868+0000 7f91848a6700 1 -- 172.21.15.76:0/1062343104 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f918002cda0 con 0x7f91800ffe60 2024-06-02T05:06:29.869 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.868+0000 7f91777fe700 1 -- 172.21.15.76:0/1062343104 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v84) v1 ==== 93+0+10 (secure 0 0 0) 0x7f91700200a0 con 0x7f91800ffe60 2024-06-02T05:06:29.869 INFO:teuthology.orchestra.run.smithi076.stdout:pg_num: 1 2024-06-02T05:06:29.871 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.870+0000 7f91848a6700 1 -- 172.21.15.76:0/1062343104 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f916c0a11a0 msgr2=0x7f916c0a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:06:29.871 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.870+0000 7f91848a6700 1 --2- 172.21.15.76:0/1062343104 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f916c0a11a0 0x7f916c0a3660 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f91800690d0 tx=0x7f916800a300 comp rx=0 tx=0).stop 2024-06-02T05:06:29.872 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.870+0000 7f91848a6700 1 -- 172.21.15.76:0/1062343104 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f91800ffe60 msgr2=0x7f9180068b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:06:29.872 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.870+0000 7f91848a6700 1 --2- 172.21.15.76:0/1062343104 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f91800ffe60 0x7f9180068b30 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f917000d950 tx=0x7f917000dc60 comp rx=0 tx=0).stop 2024-06-02T05:06:29.872 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.870+0000 7f91848a6700 1 -- 172.21.15.76:0/1062343104 shutdown_connections 2024-06-02T05:06:29.872 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.870+0000 7f91848a6700 1 --2- 172.21.15.76:0/1062343104 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9180101970 0x7f918019e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:29.872 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.870+0000 7f91848a6700 1 --2- 172.21.15.76:0/1062343104 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f91800ffe60 0x7f9180068b30 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:29.872 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.870+0000 7f91848a6700 1 --2- 172.21.15.76:0/1062343104 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f916c0a11a0 0x7f916c0a3660 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:29.872 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.870+0000 7f91848a6700 1 --2- 172.21.15.76:0/1062343104 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9180100fb0 0x7f918019bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:29.872 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.870+0000 7f91848a6700 1 -- 172.21.15.76:0/1062343104 >> 172.21.15.76:0/1062343104 conn(0x7f91800fb3f0 msgr2=0x7f9180104410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:06:29.872 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.871+0000 7f91848a6700 1 -- 172.21.15.76:0/1062343104 shutdown_connections 2024-06-02T05:06:29.872 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:29.871+0000 7f91848a6700 1 -- 172.21.15.76:0/1062343104 wait complete. 2024-06-02T05:06:29.884 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-06-02T05:06:30.014 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.010+0000 7f7870183700 1 -- 172.21.15.76:0/3097583213 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7868101990 msgr2=0x7f78681082b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:06:30.015 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.010+0000 7f7870183700 1 --2- 172.21.15.76:0/3097583213 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7868101990 0x7f78681082b0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f786000b0a0 tx=0x7f786000b3b0 comp rx=0 tx=0).stop 2024-06-02T05:06:30.015 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.011+0000 7f7870183700 1 -- 172.21.15.76:0/3097583213 shutdown_connections 2024-06-02T05:06:30.015 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.011+0000 7f7870183700 1 --2- 172.21.15.76:0/3097583213 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7868101990 0x7f78681082b0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:30.015 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.011+0000 7f7870183700 1 --2- 172.21.15.76:0/3097583213 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f78680ffe80 0x7f78681002a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:30.015 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.011+0000 7f7870183700 1 --2- 172.21.15.76:0/3097583213 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7868100fd0 0x7f7868101450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:30.015 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.011+0000 7f7870183700 1 -- 172.21.15.76:0/3097583213 >> 172.21.15.76:0/3097583213 conn(0x7f78680fb3f0 msgr2=0x7f78680fd830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:06:30.015 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.011+0000 7f7870183700 1 -- 172.21.15.76:0/3097583213 shutdown_connections 2024-06-02T05:06:30.015 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.011+0000 7f7870183700 1 -- 172.21.15.76:0/3097583213 wait complete. 2024-06-02T05:06:30.015 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.011+0000 7f7870183700 1 Processor -- start 2024-06-02T05:06:30.015 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.011+0000 7f7870183700 1 -- start start 2024-06-02T05:06:30.015 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.011+0000 7f7870183700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f78680ffe80 0x7f7868196f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:06:30.015 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.011+0000 7f7870183700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7868100fd0 0x7f7868197440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:06:30.016 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.011+0000 7f7870183700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7868101990 0x7f786819e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:06:30.016 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.011+0000 7f7870183700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f786819ea30 con 0x7f78680ffe80 2024-06-02T05:06:30.016 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.011+0000 7f7870183700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f786819eb70 con 0x7f7868100fd0 2024-06-02T05:06:30.016 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.011+0000 7f7870183700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f786819ed00 con 0x7f7868101990 2024-06-02T05:06:30.016 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.011+0000 7f786df1f700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f78680ffe80 0x7f7868196f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:06:30.016 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.012+0000 7f786df1f700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f78680ffe80 0x7f7868196f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:47144/0 (socket says 172.21.15.76:47144) 2024-06-02T05:06:30.016 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.012+0000 7f786df1f700 1 -- 172.21.15.76:0/276462790 learned_addr learned my addr 172.21.15.76:0/276462790 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:06:30.016 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.012+0000 7f786e720700 1 --2- 172.21.15.76:0/276462790 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7868101990 0x7f786819e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:06:30.016 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.012+0000 7f786d71e700 1 --2- 172.21.15.76:0/276462790 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7868100fd0 0x7f7868197440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:06:30.016 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.012+0000 7f786df1f700 1 -- 172.21.15.76:0/276462790 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7868101990 msgr2=0x7f786819e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:06:30.016 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.012+0000 7f786df1f700 1 --2- 172.21.15.76:0/276462790 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7868101990 0x7f786819e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:30.016 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.012+0000 7f786df1f700 1 -- 172.21.15.76:0/276462790 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7868100fd0 msgr2=0x7f7868197440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:06:30.016 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.012+0000 7f786df1f700 1 --2- 172.21.15.76:0/276462790 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7868100fd0 0x7f7868197440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:30.017 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.012+0000 7f786df1f700 1 -- 172.21.15.76:0/276462790 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7860009d00 con 0x7f78680ffe80 2024-06-02T05:06:30.017 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.012+0000 7f786e720700 1 --2- 172.21.15.76:0/276462790 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7868101990 0x7f786819e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T05:06:30.017 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.012+0000 7f786d71e700 1 --2- 172.21.15.76:0/276462790 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7868100fd0 0x7f7868197440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T05:06:30.017 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.012+0000 7f786df1f700 1 --2- 172.21.15.76:0/276462790 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f78680ffe80 0x7f7868196f00 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f785800e9a0 tx=0x7f785800ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:06:30.017 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.012+0000 7f785effd700 1 -- 172.21.15.76:0/276462790 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7858009790 con 0x7f78680ffe80 2024-06-02T05:06:30.017 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.012+0000 7f785effd700 1 -- 172.21.15.76:0/276462790 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f785800cbd0 con 0x7f78680ffe80 2024-06-02T05:06:30.017 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.012+0000 7f7870183700 1 -- 172.21.15.76:0/276462790 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f786819efe0 con 0x7f78680ffe80 2024-06-02T05:06:30.017 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.012+0000 7f785effd700 1 -- 172.21.15.76:0/276462790 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7858018680 con 0x7f78680ffe80 2024-06-02T05:06:30.017 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.012+0000 7f7870183700 1 -- 172.21.15.76:0/276462790 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f786819f400 con 0x7f78680ffe80 2024-06-02T05:06:30.017 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.013+0000 7f7870183700 1 -- 172.21.15.76:0/276462790 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7868067460 con 0x7f78680ffe80 2024-06-02T05:06:30.018 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.014+0000 7f785effd700 1 -- 172.21.15.76:0/276462790 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f785800cd40 con 0x7f78680ffe80 2024-06-02T05:06:30.018 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.015+0000 7f785effd700 1 --2- 172.21.15.76:0/276462790 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f78540a1120 0x7f78540a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:06:30.018 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.015+0000 7f785effd700 1 -- 172.21.15.76:0/276462790 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f7858014070 con 0x7f78680ffe80 2024-06-02T05:06:30.018 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.015+0000 7f786d71e700 1 --2- 172.21.15.76:0/276462790 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f78540a1120 0x7f78540a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:06:30.018 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.015+0000 7f786d71e700 1 --2- 172.21.15.76:0/276462790 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f78540a1120 0x7f78540a35e0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f7864005fd0 tx=0x7f7864005ee0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:06:30.019 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.018+0000 7f785effd700 1 -- 172.21.15.76:0/276462790 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f7858096540 con 0x7f78680ffe80 2024-06-02T05:06:30.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:06:29 smithi192 ceph-mon[47933]: pgmap v775: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2.3 KiB/s wr, 6 op/s 2024-06-02T05:06:30.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:06:29 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/4026773062' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-06-02T05:06:30.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:06:29 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/2445255903' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T05:06:30.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:06:29 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/1062343104' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-02T05:06:30.219 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.217+0000 7f7870183700 1 -- 172.21.15.76:0/276462790 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f786810b6e0 con 0x7f78680ffe80 2024-06-02T05:06:30.219 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.217+0000 7f785effd700 1 -- 172.21.15.76:0/276462790 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v84) v1 ==== 104+0+11 (secure 0 0 0) 0x7f78580260a0 con 0x7f78680ffe80 2024-06-02T05:06:30.219 INFO:teuthology.orchestra.run.smithi076.stdout:pg_num: 32 2024-06-02T05:06:30.221 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.219+0000 7f7870183700 1 -- 172.21.15.76:0/276462790 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f78540a1120 msgr2=0x7f78540a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:06:30.221 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.220+0000 7f7870183700 1 --2- 172.21.15.76:0/276462790 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f78540a1120 0x7f78540a35e0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f7864005fd0 tx=0x7f7864005ee0 comp rx=0 tx=0).stop 2024-06-02T05:06:30.221 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.220+0000 7f7870183700 1 -- 172.21.15.76:0/276462790 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f78680ffe80 msgr2=0x7f7868196f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:06:30.221 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.220+0000 7f7870183700 1 --2- 172.21.15.76:0/276462790 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f78680ffe80 0x7f7868196f00 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f785800e9a0 tx=0x7f785800ed60 comp rx=0 tx=0).stop 2024-06-02T05:06:30.221 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.220+0000 7f7870183700 1 -- 172.21.15.76:0/276462790 shutdown_connections 2024-06-02T05:06:30.221 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.220+0000 7f7870183700 1 --2- 172.21.15.76:0/276462790 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7868101990 0x7f786819e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:30.221 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.220+0000 7f7870183700 1 --2- 172.21.15.76:0/276462790 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f78680ffe80 0x7f7868196f00 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:30.221 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.220+0000 7f7870183700 1 --2- 172.21.15.76:0/276462790 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f78540a1120 0x7f78540a35e0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:30.221 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.220+0000 7f7870183700 1 --2- 172.21.15.76:0/276462790 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7868100fd0 0x7f7868197440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:30.221 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.220+0000 7f7870183700 1 -- 172.21.15.76:0/276462790 >> 172.21.15.76:0/276462790 conn(0x7f78680fb3f0 msgr2=0x7f78680fcf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:06:30.222 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.220+0000 7f7870183700 1 -- 172.21.15.76:0/276462790 shutdown_connections 2024-06-02T05:06:30.222 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.220+0000 7f7870183700 1 -- 172.21.15.76:0/276462790 wait complete. 2024-06-02T05:06:30.232 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:06:29 smithi076 ceph-mon[42935]: pgmap v775: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2.3 KiB/s wr, 6 op/s 2024-06-02T05:06:30.232 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:06:29 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/4026773062' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-06-02T05:06:30.232 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:06:29 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/2445255903' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T05:06:30.232 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:06:29 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/1062343104' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-02T05:06:30.233 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-06-02T05:06:30.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:06:29 smithi119 ceph-mon[46633]: pgmap v775: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2.3 KiB/s wr, 6 op/s 2024-06-02T05:06:30.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:06:29 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/4026773062' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-06-02T05:06:30.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:06:29 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/2445255903' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T05:06:30.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:06:29 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/1062343104' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-02T05:06:30.364 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.357+0000 7f3f9aaad700 1 -- 172.21.15.76:0/1459172271 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3f941001b0 msgr2=0x7f3f94100630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:06:30.365 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.357+0000 7f3f9aaad700 1 --2- 172.21.15.76:0/1459172271 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3f941001b0 0x7f3f94100630 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f3f800099c0 tx=0x7f3f80009cd0 comp rx=0 tx=0).stop 2024-06-02T05:06:30.365 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.357+0000 7f3f9aaad700 1 -- 172.21.15.76:0/1459172271 shutdown_connections 2024-06-02T05:06:30.365 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.357+0000 7f3f9aaad700 1 --2- 172.21.15.76:0/1459172271 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3f94100b70 0x7f3f94100ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:30.365 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.357+0000 7f3f9aaad700 1 --2- 172.21.15.76:0/1459172271 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3f940ff850 0x7f3f940ffc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:30.365 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.357+0000 7f3f9aaad700 1 --2- 172.21.15.76:0/1459172271 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3f941001b0 0x7f3f94100630 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:30.365 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.357+0000 7f3f9aaad700 1 -- 172.21.15.76:0/1459172271 >> 172.21.15.76:0/1459172271 conn(0x7f3f940fb3f0 msgr2=0x7f3f940fd830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:06:30.365 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.357+0000 7f3f9aaad700 1 -- 172.21.15.76:0/1459172271 shutdown_connections 2024-06-02T05:06:30.365 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.357+0000 7f3f9aaad700 1 -- 172.21.15.76:0/1459172271 wait complete. 2024-06-02T05:06:30.365 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.358+0000 7f3f9aaad700 1 Processor -- start 2024-06-02T05:06:30.365 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.358+0000 7f3f9aaad700 1 -- start start 2024-06-02T05:06:30.365 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.358+0000 7f3f9aaad700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3f940ff850 0x7f3f94198f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:06:30.366 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.358+0000 7f3f9aaad700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3f941001b0 0x7f3f941994d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:06:30.366 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.358+0000 7f3f9aaad700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3f94100b70 0x7f3f941a04f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:06:30.366 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.358+0000 7f3f9aaad700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f941a0ac0 con 0x7f3f940ff850 2024-06-02T05:06:30.366 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.358+0000 7f3f9aaad700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f941a0c00 con 0x7f3f941001b0 2024-06-02T05:06:30.366 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.358+0000 7f3f9aaad700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f941a0d90 con 0x7f3f94100b70 2024-06-02T05:06:30.366 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.358+0000 7f3f98849700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3f940ff850 0x7f3f94198f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:06:30.366 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.358+0000 7f3f98849700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3f940ff850 0x7f3f94198f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:47168/0 (socket says 172.21.15.76:47168) 2024-06-02T05:06:30.366 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.358+0000 7f3f98849700 1 -- 172.21.15.76:0/2981864435 learned_addr learned my addr 172.21.15.76:0/2981864435 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:06:30.366 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.358+0000 7f3f93fff700 1 --2- 172.21.15.76:0/2981864435 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3f941001b0 0x7f3f941994d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:06:30.366 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.359+0000 7f3f98849700 1 -- 172.21.15.76:0/2981864435 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3f94100b70 msgr2=0x7f3f941a04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:06:30.366 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.359+0000 7f3f9904a700 1 --2- 172.21.15.76:0/2981864435 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3f94100b70 0x7f3f941a04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:06:30.366 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.359+0000 7f3f98849700 1 --2- 172.21.15.76:0/2981864435 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3f94100b70 0x7f3f941a04f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:30.367 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.359+0000 7f3f98849700 1 -- 172.21.15.76:0/2981864435 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3f941001b0 msgr2=0x7f3f941994d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:06:30.367 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.359+0000 7f3f98849700 1 --2- 172.21.15.76:0/2981864435 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3f941001b0 0x7f3f941994d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:30.367 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.359+0000 7f3f98849700 1 -- 172.21.15.76:0/2981864435 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f800095f0 con 0x7f3f940ff850 2024-06-02T05:06:30.367 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.359+0000 7f3f93fff700 1 --2- 172.21.15.76:0/2981864435 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3f941001b0 0x7f3f941994d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T05:06:30.367 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.359+0000 7f3f98849700 1 --2- 172.21.15.76:0/2981864435 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3f940ff850 0x7f3f94198f90 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f3f8800c920 tx=0x7f3f8800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:06:30.367 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.359+0000 7f3f91ffb700 1 -- 172.21.15.76:0/2981864435 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f88007b00 con 0x7f3f940ff850 2024-06-02T05:06:30.367 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.359+0000 7f3f91ffb700 1 -- 172.21.15.76:0/2981864435 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3f88004cc0 con 0x7f3f940ff850 2024-06-02T05:06:30.367 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.359+0000 7f3f91ffb700 1 -- 172.21.15.76:0/2981864435 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f88005590 con 0x7f3f940ff850 2024-06-02T05:06:30.367 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.359+0000 7f3f9aaad700 1 -- 172.21.15.76:0/2981864435 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f941a1070 con 0x7f3f940ff850 2024-06-02T05:06:30.367 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.359+0000 7f3f9aaad700 1 -- 172.21.15.76:0/2981864435 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f941a1530 con 0x7f3f940ff850 2024-06-02T05:06:30.367 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.360+0000 7f3f9aaad700 1 -- 172.21.15.76:0/2981864435 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f9410a850 con 0x7f3f940ff850 2024-06-02T05:06:30.367 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.361+0000 7f3f91ffb700 1 -- 172.21.15.76:0/2981864435 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f3f88004750 con 0x7f3f940ff850 2024-06-02T05:06:30.367 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.362+0000 7f3f91ffb700 1 --2- 172.21.15.76:0/2981864435 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f3f840a1120 0x7f3f840a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:06:30.368 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.362+0000 7f3f93fff700 1 --2- 172.21.15.76:0/2981864435 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f3f840a1120 0x7f3f840a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:06:30.368 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.362+0000 7f3f91ffb700 1 -- 172.21.15.76:0/2981864435 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f3f880ccc70 con 0x7f3f940ff850 2024-06-02T05:06:30.368 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.362+0000 7f3f93fff700 1 --2- 172.21.15.76:0/2981864435 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f3f840a1120 0x7f3f840a35e0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f3f80006010 tx=0x7f3f80009510 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:06:30.368 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.366+0000 7f3f91ffb700 1 -- 172.21.15.76:0/2981864435 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f3f88096060 con 0x7f3f940ff850 2024-06-02T05:06:30.565 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.564+0000 7f3f9aaad700 1 -- 172.21.15.76:0/2981864435 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3f9410a230 con 0x7f3f940ff850 2024-06-02T05:06:30.565 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.564+0000 7f3f91ffb700 1 -- 172.21.15.76:0/2981864435 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v84) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3f8801d020 con 0x7f3f940ff850 2024-06-02T05:06:30.565 INFO:teuthology.orchestra.run.smithi076.stdout:pg_num: 64 2024-06-02T05:06:30.568 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.566+0000 7f3f9aaad700 1 -- 172.21.15.76:0/2981864435 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f3f840a1120 msgr2=0x7f3f840a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:06:30.568 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.566+0000 7f3f9aaad700 1 --2- 172.21.15.76:0/2981864435 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f3f840a1120 0x7f3f840a35e0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f3f80006010 tx=0x7f3f80009510 comp rx=0 tx=0).stop 2024-06-02T05:06:30.568 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.566+0000 7f3f9aaad700 1 -- 172.21.15.76:0/2981864435 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3f940ff850 msgr2=0x7f3f94198f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:06:30.568 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.566+0000 7f3f9aaad700 1 --2- 172.21.15.76:0/2981864435 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3f940ff850 0x7f3f94198f90 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f3f8800c920 tx=0x7f3f8800cce0 comp rx=0 tx=0).stop 2024-06-02T05:06:30.568 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.567+0000 7f3f9aaad700 1 -- 172.21.15.76:0/2981864435 shutdown_connections 2024-06-02T05:06:30.568 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.567+0000 7f3f9aaad700 1 --2- 172.21.15.76:0/2981864435 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3f94100b70 0x7f3f941a04f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:30.568 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.567+0000 7f3f9aaad700 1 --2- 172.21.15.76:0/2981864435 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3f940ff850 0x7f3f94198f90 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:30.568 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.567+0000 7f3f9aaad700 1 --2- 172.21.15.76:0/2981864435 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f3f840a1120 0x7f3f840a35e0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:30.568 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.567+0000 7f3f9aaad700 1 --2- 172.21.15.76:0/2981864435 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3f941001b0 0x7f3f941994d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:30.569 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.567+0000 7f3f9aaad700 1 -- 172.21.15.76:0/2981864435 >> 172.21.15.76:0/2981864435 conn(0x7f3f940fb3f0 msgr2=0x7f3f940fcbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:06:30.569 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.567+0000 7f3f9aaad700 1 -- 172.21.15.76:0/2981864435 shutdown_connections 2024-06-02T05:06:30.569 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.567+0000 7f3f9aaad700 1 -- 172.21.15.76:0/2981864435 wait complete. 2024-06-02T05:06:30.580 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-06-02T05:06:30.708 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.704+0000 7fbd32bfc700 1 -- 172.21.15.76:0/2845203519 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbd2c100fd0 msgr2=0x7fbd2c101450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:06:30.708 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.704+0000 7fbd32bfc700 1 --2- 172.21.15.76:0/2845203519 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbd2c100fd0 0x7fbd2c101450 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fbd18009990 tx=0x7fbd18009ca0 comp rx=0 tx=0).stop 2024-06-02T05:06:30.708 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.705+0000 7fbd32bfc700 1 -- 172.21.15.76:0/2845203519 shutdown_connections 2024-06-02T05:06:30.708 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.705+0000 7fbd32bfc700 1 --2- 172.21.15.76:0/2845203519 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbd2c101990 0x7fbd2c1082b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:30.708 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.705+0000 7fbd32bfc700 1 --2- 172.21.15.76:0/2845203519 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbd2c0ffe80 0x7fbd2c1002a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:30.708 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.705+0000 7fbd32bfc700 1 --2- 172.21.15.76:0/2845203519 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbd2c100fd0 0x7fbd2c101450 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:30.708 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.705+0000 7fbd32bfc700 1 -- 172.21.15.76:0/2845203519 >> 172.21.15.76:0/2845203519 conn(0x7fbd2c0fb3f0 msgr2=0x7fbd2c0fd830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:06:30.708 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.705+0000 7fbd32bfc700 1 -- 172.21.15.76:0/2845203519 shutdown_connections 2024-06-02T05:06:30.708 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.705+0000 7fbd32bfc700 1 -- 172.21.15.76:0/2845203519 wait complete. 2024-06-02T05:06:30.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.705+0000 7fbd32bfc700 1 Processor -- start 2024-06-02T05:06:30.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.705+0000 7fbd32bfc700 1 -- start start 2024-06-02T05:06:30.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.706+0000 7fbd32bfc700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbd2c0ffe80 0x7fbd2c195cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:06:30.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.706+0000 7fbd32bfc700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbd2c100fd0 0x7fbd2c196200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:06:30.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.706+0000 7fbd32bfc700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbd2c101990 0x7fbd2c19d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:06:30.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.706+0000 7fbd32bfc700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2c19d7e0 con 0x7fbd2c101990 2024-06-02T05:06:30.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.706+0000 7fbd32bfc700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2c19d950 con 0x7fbd2c100fd0 2024-06-02T05:06:30.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.706+0000 7fbd32bfc700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2c19db10 con 0x7fbd2c0ffe80 2024-06-02T05:06:30.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.706+0000 7fbd31199700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbd2c101990 0x7fbd2c19d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:06:30.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.706+0000 7fbd31199700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbd2c101990 0x7fbd2c19d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:47200/0 (socket says 172.21.15.76:47200) 2024-06-02T05:06:30.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.706+0000 7fbd31199700 1 -- 172.21.15.76:0/2519485159 learned_addr learned my addr 172.21.15.76:0/2519485159 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:06:30.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.706+0000 7fbd30998700 1 --2- 172.21.15.76:0/2519485159 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbd2c0ffe80 0x7fbd2c195cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:06:30.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.706+0000 7fbd2bfff700 1 --2- 172.21.15.76:0/2519485159 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbd2c100fd0 0x7fbd2c196200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:06:30.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.706+0000 7fbd31199700 1 -- 172.21.15.76:0/2519485159 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbd2c0ffe80 msgr2=0x7fbd2c195cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:06:30.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.706+0000 7fbd31199700 1 --2- 172.21.15.76:0/2519485159 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbd2c0ffe80 0x7fbd2c195cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:30.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.706+0000 7fbd31199700 1 -- 172.21.15.76:0/2519485159 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbd2c100fd0 msgr2=0x7fbd2c196200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:06:30.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.706+0000 7fbd31199700 1 --2- 172.21.15.76:0/2519485159 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbd2c100fd0 0x7fbd2c196200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:30.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.706+0000 7fbd31199700 1 -- 172.21.15.76:0/2519485159 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd180095f0 con 0x7fbd2c101990 2024-06-02T05:06:30.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.706+0000 7fbd31199700 1 --2- 172.21.15.76:0/2519485159 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbd2c101990 0x7fbd2c19d210 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fbd2400ef30 tx=0x7fbd2400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:06:30.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.706+0000 7fbd29ffb700 1 -- 172.21.15.76:0/2519485159 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd24018070 con 0x7fbd2c101990 2024-06-02T05:06:30.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.706+0000 7fbd29ffb700 1 -- 172.21.15.76:0/2519485159 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbd2400f040 con 0x7fbd2c101990 2024-06-02T05:06:30.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.706+0000 7fbd32bfc700 1 -- 172.21.15.76:0/2519485159 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd2c19dd90 con 0x7fbd2c101990 2024-06-02T05:06:30.711 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.706+0000 7fbd29ffb700 1 -- 172.21.15.76:0/2519485159 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd2400cbc0 con 0x7fbd2c101990 2024-06-02T05:06:30.711 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.707+0000 7fbd32bfc700 1 -- 172.21.15.76:0/2519485159 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd2c19e1c0 con 0x7fbd2c101990 2024-06-02T05:06:30.712 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.708+0000 7fbd32bfc700 1 -- 172.21.15.76:0/2519485159 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd2c107340 con 0x7fbd2c101990 2024-06-02T05:06:30.712 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.708+0000 7fbd29ffb700 1 -- 172.21.15.76:0/2519485159 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fbd24007500 con 0x7fbd2c101990 2024-06-02T05:06:30.712 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.709+0000 7fbd29ffb700 1 --2- 172.21.15.76:0/2519485159 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fbd1c0a1120 0x7fbd1c0a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:06:30.712 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.709+0000 7fbd30998700 1 --2- 172.21.15.76:0/2519485159 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fbd1c0a1120 0x7fbd1c0a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:06:30.712 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.709+0000 7fbd29ffb700 1 -- 172.21.15.76:0/2519485159 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7fbd240cc6c0 con 0x7fbd2c101990 2024-06-02T05:06:30.712 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.710+0000 7fbd30998700 1 --2- 172.21.15.76:0/2519485159 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fbd1c0a1120 0x7fbd1c0a35e0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c0fd870 tx=0x7fbd2000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:06:30.714 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.714+0000 7fbd29ffb700 1 -- 172.21.15.76:0/2519485159 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fbd24095ba0 con 0x7fbd2c101990 2024-06-02T05:06:30.916 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.915+0000 7fbd32bfc700 1 -- 172.21.15.76:0/2519485159 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fbd2c10b6e0 con 0x7fbd2c101990 2024-06-02T05:06:30.916 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.916+0000 7fbd29ffb700 1 -- 172.21.15.76:0/2519485159 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v84) v1 ==== 103+0+11 (secure 0 0 0) 0x7fbd240991c0 con 0x7fbd2c101990 2024-06-02T05:06:30.917 INFO:teuthology.orchestra.run.smithi076.stdout:pg_num: 32 2024-06-02T05:06:30.919 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.918+0000 7fbd32bfc700 1 -- 172.21.15.76:0/2519485159 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fbd1c0a1120 msgr2=0x7fbd1c0a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:06:30.919 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.918+0000 7fbd32bfc700 1 --2- 172.21.15.76:0/2519485159 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fbd1c0a1120 0x7fbd1c0a35e0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c0fd870 tx=0x7fbd2000b410 comp rx=0 tx=0).stop 2024-06-02T05:06:30.919 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.918+0000 7fbd32bfc700 1 -- 172.21.15.76:0/2519485159 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbd2c101990 msgr2=0x7fbd2c19d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:06:30.919 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.918+0000 7fbd32bfc700 1 --2- 172.21.15.76:0/2519485159 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbd2c101990 0x7fbd2c19d210 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fbd2400ef30 tx=0x7fbd2400c3a0 comp rx=0 tx=0).stop 2024-06-02T05:06:30.919 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.918+0000 7fbd32bfc700 1 -- 172.21.15.76:0/2519485159 shutdown_connections 2024-06-02T05:06:30.919 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.918+0000 7fbd32bfc700 1 --2- 172.21.15.76:0/2519485159 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbd2c101990 0x7fbd2c19d210 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:30.919 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.918+0000 7fbd32bfc700 1 --2- 172.21.15.76:0/2519485159 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbd2c0ffe80 0x7fbd2c195cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:30.919 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.918+0000 7fbd32bfc700 1 --2- 172.21.15.76:0/2519485159 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7fbd1c0a1120 0x7fbd1c0a35e0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:30.920 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.918+0000 7fbd32bfc700 1 --2- 172.21.15.76:0/2519485159 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbd2c100fd0 0x7fbd2c196200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:30.920 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.918+0000 7fbd32bfc700 1 -- 172.21.15.76:0/2519485159 >> 172.21.15.76:0/2519485159 conn(0x7fbd2c0fb3f0 msgr2=0x7fbd2c104480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:06:30.920 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.918+0000 7fbd32bfc700 1 -- 172.21.15.76:0/2519485159 shutdown_connections 2024-06-02T05:06:30.920 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:30.918+0000 7fbd32bfc700 1 -- 172.21.15.76:0/2519485159 wait complete. 2024-06-02T05:06:30.932 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-06-02T05:06:31.057 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:31.056+0000 7f695344a700 1 -- 172.21.15.76:0/3985528244 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f694c100fb0 msgr2=0x7f694c101430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:06:31.057 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:31.056+0000 7f695344a700 1 --2- 172.21.15.76:0/3985528244 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f694c100fb0 0x7f694c101430 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f693c009990 tx=0x7f693c009ca0 comp rx=0 tx=0).stop 2024-06-02T05:06:31.057 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:31.056+0000 7f695344a700 1 -- 172.21.15.76:0/3985528244 shutdown_connections 2024-06-02T05:06:31.057 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:31.056+0000 7f695344a700 1 --2- 172.21.15.76:0/3985528244 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f694c101970 0x7f694c108290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:31.057 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:31.056+0000 7f695344a700 1 --2- 172.21.15.76:0/3985528244 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f694c0ffe60 0x7f694c100280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:31.057 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:31.056+0000 7f695344a700 1 --2- 172.21.15.76:0/3985528244 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f694c100fb0 0x7f694c101430 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:31.057 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:31.056+0000 7f695344a700 1 -- 172.21.15.76:0/3985528244 >> 172.21.15.76:0/3985528244 conn(0x7f694c0fb3f0 msgr2=0x7f694c0fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:06:31.058 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:31.056+0000 7f695344a700 1 -- 172.21.15.76:0/3985528244 shutdown_connections 2024-06-02T05:06:31.058 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:31.056+0000 7f695344a700 1 -- 172.21.15.76:0/3985528244 wait complete. 2024-06-02T05:06:31.060 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:31.057+0000 7f695344a700 1 Processor -- start 2024-06-02T05:06:31.060 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:31.057+0000 7f695344a700 1 -- start start 2024-06-02T05:06:31.060 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:31.057+0000 7f695344a700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f694c0ffe60 0x7f694c198ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:06:31.060 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:31.057+0000 7f695344a700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f694c100fb0 0x7f694c199530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:06:31.060 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:31.057+0000 7f695344a700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f694c101970 0x7f694c1a0550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:06:31.060 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:31.057+0000 7f695344a700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f694c1a0b20 con 0x7f694c101970 2024-06-02T05:06:31.060 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:31.057+0000 7f695344a700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f694c1a0c60 con 0x7f694c0ffe60 2024-06-02T05:06:31.060 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:31.057+0000 7f695344a700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f694c1a0df0 con 0x7f694c100fb0 2024-06-02T05:06:31.061 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:31.057+0000 7f69519e7700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f694c101970 0x7f694c1a0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:06:31.061 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:31.057+0000 7f69519e7700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f694c101970 0x7f694c1a0550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:47224/0 (socket says 172.21.15.76:47224) 2024-06-02T05:06:31.061 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:31.057+0000 7f69519e7700 1 -- 172.21.15.76:0/3512827454 learned_addr learned my addr 172.21.15.76:0/3512827454 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-06-02T05:06:31.061 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:31.057+0000 7f69509e5700 1 --2- 172.21.15.76:0/3512827454 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f694c100fb0 0x7f694c199530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:06:31.061 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:31.057+0000 7f69511e6700 1 --2- 172.21.15.76:0/3512827454 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f694c0ffe60 0x7f694c198ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:06:31.061 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:31.057+0000 7f69519e7700 1 -- 172.21.15.76:0/3512827454 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f694c100fb0 msgr2=0x7f694c199530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:06:31.061 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:31.057+0000 7f69519e7700 1 --2- 172.21.15.76:0/3512827454 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f694c100fb0 0x7f694c199530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:31.061 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:31.057+0000 7f69519e7700 1 -- 172.21.15.76:0/3512827454 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f694c0ffe60 msgr2=0x7f694c198ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:06:31.061 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:31.057+0000 7f69519e7700 1 --2- 172.21.15.76:0/3512827454 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f694c0ffe60 0x7f694c198ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:31.061 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:31.057+0000 7f69519e7700 1 -- 172.21.15.76:0/3512827454 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f693c0095f0 con 0x7f694c101970 2024-06-02T05:06:31.061 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:31.057+0000 7f69519e7700 1 --2- 172.21.15.76:0/3512827454 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f694c101970 0x7f694c1a0550 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f694400ada0 tx=0x7f694400c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:06:31.061 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:31.058+0000 7f69427fc700 1 -- 172.21.15.76:0/3512827454 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f694400f070 con 0x7f694c101970 2024-06-02T05:06:31.061 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:31.058+0000 7f69427fc700 1 -- 172.21.15.76:0/3512827454 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6944007b30 con 0x7f694c101970 2024-06-02T05:06:31.062 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:31.058+0000 7f695344a700 1 -- 172.21.15.76:0/3512827454 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f694c1a10d0 con 0x7f694c101970 2024-06-02T05:06:31.062 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:31.058+0000 7f69427fc700 1 -- 172.21.15.76:0/3512827454 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6944005280 con 0x7f694c101970 2024-06-02T05:06:31.062 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:31.058+0000 7f695344a700 1 -- 172.21.15.76:0/3512827454 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f694c1a1590 con 0x7f694c101970 2024-06-02T05:06:31.062 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:31.059+0000 7f695344a700 1 -- 172.21.15.76:0/3512827454 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f694c1072c0 con 0x7f694c101970 2024-06-02T05:06:31.063 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:31.060+0000 7f69427fc700 1 -- 172.21.15.76:0/3512827454 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f694400c980 con 0x7f694c101970 2024-06-02T05:06:31.063 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:31.060+0000 7f69427fc700 1 --2- 172.21.15.76:0/3512827454 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f69380a1120 0x7f69380a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T05:06:31.063 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:31.060+0000 7f69511e6700 1 --2- 172.21.15.76:0/3512827454 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f69380a1120 0x7f69380a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T05:06:31.063 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:31.060+0000 7f69427fc700 1 -- 172.21.15.76:0/3512827454 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 9057+0+0 (secure 0 0 0) 0x7f69440cc8a0 con 0x7f694c101970 2024-06-02T05:06:31.063 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:31.061+0000 7f69511e6700 1 --2- 172.21.15.76:0/3512827454 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f69380a1120 0x7f69380a35e0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f6948009bf0 tx=0x7f6948009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T05:06:31.065 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:31.064+0000 7f69427fc700 1 -- 172.21.15.76:0/3512827454 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f6944095d80 con 0x7f694c101970 2024-06-02T05:06:31.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:06:30 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/276462790' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-06-02T05:06:31.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:06:30 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/2981864435' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-06-02T05:06:31.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:06:30 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/2519485159' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-06-02T05:06:31.235 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:06:30 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/276462790' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-06-02T05:06:31.235 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:06:30 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/2981864435' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-06-02T05:06:31.236 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:06:30 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/2519485159' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-06-02T05:06:31.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:31.282+0000 7f695344a700 1 -- 172.21.15.76:0/3512827454 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f694c10a4a0 con 0x7f694c101970 2024-06-02T05:06:31.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:31.282+0000 7f69427fc700 1 -- 172.21.15.76:0/3512827454 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v84) v1 ==== 81+0+590 (secure 0 0 0) 0x7f694400cc30 con 0x7f694c101970 2024-06-02T05:06:31.283 INFO:teuthology.orchestra.run.smithi076.stdout:172.21.15.76:6801/4200406736 2024-06-03T04:43:06.092916+0000 2024-06-02T05:06:31.283 INFO:teuthology.orchestra.run.smithi076.stdout:172.21.15.76:6800/4200406736 2024-06-03T04:43:06.092916+0000 2024-06-02T05:06:31.283 INFO:teuthology.orchestra.run.smithi076.stdout:172.21.15.76:0/1524144593 2024-06-03T04:43:06.092916+0000 2024-06-02T05:06:31.284 INFO:teuthology.orchestra.run.smithi076.stdout:172.21.15.76:0/3269372590 2024-06-03T04:43:06.092916+0000 2024-06-02T05:06:31.284 INFO:teuthology.orchestra.run.smithi076.stdout:172.21.15.76:0/3570893846 2024-06-03T04:42:44.872236+0000 2024-06-02T05:06:31.284 INFO:teuthology.orchestra.run.smithi076.stdout:172.21.15.76:0/902035790 2024-06-03T04:43:06.092916+0000 2024-06-02T05:06:31.284 INFO:teuthology.orchestra.run.smithi076.stdout:172.21.15.76:6800/2550846765 2024-06-03T04:42:44.872236+0000 2024-06-02T05:06:31.284 INFO:teuthology.orchestra.run.smithi076.stdout:172.21.15.76:6801/2550846765 2024-06-03T04:42:44.872236+0000 2024-06-02T05:06:31.284 INFO:teuthology.orchestra.run.smithi076.stdout:172.21.15.76:0/2646712763 2024-06-03T04:42:44.872236+0000 2024-06-02T05:06:31.284 INFO:teuthology.orchestra.run.smithi076.stdout:172.21.15.76:0/964578813 2024-06-03T04:42:44.872236+0000 2024-06-02T05:06:31.285 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:31.284+0000 7f695344a700 1 -- 172.21.15.76:0/3512827454 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f69380a1120 msgr2=0x7f69380a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:06:31.285 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:31.284+0000 7f695344a700 1 --2- 172.21.15.76:0/3512827454 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f69380a1120 0x7f69380a35e0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f6948009bf0 tx=0x7f6948009260 comp rx=0 tx=0).stop 2024-06-02T05:06:31.285 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:31.284+0000 7f695344a700 1 -- 172.21.15.76:0/3512827454 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f694c101970 msgr2=0x7f694c1a0550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T05:06:31.286 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:31.284+0000 7f695344a700 1 --2- 172.21.15.76:0/3512827454 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f694c101970 0x7f694c1a0550 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f694400ada0 tx=0x7f694400c330 comp rx=0 tx=0).stop 2024-06-02T05:06:31.286 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:31.284+0000 7f695344a700 1 -- 172.21.15.76:0/3512827454 shutdown_connections 2024-06-02T05:06:31.286 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:31.284+0000 7f695344a700 1 --2- 172.21.15.76:0/3512827454 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f694c101970 0x7f694c1a0550 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:31.286 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:31.284+0000 7f695344a700 1 --2- 172.21.15.76:0/3512827454 >> [v2:172.21.15.76:6800/2591353090,v1:172.21.15.76:6801/2591353090] conn(0x7f69380a1120 0x7f69380a35e0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:31.286 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:31.284+0000 7f695344a700 1 --2- 172.21.15.76:0/3512827454 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f694c0ffe60 0x7f694c198ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:31.286 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:31.284+0000 7f695344a700 1 --2- 172.21.15.76:0/3512827454 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f694c100fb0 0x7f694c199530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T05:06:31.286 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:31.284+0000 7f695344a700 1 -- 172.21.15.76:0/3512827454 >> 172.21.15.76:0/3512827454 conn(0x7f694c0fb3f0 msgr2=0x7f694c104400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T05:06:31.286 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:31.285+0000 7f695344a700 1 -- 172.21.15.76:0/3512827454 shutdown_connections 2024-06-02T05:06:31.286 INFO:teuthology.orchestra.run.smithi076.stderr:2024-06-02T05:06:31.285+0000 7f695344a700 1 -- 172.21.15.76:0/3512827454 wait complete. 2024-06-02T05:06:31.287 INFO:teuthology.orchestra.run.smithi076.stderr:listed 10 entries 2024-06-02T05:06:31.297 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi076.front.sepia.ceph.com... 2024-06-02T05:06:31.298 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T05:06:31.298 DEBUG:teuthology.orchestra.run.smithi076:> sudo fusermount -u /tmp/cephfs 2024-06-02T05:06:31.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:06:30 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/276462790' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-06-02T05:06:31.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:06:30 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/2981864435' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-06-02T05:06:31.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:06:30 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/2519485159' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-06-02T05:06:31.353 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi076.stderr:ceph-fuse[110234]: fuse finished with error 0 and tester_r 0 2024-06-02T05:06:31.456 INFO:teuthology.orchestra.run:waiting for 300 2024-06-02T05:06:32.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:06:31 smithi076 ceph-mon[42935]: pgmap v776: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 3.3 KiB/s wr, 9 op/s 2024-06-02T05:06:32.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:06:31 smithi076 ceph-mon[42935]: from='client.? 172.21.15.76:0/3512827454' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-06-02T05:06:32.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:06:31 smithi119 ceph-mon[46633]: pgmap v776: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 3.3 KiB/s wr, 9 op/s 2024-06-02T05:06:32.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:06:31 smithi119 ceph-mon[46633]: from='client.? 172.21.15.76:0/3512827454' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-06-02T05:06:32.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:06:31 smithi192 ceph-mon[47933]: pgmap v776: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 3.3 KiB/s wr, 9 op/s 2024-06-02T05:06:32.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:06:31 smithi192 ceph-mon[47933]: from='client.? 172.21.15.76:0/3512827454' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-06-02T05:06:33.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:06:32 smithi076 ceph-mon[42935]: pgmap v777: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-06-02T05:06:33.346 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:06:32 smithi119 ceph-mon[46633]: pgmap v777: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-06-02T05:06:33.432 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:06:32 smithi192 ceph-mon[47933]: pgmap v777: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-06-02T05:06:36.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:06:35 smithi119 ceph-mon[46633]: pgmap v778: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 3.5 KiB/s wr, 8 op/s 2024-06-02T05:06:36.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:06:35 smithi192 ceph-mon[47933]: pgmap v778: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 3.5 KiB/s wr, 8 op/s 2024-06-02T05:06:36.234 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:06:35 smithi076 ceph-mon[42935]: pgmap v778: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 3.5 KiB/s wr, 8 op/s 2024-06-02T05:06:37.558 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi076.front.sepia.ceph.com 2024-06-02T05:06:37.558 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T05:06:37.559 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec rmdir -- /tmp/cephfs) 2024-06-02T05:06:37.596 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T05:06:37.596 DEBUG:teuthology.orchestra.run.smithi076:> ip netns list 2024-06-02T05:06:37.677 INFO:teuthology.orchestra.run.smithi076.stdout:ceph-ns--tmp-cephfs (id: 0) 2024-06-02T05:06:37.678 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T05:06:37.678 DEBUG:teuthology.orchestra.run.smithi076:> sudo ip netns delete ceph-ns--tmp-cephfs 2024-06-02T05:06:37.763 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T05:06:37.763 DEBUG:teuthology.orchestra.run.smithi076:> sudo ip link delete ceph-brx 2024-06-02T05:06:37.851 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-06-02T05:06:37.861 INFO:tasks.cephadm:Teardown begin 2024-06-02T05:06:37.861 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e1979f064b0becde2020282c7e87cf3c5e98026c/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph_111a617aaeda17ec8908c7a46e47c4a09ebf905d/qa/tasks/cephadm.py", line 1750, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_e1979f064b0becde2020282c7e87cf3c5e98026c/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_111a617aaeda17ec8908c7a46e47c4a09ebf905d/qa/tasks/fwd_scrub.py", line 164, in task stop_all_fwd_scrubbers(ctx.ceph[config['cluster']].thrashers) File "/home/teuthworker/src/git.ceph.com_ceph_111a617aaeda17ec8908c7a46e47c4a09ebf905d/qa/tasks/fwd_scrub.py", line 99, in stop_all_fwd_scrubbers raise RuntimeError(f"error during scrub thrashing: {thrasher.exception}") RuntimeError: error during scrub thrashing: rank damage found: {'backtrace'} 2024-06-02T05:06:37.863 DEBUG:teuthology.orchestra.run.smithi076:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-06-02T05:06:37.909 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-06-02T05:06:37.945 DEBUG:teuthology.orchestra.run.smithi192:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-06-02T05:06:37.982 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-06-02T05:06:37.982 DEBUG:teuthology.orchestra.run.smithi076:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-06-02T05:06:38.007 DEBUG:teuthology.orchestra.run.smithi119:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-06-02T05:06:38.026 DEBUG:teuthology.orchestra.run.smithi192:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-06-02T05:06:38.045 INFO:tasks.cephadm:Stopping all daemons... 2024-06-02T05:06:38.046 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-06-02T05:06:38.046 DEBUG:teuthology.orchestra.run.smithi076:> sudo systemctl stop ceph-60ab6d30-209a-11ef-bc9b-c7b262605968@mon.a 2024-06-02T05:06:38.071 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:06:37 smithi076 ceph-mon[42935]: pgmap v779: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.5 KiB/s wr, 6 op/s 2024-06-02T05:06:38.096 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:06:37 smithi119 ceph-mon[46633]: pgmap v779: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.5 KiB/s wr, 6 op/s 2024-06-02T05:06:38.182 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:06:37 smithi192 ceph-mon[47933]: pgmap v779: 129 pgs: 129 active+clean; 1.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.5 KiB/s wr, 6 op/s 2024-06-02T05:06:38.449 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:06:38 smithi076 systemd[1]: Stopping Ceph mon.a for 60ab6d30-209a-11ef-bc9b-c7b262605968... 2024-06-02T05:06:38.450 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:06:38 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mon-a[42912]: 2024-06-02T05:06:38.277+0000 7f1519413700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-06-02T05:06:38.450 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:06:38 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mon-a[42912]: 2024-06-02T05:06:38.277+0000 7f1519413700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-06-02T05:06:38.734 INFO:journalctl@ceph.mon.a.smithi076.stdout:Jun 02 05:06:38 smithi076 bash[127847]: ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mon-a 2024-06-02T05:06:38.767 DEBUG:teuthology.orchestra.run.smithi076:> sudo pkill -f 'journalctl -f -n 0 -u ceph-60ab6d30-209a-11ef-bc9b-c7b262605968@mon.a.service' 2024-06-02T05:06:38.856 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-02T05:06:38.856 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-06-02T05:06:38.856 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-06-02T05:06:38.856 DEBUG:teuthology.orchestra.run.smithi119:> sudo systemctl stop ceph-60ab6d30-209a-11ef-bc9b-c7b262605968@mon.b 2024-06-02T05:06:39.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:06:38 smithi119 systemd[1]: Stopping Ceph mon.b for 60ab6d30-209a-11ef-bc9b-c7b262605968... 2024-06-02T05:06:39.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:06:39 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mon-b[46610]: 2024-06-02T05:06:39.120+0000 7fc1f7966700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-06-02T05:06:39.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:06:39 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mon-b[46610]: 2024-06-02T05:06:39.120+0000 7fc1f7966700 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-06-02T05:06:39.846 INFO:journalctl@ceph.mon.b.smithi119.stdout:Jun 02 05:06:39 smithi119 bash[89420]: ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mon-b 2024-06-02T05:06:39.911 DEBUG:teuthology.orchestra.run.smithi119:> sudo pkill -f 'journalctl -f -n 0 -u ceph-60ab6d30-209a-11ef-bc9b-c7b262605968@mon.b.service' 2024-06-02T05:06:39.961 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-02T05:06:39.962 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-06-02T05:06:39.962 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-06-02T05:06:39.962 DEBUG:teuthology.orchestra.run.smithi192:> sudo systemctl stop ceph-60ab6d30-209a-11ef-bc9b-c7b262605968@mon.c 2024-06-02T05:06:40.331 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:06:40 smithi192 systemd[1]: Stopping Ceph mon.c for 60ab6d30-209a-11ef-bc9b-c7b262605968... 2024-06-02T05:06:40.331 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:06:40 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mon-c[47910]: 2024-06-02T05:06:40.219+0000 7f9590c4f700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-06-02T05:06:40.331 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:06:40 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mon-c[47910]: 2024-06-02T05:06:40.219+0000 7f9590c4f700 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-06-02T05:06:40.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Jun 02 05:06:40 smithi192 bash[90502]: ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mon-c 2024-06-02T05:06:40.699 DEBUG:teuthology.orchestra.run.smithi192:> sudo pkill -f 'journalctl -f -n 0 -u ceph-60ab6d30-209a-11ef-bc9b-c7b262605968@mon.c.service' 2024-06-02T05:06:40.746 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-02T05:06:40.746 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-06-02T05:06:40.747 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-06-02T05:06:40.747 DEBUG:teuthology.orchestra.run.smithi076:> sudo systemctl stop ceph-60ab6d30-209a-11ef-bc9b-c7b262605968@mgr.x 2024-06-02T05:06:41.107 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Jun 02 05:06:40 smithi076 systemd[1]: Stopping Ceph mgr.x for 60ab6d30-209a-11ef-bc9b-c7b262605968... 2024-06-02T05:06:41.108 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Jun 02 05:06:40 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-x[43184]: 2024-06-02T05:06:40.993+0000 7fbea0159700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-02T05:06:41.430 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Jun 02 05:06:41 smithi076 bash[127989]: ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-x 2024-06-02T05:06:41.435 DEBUG:teuthology.orchestra.run.smithi076:> sudo pkill -f 'journalctl -f -n 0 -u ceph-60ab6d30-209a-11ef-bc9b-c7b262605968@mgr.x.service' 2024-06-02T05:06:41.472 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-02T05:06:41.473 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-06-02T05:06:41.473 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-06-02T05:06:41.473 DEBUG:teuthology.orchestra.run.smithi119:> sudo systemctl stop ceph-60ab6d30-209a-11ef-bc9b-c7b262605968@mgr.y 2024-06-02T05:06:41.847 INFO:journalctl@ceph.mgr.y.smithi119.stdout:Jun 02 05:06:41 smithi119 systemd[1]: Stopping Ceph mgr.y for 60ab6d30-209a-11ef-bc9b-c7b262605968... 2024-06-02T05:06:42.172 INFO:journalctl@ceph.mgr.y.smithi119.stdout:Jun 02 05:06:41 smithi119 bash[89568]: ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-y 2024-06-02T05:06:42.173 INFO:journalctl@ceph.mgr.y.smithi119.stdout:Jun 02 05:06:42 smithi119 systemd[1]: ceph-60ab6d30-209a-11ef-bc9b-c7b262605968@mgr.y.service: Main process exited, code=exited, status=143/n/a 2024-06-02T05:06:42.178 DEBUG:teuthology.orchestra.run.smithi119:> sudo pkill -f 'journalctl -f -n 0 -u ceph-60ab6d30-209a-11ef-bc9b-c7b262605968@mgr.y.service' 2024-06-02T05:06:42.216 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-02T05:06:42.216 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-06-02T05:06:42.217 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-06-02T05:06:42.217 DEBUG:teuthology.orchestra.run.smithi192:> sudo systemctl stop ceph-60ab6d30-209a-11ef-bc9b-c7b262605968@mgr.z 2024-06-02T05:06:42.550 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Jun 02 05:06:42 smithi192 systemd[1]: Stopping Ceph mgr.z for 60ab6d30-209a-11ef-bc9b-c7b262605968... 2024-06-02T05:06:42.862 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Jun 02 05:06:42 smithi192 bash[90651]: ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mgr-z 2024-06-02T05:06:42.862 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Jun 02 05:06:42 smithi192 systemd[1]: ceph-60ab6d30-209a-11ef-bc9b-c7b262605968@mgr.z.service: Main process exited, code=exited, status=143/n/a 2024-06-02T05:06:42.871 DEBUG:teuthology.orchestra.run.smithi192:> sudo pkill -f 'journalctl -f -n 0 -u ceph-60ab6d30-209a-11ef-bc9b-c7b262605968@mgr.z.service' 2024-06-02T05:06:42.908 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-02T05:06:42.909 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-06-02T05:06:42.909 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-06-02T05:06:42.909 DEBUG:teuthology.orchestra.run.smithi076:> sudo systemctl stop ceph-60ab6d30-209a-11ef-bc9b-c7b262605968@osd.0 2024-06-02T05:06:43.234 INFO:journalctl@ceph.osd.0.smithi076.stdout:Jun 02 05:06:42 smithi076 systemd[1]: Stopping Ceph osd.0 for 60ab6d30-209a-11ef-bc9b-c7b262605968... 2024-06-02T05:06:43.234 INFO:journalctl@ceph.osd.0.smithi076.stdout:Jun 02 05:06:43 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-0[61958]: 2024-06-02T05:06:43.142+0000 7f8e67eed700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-02T05:06:43.234 INFO:journalctl@ceph.osd.0.smithi076.stdout:Jun 02 05:06:43 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-0[61958]: 2024-06-02T05:06:43.142+0000 7f8e67eed700 -1 osd.0 84 *** Got signal Terminated *** 2024-06-02T05:06:43.234 INFO:journalctl@ceph.osd.0.smithi076.stdout:Jun 02 05:06:43 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-0[61958]: 2024-06-02T05:06:43.142+0000 7f8e67eed700 -1 osd.0 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-02T05:06:49.234 INFO:journalctl@ceph.osd.0.smithi076.stdout:Jun 02 05:06:48 smithi076 bash[128131]: ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-0 2024-06-02T05:06:50.315 DEBUG:teuthology.orchestra.run.smithi076:> sudo pkill -f 'journalctl -f -n 0 -u ceph-60ab6d30-209a-11ef-bc9b-c7b262605968@osd.0.service' 2024-06-02T05:06:50.358 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-02T05:06:50.358 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-06-02T05:06:50.358 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-06-02T05:06:50.358 DEBUG:teuthology.orchestra.run.smithi119:> sudo systemctl stop ceph-60ab6d30-209a-11ef-bc9b-c7b262605968@osd.1 2024-06-02T05:06:50.846 INFO:journalctl@ceph.osd.1.smithi119.stdout:Jun 02 05:06:50 smithi119 systemd[1]: Stopping Ceph osd.1 for 60ab6d30-209a-11ef-bc9b-c7b262605968... 2024-06-02T05:06:50.847 INFO:journalctl@ceph.osd.1.smithi119.stdout:Jun 02 05:06:50 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-1[51608]: 2024-06-02T05:06:50.585+0000 7f32ea9f9700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-02T05:06:50.847 INFO:journalctl@ceph.osd.1.smithi119.stdout:Jun 02 05:06:50 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-1[51608]: 2024-06-02T05:06:50.585+0000 7f32ea9f9700 -1 osd.1 84 *** Got signal Terminated *** 2024-06-02T05:06:50.847 INFO:journalctl@ceph.osd.1.smithi119.stdout:Jun 02 05:06:50 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-1[51608]: 2024-06-02T05:06:50.585+0000 7f32ea9f9700 -1 osd.1 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-02T05:06:56.598 INFO:journalctl@ceph.osd.1.smithi119.stdout:Jun 02 05:06:56 smithi119 bash[89710]: ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-1 2024-06-02T05:06:57.465 DEBUG:teuthology.orchestra.run.smithi119:> sudo pkill -f 'journalctl -f -n 0 -u ceph-60ab6d30-209a-11ef-bc9b-c7b262605968@osd.1.service' 2024-06-02T05:06:57.506 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-02T05:06:57.506 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-06-02T05:06:57.507 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-06-02T05:06:57.507 DEBUG:teuthology.orchestra.run.smithi192:> sudo systemctl stop ceph-60ab6d30-209a-11ef-bc9b-c7b262605968@osd.2 2024-06-02T05:06:57.932 INFO:journalctl@ceph.osd.2.smithi192.stdout:Jun 02 05:06:57 smithi192 systemd[1]: Stopping Ceph osd.2 for 60ab6d30-209a-11ef-bc9b-c7b262605968... 2024-06-02T05:06:57.932 INFO:journalctl@ceph.osd.2.smithi192.stdout:Jun 02 05:06:57 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-2[53703]: 2024-06-02T05:06:57.742+0000 7fdbe5975700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-02T05:06:57.933 INFO:journalctl@ceph.osd.2.smithi192.stdout:Jun 02 05:06:57 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-2[53703]: 2024-06-02T05:06:57.742+0000 7fdbe5975700 -1 osd.2 84 *** Got signal Terminated *** 2024-06-02T05:06:57.933 INFO:journalctl@ceph.osd.2.smithi192.stdout:Jun 02 05:06:57 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-2[53703]: 2024-06-02T05:06:57.742+0000 7fdbe5975700 -1 osd.2 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-02T05:07:03.682 INFO:journalctl@ceph.osd.2.smithi192.stdout:Jun 02 05:07:03 smithi192 bash[90805]: ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-2 2024-06-02T05:07:04.580 DEBUG:teuthology.orchestra.run.smithi192:> sudo pkill -f 'journalctl -f -n 0 -u ceph-60ab6d30-209a-11ef-bc9b-c7b262605968@osd.2.service' 2024-06-02T05:07:04.621 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-02T05:07:04.621 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-06-02T05:07:04.622 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-06-02T05:07:04.622 DEBUG:teuthology.orchestra.run.smithi076:> sudo systemctl stop ceph-60ab6d30-209a-11ef-bc9b-c7b262605968@osd.3 2024-06-02T05:07:04.984 INFO:journalctl@ceph.osd.3.smithi076.stdout:Jun 02 05:07:04 smithi076 systemd[1]: Stopping Ceph osd.3 for 60ab6d30-209a-11ef-bc9b-c7b262605968... 2024-06-02T05:07:04.984 INFO:journalctl@ceph.osd.3.smithi076.stdout:Jun 02 05:07:04 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-3[70677]: 2024-06-02T05:07:04.865+0000 7f2ba0c8e700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-02T05:07:04.984 INFO:journalctl@ceph.osd.3.smithi076.stdout:Jun 02 05:07:04 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-3[70677]: 2024-06-02T05:07:04.865+0000 7f2ba0c8e700 -1 osd.3 84 *** Got signal Terminated *** 2024-06-02T05:07:04.984 INFO:journalctl@ceph.osd.3.smithi076.stdout:Jun 02 05:07:04 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-3[70677]: 2024-06-02T05:07:04.865+0000 7f2ba0c8e700 -1 osd.3 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-02T05:07:09.484 INFO:journalctl@ceph.osd.3.smithi076.stdout:Jun 02 05:07:09 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-3[70677]: 2024-06-02T05:07:09.004+0000 7f2b9927c700 -1 osd.3 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:44.879654+0000 front 2024-06-02T05:06:44.879676+0000 (oldest deadline 2024-06-02T05:07:08.880403+0000) 2024-06-02T05:07:09.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:09 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:09.540+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.401238+0000 front 2024-06-02T05:06:46.401264+0000 (oldest deadline 2024-06-02T05:07:09.301320+0000) 2024-06-02T05:07:10.734 INFO:journalctl@ceph.osd.3.smithi076.stdout:Jun 02 05:07:10 smithi076 bash[128400]: ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-3 2024-06-02T05:07:10.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:10 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:10.572+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.401238+0000 front 2024-06-02T05:06:46.401264+0000 (oldest deadline 2024-06-02T05:07:09.301320+0000) 2024-06-02T05:07:11.711 DEBUG:teuthology.orchestra.run.smithi076:> sudo pkill -f 'journalctl -f -n 0 -u ceph-60ab6d30-209a-11ef-bc9b-c7b262605968@osd.3.service' 2024-06-02T05:07:11.752 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-02T05:07:11.752 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-06-02T05:07:11.753 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-06-02T05:07:11.753 DEBUG:teuthology.orchestra.run.smithi119:> sudo systemctl stop ceph-60ab6d30-209a-11ef-bc9b-c7b262605968@osd.4 2024-06-02T05:07:11.932 INFO:journalctl@ceph.osd.5.smithi192.stdout:Jun 02 05:07:11 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-5[61527]: 2024-06-02T05:07:11.739+0000 7fddeb146700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.518407+0000 front 2024-06-02T05:06:46.518328+0000 (oldest deadline 2024-06-02T05:07:11.218397+0000) 2024-06-02T05:07:11.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:11 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:11.550+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.401238+0000 front 2024-06-02T05:06:46.401264+0000 (oldest deadline 2024-06-02T05:07:09.301320+0000) 2024-06-02T05:07:11.984 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:11 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:11.700+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:47.393359+0000 front 2024-06-02T05:06:47.393381+0000 (oldest deadline 2024-06-02T05:07:11.493703+0000) 2024-06-02T05:07:12.096 INFO:journalctl@ceph.osd.4.smithi119.stdout:Jun 02 05:07:11 smithi119 systemd[1]: Stopping Ceph osd.4 for 60ab6d30-209a-11ef-bc9b-c7b262605968... 2024-06-02T05:07:12.505 INFO:journalctl@ceph.osd.8.smithi192.stdout:Jun 02 05:07:12 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-8[69456]: 2024-06-02T05:07:12.198+0000 7f12a6404700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:47.913588+0000 front 2024-06-02T05:06:47.913663+0000 (oldest deadline 2024-06-02T05:07:11.413557+0000) 2024-06-02T05:07:12.597 INFO:journalctl@ceph.osd.4.smithi119.stdout:Jun 02 05:07:12 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-4[60285]: 2024-06-02T05:07:12.214+0000 7f9e33f85700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-02T05:07:12.597 INFO:journalctl@ceph.osd.4.smithi119.stdout:Jun 02 05:07:12 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-4[60285]: 2024-06-02T05:07:12.214+0000 7f9e33f85700 -1 osd.4 84 *** Got signal Terminated *** 2024-06-02T05:07:12.597 INFO:journalctl@ceph.osd.4.smithi119.stdout:Jun 02 05:07:12 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-4[60285]: 2024-06-02T05:07:12.214+0000 7f9e33f85700 -1 osd.4 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-02T05:07:12.932 INFO:journalctl@ceph.osd.5.smithi192.stdout:Jun 02 05:07:12 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-5[61527]: 2024-06-02T05:07:12.695+0000 7fddeb146700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.518407+0000 front 2024-06-02T05:06:46.518328+0000 (oldest deadline 2024-06-02T05:07:11.218397+0000) 2024-06-02T05:07:12.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:12 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:12.504+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.401238+0000 front 2024-06-02T05:06:46.401264+0000 (oldest deadline 2024-06-02T05:07:09.301320+0000) 2024-06-02T05:07:12.967 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:12 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:12.680+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:47.393359+0000 front 2024-06-02T05:06:47.393381+0000 (oldest deadline 2024-06-02T05:07:11.493703+0000) 2024-06-02T05:07:13.234 INFO:journalctl@ceph.osd.6.smithi076.stdout:Jun 02 05:07:12 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-6[79456]: 2024-06-02T05:07:12.966+0000 7f6112bb9700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.922467+0000 front 2024-06-02T05:06:46.922499+0000 (oldest deadline 2024-06-02T05:07:12.222676+0000) 2024-06-02T05:07:13.597 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:13 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:13.122+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.939930+0000 front 2024-06-02T05:06:46.939951+0000 (oldest deadline 2024-06-02T05:07:12.840133+0000) 2024-06-02T05:07:13.682 INFO:journalctl@ceph.osd.8.smithi192.stdout:Jun 02 05:07:13 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-8[69456]: 2024-06-02T05:07:13.244+0000 7f12a6404700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:47.913588+0000 front 2024-06-02T05:06:47.913663+0000 (oldest deadline 2024-06-02T05:07:11.413557+0000) 2024-06-02T05:07:13.682 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:13 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:13.491+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.401238+0000 front 2024-06-02T05:06:46.401264+0000 (oldest deadline 2024-06-02T05:07:09.301320+0000) 2024-06-02T05:07:13.984 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:13 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:13.714+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:47.393359+0000 front 2024-06-02T05:06:47.393381+0000 (oldest deadline 2024-06-02T05:07:11.493703+0000) 2024-06-02T05:07:13.984 INFO:journalctl@ceph.osd.6.smithi076.stdout:Jun 02 05:07:13 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-6[79456]: 2024-06-02T05:07:13.962+0000 7f6112bb9700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.922467+0000 front 2024-06-02T05:06:46.922499+0000 (oldest deadline 2024-06-02T05:07:12.222676+0000) 2024-06-02T05:07:14.182 INFO:journalctl@ceph.osd.5.smithi192.stdout:Jun 02 05:07:13 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-5[61527]: 2024-06-02T05:07:13.681+0000 7fddeb146700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.518407+0000 front 2024-06-02T05:06:46.518328+0000 (oldest deadline 2024-06-02T05:07:11.218397+0000) 2024-06-02T05:07:14.596 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:14 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:14.121+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.939930+0000 front 2024-06-02T05:06:46.939951+0000 (oldest deadline 2024-06-02T05:07:12.840133+0000) 2024-06-02T05:07:14.647 INFO:journalctl@ceph.osd.8.smithi192.stdout:Jun 02 05:07:14 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-8[69456]: 2024-06-02T05:07:14.228+0000 7f12a6404700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:47.913588+0000 front 2024-06-02T05:06:47.913663+0000 (oldest deadline 2024-06-02T05:07:11.413557+0000) 2024-06-02T05:07:14.647 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:14 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:14.458+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.401238+0000 front 2024-06-02T05:06:46.401264+0000 (oldest deadline 2024-06-02T05:07:09.301320+0000) 2024-06-02T05:07:14.931 INFO:journalctl@ceph.osd.5.smithi192.stdout:Jun 02 05:07:14 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-5[61527]: 2024-06-02T05:07:14.646+0000 7fddeb146700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.518407+0000 front 2024-06-02T05:06:46.518328+0000 (oldest deadline 2024-06-02T05:07:11.218397+0000) 2024-06-02T05:07:14.984 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:14 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:14.673+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:47.393359+0000 front 2024-06-02T05:06:47.393381+0000 (oldest deadline 2024-06-02T05:07:11.493703+0000) 2024-06-02T05:07:15.484 INFO:journalctl@ceph.osd.6.smithi076.stdout:Jun 02 05:07:14 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-6[79456]: 2024-06-02T05:07:14.995+0000 7f6112bb9700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.922467+0000 front 2024-06-02T05:06:46.922499+0000 (oldest deadline 2024-06-02T05:07:12.222676+0000) 2024-06-02T05:07:15.487 INFO:journalctl@ceph.osd.8.smithi192.stdout:Jun 02 05:07:15 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-8[69456]: 2024-06-02T05:07:15.221+0000 7f12a6404700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:47.913588+0000 front 2024-06-02T05:06:47.913663+0000 (oldest deadline 2024-06-02T05:07:11.413557+0000) 2024-06-02T05:07:15.596 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:15 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:15.129+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.939930+0000 front 2024-06-02T05:06:46.939951+0000 (oldest deadline 2024-06-02T05:07:12.840133+0000) 2024-06-02T05:07:15.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:15 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:15.487+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.401238+0000 front 2024-06-02T05:06:46.401264+0000 (oldest deadline 2024-06-02T05:07:09.301320+0000) 2024-06-02T05:07:15.932 INFO:journalctl@ceph.osd.5.smithi192.stdout:Jun 02 05:07:15 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-5[61527]: 2024-06-02T05:07:15.685+0000 7fddeb146700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.518407+0000 front 2024-06-02T05:06:46.518328+0000 (oldest deadline 2024-06-02T05:07:11.218397+0000) 2024-06-02T05:07:15.984 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:15 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:15.666+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:47.393359+0000 front 2024-06-02T05:06:47.393381+0000 (oldest deadline 2024-06-02T05:07:11.493703+0000) 2024-06-02T05:07:16.484 INFO:journalctl@ceph.osd.6.smithi076.stdout:Jun 02 05:07:16 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-6[79456]: 2024-06-02T05:07:16.044+0000 7f6112bb9700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.922467+0000 front 2024-06-02T05:06:46.922499+0000 (oldest deadline 2024-06-02T05:07:12.222676+0000) 2024-06-02T05:07:16.596 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:16 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:16.108+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.939930+0000 front 2024-06-02T05:06:46.939951+0000 (oldest deadline 2024-06-02T05:07:12.840133+0000) 2024-06-02T05:07:16.671 INFO:journalctl@ceph.osd.8.smithi192.stdout:Jun 02 05:07:16 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-8[69456]: 2024-06-02T05:07:16.244+0000 7f12a6404700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:47.913588+0000 front 2024-06-02T05:06:47.913663+0000 (oldest deadline 2024-06-02T05:07:11.413557+0000) 2024-06-02T05:07:16.671 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:16 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:16.463+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.401238+0000 front 2024-06-02T05:06:46.401264+0000 (oldest deadline 2024-06-02T05:07:09.301320+0000) 2024-06-02T05:07:16.932 INFO:journalctl@ceph.osd.5.smithi192.stdout:Jun 02 05:07:16 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-5[61527]: 2024-06-02T05:07:16.671+0000 7fddeb146700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.518407+0000 front 2024-06-02T05:06:46.518328+0000 (oldest deadline 2024-06-02T05:07:11.218397+0000) 2024-06-02T05:07:16.983 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:16 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:16.663+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:47.393359+0000 front 2024-06-02T05:06:47.393381+0000 (oldest deadline 2024-06-02T05:07:11.493703+0000) 2024-06-02T05:07:17.484 INFO:journalctl@ceph.osd.6.smithi076.stdout:Jun 02 05:07:17 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-6[79456]: 2024-06-02T05:07:17.075+0000 7f6112bb9700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.922467+0000 front 2024-06-02T05:06:46.922499+0000 (oldest deadline 2024-06-02T05:07:12.222676+0000) 2024-06-02T05:07:17.484 INFO:journalctl@ceph.osd.6.smithi076.stdout:Jun 02 05:07:17 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-6[79456]: 2024-06-02T05:07:17.075+0000 7f6112bb9700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.923775+0000 front 2024-06-02T05:06:53.923879+0000 (oldest deadline 2024-06-02T05:07:16.223929+0000) 2024-06-02T05:07:17.596 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:17 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:17.141+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.939930+0000 front 2024-06-02T05:06:46.939951+0000 (oldest deadline 2024-06-02T05:07:12.840133+0000) 2024-06-02T05:07:17.677 INFO:journalctl@ceph.osd.8.smithi192.stdout:Jun 02 05:07:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-8[69456]: 2024-06-02T05:07:17.253+0000 7f12a6404700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:47.913588+0000 front 2024-06-02T05:06:47.913663+0000 (oldest deadline 2024-06-02T05:07:11.413557+0000) 2024-06-02T05:07:17.678 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:17.496+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.401238+0000 front 2024-06-02T05:06:46.401264+0000 (oldest deadline 2024-06-02T05:07:09.301320+0000) 2024-06-02T05:07:17.932 INFO:journalctl@ceph.osd.5.smithi192.stdout:Jun 02 05:07:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-5[61527]: 2024-06-02T05:07:17.677+0000 7fddeb146700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.518407+0000 front 2024-06-02T05:06:46.518328+0000 (oldest deadline 2024-06-02T05:07:11.218397+0000) 2024-06-02T05:07:17.932 INFO:journalctl@ceph.osd.5.smithi192.stdout:Jun 02 05:07:17 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-5[61527]: 2024-06-02T05:07:17.677+0000 7fddeb146700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:54.119435+0000 front 2024-06-02T05:06:54.119459+0000 (oldest deadline 2024-06-02T05:07:17.019372+0000) 2024-06-02T05:07:17.984 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:17 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:17.691+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:47.393359+0000 front 2024-06-02T05:06:47.393381+0000 (oldest deadline 2024-06-02T05:07:11.493703+0000) 2024-06-02T05:07:17.984 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:17 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:17.691+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:54.995133+0000 front 2024-06-02T05:06:54.995118+0000 (oldest deadline 2024-06-02T05:07:17.294826+0000) 2024-06-02T05:07:18.298 INFO:journalctl@ceph.osd.4.smithi119.stdout:Jun 02 05:07:17 smithi119 bash[89982]: ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-4 2024-06-02T05:07:18.298 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:18 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:18.169+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.939930+0000 front 2024-06-02T05:06:46.939951+0000 (oldest deadline 2024-06-02T05:07:12.840133+0000) 2024-06-02T05:07:18.298 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:18 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:18.169+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.941275+0000 front 2024-06-02T05:06:53.941295+0000 (oldest deadline 2024-06-02T05:07:17.441478+0000) 2024-06-02T05:07:18.484 INFO:journalctl@ceph.osd.6.smithi076.stdout:Jun 02 05:07:18 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-6[79456]: 2024-06-02T05:07:18.110+0000 7f6112bb9700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.922467+0000 front 2024-06-02T05:06:46.922499+0000 (oldest deadline 2024-06-02T05:07:12.222676+0000) 2024-06-02T05:07:18.484 INFO:journalctl@ceph.osd.6.smithi076.stdout:Jun 02 05:07:18 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-6[79456]: 2024-06-02T05:07:18.110+0000 7f6112bb9700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.923775+0000 front 2024-06-02T05:06:53.923879+0000 (oldest deadline 2024-06-02T05:07:16.223929+0000) 2024-06-02T05:07:18.596 INFO:journalctl@ceph.osd.7.smithi119.stdout:Jun 02 05:07:18 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-7[68256]: 2024-06-02T05:07:18.297+0000 7fc8a0df9700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.242718+0000 front 2024-06-02T05:06:53.242743+0000 (oldest deadline 2024-06-02T05:07:17.342990+0000) 2024-06-02T05:07:18.682 INFO:journalctl@ceph.osd.8.smithi192.stdout:Jun 02 05:07:18 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-8[69456]: 2024-06-02T05:07:18.282+0000 7f12a6404700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:47.913588+0000 front 2024-06-02T05:06:47.913663+0000 (oldest deadline 2024-06-02T05:07:11.413557+0000) 2024-06-02T05:07:18.682 INFO:journalctl@ceph.osd.8.smithi192.stdout:Jun 02 05:07:18 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-8[69456]: 2024-06-02T05:07:18.282+0000 7f12a6404700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:51.414200+0000 front 2024-06-02T05:06:51.414217+0000 (oldest deadline 2024-06-02T05:07:17.314193+0000) 2024-06-02T05:07:18.682 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:18 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:18.489+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.401238+0000 front 2024-06-02T05:06:46.401264+0000 (oldest deadline 2024-06-02T05:07:09.301320+0000) 2024-06-02T05:07:18.682 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:18 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:18.489+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.303014+0000 front 2024-06-02T05:06:53.302902+0000 (oldest deadline 2024-06-02T05:07:18.002899+0000) 2024-06-02T05:07:18.984 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:18 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:18.687+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:47.393359+0000 front 2024-06-02T05:06:47.393381+0000 (oldest deadline 2024-06-02T05:07:11.493703+0000) 2024-06-02T05:07:18.984 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:18 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:18.687+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:54.995133+0000 front 2024-06-02T05:06:54.995118+0000 (oldest deadline 2024-06-02T05:07:17.294826+0000) 2024-06-02T05:07:19.161 DEBUG:teuthology.orchestra.run.smithi119:> sudo pkill -f 'journalctl -f -n 0 -u ceph-60ab6d30-209a-11ef-bc9b-c7b262605968@osd.4.service' 2024-06-02T05:07:19.182 INFO:journalctl@ceph.osd.5.smithi192.stdout:Jun 02 05:07:18 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-5[61527]: 2024-06-02T05:07:18.690+0000 7fddeb146700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.518407+0000 front 2024-06-02T05:06:46.518328+0000 (oldest deadline 2024-06-02T05:07:11.218397+0000) 2024-06-02T05:07:19.182 INFO:journalctl@ceph.osd.5.smithi192.stdout:Jun 02 05:07:18 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-5[61527]: 2024-06-02T05:07:18.690+0000 7fddeb146700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:54.119435+0000 front 2024-06-02T05:06:54.119459+0000 (oldest deadline 2024-06-02T05:07:17.019372+0000) 2024-06-02T05:07:19.202 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-02T05:07:19.203 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-06-02T05:07:19.203 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-06-02T05:07:19.203 DEBUG:teuthology.orchestra.run.smithi192:> sudo systemctl stop ceph-60ab6d30-209a-11ef-bc9b-c7b262605968@osd.5 2024-06-02T05:07:19.484 INFO:journalctl@ceph.osd.6.smithi076.stdout:Jun 02 05:07:19 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-6[79456]: 2024-06-02T05:07:19.153+0000 7f6112bb9700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.922467+0000 front 2024-06-02T05:06:46.922499+0000 (oldest deadline 2024-06-02T05:07:12.222676+0000) 2024-06-02T05:07:19.484 INFO:journalctl@ceph.osd.6.smithi076.stdout:Jun 02 05:07:19 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-6[79456]: 2024-06-02T05:07:19.153+0000 7f6112bb9700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.923775+0000 front 2024-06-02T05:06:53.923879+0000 (oldest deadline 2024-06-02T05:07:16.223929+0000) 2024-06-02T05:07:19.597 INFO:journalctl@ceph.osd.7.smithi119.stdout:Jun 02 05:07:19 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-7[68256]: 2024-06-02T05:07:19.259+0000 7fc8a0df9700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.242718+0000 front 2024-06-02T05:06:53.242743+0000 (oldest deadline 2024-06-02T05:07:17.342990+0000) 2024-06-02T05:07:19.597 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:19 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:19.162+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.939930+0000 front 2024-06-02T05:06:46.939951+0000 (oldest deadline 2024-06-02T05:07:12.840133+0000) 2024-06-02T05:07:19.597 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:19 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:19.162+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.941275+0000 front 2024-06-02T05:06:53.941295+0000 (oldest deadline 2024-06-02T05:07:17.441478+0000) 2024-06-02T05:07:19.682 INFO:journalctl@ceph.osd.5.smithi192.stdout:Jun 02 05:07:19 smithi192 systemd[1]: Stopping Ceph osd.5 for 60ab6d30-209a-11ef-bc9b-c7b262605968... 2024-06-02T05:07:19.682 INFO:journalctl@ceph.osd.5.smithi192.stdout:Jun 02 05:07:19 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-5[61527]: 2024-06-02T05:07:19.439+0000 7fddeeb50700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-02T05:07:19.682 INFO:journalctl@ceph.osd.5.smithi192.stdout:Jun 02 05:07:19 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-5[61527]: 2024-06-02T05:07:19.439+0000 7fddeeb50700 -1 osd.5 84 *** Got signal Terminated *** 2024-06-02T05:07:19.682 INFO:journalctl@ceph.osd.5.smithi192.stdout:Jun 02 05:07:19 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-5[61527]: 2024-06-02T05:07:19.439+0000 7fddeeb50700 -1 osd.5 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-02T05:07:19.682 INFO:journalctl@ceph.osd.8.smithi192.stdout:Jun 02 05:07:19 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-8[69456]: 2024-06-02T05:07:19.325+0000 7f12a6404700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:47.913588+0000 front 2024-06-02T05:06:47.913663+0000 (oldest deadline 2024-06-02T05:07:11.413557+0000) 2024-06-02T05:07:19.683 INFO:journalctl@ceph.osd.8.smithi192.stdout:Jun 02 05:07:19 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-8[69456]: 2024-06-02T05:07:19.325+0000 7f12a6404700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:51.414200+0000 front 2024-06-02T05:06:51.414217+0000 (oldest deadline 2024-06-02T05:07:17.314193+0000) 2024-06-02T05:07:19.683 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:19 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:19.464+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.401238+0000 front 2024-06-02T05:06:46.401264+0000 (oldest deadline 2024-06-02T05:07:09.301320+0000) 2024-06-02T05:07:19.683 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:19 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:19.464+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.303014+0000 front 2024-06-02T05:06:53.302902+0000 (oldest deadline 2024-06-02T05:07:18.002899+0000) 2024-06-02T05:07:19.984 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:19 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:19.649+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:47.393359+0000 front 2024-06-02T05:06:47.393381+0000 (oldest deadline 2024-06-02T05:07:11.493703+0000) 2024-06-02T05:07:19.984 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:19 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:19.649+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:54.995133+0000 front 2024-06-02T05:06:54.995118+0000 (oldest deadline 2024-06-02T05:07:17.294826+0000) 2024-06-02T05:07:20.182 INFO:journalctl@ceph.osd.5.smithi192.stdout:Jun 02 05:07:19 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-5[61527]: 2024-06-02T05:07:19.722+0000 7fddeb146700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.518407+0000 front 2024-06-02T05:06:46.518328+0000 (oldest deadline 2024-06-02T05:07:11.218397+0000) 2024-06-02T05:07:20.182 INFO:journalctl@ceph.osd.5.smithi192.stdout:Jun 02 05:07:19 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-5[61527]: 2024-06-02T05:07:19.722+0000 7fddeb146700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:54.119435+0000 front 2024-06-02T05:06:54.119459+0000 (oldest deadline 2024-06-02T05:07:17.019372+0000) 2024-06-02T05:07:20.484 INFO:journalctl@ceph.osd.6.smithi076.stdout:Jun 02 05:07:20 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-6[79456]: 2024-06-02T05:07:20.186+0000 7f6112bb9700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.922467+0000 front 2024-06-02T05:06:46.922499+0000 (oldest deadline 2024-06-02T05:07:12.222676+0000) 2024-06-02T05:07:20.484 INFO:journalctl@ceph.osd.6.smithi076.stdout:Jun 02 05:07:20 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-6[79456]: 2024-06-02T05:07:20.186+0000 7f6112bb9700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.923775+0000 front 2024-06-02T05:06:53.923879+0000 (oldest deadline 2024-06-02T05:07:16.223929+0000) 2024-06-02T05:07:20.597 INFO:journalctl@ceph.osd.7.smithi119.stdout:Jun 02 05:07:20 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-7[68256]: 2024-06-02T05:07:20.219+0000 7fc8a0df9700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.242718+0000 front 2024-06-02T05:06:53.242743+0000 (oldest deadline 2024-06-02T05:07:17.342990+0000) 2024-06-02T05:07:20.597 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:20 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:20.143+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.939930+0000 front 2024-06-02T05:06:46.939951+0000 (oldest deadline 2024-06-02T05:07:12.840133+0000) 2024-06-02T05:07:20.597 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:20 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:20.143+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.941275+0000 front 2024-06-02T05:06:53.941295+0000 (oldest deadline 2024-06-02T05:07:17.441478+0000) 2024-06-02T05:07:20.682 INFO:journalctl@ceph.osd.8.smithi192.stdout:Jun 02 05:07:20 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-8[69456]: 2024-06-02T05:07:20.326+0000 7f12a6404700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:47.913588+0000 front 2024-06-02T05:06:47.913663+0000 (oldest deadline 2024-06-02T05:07:11.413557+0000) 2024-06-02T05:07:20.682 INFO:journalctl@ceph.osd.8.smithi192.stdout:Jun 02 05:07:20 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-8[69456]: 2024-06-02T05:07:20.326+0000 7f12a6404700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:51.414200+0000 front 2024-06-02T05:06:51.414217+0000 (oldest deadline 2024-06-02T05:07:17.314193+0000) 2024-06-02T05:07:20.682 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:20 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:20.487+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.401238+0000 front 2024-06-02T05:06:46.401264+0000 (oldest deadline 2024-06-02T05:07:09.301320+0000) 2024-06-02T05:07:20.682 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:20 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:20.487+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.303014+0000 front 2024-06-02T05:06:53.302902+0000 (oldest deadline 2024-06-02T05:07:18.002899+0000) 2024-06-02T05:07:20.984 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:20 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:20.676+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:47.393359+0000 front 2024-06-02T05:06:47.393381+0000 (oldest deadline 2024-06-02T05:07:11.493703+0000) 2024-06-02T05:07:20.984 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:20 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:20.676+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:54.995133+0000 front 2024-06-02T05:06:54.995118+0000 (oldest deadline 2024-06-02T05:07:17.294826+0000) 2024-06-02T05:07:21.182 INFO:journalctl@ceph.osd.5.smithi192.stdout:Jun 02 05:07:20 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-5[61527]: 2024-06-02T05:07:20.703+0000 7fddeb146700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.518407+0000 front 2024-06-02T05:06:46.518328+0000 (oldest deadline 2024-06-02T05:07:11.218397+0000) 2024-06-02T05:07:21.182 INFO:journalctl@ceph.osd.5.smithi192.stdout:Jun 02 05:07:20 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-5[61527]: 2024-06-02T05:07:20.703+0000 7fddeb146700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:54.119435+0000 front 2024-06-02T05:06:54.119459+0000 (oldest deadline 2024-06-02T05:07:17.019372+0000) 2024-06-02T05:07:21.484 INFO:journalctl@ceph.osd.6.smithi076.stdout:Jun 02 05:07:21 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-6[79456]: 2024-06-02T05:07:21.183+0000 7f6112bb9700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.922467+0000 front 2024-06-02T05:06:46.922499+0000 (oldest deadline 2024-06-02T05:07:12.222676+0000) 2024-06-02T05:07:21.484 INFO:journalctl@ceph.osd.6.smithi076.stdout:Jun 02 05:07:21 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-6[79456]: 2024-06-02T05:07:21.183+0000 7f6112bb9700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.923775+0000 front 2024-06-02T05:06:53.923879+0000 (oldest deadline 2024-06-02T05:07:16.223929+0000) 2024-06-02T05:07:21.596 INFO:journalctl@ceph.osd.7.smithi119.stdout:Jun 02 05:07:21 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-7[68256]: 2024-06-02T05:07:21.189+0000 7fc8a0df9700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.242718+0000 front 2024-06-02T05:06:53.242743+0000 (oldest deadline 2024-06-02T05:07:17.342990+0000) 2024-06-02T05:07:21.597 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:21 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:21.129+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.939930+0000 front 2024-06-02T05:06:46.939951+0000 (oldest deadline 2024-06-02T05:07:12.840133+0000) 2024-06-02T05:07:21.597 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:21 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:21.129+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.941275+0000 front 2024-06-02T05:06:53.941295+0000 (oldest deadline 2024-06-02T05:07:17.441478+0000) 2024-06-02T05:07:21.682 INFO:journalctl@ceph.osd.8.smithi192.stdout:Jun 02 05:07:21 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-8[69456]: 2024-06-02T05:07:21.373+0000 7f12a6404700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:47.913588+0000 front 2024-06-02T05:06:47.913663+0000 (oldest deadline 2024-06-02T05:07:11.413557+0000) 2024-06-02T05:07:21.682 INFO:journalctl@ceph.osd.8.smithi192.stdout:Jun 02 05:07:21 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-8[69456]: 2024-06-02T05:07:21.373+0000 7f12a6404700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:51.414200+0000 front 2024-06-02T05:06:51.414217+0000 (oldest deadline 2024-06-02T05:07:17.314193+0000) 2024-06-02T05:07:21.682 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:21 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:21.479+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.401238+0000 front 2024-06-02T05:06:46.401264+0000 (oldest deadline 2024-06-02T05:07:09.301320+0000) 2024-06-02T05:07:21.683 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:21 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:21.479+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.303014+0000 front 2024-06-02T05:06:53.302902+0000 (oldest deadline 2024-06-02T05:07:18.002899+0000) 2024-06-02T05:07:21.986 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:21 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:21.671+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:47.393359+0000 front 2024-06-02T05:06:47.393381+0000 (oldest deadline 2024-06-02T05:07:11.493703+0000) 2024-06-02T05:07:21.987 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:21 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:21.671+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:54.995133+0000 front 2024-06-02T05:06:54.995118+0000 (oldest deadline 2024-06-02T05:07:17.294826+0000) 2024-06-02T05:07:22.181 INFO:journalctl@ceph.osd.5.smithi192.stdout:Jun 02 05:07:21 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-5[61527]: 2024-06-02T05:07:21.700+0000 7fddeb146700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.518407+0000 front 2024-06-02T05:06:46.518328+0000 (oldest deadline 2024-06-02T05:07:11.218397+0000) 2024-06-02T05:07:22.182 INFO:journalctl@ceph.osd.5.smithi192.stdout:Jun 02 05:07:21 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-5[61527]: 2024-06-02T05:07:21.700+0000 7fddeb146700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:54.119435+0000 front 2024-06-02T05:06:54.119459+0000 (oldest deadline 2024-06-02T05:07:17.019372+0000) 2024-06-02T05:07:22.484 INFO:journalctl@ceph.osd.6.smithi076.stdout:Jun 02 05:07:22 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-6[79456]: 2024-06-02T05:07:22.193+0000 7f6112bb9700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.922467+0000 front 2024-06-02T05:06:46.922499+0000 (oldest deadline 2024-06-02T05:07:12.222676+0000) 2024-06-02T05:07:22.484 INFO:journalctl@ceph.osd.6.smithi076.stdout:Jun 02 05:07:22 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-6[79456]: 2024-06-02T05:07:22.193+0000 7f6112bb9700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.923775+0000 front 2024-06-02T05:06:53.923879+0000 (oldest deadline 2024-06-02T05:07:16.223929+0000) 2024-06-02T05:07:22.598 INFO:journalctl@ceph.osd.7.smithi119.stdout:Jun 02 05:07:22 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-7[68256]: 2024-06-02T05:07:22.153+0000 7fc8a0df9700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.242718+0000 front 2024-06-02T05:06:53.242743+0000 (oldest deadline 2024-06-02T05:07:17.342990+0000) 2024-06-02T05:07:22.599 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:22 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:22.142+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.939930+0000 front 2024-06-02T05:06:46.939951+0000 (oldest deadline 2024-06-02T05:07:12.840133+0000) 2024-06-02T05:07:22.599 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:22 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:22.142+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.941275+0000 front 2024-06-02T05:06:53.941295+0000 (oldest deadline 2024-06-02T05:07:17.441478+0000) 2024-06-02T05:07:22.667 INFO:journalctl@ceph.osd.8.smithi192.stdout:Jun 02 05:07:22 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-8[69456]: 2024-06-02T05:07:22.396+0000 7f12a6404700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:47.913588+0000 front 2024-06-02T05:06:47.913663+0000 (oldest deadline 2024-06-02T05:07:11.413557+0000) 2024-06-02T05:07:22.667 INFO:journalctl@ceph.osd.8.smithi192.stdout:Jun 02 05:07:22 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-8[69456]: 2024-06-02T05:07:22.396+0000 7f12a6404700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:51.414200+0000 front 2024-06-02T05:06:51.414217+0000 (oldest deadline 2024-06-02T05:07:17.314193+0000) 2024-06-02T05:07:22.668 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:22 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:22.485+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.401238+0000 front 2024-06-02T05:06:46.401264+0000 (oldest deadline 2024-06-02T05:07:09.301320+0000) 2024-06-02T05:07:22.668 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:22 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:22.485+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.303014+0000 front 2024-06-02T05:06:53.302902+0000 (oldest deadline 2024-06-02T05:07:18.002899+0000) 2024-06-02T05:07:22.932 INFO:journalctl@ceph.osd.5.smithi192.stdout:Jun 02 05:07:22 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-5[61527]: 2024-06-02T05:07:22.667+0000 7fddeb146700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.518407+0000 front 2024-06-02T05:06:46.518328+0000 (oldest deadline 2024-06-02T05:07:11.218397+0000) 2024-06-02T05:07:22.932 INFO:journalctl@ceph.osd.5.smithi192.stdout:Jun 02 05:07:22 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-5[61527]: 2024-06-02T05:07:22.667+0000 7fddeb146700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:54.119435+0000 front 2024-06-02T05:06:54.119459+0000 (oldest deadline 2024-06-02T05:07:17.019372+0000) 2024-06-02T05:07:22.984 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:22 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:22.637+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:47.393359+0000 front 2024-06-02T05:06:47.393381+0000 (oldest deadline 2024-06-02T05:07:11.493703+0000) 2024-06-02T05:07:22.984 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:22 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:22.637+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:54.995133+0000 front 2024-06-02T05:06:54.995118+0000 (oldest deadline 2024-06-02T05:07:17.294826+0000) 2024-06-02T05:07:23.484 INFO:journalctl@ceph.osd.6.smithi076.stdout:Jun 02 05:07:23 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-6[79456]: 2024-06-02T05:07:23.176+0000 7f6112bb9700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.922467+0000 front 2024-06-02T05:06:46.922499+0000 (oldest deadline 2024-06-02T05:07:12.222676+0000) 2024-06-02T05:07:23.484 INFO:journalctl@ceph.osd.6.smithi076.stdout:Jun 02 05:07:23 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-6[79456]: 2024-06-02T05:07:23.176+0000 7f6112bb9700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.923775+0000 front 2024-06-02T05:06:53.923879+0000 (oldest deadline 2024-06-02T05:07:16.223929+0000) 2024-06-02T05:07:23.596 INFO:journalctl@ceph.osd.7.smithi119.stdout:Jun 02 05:07:23 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-7[68256]: 2024-06-02T05:07:23.148+0000 7fc8a0df9700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.242718+0000 front 2024-06-02T05:06:53.242743+0000 (oldest deadline 2024-06-02T05:07:17.342990+0000) 2024-06-02T05:07:23.597 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:23 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:23.100+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.939930+0000 front 2024-06-02T05:06:46.939951+0000 (oldest deadline 2024-06-02T05:07:12.840133+0000) 2024-06-02T05:07:23.597 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:23 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:23.100+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.941275+0000 front 2024-06-02T05:06:53.941295+0000 (oldest deadline 2024-06-02T05:07:17.441478+0000) 2024-06-02T05:07:23.681 INFO:journalctl@ceph.osd.8.smithi192.stdout:Jun 02 05:07:23 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-8[69456]: 2024-06-02T05:07:23.403+0000 7f12a6404700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:47.913588+0000 front 2024-06-02T05:06:47.913663+0000 (oldest deadline 2024-06-02T05:07:11.413557+0000) 2024-06-02T05:07:23.681 INFO:journalctl@ceph.osd.8.smithi192.stdout:Jun 02 05:07:23 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-8[69456]: 2024-06-02T05:07:23.403+0000 7f12a6404700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:51.414200+0000 front 2024-06-02T05:06:51.414217+0000 (oldest deadline 2024-06-02T05:07:17.314193+0000) 2024-06-02T05:07:23.682 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:23 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:23.451+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.401238+0000 front 2024-06-02T05:06:46.401264+0000 (oldest deadline 2024-06-02T05:07:09.301320+0000) 2024-06-02T05:07:23.682 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:23 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:23.451+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.303014+0000 front 2024-06-02T05:06:53.302902+0000 (oldest deadline 2024-06-02T05:07:18.002899+0000) 2024-06-02T05:07:23.932 INFO:journalctl@ceph.osd.5.smithi192.stdout:Jun 02 05:07:23 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-5[61527]: 2024-06-02T05:07:23.681+0000 7fddeb146700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.518407+0000 front 2024-06-02T05:06:46.518328+0000 (oldest deadline 2024-06-02T05:07:11.218397+0000) 2024-06-02T05:07:23.932 INFO:journalctl@ceph.osd.5.smithi192.stdout:Jun 02 05:07:23 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-5[61527]: 2024-06-02T05:07:23.681+0000 7fddeb146700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:54.119435+0000 front 2024-06-02T05:06:54.119459+0000 (oldest deadline 2024-06-02T05:07:17.019372+0000) 2024-06-02T05:07:23.984 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:23 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:23.667+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:47.393359+0000 front 2024-06-02T05:06:47.393381+0000 (oldest deadline 2024-06-02T05:07:11.493703+0000) 2024-06-02T05:07:23.984 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:23 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:23.667+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:54.995133+0000 front 2024-06-02T05:06:54.995118+0000 (oldest deadline 2024-06-02T05:07:17.294826+0000) 2024-06-02T05:07:24.484 INFO:journalctl@ceph.osd.6.smithi076.stdout:Jun 02 05:07:24 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-6[79456]: 2024-06-02T05:07:24.135+0000 7f6112bb9700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.922467+0000 front 2024-06-02T05:06:46.922499+0000 (oldest deadline 2024-06-02T05:07:12.222676+0000) 2024-06-02T05:07:24.484 INFO:journalctl@ceph.osd.6.smithi076.stdout:Jun 02 05:07:24 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-6[79456]: 2024-06-02T05:07:24.135+0000 7f6112bb9700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.923775+0000 front 2024-06-02T05:06:53.923879+0000 (oldest deadline 2024-06-02T05:07:16.223929+0000) 2024-06-02T05:07:24.596 INFO:journalctl@ceph.osd.7.smithi119.stdout:Jun 02 05:07:24 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-7[68256]: 2024-06-02T05:07:24.175+0000 7fc8a0df9700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.242718+0000 front 2024-06-02T05:06:53.242743+0000 (oldest deadline 2024-06-02T05:07:17.342990+0000) 2024-06-02T05:07:24.597 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:24 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:24.123+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.939930+0000 front 2024-06-02T05:06:46.939951+0000 (oldest deadline 2024-06-02T05:07:12.840133+0000) 2024-06-02T05:07:24.597 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:24 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:24.123+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.941275+0000 front 2024-06-02T05:06:53.941295+0000 (oldest deadline 2024-06-02T05:07:17.441478+0000) 2024-06-02T05:07:24.682 INFO:journalctl@ceph.osd.8.smithi192.stdout:Jun 02 05:07:24 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-8[69456]: 2024-06-02T05:07:24.381+0000 7f12a6404700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:47.913588+0000 front 2024-06-02T05:06:47.913663+0000 (oldest deadline 2024-06-02T05:07:11.413557+0000) 2024-06-02T05:07:24.682 INFO:journalctl@ceph.osd.8.smithi192.stdout:Jun 02 05:07:24 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-8[69456]: 2024-06-02T05:07:24.381+0000 7f12a6404700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:51.414200+0000 front 2024-06-02T05:06:51.414217+0000 (oldest deadline 2024-06-02T05:07:17.314193+0000) 2024-06-02T05:07:24.682 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:24 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:24.435+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.401238+0000 front 2024-06-02T05:06:46.401264+0000 (oldest deadline 2024-06-02T05:07:09.301320+0000) 2024-06-02T05:07:24.682 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:24 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:24.435+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.303014+0000 front 2024-06-02T05:06:53.302902+0000 (oldest deadline 2024-06-02T05:07:18.002899+0000) 2024-06-02T05:07:24.682 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:24 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:24.435+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:00.303757+0000 front 2024-06-02T05:07:00.303798+0000 (oldest deadline 2024-06-02T05:07:24.403914+0000) 2024-06-02T05:07:24.984 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:24 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:24.642+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:47.393359+0000 front 2024-06-02T05:06:47.393381+0000 (oldest deadline 2024-06-02T05:07:11.493703+0000) 2024-06-02T05:07:24.984 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:24 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:24.642+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:54.995133+0000 front 2024-06-02T05:06:54.995118+0000 (oldest deadline 2024-06-02T05:07:17.294826+0000) 2024-06-02T05:07:24.984 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:24 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:24.642+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:06:57.795907+0000 front 2024-06-02T05:06:57.795921+0000 (oldest deadline 2024-06-02T05:07:23.696025+0000) 2024-06-02T05:07:25.432 INFO:journalctl@ceph.osd.5.smithi192.stdout:Jun 02 05:07:25 smithi192 bash[91061]: ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-5 2024-06-02T05:07:25.432 INFO:journalctl@ceph.osd.8.smithi192.stdout:Jun 02 05:07:25 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-8[69456]: 2024-06-02T05:07:25.335+0000 7f12a6404700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:47.913588+0000 front 2024-06-02T05:06:47.913663+0000 (oldest deadline 2024-06-02T05:07:11.413557+0000) 2024-06-02T05:07:25.432 INFO:journalctl@ceph.osd.8.smithi192.stdout:Jun 02 05:07:25 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-8[69456]: 2024-06-02T05:07:25.335+0000 7f12a6404700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:51.414200+0000 front 2024-06-02T05:06:51.414217+0000 (oldest deadline 2024-06-02T05:07:17.314193+0000) 2024-06-02T05:07:25.484 INFO:journalctl@ceph.osd.6.smithi076.stdout:Jun 02 05:07:25 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-6[79456]: 2024-06-02T05:07:25.095+0000 7f6112bb9700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.922467+0000 front 2024-06-02T05:06:46.922499+0000 (oldest deadline 2024-06-02T05:07:12.222676+0000) 2024-06-02T05:07:25.484 INFO:journalctl@ceph.osd.6.smithi076.stdout:Jun 02 05:07:25 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-6[79456]: 2024-06-02T05:07:25.095+0000 7f6112bb9700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.923775+0000 front 2024-06-02T05:06:53.923879+0000 (oldest deadline 2024-06-02T05:07:16.223929+0000) 2024-06-02T05:07:25.596 INFO:journalctl@ceph.osd.7.smithi119.stdout:Jun 02 05:07:25 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-7[68256]: 2024-06-02T05:07:25.216+0000 7fc8a0df9700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.242718+0000 front 2024-06-02T05:06:53.242743+0000 (oldest deadline 2024-06-02T05:07:17.342990+0000) 2024-06-02T05:07:25.597 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:25 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:25.139+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.939930+0000 front 2024-06-02T05:06:46.939951+0000 (oldest deadline 2024-06-02T05:07:12.840133+0000) 2024-06-02T05:07:25.597 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:25 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:25.139+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.941275+0000 front 2024-06-02T05:06:53.941295+0000 (oldest deadline 2024-06-02T05:07:17.441478+0000) 2024-06-02T05:07:25.746 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:25 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:25.431+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.401238+0000 front 2024-06-02T05:06:46.401264+0000 (oldest deadline 2024-06-02T05:07:09.301320+0000) 2024-06-02T05:07:25.746 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:25 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:25.431+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.303014+0000 front 2024-06-02T05:06:53.302902+0000 (oldest deadline 2024-06-02T05:07:18.002899+0000) 2024-06-02T05:07:25.746 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:25 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:25.431+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:00.303757+0000 front 2024-06-02T05:07:00.303798+0000 (oldest deadline 2024-06-02T05:07:24.403914+0000) 2024-06-02T05:07:25.984 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:25 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:25.662+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:47.393359+0000 front 2024-06-02T05:06:47.393381+0000 (oldest deadline 2024-06-02T05:07:11.493703+0000) 2024-06-02T05:07:25.984 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:25 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:25.662+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:54.995133+0000 front 2024-06-02T05:06:54.995118+0000 (oldest deadline 2024-06-02T05:07:17.294826+0000) 2024-06-02T05:07:25.984 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:25 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:25.662+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:06:57.795907+0000 front 2024-06-02T05:06:57.795921+0000 (oldest deadline 2024-06-02T05:07:23.696025+0000) 2024-06-02T05:07:26.453 DEBUG:teuthology.orchestra.run.smithi192:> sudo pkill -f 'journalctl -f -n 0 -u ceph-60ab6d30-209a-11ef-bc9b-c7b262605968@osd.5.service' 2024-06-02T05:07:26.484 INFO:journalctl@ceph.osd.6.smithi076.stdout:Jun 02 05:07:26 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-6[79456]: 2024-06-02T05:07:26.129+0000 7f6112bb9700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.922467+0000 front 2024-06-02T05:06:46.922499+0000 (oldest deadline 2024-06-02T05:07:12.222676+0000) 2024-06-02T05:07:26.484 INFO:journalctl@ceph.osd.6.smithi076.stdout:Jun 02 05:07:26 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-6[79456]: 2024-06-02T05:07:26.129+0000 7f6112bb9700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.923775+0000 front 2024-06-02T05:06:53.923879+0000 (oldest deadline 2024-06-02T05:07:16.223929+0000) 2024-06-02T05:07:26.485 INFO:journalctl@ceph.osd.6.smithi076.stdout:Jun 02 05:07:26 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-6[79456]: 2024-06-02T05:07:26.129+0000 7f6112bb9700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:01.425818+0000 front 2024-06-02T05:07:01.425898+0000 (oldest deadline 2024-06-02T05:07:26.126018+0000) 2024-06-02T05:07:26.495 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-02T05:07:26.496 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-06-02T05:07:26.496 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-06-02T05:07:26.496 DEBUG:teuthology.orchestra.run.smithi076:> sudo systemctl stop ceph-60ab6d30-209a-11ef-bc9b-c7b262605968@osd.6 2024-06-02T05:07:26.597 INFO:journalctl@ceph.osd.7.smithi119.stdout:Jun 02 05:07:26 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-7[68256]: 2024-06-02T05:07:26.228+0000 7fc8a0df9700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.242718+0000 front 2024-06-02T05:06:53.242743+0000 (oldest deadline 2024-06-02T05:07:17.342990+0000) 2024-06-02T05:07:26.597 INFO:journalctl@ceph.osd.7.smithi119.stdout:Jun 02 05:07:26 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-7[68256]: 2024-06-02T05:07:26.228+0000 7fc8a0df9700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:00.744965+0000 front 2024-06-02T05:07:00.744847+0000 (oldest deadline 2024-06-02T05:07:25.444985+0000) 2024-06-02T05:07:26.597 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:26 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:26.099+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.939930+0000 front 2024-06-02T05:06:46.939951+0000 (oldest deadline 2024-06-02T05:07:12.840133+0000) 2024-06-02T05:07:26.597 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:26 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:26.099+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.941275+0000 front 2024-06-02T05:06:53.941295+0000 (oldest deadline 2024-06-02T05:07:17.441478+0000) 2024-06-02T05:07:26.597 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:26 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:26.099+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:02.142732+0000 front 2024-06-02T05:07:02.142715+0000 (oldest deadline 2024-06-02T05:07:25.642928+0000) 2024-06-02T05:07:26.682 INFO:journalctl@ceph.osd.8.smithi192.stdout:Jun 02 05:07:26 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-8[69456]: 2024-06-02T05:07:26.381+0000 7f12a6404700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:47.913588+0000 front 2024-06-02T05:06:47.913663+0000 (oldest deadline 2024-06-02T05:07:11.413557+0000) 2024-06-02T05:07:26.682 INFO:journalctl@ceph.osd.8.smithi192.stdout:Jun 02 05:07:26 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-8[69456]: 2024-06-02T05:07:26.381+0000 7f12a6404700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:51.414200+0000 front 2024-06-02T05:06:51.414217+0000 (oldest deadline 2024-06-02T05:07:17.314193+0000) 2024-06-02T05:07:26.682 INFO:journalctl@ceph.osd.8.smithi192.stdout:Jun 02 05:07:26 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-8[69456]: 2024-06-02T05:07:26.381+0000 7f12a6404700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:01.415283+0000 front 2024-06-02T05:07:01.415436+0000 (oldest deadline 2024-06-02T05:07:26.115513+0000) 2024-06-02T05:07:26.682 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:26 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:26.402+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.401238+0000 front 2024-06-02T05:06:46.401264+0000 (oldest deadline 2024-06-02T05:07:09.301320+0000) 2024-06-02T05:07:26.682 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:26 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:26.402+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.303014+0000 front 2024-06-02T05:06:53.302902+0000 (oldest deadline 2024-06-02T05:07:18.002899+0000) 2024-06-02T05:07:26.682 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:26 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:26.402+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:00.303757+0000 front 2024-06-02T05:07:00.303798+0000 (oldest deadline 2024-06-02T05:07:24.403914+0000) 2024-06-02T05:07:26.894 INFO:journalctl@ceph.osd.6.smithi076.stdout:Jun 02 05:07:26 smithi076 systemd[1]: Stopping Ceph osd.6 for 60ab6d30-209a-11ef-bc9b-c7b262605968... 2024-06-02T05:07:26.894 INFO:journalctl@ceph.osd.6.smithi076.stdout:Jun 02 05:07:26 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-6[79456]: 2024-06-02T05:07:26.892+0000 7f61165c3700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-02T05:07:26.894 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:26 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:26.638+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:47.393359+0000 front 2024-06-02T05:06:47.393381+0000 (oldest deadline 2024-06-02T05:07:11.493703+0000) 2024-06-02T05:07:26.894 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:26 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:26.638+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:54.995133+0000 front 2024-06-02T05:06:54.995118+0000 (oldest deadline 2024-06-02T05:07:17.294826+0000) 2024-06-02T05:07:26.894 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:26 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:26.638+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:06:57.795907+0000 front 2024-06-02T05:06:57.795921+0000 (oldest deadline 2024-06-02T05:07:23.696025+0000) 2024-06-02T05:07:27.234 INFO:journalctl@ceph.osd.6.smithi076.stdout:Jun 02 05:07:26 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-6[79456]: 2024-06-02T05:07:26.892+0000 7f61165c3700 -1 osd.6 84 *** Got signal Terminated *** 2024-06-02T05:07:27.234 INFO:journalctl@ceph.osd.6.smithi076.stdout:Jun 02 05:07:26 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-6[79456]: 2024-06-02T05:07:26.892+0000 7f61165c3700 -1 osd.6 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-02T05:07:27.234 INFO:journalctl@ceph.osd.6.smithi076.stdout:Jun 02 05:07:27 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-6[79456]: 2024-06-02T05:07:27.118+0000 7f6112bb9700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.922467+0000 front 2024-06-02T05:06:46.922499+0000 (oldest deadline 2024-06-02T05:07:12.222676+0000) 2024-06-02T05:07:27.234 INFO:journalctl@ceph.osd.6.smithi076.stdout:Jun 02 05:07:27 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-6[79456]: 2024-06-02T05:07:27.118+0000 7f6112bb9700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.923775+0000 front 2024-06-02T05:06:53.923879+0000 (oldest deadline 2024-06-02T05:07:16.223929+0000) 2024-06-02T05:07:27.234 INFO:journalctl@ceph.osd.6.smithi076.stdout:Jun 02 05:07:27 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-6[79456]: 2024-06-02T05:07:27.118+0000 7f6112bb9700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:01.425818+0000 front 2024-06-02T05:07:01.425898+0000 (oldest deadline 2024-06-02T05:07:26.126018+0000) 2024-06-02T05:07:27.347 INFO:journalctl@ceph.osd.7.smithi119.stdout:Jun 02 05:07:27 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-7[68256]: 2024-06-02T05:07:27.185+0000 7fc8a0df9700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.242718+0000 front 2024-06-02T05:06:53.242743+0000 (oldest deadline 2024-06-02T05:07:17.342990+0000) 2024-06-02T05:07:27.347 INFO:journalctl@ceph.osd.7.smithi119.stdout:Jun 02 05:07:27 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-7[68256]: 2024-06-02T05:07:27.185+0000 7fc8a0df9700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:00.744965+0000 front 2024-06-02T05:07:00.744847+0000 (oldest deadline 2024-06-02T05:07:25.444985+0000) 2024-06-02T05:07:27.347 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:27 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:27.080+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.939930+0000 front 2024-06-02T05:06:46.939951+0000 (oldest deadline 2024-06-02T05:07:12.840133+0000) 2024-06-02T05:07:27.347 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:27 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:27.080+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.941275+0000 front 2024-06-02T05:06:53.941295+0000 (oldest deadline 2024-06-02T05:07:17.441478+0000) 2024-06-02T05:07:27.347 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:27 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:27.080+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:02.142732+0000 front 2024-06-02T05:07:02.142715+0000 (oldest deadline 2024-06-02T05:07:25.642928+0000) 2024-06-02T05:07:27.682 INFO:journalctl@ceph.osd.8.smithi192.stdout:Jun 02 05:07:27 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-8[69456]: 2024-06-02T05:07:27.366+0000 7f12a6404700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:47.913588+0000 front 2024-06-02T05:06:47.913663+0000 (oldest deadline 2024-06-02T05:07:11.413557+0000) 2024-06-02T05:07:27.682 INFO:journalctl@ceph.osd.8.smithi192.stdout:Jun 02 05:07:27 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-8[69456]: 2024-06-02T05:07:27.366+0000 7f12a6404700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:51.414200+0000 front 2024-06-02T05:06:51.414217+0000 (oldest deadline 2024-06-02T05:07:17.314193+0000) 2024-06-02T05:07:27.683 INFO:journalctl@ceph.osd.8.smithi192.stdout:Jun 02 05:07:27 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-8[69456]: 2024-06-02T05:07:27.366+0000 7f12a6404700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:01.415283+0000 front 2024-06-02T05:07:01.415436+0000 (oldest deadline 2024-06-02T05:07:26.115513+0000) 2024-06-02T05:07:27.683 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:27 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:27.412+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.401238+0000 front 2024-06-02T05:06:46.401264+0000 (oldest deadline 2024-06-02T05:07:09.301320+0000) 2024-06-02T05:07:27.683 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:27 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:27.412+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.303014+0000 front 2024-06-02T05:06:53.302902+0000 (oldest deadline 2024-06-02T05:07:18.002899+0000) 2024-06-02T05:07:27.683 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:27 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:27.412+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:00.303757+0000 front 2024-06-02T05:07:00.303798+0000 (oldest deadline 2024-06-02T05:07:24.403914+0000) 2024-06-02T05:07:27.984 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:27 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:27.664+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:47.393359+0000 front 2024-06-02T05:06:47.393381+0000 (oldest deadline 2024-06-02T05:07:11.493703+0000) 2024-06-02T05:07:27.984 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:27 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:27.664+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:54.995133+0000 front 2024-06-02T05:06:54.995118+0000 (oldest deadline 2024-06-02T05:07:17.294826+0000) 2024-06-02T05:07:27.984 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:27 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:27.664+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:06:57.795907+0000 front 2024-06-02T05:06:57.795921+0000 (oldest deadline 2024-06-02T05:07:23.696025+0000) 2024-06-02T05:07:28.484 INFO:journalctl@ceph.osd.6.smithi076.stdout:Jun 02 05:07:28 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-6[79456]: 2024-06-02T05:07:28.110+0000 7f6112bb9700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.922467+0000 front 2024-06-02T05:06:46.922499+0000 (oldest deadline 2024-06-02T05:07:12.222676+0000) 2024-06-02T05:07:28.484 INFO:journalctl@ceph.osd.6.smithi076.stdout:Jun 02 05:07:28 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-6[79456]: 2024-06-02T05:07:28.110+0000 7f6112bb9700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.923775+0000 front 2024-06-02T05:06:53.923879+0000 (oldest deadline 2024-06-02T05:07:16.223929+0000) 2024-06-02T05:07:28.484 INFO:journalctl@ceph.osd.6.smithi076.stdout:Jun 02 05:07:28 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-6[79456]: 2024-06-02T05:07:28.110+0000 7f6112bb9700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:01.425818+0000 front 2024-06-02T05:07:01.425898+0000 (oldest deadline 2024-06-02T05:07:26.126018+0000) 2024-06-02T05:07:28.596 INFO:journalctl@ceph.osd.7.smithi119.stdout:Jun 02 05:07:28 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-7[68256]: 2024-06-02T05:07:28.210+0000 7fc8a0df9700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.242718+0000 front 2024-06-02T05:06:53.242743+0000 (oldest deadline 2024-06-02T05:07:17.342990+0000) 2024-06-02T05:07:28.597 INFO:journalctl@ceph.osd.7.smithi119.stdout:Jun 02 05:07:28 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-7[68256]: 2024-06-02T05:07:28.210+0000 7fc8a0df9700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:00.744965+0000 front 2024-06-02T05:07:00.744847+0000 (oldest deadline 2024-06-02T05:07:25.444985+0000) 2024-06-02T05:07:28.597 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:28 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:28.097+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.939930+0000 front 2024-06-02T05:06:46.939951+0000 (oldest deadline 2024-06-02T05:07:12.840133+0000) 2024-06-02T05:07:28.597 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:28 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:28.097+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.941275+0000 front 2024-06-02T05:06:53.941295+0000 (oldest deadline 2024-06-02T05:07:17.441478+0000) 2024-06-02T05:07:28.597 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:28 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:28.097+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:02.142732+0000 front 2024-06-02T05:07:02.142715+0000 (oldest deadline 2024-06-02T05:07:25.642928+0000) 2024-06-02T05:07:28.682 INFO:journalctl@ceph.osd.8.smithi192.stdout:Jun 02 05:07:28 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-8[69456]: 2024-06-02T05:07:28.342+0000 7f12a6404700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:47.913588+0000 front 2024-06-02T05:06:47.913663+0000 (oldest deadline 2024-06-02T05:07:11.413557+0000) 2024-06-02T05:07:28.682 INFO:journalctl@ceph.osd.8.smithi192.stdout:Jun 02 05:07:28 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-8[69456]: 2024-06-02T05:07:28.342+0000 7f12a6404700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:51.414200+0000 front 2024-06-02T05:06:51.414217+0000 (oldest deadline 2024-06-02T05:07:17.314193+0000) 2024-06-02T05:07:28.682 INFO:journalctl@ceph.osd.8.smithi192.stdout:Jun 02 05:07:28 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-8[69456]: 2024-06-02T05:07:28.342+0000 7f12a6404700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:01.415283+0000 front 2024-06-02T05:07:01.415436+0000 (oldest deadline 2024-06-02T05:07:26.115513+0000) 2024-06-02T05:07:28.682 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:28 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:28.401+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.401238+0000 front 2024-06-02T05:06:46.401264+0000 (oldest deadline 2024-06-02T05:07:09.301320+0000) 2024-06-02T05:07:28.682 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:28 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:28.401+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.303014+0000 front 2024-06-02T05:06:53.302902+0000 (oldest deadline 2024-06-02T05:07:18.002899+0000) 2024-06-02T05:07:28.682 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:28 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:28.401+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:00.303757+0000 front 2024-06-02T05:07:00.303798+0000 (oldest deadline 2024-06-02T05:07:24.403914+0000) 2024-06-02T05:07:28.984 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:28 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:28.687+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:47.393359+0000 front 2024-06-02T05:06:47.393381+0000 (oldest deadline 2024-06-02T05:07:11.493703+0000) 2024-06-02T05:07:28.984 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:28 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:28.687+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:54.995133+0000 front 2024-06-02T05:06:54.995118+0000 (oldest deadline 2024-06-02T05:07:17.294826+0000) 2024-06-02T05:07:28.984 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:28 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:28.687+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:06:57.795907+0000 front 2024-06-02T05:06:57.795921+0000 (oldest deadline 2024-06-02T05:07:23.696025+0000) 2024-06-02T05:07:29.484 INFO:journalctl@ceph.osd.6.smithi076.stdout:Jun 02 05:07:29 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-6[79456]: 2024-06-02T05:07:29.067+0000 7f6112bb9700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.922467+0000 front 2024-06-02T05:06:46.922499+0000 (oldest deadline 2024-06-02T05:07:12.222676+0000) 2024-06-02T05:07:29.484 INFO:journalctl@ceph.osd.6.smithi076.stdout:Jun 02 05:07:29 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-6[79456]: 2024-06-02T05:07:29.067+0000 7f6112bb9700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.923775+0000 front 2024-06-02T05:06:53.923879+0000 (oldest deadline 2024-06-02T05:07:16.223929+0000) 2024-06-02T05:07:29.484 INFO:journalctl@ceph.osd.6.smithi076.stdout:Jun 02 05:07:29 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-6[79456]: 2024-06-02T05:07:29.067+0000 7f6112bb9700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:01.425818+0000 front 2024-06-02T05:07:01.425898+0000 (oldest deadline 2024-06-02T05:07:26.126018+0000) 2024-06-02T05:07:29.597 INFO:journalctl@ceph.osd.7.smithi119.stdout:Jun 02 05:07:29 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-7[68256]: 2024-06-02T05:07:29.243+0000 7fc8a0df9700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.242718+0000 front 2024-06-02T05:06:53.242743+0000 (oldest deadline 2024-06-02T05:07:17.342990+0000) 2024-06-02T05:07:29.597 INFO:journalctl@ceph.osd.7.smithi119.stdout:Jun 02 05:07:29 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-7[68256]: 2024-06-02T05:07:29.243+0000 7fc8a0df9700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:00.744965+0000 front 2024-06-02T05:07:00.744847+0000 (oldest deadline 2024-06-02T05:07:25.444985+0000) 2024-06-02T05:07:29.597 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:29 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:29.136+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.939930+0000 front 2024-06-02T05:06:46.939951+0000 (oldest deadline 2024-06-02T05:07:12.840133+0000) 2024-06-02T05:07:29.597 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:29 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:29.136+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.941275+0000 front 2024-06-02T05:06:53.941295+0000 (oldest deadline 2024-06-02T05:07:17.441478+0000) 2024-06-02T05:07:29.597 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:29 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:29.136+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:02.142732+0000 front 2024-06-02T05:07:02.142715+0000 (oldest deadline 2024-06-02T05:07:25.642928+0000) 2024-06-02T05:07:29.682 INFO:journalctl@ceph.osd.8.smithi192.stdout:Jun 02 05:07:29 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-8[69456]: 2024-06-02T05:07:29.371+0000 7f12a6404700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:47.913588+0000 front 2024-06-02T05:06:47.913663+0000 (oldest deadline 2024-06-02T05:07:11.413557+0000) 2024-06-02T05:07:29.682 INFO:journalctl@ceph.osd.8.smithi192.stdout:Jun 02 05:07:29 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-8[69456]: 2024-06-02T05:07:29.371+0000 7f12a6404700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:51.414200+0000 front 2024-06-02T05:06:51.414217+0000 (oldest deadline 2024-06-02T05:07:17.314193+0000) 2024-06-02T05:07:29.682 INFO:journalctl@ceph.osd.8.smithi192.stdout:Jun 02 05:07:29 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-8[69456]: 2024-06-02T05:07:29.371+0000 7f12a6404700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:01.415283+0000 front 2024-06-02T05:07:01.415436+0000 (oldest deadline 2024-06-02T05:07:26.115513+0000) 2024-06-02T05:07:29.682 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:29 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:29.405+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.401238+0000 front 2024-06-02T05:06:46.401264+0000 (oldest deadline 2024-06-02T05:07:09.301320+0000) 2024-06-02T05:07:29.682 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:29 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:29.405+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.303014+0000 front 2024-06-02T05:06:53.302902+0000 (oldest deadline 2024-06-02T05:07:18.002899+0000) 2024-06-02T05:07:29.682 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:29 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:29.405+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:00.303757+0000 front 2024-06-02T05:07:00.303798+0000 (oldest deadline 2024-06-02T05:07:24.403914+0000) 2024-06-02T05:07:29.984 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:29 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:29.682+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:47.393359+0000 front 2024-06-02T05:06:47.393381+0000 (oldest deadline 2024-06-02T05:07:11.493703+0000) 2024-06-02T05:07:29.984 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:29 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:29.682+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:54.995133+0000 front 2024-06-02T05:06:54.995118+0000 (oldest deadline 2024-06-02T05:07:17.294826+0000) 2024-06-02T05:07:29.984 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:29 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:29.682+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:06:57.795907+0000 front 2024-06-02T05:06:57.795921+0000 (oldest deadline 2024-06-02T05:07:23.696025+0000) 2024-06-02T05:07:30.484 INFO:journalctl@ceph.osd.6.smithi076.stdout:Jun 02 05:07:30 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-6[79456]: 2024-06-02T05:07:30.106+0000 7f6112bb9700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.922467+0000 front 2024-06-02T05:06:46.922499+0000 (oldest deadline 2024-06-02T05:07:12.222676+0000) 2024-06-02T05:07:30.484 INFO:journalctl@ceph.osd.6.smithi076.stdout:Jun 02 05:07:30 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-6[79456]: 2024-06-02T05:07:30.106+0000 7f6112bb9700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.923775+0000 front 2024-06-02T05:06:53.923879+0000 (oldest deadline 2024-06-02T05:07:16.223929+0000) 2024-06-02T05:07:30.484 INFO:journalctl@ceph.osd.6.smithi076.stdout:Jun 02 05:07:30 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-6[79456]: 2024-06-02T05:07:30.106+0000 7f6112bb9700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:01.425818+0000 front 2024-06-02T05:07:01.425898+0000 (oldest deadline 2024-06-02T05:07:26.126018+0000) 2024-06-02T05:07:30.596 INFO:journalctl@ceph.osd.7.smithi119.stdout:Jun 02 05:07:30 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-7[68256]: 2024-06-02T05:07:30.266+0000 7fc8a0df9700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.242718+0000 front 2024-06-02T05:06:53.242743+0000 (oldest deadline 2024-06-02T05:07:17.342990+0000) 2024-06-02T05:07:30.597 INFO:journalctl@ceph.osd.7.smithi119.stdout:Jun 02 05:07:30 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-7[68256]: 2024-06-02T05:07:30.266+0000 7fc8a0df9700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:00.744965+0000 front 2024-06-02T05:07:00.744847+0000 (oldest deadline 2024-06-02T05:07:25.444985+0000) 2024-06-02T05:07:30.597 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:30 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:30.137+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.939930+0000 front 2024-06-02T05:06:46.939951+0000 (oldest deadline 2024-06-02T05:07:12.840133+0000) 2024-06-02T05:07:30.597 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:30 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:30.137+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.941275+0000 front 2024-06-02T05:06:53.941295+0000 (oldest deadline 2024-06-02T05:07:17.441478+0000) 2024-06-02T05:07:30.597 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:30 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:30.137+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:02.142732+0000 front 2024-06-02T05:07:02.142715+0000 (oldest deadline 2024-06-02T05:07:25.642928+0000) 2024-06-02T05:07:30.682 INFO:journalctl@ceph.osd.8.smithi192.stdout:Jun 02 05:07:30 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-8[69456]: 2024-06-02T05:07:30.358+0000 7f12a6404700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:47.913588+0000 front 2024-06-02T05:06:47.913663+0000 (oldest deadline 2024-06-02T05:07:11.413557+0000) 2024-06-02T05:07:30.682 INFO:journalctl@ceph.osd.8.smithi192.stdout:Jun 02 05:07:30 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-8[69456]: 2024-06-02T05:07:30.358+0000 7f12a6404700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:51.414200+0000 front 2024-06-02T05:06:51.414217+0000 (oldest deadline 2024-06-02T05:07:17.314193+0000) 2024-06-02T05:07:30.682 INFO:journalctl@ceph.osd.8.smithi192.stdout:Jun 02 05:07:30 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-8[69456]: 2024-06-02T05:07:30.358+0000 7f12a6404700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:01.415283+0000 front 2024-06-02T05:07:01.415436+0000 (oldest deadline 2024-06-02T05:07:26.115513+0000) 2024-06-02T05:07:30.682 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:30 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:30.452+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.401238+0000 front 2024-06-02T05:06:46.401264+0000 (oldest deadline 2024-06-02T05:07:09.301320+0000) 2024-06-02T05:07:30.682 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:30 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:30.452+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.303014+0000 front 2024-06-02T05:06:53.302902+0000 (oldest deadline 2024-06-02T05:07:18.002899+0000) 2024-06-02T05:07:30.683 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:30 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:30.452+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:00.303757+0000 front 2024-06-02T05:07:00.303798+0000 (oldest deadline 2024-06-02T05:07:24.403914+0000) 2024-06-02T05:07:30.984 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:30 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:30.707+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:47.393359+0000 front 2024-06-02T05:06:47.393381+0000 (oldest deadline 2024-06-02T05:07:11.493703+0000) 2024-06-02T05:07:30.984 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:30 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:30.707+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:54.995133+0000 front 2024-06-02T05:06:54.995118+0000 (oldest deadline 2024-06-02T05:07:17.294826+0000) 2024-06-02T05:07:30.984 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:30 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:30.707+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:06:57.795907+0000 front 2024-06-02T05:06:57.795921+0000 (oldest deadline 2024-06-02T05:07:23.696025+0000) 2024-06-02T05:07:30.984 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:30 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:30.707+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-06-02T05:07:09.596998+0000 front 2024-06-02T05:07:09.597043+0000 (oldest deadline 2024-06-02T05:07:30.697188+0000) 2024-06-02T05:07:31.484 INFO:journalctl@ceph.osd.6.smithi076.stdout:Jun 02 05:07:31 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-6[79456]: 2024-06-02T05:07:31.060+0000 7f6112bb9700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.922467+0000 front 2024-06-02T05:06:46.922499+0000 (oldest deadline 2024-06-02T05:07:12.222676+0000) 2024-06-02T05:07:31.484 INFO:journalctl@ceph.osd.6.smithi076.stdout:Jun 02 05:07:31 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-6[79456]: 2024-06-02T05:07:31.060+0000 7f6112bb9700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.923775+0000 front 2024-06-02T05:06:53.923879+0000 (oldest deadline 2024-06-02T05:07:16.223929+0000) 2024-06-02T05:07:31.484 INFO:journalctl@ceph.osd.6.smithi076.stdout:Jun 02 05:07:31 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-6[79456]: 2024-06-02T05:07:31.060+0000 7f6112bb9700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:01.425818+0000 front 2024-06-02T05:07:01.425898+0000 (oldest deadline 2024-06-02T05:07:26.126018+0000) 2024-06-02T05:07:31.596 INFO:journalctl@ceph.osd.7.smithi119.stdout:Jun 02 05:07:31 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-7[68256]: 2024-06-02T05:07:31.269+0000 7fc8a0df9700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.242718+0000 front 2024-06-02T05:06:53.242743+0000 (oldest deadline 2024-06-02T05:07:17.342990+0000) 2024-06-02T05:07:31.597 INFO:journalctl@ceph.osd.7.smithi119.stdout:Jun 02 05:07:31 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-7[68256]: 2024-06-02T05:07:31.269+0000 7fc8a0df9700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:00.744965+0000 front 2024-06-02T05:07:00.744847+0000 (oldest deadline 2024-06-02T05:07:25.444985+0000) 2024-06-02T05:07:31.597 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:31 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:31.112+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.939930+0000 front 2024-06-02T05:06:46.939951+0000 (oldest deadline 2024-06-02T05:07:12.840133+0000) 2024-06-02T05:07:31.597 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:31 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:31.112+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.941275+0000 front 2024-06-02T05:06:53.941295+0000 (oldest deadline 2024-06-02T05:07:17.441478+0000) 2024-06-02T05:07:31.597 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:31 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:31.112+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:02.142732+0000 front 2024-06-02T05:07:02.142715+0000 (oldest deadline 2024-06-02T05:07:25.642928+0000) 2024-06-02T05:07:31.597 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:31 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:31.112+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-06-02T05:07:05.643520+0000 front 2024-06-02T05:07:05.643422+0000 (oldest deadline 2024-06-02T05:07:30.943577+0000) 2024-06-02T05:07:31.682 INFO:journalctl@ceph.osd.8.smithi192.stdout:Jun 02 05:07:31 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-8[69456]: 2024-06-02T05:07:31.330+0000 7f12a6404700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:47.913588+0000 front 2024-06-02T05:06:47.913663+0000 (oldest deadline 2024-06-02T05:07:11.413557+0000) 2024-06-02T05:07:31.682 INFO:journalctl@ceph.osd.8.smithi192.stdout:Jun 02 05:07:31 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-8[69456]: 2024-06-02T05:07:31.330+0000 7f12a6404700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:51.414200+0000 front 2024-06-02T05:06:51.414217+0000 (oldest deadline 2024-06-02T05:07:17.314193+0000) 2024-06-02T05:07:31.682 INFO:journalctl@ceph.osd.8.smithi192.stdout:Jun 02 05:07:31 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-8[69456]: 2024-06-02T05:07:31.330+0000 7f12a6404700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:01.415283+0000 front 2024-06-02T05:07:01.415436+0000 (oldest deadline 2024-06-02T05:07:26.115513+0000) 2024-06-02T05:07:31.682 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:31 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:31.472+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.401238+0000 front 2024-06-02T05:06:46.401264+0000 (oldest deadline 2024-06-02T05:07:09.301320+0000) 2024-06-02T05:07:31.682 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:31 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:31.472+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.303014+0000 front 2024-06-02T05:06:53.302902+0000 (oldest deadline 2024-06-02T05:07:18.002899+0000) 2024-06-02T05:07:31.683 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:31 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:31.472+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:00.303757+0000 front 2024-06-02T05:07:00.303798+0000 (oldest deadline 2024-06-02T05:07:24.403914+0000) 2024-06-02T05:07:31.984 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:31 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:31.724+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:47.393359+0000 front 2024-06-02T05:06:47.393381+0000 (oldest deadline 2024-06-02T05:07:11.493703+0000) 2024-06-02T05:07:31.984 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:31 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:31.724+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:54.995133+0000 front 2024-06-02T05:06:54.995118+0000 (oldest deadline 2024-06-02T05:07:17.294826+0000) 2024-06-02T05:07:31.984 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:31 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:31.724+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:06:57.795907+0000 front 2024-06-02T05:06:57.795921+0000 (oldest deadline 2024-06-02T05:07:23.696025+0000) 2024-06-02T05:07:31.984 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:31 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:31.724+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-06-02T05:07:09.596998+0000 front 2024-06-02T05:07:09.597043+0000 (oldest deadline 2024-06-02T05:07:30.697188+0000) 2024-06-02T05:07:32.597 INFO:journalctl@ceph.osd.7.smithi119.stdout:Jun 02 05:07:32 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-7[68256]: 2024-06-02T05:07:32.307+0000 7fc8a0df9700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.242718+0000 front 2024-06-02T05:06:53.242743+0000 (oldest deadline 2024-06-02T05:07:17.342990+0000) 2024-06-02T05:07:32.597 INFO:journalctl@ceph.osd.7.smithi119.stdout:Jun 02 05:07:32 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-7[68256]: 2024-06-02T05:07:32.307+0000 7fc8a0df9700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:00.744965+0000 front 2024-06-02T05:07:00.744847+0000 (oldest deadline 2024-06-02T05:07:25.444985+0000) 2024-06-02T05:07:32.597 INFO:journalctl@ceph.osd.7.smithi119.stdout:Jun 02 05:07:32 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-7[68256]: 2024-06-02T05:07:32.307+0000 7fc8a0df9700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-06-02T05:07:07.146209+0000 front 2024-06-02T05:07:07.146175+0000 (oldest deadline 2024-06-02T05:07:31.846212+0000) 2024-06-02T05:07:32.597 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:32 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:32.126+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.939930+0000 front 2024-06-02T05:06:46.939951+0000 (oldest deadline 2024-06-02T05:07:12.840133+0000) 2024-06-02T05:07:32.597 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:32 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:32.126+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.941275+0000 front 2024-06-02T05:06:53.941295+0000 (oldest deadline 2024-06-02T05:07:17.441478+0000) 2024-06-02T05:07:32.597 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:32 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:32.126+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:02.142732+0000 front 2024-06-02T05:07:02.142715+0000 (oldest deadline 2024-06-02T05:07:25.642928+0000) 2024-06-02T05:07:32.597 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:32 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:32.126+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-06-02T05:07:05.643520+0000 front 2024-06-02T05:07:05.643422+0000 (oldest deadline 2024-06-02T05:07:30.943577+0000) 2024-06-02T05:07:32.682 INFO:journalctl@ceph.osd.8.smithi192.stdout:Jun 02 05:07:32 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-8[69456]: 2024-06-02T05:07:32.367+0000 7f12a6404700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:47.913588+0000 front 2024-06-02T05:06:47.913663+0000 (oldest deadline 2024-06-02T05:07:11.413557+0000) 2024-06-02T05:07:32.682 INFO:journalctl@ceph.osd.8.smithi192.stdout:Jun 02 05:07:32 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-8[69456]: 2024-06-02T05:07:32.367+0000 7f12a6404700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:51.414200+0000 front 2024-06-02T05:06:51.414217+0000 (oldest deadline 2024-06-02T05:07:17.314193+0000) 2024-06-02T05:07:32.682 INFO:journalctl@ceph.osd.8.smithi192.stdout:Jun 02 05:07:32 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-8[69456]: 2024-06-02T05:07:32.368+0000 7f12a6404700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:01.415283+0000 front 2024-06-02T05:07:01.415436+0000 (oldest deadline 2024-06-02T05:07:26.115513+0000) 2024-06-02T05:07:32.682 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:32 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:32.485+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.401238+0000 front 2024-06-02T05:06:46.401264+0000 (oldest deadline 2024-06-02T05:07:09.301320+0000) 2024-06-02T05:07:32.682 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:32 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:32.485+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.303014+0000 front 2024-06-02T05:06:53.302902+0000 (oldest deadline 2024-06-02T05:07:18.002899+0000) 2024-06-02T05:07:32.682 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:32 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:32.485+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:00.303757+0000 front 2024-06-02T05:07:00.303798+0000 (oldest deadline 2024-06-02T05:07:24.403914+0000) 2024-06-02T05:07:32.984 INFO:journalctl@ceph.osd.6.smithi076.stdout:Jun 02 05:07:32 smithi076 bash[128652]: ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-6 2024-06-02T05:07:32.984 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:32 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:32.675+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:47.393359+0000 front 2024-06-02T05:06:47.393381+0000 (oldest deadline 2024-06-02T05:07:11.493703+0000) 2024-06-02T05:07:32.984 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:32 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:32.675+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:54.995133+0000 front 2024-06-02T05:06:54.995118+0000 (oldest deadline 2024-06-02T05:07:17.294826+0000) 2024-06-02T05:07:32.984 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:32 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:32.675+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:06:57.795907+0000 front 2024-06-02T05:06:57.795921+0000 (oldest deadline 2024-06-02T05:07:23.696025+0000) 2024-06-02T05:07:32.984 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:32 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:32.675+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-06-02T05:07:09.596998+0000 front 2024-06-02T05:07:09.597043+0000 (oldest deadline 2024-06-02T05:07:30.697188+0000) 2024-06-02T05:07:33.346 INFO:journalctl@ceph.osd.7.smithi119.stdout:Jun 02 05:07:33 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-7[68256]: 2024-06-02T05:07:33.291+0000 7fc8a0df9700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.242718+0000 front 2024-06-02T05:06:53.242743+0000 (oldest deadline 2024-06-02T05:07:17.342990+0000) 2024-06-02T05:07:33.347 INFO:journalctl@ceph.osd.7.smithi119.stdout:Jun 02 05:07:33 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-7[68256]: 2024-06-02T05:07:33.291+0000 7fc8a0df9700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:00.744965+0000 front 2024-06-02T05:07:00.744847+0000 (oldest deadline 2024-06-02T05:07:25.444985+0000) 2024-06-02T05:07:33.347 INFO:journalctl@ceph.osd.7.smithi119.stdout:Jun 02 05:07:33 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-7[68256]: 2024-06-02T05:07:33.291+0000 7fc8a0df9700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-06-02T05:07:07.146209+0000 front 2024-06-02T05:07:07.146175+0000 (oldest deadline 2024-06-02T05:07:31.846212+0000) 2024-06-02T05:07:33.347 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:33 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:33.094+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.939930+0000 front 2024-06-02T05:06:46.939951+0000 (oldest deadline 2024-06-02T05:07:12.840133+0000) 2024-06-02T05:07:33.347 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:33 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:33.094+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.941275+0000 front 2024-06-02T05:06:53.941295+0000 (oldest deadline 2024-06-02T05:07:17.441478+0000) 2024-06-02T05:07:33.347 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:33 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:33.094+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:02.142732+0000 front 2024-06-02T05:07:02.142715+0000 (oldest deadline 2024-06-02T05:07:25.642928+0000) 2024-06-02T05:07:33.347 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:33 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:33.094+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-06-02T05:07:05.643520+0000 front 2024-06-02T05:07:05.643422+0000 (oldest deadline 2024-06-02T05:07:30.943577+0000) 2024-06-02T05:07:33.682 INFO:journalctl@ceph.osd.8.smithi192.stdout:Jun 02 05:07:33 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-8[69456]: 2024-06-02T05:07:33.402+0000 7f12a6404700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:47.913588+0000 front 2024-06-02T05:06:47.913663+0000 (oldest deadline 2024-06-02T05:07:11.413557+0000) 2024-06-02T05:07:33.682 INFO:journalctl@ceph.osd.8.smithi192.stdout:Jun 02 05:07:33 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-8[69456]: 2024-06-02T05:07:33.402+0000 7f12a6404700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:51.414200+0000 front 2024-06-02T05:06:51.414217+0000 (oldest deadline 2024-06-02T05:07:17.314193+0000) 2024-06-02T05:07:33.682 INFO:journalctl@ceph.osd.8.smithi192.stdout:Jun 02 05:07:33 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-8[69456]: 2024-06-02T05:07:33.402+0000 7f12a6404700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:01.415283+0000 front 2024-06-02T05:07:01.415436+0000 (oldest deadline 2024-06-02T05:07:26.115513+0000) 2024-06-02T05:07:33.682 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:33 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:33.484+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.401238+0000 front 2024-06-02T05:06:46.401264+0000 (oldest deadline 2024-06-02T05:07:09.301320+0000) 2024-06-02T05:07:33.682 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:33 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:33.484+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.303014+0000 front 2024-06-02T05:06:53.302902+0000 (oldest deadline 2024-06-02T05:07:18.002899+0000) 2024-06-02T05:07:33.683 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:33 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:33.484+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:00.303757+0000 front 2024-06-02T05:07:00.303798+0000 (oldest deadline 2024-06-02T05:07:24.403914+0000) 2024-06-02T05:07:33.758 DEBUG:teuthology.orchestra.run.smithi076:> sudo pkill -f 'journalctl -f -n 0 -u ceph-60ab6d30-209a-11ef-bc9b-c7b262605968@osd.6.service' 2024-06-02T05:07:33.800 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-02T05:07:33.800 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-06-02T05:07:33.800 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-06-02T05:07:33.800 DEBUG:teuthology.orchestra.run.smithi119:> sudo systemctl stop ceph-60ab6d30-209a-11ef-bc9b-c7b262605968@osd.7 2024-06-02T05:07:33.984 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:33 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:33.708+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:47.393359+0000 front 2024-06-02T05:06:47.393381+0000 (oldest deadline 2024-06-02T05:07:11.493703+0000) 2024-06-02T05:07:33.984 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:33 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:33.708+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:54.995133+0000 front 2024-06-02T05:06:54.995118+0000 (oldest deadline 2024-06-02T05:07:17.294826+0000) 2024-06-02T05:07:33.984 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:33 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:33.708+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:06:57.795907+0000 front 2024-06-02T05:06:57.795921+0000 (oldest deadline 2024-06-02T05:07:23.696025+0000) 2024-06-02T05:07:33.984 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:33 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:33.708+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-06-02T05:07:09.596998+0000 front 2024-06-02T05:07:09.597043+0000 (oldest deadline 2024-06-02T05:07:30.697188+0000) 2024-06-02T05:07:34.096 INFO:journalctl@ceph.osd.7.smithi119.stdout:Jun 02 05:07:33 smithi119 systemd[1]: Stopping Ceph osd.7 for 60ab6d30-209a-11ef-bc9b-c7b262605968... 2024-06-02T05:07:34.097 INFO:journalctl@ceph.osd.7.smithi119.stdout:Jun 02 05:07:34 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-7[68256]: 2024-06-02T05:07:34.036+0000 7fc8a880b700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-02T05:07:34.097 INFO:journalctl@ceph.osd.7.smithi119.stdout:Jun 02 05:07:34 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-7[68256]: 2024-06-02T05:07:34.036+0000 7fc8a880b700 -1 osd.7 84 *** Got signal Terminated *** 2024-06-02T05:07:34.097 INFO:journalctl@ceph.osd.7.smithi119.stdout:Jun 02 05:07:34 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-7[68256]: 2024-06-02T05:07:34.036+0000 7fc8a880b700 -1 osd.7 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-02T05:07:34.097 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:34 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:34.059+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.939930+0000 front 2024-06-02T05:06:46.939951+0000 (oldest deadline 2024-06-02T05:07:12.840133+0000) 2024-06-02T05:07:34.097 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:34 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:34.059+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.941275+0000 front 2024-06-02T05:06:53.941295+0000 (oldest deadline 2024-06-02T05:07:17.441478+0000) 2024-06-02T05:07:34.097 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:34 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:34.059+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:02.142732+0000 front 2024-06-02T05:07:02.142715+0000 (oldest deadline 2024-06-02T05:07:25.642928+0000) 2024-06-02T05:07:34.097 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:34 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:34.059+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-06-02T05:07:05.643520+0000 front 2024-06-02T05:07:05.643422+0000 (oldest deadline 2024-06-02T05:07:30.943577+0000) 2024-06-02T05:07:34.596 INFO:journalctl@ceph.osd.7.smithi119.stdout:Jun 02 05:07:34 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-7[68256]: 2024-06-02T05:07:34.254+0000 7fc8a0df9700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.242718+0000 front 2024-06-02T05:06:53.242743+0000 (oldest deadline 2024-06-02T05:07:17.342990+0000) 2024-06-02T05:07:34.597 INFO:journalctl@ceph.osd.7.smithi119.stdout:Jun 02 05:07:34 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-7[68256]: 2024-06-02T05:07:34.254+0000 7fc8a0df9700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:00.744965+0000 front 2024-06-02T05:07:00.744847+0000 (oldest deadline 2024-06-02T05:07:25.444985+0000) 2024-06-02T05:07:34.597 INFO:journalctl@ceph.osd.7.smithi119.stdout:Jun 02 05:07:34 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-7[68256]: 2024-06-02T05:07:34.254+0000 7fc8a0df9700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-06-02T05:07:07.146209+0000 front 2024-06-02T05:07:07.146175+0000 (oldest deadline 2024-06-02T05:07:31.846212+0000) 2024-06-02T05:07:34.682 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:34 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:34.449+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.401238+0000 front 2024-06-02T05:06:46.401264+0000 (oldest deadline 2024-06-02T05:07:09.301320+0000) 2024-06-02T05:07:34.682 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:34 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:34.449+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.303014+0000 front 2024-06-02T05:06:53.302902+0000 (oldest deadline 2024-06-02T05:07:18.002899+0000) 2024-06-02T05:07:34.682 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:34 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:34.449+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:00.303757+0000 front 2024-06-02T05:07:00.303798+0000 (oldest deadline 2024-06-02T05:07:24.403914+0000) 2024-06-02T05:07:34.682 INFO:journalctl@ceph.osd.8.smithi192.stdout:Jun 02 05:07:34 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-8[69456]: 2024-06-02T05:07:34.420+0000 7f12a6404700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:47.913588+0000 front 2024-06-02T05:06:47.913663+0000 (oldest deadline 2024-06-02T05:07:11.413557+0000) 2024-06-02T05:07:34.682 INFO:journalctl@ceph.osd.8.smithi192.stdout:Jun 02 05:07:34 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-8[69456]: 2024-06-02T05:07:34.420+0000 7f12a6404700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:51.414200+0000 front 2024-06-02T05:06:51.414217+0000 (oldest deadline 2024-06-02T05:07:17.314193+0000) 2024-06-02T05:07:34.682 INFO:journalctl@ceph.osd.8.smithi192.stdout:Jun 02 05:07:34 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-8[69456]: 2024-06-02T05:07:34.420+0000 7f12a6404700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:01.415283+0000 front 2024-06-02T05:07:01.415436+0000 (oldest deadline 2024-06-02T05:07:26.115513+0000) 2024-06-02T05:07:34.683 INFO:journalctl@ceph.osd.8.smithi192.stdout:Jun 02 05:07:34 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-8[69456]: 2024-06-02T05:07:34.420+0000 7f12a6404700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-06-02T05:07:09.517224+0000 front 2024-06-02T05:07:09.517339+0000 (oldest deadline 2024-06-02T05:07:33.617069+0000) 2024-06-02T05:07:35.234 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:34 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:34.746+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:47.393359+0000 front 2024-06-02T05:06:47.393381+0000 (oldest deadline 2024-06-02T05:07:11.493703+0000) 2024-06-02T05:07:35.235 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:34 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:34.746+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:54.995133+0000 front 2024-06-02T05:06:54.995118+0000 (oldest deadline 2024-06-02T05:07:17.294826+0000) 2024-06-02T05:07:35.235 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:34 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:34.746+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:06:57.795907+0000 front 2024-06-02T05:06:57.795921+0000 (oldest deadline 2024-06-02T05:07:23.696025+0000) 2024-06-02T05:07:35.235 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:34 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:34.746+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-06-02T05:07:09.596998+0000 front 2024-06-02T05:07:09.597043+0000 (oldest deadline 2024-06-02T05:07:30.697188+0000) 2024-06-02T05:07:35.346 INFO:journalctl@ceph.osd.7.smithi119.stdout:Jun 02 05:07:35 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-7[68256]: 2024-06-02T05:07:35.234+0000 7fc8a0df9700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.242718+0000 front 2024-06-02T05:06:53.242743+0000 (oldest deadline 2024-06-02T05:07:17.342990+0000) 2024-06-02T05:07:35.347 INFO:journalctl@ceph.osd.7.smithi119.stdout:Jun 02 05:07:35 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-7[68256]: 2024-06-02T05:07:35.234+0000 7fc8a0df9700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:00.744965+0000 front 2024-06-02T05:07:00.744847+0000 (oldest deadline 2024-06-02T05:07:25.444985+0000) 2024-06-02T05:07:35.347 INFO:journalctl@ceph.osd.7.smithi119.stdout:Jun 02 05:07:35 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-7[68256]: 2024-06-02T05:07:35.234+0000 7fc8a0df9700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-06-02T05:07:07.146209+0000 front 2024-06-02T05:07:07.146175+0000 (oldest deadline 2024-06-02T05:07:31.846212+0000) 2024-06-02T05:07:35.347 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:35 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:35.078+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.939930+0000 front 2024-06-02T05:06:46.939951+0000 (oldest deadline 2024-06-02T05:07:12.840133+0000) 2024-06-02T05:07:35.347 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:35 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:35.078+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.941275+0000 front 2024-06-02T05:06:53.941295+0000 (oldest deadline 2024-06-02T05:07:17.441478+0000) 2024-06-02T05:07:35.347 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:35 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:35.078+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:02.142732+0000 front 2024-06-02T05:07:02.142715+0000 (oldest deadline 2024-06-02T05:07:25.642928+0000) 2024-06-02T05:07:35.347 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:35 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:35.078+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-06-02T05:07:05.643520+0000 front 2024-06-02T05:07:05.643422+0000 (oldest deadline 2024-06-02T05:07:30.943577+0000) 2024-06-02T05:07:35.682 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:35 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:35.487+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.401238+0000 front 2024-06-02T05:06:46.401264+0000 (oldest deadline 2024-06-02T05:07:09.301320+0000) 2024-06-02T05:07:35.682 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:35 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:35.487+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.303014+0000 front 2024-06-02T05:06:53.302902+0000 (oldest deadline 2024-06-02T05:07:18.002899+0000) 2024-06-02T05:07:35.682 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:35 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:35.487+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:00.303757+0000 front 2024-06-02T05:07:00.303798+0000 (oldest deadline 2024-06-02T05:07:24.403914+0000) 2024-06-02T05:07:35.683 INFO:journalctl@ceph.osd.8.smithi192.stdout:Jun 02 05:07:35 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-8[69456]: 2024-06-02T05:07:35.428+0000 7f12a6404700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:47.913588+0000 front 2024-06-02T05:06:47.913663+0000 (oldest deadline 2024-06-02T05:07:11.413557+0000) 2024-06-02T05:07:35.683 INFO:journalctl@ceph.osd.8.smithi192.stdout:Jun 02 05:07:35 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-8[69456]: 2024-06-02T05:07:35.428+0000 7f12a6404700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:51.414200+0000 front 2024-06-02T05:06:51.414217+0000 (oldest deadline 2024-06-02T05:07:17.314193+0000) 2024-06-02T05:07:35.683 INFO:journalctl@ceph.osd.8.smithi192.stdout:Jun 02 05:07:35 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-8[69456]: 2024-06-02T05:07:35.428+0000 7f12a6404700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:01.415283+0000 front 2024-06-02T05:07:01.415436+0000 (oldest deadline 2024-06-02T05:07:26.115513+0000) 2024-06-02T05:07:35.683 INFO:journalctl@ceph.osd.8.smithi192.stdout:Jun 02 05:07:35 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-8[69456]: 2024-06-02T05:07:35.428+0000 7f12a6404700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-06-02T05:07:09.517224+0000 front 2024-06-02T05:07:09.517339+0000 (oldest deadline 2024-06-02T05:07:33.617069+0000) 2024-06-02T05:07:35.984 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:35 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:35.724+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:47.393359+0000 front 2024-06-02T05:06:47.393381+0000 (oldest deadline 2024-06-02T05:07:11.493703+0000) 2024-06-02T05:07:35.984 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:35 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:35.724+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:54.995133+0000 front 2024-06-02T05:06:54.995118+0000 (oldest deadline 2024-06-02T05:07:17.294826+0000) 2024-06-02T05:07:35.984 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:35 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:35.724+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:06:57.795907+0000 front 2024-06-02T05:06:57.795921+0000 (oldest deadline 2024-06-02T05:07:23.696025+0000) 2024-06-02T05:07:35.984 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:35 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:35.724+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-06-02T05:07:09.596998+0000 front 2024-06-02T05:07:09.597043+0000 (oldest deadline 2024-06-02T05:07:30.697188+0000) 2024-06-02T05:07:36.347 INFO:journalctl@ceph.osd.7.smithi119.stdout:Jun 02 05:07:36 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-7[68256]: 2024-06-02T05:07:36.275+0000 7fc8a0df9700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.242718+0000 front 2024-06-02T05:06:53.242743+0000 (oldest deadline 2024-06-02T05:07:17.342990+0000) 2024-06-02T05:07:36.347 INFO:journalctl@ceph.osd.7.smithi119.stdout:Jun 02 05:07:36 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-7[68256]: 2024-06-02T05:07:36.275+0000 7fc8a0df9700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:00.744965+0000 front 2024-06-02T05:07:00.744847+0000 (oldest deadline 2024-06-02T05:07:25.444985+0000) 2024-06-02T05:07:36.347 INFO:journalctl@ceph.osd.7.smithi119.stdout:Jun 02 05:07:36 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-7[68256]: 2024-06-02T05:07:36.275+0000 7fc8a0df9700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-06-02T05:07:07.146209+0000 front 2024-06-02T05:07:07.146175+0000 (oldest deadline 2024-06-02T05:07:31.846212+0000) 2024-06-02T05:07:36.347 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:36 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:36.087+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.939930+0000 front 2024-06-02T05:06:46.939951+0000 (oldest deadline 2024-06-02T05:07:12.840133+0000) 2024-06-02T05:07:36.347 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:36 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:36.087+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.941275+0000 front 2024-06-02T05:06:53.941295+0000 (oldest deadline 2024-06-02T05:07:17.441478+0000) 2024-06-02T05:07:36.347 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:36 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:36.087+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:02.142732+0000 front 2024-06-02T05:07:02.142715+0000 (oldest deadline 2024-06-02T05:07:25.642928+0000) 2024-06-02T05:07:36.347 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:36 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:36.087+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-06-02T05:07:05.643520+0000 front 2024-06-02T05:07:05.643422+0000 (oldest deadline 2024-06-02T05:07:30.943577+0000) 2024-06-02T05:07:36.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:36 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:36.511+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.401238+0000 front 2024-06-02T05:06:46.401264+0000 (oldest deadline 2024-06-02T05:07:09.301320+0000) 2024-06-02T05:07:36.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:36 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:36.511+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.303014+0000 front 2024-06-02T05:06:53.302902+0000 (oldest deadline 2024-06-02T05:07:18.002899+0000) 2024-06-02T05:07:36.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:36 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:36.511+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:00.303757+0000 front 2024-06-02T05:07:00.303798+0000 (oldest deadline 2024-06-02T05:07:24.403914+0000) 2024-06-02T05:07:36.933 INFO:journalctl@ceph.osd.8.smithi192.stdout:Jun 02 05:07:36 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-8[69456]: 2024-06-02T05:07:36.464+0000 7f12a6404700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:47.913588+0000 front 2024-06-02T05:06:47.913663+0000 (oldest deadline 2024-06-02T05:07:11.413557+0000) 2024-06-02T05:07:36.933 INFO:journalctl@ceph.osd.8.smithi192.stdout:Jun 02 05:07:36 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-8[69456]: 2024-06-02T05:07:36.464+0000 7f12a6404700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:51.414200+0000 front 2024-06-02T05:06:51.414217+0000 (oldest deadline 2024-06-02T05:07:17.314193+0000) 2024-06-02T05:07:36.933 INFO:journalctl@ceph.osd.8.smithi192.stdout:Jun 02 05:07:36 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-8[69456]: 2024-06-02T05:07:36.464+0000 7f12a6404700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:01.415283+0000 front 2024-06-02T05:07:01.415436+0000 (oldest deadline 2024-06-02T05:07:26.115513+0000) 2024-06-02T05:07:36.933 INFO:journalctl@ceph.osd.8.smithi192.stdout:Jun 02 05:07:36 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-8[69456]: 2024-06-02T05:07:36.464+0000 7f12a6404700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-06-02T05:07:09.517224+0000 front 2024-06-02T05:07:09.517339+0000 (oldest deadline 2024-06-02T05:07:33.617069+0000) 2024-06-02T05:07:36.984 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:36 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:36.719+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:47.393359+0000 front 2024-06-02T05:06:47.393381+0000 (oldest deadline 2024-06-02T05:07:11.493703+0000) 2024-06-02T05:07:36.984 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:36 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:36.719+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:54.995133+0000 front 2024-06-02T05:06:54.995118+0000 (oldest deadline 2024-06-02T05:07:17.294826+0000) 2024-06-02T05:07:36.984 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:36 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:36.719+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:06:57.795907+0000 front 2024-06-02T05:06:57.795921+0000 (oldest deadline 2024-06-02T05:07:23.696025+0000) 2024-06-02T05:07:36.984 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:36 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:36.719+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-06-02T05:07:09.596998+0000 front 2024-06-02T05:07:09.597043+0000 (oldest deadline 2024-06-02T05:07:30.697188+0000) 2024-06-02T05:07:37.597 INFO:journalctl@ceph.osd.7.smithi119.stdout:Jun 02 05:07:37 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-7[68256]: 2024-06-02T05:07:37.325+0000 7fc8a0df9700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.242718+0000 front 2024-06-02T05:06:53.242743+0000 (oldest deadline 2024-06-02T05:07:17.342990+0000) 2024-06-02T05:07:37.597 INFO:journalctl@ceph.osd.7.smithi119.stdout:Jun 02 05:07:37 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-7[68256]: 2024-06-02T05:07:37.325+0000 7fc8a0df9700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:00.744965+0000 front 2024-06-02T05:07:00.744847+0000 (oldest deadline 2024-06-02T05:07:25.444985+0000) 2024-06-02T05:07:37.597 INFO:journalctl@ceph.osd.7.smithi119.stdout:Jun 02 05:07:37 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-7[68256]: 2024-06-02T05:07:37.325+0000 7fc8a0df9700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-06-02T05:07:07.146209+0000 front 2024-06-02T05:07:07.146175+0000 (oldest deadline 2024-06-02T05:07:31.846212+0000) 2024-06-02T05:07:37.597 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:37 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:37.123+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.939930+0000 front 2024-06-02T05:06:46.939951+0000 (oldest deadline 2024-06-02T05:07:12.840133+0000) 2024-06-02T05:07:37.597 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:37 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:37.123+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.941275+0000 front 2024-06-02T05:06:53.941295+0000 (oldest deadline 2024-06-02T05:07:17.441478+0000) 2024-06-02T05:07:37.597 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:37 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:37.123+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:02.142732+0000 front 2024-06-02T05:07:02.142715+0000 (oldest deadline 2024-06-02T05:07:25.642928+0000) 2024-06-02T05:07:37.597 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:37 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:37.123+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-06-02T05:07:05.643520+0000 front 2024-06-02T05:07:05.643422+0000 (oldest deadline 2024-06-02T05:07:30.943577+0000) 2024-06-02T05:07:37.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:37 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:37.516+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.401238+0000 front 2024-06-02T05:06:46.401264+0000 (oldest deadline 2024-06-02T05:07:09.301320+0000) 2024-06-02T05:07:37.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:37 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:37.516+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.303014+0000 front 2024-06-02T05:06:53.302902+0000 (oldest deadline 2024-06-02T05:07:18.002899+0000) 2024-06-02T05:07:37.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:37 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:37.516+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:00.303757+0000 front 2024-06-02T05:07:00.303798+0000 (oldest deadline 2024-06-02T05:07:24.403914+0000) 2024-06-02T05:07:37.932 INFO:journalctl@ceph.osd.8.smithi192.stdout:Jun 02 05:07:37 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-8[69456]: 2024-06-02T05:07:37.453+0000 7f12a6404700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:47.913588+0000 front 2024-06-02T05:06:47.913663+0000 (oldest deadline 2024-06-02T05:07:11.413557+0000) 2024-06-02T05:07:37.932 INFO:journalctl@ceph.osd.8.smithi192.stdout:Jun 02 05:07:37 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-8[69456]: 2024-06-02T05:07:37.453+0000 7f12a6404700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:51.414200+0000 front 2024-06-02T05:06:51.414217+0000 (oldest deadline 2024-06-02T05:07:17.314193+0000) 2024-06-02T05:07:37.933 INFO:journalctl@ceph.osd.8.smithi192.stdout:Jun 02 05:07:37 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-8[69456]: 2024-06-02T05:07:37.453+0000 7f12a6404700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:01.415283+0000 front 2024-06-02T05:07:01.415436+0000 (oldest deadline 2024-06-02T05:07:26.115513+0000) 2024-06-02T05:07:37.933 INFO:journalctl@ceph.osd.8.smithi192.stdout:Jun 02 05:07:37 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-8[69456]: 2024-06-02T05:07:37.453+0000 7f12a6404700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-06-02T05:07:09.517224+0000 front 2024-06-02T05:07:09.517339+0000 (oldest deadline 2024-06-02T05:07:33.617069+0000) 2024-06-02T05:07:37.984 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:37 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:37.684+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:47.393359+0000 front 2024-06-02T05:06:47.393381+0000 (oldest deadline 2024-06-02T05:07:11.493703+0000) 2024-06-02T05:07:37.984 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:37 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:37.684+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:54.995133+0000 front 2024-06-02T05:06:54.995118+0000 (oldest deadline 2024-06-02T05:07:17.294826+0000) 2024-06-02T05:07:37.984 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:37 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:37.684+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:06:57.795907+0000 front 2024-06-02T05:06:57.795921+0000 (oldest deadline 2024-06-02T05:07:23.696025+0000) 2024-06-02T05:07:37.984 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:37 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:37.684+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-06-02T05:07:09.596998+0000 front 2024-06-02T05:07:09.597043+0000 (oldest deadline 2024-06-02T05:07:30.697188+0000) 2024-06-02T05:07:38.596 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:38 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:38.144+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.939930+0000 front 2024-06-02T05:06:46.939951+0000 (oldest deadline 2024-06-02T05:07:12.840133+0000) 2024-06-02T05:07:38.597 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:38 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:38.144+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.941275+0000 front 2024-06-02T05:06:53.941295+0000 (oldest deadline 2024-06-02T05:07:17.441478+0000) 2024-06-02T05:07:38.597 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:38 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:38.144+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:02.142732+0000 front 2024-06-02T05:07:02.142715+0000 (oldest deadline 2024-06-02T05:07:25.642928+0000) 2024-06-02T05:07:38.597 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:38 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:38.144+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-06-02T05:07:05.643520+0000 front 2024-06-02T05:07:05.643422+0000 (oldest deadline 2024-06-02T05:07:30.943577+0000) 2024-06-02T05:07:38.597 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:38 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:38.144+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-06-02T05:07:12.644513+0000 front 2024-06-02T05:07:12.644454+0000 (oldest deadline 2024-06-02T05:07:37.944703+0000) 2024-06-02T05:07:38.597 INFO:journalctl@ceph.osd.7.smithi119.stdout:Jun 02 05:07:38 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-7[68256]: 2024-06-02T05:07:38.291+0000 7fc8a0df9700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.242718+0000 front 2024-06-02T05:06:53.242743+0000 (oldest deadline 2024-06-02T05:07:17.342990+0000) 2024-06-02T05:07:38.597 INFO:journalctl@ceph.osd.7.smithi119.stdout:Jun 02 05:07:38 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-7[68256]: 2024-06-02T05:07:38.291+0000 7fc8a0df9700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:00.744965+0000 front 2024-06-02T05:07:00.744847+0000 (oldest deadline 2024-06-02T05:07:25.444985+0000) 2024-06-02T05:07:38.597 INFO:journalctl@ceph.osd.7.smithi119.stdout:Jun 02 05:07:38 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-7[68256]: 2024-06-02T05:07:38.291+0000 7fc8a0df9700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-06-02T05:07:07.146209+0000 front 2024-06-02T05:07:07.146175+0000 (oldest deadline 2024-06-02T05:07:31.846212+0000) 2024-06-02T05:07:38.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:38 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:38.501+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.401238+0000 front 2024-06-02T05:06:46.401264+0000 (oldest deadline 2024-06-02T05:07:09.301320+0000) 2024-06-02T05:07:38.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:38 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:38.501+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.303014+0000 front 2024-06-02T05:06:53.302902+0000 (oldest deadline 2024-06-02T05:07:18.002899+0000) 2024-06-02T05:07:38.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:38 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:38.501+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:00.303757+0000 front 2024-06-02T05:07:00.303798+0000 (oldest deadline 2024-06-02T05:07:24.403914+0000) 2024-06-02T05:07:38.933 INFO:journalctl@ceph.osd.8.smithi192.stdout:Jun 02 05:07:38 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-8[69456]: 2024-06-02T05:07:38.448+0000 7f12a6404700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:47.913588+0000 front 2024-06-02T05:06:47.913663+0000 (oldest deadline 2024-06-02T05:07:11.413557+0000) 2024-06-02T05:07:38.933 INFO:journalctl@ceph.osd.8.smithi192.stdout:Jun 02 05:07:38 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-8[69456]: 2024-06-02T05:07:38.448+0000 7f12a6404700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:51.414200+0000 front 2024-06-02T05:06:51.414217+0000 (oldest deadline 2024-06-02T05:07:17.314193+0000) 2024-06-02T05:07:38.933 INFO:journalctl@ceph.osd.8.smithi192.stdout:Jun 02 05:07:38 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-8[69456]: 2024-06-02T05:07:38.448+0000 7f12a6404700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:01.415283+0000 front 2024-06-02T05:07:01.415436+0000 (oldest deadline 2024-06-02T05:07:26.115513+0000) 2024-06-02T05:07:38.933 INFO:journalctl@ceph.osd.8.smithi192.stdout:Jun 02 05:07:38 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-8[69456]: 2024-06-02T05:07:38.448+0000 7f12a6404700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-06-02T05:07:09.517224+0000 front 2024-06-02T05:07:09.517339+0000 (oldest deadline 2024-06-02T05:07:33.617069+0000) 2024-06-02T05:07:38.933 INFO:journalctl@ceph.osd.8.smithi192.stdout:Jun 02 05:07:38 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-8[69456]: 2024-06-02T05:07:38.448+0000 7f12a6404700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-06-02T05:07:17.118256+0000 front 2024-06-02T05:07:17.118152+0000 (oldest deadline 2024-06-02T05:07:38.118514+0000) 2024-06-02T05:07:38.984 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:38 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:38.655+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:47.393359+0000 front 2024-06-02T05:06:47.393381+0000 (oldest deadline 2024-06-02T05:07:11.493703+0000) 2024-06-02T05:07:38.984 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:38 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:38.655+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:54.995133+0000 front 2024-06-02T05:06:54.995118+0000 (oldest deadline 2024-06-02T05:07:17.294826+0000) 2024-06-02T05:07:38.984 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:38 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:38.655+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:06:57.795907+0000 front 2024-06-02T05:06:57.795921+0000 (oldest deadline 2024-06-02T05:07:23.696025+0000) 2024-06-02T05:07:38.984 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:38 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:38.655+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-06-02T05:07:09.596998+0000 front 2024-06-02T05:07:09.597043+0000 (oldest deadline 2024-06-02T05:07:30.697188+0000) 2024-06-02T05:07:39.597 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:39 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:39.141+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.939930+0000 front 2024-06-02T05:06:46.939951+0000 (oldest deadline 2024-06-02T05:07:12.840133+0000) 2024-06-02T05:07:39.597 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:39 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:39.141+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.941275+0000 front 2024-06-02T05:06:53.941295+0000 (oldest deadline 2024-06-02T05:07:17.441478+0000) 2024-06-02T05:07:39.598 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:39 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:39.141+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:02.142732+0000 front 2024-06-02T05:07:02.142715+0000 (oldest deadline 2024-06-02T05:07:25.642928+0000) 2024-06-02T05:07:39.598 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:39 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:39.141+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-06-02T05:07:05.643520+0000 front 2024-06-02T05:07:05.643422+0000 (oldest deadline 2024-06-02T05:07:30.943577+0000) 2024-06-02T05:07:39.598 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:39 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:39.141+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-06-02T05:07:12.644513+0000 front 2024-06-02T05:07:12.644454+0000 (oldest deadline 2024-06-02T05:07:37.944703+0000) 2024-06-02T05:07:39.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:39 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:39.502+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.401238+0000 front 2024-06-02T05:06:46.401264+0000 (oldest deadline 2024-06-02T05:07:09.301320+0000) 2024-06-02T05:07:39.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:39 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:39.502+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.303014+0000 front 2024-06-02T05:06:53.302902+0000 (oldest deadline 2024-06-02T05:07:18.002899+0000) 2024-06-02T05:07:39.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:39 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:39.502+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:00.303757+0000 front 2024-06-02T05:07:00.303798+0000 (oldest deadline 2024-06-02T05:07:24.403914+0000) 2024-06-02T05:07:39.932 INFO:journalctl@ceph.osd.8.smithi192.stdout:Jun 02 05:07:39 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-8[69456]: 2024-06-02T05:07:39.479+0000 7f12a6404700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:47.913588+0000 front 2024-06-02T05:06:47.913663+0000 (oldest deadline 2024-06-02T05:07:11.413557+0000) 2024-06-02T05:07:39.932 INFO:journalctl@ceph.osd.8.smithi192.stdout:Jun 02 05:07:39 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-8[69456]: 2024-06-02T05:07:39.479+0000 7f12a6404700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:51.414200+0000 front 2024-06-02T05:06:51.414217+0000 (oldest deadline 2024-06-02T05:07:17.314193+0000) 2024-06-02T05:07:39.932 INFO:journalctl@ceph.osd.8.smithi192.stdout:Jun 02 05:07:39 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-8[69456]: 2024-06-02T05:07:39.479+0000 7f12a6404700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:01.415283+0000 front 2024-06-02T05:07:01.415436+0000 (oldest deadline 2024-06-02T05:07:26.115513+0000) 2024-06-02T05:07:39.933 INFO:journalctl@ceph.osd.8.smithi192.stdout:Jun 02 05:07:39 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-8[69456]: 2024-06-02T05:07:39.479+0000 7f12a6404700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-06-02T05:07:09.517224+0000 front 2024-06-02T05:07:09.517339+0000 (oldest deadline 2024-06-02T05:07:33.617069+0000) 2024-06-02T05:07:39.933 INFO:journalctl@ceph.osd.8.smithi192.stdout:Jun 02 05:07:39 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-8[69456]: 2024-06-02T05:07:39.479+0000 7f12a6404700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-06-02T05:07:17.118256+0000 front 2024-06-02T05:07:17.118152+0000 (oldest deadline 2024-06-02T05:07:38.118514+0000) 2024-06-02T05:07:39.984 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:39 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:39.668+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:47.393359+0000 front 2024-06-02T05:06:47.393381+0000 (oldest deadline 2024-06-02T05:07:11.493703+0000) 2024-06-02T05:07:39.984 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:39 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:39.668+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:54.995133+0000 front 2024-06-02T05:06:54.995118+0000 (oldest deadline 2024-06-02T05:07:17.294826+0000) 2024-06-02T05:07:39.984 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:39 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:39.668+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:06:57.795907+0000 front 2024-06-02T05:06:57.795921+0000 (oldest deadline 2024-06-02T05:07:23.696025+0000) 2024-06-02T05:07:39.984 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:39 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:39.668+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-06-02T05:07:09.596998+0000 front 2024-06-02T05:07:09.597043+0000 (oldest deadline 2024-06-02T05:07:30.697188+0000) 2024-06-02T05:07:39.984 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:39 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:39.668+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-06-02T05:07:15.398022+0000 front 2024-06-02T05:07:15.397997+0000 (oldest deadline 2024-06-02T05:07:39.498032+0000) 2024-06-02T05:07:40.096 INFO:journalctl@ceph.osd.7.smithi119.stdout:Jun 02 05:07:39 smithi119 bash[90238]: ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-7 2024-06-02T05:07:40.597 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:40 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:40.111+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.939930+0000 front 2024-06-02T05:06:46.939951+0000 (oldest deadline 2024-06-02T05:07:12.840133+0000) 2024-06-02T05:07:40.597 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:40 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:40.111+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.941275+0000 front 2024-06-02T05:06:53.941295+0000 (oldest deadline 2024-06-02T05:07:17.441478+0000) 2024-06-02T05:07:40.597 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:40 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:40.111+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:02.142732+0000 front 2024-06-02T05:07:02.142715+0000 (oldest deadline 2024-06-02T05:07:25.642928+0000) 2024-06-02T05:07:40.597 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:40 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:40.111+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-06-02T05:07:05.643520+0000 front 2024-06-02T05:07:05.643422+0000 (oldest deadline 2024-06-02T05:07:30.943577+0000) 2024-06-02T05:07:40.597 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:40 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:40.111+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-06-02T05:07:12.644513+0000 front 2024-06-02T05:07:12.644454+0000 (oldest deadline 2024-06-02T05:07:37.944703+0000) 2024-06-02T05:07:40.932 INFO:journalctl@ceph.osd.8.smithi192.stdout:Jun 02 05:07:40 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-8[69456]: 2024-06-02T05:07:40.499+0000 7f12a6404700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:47.913588+0000 front 2024-06-02T05:06:47.913663+0000 (oldest deadline 2024-06-02T05:07:11.413557+0000) 2024-06-02T05:07:40.932 INFO:journalctl@ceph.osd.8.smithi192.stdout:Jun 02 05:07:40 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-8[69456]: 2024-06-02T05:07:40.499+0000 7f12a6404700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:51.414200+0000 front 2024-06-02T05:06:51.414217+0000 (oldest deadline 2024-06-02T05:07:17.314193+0000) 2024-06-02T05:07:40.932 INFO:journalctl@ceph.osd.8.smithi192.stdout:Jun 02 05:07:40 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-8[69456]: 2024-06-02T05:07:40.499+0000 7f12a6404700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:01.415283+0000 front 2024-06-02T05:07:01.415436+0000 (oldest deadline 2024-06-02T05:07:26.115513+0000) 2024-06-02T05:07:40.932 INFO:journalctl@ceph.osd.8.smithi192.stdout:Jun 02 05:07:40 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-8[69456]: 2024-06-02T05:07:40.499+0000 7f12a6404700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-06-02T05:07:09.517224+0000 front 2024-06-02T05:07:09.517339+0000 (oldest deadline 2024-06-02T05:07:33.617069+0000) 2024-06-02T05:07:40.932 INFO:journalctl@ceph.osd.8.smithi192.stdout:Jun 02 05:07:40 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-8[69456]: 2024-06-02T05:07:40.499+0000 7f12a6404700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-06-02T05:07:17.118256+0000 front 2024-06-02T05:07:17.118152+0000 (oldest deadline 2024-06-02T05:07:38.118514+0000) 2024-06-02T05:07:40.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:40 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:40.542+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.401238+0000 front 2024-06-02T05:06:46.401264+0000 (oldest deadline 2024-06-02T05:07:09.301320+0000) 2024-06-02T05:07:40.933 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:40 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:40.542+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.303014+0000 front 2024-06-02T05:06:53.302902+0000 (oldest deadline 2024-06-02T05:07:18.002899+0000) 2024-06-02T05:07:40.933 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:40 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:40.542+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:00.303757+0000 front 2024-06-02T05:07:00.303798+0000 (oldest deadline 2024-06-02T05:07:24.403914+0000) 2024-06-02T05:07:40.966 DEBUG:teuthology.orchestra.run.smithi119:> sudo pkill -f 'journalctl -f -n 0 -u ceph-60ab6d30-209a-11ef-bc9b-c7b262605968@osd.7.service' 2024-06-02T05:07:40.984 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:40 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:40.682+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:47.393359+0000 front 2024-06-02T05:06:47.393381+0000 (oldest deadline 2024-06-02T05:07:11.493703+0000) 2024-06-02T05:07:40.984 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:40 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:40.682+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:54.995133+0000 front 2024-06-02T05:06:54.995118+0000 (oldest deadline 2024-06-02T05:07:17.294826+0000) 2024-06-02T05:07:40.984 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:40 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:40.682+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:06:57.795907+0000 front 2024-06-02T05:06:57.795921+0000 (oldest deadline 2024-06-02T05:07:23.696025+0000) 2024-06-02T05:07:40.984 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:40 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:40.682+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-06-02T05:07:09.596998+0000 front 2024-06-02T05:07:09.597043+0000 (oldest deadline 2024-06-02T05:07:30.697188+0000) 2024-06-02T05:07:40.984 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:40 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:40.682+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-06-02T05:07:15.398022+0000 front 2024-06-02T05:07:15.397997+0000 (oldest deadline 2024-06-02T05:07:39.498032+0000) 2024-06-02T05:07:41.007 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-02T05:07:41.007 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-06-02T05:07:41.007 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-06-02T05:07:41.007 DEBUG:teuthology.orchestra.run.smithi192:> sudo systemctl stop ceph-60ab6d30-209a-11ef-bc9b-c7b262605968@osd.8 2024-06-02T05:07:41.347 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:41 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:41.137+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.939930+0000 front 2024-06-02T05:06:46.939951+0000 (oldest deadline 2024-06-02T05:07:12.840133+0000) 2024-06-02T05:07:41.347 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:41 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:41.137+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.941275+0000 front 2024-06-02T05:06:53.941295+0000 (oldest deadline 2024-06-02T05:07:17.441478+0000) 2024-06-02T05:07:41.347 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:41 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:41.137+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:02.142732+0000 front 2024-06-02T05:07:02.142715+0000 (oldest deadline 2024-06-02T05:07:25.642928+0000) 2024-06-02T05:07:41.347 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:41 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:41.137+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-06-02T05:07:05.643520+0000 front 2024-06-02T05:07:05.643422+0000 (oldest deadline 2024-06-02T05:07:30.943577+0000) 2024-06-02T05:07:41.347 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:41 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:41.137+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-06-02T05:07:12.644513+0000 front 2024-06-02T05:07:12.644454+0000 (oldest deadline 2024-06-02T05:07:37.944703+0000) 2024-06-02T05:07:41.432 INFO:journalctl@ceph.osd.8.smithi192.stdout:Jun 02 05:07:41 smithi192 systemd[1]: Stopping Ceph osd.8 for 60ab6d30-209a-11ef-bc9b-c7b262605968... 2024-06-02T05:07:41.432 INFO:journalctl@ceph.osd.8.smithi192.stdout:Jun 02 05:07:41 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-8[69456]: 2024-06-02T05:07:41.268+0000 7f12a9e0e700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-02T05:07:41.432 INFO:journalctl@ceph.osd.8.smithi192.stdout:Jun 02 05:07:41 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-8[69456]: 2024-06-02T05:07:41.268+0000 7f12a9e0e700 -1 osd.8 84 *** Got signal Terminated *** 2024-06-02T05:07:41.432 INFO:journalctl@ceph.osd.8.smithi192.stdout:Jun 02 05:07:41 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-8[69456]: 2024-06-02T05:07:41.268+0000 7f12a9e0e700 -1 osd.8 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-02T05:07:41.932 INFO:journalctl@ceph.osd.8.smithi192.stdout:Jun 02 05:07:41 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-8[69456]: 2024-06-02T05:07:41.511+0000 7f12a6404700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:47.913588+0000 front 2024-06-02T05:06:47.913663+0000 (oldest deadline 2024-06-02T05:07:11.413557+0000) 2024-06-02T05:07:41.932 INFO:journalctl@ceph.osd.8.smithi192.stdout:Jun 02 05:07:41 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-8[69456]: 2024-06-02T05:07:41.511+0000 7f12a6404700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:51.414200+0000 front 2024-06-02T05:06:51.414217+0000 (oldest deadline 2024-06-02T05:07:17.314193+0000) 2024-06-02T05:07:41.932 INFO:journalctl@ceph.osd.8.smithi192.stdout:Jun 02 05:07:41 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-8[69456]: 2024-06-02T05:07:41.511+0000 7f12a6404700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:01.415283+0000 front 2024-06-02T05:07:01.415436+0000 (oldest deadline 2024-06-02T05:07:26.115513+0000) 2024-06-02T05:07:41.932 INFO:journalctl@ceph.osd.8.smithi192.stdout:Jun 02 05:07:41 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-8[69456]: 2024-06-02T05:07:41.511+0000 7f12a6404700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-06-02T05:07:09.517224+0000 front 2024-06-02T05:07:09.517339+0000 (oldest deadline 2024-06-02T05:07:33.617069+0000) 2024-06-02T05:07:41.933 INFO:journalctl@ceph.osd.8.smithi192.stdout:Jun 02 05:07:41 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-8[69456]: 2024-06-02T05:07:41.511+0000 7f12a6404700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-06-02T05:07:17.118256+0000 front 2024-06-02T05:07:17.118152+0000 (oldest deadline 2024-06-02T05:07:38.118514+0000) 2024-06-02T05:07:41.933 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:41 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:41.577+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.401238+0000 front 2024-06-02T05:06:46.401264+0000 (oldest deadline 2024-06-02T05:07:09.301320+0000) 2024-06-02T05:07:41.933 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:41 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:41.577+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.303014+0000 front 2024-06-02T05:06:53.302902+0000 (oldest deadline 2024-06-02T05:07:18.002899+0000) 2024-06-02T05:07:41.933 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:41 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:41.577+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:00.303757+0000 front 2024-06-02T05:07:00.303798+0000 (oldest deadline 2024-06-02T05:07:24.403914+0000) 2024-06-02T05:07:41.984 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:41 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:41.713+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:47.393359+0000 front 2024-06-02T05:06:47.393381+0000 (oldest deadline 2024-06-02T05:07:11.493703+0000) 2024-06-02T05:07:41.984 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:41 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:41.713+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:54.995133+0000 front 2024-06-02T05:06:54.995118+0000 (oldest deadline 2024-06-02T05:07:17.294826+0000) 2024-06-02T05:07:41.984 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:41 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:41.713+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:06:57.795907+0000 front 2024-06-02T05:06:57.795921+0000 (oldest deadline 2024-06-02T05:07:23.696025+0000) 2024-06-02T05:07:41.984 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:41 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:41.713+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-06-02T05:07:09.596998+0000 front 2024-06-02T05:07:09.597043+0000 (oldest deadline 2024-06-02T05:07:30.697188+0000) 2024-06-02T05:07:41.985 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:41 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:41.713+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-06-02T05:07:15.398022+0000 front 2024-06-02T05:07:15.397997+0000 (oldest deadline 2024-06-02T05:07:39.498032+0000) 2024-06-02T05:07:42.346 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:42 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:42.088+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.939930+0000 front 2024-06-02T05:06:46.939951+0000 (oldest deadline 2024-06-02T05:07:12.840133+0000) 2024-06-02T05:07:42.347 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:42 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:42.088+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.941275+0000 front 2024-06-02T05:06:53.941295+0000 (oldest deadline 2024-06-02T05:07:17.441478+0000) 2024-06-02T05:07:42.347 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:42 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:42.088+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:02.142732+0000 front 2024-06-02T05:07:02.142715+0000 (oldest deadline 2024-06-02T05:07:25.642928+0000) 2024-06-02T05:07:42.347 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:42 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:42.088+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-06-02T05:07:05.643520+0000 front 2024-06-02T05:07:05.643422+0000 (oldest deadline 2024-06-02T05:07:30.943577+0000) 2024-06-02T05:07:42.347 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:42 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:42.088+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-06-02T05:07:12.644513+0000 front 2024-06-02T05:07:12.644454+0000 (oldest deadline 2024-06-02T05:07:37.944703+0000) 2024-06-02T05:07:42.932 INFO:journalctl@ceph.osd.8.smithi192.stdout:Jun 02 05:07:42 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-8[69456]: 2024-06-02T05:07:42.463+0000 7f12a6404700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:47.913588+0000 front 2024-06-02T05:06:47.913663+0000 (oldest deadline 2024-06-02T05:07:11.413557+0000) 2024-06-02T05:07:42.932 INFO:journalctl@ceph.osd.8.smithi192.stdout:Jun 02 05:07:42 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-8[69456]: 2024-06-02T05:07:42.463+0000 7f12a6404700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:51.414200+0000 front 2024-06-02T05:06:51.414217+0000 (oldest deadline 2024-06-02T05:07:17.314193+0000) 2024-06-02T05:07:42.932 INFO:journalctl@ceph.osd.8.smithi192.stdout:Jun 02 05:07:42 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-8[69456]: 2024-06-02T05:07:42.463+0000 7f12a6404700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:01.415283+0000 front 2024-06-02T05:07:01.415436+0000 (oldest deadline 2024-06-02T05:07:26.115513+0000) 2024-06-02T05:07:42.932 INFO:journalctl@ceph.osd.8.smithi192.stdout:Jun 02 05:07:42 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-8[69456]: 2024-06-02T05:07:42.463+0000 7f12a6404700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-06-02T05:07:09.517224+0000 front 2024-06-02T05:07:09.517339+0000 (oldest deadline 2024-06-02T05:07:33.617069+0000) 2024-06-02T05:07:42.933 INFO:journalctl@ceph.osd.8.smithi192.stdout:Jun 02 05:07:42 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-8[69456]: 2024-06-02T05:07:42.463+0000 7f12a6404700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-06-02T05:07:17.118256+0000 front 2024-06-02T05:07:17.118152+0000 (oldest deadline 2024-06-02T05:07:38.118514+0000) 2024-06-02T05:07:42.933 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:42 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:42.603+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.401238+0000 front 2024-06-02T05:06:46.401264+0000 (oldest deadline 2024-06-02T05:07:09.301320+0000) 2024-06-02T05:07:42.933 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:42 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:42.603+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.303014+0000 front 2024-06-02T05:06:53.302902+0000 (oldest deadline 2024-06-02T05:07:18.002899+0000) 2024-06-02T05:07:42.933 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:42 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:42.603+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:00.303757+0000 front 2024-06-02T05:07:00.303798+0000 (oldest deadline 2024-06-02T05:07:24.403914+0000) 2024-06-02T05:07:42.984 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:42 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:42.671+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:47.393359+0000 front 2024-06-02T05:06:47.393381+0000 (oldest deadline 2024-06-02T05:07:11.493703+0000) 2024-06-02T05:07:42.984 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:42 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:42.671+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:54.995133+0000 front 2024-06-02T05:06:54.995118+0000 (oldest deadline 2024-06-02T05:07:17.294826+0000) 2024-06-02T05:07:42.984 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:42 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:42.671+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:06:57.795907+0000 front 2024-06-02T05:06:57.795921+0000 (oldest deadline 2024-06-02T05:07:23.696025+0000) 2024-06-02T05:07:42.984 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:42 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:42.671+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-06-02T05:07:09.596998+0000 front 2024-06-02T05:07:09.597043+0000 (oldest deadline 2024-06-02T05:07:30.697188+0000) 2024-06-02T05:07:42.985 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:42 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:42.671+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-06-02T05:07:15.398022+0000 front 2024-06-02T05:07:15.397997+0000 (oldest deadline 2024-06-02T05:07:39.498032+0000) 2024-06-02T05:07:43.346 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:43 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:43.075+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.939930+0000 front 2024-06-02T05:06:46.939951+0000 (oldest deadline 2024-06-02T05:07:12.840133+0000) 2024-06-02T05:07:43.347 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:43 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:43.075+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.941275+0000 front 2024-06-02T05:06:53.941295+0000 (oldest deadline 2024-06-02T05:07:17.441478+0000) 2024-06-02T05:07:43.347 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:43 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:43.075+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:02.142732+0000 front 2024-06-02T05:07:02.142715+0000 (oldest deadline 2024-06-02T05:07:25.642928+0000) 2024-06-02T05:07:43.347 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:43 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:43.075+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-06-02T05:07:05.643520+0000 front 2024-06-02T05:07:05.643422+0000 (oldest deadline 2024-06-02T05:07:30.943577+0000) 2024-06-02T05:07:43.347 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:43 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:43.075+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-06-02T05:07:12.644513+0000 front 2024-06-02T05:07:12.644454+0000 (oldest deadline 2024-06-02T05:07:37.944703+0000) 2024-06-02T05:07:43.932 INFO:journalctl@ceph.osd.8.smithi192.stdout:Jun 02 05:07:43 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-8[69456]: 2024-06-02T05:07:43.491+0000 7f12a6404700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:47.913588+0000 front 2024-06-02T05:06:47.913663+0000 (oldest deadline 2024-06-02T05:07:11.413557+0000) 2024-06-02T05:07:43.932 INFO:journalctl@ceph.osd.8.smithi192.stdout:Jun 02 05:07:43 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-8[69456]: 2024-06-02T05:07:43.491+0000 7f12a6404700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:51.414200+0000 front 2024-06-02T05:06:51.414217+0000 (oldest deadline 2024-06-02T05:07:17.314193+0000) 2024-06-02T05:07:43.932 INFO:journalctl@ceph.osd.8.smithi192.stdout:Jun 02 05:07:43 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-8[69456]: 2024-06-02T05:07:43.491+0000 7f12a6404700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:01.415283+0000 front 2024-06-02T05:07:01.415436+0000 (oldest deadline 2024-06-02T05:07:26.115513+0000) 2024-06-02T05:07:43.932 INFO:journalctl@ceph.osd.8.smithi192.stdout:Jun 02 05:07:43 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-8[69456]: 2024-06-02T05:07:43.491+0000 7f12a6404700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-06-02T05:07:09.517224+0000 front 2024-06-02T05:07:09.517339+0000 (oldest deadline 2024-06-02T05:07:33.617069+0000) 2024-06-02T05:07:43.932 INFO:journalctl@ceph.osd.8.smithi192.stdout:Jun 02 05:07:43 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-8[69456]: 2024-06-02T05:07:43.491+0000 7f12a6404700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-06-02T05:07:17.118256+0000 front 2024-06-02T05:07:17.118152+0000 (oldest deadline 2024-06-02T05:07:38.118514+0000) 2024-06-02T05:07:43.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:43 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:43.646+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.401238+0000 front 2024-06-02T05:06:46.401264+0000 (oldest deadline 2024-06-02T05:07:09.301320+0000) 2024-06-02T05:07:43.933 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:43 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:43.646+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.303014+0000 front 2024-06-02T05:06:53.302902+0000 (oldest deadline 2024-06-02T05:07:18.002899+0000) 2024-06-02T05:07:43.933 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:43 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:43.646+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:00.303757+0000 front 2024-06-02T05:07:00.303798+0000 (oldest deadline 2024-06-02T05:07:24.403914+0000) 2024-06-02T05:07:43.933 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:43 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:43.646+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-06-02T05:07:16.706052+0000 front 2024-06-02T05:07:16.706202+0000 (oldest deadline 2024-06-02T05:07:42.606070+0000) 2024-06-02T05:07:43.984 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:43 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:43.658+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:47.393359+0000 front 2024-06-02T05:06:47.393381+0000 (oldest deadline 2024-06-02T05:07:11.493703+0000) 2024-06-02T05:07:43.984 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:43 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:43.658+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:54.995133+0000 front 2024-06-02T05:06:54.995118+0000 (oldest deadline 2024-06-02T05:07:17.294826+0000) 2024-06-02T05:07:43.984 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:43 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:43.658+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:06:57.795907+0000 front 2024-06-02T05:06:57.795921+0000 (oldest deadline 2024-06-02T05:07:23.696025+0000) 2024-06-02T05:07:43.984 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:43 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:43.658+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-06-02T05:07:09.596998+0000 front 2024-06-02T05:07:09.597043+0000 (oldest deadline 2024-06-02T05:07:30.697188+0000) 2024-06-02T05:07:43.984 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:43 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:43.658+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-06-02T05:07:15.398022+0000 front 2024-06-02T05:07:15.397997+0000 (oldest deadline 2024-06-02T05:07:39.498032+0000) 2024-06-02T05:07:44.346 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:44 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:44.050+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.939930+0000 front 2024-06-02T05:06:46.939951+0000 (oldest deadline 2024-06-02T05:07:12.840133+0000) 2024-06-02T05:07:44.347 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:44 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:44.050+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.941275+0000 front 2024-06-02T05:06:53.941295+0000 (oldest deadline 2024-06-02T05:07:17.441478+0000) 2024-06-02T05:07:44.347 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:44 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:44.050+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:02.142732+0000 front 2024-06-02T05:07:02.142715+0000 (oldest deadline 2024-06-02T05:07:25.642928+0000) 2024-06-02T05:07:44.347 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:44 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:44.050+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-06-02T05:07:05.643520+0000 front 2024-06-02T05:07:05.643422+0000 (oldest deadline 2024-06-02T05:07:30.943577+0000) 2024-06-02T05:07:44.347 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:44 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:44.050+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-06-02T05:07:12.644513+0000 front 2024-06-02T05:07:12.644454+0000 (oldest deadline 2024-06-02T05:07:37.944703+0000) 2024-06-02T05:07:44.934 INFO:journalctl@ceph.osd.8.smithi192.stdout:Jun 02 05:07:44 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-8[69456]: 2024-06-02T05:07:44.473+0000 7f12a6404700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:47.913588+0000 front 2024-06-02T05:06:47.913663+0000 (oldest deadline 2024-06-02T05:07:11.413557+0000) 2024-06-02T05:07:44.934 INFO:journalctl@ceph.osd.8.smithi192.stdout:Jun 02 05:07:44 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-8[69456]: 2024-06-02T05:07:44.473+0000 7f12a6404700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:51.414200+0000 front 2024-06-02T05:06:51.414217+0000 (oldest deadline 2024-06-02T05:07:17.314193+0000) 2024-06-02T05:07:44.934 INFO:journalctl@ceph.osd.8.smithi192.stdout:Jun 02 05:07:44 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-8[69456]: 2024-06-02T05:07:44.473+0000 7f12a6404700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:01.415283+0000 front 2024-06-02T05:07:01.415436+0000 (oldest deadline 2024-06-02T05:07:26.115513+0000) 2024-06-02T05:07:44.934 INFO:journalctl@ceph.osd.8.smithi192.stdout:Jun 02 05:07:44 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-8[69456]: 2024-06-02T05:07:44.473+0000 7f12a6404700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-06-02T05:07:09.517224+0000 front 2024-06-02T05:07:09.517339+0000 (oldest deadline 2024-06-02T05:07:33.617069+0000) 2024-06-02T05:07:44.934 INFO:journalctl@ceph.osd.8.smithi192.stdout:Jun 02 05:07:44 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-8[69456]: 2024-06-02T05:07:44.473+0000 7f12a6404700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-06-02T05:07:17.118256+0000 front 2024-06-02T05:07:17.118152+0000 (oldest deadline 2024-06-02T05:07:38.118514+0000) 2024-06-02T05:07:44.934 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:44 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:44.632+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.401238+0000 front 2024-06-02T05:06:46.401264+0000 (oldest deadline 2024-06-02T05:07:09.301320+0000) 2024-06-02T05:07:44.934 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:44 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:44.632+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.303014+0000 front 2024-06-02T05:06:53.302902+0000 (oldest deadline 2024-06-02T05:07:18.002899+0000) 2024-06-02T05:07:44.935 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:44 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:44.632+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:00.303757+0000 front 2024-06-02T05:07:00.303798+0000 (oldest deadline 2024-06-02T05:07:24.403914+0000) 2024-06-02T05:07:44.935 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:44 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:44.632+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-06-02T05:07:16.706052+0000 front 2024-06-02T05:07:16.706202+0000 (oldest deadline 2024-06-02T05:07:42.606070+0000) 2024-06-02T05:07:44.984 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:44 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:44.687+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:47.393359+0000 front 2024-06-02T05:06:47.393381+0000 (oldest deadline 2024-06-02T05:07:11.493703+0000) 2024-06-02T05:07:44.984 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:44 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:44.687+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:54.995133+0000 front 2024-06-02T05:06:54.995118+0000 (oldest deadline 2024-06-02T05:07:17.294826+0000) 2024-06-02T05:07:44.984 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:44 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:44.687+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:06:57.795907+0000 front 2024-06-02T05:06:57.795921+0000 (oldest deadline 2024-06-02T05:07:23.696025+0000) 2024-06-02T05:07:44.984 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:44 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:44.687+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-06-02T05:07:09.596998+0000 front 2024-06-02T05:07:09.597043+0000 (oldest deadline 2024-06-02T05:07:30.697188+0000) 2024-06-02T05:07:44.984 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:44 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:44.687+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-06-02T05:07:15.398022+0000 front 2024-06-02T05:07:15.397997+0000 (oldest deadline 2024-06-02T05:07:39.498032+0000) 2024-06-02T05:07:45.346 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:45 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:45.050+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.939930+0000 front 2024-06-02T05:06:46.939951+0000 (oldest deadline 2024-06-02T05:07:12.840133+0000) 2024-06-02T05:07:45.347 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:45 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:45.050+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.941275+0000 front 2024-06-02T05:06:53.941295+0000 (oldest deadline 2024-06-02T05:07:17.441478+0000) 2024-06-02T05:07:45.347 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:45 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:45.050+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:02.142732+0000 front 2024-06-02T05:07:02.142715+0000 (oldest deadline 2024-06-02T05:07:25.642928+0000) 2024-06-02T05:07:45.349 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:45 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:45.050+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-06-02T05:07:05.643520+0000 front 2024-06-02T05:07:05.643422+0000 (oldest deadline 2024-06-02T05:07:30.943577+0000) 2024-06-02T05:07:45.349 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:45 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:45.050+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-06-02T05:07:12.644513+0000 front 2024-06-02T05:07:12.644454+0000 (oldest deadline 2024-06-02T05:07:37.944703+0000) 2024-06-02T05:07:45.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:45 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:45.655+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.401238+0000 front 2024-06-02T05:06:46.401264+0000 (oldest deadline 2024-06-02T05:07:09.301320+0000) 2024-06-02T05:07:45.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:45 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:45.655+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.303014+0000 front 2024-06-02T05:06:53.302902+0000 (oldest deadline 2024-06-02T05:07:18.002899+0000) 2024-06-02T05:07:45.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:45 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:45.655+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:00.303757+0000 front 2024-06-02T05:07:00.303798+0000 (oldest deadline 2024-06-02T05:07:24.403914+0000) 2024-06-02T05:07:45.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:45 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:45.655+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-06-02T05:07:16.706052+0000 front 2024-06-02T05:07:16.706202+0000 (oldest deadline 2024-06-02T05:07:42.606070+0000) 2024-06-02T05:07:45.932 INFO:journalctl@ceph.osd.8.smithi192.stdout:Jun 02 05:07:45 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-8[69456]: 2024-06-02T05:07:45.504+0000 7f12a6404700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:47.913588+0000 front 2024-06-02T05:06:47.913663+0000 (oldest deadline 2024-06-02T05:07:11.413557+0000) 2024-06-02T05:07:45.932 INFO:journalctl@ceph.osd.8.smithi192.stdout:Jun 02 05:07:45 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-8[69456]: 2024-06-02T05:07:45.504+0000 7f12a6404700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:51.414200+0000 front 2024-06-02T05:06:51.414217+0000 (oldest deadline 2024-06-02T05:07:17.314193+0000) 2024-06-02T05:07:45.933 INFO:journalctl@ceph.osd.8.smithi192.stdout:Jun 02 05:07:45 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-8[69456]: 2024-06-02T05:07:45.504+0000 7f12a6404700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:01.415283+0000 front 2024-06-02T05:07:01.415436+0000 (oldest deadline 2024-06-02T05:07:26.115513+0000) 2024-06-02T05:07:45.933 INFO:journalctl@ceph.osd.8.smithi192.stdout:Jun 02 05:07:45 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-8[69456]: 2024-06-02T05:07:45.504+0000 7f12a6404700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-06-02T05:07:09.517224+0000 front 2024-06-02T05:07:09.517339+0000 (oldest deadline 2024-06-02T05:07:33.617069+0000) 2024-06-02T05:07:45.933 INFO:journalctl@ceph.osd.8.smithi192.stdout:Jun 02 05:07:45 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-8[69456]: 2024-06-02T05:07:45.504+0000 7f12a6404700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-06-02T05:07:17.118256+0000 front 2024-06-02T05:07:17.118152+0000 (oldest deadline 2024-06-02T05:07:38.118514+0000) 2024-06-02T05:07:45.933 INFO:journalctl@ceph.osd.8.smithi192.stdout:Jun 02 05:07:45 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-8[69456]: 2024-06-02T05:07:45.504+0000 7f12a6404700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-06-02T05:07:21.520290+0000 front 2024-06-02T05:07:21.520310+0000 (oldest deadline 2024-06-02T05:07:45.020383+0000) 2024-06-02T05:07:45.984 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:45 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:45.691+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:47.393359+0000 front 2024-06-02T05:06:47.393381+0000 (oldest deadline 2024-06-02T05:07:11.493703+0000) 2024-06-02T05:07:45.984 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:45 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:45.691+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:54.995133+0000 front 2024-06-02T05:06:54.995118+0000 (oldest deadline 2024-06-02T05:07:17.294826+0000) 2024-06-02T05:07:45.984 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:45 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:45.691+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:06:57.795907+0000 front 2024-06-02T05:06:57.795921+0000 (oldest deadline 2024-06-02T05:07:23.696025+0000) 2024-06-02T05:07:45.984 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:45 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:45.691+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-06-02T05:07:09.596998+0000 front 2024-06-02T05:07:09.597043+0000 (oldest deadline 2024-06-02T05:07:30.697188+0000) 2024-06-02T05:07:45.984 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:45 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:45.691+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-06-02T05:07:15.398022+0000 front 2024-06-02T05:07:15.397997+0000 (oldest deadline 2024-06-02T05:07:39.498032+0000) 2024-06-02T05:07:46.346 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:46 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:46.015+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.939930+0000 front 2024-06-02T05:06:46.939951+0000 (oldest deadline 2024-06-02T05:07:12.840133+0000) 2024-06-02T05:07:46.347 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:46 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:46.015+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.941275+0000 front 2024-06-02T05:06:53.941295+0000 (oldest deadline 2024-06-02T05:07:17.441478+0000) 2024-06-02T05:07:46.347 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:46 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:46.015+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:02.142732+0000 front 2024-06-02T05:07:02.142715+0000 (oldest deadline 2024-06-02T05:07:25.642928+0000) 2024-06-02T05:07:46.347 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:46 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:46.015+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-06-02T05:07:05.643520+0000 front 2024-06-02T05:07:05.643422+0000 (oldest deadline 2024-06-02T05:07:30.943577+0000) 2024-06-02T05:07:46.347 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:46 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:46.015+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-06-02T05:07:12.644513+0000 front 2024-06-02T05:07:12.644454+0000 (oldest deadline 2024-06-02T05:07:37.944703+0000) 2024-06-02T05:07:46.984 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:46 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:46.709+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:47.393359+0000 front 2024-06-02T05:06:47.393381+0000 (oldest deadline 2024-06-02T05:07:11.493703+0000) 2024-06-02T05:07:46.984 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:46 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:46.709+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:54.995133+0000 front 2024-06-02T05:06:54.995118+0000 (oldest deadline 2024-06-02T05:07:17.294826+0000) 2024-06-02T05:07:46.984 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:46 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:46.709+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:06:57.795907+0000 front 2024-06-02T05:06:57.795921+0000 (oldest deadline 2024-06-02T05:07:23.696025+0000) 2024-06-02T05:07:46.984 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:46 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:46.709+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-06-02T05:07:09.596998+0000 front 2024-06-02T05:07:09.597043+0000 (oldest deadline 2024-06-02T05:07:30.697188+0000) 2024-06-02T05:07:46.984 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:46 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:46.709+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-06-02T05:07:15.398022+0000 front 2024-06-02T05:07:15.397997+0000 (oldest deadline 2024-06-02T05:07:39.498032+0000) 2024-06-02T05:07:47.015 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:46 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:46.681+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.401238+0000 front 2024-06-02T05:06:46.401264+0000 (oldest deadline 2024-06-02T05:07:09.301320+0000) 2024-06-02T05:07:47.016 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:46 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:46.681+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.303014+0000 front 2024-06-02T05:06:53.302902+0000 (oldest deadline 2024-06-02T05:07:18.002899+0000) 2024-06-02T05:07:47.016 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:46 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:46.681+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:00.303757+0000 front 2024-06-02T05:07:00.303798+0000 (oldest deadline 2024-06-02T05:07:24.403914+0000) 2024-06-02T05:07:47.016 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:46 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:46.681+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-06-02T05:07:16.706052+0000 front 2024-06-02T05:07:16.706202+0000 (oldest deadline 2024-06-02T05:07:42.606070+0000) 2024-06-02T05:07:47.346 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:47 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:47.051+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.939930+0000 front 2024-06-02T05:06:46.939951+0000 (oldest deadline 2024-06-02T05:07:12.840133+0000) 2024-06-02T05:07:47.347 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:47 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:47.051+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.941275+0000 front 2024-06-02T05:06:53.941295+0000 (oldest deadline 2024-06-02T05:07:17.441478+0000) 2024-06-02T05:07:47.347 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:47 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:47.051+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:02.142732+0000 front 2024-06-02T05:07:02.142715+0000 (oldest deadline 2024-06-02T05:07:25.642928+0000) 2024-06-02T05:07:47.347 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:47 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:47.051+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-06-02T05:07:05.643520+0000 front 2024-06-02T05:07:05.643422+0000 (oldest deadline 2024-06-02T05:07:30.943577+0000) 2024-06-02T05:07:47.347 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:47 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:47.051+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-06-02T05:07:12.644513+0000 front 2024-06-02T05:07:12.644454+0000 (oldest deadline 2024-06-02T05:07:37.944703+0000) 2024-06-02T05:07:47.432 INFO:journalctl@ceph.osd.8.smithi192.stdout:Jun 02 05:07:47 smithi192 bash[91321]: ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-8 2024-06-02T05:07:47.887 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:47 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:47.652+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.401238+0000 front 2024-06-02T05:06:46.401264+0000 (oldest deadline 2024-06-02T05:07:09.301320+0000) 2024-06-02T05:07:47.887 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:47 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:47.652+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.303014+0000 front 2024-06-02T05:06:53.302902+0000 (oldest deadline 2024-06-02T05:07:18.002899+0000) 2024-06-02T05:07:47.887 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:47 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:47.652+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:00.303757+0000 front 2024-06-02T05:07:00.303798+0000 (oldest deadline 2024-06-02T05:07:24.403914+0000) 2024-06-02T05:07:47.887 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:47 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:47.652+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-06-02T05:07:16.706052+0000 front 2024-06-02T05:07:16.706202+0000 (oldest deadline 2024-06-02T05:07:42.606070+0000) 2024-06-02T05:07:48.215 DEBUG:teuthology.orchestra.run.smithi192:> sudo pkill -f 'journalctl -f -n 0 -u ceph-60ab6d30-209a-11ef-bc9b-c7b262605968@osd.8.service' 2024-06-02T05:07:48.234 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:47 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:47.750+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:47.393359+0000 front 2024-06-02T05:06:47.393381+0000 (oldest deadline 2024-06-02T05:07:11.493703+0000) 2024-06-02T05:07:48.234 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:47 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:47.750+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:54.995133+0000 front 2024-06-02T05:06:54.995118+0000 (oldest deadline 2024-06-02T05:07:17.294826+0000) 2024-06-02T05:07:48.234 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:47 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:47.750+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:06:57.795907+0000 front 2024-06-02T05:06:57.795921+0000 (oldest deadline 2024-06-02T05:07:23.696025+0000) 2024-06-02T05:07:48.234 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:47 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:47.750+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-06-02T05:07:09.596998+0000 front 2024-06-02T05:07:09.597043+0000 (oldest deadline 2024-06-02T05:07:30.697188+0000) 2024-06-02T05:07:48.234 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:47 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:47.750+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-06-02T05:07:15.398022+0000 front 2024-06-02T05:07:15.397997+0000 (oldest deadline 2024-06-02T05:07:39.498032+0000) 2024-06-02T05:07:48.256 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-02T05:07:48.256 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-06-02T05:07:48.256 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-06-02T05:07:48.256 DEBUG:teuthology.orchestra.run.smithi076:> sudo systemctl stop ceph-60ab6d30-209a-11ef-bc9b-c7b262605968@osd.9 2024-06-02T05:07:48.346 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:48 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:48.066+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.939930+0000 front 2024-06-02T05:06:46.939951+0000 (oldest deadline 2024-06-02T05:07:12.840133+0000) 2024-06-02T05:07:48.347 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:48 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:48.066+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.941275+0000 front 2024-06-02T05:06:53.941295+0000 (oldest deadline 2024-06-02T05:07:17.441478+0000) 2024-06-02T05:07:48.347 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:48 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:48.066+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:02.142732+0000 front 2024-06-02T05:07:02.142715+0000 (oldest deadline 2024-06-02T05:07:25.642928+0000) 2024-06-02T05:07:48.347 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:48 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:48.066+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-06-02T05:07:05.643520+0000 front 2024-06-02T05:07:05.643422+0000 (oldest deadline 2024-06-02T05:07:30.943577+0000) 2024-06-02T05:07:48.347 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:48 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:48.066+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-06-02T05:07:12.644513+0000 front 2024-06-02T05:07:12.644454+0000 (oldest deadline 2024-06-02T05:07:37.944703+0000) 2024-06-02T05:07:48.568 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:48 smithi076 systemd[1]: Stopping Ceph osd.9 for 60ab6d30-209a-11ef-bc9b-c7b262605968... 2024-06-02T05:07:48.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:48 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:48.612+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.401238+0000 front 2024-06-02T05:06:46.401264+0000 (oldest deadline 2024-06-02T05:07:09.301320+0000) 2024-06-02T05:07:48.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:48 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:48.612+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.303014+0000 front 2024-06-02T05:06:53.302902+0000 (oldest deadline 2024-06-02T05:07:18.002899+0000) 2024-06-02T05:07:48.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:48 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:48.612+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:00.303757+0000 front 2024-06-02T05:07:00.303798+0000 (oldest deadline 2024-06-02T05:07:24.403914+0000) 2024-06-02T05:07:48.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:48 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:48.612+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-06-02T05:07:16.706052+0000 front 2024-06-02T05:07:16.706202+0000 (oldest deadline 2024-06-02T05:07:42.606070+0000) 2024-06-02T05:07:48.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:48 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:48.612+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-06-02T05:07:22.606660+0000 front 2024-06-02T05:07:22.606634+0000 (oldest deadline 2024-06-02T05:07:47.906821+0000) 2024-06-02T05:07:48.984 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:48 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:48.567+0000 7f41d2c5a700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-02T05:07:48.984 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:48 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:48.567+0000 7f41d2c5a700 -1 osd.9 84 *** Got signal Terminated *** 2024-06-02T05:07:48.984 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:48 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:48.567+0000 7f41d2c5a700 -1 osd.9 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-02T05:07:48.984 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:48 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:48.788+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:47.393359+0000 front 2024-06-02T05:06:47.393381+0000 (oldest deadline 2024-06-02T05:07:11.493703+0000) 2024-06-02T05:07:48.984 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:48 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:48.788+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:54.995133+0000 front 2024-06-02T05:06:54.995118+0000 (oldest deadline 2024-06-02T05:07:17.294826+0000) 2024-06-02T05:07:48.984 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:48 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:48.788+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:06:57.795907+0000 front 2024-06-02T05:06:57.795921+0000 (oldest deadline 2024-06-02T05:07:23.696025+0000) 2024-06-02T05:07:48.984 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:48 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:48.788+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-06-02T05:07:09.596998+0000 front 2024-06-02T05:07:09.597043+0000 (oldest deadline 2024-06-02T05:07:30.697188+0000) 2024-06-02T05:07:48.984 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:48 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:48.788+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-06-02T05:07:15.398022+0000 front 2024-06-02T05:07:15.397997+0000 (oldest deadline 2024-06-02T05:07:39.498032+0000) 2024-06-02T05:07:49.596 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:49 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:49.112+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.939930+0000 front 2024-06-02T05:06:46.939951+0000 (oldest deadline 2024-06-02T05:07:12.840133+0000) 2024-06-02T05:07:49.597 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:49 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:49.112+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.941275+0000 front 2024-06-02T05:06:53.941295+0000 (oldest deadline 2024-06-02T05:07:17.441478+0000) 2024-06-02T05:07:49.597 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:49 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:49.112+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:02.142732+0000 front 2024-06-02T05:07:02.142715+0000 (oldest deadline 2024-06-02T05:07:25.642928+0000) 2024-06-02T05:07:49.597 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:49 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:49.112+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-06-02T05:07:05.643520+0000 front 2024-06-02T05:07:05.643422+0000 (oldest deadline 2024-06-02T05:07:30.943577+0000) 2024-06-02T05:07:49.597 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:49 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:49.112+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-06-02T05:07:12.644513+0000 front 2024-06-02T05:07:12.644454+0000 (oldest deadline 2024-06-02T05:07:37.944703+0000) 2024-06-02T05:07:49.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:49 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:49.589+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.401238+0000 front 2024-06-02T05:06:46.401264+0000 (oldest deadline 2024-06-02T05:07:09.301320+0000) 2024-06-02T05:07:49.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:49 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:49.589+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.303014+0000 front 2024-06-02T05:06:53.302902+0000 (oldest deadline 2024-06-02T05:07:18.002899+0000) 2024-06-02T05:07:49.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:49 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:49.589+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:00.303757+0000 front 2024-06-02T05:07:00.303798+0000 (oldest deadline 2024-06-02T05:07:24.403914+0000) 2024-06-02T05:07:49.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:49 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:49.589+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-06-02T05:07:16.706052+0000 front 2024-06-02T05:07:16.706202+0000 (oldest deadline 2024-06-02T05:07:42.606070+0000) 2024-06-02T05:07:49.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:49 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:49.589+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-06-02T05:07:22.606660+0000 front 2024-06-02T05:07:22.606634+0000 (oldest deadline 2024-06-02T05:07:47.906821+0000) 2024-06-02T05:07:50.234 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:49 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:49.813+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:47.393359+0000 front 2024-06-02T05:06:47.393381+0000 (oldest deadline 2024-06-02T05:07:11.493703+0000) 2024-06-02T05:07:50.234 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:49 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:49.813+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:54.995133+0000 front 2024-06-02T05:06:54.995118+0000 (oldest deadline 2024-06-02T05:07:17.294826+0000) 2024-06-02T05:07:50.234 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:49 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:49.813+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:06:57.795907+0000 front 2024-06-02T05:06:57.795921+0000 (oldest deadline 2024-06-02T05:07:23.696025+0000) 2024-06-02T05:07:50.234 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:49 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:49.813+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-06-02T05:07:09.596998+0000 front 2024-06-02T05:07:09.597043+0000 (oldest deadline 2024-06-02T05:07:30.697188+0000) 2024-06-02T05:07:50.234 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:49 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:49.813+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-06-02T05:07:15.398022+0000 front 2024-06-02T05:07:15.397997+0000 (oldest deadline 2024-06-02T05:07:39.498032+0000) 2024-06-02T05:07:50.235 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:49 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:49.813+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-06-02T05:07:24.099457+0000 front 2024-06-02T05:07:24.099405+0000 (oldest deadline 2024-06-02T05:07:49.399287+0000) 2024-06-02T05:07:50.597 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:50 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:50.131+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.939930+0000 front 2024-06-02T05:06:46.939951+0000 (oldest deadline 2024-06-02T05:07:12.840133+0000) 2024-06-02T05:07:50.597 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:50 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:50.131+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.941275+0000 front 2024-06-02T05:06:53.941295+0000 (oldest deadline 2024-06-02T05:07:17.441478+0000) 2024-06-02T05:07:50.597 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:50 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:50.131+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:02.142732+0000 front 2024-06-02T05:07:02.142715+0000 (oldest deadline 2024-06-02T05:07:25.642928+0000) 2024-06-02T05:07:50.597 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:50 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:50.131+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-06-02T05:07:05.643520+0000 front 2024-06-02T05:07:05.643422+0000 (oldest deadline 2024-06-02T05:07:30.943577+0000) 2024-06-02T05:07:50.597 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:50 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:50.131+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-06-02T05:07:12.644513+0000 front 2024-06-02T05:07:12.644454+0000 (oldest deadline 2024-06-02T05:07:37.944703+0000) 2024-06-02T05:07:50.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:50 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:50.539+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.401238+0000 front 2024-06-02T05:06:46.401264+0000 (oldest deadline 2024-06-02T05:07:09.301320+0000) 2024-06-02T05:07:50.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:50 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:50.539+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.303014+0000 front 2024-06-02T05:06:53.302902+0000 (oldest deadline 2024-06-02T05:07:18.002899+0000) 2024-06-02T05:07:50.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:50 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:50.539+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:00.303757+0000 front 2024-06-02T05:07:00.303798+0000 (oldest deadline 2024-06-02T05:07:24.403914+0000) 2024-06-02T05:07:50.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:50 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:50.539+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-06-02T05:07:16.706052+0000 front 2024-06-02T05:07:16.706202+0000 (oldest deadline 2024-06-02T05:07:42.606070+0000) 2024-06-02T05:07:50.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:50 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:50.539+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-06-02T05:07:22.606660+0000 front 2024-06-02T05:07:22.606634+0000 (oldest deadline 2024-06-02T05:07:47.906821+0000) 2024-06-02T05:07:51.234 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:50 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:50.768+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:47.393359+0000 front 2024-06-02T05:06:47.393381+0000 (oldest deadline 2024-06-02T05:07:11.493703+0000) 2024-06-02T05:07:51.234 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:50 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:50.768+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:54.995133+0000 front 2024-06-02T05:06:54.995118+0000 (oldest deadline 2024-06-02T05:07:17.294826+0000) 2024-06-02T05:07:51.234 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:50 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:50.768+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:06:57.795907+0000 front 2024-06-02T05:06:57.795921+0000 (oldest deadline 2024-06-02T05:07:23.696025+0000) 2024-06-02T05:07:51.234 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:50 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:50.768+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-06-02T05:07:09.596998+0000 front 2024-06-02T05:07:09.597043+0000 (oldest deadline 2024-06-02T05:07:30.697188+0000) 2024-06-02T05:07:51.235 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:50 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:50.768+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-06-02T05:07:15.398022+0000 front 2024-06-02T05:07:15.397997+0000 (oldest deadline 2024-06-02T05:07:39.498032+0000) 2024-06-02T05:07:51.235 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:50 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:50.768+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-06-02T05:07:24.099457+0000 front 2024-06-02T05:07:24.099405+0000 (oldest deadline 2024-06-02T05:07:49.399287+0000) 2024-06-02T05:07:51.346 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:51 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:51.095+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.939930+0000 front 2024-06-02T05:06:46.939951+0000 (oldest deadline 2024-06-02T05:07:12.840133+0000) 2024-06-02T05:07:51.347 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:51 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:51.095+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.941275+0000 front 2024-06-02T05:06:53.941295+0000 (oldest deadline 2024-06-02T05:07:17.441478+0000) 2024-06-02T05:07:51.347 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:51 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:51.095+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:02.142732+0000 front 2024-06-02T05:07:02.142715+0000 (oldest deadline 2024-06-02T05:07:25.642928+0000) 2024-06-02T05:07:51.347 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:51 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:51.095+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-06-02T05:07:05.643520+0000 front 2024-06-02T05:07:05.643422+0000 (oldest deadline 2024-06-02T05:07:30.943577+0000) 2024-06-02T05:07:51.347 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:51 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:51.095+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-06-02T05:07:12.644513+0000 front 2024-06-02T05:07:12.644454+0000 (oldest deadline 2024-06-02T05:07:37.944703+0000) 2024-06-02T05:07:51.347 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:51 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:51.095+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-06-02T05:07:19.645961+0000 front 2024-06-02T05:07:19.645982+0000 (oldest deadline 2024-06-02T05:07:50.846634+0000) 2024-06-02T05:07:51.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:51 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:51.528+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.401238+0000 front 2024-06-02T05:06:46.401264+0000 (oldest deadline 2024-06-02T05:07:09.301320+0000) 2024-06-02T05:07:51.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:51 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:51.528+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.303014+0000 front 2024-06-02T05:06:53.302902+0000 (oldest deadline 2024-06-02T05:07:18.002899+0000) 2024-06-02T05:07:51.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:51 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:51.528+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:00.303757+0000 front 2024-06-02T05:07:00.303798+0000 (oldest deadline 2024-06-02T05:07:24.403914+0000) 2024-06-02T05:07:51.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:51 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:51.528+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-06-02T05:07:16.706052+0000 front 2024-06-02T05:07:16.706202+0000 (oldest deadline 2024-06-02T05:07:42.606070+0000) 2024-06-02T05:07:51.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:51 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:51.528+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-06-02T05:07:22.606660+0000 front 2024-06-02T05:07:22.606634+0000 (oldest deadline 2024-06-02T05:07:47.906821+0000) 2024-06-02T05:07:52.234 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:51 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:51.740+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:47.393359+0000 front 2024-06-02T05:06:47.393381+0000 (oldest deadline 2024-06-02T05:07:11.493703+0000) 2024-06-02T05:07:52.235 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:51 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:51.740+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:54.995133+0000 front 2024-06-02T05:06:54.995118+0000 (oldest deadline 2024-06-02T05:07:17.294826+0000) 2024-06-02T05:07:52.235 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:51 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:51.740+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:06:57.795907+0000 front 2024-06-02T05:06:57.795921+0000 (oldest deadline 2024-06-02T05:07:23.696025+0000) 2024-06-02T05:07:52.235 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:51 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:51.740+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-06-02T05:07:09.596998+0000 front 2024-06-02T05:07:09.597043+0000 (oldest deadline 2024-06-02T05:07:30.697188+0000) 2024-06-02T05:07:52.235 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:51 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:51.740+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-06-02T05:07:15.398022+0000 front 2024-06-02T05:07:15.397997+0000 (oldest deadline 2024-06-02T05:07:39.498032+0000) 2024-06-02T05:07:52.235 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:51 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:51.740+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-06-02T05:07:24.099457+0000 front 2024-06-02T05:07:24.099405+0000 (oldest deadline 2024-06-02T05:07:49.399287+0000) 2024-06-02T05:07:52.346 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:52 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:52.066+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.939930+0000 front 2024-06-02T05:06:46.939951+0000 (oldest deadline 2024-06-02T05:07:12.840133+0000) 2024-06-02T05:07:52.347 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:52 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:52.066+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.941275+0000 front 2024-06-02T05:06:53.941295+0000 (oldest deadline 2024-06-02T05:07:17.441478+0000) 2024-06-02T05:07:52.347 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:52 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:52.066+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:02.142732+0000 front 2024-06-02T05:07:02.142715+0000 (oldest deadline 2024-06-02T05:07:25.642928+0000) 2024-06-02T05:07:52.347 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:52 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:52.066+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-06-02T05:07:05.643520+0000 front 2024-06-02T05:07:05.643422+0000 (oldest deadline 2024-06-02T05:07:30.943577+0000) 2024-06-02T05:07:52.347 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:52 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:52.066+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-06-02T05:07:12.644513+0000 front 2024-06-02T05:07:12.644454+0000 (oldest deadline 2024-06-02T05:07:37.944703+0000) 2024-06-02T05:07:52.347 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:52 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:52.066+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-06-02T05:07:19.645961+0000 front 2024-06-02T05:07:19.645982+0000 (oldest deadline 2024-06-02T05:07:50.846634+0000) 2024-06-02T05:07:52.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:52 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:52.493+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.401238+0000 front 2024-06-02T05:06:46.401264+0000 (oldest deadline 2024-06-02T05:07:09.301320+0000) 2024-06-02T05:07:52.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:52 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:52.493+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.303014+0000 front 2024-06-02T05:06:53.302902+0000 (oldest deadline 2024-06-02T05:07:18.002899+0000) 2024-06-02T05:07:52.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:52 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:52.493+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:00.303757+0000 front 2024-06-02T05:07:00.303798+0000 (oldest deadline 2024-06-02T05:07:24.403914+0000) 2024-06-02T05:07:52.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:52 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:52.493+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-06-02T05:07:16.706052+0000 front 2024-06-02T05:07:16.706202+0000 (oldest deadline 2024-06-02T05:07:42.606070+0000) 2024-06-02T05:07:52.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:52 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:52.493+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-06-02T05:07:22.606660+0000 front 2024-06-02T05:07:22.606634+0000 (oldest deadline 2024-06-02T05:07:47.906821+0000) 2024-06-02T05:07:53.234 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:52 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:52.741+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:47.393359+0000 front 2024-06-02T05:06:47.393381+0000 (oldest deadline 2024-06-02T05:07:11.493703+0000) 2024-06-02T05:07:53.234 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:52 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:52.741+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:54.995133+0000 front 2024-06-02T05:06:54.995118+0000 (oldest deadline 2024-06-02T05:07:17.294826+0000) 2024-06-02T05:07:53.234 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:52 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:52.741+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:06:57.795907+0000 front 2024-06-02T05:06:57.795921+0000 (oldest deadline 2024-06-02T05:07:23.696025+0000) 2024-06-02T05:07:53.234 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:52 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:52.741+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-06-02T05:07:09.596998+0000 front 2024-06-02T05:07:09.597043+0000 (oldest deadline 2024-06-02T05:07:30.697188+0000) 2024-06-02T05:07:53.234 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:52 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:52.741+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-06-02T05:07:15.398022+0000 front 2024-06-02T05:07:15.397997+0000 (oldest deadline 2024-06-02T05:07:39.498032+0000) 2024-06-02T05:07:53.234 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:52 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9[87600]: 2024-06-02T05:07:52.741+0000 7f41cb248700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-06-02T05:07:24.099457+0000 front 2024-06-02T05:07:24.099405+0000 (oldest deadline 2024-06-02T05:07:49.399287+0000) 2024-06-02T05:07:53.596 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:53 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:53.101+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.939930+0000 front 2024-06-02T05:06:46.939951+0000 (oldest deadline 2024-06-02T05:07:12.840133+0000) 2024-06-02T05:07:53.597 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:53 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:53.101+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.941275+0000 front 2024-06-02T05:06:53.941295+0000 (oldest deadline 2024-06-02T05:07:17.441478+0000) 2024-06-02T05:07:53.597 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:53 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:53.101+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:02.142732+0000 front 2024-06-02T05:07:02.142715+0000 (oldest deadline 2024-06-02T05:07:25.642928+0000) 2024-06-02T05:07:53.597 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:53 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:53.101+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-06-02T05:07:05.643520+0000 front 2024-06-02T05:07:05.643422+0000 (oldest deadline 2024-06-02T05:07:30.943577+0000) 2024-06-02T05:07:53.597 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:53 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:53.101+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-06-02T05:07:12.644513+0000 front 2024-06-02T05:07:12.644454+0000 (oldest deadline 2024-06-02T05:07:37.944703+0000) 2024-06-02T05:07:53.597 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:53 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:53.101+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-06-02T05:07:19.645961+0000 front 2024-06-02T05:07:19.645982+0000 (oldest deadline 2024-06-02T05:07:50.846634+0000) 2024-06-02T05:07:53.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:53 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:53.505+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.401238+0000 front 2024-06-02T05:06:46.401264+0000 (oldest deadline 2024-06-02T05:07:09.301320+0000) 2024-06-02T05:07:53.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:53 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:53.505+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.303014+0000 front 2024-06-02T05:06:53.302902+0000 (oldest deadline 2024-06-02T05:07:18.002899+0000) 2024-06-02T05:07:53.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:53 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:53.505+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:00.303757+0000 front 2024-06-02T05:07:00.303798+0000 (oldest deadline 2024-06-02T05:07:24.403914+0000) 2024-06-02T05:07:53.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:53 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:53.505+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-06-02T05:07:16.706052+0000 front 2024-06-02T05:07:16.706202+0000 (oldest deadline 2024-06-02T05:07:42.606070+0000) 2024-06-02T05:07:53.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:53 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:53.505+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-06-02T05:07:22.606660+0000 front 2024-06-02T05:07:22.606634+0000 (oldest deadline 2024-06-02T05:07:47.906821+0000) 2024-06-02T05:07:54.596 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:54 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:54.096+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.939930+0000 front 2024-06-02T05:06:46.939951+0000 (oldest deadline 2024-06-02T05:07:12.840133+0000) 2024-06-02T05:07:54.597 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:54 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:54.096+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.941275+0000 front 2024-06-02T05:06:53.941295+0000 (oldest deadline 2024-06-02T05:07:17.441478+0000) 2024-06-02T05:07:54.597 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:54 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:54.096+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:02.142732+0000 front 2024-06-02T05:07:02.142715+0000 (oldest deadline 2024-06-02T05:07:25.642928+0000) 2024-06-02T05:07:54.597 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:54 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:54.096+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-06-02T05:07:05.643520+0000 front 2024-06-02T05:07:05.643422+0000 (oldest deadline 2024-06-02T05:07:30.943577+0000) 2024-06-02T05:07:54.597 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:54 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:54.096+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-06-02T05:07:12.644513+0000 front 2024-06-02T05:07:12.644454+0000 (oldest deadline 2024-06-02T05:07:37.944703+0000) 2024-06-02T05:07:54.597 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:54 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:54.096+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-06-02T05:07:19.645961+0000 front 2024-06-02T05:07:19.645982+0000 (oldest deadline 2024-06-02T05:07:50.846634+0000) 2024-06-02T05:07:54.734 INFO:journalctl@ceph.osd.9.smithi076.stdout:Jun 02 05:07:54 smithi076 bash[128906]: ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-9 2024-06-02T05:07:54.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:54 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:54.493+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.401238+0000 front 2024-06-02T05:06:46.401264+0000 (oldest deadline 2024-06-02T05:07:09.301320+0000) 2024-06-02T05:07:54.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:54 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:54.493+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.303014+0000 front 2024-06-02T05:06:53.302902+0000 (oldest deadline 2024-06-02T05:07:18.002899+0000) 2024-06-02T05:07:54.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:54 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:54.493+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:00.303757+0000 front 2024-06-02T05:07:00.303798+0000 (oldest deadline 2024-06-02T05:07:24.403914+0000) 2024-06-02T05:07:54.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:54 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:54.493+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-06-02T05:07:16.706052+0000 front 2024-06-02T05:07:16.706202+0000 (oldest deadline 2024-06-02T05:07:42.606070+0000) 2024-06-02T05:07:54.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:54 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:54.493+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-06-02T05:07:22.606660+0000 front 2024-06-02T05:07:22.606634+0000 (oldest deadline 2024-06-02T05:07:47.906821+0000) 2024-06-02T05:07:55.347 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:55 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:55.079+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.939930+0000 front 2024-06-02T05:06:46.939951+0000 (oldest deadline 2024-06-02T05:07:12.840133+0000) 2024-06-02T05:07:55.347 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:55 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:55.079+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.941275+0000 front 2024-06-02T05:06:53.941295+0000 (oldest deadline 2024-06-02T05:07:17.441478+0000) 2024-06-02T05:07:55.347 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:55 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:55.079+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:02.142732+0000 front 2024-06-02T05:07:02.142715+0000 (oldest deadline 2024-06-02T05:07:25.642928+0000) 2024-06-02T05:07:55.347 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:55 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:55.079+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-06-02T05:07:05.643520+0000 front 2024-06-02T05:07:05.643422+0000 (oldest deadline 2024-06-02T05:07:30.943577+0000) 2024-06-02T05:07:55.347 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:55 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:55.079+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-06-02T05:07:12.644513+0000 front 2024-06-02T05:07:12.644454+0000 (oldest deadline 2024-06-02T05:07:37.944703+0000) 2024-06-02T05:07:55.347 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:55 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:55.079+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-06-02T05:07:19.645961+0000 front 2024-06-02T05:07:19.645982+0000 (oldest deadline 2024-06-02T05:07:50.846634+0000) 2024-06-02T05:07:55.347 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:55 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:55.079+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.76:6822 osd.6 since back 2024-06-02T05:07:30.847234+0000 front 2024-06-02T05:07:30.847151+0000 (oldest deadline 2024-06-02T05:07:54.947114+0000) 2024-06-02T05:07:55.589 DEBUG:teuthology.orchestra.run.smithi076:> sudo pkill -f 'journalctl -f -n 0 -u ceph-60ab6d30-209a-11ef-bc9b-c7b262605968@osd.9.service' 2024-06-02T05:07:55.631 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-02T05:07:55.631 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-06-02T05:07:55.632 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-06-02T05:07:55.632 DEBUG:teuthology.orchestra.run.smithi119:> sudo systemctl stop ceph-60ab6d30-209a-11ef-bc9b-c7b262605968@osd.10 2024-06-02T05:07:55.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:55 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:55.532+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.401238+0000 front 2024-06-02T05:06:46.401264+0000 (oldest deadline 2024-06-02T05:07:09.301320+0000) 2024-06-02T05:07:55.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:55 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:55.532+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.303014+0000 front 2024-06-02T05:06:53.302902+0000 (oldest deadline 2024-06-02T05:07:18.002899+0000) 2024-06-02T05:07:55.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:55 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:55.532+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:00.303757+0000 front 2024-06-02T05:07:00.303798+0000 (oldest deadline 2024-06-02T05:07:24.403914+0000) 2024-06-02T05:07:55.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:55 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:55.532+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-06-02T05:07:16.706052+0000 front 2024-06-02T05:07:16.706202+0000 (oldest deadline 2024-06-02T05:07:42.606070+0000) 2024-06-02T05:07:55.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:55 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:55.532+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-06-02T05:07:22.606660+0000 front 2024-06-02T05:07:22.606634+0000 (oldest deadline 2024-06-02T05:07:47.906821+0000) 2024-06-02T05:07:56.045 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:55 smithi119 systemd[1]: Stopping Ceph osd.10 for 60ab6d30-209a-11ef-bc9b-c7b262605968... 2024-06-02T05:07:56.045 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:55 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:55.874+0000 7f692719f700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-02T05:07:56.045 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:55 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:55.874+0000 7f692719f700 -1 osd.10 84 *** Got signal Terminated *** 2024-06-02T05:07:56.045 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:55 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:55.874+0000 7f692719f700 -1 osd.10 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-02T05:07:56.045 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:56 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:56.045+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.939930+0000 front 2024-06-02T05:06:46.939951+0000 (oldest deadline 2024-06-02T05:07:12.840133+0000) 2024-06-02T05:07:56.045 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:56 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:56.045+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.941275+0000 front 2024-06-02T05:06:53.941295+0000 (oldest deadline 2024-06-02T05:07:17.441478+0000) 2024-06-02T05:07:56.346 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:56 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:56.045+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:02.142732+0000 front 2024-06-02T05:07:02.142715+0000 (oldest deadline 2024-06-02T05:07:25.642928+0000) 2024-06-02T05:07:56.346 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:56 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:56.045+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-06-02T05:07:05.643520+0000 front 2024-06-02T05:07:05.643422+0000 (oldest deadline 2024-06-02T05:07:30.943577+0000) 2024-06-02T05:07:56.347 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:56 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:56.045+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-06-02T05:07:12.644513+0000 front 2024-06-02T05:07:12.644454+0000 (oldest deadline 2024-06-02T05:07:37.944703+0000) 2024-06-02T05:07:56.347 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:56 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:56.045+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-06-02T05:07:19.645961+0000 front 2024-06-02T05:07:19.645982+0000 (oldest deadline 2024-06-02T05:07:50.846634+0000) 2024-06-02T05:07:56.347 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:56 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:56.045+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.76:6822 osd.6 since back 2024-06-02T05:07:30.847234+0000 front 2024-06-02T05:07:30.847151+0000 (oldest deadline 2024-06-02T05:07:54.947114+0000) 2024-06-02T05:07:56.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:56 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:56.573+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.401238+0000 front 2024-06-02T05:06:46.401264+0000 (oldest deadline 2024-06-02T05:07:09.301320+0000) 2024-06-02T05:07:56.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:56 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:56.573+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.303014+0000 front 2024-06-02T05:06:53.302902+0000 (oldest deadline 2024-06-02T05:07:18.002899+0000) 2024-06-02T05:07:56.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:56 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:56.573+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:00.303757+0000 front 2024-06-02T05:07:00.303798+0000 (oldest deadline 2024-06-02T05:07:24.403914+0000) 2024-06-02T05:07:56.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:56 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:56.573+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-06-02T05:07:16.706052+0000 front 2024-06-02T05:07:16.706202+0000 (oldest deadline 2024-06-02T05:07:42.606070+0000) 2024-06-02T05:07:56.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:56 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:56.573+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-06-02T05:07:22.606660+0000 front 2024-06-02T05:07:22.606634+0000 (oldest deadline 2024-06-02T05:07:47.906821+0000) 2024-06-02T05:07:56.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:56 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:56.573+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.76:6822 osd.6 since back 2024-06-02T05:07:30.108698+0000 front 2024-06-02T05:07:30.108769+0000 (oldest deadline 2024-06-02T05:07:56.008585+0000) 2024-06-02T05:07:57.346 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:57 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:57.004+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.939930+0000 front 2024-06-02T05:06:46.939951+0000 (oldest deadline 2024-06-02T05:07:12.840133+0000) 2024-06-02T05:07:57.347 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:57 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:57.004+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.941275+0000 front 2024-06-02T05:06:53.941295+0000 (oldest deadline 2024-06-02T05:07:17.441478+0000) 2024-06-02T05:07:57.347 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:57 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:57.004+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:02.142732+0000 front 2024-06-02T05:07:02.142715+0000 (oldest deadline 2024-06-02T05:07:25.642928+0000) 2024-06-02T05:07:57.347 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:57 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:57.004+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-06-02T05:07:05.643520+0000 front 2024-06-02T05:07:05.643422+0000 (oldest deadline 2024-06-02T05:07:30.943577+0000) 2024-06-02T05:07:57.347 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:57 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:57.004+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-06-02T05:07:12.644513+0000 front 2024-06-02T05:07:12.644454+0000 (oldest deadline 2024-06-02T05:07:37.944703+0000) 2024-06-02T05:07:57.347 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:57 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:57.004+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-06-02T05:07:19.645961+0000 front 2024-06-02T05:07:19.645982+0000 (oldest deadline 2024-06-02T05:07:50.846634+0000) 2024-06-02T05:07:57.347 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:57 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:57.004+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.76:6822 osd.6 since back 2024-06-02T05:07:30.847234+0000 front 2024-06-02T05:07:30.847151+0000 (oldest deadline 2024-06-02T05:07:54.947114+0000) 2024-06-02T05:07:57.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:57 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:57.616+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.401238+0000 front 2024-06-02T05:06:46.401264+0000 (oldest deadline 2024-06-02T05:07:09.301320+0000) 2024-06-02T05:07:57.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:57 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:57.616+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.303014+0000 front 2024-06-02T05:06:53.302902+0000 (oldest deadline 2024-06-02T05:07:18.002899+0000) 2024-06-02T05:07:57.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:57 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:57.616+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:00.303757+0000 front 2024-06-02T05:07:00.303798+0000 (oldest deadline 2024-06-02T05:07:24.403914+0000) 2024-06-02T05:07:57.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:57 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:57.616+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-06-02T05:07:16.706052+0000 front 2024-06-02T05:07:16.706202+0000 (oldest deadline 2024-06-02T05:07:42.606070+0000) 2024-06-02T05:07:57.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:57 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:57.616+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-06-02T05:07:22.606660+0000 front 2024-06-02T05:07:22.606634+0000 (oldest deadline 2024-06-02T05:07:47.906821+0000) 2024-06-02T05:07:57.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:57 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:57.616+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.76:6822 osd.6 since back 2024-06-02T05:07:30.108698+0000 front 2024-06-02T05:07:30.108769+0000 (oldest deadline 2024-06-02T05:07:56.008585+0000) 2024-06-02T05:07:58.346 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:58 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:58.027+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.939930+0000 front 2024-06-02T05:06:46.939951+0000 (oldest deadline 2024-06-02T05:07:12.840133+0000) 2024-06-02T05:07:58.347 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:58 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:58.027+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.941275+0000 front 2024-06-02T05:06:53.941295+0000 (oldest deadline 2024-06-02T05:07:17.441478+0000) 2024-06-02T05:07:58.347 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:58 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:58.027+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:02.142732+0000 front 2024-06-02T05:07:02.142715+0000 (oldest deadline 2024-06-02T05:07:25.642928+0000) 2024-06-02T05:07:58.347 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:58 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:58.027+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-06-02T05:07:05.643520+0000 front 2024-06-02T05:07:05.643422+0000 (oldest deadline 2024-06-02T05:07:30.943577+0000) 2024-06-02T05:07:58.347 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:58 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:58.027+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-06-02T05:07:12.644513+0000 front 2024-06-02T05:07:12.644454+0000 (oldest deadline 2024-06-02T05:07:37.944703+0000) 2024-06-02T05:07:58.347 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:58 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:58.027+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-06-02T05:07:19.645961+0000 front 2024-06-02T05:07:19.645982+0000 (oldest deadline 2024-06-02T05:07:50.846634+0000) 2024-06-02T05:07:58.347 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:58 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:58.027+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.76:6822 osd.6 since back 2024-06-02T05:07:30.847234+0000 front 2024-06-02T05:07:30.847151+0000 (oldest deadline 2024-06-02T05:07:54.947114+0000) 2024-06-02T05:07:58.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:58 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:58.577+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.401238+0000 front 2024-06-02T05:06:46.401264+0000 (oldest deadline 2024-06-02T05:07:09.301320+0000) 2024-06-02T05:07:58.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:58 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:58.577+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.303014+0000 front 2024-06-02T05:06:53.302902+0000 (oldest deadline 2024-06-02T05:07:18.002899+0000) 2024-06-02T05:07:58.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:58 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:58.577+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:00.303757+0000 front 2024-06-02T05:07:00.303798+0000 (oldest deadline 2024-06-02T05:07:24.403914+0000) 2024-06-02T05:07:58.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:58 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:58.577+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-06-02T05:07:16.706052+0000 front 2024-06-02T05:07:16.706202+0000 (oldest deadline 2024-06-02T05:07:42.606070+0000) 2024-06-02T05:07:58.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:58 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:58.577+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-06-02T05:07:22.606660+0000 front 2024-06-02T05:07:22.606634+0000 (oldest deadline 2024-06-02T05:07:47.906821+0000) 2024-06-02T05:07:58.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:58 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:58.577+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.76:6822 osd.6 since back 2024-06-02T05:07:30.108698+0000 front 2024-06-02T05:07:30.108769+0000 (oldest deadline 2024-06-02T05:07:56.008585+0000) 2024-06-02T05:07:59.346 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:59 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:59.068+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.939930+0000 front 2024-06-02T05:06:46.939951+0000 (oldest deadline 2024-06-02T05:07:12.840133+0000) 2024-06-02T05:07:59.347 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:59 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:59.068+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.941275+0000 front 2024-06-02T05:06:53.941295+0000 (oldest deadline 2024-06-02T05:07:17.441478+0000) 2024-06-02T05:07:59.347 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:59 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:59.068+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:02.142732+0000 front 2024-06-02T05:07:02.142715+0000 (oldest deadline 2024-06-02T05:07:25.642928+0000) 2024-06-02T05:07:59.347 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:59 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:59.068+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-06-02T05:07:05.643520+0000 front 2024-06-02T05:07:05.643422+0000 (oldest deadline 2024-06-02T05:07:30.943577+0000) 2024-06-02T05:07:59.347 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:59 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:59.068+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-06-02T05:07:12.644513+0000 front 2024-06-02T05:07:12.644454+0000 (oldest deadline 2024-06-02T05:07:37.944703+0000) 2024-06-02T05:07:59.347 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:59 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:59.068+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-06-02T05:07:19.645961+0000 front 2024-06-02T05:07:19.645982+0000 (oldest deadline 2024-06-02T05:07:50.846634+0000) 2024-06-02T05:07:59.347 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:07:59 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:07:59.068+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.76:6822 osd.6 since back 2024-06-02T05:07:30.847234+0000 front 2024-06-02T05:07:30.847151+0000 (oldest deadline 2024-06-02T05:07:54.947114+0000) 2024-06-02T05:07:59.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:59 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:59.546+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.401238+0000 front 2024-06-02T05:06:46.401264+0000 (oldest deadline 2024-06-02T05:07:09.301320+0000) 2024-06-02T05:07:59.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:59 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:59.546+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.303014+0000 front 2024-06-02T05:06:53.302902+0000 (oldest deadline 2024-06-02T05:07:18.002899+0000) 2024-06-02T05:07:59.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:59 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:59.546+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:00.303757+0000 front 2024-06-02T05:07:00.303798+0000 (oldest deadline 2024-06-02T05:07:24.403914+0000) 2024-06-02T05:07:59.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:59 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:59.546+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-06-02T05:07:16.706052+0000 front 2024-06-02T05:07:16.706202+0000 (oldest deadline 2024-06-02T05:07:42.606070+0000) 2024-06-02T05:07:59.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:59 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:59.546+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-06-02T05:07:22.606660+0000 front 2024-06-02T05:07:22.606634+0000 (oldest deadline 2024-06-02T05:07:47.906821+0000) 2024-06-02T05:07:59.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:07:59 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:07:59.546+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.76:6822 osd.6 since back 2024-06-02T05:07:30.108698+0000 front 2024-06-02T05:07:30.108769+0000 (oldest deadline 2024-06-02T05:07:56.008585+0000) 2024-06-02T05:08:00.596 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:08:00 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:08:00.098+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.939930+0000 front 2024-06-02T05:06:46.939951+0000 (oldest deadline 2024-06-02T05:07:12.840133+0000) 2024-06-02T05:08:00.597 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:08:00 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:08:00.098+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.941275+0000 front 2024-06-02T05:06:53.941295+0000 (oldest deadline 2024-06-02T05:07:17.441478+0000) 2024-06-02T05:08:00.597 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:08:00 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:08:00.098+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:02.142732+0000 front 2024-06-02T05:07:02.142715+0000 (oldest deadline 2024-06-02T05:07:25.642928+0000) 2024-06-02T05:08:00.597 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:08:00 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:08:00.098+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-06-02T05:07:05.643520+0000 front 2024-06-02T05:07:05.643422+0000 (oldest deadline 2024-06-02T05:07:30.943577+0000) 2024-06-02T05:08:00.597 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:08:00 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:08:00.098+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-06-02T05:07:12.644513+0000 front 2024-06-02T05:07:12.644454+0000 (oldest deadline 2024-06-02T05:07:37.944703+0000) 2024-06-02T05:08:00.597 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:08:00 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:08:00.098+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-06-02T05:07:19.645961+0000 front 2024-06-02T05:07:19.645982+0000 (oldest deadline 2024-06-02T05:07:50.846634+0000) 2024-06-02T05:08:00.597 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:08:00 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10[76379]: 2024-06-02T05:08:00.098+0000 7f691f78d700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.76:6822 osd.6 since back 2024-06-02T05:07:30.847234+0000 front 2024-06-02T05:07:30.847151+0000 (oldest deadline 2024-06-02T05:07:54.947114+0000) 2024-06-02T05:08:00.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:08:00 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:08:00.553+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.401238+0000 front 2024-06-02T05:06:46.401264+0000 (oldest deadline 2024-06-02T05:07:09.301320+0000) 2024-06-02T05:08:00.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:08:00 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:08:00.553+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.303014+0000 front 2024-06-02T05:06:53.302902+0000 (oldest deadline 2024-06-02T05:07:18.002899+0000) 2024-06-02T05:08:00.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:08:00 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:08:00.553+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:00.303757+0000 front 2024-06-02T05:07:00.303798+0000 (oldest deadline 2024-06-02T05:07:24.403914+0000) 2024-06-02T05:08:00.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:08:00 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:08:00.553+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-06-02T05:07:16.706052+0000 front 2024-06-02T05:07:16.706202+0000 (oldest deadline 2024-06-02T05:07:42.606070+0000) 2024-06-02T05:08:00.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:08:00 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:08:00.553+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-06-02T05:07:22.606660+0000 front 2024-06-02T05:07:22.606634+0000 (oldest deadline 2024-06-02T05:07:47.906821+0000) 2024-06-02T05:08:00.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:08:00 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:08:00.553+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.76:6822 osd.6 since back 2024-06-02T05:07:30.108698+0000 front 2024-06-02T05:07:30.108769+0000 (oldest deadline 2024-06-02T05:07:56.008585+0000) 2024-06-02T05:08:00.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:08:00 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:08:00.553+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6820 osd.7 since back 2024-06-02T05:07:36.009128+0000 front 2024-06-02T05:07:36.009113+0000 (oldest deadline 2024-06-02T05:08:00.109075+0000) 2024-06-02T05:08:01.846 INFO:journalctl@ceph.osd.10.smithi119.stdout:Jun 02 05:08:01 smithi119 bash[90495]: ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-10 2024-06-02T05:08:01.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:08:01 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:08:01.575+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.401238+0000 front 2024-06-02T05:06:46.401264+0000 (oldest deadline 2024-06-02T05:07:09.301320+0000) 2024-06-02T05:08:01.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:08:01 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:08:01.575+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.303014+0000 front 2024-06-02T05:06:53.302902+0000 (oldest deadline 2024-06-02T05:07:18.002899+0000) 2024-06-02T05:08:01.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:08:01 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:08:01.575+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:00.303757+0000 front 2024-06-02T05:07:00.303798+0000 (oldest deadline 2024-06-02T05:07:24.403914+0000) 2024-06-02T05:08:01.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:08:01 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:08:01.575+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-06-02T05:07:16.706052+0000 front 2024-06-02T05:07:16.706202+0000 (oldest deadline 2024-06-02T05:07:42.606070+0000) 2024-06-02T05:08:01.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:08:01 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:08:01.575+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-06-02T05:07:22.606660+0000 front 2024-06-02T05:07:22.606634+0000 (oldest deadline 2024-06-02T05:07:47.906821+0000) 2024-06-02T05:08:01.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:08:01 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:08:01.575+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.76:6822 osd.6 since back 2024-06-02T05:07:30.108698+0000 front 2024-06-02T05:07:30.108769+0000 (oldest deadline 2024-06-02T05:07:56.008585+0000) 2024-06-02T05:08:01.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:08:01 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:08:01.575+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6820 osd.7 since back 2024-06-02T05:07:36.009128+0000 front 2024-06-02T05:07:36.009113+0000 (oldest deadline 2024-06-02T05:08:00.109075+0000) 2024-06-02T05:08:02.737 DEBUG:teuthology.orchestra.run.smithi119:> sudo pkill -f 'journalctl -f -n 0 -u ceph-60ab6d30-209a-11ef-bc9b-c7b262605968@osd.10.service' 2024-06-02T05:08:02.783 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-02T05:08:02.783 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-06-02T05:08:02.783 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-06-02T05:08:02.783 DEBUG:teuthology.orchestra.run.smithi192:> sudo systemctl stop ceph-60ab6d30-209a-11ef-bc9b-c7b262605968@osd.11 2024-06-02T05:08:02.815 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:08:02 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:08:02.553+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.401238+0000 front 2024-06-02T05:06:46.401264+0000 (oldest deadline 2024-06-02T05:07:09.301320+0000) 2024-06-02T05:08:02.815 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:08:02 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:08:02.553+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.303014+0000 front 2024-06-02T05:06:53.302902+0000 (oldest deadline 2024-06-02T05:07:18.002899+0000) 2024-06-02T05:08:02.815 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:08:02 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:08:02.553+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:00.303757+0000 front 2024-06-02T05:07:00.303798+0000 (oldest deadline 2024-06-02T05:07:24.403914+0000) 2024-06-02T05:08:02.816 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:08:02 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:08:02.553+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-06-02T05:07:16.706052+0000 front 2024-06-02T05:07:16.706202+0000 (oldest deadline 2024-06-02T05:07:42.606070+0000) 2024-06-02T05:08:02.816 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:08:02 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:08:02.553+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-06-02T05:07:22.606660+0000 front 2024-06-02T05:07:22.606634+0000 (oldest deadline 2024-06-02T05:07:47.906821+0000) 2024-06-02T05:08:02.816 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:08:02 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:08:02.553+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.76:6822 osd.6 since back 2024-06-02T05:07:30.108698+0000 front 2024-06-02T05:07:30.108769+0000 (oldest deadline 2024-06-02T05:07:56.008585+0000) 2024-06-02T05:08:02.816 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:08:02 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:08:02.553+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6820 osd.7 since back 2024-06-02T05:07:36.009128+0000 front 2024-06-02T05:07:36.009113+0000 (oldest deadline 2024-06-02T05:08:00.109075+0000) 2024-06-02T05:08:03.182 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:08:02 smithi192 systemd[1]: Stopping Ceph osd.11 for 60ab6d30-209a-11ef-bc9b-c7b262605968... 2024-06-02T05:08:03.182 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:08:03 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:08:03.024+0000 7f962ff4c700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-02T05:08:03.182 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:08:03 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:08:03.024+0000 7f962ff4c700 -1 osd.11 84 *** Got signal Terminated *** 2024-06-02T05:08:03.182 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:08:03 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:08:03.024+0000 7f962ff4c700 -1 osd.11 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-02T05:08:03.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:08:03 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:08:03.577+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.401238+0000 front 2024-06-02T05:06:46.401264+0000 (oldest deadline 2024-06-02T05:07:09.301320+0000) 2024-06-02T05:08:03.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:08:03 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:08:03.577+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.303014+0000 front 2024-06-02T05:06:53.302902+0000 (oldest deadline 2024-06-02T05:07:18.002899+0000) 2024-06-02T05:08:03.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:08:03 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:08:03.577+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:00.303757+0000 front 2024-06-02T05:07:00.303798+0000 (oldest deadline 2024-06-02T05:07:24.403914+0000) 2024-06-02T05:08:03.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:08:03 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:08:03.577+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-06-02T05:07:16.706052+0000 front 2024-06-02T05:07:16.706202+0000 (oldest deadline 2024-06-02T05:07:42.606070+0000) 2024-06-02T05:08:03.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:08:03 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:08:03.577+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-06-02T05:07:22.606660+0000 front 2024-06-02T05:07:22.606634+0000 (oldest deadline 2024-06-02T05:07:47.906821+0000) 2024-06-02T05:08:03.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:08:03 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:08:03.577+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.76:6822 osd.6 since back 2024-06-02T05:07:30.108698+0000 front 2024-06-02T05:07:30.108769+0000 (oldest deadline 2024-06-02T05:07:56.008585+0000) 2024-06-02T05:08:03.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:08:03 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:08:03.577+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6820 osd.7 since back 2024-06-02T05:07:36.009128+0000 front 2024-06-02T05:07:36.009113+0000 (oldest deadline 2024-06-02T05:08:00.109075+0000) 2024-06-02T05:08:04.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:08:04 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:08:04.571+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.401238+0000 front 2024-06-02T05:06:46.401264+0000 (oldest deadline 2024-06-02T05:07:09.301320+0000) 2024-06-02T05:08:04.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:08:04 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:08:04.571+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.303014+0000 front 2024-06-02T05:06:53.302902+0000 (oldest deadline 2024-06-02T05:07:18.002899+0000) 2024-06-02T05:08:04.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:08:04 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:08:04.571+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:00.303757+0000 front 2024-06-02T05:07:00.303798+0000 (oldest deadline 2024-06-02T05:07:24.403914+0000) 2024-06-02T05:08:04.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:08:04 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:08:04.571+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-06-02T05:07:16.706052+0000 front 2024-06-02T05:07:16.706202+0000 (oldest deadline 2024-06-02T05:07:42.606070+0000) 2024-06-02T05:08:04.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:08:04 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:08:04.571+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-06-02T05:07:22.606660+0000 front 2024-06-02T05:07:22.606634+0000 (oldest deadline 2024-06-02T05:07:47.906821+0000) 2024-06-02T05:08:04.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:08:04 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:08:04.571+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.76:6822 osd.6 since back 2024-06-02T05:07:30.108698+0000 front 2024-06-02T05:07:30.108769+0000 (oldest deadline 2024-06-02T05:07:56.008585+0000) 2024-06-02T05:08:04.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:08:04 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:08:04.571+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6820 osd.7 since back 2024-06-02T05:07:36.009128+0000 front 2024-06-02T05:07:36.009113+0000 (oldest deadline 2024-06-02T05:08:00.109075+0000) 2024-06-02T05:08:05.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:08:05 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:08:05.606+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.401238+0000 front 2024-06-02T05:06:46.401264+0000 (oldest deadline 2024-06-02T05:07:09.301320+0000) 2024-06-02T05:08:05.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:08:05 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:08:05.606+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.303014+0000 front 2024-06-02T05:06:53.302902+0000 (oldest deadline 2024-06-02T05:07:18.002899+0000) 2024-06-02T05:08:05.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:08:05 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:08:05.606+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:00.303757+0000 front 2024-06-02T05:07:00.303798+0000 (oldest deadline 2024-06-02T05:07:24.403914+0000) 2024-06-02T05:08:05.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:08:05 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:08:05.606+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-06-02T05:07:16.706052+0000 front 2024-06-02T05:07:16.706202+0000 (oldest deadline 2024-06-02T05:07:42.606070+0000) 2024-06-02T05:08:05.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:08:05 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:08:05.606+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-06-02T05:07:22.606660+0000 front 2024-06-02T05:07:22.606634+0000 (oldest deadline 2024-06-02T05:07:47.906821+0000) 2024-06-02T05:08:05.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:08:05 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:08:05.606+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.76:6822 osd.6 since back 2024-06-02T05:07:30.108698+0000 front 2024-06-02T05:07:30.108769+0000 (oldest deadline 2024-06-02T05:07:56.008585+0000) 2024-06-02T05:08:05.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:08:05 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:08:05.606+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6820 osd.7 since back 2024-06-02T05:07:36.009128+0000 front 2024-06-02T05:07:36.009113+0000 (oldest deadline 2024-06-02T05:08:00.109075+0000) 2024-06-02T05:08:06.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:08:06 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:08:06.626+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.401238+0000 front 2024-06-02T05:06:46.401264+0000 (oldest deadline 2024-06-02T05:07:09.301320+0000) 2024-06-02T05:08:06.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:08:06 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:08:06.626+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.303014+0000 front 2024-06-02T05:06:53.302902+0000 (oldest deadline 2024-06-02T05:07:18.002899+0000) 2024-06-02T05:08:06.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:08:06 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:08:06.626+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:00.303757+0000 front 2024-06-02T05:07:00.303798+0000 (oldest deadline 2024-06-02T05:07:24.403914+0000) 2024-06-02T05:08:06.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:08:06 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:08:06.626+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-06-02T05:07:16.706052+0000 front 2024-06-02T05:07:16.706202+0000 (oldest deadline 2024-06-02T05:07:42.606070+0000) 2024-06-02T05:08:06.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:08:06 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:08:06.626+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-06-02T05:07:22.606660+0000 front 2024-06-02T05:07:22.606634+0000 (oldest deadline 2024-06-02T05:07:47.906821+0000) 2024-06-02T05:08:06.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:08:06 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:08:06.626+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.76:6822 osd.6 since back 2024-06-02T05:07:30.108698+0000 front 2024-06-02T05:07:30.108769+0000 (oldest deadline 2024-06-02T05:07:56.008585+0000) 2024-06-02T05:08:06.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:08:06 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:08:06.626+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6820 osd.7 since back 2024-06-02T05:07:36.009128+0000 front 2024-06-02T05:07:36.009113+0000 (oldest deadline 2024-06-02T05:08:00.109075+0000) 2024-06-02T05:08:07.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:08:07 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:08:07.634+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-06-02T05:06:46.401238+0000 front 2024-06-02T05:06:46.401264+0000 (oldest deadline 2024-06-02T05:07:09.301320+0000) 2024-06-02T05:08:07.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:08:07 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:08:07.634+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-06-02T05:06:53.303014+0000 front 2024-06-02T05:06:53.302902+0000 (oldest deadline 2024-06-02T05:07:18.002899+0000) 2024-06-02T05:08:07.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:08:07 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:08:07.634+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-06-02T05:07:00.303757+0000 front 2024-06-02T05:07:00.303798+0000 (oldest deadline 2024-06-02T05:07:24.403914+0000) 2024-06-02T05:08:07.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:08:07 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:08:07.634+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-06-02T05:07:16.706052+0000 front 2024-06-02T05:07:16.706202+0000 (oldest deadline 2024-06-02T05:07:42.606070+0000) 2024-06-02T05:08:07.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:08:07 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:08:07.634+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-06-02T05:07:22.606660+0000 front 2024-06-02T05:07:22.606634+0000 (oldest deadline 2024-06-02T05:07:47.906821+0000) 2024-06-02T05:08:07.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:08:07 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:08:07.634+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.76:6822 osd.6 since back 2024-06-02T05:07:30.108698+0000 front 2024-06-02T05:07:30.108769+0000 (oldest deadline 2024-06-02T05:07:56.008585+0000) 2024-06-02T05:08:07.932 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:08:07 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11[78226]: 2024-06-02T05:08:07.634+0000 7f962c542700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.119:6820 osd.7 since back 2024-06-02T05:07:36.009128+0000 front 2024-06-02T05:07:36.009113+0000 (oldest deadline 2024-06-02T05:08:00.109075+0000) 2024-06-02T05:08:08.933 INFO:journalctl@ceph.osd.11.smithi192.stdout:Jun 02 05:08:08 smithi192 bash[91586]: ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-osd-11 2024-06-02T05:08:09.879 DEBUG:teuthology.orchestra.run.smithi192:> sudo pkill -f 'journalctl -f -n 0 -u ceph-60ab6d30-209a-11ef-bc9b-c7b262605968@osd.11.service' 2024-06-02T05:08:09.960 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-02T05:08:09.961 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-06-02T05:08:09.961 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-06-02T05:08:09.961 DEBUG:teuthology.orchestra.run.smithi076:> sudo systemctl stop ceph-60ab6d30-209a-11ef-bc9b-c7b262605968@mds.a 2024-06-02T05:08:10.484 INFO:journalctl@ceph.mds.a.smithi076.stdout:Jun 02 05:08:10 smithi076 systemd[1]: Stopping Ceph mds.a for 60ab6d30-209a-11ef-bc9b-c7b262605968... 2024-06-02T05:08:10.484 INFO:journalctl@ceph.mds.a.smithi076.stdout:Jun 02 05:08:10 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-a[95327]: 2024-06-02T05:08:10.206+0000 7f56e4cd3700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-02T05:08:10.484 INFO:journalctl@ceph.mds.a.smithi076.stdout:Jun 02 05:08:10 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-a[95327]: 2024-06-02T05:08:10.206+0000 7f56e4cd3700 -1 mds.a *** got signal Terminated *** 2024-06-02T05:08:11.977 INFO:journalctl@ceph.mds.a.smithi076.stdout:Jun 02 05:08:11 smithi076 bash[129168]: ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-a 2024-06-02T05:08:11.982 DEBUG:teuthology.orchestra.run.smithi076:> sudo pkill -f 'journalctl -f -n 0 -u ceph-60ab6d30-209a-11ef-bc9b-c7b262605968@mds.a.service' 2024-06-02T05:08:12.020 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-02T05:08:12.020 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-06-02T05:08:12.020 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-06-02T05:08:12.020 DEBUG:teuthology.orchestra.run.smithi076:> sudo systemctl stop ceph-60ab6d30-209a-11ef-bc9b-c7b262605968@mds.d 2024-06-02T05:08:12.234 INFO:journalctl@ceph.mds.d.smithi076.stdout:Jun 02 05:08:12 smithi076 systemd[1]: Stopping Ceph mds.d for 60ab6d30-209a-11ef-bc9b-c7b262605968... 2024-06-02T05:08:12.734 INFO:journalctl@ceph.mds.d.smithi076.stdout:Jun 02 05:08:12 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-d[94410]: 2024-06-02T05:08:12.272+0000 7fb139ce3700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-02T05:08:12.784 INFO:journalctl@ceph.mds.d.smithi076.stdout:Jun 02 05:08:12 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-d[94410]: 2024-06-02T05:08:12.272+0000 7fb139ce3700 -1 mds.d *** got signal Terminated *** 2024-06-02T05:08:15.734 INFO:journalctl@ceph.mds.d.smithi076.stdout:Jun 02 05:08:15 smithi076 bash[129307]: ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-d 2024-06-02T05:08:15.809 DEBUG:teuthology.orchestra.run.smithi076:> sudo pkill -f 'journalctl -f -n 0 -u ceph-60ab6d30-209a-11ef-bc9b-c7b262605968@mds.d.service' 2024-06-02T05:08:15.844 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-02T05:08:15.845 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-06-02T05:08:15.845 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-06-02T05:08:15.845 DEBUG:teuthology.orchestra.run.smithi076:> sudo systemctl stop ceph-60ab6d30-209a-11ef-bc9b-c7b262605968@mds.g 2024-06-02T05:08:16.098 INFO:journalctl@ceph.mds.g.smithi076.stdout:Jun 02 05:08:15 smithi076 systemd[1]: Stopping Ceph mds.g for 60ab6d30-209a-11ef-bc9b-c7b262605968... 2024-06-02T05:08:16.484 INFO:journalctl@ceph.mds.g.smithi076.stdout:Jun 02 05:08:16 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-g[94940]: 2024-06-02T05:08:16.097+0000 7f69fd991700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-02T05:08:16.484 INFO:journalctl@ceph.mds.g.smithi076.stdout:Jun 02 05:08:16 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-g[94940]: 2024-06-02T05:08:16.097+0000 7f69fd991700 -1 mds.g *** got signal Terminated *** 2024-06-02T05:08:18.235 INFO:journalctl@ceph.mds.g.smithi076.stdout:Jun 02 05:08:17 smithi076 bash[129445]: ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-g 2024-06-02T05:08:18.240 DEBUG:teuthology.orchestra.run.smithi076:> sudo pkill -f 'journalctl -f -n 0 -u ceph-60ab6d30-209a-11ef-bc9b-c7b262605968@mds.g.service' 2024-06-02T05:08:18.274 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-02T05:08:18.275 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-06-02T05:08:18.275 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-06-02T05:08:18.275 DEBUG:teuthology.orchestra.run.smithi076:> sudo systemctl stop ceph-60ab6d30-209a-11ef-bc9b-c7b262605968@mds.j 2024-06-02T05:08:18.530 INFO:journalctl@ceph.mds.j.smithi076.stdout:Jun 02 05:08:18 smithi076 systemd[1]: Stopping Ceph mds.j for 60ab6d30-209a-11ef-bc9b-c7b262605968... 2024-06-02T05:08:18.984 INFO:journalctl@ceph.mds.j.smithi076.stdout:Jun 02 05:08:18 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-j[94024]: 2024-06-02T05:08:18.529+0000 7fb2532c5700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-02T05:08:18.984 INFO:journalctl@ceph.mds.j.smithi076.stdout:Jun 02 05:08:18 smithi076 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-j[94024]: 2024-06-02T05:08:18.529+0000 7fb2532c5700 -1 mds.j *** got signal Terminated *** 2024-06-02T05:08:22.119 INFO:journalctl@ceph.mds.j.smithi076.stdout:Jun 02 05:08:21 smithi076 bash[129584]: ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-j 2024-06-02T05:08:22.126 DEBUG:teuthology.orchestra.run.smithi076:> sudo pkill -f 'journalctl -f -n 0 -u ceph-60ab6d30-209a-11ef-bc9b-c7b262605968@mds.j.service' 2024-06-02T05:08:22.160 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-02T05:08:22.161 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-06-02T05:08:22.161 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-06-02T05:08:22.161 DEBUG:teuthology.orchestra.run.smithi119:> sudo systemctl stop ceph-60ab6d30-209a-11ef-bc9b-c7b262605968@mds.b 2024-06-02T05:08:22.597 INFO:journalctl@ceph.mds.b.smithi119.stdout:Jun 02 05:08:22 smithi119 systemd[1]: Stopping Ceph mds.b for 60ab6d30-209a-11ef-bc9b-c7b262605968... 2024-06-02T05:08:22.597 INFO:journalctl@ceph.mds.b.smithi119.stdout:Jun 02 05:08:22 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-b[83265]: 2024-06-02T05:08:22.429+0000 7f60dfa58700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-02T05:08:22.597 INFO:journalctl@ceph.mds.b.smithi119.stdout:Jun 02 05:08:22 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-b[83265]: 2024-06-02T05:08:22.429+0000 7f60dfa58700 -1 mds.b *** got signal Terminated *** 2024-06-02T05:08:29.189 INFO:journalctl@ceph.mds.b.smithi119.stdout:Jun 02 05:08:28 smithi119 bash[90758]: ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-b 2024-06-02T05:08:29.195 DEBUG:teuthology.orchestra.run.smithi119:> sudo pkill -f 'journalctl -f -n 0 -u ceph-60ab6d30-209a-11ef-bc9b-c7b262605968@mds.b.service' 2024-06-02T05:08:29.232 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-02T05:08:29.233 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-06-02T05:08:29.233 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-06-02T05:08:29.233 DEBUG:teuthology.orchestra.run.smithi119:> sudo systemctl stop ceph-60ab6d30-209a-11ef-bc9b-c7b262605968@mds.e 2024-06-02T05:08:29.495 INFO:journalctl@ceph.mds.e.smithi119.stdout:Jun 02 05:08:29 smithi119 systemd[1]: Stopping Ceph mds.e for 60ab6d30-209a-11ef-bc9b-c7b262605968... 2024-06-02T05:08:29.846 INFO:journalctl@ceph.mds.e.smithi119.stdout:Jun 02 05:08:29 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-e[82588]: 2024-06-02T05:08:29.494+0000 7f4cf7237700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-02T05:08:29.846 INFO:journalctl@ceph.mds.e.smithi119.stdout:Jun 02 05:08:29 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-e[82588]: 2024-06-02T05:08:29.494+0000 7f4cf7237700 -1 mds.e *** got signal Terminated *** 2024-06-02T05:08:33.471 INFO:journalctl@ceph.mds.e.smithi119.stdout:Jun 02 05:08:33 smithi119 bash[90898]: ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-e 2024-06-02T05:08:33.477 DEBUG:teuthology.orchestra.run.smithi119:> sudo pkill -f 'journalctl -f -n 0 -u ceph-60ab6d30-209a-11ef-bc9b-c7b262605968@mds.e.service' 2024-06-02T05:08:33.517 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-02T05:08:33.517 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-06-02T05:08:33.517 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-06-02T05:08:33.517 DEBUG:teuthology.orchestra.run.smithi119:> sudo systemctl stop ceph-60ab6d30-209a-11ef-bc9b-c7b262605968@mds.h 2024-06-02T05:08:33.778 INFO:journalctl@ceph.mds.h.smithi119.stdout:Jun 02 05:08:33 smithi119 systemd[1]: Stopping Ceph mds.h for 60ab6d30-209a-11ef-bc9b-c7b262605968... 2024-06-02T05:08:34.096 INFO:journalctl@ceph.mds.h.smithi119.stdout:Jun 02 05:08:33 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-h[82925]: 2024-06-02T05:08:33.776+0000 7efd12cc6700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-02T05:08:34.097 INFO:journalctl@ceph.mds.h.smithi119.stdout:Jun 02 05:08:33 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-h[82925]: 2024-06-02T05:08:33.776+0000 7efd12cc6700 -1 mds.h *** got signal Terminated *** 2024-06-02T05:08:38.393 INFO:journalctl@ceph.mds.h.smithi119.stdout:Jun 02 05:08:38 smithi119 bash[91037]: ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-h 2024-06-02T05:08:38.398 DEBUG:teuthology.orchestra.run.smithi119:> sudo pkill -f 'journalctl -f -n 0 -u ceph-60ab6d30-209a-11ef-bc9b-c7b262605968@mds.h.service' 2024-06-02T05:08:38.432 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-02T05:08:38.432 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-06-02T05:08:38.433 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-06-02T05:08:38.433 DEBUG:teuthology.orchestra.run.smithi119:> sudo systemctl stop ceph-60ab6d30-209a-11ef-bc9b-c7b262605968@mds.k 2024-06-02T05:08:38.701 INFO:journalctl@ceph.mds.k.smithi119.stdout:Jun 02 05:08:38 smithi119 systemd[1]: Stopping Ceph mds.k for 60ab6d30-209a-11ef-bc9b-c7b262605968... 2024-06-02T05:08:39.096 INFO:journalctl@ceph.mds.k.smithi119.stdout:Jun 02 05:08:38 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-k[82248]: 2024-06-02T05:08:38.700+0000 7fdd2ea49700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-02T05:08:39.096 INFO:journalctl@ceph.mds.k.smithi119.stdout:Jun 02 05:08:38 smithi119 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-k[82248]: 2024-06-02T05:08:38.700+0000 7fdd2ea49700 -1 mds.k *** got signal Terminated *** 2024-06-02T05:08:43.188 INFO:journalctl@ceph.mds.k.smithi119.stdout:Jun 02 05:08:42 smithi119 bash[91175]: ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-k 2024-06-02T05:08:43.193 DEBUG:teuthology.orchestra.run.smithi119:> sudo pkill -f 'journalctl -f -n 0 -u ceph-60ab6d30-209a-11ef-bc9b-c7b262605968@mds.k.service' 2024-06-02T05:08:43.227 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-02T05:08:43.228 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-06-02T05:08:43.228 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-06-02T05:08:43.228 DEBUG:teuthology.orchestra.run.smithi192:> sudo systemctl stop ceph-60ab6d30-209a-11ef-bc9b-c7b262605968@mds.c 2024-06-02T05:08:43.682 INFO:journalctl@ceph.mds.c.smithi192.stdout:Jun 02 05:08:43 smithi192 systemd[1]: Stopping Ceph mds.c for 60ab6d30-209a-11ef-bc9b-c7b262605968... 2024-06-02T05:08:43.682 INFO:journalctl@ceph.mds.c.smithi192.stdout:Jun 02 05:08:43 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-c[84292]: 2024-06-02T05:08:43.467+0000 7f46ab8f1700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-02T05:08:43.682 INFO:journalctl@ceph.mds.c.smithi192.stdout:Jun 02 05:08:43 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-c[84292]: 2024-06-02T05:08:43.467+0000 7f46ab8f1700 -1 mds.c *** got signal Terminated *** 2024-06-02T05:08:49.021 INFO:journalctl@ceph.mds.c.smithi192.stdout:Jun 02 05:08:48 smithi192 bash[91840]: ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-c 2024-06-02T05:08:49.027 DEBUG:teuthology.orchestra.run.smithi192:> sudo pkill -f 'journalctl -f -n 0 -u ceph-60ab6d30-209a-11ef-bc9b-c7b262605968@mds.c.service' 2024-06-02T05:08:49.063 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-02T05:08:49.064 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-06-02T05:08:49.064 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-06-02T05:08:49.064 DEBUG:teuthology.orchestra.run.smithi192:> sudo systemctl stop ceph-60ab6d30-209a-11ef-bc9b-c7b262605968@mds.f 2024-06-02T05:08:49.327 INFO:journalctl@ceph.mds.f.smithi192.stdout:Jun 02 05:08:49 smithi192 systemd[1]: Stopping Ceph mds.f for 60ab6d30-209a-11ef-bc9b-c7b262605968... 2024-06-02T05:08:49.681 INFO:journalctl@ceph.mds.f.smithi192.stdout:Jun 02 05:08:49 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-f[83952]: 2024-06-02T05:08:49.325+0000 7febc3c87700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-02T05:08:49.682 INFO:journalctl@ceph.mds.f.smithi192.stdout:Jun 02 05:08:49 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-f[83952]: 2024-06-02T05:08:49.325+0000 7febc3c87700 -1 mds.f *** got signal Terminated *** 2024-06-02T05:08:51.432 INFO:journalctl@ceph.mds.f.smithi192.stdout:Jun 02 05:08:51 smithi192 bash[91987]: ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-f 2024-06-02T05:08:51.493 DEBUG:teuthology.orchestra.run.smithi192:> sudo pkill -f 'journalctl -f -n 0 -u ceph-60ab6d30-209a-11ef-bc9b-c7b262605968@mds.f.service' 2024-06-02T05:08:51.528 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-02T05:08:51.528 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-06-02T05:08:51.528 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-06-02T05:08:51.529 DEBUG:teuthology.orchestra.run.smithi192:> sudo systemctl stop ceph-60ab6d30-209a-11ef-bc9b-c7b262605968@mds.i 2024-06-02T05:08:51.801 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 05:08:51 smithi192 systemd[1]: Stopping Ceph mds.i for 60ab6d30-209a-11ef-bc9b-c7b262605968... 2024-06-02T05:08:52.181 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 05:08:51 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T05:08:51.799+0000 7f2b466f5700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-02T05:08:52.182 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 05:08:51 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i[84634]: 2024-06-02T05:08:51.799+0000 7f2b466f5700 -1 mds.i *** got signal Terminated *** 2024-06-02T05:08:55.912 INFO:journalctl@ceph.mds.i.smithi192.stdout:Jun 02 05:08:55 smithi192 bash[92128]: ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-i 2024-06-02T05:08:55.917 DEBUG:teuthology.orchestra.run.smithi192:> sudo pkill -f 'journalctl -f -n 0 -u ceph-60ab6d30-209a-11ef-bc9b-c7b262605968@mds.i.service' 2024-06-02T05:08:55.951 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-02T05:08:55.951 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-06-02T05:08:55.952 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-06-02T05:08:55.952 DEBUG:teuthology.orchestra.run.smithi192:> sudo systemctl stop ceph-60ab6d30-209a-11ef-bc9b-c7b262605968@mds.l 2024-06-02T05:08:56.182 INFO:journalctl@ceph.mds.l.smithi192.stdout:Jun 02 05:08:56 smithi192 systemd[1]: Stopping Ceph mds.l for 60ab6d30-209a-11ef-bc9b-c7b262605968... 2024-06-02T05:08:56.682 INFO:journalctl@ceph.mds.l.smithi192.stdout:Jun 02 05:08:56 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-l[83604]: 2024-06-02T05:08:56.220+0000 7f222d21c700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-02T05:08:56.682 INFO:journalctl@ceph.mds.l.smithi192.stdout:Jun 02 05:08:56 smithi192 ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-l[83604]: 2024-06-02T05:08:56.220+0000 7f222d21c700 -1 mds.l *** got signal Terminated *** 2024-06-02T05:08:58.347 INFO:journalctl@ceph.mds.l.smithi192.stdout:Jun 02 05:08:58 smithi192 bash[92266]: ceph-60ab6d30-209a-11ef-bc9b-c7b262605968-mds-l 2024-06-02T05:08:58.353 DEBUG:teuthology.orchestra.run.smithi192:> sudo pkill -f 'journalctl -f -n 0 -u ceph-60ab6d30-209a-11ef-bc9b-c7b262605968@mds.l.service' 2024-06-02T05:08:58.387 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-02T05:08:58.387 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-06-02T05:08:58.387 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 60ab6d30-209a-11ef-bc9b-c7b262605968 --force --keep-logs 2024-06-02T05:08:58.581 INFO:teuthology.orchestra.run.smithi076.stdout:Deleting cluster with fsid: 60ab6d30-209a-11ef-bc9b-c7b262605968 2024-06-02T05:09:00.046 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 60ab6d30-209a-11ef-bc9b-c7b262605968 --force --keep-logs 2024-06-02T05:09:00.237 INFO:teuthology.orchestra.run.smithi119.stdout:Deleting cluster with fsid: 60ab6d30-209a-11ef-bc9b-c7b262605968 2024-06-02T05:09:01.716 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 60ab6d30-209a-11ef-bc9b-c7b262605968 --force --keep-logs 2024-06-02T05:09:01.905 INFO:teuthology.orchestra.run.smithi192.stdout:Deleting cluster with fsid: 60ab6d30-209a-11ef-bc9b-c7b262605968 2024-06-02T05:09:03.364 DEBUG:teuthology.orchestra.run.smithi076:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-06-02T05:09:03.402 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-06-02T05:09:03.439 DEBUG:teuthology.orchestra.run.smithi192:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-06-02T05:09:03.469 INFO:tasks.cephadm:Archiving crash dumps... 2024-06-02T05:09:03.472 DEBUG:teuthology.misc:Transferring archived files from smithi076:/var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-05-29_22:24:02-fs-reef-distro-default-smithi/7733689/remote/smithi076/crash 2024-06-02T05:09:03.472 DEBUG:teuthology.orchestra.run.smithi076:> sudo tar c -f - -C /var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/crash -- . 2024-06-02T05:09:03.521 INFO:teuthology.orchestra.run.smithi076.stderr:tar: /var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/crash: Cannot open: No such file or directory 2024-06-02T05:09:03.521 INFO:teuthology.orchestra.run.smithi076.stderr:tar: Error is not recoverable: exiting now 2024-06-02T05:09:03.523 DEBUG:teuthology.misc:Transferring archived files from smithi119:/var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-05-29_22:24:02-fs-reef-distro-default-smithi/7733689/remote/smithi119/crash 2024-06-02T05:09:03.524 DEBUG:teuthology.orchestra.run.smithi119:> sudo tar c -f - -C /var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/crash -- . 2024-06-02T05:09:03.581 INFO:teuthology.orchestra.run.smithi119.stderr:tar: /var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/crash: Cannot open: No such file or directory 2024-06-02T05:09:03.581 INFO:teuthology.orchestra.run.smithi119.stderr:tar: Error is not recoverable: exiting now 2024-06-02T05:09:03.583 DEBUG:teuthology.misc:Transferring archived files from smithi192:/var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-05-29_22:24:02-fs-reef-distro-default-smithi/7733689/remote/smithi192/crash 2024-06-02T05:09:03.584 DEBUG:teuthology.orchestra.run.smithi192:> sudo tar c -f - -C /var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/crash -- . 2024-06-02T05:09:03.635 INFO:teuthology.orchestra.run.smithi192.stderr:tar: /var/lib/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/crash: Cannot open: No such file or directory 2024-06-02T05:09:03.636 INFO:teuthology.orchestra.run.smithi192.stderr:tar: Error is not recoverable: exiting now 2024-06-02T05:09:03.636 INFO:tasks.cephadm:Checking cluster log for badness... 2024-06-02T05:09:03.637 DEBUG:teuthology.orchestra.run.smithi076:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-06-02T05:09:03.674 INFO:teuthology.orchestra.run.smithi076.stderr:grep: /var/log/ceph/60ab6d30-209a-11ef-bc9b-c7b262605968/ceph.log: No such file or directory 2024-06-02T05:09:03.677 INFO:tasks.cephadm:Compressing logs... 2024-06-02T05:09:03.677 DEBUG:teuthology.orchestra.run.smithi076:> sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-06-02T05:09:03.720 DEBUG:teuthology.orchestra.run.smithi119:> sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-06-02T05:09:03.723 DEBUG:teuthology.orchestra.run.smithi192:> sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-06-02T05:09:03.760 INFO:teuthology.orchestra.run.smithi192.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-06-02T05:09:03.761 INFO:teuthology.orchestra.run.smithi119.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-06-02T05:09:03.764 INFO:teuthology.orchestra.run.smithi076.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-06-02T05:18:23.404 INFO:tasks.cephadm:Archiving logs... 2024-06-02T05:18:23.405 DEBUG:teuthology.misc:Transferring archived files from smithi076:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-05-29_22:24:02-fs-reef-distro-default-smithi/7733689/remote/smithi076/log 2024-06-02T05:18:23.406 DEBUG:teuthology.orchestra.run.smithi076:> sudo tar c -f - -C /var/log/ceph -- . 2024-06-02T05:19:38.140 DEBUG:teuthology.misc:Transferring archived files from smithi119:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-05-29_22:24:02-fs-reef-distro-default-smithi/7733689/remote/smithi119/log 2024-06-02T05:19:38.142 DEBUG:teuthology.orchestra.run.smithi119:> sudo tar c -f - -C /var/log/ceph -- . 2024-06-02T05:20:30.217 DEBUG:teuthology.misc:Transferring archived files from smithi192:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-05-29_22:24:02-fs-reef-distro-default-smithi/7733689/remote/smithi192/log 2024-06-02T05:20:30.219 DEBUG:teuthology.orchestra.run.smithi192:> sudo tar c -f - -C /var/log/ceph -- . 2024-06-02T05:21:20.001 INFO:tasks.cephadm:Removing cluster... 2024-06-02T05:21:20.002 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 60ab6d30-209a-11ef-bc9b-c7b262605968 --force 2024-06-02T05:21:20.318 INFO:teuthology.orchestra.run.smithi076.stdout:Deleting cluster with fsid: 60ab6d30-209a-11ef-bc9b-c7b262605968 2024-06-02T05:21:21.072 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 60ab6d30-209a-11ef-bc9b-c7b262605968 --force 2024-06-02T05:21:21.256 INFO:teuthology.orchestra.run.smithi119.stdout:Deleting cluster with fsid: 60ab6d30-209a-11ef-bc9b-c7b262605968 2024-06-02T05:21:21.892 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 60ab6d30-209a-11ef-bc9b-c7b262605968 --force 2024-06-02T05:21:22.182 INFO:teuthology.orchestra.run.smithi192.stdout:Deleting cluster with fsid: 60ab6d30-209a-11ef-bc9b-c7b262605968 2024-06-02T05:21:22.810 INFO:tasks.cephadm:Removing cephadm ... 2024-06-02T05:21:22.810 DEBUG:teuthology.orchestra.run.smithi076:> rm -rf /home/ubuntu/cephtest/cephadm 2024-06-02T05:21:22.832 DEBUG:teuthology.orchestra.run.smithi119:> rm -rf /home/ubuntu/cephtest/cephadm 2024-06-02T05:21:22.858 DEBUG:teuthology.orchestra.run.smithi192:> rm -rf /home/ubuntu/cephtest/cephadm 2024-06-02T05:21:22.887 INFO:tasks.cephadm:Teardown complete 2024-06-02T05:21:22.887 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-06-02T05:21:22.898 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e1979f064b0becde2020282c7e87cf3c5e98026c/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_e1979f064b0becde2020282c7e87cf3c5e98026c/teuthology/task/install/__init__.py", line 641, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_e1979f064b0becde2020282c7e87cf3c5e98026c/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_111a617aaeda17ec8908c7a46e47c4a09ebf905d/qa/tasks/fwd_scrub.py", line 164, in task stop_all_fwd_scrubbers(ctx.ceph[config['cluster']].thrashers) File "/home/teuthworker/src/git.ceph.com_ceph_111a617aaeda17ec8908c7a46e47c4a09ebf905d/qa/tasks/fwd_scrub.py", line 99, in stop_all_fwd_scrubbers raise RuntimeError(f"error during scrub thrashing: {thrasher.exception}") RuntimeError: error during scrub thrashing: rank damage found: {'backtrace'} 2024-06-02T05:21:22.899 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-06-02T05:21:22.899 DEBUG:teuthology.orchestra.run.smithi076:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-06-02T05:21:22.902 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-06-02T05:21:22.904 DEBUG:teuthology.orchestra.run.smithi192:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-06-02T05:21:23.078 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-06-02T05:21:23.088 INFO:teuthology.task.clock:Checking final clock skew... 2024-06-02T05:21:23.089 DEBUG:teuthology.orchestra.run.smithi076:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-06-02T05:21:23.091 DEBUG:teuthology.orchestra.run.smithi119:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-06-02T05:21:23.094 DEBUG:teuthology.orchestra.run.smithi192:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-06-02T05:21:23.108 INFO:teuthology.orchestra.run.smithi076.stderr:bash: ntpq: command not found 2024-06-02T05:21:23.109 INFO:teuthology.orchestra.run.smithi119.stderr:bash: ntpq: command not found 2024-06-02T05:21:23.110 INFO:teuthology.orchestra.run.smithi192.stderr:bash: ntpq: command not found 2024-06-02T05:21:23.133 INFO:teuthology.orchestra.run.smithi076.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-06-02T05:21:23.133 INFO:teuthology.orchestra.run.smithi076.stdout:=============================================================================== 2024-06-02T05:21:23.133 INFO:teuthology.orchestra.run.smithi076.stdout:^* hv01.front.sepia.ceph.com 3 6 377 30 +336us[ +333us] +/- 48ms 2024-06-02T05:21:23.134 INFO:teuthology.orchestra.run.smithi076.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 33 -937us[ -939us] +/- 79ms 2024-06-02T05:21:23.134 INFO:teuthology.orchestra.run.smithi076.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 25 +274us[ +274us] +/- 68ms 2024-06-02T05:21:23.134 INFO:teuthology.orchestra.run.smithi076.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-06-02T05:21:23.136 INFO:teuthology.orchestra.run.smithi192.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-06-02T05:21:23.136 INFO:teuthology.orchestra.run.smithi192.stdout:=============================================================================== 2024-06-02T05:21:23.136 INFO:teuthology.orchestra.run.smithi192.stdout:^* hv01.front.sepia.ceph.com 3 6 377 31 +382us[ +437us] +/- 48ms 2024-06-02T05:21:23.136 INFO:teuthology.orchestra.run.smithi192.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 30 -901us[ -901us] +/- 79ms 2024-06-02T05:21:23.136 INFO:teuthology.orchestra.run.smithi192.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 29 +331us[ +331us] +/- 68ms 2024-06-02T05:21:23.136 INFO:teuthology.orchestra.run.smithi192.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-06-02T05:21:23.153 INFO:teuthology.orchestra.run.smithi119.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-06-02T05:21:23.153 INFO:teuthology.orchestra.run.smithi119.stdout:=============================================================================== 2024-06-02T05:21:23.153 INFO:teuthology.orchestra.run.smithi119.stdout:^* hv01.front.sepia.ceph.com 3 6 377 28 +374us[ +435us] +/- 48ms 2024-06-02T05:21:23.153 INFO:teuthology.orchestra.run.smithi119.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 29 -917us[ -857us] +/- 79ms 2024-06-02T05:21:23.153 INFO:teuthology.orchestra.run.smithi119.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 26 +307us[ +307us] +/- 68ms 2024-06-02T05:21:23.153 INFO:teuthology.orchestra.run.smithi119.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-06-02T05:21:23.154 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-06-02T05:21:23.165 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-06-02T05:21:23.165 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-06-02T05:21:23.175 DEBUG:teuthology.orchestra.run.smithi076:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-06-02T05:21:23.281 DEBUG:teuthology.orchestra.run.smithi119:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-06-02T05:21:23.378 DEBUG:teuthology.orchestra.run.smithi192:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-06-02T05:21:23.475 DEBUG:teuthology.orchestra.run.smithi076:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-06-02T05:21:23.509 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-02T05:21:23.510 DEBUG:teuthology.orchestra.run.smithi119:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-06-02T05:21:23.540 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-02T05:21:23.541 DEBUG:teuthology.orchestra.run.smithi192:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-06-02T05:21:23.570 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-02T05:21:23.571 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-06-02T05:21:23.582 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-06-02T05:21:23.592 INFO:teuthology.task.internal:Duration was 3251.585429 seconds 2024-06-02T05:21:23.592 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-06-02T05:21:23.602 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-06-02T05:21:23.602 DEBUG:teuthology.orchestra.run.smithi076:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-06-02T05:21:23.605 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-06-02T05:21:23.607 DEBUG:teuthology.orchestra.run.smithi192:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-06-02T05:21:23.665 INFO:teuthology.orchestra.run.smithi192.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-06-02T05:21:23.671 INFO:teuthology.orchestra.run.smithi076.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-06-02T05:21:23.672 INFO:teuthology.orchestra.run.smithi119.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-06-02T05:21:24.158 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-06-02T05:21:24.158 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi076.front.sepia.ceph.com 2024-06-02T05:21:24.159 DEBUG:teuthology.orchestra.run.smithi076:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-06-02T05:21:24.184 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi119.front.sepia.ceph.com 2024-06-02T05:21:24.184 DEBUG:teuthology.orchestra.run.smithi119:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-06-02T05:21:24.211 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi192.front.sepia.ceph.com 2024-06-02T05:21:24.211 DEBUG:teuthology.orchestra.run.smithi192:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-06-02T05:21:24.235 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-06-02T05:21:24.235 DEBUG:teuthology.orchestra.run.smithi076:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-06-02T05:21:24.238 DEBUG:teuthology.orchestra.run.smithi119:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-06-02T05:21:24.254 DEBUG:teuthology.orchestra.run.smithi192:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-06-02T05:21:24.330 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-06-02T05:21:24.331 DEBUG:teuthology.orchestra.run.smithi076:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-06-02T05:21:24.334 DEBUG:teuthology.orchestra.run.smithi119:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-06-02T05:21:24.336 DEBUG:teuthology.orchestra.run.smithi192:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-06-02T05:21:24.473 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-06-02T05:21:24.485 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-06-02T05:21:24.485 DEBUG:teuthology.orchestra.run.smithi076:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-06-02T05:21:24.579 DEBUG:teuthology.orchestra.run.smithi119:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-06-02T05:21:24.607 DEBUG:teuthology.orchestra.run.smithi192:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-06-02T05:21:24.635 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-06-02T05:21:24.647 DEBUG:teuthology.orchestra.run.smithi076:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-06-02T05:21:24.649 DEBUG:teuthology.orchestra.run.smithi119:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-06-02T05:21:24.652 DEBUG:teuthology.orchestra.run.smithi192:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-06-02T05:21:24.687 INFO:teuthology.orchestra.run.smithi076.stdout:kernel.core_pattern = core 2024-06-02T05:21:24.693 INFO:teuthology.orchestra.run.smithi119.stdout:kernel.core_pattern = core 2024-06-02T05:21:24.710 INFO:teuthology.orchestra.run.smithi192.stdout:kernel.core_pattern = core 2024-06-02T05:21:24.725 DEBUG:teuthology.orchestra.run.smithi076:> test -e /home/ubuntu/cephtest/archive/coredump 2024-06-02T05:21:24.760 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-02T05:21:24.761 DEBUG:teuthology.orchestra.run.smithi119:> test -e /home/ubuntu/cephtest/archive/coredump 2024-06-02T05:21:24.782 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-02T05:21:24.782 DEBUG:teuthology.orchestra.run.smithi192:> test -e /home/ubuntu/cephtest/archive/coredump 2024-06-02T05:21:24.798 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-02T05:21:24.799 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-06-02T05:21:24.810 INFO:teuthology.task.internal:Transferring archived files... 2024-06-02T05:21:24.812 DEBUG:teuthology.misc:Transferring archived files from smithi076:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-05-29_22:24:02-fs-reef-distro-default-smithi/7733689/remote/smithi076 2024-06-02T05:21:24.812 DEBUG:teuthology.orchestra.run.smithi076:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-06-02T05:21:24.861 DEBUG:teuthology.misc:Transferring archived files from smithi119:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-05-29_22:24:02-fs-reef-distro-default-smithi/7733689/remote/smithi119 2024-06-02T05:21:24.862 DEBUG:teuthology.orchestra.run.smithi119:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-06-02T05:21:24.904 DEBUG:teuthology.misc:Transferring archived files from smithi192:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-05-29_22:24:02-fs-reef-distro-default-smithi/7733689/remote/smithi192 2024-06-02T05:21:24.904 DEBUG:teuthology.orchestra.run.smithi192:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-06-02T05:21:24.946 INFO:teuthology.task.internal:Removing archive directory... 2024-06-02T05:21:24.946 DEBUG:teuthology.orchestra.run.smithi076:> rm -rf -- /home/ubuntu/cephtest/archive 2024-06-02T05:21:24.949 DEBUG:teuthology.orchestra.run.smithi119:> rm -rf -- /home/ubuntu/cephtest/archive 2024-06-02T05:21:24.951 DEBUG:teuthology.orchestra.run.smithi192:> rm -rf -- /home/ubuntu/cephtest/archive 2024-06-02T05:21:24.995 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-06-02T05:21:25.017 INFO:teuthology.task.internal:Not uploading archives. 2024-06-02T05:21:25.017 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-06-02T05:21:25.038 INFO:teuthology.task.internal:Tidying up after the test... 2024-06-02T05:21:25.039 DEBUG:teuthology.orchestra.run.smithi076:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-06-02T05:21:25.042 DEBUG:teuthology.orchestra.run.smithi119:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-06-02T05:21:25.045 DEBUG:teuthology.orchestra.run.smithi192:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-06-02T05:21:25.056 INFO:teuthology.orchestra.run.smithi076.stdout: 262179 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 2 05:21 /home/ubuntu/cephtest 2024-06-02T05:21:25.059 INFO:teuthology.orchestra.run.smithi119.stdout: 262175 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 2 05:21 /home/ubuntu/cephtest 2024-06-02T05:21:25.061 INFO:teuthology.orchestra.run.smithi192.stdout: 262175 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 2 05:21 /home/ubuntu/cephtest 2024-06-02T05:21:25.070 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-06-02T05:21:25.082 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-06-02T05:21:25.095 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: RuntimeError: error during scrub thrashing: rank damage found: {'backtrace'} 2024-06-02T05:21:25.098 INFO:teuthology.run:Summary data: description: fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-workunit/postgres}} duration: 3251.585429430008 failure_reason: 'error during scrub thrashing: rank damage found: {''backtrace''}' flavor: default owner: scheduled_teuthology@teuthology status: fail success: false 2024-06-02T05:21:25.099 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-06-02T05:21:25.209 INFO:teuthology.run:FAIL